2020-02-11T15:40:55.539 INFO:root:teuthology version: 1.0.0-ee19bca 2020-02-11T15:40:55.540 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.N9D00U.tmp -- --verbose --lock --description fs/thrash/{begin.yaml ceph-thrash/mon.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_snaptests.yaml} --name pdonnell-2020-02-11_15:01:19-fs-wip-pdonnell-testing-20200211.032856-distro-basic-smithi --block --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2020-02-11_15:01:19-fs-wip-pdonnell-testing-20200211.032856-distro-basic-smithi/4754538 2020-02-11T15:40:55.610 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-11T15:40:55.702 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-02-11_15:01:19-fs-wip-pdonnell-testing-20200211.032856-distro-basic-smithi/4754538 branch: wip-pdonnell-testing-20200211.032856 description: fs/thrash/{begin.yaml ceph-thrash/mon.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_snaptests.yaml} email: pdonnell@redhat.com first_in_suite: false job_id: '4754538' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-02-11_15:01:19-fs-wip-pdonnell-testing-20200211.032856-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-pdonnell-testing-20200211.032856 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(MON_DOWN\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 71281e48a442b0f38f812cad32658ed72c6d8ff5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 71281e48a442b0f38f812cad32658ed72c6d8ff5 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20200211.032856 sha1: 71281e48a442b0f38f812cad32658ed72c6d8ff5 owner: scheduled_pdonnell@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: 71281e48a442b0f38f812cad32658ed72c6d8ff5 suite: fs suite_branch: wip-pdonnell-testing-20200211.032856 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.032856/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 71281e48a442b0f38f812cad32658ed72c6d8ff5 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - ceph: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - ceph-fuse: null - workunit: clients: all: - fs/snaps teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2512 2020-02-11T15:40:55.702 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.032856/qa; will attempt to use it 2020-02-11T15:40:55.703 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.032856/qa/tasks 2020-02-11T15:40:55.703 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-02-11T15:40:55.704 INFO:teuthology.task.internal:Checking packages... 2020-02-11T15:40:55.719 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '71281e48a442b0f38f812cad32658ed72c6d8ff5' 2020-02-11T15:40:55.719 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-02-11T15:40:55.719 INFO:teuthology.packaging:ref: None 2020-02-11T15:40:55.719 INFO:teuthology.packaging:tag: None 2020-02-11T15:40:55.719 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20200211.032856 2020-02-11T15:40:55.719 INFO:teuthology.packaging:sha1: 71281e48a442b0f38f812cad32658ed72c6d8ff5 2020-02-11T15:40:55.720 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20200211.032856 2020-02-11T15:40:55.891 INFO:teuthology.task.internal:Found packages for ceph version 15.1.0-486.g71281e4 2020-02-11T15:40:55.891 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-02-11T15:40:55.910 INFO:teuthology.task.internal:no buildpackages task found 2020-02-11T15:40:55.910 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-02-11T15:40:55.927 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-02-11T15:40:55.927 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-11T15:40:56.038 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:41:06.054 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:41:16.071 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:41:26.089 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:41:36.107 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:41:46.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:41:56.142 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:42:06.164 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:42:16.183 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:42:26.209 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:42:36.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:42:46.414 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-11T15:42:56.430 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-11T15:43:06.446 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-11T15:43:16.467 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-11T15:43:26.485 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:43:36.502 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:43:46.521 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:43:56.538 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:44:06.557 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:44:16.579 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:44:26.596 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:44:36.609 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:44:46.626 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:44:56.648 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:45:06.666 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:45:16.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:45:26.700 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:45:36.719 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:45:46.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:45:56.757 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-11T15:46:06.774 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:46:16.792 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:46:26.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:46:36.841 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:46:46.862 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:46:56.878 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:47:06.899 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:47:16.921 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:47:26.942 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:47:36.960 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:47:46.981 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:47:57.003 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-11T15:48:07.028 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_pdonnell@teuthology', 'description': '/home/teuthworker/archive/pdonnell-2020-02-11_15:01:19-fs-wip-pdonnell-testing-20200211.032856-distro-basic-smithi/4754538', 'machine_type': 'smithi'} 2020-02-11T15:48:07.053 DEBUG:teuthology.lock.ops:locked ubuntu@smithi052.front.sepia.ceph.com, ubuntu@smithi088.front.sepia.ceph.com 2020-02-11T15:48:07.132 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-11T15:48:07.360 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 8.1 2020-02-11T15:48:07.422 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 8.1 2020-02-11T15:48:07.930 INFO:teuthology.orchestra.console:Power off smithi052 2020-02-11T15:48:07.930 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-11T15:48:07.946 INFO:teuthology.orchestra.console:Power off smithi088 2020-02-11T15:48:07.947 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-11T15:48:07.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:07.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:11.982 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:11.994 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:16.094 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:16.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:16.304 INFO:teuthology.orchestra.console:Power off for smithi052 completed 2020-02-11T15:48:16.405 INFO:teuthology.orchestra.console:Power on smithi052 2020-02-11T15:48:16.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-11T15:48:16.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:20.215 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:20.425 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2020-02-11T15:48:20.449 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:20.527 INFO:teuthology.orchestra.console:Power on smithi088 2020-02-11T15:48:20.527 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-11T15:48:20.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:24.559 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:24.571 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-11T15:48:24.791 INFO:teuthology.orchestra.console:Power on for smithi088 completed 2020-02-11T15:48:24.830 INFO:teuthology.orchestra.console:Power on for smithi052 completed 2020-02-11T15:48:24.892 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2020-02-11T15:48:24.932 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2020-02-11T15:50:41.294 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:50:50.362 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:50:59.421 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:51:08.510 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:51:11.557 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi088.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:51:11.656 ERROR:teuthology.orchestra.connection:Error connecting to smithi088.front.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 446, in connect passphrase, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 764, in _auth raise saved_exception AuthenticationException: Authentication failed. 2020-02-11T15:51:17.591 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:51:26.647 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:52:18.661 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi088.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:52:26.967 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi088.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:52:32.650 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:52:32.934 INFO:teuthology.orchestra.run.smithi052:> hostname 2020-02-11T15:52:33.247 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2020-02-11T15:52:33.247 INFO:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts 2020-02-11T15:52:33.262 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2020-02-11T15:52:33.263 INFO:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2020-02-11T15:52:33.374 INFO:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts 2020-02-11T15:52:33.406 INFO:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts 2020-02-11T15:52:33.477 INFO:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname 2020-02-11T15:52:33.550 INFO:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2020-02-11T15:52:33.620 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2020-02-11T15:52:33.622 DEBUG:teuthology.parallel:result is None 2020-02-11T15:53:32.970 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi088.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:53:33.236 INFO:teuthology.orchestra.run.smithi088:> hostname 2020-02-11T15:53:33.545 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2020-02-11T15:53:33.546 INFO:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2020-02-11T15:53:33.564 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2020-02-11T15:53:33.565 INFO:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2020-02-11T15:53:33.710 INFO:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2020-02-11T15:53:33.739 INFO:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2020-02-11T15:53:33.807 INFO:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2020-02-11T15:53:33.874 INFO:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2020-02-11T15:53:33.940 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2020-02-11T15:53:33.942 DEBUG:teuthology.parallel:result is None 2020-02-11T15:53:34.067 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2020-02-11T15:53:34.068 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-11T15:53:34.091 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2020-02-11T15:53:34.092 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-11T15:53:34.117 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2020-02-11T15:53:34.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-11T15:53:34.120 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi088.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:53:34.189 INFO:teuthology.orchestra.run.smithi088:> true 2020-02-11T15:53:34.348 INFO:teuthology.orchestra.run.smithi088:> uname -m 2020-02-11T15:53:34.401 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2020-02-11T15:53:34.402 INFO:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2020-02-11T15:53:34.455 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Linux" 2020-02-11T15:53:34.455 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8 (Core)" 2020-02-11T15:53:34.456 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2020-02-11T15:53:34.456 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2020-02-11T15:53:34.456 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2020-02-11T15:53:34.456 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2020-02-11T15:53:34.456 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-11T15:53:34.456 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2020-02-11T15:53:34.456 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-11T15:53:34.457 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.centos.org/" 2020-02-11T15:53:34.457 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-11T15:53:34.457 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T15:53:34.457 INFO:teuthology.orchestra.run.smithi088.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-11T15:53:34.457 INFO:teuthology.orchestra.run.smithi088.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-11T15:53:34.457 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-11T15:53:34.458 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-11T15:53:34.458 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T15:53:34.459 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2020-02-11T15:53:34.473 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2020-02-11T15:53:34.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-11T15:53:34.474 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:53:34.547 INFO:teuthology.orchestra.run.smithi052:> true 2020-02-11T15:53:34.736 INFO:teuthology.orchestra.run.smithi052:> uname -m 2020-02-11T15:53:34.791 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2020-02-11T15:53:34.792 INFO:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2020-02-11T15:53:34.848 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Linux" 2020-02-11T15:53:34.848 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8 (Core)" 2020-02-11T15:53:34.848 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2020-02-11T15:53:34.849 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2020-02-11T15:53:34.849 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8" 2020-02-11T15:53:34.850 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2020-02-11T15:53:34.850 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-11T15:53:34.850 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2020-02-11T15:53:34.850 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-11T15:53:34.851 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.centos.org/" 2020-02-11T15:53:34.851 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-11T15:53:34.851 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T15:53:34.851 INFO:teuthology.orchestra.run.smithi052.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-11T15:53:34.851 INFO:teuthology.orchestra.run.smithi052.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-11T15:53:34.851 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-11T15:53:34.851 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-11T15:53:34.852 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T15:53:34.852 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2020-02-11T15:53:34.867 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-02-11T15:53:34.900 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi052.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq0lwVIINIRDTGlxFoclXyGUVLDlH+umgv9VD0YSCIZzaESd6VP8mvyiZqZjlPJ/p+JlCGJt0hhOUncMc+Eb8e4ytZKPuYBg3i0jcDuNVBsrt6hejP9aDXqETTambaJ/4te1p3IBXZezC9gmdKMC+GFFp+q0eBONbYE1GkXYb6jyQ9oMfbDjEitQtjARPnqg8yE8OOsQXnWLfq4+VrpuJDb/xCnvMrIO4YMsNgX6jq1l7Yo4d3ChBRpgeJJRYckRLSoOkBVUT3UtmrrBkKCn8ZRGx8Q3aME/6+c4UVh9by3MGycKEIOJsXUMGXPhyvi6dRZJLbxaeM/CN2/kOMpKM0nnuQi4xTTpV030LjVNK7NSl1sC+2z4YBfqHUNjC8Ll4DljvXX64bhR0+aHeFHCGC9cS5EkZqPqF+0yDs0JjW3t7nDhOBHIqSH8HGNePekoIvQAnUSa/FTcp7yt/OW4RKXpRxKkzAkTw65bWYNQh1w/Q+tagqMzd2WkhjMd6/aM0= smithi088.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZYuLM33qpEv47TfO1v9fcw54HPcBlY8gQsHgMhj9SrWsUzyBZgunLNFWStWtn23rrmJuTSJxw3DNZNtBwhkgRyWu/jXC+rVLOPYA+vyfC/7c1shRi1gz4rko5LjHNUWu1YrXyTMq0ZitHW4p3jsjEO+nFUlPd8Xzi5wPEHAbSivz43UXJ5YS5bbo42Fl1NrJAx5a9Scu42bOZi2CHHa1u/zBxX2YAfPr9dni5m/W68EqCPJG3BeaA88q0zxwmK0N0lEN78ykdT8h+nTL/4SmVqABdF83tEdHRQmRwv3bbs10evkqnSVjVdp3nyfvwCOm3UbpY7eiLvpzk/Ri0Ew171YjXTEY2f9ZxiMwYksMUxdlJIN6cSFlw5q16Zw6SdoMMCaEB6XToKGP4YqerhdaYJn1ukIX3B4dlrTGMzkL1p0Cuan/OMswVNLRkL3qKNq7YoC9qdCRQP7OxbOf5KNChNqaWjcx7g2hDKoc8KUqC7F2qdWkh4geTNRnro0kDdgM= 2020-02-11T15:53:34.900 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-11T15:53:34.957 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-02-11T15:53:34.972 INFO:teuthology.task.internal:Saving configuration 2020-02-11T15:53:34.991 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-02-11T15:53:35.028 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-02-11T15:53:35.045 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-11 15:48:07.038864', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi088.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSUqX1TEgeIrv7MOERaW4AWVeKhws9VLifmw8a3mAexKSP+WbXmWAEbhx62fm6CJJV/NJC/tHI1W+orKWwTz9E=', u'description': u'/home/teuthworker/archive/pdonnell-2020-02-11_15:01:19-fs-wip-pdonnell-testing-20200211.032856-distro-basic-smithi/4754538'} 2020-02-11T15:53:35.062 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-11 15:48:07.038841', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi052.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHCd7E72BBu7BcBTkZd3BmW7SgziIR38ZVDnqpzALmQ0fAY8gVGdTpg/HpdaTKbaH6vskM0NhDFEta04ujUwM6I=', u'description': u'/home/teuthworker/archive/pdonnell-2020-02-11_15:01:19-fs-wip-pdonnell-testing-20200211.032856-distro-basic-smithi/4754538'} 2020-02-11T15:53:35.062 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-02-11T15:53:35.150 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-02-11T15:53:35.150 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-02-11T15:53:35.150 INFO:teuthology.run_tasks:Running task console_log... 2020-02-11T15:53:35.239 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-11T15:53:35.240 INFO:teuthology.run_tasks:Running task internal.connect... 2020-02-11T15:53:35.306 INFO:teuthology.task.internal:Opening connections... 2020-02-11T15:53:35.306 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2020-02-11T15:53:35.307 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi088.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:53:35.381 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2020-02-11T15:53:35.381 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:53:35.458 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-02-11T15:53:35.475 INFO:teuthology.orchestra.run.smithi088:> uname -m 2020-02-11T15:53:35.507 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2020-02-11T15:53:35.508 INFO:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2020-02-11T15:53:35.562 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Linux" 2020-02-11T15:53:35.562 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8 (Core)" 2020-02-11T15:53:35.562 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2020-02-11T15:53:35.562 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2020-02-11T15:53:35.562 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2020-02-11T15:53:35.563 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2020-02-11T15:53:35.563 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-11T15:53:35.563 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2020-02-11T15:53:35.563 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-11T15:53:35.563 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.centos.org/" 2020-02-11T15:53:35.563 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-11T15:53:35.563 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T15:53:35.564 INFO:teuthology.orchestra.run.smithi088.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-11T15:53:35.564 INFO:teuthology.orchestra.run.smithi088.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-11T15:53:35.564 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-11T15:53:35.564 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-11T15:53:35.564 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T15:53:35.564 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2020-02-11T15:53:35.622 INFO:teuthology.orchestra.run.smithi052:> uname -m 2020-02-11T15:53:35.638 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2020-02-11T15:53:35.639 INFO:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2020-02-11T15:53:35.694 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Linux" 2020-02-11T15:53:35.694 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8 (Core)" 2020-02-11T15:53:35.695 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2020-02-11T15:53:35.695 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2020-02-11T15:53:35.695 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8" 2020-02-11T15:53:35.695 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2020-02-11T15:53:35.695 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-11T15:53:35.696 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2020-02-11T15:53:35.696 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-11T15:53:35.696 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.centos.org/" 2020-02-11T15:53:35.696 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-11T15:53:35.697 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T15:53:35.697 INFO:teuthology.orchestra.run.smithi052.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-11T15:53:35.697 INFO:teuthology.orchestra.run.smithi052.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-11T15:53:35.697 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-11T15:53:35.697 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-11T15:53:35.698 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T15:53:35.698 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2020-02-11T15:53:35.719 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-02-11T15:53:35.749 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-02-11T15:53:35.840 INFO:teuthology.task.internal:Checking for old test directory... 2020-02-11T15:53:35.841 INFO:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2020-02-11T15:53:35.845 INFO:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2020-02-11T15:53:35.859 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-02-11T15:53:35.943 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-02-11T15:53:35.943 INFO:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2020-02-11T15:53:35.946 INFO:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2020-02-11T15:53:36.054 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-02-11T15:53:36.101 INFO:teuthology.run_tasks:Running task kernel... 2020-02-11T15:53:36.124 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}} 2020-02-11T15:53:36.124 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-02-11T15:53:36.124 INFO:teuthology.orchestra.run.smithi088:> uname -r 2020-02-11T15:53:36.140 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-147.3.1.el8_1.x86_64 2020-02-11T15:53:36.140 INFO:teuthology.task.kernel:Running kernel on smithi088: 4.18.0-147.3.1.el8_1.x86_64 2020-02-11T15:53:36.141 INFO:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2020-02-11T15:53:38.540 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - AppStream 37 kB/s | 4.3 kB 00:00 2020-02-11T15:53:38.790 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - AppStream 26 MB/s | 6.4 MB 00:00 2020-02-11T15:54:04.124 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - Base 161 B/s | 3.8 kB 00:24 2020-02-11T15:54:24.564 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - Base 249 kB/s | 5.0 MB 00:20 2020-02-11T15:54:25.528 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - Extras 7.6 kB/s | 1.5 kB 00:00 2020-02-11T15:54:25.821 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for ceph-el8 owned by ktdreyer 13 kB/s | 3.3 kB 00:00 2020-02-11T15:54:26.411 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for ceph-el8 owned by ktdreyer 64 kB/s | 38 kB 00:00 2020-02-11T15:54:26.580 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 8 - x86_64 208 kB/s | 19 kB 00:00 2020-02-11T15:54:26.866 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 8 - x86_64 20 MB/s | 5.6 MB 00:00 2020-02-11T15:54:28.096 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 568 kB/s | 2.9 kB 00:00 2020-02-11T15:54:28.871 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-02-11T15:54:28.871 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-4.18.0-147.3.1.el8_1.x86_64 is already installed. 2020-02-11T15:54:29.013 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2020-02-11T15:54:29.013 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2020-02-11T15:54:29.013 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2020-02-11T15:54:29.014 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2020-02-11T15:54:29.014 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2020-02-11T15:54:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-11T15:54:29.014 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2020-02-11T15:54:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core x86_64 4.18.0-147.5.1.el8_1 BaseOS 25 M 2020-02-11T15:54:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules x86_64 4.18.0-147.5.1.el8_1 BaseOS 22 M 2020-02-11T15:54:29.014 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T15:54:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2020-02-11T15:54:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2020-02-11T15:54:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:Install 3 Packages 2020-02-11T15:54:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T15:54:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 49 M 2020-02-11T15:54:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 78 M 2020-02-11T15:54:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2020-02-11T15:54:48.124 INFO:teuthology.orchestra.run.smithi088.stdout:(1/3): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 83 kB/s | 1.5 MB 00:18 2020-02-11T15:54:49.821 INFO:teuthology.orchestra.run.smithi088.stdout:(2/3): kernel-modules-4.18.0-147.5.1.el8_1.x86_ 1.1 MB/s | 22 MB 00:20 2020-02-11T15:54:50.046 INFO:teuthology.orchestra.run.smithi088.stdout:(3/3): kernel-core-4.18.0-147.5.1.el8_1.x86_64. 1.2 MB/s | 25 MB 00:20 2020-02-11T15:54:50.047 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2020-02-11T15:54:50.047 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.3 MB/s | 49 MB 00:21 2020-02-11T15:54:50.089 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2020-02-11T15:54:50.328 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2020-02-11T15:54:50.329 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2020-02-11T15:54:51.139 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2020-02-11T15:54:51.139 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2020-02-11T15:54:53.125 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2020-02-11T15:54:53.529 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-core-4.18.0-147.5.1.el8_1.x86_64 1/3 2020-02-11T15:54:56.147 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-4.18.0-147.5.1.el8_1.x86_64 1/3 2020-02-11T15:54:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-4.18.0-147.5.1.el8_1.x86_64 2/3 2020-02-11T15:54:59.200 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-4.18.0-147.5.1.el8_1.x86_64 2/3 2020-02-11T15:54:59.362 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-4.18.0-147.5.1.el8_1.x86_64 3/3 2020-02-11T15:55:21.186 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-4.18.0-147.5.1.el8_1.x86_64 3/3 2020-02-11T15:55:21.416 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 3/3 2020-02-11T15:55:21.416 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/3 2020-02-11T15:55:21.417 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-core-4.18.0-147.5.1.el8_1.x86_64 2/3 2020-02-11T15:55:21.654 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-4.18.0-147.5.1.el8_1.x86_64 3/3 2020-02-11T15:55:21.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T15:55:21.655 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2020-02-11T15:55:21.655 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:55:21.655 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core-4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:55:21.655 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:55:21.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T15:55:21.655 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2020-02-11T15:55:21.799 INFO:teuthology.orchestra.run.smithi088:> rpm -q kernel --last | head -n 1 2020-02-11T15:55:21.874 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-4.18.0-147.5.1.el8_1.x86_64 Tue 11 Feb 2020 03:54:59 PM UTC 2020-02-11T15:55:21.875 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:55:21.875 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.3.1.el8_1.x86_64 Expected: 4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:55:21.876 INFO:teuthology.orchestra.run.smithi052:> uname -r 2020-02-11T15:55:21.894 INFO:teuthology.orchestra.run.smithi052.stdout:4.18.0-147.3.1.el8_1.x86_64 2020-02-11T15:55:21.894 INFO:teuthology.task.kernel:Running kernel on smithi052: 4.18.0-147.3.1.el8_1.x86_64 2020-02-11T15:55:21.894 INFO:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2020-02-11T15:55:24.560 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-8 - AppStream 16 kB/s | 4.3 kB 00:00 2020-02-11T15:55:25.104 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-8 - AppStream 12 MB/s | 6.4 MB 00:00 2020-02-11T15:56:05.787 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-8 - Base 99 B/s | 3.8 kB 00:39 2020-02-11T15:56:12.330 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-8 - Base 778 kB/s | 5.0 MB 00:06 2020-02-11T15:56:14.465 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-8 - Extras 1.2 kB/s | 1.5 kB 00:01 2020-02-11T15:56:14.753 INFO:teuthology.orchestra.run.smithi052.stdout:Copr repo for ceph-el8 owned by ktdreyer 13 kB/s | 3.3 kB 00:00 2020-02-11T15:56:15.301 INFO:teuthology.orchestra.run.smithi052.stdout:Copr repo for ceph-el8 owned by ktdreyer 69 kB/s | 38 kB 00:00 2020-02-11T15:56:15.695 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 8 - x86_64 62 kB/s | 19 kB 00:00 2020-02-11T15:56:16.565 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 8 - x86_64 6.5 MB/s | 5.6 MB 00:00 2020-02-11T15:56:17.892 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 1.1 MB/s | 2.9 kB 00:00 2020-02-11T15:56:18.711 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-02-11T15:56:18.712 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-4.18.0-147.3.1.el8_1.x86_64 is already installed. 2020-02-11T15:56:18.855 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2020-02-11T15:56:18.856 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2020-02-11T15:56:18.856 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2020-02-11T15:56:18.857 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2020-02-11T15:56:18.857 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2020-02-11T15:56:18.857 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-11T15:56:18.857 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2020-02-11T15:56:18.857 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core x86_64 4.18.0-147.5.1.el8_1 BaseOS 25 M 2020-02-11T15:56:18.858 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules x86_64 4.18.0-147.5.1.el8_1 BaseOS 22 M 2020-02-11T15:56:18.858 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T15:56:18.858 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2020-02-11T15:56:18.858 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2020-02-11T15:56:18.858 INFO:teuthology.orchestra.run.smithi052.stdout:Install 3 Packages 2020-02-11T15:56:18.859 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T15:56:18.867 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 49 M 2020-02-11T15:56:18.867 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 78 M 2020-02-11T15:56:18.867 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2020-02-11T15:56:25.317 INFO:teuthology.orchestra.run.smithi052.stdout:(1/3): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 251 kB/s | 1.5 MB 00:06 2020-02-11T15:56:26.626 INFO:teuthology.orchestra.run.smithi052.stdout:(2/3): kernel-modules-4.18.0-147.5.1.el8_1.x86_ 2.9 MB/s | 22 MB 00:07 2020-02-11T15:56:27.480 INFO:teuthology.orchestra.run.smithi052.stdout:(3/3): kernel-core-4.18.0-147.5.1.el8_1.x86_64. 3.0 MB/s | 25 MB 00:08 2020-02-11T15:56:27.481 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2020-02-11T15:56:27.481 INFO:teuthology.orchestra.run.smithi052.stdout:Total 5.6 MB/s | 49 MB 00:08 2020-02-11T15:56:27.566 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2020-02-11T15:56:27.804 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2020-02-11T15:56:27.805 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2020-02-11T15:56:28.616 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2020-02-11T15:56:28.617 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2020-02-11T15:56:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2020-02-11T15:56:31.246 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-core-4.18.0-147.5.1.el8_1.x86_64 1/3 2020-02-11T15:56:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-4.18.0-147.5.1.el8_1.x86_64 1/3 2020-02-11T15:56:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-4.18.0-147.5.1.el8_1.x86_64 2/3 2020-02-11T15:56:37.299 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-4.18.0-147.5.1.el8_1.x86_64 2/3 2020-02-11T15:56:37.439 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-4.18.0-147.5.1.el8_1.x86_64 3/3 2020-02-11T15:57:00.845 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-4.18.0-147.5.1.el8_1.x86_64 3/3 2020-02-11T15:57:01.077 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 3/3 2020-02-11T15:57:01.077 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/3 2020-02-11T15:57:01.077 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-core-4.18.0-147.5.1.el8_1.x86_64 2/3 2020-02-11T15:57:01.695 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-4.18.0-147.5.1.el8_1.x86_64 3/3 2020-02-11T15:57:01.695 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T15:57:01.695 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2020-02-11T15:57:01.695 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:01.695 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core-4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:01.695 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:01.696 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T15:57:01.696 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2020-02-11T15:57:01.800 INFO:teuthology.orchestra.run.smithi052:> rpm -q kernel --last | head -n 1 2020-02-11T15:57:01.873 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-4.18.0-147.5.1.el8_1.x86_64 Tue 11 Feb 2020 03:56:37 PM UTC 2020-02-11T15:57:01.874 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:01.874 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.3.1.el8_1.x86_64 Expected: 4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:01.875 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-02-11T15:57:01.875 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-02-11T15:57:01.875 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-02-11T15:57:01.875 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-02-11T15:57:01.875 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2020-02-11T15:57:01.875 INFO:teuthology.orchestra.run.smithi088:> rpm -q kernel --last | head -n 1 2020-02-11T15:57:01.933 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-4.18.0-147.5.1.el8_1.x86_64 Tue 11 Feb 2020 03:54:59 PM UTC 2020-02-11T15:57:01.935 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:01.935 INFO:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2020-02-11T15:57:01.970 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2020-02-11T15:57:01.971 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2020-02-11T15:57:01.971 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.02 2020-02-11T15:57:01.971 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 78.el8 2020-02-11T15:57:01.971 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2020-02-11T15:57:01.971 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Wed 29 Jan 2020 03:22:03 PM UTC 2020-02-11T15:57:01.971 INFO:teuthology.orchestra.run.smithi088.stdout:Group : System Environment/Base 2020-02-11T15:57:01.972 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 9192691 2020-02-11T15:57:01.972 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2020-02-11T15:57:01.972 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-02-11T15:57:01.972 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-02-11T15:57:01.972 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-02-11T15:57:01.972 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : kbuilder.bsys.centos.org 2020-02-11T15:57:01.972 INFO:teuthology.orchestra.run.smithi088.stdout:Relocations : (not relocatable) 2020-02-11T15:57:01.972 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : CentOS BuildSystem 2020-02-11T15:57:01.973 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2020-02-11T15:57:01.973 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2020-02-11T15:57:01.973 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2020-02-11T15:57:01.973 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2020-02-11T15:57:01.973 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T15:57:01.973 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-02-11T15:57:01.974 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2020-02-11T15:57:01.974 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2020-02-11T15:57:01.974 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2020-02-11T15:57:01.974 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T15:57:01.974 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2020-02-11T15:57:01.975 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-02-11T15:57:01.975 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:01.976 INFO:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-02-11T15:57:02.639 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2020-02-11T15:57:04.788 INFO:teuthology.orchestra.run.smithi088.stderr:done 2020-02-11T15:57:04.790 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T15:57:04.807 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.pUIblp0tXh 2020-02-11T15:57:04.807 INFO:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pUIblp0tXh 2020-02-11T15:57:04.887 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.pUIblp0tXh 2020-02-11T15:57:05.046 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.pUIblp0tXh is 4KB 2020-02-11T15:57:05.100 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.pUIblp0tXh 2020-02-11T15:57:05.115 INFO:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2020-02-11T15:57:05.179 INFO:teuthology.orchestra.run.smithi088.stdout:ca793b025e714070a10a474a42e8e28c-0-rescue.conf 2020-02-11T15:57:05.179 INFO:teuthology.orchestra.run.smithi088.stdout:ca793b025e714070a10a474a42e8e28c-4.18.0-147.3.1.el8_1.x86_64.conf 2020-02-11T15:57:05.179 INFO:teuthology.orchestra.run.smithi088.stdout:ca793b025e714070a10a474a42e8e28c-4.18.0-147.5.1.el8_1.x86_64.conf 2020-02-11T15:57:05.179 INFO:teuthology.orchestra.run.smithi088.stdout:ca793b025e714070a10a474a42e8e28c-4.18.0-147.el8.x86_64.conf 2020-02-11T15:57:05.180 INFO:teuthology.orchestra.run.smithi088:> sudo grub2-set-default ca793b025e714070a10a474a42e8e28c-4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:05.353 INFO:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2020-02-11T15:57:05.355 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-02-11T15:57:05.355 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2020-02-11T15:57:05.356 INFO:teuthology.orchestra.run.smithi052:> rpm -q kernel --last | head -n 1 2020-02-11T15:57:05.416 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-4.18.0-147.5.1.el8_1.x86_64 Tue 11 Feb 2020 03:56:37 PM UTC 2020-02-11T15:57:05.418 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:05.418 INFO:teuthology.orchestra.run.smithi052:> sudo rpm -qi grub2-tools 2020-02-11T15:57:05.457 INFO:teuthology.orchestra.run.smithi052.stdout:Name : grub2-tools 2020-02-11T15:57:05.458 INFO:teuthology.orchestra.run.smithi052.stdout:Epoch : 1 2020-02-11T15:57:05.458 INFO:teuthology.orchestra.run.smithi052.stdout:Version : 2.02 2020-02-11T15:57:05.458 INFO:teuthology.orchestra.run.smithi052.stdout:Release : 78.el8 2020-02-11T15:57:05.458 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: x86_64 2020-02-11T15:57:05.458 INFO:teuthology.orchestra.run.smithi052.stdout:Install Date: Wed 29 Jan 2020 03:22:03 PM UTC 2020-02-11T15:57:05.458 INFO:teuthology.orchestra.run.smithi052.stdout:Group : System Environment/Base 2020-02-11T15:57:05.458 INFO:teuthology.orchestra.run.smithi052.stdout:Size : 9192691 2020-02-11T15:57:05.459 INFO:teuthology.orchestra.run.smithi052.stdout:License : GPLv3+ 2020-02-11T15:57:05.459 INFO:teuthology.orchestra.run.smithi052.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-02-11T15:57:05.459 INFO:teuthology.orchestra.run.smithi052.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-02-11T15:57:05.459 INFO:teuthology.orchestra.run.smithi052.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-02-11T15:57:05.459 INFO:teuthology.orchestra.run.smithi052.stdout:Build Host : kbuilder.bsys.centos.org 2020-02-11T15:57:05.459 INFO:teuthology.orchestra.run.smithi052.stdout:Relocations : (not relocatable) 2020-02-11T15:57:05.459 INFO:teuthology.orchestra.run.smithi052.stdout:Packager : CentOS BuildSystem 2020-02-11T15:57:05.460 INFO:teuthology.orchestra.run.smithi052.stdout:Vendor : CentOS 2020-02-11T15:57:05.460 INFO:teuthology.orchestra.run.smithi052.stdout:URL : http://www.gnu.org/software/grub/ 2020-02-11T15:57:05.460 INFO:teuthology.orchestra.run.smithi052.stdout:Summary : Support tools for GRUB. 2020-02-11T15:57:05.460 INFO:teuthology.orchestra.run.smithi052.stdout:Description : 2020-02-11T15:57:05.460 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T15:57:05.460 INFO:teuthology.orchestra.run.smithi052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-02-11T15:57:05.460 INFO:teuthology.orchestra.run.smithi052.stdout:customizable bootloader with modular architecture. It supports a rich 2020-02-11T15:57:05.461 INFO:teuthology.orchestra.run.smithi052.stdout:variety of kernel formats, file systems, computer architectures and 2020-02-11T15:57:05.461 INFO:teuthology.orchestra.run.smithi052.stdout:hardware devices. 2020-02-11T15:57:05.461 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T15:57:05.461 INFO:teuthology.orchestra.run.smithi052.stdout:This subpackage provides tools for support of all platforms. 2020-02-11T15:57:05.462 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-02-11T15:57:05.462 INFO:teuthology.task.kernel:Updating grub on smithi052 to boot 4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:05.462 INFO:teuthology.orchestra.run.smithi052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-02-11T15:57:06.550 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2020-02-11T15:57:08.966 INFO:teuthology.orchestra.run.smithi052.stderr:done 2020-02-11T15:57:08.967 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T15:57:08.982 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.yrJeb4xunF 2020-02-11T15:57:08.983 INFO:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yrJeb4xunF 2020-02-11T15:57:09.067 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.yrJeb4xunF 2020-02-11T15:57:09.231 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.yrJeb4xunF is 4KB 2020-02-11T15:57:09.282 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.yrJeb4xunF 2020-02-11T15:57:09.310 INFO:teuthology.orchestra.run.smithi052:> sudo /bin/ls /boot/loader/entries || true 2020-02-11T15:57:09.389 INFO:teuthology.orchestra.run.smithi052.stdout:ca793b025e714070a10a474a42e8e28c-0-rescue.conf 2020-02-11T15:57:09.389 INFO:teuthology.orchestra.run.smithi052.stdout:ca793b025e714070a10a474a42e8e28c-4.18.0-147.3.1.el8_1.x86_64.conf 2020-02-11T15:57:09.389 INFO:teuthology.orchestra.run.smithi052.stdout:ca793b025e714070a10a474a42e8e28c-4.18.0-147.5.1.el8_1.x86_64.conf 2020-02-11T15:57:09.389 INFO:teuthology.orchestra.run.smithi052.stdout:ca793b025e714070a10a474a42e8e28c-4.18.0-147.el8.x86_64.conf 2020-02-11T15:57:09.391 INFO:teuthology.orchestra.run.smithi052:> sudo grub2-set-default ca793b025e714070a10a474a42e8e28c-4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:57:09.547 INFO:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2020-02-11T15:57:09.549 INFO:teuthology.misc:Re-opening connections... 2020-02-11T15:57:09.549 INFO:teuthology.misc:trying to connect to ubuntu@smithi088.front.sepia.ceph.com 2020-02-11T15:57:09.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-11T15:57:09.550 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi088.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:58:09.552 DEBUG:teuthology.orchestra.remote:timed out 2020-02-11T15:58:09.552 INFO:teuthology.misc:trying to connect to ubuntu@smithi052.front.sepia.ceph.com 2020-02-11T15:58:09.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-11T15:58:09.553 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:58:28.074 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.52 2020-02-11T15:58:28.074 DEBUG:teuthology.misc:waited 78.5251090527 2020-02-11T15:58:29.075 INFO:teuthology.misc:trying to connect to ubuntu@smithi088.front.sepia.ceph.com 2020-02-11T15:58:29.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-11T15:58:29.075 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi088.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:59:01.045 INFO:teuthology.orchestra.run.smithi088:> true 2020-02-11T15:59:01.415 DEBUG:teuthology.misc:waited 111.865886927 2020-02-11T15:59:02.416 INFO:teuthology.misc:trying to connect to ubuntu@smithi052.front.sepia.ceph.com 2020-02-11T15:59:02.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-11T15:59:02.417 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T15:59:02.700 INFO:teuthology.orchestra.run.smithi052:> true 2020-02-11T15:59:03.021 DEBUG:teuthology.misc:waited 113.471806049 2020-02-11T15:59:04.023 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-02-11T15:59:04.023 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-147.5.1.el8_1.x86_64"... 2020-02-11T15:59:04.023 INFO:teuthology.orchestra.run.smithi088:> uname -r 2020-02-11T15:59:04.038 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:59:04.039 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.5.1.el8_1.x86_64 vs 4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:59:04.039 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-02-11T15:59:04.039 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-02-11T15:59:04.039 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-147.5.1.el8_1.x86_64"... 2020-02-11T15:59:04.039 INFO:teuthology.orchestra.run.smithi052:> uname -r 2020-02-11T15:59:04.057 INFO:teuthology.orchestra.run.smithi052.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:59:04.057 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.5.1.el8_1.x86_64 vs 4.18.0-147.5.1.el8_1.x86_64 2020-02-11T15:59:04.057 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-02-11T15:59:05.058 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-02-11T15:59:05.058 INFO:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-02-11T15:59:05.626 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2020-02-11T15:59:05.656 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-02-11T15:59:05.656 INFO:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-02-11T15:59:05.756 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2020-02-11T15:59:05.772 INFO:teuthology.run_tasks:Running task internal.base... 2020-02-11T15:59:05.801 INFO:teuthology.task.internal:Creating test directory... 2020-02-11T15:59:05.801 INFO:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-02-11T15:59:05.805 INFO:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-02-11T15:59:06.062 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-02-11T15:59:06.076 INFO:teuthology.run_tasks:Running task internal.archive... 2020-02-11T15:59:06.089 INFO:teuthology.task.internal:Creating archive directory... 2020-02-11T15:59:06.089 INFO:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-02-11T15:59:06.092 INFO:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-02-11T15:59:06.121 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-02-11T15:59:06.134 INFO:teuthology.task.internal:Enabling coredump saving... 2020-02-11T15:59:06.134 INFO:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-02-11T15:59:06.164 INFO:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-02-11T15:59:06.198 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-11T15:59:06.217 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-11T15:59:06.249 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-11T15:59:06.328 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-11T15:59:06.349 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-02-11T15:59:06.358 INFO:teuthology.task.internal:Configuring sudo... 2020-02-11T15:59:06.358 INFO:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-02-11T15:59:06.361 INFO:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-02-11T15:59:06.430 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-02-11T15:59:06.441 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-02-11T15:59:06.442 INFO:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-02-11T15:59:06.445 INFO:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-02-11T15:59:06.462 INFO:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-11T15:59:06.542 INFO:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-11T15:59:06.685 INFO:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-11T15:59:06.719 INFO:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-11T15:59:06.771 INFO:teuthology.orchestra.run.smithi088:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-02-11T15:59:06.857 INFO:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-11T15:59:06.894 INFO:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-11T15:59:06.959 INFO:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-11T15:59:07.038 INFO:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-11T15:59:07.095 INFO:teuthology.orchestra.run.smithi052:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-02-11T15:59:07.181 INFO:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2020-02-11T15:59:07.225 INFO:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2020-02-11T15:59:07.292 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-02-11T15:59:07.316 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-02-11T15:59:07.765 INFO:teuthology.run_tasks:Running task internal.timer... 2020-02-11T15:59:07.782 INFO:teuthology.task.internal:Starting timer... 2020-02-11T15:59:07.783 INFO:teuthology.run_tasks:Running task pcp... 2020-02-11T15:59:07.825 INFO:teuthology.run_tasks:Running task selinux... 2020-02-11T15:59:07.840 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-02-11T15:59:07.840 INFO:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2020-02-11T15:59:07.908 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: [ OK ] 2020-02-11T15:59:07.910 INFO:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2020-02-11T15:59:07.994 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: [ OK ] 2020-02-11T15:59:07.996 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-02-11T15:59:07.996 INFO:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2020-02-11T15:59:08.039 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2020-02-11T15:59:08.040 INFO:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2020-02-11T15:59:08.063 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2020-02-11T15:59:08.063 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi088.front.sepia.ceph.com': 'permissive'} 2020-02-11T15:59:08.064 INFO:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-02-11T15:59:08.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-02-11T15:59:08.107 INFO:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-02-11T15:59:08.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-02-11T15:59:08.139 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-02-11T15:59:08.140 INFO:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2020-02-11T15:59:08.174 INFO:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2020-02-11T15:59:08.212 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-02-11T15:59:08.223 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-02-11T15:59:08.223 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-02-11T15:59:08.238 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-02-11T15:59:08.240 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi052.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-02-11T15:59:08.593 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-02-11T15:59:09.733 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-02-11T15:59:12.702 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-02-11T15:59:12.726 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:12 +0000 (0:00:00.065) 0:00:00.065 ****** 2020-02-11T15:59:12.742 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:12 +0000 (0:00:00.012) 0:00:00.077 ****** 2020-02-11T15:59:15.311 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi052.front.sepia.ceph.com] 2020-02-11T15:59:15.323 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] 2020-02-11T15:59:15.433 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:15 +0000 (0:00:02.694) 0:00:02.772 ****** 2020-02-11T15:59:15.469 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:15 +0000 (0:00:00.035) 0:00:02.808 ****** 2020-02-11T15:59:15.797 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-02-11T15:59:15.799 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-11T15:59:15.837 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:15 +0000 (0:00:00.368) 0:00:03.177 ****** 2020-02-11T15:59:15.871 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:15 +0000 (0:00:00.033) 0:00:03.210 ****** 2020-02-11T15:59:16.310 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-02-11T15:59:16.311 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-02-11T15:59:16.347 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:16 +0000 (0:00:00.476) 0:00:03.686 ****** 2020-02-11T15:59:16.372 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-02-11T15:59:16.374 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:16.415 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:16 +0000 (0:00:00.067) 0:00:03.754 ****** 2020-02-11T15:59:16.431 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-02-11T15:59:16.432 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-02-11T15:59:16.477 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:16 +0000 (0:00:00.059) 0:00:03.814 ****** 2020-02-11T15:59:16.501 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-02-11T15:59:16.502 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:16.550 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:16 +0000 (0:00:00.070) 0:00:03.885 ****** 2020-02-11T15:59:16.793 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-02-11T15:59:16.794 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-11T15:59:16.839 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:16 +0000 (0:00:00.292) 0:00:04.178 ****** 2020-02-11T15:59:16.846 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-11T15:59:16.891 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:16 +0000 (0:00:00.052) 0:00:04.230 ****** 2020-02-11T15:59:17.733 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "state": "file", "uid": 0} 2020-02-11T15:59:17.769 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:17 +0000 (0:00:00.878) 0:00:05.109 ****** 2020-02-11T15:59:17.775 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "state": "file", "uid": 0} 2020-02-11T15:59:17.812 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:17 +0000 (0:00:00.042) 0:00:05.152 ****** 2020-02-11T15:59:18.236 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-02-11T15:59:18.238 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-02-11T15:59:18.277 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-02-11T15:59:18.278 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-02-11T15:59:18.402 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-02-11T15:59:18.407 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-02-11T15:59:18.594 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:18 +0000 (0:00:00.781) 0:00:05.933 ****** 2020-02-11T15:59:18.626 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:18 +0000 (0:00:00.032) 0:00:05.966 ****** 2020-02-11T15:59:19.305 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-02-11T15:59:19.307 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] 2020-02-11T15:59:19.320 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] 2020-02-11T15:59:19.462 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Tuesday 11 February 2020 15:59:19 +0000 (0:00:00.833) 0:00:06.799 ****** 2020-02-11T15:59:19.499 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:19 +0000 (0:00:00.039) 0:00:06.839 ****** 2020-02-11T15:59:20.034 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-02-11T15:59:20.035 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.248865", "end": "2020-02-11 15:59:20.000422", "rc": 0, "start": "2020-02-11 15:59:19.751557", "stderr": "", "stderr_lines": [], "stdout": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "stdout_lines": ["966e9a6bfb22958c64d4123b47ddee87a2318d5a"]} 2020-02-11T15:59:20.036 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.254376", "end": "2020-02-11 15:59:20.012492", "rc": 0, "start": "2020-02-11 15:59:19.758116", "stderr": "", "stderr_lines": [], "stdout": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "stdout_lines": ["966e9a6bfb22958c64d4123b47ddee87a2318d5a"]} 2020-02-11T15:59:20.073 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.573) 0:00:07.413 ****** 2020-02-11T15:59:20.105 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.031) 0:00:07.444 ****** 2020-02-11T15:59:20.301 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-02-11T15:59:20.302 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013938", "end": "2020-02-11 15:59:20.276521", "failed_when_result": false, "rc": 0, "start": "2020-02-11 15:59:20.262583", "stderr": "", "stderr_lines": [], "stdout": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "stdout_lines": ["18e9b29cc5746d2d70d31eb50513efa350c4d3f4"]} 2020-02-11T15:59:20.343 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.237) 0:00:07.682 ****** 2020-02-11T15:59:20.350 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.022223", "end": "2020-02-11 15:59:20.314517", "failed_when_result": false, "rc": 0, "start": "2020-02-11 15:59:20.292294", "stderr": "", "stderr_lines": [], "stdout": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "stdout_lines": ["18e9b29cc5746d2d70d31eb50513efa350c4d3f4"]} 2020-02-11T15:59:20.390 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.047) 0:00:07.730 ****** 2020-02-11T15:59:20.395 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-02-11T15:59:20.397 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:20.439 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.048) 0:00:07.778 ****** 2020-02-11T15:59:20.444 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:20.484 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.045) 0:00:07.823 ****** 2020-02-11T15:59:20.489 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-02-11T15:59:20.489 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:20.531 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.045) 0:00:07.869 ****** 2020-02-11T15:59:20.535 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:20.583 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.053) 0:00:07.922 ****** 2020-02-11T15:59:20.595 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-02-11T15:59:20.596 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:20.634 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.051) 0:00:07.974 ****** 2020-02-11T15:59:20.640 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:20.683 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.045) 0:00:08.019 ****** 2020-02-11T15:59:20.684 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-02-11T15:59:20.685 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:20.723 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.043) 0:00:08.062 ****** 2020-02-11T15:59:20.730 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:20.771 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.048) 0:00:08.111 ****** 2020-02-11T15:59:20.782 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:20.825 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.053) 0:00:08.164 ****** 2020-02-11T15:59:20.833 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:20.872 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:20 +0000 (0:00:00.047) 0:00:08.212 ****** 2020-02-11T15:59:21.050 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-02-11T15:59:21.051 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-11T15:59:21.094 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:21 +0000 (0:00:00.222) 0:00:08.434 ****** 2020-02-11T15:59:21.102 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-11T15:59:21.147 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:21 +0000 (0:00:00.052) 0:00:08.486 ****** 2020-02-11T15:59:21.352 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-11T15:59:21.353 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-02-11T15:59:21.409 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-02-11T15:59:21.568 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-02-11T15:59:21.624 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-02-11T15:59:21.781 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-02-11T15:59:21.825 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-02-11T15:59:22.007 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-02-11T15:59:22.030 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-02-11T15:59:22.212 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-02-11T15:59:22.235 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-02-11T15:59:22.433 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-02-11T15:59:22.444 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-02-11T15:59:22.641 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-02-11T15:59:22.664 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-02-11T15:59:22.846 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-02-11T15:59:22.879 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-02-11T15:59:23.048 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-02-11T15:59:23.093 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-02-11T15:59:23.273 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-02-11T15:59:23.332 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-02-11T15:59:23.457 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-02-11T15:59:23.544 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-02-11T15:59:23.671 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-02-11T15:59:23.759 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-02-11T15:59:23.877 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-02-11T15:59:23.983 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-02-11T15:59:24.079 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-02-11T15:59:24.197 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-02-11T15:59:24.293 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-02-11T15:59:24.411 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-02-11T15:59:24.487 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-02-11T15:59:24.629 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-02-11T15:59:24.683 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-02-11T15:59:24.850 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-02-11T15:59:24.903 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-02-11T15:59:25.057 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-02-11T15:59:25.110 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-02-11T15:59:25.291 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-02-11T15:59:25.302 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-02-11T15:59:25.504 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-02-11T15:59:25.506 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-02-11T15:59:25.729 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-02-11T15:59:25.732 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-02-11T15:59:25.939 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-02-11T15:59:25.961 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-02-11T15:59:26.161 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-02-11T15:59:26.163 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-02-11T15:59:26.356 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-02-11T15:59:26.369 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-02-11T15:59:26.551 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-02-11T15:59:26.584 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-02-11T15:59:26.752 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-02-11T15:59:26.795 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-02-11T15:59:26.975 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-02-11T15:59:27.030 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-02-11T15:59:27.185 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-02-11T15:59:27.239 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-02-11T15:59:27.390 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-02-11T15:59:27.454 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-02-11T15:59:27.595 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-02-11T15:59:27.665 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-02-11T15:59:27.802 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-02-11T15:59:27.878 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-02-11T15:59:28.013 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-02-11T15:59:28.086 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-02-11T15:59:28.213 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-02-11T15:59:28.297 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-02-11T15:59:28.412 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-02-11T15:59:28.508 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-02-11T15:59:28.627 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-02-11T15:59:28.718 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-02-11T15:59:28.826 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-02-11T15:59:28.942 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-02-11T15:59:29.022 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-02-11T15:59:29.154 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-02-11T15:59:29.231 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-02-11T15:59:29.377 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-02-11T15:59:29.438 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-02-11T15:59:29.575 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-02-11T15:59:29.629 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-02-11T15:59:29.790 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-02-11T15:59:29.844 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-02-11T15:59:30.006 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-02-11T15:59:30.072 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-02-11T15:59:30.221 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-02-11T15:59:30.289 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-02-11T15:59:30.442 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-02-11T15:59:30.505 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-02-11T15:59:30.671 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-02-11T15:59:30.703 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-02-11T15:59:30.884 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-02-11T15:59:30.920 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-02-11T15:59:31.095 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-02-11T15:59:31.118 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-02-11T15:59:31.327 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-02-11T15:59:31.340 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-02-11T15:59:31.530 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-02-11T15:59:31.553 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-02-11T15:59:31.775 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-02-11T15:59:31.788 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-02-11T15:59:31.957 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-02-11T15:59:32.014 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-02-11T15:59:32.178 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-02-11T15:59:32.243 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-02-11T15:59:32.374 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-02-11T15:59:32.454 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-02-11T15:59:32.575 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-02-11T15:59:32.671 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-02-11T15:59:32.779 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-02-11T15:59:32.885 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-02-11T15:59:32.992 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-02-11T15:59:33.109 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-02-11T15:59:33.214 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-02-11T15:59:33.332 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-02-11T15:59:33.408 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-02-11T15:59:33.547 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-02-11T15:59:33.614 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-02-11T15:59:33.772 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-02-11T15:59:33.814 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-02-11T15:59:34.006 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-02-11T15:59:34.017 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-02-11T15:59:34.208 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-02-11T15:59:34.232 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-02-11T15:59:34.422 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-02-11T15:59:34.446 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-02-11T15:59:34.621 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-02-11T15:59:34.675 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-02-11T15:59:34.832 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-02-11T15:59:34.907 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-02-11T15:59:35.045 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-02-11T15:59:35.131 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-02-11T15:59:35.248 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-02-11T15:59:35.347 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-02-11T15:59:35.457 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-02-11T15:59:35.578 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-02-11T15:59:35.652 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-02-11T15:59:35.790 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-02-11T15:59:35.868 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-02-11T15:59:36.006 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-02-11T15:59:36.081 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-02-11T15:59:36.220 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-02-11T15:59:36.299 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-02-11T15:59:36.446 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-02-11T15:59:36.521 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-02-11T15:59:36.685 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-02-11T15:59:36.739 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-02-11T15:59:36.924 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-02-11T15:59:36.943 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-02-11T15:59:37.138 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-02-11T15:59:37.151 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-02-11T15:59:37.348 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-02-11T15:59:37.351 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-02-11T15:59:37.570 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-02-11T15:59:37.582 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-02-11T15:59:37.774 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-02-11T15:59:37.795 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-02-11T15:59:37.975 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-02-11T15:59:38.043 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-02-11T15:59:38.178 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-02-11T15:59:38.272 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-02-11T15:59:38.393 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-02-11T15:59:38.489 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-02-11T15:59:38.606 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-02-11T15:59:38.707 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-02-11T15:59:38.815 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-02-11T15:59:38.923 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-02-11T15:59:39.023 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-02-11T15:59:39.148 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-02-11T15:59:39.212 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-02-11T15:59:39.361 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-02-11T15:59:39.417 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-02-11T15:59:39.568 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-02-11T15:59:39.629 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-02-11T15:59:39.631 INFO:teuthology.task.ansible.out: 2020-02-11T15:59:39.784 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-02-11T15:59:39.828 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-02-11T15:59:40.002 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-02-11T15:59:40.032 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-02-11T15:59:40.213 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-02-11T15:59:40.270 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-02-11T15:59:40.425 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-02-11T15:59:40.471 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-02-11T15:59:40.654 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-02-11T15:59:40.687 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-02-11T15:59:40.876 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-02-11T15:59:40.901 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-02-11T15:59:41.098 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-02-11T15:59:41.152 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-02-11T15:59:41.312 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-02-11T15:59:41.356 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-02-11T15:59:41.530 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-02-11T15:59:41.587 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-02-11T15:59:41.751 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-02-11T15:59:41.775 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-02-11T15:59:41.967 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-02-11T15:59:41.985 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-02-11T15:59:42.184 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-02-11T15:59:42.185 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-02-11T15:59:42.385 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-02-11T15:59:42.410 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-02-11T15:59:42.584 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-02-11T15:59:42.645 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-02-11T15:59:42.797 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-02-11T15:59:42.876 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-02-11T15:59:43.011 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-02-11T15:59:43.089 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-02-11T15:59:43.226 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-02-11T15:59:43.303 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-02-11T15:59:43.440 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-02-11T15:59:43.515 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-02-11T15:59:43.641 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-02-11T15:59:43.745 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-02-11T15:59:43.860 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-02-11T15:59:43.967 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-02-11T15:59:44.075 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-02-11T15:59:44.195 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-02-11T15:59:44.230 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:44 +0000 (0:00:23.083) 0:00:31.570 ****** 2020-02-11T15:59:44.263 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-02-11T15:59:44.315 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:44 +0000 (0:00:00.082) 0:00:31.653 ****** 2020-02-11T15:59:44.363 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-02-11T15:59:44.370 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-02-11T15:59:44.372 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-02-11T15:59:44.373 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-02-11T15:59:44.374 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-02-11T15:59:44.376 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-02-11T15:59:44.377 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-02-11T15:59:44.379 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d 2020-02-11T15:59:44.379 INFO:teuthology.task.ansible.out:49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-02-11T15:59:44.380 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280 2020-02-11T15:59:44.382 INFO:teuthology.task.ansible.out:b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkr 2020-02-11T15:59:44.383 INFO:teuthology.task.ansible.out:Q 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": 2020-02-11T15:59:44.385 INFO:teuthology.task.ansible.out: "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}]}, "changed": false} 2020-02-11T15:59:44.437 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:44 +0000 (0:00:00.123) 0:00:31.777 ****** 2020-02-11T15:59:44.443 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-11T15:59:44.444 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-02-11T15:59:44.627 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-02-11T15:59:44.881 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-02-11T15:59:45.121 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-02-11T15:59:45.328 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-02-11T15:59:45.490 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:45 +0000 (0:00:01.052) 0:00:32.830 ****** 2020-02-11T15:59:45.519 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-02-11T15:59:45.562 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:45 +0000 (0:00:00.071) 0:00:32.901 ****** 2020-02-11T15:59:45.580 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi088.front.sepia.ceph.com -> localhost] => {"after": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "attempts": 1, "before": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "changed": false, "remote_url_changed": false} 2020-02-11T15:59:45.624 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:45 +0000 (0:00:00.062) 0:00:32.964 ****** 2020-02-11T15:59:45.632 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-02-11T15:59:45.637 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-02-11T15:59:45.639 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-02-11T15:59:45.641 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-02-11T15:59:45.643 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-02-11T15:59:45.644 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-02-11T15:59:45.646 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa 2020-02-11T15:59:45.646 INFO:teuthology.task.ansible.out:256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-02-11T15:59:45.648 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-02-11T15:59:45.649 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280 2020-02-11T15:59:45.650 INFO:teuthology.task.ansible.out:b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkr 2020-02-11T15:59:45.652 INFO:teuthology.task.ansible.out:Q 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": 2020-02-11T15:59:45.653 INFO:teuthology.task.ansible.out: "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}]}, "changed": false} 2020-02-11T15:59:45.692 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:45 +0000 (0:00:00.068) 0:00:33.032 ****** 2020-02-11T15:59:45.921 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-11T15:59:45.922 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-02-11T15:59:46.148 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-02-11T15:59:46.389 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-02-11T15:59:46.401 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi052.front.sepia.ceph.com -> localhost] => {"after": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "attempts": 1, "before": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "changed": false, "remote_url_changed": false} 2020-02-11T15:59:46.449 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 15:59:46 +0000 (0:00:00.756) 0:00:33.788 ****** 2020-02-11T15:59:46.622 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authoriz 2020-02-11T15:59:46.624 INFO:teuthology.task.ansible.out:ed_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-02-11T15:59:46.752 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-02-11T15:59:46.873 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-02-11T15:59:46.995 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-02-11T15:59:47.092 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-02-11T15:59:47.095 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-02-11T15:59:47.250 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-02-11T15:59:47.315 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-02-11T15:59:47.482 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2020-02-11T15:59:47.483 INFO:teuthology.task.ansible.out:lidate_certs": true} 2020-02-11T15:59:47.545 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-02-11T15:59:47.557 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:47.728 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-02-11T15:59:47.782 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-02-11T15:59:47.783 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-02-11T15:59:47.803 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:47.814 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:47.827 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:47.966 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-02-11T15:59:47.968 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-02-11T15:59:48.040 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-02-11T15:59:48.210 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-02-11T15:59:48.271 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-02-11T15:59:48.273 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-02-11T15:59:48.449 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-02-11T15:59:48.462 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:48.504 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-02-11T15:59:48.702 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-02-11T15:59:48.704 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-02-11T15:59:48.719 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f4 2020-02-11T15:59:48.722 INFO:teuthology.task.ansible.out:3d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-02-11T15:59:48.730 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:48.751 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-02-11T15:59:48.958 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-02-11T15:59:49.001 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-02-11T15:59:49.182 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-02-11T15:59:49.237 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-02-11T15:59:49.238 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-02-11T15:59:49.414 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-02-11T15:59:49.491 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-02-11T15:59:49.637 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-02-11T15:59:49.722 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-02-11T15:59:49.869 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-02-11T15:59:49.870 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-02-11T15:59:49.974 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-02-11T15:59:50.091 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-02-11T15:59:50.093 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-02-11T15:59:50.227 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-02-11T15:59:50.322 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-02-11T15:59:50.470 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-02-11T15:59:50.555 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-02-11T15:59:50.710 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-02-11T15:59:50.788 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-02-11T15:59:50.789 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-02-11T15:59:50.984 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-02-11T15:59:50.985 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-02-11T15:59:51.017 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-02-11T15:59:51.249 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-02-11T15:59:51.251 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-02-11T15:59:51.468 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-02-11T15:59:51.510 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-02-11T15:59:51.731 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-02-11T15:59:51.755 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-02-11T15:59:51.962 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-02-11T15:59:52.004 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-02-11T15:59:52.006 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-02-11T15:59:52.214 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-02-11T15:59:52.215 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-02-11T15:59:52.258 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-02-11T15:59:52.433 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-02-11T15:59:52.508 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-02-11T15:59:52.662 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-02-11T15:59:52.750 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-02-11T15:59:52.874 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-02-11T15:59:52.982 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-02-11T15:59:53.109 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-02-11T15:59:53.215 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-02-11T15:59:53.343 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-02-11T15:59:53.453 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-02-11T15:59:53.454 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-02-11T15:59:53.563 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-02-11T15:59:53.683 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-02-11T15:59:53.790 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-02-11T15:59:53.928 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-02-11T15:59:54.023 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-02-11T15:59:54.163 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-02-11T15:59:54.240 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-02-11T15:59:54.427 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-02-11T15:59:54.474 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-02-11T15:59:54.476 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-02-11T15:59:54.668 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-02-11T15:59:54.701 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-02-11T15:59:54.703 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-02-11T15:59:54.942 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-02-11T15:59:54.945 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-02-11T15:59:55.163 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-02-11T15:59:55.185 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-02-11T15:59:55.393 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-02-11T15:59:55.447 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-02-11T15:59:55.629 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-02-11T15:59:55.631 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-02-11T15:59:55.682 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-02-11T15:59:55.868 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-02-11T15:59:55.869 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-02-11T15:59:55.871 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-02-11T15:59:55.923 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-02-11T15:59:55.925 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-02-11T15:59:56.088 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-02-11T15:59:56.155 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-02-11T15:59:56.157 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-02-11T15:59:56.323 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-02-11T15:59:56.392 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-02-11T15:59:56.542 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-02-11T15:59:56.666 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-02-11T15:59:56.772 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-02-11T15:59:56.922 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-02-11T15:59:57.012 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-02-11T15:59:57.162 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-02-11T15:59:57.163 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-02-11T15:59:57.265 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-02-11T15:59:57.405 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-02-11T15:59:57.406 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-02-11T15:59:57.408 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-02-11T15:59:57.505 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-02-11T15:59:57.647 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-02-11T15:59:57.732 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-02-11T15:59:57.887 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-02-11T15:59:57.951 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-02-11T15:59:57.952 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-02-11T15:59:58.121 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-02-11T15:59:58.198 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-02-11T15:59:58.375 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-02-11T15:59:58.436 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-02-11T15:59:58.615 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-02-11T15:59:58.651 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-02-11T15:59:58.652 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-02-11T15:59:58.860 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-02-11T15:59:58.890 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-02-11T15:59:59.096 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-02-11T15:59:59.135 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-02-11T15:59:59.355 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-02-11T15:59:59.387 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-02-11T15:59:59.611 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-02-11T15:59:59.613 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-02-11T15:59:59.614 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-02-11T15:59:59.847 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-02-11T15:59:59.849 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-02-11T16:00:00.067 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-02-11T16:00:00.089 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-02-11T16:00:00.290 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-02-11T16:00:00.338 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-02-11T16:00:00.339 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-02-11T16:00:00.532 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-02-11T16:00:00.574 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-02-11T16:00:00.748 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-02-11T16:00:00.825 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-02-11T16:00:01.009 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-02-11T16:00:01.082 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-02-11T16:00:01.223 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-02-11T16:00:01.321 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-02-11T16:00:01.471 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-02-11T16:00:01.577 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-02-11T16:00:01.686 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-02-11T16:00:01.806 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-02-11T16:00:01.908 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-02-11T16:00:02.056 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-02-11T16:00:02.141 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-02-11T16:00:02.300 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-02-11T16:00:02.375 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/Z 2020-02-11T16:00:02.377 INFO:teuthology.task.ansible.out:yG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-02-11T16:00:02.539 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-02-11T16:00:02.615 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-02-11T16:00:02.779 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-02-11T16:00:02.855 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-02-11T16:00:03.011 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-02-11T16:00:03.074 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-02-11T16:00:03.237 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-02-11T16:00:03.301 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-02-11T16:00:03.478 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-02-11T16:00:03.516 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-02-11T16:00:03.711 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-02-11T16:00:03.755 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-02-11T16:00:03.947 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-02-11T16:00:03.970 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-02-11T16:00:04.182 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-02-11T16:00:04.197 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-02-11T16:00:04.425 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-02-11T16:00:04.426 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-02-11T16:00:04.679 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-02-11T16:00:04.681 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-02-11T16:00:04.702 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-02-11T16:00:04.904 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-02-11T16:00:04.905 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-02-11T16:00:04.915 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-02-11T16:00:05.127 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-02-11T16:00:05.163 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-02-11T16:00:05.353 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-02-11T16:00:05.396 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-02-11T16:00:05.571 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-02-11T16:00:05.636 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-02-11T16:00:05.808 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-02-11T16:00:05.881 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-02-11T16:00:06.031 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-02-11T16:00:06.126 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-02-11T16:00:06.267 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-02-11T16:00:06.366 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-02-11T16:00:06.477 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-02-11T16:00:06.616 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-02-11T16:00:06.618 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-02-11T16:00:06.693 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-02-11T16:00:06.854 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-02-11T16:00:06.856 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-02-11T16:00:06.917 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-02-11T16:00:07.088 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-02-11T16:00:07.161 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-02-11T16:00:07.330 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-02-11T16:00:07.395 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-02-11T16:00:07.557 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-02-11T16:00:07.610 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-02-11T16:00:07.818 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-02-11T16:00:07.853 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-02-11T16:00:08.052 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-02-11T16:00:08.107 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-02-11T16:00:08.303 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-02-11T16:00:08.336 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-02-11T16:00:08.338 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-02-11T16:00:08.551 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-02-11T16:00:08.583 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-02-11T16:00:08.790 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-02-11T16:00:08.813 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-02-11T16:00:09.024 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-02-11T16:00:09.046 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-02-11T16:00:09.264 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-02-11T16:00:09.275 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-02-11T16:00:09.511 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-02-11T16:00:09.555 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-02-11T16:00:09.725 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-02-11T16:00:09.791 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-02-11T16:00:09.952 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-02-11T16:00:10.026 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-02-11T16:00:10.204 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-02-11T16:00:10.284 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-02-11T16:00:10.321 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:10 +0000 (0:00:23.872) 0:00:57.660 ****** 2020-02-11T16:00:10.364 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-11T16:00:10.366 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:10.376 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:10.399 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:10.400 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:10.418 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:10.435 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:10.457 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:10.458 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:10.515 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsri 2020-02-11T16:00:10.519 INFO:teuthology.task.ansible.out:vas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-02-11T16:00:10.673 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-11T16:00:10.674 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-02-11T16:00:10.686 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:10.759 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-11T16:00:10.761 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-02-11T16:00:10.918 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-11T16:00:10.919 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-02-11T16:00:11.003 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-11T16:00:11.005 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-02-11T16:00:11.137 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-11T16:00:11.138 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-02-11T16:00:11.244 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-11T16:00:11.246 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-02-11T16:00:11.354 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-02-11T16:00:11.382 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.383 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.398 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.405 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.417 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.418 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.440 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.441 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.456 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.473 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.474 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.485 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.497 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.509 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.510 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-02-11T16:00:11.511 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.522 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.533 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.545 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.556 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.568 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.586 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.601 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.602 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.615 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.615 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.629 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.641 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.653 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.664 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.676 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.698 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.700 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.710 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.722 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.722 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.734 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.746 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.759 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-02-11T16:00:11.761 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.770 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.772 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.784 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.796 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.818 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.818 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.831 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.855 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.857 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.868 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.881 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.893 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.894 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.917 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.918 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.940 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.946 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.948 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.960 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.971 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:11.982 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.005 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.012 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.013 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-02-11T16:00:12.013 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-11T16:00:12.013 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.025 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.050 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.061 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.062 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.077 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.088 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.100 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.101 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.111 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.134 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.145 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.146 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.157 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.175 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.175 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.191 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.202 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.213 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.224 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.226 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.236 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.257 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.258 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.269 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-11T16:00:12.270 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-02-11T16:00:12.272 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.284 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.295 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.307 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.325 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.326 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.339 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.348 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.411 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:12 +0000 (0:00:02.090) 0:00:59.751 ****** 2020-02-11T16:00:12.438 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-02-11T16:00:12.440 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.491 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:12 +0000 (0:00:00.079) 0:00:59.830 ****** 2020-02-11T16:00:12.507 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-11T16:00:12.508 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-02-11T16:00:12.625 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:12 +0000 (0:00:00.134) 0:00:59.964 ****** 2020-02-11T16:00:12.627 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:12.682 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.690 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.692 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.703 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.715 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.716 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.738 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.739 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:12.763 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:12.763 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-02-11T16:00:12.965 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-02-11T16:00:12.998 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-11T16:00:12.999 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-02-11T16:00:13.015 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.157 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi088.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-02-11T16:00:13.253 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-02-11T16:00:13.362 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:13.364 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-02-11T16:00:13.491 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-11T16:00:13.493 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-02-11T16:00:13.589 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:13.590 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-02-11T16:00:13.725 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-11T16:00:13.727 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-02-11T16:00:13.737 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.758 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.769 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.781 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.782 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.803 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:13.804 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.829 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.830 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.842 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.855 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.865 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.879 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.895 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.897 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.910 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.923 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.925 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.937 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.948 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.950 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:13.960 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.962 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:13.972 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.973 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:13.985 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.987 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:13.997 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:13.999 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:14.000 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-02-11T16:00:14.016 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.019 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-11T16:00:14.025 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.026 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.028 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.039 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.040 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.062 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.063 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.065 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.076 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.078 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.090 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.091 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.102 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.104 INFO:teuthology.task.ansible.out: skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.116 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.117 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.128 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.129 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.139 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.141 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.152 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.153 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.166 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.167 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.178 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.190 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.191 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:14.192 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-02-11T16:00:14.194 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.204 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.215 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.240 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.250 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.261 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.272 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.273 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.288 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.295 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.311 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.311 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.323 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.334 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.345 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.356 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.357 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.368 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.379 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.391 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.404 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.404 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:14.406 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.417 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.428 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.439 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.461 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.584 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.595 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.596 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.618 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:14.619 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.619 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:14.630 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.642 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.652 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.663 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.666 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.689 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.690 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.703 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.704 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.714 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.730 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.732 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.742 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.753 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.764 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.765 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.776 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.787 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.798 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.810 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.821 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi088.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-02-11T16:00:14.822 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-11T16:00:14.823 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.824 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.834 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.917 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:14 +0000 (0:00:02.292) 0:01:02.257 ****** 2020-02-11T16:00:14.948 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-02-11T16:00:14.949 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:14.989 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:14 +0000 (0:00:00.072) 0:01:02.329 ****** 2020-02-11T16:00:15.026 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:15.027 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-02-11T16:00:15.235 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-02-11T16:00:15.251 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-02-11T16:00:15.429 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-02-11T16:00:15.451 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-02-11T16:00:15.638 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-02-11T16:00:15.671 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-02-11T16:00:15.843 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-02-11T16:00:15.875 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-02-11T16:00:16.038 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-02-11T16:00:16.080 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-02-11T16:00:16.234 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-02-11T16:00:16.298 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-02-11T16:00:16.430 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-02-11T16:00:16.509 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-02-11T16:00:16.634 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-02-11T16:00:16.743 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-02-11T16:00:16.828 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-02-11T16:00:16.946 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-02-11T16:00:17.040 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-02-11T16:00:17.156 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-02-11T16:00:17.240 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-02-11T16:00:17.241 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:17.374 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-02-11T16:00:17.438 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-02-11T16:00:17.587 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-02-11T16:00:17.640 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-02-11T16:00:17.797 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-02-11T16:00:17.829 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-02-11T16:00:17.997 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-02-11T16:00:18.029 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-02-11T16:00:18.235 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-02-11T16:00:18.237 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-02-11T16:00:18.440 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-02-11T16:00:18.440 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:18.442 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-02-11T16:00:18.655 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-02-11T16:00:18.656 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-02-11T16:00:18.846 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-02-11T16:00:18.855 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-02-11T16:00:19.044 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-02-11T16:00:19.066 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-02-11T16:00:19.254 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-02-11T16:00:19.276 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-02-11T16:00:19.443 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-02-11T16:00:19.475 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-02-11T16:00:19.634 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-02-11T16:00:19.691 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-02-11T16:00:19.831 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-02-11T16:00:19.896 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-02-11T16:00:20.033 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-02-11T16:00:20.103 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-02-11T16:00:20.230 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-02-11T16:00:20.335 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-02-11T16:00:20.420 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-02-11T16:00:20.541 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-02-11T16:00:20.615 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-02-11T16:00:20.754 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-02-11T16:00:20.819 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-02-11T16:00:20.966 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-02-11T16:00:21.010 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-02-11T16:00:21.088 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:21 +0000 (0:00:06.098) 0:01:08.427 ****** 2020-02-11T16:00:21.190 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-02-11T16:00:21.394 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-02-11T16:00:21.615 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-02-11T16:00:21.830 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-02-11T16:00:21.967 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-02-11T16:00:21.968 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "checksum": "5b601f2fa82999d906840a797df62d8ddf28ca4b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "fef9572bd2396dd9d379b457b328afbe", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581436821.12-157630311427868/source", "state": "file", "uid": 0} 2020-02-11T16:00:22.026 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:22 +0000 (0:00:00.937) 0:01:09.365 ****** 2020-02-11T16:00:22.045 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:22.046 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-02-11T16:00:22.080 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-02-11T16:00:22.082 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => { "msg": "Host smithi088.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-02-11T16:00:22.120 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:22 +0000 (0:00:00.093) 0:01:09.459 ****** 2020-02-11T16:00:22.158 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-02-11T16:00:22.159 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-02-11T16:00:22.198 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:22 +0000 (0:00:00.076) 0:01:09.536 ****** 2020-02-11T16:00:22.224 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-02-11T16:00:22.226 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:22.264 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:22 +0000 (0:00:00.067) 0:01:09.604 ****** 2020-02-11T16:00:22.270 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:22.271 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-02-11T16:00:22.504 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-02-11T16:00:22.537 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-02-11T16:00:22.539 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.081169", "end": "2020-02-11 16:00:22.516683", "rc": 0, "start": "2020-02-11 16:00:22.435514", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-02-11T16:00:22.590 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:22 +0000 (0:00:00.318) 0:01:09.923 ****** 2020-02-11T16:00:22.609 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-02-11T16:00:22.610 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:22.666 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:22 +0000 (0:00:00.083) 0:01:10.006 ****** 2020-02-11T16:00:22.692 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-02-11T16:00:22.694 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:22.734 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:22 +0000 (0:00:00.067) 0:01:10.073 ****** 2020-02-11T16:00:22.740 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:22.741 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-02-11T16:00:22.764 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-02-11T16:00:22.765 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:22.808 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:22 +0000 (0:00:00.074) 0:01:10.147 ****** 2020-02-11T16:00:22.845 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-02-11T16:00:22.846 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:22.884 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:22 +0000 (0:00:00.076) 0:01:10.224 ****** 2020-02-11T16:00:22.922 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:22.923 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:22.965 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:22 +0000 (0:00:00.080) 0:01:10.305 ****** 2020-02-11T16:00:23.002 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-02-11T16:00:23.004 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:23.050 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.084) 0:01:10.389 ****** 2020-02-11T16:00:23.086 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-02-11T16:00:23.088 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi088.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-11T16:00:23.141 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.091) 0:01:10.480 ****** 2020-02-11T16:00:23.149 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:23.151 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-02-11T16:00:23.174 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:23.227 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.086) 0:01:10.567 ****** 2020-02-11T16:00:23.264 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-02-11T16:00:23.265 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:23.320 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.092) 0:01:10.660 ****** 2020-02-11T16:00:23.455 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi088.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.074) 0:01:10.734 ****** TASK [users : Remove revoked users] ******************************************** ok: [smithi052.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:23.464 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.069) 0:01:10.804 ****** 2020-02-11T16:00:23.490 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi088.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-11T16:00:23.527 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.062) 0:01:10.867 ****** 2020-02-11T16:00:23.563 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-02-11T16:00:23.565 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:23.614 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.085) 0:01:10.952 ****** 2020-02-11T16:00:23.623 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:23.624 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-02-11T16:00:23.646 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-02-11T16:00:23.648 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:23.683 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.070) 0:01:11.023 ****** 2020-02-11T16:00:23.730 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-02-11T16:00:23.731 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:23.772 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.088) 0:01:11.111 ****** 2020-02-11T16:00:23.808 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-02-11T16:00:23.810 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi052.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-02-11T16:00:23.848 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.076) 0:01:11.188 ****** 2020-02-11T16:00:23.877 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-02-11T16:00:23.878 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-11T16:00:23.916 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.067) 0:01:11.255 ****** 2020-02-11T16:00:23.951 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:23.999 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:23 +0000 (0:00:00.083) 0:01:11.339 ****** 2020-02-11T16:00:24.044 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:24.045 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:24.052 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-02-11T16:00:24.109 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.109) 0:01:11.448 ****** 2020-02-11T16:00:24.145 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.035) 0:01:11.484 ****** 2020-02-11T16:00:24.181 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-02-11T16:00:24.182 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:24.237 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.091) 0:01:11.576 ****** 2020-02-11T16:00:24.274 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-02-11T16:00:24.275 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:24.332 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.095) 0:01:11.672 ****** 2020-02-11T16:00:24.365 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-02-11T16:00:24.367 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:24.405 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.073) 0:01:11.745 ****** 2020-02-11T16:00:24.442 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-02-11T16:00:24.444 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:24.489 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.083) 0:01:11.828 ****** 2020-02-11T16:00:24.526 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-02-11T16:00:24.528 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-11T16:00:24.570 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.080) 0:01:11.909 ****** 2020-02-11T16:00:24.600 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-02-11T16:00:24.641 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.071) 0:01:11.980 ****** 2020-02-11T16:00:24.668 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-02-11T16:00:24.670 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:24.707 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.066) 0:01:12.046 ****** 2020-02-11T16:00:24.713 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-02-11T16:00:24.713 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "checksum": "5b601f2fa82999d906840a797df62d8ddf28ca4b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "fef9572bd2396dd9d379b457b328afbe", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581436824.13-119759283245045/source", "state": "file", "uid": 0} 2020-02-11T16:00:24.761 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.053) 0:01:12.100 ****** 2020-02-11T16:00:24.789 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-02-11T16:00:24.791 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => { "msg": "Host smithi052.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-02-11T16:00:24.827 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.066) 0:01:12.166 ****** 2020-02-11T16:00:24.864 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-02-11T16:00:24.866 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-02-11T16:00:24.909 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.081) 0:01:12.248 ****** 2020-02-11T16:00:24.935 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-02-11T16:00:24.936 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** ok: [smithi088.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-11T16:00:24.977 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:24 +0000 (0:00:00.067) 0:01:12.316 ****** 2020-02-11T16:00:25.021 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.044) 0:01:12.361 ****** 2020-02-11T16:00:25.282 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-02-11T16:00:25.284 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.095980", "end": "2020-02-11 16:00:25.257774", "rc": 0, "start": "2020-02-11 16:00:25.161794", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-02-11T16:00:25.331 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.305) 0:01:12.666 ****** 2020-02-11T16:00:25.353 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-02-11T16:00:25.354 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:25.393 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.066) 0:01:12.733 ****** 2020-02-11T16:00:25.420 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-02-11T16:00:25.420 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:25.463 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.069) 0:01:12.802 ****** 2020-02-11T16:00:25.500 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-02-11T16:00:25.500 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:25.538 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.074) 0:01:12.877 ****** 2020-02-11T16:00:25.564 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-02-11T16:00:25.565 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:25.603 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.064) 0:01:12.942 ****** 2020-02-11T16:00:25.619 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-02-11T16:00:25.620 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "2da7f101e29cfe8f3b630dbd6da82b4f9a749fee", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "md5sum": "a8fc4394319cef97573dd9cbb76e901f", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 304, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581436825.09-122193067139104/source", "state": "file", "uid": 0} 2020-02-11T16:00:25.631 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-02-11T16:00:25.632 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:25.670 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.067) 0:01:13.009 ****** 2020-02-11T16:00:25.697 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-02-11T16:00:25.698 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:25.736 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.065) 0:01:13.075 ****** 2020-02-11T16:00:25.772 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-02-11T16:00:25.773 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-11T16:00:25.775 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-11T16:00:25.822 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.086) 0:01:13.161 ****** 2020-02-11T16:00:25.859 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-02-11T16:00:25.860 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:25.904 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.079) 0:01:13.241 ****** 2020-02-11T16:00:25.939 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:25.977 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:25 +0000 (0:00:00.076) 0:01:13.317 ****** 2020-02-11T16:00:26.007 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-02-11T16:00:26.009 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-11T16:00:26.051 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.073) 0:01:13.390 ****** 2020-02-11T16:00:26.083 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-02-11T16:00:26.099 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:26.131 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.079) 0:01:13.470 ****** 2020-02-11T16:00:26.158 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-02-11T16:00:26.159 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-11T16:00:26.201 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.070) 0:01:13.540 ****** 2020-02-11T16:00:26.207 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-02-11T16:00:26.209 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "ddfaa38799b2dd4c23933a375aa4c3ff61bf7625", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "md5sum": "28027cc3431fdd12cf0ab83482917668", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 338, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581436825.64-128389694249634/source", "state": "file", "uid": 0} 2020-02-11T16:00:26.253 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.050) 0:01:13.591 ****** 2020-02-11T16:00:26.262 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:26.298 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.045) 0:01:13.637 ****** 2020-02-11T16:00:26.338 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-02-11T16:00:26.340 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:26.376 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.078) 0:01:13.715 ****** 2020-02-11T16:00:26.412 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:26.452 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.076) 0:01:13.792 ****** 2020-02-11T16:00:26.492 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-02-11T16:00:26.493 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:26.537 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.084) 0:01:13.876 ****** 2020-02-11T16:00:26.564 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-02-11T16:00:26.566 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-11T16:00:26.615 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.078) 0:01:13.955 ****** 2020-02-11T16:00:26.651 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:26.699 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.083) 0:01:14.039 ****** 2020-02-11T16:00:26.739 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:26.781 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.081) 0:01:14.120 ****** 2020-02-11T16:00:26.793 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-02-11T16:00:26.794 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-02-11T16:00:26.817 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-02-11T16:00:26.818 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:26.862 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.079) 0:01:14.200 ****** 2020-02-11T16:00:26.890 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-02-11T16:00:26.892 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:26.935 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:26 +0000 (0:00:00.074) 0:01:14.275 ****** 2020-02-11T16:00:26.972 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:27.014 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:27 +0000 (0:00:00.078) 0:01:14.353 ****** 2020-02-11T16:00:27.051 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-02-11T16:00:27.052 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:27.092 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:27 +0000 (0:00:00.078) 0:01:14.431 ****** 2020-02-11T16:00:27.121 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi052.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-11T16:00:27.155 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:27 +0000 (0:00:00.063) 0:01:14.495 ****** 2020-02-11T16:00:27.181 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-02-11T16:00:27.222 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:27 +0000 (0:00:00.066) 0:01:14.561 ****** 2020-02-11T16:00:27.253 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi088.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-02-11T16:00:27.298 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:27 +0000 (0:00:00.076) 0:01:14.637 ****** 2020-02-11T16:00:27.342 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:27 +0000 (0:00:00.043) 0:01:14.681 ****** 2020-02-11T16:00:27.551 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-02-11T16:00:27.552 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-11T16:00:27.588 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:27 +0000 (0:00:00.245) 0:01:14.927 ****** 2020-02-11T16:00:28.213 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-02-11T16:00:28.213 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "2da7f101e29cfe8f3b630dbd6da82b4f9a749fee", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "md5sum": "a8fc4394319cef97573dd9cbb76e901f", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 304, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581436827.63-41287821371346/source", "state": "file", "uid": 0} 2020-02-11T16:00:28.629 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-02-11T16:00:28.629 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum module rather than running 'yum'. If you need to use command because yum is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-02-11T16:00:28.631 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:01.066303", "end": "2020-02-11 16:00:28.595739", "rc": 0, "start": "2020-02-11 16:00:27.529436", "stderr": "", "stderr_lines": [], "stdout": "229 files removed", "stdout_lines": ["229 files removed"]} 2020-02-11T16:00:28.706 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:28 +0000 (0:00:01.113) 0:01:16.041 ****** 2020-02-11T16:00:28.730 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-11T16:00:28.732 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:28.781 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:28 +0000 (0:00:00.079) 0:01:16.121 ****** 2020-02-11T16:00:28.797 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-02-11T16:00:28.798 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "ddfaa38799b2dd4c23933a375aa4c3ff61bf7625", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "md5sum": "28027cc3431fdd12cf0ab83482917668", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 338, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581436828.22-151196320443554/source", "state": "file", "uid": 0} 2020-02-11T16:00:28.843 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:28 +0000 (0:00:00.061) 0:01:16.182 ****** 2020-02-11T16:00:28.848 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-02-11T16:00:28.849 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:28.889 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:28 +0000 (0:00:00.045) 0:01:16.228 ****** 2020-02-11T16:00:28.913 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-02-11T16:00:28.915 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:28.951 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:28 +0000 (0:00:00.062) 0:01:16.291 ****** 2020-02-11T16:00:28.987 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-11T16:00:28.989 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:29.026 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:29 +0000 (0:00:00.074) 0:01:16.366 ****** 2020-02-11T16:00:29.052 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:29.094 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:29 +0000 (0:00:00.067) 0:01:16.434 ****** 2020-02-11T16:00:29.121 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-02-11T16:00:29.123 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:29.159 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:29 +0000 (0:00:00.064) 0:01:16.498 ****** 2020-02-11T16:00:29.184 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-02-11T16:00:29.186 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:29.222 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:29 +0000 (0:00:00.063) 0:01:16.562 ****** 2020-02-11T16:00:29.248 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-02-11T16:00:29.250 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:29.292 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:29 +0000 (0:00:00.069) 0:01:16.632 ****** 2020-02-11T16:00:29.381 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-02-11T16:00:29.382 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-02-11T16:00:29.520 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-02-11T16:00:29.520 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.034121", "end": "2020-02-11 16:00:29.500304", "rc": 0, "start": "2020-02-11 16:00:29.466183", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:00:29.568 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:29 +0000 (0:00:00.276) 0:01:16.908 ****** 2020-02-11T16:00:29.869 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-02-11T16:00:29.870 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-02-11T16:00:29.920 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:29 +0000 (0:00:00.351) 0:01:17.260 ****** 2020-02-11T16:00:31.258 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-02-11T16:00:31.259 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:01.117442", "end": "2020-02-11 16:00:31.237132", "rc": 0, "start": "2020-02-11 16:00:30.119690", "stderr": "", "stderr_lines": [], "stdout": "229 files removed", "stdout_lines": ["229 files removed"]} 2020-02-11T16:00:31.297 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:31 +0000 (0:00:01.376) 0:01:18.636 ****** 2020-02-11T16:00:31.323 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-11T16:00:31.324 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:31.380 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:31 +0000 (0:00:00.083) 0:01:18.719 ****** 2020-02-11T16:00:31.406 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-02-11T16:00:31.407 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:31.445 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:31 +0000 (0:00:00.065) 0:01:18.784 ****** 2020-02-11T16:00:31.472 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:31.523 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:31 +0000 (0:00:00.077) 0:01:18.862 ****** 2020-02-11T16:00:31.549 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-11T16:00:31.550 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:31.598 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:31 +0000 (0:00:00.075) 0:01:18.938 ****** 2020-02-11T16:00:31.624 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-02-11T16:00:31.626 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:31.668 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:31 +0000 (0:00:00.069) 0:01:19.007 ****** 2020-02-11T16:00:31.699 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:31.732 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:31 +0000 (0:00:00.063) 0:01:19.071 ****** 2020-02-11T16:00:31.758 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-02-11T16:00:31.760 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:31.810 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:31 +0000 (0:00:00.078) 0:01:19.150 ****** 2020-02-11T16:00:31.841 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:31.877 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:31 +0000 (0:00:00.066) 0:01:19.217 ****** 2020-02-11T16:00:32.532 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-02-11T16:00:32.533 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.434918", "end": "2020-02-11 16:00:32.500314", "rc": 0, "start": "2020-02-11 16:00:32.065396", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:00:32.585 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:32 +0000 (0:00:00.707) 0:01:19.924 ****** 2020-02-11T16:00:39.204 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-02-11T16:00:39.206 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-02-11T16:00:39.250 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:39 +0000 (0:00:06.664) 0:01:26.589 ****** 2020-02-11T16:00:39.277 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-02-11T16:00:39.279 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:39.318 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:39 +0000 (0:00:00.067) 0:01:26.657 ****** 2020-02-11T16:00:39.344 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-02-11T16:00:39.345 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:39.386 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:39 +0000 (0:00:00.068) 0:01:26.726 ****** 2020-02-11T16:00:39.388 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:39.417 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:39.419 INFO:teuthology.task.ansible.out:TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:39.459 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:39 +0000 (0:00:00.072) 0:01:26.798 ****** 2020-02-11T16:00:39.460 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:39.487 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:39.489 INFO:teuthology.task.ansible.out:TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:39.530 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:39 +0000 (0:00:00.070) 0:01:26.869 ****** 2020-02-11T16:00:39.531 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:40.020 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:40.021 INFO:teuthology.task.ansible.out:TASK [common : Add krb5 config file] ******************************************* ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-02-11T16:00:40.062 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:40 +0000 (0:00:00.532) 0:01:27.402 ****** 2020-02-11T16:00:40.064 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:40.976 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-02-11T16:00:40.977 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-02-11T16:00:41.028 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:41 +0000 (0:00:00.966) 0:01:28.368 ****** 2020-02-11T16:00:41.416 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-02-11T16:00:41.418 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-02-11T16:00:41.465 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:41 +0000 (0:00:00.436) 0:01:28.804 ****** 2020-02-11T16:00:41.491 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-02-11T16:00:41.493 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:41.540 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:41 +0000 (0:00:00.074) 0:01:28.879 ****** 2020-02-11T16:00:41.663 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-11T16:00:41.665 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-02-11T16:00:41.698 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-02-11T16:00:41.699 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:41.861 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:41 +0000 (0:00:00.321) 0:01:29.201 ****** 2020-02-11T16:00:41.899 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-02-11T16:00:41.901 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:41.939 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:41 +0000 (0:00:00.077) 0:01:29.278 ****** 2020-02-11T16:00:41.970 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-02-11T16:00:41.973 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:42.012 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:42 +0000 (0:00:00.072) 0:01:29.351 ****** 2020-02-11T16:00:42.144 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-11T16:00:42.145 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-02-11T16:00:42.532 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-02-11T16:00:42.577 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:42 +0000 (0:00:00.564) 0:01:29.916 ****** 2020-02-11T16:00:42.593 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-11T16:00:42.595 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-02-11T16:00:42.655 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:42 +0000 (0:00:00.079) 0:01:29.995 ****** 2020-02-11T16:00:42.852 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-02-11T16:00:42.852 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-11T16:00:42.915 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:42 +0000 (0:00:00.259) 0:01:30.254 ****** 2020-02-11T16:00:43.370 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-11T16:00:43.377 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-02-11T16:00:43.556 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-02-11T16:00:43.557 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-02-11T16:00:43.595 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:43 +0000 (0:00:00.679) 0:01:30.934 ****** 2020-02-11T16:00:43.830 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-11T16:00:43.831 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-02-11T16:00:44.128 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-11T16:00:44.130 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-02-11T16:00:44.267 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-11T16:00:44.268 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-02-11T16:00:44.328 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:44 +0000 (0:00:00.733) 0:01:31.667 ****** 2020-02-11T16:00:44.355 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:44.356 INFO:teuthology.task.ansible.out:TASK [common : Include apt_system vars] **************************************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:44.399 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:44 +0000 (0:00:00.070) 0:01:31.738 ****** 2020-02-11T16:00:44.435 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-02-11T16:00:44.437 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-02-11T16:00:44.502 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:44 +0000 (0:00:00.100) 0:01:31.839 ****** 2020-02-11T16:00:44.634 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:44.635 INFO:teuthology.task.ansible.out:TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi052.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-02-11T16:00:44.698 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi088.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-02-11T16:00:44.739 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:44 +0000 (0:00:00.240) 0:01:32.079 ****** 2020-02-11T16:00:44.776 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-02-11T16:00:44.778 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-11T16:00:44.787 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-11T16:00:44.799 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-11T16:00:44.810 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-11T16:00:44.811 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:44.866 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:44 +0000 (0:00:00.126) 0:01:32.205 ****** 2020-02-11T16:00:45.114 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi052.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-02-11T16:00:45.157 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:45 +0000 (0:00:00.291) 0:01:32.496 ****** 2020-02-11T16:00:45.371 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-02-11T16:00:45.372 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-11T16:00:45.411 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:45 +0000 (0:00:00.253) 0:01:32.750 ****** 2020-02-11T16:00:45.818 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-02-11T16:00:45.858 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:45 +0000 (0:00:00.446) 0:01:33.197 ****** 2020-02-11T16:00:45.886 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-02-11T16:00:45.888 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi052.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-02-11T16:00:45.935 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:45 +0000 (0:00:00.077) 0:01:33.274 ****** 2020-02-11T16:00:46.354 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-02-11T16:00:46.418 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-02-11T16:00:46.420 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-02-11T16:00:46.472 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:46 +0000 (0:00:00.535) 0:01:33.810 ****** 2020-02-11T16:00:46.838 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-11T16:00:46.838 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-02-11T16:00:46.887 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:46 +0000 (0:00:00.416) 0:01:34.226 ****** 2020-02-11T16:00:46.914 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-02-11T16:00:46.921 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:46.956 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:46 +0000 (0:00:00.069) 0:01:34.296 ****** 2020-02-11T16:00:46.962 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-02-11T16:00:46.964 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-02-11T16:00:47.022 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:47 +0000 (0:00:00.065) 0:01:34.361 ****** 2020-02-11T16:00:47.028 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-02-11T16:00:47.029 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-02-11T16:00:47.068 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:47 +0000 (0:00:00.046) 0:01:34.408 ****** 2020-02-11T16:00:47.077 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-02-11T16:00:47.078 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:47.116 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:47 +0000 (0:00:00.047) 0:01:34.455 ****** 2020-02-11T16:00:47.278 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-02-11T16:00:47.280 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-02-11T16:00:47.316 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:47 +0000 (0:00:00.200) 0:01:34.656 ****** 2020-02-11T16:00:47.360 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-02-11T16:00:47.361 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-11T16:00:47.363 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi052.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-11T16:00:47.405 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:47 +0000 (0:00:00.088) 0:01:34.745 ****** 2020-02-11T16:00:47.411 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-11T16:00:47.412 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-11T16:00:47.413 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-11T16:00:47.452 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:47 +0000 (0:00:00.046) 0:01:34.792 ****** 2020-02-11T16:00:47.667 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-02-11T16:00:47.669 INFO:teuthology.task.ansible.out:fatal: [smithi088.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-02-11T16:00:47.706 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:47 +0000 (0:00:00.253) 0:01:35.045 ****** 2020-02-11T16:00:47.746 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:47.789 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:47 +0000 (0:00:00.083) 0:01:35.128 ****** 2020-02-11T16:00:48.257 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-02-11T16:00:48.296 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:48 +0000 (0:00:00.507) 0:01:35.636 ****** 2020-02-11T16:00:48.434 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-02-11T16:00:48.435 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-02-11T16:00:48.477 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:48 +0000 (0:00:00.180) 0:01:35.816 ****** 2020-02-11T16:00:48.515 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-02-11T16:00:48.517 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:48.582 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:48 +0000 (0:00:00.104) 0:01:35.921 ****** 2020-02-11T16:00:49.111 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-02-11T16:00:49.114 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-02-11 15:58:52 UTC", "ActiveEnterTimestampMonotonic": "11826549", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service nss-lookup.target time-sync.target network.target systemd-journald.socket -.mount local-fs.target var-run.mount system.slice sysinit.target tmp.mount basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-02-11 15:58:52 UTC", "AssertTimestampMonotonic": "11825567", "Before": "getty@tty1.service shutdown.target plymouth-quit.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-02-11 15:58:52 UTC", "ConditionTimestampMonotonic": "11825566", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-02-11T16:00:49.115 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2398", "ExecMainStartTimestamp": "Tue 2020-02-11 15:58:52 UTC", "ExecMainStartTimestampMonotonic": "11826516", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Tue 2020-02-11 15:58:52 UTC] ; stop_time=[n/a] ; pid=2398 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-02-11 15:58:52 UTC", "InactiveExitTimestampMonotonic": "11826549", "InvocationID": "6595db156c59494197994b14833349ef", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-02-11T16:00:49.117 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2398", "MemoryAccounting": "yes", "MemoryCurrent": "1576960", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-02-11T16:00:49.118 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-02-11 15:58:52 UTC", "StateChangeTimestampMonotonic": "11826549", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-02-11 15:58:52 UTC", "WatchdogTimestampMonotonic": "11826548", "WatchdogUSec": "0"}} TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-02-11T16:00:49.169 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:49 +0000 (0:00:00.587) 0:01:36.508 ****** 2020-02-11T16:00:49.213 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:49 +0000 (0:00:00.044) 0:01:36.553 ****** 2020-02-11T16:00:49.411 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-02-11T16:00:49.413 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001636", "end": "2020-02-11 16:00:49.388571", "rc": 0, "start": "2020-02-11 16:00:49.386935", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-02-11T16:00:49.452 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:49 +0000 (0:00:00.239) 0:01:36.792 ****** 2020-02-11T16:00:49.677 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-02-11T16:00:49.677 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-02-11T16:00:49.731 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:49 +0000 (0:00:00.278) 0:01:37.071 ****** 2020-02-11T16:00:49.771 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-02-11T16:00:49.772 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:49.810 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:49 +0000 (0:00:00.078) 0:01:37.149 ****** 2020-02-11T16:00:50.035 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-02-11T16:00:50.036 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-11T16:00:50.078 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:50 +0000 (0:00:00.268) 0:01:37.418 ****** 2020-02-11T16:00:50.332 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi052.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-02-11T16:00:50.378 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:50 +0000 (0:00:00.300) 0:01:37.718 ****** 2020-02-11T16:00:50.409 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:50.410 INFO:teuthology.task.ansible.out:TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-02-11T16:00:50.410 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:00:50.411 INFO:teuthology.task.ansible.out: 2020-02-11T16:00:50.454 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:50 +0000 (0:00:00.072) 0:01:37.790 ****** 2020-02-11T16:00:50.974 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-02-11T16:00:51.018 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:51 +0000 (0:00:00.567) 0:01:38.357 ****** 2020-02-11T16:00:51.341 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-02-11 15:58:33 UTC", "ActiveEnterTimestampMonotonic": "14680704", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target tmp.mount systemd-tmpfiles-setup.service time-sync.target network.target system.slice basic.target nss-lookup.target systemd-journald.socket var-run.mount -.mount local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-02-11 15:58:33 UTC", "AssertTimestampMonotonic": "14679724", "Before": "multi-user.target getty@tty1.service xdm.service plymouth-quit.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-02-11 15:58:33 UTC", "ConditionTimestampMonotonic": "14679724", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket s 2020-02-11T16:00:51.343 INFO:teuthology.task.ansible.out:hutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2371", "ExecMainStartTimestamp": "Tue 2020-02-11 15:58:33 UTC", "ExecMainStartTimestampMonotonic": "14680665", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Tue 2020-02-11 15:58:33 UTC] ; stop_time=[n/a] ; pid=2371 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-02-11 15:58:33 UTC", "InactiveExitTimestampMonotonic": "14680704", "InvocationID": "bee297445a12484089a42987fd67a0cc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "L 2020-02-11T16:00:51.345 INFO:teuthology.task.ansible.out:imitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127467", "LimitNPROCSoft": "127467", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127467", "LimitSIGPENDINGSoft": "127467", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2371", "MemoryAccounting": "yes", "MemoryCurrent": "1585152", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime 2020-02-11T16:00:51.346 INFO:teuthology.task.ansible.out:": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-02-11 15:58:33 UTC", "StateChangeTimestampMonotonic": "14680704", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-02-11 15:58:33 UTC", "WatchdogTimestampMonotonic": "14680703", "WatchdogUSec": "0"}} 2020-02-11T16:00:51.379 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:51 +0000 (0:00:00.360) 0:01:38.718 ****** 2020-02-11T16:00:51.591 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-02-11T16:00:51.593 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001877", "end": "2020-02-11 16:00:51.560312", "rc": 0, "start": "2020-02-11 16:00:51.558435", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-02-11T16:00:51.628 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:51 +0000 (0:00:00.248) 0:01:38.967 ****** 2020-02-11T16:00:54.661 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-02-11T16:00:54.662 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: python3-policycoreutils-2.9-3.el8_1.1.noarch", "Installed: policycoreutils-2.9-3.el8_1.1.x86_64", "Installed: policycoreutils-python-utils-2.9-3.el8_1.1.noarch", "Removed: python3-policycoreutils-2.9-3.el8.noarch", "Removed: policycoreutils-2.9-3.el8.x86_64", "Removed: policycoreutils-python-utils-2.9-3.el8.noarch"]} 2020-02-11T16:00:54.705 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:54 +0000 (0:00:03.072) 0:01:42.040 ****** 2020-02-11T16:00:55.710 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-02-11T16:00:55.749 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:55 +0000 (0:00:01.048) 0:01:43.089 ****** 2020-02-11T16:00:57.169 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-02-11T16:00:57.169 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: python3-policycoreutils-2.9-3.el8_1.1.noarch", "Installed: policycoreutils-2.9-3.el8_1.1.x86_64", "Installed: policycoreutils-python-utils-2.9-3.el8_1.1.noarch", "Removed: python3-policycoreutils-2.9-3.el8.noarch", "Removed: policycoreutils-2.9-3.el8.x86_64", "Removed: policycoreutils-python-utils-2.9-3.el8.noarch"]} 2020-02-11T16:00:57.214 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:57 +0000 (0:00:01.464) 0:01:44.553 ****** 2020-02-11T16:00:58.029 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-02-11T16:00:58.030 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-02-11T16:00:58.071 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:58 +0000 (0:00:00.857) 0:01:45.410 ****** 2020-02-11T16:00:58.234 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-02-11T16:00:58.236 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-02-11T16:00:58.274 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:00:58 +0000 (0:00:00.203) 0:01:45.614 ****** 2020-02-11T16:01:00.471 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-02-11T16:01:00.473 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-02-11T16:01:00.512 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:00 +0000 (0:00:02.237) 0:01:47.851 ****** 2020-02-11T16:01:14.372 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-02-11T16:01:14.373 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.103316", "end": "2020-02-11 16:01:14.343503", "failed_when_result": false, "rc": 0, "start": "2020-02-11 16:00:58.240187", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-02-11T16:01:14.417 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:14 +0000 (0:00:13.899) 0:02:01.751 ****** 2020-02-11T16:01:14.881 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-02-11T16:01:14.881 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-02-11T16:01:14.921 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:14 +0000 (0:00:00.508) 0:02:02.260 ****** 2020-02-11T16:01:15.131 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-02-11T16:01:15.133 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012059", "end": "2020-02-11 16:01:15.108188", "rc": 0, "start": "2020-02-11 16:01:15.096129", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:01:15.180 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:15 +0000 (0:00:00.258) 0:02:02.519 ****** 2020-02-11T16:01:15.375 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-02-11T16:01:15.377 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.001807", "end": "2020-02-11 16:01:15.349924", "rc": 0, "start": "2020-02-11 16:01:15.348117", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:01:15.419 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:15 +0000 (0:00:00.238) 0:02:02.758 ****** 2020-02-11T16:01:17.564 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-02-11T16:01:17.565 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.826201", "end": "2020-02-11 16:01:17.538494", "failed_when_result": false, "rc": 0, "start": "2020-02-11 16:01:00.712293", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-02-11T16:01:17.605 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:17 +0000 (0:00:02.186) 0:02:04.944 ****** 2020-02-11T16:01:18.129 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-02-11T16:01:18.167 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:18 +0000 (0:00:00.562) 0:02:05.506 ****** 2020-02-11T16:01:18.391 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-02-11T16:01:18.392 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013982", "end": "2020-02-11 16:01:18.369166", "rc": 0, "start": "2020-02-11 16:01:18.355184", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:01:18.434 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:18 +0000 (0:00:00.266) 0:02:05.773 ****** 2020-02-11T16:01:18.641 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-02-11T16:01:18.643 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.001729", "end": "2020-02-11 16:01:18.619195", "rc": 0, "start": "2020-02-11 16:01:18.617466", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:01:18.686 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:18 +0000 (0:00:00.252) 0:02:06.026 ****** 2020-02-11T16:01:31.478 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-02-11T16:01:31.478 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:15.851368", "end": "2020-02-11 16:01:31.446508", "rc": 0, "start": "2020-02-11 16:01:15.595140", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:01:31.519 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:31 +0000 (0:00:12.832) 0:02:18.858 ****** 2020-02-11T16:01:31.716 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-02-11T16:01:31.718 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-02-11T16:01:31.754 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:31 +0000 (0:00:00.234) 0:02:19.093 ****** 2020-02-11T16:01:31.792 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi088.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-02-11T16:01:31.833 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:31 +0000 (0:00:00.075) 0:02:19.169 ****** 2020-02-11T16:01:31.866 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-02-11T16:01:31.867 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-11T16:01:31.904 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:31 +0000 (0:00:00.074) 0:02:19.243 ****** 2020-02-11T16:01:31.966 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi088.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-02-11T16:01:31.999 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:31 +0000 (0:00:00.095) 0:02:19.338 ****** 2020-02-11T16:01:32.046 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-02-11T16:01:32.048 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-11T16:01:32.089 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:32 +0000 (0:00:00.089) 0:02:19.428 ****** 2020-02-11T16:01:32.287 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-02-11T16:01:32.288 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-11T16:01:32.326 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:32 +0000 (0:00:00.237) 0:02:19.665 ****** 2020-02-11T16:01:32.519 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-02-11T16:01:32.520 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "name": "ubuntu", "state": "present", "system": false} 2020-02-11T16:01:32.564 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:32 +0000 (0:00:00.238) 0:02:19.904 ****** 2020-02-11T16:01:32.593 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-02-11T16:01:32.594 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:32.633 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:32 +0000 (0:00:00.068) 0:02:19.972 ****** 2020-02-11T16:01:32.659 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-02-11T16:01:32.661 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:32.704 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:32 +0000 (0:00:00.071) 0:02:20.044 ****** 2020-02-11T16:01:32.932 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-02-11T16:01:32.934 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-02-11T16:01:32.971 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:32 +0000 (0:00:00.266) 0:02:20.310 ****** 2020-02-11T16:01:33.537 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-02-11T16:01:33.538 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-02-11T16:01:33.577 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:33 +0000 (0:00:00.606) 0:02:20.916 ****** 2020-02-11T16:01:33.603 INFO:teuthology.task.ansible.out: 2020-02-11T16:01:33.604 INFO:teuthology.task.ansible.out:TASK [testnode : Set hostname var] ********************************************* ok: [smithi088.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi088"}, "changed": false} 2020-02-11T16:01:33.642 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:33 +0000 (0:00:00.065) 0:02:20.981 ****** 2020-02-11T16:01:34.659 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-02-11T16:01:34.661 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi088.front.sepia.ceph.com", "ansible_hostname": "smithi088", "ansible_nodename": "smithi088"}, "changed": true, "name": "smithi088"} 2020-02-11T16:01:34.697 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:34 +0000 (0:00:01.055) 0:02:22.037 ****** 2020-02-11T16:01:35.178 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-02-11T16:01:35.180 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-02-11T16:01:35.220 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:35 +0000 (0:00:00.522) 0:02:22.559 ****** 2020-02-11T16:01:35.494 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-02-11T16:01:35.496 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.605821", "end": "2020-02-11 16:01:35.473374", "rc": 0, "start": "2020-02-11 16:01:18.867553", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:01:35.545 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:35 +0000 (0:00:00.324) 0:02:22.884 ****** 2020-02-11T16:01:35.702 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-02-11T16:01:35.704 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-02-11T16:01:35.743 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:35 +0000 (0:00:00.198) 0:02:23.083 ****** 2020-02-11T16:01:35.759 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-02-11T16:01:35.760 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-02-11T16:01:35.801 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:35 +0000 (0:00:00.057) 0:02:23.140 ****** 2020-02-11T16:01:35.847 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-02-11T16:01:35.848 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-02-11T16:01:35.887 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:35 +0000 (0:00:00.086) 0:02:23.227 ****** 2020-02-11T16:01:35.928 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-02-11T16:01:35.930 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-11T16:01:35.971 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:35 +0000 (0:00:00.083) 0:02:23.310 ****** 2020-02-11T16:01:36.026 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi052.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-02-11T16:01:36.066 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:36 +0000 (0:00:00.095) 0:02:23.405 ****** 2020-02-11T16:01:36.107 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-02-11T16:01:36.108 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-11T16:01:36.145 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:36 +0000 (0:00:00.078) 0:02:23.484 ****** 2020-02-11T16:01:36.326 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-02-11T16:01:36.327 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-02-11T16:01:36.370 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:36 +0000 (0:00:00.225) 0:02:23.709 ****** 2020-02-11T16:01:36.376 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-02-11T16:01:36.377 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-11T16:01:36.418 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:36 +0000 (0:00:00.047) 0:02:23.757 ****** 2020-02-11T16:01:36.628 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-02-11T16:01:36.630 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "name": "ubuntu", "state": "present", "system": false} 2020-02-11T16:01:36.692 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:36 +0000 (0:00:00.274) 0:02:24.031 ****** 2020-02-11T16:01:36.719 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-02-11T16:01:36.721 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:36.758 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:36 +0000 (0:00:00.065) 0:02:24.097 ****** 2020-02-11T16:01:36.784 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-02-11T16:01:36.786 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:36.826 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:36 +0000 (0:00:00.068) 0:02:24.166 ****** 2020-02-11T16:01:36.865 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-02-11T16:01:36.900 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:36 +0000 (0:00:00.073) 0:02:24.240 ****** 2020-02-11T16:01:37.055 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-02-11T16:01:37.056 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-02-11T16:01:37.092 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:37 +0000 (0:00:00.191) 0:02:24.432 ****** 2020-02-11T16:01:37.108 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-02-11T16:01:37.109 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-11T16:01:37.156 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:37 +0000 (0:00:00.063) 0:02:24.495 ****** 2020-02-11T16:01:37.386 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-02-11T16:01:37.388 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-02-11T16:01:37.426 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:37 +0000 (0:00:00.270) 0:02:24.766 ****** 2020-02-11T16:01:37.642 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-02-11T16:01:37.643 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1209, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-02-11T16:01:37.683 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:37 +0000 (0:00:00.256) 0:02:25.022 ****** 2020-02-11T16:01:37.710 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-02-11T16:01:37.749 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:37 +0000 (0:00:00.066) 0:02:25.088 ****** 2020-02-11T16:01:37.786 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-02-11T16:01:37.788 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi052"}, "changed": false} 2020-02-11T16:01:37.832 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:37 +0000 (0:00:00.083) 0:02:25.172 ****** 2020-02-11T16:01:38.167 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-02-11T16:01:38.168 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-02-11T16:01:38.207 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:38 +0000 (0:00:00.374) 0:02:25.546 ****** 2020-02-11T16:01:38.432 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-02-11T16:01:38.434 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi052.front.sepia.ceph.com", "ansible_hostname": "smithi052", "ansible_nodename": "smithi052"}, "changed": true, "name": "smithi052"} 2020-02-11T16:01:38.477 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:38 +0000 (0:00:00.268) 0:02:25.815 ****** 2020-02-11T16:01:38.687 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-02-11T16:01:38.688 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-02-11T16:01:38.731 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:38 +0000 (0:00:00.255) 0:02:26.070 ****** 2020-02-11T16:01:38.962 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-02-11T16:01:38.999 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:38 +0000 (0:00:00.268) 0:02:26.338 ****** 2020-02-11T16:01:39.493 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-02-11T16:01:39.530 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:39 +0000 (0:00:00.530) 0:02:26.869 ****** 2020-02-11T16:01:40.140 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-02-11T16:01:40.141 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-02-11T16:01:40.189 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:40 +0000 (0:00:00.659) 0:02:27.529 ****** 2020-02-11T16:01:40.722 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-02-11T16:01:40.723 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-02-11T16:01:40.775 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:40 +0000 (0:00:00.585) 0:02:28.115 ****** 2020-02-11T16:01:40.781 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-02-11T16:01:40.781 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-02-11T16:01:40.783 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.801815", "end": "2020-02-11 16:01:40.718802", "rc": 0, "start": "2020-02-11 16:01:38.916987", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:01:40.836 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:40 +0000 (0:00:00.060) 0:02:28.176 ****** 2020-02-11T16:01:40.989 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-11T16:01:41.047 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:41 +0000 (0:00:00.210) 0:02:28.386 ****** 2020-02-11T16:01:41.279 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-02-11T16:01:41.315 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:41 +0000 (0:00:00.267) 0:02:28.654 ****** 2020-02-11T16:01:41.358 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi088.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-02-11T16:01:41.404 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:41 +0000 (0:00:00.089) 0:02:28.743 ****** 2020-02-11T16:01:41.431 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-02-11T16:01:41.471 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:41 +0000 (0:00:00.067) 0:02:28.811 ****** 2020-02-11T16:01:41.572 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-02-11T16:01:41.582 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1209, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-02-11T16:01:41.622 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:41 +0000 (0:00:00.150) 0:02:28.961 ****** 2020-02-11T16:01:42.137 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-02-11T16:01:42.180 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:42 +0000 (0:00:00.558) 0:02:29.519 ****** 2020-02-11T16:01:42.186 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-02-11T16:01:42.187 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.480261", "end": "2020-02-11 16:01:42.133750", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-02-11 16:01:41.653489", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-02-11T16:01:42.190 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-02-11T16:01:42.229 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:42 +0000 (0:00:00.049) 0:02:29.568 ****** 2020-02-11T16:01:42.271 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-02-11T16:01:42.281 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:42.310 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:42 +0000 (0:00:00.081) 0:02:29.650 ****** 2020-02-11T16:01:42.348 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-02-11T16:01:42.349 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-11T16:01:42.360 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-02-11T16:01:42.401 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:42 +0000 (0:00:00.088) 0:02:29.738 ****** 2020-02-11T16:01:42.435 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-02-11T16:01:42.436 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:42.476 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:42 +0000 (0:00:00.077) 0:02:29.815 ****** 2020-02-11T16:01:42.513 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-11T16:01:42.514 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-02-11T16:01:42.553 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:42 +0000 (0:00:00.077) 0:02:29.893 ****** 2020-02-11T16:01:42.598 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-02-11T16:01:42.599 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:42.635 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:42 +0000 (0:00:00.081) 0:02:29.974 ****** 2020-02-11T16:01:42.671 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-02-11T16:01:42.672 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:42.709 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:42 +0000 (0:00:00.074) 0:02:30.048 ****** 2020-02-11T16:01:42.714 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-02-11T16:01:42.715 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-02-11T16:01:42.753 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:42 +0000 (0:00:00.044) 0:02:30.093 ****** 2020-02-11T16:01:42.914 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-02-11T16:01:42.915 INFO:teuthology.task.ansible.out:fatal: [smithi088.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006614", "end": "2020-02-11 16:01:42.890159", "msg": "non-zero return code", "rc": 1, "start": "2020-02-11 16:01:42.883545", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} 2020-02-11T16:01:42.916 INFO:teuthology.task.ansible.out:...ignoring 2020-02-11T16:01:42.959 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:42 +0000 (0:00:00.206) 0:02:30.299 ****** 2020-02-11T16:01:42.992 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-02-11T16:01:42.993 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:43.032 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:43 +0000 (0:00:00.072) 0:02:30.372 ****** 2020-02-11T16:01:44.919 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.941172", "end": "2020-02-11 16:01:44.891248", "rc": 0, "start": "2020-02-11 16:01:42.950076", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:01:44.986 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:44 +0000 (0:00:01.953) 0:02:32.325 ****** 2020-02-11T16:01:45.536 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi052.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-02-11T16:01:45.570 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:45 +0000 (0:00:00.581) 0:02:32.906 ****** 2020-02-11T16:01:45.593 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-02-11T16:01:45.642 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:45 +0000 (0:00:00.071) 0:02:32.978 ****** 2020-02-11T16:01:45.644 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-02-11T16:01:45.645 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+258+1d2a1d58.1.x86_64"]} 2020-02-11T16:01:45.683 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:45 +0000 (0:00:00.043) 0:02:33.022 ****** 2020-02-11T16:01:46.358 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-02-11T16:01:46.358 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.502820", "end": "2020-02-11 16:01:46.333527", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-02-11 16:01:45.830707", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-02-11T16:01:46.401 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:46 +0000 (0:00:00.718) 0:02:33.740 ****** 2020-02-11T16:01:46.438 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-02-11T16:01:46.440 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:46.477 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:46 +0000 (0:00:00.076) 0:02:33.816 ****** 2020-02-11T16:01:46.514 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-02-11T16:01:46.515 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-11T16:01:46.525 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-02-11T16:01:46.565 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:46 +0000 (0:00:00.088) 0:02:33.905 ****** 2020-02-11T16:01:46.602 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:46.639 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:46 +0000 (0:00:00.074) 0:02:33.979 ****** 2020-02-11T16:01:46.675 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-11T16:01:46.677 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-02-11T16:01:46.727 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:46 +0000 (0:00:00.087) 0:02:34.066 ****** 2020-02-11T16:01:46.764 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-02-11T16:01:46.766 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:46.800 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:46 +0000 (0:00:00.073) 0:02:34.139 ****** 2020-02-11T16:01:46.836 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-02-11T16:01:46.838 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:46.874 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:46 +0000 (0:00:00.074) 0:02:34.214 ****** 2020-02-11T16:01:47.095 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-02-11T16:01:47.096 INFO:teuthology.task.ansible.out:fatal: [smithi052.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006711", "end": "2020-02-11 16:01:47.071565", "msg": "non-zero return code", "rc": 1, "start": "2020-02-11 16:01:47.064854", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-02-11T16:01:47.141 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:47 +0000 (0:00:00.267) 0:02:34.481 ****** 2020-02-11T16:01:47.178 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-02-11T16:01:47.181 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:01:47.226 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:47 +0000 (0:00:00.084) 0:02:34.566 ****** 2020-02-11T16:01:48.703 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-02-11T16:01:48.704 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: hdparm-9.54-2.el8.x86_64", "Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: tuned-2.12.0-3.el8.noarch"]} 2020-02-11T16:01:48.746 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:48 +0000 (0:00:01.517) 0:02:36.084 ****** 2020-02-11T16:01:50.062 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-02-11T16:01:50.063 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+258+1d2a1d58.1.x86_64"]} 2020-02-11T16:01:50.128 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:50 +0000 (0:00:01.383) 0:02:37.468 ****** 2020-02-11T16:01:53.118 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-02-11T16:01:53.119 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: hdparm-9.54-2.el8.x86_64", "Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: tuned-2.12.0-3.el8.noarch"]} 2020-02-11T16:01:53.164 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:01:53 +0000 (0:00:03.035) 0:02:40.503 ****** 2020-02-11T16:02:02.156 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-02-11T16:02:02.158 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:13.204733", "end": "2020-02-11 16:02:02.134020", "rc": 0, "start": "2020-02-11 16:01:48.929287", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\""], "stdout": "CentOS-8 - AppStream 15 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 5.8 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 6.4 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 16 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 165 kB/s | 5.3 kB 00:00 \nlab-extras 1.1 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Tue 11 Feb 2020 04:01:50 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-02-11T16:02:02.160 INFO:teuthology.task.ansible.out:===================\nUpgrading:\n bpftool x86_64 4.18.0-147.5.1.el8_1 BaseOS 2.1 M\n systemd x86_64 239-18.el8_1.2 BaseOS 3.5 M\n systemd-libs x86_64 239-18.el8_1.2 BaseOS 560 k\n systemd-pam x86_64 239-18.el8_1.2 BaseOS 230 k\n systemd-udev x86_64 239-18.el8_1.2 BaseOS 1.3 M\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\nUpgrade 5 Packages\n\nTotal download size: 7.7 M\nDownloading Packages:\n(1/5): systemd-libs-239-18.el8_1.2.x86_64.rpm 1.1 MB/s | 560 kB 00:00 \n(2/5): systemd-pam-239-18.el8_1.2.x86_64.rpm 2.8 MB/s | 230 kB 00:00 \n(3/5): bpftool-4.18.0-147.5.1.el8_1.x86_64.rpm 3.2 MB/s | 2.1 MB 00:00 \n(4/5): systemd-239-18.el8_1.2.x86_64.rpm 4.6 MB/s | 3.5 MB 00:00 \n(5/5): systemd-udev-239-18.el8_1.2.x86_64.rpm 8.3 MB/s | 1.3 MB 00:00 \n--------------------------------------------------------------------------------\nTotal 9.3 MB/s | 7.7 MB 00:00 \nRunning transaction check\nTransaction check succeeded.\nRunning transaction test\nTransaction test succeeded.\nRunning transaction\n Preparing : 1/1 \n Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/1 \n Upgrading : systemd-libs-239-18.el8_1.2.x86_64 1/10 \n Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/10 \n Upgrading : systemd-pam-239-18.el8_1.2.x86_64 2/10 \n Running scriptlet: systemd-239-18.el8_1.2.x86_64 3/10 \n Upgrading : systemd-239-18.el8_1.2.x86_64 3/10 \n Runni 2020-02-11T16:02:02.161 INFO:teuthology.task.ansible.out:ng scriptlet: systemd-239-18.el8_1.2.x86_64 3/10 \n Upgrading : systemd-udev-239-18.el8_1.2.x86_64 4/10 \n Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 4/10 \n Upgrading : bpftool-4.18.0-147.5.1.el8_1.x86_64 5/10 \n Cleanup : systemd-udev-239-18.el8_1.1.x86_64 6/10 \n Running scriptlet: systemd-udev-239-18.el8_1.1.x86_64 6/10 \n Running scriptlet: systemd-239-18.el8_1.1.x86_64 7/10 \n Cleanup : systemd-239-18.el8_1.1.x86_64 7/10 \n Cleanup : systemd-libs-239-18.el8_1.1.x86_64 8/10 \n Cleanup : systemd-pam-239-18.el8_1.1.x86_64 9/10 \n Cleanup : bpftool-4.18.0-147.3.1.el8_1.x86_64 10/10 \n Running scriptlet: bpftool-4.18.0-147.3.1.el8_1.x86_64 10/10 \n Running scriptlet: systemd-239-18.el8_1.2.x86_64 10/10 \n Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 10/10 \n Verifying : bpftool-4.18.0-147.5.1.el8_1.x86_64 1/10 \n Verifying : bpftool-4.18.0-147.3.1.el8_1.x86_64 2/10 \n Verifying : systemd-239-18.el8_1.2.x86_64 3/10 \n Verifying : systemd-239-18.el8_1.1.x86_64 4/10 \n Verifying : systemd-libs-239-18.el8_1.2.x86_64 5/10 \n Verifying : systemd-libs-239-18.el8_1.1.x86_64 6/10 \n Verifying : systemd-pam-239-18.el8_1.2.x86_64 7/10 \n Verifying : systemd-pam-239-18.el8_1.1.x86_64 8/10 \n Verifying : systemd-udev-239-18.el8_1.2.x86_64 9/10 \n Verifying : systemd-udev-239-18.el8_1.1.x86_64 10/10 \n\nUpgraded:\n bpftool-4.18.0-147.5.1.e 2020-02-11T16:02:02.163 INFO:teuthology.task.ansible.out:l8_1.x86_64 systemd-239-18.el8_1.2.x86_64 \n systemd-libs-239-18.el8_1.2.x86_64 systemd-pam-239-18.el8_1.2.x86_64 \n systemd-udev-239-18.el8_1.2.x86_64 \n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 15 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 5.8 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 6.4 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 16 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 165 kB/s | 5.3 kB 00:00 ", "lab-extras 1.1 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Tue 11 Feb 2020 04:01:50 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading:", " bpftool x86_64 4.18.0-147.5.1.el8_1 BaseOS 2.1 M", " systemd x86_64 239-18.el8_1.2 BaseOS 3.5 M", " systemd-libs x86_64 239-18.el8_1.2 BaseOS 560 k", " systemd-pam x86_64 239-18.el8_1.2 BaseOS 230 k", " systemd-udev x86_64 239-18.el8_1.2 BaseOS 1 2020-02-11T16:02:02.164 INFO:teuthology.task.ansible.out:.3 M", "Upgrading Groups:", " Base 2020-02-11T16:02:02.165 INFO:teuthology.task.ansible.out: ", "", "Transaction Summary", "================================================================================", "Upgrade 5 Packages", "", "Total download size: 7.7 M", "Downloading Packages:", "(1/5): systemd-libs-239-18.el8_1.2.x86_64.rpm 1.1 MB/s | 560 kB 00:00 ", "(2/5): systemd-pam-239-18.el8_1.2.x86_64.rpm 2.8 MB/s | 230 kB 00:00 ", "(3/5): bpftool-4.18.0-147.5.1.el8_1.x86_64.rpm 3.2 MB/s | 2.1 MB 00:00 ", "(4/5): systemd-239-18.el8_1.2.x86_64.rpm 4.6 MB/s | 3.5 MB 00:00 ", "(5/5): systemd-udev-239-18.el8_1.2.x86_64.rpm 8.3 MB/s | 1.3 MB 00:00 ", "--------------------------------------------------------------------------------", "Total 9.3 MB/s | 7.7 MB 00:00 ", "Running transaction check", "Transaction check succeeded.", "Running transaction test", "Transaction test succeeded.", "Running transaction", " Preparing : 1/1 ", " Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/1 ", " Upgrading : systemd-libs-239-18.el8_1.2.x86_64 1/10 ", " Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/10 ", " Upgrading : systemd-pam-239-18.el8_1.2.x86_64 2/10 ", " Running scriptlet: systemd-239-18.el8_1.2.x86_64 3/10 ", " Upgrading : systemd-239-18.el8_1.2.x86_64 3/10 ", " Running scriptlet: systemd-239-18.el8_1.2.x86_64 3/10 ", " Upgrading : systemd-udev-239-18.el8_1.2.x86_64 4/10 ", " Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 4/10 ", " Upgrading : bpftool-4.18.0-147.5.1.el8_1.x86_64 5/10 ", " Cleanup : systemd-udev-239-18.el8_ 2020-02-11T16:02:02.166 INFO:teuthology.task.ansible.out:1.1.x86_64 6/10 ", " Running scriptlet: systemd-udev-239-18.el8_1.1.x86_64 6/10 ", " Running scriptlet: systemd-239-18.el8_1.1.x86_64 7/10 ", " Cleanup : systemd-239-18.el8_1.1.x86_64 7/10 ", " Cleanup : systemd-libs-239-18.el8_1.1.x86_64 8/10 ", " Cleanup : systemd-pam-239-18.el8_1.1.x86_64 9/10 ", " Cleanup : bpftool-4.18.0-147.3.1.el8_1.x86_64 10/10 ", " Running scriptlet: bpftool-4.18.0-147.3.1.el8_1.x86_64 10/10 ", " Running scriptlet: systemd-239-18.el8_1.2.x86_64 10/10 ", " Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 10/10 ", " Verifying : bpftool-4.18.0-147.5.1.el8_1.x86_64 1/10 ", " Verifying : bpftool-4.18.0-147.3.1.el8_1.x86_64 2/10 ", " Verifying : systemd-239-18.el8_1.2.x86_64 3/10 ", " Verifying : systemd-239-18.el8_1.1.x86_64 4/10 ", " Verifying : systemd-libs-239-18.el8_1.2.x86_64 5/10 ", " Verifying : systemd-libs-239-18.el8_1.1.x86_64 6/10 ", " Verifying : systemd-pam-239-18.el8_1.2.x86_64 7/10 ", " Verifying : systemd-pam-239-18.el8_1.1.x86_64 8/10 ", " Verifying : systemd-udev-239-18.el8_1.2.x86_64 9/10 ", " Verifying : systemd-udev-239-18.el8_1.1.x86_64 10/10 ", "", "Upgraded:", " bpftool-4.18.0-147.5.1.el8_1.x86_64 systemd-239-18.el8_1.2.x86_64 ", " systemd-libs-239-18.el8_1.2.x86_64 systemd-pam-239-18.el8_1.2.x86_64 ", " systemd-udev-239-18.el8_1.2.x86_64 ", "", "Complete!"]} 2020-02-11T16:02:02.204 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:02 +0000 (0:00:09.040) 0:02:49.544 ****** 2020-02-11T16:02:06.969 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:13.580055", "end": "2020-02-11 16:02:06.938489", "rc": 0, "start": "2020-02-11 16:01:53.358434", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\""], "stdout": "CentOS-8 - AppStream 16 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 16 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 4.1 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 16 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 166 kB/s | 5.3 kB 00:00 \nlab-extras 1.1 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:03 ago on Tue 11 Feb 2020 04:01:54 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-02-11T16:02:06.971 INFO:teuthology.task.ansible.out:===================\nUpgrading:\n bpftool x86_64 4.18.0-147.5.1.el8_1 BaseOS 2.1 M\n systemd x86_64 239-18.el8_1.2 BaseOS 3.5 M\n systemd-libs x86_64 239-18.el8_1.2 BaseOS 560 k\n systemd-pam x86_64 239-18.el8_1.2 BaseOS 230 k\n systemd-udev x86_64 239-18.el8_1.2 BaseOS 1.3 M\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\nUpgrade 5 Packages\n\nTotal download size: 7.7 M\nDownloading Packages:\n(1/5): systemd-libs-239-18.el8_1.2.x86_64.rpm 1.0 MB/s | 560 kB 00:00 \n(2/5): systemd-pam-239-18.el8_1.2.x86_64.rpm 2.8 MB/s | 230 kB 00:00 \n(3/5): bpftool-4.18.0-147.5.1.el8_1.x86_64.rpm 3.1 MB/s | 2.1 MB 00:00 \n(4/5): systemd-239-18.el8_1.2.x86_64.rpm 4.8 MB/s | 3.5 MB 00:00 \n(5/5): systemd-udev-239-18.el8_1.2.x86_64.rpm 8.1 MB/s | 1.3 MB 00:00 \n--------------------------------------------------------------------------------\nTotal 7.9 MB/s | 7.7 MB 00:00 \nRunning transaction check\nTransaction check succeeded.\nRunning transaction test\nTransaction test succeeded.\nRunning transaction\n Preparing : 1/1 \n Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/1 \n Upgrading : systemd-libs-239-18.el8_1.2.x86_64 1/10 \n Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/10 \n Upgrading : systemd-pam-239-18.el8_1.2.x86_64 2/10 \n Running scriptlet: systemd-239-18.el8_1.2.x86_64 3/10 \n Upgrading : systemd-239-18.el8_1.2.x86_64 3/10 \n Runni 2020-02-11T16:02:06.972 INFO:teuthology.task.ansible.out:ng scriptlet: systemd-239-18.el8_1.2.x86_64 3/10 \n Upgrading : systemd-udev-239-18.el8_1.2.x86_64 4/10 \n Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 4/10 \n Upgrading : bpftool-4.18.0-147.5.1.el8_1.x86_64 5/10 \n Cleanup : systemd-udev-239-18.el8_1.1.x86_64 6/10 \n Running scriptlet: systemd-udev-239-18.el8_1.1.x86_64 6/10 \n Running scriptlet: systemd-239-18.el8_1.1.x86_64 7/10 \n Cleanup : systemd-239-18.el8_1.1.x86_64 7/10 \n Cleanup : systemd-libs-239-18.el8_1.1.x86_64 8/10 \n Cleanup : systemd-pam-239-18.el8_1.1.x86_64 9/10 \n Cleanup : bpftool-4.18.0-147.3.1.el8_1.x86_64 10/10 \n Running scriptlet: bpftool-4.18.0-147.3.1.el8_1.x86_64 10/10 \n Running scriptlet: systemd-239-18.el8_1.2.x86_64 10/10 \n Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 10/10 \n Verifying : bpftool-4.18.0-147.5.1.el8_1.x86_64 1/10 \n Verifying : bpftool-4.18.0-147.3.1.el8_1.x86_64 2/10 \n Verifying : systemd-239-18.el8_1.2.x86_64 3/10 \n Verifying : systemd-239-18.el8_1.1.x86_64 4/10 \n Verifying : systemd-libs-239-18.el8_1.2.x86_64 5/10 \n Verifying : systemd-libs-239-18.el8_1.1.x86_64 6/10 \n Verifying : systemd-pam-239-18.el8_1.2.x86_64 7/10 \n Verifying : systemd-pam-239-18.el8_1.1.x86_64 8/10 \n Verifying : systemd-udev-239-18.el8_1.2.x86_64 9/10 \n Verifying : systemd-udev-239-18.el8_1.1.x86_64 10/10 \n\nUpgraded:\n bpftool-4.18.0-147.5.1.e 2020-02-11T16:02:06.974 INFO:teuthology.task.ansible.out:l8_1.x86_64 systemd-239-18.el8_1.2.x86_64 \n systemd-libs-239-18.el8_1.2.x86_64 systemd-pam-239-18.el8_1.2.x86_64 \n systemd-udev-239-18.el8_1.2.x86_64 \n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 16 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 16 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 4.1 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 16 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 166 kB/s | 5.3 kB 00:00 ", "lab-extras 1.1 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:03 ago on Tue 11 Feb 2020 04:01:54 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading:", " bpftool x86_64 4.18.0-147.5.1.el8_1 BaseOS 2.1 M", " systemd x86_64 239-18.el8_1.2 BaseOS 3.5 M", " systemd-libs x86_64 239-18.el8_1.2 BaseOS 560 k", " systemd-pam x86_64 239-18.el8_1.2 BaseOS 230 k", " systemd-udev x86_64 239-18.el8_1.2 BaseOS 1 2020-02-11T16:02:06.975 INFO:teuthology.task.ansible.out:.3 M", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "Upgrade 5 Packages", "", "Total download size: 7.7 M", "Downloading Packages:", "(1/5): systemd-libs-239-18.el8_1.2.x86_64.rpm 1.0 MB/s | 560 kB 00:00 ", "(2/5): systemd-pam-239-18.el8_1.2.x86_64.rpm 2.8 MB/s | 230 kB 00:00 ", "(3/5): bpftool-4.18.0-147.5.1.el8_1.x86_64.rpm 3.1 MB/s | 2.1 MB 00:00 ", "(4/5): systemd-239-18.el8_1.2.x86_64.rpm 4.8 MB/s | 3.5 MB 00:00 ", "(5/5): systemd-udev-239-18.el8_1.2.x86_64.rpm 8.1 MB/s | 1.3 MB 00:00 ", "--------------------------------------------------------------------------------", "Total 7.9 MB/s | 7.7 MB 00:00 ", "Running transaction check", "Transaction check succeeded.", "Running tra 2020-02-11T16:02:06.975 INFO:teuthology.task.ansible.out:nsaction test", "Transaction test succeeded.", "Running transaction", " Preparing : 1/1 ", " Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/1 ", " Upgrading : systemd-libs-239-18.el8_1.2.x86_64 1/10 ", " Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/10 ", " Upgrading : systemd-pam-239-18.el8_1.2.x86_64 2/10 ", " Running scriptlet: systemd-239-18.el8_1.2.x86_64 3/10 ", " Upgrading : systemd-239-18.el8_1.2.x86_64 3/10 ", " Running scriptlet: systemd-239-18.el8_1.2.x86_64 3/10 ", " Upgrading : systemd-udev-239-18.el8_1.2.x86_64 4/10 ", " Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 4/10 ", " Upgrading : bpftool-4.18.0-147.5.1.el8_1.x86_64 5/10 ", " Cleanup : systemd-udev-239-18.el8_ 2020-02-11T16:02:06.977 INFO:teuthology.task.ansible.out:1.1.x86_64 6/10 ", " Running scriptlet: systemd-udev-239-18.el8_1.1.x86_64 6/10 ", " Running scriptlet: systemd-239-18.el8_1.1.x86_64 7/10 ", " Cleanup : systemd-239-18.el8_1.1.x86_64 7/10 ", " Cleanup : systemd-libs-239-18.el8_1.1.x86_64 8/10 ", " Cleanup : systemd-pam-239-18.el8_1.1.x86_64 9/10 ", " Cleanup : bpftool-4.18.0-147.3.1.el8_1.x86_64 10/10 ", " Running scriptlet: bpftool-4.18.0-147.3.1.el8_1.x86_64 10/10 ", " Running scriptlet: systemd-239-18.el8_1.2.x86_64 10/10 ", " Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 10/10 ", " Verifying : bpftool-4.18.0-147.5.1.el8_1.x86_64 1/10 ", " Verifying : bpftool-4.18.0-147.3.1.el8_1.x86_64 2/10 ", " Verifying : systemd-239-18.el8_1.2.x86_64 3/10 ", " Verifying : systemd-239-18.el8_1.1.x86_64 4/10 ", " Verifying : systemd-libs-239-18.el8_1.2.x86_64 5/10 ", " Verifying : systemd-libs-239-18.el8_1.1.x86_64 6/10 ", " Verifying : systemd-pam-239-18.el8_1.2.x86_64 7/10 ", " Verifying : systemd-pam-239-18.el8_1.1.x86_64 8/10 ", " Verifying : systemd-udev-239-18.el8_1.2.x86_64 9/10 ", " Verifying : systemd-udev-239-18.el8_1.1.x86_64 10/10 ", "", "Upgraded:", " bpftool-4.18.0-147.5.1.el8_1.x86_64 systemd-239-18.el8_1.2.x86_64 ", " systemd-libs-239-18.el8_1.2.x86_64 systemd-pam-239-18.el8_1.2.x86_64 ", " systemd-udev-239-18.el8_1.2.x86_64 ", "", "Complete!"]} 2020-02-11T16:02:07.016 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:07 +0000 (0:00:04.811) 0:02:54.355 ****** 2020-02-11T16:02:26.113 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-11T16:02:26.114 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: glibc-langpack-en-2.28-72.el8_1.1.x86_64", "Installed: kernel-tools-4.18.0-147.5.1.el8_1.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: kernel-tools-libs-4.18.0-147.5.1.el8_1.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-img-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: podman-1.6.4-2.module_el8.1.0+272+3e64ee36.x86_64", "Installed: podman-docker-1.6.4-2.module_el8.1.0+272+3e64ee36.noarch", "Installed: podman-manpages-1.6.4-2.module_el8.1.0+272+3e64ee36.noarch", "Installed: glibc-2.28-72.el8_1.1.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: glibc-common-2.28-72.el8_1.1.x86_64", "Installed: qemu-kvm-common-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: qemu-kvm-core-15:2.12.0-88.module_el8.1.0+266 2020-02-11T16:02:26.115 INFO:teuthology.task.ansible.out:+ba744077.2.x86_64", "Installed: glibc-devel-2.28-72.el8_1.1.x86_64", "Installed: glibc-headers-2.28-72.el8_1.1.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: conmon-2:2.0.6-1.module_el8.1.0+272+3e64ee36.x86_64", "Installed: openssh-8.0p1-4.el8_1.x86_64", "Installed: openssh-clients-8.0p1-4.el8_1.x86_64", "Installed: openssh-server-8.0p1-4.el8_1.x86_64", "Installed: slirp4netns-0.4.2-2.git21fdece.module_el8.1.0+272+3e64ee36.x86_64", "Removed: qemu-img-15:2.12.0-88.module_el8.1.0+258+1d2a1d58.1.x86_64", "Removed: qemu-kvm-common-15:2.12.0-88.module_el8.1.0+258+1d2a1d58.1.x86_64", "Removed: qemu-kvm-core-15:2.12.0-88.module_el8.1.0+258+1d2a1d58.1.x86_64", "Removed: kernel-tools-4.18.0-147.3.1.el8_1.x86_64", "Removed: glibc-2.28-72.el8.x86_64", "Removed: glibc-common-2.28-72.el8.x86_64", "Removed: glibc-devel-2.28-72.el8.x86_64", "Removed: glibc-headers-2.28-72.el8.x86_64", "Removed: slirp4netns-0.3.0-4.module_el8.1.0+237+63e26edc.x86_64", "Removed: podman-1.4.2-5.module_el8.1.0+237+63e26edc.x86_64", "Removed: podman-docker-1.4.2-5.module_el8.1.0+237+63e26edc.noarch", "Removed: podman-manpages-1.4.2-5.module_el8.1.0+237+63e26edc.noarch", "Removed: glibc-langpack-en-2.28-72.el8.x86_64", "Removed: kernel-tools-libs-4.18.0-147.3.1.el8_1.x86_64", "Removed: openssh-8.0p1-3.el8.x86_64", "Removed: openssh-clients-8.0p1-3.el8.x86_64", "Removed: openssh-server-8.0p1-3.el8.x86_64"]} 2020-02-11T16:02:26.164 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:26 +0000 (0:00:19.147) 0:03:13.503 ****** 2020-02-11T16:02:26.194 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-02-11T16:02:26.195 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:26.233 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:26 +0000 (0:00:00.069) 0:03:13.572 ****** 2020-02-11T16:02:27.210 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-02-11T16:02:27.251 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:27 +0000 (0:00:01.017) 0:03:14.590 ****** 2020-02-11T16:02:27.289 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-11T16:02:27.290 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:27.328 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:27 +0000 (0:00:00.077) 0:03:14.667 ****** 2020-02-11T16:02:27.636 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-02-11T16:02:27.638 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice basic.target polkit.service sysinit.target dbus.service dbus.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service iptables.service ip6tables.service ebtables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-02-11T16:02:27.639 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", 2020-02-11T16:02:27.641 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-02-11T16:02:27.642 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-02-11T16:02:27.678 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:27 +0000 (0:00:00.349) 0:03:15.017 ****** 2020-02-11T16:02:27.971 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi088.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-02-11T16:02:28.013 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:28 +0000 (0:00:00.335) 0:03:15.353 ****** 2020-02-11T16:02:28.708 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-02-11T16:02:28.750 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:28 +0000 (0:00:00.736) 0:03:16.090 ****** 2020-02-11T16:02:28.776 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-02-11T16:02:28.778 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:28.813 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:28 +0000 (0:00:00.062) 0:03:16.152 ****** 2020-02-11T16:02:28.838 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-02-11T16:02:28.876 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:28 +0000 (0:00:00.062) 0:03:16.215 ****** 2020-02-11T16:02:28.901 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-02-11T16:02:28.903 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:28.937 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:28 +0000 (0:00:00.061) 0:03:16.276 ****** 2020-02-11T16:02:28.964 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.000 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:28 +0000 (0:00:00.063) 0:03:16.339 ****** 2020-02-11T16:02:29.037 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-02-11T16:02:29.038 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi088.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.075 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.075) 0:03:16.415 ****** 2020-02-11T16:02:29.101 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-02-11T16:02:29.103 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.141 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.064) 0:03:16.480 ****** 2020-02-11T16:02:29.168 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-02-11T16:02:29.205 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.064) 0:03:16.544 ****** 2020-02-11T16:02:29.233 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-02-11T16:02:29.234 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.272 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.067) 0:03:16.612 ****** 2020-02-11T16:02:29.301 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-02-11T16:02:29.302 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.337 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.064) 0:03:16.677 ****** 2020-02-11T16:02:29.364 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-02-11T16:02:29.366 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.403 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.065) 0:03:16.742 ****** 2020-02-11T16:02:29.429 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-11T16:02:29.430 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.468 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.065) 0:03:16.808 ****** 2020-02-11T16:02:29.494 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-02-11T16:02:29.502 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.532 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.063) 0:03:16.871 ****** 2020-02-11T16:02:29.558 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-11T16:02:29.560 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.603 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.071) 0:03:16.942 ****** 2020-02-11T16:02:29.640 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-02-11T16:02:29.641 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.681 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.078) 0:03:17.021 ****** 2020-02-11T16:02:29.707 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-02-11T16:02:29.709 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.744 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.062) 0:03:17.084 ****** 2020-02-11T16:02:29.770 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.808 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.064) 0:03:17.148 ****** 2020-02-11T16:02:29.834 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-02-11T16:02:29.835 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.871 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.062) 0:03:17.210 ****** 2020-02-11T16:02:29.896 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-02-11T16:02:29.898 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.934 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.063) 0:03:17.274 ****** 2020-02-11T16:02:29.960 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:29.998 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:29 +0000 (0:00:00.063) 0:03:17.337 ****** 2020-02-11T16:02:30.037 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.083 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.084) 0:03:17.422 ****** 2020-02-11T16:02:30.110 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-02-11T16:02:30.112 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.151 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.067) 0:03:17.490 ****** 2020-02-11T16:02:30.176 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-02-11T16:02:30.180 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.215 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.064) 0:03:17.555 ****** 2020-02-11T16:02:30.241 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-02-11T16:02:30.242 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.296 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.080) 0:03:17.636 ****** 2020-02-11T16:02:30.302 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-11T16:02:30.304 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: glibc-langpack-en-2.28-72.el8_1.1.x86_64", "Installed: kernel-tools-4.18.0-147.5.1.el8_1.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: kernel-tools-libs-4.18.0-147.5.1.el8_1.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-img-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: podman-1.6.4-2.module_el8.1.0+272+3e64ee36.x86_64", "Installed: podman-docker-1.6.4-2.module_el8.1.0+272+3e64ee36.noarch", "Installed: podman-manpages-1.6.4-2.module_el8.1.0+272+3e64ee36.noarch", "Installed: glibc-2.28-72.el8_1.1.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: glibc-common-2.28-72.el8_1.1.x86_64", "Installed: qemu-kvm-common-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: qemu-kvm-core-15:2.12.0-88.module_el8.1.0+266 2020-02-11T16:02:30.305 INFO:teuthology.task.ansible.out:+ba744077.2.x86_64", "Installed: glibc-devel-2.28-72.el8_1.1.x86_64", "Installed: glibc-headers-2.28-72.el8_1.1.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: conmon-2:2.0.6-1.module_el8.1.0+272+3e64ee36.x86_64", "Installed: openssh-8.0p1-4.el8_1.x86_64", "Installed: openssh-clients-8.0p1-4.el8_1.x86_64", "Installed: openssh-server-8.0p1-4.el8_1.x86_64", "Installed: slirp4netns-0.4.2-2.git21fdece.module_el8.1.0+272+3e64ee36.x86_64", "Removed: qemu-img-15:2.12.0-88.module_el8.1.0+258+1d2a1d58.1.x86_64", "Removed: qemu-kvm-common-15:2.12.0-88.module_el8.1.0+258+1d2a1d58.1.x86_64", "Removed: qemu-kvm-core-15:2.12.0-88.module_el8.1.0+258+1d2a1d58.1.x86_64", "Removed: kernel-tools-4.18.0-147.3.1.el8_1.x86_64", "Removed: glibc-2.28-72.el8.x86_64", "Removed: glibc-common-2.28-72.el8.x86_64", "Removed: glibc-devel-2.28-72.el8.x86_64", "Removed: glibc-headers-2.28-72.el8.x86_64", "Removed: slirp4netns-0.3.0-4.module_el8.1.0+237+63e26edc.x86_64", "Removed: podman-1.4.2-5.module_el8.1.0+237+63e26edc.x86_64", "Removed: podman-docker-1.4.2-5.module_el8.1.0+237+63e26edc.noarch", "Removed: podman-manpages-1.4.2-5.module_el8.1.0+237+63e26edc.noarch", "Removed: glibc-langpack-en-2.28-72.el8.x86_64", "Removed: kernel-tools-libs-4.18.0-147.3.1.el8_1.x86_64", "Removed: openssh-8.0p1-3.el8.x86_64", "Removed: openssh-clients-8.0p1-3.el8.x86_64", "Removed: openssh-server-8.0p1-3.el8.x86_64"]} 2020-02-11T16:02:30.350 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.053) 0:03:17.690 ****** 2020-02-11T16:02:30.358 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-02-11T16:02:30.359 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.401 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.050) 0:03:17.741 ****** 2020-02-11T16:02:30.406 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-02-11T16:02:30.406 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.451 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.050) 0:03:17.791 ****** 2020-02-11T16:02:30.457 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-02-11T16:02:30.457 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.506 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.054) 0:03:17.845 ****** 2020-02-11T16:02:30.531 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-02-11T16:02:30.532 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.574 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.068) 0:03:17.913 ****** 2020-02-11T16:02:30.600 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-02-11T16:02:30.601 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.636 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.061) 0:03:17.975 ****** 2020-02-11T16:02:30.661 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-02-11T16:02:30.663 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.698 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.061) 0:03:18.037 ****** 2020-02-11T16:02:30.726 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.774 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.076) 0:03:18.113 ****** 2020-02-11T16:02:30.804 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.853 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.079) 0:03:18.193 ****** 2020-02-11T16:02:30.882 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.920 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.066) 0:03:18.260 ****** 2020-02-11T16:02:30.950 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:30.987 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:30 +0000 (0:00:00.066) 0:03:18.326 ****** 2020-02-11T16:02:31.013 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:31.050 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:31 +0000 (0:00:00.063) 0:03:18.389 ****** 2020-02-11T16:02:31.265 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-11T16:02:31.267 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-02-11T16:02:31.303 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:31 +0000 (0:00:00.253) 0:03:18.643 ****** 2020-02-11T16:02:31.465 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-02-11T16:02:31.467 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-02-11T16:02:31.509 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:31 +0000 (0:00:00.202) 0:03:18.846 ****** 2020-02-11T16:02:31.522 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-11T16:02:31.522 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-11T16:02:31.561 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:31 +0000 (0:00:00.054) 0:03:18.900 ****** 2020-02-11T16:02:31.565 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-11T16:02:31.567 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:31.610 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:31 +0000 (0:00:00.049) 0:03:18.949 ****** 2020-02-11T16:02:31.773 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-11T16:02:31.774 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. 2020-02-11T16:02:31.774 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-02-11T16:02:31.813 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:31 +0000 (0:00:00.202) 0:03:19.152 ****** 2020-02-11T16:02:31.839 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-11T16:02:31.840 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:31.882 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:31 +0000 (0:00:00.069) 0:03:19.222 ****** 2020-02-11T16:02:31.910 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-11T16:02:31.912 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:31.950 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:31 +0000 (0:00:00.067) 0:03:19.290 ****** 2020-02-11T16:02:31.956 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-02-11T16:02:31.958 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice polkit.service dbus.service sysinit.target basic.target dbus.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service ipset.service shutdown.target iptables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-02-11T16:02:31.960 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127467", "LimitNPROCSoft": "127467", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127467", 2020-02-11T16:02:31.961 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127467", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-02-11T16:02:31.963 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-02-11T16:02:32.007 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.056) 0:03:19.346 ****** 2020-02-11T16:02:32.012 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-11T16:02:32.012 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.054 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.045) 0:03:19.391 ****** 2020-02-11T16:02:32.077 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-11T16:02:32.078 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.114 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.061) 0:03:19.453 ****** 2020-02-11T16:02:32.147 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-11T16:02:32.149 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.183 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.069) 0:03:19.522 ****** 2020-02-11T16:02:32.208 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-11T16:02:32.214 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.247 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.064) 0:03:19.587 ****** 2020-02-11T16:02:32.273 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-11T16:02:32.278 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.317 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.069) 0:03:19.656 ****** 2020-02-11T16:02:32.322 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-02-11T16:02:32.324 INFO:teuthology.task.ansible.out:fatal: [smithi052.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-02-11T16:02:32.361 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.044) 0:03:19.701 ****** 2020-02-11T16:02:32.366 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-11T16:02:32.368 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.406 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.044) 0:03:19.745 ****** 2020-02-11T16:02:32.432 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-11T16:02:32.434 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.470 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.063) 0:03:19.809 ****** 2020-02-11T16:02:32.495 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-02-11T16:02:32.496 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.534 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.063) 0:03:19.873 ****** 2020-02-11T16:02:32.560 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-02-11T16:02:32.561 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.598 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.064) 0:03:19.937 ****** 2020-02-11T16:02:32.624 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-11T16:02:32.626 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.670 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.072) 0:03:20.009 ****** 2020-02-11T16:02:32.685 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-02-11T16:02:32.687 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-02-11T16:02:32.726 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.055) 0:03:20.065 ****** 2020-02-11T16:02:32.731 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-11T16:02:32.733 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.771 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.045) 0:03:20.110 ****** 2020-02-11T16:02:32.776 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-02-11T16:02:32.777 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.816 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.044) 0:03:20.155 ****** 2020-02-11T16:02:32.822 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-02-11T16:02:32.823 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.861 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.045) 0:03:20.200 ****** 2020-02-11T16:02:32.866 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-02-11T16:02:32.910 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.048) 0:03:20.249 ****** 2020-02-11T16:02:32.915 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-02-11T16:02:32.916 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:32.972 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:32 +0000 (0:00:00.061) 0:03:20.311 ****** 2020-02-11T16:02:32.982 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.021 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.049) 0:03:20.360 ****** 2020-02-11T16:02:33.028 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-02-11T16:02:33.030 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.067 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.046) 0:03:20.406 ****** 2020-02-11T16:02:33.072 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-02-11T16:02:33.073 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.114 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.047) 0:03:20.454 ****** 2020-02-11T16:02:33.123 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-02-11T16:02:33.124 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.176 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.061) 0:03:20.516 ****** 2020-02-11T16:02:33.185 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi052.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi052.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.226 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.047) 0:03:20.563 ****** 2020-02-11T16:02:33.229 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-02-11T16:02:33.230 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.270 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.046) 0:03:20.609 ****** 2020-02-11T16:02:33.275 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-02-11T16:02:33.277 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.316 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.046) 0:03:20.656 ****** 2020-02-11T16:02:33.321 INFO:teuthology.task.ansible.out: 2020-02-11T16:02:33.323 INFO:teuthology.task.ansible.out:TASK [testnode : Stop collectl] ************************************************ skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.363 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.046) 0:03:20.702 ****** 2020-02-11T16:02:33.370 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-02-11T16:02:33.409 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.046) 0:03:20.748 ****** 2020-02-11T16:02:33.414 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-02-11T16:02:33.416 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.454 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.045) 0:03:20.794 ****** 2020-02-11T16:02:33.463 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.501 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.047) 0:03:20.841 ****** 2020-02-11T16:02:33.507 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-02-11T16:02:33.510 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.554 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.052) 0:03:20.894 ****** 2020-02-11T16:02:33.559 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-02-11T16:02:33.561 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.601 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.046) 0:03:20.940 ****** 2020-02-11T16:02:33.608 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-02-11T16:02:33.608 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.651 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.049) 0:03:20.990 ****** 2020-02-11T16:02:33.657 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-02-11T16:02:33.658 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.701 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.048) 0:03:21.039 ****** 2020-02-11T16:02:33.706 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-11T16:02:33.708 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-02-11T16:02:33.744 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.044) 0:03:21.084 ****** 2020-02-11T16:02:33.754 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-11T16:02:33.756 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.793 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.048) 0:03:21.133 ****** 2020-02-11T16:02:33.799 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-02-11T16:02:33.801 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.811 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-02-11T16:02:33.812 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.823 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.823 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.878 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.075) 0:03:21.208 ****** TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi088.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.878 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.880 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.925 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.056) 0:03:21.264 ****** 2020-02-11T16:02:33.933 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:33.972 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:33 +0000 (0:00:00.046) 0:03:21.311 ****** 2020-02-11T16:02:33.998 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-02-11T16:02:33.999 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.042 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.070) 0:03:21.381 ****** 2020-02-11T16:02:34.068 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-02-11T16:02:34.070 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003336", "end": "2020-02-11 16:02:34.045885", "rc": 0, "start": "2020-02-11 16:02:34.042549", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-02-11T16:02:34.108 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.065) 0:03:21.447 ****** 2020-02-11T16:02:34.117 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.151 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.043) 0:03:21.491 ****** 2020-02-11T16:02:34.157 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-02-11T16:02:34.158 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.225 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.073) 0:03:21.564 ****** 2020-02-11T16:02:34.233 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-02-11T16:02:34.234 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.274 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.049) 0:03:21.613 ****** 2020-02-11T16:02:34.283 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.321 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.047) 0:03:21.660 ****** 2020-02-11T16:02:34.326 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-02-11T16:02:34.327 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.370 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.049) 0:03:21.710 ****** 2020-02-11T16:02:34.375 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-02-11T16:02:34.376 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.417 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.046) 0:03:21.756 ****** 2020-02-11T16:02:34.422 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-02-11T16:02:34.424 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.465 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.048) 0:03:21.805 ****** 2020-02-11T16:02:34.471 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-02-11T16:02:34.472 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.521 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.055) 0:03:21.860 ****** 2020-02-11T16:02:34.528 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-02-11T16:02:34.529 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.569 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.047) 0:03:21.908 ****** 2020-02-11T16:02:34.598 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.635 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.066) 0:03:21.975 ****** 2020-02-11T16:02:34.663 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-02-11T16:02:34.665 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.710 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.071) 0:03:22.046 ****** 2020-02-11T16:02:34.732 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-02-11T16:02:34.734 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.770 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.062) 0:03:22.109 ****** 2020-02-11T16:02:34.801 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-02-11T16:02:34.803 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.840 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.070) 0:03:22.179 ****** 2020-02-11T16:02:34.877 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-02-11T16:02:34.878 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.917 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.077) 0:03:22.256 ****** 2020-02-11T16:02:34.945 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-02-11T16:02:34.947 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:34.992 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:34 +0000 (0:00:00.075) 0:03:22.331 ****** 2020-02-11T16:02:35.021 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:35.072 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.079) 0:03:22.411 ****** 2020-02-11T16:02:35.108 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-02-11T16:02:35.109 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:35.145 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.073) 0:03:22.484 ****** 2020-02-11T16:02:35.171 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-02-11T16:02:35.172 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:35.207 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.062) 0:03:22.547 ****** 2020-02-11T16:02:35.233 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-02-11T16:02:35.234 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:35.271 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.063) 0:03:22.610 ****** 2020-02-11T16:02:35.297 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-02-11T16:02:35.297 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:35.344 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.073) 0:03:22.683 ****** 2020-02-11T16:02:35.370 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-11T16:02:35.371 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:35.408 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.064) 0:03:22.748 ****** 2020-02-11T16:02:35.425 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-02-11T16:02:35.427 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-02-11T16:02:35.469 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.060) 0:03:22.808 ****** 2020-02-11T16:02:35.477 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-11T16:02:35.478 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:35.517 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.047) 0:03:22.856 ****** 2020-02-11T16:02:35.522 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-11T16:02:35.523 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item={u'block_used': 12981108, u'uuid': u'6d9a851d-d573-4d97-a747-a9366dcc8e32', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227114000, u'size_available': 930258944000, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60986713, u'device': u'/dev/sda1', u'inode_used': 68263, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114000, "block_size": 4096, "block_total": 240095108, "block_used": 12981108, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986713, "inode_total": 61054976, "inode_used": 68263, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930258944000, "size_total": 983429562368, "uuid": "6d9a851d-d573-4d97-a747-a9366dcc8e32"}} 2020-02-11T16:02:35.566 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.049) 0:03:22.906 ****** 2020-02-11T16:02:35.572 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-11T16:02:35.572 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:35.613 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.046) 0:03:22.952 ****** 2020-02-11T16:02:35.764 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-02-11T16:02:35.766 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005209", "end": "2020-02-11 16:02:35.745665", "rc": 0, "start": "2020-02-11 16:02:35.740456", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:35.803 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.189) 0:03:23.142 ****** 2020-02-11T16:02:35.840 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-02-11T16:02:35.842 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={u'block_used': 12981108, u'uuid': u'6d9a851d-d573-4d97-a747-a9366dcc8e32', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227114000, u'size_available': 930258944000, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60986713, u'device': u'/dev/sda1', u'inode_used': 68263, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114000, "block_size": 4096, "block_total": 240095108, "block_used": 12981108, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986713, "inode_total": 61054976, "inode_used": 68263, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930258944000, "size_total": 983429562368, "uuid": "6d9a851d-d573-4d97-a747-a9366dcc8e32"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:35.878 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.075) 0:03:23.218 ****** 2020-02-11T16:02:35.884 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-11T16:02:35.885 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-02-11T16:02:35.932 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.053) 0:03:23.271 ****** 2020-02-11T16:02:35.937 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-02-11T16:02:35.978 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:35 +0000 (0:00:00.046) 0:03:23.318 ****** 2020-02-11T16:02:36.020 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-11T16:02:36.022 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LHZ6', u'wwn-0x5000c500918d95c7'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LHZ6', u'wwn': u'0x5000c500918d95c7', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'6d9a851d-d573-4d97-a747-a9366dcc8e32', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LHZ6-part1', u'wwn-0x5000c500918d95c7-part1'], u'uuids': [u'6d9a851d-d573-4d97-a747-a9366dcc8e32']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHZ6", "wwn-0x5000c500918d95c7"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHZ6-part1", "wwn-0x5000c500918d95c7-part1"], "labels": [], "masters": [], "uuids": ["6d9a851d-d573-4d97-a747-a9366dcc8e32"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "6d9a851d-d573-4d97-a747-a9366dcc8e32"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LHZ6", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-11T16:02:36.023 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918d95c7"}}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:36.159 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-11T16:02:36.160 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-11T16:02:36.205 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:36 +0000 (0:00:00.226) 0:03:23.545 ****** 2020-02-11T16:02:36.429 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-02-11T16:02:36.469 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:36 +0000 (0:00:00.263) 0:03:23.808 ****** 2020-02-11T16:02:36.495 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-11T16:02:36.497 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:36.536 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:36 +0000 (0:00:00.067) 0:03:23.875 ****** 2020-02-11T16:02:36.575 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-11T16:02:36.577 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:36.625 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:36 +0000 (0:00:00.089) 0:03:23.965 ****** 2020-02-11T16:02:36.651 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-11T16:02:36.653 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:36.687 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:36 +0000 (0:00:00.062) 0:03:24.027 ****** 2020-02-11T16:02:36.713 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-11T16:02:36.715 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:36.752 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:36 +0000 (0:00:00.064) 0:03:24.091 ****** 2020-02-11T16:02:36.777 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-11T16:02:36.779 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:36.818 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:36 +0000 (0:00:00.066) 0:03:24.157 ****** 2020-02-11T16:02:36.855 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-11T16:02:36.857 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:36.901 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:36 +0000 (0:00:00.082) 0:03:24.240 ****** 2020-02-11T16:02:36.927 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-11T16:02:36.930 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:36.970 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:36 +0000 (0:00:00.069) 0:03:24.309 ****** 2020-02-11T16:02:36.997 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-11T16:02:36.999 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.039 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.068) 0:03:24.378 ****** 2020-02-11T16:02:37.065 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.109 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.070) 0:03:24.448 ****** 2020-02-11T16:02:37.139 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-02-11T16:02:37.141 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.179 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.070) 0:03:24.519 ****** 2020-02-11T16:02:37.205 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-02-11T16:02:37.207 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.246 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.067) 0:03:24.586 ****** 2020-02-11T16:02:37.272 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-11T16:02:37.274 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.318 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.071) 0:03:24.657 ****** 2020-02-11T16:02:37.355 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-11T16:02:37.356 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.394 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.076) 0:03:24.734 ****** 2020-02-11T16:02:37.420 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-02-11T16:02:37.422 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.459 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.064) 0:03:24.798 ****** 2020-02-11T16:02:37.484 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-02-11T16:02:37.486 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.524 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.065) 0:03:24.864 ****** 2020-02-11T16:02:37.550 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-02-11T16:02:37.552 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.590 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.065) 0:03:24.929 ****** 2020-02-11T16:02:37.616 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-02-11T16:02:37.617 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.663 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.073) 0:03:25.003 ****** 2020-02-11T16:02:37.690 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-02-11T16:02:37.691 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.732 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.068) 0:03:25.071 ****** 2020-02-11T16:02:37.738 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-11T16:02:37.740 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-FO8boU-12TK-t8Yb-Hvx1-8w8v-wO3D-kFX7dc', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400XD400BGN', u'nvme-nvme.8086-50484654363230343030584434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.507974", "end": "2020-02-11 16:02:37.685316", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-FO8boU-12TK-t8Yb-Hvx1-8w8v-wO3D-kFX7dc", "nvme-INTEL_SSDPEDMD400G4_PHFT620400XD400BGN", "nvme-nvme.8086-50484654363230343030584434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:36.177342", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-02-11T16:02:37.741 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:37.751 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-02-11T16:02:37.753 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.788 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.056) 0:03:25.127 ****** 2020-02-11T16:02:37.827 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.865 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.077) 0:03:25.204 ****** 2020-02-11T16:02:37.892 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-02-11T16:02:37.894 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.930 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.064) 0:03:25.269 ****** 2020-02-11T16:02:37.956 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-02-11T16:02:37.963 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:37.994 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:37 +0000 (0:00:00.063) 0:03:25.333 ****** 2020-02-11T16:02:38.021 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-11T16:02:38.023 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-02-11T16:02:38.057 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:38 +0000 (0:00:00.063) 0:03:25.397 ****** 2020-02-11T16:02:38.095 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-02-11T16:02:38.095 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:38.116 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-02-11T16:02:38.127 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:38.138 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:38.149 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:38.160 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:38.171 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:38.212 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:38 +0000 (0:00:00.154) 0:03:25.551 ****** 2020-02-11T16:02:38.364 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-02-11T16:02:38.365 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003451", "end": "2020-02-11 16:02:38.343021", "rc": 0, "start": "2020-02-11 16:02:38.339570", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-02-11T16:02:38.404 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:38 +0000 (0:00:00.192) 0:03:25.743 ****** 2020-02-11T16:02:38.436 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-02-11T16:02:38.438 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:38.477 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:38 +0000 (0:00:00.072) 0:03:25.816 ****** 2020-02-11T16:02:38.504 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-02-11T16:02:38.505 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:38.541 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:38 +0000 (0:00:00.064) 0:03:25.880 ****** 2020-02-11T16:02:38.567 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-02-11T16:02:38.568 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:38.606 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:38 +0000 (0:00:00.064) 0:03:25.945 ****** 2020-02-11T16:02:38.635 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:38.677 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:38 +0000 (0:00:00.069) 0:03:26.015 ****** 2020-02-11T16:02:38.973 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4Y4pHGUJp9HlnLhBtZTqLvNUROXJUCpjY'], u'uuids': [u'e8d05d82-ee71-4b3c-a7b2-797be9ab9e35']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.043569", "end": "2020-02-11 16:02:38.933914", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4Y4pHGUJp9HlnLhBtZTqLvNUROXJUCpjY"], "labels": [], "masters": [], "uuids": ["e8d05d82-ee71-4b3c-a7b2-797be9ab9e35"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:37.890345", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! 2020-02-11T16:02:38.975 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:39.693 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-02-11T16:02:39.733 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:39 +0000 (0:00:01.057) 0:03:27.072 ****** 2020-02-11T16:02:39.771 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-11T16:02:39.772 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item={u'block_used': 12981135, u'uuid': u'6d9a851d-d573-4d97-a747-a9366dcc8e32', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227113973, u'size_available': 930258833408, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60986711, u'device': u'/dev/sda1', u'inode_used': 68265, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227113973, "block_size": 4096, "block_total": 240095108, "block_used": 12981135, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986711, "inode_total": 61054976, "inode_used": 68265, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930258833408, "size_total": 983429562368, "uuid": "6d9a851d-d573-4d97-a747-a9366dcc8e32"}} 2020-02-11T16:02:39.826 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:39 +0000 (0:00:00.086) 0:03:27.158 ****** 2020-02-11T16:02:40.038 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-02-11T16:02:40.039 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005375", "end": "2020-02-11 16:02:40.006190", "rc": 0, "start": "2020-02-11 16:02:40.000815", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:40.084 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:40 +0000 (0:00:00.264) 0:03:27.423 ****** 2020-02-11T16:02:40.124 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-02-11T16:02:40.125 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'block_used': 12981135, u'uuid': u'6d9a851d-d573-4d97-a747-a9366dcc8e32', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227113973, u'size_available': 930258833408, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60986711, u'device': u'/dev/sda1', u'inode_used': 68265, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227113973, "block_size": 4096, "block_total": 240095108, "block_used": 12981135, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986711, "inode_total": 61054976, "inode_used": 68265, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930258833408, "size_total": 983429562368, "uuid": "6d9a851d-d573-4d97-a747-a9366dcc8e32"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:40.174 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:40 +0000 (0:00:00.090) 0:03:27.514 ****** 2020-02-11T16:02:40.201 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-02-11T16:02:40.244 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:40 +0000 (0:00:00.069) 0:03:27.583 ****** 2020-02-11T16:02:40.250 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-11T16:02:40.251 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy46NlpDL3Mg7JirK2m5dcQRnj1za8nMD8q'], u'uuids': [u'4a409bde-c28e-42af-a9ef-41a0b9abd695']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.058916", "end": "2020-02-11 16:02:40.191326", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy46NlpDL3Mg7JirK2m5dcQRnj1za8nMD8q"], "labels": [], "masters": [], "uuids": ["4a409bde-c28e-42af-a9ef-41a0b9abd695"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:39.132410", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:40.285 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRYS', u'wwn-0x5000c500871a48d9'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HRYS', u'wwn': u'0x5000c500871a48d9', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'6d9a851d-d573-4d97-a747-a9366dcc8e32', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRYS-part1', u'wwn-0x5000c500871a48d9-part1'], u'uuids': [u'6d9a851d-d573-4d97-a747-a9366dcc8e32']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRYS", "wwn-0x5000c500871a48d9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRYS-part1", "wwn-0x5000c500871a48d9-part1"], "labels": [], "masters": [], "uuids": ["6d9a851d-d573-4d97-a747-a9366dcc8e32"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "6d9a851d-d573-4d97-a747-a9366dcc8e32"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRYS", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-11T16:02:40.286 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500871a48d9"}}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:41.493 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4tXswfEvm9ECXrk4oIO6saBACPbSVghZn'], u'uuids': [u'61828885-d9cf-4396-8644-5c4346e522ef']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.075958", "end": "2020-02-11 16:02:41.466209", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4tXswfEvm9ECXrk4oIO6saBACPbSVghZn"], "labels": [], "masters": [], "uuids": ["61828885-d9cf-4396-8644-5c4346e522ef"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:40.390251", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:41.967 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-0iKgHy-ZpwO-tIMU-Lht3-7HZG-91G0-gqX2IM', u'nvme-INTEL_SSDPED1D480GA_PHMB7513010N480DGN', u'nvme-nvme.8086-50484d42373531333031304e34383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.485156", "end": "2020-02-11 16:02:41.936601", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-0iKgHy-ZpwO-tIMU-Lht3-7HZG-91G0-gqX2IM", "nvme-INTEL_SSDPED1D480GA_PHMB7513010N480DGN", "nvme-nvme.8086-50484d42373531333031304e34383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:40.451445", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGP 2020-02-11T16:02:41.969 INFO:teuthology.task.ansible.out:T data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:42.772 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4OUKblbk3jtBIEAXZ3914yKo9Yy5qESvR'], u'uuids': [u'33f79322-52c6-4ee9-980f-626919864ae9']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.062101", "end": "2020-02-11 16:02:42.733862", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4OUKblbk3jtBIEAXZ3914yKo9Yy5qESvR"], "labels": [], "masters": [], "uuids": ["33f79322-52c6-4ee9-980f-626919864ae9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:41.671761", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:43.244 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSo8xlSu4YZBgGTxZqQTIkpibgh2egc32K'], u'uuids': [u'd832a8e4-e274-46c0-89a0-bbd0e6b79b65']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.057534", "end": "2020-02-11 16:02:43.206649", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSo8xlSu4YZBgGTxZqQTIkpibgh2egc32K"], "labels": [], "masters": [], "uuids": ["d832a8e4-e274-46c0-89a0-bbd0e6b79b65"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:42.149115", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:44.034 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4zf3M1CEnCIJndund4brvL3aIT6fO7ZvL'], u'uuids': [u'799afaae-4ed9-4c65-8ba9-ff7e401d294d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.062140", "end": "2020-02-11 16:02:43.992311", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4zf3M1CEnCIJndund4brvL3aIT6fO7ZvL"], "labels": [], "masters": [], "uuids": ["799afaae-4ed9-4c65-8ba9-ff7e401d294d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:42.930171", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:44.079 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:44 +0000 (0:00:03.835) 0:03:31.418 ****** 2020-02-11T16:02:44.118 INFO:teuthology.task.ansible.out: 2020-02-11T16:02:44.120 INFO:teuthology.task.ansible.out:TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LHZ6', u'wwn-0x5000c500918d95c7'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LHZ6', u'wwn': u'0x5000c500918d95c7', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'6d9a851d-d573-4d97-a747-a9366dcc8e32', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LHZ6-part1', u'wwn-0x5000c500918d95c7-part1'], u'uuids': [u'6d9a851d-d573-4d97-a747-a9366dcc8e32']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHZ6", "wwn-0x5000c500918d95c7"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHZ6-part1", "wwn-0x5000c500918d95c7-part1"], "labels": [], "masters": [], "uuids": ["6d9a851d-d573-4d97-a747-a9366dcc8e32"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "6d9a851d-d573-4d97-a747-a9366dcc8e32"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize 2020-02-11T16:02:44.121 INFO:teuthology.task.ansible.out:": "512", "serial": "Z1W5LHZ6", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918d95c7"}}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:44.350 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-FO8boU-12TK-t8Yb-Hvx1-8w8v-wO3D-kFX7dc', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400XD400BGN', u'nvme-nvme.8086-50484654363230343030584434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037343", "end": "2020-02-11 16:02:44.322654", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-FO8boU-12TK-t8Yb-Hvx1-8w8v-wO3D-kFX7dc", "nvme-INTEL_SSDPEDMD400G4_PHFT620400XD400BGN", "nvme-nvme.8086-50484654363230343030584434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:44.285311", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-02-11T16:02:44.352 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0346836 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0346836 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:44.532 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSOtgS40CCePgNpv4nYzn5ig77otLWVJUP'], u'uuids': [u'ecaac5e5-9376-48eb-8c2c-f12951a17336']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.079590", "end": "2020-02-11 16:02:44.500094", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSOtgS40CCePgNpv4nYzn5ig77otLWVJUP"], "labels": [], "masters": [], "uuids": ["ecaac5e5-9376-48eb-8c2c-f12951a17336"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:43.420504", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! 2020-02-11T16:02:44.534 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:44.678 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-11T16:02:44.679 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4Y4pHGUJp9HlnLhBtZTqLvNUROXJUCpjY'], u'uuids': [u'e8d05d82-ee71-4b3c-a7b2-797be9ab9e35']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139977", "end": "2020-02-11 16:02:44.649721", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4Y4pHGUJp9HlnLhBtZTqLvNUROXJUCpjY"], "labels": [], "masters": [], "uuids": ["e8d05d82-ee71-4b3c-a7b2-797be9ab9e35"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:44.509744", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137477 s, 839 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137477 s, 839 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:44.993 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy46NlpDL3Mg7JirK2m5dcQRnj1za8nMD8q'], u'uuids': [u'4a409bde-c28e-42af-a9ef-41a0b9abd695']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.135401", "end": "2020-02-11 16:02:44.966555", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy46NlpDL3Mg7JirK2m5dcQRnj1za8nMD8q"], "labels": [], "masters": [], "uuids": ["4a409bde-c28e-42af-a9ef-41a0b9abd695"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:44.831154", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.132861 s, 868 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.132861 s, 868 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:45.307 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4tXswfEvm9ECXrk4oIO6saBACPbSVghZn'], u'uuids': [u'61828885-d9cf-4396-8644-5c4346e522ef']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.136876", "end": "2020-02-11 16:02:45.283899", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4tXswfEvm9ECXrk4oIO6saBACPbSVghZn"], "labels": [], "masters": [], "uuids": ["61828885-d9cf-4396-8644-5c4346e522ef"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:45.147023", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.134364 s, 858 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.134364 s, 858 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:45.633 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4OUKblbk3jtBIEAXZ3914yKo9Yy5qESvR'], u'uuids': [u'33f79322-52c6-4ee9-980f-626919864ae9']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.138491", "end": "2020-02-11 16:02:45.604937", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4OUKblbk3jtBIEAXZ3914yKo9Yy5qESvR"], "labels": [], "masters": [], "uuids": ["33f79322-52c6-4ee9-980f-626919864ae9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:45.466446", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136071 s, 848 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136071 s, 848 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:45.804 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-11T16:02:45.811 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxS2NOsxEUBLPEog1Iwi1993B1XOqZrXBtI'], u'uuids': [u'0bd63c2d-09d3-4434-a13b-9a94a85e5845']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.053968", "end": "2020-02-11 16:02:45.767294", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxS2NOsxEUBLPEog1Iwi1993B1XOqZrXBtI"], "labels": [], "masters": [], "uuids": ["0bd63c2d-09d3-4434-a13b-9a94a85e5845"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:44.713326", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:45.967 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-11T16:02:45.968 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4zf3M1CEnCIJndund4brvL3aIT6fO7ZvL'], u'uuids': [u'799afaae-4ed9-4c65-8ba9-ff7e401d294d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.145823", "end": "2020-02-11 16:02:45.940455", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-1hOIgXxSJctGwFrBw434lO6DUlk5dqy4zf3M1CEnCIJndund4brvL3aIT6fO7ZvL"], "labels": [], "masters": [], "uuids": ["799afaae-4ed9-4c65-8ba9-ff7e401d294d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:45.794632", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143296 s, 805 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143296 s, 805 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:46.018 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:46 +0000 (0:00:01.935) 0:03:33.354 ****** 2020-02-11T16:02:46.267 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-02-11T16:02:46.267 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.059673", "end": "2020-02-11 16:02:46.241059", "rc": 0, "start": "2020-02-11 16:02:46.181386", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:46.306 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:46 +0000 (0:00:00.291) 0:03:33.646 ****** 2020-02-11T16:02:46.549 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-02-11T16:02:46.550 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051253", "end": "2020-02-11 16:02:46.526983", "rc": 0, "start": "2020-02-11 16:02:46.475730", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:46.594 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:46 +0000 (0:00:00.287) 0:03:33.933 ****** 2020-02-11T16:02:46.595 INFO:teuthology.task.ansible.out: 2020-02-11T16:02:46.622 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-02-11T16:02:46.669 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:46 +0000 (0:00:00.075) 0:03:34.009 ****** 2020-02-11T16:02:46.696 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-02-11T16:02:46.696 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:46.739 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:46 +0000 (0:00:00.069) 0:03:34.079 ****** 2020-02-11T16:02:46.786 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:46.823 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:46 +0000 (0:00:00.078) 0:03:34.158 ****** 2020-02-11T16:02:46.846 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-11T16:02:46.848 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:46.888 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:46 +0000 (0:00:00.069) 0:03:34.227 ****** 2020-02-11T16:02:46.913 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:46.952 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:46 +0000 (0:00:00.064) 0:03:34.292 ****** 2020-02-11T16:02:47.109 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-11T16:02:47.110 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSnu0uTfkp1YHhm0cDosoBzVPJ0Bc7FzKu'], u'uuids': [u'04bc65f8-56cc-44f1-9bbd-7188b8a138d6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.061680", "end": "2020-02-11 16:02:47.050069", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSnu0uTfkp1YHhm0cDosoBzVPJ0Bc7FzKu"], "labels": [], "masters": [], "uuids": ["04bc65f8-56cc-44f1-9bbd-7188b8a138d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:45.988389", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:47.154 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi088.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-11T16:02:47.193 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:47 +0000 (0:00:00.241) 0:03:34.533 ****** 2020-02-11T16:02:47.235 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi088.front.sepia.ceph.com] => (item={u'block_used': 12981108, u'uuid': u'6d9a851d-d573-4d97-a747-a9366dcc8e32', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227114000, u'size_available': 930258944000, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60986713, u'device': u'/dev/sda1', u'inode_used': 68263, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114000, "block_size": 4096, "block_total": 240095108, "block_used": 12981108, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986713, "inode_total": 61054976, "inode_used": 68263, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930258944000, "size_total": 983429562368, "uuid": "6d9a851d-d573-4d97-a747-a9366dcc8e32"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:47.269 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:47 +0000 (0:00:00.075) 0:03:34.609 ****** 2020-02-11T16:02:47.295 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-02-11T16:02:47.295 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:47.334 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:47 +0000 (0:00:00.063) 0:03:34.672 ****** 2020-02-11T16:02:47.360 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-11T16:02:47.361 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:47.398 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:47 +0000 (0:00:00.065) 0:03:34.737 ****** 2020-02-11T16:02:47.423 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-11T16:02:47.425 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:47.461 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:47 +0000 (0:00:00.062) 0:03:34.800 ****** 2020-02-11T16:02:47.488 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-02-11T16:02:47.489 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:47.524 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:47 +0000 (0:00:00.063) 0:03:34.864 ****** 2020-02-11T16:02:47.571 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-02-11T16:02:47.573 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:47.608 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:47 +0000 (0:00:00.083) 0:03:34.948 ****** 2020-02-11T16:02:47.645 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-02-11T16:02:47.646 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:47.685 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:47 +0000 (0:00:00.074) 0:03:35.023 ****** 2020-02-11T16:02:48.359 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-11T16:02:48.360 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxS2lGql1rE7I33kNcuYmfbYwrqLybiI2it'], u'uuids': [u'884f715e-ce1a-4e65-b5b0-d31b6bb901cd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.057548", "end": "2020-02-11 16:02:48.326783", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxS2lGql1rE7I33kNcuYmfbYwrqLybiI2it"], "labels": [], "masters": [], "uuids": ["884f715e-ce1a-4e65-b5b0-d31b6bb901cd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:47.269235", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-11T16:02:48.405 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:48 +0000 (0:00:00.721) 0:03:35.744 ****** 2020-02-11T16:02:48.421 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-02-11T16:02:48.423 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-02-11T16:02:48.471 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:48 +0000 (0:00:00.066) 0:03:35.810 ****** 2020-02-11T16:02:48.477 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-11T16:02:48.478 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRYS', u'wwn-0x5000c500871a48d9'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HRYS', u'wwn': u'0x5000c500871a48d9', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'6d9a851d-d573-4d97-a747-a9366dcc8e32', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRYS-part1', u'wwn-0x5000c500871a48d9-part1'], u'uuids': [u'6d9a851d-d573-4d97-a747-a9366dcc8e32']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRYS", "wwn-0x5000c500871a48d9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRYS-part1", "wwn-0x5000c500871a48d9-part1"], "labels": [], "masters": [], "uuids": ["6d9a851d-d573-4d97-a747-a9366dcc8e32"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "6d9a851d-d573-4d97-a747-a9366dcc8e32"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRYS", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-11T16:02:48.480 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500871a48d9"}}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:48.690 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-0iKgHy-ZpwO-tIMU-Lht3-7HZG-91G0-gqX2IM', u'nvme-INTEL_SSDPED1D480GA_PHMB7513010N480DGN', u'nvme-nvme.8086-50484d42373531333031304e34383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036728", "end": "2020-02-11 16:02:48.664152", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-0iKgHy-ZpwO-tIMU-Lht3-7HZG-91G0-gqX2IM", "nvme-INTEL_SSDPED1D480GA_PHMB7513010N480DGN", "nvme-nvme.8086-50484d42373531333031304e34383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:48.627424", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 2020-02-11T16:02:48.692 INFO:teuthology.task.ansible.out: 0.0339573 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0339573 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:48.992 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSo8xlSu4YZBgGTxZqQTIkpibgh2egc32K'], u'uuids': [u'd832a8e4-e274-46c0-89a0-bbd0e6b79b65']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.094258", "end": "2020-02-11 16:02:48.956394", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSo8xlSu4YZBgGTxZqQTIkpibgh2egc32K"], "labels": [], "masters": [], "uuids": ["d832a8e4-e274-46c0-89a0-bbd0e6b79b65"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:48.862136", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0916912 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0916912 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:49.129 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-11T16:02:49.131 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-11T16:02:49.280 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-11T16:02:49.281 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSOtgS40CCePgNpv4nYzn5ig77otLWVJUP'], u'uuids': [u'ecaac5e5-9376-48eb-8c2c-f12951a17336']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.094908", "end": "2020-02-11 16:02:49.251851", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSOtgS40CCePgNpv4nYzn5ig77otLWVJUP"], "labels": [], "masters": [], "uuids": ["ecaac5e5-9376-48eb-8c2c-f12951a17336"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:49.156943", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0922576 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0922576 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:49.468 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-11T16:02:49.571 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-11T16:02:49.572 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxS2NOsxEUBLPEog1Iwi1993B1XOqZrXBtI'], u'uuids': [u'0bd63c2d-09d3-4434-a13b-9a94a85e5845']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.094016", "end": "2020-02-11 16:02:49.545757", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxS2NOsxEUBLPEog1Iwi1993B1XOqZrXBtI"], "labels": [], "masters": [], "uuids": ["0bd63c2d-09d3-4434-a13b-9a94a85e5845"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:49.451741", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0913895 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0913895 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:49.815 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-11T16:02:49.817 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-11T16:02:49.877 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-11T16:02:49.878 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSnu0uTfkp1YHhm0cDosoBzVPJ0Bc7FzKu'], u'uuids': [u'04bc65f8-56cc-44f1-9bbd-7188b8a138d6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.095090", "end": "2020-02-11 16:02:49.837582", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxSnu0uTfkp1YHhm0cDosoBzVPJ0Bc7FzKu"], "labels": [], "masters": [], "uuids": ["04bc65f8-56cc-44f1-9bbd-7188b8a138d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:49.742492", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0924241 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0924241 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:50.174 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxS2lGql1rE7I33kNcuYmfbYwrqLybiI2it'], u'uuids': [u'884f715e-ce1a-4e65-b5b0-d31b6bb901cd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.095643", "end": "2020-02-11 16:02:50.138944", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-pDnVou8J23lf5wNUtQTl22FlIHiD4jxS2lGql1rE7I33kNcuYmfbYwrqLybiI2it"], "labels": [], "masters": [], "uuids": ["884f715e-ce1a-4e65-b5b0-d31b6bb901cd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-11 16:02:50.043301", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0929642 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0929642 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:50.192 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-11T16:02:50.193 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-11T16:02:50.231 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:50 +0000 (0:00:01.759) 0:03:37.570 ****** 2020-02-11T16:02:50.514 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-02-11T16:02:50.515 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.069315", "end": "2020-02-11 16:02:50.482299", "rc": 0, "start": "2020-02-11 16:02:50.412984", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:50.516 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-11T16:02:50.570 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:50 +0000 (0:00:00.339) 0:03:37.909 ****** 2020-02-11T16:02:50.612 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:50 +0000 (0:00:00.042) 0:03:37.952 ****** 2020-02-11T16:02:50.812 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-11T16:02:50.814 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-02-11T16:02:50.850 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:50 +0000 (0:00:00.238) 0:03:38.190 ****** 2020-02-11T16:02:50.856 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-02-11T16:02:50.856 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.052458", "end": "2020-02-11 16:02:50.802111", "rc": 0, "start": "2020-02-11 16:02:50.749653", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:02:50.897 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:50 +0000 (0:00:00.046) 0:03:38.237 ****** 2020-02-11T16:02:50.903 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-11T16:02:50.904 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:50.927 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-02-11T16:02:50.973 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:50 +0000 (0:00:00.075) 0:03:38.313 ****** 2020-02-11T16:02:51.000 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-02-11T16:02:51.002 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:51.052 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.078) 0:03:38.392 ****** 2020-02-11T16:02:51.069 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-11T16:02:51.070 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-11T16:02:51.083 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-02-11T16:02:51.084 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:51.121 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.068) 0:03:38.460 ****** 2020-02-11T16:02:51.147 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-11T16:02:51.148 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:51.188 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.065) 0:03:38.526 ****** 2020-02-11T16:02:51.212 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-02-11T16:02:51.214 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:51.252 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.065) 0:03:38.591 ****** 2020-02-11T16:02:51.257 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-11T16:02:51.258 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-11T16:02:51.440 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-11T16:02:51.452 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-02-11T16:02:51.453 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-11T16:02:51.496 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.243) 0:03:38.835 ****** 2020-02-11T16:02:51.533 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-11T16:02:51.542 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={u'block_used': 12981135, u'uuid': u'6d9a851d-d573-4d97-a747-a9366dcc8e32', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227113973, u'size_available': 930258833408, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60986711, u'device': u'/dev/sda1', u'inode_used': 68265, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227113973, "block_size": 4096, "block_total": 240095108, "block_used": 12981135, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986711, "inode_total": 61054976, "inode_used": 68265, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930258833408, "size_total": 983429562368, "uuid": "6d9a851d-d573-4d97-a747-a9366dcc8e32"}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:51.543 INFO:teuthology.task.ansible.out: 2020-02-11T16:02:51.578 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.082) 0:03:38.918 ****** 2020-02-11T16:02:51.604 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-02-11T16:02:51.605 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:51.642 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.063) 0:03:38.981 ****** 2020-02-11T16:02:51.647 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-11T16:02:51.648 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-11T16:02:51.691 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.048) 0:03:39.030 ****** 2020-02-11T16:02:51.696 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-11T16:02:51.697 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:51.751 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.060) 0:03:39.090 ****** 2020-02-11T16:02:51.805 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:51.862 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.111) 0:03:39.201 ****** 2020-02-11T16:02:51.888 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-02-11T16:02:51.890 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:51.933 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.066) 0:03:39.268 ****** 2020-02-11T16:02:51.935 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-02-11T16:02:51.937 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-11T16:02:51.978 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:51 +0000 (0:00:00.049) 0:03:39.317 ****** 2020-02-11T16:02:51.985 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-02-11T16:02:51.987 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:52.028 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:52 +0000 (0:00:00.050) 0:03:39.368 ****** 2020-02-11T16:02:52.035 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-02-11T16:02:52.038 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-02-11T16:02:52.080 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:52 +0000 (0:00:00.051) 0:03:39.419 ****** 2020-02-11T16:02:52.085 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-02-11T16:02:52.086 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:52.123 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:52 +0000 (0:00:00.043) 0:03:39.463 ****** 2020-02-11T16:02:52.591 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-02-11T16:02:52.592 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-02-11T16:02:52.631 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:52 +0000 (0:00:00.508) 0:03:39.971 ****** 2020-02-11T16:02:52.689 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-02-11T16:02:52.690 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true} 2020-02-11T16:02:52.739 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:52 +0000 (0:00:00.107) 0:03:40.078 ****** 2020-02-11T16:02:53.018 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-11T16:02:53.018 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-11T16:02:53.345 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-02-11T16:02:53.347 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-02-11T16:02:53.384 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:53 +0000 (0:00:00.645) 0:03:40.723 ****** 2020-02-11T16:02:53.389 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-11T16:02:53.390 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-11T16:02:53.412 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-02-11T16:02:53.413 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:53.451 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:53 +0000 (0:00:00.067) 0:03:40.791 ****** 2020-02-11T16:02:53.477 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-02-11T16:02:53.479 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:53.515 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:53 +0000 (0:00:00.064) 0:03:40.855 ****** 2020-02-11T16:02:53.552 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-02-11T16:02:53.554 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:53.596 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:53 +0000 (0:00:00.080) 0:03:40.935 ****** 2020-02-11T16:02:53.622 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-02-11T16:02:53.625 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:53.663 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:53 +0000 (0:00:00.067) 0:03:41.002 ****** 2020-02-11T16:02:53.690 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:53.735 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:53 +0000 (0:00:00.072) 0:03:41.075 ****** 2020-02-11T16:02:53.752 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-11T16:02:53.753 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-11T16:02:53.765 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:53.808 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:53 +0000 (0:00:00.072) 0:03:41.148 ****** 2020-02-11T16:02:53.835 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-02-11T16:02:53.836 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:53.878 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:53 +0000 (0:00:00.069) 0:03:41.217 ****** 2020-02-11T16:02:53.910 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:53.942 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:53 +0000 (0:00:00.064) 0:03:41.281 ****** 2020-02-11T16:02:53.978 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-02-11T16:02:53.979 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:54.018 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:54 +0000 (0:00:00.075) 0:03:41.357 ****** 2020-02-11T16:02:54.043 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-02-11T16:02:54.045 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:54.080 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:54 +0000 (0:00:00.062) 0:03:41.419 ****** 2020-02-11T16:02:54.095 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-11T16:02:54.096 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-11T16:02:54.107 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-02-11T16:02:54.109 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:54.146 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:54 +0000 (0:00:00.066) 0:03:41.485 ****** 2020-02-11T16:02:54.459 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-11T16:02:54.460 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-11T16:02:54.524 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:54 +0000 (0:00:00.378) 0:03:41.864 ****** 2020-02-11T16:02:54.649 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-02-11T16:02:54.650 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-02-11T16:02:54.704 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:54 +0000 (0:00:00.179) 0:03:42.043 ****** 2020-02-11T16:02:54.742 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-11T16:02:54.744 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-02-11T16:02:54.788 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:54 +0000 (0:00:00.076) 0:03:42.120 ****** 2020-02-11T16:02:54.849 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-11T16:02:54.853 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:55.026 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-02-11T16:02:55.029 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-02-11 15:58:52 UTC", "ActiveEnterTimestampMonotonic": "11547175", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target -.mount tmp.mount system.slice ntpdate.service ntpd.service sntp.service sysinit.target systemd-journald.socket systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-02-11 15:58:51 UTC", "AssertTimestampMonotonic": "10470080", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-02-11 15:58:51 UTC", "ConditionTimestampMonotonic": "10469891", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-02-11T16:02:55.031 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2322", "ExecMainStartTimestamp": "Tue 2020-02-11 15:58:52 UTC", "ExecMainStartTimestampMonotonic": "11495557", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-02-11 15:58:51 UTC", "InactiveExitTimestampMonotonic": "10517609", "InvocationID": "750e673d29334857b03e9f275cf182a3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-02-11T16:02:55.032 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2322", "MemoryAccounting": "yes", "MemoryCurrent": "2998272", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-02-11T16:02:55.034 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-02-11 15:58:52 UTC", "StateChangeTimestampMonotonic": "11547175", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-02-11 15:58:52 UTC", "WatchdogTimestampMonotonic": "11495573", "WatchdogUSec": "0"}} 2020-02-11T16:02:55.089 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:55 +0000 (0:00:00.308) 0:03:42.428 ****** 2020-02-11T16:02:55.096 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-11T16:02:55.097 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-11T16:02:55.118 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-02-11T16:02:55.120 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:55.159 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:55 +0000 (0:00:00.069) 0:03:42.498 ****** 2020-02-11T16:02:55.185 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-02-11T16:02:55.187 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:55.224 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:55 +0000 (0:00:00.065) 0:03:42.564 ****** 2020-02-11T16:02:55.252 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-02-11T16:02:55.254 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:55.295 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:55 +0000 (0:00:00.070) 0:03:42.634 ****** 2020-02-11T16:02:55.300 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-11T16:02:55.302 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-11T16:02:55.465 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-11T16:02:55.507 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-02-11T16:02:55.508 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-02-11T16:02:55.556 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:55 +0000 (0:00:00.260) 0:03:42.895 ****** 2020-02-11T16:02:55.668 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-11T16:02:55.669 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-11T16:02:55.714 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:55 +0000 (0:00:00.157) 0:03:43.053 ****** 2020-02-11T16:02:55.928 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-02-11T16:02:55.929 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-11T16:02:55.966 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:55 +0000 (0:00:00.251) 0:03:43.305 ****** 2020-02-11T16:02:56.002 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-02-11T16:02:56.004 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-02-11T16:02:56.040 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:56 +0000 (0:00:00.074) 0:03:43.379 ****** 2020-02-11T16:02:56.045 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-02-11T16:02:56.046 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-02-11T16:02:56.084 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:56 +0000 (0:00:00.044) 0:03:43.424 ****** 2020-02-11T16:02:56.274 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi052.front.sepia.ceph.com] => {"changed": true} 2020-02-11T16:02:56.345 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:56 +0000 (0:00:00.260) 0:03:43.684 ****** 2020-02-11T16:02:56.691 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-02-11T16:02:56.693 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-02-11T16:02:56.757 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:56 +0000 (0:00:00.412) 0:03:44.097 ****** 2020-02-11T16:02:56.783 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-02-11T16:02:56.785 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:56.825 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:56 +0000 (0:00:00.067) 0:03:44.164 ****** 2020-02-11T16:02:56.851 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-02-11T16:02:56.853 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:56.888 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:56 +0000 (0:00:00.063) 0:03:44.227 ****** 2020-02-11T16:02:56.927 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-02-11T16:02:56.929 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:57.003 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:56 +0000 (0:00:00.111) 0:03:44.339 ****** 2020-02-11T16:02:57.025 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-02-11T16:02:57.027 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:57.066 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.066) 0:03:44.405 ****** 2020-02-11T16:02:57.092 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-02-11T16:02:57.094 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:57.135 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.068) 0:03:44.474 ****** 2020-02-11T16:02:57.171 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-02-11T16:02:57.173 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:57.208 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.073) 0:03:44.547 ****** 2020-02-11T16:02:57.234 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-02-11T16:02:57.236 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:57.271 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.062) 0:03:44.610 ****** 2020-02-11T16:02:57.297 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-02-11T16:02:57.298 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:57.332 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.061) 0:03:44.672 ****** 2020-02-11T16:02:57.359 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-02-11T16:02:57.361 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:57.399 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.066) 0:03:44.738 ****** 2020-02-11T16:02:57.433 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-02-11T16:02:57.434 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:57.489 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.090) 0:03:44.829 ****** 2020-02-11T16:02:57.498 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-02-11T16:02:57.499 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-02-11T16:02:57.548 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.059) 0:03:44.888 ****** 2020-02-11T16:02:57.554 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-02-11T16:02:57.555 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:57.602 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.044) 0:03:44.932 ****** TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:57.645 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.052) 0:03:44.985 ****** 2020-02-11T16:02:57.682 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-02-11T16:02:57.684 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-02-11T16:02:57.719 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.074) 0:03:45.059 ****** 2020-02-11T16:02:57.926 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-02-11T16:02:57.927 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-02-11T16:02:57.972 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:57 +0000 (0:00:00.252) 0:03:45.311 ****** 2020-02-11T16:02:58.002 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:58.043 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.071) 0:03:45.383 ****** 2020-02-11T16:02:58.072 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-02-11T16:02:58.074 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-02-11T16:02:58.144 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.100) 0:03:45.483 ****** 2020-02-11T16:02:58.152 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-02-11T16:02:58.153 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-02-11T16:02:58.199 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.054) 0:03:45.538 ****** 2020-02-11T16:02:58.207 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-02-11T16:02:58.208 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:58.250 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.051) 0:03:45.590 ****** 2020-02-11T16:02:58.458 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-02-11T16:02:58.460 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-02-11T16:02:58.513 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.262) 0:03:45.852 ****** 2020-02-11T16:02:58.554 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-02-11T16:02:58.557 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-02-11 15:58:33 UTC", "ActiveEnterTimestampMonotonic": "14408167", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sntp.service sysinit.target -.mount basic.target systemd-journald.socket systemd-tmpfiles-setup.service ntpd.service tmp.mount system.slice ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-02-11 15:58:31 UTC", "AssertTimestampMonotonic": "13137721", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-02-11 15:58:31 UTC", "ConditionTimestampMonotonic": "13137685", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-02-11T16:02:58.558 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2339", "ExecMainStartTimestamp": "Tue 2020-02-11 15:58:33 UTC", "ExecMainStartTimestampMonotonic": "14370658", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-02-11 15:58:31 UTC", "InactiveExitTimestampMonotonic": "13263123", "InvocationID": "de42f29b02df4809b231edf5805b0703", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-02-11T16:02:58.560 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127467", "LimitNPROCSoft": "127467", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127467", "LimitSIGPENDINGSoft": "127467", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2339", "MemoryAccounting": "yes", "MemoryCurrent": "2772992", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-02-11T16:02:58.561 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-02-11 15:58:33 UTC", "StateChangeTimestampMonotonic": "14408167", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-02-11 15:58:33 UTC", "WatchdogTimestampMonotonic": "14370672", "WatchdogUSec": "0"}} 2020-02-11T16:02:58.596 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.083) 0:03:45.936 ****** 2020-02-11T16:02:58.634 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:58.685 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.088) 0:03:46.024 ****** 2020-02-11T16:02:58.724 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-02-11T16:02:58.725 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:58.733 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi088.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-02-11T16:02:58.776 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.091) 0:03:46.115 ****** 2020-02-11T16:02:58.810 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.033) 0:03:46.149 ****** 2020-02-11T16:02:58.815 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:58.854 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.044) 0:03:46.194 ****** 2020-02-11T16:02:58.859 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-02-11T16:02:58.862 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:58.900 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.045) 0:03:46.239 ****** 2020-02-11T16:02:58.941 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi088.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:58.942 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:58.962 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:58.963 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:58.964 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.001 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:58 +0000 (0:00:00.101) 0:03:46.340 ****** 2020-02-11T16:02:59.037 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-02-11T16:02:59.045 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.049 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.050 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.060 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.072 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.089 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-02-11T16:02:59.112 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.110) 0:03:46.451 ****** 2020-02-11T16:02:59.147 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.034) 0:03:46.486 ****** 2020-02-11T16:02:59.172 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-11T16:02:59.174 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.212 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.065) 0:03:46.551 ****** 2020-02-11T16:02:59.238 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.274 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.062) 0:03:46.614 ****** 2020-02-11T16:02:59.300 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-02-11T16:02:59.302 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.339 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.064) 0:03:46.679 ****** 2020-02-11T16:02:59.365 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-02-11T16:02:59.367 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.405 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.063) 0:03:46.743 ****** 2020-02-11T16:02:59.429 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-02-11T16:02:59.430 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.486 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.065) 0:03:46.808 ****** 2020-02-11T16:02:59.495 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-02-11T16:02:59.496 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.533 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.064) 0:03:46.873 ****** 2020-02-11T16:02:59.569 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-02-11T16:02:59.570 INFO:teuthology.task.ansible.out:skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.608 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.074) 0:03:46.947 ****** 2020-02-11T16:02:59.623 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-02-11T16:02:59.625 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-02-11T16:02:59.670 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.059) 0:03:47.007 ****** 2020-02-11T16:02:59.677 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi088.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:02:59.722 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:02:59 +0000 (0:00:00.054) 0:03:47.062 ****** 2020-02-11T16:02:59.962 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-02-11T16:02:59.963 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004593", "end": "2020-02-11 16:02:59.920743", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-02-11 16:02:59.916150", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:03:00.794 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-02-11T16:03:00.840 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:00 +0000 (0:00:01.117) 0:03:48.180 ****** 2020-02-11T16:03:00.877 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-02-11T16:03:00.879 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:00.919 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:00 +0000 (0:00:00.078) 0:03:48.259 ****** 2020-02-11T16:03:00.946 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-02-11T16:03:00.948 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-02-11T16:03:01.005 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:01 +0000 (0:00:00.085) 0:03:48.344 ****** 2020-02-11T16:03:01.157 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-02-11T16:03:01.158 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:01.003912", "end": "2020-02-11 16:03:01.106077", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-02-11 16:03:00.102165", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:03:01.210 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-02-11T16:03:01.212 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-02-11T16:03:01.250 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:01 +0000 (0:00:00.245) 0:03:48.590 ****** 2020-02-11T16:03:01.278 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:01.318 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:01 +0000 (0:00:00.067) 0:03:48.657 ****** 2020-02-11T16:03:01.343 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-02-11T16:03:01.345 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-02-11T16:03:01.386 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:01 +0000 (0:00:00.068) 0:03:48.725 ****** 2020-02-11T16:03:01.391 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-02-11T16:03:01.392 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002818", "end": "2020-02-11 16:03:01.336224", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-02-11 16:03:01.333406", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-02-11T16:03:01.414 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:01.451 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:01 +0000 (0:00:00.065) 0:03:48.791 ****** 2020-02-11T16:03:01.600 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-02-11T16:03:01.606 INFO:teuthology.task.ansible.out:ok: [smithi088.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.032633", "end": "2020-02-11 16:03:01.558462", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-02-11 16:03:01.525829", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:03:01.658 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:01 +0000 (0:00:00.206) 0:03:48.998 ****** 2020-02-11T16:03:01.663 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-02-11T16:03:01.664 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-02-11T16:03:01.710 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:01 +0000 (0:00:00.051) 0:03:49.049 ****** 2020-02-11T16:03:01.715 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-02-11T16:03:01.755 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:01 +0000 (0:00:00.044) 0:03:49.094 ****** 2020-02-11T16:03:01.908 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-02-11T16:03:01.908 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-02-11T16:03:01.946 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:01 +0000 (0:00:00.191) 0:03:49.286 ****** 2020-02-11T16:03:01.962 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-02-11T16:03:01.963 INFO:teuthology.task.ansible.out:changed: [smithi088.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-11T16:03:02.003 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-02-11T16:03:02.006 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.037 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.091) 0:03:49.377 ****** 2020-02-11T16:03:02.077 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-02-11T16:03:02.078 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.089 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi052.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi052.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.101 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.140 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.102) 0:03:49.479 ****** 2020-02-11T16:03:02.177 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-02-11T16:03:02.179 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.189 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.200 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.211 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.212 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.252 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.111) 0:03:49.591 ****** 2020-02-11T16:03:02.277 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-11T16:03:02.279 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.319 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.066) 0:03:49.658 ****** 2020-02-11T16:03:02.344 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-02-11T16:03:02.346 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.387 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.068) 0:03:49.727 ****** 2020-02-11T16:03:02.414 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-02-11T16:03:02.415 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.467 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.079) 0:03:49.806 ****** 2020-02-11T16:03:02.494 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-02-11T16:03:02.496 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.540 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.072) 0:03:49.879 ****** 2020-02-11T16:03:02.567 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.612 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.072) 0:03:49.952 ****** 2020-02-11T16:03:02.638 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-02-11T16:03:02.640 INFO:teuthology.task.ansible.out:skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.691 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.078) 0:03:50.030 ****** 2020-02-11T16:03:02.724 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.794 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.102) 0:03:50.133 ****** 2020-02-11T16:03:02.825 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi052.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-11T16:03:02.867 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:02 +0000 (0:00:00.073) 0:03:50.206 ****** 2020-02-11T16:03:03.105 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-02-11T16:03:03.107 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005801", "end": "2020-02-11 16:03:03.068272", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-02-11 16:03:03.062471", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:03:03.317 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003079", "end": "2020-02-11 16:03:03.277771", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-02-11 16:03:03.274692", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:03:03.531 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002895", "end": "2020-02-11 16:03:03.478706", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-02-11 16:03:03.475811", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-02-11T16:03:03.741 INFO:teuthology.task.ansible.out:ok: [smithi052.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.018540", "end": "2020-02-11 16:03:03.705053", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-02-11 16:03:03.686513", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-11T16:03:03.789 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:03 +0000 (0:00:00.921) 0:03:51.128 ****** 2020-02-11T16:03:03.816 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-02-11T16:03:03.858 INFO:teuthology.task.ansible.out:Tuesday 11 February 2020 16:03:03 +0000 (0:00:00.069) 0:03:51.198 ****** 2020-02-11T16:03:04.061 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-02-11T16:03:04.062 INFO:teuthology.task.ansible.out:changed: [smithi052.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-11T16:03:04.163 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-02-11T16:03:04.166 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-02-11T16:03:04.167 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-02-11T16:03:04.169 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi052.front.sepia.ceph.com : ok=116 changed=37 unreachable=0 failed=0 skipped=165 rescued=0 ignored=3 smithi088.front.sepia.ceph.com : ok=116 changed=37 unreachable=0 failed=0 skipped=165 rescued=0 ignored=3 Tuesday 11 February 2020 16:03:04 +0000 (0:00:00.309) 0:03:51.508 ****** =============================================================================== 2020-02-11T16:03:04.170 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 23.87s users : Create all admin users with sudo access. ----------------------- 23.08s testnode : Install packages -------------------------------------------- 19.15s common : nrpe - Remove SELinux policy package -------------------------- 13.90s common : nrpe - Load SELinux policy package ---------------------------- 12.83s testnode : Base group workaround for BZ1782899 -------------------------- 9.04s common : Install Kerberos Packages (RedHat) ----------------------------- 6.66s users : Remove revoked users -------------------------------------------- 6.10s testnode : Zap all non-root disks --------------------------------------- 3.84s common : nrpe - Install SELinux dependencies ---------------------------- 3.07s testnode : Ensure ceph dependency packages are not present. ------------- 3.04s Gathering Facts --------------------------------------------------------- 2.69s users : Update authorized_keys for each user with literal keys ---------- 2.29s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 2.24s testnode : Ensure ceph packages are not present. ------------------------ 1.52s common : Clean yum cache ------------------------------------------------ 1.38s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 1.11s testnode : Make sure rpm dependencies are installed --------------------- 1.06s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.92s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.88s 2020-02-11T16:03:04.424 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi052.front.sepia.ceph.com')] 2020-02-11T16:03:04.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-11T16:03:04.427 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi088.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T16:03:04.501 INFO:teuthology.orchestra.run.smithi088:> true 2020-02-11T16:03:04.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-11T16:03:04.594 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi052.front.sepia.ceph.com', 'timeout': 60} 2020-02-11T16:03:04.669 INFO:teuthology.orchestra.run.smithi052:> true 2020-02-11T16:03:04.758 INFO:teuthology.run_tasks:Running task clock... 2020-02-11T16:03:04.770 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-02-11T16:03:04.771 INFO:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-02-11T16:03:04.811 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-02-11T16:03:04.831 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-02-11T16:03:04.874 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2020-02-11T16:03:04.888 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2020-02-11T16:03:04.906 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-02-11T16:03:04.924 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-02-11T16:03:04.988 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2020-02-11T16:03:04.991 INFO:teuthology.orchestra.run.smithi088.stdout:210 Number of sources = 4 2020-02-11T16:03:04.991 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-02-11T16:03:04.991 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2020-02-11T16:03:04.991 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-11T16:03:04.991 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-11T16:03:04.991 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-11T16:03:04.992 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-11T16:03:04.992 INFO:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-02-11T16:03:05.033 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-02-11T16:03:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-02-11T16:03:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2020-02-11T16:03:05.121 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2020-02-11T16:03:05.142 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-02-11T16:03:05.163 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-02-11T16:03:05.235 INFO:teuthology.orchestra.run.smithi052.stderr:bash: ntpq: command not found 2020-02-11T16:03:05.237 INFO:teuthology.orchestra.run.smithi052.stdout:210 Number of sources = 4 2020-02-11T16:03:05.237 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-02-11T16:03:05.237 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2020-02-11T16:03:05.238 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-11T16:03:05.238 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-11T16:03:05.238 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-11T16:03:05.238 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-11T16:03:05.239 INFO:teuthology.run_tasks:Running task install... 2020-02-11T16:03:05.251 DEBUG:teuthology.task.install:project ceph 2020-02-11T16:03:05.251 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '71281e48a442b0f38f812cad32658ed72c6d8ff5'}} 2020-02-11T16:03:05.251 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '71281e48a442b0f38f812cad32658ed72c6d8ff5'} 2020-02-11T16:03:05.251 INFO:teuthology.task.install:Using flavor: basic 2020-02-11T16:03:05.259 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-02-11T16:03:05.260 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-02-11T16:03:05.260 INFO:teuthology.orchestra.run.smithi088:> sudo lsb_release -is 2020-02-11T16:03:05.298 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS 2020-02-11T16:03:05.299 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-11T16:03:05.299 INFO:teuthology.orchestra.run.smithi052:> sudo lsb_release -is 2020-02-11T16:03:05.300 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '71281e48a442b0f38f812cad32658ed72c6d8ff5', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-02-11T16:03:05.300 INFO:teuthology.orchestra.run.smithi088:> sudo lsb_release -is 2020-02-11T16:03:05.339 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS 2020-02-11T16:03:05.341 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-11T16:03:05.341 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '71281e48a442b0f38f812cad32658ed72c6d8ff5', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-02-11T16:03:05.341 INFO:teuthology.orchestra.run.smithi052:> sudo lsb_release -is 2020-02-11T16:03:05.373 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS 2020-02-11T16:03:05.375 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-11T16:03:05.375 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=71281e48a442b0f38f812cad32658ed72c6d8ff5 2020-02-11T16:03:05.425 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS 2020-02-11T16:03:05.426 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-11T16:03:05.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=71281e48a442b0f38f812cad32658ed72c6d8ff5 2020-02-11T16:03:05.545 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200211.032856/71281e48a442b0f38f812cad32658ed72c6d8ff5/centos/8/flavors/default/ 2020-02-11T16:03:05.546 INFO:teuthology.task.install.rpm:Package version is 15.1.0-486.g71281e4 2020-02-11T16:03:05.597 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200211.032856/71281e48a442b0f38f812cad32658ed72c6d8ff5/centos/8/flavors/default/ 2020-02-11T16:03:05.598 INFO:teuthology.task.install.rpm:Package version is 15.1.0-486.g71281e4 2020-02-11T16:03:05.672 INFO:teuthology.orchestra.run.smithi088:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-02-11T16:03:05.719 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-02-11T16:03:05.719 INFO:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/71281e48a442b0f38f812cad32658ed72c6d8ff5/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-02-11T16:03:05.765 INFO:teuthology.orchestra.run.smithi052:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-02-11T16:03:05.788 INFO:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-02-11T16:03:05.811 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-02-11T16:03:05.811 INFO:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/71281e48a442b0f38f812cad32658ed72c6d8ff5/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-02-11T16:03:05.872 INFO:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-02-11T16:03:05.883 INFO:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-02-11T16:03:05.943 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2020-02-11T16:03:05.943 INFO:teuthology.orchestra.run.smithi088:> sudo yum clean all 2020-02-11T16:03:05.972 INFO:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-02-11T16:03:06.002 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2020-02-11T16:03:06.003 INFO:teuthology.orchestra.run.smithi052:> sudo yum clean all 2020-02-11T16:03:06.225 INFO:teuthology.orchestra.run.smithi088.stdout:74 files removed 2020-02-11T16:03:06.253 INFO:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-02-11T16:03:06.304 INFO:teuthology.orchestra.run.smithi052.stdout:74 files removed 2020-02-11T16:03:06.334 INFO:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-02-11T16:03:06.821 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 313 kB/s | 69 kB 00:00 2020-02-11T16:03:06.930 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 312 kB/s | 69 kB 00:00 2020-02-11T16:03:07.032 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 67 kB/s | 12 kB 00:00 2020-02-11T16:03:07.144 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 67 kB/s | 12 kB 00:00 2020-02-11T16:03:07.235 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 7.6 kB/s | 1.4 kB 00:00 2020-02-11T16:03:07.349 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 7.6 kB/s | 1.4 kB 00:00 2020-02-11T16:03:07.733 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-8 - AppStream 18 MB/s | 6.4 MB 00:00 2020-02-11T16:03:08.674 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - AppStream 4.5 MB/s | 6.4 MB 00:01 2020-02-11T16:03:09.905 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-8 - Base 4.7 MB/s | 5.0 MB 00:01 2020-02-11T16:03:10.582 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - Base 5.5 MB/s | 5.0 MB 00:00 2020-02-11T16:03:11.207 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-8 - Extras 3.8 kB/s | 2.1 kB 00:00 2020-02-11T16:03:11.673 INFO:teuthology.orchestra.run.smithi052.stdout:Copr repo for ceph-el8 owned by ktdreyer 91 kB/s | 38 kB 00:00 2020-02-11T16:03:12.190 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - Extras 2.3 kB/s | 2.1 kB 00:00 2020-02-11T16:03:12.656 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for ceph-el8 owned by ktdreyer 90 kB/s | 38 kB 00:00 2020-02-11T16:03:12.845 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 5.6 MB 00:01 2020-02-11T16:03:13.238 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 11 MB/s | 5.6 MB 00:00 2020-02-11T16:03:14.082 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 5.8 MB/s | 33 kB 00:00 2020-02-11T16:03:14.407 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 5.8 MB/s | 33 kB 00:00 2020-02-11T16:03:15.019 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-11T16:03:15.019 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-11T16:03:15.023 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-02-11T16:03:15.024 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-02-11T16:03:15.025 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-02-11T16:03:15.025 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-02-11T16:03:15.150 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2020-02-11T16:03:15.162 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2020-02-11T16:03:15.162 INFO:teuthology.orchestra.run.smithi052.stdout: Package ArchVersion Repository Size 2020-02-11T16:03:15.163 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2020-02-11T16:03:15.163 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2020-02-11T16:03:15.163 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_642:15.1.0-486.g71281e4.el8 ceph 6.4 k 2020-02-11T16:03:15.163 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_642:15.1.0-486.g71281e4.el8 ceph 5.5 M 2020-02-11T16:03:15.163 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_642:15.1.0-486.g71281e4.el8 ceph 571 k 2020-02-11T16:03:15.163 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_642:15.1.0-486.g71281e4.el8 ceph 202 k 2020-02-11T16:03:15.163 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_642:15.1.0-486.g71281e4.el8 ceph 1.5 M 2020-02-11T16:03:15.164 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_642:15.1.0-486.g71281e4.el8 ceph 9.7 M 2020-02-11T16:03:15.164 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_642:15.1.0-486.g71281e4.el8 ceph 41 M 2020-02-11T16:03:15.164 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm x86_642:15.1.0-486.g71281e4.el8 ceph 32 k 2020-02-11T16:03:15.164 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_642:15.1.0-486.g71281e4.el8 ceph 21 k 2020-02-11T16:03:15.164 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_642:15.1.0-486.g71281e4.el8 ceph 507 k 2020-02-11T16:03:15.164 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_642:15.1.0-486.g71281e4.el8 ceph 140 k 2020-02-11T16:03:15.164 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_642:15.1.0-486.g71281e4.el8 ceph 149 k 2020-02-11T16:03:15.164 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_642:15.1.0-486.g71281e4.el8 ceph 351 k 2020-02-11T16:03:15.165 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_642:15.1.0-486.g71281e4.el8 ceph 309 k 2020-02-11T16:03:15.165 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_642:15.1.0-486.g71281e4.el8 ceph 113 k 2020-02-11T16:03:15.165 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_642:15.1.0-486.g71281e4.el8 ceph 72 k 2020-02-11T16:03:15.165 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_642:15.1.0-486.g71281e4.el8 ceph 2.6 M 2020-02-11T16:03:15.165 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_642:15.1.0-486.g71281e4.el8 ceph 141 k 2020-02-11T16:03:15.165 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch2:15.1.0-486.g71281e4.el8 ceph-noarch 29 k 2020-02-11T16:03:15.165 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch2:15.1.0-486.g71281e4.el8 ceph-noarch 3.8 M 2020-02-11T16:03:15.166 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch2:15.1.0-486.g71281e4.el8 ceph-noarch 8.6 M 2020-02-11T16:03:15.166 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch2:15.1.0-486.g71281e4.el8 ceph-noarch 17 k 2020-02-11T16:03:15.166 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_643.0.4-10.el8 AppStream 688 k 2020-02-11T16:03:15.166 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_642.6.1-9.el8 AppStream 320 k 2020-02-11T16:03:15.166 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_642.4.6-25.el8 AppStream 709 k 2020-02-11T16:03:15.166 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_640.176-5.el8 BaseOS 54 k 2020-02-11T16:03:15.166 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_640.3.112-1.el8 BaseOS 19 k 2020-02-11T16:03:15.167 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_642.32.1-17.el8 BaseOS 95 k 2020-02-11T16:03:15.167 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_641:1.1.1c-2.el8 BaseOS 2.3 M 2020-02-11T16:03:15.167 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_645.0.0-1.el8 BaseOS 69 k 2020-02-11T16:03:15.167 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2020-02-11T16:03:15.167 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_642:15.1.0-486.g71281e4.el8 ceph 3.6 M 2020-02-11T16:03:15.167 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_642:15.1.0-486.g71281e4.el8 ceph 1.9 M 2020-02-11T16:03:15.167 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2020-02-11T16:03:15.167 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_642:15.1.0-486.g71281e4.el8 ceph 21 M 2020-02-11T16:03:15.168 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_642:15.1.0-486.g71281e4.el8 ceph 2.0 M 2020-02-11T16:03:15.168 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_642:15.1.0-486.g71281e4.el8 ceph 4.3 M 2020-02-11T16:03:15.168 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_642:15.1.0-486.g71281e4.el8 ceph 17 M 2020-02-11T16:03:15.168 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_642:15.1.0-486.g71281e4.el8 ceph 25 k 2020-02-11T16:03:15.168 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_642:15.1.0-486.g71281e4.el8 ceph 377 k 2020-02-11T16:03:15.168 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_642:15.1.0-486.g71281e4.el8 ceph 6.2 M 2020-02-11T16:03:15.168 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_642:15.1.0-486.g71281e4.el8 ceph 40 k 2020-02-11T16:03:15.169 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_642:15.1.0-486.g71281e4.el8 ceph 51 k 2020-02-11T16:03:15.169 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch2:15.1.0-486.g71281e4.el8 ceph-noarch 22 k 2020-02-11T16:03:15.169 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch1.16.1-6.el8 AppStream 713 k 2020-02-11T16:03:15.169 INFO:teuthology.orchestra.run.smithi052.stdout: jq x86_641.5-12.el8 AppStream 161 k 2020-02-11T16:03:15.169 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_640.11.4-1.el8 AppStream 353 k 2020-02-11T16:03:15.169 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_642.8.1-11.el8 AppStream 259 k 2020-02-11T16:03:15.169 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma x86_646.8.2-1.el8 AppStream 188 k 2020-02-11T16:03:15.170 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_640.3.3-2.el8 AppStream 4.3 M 2020-02-11T16:03:15.170 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-threads x86_640.3.3-2.el8 AppStream 4.4 M 2020-02-11T16:03:15.170 INFO:teuthology.orchestra.run.smithi052.stdout: python3-lxml x86_644.2.3-1.el8 AppStream 1.5 M 2020-02-11T16:03:15.170 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch1.0.6-13.el8 AppStream 157 k 2020-02-11T16:03:15.170 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_640.23-19.el8 AppStream 39 k 2020-02-11T16:03:15.170 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_641:1.14.3-9.el8 AppStream 3.7 M 2020-02-11T16:03:15.170 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 AppStream 225 k 2020-02-11T16:03:15.170 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch0.7.2-14.el8 AppStream 44 k 2020-02-11T16:03:15.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch0.3.7-6.el8 AppStream 126 k 2020-02-11T16:03:15.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 AppStream 110 k 2020-02-11T16:03:15.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch2017.2-9.el8 AppStream 54 k 2020-02-11T16:03:15.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f AppStream 15 M 2020-02-11T16:03:15.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webencodings noarch0.5.1-6.el8 AppStream 27 k 2020-02-11T16:03:15.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch0.12.2-4.el8 AppStream 457 k 2020-02-11T16:03:15.171 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_641.7.3.2-6.el8 AppStream 298 k 2020-02-11T16:03:15.172 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_642.9.7-12.el8 BaseOS 82 k 2020-02-11T16:03:15.172 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-common x86_643.2.1-12.el8 BaseOS 21 k 2020-02-11T16:03:15.172 INFO:teuthology.orchestra.run.smithi052.stdout: keyutils-libs-devel x86_641.5.10-6.el8 BaseOS 48 k 2020-02-11T16:03:15.172 INFO:teuthology.orchestra.run.smithi052.stdout: krb5-devel x86_641.17-9.el8 BaseOS 548 k 2020-02-11T16:03:15.172 INFO:teuthology.orchestra.run.smithi052.stdout: libcom_err-devel x86_641.44.6-3.el8 BaseOS 38 k 2020-02-11T16:03:15.172 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_648.3.1-4.5.el8 BaseOS 638 k 2020-02-11T16:03:15.172 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_648.3.1-4.5.el8 BaseOS 169 k 2020-02-11T16:03:15.173 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_640.9.0-1.el8 BaseOS 47 k 2020-02-11T16:03:15.173 INFO:teuthology.orchestra.run.smithi052.stdout: libselinux-devel x86_642.9-2.1.el8 BaseOS 199 k 2020-02-11T16:03:15.173 INFO:teuthology.orchestra.run.smithi052.stdout: libsepol-devel x86_642.9-1.el8 BaseOS 86 k 2020-02-11T16:03:15.173 INFO:teuthology.orchestra.run.smithi052.stdout: libverto-devel x86_640.3.0-5.el8 BaseOS 18 k 2020-02-11T16:03:15.173 INFO:teuthology.orchestra.run.smithi052.stdout: libxslt x86_641.1.32-3.el8 BaseOS 249 k 2020-02-11T16:03:15.173 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-devel x86_6410.32-1.el8 BaseOS 605 k 2020-02-11T16:03:15.173 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf16 x86_6410.32-1.el8 BaseOS 228 k 2020-02-11T16:03:15.174 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf32 x86_6410.32-1.el8 BaseOS 220 k 2020-02-11T16:03:15.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-chardet noarch3.0.4-7.el8 BaseOS 195 k 2020-02-11T16:03:15.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt noarch1.6.1-2.el8 BaseOS 43 k 2020-02-11T16:03:15.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch2.1.0-1.el8 BaseOS 155 k 2020-02-11T16:03:15.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pysocks noarch1.6.8-3.el8 BaseOS 34 k 2020-02-11T16:03:15.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch2.20.0-2.1.el8_1 BaseOS 123 k 2020-02-11T16:03:15.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 BaseOS 43 k 2020-02-11T16:03:15.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch1.24.2-2.el8 BaseOS 176 k 2020-02-11T16:03:15.175 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_641.2.11-10.el8 BaseOS 56 k 2020-02-11T16:03:15.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-02-11T16:03:15.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-02-11T16:03:15.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-02-11T16:03:15.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-02-11T16:03:15.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-02-11T16:03:15.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-02-11T16:03:15.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch7.2.0-3.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-02-11T16:03:15.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-02-11T16:03:15.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-02-11T16:03:15.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-02-11T16:03:15.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-02-11T16:03:15.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-02-11T16:03:15.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-02-11T16:03:15.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-02-11T16:03:15.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-02-11T16:03:15.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-02-11T16:03:15.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-02-11T16:03:15.178 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-02-11T16:03:15.178 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-02-11T16:03:15.178 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-02-11T16:03:15.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-02-11T16:03:15.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-02-11T16:03:15.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-02-11T16:03:15.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-02-11T16:03:15.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-02-11T16:03:15.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-02-11T16:03:15.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch10.0.1-1.el8 epel 1.1 M 2020-02-11T16:03:15.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-02-11T16:03:15.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-02-11T16:03:15.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-02-11T16:03:15.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-02-11T16:03:15.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-02-11T16:03:15.180 INFO:teuthology.orchestra.run.smithi052.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-02-11T16:03:15.181 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_641.6.1-13.el8 lab-extras 69 k 2020-02-11T16:03:15.181 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2020-02-11T16:03:15.181 INFO:teuthology.orchestra.run.smithi052.stdout: python3-html5lib noarch1:0.999999999-6.el8 AppStream 214 k 2020-02-11T16:03:15.181 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-02-11T16:03:15.181 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:03:15.181 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2020-02-11T16:03:15.181 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2020-02-11T16:03:15.181 INFO:teuthology.orchestra.run.smithi052.stdout:Install 119 Packages 2020-02-11T16:03:15.182 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 2 Packages 2020-02-11T16:03:15.182 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:03:15.182 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 176 M 2020-02-11T16:03:15.182 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2020-02-11T16:03:15.263 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-11T16:03:15.263 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-11T16:03:15.266 INFO:teuthology.orchestra.run.smithi088.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-02-11T16:03:15.267 INFO:teuthology.orchestra.run.smithi088.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-02-11T16:03:15.268 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-02-11T16:03:15.268 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-02-11T16:03:15.383 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2020-02-11T16:03:15.395 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2020-02-11T16:03:15.395 INFO:teuthology.orchestra.run.smithi088.stdout: Package ArchVersion Repository Size 2020-02-11T16:03:15.395 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2020-02-11T16:03:15.395 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2020-02-11T16:03:15.395 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_642:15.1.0-486.g71281e4.el8 ceph 6.4 k 2020-02-11T16:03:15.396 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_642:15.1.0-486.g71281e4.el8 ceph 5.5 M 2020-02-11T16:03:15.396 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_642:15.1.0-486.g71281e4.el8 ceph 571 k 2020-02-11T16:03:15.396 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_642:15.1.0-486.g71281e4.el8 ceph 202 k 2020-02-11T16:03:15.396 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_642:15.1.0-486.g71281e4.el8 ceph 1.5 M 2020-02-11T16:03:15.396 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_642:15.1.0-486.g71281e4.el8 ceph 9.7 M 2020-02-11T16:03:15.396 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_642:15.1.0-486.g71281e4.el8 ceph 41 M 2020-02-11T16:03:15.397 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm x86_642:15.1.0-486.g71281e4.el8 ceph 32 k 2020-02-11T16:03:15.397 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_642:15.1.0-486.g71281e4.el8 ceph 21 k 2020-02-11T16:03:15.397 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_642:15.1.0-486.g71281e4.el8 ceph 507 k 2020-02-11T16:03:15.397 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_642:15.1.0-486.g71281e4.el8 ceph 140 k 2020-02-11T16:03:15.397 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_642:15.1.0-486.g71281e4.el8 ceph 149 k 2020-02-11T16:03:15.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_642:15.1.0-486.g71281e4.el8 ceph 351 k 2020-02-11T16:03:15.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_642:15.1.0-486.g71281e4.el8 ceph 309 k 2020-02-11T16:03:15.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_642:15.1.0-486.g71281e4.el8 ceph 113 k 2020-02-11T16:03:15.398 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_642:15.1.0-486.g71281e4.el8 ceph 72 k 2020-02-11T16:03:15.398 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_642:15.1.0-486.g71281e4.el8 ceph 2.6 M 2020-02-11T16:03:15.399 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_642:15.1.0-486.g71281e4.el8 ceph 141 k 2020-02-11T16:03:15.399 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch2:15.1.0-486.g71281e4.el8 ceph-noarch 29 k 2020-02-11T16:03:15.399 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch2:15.1.0-486.g71281e4.el8 ceph-noarch 3.8 M 2020-02-11T16:03:15.399 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch2:15.1.0-486.g71281e4.el8 ceph-noarch 8.6 M 2020-02-11T16:03:15.399 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch2:15.1.0-486.g71281e4.el8 ceph-noarch 17 k 2020-02-11T16:03:15.399 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_643.0.4-10.el8 AppStream 688 k 2020-02-11T16:03:15.400 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_642.6.1-9.el8 AppStream 320 k 2020-02-11T16:03:15.400 INFO:teuthology.orchestra.run.smithi088.stdout: libtool x86_642.4.6-25.el8 AppStream 709 k 2020-02-11T16:03:15.400 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_640.176-5.el8 BaseOS 54 k 2020-02-11T16:03:15.400 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel x86_640.3.112-1.el8 BaseOS 19 k 2020-02-11T16:03:15.400 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel x86_642.32.1-17.el8 BaseOS 95 k 2020-02-11T16:03:15.400 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_641:1.1.1c-2.el8 BaseOS 2.3 M 2020-02-11T16:03:15.401 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel x86_645.0.0-1.el8 BaseOS 69 k 2020-02-11T16:03:15.401 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2020-02-11T16:03:15.401 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_642:15.1.0-486.g71281e4.el8 ceph 3.6 M 2020-02-11T16:03:15.401 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_642:15.1.0-486.g71281e4.el8 ceph 1.9 M 2020-02-11T16:03:15.401 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2020-02-11T16:03:15.401 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_642:15.1.0-486.g71281e4.el8 ceph 21 M 2020-02-11T16:03:15.402 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_642:15.1.0-486.g71281e4.el8 ceph 2.0 M 2020-02-11T16:03:15.402 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_642:15.1.0-486.g71281e4.el8 ceph 4.3 M 2020-02-11T16:03:15.402 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_642:15.1.0-486.g71281e4.el8 ceph 17 M 2020-02-11T16:03:15.402 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_642:15.1.0-486.g71281e4.el8 ceph 25 k 2020-02-11T16:03:15.402 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_642:15.1.0-486.g71281e4.el8 ceph 377 k 2020-02-11T16:03:15.402 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_642:15.1.0-486.g71281e4.el8 ceph 6.2 M 2020-02-11T16:03:15.402 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_642:15.1.0-486.g71281e4.el8 ceph 40 k 2020-02-11T16:03:15.403 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_642:15.1.0-486.g71281e4.el8 ceph 51 k 2020-02-11T16:03:15.403 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch2:15.1.0-486.g71281e4.el8 ceph-noarch 22 k 2020-02-11T16:03:15.403 INFO:teuthology.orchestra.run.smithi088.stdout: automake noarch1.16.1-6.el8 AppStream 713 k 2020-02-11T16:03:15.403 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_641.5-12.el8 AppStream 161 k 2020-02-11T16:03:15.403 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_640.11.4-1.el8 AppStream 353 k 2020-02-11T16:03:15.403 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_642.8.1-11.el8 AppStream 259 k 2020-02-11T16:03:15.403 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_646.8.2-1.el8 AppStream 188 k 2020-02-11T16:03:15.404 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_640.3.3-2.el8 AppStream 4.3 M 2020-02-11T16:03:15.404 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads x86_640.3.3-2.el8 AppStream 4.4 M 2020-02-11T16:03:15.404 INFO:teuthology.orchestra.run.smithi088.stdout: python3-lxml x86_644.2.3-1.el8 AppStream 1.5 M 2020-02-11T16:03:15.404 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch1.0.6-13.el8 AppStream 157 k 2020-02-11T16:03:15.404 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_640.23-19.el8 AppStream 39 k 2020-02-11T16:03:15.404 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_641:1.14.3-9.el8 AppStream 3.7 M 2020-02-11T16:03:15.404 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 AppStream 225 k 2020-02-11T16:03:15.405 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch0.7.2-14.el8 AppStream 44 k 2020-02-11T16:03:15.405 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch0.3.7-6.el8 AppStream 126 k 2020-02-11T16:03:15.405 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 AppStream 110 k 2020-02-11T16:03:15.405 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch2017.2-9.el8 AppStream 54 k 2020-02-11T16:03:15.405 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f AppStream 15 M 2020-02-11T16:03:15.405 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webencodings noarch0.5.1-6.el8 AppStream 27 k 2020-02-11T16:03:15.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch0.12.2-4.el8 AppStream 457 k 2020-02-11T16:03:15.408 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_641.7.3.2-6.el8 AppStream 298 k 2020-02-11T16:03:15.408 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_642.9.7-12.el8 BaseOS 82 k 2020-02-11T16:03:15.408 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-common x86_643.2.1-12.el8 BaseOS 21 k 2020-02-11T16:03:15.408 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel x86_641.5.10-6.el8 BaseOS 48 k 2020-02-11T16:03:15.408 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel x86_641.17-9.el8 BaseOS 548 k 2020-02-11T16:03:15.409 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel x86_641.44.6-3.el8 BaseOS 38 k 2020-02-11T16:03:15.409 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_648.3.1-4.5.el8 BaseOS 638 k 2020-02-11T16:03:15.409 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_648.3.1-4.5.el8 BaseOS 169 k 2020-02-11T16:03:15.409 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_640.9.0-1.el8 BaseOS 47 k 2020-02-11T16:03:15.409 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel x86_642.9-2.1.el8 BaseOS 199 k 2020-02-11T16:03:15.409 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel x86_642.9-1.el8 BaseOS 86 k 2020-02-11T16:03:15.409 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel x86_640.3.0-5.el8 BaseOS 18 k 2020-02-11T16:03:15.410 INFO:teuthology.orchestra.run.smithi088.stdout: libxslt x86_641.1.32-3.el8 BaseOS 249 k 2020-02-11T16:03:15.410 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel x86_6410.32-1.el8 BaseOS 605 k 2020-02-11T16:03:15.410 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16 x86_6410.32-1.el8 BaseOS 228 k 2020-02-11T16:03:15.410 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32 x86_6410.32-1.el8 BaseOS 220 k 2020-02-11T16:03:15.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-chardet noarch3.0.4-7.el8 BaseOS 195 k 2020-02-11T16:03:15.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch1.6.1-2.el8 BaseOS 43 k 2020-02-11T16:03:15.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch2.1.0-1.el8 BaseOS 155 k 2020-02-11T16:03:15.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pysocks noarch1.6.8-3.el8 BaseOS 34 k 2020-02-11T16:03:15.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests noarch2.20.0-2.1.el8_1 BaseOS 123 k 2020-02-11T16:03:15.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 BaseOS 43 k 2020-02-11T16:03:15.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3 noarch1.24.2-2.el8 BaseOS 176 k 2020-02-11T16:03:15.411 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_641.2.11-10.el8 BaseOS 56 k 2020-02-11T16:03:15.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-02-11T16:03:15.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-02-11T16:03:15.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-02-11T16:03:15.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-02-11T16:03:15.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-02-11T16:03:15.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-02-11T16:03:15.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch7.2.0-3.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-02-11T16:03:15.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-02-11T16:03:15.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-02-11T16:03:15.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-02-11T16:03:15.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-02-11T16:03:15.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-02-11T16:03:15.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-02-11T16:03:15.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-02-11T16:03:15.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-02-11T16:03:15.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-02-11T16:03:15.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-02-11T16:03:15.414 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-02-11T16:03:15.414 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-02-11T16:03:15.414 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-02-11T16:03:15.415 INFO:teuthology.orchestra.run.smithi088.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-02-11T16:03:15.415 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-02-11T16:03:15.415 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-02-11T16:03:15.415 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-02-11T16:03:15.415 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-02-11T16:03:15.415 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-02-11T16:03:15.415 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch10.0.1-1.el8 epel 1.1 M 2020-02-11T16:03:15.416 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-02-11T16:03:15.416 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-02-11T16:03:15.416 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-02-11T16:03:15.416 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-02-11T16:03:15.416 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-02-11T16:03:15.416 INFO:teuthology.orchestra.run.smithi088.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-02-11T16:03:15.416 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_641.6.1-13.el8 lab-extras 69 k 2020-02-11T16:03:15.417 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2020-02-11T16:03:15.417 INFO:teuthology.orchestra.run.smithi088.stdout: python3-html5lib noarch1:0.999999999-6.el8 AppStream 214 k 2020-02-11T16:03:15.417 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-02-11T16:03:15.417 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:03:15.417 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2020-02-11T16:03:15.417 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2020-02-11T16:03:15.417 INFO:teuthology.orchestra.run.smithi088.stdout:Install 119 Packages 2020-02-11T16:03:15.418 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 2 Packages 2020-02-11T16:03:15.418 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:03:15.418 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 176 M 2020-02-11T16:03:15.418 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2020-02-11T16:03:15.452 INFO:teuthology.orchestra.run.smithi052.stdout:(1/121): ceph-15.1.0-486.g71281e4.el8.x86_64.rp 73 kB/s | 6.4 kB 00:00 2020-02-11T16:03:15.598 INFO:teuthology.orchestra.run.smithi052.stdout:(2/121): ceph-fuse-15.1.0-486.g71281e4.el8.x86_ 3.7 MB/s | 571 kB 00:00 2020-02-11T16:03:15.632 INFO:teuthology.orchestra.run.smithi052.stdout:(3/121): ceph-immutable-object-cache-15.1.0-486 5.9 MB/s | 202 kB 00:00 2020-02-11T16:03:15.889 INFO:teuthology.orchestra.run.smithi088.stdout:(1/121): ceph-15.1.0-486.g71281e4.el8.x86_64.rp 35 kB/s | 6.4 kB 00:00 2020-02-11T16:03:15.890 INFO:teuthology.orchestra.run.smithi052.stdout:(4/121): ceph-mds-15.1.0-486.g71281e4.el8.x86_6 7.8 MB/s | 2.0 MB 00:00 2020-02-11T16:03:16.013 INFO:teuthology.orchestra.run.smithi052.stdout:(5/121): ceph-base-15.1.0-486.g71281e4.el8.x86_ 8.3 MB/s | 5.5 MB 00:00 2020-02-11T16:03:16.099 INFO:teuthology.orchestra.run.smithi052.stdout:(6/121): ceph-mgr-15.1.0-486.g71281e4.el8.x86_6 7.4 MB/s | 1.5 MB 00:00 2020-02-11T16:03:16.558 INFO:teuthology.orchestra.run.smithi088.stdout:(2/121): ceph-fuse-15.1.0-486.g71281e4.el8.x86_ 854 kB/s | 571 kB 00:00 2020-02-11T16:03:16.559 INFO:teuthology.orchestra.run.smithi052.stdout:(7/121): ceph-mon-15.1.0-486.g71281e4.el8.x86_6 8.0 MB/s | 4.3 MB 00:00 2020-02-11T16:03:16.777 INFO:teuthology.orchestra.run.smithi088.stdout:(3/121): ceph-immutable-object-cache-15.1.0-486 920 kB/s | 202 kB 00:00 2020-02-11T16:03:17.695 INFO:teuthology.orchestra.run.smithi052.stdout:(8/121): ceph-common-15.1.0-486.g71281e4.el8.x8 8.8 MB/s | 21 MB 00:02 2020-02-11T16:03:17.789 INFO:teuthology.orchestra.run.smithi052.stdout:(9/121): ceph-radosgw-15.1.0-486.g71281e4.el8.x 7.9 MB/s | 9.7 MB 00:01 2020-02-11T16:03:17.789 INFO:teuthology.orchestra.run.smithi052.stdout:(10/121): ceph-selinux-15.1.0-486.g71281e4.el8. 263 kB/s | 25 kB 00:00 2020-02-11T16:03:17.852 INFO:teuthology.orchestra.run.smithi052.stdout:(11/121): cephadm-15.1.0-486.g71281e4.el8.x86_6 520 kB/s | 32 kB 00:00 2020-02-11T16:03:17.907 INFO:teuthology.orchestra.run.smithi052.stdout:(12/121): libcephfs-devel-15.1.0-486.g71281e4.e 380 kB/s | 21 kB 00:00 2020-02-11T16:03:17.983 INFO:teuthology.orchestra.run.smithi052.stdout:(13/121): libcephfs2-15.1.0-486.g71281e4.el8.x8 6.5 MB/s | 507 kB 00:00 2020-02-11T16:03:18.046 INFO:teuthology.orchestra.run.smithi052.stdout:(14/121): librados-devel-15.1.0-486.g71281e4.el 2.2 MB/s | 140 kB 00:00 2020-02-11T16:03:18.118 INFO:teuthology.orchestra.run.smithi052.stdout:(15/121): libradosstriper1-15.1.0-486.g71281e4. 5.1 MB/s | 377 kB 00:00 2020-02-11T16:03:18.284 INFO:teuthology.orchestra.run.smithi052.stdout:(16/121): ceph-osd-15.1.0-486.g71281e4.el8.x86_ 7.6 MB/s | 17 MB 00:02 2020-02-11T16:03:18.354 INFO:teuthology.orchestra.run.smithi052.stdout:(17/121): python3-ceph-argparse-15.1.0-486.g712 573 kB/s | 40 kB 00:00 2020-02-11T16:03:18.421 INFO:teuthology.orchestra.run.smithi052.stdout:(18/121): python3-ceph-common-15.1.0-486.g71281 755 kB/s | 51 kB 00:00 2020-02-11T16:03:18.494 INFO:teuthology.orchestra.run.smithi052.stdout:(19/121): python3-cephfs-15.1.0-486.g71281e4.el 2.0 MB/s | 149 kB 00:00 2020-02-11T16:03:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:(20/121): python3-rados-15.1.0-486.g71281e4.el8 4.3 MB/s | 351 kB 00:00 2020-02-11T16:03:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:(21/121): python3-rbd-15.1.0-486.g71281e4.el8.x 3.8 MB/s | 309 kB 00:00 2020-02-11T16:03:18.686 INFO:teuthology.orchestra.run.smithi088.stdout:(4/121): ceph-mds-15.1.0-486.g71281e4.el8.x86_6 1.1 MB/s | 2.0 MB 00:01 2020-02-11T16:03:18.724 INFO:teuthology.orchestra.run.smithi052.stdout:(22/121): python3-rgw-15.1.0-486.g71281e4.el8.x 1.6 MB/s | 113 kB 00:00 2020-02-11T16:03:18.790 INFO:teuthology.orchestra.run.smithi052.stdout:(23/121): rbd-fuse-15.1.0-486.g71281e4.el8.x86_ 1.1 MB/s | 72 kB 00:00 2020-02-11T16:03:18.850 INFO:teuthology.orchestra.run.smithi052.stdout:(24/121): librgw2-15.1.0-486.g71281e4.el8.x86_6 8.5 MB/s | 6.2 MB 00:00 2020-02-11T16:03:18.915 INFO:teuthology.orchestra.run.smithi052.stdout:(25/121): rbd-nbd-15.1.0-486.g71281e4.el8.x86_6 2.1 MB/s | 141 kB 00:00 2020-02-11T16:03:18.975 INFO:teuthology.orchestra.run.smithi052.stdout:(26/121): ceph-grafana-dashboards-15.1.0-486.g7 372 kB/s | 22 kB 00:00 2020-02-11T16:03:19.037 INFO:teuthology.orchestra.run.smithi052.stdout:(27/121): ceph-mgr-cephadm-15.1.0-486.g71281e4. 474 kB/s | 29 kB 00:00 2020-02-11T16:03:19.124 INFO:teuthology.orchestra.run.smithi052.stdout:(28/121): rbd-mirror-15.1.0-486.g71281e4.el8.x8 7.7 MB/s | 2.6 MB 00:00 2020-02-11T16:03:19.653 INFO:teuthology.orchestra.run.smithi052.stdout:(29/121): ceph-mgr-dashboard-15.1.0-486.g71281e 6.2 MB/s | 3.8 MB 00:00 2020-02-11T16:03:19.716 INFO:teuthology.orchestra.run.smithi052.stdout:(30/121): ceph-mgr-rook-15.1.0-486.g71281e4.el8 264 kB/s | 17 kB 00:00 2020-02-11T16:03:19.786 INFO:teuthology.orchestra.run.smithi052.stdout:(31/121): automake-1.16.1-6.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2020-02-11T16:03:19.799 INFO:teuthology.orchestra.run.smithi052.stdout:(32/121): bison-3.0.4-10.el8.x86_64.rpm 52 MB/s | 688 kB 00:00 2020-02-11T16:03:19.812 INFO:teuthology.orchestra.run.smithi052.stdout:(33/121): flex-2.6.1-9.el8.x86_64.rpm 30 MB/s | 320 kB 00:00 2020-02-11T16:03:19.825 INFO:teuthology.orchestra.run.smithi052.stdout:(34/121): jq-1.5-12.el8.x86_64.rpm 11 MB/s | 161 kB 00:00 2020-02-11T16:03:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:(35/121): librdkafka-0.11.4-1.el8.x86_64.rpm 32 MB/s | 353 kB 00:00 2020-02-11T16:03:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:(36/121): libtool-2.4.6-25.el8.x86_64.rpm 52 MB/s | 709 kB 00:00 2020-02-11T16:03:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:(37/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 25 MB/s | 259 kB 00:00 2020-02-11T16:03:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:(38/121): oniguruma-6.8.2-1.el8.x86_64.rpm 19 MB/s | 188 kB 00:00 2020-02-11T16:03:19.885 INFO:teuthology.orchestra.run.smithi088.stdout:(5/121): ceph-base-15.1.0-486.g71281e4.el8.x86_ 1.3 MB/s | 5.5 MB 00:04 2020-02-11T16:03:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:(39/121): openblas-0.3.3-2.el8.x86_64.rpm 91 MB/s | 4.3 MB 00:00 2020-02-11T16:03:20.191 INFO:teuthology.orchestra.run.smithi052.stdout:(40/121): openblas-threads-0.3.3-2.el8.x86_64.r 16 MB/s | 4.4 MB 00:00 2020-02-11T16:03:20.217 INFO:teuthology.orchestra.run.smithi052.stdout:(41/121): python3-html5lib-0.999999999-6.el8.no 8.2 MB/s | 214 kB 00:00 2020-02-11T16:03:20.252 INFO:teuthology.orchestra.run.smithi052.stdout:(42/121): ceph-mgr-diskprediction-local-15.1.0- 7.6 MB/s | 8.6 MB 00:01 2020-02-11T16:03:20.260 INFO:teuthology.orchestra.run.smithi052.stdout:(43/121): python3-lxml-4.2.3-1.el8.x86_64.rpm 35 MB/s | 1.5 MB 00:00 2020-02-11T16:03:20.269 INFO:teuthology.orchestra.run.smithi052.stdout:(44/121): python3-markupsafe-0.23-19.el8.x86_64 4.3 MB/s | 39 kB 00:00 2020-02-11T16:03:20.296 INFO:teuthology.orchestra.run.smithi052.stdout:(45/121): python3-mako-1.0.6-13.el8.noarch.rpm 3.5 MB/s | 157 kB 00:00 2020-02-11T16:03:20.324 INFO:teuthology.orchestra.run.smithi052.stdout:(46/121): python3-numpy-1.14.3-9.el8.x86_64.rpm 68 MB/s | 3.7 MB 00:00 2020-02-11T16:03:20.326 INFO:teuthology.orchestra.run.smithi052.stdout:(47/121): python3-numpy-f2py-1.14.3-9.el8.x86_6 7.6 MB/s | 225 kB 00:00 2020-02-11T16:03:20.334 INFO:teuthology.orchestra.run.smithi052.stdout:(48/121): python3-prettytable-0.7.2-14.el8.noar 4.9 MB/s | 44 kB 00:00 2020-02-11T16:03:20.335 INFO:teuthology.orchestra.run.smithi052.stdout:(49/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 13 MB/s | 126 kB 00:00 2020-02-11T16:03:20.343 INFO:teuthology.orchestra.run.smithi052.stdout:(50/121): python3-pyasn1-modules-0.3.7-6.el8.no 12 MB/s | 110 kB 00:00 2020-02-11T16:03:20.345 INFO:teuthology.orchestra.run.smithi052.stdout:(51/121): python3-pytz-2017.2-9.el8.noarch.rpm 5.7 MB/s | 54 kB 00:00 2020-02-11T16:03:20.355 INFO:teuthology.orchestra.run.smithi088.stdout:(6/121): ceph-mgr-15.1.0-486.g71281e4.el8.x86_6 950 kB/s | 1.5 MB 00:01 2020-02-11T16:03:20.356 INFO:teuthology.orchestra.run.smithi052.stdout:(52/121): python3-webencodings-0.5.1-6.el8.noar 2.4 MB/s | 27 kB 00:00 2020-02-11T16:03:20.376 INFO:teuthology.orchestra.run.smithi052.stdout:(53/121): python3-werkzeug-0.12.2-4.el8.noarch. 22 MB/s | 457 kB 00:00 2020-02-11T16:03:20.388 INFO:teuthology.orchestra.run.smithi052.stdout:(54/121): socat-1.7.3.2-6.el8.x86_64.rpm 26 MB/s | 298 kB 00:00 2020-02-11T16:03:20.502 INFO:teuthology.orchestra.run.smithi052.stdout:(55/121): python3-scipy-1.0.0-20.module_el8.1.0 91 MB/s | 15 MB 00:00 2020-02-11T16:03:20.650 INFO:teuthology.orchestra.run.smithi088.stdout:(7/121): ceph-common-15.1.0-486.g71281e4.el8.x8 4.2 MB/s | 21 MB 00:04 2020-02-11T16:03:20.724 INFO:teuthology.orchestra.run.smithi052.stdout:(56/121): elfutils-libelf-devel-0.176-5.el8.x86 160 kB/s | 54 kB 00:00 2020-02-11T16:03:20.802 INFO:teuthology.orchestra.run.smithi052.stdout:(57/121): fuse-common-3.2.1-12.el8.x86_64.rpm 275 kB/s | 21 kB 00:00 2020-02-11T16:03:20.807 INFO:teuthology.orchestra.run.smithi052.stdout:(58/121): fuse-2.9.7-12.el8.x86_64.rpm 271 kB/s | 82 kB 00:00 2020-02-11T16:03:20.879 INFO:teuthology.orchestra.run.smithi052.stdout:(59/121): keyutils-libs-devel-1.5.10-6.el8.x86_ 614 kB/s | 48 kB 00:00 2020-02-11T16:03:20.957 INFO:teuthology.orchestra.run.smithi052.stdout:(60/121): libaio-devel-0.3.112-1.el8.x86_64.rpm 240 kB/s | 19 kB 00:00 2020-02-11T16:03:21.038 INFO:teuthology.orchestra.run.smithi052.stdout:(61/121): libcom_err-devel-1.44.6-3.el8.x86_64. 489 kB/s | 38 kB 00:00 2020-02-11T16:03:21.041 INFO:teuthology.orchestra.run.smithi052.stdout:(62/121): krb5-devel-1.17-9.el8.x86_64.rpm 2.3 MB/s | 548 kB 00:00 2020-02-11T16:03:21.122 INFO:teuthology.orchestra.run.smithi052.stdout:(63/121): libquadmath-8.3.1-4.5.el8.x86_64.rpm 2.0 MB/s | 169 kB 00:00 2020-02-11T16:03:21.401 INFO:teuthology.orchestra.run.smithi052.stdout:(64/121): ceph-test-15.1.0-486.g71281e4.el8.x86 11 MB/s | 41 MB 00:03 2020-02-11T16:03:21.402 INFO:teuthology.orchestra.run.smithi052.stdout:(65/121): librabbitmq-0.9.0-1.el8.x86_64.rpm 167 kB/s | 47 kB 00:00 2020-02-11T16:03:21.404 INFO:teuthology.orchestra.run.smithi088.stdout:(8/121): ceph-radosgw-15.1.0-486.g71281e4.el8.x 13 MB/s | 9.7 MB 00:00 2020-02-11T16:03:21.426 INFO:teuthology.orchestra.run.smithi088.stdout:(9/121): ceph-selinux-15.1.0-486.g71281e4.el8.x 1.1 MB/s | 25 kB 00:00 2020-02-11T16:03:21.476 INFO:teuthology.orchestra.run.smithi052.stdout:(66/121): libgfortran-8.3.1-4.5.el8.x86_64.rpm 1.4 MB/s | 638 kB 00:00 2020-02-11T16:03:21.480 INFO:teuthology.orchestra.run.smithi052.stdout:(67/121): libsepol-devel-2.9-1.el8.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2020-02-11T16:03:21.551 INFO:teuthology.orchestra.run.smithi052.stdout:(68/121): libuuid-devel-2.32.1-17.el8.x86_64.rp 1.2 MB/s | 95 kB 00:00 2020-02-11T16:03:21.557 INFO:teuthology.orchestra.run.smithi052.stdout:(69/121): libverto-devel-0.3.0-5.el8.x86_64.rpm 232 kB/s | 18 kB 00:00 2020-02-11T16:03:21.628 INFO:teuthology.orchestra.run.smithi052.stdout:(70/121): libxslt-1.1.32-3.el8.x86_64.rpm 3.2 MB/s | 249 kB 00:00 2020-02-11T16:03:21.768 INFO:teuthology.orchestra.run.smithi052.stdout:(71/121): libselinux-devel-2.9-2.1.el8.x86_64.r 544 kB/s | 199 kB 00:00 2020-02-11T16:03:21.772 INFO:teuthology.orchestra.run.smithi088.stdout:(10/121): ceph-mon-15.1.0-486.g71281e4.el8.x86_ 2.3 MB/s | 4.3 MB 00:01 2020-02-11T16:03:21.778 INFO:teuthology.orchestra.run.smithi052.stdout:(72/121): pcre2-devel-10.32-1.el8.x86_64.rpm 4.0 MB/s | 605 kB 00:00 2020-02-11T16:03:21.797 INFO:teuthology.orchestra.run.smithi088.stdout:(11/121): cephadm-15.1.0-486.g71281e4.el8.x86_6 1.3 MB/s | 32 kB 00:00 2020-02-11T16:03:21.817 INFO:teuthology.orchestra.run.smithi088.stdout:(12/121): libcephfs-devel-15.1.0-486.g71281e4.e 1.0 MB/s | 21 kB 00:00 2020-02-11T16:03:21.854 INFO:teuthology.orchestra.run.smithi052.stdout:(73/121): pcre2-utf32-10.32-1.el8.x86_64.rpm 2.8 MB/s | 220 kB 00:00 2020-02-11T16:03:21.865 INFO:teuthology.orchestra.run.smithi052.stdout:(74/121): openssl-devel-1.1.1c-2.el8.x86_64.rpm 7.4 MB/s | 2.3 MB 00:00 2020-02-11T16:03:21.917 INFO:teuthology.orchestra.run.smithi052.stdout:(75/121): pcre2-utf16-10.32-1.el8.x86_64.rpm 1.5 MB/s | 228 kB 00:00 2020-02-11T16:03:21.930 INFO:teuthology.orchestra.run.smithi052.stdout:(76/121): python3-chardet-3.0.4-7.el8.noarch.rp 2.5 MB/s | 195 kB 00:00 2020-02-11T16:03:21.931 INFO:teuthology.orchestra.run.smithi088.stdout:(13/121): libcephfs2-15.1.0-486.g71281e4.el8.x8 4.4 MB/s | 507 kB 00:00 2020-02-11T16:03:21.942 INFO:teuthology.orchestra.run.smithi052.stdout:(77/121): python3-jwt-1.6.1-2.el8.noarch.rpm 550 kB/s | 43 kB 00:00 2020-02-11T16:03:21.977 INFO:teuthology.orchestra.run.smithi088.stdout:(14/121): librados-devel-15.1.0-486.g71281e4.el 3.2 MB/s | 140 kB 00:00 2020-02-11T16:03:21.993 INFO:teuthology.orchestra.run.smithi052.stdout:(78/121): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2020-02-11T16:03:22.004 INFO:teuthology.orchestra.run.smithi052.stdout:(79/121): python3-pysocks-1.6.8-3.el8.noarch.rp 462 kB/s | 34 kB 00:00 2020-02-11T16:03:22.021 INFO:teuthology.orchestra.run.smithi052.stdout:(80/121): python3-requests-2.20.0-2.1.el8_1.noa 1.5 MB/s | 123 kB 00:00 2020-02-11T16:03:22.066 INFO:teuthology.orchestra.run.smithi088.stdout:(15/121): libradosstriper1-15.1.0-486.g71281e4. 4.0 MB/s | 377 kB 00:00 2020-02-11T16:03:22.068 INFO:teuthology.orchestra.run.smithi052.stdout:(81/121): python3-requests-oauthlib-1.0.0-1.el8 570 kB/s | 43 kB 00:00 2020-02-11T16:03:22.081 INFO:teuthology.orchestra.run.smithi052.stdout:(82/121): python3-urllib3-1.24.2-2.el8.noarch.r 2.2 MB/s | 176 kB 00:00 2020-02-11T16:03:22.098 INFO:teuthology.orchestra.run.smithi052.stdout:(83/121): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 889 kB/s | 69 kB 00:00 2020-02-11T16:03:22.145 INFO:teuthology.orchestra.run.smithi052.stdout:(84/121): zlib-devel-1.2.11-10.el8.x86_64.rpm 731 kB/s | 56 kB 00:00 2020-02-11T16:03:22.162 INFO:teuthology.orchestra.run.smithi052.stdout:(85/121): python3-cheroot-8.2.1-1.el8.noarch.rp 1.8 MB/s | 145 kB 00:00 2020-02-11T16:03:22.169 INFO:teuthology.orchestra.run.smithi052.stdout:(86/121): python3-cherrypy-18.4.0-1.el8.noarch. 5.4 MB/s | 385 kB 00:00 2020-02-11T16:03:22.169 INFO:teuthology.orchestra.run.smithi052.stdout:(87/121): python3-jaraco-6.2-6.el8.noarch.rpm 1.1 MB/s | 11 kB 00:00 2020-02-11T16:03:22.177 INFO:teuthology.orchestra.run.smithi052.stdout:(88/121): python3-jaraco-functools-2.0-4.el8.no 1.9 MB/s | 18 kB 00:00 2020-02-11T16:03:22.184 INFO:teuthology.orchestra.run.smithi052.stdout:(89/121): python3-logutils-0.3.5-11.el8.noarch. 3.3 MB/s | 49 kB 00:00 2020-02-11T16:03:22.189 INFO:teuthology.orchestra.run.smithi052.stdout:(90/121): python3-more-itertools-7.2.0-3.el8.no 5.0 MB/s | 59 kB 00:00 2020-02-11T16:03:22.205 INFO:teuthology.orchestra.run.smithi052.stdout:(91/121): python3-portend-2.6-1.el8.noarch.rpm 1.3 MB/s | 16 kB 00:00 2020-02-11T16:03:22.213 INFO:teuthology.orchestra.run.smithi052.stdout:(92/121): python3-remoto-1.1.4-4.el8.noarch.rpm 4.2 MB/s | 48 kB 00:00 2020-02-11T16:03:22.215 INFO:teuthology.orchestra.run.smithi052.stdout:(93/121): python3-execnet-1.7.1-1.el8.2.noarch. 5.0 MB/s | 356 kB 00:00 2020-02-11T16:03:22.222 INFO:teuthology.orchestra.run.smithi052.stdout:(94/121): python3-pecan-1.3.2-9.el8.noarch.rpm 7.3 MB/s | 283 kB 00:00 2020-02-11T16:03:22.224 INFO:teuthology.orchestra.run.smithi052.stdout:(95/121): python3-repoze-lru-0.7-6.el8.noarch.r 2.9 MB/s | 34 kB 00:00 2020-02-11T16:03:22.227 INFO:teuthology.orchestra.run.smithi052.stdout:(96/121): python3-routes-2.4.1-12.el8.noarch.rp 16 MB/s | 197 kB 00:00 2020-02-11T16:03:22.233 INFO:teuthology.orchestra.run.smithi052.stdout:(97/121): python3-singledispatch-3.4.0.3-18.el8 2.9 MB/s | 24 kB 00:00 2020-02-11T16:03:22.234 INFO:teuthology.orchestra.run.smithi052.stdout:(98/121): python3-simplegeneric-0.8.1-17.el8.no 1.5 MB/s | 19 kB 00:00 2020-02-11T16:03:22.241 INFO:teuthology.orchestra.run.smithi052.stdout:(99/121): python3-tempora-1.14.1-5.el8.noarch.r 2.1 MB/s | 30 kB 00:00 2020-02-11T16:03:22.242 INFO:teuthology.orchestra.run.smithi052.stdout:(100/121): python3-trustme-0.5.2-4.el8.noarch.r 3.0 MB/s | 27 kB 00:00 2020-02-11T16:03:22.252 INFO:teuthology.orchestra.run.smithi052.stdout:(101/121): python3-zc-lockfile-2.0-2.el8.noarch 1.3 MB/s | 23 kB 00:00 2020-02-11T16:03:22.305 INFO:teuthology.orchestra.run.smithi052.stdout:(102/121): liboath-2.6.2-3.el8.x86_64.rpm 939 kB/s | 59 kB 00:00 2020-02-11T16:03:22.321 INFO:teuthology.orchestra.run.smithi052.stdout:(103/121): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-02-11T16:03:22.329 INFO:teuthology.orchestra.run.smithi052.stdout:(104/121): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2020-02-11T16:03:22.337 INFO:teuthology.orchestra.run.smithi052.stdout:(105/121): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.6 MB/s | 44 kB 00:00 2020-02-11T16:03:22.353 INFO:teuthology.orchestra.run.smithi052.stdout:(106/121): python3-cachetools-3.1.1-4.el8.noarc 2.1 MB/s | 33 kB 00:00 2020-02-11T16:03:22.355 INFO:teuthology.orchestra.run.smithi052.stdout:(107/121): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-02-11T16:03:22.366 INFO:teuthology.orchestra.run.smithi052.stdout:(108/121): python3-beautifulsoup4-4.6.3-2.el8.1 4.7 MB/s | 185 kB 00:00 2020-02-11T16:03:22.369 INFO:teuthology.orchestra.run.smithi052.stdout:(109/121): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-02-11T16:03:22.374 INFO:teuthology.orchestra.run.smithi052.stdout:(110/121): python3-cssselect-0.9.2-10.el8.noarc 2.0 MB/s | 40 kB 00:00 2020-02-11T16:03:22.385 INFO:teuthology.orchestra.run.smithi052.stdout:(111/121): python3-google-auth-1.1.1-10.el8.noa 4.0 MB/s | 81 kB 00:00 2020-02-11T16:03:22.394 INFO:teuthology.orchestra.run.smithi052.stdout:(112/121): python3-rsa-3.4.2-12.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2020-02-11T16:03:22.424 INFO:teuthology.orchestra.run.smithi052.stdout:(113/121): python3-waitress-1.2.1-2.el8.1.noarc 6.1 MB/s | 241 kB 00:00 2020-02-11T16:03:22.434 INFO:teuthology.orchestra.run.smithi052.stdout:(114/121): python3-webob-1.8.5-1.el8.1.noarch.r 6.3 MB/s | 251 kB 00:00 2020-02-11T16:03:22.444 INFO:teuthology.orchestra.run.smithi052.stdout:(115/121): python3-websocket-client-0.56.0-5.el 3.1 MB/s | 61 kB 00:00 2020-02-11T16:03:22.450 INFO:teuthology.orchestra.run.smithi052.stdout:(116/121): leveldb-1.21-2.el8.x86_64.rpm 29 MB/s | 179 kB 00:00 2020-02-11T16:03:22.452 INFO:teuthology.orchestra.run.smithi052.stdout:(117/121): xmlstarlet-1.6.1-13.el8.x86_64.rpm 33 MB/s | 69 kB 00:00 2020-02-11T16:03:22.453 INFO:teuthology.orchestra.run.smithi052.stdout:(118/121): python3-webtest-2.0.33-1.el8.noarch. 4.2 MB/s | 85 kB 00:00 2020-02-11T16:03:22.524 INFO:teuthology.orchestra.run.smithi052.stdout:(119/121): python3-kubernetes-10.0.1-1.el8.noar 7.2 MB/s | 1.1 MB 00:00 2020-02-11T16:03:23.022 INFO:teuthology.orchestra.run.smithi052.stdout:(120/121): librbd1-15.1.0-486.g71281e4.el8.x86_ 3.3 MB/s | 1.9 MB 00:00 2020-02-11T16:03:23.227 INFO:teuthology.orchestra.run.smithi052.stdout:(121/121): librados2-15.1.0-486.g71281e4.el8.x8 4.6 MB/s | 3.6 MB 00:00 2020-02-11T16:03:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2020-02-11T16:03:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:Total 22 MB/s | 176 MB 00:08 2020-02-11T16:03:23.318 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2020-02-11T16:03:23.429 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2020-02-11T16:03:23.430 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2020-02-11T16:03:23.530 INFO:teuthology.orchestra.run.smithi088.stdout:(16/121): librgw2-15.1.0-486.g71281e4.el8.x86_6 4.2 MB/s | 6.2 MB 00:01 2020-02-11T16:03:23.558 INFO:teuthology.orchestra.run.smithi088.stdout:(17/121): python3-ceph-argparse-15.1.0-486.g712 1.4 MB/s | 40 kB 00:00 2020-02-11T16:03:23.580 INFO:teuthology.orchestra.run.smithi088.stdout:(18/121): python3-ceph-common-15.1.0-486.g71281 2.2 MB/s | 51 kB 00:00 2020-02-11T16:03:23.629 INFO:teuthology.orchestra.run.smithi088.stdout:(19/121): python3-cephfs-15.1.0-486.g71281e4.el 3.0 MB/s | 149 kB 00:00 2020-02-11T16:03:23.708 INFO:teuthology.orchestra.run.smithi088.stdout:(20/121): python3-rados-15.1.0-486.g71281e4.el8 4.4 MB/s | 351 kB 00:00 2020-02-11T16:03:24.046 INFO:teuthology.orchestra.run.smithi088.stdout:(21/121): ceph-test-15.1.0-486.g71281e4.el8.x86 16 MB/s | 41 MB 00:02 2020-02-11T16:03:24.049 INFO:teuthology.orchestra.run.smithi088.stdout:(22/121): python3-rbd-15.1.0-486.g71281e4.el8.x 904 kB/s | 309 kB 00:00 2020-02-11T16:03:24.069 INFO:teuthology.orchestra.run.smithi088.stdout:(23/121): python3-rgw-15.1.0-486.g71281e4.el8.x 4.9 MB/s | 113 kB 00:00 2020-02-11T16:03:24.071 INFO:teuthology.orchestra.run.smithi088.stdout:(24/121): rbd-fuse-15.1.0-486.g71281e4.el8.x86_ 3.3 MB/s | 72 kB 00:00 2020-02-11T16:03:24.095 INFO:teuthology.orchestra.run.smithi088.stdout:(25/121): rbd-nbd-15.1.0-486.g71281e4.el8.x86_6 5.7 MB/s | 141 kB 00:00 2020-02-11T16:03:24.118 INFO:teuthology.orchestra.run.smithi088.stdout:(26/121): ceph-grafana-dashboards-15.1.0-486.g7 1.0 MB/s | 22 kB 00:00 2020-02-11T16:03:24.140 INFO:teuthology.orchestra.run.smithi088.stdout:(27/121): ceph-mgr-cephadm-15.1.0-486.g71281e4. 1.3 MB/s | 29 kB 00:00 2020-02-11T16:03:24.222 INFO:teuthology.orchestra.run.smithi088.stdout:(28/121): rbd-mirror-15.1.0-486.g71281e4.el8.x8 17 MB/s | 2.6 MB 00:00 2020-02-11T16:03:24.602 INFO:teuthology.orchestra.run.smithi088.stdout:(29/121): ceph-osd-15.1.0-486.g71281e4.el8.x86_ 3.9 MB/s | 17 MB 00:04 2020-02-11T16:03:24.635 INFO:teuthology.orchestra.run.smithi088.stdout:(30/121): ceph-mgr-rook-15.1.0-486.g71281e4.el8 506 kB/s | 17 kB 00:00 2020-02-11T16:03:24.700 INFO:teuthology.orchestra.run.smithi088.stdout:(31/121): automake-1.16.1-6.el8.noarch.rpm 11 MB/s | 713 kB 00:00 2020-02-11T16:03:24.714 INFO:teuthology.orchestra.run.smithi088.stdout:(32/121): bison-3.0.4-10.el8.x86_64.rpm 51 MB/s | 688 kB 00:00 2020-02-11T16:03:24.725 INFO:teuthology.orchestra.run.smithi088.stdout:(33/121): flex-2.6.1-9.el8.x86_64.rpm 29 MB/s | 320 kB 00:00 2020-02-11T16:03:24.728 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2020-02-11T16:03:24.729 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2020-02-11T16:03:24.735 INFO:teuthology.orchestra.run.smithi088.stdout:(34/121): jq-1.5-12.el8.x86_64.rpm 16 MB/s | 161 kB 00:00 2020-02-11T16:03:24.763 INFO:teuthology.orchestra.run.smithi088.stdout:(35/121): ceph-mgr-diskprediction-local-15.1.0- 16 MB/s | 8.6 MB 00:00 2020-02-11T16:03:24.765 INFO:teuthology.orchestra.run.smithi088.stdout:(36/121): librdkafka-0.11.4-1.el8.x86_64.rpm 11 MB/s | 353 kB 00:00 2020-02-11T16:03:24.775 INFO:teuthology.orchestra.run.smithi088.stdout:(37/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 25 MB/s | 259 kB 00:00 2020-02-11T16:03:24.786 INFO:teuthology.orchestra.run.smithi088.stdout:(38/121): oniguruma-6.8.2-1.el8.x86_64.rpm 19 MB/s | 188 kB 00:00 2020-02-11T16:03:24.828 INFO:teuthology.orchestra.run.smithi088.stdout:(39/121): openblas-0.3.3-2.el8.x86_64.rpm 102 MB/s | 4.3 MB 00:00 2020-02-11T16:03:24.839 INFO:teuthology.orchestra.run.smithi088.stdout:(40/121): ceph-mgr-dashboard-15.1.0-486.g71281e 5.4 MB/s | 3.8 MB 00:00 2020-02-11T16:03:24.842 INFO:teuthology.orchestra.run.smithi088.stdout:(41/121): libtool-2.4.6-25.el8.x86_64.rpm 8.8 MB/s | 709 kB 00:00 2020-02-11T16:03:24.874 INFO:teuthology.orchestra.run.smithi088.stdout:(42/121): openblas-threads-0.3.3-2.el8.x86_64.r 95 MB/s | 4.4 MB 00:00 2020-02-11T16:03:24.880 INFO:teuthology.orchestra.run.smithi088.stdout:(43/121): python3-lxml-4.2.3-1.el8.x86_64.rpm 39 MB/s | 1.5 MB 00:00 2020-02-11T16:03:24.884 INFO:teuthology.orchestra.run.smithi088.stdout:(44/121): python3-mako-1.0.6-13.el8.noarch.rpm 16 MB/s | 157 kB 00:00 2020-02-11T16:03:24.889 INFO:teuthology.orchestra.run.smithi088.stdout:(45/121): python3-markupsafe-0.23-19.el8.x86_64 4.2 MB/s | 39 kB 00:00 2020-02-11T16:03:24.890 INFO:teuthology.orchestra.run.smithi088.stdout:(46/121): python3-html5lib-0.999999999-6.el8.no 4.1 MB/s | 214 kB 00:00 2020-02-11T16:03:24.899 INFO:teuthology.orchestra.run.smithi088.stdout:(47/121): python3-prettytable-0.7.2-14.el8.noar 4.8 MB/s | 44 kB 00:00 2020-02-11T16:03:24.900 INFO:teuthology.orchestra.run.smithi088.stdout:(48/121): python3-numpy-f2py-1.14.3-9.el8.x86_6 21 MB/s | 225 kB 00:00 2020-02-11T16:03:24.909 INFO:teuthology.orchestra.run.smithi088.stdout:(49/121): python3-pyasn1-modules-0.3.7-6.el8.no 11 MB/s | 110 kB 00:00 2020-02-11T16:03:24.920 INFO:teuthology.orchestra.run.smithi088.stdout:(50/121): python3-numpy-1.14.3-9.el8.x86_64.rpm 104 MB/s | 3.7 MB 00:00 2020-02-11T16:03:24.920 INFO:teuthology.orchestra.run.smithi088.stdout:(51/121): python3-pytz-2017.2-9.el8.noarch.rpm 4.8 MB/s | 54 kB 00:00 2020-02-11T16:03:24.929 INFO:teuthology.orchestra.run.smithi088.stdout:(52/121): python3-webencodings-0.5.1-6.el8.noar 3.1 MB/s | 27 kB 00:00 2020-02-11T16:03:24.951 INFO:teuthology.orchestra.run.smithi088.stdout:(53/121): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2020-02-11T16:03:24.961 INFO:teuthology.orchestra.run.smithi088.stdout:(54/121): socat-1.7.3.2-6.el8.x86_64.rpm 29 MB/s | 298 kB 00:00 2020-02-11T16:03:25.057 INFO:teuthology.orchestra.run.smithi088.stdout:(55/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 804 kB/s | 126 kB 00:00 2020-02-11T16:03:25.216 INFO:teuthology.orchestra.run.smithi088.stdout:(56/121): python3-scipy-1.0.0-20.module_el8.1.0 49 MB/s | 15 MB 00:00 2020-02-11T16:03:25.248 INFO:teuthology.orchestra.run.smithi088.stdout:(57/121): elfutils-libelf-devel-0.176-5.el8.x86 188 kB/s | 54 kB 00:00 2020-02-11T16:03:25.324 INFO:teuthology.orchestra.run.smithi088.stdout:(58/121): keyutils-libs-devel-1.5.10-6.el8.x86_ 631 kB/s | 48 kB 00:00 2020-02-11T16:03:25.437 INFO:teuthology.orchestra.run.smithi088.stdout:(59/121): fuse-2.9.7-12.el8.x86_64.rpm 217 kB/s | 82 kB 00:00 2020-02-11T16:03:25.444 INFO:teuthology.orchestra.run.smithi088.stdout:(60/121): fuse-common-3.2.1-12.el8.x86_64.rpm 92 kB/s | 21 kB 00:00 2020-02-11T16:03:25.513 INFO:teuthology.orchestra.run.smithi088.stdout:(61/121): libaio-devel-0.3.112-1.el8.x86_64.rpm 244 kB/s | 19 kB 00:00 2020-02-11T16:03:25.543 INFO:teuthology.orchestra.run.smithi088.stdout:(62/121): krb5-devel-1.17-9.el8.x86_64.rpm 2.4 MB/s | 548 kB 00:00 2020-02-11T16:03:25.599 INFO:teuthology.orchestra.run.smithi088.stdout:(63/121): libcom_err-devel-1.44.6-3.el8.x86_64. 244 kB/s | 38 kB 00:00 2020-02-11T16:03:25.623 INFO:teuthology.orchestra.run.smithi088.stdout:(64/121): libquadmath-8.3.1-4.5.el8.x86_64.rpm 2.1 MB/s | 169 kB 00:00 2020-02-11T16:03:25.679 INFO:teuthology.orchestra.run.smithi088.stdout:(65/121): librabbitmq-0.9.0-1.el8.x86_64.rpm 586 kB/s | 47 kB 00:00 2020-02-11T16:03:25.695 INFO:teuthology.orchestra.run.smithi088.stdout:(66/121): libselinux-devel-2.9-2.1.el8.x86_64.r 2.6 MB/s | 199 kB 00:00 2020-02-11T16:03:25.742 INFO:teuthology.orchestra.run.smithi088.stdout:(67/121): libgfortran-8.3.1-4.5.el8.x86_64.rpm 2.7 MB/s | 638 kB 00:00 2020-02-11T16:03:25.759 INFO:teuthology.orchestra.run.smithi088.stdout:(68/121): libsepol-devel-2.9-1.el8.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2020-02-11T16:03:25.769 INFO:teuthology.orchestra.run.smithi088.stdout:(69/121): libuuid-devel-2.32.1-17.el8.x86_64.rp 1.3 MB/s | 95 kB 00:00 2020-02-11T16:03:25.819 INFO:teuthology.orchestra.run.smithi088.stdout:(70/121): libverto-devel-0.3.0-5.el8.x86_64.rpm 231 kB/s | 18 kB 00:00 2020-02-11T16:03:25.902 INFO:teuthology.orchestra.run.smithi088.stdout:(71/121): pcre2-devel-10.32-1.el8.x86_64.rpm 7.2 MB/s | 605 kB 00:00 2020-02-11T16:03:25.914 INFO:teuthology.orchestra.run.smithi088.stdout:(72/121): libxslt-1.1.32-3.el8.x86_64.rpm 1.6 MB/s | 249 kB 00:00 2020-02-11T16:03:25.978 INFO:teuthology.orchestra.run.smithi088.stdout:(73/121): pcre2-utf16-10.32-1.el8.x86_64.rpm 2.9 MB/s | 228 kB 00:00 2020-02-11T16:03:25.991 INFO:teuthology.orchestra.run.smithi088.stdout:(74/121): openssl-devel-1.1.1c-2.el8.x86_64.rpm 10 MB/s | 2.3 MB 00:00 2020-02-11T16:03:25.993 INFO:teuthology.orchestra.run.smithi088.stdout:(75/121): pcre2-utf32-10.32-1.el8.x86_64.rpm 2.7 MB/s | 220 kB 00:00 2020-02-11T16:03:26.057 INFO:teuthology.orchestra.run.smithi088.stdout:(76/121): python3-chardet-3.0.4-7.el8.noarch.rp 2.4 MB/s | 195 kB 00:00 2020-02-11T16:03:26.062 INFO:teuthology.orchestra.run.smithi088.stdout:(77/121): python3-jwt-1.6.1-2.el8.noarch.rpm 590 kB/s | 43 kB 00:00 2020-02-11T16:03:26.071 INFO:teuthology.orchestra.run.smithi088.stdout:(78/121): python3-oauthlib-2.1.0-1.el8.noarch.r 1.9 MB/s | 155 kB 00:00 2020-02-11T16:03:26.134 INFO:teuthology.orchestra.run.smithi088.stdout:(79/121): python3-pysocks-1.6.8-3.el8.noarch.rp 454 kB/s | 34 kB 00:00 2020-02-11T16:03:26.137 INFO:teuthology.orchestra.run.smithi088.stdout:(80/121): python3-requests-2.20.0-2.1.el8_1.noa 1.6 MB/s | 123 kB 00:00 2020-02-11T16:03:26.149 INFO:teuthology.orchestra.run.smithi088.stdout:(81/121): python3-requests-oauthlib-1.0.0-1.el8 551 kB/s | 43 kB 00:00 2020-02-11T16:03:26.208 INFO:teuthology.orchestra.run.smithi088.stdout:(82/121): python3-urllib3-1.24.2-2.el8.noarch.r 2.3 MB/s | 176 kB 00:00 2020-02-11T16:03:26.213 INFO:teuthology.orchestra.run.smithi088.stdout:(83/121): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 916 kB/s | 69 kB 00:00 2020-02-11T16:03:26.227 INFO:teuthology.orchestra.run.smithi088.stdout:(84/121): zlib-devel-1.2.11-10.el8.x86_64.rpm 721 kB/s | 56 kB 00:00 2020-02-11T16:03:26.275 INFO:teuthology.orchestra.run.smithi088.stdout:(85/121): python3-cheroot-8.2.1-1.el8.noarch.rp 2.1 MB/s | 145 kB 00:00 2020-02-11T16:03:26.283 INFO:teuthology.orchestra.run.smithi088.stdout:(86/121): python3-jaraco-6.2-6.el8.noarch.rpm 1.3 MB/s | 11 kB 00:00 2020-02-11T16:03:26.291 INFO:teuthology.orchestra.run.smithi088.stdout:(87/121): python3-cherrypy-18.4.0-1.el8.noarch. 4.8 MB/s | 385 kB 00:00 2020-02-11T16:03:26.293 INFO:teuthology.orchestra.run.smithi088.stdout:(88/121): python3-execnet-1.7.1-1.el8.2.noarch. 5.3 MB/s | 356 kB 00:00 2020-02-11T16:03:26.293 INFO:teuthology.orchestra.run.smithi088.stdout:(89/121): python3-jaraco-functools-2.0-4.el8.no 1.8 MB/s | 18 kB 00:00 2020-02-11T16:03:26.300 INFO:teuthology.orchestra.run.smithi088.stdout:(90/121): python3-logutils-0.3.5-11.el8.noarch. 5.4 MB/s | 49 kB 00:00 2020-02-11T16:03:26.304 INFO:teuthology.orchestra.run.smithi088.stdout:(91/121): python3-more-itertools-7.2.0-3.el8.no 6.3 MB/s | 59 kB 00:00 2020-02-11T16:03:26.306 INFO:teuthology.orchestra.run.smithi088.stdout:(92/121): python3-pecan-1.3.2-9.el8.noarch.rpm 22 MB/s | 283 kB 00:00 2020-02-11T16:03:26.309 INFO:teuthology.orchestra.run.smithi088.stdout:(93/121): python3-portend-2.6-1.el8.noarch.rpm 1.7 MB/s | 16 kB 00:00 2020-02-11T16:03:26.313 INFO:teuthology.orchestra.run.smithi088.stdout:(94/121): python3-remoto-1.1.4-4.el8.noarch.rpm 4.5 MB/s | 48 kB 00:00 2020-02-11T16:03:26.315 INFO:teuthology.orchestra.run.smithi088.stdout:(95/121): python3-repoze-lru-0.7-6.el8.noarch.r 3.8 MB/s | 34 kB 00:00 2020-02-11T16:03:26.321 INFO:teuthology.orchestra.run.smithi088.stdout:(96/121): python3-routes-2.4.1-12.el8.noarch.rp 17 MB/s | 197 kB 00:00 2020-02-11T16:03:26.322 INFO:teuthology.orchestra.run.smithi088.stdout:(97/121): python3-simplegeneric-0.8.1-17.el8.no 2.2 MB/s | 19 kB 00:00 2020-02-11T16:03:26.323 INFO:teuthology.orchestra.run.smithi088.stdout:(98/121): python3-singledispatch-3.4.0.3-18.el8 2.9 MB/s | 24 kB 00:00 2020-02-11T16:03:26.329 INFO:teuthology.orchestra.run.smithi088.stdout:(99/121): python3-tempora-1.14.1-5.el8.noarch.r 3.4 MB/s | 30 kB 00:00 2020-02-11T16:03:26.332 INFO:teuthology.orchestra.run.smithi088.stdout:(100/121): python3-trustme-0.5.2-4.el8.noarch.r 2.6 MB/s | 27 kB 00:00 2020-02-11T16:03:26.333 INFO:teuthology.orchestra.run.smithi088.stdout:(101/121): python3-zc-lockfile-2.0-2.el8.noarch 2.3 MB/s | 23 kB 00:00 2020-02-11T16:03:26.394 INFO:teuthology.orchestra.run.smithi088.stdout:(102/121): liboath-2.6.2-3.el8.x86_64.rpm 946 kB/s | 59 kB 00:00 2020-02-11T16:03:26.395 INFO:teuthology.orchestra.run.smithi088.stdout:(103/121): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2020-02-11T16:03:26.410 INFO:teuthology.orchestra.run.smithi088.stdout:(104/121): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-02-11T16:03:26.411 INFO:teuthology.orchestra.run.smithi088.stdout:(105/121): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.7 MB/s | 44 kB 00:00 2020-02-11T16:03:26.423 INFO:teuthology.orchestra.run.smithi088.stdout:(106/121): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-02-11T16:03:26.427 INFO:teuthology.orchestra.run.smithi088.stdout:(107/121): python3-cachetools-3.1.1-4.el8.noarc 2.1 MB/s | 33 kB 00:00 2020-02-11T16:03:26.439 INFO:teuthology.orchestra.run.smithi088.stdout:(108/121): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-02-11T16:03:26.442 INFO:teuthology.orchestra.run.smithi088.stdout:(109/121): python3-cssselect-0.9.2-10.el8.noarc 2.5 MB/s | 40 kB 00:00 2020-02-11T16:03:26.456 INFO:teuthology.orchestra.run.smithi088.stdout:(110/121): python3-google-auth-1.1.1-10.el8.noa 4.9 MB/s | 81 kB 00:00 2020-02-11T16:03:26.457 INFO:teuthology.orchestra.run.smithi088.stdout:(111/121): python3-beautifulsoup4-4.6.3-2.el8.1 3.8 MB/s | 185 kB 00:00 2020-02-11T16:03:26.472 INFO:teuthology.orchestra.run.smithi088.stdout:(112/121): python3-rsa-3.4.2-12.el8.noarch.rpm 4.5 MB/s | 73 kB 00:00 2020-02-11T16:03:26.494 INFO:teuthology.orchestra.run.smithi088.stdout:(113/121): python3-waitress-1.2.1-2.el8.1.noarc 7.4 MB/s | 241 kB 00:00 2020-02-11T16:03:26.504 INFO:teuthology.orchestra.run.smithi088.stdout:(114/121): python3-webob-1.8.5-1.el8.1.noarch.r 7.6 MB/s | 251 kB 00:00 2020-02-11T16:03:26.506 INFO:teuthology.orchestra.run.smithi088.stdout:(115/121): python3-websocket-client-0.56.0-5.el 3.7 MB/s | 61 kB 00:00 2020-02-11T16:03:26.511 INFO:teuthology.orchestra.run.smithi088.stdout:(116/121): leveldb-1.21-2.el8.x86_64.rpm 32 MB/s | 179 kB 00:00 2020-02-11T16:03:26.513 INFO:teuthology.orchestra.run.smithi088.stdout:(117/121): xmlstarlet-1.6.1-13.el8.x86_64.rpm 51 MB/s | 69 kB 00:00 2020-02-11T16:03:26.520 INFO:teuthology.orchestra.run.smithi088.stdout:(118/121): python3-webtest-2.0.33-1.el8.noarch. 5.2 MB/s | 85 kB 00:00 2020-02-11T16:03:26.599 INFO:teuthology.orchestra.run.smithi088.stdout:(119/121): python3-kubernetes-10.0.1-1.el8.noar 7.3 MB/s | 1.1 MB 00:00 2020-02-11T16:03:26.802 INFO:teuthology.orchestra.run.smithi088.stdout:(120/121): librbd1-15.1.0-486.g71281e4.el8.x86_ 6.6 MB/s | 1.9 MB 00:00 2020-02-11T16:03:26.873 INFO:teuthology.orchestra.run.smithi088.stdout:(121/121): librados2-15.1.0-486.g71281e4.el8.x8 9.9 MB/s | 3.6 MB 00:00 2020-02-11T16:03:26.878 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2020-02-11T16:03:26.878 INFO:teuthology.orchestra.run.smithi088.stdout:Total 15 MB/s | 176 MB 00:11 2020-02-11T16:03:26.943 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2020-02-11T16:03:27.052 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2020-02-11T16:03:27.052 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2020-02-11T16:03:28.150 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2020-02-11T16:03:28.150 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2020-02-11T16:03:29.256 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2020-02-11T16:03:29.398 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/123 2020-02-11T16:03:29.539 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/123 2020-02-11T16:03:29.710 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-11T16:03:30.129 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-11T16:03:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:15.1.0-486.g71281e4.el8.x86_64 4/123 2020-02-11T16:03:30.541 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:15.1.0-486.g71281e4.el8.x86_64 4/123 2020-02-11T16:03:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:15.1.0-486.g71281e4.el8.x86_64 5/123 2020-02-11T16:03:30.824 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:15.1.0-486.g71281e4.el8.x86_64 5/123 2020-02-11T16:03:30.976 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:15.1.0-486.g71281e4.el8.x86_64 6/123 2020-02-11T16:03:31.073 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:15.1.0-486.g71281e4.el8.x86_64 6/123 2020-02-11T16:03:31.377 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:15.1.0-486.g71281e4.el8.x86_64 7/123 2020-02-11T16:03:31.518 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-11T16:03:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-11T16:03:32.301 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:15.1.0-486.g71281e4.el8.x86_64 9/123 2020-02-11T16:03:32.424 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:15.1.0-486.g71281e4.el8.x86_64 9/123 2020-02-11T16:03:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2020-02-11T16:03:32.613 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/123 2020-02-11T16:03:32.699 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/123 2020-02-11T16:03:32.749 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:15.1.0-486.g71281e4.el8.x86_6 11/123 2020-02-11T16:03:32.871 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/123 2020-02-11T16:03:32.872 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:15.1.0-486.g71281e4.el8.x86_6 11/123 2020-02-11T16:03:33.036 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-11T16:03:33.063 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/123 2020-02-11T16:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/123 2020-02-11T16:03:33.338 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/123 2020-02-11T16:03:33.434 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-11T16:03:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/123 2020-02-11T16:03:33.603 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:15.1.0-486.g71281e4.el8.x86_64 4/123 2020-02-11T16:03:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/123 2020-02-11T16:03:33.838 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:15.1.0-486.g71281e4.el8.x86_64 4/123 2020-02-11T16:03:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-11T16:03:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-11T16:03:34.019 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:15.1.0-486.g71281e4.el8.x86_64 5/123 2020-02-11T16:03:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-11T16:03:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:15.1.0-486.g71281e4.el8.x86_64 5/123 2020-02-11T16:03:34.286 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:15.1.0-486.g71281e4.el8.x86_64 6/123 2020-02-11T16:03:34.379 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:15.1.0-486.g71281e4.el8.x86_64 6/123 2020-02-11T16:03:34.559 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:15.1.0-486.g71281e4.el8.x86_64 7/123 2020-02-11T16:03:34.703 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-11T16:03:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-11T16:03:34.876 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/123 2020-02-11T16:03:35.318 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-11T16:03:35.455 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/123 2020-02-11T16:03:35.511 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:15.1.0-486.g71281e4.el8.x86_64 9/123 2020-02-11T16:03:35.567 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-11T16:03:35.619 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:15.1.0-486.g71281e4.el8.x86_64 9/123 2020-02-11T16:03:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/123 2020-02-11T16:03:35.961 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:15.1.0-486.g71281e4.el8.x86_6 11/123 2020-02-11T16:03:36.065 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:15.1.0-486.g71281e4.el8.x86_6 11/123 2020-02-11T16:03:36.288 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/123 2020-02-11T16:03:36.314 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-11T16:03:36.416 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/123 2020-02-11T16:03:36.579 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/123 2020-02-11T16:03:36.592 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/123 2020-02-11T16:03:36.742 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/123 2020-02-11T16:03:36.747 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/123 2020-02-11T16:03:36.851 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:15.1.0-486.g71281e4.el8. 23/123 2020-02-11T16:03:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/123 2020-02-11T16:03:37.052 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:15.1.0-486.g71281e4.el8.x86_64 24/123 2020-02-11T16:03:37.086 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-11T16:03:37.213 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-11T16:03:37.242 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-11T16:03:37.394 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-11T16:03:37.913 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-11T16:03:38.068 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/123 2020-02-11T16:03:38.594 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/123 2020-02-11T16:03:38.743 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-11T16:03:39.340 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-11T16:03:39.419 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-11T16:03:39.595 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/123 2020-02-11T16:03:39.752 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/123 2020-02-11T16:03:39.794 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-13.el8.x86_64 27/123 2020-02-11T16:03:39.923 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/123 2020-02-11T16:03:40.015 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/123 2020-02-11T16:03:40.034 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:15.1.0-486.g71281e4.el8. 23/123 2020-02-11T16:03:40.255 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:15.1.0-486.g71281e4.el8.x86_64 24/123 2020-02-11T16:03:40.401 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/123 2020-02-11T16:03:40.426 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-11T16:03:40.601 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/123 2020-02-11T16:03:40.764 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:15.1.0-486.g71281e4.el8.x86_64 31/123 2020-02-11T16:03:40.923 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:15.1.0-486.g71281e4.el8.x86_64 32/123 2020-02-11T16:03:41.054 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:15.1.0-486.g71281e4.el8.x86_64 33/123 2020-02-11T16:03:41.311 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/123 2020-02-11T16:03:41.461 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/123 2020-02-11T16:03:41.599 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/123 2020-02-11T16:03:41.731 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/123 2020-02-11T16:03:41.940 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/123 2020-02-11T16:03:42.143 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/123 2020-02-11T16:03:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/123 2020-02-11T16:03:42.372 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-11T16:03:42.551 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/123 2020-02-11T16:03:42.636 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/123 2020-02-11T16:03:42.798 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/123 2020-02-11T16:03:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-13.el8.x86_64 27/123 2020-02-11T16:03:42.985 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/123 2020-02-11T16:03:43.079 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/123 2020-02-11T16:03:43.162 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/123 2020-02-11T16:03:43.273 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/123 2020-02-11T16:03:43.317 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/123 2020-02-11T16:03:43.467 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/123 2020-02-11T16:03:43.479 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/123 2020-02-11T16:03:43.600 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/123 2020-02-11T16:03:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:15.1.0-486.g71281e4.el8.x86_64 31/123 2020-02-11T16:03:43.748 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/123 2020-02-11T16:03:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:15.1.0-486.g71281e4.el8.x86_64 32/123 2020-02-11T16:03:43.905 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/123 2020-02-11T16:03:43.978 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:15.1.0-486.g71281e4.el8.x86_64 33/123 2020-02-11T16:03:44.053 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/123 2020-02-11T16:03:44.211 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/123 2020-02-11T16:03:44.246 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/123 2020-02-11T16:03:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/123 2020-02-11T16:03:44.557 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/123 2020-02-11T16:03:44.689 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/123 2020-02-11T16:03:44.731 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/123 2020-02-11T16:03:44.862 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/123 2020-02-11T16:03:45.015 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/123 2020-02-11T16:03:45.178 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/123 2020-02-11T16:03:45.206 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/123 2020-02-11T16:03:45.358 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/123 2020-02-11T16:03:45.377 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/123 2020-02-11T16:03:45.557 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/123 2020-02-11T16:03:45.602 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/123 2020-02-11T16:03:45.788 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/123 2020-02-11T16:03:45.816 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/123 2020-02-11T16:03:46.012 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/123 2020-02-11T16:03:46.047 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/123 2020-02-11T16:03:46.234 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/123 2020-02-11T16:03:46.280 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/123 2020-02-11T16:03:46.402 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/123 2020-02-11T16:03:46.574 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/123 2020-02-11T16:03:46.708 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/123 2020-02-11T16:03:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/123 2020-02-11T16:03:46.998 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/123 2020-02-11T16:03:47.154 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/123 2020-02-11T16:03:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/123 2020-02-11T16:03:47.405 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/123 2020-02-11T16:03:47.492 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/123 2020-02-11T16:03:47.711 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/123 2020-02-11T16:03:47.778 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-10.0.1-1.el8.noarch 62/123 2020-02-11T16:03:47.878 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/123 2020-02-11T16:03:47.962 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/123 2020-02-11T16:03:48.048 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/123 2020-02-11T16:03:48.223 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/123 2020-02-11T16:03:48.242 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/123 2020-02-11T16:03:48.385 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/123 2020-02-11T16:03:48.424 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/123 2020-02-11T16:03:48.490 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/123 2020-02-11T16:03:48.629 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/123 2020-02-11T16:03:48.648 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/123 2020-02-11T16:03:48.894 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/123 2020-02-11T16:03:48.946 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-11T16:03:49.138 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/123 2020-02-11T16:03:49.195 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/123 2020-02-11T16:03:49.312 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/123 2020-02-11T16:03:49.374 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/123 2020-02-11T16:03:49.500 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/123 2020-02-11T16:03:49.802 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/123 2020-02-11T16:03:49.802 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/123 2020-02-11T16:03:49.802 INFO:teuthology.orchestra.run.smithi052.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-02-11T16:03:49.803 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:03:50.146 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/123 2020-02-11T16:03:50.303 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/123 2020-02-11T16:03:50.417 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/123 2020-02-11T16:03:50.570 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/123 2020-02-11T16:03:50.799 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/123 2020-02-11T16:03:51.035 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-10.0.1-1.el8.noarch 62/123 2020-02-11T16:03:51.185 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/123 2020-02-11T16:03:51.196 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/123 2020-02-11T16:03:51.484 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/123 2020-02-11T16:03:51.515 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/123 2020-02-11T16:03:51.726 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/123 2020-02-11T16:03:51.731 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/123 2020-02-11T16:03:51.839 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/123 2020-02-11T16:03:51.869 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/123 2020-02-11T16:03:52.020 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/123 2020-02-11T16:03:52.070 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/123 2020-02-11T16:03:52.292 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/123 2020-02-11T16:03:52.296 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-11T16:03:52.508 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/123 2020-02-11T16:03:52.544 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/123 2020-02-11T16:03:52.679 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/123 2020-02-11T16:03:52.711 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/123 2020-02-11T16:03:52.882 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/123 2020-02-11T16:03:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/123 2020-02-11T16:03:53.084 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/123 2020-02-11T16:03:53.085 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/123 2020-02-11T16:03:53.085 INFO:teuthology.orchestra.run.smithi088.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-02-11T16:03:53.085 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:03:53.178 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/123 2020-02-11T16:03:53.391 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/123 2020-02-11T16:03:53.428 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/123 2020-02-11T16:03:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/123 2020-02-11T16:03:53.607 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-11T16:03:53.673 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-11T16:03:53.831 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/123 2020-02-11T16:03:53.936 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : jq-1.5-12.el8.x86_64 90/123 2020-02-11T16:03:54.035 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/123 2020-02-11T16:03:54.155 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.1-6.el8.noarch 91/123 2020-02-11T16:03:54.325 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:15.1.0-486.g71281e4.el 92/123 2020-02-11T16:03:54.439 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/123 2020-02-11T16:03:54.515 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:15.1.0-486.g71281e4.el8.x8 93/123 2020-02-11T16:03:54.712 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/123 2020-02-11T16:03:54.971 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/123 2020-02-11T16:03:55.134 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/123 2020-02-11T16:03:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/123 2020-02-11T16:03:55.570 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/123 2020-02-11T16:03:55.814 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/123 2020-02-11T16:03:55.986 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/123 2020-02-11T16:03:56.201 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/123 2020-02-11T16:03:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/123 2020-02-11T16:03:56.834 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/123 2020-02-11T16:03:56.997 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-11T16:03:57.107 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-11T16:03:57.342 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.5-12.el8.x86_64 90/123 2020-02-11T16:03:57.629 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : automake-1.16.1-6.el8.noarch 91/123 2020-02-11T16:03:57.838 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:15.1.0-486.g71281e4.el 92/123 2020-02-11T16:03:58.006 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:15.1.0-486.g71281e4.el8.x8 93/123 2020-02-11T16:03:58.610 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 94/123 2020-02-11T16:03:58.832 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 94/123 2020-02-11T16:03:59.510 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 94/123 2020-02-11T16:03:59.717 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:15.1.0-486.g71281e4.el8.x86_64 95/123 2020-02-11T16:03:59.818 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:15.1.0-486.g71281e4.el8.x86_64 95/123 2020-02-11T16:03:59.939 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:15.1.0-486.g71281e4.el8.x86_64 96/123 2020-02-11T16:04:01.487 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 94/123 2020-02-11T16:04:01.748 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 94/123 2020-02-11T16:04:02.384 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 94/123 2020-02-11T16:04:02.655 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:15.1.0-486.g71281e4.el8.x86_64 95/123 2020-02-11T16:04:02.758 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:15.1.0-486.g71281e4.el8.x86_64 95/123 2020-02-11T16:04:02.896 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:15.1.0-486.g71281e4.el8.x86_64 96/123 2020-02-11T16:04:16.875 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:15.1.0-486.g71281e4.el8.x86_64 96/123 2020-02-11T16:04:16.875 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2020-02-11T16:04:16.875 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2020-02-11T16:04:16.875 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /dev 2020-02-11T16:04:16.876 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /run 2020-02-11T16:04:16.876 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2020-02-11T16:04:16.876 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2020-02-11T16:04:16.876 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2020-02-11T16:04:16.876 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2020-02-11T16:04:16.876 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /dev 2020-02-11T16:04:16.876 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:17.304 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:15.1.0-486.g71281e4.el8.x86_64 97/123 2020-02-11T16:04:17.509 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:15.1.0-486.g71281e4.el8.x86_64 97/123 2020-02-11T16:04:18.025 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:15.1.0-486.g71281e4.el8.x86_64 98/123 2020-02-11T16:04:18.429 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:15.1.0-486.g71281e4.el8.x86_64 98/123 2020-02-11T16:04:18.595 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:15.1.0-486.g71281e4.el8.x86_64 99/123 2020-02-11T16:04:19.068 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:15.1.0-486.g71281e4.el8.x86_64 96/123 2020-02-11T16:04:19.068 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2020-02-11T16:04:19.068 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2020-02-11T16:04:19.069 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2020-02-11T16:04:19.069 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /run 2020-02-11T16:04:19.069 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2020-02-11T16:04:19.069 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2020-02-11T16:04:19.069 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2020-02-11T16:04:19.070 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2020-02-11T16:04:19.070 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2020-02-11T16:04:19.070 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:19.476 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:15.1.0-486.g71281e4.el8.x86_64 97/123 2020-02-11T16:04:19.670 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:15.1.0-486.g71281e4.el8.x86_64 97/123 2020-02-11T16:04:19.826 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:15.1.0-486.g71281e4.el8.x86_64 98/123 2020-02-11T16:04:20.081 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:15.1.0-486.g71281e4.el8.x86_64 99/123 2020-02-11T16:04:20.207 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:15.1.0-486.g71281e4.el8.x86_64 98/123 2020-02-11T16:04:20.304 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:15.1.0-486.g71281e4.el8.x86_64 100/123 2020-02-11T16:04:20.328 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:15.1.0-486.g71281e4.el8.x86_64 100/123 2020-02-11T16:04:20.409 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:15.1.0-486.g71281e4.el8.x86_64 99/123 2020-02-11T16:04:21.697 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:15.1.0-486.g71281e4.el8.x86_64 101/123 2020-02-11T16:04:21.802 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:15.1.0-486.g71281e4.el8.x86_64 99/123 2020-02-11T16:04:21.868 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:15.1.0-486.g71281e4.el8.x86_64 101/123 2020-02-11T16:04:22.037 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:15.1.0-486.g71281e4.el8.noarc 102/123 2020-02-11T16:04:22.050 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:15.1.0-486.g71281e4.el8.x86_64 100/123 2020-02-11T16:04:22.052 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.1.0-486.g71281e4.el8.noarc 102/123 2020-02-11T16:04:22.074 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:15.1.0-486.g71281e4.el8.x86_64 100/123 2020-02-11T16:04:23.030 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:15.1.0-486.g71281e4.el8.x86_64 103/123 2020-02-11T16:04:23.671 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:15.1.0-486.g71281e4.el8.noa 104/123 2020-02-11T16:04:24.026 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:15.1.0-486.g71281e4.el8.x86_64 101/123 2020-02-11T16:04:24.260 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:15.1.0-486.g71281e4.el8.x86_64 101/123 2020-02-11T16:04:24.433 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:15.1.0-486.g71281e4.el8.noarc 102/123 2020-02-11T16:04:24.452 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.1.0-486.g71281e4.el8.noarc 102/123 2020-02-11T16:04:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.1.0-486.g71281e4.el8.noa 104/123 2020-02-11T16:04:24.953 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:15.1.0-486.g7128 105/123 2020-02-11T16:04:24.974 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.1.0-486.g7128 105/123 2020-02-11T16:04:25.144 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:15.1.0-486.g71281e4.el8.noarch 106/123 2020-02-11T16:04:25.370 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:15.1.0-486.g71281e4.el8.x86_64 103/123 2020-02-11T16:04:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:15.1.0-486.g71281e4.el8.noa 104/123 2020-02-11T16:04:26.077 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:15.1.0-486.g71281e4.el8.noarch 106/123 2020-02-11T16:04:26.320 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:15.1.0-486.g71281e4.el8.x86_64 107/123 2020-02-11T16:04:26.636 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.1.0-486.g71281e4.el8.noa 104/123 2020-02-11T16:04:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:15.1.0-486.g71281e4.el8.x86_64 107/123 2020-02-11T16:04:26.832 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:15.1.0-486.g7128 105/123 2020-02-11T16:04:26.835 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:15.1.0-486.g71281e4.el8.x86_64 108/123 2020-02-11T16:04:26.848 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.1.0-486.g7128 105/123 2020-02-11T16:04:26.983 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:15.1.0-486.g71281e4.el8.noarch 106/123 2020-02-11T16:04:27.855 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:15.1.0-486.g71281e4.el8.noarch 106/123 2020-02-11T16:04:28.091 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:15.1.0-486.g71281e4.el8.x86_64 107/123 2020-02-11T16:04:28.406 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:15.1.0-486.g71281e4.el8.x86_64 107/123 2020-02-11T16:04:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:15.1.0-486.g71281e4.el8.x86_64 108/123 2020-02-11T16:04:30.854 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:15.1.0-486.g71281e4.el8.x86_64 108/123 2020-02-11T16:04:31.137 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:15.1.0-486.g71281e4.el8.x86_64 109/123 2020-02-11T16:04:31.293 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-25.el8.x86_64 110/123 2020-02-11T16:04:31.354 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 110/123 2020-02-11T16:04:32.323 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:15.1.0-486.g71281e4.el8.x86_64 111/123 2020-02-11T16:04:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:15.1.0-486.g71281e4.el8.x86_64 108/123 2020-02-11T16:04:32.572 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 112/123 2020-02-11T16:04:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 113/123 2020-02-11T16:04:32.715 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:15.1.0-486.g71281e4.el8.x86_64 109/123 2020-02-11T16:04:32.846 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:15.1.0-486.g71281e4.el8.x86_64 114/123 2020-02-11T16:04:32.890 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-2.4.6-25.el8.x86_64 110/123 2020-02-11T16:04:32.948 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 110/123 2020-02-11T16:04:32.958 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 115/123 2020-02-11T16:04:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:15.1.0-486.g71281e4.el8.x86_64 116/123 2020-02-11T16:04:33.347 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:15.1.0-486.g71281e4.el8.x86_64 117/123 2020-02-11T16:04:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:15.1.0-486.g71281e 118/123 2020-02-11T16:04:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.1.0-486.g71281e 118/123 2020-02-11T16:04:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 119/123 2020-02-11T16:04:33.812 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:15.1.0-486.g71281e4.el8.x86_64 111/123 2020-02-11T16:04:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/123 2020-02-11T16:04:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/123 2020-02-11T16:04:34.075 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 112/123 2020-02-11T16:04:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/123 2020-02-11T16:04:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/123 2020-02-11T16:04:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-11T16:04:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 113/123 2020-02-11T16:04:34.375 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:15.1.0-486.g71281e4.el8.x86_64 114/123 2020-02-11T16:04:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-11T16:04:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-11T16:04:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-11T16:04:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:15.1.0-486.g71281e4.el8.x86_64 1/123 2020-02-11T16:04:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:15.1.0-486.g71281e4.el8.x86_64 2/123 2020-02-11T16:04:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 3/123 2020-02-11T16:04:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:15.1.0-486.g71281e4.el8.x86_64 4/123 2020-02-11T16:04:35.341 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:15.1.0-486.g71281e 5/123 2020-02-11T16:04:35.341 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:15.1.0-486.g71281e4.el8.x86_64 6/123 2020-02-11T16:04:35.341 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:15.1.0-486.g71281e4.el8.x86_64 7/123 2020-02-11T16:04:35.341 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:15.1.0-486.g71281e4.el8.x86_64 8/123 2020-02-11T16:04:35.341 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:15.1.0-486.g71281e4.el8.x86_64 9/123 2020-02-11T16:04:35.341 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:15.1.0-486.g71281e4.el8.x86_64 10/123 2020-02-11T16:04:35.341 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:15.1.0-486.g71281e4.el8.x86_64 11/123 2020-02-11T16:04:35.342 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:15.1.0-486.g71281e4.el8.x86_64 12/123 2020-02-11T16:04:35.342 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:15.1.0-486.g71281e4.el8.x86_64 13/123 2020-02-11T16:04:35.342 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:15.1.0-486.g71281e4.el8.x86_64 14/123 2020-02-11T16:04:35.342 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:15.1.0-486.g71281e4.el8.x86_64 15/123 2020-02-11T16:04:35.342 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:15.1.0-486.g71281e4.el8.x86_64 16/123 2020-02-11T16:04:35.342 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:15.1.0-486.g71281e4.el8.x86_6 17/123 2020-02-11T16:04:35.342 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:15.1.0-486.g71281e4.el8.x86_64 18/123 2020-02-11T16:04:35.343 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:15.1.0-486.g71281e4.el8. 19/123 2020-02-11T16:04:35.343 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:15.1.0-486.g71281e4.el8.x8 20/123 2020-02-11T16:04:35.343 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:15.1.0-486.g71281e4.el8.x86_64 21/123 2020-02-11T16:04:35.343 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:15.1.0-486.g71281e4.el8.x86_64 22/123 2020-02-11T16:04:35.343 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:15.1.0-486.g71281e4.el8.x86_64 23/123 2020-02-11T16:04:35.343 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:15.1.0-486.g71281e4.el8.x86_64 24/123 2020-02-11T16:04:35.343 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:15.1.0-486.g71281e4.el8.x86_64 25/123 2020-02-11T16:04:35.343 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:15.1.0-486.g71281e4.el8.x86_64 26/123 2020-02-11T16:04:35.344 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:15.1.0-486.g71281e4.el8.x86_64 27/123 2020-02-11T16:04:35.344 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:15.1.0-486.g71281e4.el 28/123 2020-02-11T16:04:35.344 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:15.1.0-486.g71281e4.el8.noarc 29/123 2020-02-11T16:04:35.344 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:15.1.0-486.g71281e4.el8.noa 30/123 2020-02-11T16:04:35.344 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.1.0-486.g7128 31/123 2020-02-11T16:04:35.344 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:15.1.0-486.g71281e4.el8.noarch 32/123 2020-02-11T16:04:35.344 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.1-6.el8.noarch 33/123 2020-02-11T16:04:35.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.0.4-10.el8.x86_64 34/123 2020-02-11T16:04:35.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.1-9.el8.x86_64 35/123 2020-02-11T16:04:35.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : jq-1.5-12.el8.x86_64 36/123 2020-02-11T16:04:35.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 37/123 2020-02-11T16:04:35.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 38/123 2020-02-11T16:04:35.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 39/123 2020-02-11T16:04:35.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 40/123 2020-02-11T16:04:35.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 41/123 2020-02-11T16:04:35.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 42/123 2020-02-11T16:04:35.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 43/123 2020-02-11T16:04:35.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 44/123 2020-02-11T16:04:35.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 45/123 2020-02-11T16:04:35.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 46/123 2020-02-11T16:04:35.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 47/123 2020-02-11T16:04:35.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 48/123 2020-02-11T16:04:35.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 49/123 2020-02-11T16:04:35.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 50/123 2020-02-11T16:04:35.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 51/123 2020-02-11T16:04:35.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 52/123 2020-02-11T16:04:35.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 53/123 2020-02-11T16:04:35.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 54/123 2020-02-11T16:04:35.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 55/123 2020-02-11T16:04:35.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 56/123 2020-02-11T16:04:35.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 57/123 2020-02-11T16:04:35.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 58/123 2020-02-11T16:04:35.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 59/123 2020-02-11T16:04:35.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/123 2020-02-11T16:04:35.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 61/123 2020-02-11T16:04:35.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 62/123 2020-02-11T16:04:35.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 63/123 2020-02-11T16:04:35.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 64/123 2020-02-11T16:04:35.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 65/123 2020-02-11T16:04:35.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 66/123 2020-02-11T16:04:35.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 67/123 2020-02-11T16:04:35.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-11T16:04:35.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 69/123 2020-02-11T16:04:35.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 70/123 2020-02-11T16:04:35.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 71/123 2020-02-11T16:04:35.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 72/123 2020-02-11T16:04:35.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 73/123 2020-02-11T16:04:35.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 74/123 2020-02-11T16:04:35.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 75/123 2020-02-11T16:04:35.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 76/123 2020-02-11T16:04:35.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 77/123 2020-02-11T16:04:35.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 78/123 2020-02-11T16:04:35.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 79/123 2020-02-11T16:04:35.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 80/123 2020-02-11T16:04:35.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 81/123 2020-02-11T16:04:35.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 82/123 2020-02-11T16:04:35.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 83/123 2020-02-11T16:04:35.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 84/123 2020-02-11T16:04:35.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 85/123 2020-02-11T16:04:35.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 86/123 2020-02-11T16:04:35.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 87/123 2020-02-11T16:04:35.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 88/123 2020-02-11T16:04:35.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 89/123 2020-02-11T16:04:35.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 90/123 2020-02-11T16:04:35.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 91/123 2020-02-11T16:04:35.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 92/123 2020-02-11T16:04:35.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-2.6-1.el8.noarch 93/123 2020-02-11T16:04:35.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 94/123 2020-02-11T16:04:35.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 95/123 2020-02-11T16:04:35.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 96/123 2020-02-11T16:04:35.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 97/123 2020-02-11T16:04:35.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 98/123 2020-02-11T16:04:35.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 99/123 2020-02-11T16:04:35.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 100/123 2020-02-11T16:04:35.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 101/123 2020-02-11T16:04:35.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/123 2020-02-11T16:04:35.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 103/123 2020-02-11T16:04:35.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 104/123 2020-02-11T16:04:35.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 105/123 2020-02-11T16:04:35.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 106/123 2020-02-11T16:04:35.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 107/123 2020-02-11T16:04:35.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 108/123 2020-02-11T16:04:35.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 109/123 2020-02-11T16:04:35.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 110/123 2020-02-11T16:04:35.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 111/123 2020-02-11T16:04:35.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-10.0.1-1.el8.noarch 112/123 2020-02-11T16:04:35.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 113/123 2020-02-11T16:04:35.356 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 114/123 2020-02-11T16:04:35.356 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 115/123 2020-02-11T16:04:35.356 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 116/123 2020-02-11T16:04:35.356 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 117/123 2020-02-11T16:04:35.356 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : leveldb-1.21-2.el8.x86_64 118/123 2020-02-11T16:04:35.356 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-13.el8.x86_64 119/123 2020-02-11T16:04:35.356 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:15.1.0-486.g71281e4.el8.x86_64 120/123 2020-02-11T16:04:35.357 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 121/123 2020-02-11T16:04:35.357 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:15.1.0-486.g71281e4.el8.x86_64 122/123 2020-02-11T16:04:35.539 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 115/123 2020-02-11T16:04:35.902 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:15.1.0-486.g71281e4.el8.x86_64 116/123 2020-02-11T16:04:36.100 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:15.1.0-486.g71281e4.el8.x86_64 117/123 2020-02-11T16:04:36.289 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:15.1.0-486.g71281e 118/123 2020-02-11T16:04:36.313 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.1.0-486.g71281e 118/123 2020-02-11T16:04:36.464 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 119/123 2020-02-11T16:04:36.622 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/123 2020-02-11T16:04:36.701 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/123 2020-02-11T16:04:36.897 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/123 2020-02-11T16:04:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 123/123 2020-02-11T16:04:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:36.909 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2020-02-11T16:04:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:36.910 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2020-02-11T16:04:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:15.1.0-486.g71281e4.el8.noarch 2020-02-11T16:04:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:15.1.0-486.g71281e4.el8.noarch 2020-02-11T16:04:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:15.1.0-486.g71281e4.el8.noarch 2020-02-11T16:04:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:15.1.0-486.g71281e4.el8.noarch 2020-02-11T16:04:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.0.4-10.el8.x86_64 2020-02-11T16:04:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.1-9.el8.x86_64 2020-02-11T16:04:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-25.el8.x86_64 2020-02-11T16:04:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-02-11T16:04:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-02-11T16:04:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-02-11T16:04:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-02-11T16:04:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-02-11T16:04:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-02-11T16:04:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-02-11T16:04:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:15.1.0-486.g71281e4.el8.noarch 2020-02-11T16:04:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.1-6.el8.noarch 2020-02-11T16:04:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: jq-1.5-12.el8.x86_64 2020-02-11T16:04:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-02-11T16:04:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-02-11T16:04:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-02-11T16:04:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.3-2.el8.x86_64 2020-02-11T16:04:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-02-11T16:04:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-02-11T16:04:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.0.6-13.el8.noarch 2020-02-11T16:04:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-02-11T16:04:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-02-11T16:04:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-02-11T16:04:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-02-11T16:04:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-02-11T16:04:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-02-11T16:04:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2017.2-9.el8.noarch 2020-02-11T16:04:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-02-11T16:04:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-02-11T16:04:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-02-11T16:04:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.3.2-6.el8.x86_64 2020-02-11T16:04:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.7-12.el8.x86_64 2020-02-11T16:04:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-02-11T16:04:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-02-11T16:04:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: krb5-devel-1.17-9.el8.x86_64 2020-02-11T16:04:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-02-11T16:04:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-02-11T16:04:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-02-11T16:04:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-02-11T16:04:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-02-11T16:04:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-02-11T16:04:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-02-11T16:04:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: libxslt-1.1.32-3.el8.x86_64 2020-02-11T16:04:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-02-11T16:04:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-02-11T16:04:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-02-11T16:04:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-02-11T16:04:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-02-11T16:04:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-02-11T16:04:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-02-11T16:04:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-02-11T16:04:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-02-11T16:04:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-02-11T16:04:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-02-11T16:04:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-02-11T16:04:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-02-11T16:04:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-02-11T16:04:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-6.2-6.el8.noarch 2020-02-11T16:04:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-02-11T16:04:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-02-11T16:04:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-02-11T16:04:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-02-11T16:04:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-2.6-1.el8.noarch 2020-02-11T16:04:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-02-11T16:04:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-02-11T16:04:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.4.1-12.el8.noarch 2020-02-11T16:04:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-02-11T16:04:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-02-11T16:04:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-02-11T16:04:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-02-11T16:04:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-02-11T16:04:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-02-11T16:04:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.2-3.el8.x86_64 2020-02-11T16:04:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.3.1-3.el8.x86_64 2020-02-11T16:04:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: python3-apipkg-1.5-6.el8.noarch 2020-02-11T16:04:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-02-11T16:04:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-02-11T16:04:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-02-11T16:04:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-02-11T16:04:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-02-11T16:04:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-10.0.1-1.el8.noarch 2020-02-11T16:04:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-02-11T16:04:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-02-11T16:04:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-02-11T16:04:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-02-11T16:04:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-02-11T16:04:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: leveldb-1.21-2.el8.x86_64 2020-02-11T16:04:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-13.el8.x86_64 2020-02-11T16:04:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/123 2020-02-11T16:04:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-11T16:04:36.934 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2020-02-11T16:04:37.086 DEBUG:teuthology.parallel:result is None 2020-02-11T16:04:37.158 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-11T16:04:37.158 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-11T16:04:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-11T16:04:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:15.1.0-486.g71281e4.el8.x86_64 1/123 2020-02-11T16:04:37.983 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:15.1.0-486.g71281e4.el8.x86_64 2/123 2020-02-11T16:04:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 3/123 2020-02-11T16:04:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:15.1.0-486.g71281e4.el8.x86_64 4/123 2020-02-11T16:04:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:15.1.0-486.g71281e 5/123 2020-02-11T16:04:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:15.1.0-486.g71281e4.el8.x86_64 6/123 2020-02-11T16:04:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:15.1.0-486.g71281e4.el8.x86_64 7/123 2020-02-11T16:04:37.984 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:15.1.0-486.g71281e4.el8.x86_64 8/123 2020-02-11T16:04:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:15.1.0-486.g71281e4.el8.x86_64 9/123 2020-02-11T16:04:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:15.1.0-486.g71281e4.el8.x86_64 10/123 2020-02-11T16:04:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:15.1.0-486.g71281e4.el8.x86_64 11/123 2020-02-11T16:04:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:15.1.0-486.g71281e4.el8.x86_64 12/123 2020-02-11T16:04:37.985 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:15.1.0-486.g71281e4.el8.x86_64 13/123 2020-02-11T16:04:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:15.1.0-486.g71281e4.el8.x86_64 14/123 2020-02-11T16:04:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:15.1.0-486.g71281e4.el8.x86_64 15/123 2020-02-11T16:04:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:15.1.0-486.g71281e4.el8.x86_64 16/123 2020-02-11T16:04:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:15.1.0-486.g71281e4.el8.x86_6 17/123 2020-02-11T16:04:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:15.1.0-486.g71281e4.el8.x86_64 18/123 2020-02-11T16:04:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:15.1.0-486.g71281e4.el8. 19/123 2020-02-11T16:04:37.986 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:15.1.0-486.g71281e4.el8.x8 20/123 2020-02-11T16:04:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:15.1.0-486.g71281e4.el8.x86_64 21/123 2020-02-11T16:04:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:15.1.0-486.g71281e4.el8.x86_64 22/123 2020-02-11T16:04:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:15.1.0-486.g71281e4.el8.x86_64 23/123 2020-02-11T16:04:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:15.1.0-486.g71281e4.el8.x86_64 24/123 2020-02-11T16:04:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:15.1.0-486.g71281e4.el8.x86_64 25/123 2020-02-11T16:04:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:15.1.0-486.g71281e4.el8.x86_64 26/123 2020-02-11T16:04:37.987 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:15.1.0-486.g71281e4.el8.x86_64 27/123 2020-02-11T16:04:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:15.1.0-486.g71281e4.el 28/123 2020-02-11T16:04:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:15.1.0-486.g71281e4.el8.noarc 29/123 2020-02-11T16:04:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:15.1.0-486.g71281e4.el8.noa 30/123 2020-02-11T16:04:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.1.0-486.g7128 31/123 2020-02-11T16:04:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:15.1.0-486.g71281e4.el8.noarch 32/123 2020-02-11T16:04:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : automake-1.16.1-6.el8.noarch 33/123 2020-02-11T16:04:37.988 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.0.4-10.el8.x86_64 34/123 2020-02-11T16:04:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.1-9.el8.x86_64 35/123 2020-02-11T16:04:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.5-12.el8.x86_64 36/123 2020-02-11T16:04:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 37/123 2020-02-11T16:04:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 38/123 2020-02-11T16:04:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 39/123 2020-02-11T16:04:37.989 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 40/123 2020-02-11T16:04:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 41/123 2020-02-11T16:04:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 42/123 2020-02-11T16:04:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 43/123 2020-02-11T16:04:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 44/123 2020-02-11T16:04:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 45/123 2020-02-11T16:04:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 46/123 2020-02-11T16:04:37.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 47/123 2020-02-11T16:04:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 48/123 2020-02-11T16:04:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 49/123 2020-02-11T16:04:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 50/123 2020-02-11T16:04:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 51/123 2020-02-11T16:04:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 52/123 2020-02-11T16:04:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 53/123 2020-02-11T16:04:37.991 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 54/123 2020-02-11T16:04:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 55/123 2020-02-11T16:04:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 56/123 2020-02-11T16:04:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 57/123 2020-02-11T16:04:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 58/123 2020-02-11T16:04:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 59/123 2020-02-11T16:04:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/123 2020-02-11T16:04:37.992 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 61/123 2020-02-11T16:04:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 62/123 2020-02-11T16:04:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 63/123 2020-02-11T16:04:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 64/123 2020-02-11T16:04:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 65/123 2020-02-11T16:04:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 66/123 2020-02-11T16:04:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 67/123 2020-02-11T16:04:37.993 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-11T16:04:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 69/123 2020-02-11T16:04:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 70/123 2020-02-11T16:04:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 71/123 2020-02-11T16:04:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 72/123 2020-02-11T16:04:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 73/123 2020-02-11T16:04:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 74/123 2020-02-11T16:04:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 75/123 2020-02-11T16:04:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 76/123 2020-02-11T16:04:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 77/123 2020-02-11T16:04:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 78/123 2020-02-11T16:04:37.996 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 79/123 2020-02-11T16:04:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 80/123 2020-02-11T16:04:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 81/123 2020-02-11T16:04:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 82/123 2020-02-11T16:04:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 83/123 2020-02-11T16:04:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 84/123 2020-02-11T16:04:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 85/123 2020-02-11T16:04:37.997 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 86/123 2020-02-11T16:04:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 87/123 2020-02-11T16:04:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 88/123 2020-02-11T16:04:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 89/123 2020-02-11T16:04:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 90/123 2020-02-11T16:04:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 91/123 2020-02-11T16:04:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 92/123 2020-02-11T16:04:37.998 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-2.6-1.el8.noarch 93/123 2020-02-11T16:04:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 94/123 2020-02-11T16:04:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 95/123 2020-02-11T16:04:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 96/123 2020-02-11T16:04:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 97/123 2020-02-11T16:04:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 98/123 2020-02-11T16:04:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 99/123 2020-02-11T16:04:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 100/123 2020-02-11T16:04:37.999 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 101/123 2020-02-11T16:04:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/123 2020-02-11T16:04:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 103/123 2020-02-11T16:04:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 104/123 2020-02-11T16:04:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 105/123 2020-02-11T16:04:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 106/123 2020-02-11T16:04:38.000 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 107/123 2020-02-11T16:04:38.001 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 108/123 2020-02-11T16:04:38.001 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 109/123 2020-02-11T16:04:38.001 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 110/123 2020-02-11T16:04:38.001 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 111/123 2020-02-11T16:04:38.001 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-10.0.1-1.el8.noarch 112/123 2020-02-11T16:04:38.001 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 113/123 2020-02-11T16:04:38.001 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 114/123 2020-02-11T16:04:38.002 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 115/123 2020-02-11T16:04:38.002 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 116/123 2020-02-11T16:04:38.002 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 117/123 2020-02-11T16:04:38.002 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : leveldb-1.21-2.el8.x86_64 118/123 2020-02-11T16:04:38.002 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-13.el8.x86_64 119/123 2020-02-11T16:04:38.002 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:15.1.0-486.g71281e4.el8.x86_64 120/123 2020-02-11T16:04:38.002 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 121/123 2020-02-11T16:04:38.003 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:15.1.0-486.g71281e4.el8.x86_64 122/123 2020-02-11T16:04:39.504 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 123/123 2020-02-11T16:04:39.504 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:39.504 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2020-02-11T16:04:39.505 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.505 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.505 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:39.505 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2020-02-11T16:04:39.505 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.506 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.506 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.506 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.506 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.507 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.507 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.507 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.507 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.507 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.508 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.508 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.508 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.508 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.508 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.509 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.510 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.510 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.510 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:15.1.0-486.g71281e4.el8.noarch 2020-02-11T16:04:39.510 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:15.1.0-486.g71281e4.el8.noarch 2020-02-11T16:04:39.511 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:15.1.0-486.g71281e4.el8.noarch 2020-02-11T16:04:39.511 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:15.1.0-486.g71281e4.el8.noarch 2020-02-11T16:04:39.511 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.0.4-10.el8.x86_64 2020-02-11T16:04:39.511 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.1-9.el8.x86_64 2020-02-11T16:04:39.512 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-2.4.6-25.el8.x86_64 2020-02-11T16:04:39.512 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-02-11T16:04:39.512 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-02-11T16:04:39.512 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-02-11T16:04:39.512 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-02-11T16:04:39.513 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-02-11T16:04:39.513 INFO:teuthology.orchestra.run.smithi088.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-02-11T16:04:39.513 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-02-11T16:04:39.513 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.513 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.514 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.514 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.514 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.514 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.515 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.515 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.515 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:15.1.0-486.g71281e4.el8.x86_64 2020-02-11T16:04:39.515 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:15.1.0-486.g71281e4.el8.noarch 2020-02-11T16:04:39.515 INFO:teuthology.orchestra.run.smithi088.stdout: automake-1.16.1-6.el8.noarch 2020-02-11T16:04:39.516 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.5-12.el8.x86_64 2020-02-11T16:04:39.516 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-02-11T16:04:39.516 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-02-11T16:04:39.516 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-02-11T16:04:39.516 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.3-2.el8.x86_64 2020-02-11T16:04:39.517 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-02-11T16:04:39.517 INFO:teuthology.orchestra.run.smithi088.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-02-11T16:04:39.517 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.0.6-13.el8.noarch 2020-02-11T16:04:39.517 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-02-11T16:04:39.518 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-02-11T16:04:39.518 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-02-11T16:04:39.518 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-02-11T16:04:39.518 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-02-11T16:04:39.519 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-02-11T16:04:39.519 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2017.2-9.el8.noarch 2020-02-11T16:04:39.519 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-02-11T16:04:39.519 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-02-11T16:04:39.519 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-02-11T16:04:39.520 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.3.2-6.el8.x86_64 2020-02-11T16:04:39.520 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.7-12.el8.x86_64 2020-02-11T16:04:39.520 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-02-11T16:04:39.520 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-02-11T16:04:39.520 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel-1.17-9.el8.x86_64 2020-02-11T16:04:39.521 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-02-11T16:04:39.521 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-02-11T16:04:39.521 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-02-11T16:04:39.521 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-02-11T16:04:39.521 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-02-11T16:04:39.522 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-02-11T16:04:39.522 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-02-11T16:04:39.522 INFO:teuthology.orchestra.run.smithi088.stdout: libxslt-1.1.32-3.el8.x86_64 2020-02-11T16:04:39.522 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-02-11T16:04:39.522 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-02-11T16:04:39.522 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-02-11T16:04:39.523 INFO:teuthology.orchestra.run.smithi088.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-02-11T16:04:39.523 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-02-11T16:04:39.523 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-02-11T16:04:39.523 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-02-11T16:04:39.523 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-02-11T16:04:39.524 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-02-11T16:04:39.524 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-02-11T16:04:39.524 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-02-11T16:04:39.524 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-02-11T16:04:39.525 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-02-11T16:04:39.526 INFO:teuthology.orchestra.run.smithi088.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-02-11T16:04:39.526 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-6.2-6.el8.noarch 2020-02-11T16:04:39.526 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-02-11T16:04:39.526 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-02-11T16:04:39.526 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-02-11T16:04:39.526 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-02-11T16:04:39.526 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-2.6-1.el8.noarch 2020-02-11T16:04:39.527 INFO:teuthology.orchestra.run.smithi088.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-02-11T16:04:39.527 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-02-11T16:04:39.527 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.4.1-12.el8.noarch 2020-02-11T16:04:39.527 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-02-11T16:04:39.527 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-02-11T16:04:39.527 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-02-11T16:04:39.528 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-02-11T16:04:39.528 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-02-11T16:04:39.528 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-02-11T16:04:39.529 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.2-3.el8.x86_64 2020-02-11T16:04:39.529 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.3.1-3.el8.x86_64 2020-02-11T16:04:39.529 INFO:teuthology.orchestra.run.smithi088.stdout: python3-apipkg-1.5-6.el8.noarch 2020-02-11T16:04:39.529 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-02-11T16:04:39.530 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-02-11T16:04:39.530 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-02-11T16:04:39.530 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-02-11T16:04:39.530 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-02-11T16:04:39.531 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-10.0.1-1.el8.noarch 2020-02-11T16:04:39.531 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-02-11T16:04:39.531 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-02-11T16:04:39.531 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-02-11T16:04:39.531 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-02-11T16:04:39.532 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-02-11T16:04:39.532 INFO:teuthology.orchestra.run.smithi088.stdout: leveldb-1.21-2.el8.x86_64 2020-02-11T16:04:39.532 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-13.el8.x86_64 2020-02-11T16:04:39.532 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:39.533 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2020-02-11T16:04:39.658 DEBUG:teuthology.parallel:result is None 2020-02-11T16:04:39.658 INFO:teuthology.orchestra.run.smithi088:> sudo lsb_release -is 2020-02-11T16:04:39.708 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS 2020-02-11T16:04:39.709 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-11T16:04:39.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=71281e48a442b0f38f812cad32658ed72c6d8ff5 2020-02-11T16:04:39.873 INFO:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-02-11T16:04:39.894 INFO:teuthology.orchestra.run.smithi088.stdout:15.1.0-486.g71281e4.el8 2020-02-11T16:04:39.894 INFO:teuthology.packaging:The installed version of ceph is 15.1.0-486.g71281e4.el8 2020-02-11T16:04:39.895 INFO:teuthology.task.install:The correct ceph version 15.1.0-486.g71281e4 is installed. 2020-02-11T16:04:39.895 INFO:teuthology.orchestra.run.smithi052:> sudo lsb_release -is 2020-02-11T16:04:39.955 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS 2020-02-11T16:04:39.956 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-11T16:04:39.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=71281e48a442b0f38f812cad32658ed72c6d8ff5 2020-02-11T16:04:40.112 INFO:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-02-11T16:04:40.135 INFO:teuthology.orchestra.run.smithi052.stdout:15.1.0-486.g71281e4.el8 2020-02-11T16:04:40.136 INFO:teuthology.packaging:The installed version of ceph is 15.1.0-486.g71281e4.el8 2020-02-11T16:04:40.136 INFO:teuthology.task.install:The correct ceph version 15.1.0-486.g71281e4 is installed. 2020-02-11T16:04:40.136 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-02-11T16:04:40.136 INFO:teuthology.orchestra.run.smithi088:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-02-11T16:04:40.164 INFO:teuthology.orchestra.run.smithi052:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-02-11T16:04:40.212 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-02-11T16:04:40.212 INFO:teuthology.orchestra.run.smithi088:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-02-11T16:04:40.241 INFO:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-02-11T16:04:40.309 INFO:teuthology.orchestra.run.smithi052:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-02-11T16:04:40.346 INFO:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-02-11T16:04:40.421 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-02-11T16:04:40.421 INFO:teuthology.orchestra.run.smithi088:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-02-11T16:04:40.467 INFO:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-02-11T16:04:40.533 INFO:teuthology.orchestra.run.smithi052:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-02-11T16:04:40.579 INFO:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-02-11T16:04:40.654 INFO:teuthology.run_tasks:Running task ceph... 2020-02-11T16:04:40.746 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-02-11T16:04:40.746 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2020-02-11T16:04:40.749 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2020-02-11T16:04:40.780 INFO:tasks.ceph:Disabling ceph logrotate... 2020-02-11T16:04:40.780 INFO:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2020-02-11T16:04:40.822 INFO:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2020-02-11T16:04:40.852 INFO:tasks.ceph:Creating extra log directories... 2020-02-11T16:04:40.852 INFO:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-02-11T16:04:40.895 INFO:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-02-11T16:04:40.925 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-02-11T16:04:40.925 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-02-11T16:04:40.926 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-02-11T16:04:40.926 INFO:teuthology.orchestra.run.smithi088:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-02-11T16:04:41.007 INFO:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-02-11T16:04:41.120 INFO:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-02-11T16:04:41.146 INFO:teuthology.orchestra.run.smithi052:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-02-11T16:04:41.190 INFO:teuthology.orchestra.run.smithi052:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-02-11T16:04:41.322 INFO:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-02-11T16:04:41.353 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-02-11T16:04:41.353 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(MON_DOWN\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'mon osd backfillfull_ratio': 0.85, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd op complaint time': 180, 'bluestore fsck on mount': True}}} 2020-02-11T16:04:41.354 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '71281e48a442b0f38f812cad32658ed72c6d8ff5'}}, {'ceph': None}, {'mon_thrash': {'revive_delay': 20, 'check_mds_failover': True, 'thrash_delay': 10}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/snaps']}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.032856/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.2512', 'owner': 'scheduled_pdonnell@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'targets': {'smithi088.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZYuLM33qpEv47TfO1v9fcw54HPcBlY8gQsHgMhj9SrWsUzyBZgunLNFWStWtn23rrmJuTSJxw3DNZNtBwhkgRyWu/jXC+rVLOPYA+vyfC/7c1shRi1gz4rko5LjHNUWu1YrXyTMq0ZitHW4p3jsjEO+nFUlPd8Xzi5wPEHAbSivz43UXJ5YS5bbo42Fl1NrJAx5a9Scu42bOZi2CHHa1u/zBxX2YAfPr9dni5m/W68EqCPJG3BeaA88q0zxwmK0N0lEN78ykdT8h+nTL/4SmVqABdF83tEdHRQmRwv3bbs10evkqnSVjVdp3nyfvwCOm3UbpY7eiLvpzk/Ri0Ew171YjXTEY2f9ZxiMwYksMUxdlJIN6cSFlw5q16Zw6SdoMMCaEB6XToKGP4YqerhdaYJn1ukIX3B4dlrTGMzkL1p0Cuan/OMswVNLRkL3qKNq7YoC9qdCRQP7OxbOf5KNChNqaWjcx7g2hDKoc8KUqC7F2qdWkh4geTNRnro0kDdgM=', 'smithi052.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq0lwVIINIRDTGlxFoclXyGUVLDlH+umgv9VD0YSCIZzaESd6VP8mvyiZqZjlPJ/p+JlCGJt0hhOUncMc+Eb8e4ytZKPuYBg3i0jcDuNVBsrt6hejP9aDXqETTambaJ/4te1p3IBXZezC9gmdKMC+GFFp+q0eBONbYE1GkXYb6jyQ9oMfbDjEitQtjARPnqg8yE8OOsQXnWLfq4+VrpuJDb/xCnvMrIO4YMsNgX6jq1l7Yo4d3ChBRpgeJJRYckRLSoOkBVUT3UtmrrBkKCn8ZRGx8Q3aME/6+c4UVh9by3MGycKEIOJsXUMGXPhyvi6dRZJLbxaeM/CN2/kOMpKM0nnuQi4xTTpV030LjVNK7NSl1sC+2z4YBfqHUNjC8Ll4DljvXX64bhR0+aHeFHCGC9cS5EkZqPqF+0yDs0JjW3t7nDhOBHIqSH8HGNePekoIvQAnUSa/FTcp7yt/OW4RKXpRxKkzAkTw65bWYNQh1w/Q+tagqMzd2WkhjMd6/aM0='}, 'job_id': '4754538', 'tube': 'smithi', 'suite_branch': 'wip-pdonnell-testing-20200211.032856', 'priority': 75, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'wip-pdonnell-testing-20200211.032856', 'suite': 'fs', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': 'pdonnell@redhat.com', 'archive_path': '/home/teuthworker/archive/pdonnell-2020-02-11_15:01:19-fs-wip-pdonnell-testing-20200211.032856-distro-basic-smithi/4754538', 'description': 'fs/thrash/{begin.yaml ceph-thrash/mon.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_snaptests.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '71281e48a442b0f38f812cad32658ed72c6d8ff5', 'name': 'pdonnell-2020-02-11_15:01:19-fs-wip-pdonnell-testing-20200211.032856-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'overrides': {'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(MON_DOWN\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'mon osd backfillfull_ratio': 0.85, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd op complaint time': 180, 'bluestore fsck on mount': True}}, 'fs': 'xfs', 'sha1': '71281e48a442b0f38f812cad32658ed72c6d8ff5'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'osd failsafe full ratio': 0.95}}}, 'install': {'ceph': {'sha1': '71281e48a442b0f38f812cad32658ed72c6d8ff5'}}, 'admin_socket': {'branch': 'wip-pdonnell-testing-20200211.032856'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'sha1': '71281e48a442b0f38f812cad32658ed72c6d8ff5', 'branch': 'wip-pdonnell-testing-20200211.032856'}}, 'os_type': 'centos', 'suite_sha1': '71281e48a442b0f38f812cad32658ed72c6d8ff5'} 2020-02-11T16:04:41.354 INFO:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-02-11T16:04:41.395 INFO:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-02-11T16:04:41.409 INFO:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2020-02-11T16:04:41.450 INFO:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2020-02-11T16:04:41.537 DEBUG:teuthology.orchestra.remote:smithi088:/scratch_devs is 72B 2020-02-11T16:04:41.585 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-11T16:04:41.586 INFO:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-02-11T16:04:41.600 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-02-11T16:04:41.600 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-11T16:04:41.601 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 96568 Links: 1 2020-02-11T16:04:41.601 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-11T16:04:41.601 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2020-02-11T16:04:41.601 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2020-02-11 16:04:37.630071314 +0000 2020-02-11T16:04:41.601 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2020-02-11 16:02:49.434981708 +0000 2020-02-11T16:04:41.601 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2020-02-11 16:02:49.434981708 +0000 2020-02-11T16:04:41.602 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2020-02-11T16:04:41.613 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2020-02-11T16:04:41.614 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2020-02-11T16:04:41.614 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000195989 s, 2.6 MB/s 2020-02-11T16:04:41.616 INFO:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-02-11T16:04:41.671 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-02-11T16:04:41.671 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-11T16:04:41.671 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 94750 Links: 1 2020-02-11T16:04:41.671 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-11T16:04:41.672 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2020-02-11T16:04:41.672 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2020-02-11 16:04:37.630071314 +0000 2020-02-11T16:04:41.672 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2020-02-11 16:02:49.790973635 +0000 2020-02-11T16:04:41.672 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2020-02-11 16:02:49.790973635 +0000 2020-02-11T16:04:41.672 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2020-02-11T16:04:41.684 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2020-02-11T16:04:41.684 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2020-02-11T16:04:41.684 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000181002 s, 2.8 MB/s 2020-02-11T16:04:41.687 INFO:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-02-11T16:04:41.740 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-02-11T16:04:41.740 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-11T16:04:41.740 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 96663 Links: 1 2020-02-11T16:04:41.741 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-11T16:04:41.741 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2020-02-11T16:04:41.741 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2020-02-11 16:04:37.630071314 +0000 2020-02-11T16:04:41.741 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2020-02-11 16:02:50.142965652 +0000 2020-02-11T16:04:41.741 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2020-02-11 16:02:50.142965652 +0000 2020-02-11T16:04:41.741 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2020-02-11T16:04:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2020-02-11T16:04:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2020-02-11T16:04:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000226262 s, 2.3 MB/s 2020-02-11T16:04:41.756 INFO:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-02-11T16:04:41.810 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-02-11T16:04:41.811 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-11T16:04:41.811 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 98464 Links: 1 2020-02-11T16:04:41.811 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-11T16:04:41.811 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2020-02-11T16:04:41.811 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2020-02-11 16:04:37.630071314 +0000 2020-02-11T16:04:41.812 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2020-02-11 16:02:50.486957851 +0000 2020-02-11T16:04:41.812 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2020-02-11 16:02:50.486957851 +0000 2020-02-11T16:04:41.812 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2020-02-11T16:04:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2020-02-11T16:04:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2020-02-11T16:04:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000202754 s, 2.5 MB/s 2020-02-11T16:04:41.826 INFO:tasks.ceph:fs option selected, checking for scratch devs 2020-02-11T16:04:41.826 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-11T16:04:41.826 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2020-02-11T16:04:41.826 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-11T16:04:41.846 DEBUG:teuthology.orchestra.remote:smithi052:/scratch_devs is 72B 2020-02-11T16:04:41.894 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-11T16:04:41.894 INFO:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-02-11T16:04:41.910 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-02-11T16:04:41.910 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-11T16:04:41.910 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 88887 Links: 1 2020-02-11T16:04:41.910 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-11T16:04:41.910 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2020-02-11T16:04:41.911 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2020-02-11 16:04:34.842659471 +0000 2020-02-11T16:04:41.911 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2020-02-11 16:02:53.362775158 +0000 2020-02-11T16:04:41.911 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2020-02-11 16:02:53.362775158 +0000 2020-02-11T16:04:41.911 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2020-02-11T16:04:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2020-02-11T16:04:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2020-02-11T16:04:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000107704 s, 4.8 MB/s 2020-02-11T16:04:41.930 INFO:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-02-11T16:04:41.985 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-02-11T16:04:41.985 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-11T16:04:41.985 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 94774 Links: 1 2020-02-11T16:04:41.986 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-11T16:04:41.986 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2020-02-11T16:04:41.986 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2020-02-11 16:04:34.842659471 +0000 2020-02-11T16:04:41.986 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2020-02-11 16:02:53.707770617 +0000 2020-02-11T16:04:41.986 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2020-02-11 16:02:53.707770617 +0000 2020-02-11T16:04:41.986 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2020-02-11T16:04:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2020-02-11T16:04:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2020-02-11T16:04:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000104981 s, 4.9 MB/s 2020-02-11T16:04:42.005 INFO:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-02-11T16:04:42.060 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-02-11T16:04:42.060 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-11T16:04:42.060 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 99479 Links: 1 2020-02-11T16:04:42.060 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-11T16:04:42.060 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2020-02-11T16:04:42.061 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2020-02-11 16:04:34.842659471 +0000 2020-02-11T16:04:42.061 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2020-02-11 16:02:54.054766049 +0000 2020-02-11T16:04:42.061 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2020-02-11 16:02:54.054766049 +0000 2020-02-11T16:04:42.061 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2020-02-11T16:04:42.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2020-02-11T16:04:42.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2020-02-11T16:04:42.077 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.4134e-05 s, 5.4 MB/s 2020-02-11T16:04:42.080 INFO:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-02-11T16:04:42.134 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-02-11T16:04:42.134 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-11T16:04:42.134 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 89039 Links: 1 2020-02-11T16:04:42.135 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-11T16:04:42.135 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2020-02-11T16:04:42.135 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2020-02-11 16:04:34.842659471 +0000 2020-02-11T16:04:42.135 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2020-02-11 16:02:54.411761348 +0000 2020-02-11T16:04:42.135 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2020-02-11 16:02:54.411761348 +0000 2020-02-11T16:04:42.135 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2020-02-11T16:04:42.151 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2020-02-11T16:04:42.151 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2020-02-11T16:04:42.151 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 8.5091e-05 s, 6.0 MB/s 2020-02-11T16:04:42.153 INFO:tasks.ceph:fs option selected, checking for scratch devs 2020-02-11T16:04:42.153 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-11T16:04:42.154 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2020-02-11T16:04:42.154 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-11T16:04:42.154 INFO:tasks.ceph:Generating config... 2020-02-11T16:04:42.155 INFO:tasks.ceph:[mds] mds debug frag = True 2020-02-11T16:04:42.155 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-02-11T16:04:42.155 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-02-11T16:04:42.155 INFO:tasks.ceph:[mds] debug mds = 20 2020-02-11T16:04:42.156 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-02-11T16:04:42.156 INFO:tasks.ceph:[mds] debug ms = 1 2020-02-11T16:04:42.156 INFO:tasks.ceph:[mds] mds bal frag = True 2020-02-11T16:04:42.156 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-02-11T16:04:42.156 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-02-11T16:04:42.156 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-02-11T16:04:42.156 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-02-11T16:04:42.156 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-02-11T16:04:42.157 INFO:tasks.ceph:[client] debug ms = 1 2020-02-11T16:04:42.157 INFO:tasks.ceph:[client] debug client = 20 2020-02-11T16:04:42.157 INFO:tasks.ceph:[client] client mount timeout = 600 2020-02-11T16:04:42.157 INFO:tasks.ceph:[mon] debug mon = 20 2020-02-11T16:04:42.157 INFO:tasks.ceph:[mon] debug paxos = 20 2020-02-11T16:04:42.157 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-02-11T16:04:42.157 INFO:tasks.ceph:[mon] debug ms = 1 2020-02-11T16:04:42.158 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-02-11T16:04:42.158 INFO:tasks.ceph:[osd] debug ms = 1 2020-02-11T16:04:42.158 INFO:tasks.ceph:[osd] debug journal = 20 2020-02-11T16:04:42.158 INFO:tasks.ceph:[osd] debug osd = 25 2020-02-11T16:04:42.158 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-02-11T16:04:42.159 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-02-11T16:04:42.159 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-02-11T16:04:42.159 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-02-11T16:04:42.159 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-02-11T16:04:42.159 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-02-11T16:04:42.159 INFO:tasks.ceph:[osd] debug filestore = 20 2020-02-11T16:04:42.159 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-02-11T16:04:42.159 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-02-11T16:04:42.160 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-02-11T16:04:42.160 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-02-11T16:04:42.160 INFO:tasks.ceph:Setting up mon.a... 2020-02-11T16:04:42.160 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-02-11T16:04:42.221 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2020-02-11T16:04:42.223 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-02-11T16:04:42.263 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-02-11T16:04:42.330 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.c', '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]'), ('mon.b', '172.21.15.52')] 2020-02-11T16:04:42.330 INFO:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.88 --addv c '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]' --add b 172.21.15.52 --print /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:04:42.405 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:04:42.406 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid 386cdcef-05ad-40b9-b029-1e37a6356c21 2020-02-11T16:04:42.406 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2020-02-11T16:04:42.406 INFO:teuthology.orchestra.run.smithi088.stdout:fsid 386cdcef-05ad-40b9-b029-1e37a6356c21 2020-02-11T16:04:42.406 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2020-02-11T16:04:42.404721+0000 2020-02-11T16:04:42.406 INFO:teuthology.orchestra.run.smithi088.stdout:created 2020-02-11T16:04:42.404721+0000 2020-02-11T16:04:42.406 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 0 (unknown) 2020-02-11T16:04:42.407 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2020-02-11T16:04:42.407 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2020-02-11T16:04:42.407 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2020-02-11T16:04:42.407 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-02-11T16:04:42.408 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 386cdcef-05ad-40b9-b029-1e37a6356c21... 2020-02-11T16:04:42.409 INFO:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-02-11T16:04:42.413 INFO:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-02-11T16:04:42.476 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2020-02-11T16:04:42.476 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2020-02-11T16:04:42.476 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-02-11T16:04:42.477 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2020-02-11T16:04:42.477 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.477 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2020-02-11T16:04:42.477 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.477 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2020-02-11T16:04:42.477 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.477 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2020-02-11T16:04:42.478 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2020-02-11T16:04:42.478 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.478 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2020-02-11T16:04:42.478 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2020-02-11T16:04:42.478 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.478 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2020-02-11T16:04:42.478 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2020-02-11T16:04:42.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.479 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2020-02-11T16:04:42.479 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2020-02-11T16:04:42.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.479 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2020-02-11T16:04:42.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.479 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2020-02-11T16:04:42.479 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2020-02-11T16:04:42.480 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2020-02-11T16:04:42.480 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2020-02-11T16:04:42.480 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2020-02-11T16:04:42.480 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2020-02-11T16:04:42.480 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2020-02-11T16:04:42.480 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-02-11T16:04:42.480 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2020-02-11T16:04:42.481 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.481 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-02-11T16:04:42.481 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.481 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2020-02-11T16:04:42.481 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.481 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2020-02-11T16:04:42.481 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.482 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2020-02-11T16:04:42.482 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2020-02-11T16:04:42.482 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.88,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],172.21.15.52" 2020-02-11T16:04:42.482 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 386cdcef-05ad-40b9-b029-1e37a6356c21 2020-02-11T16:04:42.482 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.482 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2020-02-11T16:04:42.482 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2020-02-11T16:04:42.483 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.483 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2020-02-11T16:04:42.483 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2020-02-11T16:04:42.483 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.483 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2020-02-11T16:04:42.483 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2020-02-11T16:04:42.483 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.483 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2020-02-11T16:04:42.484 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2020-02-11T16:04:42.484 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2020-02-11T16:04:42.484 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.484 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2020-02-11T16:04:42.484 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2020-02-11T16:04:42.484 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.484 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2020-02-11T16:04:42.485 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.485 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2020-02-11T16:04:42.485 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.485 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2020-02-11T16:04:42.485 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.485 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2020-02-11T16:04:42.485 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2020-02-11T16:04:42.486 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.486 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2020-02-11T16:04:42.486 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2020-02-11T16:04:42.486 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2020-02-11T16:04:42.486 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2020-02-11T16:04:42.486 INFO:teuthology.orchestra.run.smithi052.stdout: debug journal = 20 2020-02-11T16:04:42.486 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 25 2020-02-11T16:04:42.486 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 20 2020-02-11T16:04:42.487 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 20 2020-02-11T16:04:42.487 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2020-02-11T16:04:42.487 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2020-02-11T16:04:42.487 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2020-02-11T16:04:42.487 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2020-02-11T16:04:42.487 INFO:teuthology.orchestra.run.smithi052.stdout: debug filestore = 20 2020-02-11T16:04:42.487 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 10 2020-02-11T16:04:42.488 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2020-02-11T16:04:42.488 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2020-02-11T16:04:42.488 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2020-02-11T16:04:42.488 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.488 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2020-02-11T16:04:42.488 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2020-02-11T16:04:42.488 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2020-02-11T16:04:42.489 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2020-02-11T16:04:42.489 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2020-02-11T16:04:42.489 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2020-02-11T16:04:42.489 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2020-02-11T16:04:42.489 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2020-02-11T16:04:42.489 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.489 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2020-02-11T16:04:42.498 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2020-02-11T16:04:42.498 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2020-02-11T16:04:42.498 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2020-02-11T16:04:42.498 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2020-02-11T16:04:42.498 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2020-02-11T16:04:42.498 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2020-02-11T16:04:42.498 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2020-02-11T16:04:42.499 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2020-02-11T16:04:42.499 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2020-02-11T16:04:42.499 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2020-02-11T16:04:42.499 INFO:teuthology.orchestra.run.smithi052.stdout: mon op complaint time = 120 2020-02-11T16:04:42.499 INFO:teuthology.orchestra.run.smithi052.stdout: 2020-02-11T16:04:42.499 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2020-02-11T16:04:42.499 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2020-02-11T16:04:42.500 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2020-02-11T16:04:42.500 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2020-02-11T16:04:42.500 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-02-11T16:04:42.500 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-02-11T16:04:42.500 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2020-02-11T16:04:42.500 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2020-02-11T16:04:42.500 INFO:teuthology.orchestra.run.smithi052.stdout: client mount timeout = 600 2020-02-11T16:04:42.500 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2020-02-11T16:04:42.501 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2020-02-11T16:04:42.501 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2020-02-11T16:04:42.501 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2020-02-11T16:04:42.501 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2020-02-11T16:04:42.501 INFO:teuthology.orchestra.run.smithi052.stdout:[mds] 2020-02-11T16:04:42.501 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug frag = True 2020-02-11T16:04:42.501 INFO:teuthology.orchestra.run.smithi052.stdout: mds bal split bits = 3 2020-02-11T16:04:42.502 INFO:teuthology.orchestra.run.smithi052.stdout: mds bal split size = 100 2020-02-11T16:04:42.502 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds = 20 2020-02-11T16:04:42.502 INFO:teuthology.orchestra.run.smithi052.stdout: mds bal merge size = 5 2020-02-11T16:04:42.502 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2020-02-11T16:04:42.502 INFO:teuthology.orchestra.run.smithi052.stdout: mds bal frag = True 2020-02-11T16:04:42.502 INFO:teuthology.orchestra.run.smithi052.stdout: mds bal fragment size max = 10000 2020-02-11T16:04:42.503 INFO:teuthology.orchestra.run.smithi052.stdout: mds op complaint time = 180 2020-02-11T16:04:42.503 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug scatterstat = True 2020-02-11T16:04:42.503 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2020-02-11T16:04:42.503 INFO:teuthology.orchestra.run.smithi052.stdout: mds verify scatter = True 2020-02-11T16:04:42.504 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2020-02-11T16:04:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2020-02-11T16:04:42.504 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-02-11T16:04:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2020-02-11T16:04:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2020-02-11T16:04:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2020-02-11T16:04:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.505 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2020-02-11T16:04:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2020-02-11T16:04:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2020-02-11T16:04:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2020-02-11T16:04:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2020-02-11T16:04:42.506 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2020-02-11T16:04:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2020-02-11T16:04:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2020-02-11T16:04:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2020-02-11T16:04:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2020-02-11T16:04:42.507 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2020-02-11T16:04:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2020-02-11T16:04:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2020-02-11T16:04:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2020-02-11T16:04:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2020-02-11T16:04:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2020-02-11T16:04:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-02-11T16:04:42.508 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2020-02-11T16:04:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-02-11T16:04:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2020-02-11T16:04:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2020-02-11T16:04:42.509 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2020-02-11T16:04:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2020-02-11T16:04:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],172.21.15.52" 2020-02-11T16:04:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 386cdcef-05ad-40b9-b029-1e37a6356c21 2020-02-11T16:04:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.510 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2020-02-11T16:04:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2020-02-11T16:04:42.510 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2020-02-11T16:04:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2020-02-11T16:04:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2020-02-11T16:04:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2020-02-11T16:04:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.511 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2020-02-11T16:04:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2020-02-11T16:04:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2020-02-11T16:04:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2020-02-11T16:04:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2020-02-11T16:04:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.512 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2020-02-11T16:04:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2020-02-11T16:04:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2020-02-11T16:04:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2020-02-11T16:04:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2020-02-11T16:04:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2020-02-11T16:04:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2020-02-11T16:04:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2020-02-11T16:04:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2020-02-11T16:04:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: debug journal = 20 2020-02-11T16:04:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 25 2020-02-11T16:04:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 20 2020-02-11T16:04:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 20 2020-02-11T16:04:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2020-02-11T16:04:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2020-02-11T16:04:42.515 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2020-02-11T16:04:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2020-02-11T16:04:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: debug filestore = 20 2020-02-11T16:04:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 10 2020-02-11T16:04:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2020-02-11T16:04:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2020-02-11T16:04:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2020-02-11T16:04:42.516 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.517 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2020-02-11T16:04:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2020-02-11T16:04:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2020-02-11T16:04:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2020-02-11T16:04:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2020-02-11T16:04:42.517 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2020-02-11T16:04:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2020-02-11T16:04:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2020-02-11T16:04:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.518 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2020-02-11T16:04:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2020-02-11T16:04:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2020-02-11T16:04:42.518 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2020-02-11T16:04:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2020-02-11T16:04:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2020-02-11T16:04:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2020-02-11T16:04:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2020-02-11T16:04:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2020-02-11T16:04:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2020-02-11T16:04:42.519 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2020-02-11T16:04:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2020-02-11T16:04:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:04:42.520 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2020-02-11T16:04:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2020-02-11T16:04:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2020-02-11T16:04:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2020-02-11T16:04:42.520 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-02-11T16:04:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-02-11T16:04:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2020-02-11T16:04:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2020-02-11T16:04:42.521 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2020-02-11T16:04:42.521 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2020-02-11T16:04:42.521 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2020-02-11T16:04:42.521 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2020-02-11T16:04:42.522 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2020-02-11T16:04:42.522 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2020-02-11T16:04:42.522 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2020-02-11T16:04:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2020-02-11T16:04:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal split bits = 3 2020-02-11T16:04:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal split size = 100 2020-02-11T16:04:42.522 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2020-02-11T16:04:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal merge size = 5 2020-02-11T16:04:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2020-02-11T16:04:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal frag = True 2020-02-11T16:04:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal fragment size max = 10000 2020-02-11T16:04:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2020-02-11T16:04:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2020-02-11T16:04:42.523 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2020-02-11T16:04:42.524 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2020-02-11T16:04:42.525 INFO:tasks.ceph:Creating admin key on mon.a... 2020-02-11T16:04:42.525 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-02-11T16:04:42.575 INFO:tasks.ceph:Copying monmap to all nodes... 2020-02-11T16:04:42.591 DEBUG:teuthology.orchestra.remote:smithi088:/etc/ceph/ceph.keyring is 206B 2020-02-11T16:04:42.683 DEBUG:teuthology.orchestra.remote:smithi088:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-02-11T16:04:42.731 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2020-02-11T16:04:42.731 INFO:teuthology.orchestra.run.smithi088:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-02-11T16:04:42.789 INFO:teuthology.orchestra.run.smithi088:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:04:42.874 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2020-02-11T16:04:42.874 INFO:teuthology.orchestra.run.smithi052:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-02-11T16:04:42.937 INFO:teuthology.orchestra.run.smithi052:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:04:43.021 INFO:tasks.ceph:Setting up mon nodes... 2020-02-11T16:04:43.022 INFO:tasks.ceph:Setting up mgr nodes... 2020-02-11T16:04:43.022 INFO:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-02-11T16:04:43.074 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-02-11T16:04:43.076 INFO:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-02-11T16:04:43.180 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-02-11T16:04:43.182 INFO:tasks.ceph:Setting up mds nodes... 2020-02-11T16:04:43.183 INFO:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-02-11T16:04:43.235 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-02-11T16:04:43.237 INFO:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-02-11T16:04:43.263 INFO:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-02-11T16:04:43.326 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-02-11T16:04:43.328 INFO:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-02-11T16:04:43.359 INFO:tasks.ceph_client:Setting up client nodes... 2020-02-11T16:04:43.360 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-02-11T16:04:43.398 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-02-11T16:04:43.414 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-02-11T16:04:43.414 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-02-11T16:04:43.414 INFO:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-02-11T16:04:43.480 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-11T16:04:43.481 INFO:tasks.ceph:{} 2020-02-11T16:04:43.481 INFO:tasks.ceph:osd.0 2020-02-11T16:04:43.482 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2020-02-11T16:04:43.482 INFO:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-02-11T16:04:44.013 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-02-11T16:04:44.013 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-11T16:04:44.013 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-11T16:04:44.013 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2020-02-11T16:04:44.014 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-11T16:04:44.014 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2020-02-11T16:04:44.014 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-11T16:04:44.014 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-11T16:04:44.014 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-11T16:04:44.014 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-11T16:04:44.015 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2020-02-11T16:04:44.015 INFO:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-02-11T16:04:44.148 INFO:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-02-11T16:04:44.189 INFO:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-02-11T16:04:44.263 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-11T16:04:44.263 INFO:tasks.ceph:{} 2020-02-11T16:04:44.263 INFO:tasks.ceph:osd.1 2020-02-11T16:04:44.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2020-02-11T16:04:44.263 INFO:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-02-11T16:04:44.763 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-02-11T16:04:44.764 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-11T16:04:44.764 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-11T16:04:44.764 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2020-02-11T16:04:44.764 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-11T16:04:44.764 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2020-02-11T16:04:44.765 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-11T16:04:44.765 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-11T16:04:44.765 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-11T16:04:44.765 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-11T16:04:44.766 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2020-02-11T16:04:44.766 INFO:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-02-11T16:04:44.809 INFO:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-02-11T16:04:44.880 INFO:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-02-11T16:04:44.946 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-11T16:04:44.946 INFO:tasks.ceph:{} 2020-02-11T16:04:44.946 INFO:tasks.ceph:osd.2 2020-02-11T16:04:44.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2020-02-11T16:04:44.947 INFO:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-02-11T16:04:45.487 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-02-11T16:04:45.488 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-11T16:04:45.488 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-11T16:04:45.488 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2020-02-11T16:04:45.488 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-11T16:04:45.488 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2020-02-11T16:04:45.488 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-11T16:04:45.488 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-11T16:04:45.489 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-11T16:04:45.489 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-11T16:04:45.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2020-02-11T16:04:45.490 INFO:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-02-11T16:04:45.569 INFO:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-02-11T16:04:45.599 INFO:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-02-11T16:04:45.666 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-11T16:04:45.666 INFO:tasks.ceph:{} 2020-02-11T16:04:45.667 INFO:tasks.ceph:osd.3 2020-02-11T16:04:45.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2020-02-11T16:04:45.667 INFO:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-02-11T16:04:46.218 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-02-11T16:04:46.218 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-11T16:04:46.218 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-11T16:04:46.218 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2020-02-11T16:04:46.218 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-11T16:04:46.219 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2020-02-11T16:04:46.219 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-11T16:04:46.219 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-11T16:04:46.219 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-11T16:04:46.219 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-11T16:04:46.220 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2020-02-11T16:04:46.220 INFO:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2020-02-11T16:04:46.335 INFO:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-02-11T16:04:46.365 INFO:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:04:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:46.469+0000 7f8e27e45ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-02-11T16:04:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:46.470+0000 7f8e27e45ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-02-11T16:04:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:46.470+0000 7f8e27e45ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-02-11T16:04:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:46.470+0000 7f8e27e45ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-02-11T16:04:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:46.470+0000 7f8e27e45ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-02-11T16:04:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:46.474+0000 7f8e27e45ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-02-11T16:04:48.817 INFO:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-02-11T16:04:48.849 INFO:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:04:48.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:48.933+0000 7ff917506ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-02-11T16:04:48.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:48.934+0000 7ff917506ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-02-11T16:04:48.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:48.934+0000 7ff917506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-02-11T16:04:48.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:48.934+0000 7ff917506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-02-11T16:04:48.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:48.934+0000 7ff917506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-02-11T16:04:48.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:48.934+0000 7ff917506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-02-11T16:04:51.269 INFO:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-02-11T16:04:51.301 INFO:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:04:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:51.386+0000 7f52ffe4bec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-02-11T16:04:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:51.387+0000 7f52ffe4bec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-02-11T16:04:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:51.387+0000 7f52ffe4bec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-02-11T16:04:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:51.387+0000 7f52ffe4bec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-02-11T16:04:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:51.387+0000 7f52ffe4bec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-02-11T16:04:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:51.387+0000 7f52ffe4bec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-02-11T16:04:53.729 INFO:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-02-11T16:04:53.760 INFO:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:04:53.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:53.844+0000 7f0d1d349ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-02-11T16:04:53.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:53.844+0000 7f0d1d349ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-02-11T16:04:53.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:53.844+0000 7f0d1d349ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-02-11T16:04:53.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:53.844+0000 7f0d1d349ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-02-11T16:04:53.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:53.844+0000 7f0d1d349ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-02-11T16:04:53.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:04:53.845+0000 7f0d1d349ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-02-11T16:04:56.183 INFO:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-02-11T16:04:56.214 INFO:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-02-11T16:04:56.251 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-11T16:04:56.251 INFO:tasks.ceph:{} 2020-02-11T16:04:56.251 INFO:tasks.ceph:osd.4 2020-02-11T16:04:56.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com 2020-02-11T16:04:56.251 INFO:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-02-11T16:04:56.349 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-02-11T16:04:56.350 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-11T16:04:56.350 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-11T16:04:56.350 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 2020-02-11T16:04:56.350 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-11T16:04:56.350 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2020-02-11T16:04:56.351 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-11T16:04:56.351 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-11T16:04:56.351 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-11T16:04:56.351 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-11T16:04:56.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2020-02-11T16:04:56.352 INFO:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-02-11T16:04:56.398 INFO:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-02-11T16:04:56.435 INFO:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-02-11T16:04:56.520 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-11T16:04:56.521 INFO:tasks.ceph:{} 2020-02-11T16:04:56.521 INFO:tasks.ceph:osd.5 2020-02-11T16:04:56.521 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2020-02-11T16:04:56.521 INFO:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-02-11T16:04:56.576 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-02-11T16:04:56.577 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-11T16:04:56.577 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-11T16:04:56.577 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 2020-02-11T16:04:56.577 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-11T16:04:56.577 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2020-02-11T16:04:56.577 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-11T16:04:56.578 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-11T16:04:56.578 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-11T16:04:56.578 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-11T16:04:56.579 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2020-02-11T16:04:56.579 INFO:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2020-02-11T16:04:56.649 INFO:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-02-11T16:04:56.683 INFO:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-02-11T16:04:56.753 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-11T16:04:56.753 INFO:tasks.ceph:{} 2020-02-11T16:04:56.753 INFO:tasks.ceph:osd.6 2020-02-11T16:04:56.753 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2020-02-11T16:04:56.754 INFO:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-02-11T16:04:56.848 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-02-11T16:04:56.848 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-11T16:04:56.849 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-11T16:04:56.849 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 2020-02-11T16:04:56.849 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-11T16:04:56.849 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2020-02-11T16:04:56.850 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-11T16:04:56.850 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-11T16:04:56.850 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-11T16:04:56.850 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-11T16:04:56.852 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2020-02-11T16:04:56.852 INFO:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-02-11T16:04:56.895 INFO:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-02-11T16:04:56.970 INFO:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-02-11T16:04:57.042 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-11T16:04:57.042 INFO:tasks.ceph:{} 2020-02-11T16:04:57.042 INFO:tasks.ceph:osd.7 2020-02-11T16:04:57.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com 2020-02-11T16:04:57.042 INFO:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-02-11T16:04:57.136 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-02-11T16:04:57.137 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-11T16:04:57.137 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-11T16:04:57.138 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 2020-02-11T16:04:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-11T16:04:57.138 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2020-02-11T16:04:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-11T16:04:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-11T16:04:57.138 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-11T16:04:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-11T16:04:57.140 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2020-02-11T16:04:57.140 INFO:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2020-02-11T16:04:57.183 INFO:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-02-11T16:04:57.259 INFO:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:04:57.638 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:04:57.633+0000 7f5c39e79ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-02-11T16:04:57.638 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:04:57.633+0000 7f5c39e79ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-02-11T16:04:57.638 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:04:57.633+0000 7f5c39e79ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-02-11T16:04:57.639 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:04:57.633+0000 7f5c39e79ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-02-11T16:04:57.639 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:04:57.633+0000 7f5c39e79ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-02-11T16:04:57.639 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:04:57.634+0000 7f5c39e79ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-02-11T16:04:59.973 INFO:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-02-11T16:05:00.011 INFO:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:05:00.103 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:00.101+0000 7fa72d506ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-02-11T16:05:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:00.101+0000 7fa72d506ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-02-11T16:05:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:00.101+0000 7fa72d506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-02-11T16:05:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:00.101+0000 7fa72d506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-02-11T16:05:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:00.101+0000 7fa72d506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-02-11T16:05:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:00.101+0000 7fa72d506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-02-11T16:05:02.441 INFO:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-02-11T16:05:02.478 INFO:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:05:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:02.568+0000 7f419b875ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-02-11T16:05:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:02.569+0000 7f419b875ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-02-11T16:05:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:02.569+0000 7f419b875ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-02-11T16:05:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:02.569+0000 7f419b875ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-02-11T16:05:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:02.569+0000 7f419b875ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-02-11T16:05:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:02.569+0000 7f419b875ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-02-11T16:05:04.904 INFO:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-02-11T16:05:04.940 INFO:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:05:05.033 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:05.030+0000 7fc29b93cec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-02-11T16:05:05.033 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:05.030+0000 7fc29b93cec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-02-11T16:05:05.033 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:05.030+0000 7fc29b93cec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-02-11T16:05:05.033 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:05.030+0000 7fc29b93cec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-02-11T16:05:05.033 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:05.030+0000 7fc29b93cec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-02-11T16:05:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:05.031+0000 7fc29b93cec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-02-11T16:05:07.371 INFO:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-02-11T16:05:07.408 INFO:tasks.ceph:Reading keys from all nodes... 2020-02-11T16:05:07.408 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T16:05:07.425 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.N6e1bAFp9J 2020-02-11T16:05:07.426 INFO:teuthology.orchestra.run.smithi088:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.N6e1bAFp9J 2020-02-11T16:05:07.497 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.N6e1bAFp9J 2020-02-11T16:05:07.625 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.N6e1bAFp9J is 56B 2020-02-11T16:05:07.673 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.N6e1bAFp9J 2020-02-11T16:05:07.688 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T16:05:07.741 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.M6aenzk6OJ 2020-02-11T16:05:07.742 INFO:teuthology.orchestra.run.smithi088:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.M6aenzk6OJ 2020-02-11T16:05:07.810 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.M6aenzk6OJ 2020-02-11T16:05:07.935 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.M6aenzk6OJ is 56B 2020-02-11T16:05:07.983 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.M6aenzk6OJ 2020-02-11T16:05:07.997 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T16:05:08.049 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.lhsVECbATt 2020-02-11T16:05:08.050 INFO:teuthology.orchestra.run.smithi088:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.lhsVECbATt 2020-02-11T16:05:08.117 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.lhsVECbATt 2020-02-11T16:05:08.242 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.lhsVECbATt is 56B 2020-02-11T16:05:08.298 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.lhsVECbATt 2020-02-11T16:05:08.312 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T16:05:08.364 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.knowyVEP98 2020-02-11T16:05:08.364 INFO:teuthology.orchestra.run.smithi088:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.knowyVEP98 2020-02-11T16:05:08.431 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.knowyVEP98 2020-02-11T16:05:08.557 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.knowyVEP98 is 56B 2020-02-11T16:05:08.604 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.knowyVEP98 2020-02-11T16:05:08.618 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T16:05:08.671 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.jokxC5nDi6 2020-02-11T16:05:08.671 INFO:teuthology.orchestra.run.smithi088:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.jokxC5nDi6 2020-02-11T16:05:08.737 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.jokxC5nDi6 2020-02-11T16:05:08.861 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.jokxC5nDi6 is 56B 2020-02-11T16:05:08.910 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.jokxC5nDi6 2020-02-11T16:05:08.924 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T16:05:08.977 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.s2mCbSlhB0 2020-02-11T16:05:08.977 INFO:teuthology.orchestra.run.smithi088:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.s2mCbSlhB0 2020-02-11T16:05:09.045 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.s2mCbSlhB0 2020-02-11T16:05:09.171 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.s2mCbSlhB0 is 56B 2020-02-11T16:05:09.218 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.s2mCbSlhB0 2020-02-11T16:05:09.231 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T16:05:09.249 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.r77jVLF441 2020-02-11T16:05:09.250 INFO:teuthology.orchestra.run.smithi052:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.r77jVLF441 2020-02-11T16:05:09.326 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.r77jVLF441 2020-02-11T16:05:09.460 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.r77jVLF441 is 56B 2020-02-11T16:05:09.515 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.r77jVLF441 2020-02-11T16:05:09.533 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T16:05:09.588 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.RxdsVfZsf7 2020-02-11T16:05:09.589 INFO:teuthology.orchestra.run.smithi052:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.RxdsVfZsf7 2020-02-11T16:05:09.662 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.RxdsVfZsf7 2020-02-11T16:05:09.800 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.RxdsVfZsf7 is 56B 2020-02-11T16:05:09.849 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.RxdsVfZsf7 2020-02-11T16:05:09.864 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T16:05:09.919 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.zjey7E9QPq 2020-02-11T16:05:09.919 INFO:teuthology.orchestra.run.smithi052:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.zjey7E9QPq 2020-02-11T16:05:09.992 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.zjey7E9QPq 2020-02-11T16:05:10.131 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.zjey7E9QPq is 56B 2020-02-11T16:05:10.179 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.zjey7E9QPq 2020-02-11T16:05:10.194 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T16:05:10.248 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.7wEYEq2r6I 2020-02-11T16:05:10.249 INFO:teuthology.orchestra.run.smithi052:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.7wEYEq2r6I 2020-02-11T16:05:10.321 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.7wEYEq2r6I 2020-02-11T16:05:10.451 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.7wEYEq2r6I is 56B 2020-02-11T16:05:10.499 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.7wEYEq2r6I 2020-02-11T16:05:10.513 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T16:05:10.568 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.R4jC49qXFd 2020-02-11T16:05:10.568 INFO:teuthology.orchestra.run.smithi052:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.R4jC49qXFd 2020-02-11T16:05:10.640 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.R4jC49qXFd 2020-02-11T16:05:10.768 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.R4jC49qXFd is 56B 2020-02-11T16:05:10.816 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.R4jC49qXFd 2020-02-11T16:05:10.830 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T16:05:10.889 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.x8VWvvX304 2020-02-11T16:05:10.890 INFO:teuthology.orchestra.run.smithi052:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.x8VWvvX304 2020-02-11T16:05:10.960 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.x8VWvvX304 2020-02-11T16:05:11.088 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.x8VWvvX304 is 56B 2020-02-11T16:05:11.136 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.x8VWvvX304 2020-02-11T16:05:11.170 DEBUG:teuthology.orchestra.remote:smithi088:/etc/ceph/ceph.client.0.keyring is 59B 2020-02-11T16:05:11.218 INFO:tasks.ceph:Adding keys to all mons... 2020-02-11T16:05:11.219 INFO:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2020-02-11T16:05:11.221 INFO:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2020-02-11T16:05:11.248 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2020-02-11T16:05:11.248 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCb0EJetY5eBBAAXmvlXjF91pnSqAE+MGMi9Q== 2020-02-11T16:05:11.248 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2020-02-11T16:05:11.248 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCb0EJekczyDRAAi7728wqmS3Ele8AtrZAtKg== 2020-02-11T16:05:11.249 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2020-02-11T16:05:11.249 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCe0EJeSMUOHBAA3QY3PUrfF3eHxT0wx6aqJg== 2020-02-11T16:05:11.249 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2020-02-11T16:05:11.249 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCg0EJezMu9NxAAyzJmpajMjly/sNX5PPIEXQ== 2020-02-11T16:05:11.249 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2020-02-11T16:05:11.249 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCj0EJe2qMlFxAA0e4BmKudZzojR0L6ecqO6w== 2020-02-11T16:05:11.249 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2020-02-11T16:05:11.250 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCl0EJewwpmMhAAX4ozqkYPhdv81/Ha5AUCzw== 2020-02-11T16:05:11.250 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2020-02-11T16:05:11.250 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCb0EJe7eKxChAAsoRHlU8VfrYzpdK25JG7Rw== 2020-02-11T16:05:11.250 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2020-02-11T16:05:11.250 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCb0EJeNxpgExAAXvAL5Z2MCe+yvr46bJOiZg== 2020-02-11T16:05:11.250 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.4] 2020-02-11T16:05:11.250 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCp0EJepKjNJRAAlXufviz1m7q2gp7/65WaGQ== 2020-02-11T16:05:11.251 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.5] 2020-02-11T16:05:11.251 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCs0EJe/k8VBhAAwU1AJwt3NQ6uhIE9CAOEbQ== 2020-02-11T16:05:11.251 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.6] 2020-02-11T16:05:11.251 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCu0EJe+oz1IRAAp5AhcbYQLgOjizAVzuZr3A== 2020-02-11T16:05:11.251 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.7] 2020-02-11T16:05:11.251 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCx0EJenDbfARAAYRUwdiWZ0uQF9+sesnAlPQ== 2020-02-11T16:05:11.251 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2020-02-11T16:05:11.252 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCb0EJeqHq0FxAALljy3xomnrV239mvwiC7wQ== 2020-02-11T16:05:11.264 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2020-02-11T16:05:11.264 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCb0EJetY5eBBAAXmvlXjF91pnSqAE+MGMi9Q== 2020-02-11T16:05:11.265 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2020-02-11T16:05:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCb0EJekczyDRAAi7728wqmS3Ele8AtrZAtKg== 2020-02-11T16:05:11.265 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2020-02-11T16:05:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCe0EJeSMUOHBAA3QY3PUrfF3eHxT0wx6aqJg== 2020-02-11T16:05:11.265 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2020-02-11T16:05:11.265 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCg0EJezMu9NxAAyzJmpajMjly/sNX5PPIEXQ== 2020-02-11T16:05:11.265 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2020-02-11T16:05:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCj0EJe2qMlFxAA0e4BmKudZzojR0L6ecqO6w== 2020-02-11T16:05:11.266 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2020-02-11T16:05:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCl0EJewwpmMhAAX4ozqkYPhdv81/Ha5AUCzw== 2020-02-11T16:05:11.266 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2020-02-11T16:05:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCb0EJe7eKxChAAsoRHlU8VfrYzpdK25JG7Rw== 2020-02-11T16:05:11.266 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2020-02-11T16:05:11.266 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCb0EJeNxpgExAAXvAL5Z2MCe+yvr46bJOiZg== 2020-02-11T16:05:11.267 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2020-02-11T16:05:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCp0EJepKjNJRAAlXufviz1m7q2gp7/65WaGQ== 2020-02-11T16:05:11.267 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2020-02-11T16:05:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCs0EJe/k8VBhAAwU1AJwt3NQ6uhIE9CAOEbQ== 2020-02-11T16:05:11.267 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2020-02-11T16:05:11.267 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCu0EJe+oz1IRAAp5AhcbYQLgOjizAVzuZr3A== 2020-02-11T16:05:11.267 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2020-02-11T16:05:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCx0EJenDbfARAAYRUwdiWZ0uQF9+sesnAlPQ== 2020-02-11T16:05:11.268 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2020-02-11T16:05:11.268 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCb0EJeqHq0FxAALljy3xomnrV239mvwiC7wQ== 2020-02-11T16:05:11.269 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-11T16:05:11.295 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-11T16:05:11.355 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:05:11.358 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:05:11.359 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.402 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.492 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.511 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.580 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.582 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.632 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.634 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.683 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.686 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.735 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-11T16:05:11.742 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-11T16:05:11.789 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.792 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.879 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.882 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.932 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.934 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.984 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:11.987 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:12.036 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:12.039 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-11T16:05:12.088 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-02-11T16:05:12.091 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-02-11T16:05:12.177 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-02-11T16:05:12.177 INFO:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-02-11T16:05:12.204 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-02-11T16:05:12.297 INFO:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-02-11T16:05:12.324 INFO:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-02-11T16:05:12.356 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-02-11T16:05:12.455 INFO:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-02-11T16:05:12.486 INFO:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-02-11T16:05:12.556 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-02-11T16:05:12.655 INFO:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-02-11T16:05:12.687 INFO:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:05:12.730 INFO:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-02-11T16:05:12.745 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-02-11T16:05:12.746 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:05:12.746 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:05:12.788 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:05:12.788 INFO:tasks.ceph.mon.b:Restarting daemon 2020-02-11T16:05:12.789 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-02-11T16:05:12.793 INFO:tasks.ceph.mon.b:Started 2020-02-11T16:05:12.793 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-11T16:05:12.793 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-11T16:05:12.795 INFO:tasks.ceph.mon.c:Started 2020-02-11T16:05:12.795 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-02-11T16:05:12.795 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-02-11T16:05:12.796 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-02-11T16:05:12.798 INFO:tasks.ceph.mgr.y:Started 2020-02-11T16:05:12.798 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-02-11T16:05:12.798 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-02-11T16:05:12.800 INFO:tasks.ceph.mgr.x:Started 2020-02-11T16:05:12.801 INFO:tasks.ceph:Setting crush tunables to default 2020-02-11T16:05:12.801 INFO:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2020-02-11T16:05:17.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.911+0000 7fde6cd0d700 1 Processor -- start 2020-02-11T16:05:17.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.911+0000 7fde6cd0d700 1 -- start start 2020-02-11T16:05:17.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.911+0000 7fde6cd0d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:17.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.911+0000 7fde6cd0d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:17.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.911+0000 7fde6cd0d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde680a4420 con 0x7fde680a3590 2020-02-11T16:05:17.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.911+0000 7fde6cd0d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde680a2d00 con 0x7fde6805ace0 2020-02-11T16:05:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.911+0000 7fde6cd0d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde680a6600 con 0x7fde680a5b80 2020-02-11T16:05:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde6759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde6759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50904/0 (socket says 172.21.15.88:50904) 2020-02-11T16:05:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde66d9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde6659c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fde680a3590 0x7fde6805a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38530/0 (socket says 172.21.15.88:38530) 2020-02-11T16:05:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 learned_addr learned my addr 172.21.15.88:0/914271000 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:05:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:05:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:05:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde66d9d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-02-11T16:05:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde66d9d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:05:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:05:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:05:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:12.912+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:05:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.113+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.113+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-02-11T16:05:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.113+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:05:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.113+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:05:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.113+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:05:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.113+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.113+0000 7fde66d9d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:05:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.113+0000 7fde66d9d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:05:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.113+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:05:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.113+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:05:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.514+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.514+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-02-11T16:05:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.514+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:05:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.514+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:05:17.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.514+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.514+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:05:17.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.514+0000 7fde66d9d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:05:17.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.514+0000 7fde66d9d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:05:17.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.514+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:05:17.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:13.514+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:05:17.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:14.315+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:14.315+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:14.315+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-02-11T16:05:17.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:14.315+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:05:17.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:14.315+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:05:17.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:14.315+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:05:17.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:14.315+0000 7fde66d9d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:05:17.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:14.315+0000 7fde66d9d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:05:17.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:14.315+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:05:17.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:14.315+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:05:17.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:15.917+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:15.917+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-02-11T16:05:17.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:15.917+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:05:17.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:15.917+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:05:17.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:15.917+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:05:17.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:15.917+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:15.917+0000 7fde66d9d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:05:17.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:15.917+0000 7fde66d9d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:05:17.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:15.917+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:05:17.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:15.917+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:05:17.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.954+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482745290 0 0) 0x7fde680a4420 con 0x7fde680a3590 2020-02-11T16:05:17.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.954+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde50003230 con 0x7fde680a3590 2020-02-11T16:05:17.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.959+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2728043596 0 0) 0x7fde50003230 con 0x7fde680a3590 2020-02-11T16:05:17.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.959+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde680a3130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:05:17.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.959+0000 7fde65d9b700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde680a3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:17.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.959+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 msgr2=0x7fde6805b170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:05:17.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.959+0000 7fde65d9b700 1 --2- 172.21.15.88:0/914271000 >> v2:172.21.15.88:3300/0 conn(0x7fde6805ace0 0x7fde6805b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:17.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.959+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680a15a0 con 0x7fde680a3590 2020-02-11T16:05:17.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.959+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fde5c0016d0 con 0x7fde680a3590 2020-02-11T16:05:17.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 >> v1:172.21.15.88:6789/0 conn(0x7fde680a3590 legacy=0x7fde6805a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:17.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde65d9b700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde500037a0 0x7fde50003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:17.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde65d9b700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde500044d0 0x7fde50004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:17.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde65d9b700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde50004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:17.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680a2d00 con 0x7fde500037a0 2020-02-11T16:05:17.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680a6600 con 0x7fde500044d0 2020-02-11T16:05:17.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde50004330 con 0x7fde680a5b80 2020-02-11T16:05:17.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde6659c700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde500044d0 0x7fde50004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde6759e700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde50004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde66d9d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde500037a0 0x7fde50003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde6659c700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 msgr2=0x7fde50004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:17.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde6659c700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680a5b80 0x7fde50004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:17.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde6659c700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde500037a0 msgr2=0x7fde50003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:17.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde6659c700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde500037a0 0x7fde50003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:17.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde6659c700 1 -- 172.21.15.88:0/914271000 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50003230 con 0x7fde500044d0 2020-02-11T16:05:17.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde6659c700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde500044d0 0x7fde50004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde6659c700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde500044d0 0x7fde50004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.960+0000 7fde6659c700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde500044d0 0x7fde50004950 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).ready entity=mon.1 client_cookie=a94e17a3e6ae7c43 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:17.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.961+0000 7fde6659c700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde500044d0 0x7fde50004950 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.961+0000 7fde6659c700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde500044d0 0x7fde50004950 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.961+0000 7fde6659c700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde500044d0 0x7fde50004950 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.961+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde5c00ee40 con 0x7fde500044d0 2020-02-11T16:05:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.961+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c010ca0 con 0x7fde500044d0 2020-02-11T16:05:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.961+0000 7fde65d9b700 1 -- 172.21.15.88:0/914271000 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde5c005520 con 0x7fde500044d0 2020-02-11T16:05:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.961+0000 7fde6cd0d700 1 -- 172.21.15.88:0/914271000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde500044d0 msgr2=0x7fde50004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.961+0000 7fde6cd0d700 1 --2- 172.21.15.88:0/914271000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde500044d0 0x7fde50004950 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).stop 2020-02-11T16:05:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.961+0000 7fde6759e700 1 -- 172.21.15.88:0/914271000 reap_dead start 2020-02-11T16:05:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.962+0000 7fde6cd0d700 1 -- 172.21.15.88:0/914271000 shutdown_connections 2020-02-11T16:05:17.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.962+0000 7fde6cd0d700 1 -- 172.21.15.88:0/914271000 >> 172.21.15.88:0/914271000 conn(0x7fde680a9fb0 msgr2=0x7fde680aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:17.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.962+0000 7fde6cd0d700 1 -- 172.21.15.88:0/914271000 shutdown_connections 2020-02-11T16:05:17.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.962+0000 7fde6cd0d700 1 -- 172.21.15.88:0/914271000 wait complete. 2020-02-11T16:05:17.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6cd0d700 1 Processor -- start 2020-02-11T16:05:17.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6cd0d700 1 -- start start 2020-02-11T16:05:17.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6cd0d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fde68125d40 0x7fde68066540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:17.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6cd0d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680669a0 0x7fde6813ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:17.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6cd0d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde68137d40 con 0x7fde680a8230 2020-02-11T16:05:17.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6cd0d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde68137fe0 con 0x7fde68125d40 2020-02-11T16:05:17.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6cd0d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde68138280 con 0x7fde680669a0 2020-02-11T16:05:17.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fde68125d40 0x7fde68066540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fde68125d40 0x7fde68066540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50956/0 (socket says 172.21.15.88:50956) 2020-02-11T16:05:17.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6659c700 1 -- 172.21.15.88:0/2040325754 learned_addr learned my addr 172.21.15.88:0/2040325754 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:17.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.964+0000 7fde6759e700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680669a0 0x7fde6813ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:17.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.965+0000 7fde6659c700 1 -- 172.21.15.88:0/2040325754 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680669a0 msgr2=0x7fde6813ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:17.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.965+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680669a0 0x7fde6813ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:17.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.965+0000 7fde6659c700 1 -- 172.21.15.88:0/2040325754 >> v1:172.21.15.52:6789/0 conn(0x7fde680a8230 legacy=0x7fde681343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:17.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.965+0000 7fde6659c700 1 -- 172.21.15.88:0/2040325754 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680a8700 con 0x7fde68125d40 2020-02-11T16:05:17.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.965+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> v2:172.21.15.88:3300/0 conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.965+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> v2:172.21.15.88:3300/0 conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.965+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:17.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.966+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.966+0000 7fde577fe700 1 -- 172.21.15.88:0/2040325754 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde5c00bbb0 con 0x7fde68125d40 2020-02-11T16:05:17.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.966+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.966+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.966+0000 7fde6cd0d700 1 -- 172.21.15.88:0/2040325754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde681379c0 con 0x7fde68125d40 2020-02-11T16:05:17.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.966+0000 7fde577fe700 1 -- 172.21.15.88:0/2040325754 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c0105b0 con 0x7fde68125d40 2020-02-11T16:05:17.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.966+0000 7fde577fe700 1 -- 172.21.15.88:0/2040325754 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde5c00c740 con 0x7fde68125d40 2020-02-11T16:05:17.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.966+0000 7fde6cd0d700 1 -- 172.21.15.88:0/2040325754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde68138720 con 0x7fde68125d40 2020-02-11T16:05:17.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.966+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.966+0000 7fde577fe700 1 -- 172.21.15.88:0/2040325754 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7fde5c00cd20 con 0x7fde68125d40 2020-02-11T16:05:17.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.968+0000 7fde6cd0d700 1 -- 172.21.15.88:0/2040325754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde680565b0 con 0x7fde68125d40 2020-02-11T16:05:17.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.971+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.971+0000 7fde577fe700 1 -- 172.21.15.88:0/2040325754 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fde5c0011c0 con 0x7fde68125d40 2020-02-11T16:05:17.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.973+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:17.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:17.973+0000 7fde577fe700 1 -- 172.21.15.88:0/2040325754 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7fde5c00f930 con 0x7fde68125d40 2020-02-11T16:05:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.050+0000 7fde6cd0d700 1 -- 172.21.15.88:0/2040325754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fde681383f0 con 0x7fde68125d40 2020-02-11T16:05:18.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.058+0000 7fde6659c700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.058+0000 7fde577fe700 1 -- 172.21.15.88:0/2040325754 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fde5c00fad0 con 0x7fde68125d40 2020-02-11T16:05:18.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.058+0000 7fde6cd0d700 1 -- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 msgr2=0x7fde68066540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:18.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.058+0000 7fde6cd0d700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 0x7fde68066540 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fde5c0013e0 tx=0x7fde680a5f60).stop 2020-02-11T16:05:18.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.059+0000 7fde6cd0d700 1 -- 172.21.15.88:0/2040325754 shutdown_connections 2020-02-11T16:05:18.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.059+0000 7fde6cd0d700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde680669a0 0x7fde6813ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:18.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.059+0000 7fde6cd0d700 1 --2- 172.21.15.88:0/2040325754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde68125d40 0x7fde68066540 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:18.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.059+0000 7fde6cd0d700 1 -- 172.21.15.88:0/2040325754 >> 172.21.15.88:0/2040325754 conn(0x7fde680a9fb0 msgr2=0x7fde68069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:18.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.059+0000 7fde6cd0d700 1 -- 172.21.15.88:0/2040325754 shutdown_connections 2020-02-11T16:05:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:18.059+0000 7fde6cd0d700 1 -- 172.21.15.88:0/2040325754 wait complete. 2020-02-11T16:05:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2020-02-11T16:05:18.071 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-02-11T16:05:18.072 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T16:05:18.086 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.jugVlxDiJF 2020-02-11T16:05:18.087 INFO:teuthology.orchestra.run.smithi088:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.jugVlxDiJF 2020-02-11T16:05:18.154 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.jugVlxDiJF 2020-02-11T16:05:18.279 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.jugVlxDiJF is 37B 2020-02-11T16:05:18.331 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.jugVlxDiJF 2020-02-11T16:05:18.345 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T16:05:18.398 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.H9ciFbFwx6 2020-02-11T16:05:18.399 INFO:teuthology.orchestra.run.smithi088:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.H9ciFbFwx6 2020-02-11T16:05:18.466 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.H9ciFbFwx6 2020-02-11T16:05:18.593 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.H9ciFbFwx6 is 37B 2020-02-11T16:05:18.641 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.H9ciFbFwx6 2020-02-11T16:05:18.654 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T16:05:18.707 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.6cfCH1mFu9 2020-02-11T16:05:18.708 INFO:teuthology.orchestra.run.smithi088:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.6cfCH1mFu9 2020-02-11T16:05:18.775 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.6cfCH1mFu9 2020-02-11T16:05:18.899 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.6cfCH1mFu9 is 37B 2020-02-11T16:05:18.947 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.6cfCH1mFu9 2020-02-11T16:05:18.960 INFO:teuthology.orchestra.run.smithi088:> mktemp 2020-02-11T16:05:19.013 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.iI3cCZNkmL 2020-02-11T16:05:19.014 INFO:teuthology.orchestra.run.smithi088:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.iI3cCZNkmL 2020-02-11T16:05:19.080 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.iI3cCZNkmL 2020-02-11T16:05:19.213 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.iI3cCZNkmL is 37B 2020-02-11T16:05:19.260 INFO:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.iI3cCZNkmL 2020-02-11T16:05:19.274 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T16:05:19.288 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.gSftpNeRzq 2020-02-11T16:05:19.289 INFO:teuthology.orchestra.run.smithi052:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.gSftpNeRzq 2020-02-11T16:05:19.360 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.gSftpNeRzq 2020-02-11T16:05:19.488 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.gSftpNeRzq is 37B 2020-02-11T16:05:19.536 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.gSftpNeRzq 2020-02-11T16:05:19.550 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T16:05:19.603 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.F0tFTPtWHY 2020-02-11T16:05:19.604 INFO:teuthology.orchestra.run.smithi052:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.F0tFTPtWHY 2020-02-11T16:05:19.677 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.F0tFTPtWHY 2020-02-11T16:05:19.824 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.F0tFTPtWHY is 37B 2020-02-11T16:05:19.859 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.F0tFTPtWHY 2020-02-11T16:05:19.877 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T16:05:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.yD3Phj36rn 2020-02-11T16:05:19.932 INFO:teuthology.orchestra.run.smithi052:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.yD3Phj36rn 2020-02-11T16:05:20.005 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.yD3Phj36rn 2020-02-11T16:05:20.134 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.yD3Phj36rn is 37B 2020-02-11T16:05:20.182 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.yD3Phj36rn 2020-02-11T16:05:20.196 INFO:teuthology.orchestra.run.smithi052:> mktemp 2020-02-11T16:05:20.250 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.ehWK43Mqau 2020-02-11T16:05:20.250 INFO:teuthology.orchestra.run.smithi052:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.ehWK43Mqau 2020-02-11T16:05:20.329 INFO:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.ehWK43Mqau 2020-02-11T16:05:20.458 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.ehWK43Mqau is 37B 2020-02-11T16:05:20.506 INFO:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.ehWK43Mqau 2020-02-11T16:05:20.520 INFO:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 809323e5-6c36-494b-84da-c02a9e07821b 0 2020-02-11T16:05:20.681 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.670+0000 7feb4b1b2700 1 Processor -- start 2020-02-11T16:05:20.681 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.670+0000 7feb4b1b2700 1 -- start start 2020-02-11T16:05:20.682 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4b1b2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb440a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:20.683 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4b1b2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb4405ace0 0x7feb4405b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4b1b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb440a4420 con 0x7feb440a3590 2020-02-11T16:05:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4b1b2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb440a2d00 con 0x7feb4405ace0 2020-02-11T16:05:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4b1b2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb440a6600 con 0x7feb440a5b80 2020-02-11T16:05:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4974f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb440a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb48f4e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feb440a3590 0x7feb4405a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48032/0 (socket says 172.21.15.52:48032) 2020-02-11T16:05:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb48f4e700 1 -- 172.21.15.52:0/2936930639 learned_addr learned my addr 172.21.15.52:0/2936930639 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb49f50700 1 --2- 172.21.15.52:0/2936930639 >> v2:172.21.15.88:3300/0 conn(0x7feb4405ace0 0x7feb4405b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb3bfff700 1 -- 172.21.15.52:0/2936930639 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811003055 0 0) 0x7feb440a4420 con 0x7feb440a3590 2020-02-11T16:05:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb3bfff700 1 -- 172.21.15.52:0/2936930639 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb30003230 con 0x7feb440a3590 2020-02-11T16:05:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4974f700 1 -- 172.21.15.52:0/2936930639 >> v2:172.21.15.88:3300/0 conn(0x7feb4405ace0 msgr2=0x7feb4405b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4974f700 1 --2- 172.21.15.52:0/2936930639 >> v2:172.21.15.88:3300/0 conn(0x7feb4405ace0 0x7feb4405b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4974f700 1 -- 172.21.15.52:0/2936930639 >> v1:172.21.15.52:6789/0 conn(0x7feb440a3590 legacy=0x7feb4405a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4974f700 1 -- 172.21.15.52:0/2936930639 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb440a15a0 con 0x7feb440a5b80 2020-02-11T16:05:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4974f700 1 --2- 172.21.15.52:0/2936930639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb440a3130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb34002f30 tx=0x7feb440684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4974f700 1 --2- 172.21.15.52:0/2936930639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb440a3130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb34002f30 tx=0x7feb440684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.671+0000 7feb4974f700 1 --2- 172.21.15.52:0/2936930639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb440a3130 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7feb34002f30 tx=0x7feb440684d0).ready entity=mon.2 client_cookie=10e584ba5546b0f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4974f700 1 --2- 172.21.15.52:0/2936930639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb440a3130 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7feb34002f30 tx=0x7feb440684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4974f700 1 --2- 172.21.15.52:0/2936930639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb440a3130 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7feb34002f30 tx=0x7feb440684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb3bfff700 1 -- 172.21.15.52:0/2936930639 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb34008e40 con 0x7feb440a5b80 2020-02-11T16:05:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4974f700 1 --2- 172.21.15.52:0/2936930639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb440a3130 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7feb34002f30 tx=0x7feb440684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb3bfff700 1 -- 172.21.15.52:0/2936930639 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb34011500 con 0x7feb440a5b80 2020-02-11T16:05:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb3bfff700 1 -- 172.21.15.52:0/2936930639 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb340118e0 con 0x7feb440a5b80 2020-02-11T16:05:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4b1b2700 1 -- 172.21.15.52:0/2936930639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 msgr2=0x7feb440a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4b1b2700 1 --2- 172.21.15.52:0/2936930639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb440a3130 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7feb34002f30 tx=0x7feb440684d0).stop 2020-02-11T16:05:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4b1b2700 1 -- 172.21.15.52:0/2936930639 shutdown_connections 2020-02-11T16:05:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4b1b2700 1 --2- 172.21.15.52:0/2936930639 >> v2:172.21.15.88:3300/0 conn(0x7feb4405ace0 0x7feb4405b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4b1b2700 1 --2- 172.21.15.52:0/2936930639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb440a3130 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4b1b2700 1 -- 172.21.15.52:0/2936930639 >> 172.21.15.52:0/2936930639 conn(0x7feb440a9fb0 msgr2=0x7feb440aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4b1b2700 1 -- 172.21.15.52:0/2936930639 shutdown_connections 2020-02-11T16:05:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.672+0000 7feb4b1b2700 1 -- 172.21.15.52:0/2936930639 wait complete. 2020-02-11T16:05:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.673+0000 7feb4b1b2700 1 Processor -- start 2020-02-11T16:05:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.673+0000 7feb4b1b2700 1 -- start start 2020-02-11T16:05:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.674+0000 7feb4b1b2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb440a3590 0x7feb44135a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.674+0000 7feb4b1b2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb44135eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.674+0000 7feb4b1b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb44135480 con 0x7feb4405ace0 2020-02-11T16:05:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.674+0000 7feb4b1b2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb44066b40 con 0x7feb440a3590 2020-02-11T16:05:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.674+0000 7feb4b1b2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb44066de0 con 0x7feb440a5b80 2020-02-11T16:05:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.674+0000 7feb4974f700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feb4405ace0 0x7feb440639f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48036/0 (socket says 172.21.15.52:48036) 2020-02-11T16:05:20.697 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.674+0000 7feb4974f700 1 -- 172.21.15.52:0/3128502641 learned_addr learned my addr 172.21.15.52:0/3128502641 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:20.697 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.674+0000 7feb49f50700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb44135eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:20.697 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.674+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> v2:172.21.15.88:3300/0 conn(0x7feb440a3590 0x7feb44135a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb39ffb700 1 -- 172.21.15.52:0/3128502641 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592635103 0 0) 0x7feb44135480 con 0x7feb4405ace0 2020-02-11T16:05:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb39ffb700 1 -- 172.21.15.52:0/3128502641 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb24003230 con 0x7feb4405ace0 2020-02-11T16:05:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 -- 172.21.15.52:0/3128502641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 msgr2=0x7feb44135eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb44135eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 -- 172.21.15.52:0/3128502641 >> v1:172.21.15.52:6789/0 conn(0x7feb4405ace0 legacy=0x7feb440639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 -- 172.21.15.52:0/3128502641 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4407f180 con 0x7feb440a3590 2020-02-11T16:05:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb49f50700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb44135eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> v2:172.21.15.88:3300/0 conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> v2:172.21.15.88:3300/0 conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb39ffb700 1 -- 172.21.15.52:0/3128502641 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb40005e50 con 0x7feb440a3590 2020-02-11T16:05:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb39ffb700 1 -- 172.21.15.52:0/3128502641 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40012470 con 0x7feb440a3590 2020-02-11T16:05:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb4b1b2700 1 -- 172.21.15.52:0/3128502641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb44136310 con 0x7feb440a3590 2020-02-11T16:05:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb39ffb700 1 -- 172.21.15.52:0/3128502641 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb40012890 con 0x7feb440a3590 2020-02-11T16:05:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb4b1b2700 1 -- 172.21.15.52:0/3128502641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb440a3150 con 0x7feb440a3590 2020-02-11T16:05:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb39ffb700 1 -- 172.21.15.52:0/3128502641 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7feb4000a320 con 0x7feb440a3590 2020-02-11T16:05:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.675+0000 7feb39ffb700 1 -- 172.21.15.52:0/3128502641 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7feb4000a5b0 con 0x7feb440a3590 2020-02-11T16:05:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.676+0000 7feb4b1b2700 1 -- 172.21.15.52:0/3128502641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb440565b0 con 0x7feb440a3590 2020-02-11T16:05:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.678+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.678+0000 7feb39ffb700 1 -- 172.21.15.52:0/3128502641 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7feb400090b0 con 0x7feb440a3590 2020-02-11T16:05:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.767+0000 7feb4b1b2700 1 -- 172.21.15.52:0/3128502641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "809323e5-6c36-494b-84da-c02a9e07821b", "id": 0} v 0) v1 -- 0x7feb4405e2f0 con 0x7feb440a3590 2020-02-11T16:05:20.773 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.771+0000 7feb48f4e700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.773 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.771+0000 7feb39ffb700 1 -- 172.21.15.52:0/3128502641 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "809323e5-6c36-494b-84da-c02a9e07821b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7feb400095c0 con 0x7feb440a3590 2020-02-11T16:05:20.773 INFO:teuthology.orchestra.run.smithi052.stdout:0 2020-02-11T16:05:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.772+0000 7feb4b1b2700 1 -- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 msgr2=0x7feb44135a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.772+0000 7feb4b1b2700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 0x7feb44135a50 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7feb40001450 tx=0x7feb40010c90).stop 2020-02-11T16:05:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.772+0000 7feb4b1b2700 1 -- 172.21.15.52:0/3128502641 shutdown_connections 2020-02-11T16:05:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.772+0000 7feb4b1b2700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb440a5b80 0x7feb44135eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.772+0000 7feb4b1b2700 1 --2- 172.21.15.52:0/3128502641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb440a3590 0x7feb44135a50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.772+0000 7feb4b1b2700 1 -- 172.21.15.52:0/3128502641 >> 172.21.15.52:0/3128502641 conn(0x7feb440a9fb0 msgr2=0x7feb44069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.772+0000 7feb4b1b2700 1 -- 172.21.15.52:0/3128502641 shutdown_connections 2020-02-11T16:05:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.772+0000 7feb4b1b2700 1 -- 172.21.15.52:0/3128502641 wait complete. 2020-02-11T16:05:20.785 INFO:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 0760ed1f-9e02-4585-a5f9-449338628583 1 2020-02-11T16:05:20.905 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.896+0000 7f98db115700 1 Processor -- start 2020-02-11T16:05:20.906 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.896+0000 7f98db115700 1 -- start start 2020-02-11T16:05:20.906 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98db115700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 0x7f98d414cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:20.906 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98db115700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d40a4420 con 0x7f98d40a5b80 2020-02-11T16:05:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98db115700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d40a15a0 con 0x7f98d414cf40 2020-02-11T16:05:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98db115700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40a2d00 con 0x7f98d414a6f0 2020-02-11T16:05:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98d8eb1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 0x7f98d414cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98d96b2700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f98d40a5b80 0x7f98d40a3130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48042/0 (socket says 172.21.15.52:48042) 2020-02-11T16:05:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98d96b2700 1 -- 172.21.15.52:0/4136826190 learned_addr learned my addr 172.21.15.52:0/4136826190 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98c7fff700 1 -- 172.21.15.52:0/4136826190 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214046338 0 0) 0x7f98d40a4420 con 0x7f98d40a5b80 2020-02-11T16:05:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98c7fff700 1 -- 172.21.15.52:0/4136826190 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c0003230 con 0x7f98d40a5b80 2020-02-11T16:05:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98d8eb1700 1 -- 172.21.15.52:0/4136826190 >> v1:172.21.15.88:6789/0 conn(0x7f98d414cf40 legacy=0x7f98d414f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98d8eb1700 1 -- 172.21.15.52:0/4136826190 >> v1:172.21.15.52:6789/0 conn(0x7f98d40a5b80 legacy=0x7f98d40a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98d8eb1700 1 -- 172.21.15.52:0/4136826190 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d40a6600 con 0x7f98d414a6f0 2020-02-11T16:05:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.897+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/4136826190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 0x7f98d414cae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98d0002f30 tx=0x7f98d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/4136826190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 0x7f98d414cae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98d0002f30 tx=0x7f98d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/4136826190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 0x7f98d414cae0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00088e0).ready entity=mon.2 client_cookie=332b84460f44c605 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/4136826190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 0x7f98d414cae0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98c7fff700 1 -- 172.21.15.52:0/4136826190 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98d0008e40 con 0x7f98d414a6f0 2020-02-11T16:05:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/4136826190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 0x7f98d414cae0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98c7fff700 1 -- 172.21.15.52:0/4136826190 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d00115f0 con 0x7f98d414a6f0 2020-02-11T16:05:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/4136826190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 0x7f98d414cae0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98c7fff700 1 -- 172.21.15.52:0/4136826190 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98d0011950 con 0x7f98d414a6f0 2020-02-11T16:05:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98db115700 1 -- 172.21.15.52:0/4136826190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 msgr2=0x7f98d414cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98db115700 1 --2- 172.21.15.52:0/4136826190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 0x7f98d414cae0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00088e0).stop 2020-02-11T16:05:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98db115700 1 -- 172.21.15.52:0/4136826190 shutdown_connections 2020-02-11T16:05:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98db115700 1 --2- 172.21.15.52:0/4136826190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98d414a6f0 0x7f98d414cae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98db115700 1 -- 172.21.15.52:0/4136826190 >> 172.21.15.52:0/4136826190 conn(0x7f98d40a9fb0 msgr2=0x7f98d40aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98db115700 1 -- 172.21.15.52:0/4136826190 shutdown_connections 2020-02-11T16:05:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.898+0000 7f98db115700 1 -- 172.21.15.52:0/4136826190 wait complete. 2020-02-11T16:05:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.899+0000 7f98db115700 1 Processor -- start 2020-02-11T16:05:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.899+0000 7f98db115700 1 -- start start 2020-02-11T16:05:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.900+0000 7f98db115700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f98d414a6f0 0x7f98d409b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.900+0000 7f98db115700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98d414cf40 0x7f98d414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.900+0000 7f98db115700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d4065a10 con 0x7f98d40a5b80 2020-02-11T16:05:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.900+0000 7f98db115700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d4065cb0 con 0x7f98d414a6f0 2020-02-11T16:05:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.900+0000 7f98db115700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d4065460 con 0x7f98d414cf40 2020-02-11T16:05:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.900+0000 7f98d96b2700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f98d40a5b80 0x7f98d412e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48048/0 (socket says 172.21.15.52:48048) 2020-02-11T16:05:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.900+0000 7f98d96b2700 1 -- 172.21.15.52:0/1773224303 learned_addr learned my addr 172.21.15.52:0/1773224303 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.900+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> v2:172.21.15.52:3300/0 conn(0x7f98d414a6f0 0x7f98d409b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.900+0000 7f98d9eb3700 1 --2- 172.21.15.52:0/1773224303 >> v2:172.21.15.88:3300/0 conn(0x7f98d414cf40 0x7f98d414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98c5ffb700 1 -- 172.21.15.52:0/1773224303 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625208575 0 0) 0x7f98d4065a10 con 0x7f98d40a5b80 2020-02-11T16:05:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98c5ffb700 1 -- 172.21.15.52:0/1773224303 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98b4003230 con 0x7f98d40a5b80 2020-02-11T16:05:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98d8eb1700 1 -- 172.21.15.52:0/1773224303 >> v2:172.21.15.88:3300/0 conn(0x7f98d414cf40 msgr2=0x7f98d414f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> v2:172.21.15.88:3300/0 conn(0x7f98d414cf40 0x7f98d414f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98d8eb1700 1 -- 172.21.15.52:0/1773224303 >> v1:172.21.15.52:6789/0 conn(0x7f98d40a5b80 legacy=0x7f98d412e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98d8eb1700 1 -- 172.21.15.52:0/1773224303 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d405b2b0 con 0x7f98d414a6f0 2020-02-11T16:05:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> v2:172.21.15.52:3300/0 conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> v2:172.21.15.52:3300/0 conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98c5ffb700 1 -- 172.21.15.52:0/1773224303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98d000f800 con 0x7f98d414a6f0 2020-02-11T16:05:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98c5ffb700 1 -- 172.21.15.52:0/1773224303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d0007150 con 0x7f98d414a6f0 2020-02-11T16:05:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.916 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98db115700 1 -- 172.21.15.52:0/1773224303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d405b440 con 0x7f98d414a6f0 2020-02-11T16:05:20.916 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98c5ffb700 1 -- 172.21.15.52:0/1773224303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98d0007530 con 0x7f98d414a6f0 2020-02-11T16:05:20.916 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.901+0000 7f98db115700 1 -- 172.21.15.52:0/1773224303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d412ec80 con 0x7f98d414a6f0 2020-02-11T16:05:20.916 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.902+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.916 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.902+0000 7f98c5ffb700 1 -- 172.21.15.52:0/1773224303 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f98d0005a60 con 0x7f98d414a6f0 2020-02-11T16:05:20.916 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.902+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.917 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.902+0000 7f98c5ffb700 1 -- 172.21.15.52:0/1773224303 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f98d0005cf0 con 0x7f98d414a6f0 2020-02-11T16:05:20.917 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.902+0000 7f98db115700 1 -- 172.21.15.52:0/1773224303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d4066070 con 0x7f98d414a6f0 2020-02-11T16:05:20.918 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.904+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.918 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.904+0000 7f98c5ffb700 1 -- 172.21.15.52:0/1773224303 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f98d000caf0 con 0x7f98d414a6f0 2020-02-11T16:05:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.945+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.945+0000 7f98c5ffb700 1 -- 172.21.15.52:0/1773224303 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7f98d000cc90 con 0x7f98d414a6f0 2020-02-11T16:05:20.999 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:20.997+0000 7f98db115700 1 -- 172.21.15.52:0/1773224303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0760ed1f-9e02-4585-a5f9-449338628583", "id": 1} v 0) v1 -- 0x7f98d4065860 con 0x7f98d414a6f0 2020-02-11T16:05:21.002 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.000+0000 7f98d8eb1700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.002 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.000+0000 7f98c5ffb700 1 -- 172.21.15.52:0/1773224303 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0760ed1f-9e02-4585-a5f9-449338628583", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f98d0006ae0 con 0x7f98d414a6f0 2020-02-11T16:05:21.002 INFO:teuthology.orchestra.run.smithi052.stdout:1 2020-02-11T16:05:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.001+0000 7f98db115700 1 -- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 msgr2=0x7f98d409b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.001+0000 7f98db115700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f98d0002f30 tx=0x7f98d00113a0).stop 2020-02-11T16:05:21.004 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.001+0000 7f98db115700 1 -- 172.21.15.52:0/1773224303 shutdown_connections 2020-02-11T16:05:21.004 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.001+0000 7f98db115700 1 --2- 172.21.15.52:0/1773224303 >> v2:172.21.15.88:3300/0 conn(0x7f98d414cf40 0x7f98d414f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.004 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.001+0000 7f98db115700 1 --2- 172.21.15.52:0/1773224303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98d414a6f0 0x7f98d409b0a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.004 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.001+0000 7f98db115700 1 -- 172.21.15.52:0/1773224303 >> 172.21.15.52:0/1773224303 conn(0x7f98d40a9fb0 msgr2=0x7f98d40a7330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:21.004 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.001+0000 7f98db115700 1 -- 172.21.15.52:0/1773224303 shutdown_connections 2020-02-11T16:05:21.004 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.001+0000 7f98db115700 1 -- 172.21.15.52:0/1773224303 wait complete. 2020-02-11T16:05:21.013 INFO:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new d6372c66-ded4-496f-bf0a-43938f97dd5e 2 2020-02-11T16:05:21.133 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.123+0000 7f1804db6700 1 Processor -- start 2020-02-11T16:05:21.133 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.123+0000 7f1804db6700 1 -- start start 2020-02-11T16:05:21.133 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.123+0000 7f1804db6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f180014a6f0 0x7f180014cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:21.133 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.123+0000 7f1804db6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f180014cf40 0x7f180014f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:21.133 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.123+0000 7f1804db6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000a4420 con 0x7f18000a5b80 2020-02-11T16:05:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.123+0000 7f1804db6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000a2d00 con 0x7f180014a6f0 2020-02-11T16:05:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.123+0000 7f1804db6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000a6600 con 0x7f180014cf40 2020-02-11T16:05:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f180014a6f0 0x7f180014cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f180014a6f0 0x7f180014cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39648/0 (socket says 172.21.15.52:39648) 2020-02-11T16:05:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 -- 172.21.15.52:0/1279473883 learned_addr learned my addr 172.21.15.52:0/1279473883 (peer_addr_for_me v2:172.21.15.52:0/0) 2020-02-11T16:05:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fed9d700 1 --1- 172.21.15.52:0/1279473883 >> v1:172.21.15.52:6789/0 conn(0x7f18000a5b80 0x7f18000a3130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48072/0 (socket says 172.21.15.52:48072) 2020-02-11T16:05:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17ff59e700 1 --2- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f180014cf40 0x7f180014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 -- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f180014cf40 msgr2=0x7f180014f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 --2- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f180014cf40 0x7f180014f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 -- 172.21.15.52:0/1279473883 >> v1:172.21.15.52:6789/0 conn(0x7f18000a5b80 legacy=0x7f18000a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 -- 172.21.15.52:0/1279473883 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000a15a0 con 0x7f180014a6f0 2020-02-11T16:05:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fdd9b700 1 -- 172.21.15.52:0/1279473883 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439570281 0 0) 0x7f18000a4420 con 0x7f18000a5b80 2020-02-11T16:05:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17ff59e700 1 --2- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f180014cf40 0x7f180014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 --2- 172.21.15.52:0/1279473883 >> v2:172.21.15.52:3300/0 conn(0x7f180014a6f0 0x7f180014cae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17e8002f30 tx=0x7f17e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 --2- 172.21.15.52:0/1279473883 >> v2:172.21.15.52:3300/0 conn(0x7f180014a6f0 0x7f180014cae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17e8002f30 tx=0x7f17e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 --2- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f180014a6f0 0x7f180014cae0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f17e8002f30 tx=0x7f17e80088e0).ready entity=mon.0 client_cookie=9cbc070a85f6d4d9 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 --2- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f180014a6f0 0x7f180014cae0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f17e8002f30 tx=0x7f17e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fdd9b700 1 -- 172.21.15.52:0/1279473883 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e80116b0 con 0x7f180014a6f0 2020-02-11T16:05:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 --2- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f180014a6f0 0x7f180014cae0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f17e8002f30 tx=0x7f17e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fe59c700 1 --2- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f180014a6f0 0x7f180014cae0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f17e8002f30 tx=0x7f17e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fdd9b700 1 -- 172.21.15.52:0/1279473883 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8011810 con 0x7f180014a6f0 2020-02-11T16:05:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f17fdd9b700 1 -- 172.21.15.52:0/1279473883 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e8011bb0 con 0x7f180014a6f0 2020-02-11T16:05:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f1804db6700 1 -- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f180014a6f0 msgr2=0x7f180014cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.124+0000 7f1804db6700 1 --2- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f180014a6f0 0x7f180014cae0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f17e8002f30 tx=0x7f17e80088e0).stop 2020-02-11T16:05:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.125+0000 7f1804db6700 1 -- 172.21.15.52:0/1279473883 shutdown_connections 2020-02-11T16:05:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.125+0000 7f1804db6700 1 --2- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f180014cf40 0x7f180014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.125+0000 7f1804db6700 1 --2- 172.21.15.52:0/1279473883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f180014a6f0 0x7f180014cae0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.138 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.125+0000 7f1804db6700 1 -- 172.21.15.52:0/1279473883 >> 172.21.15.52:0/1279473883 conn(0x7f18000a9fb0 msgr2=0x7f18000aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:21.138 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.125+0000 7f1804db6700 1 -- 172.21.15.52:0/1279473883 shutdown_connections 2020-02-11T16:05:21.138 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.125+0000 7f1804db6700 1 -- 172.21.15.52:0/1279473883 wait complete. 2020-02-11T16:05:21.138 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.126+0000 7f1804db6700 1 Processor -- start 2020-02-11T16:05:21.138 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.126+0000 7f1804db6700 1 -- start start 2020-02-11T16:05:21.138 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.126+0000 7f1804db6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:21.138 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.126+0000 7f1804db6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1800067160 con 0x7f180014a6f0 2020-02-11T16:05:21.139 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.126+0000 7f1804db6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1800066a20 con 0x7f180014cf40 2020-02-11T16:05:21.139 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.126+0000 7f1804db6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180009ff70 con 0x7f18000a5b80 2020-02-11T16:05:21.139 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.126+0000 7f17fed9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.139 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fe59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f180014a6f0 0x7f180009ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48078/0 (socket says 172.21.15.52:48078) 2020-02-11T16:05:21.157 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fe59c700 1 -- 172.21.15.52:0/2824172911 learned_addr learned my addr 172.21.15.52:0/2824172911 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:21.157 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17f77fe700 1 -- 172.21.15.52:0/2824172911 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657691503 0 0) 0x7f1800067160 con 0x7f180014a6f0 2020-02-11T16:05:21.157 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17f77fe700 1 -- 172.21.15.52:0/2824172911 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17e4003230 con 0x7f180014a6f0 2020-02-11T16:05:21.157 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fed9d700 1 -- 172.21.15.52:0/2824172911 >> v1:172.21.15.88:6789/0 conn(0x7f180014cf40 legacy=0x7f180007e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.157 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fed9d700 1 -- 172.21.15.52:0/2824172911 >> v1:172.21.15.52:6789/0 conn(0x7f180014a6f0 legacy=0x7f180009ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.158 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fed9d700 1 -- 172.21.15.52:0/2824172911 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1800066cc0 con 0x7f18000a5b80 2020-02-11T16:05:21.158 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fed9d700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.158 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fed9d700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.158 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fed9d700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:21.159 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fed9d700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.159 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17f77fe700 1 -- 172.21.15.52:0/2824172911 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17f800ca10 con 0x7f18000a5b80 2020-02-11T16:05:21.159 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fed9d700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.159 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fed9d700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.159 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17f77fe700 1 -- 172.21.15.52:0/2824172911 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f800cb70 con 0x7f18000a5b80 2020-02-11T16:05:21.159 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f1804db6700 1 -- 172.21.15.52:0/2824172911 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180009e4d0 con 0x7f18000a5b80 2020-02-11T16:05:21.159 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17f77fe700 1 -- 172.21.15.52:0/2824172911 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17f800d0c0 con 0x7f18000a5b80 2020-02-11T16:05:21.160 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f1804db6700 1 -- 172.21.15.52:0/2824172911 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180009ee00 con 0x7f18000a5b80 2020-02-11T16:05:21.160 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.127+0000 7f17fed9d700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.160 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.128+0000 7f17f77fe700 1 -- 172.21.15.52:0/2824172911 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7f17f80054b0 con 0x7f18000a5b80 2020-02-11T16:05:21.160 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.128+0000 7f17fed9d700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.160 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.128+0000 7f17f77fe700 1 -- 172.21.15.52:0/2824172911 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f17f80284c0 con 0x7f18000a5b80 2020-02-11T16:05:21.160 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.128+0000 7f1804db6700 1 -- 172.21.15.52:0/2824172911 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1800066830 con 0x7f18000a5b80 2020-02-11T16:05:21.160 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.130+0000 7f17fed9d700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.161 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.130+0000 7f17f77fe700 1 -- 172.21.15.52:0/2824172911 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f17f8005740 con 0x7f18000a5b80 2020-02-11T16:05:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.218+0000 7f1804db6700 1 -- 172.21.15.52:0/2824172911 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d6372c66-ded4-496f-bf0a-43938f97dd5e", "id": 2} v 0) v1 -- 0x7f1800066e50 con 0x7f18000a5b80 2020-02-11T16:05:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.221+0000 7f17fed9d700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.221+0000 7f17f77fe700 1 -- 172.21.15.52:0/2824172911 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6372c66-ded4-496f-bf0a-43938f97dd5e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f17f8010f00 con 0x7f18000a5b80 2020-02-11T16:05:21.223 INFO:teuthology.orchestra.run.smithi052.stdout:2 2020-02-11T16:05:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.222+0000 7f1804db6700 1 -- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 msgr2=0x7f18000a0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.222+0000 7f1804db6700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f17f8001230 tx=0x7f18000684d0).stop 2020-02-11T16:05:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.222+0000 7f1804db6700 1 -- 172.21.15.52:0/2824172911 shutdown_connections 2020-02-11T16:05:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.222+0000 7f1804db6700 1 --2- 172.21.15.52:0/2824172911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18000a5b80 0x7f18000a0c60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.222+0000 7f1804db6700 1 -- 172.21.15.52:0/2824172911 >> 172.21.15.52:0/2824172911 conn(0x7f18000a9fb0 msgr2=0x7f1800069da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.222+0000 7f1804db6700 1 -- 172.21.15.52:0/2824172911 shutdown_connections 2020-02-11T16:05:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.222+0000 7f1804db6700 1 -- 172.21.15.52:0/2824172911 wait complete. 2020-02-11T16:05:21.234 INFO:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new b686c004-a479-4f21-8ec2-3874704bab42 3 2020-02-11T16:05:21.349 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.343+0000 7fdecb464700 1 Processor -- start 2020-02-11T16:05:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.344+0000 7fdecb464700 1 -- start start 2020-02-11T16:05:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.344+0000 7fdecb464700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdec40a5b80 0x7fdec40a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.344+0000 7fdecb464700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 0x7fdec405b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.344+0000 7fdecb464700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec40a4420 con 0x7fdec40a3590 2020-02-11T16:05:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.344+0000 7fdecb464700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec40a2d00 con 0x7fdec40a5b80 2020-02-11T16:05:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.344+0000 7fdecb464700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40a6600 con 0x7fdec405ace0 2020-02-11T16:05:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdec9200700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdec40a3590 0x7fdec405a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48082/0 (socket says 172.21.15.52:48082) 2020-02-11T16:05:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdec9200700 1 -- 172.21.15.52:0/2953918161 learned_addr learned my addr 172.21.15.52:0/2953918161 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdec9a01700 1 --2- 172.21.15.52:0/2953918161 >> v2:172.21.15.52:3300/0 conn(0x7fdec40a5b80 0x7fdec40a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 --2- 172.21.15.52:0/2953918161 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 0x7fdec405b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdec89ff700 1 -- 172.21.15.52:0/2953918161 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894546623 0 0) 0x7fdec40a4420 con 0x7fdec40a3590 2020-02-11T16:05:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdec89ff700 1 -- 172.21.15.52:0/2953918161 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeac003230 con 0x7fdec40a3590 2020-02-11T16:05:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 -- 172.21.15.52:0/2953918161 >> v2:172.21.15.52:3300/0 conn(0x7fdec40a5b80 msgr2=0x7fdec40a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 --2- 172.21.15.52:0/2953918161 >> v2:172.21.15.52:3300/0 conn(0x7fdec40a5b80 0x7fdec40a3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 -- 172.21.15.52:0/2953918161 >> v1:172.21.15.52:6789/0 conn(0x7fdec40a3590 legacy=0x7fdec405a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 -- 172.21.15.52:0/2953918161 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40a15a0 con 0x7fdec405ace0 2020-02-11T16:05:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdec9a01700 1 --2- 172.21.15.52:0/2953918161 >> v2:172.21.15.52:3300/0 conn(0x7fdec40a5b80 0x7fdec40a3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 --2- 172.21.15.52:0/2953918161 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 0x7fdec405b170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdebc0032b0 tx=0x7fdebc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 --2- 172.21.15.52:0/2953918161 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 0x7fdec405b170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdebc0032b0 tx=0x7fdebc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 --2- 172.21.15.52:0/2953918161 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 0x7fdec405b170 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fdebc0032b0 tx=0x7fdebc008c60).ready entity=mon.2 client_cookie=2651e889fdac807f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 --2- 172.21.15.52:0/2953918161 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 0x7fdec405b170 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fdebc0032b0 tx=0x7fdebc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdec89ff700 1 -- 172.21.15.52:0/2953918161 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc011db0 con 0x7fdec405ace0 2020-02-11T16:05:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 --2- 172.21.15.52:0/2953918161 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 0x7fdec405b170 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fdebc0032b0 tx=0x7fdebc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdeca202700 1 --2- 172.21.15.52:0/2953918161 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 0x7fdec405b170 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fdebc0032b0 tx=0x7fdebc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdec89ff700 1 -- 172.21.15.52:0/2953918161 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc00a160 con 0x7fdec405ace0 2020-02-11T16:05:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdec89ff700 1 -- 172.21.15.52:0/2953918161 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc00a540 con 0x7fdec405ace0 2020-02-11T16:05:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdecb464700 1 -- 172.21.15.52:0/2953918161 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 msgr2=0x7fdec405b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.345+0000 7fdecb464700 1 --2- 172.21.15.52:0/2953918161 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 0x7fdec405b170 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fdebc0032b0 tx=0x7fdebc008c60).stop 2020-02-11T16:05:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.346+0000 7fdecb464700 1 -- 172.21.15.52:0/2953918161 shutdown_connections 2020-02-11T16:05:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.346+0000 7fdecb464700 1 --2- 172.21.15.52:0/2953918161 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec405ace0 0x7fdec405b170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.346+0000 7fdecb464700 1 --2- 172.21.15.52:0/2953918161 >> v2:172.21.15.52:3300/0 conn(0x7fdec40a5b80 0x7fdec40a3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.346+0000 7fdecb464700 1 -- 172.21.15.52:0/2953918161 >> 172.21.15.52:0/2953918161 conn(0x7fdec40a9fb0 msgr2=0x7fdec40aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.346+0000 7fdecb464700 1 -- 172.21.15.52:0/2953918161 shutdown_connections 2020-02-11T16:05:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.346+0000 7fdecb464700 1 -- 172.21.15.52:0/2953918161 wait complete. 2020-02-11T16:05:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.347+0000 7fdecb464700 1 Processor -- start 2020-02-11T16:05:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.347+0000 7fdecb464700 1 -- start start 2020-02-11T16:05:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdecb464700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdecb464700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec4125130 con 0x7fdec405ace0 2020-02-11T16:05:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdecb464700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec407f1f0 con 0x7fdec40a5b80 2020-02-11T16:05:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdecb464700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4126b50 con 0x7fdec40a3590 2020-02-11T16:05:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9200700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9a01700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdec405ace0 0x7fdec407e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48088/0 (socket says 172.21.15.52:48088) 2020-02-11T16:05:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9a01700 1 -- 172.21.15.52:0/957960684 learned_addr learned my addr 172.21.15.52:0/957960684 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec27fc700 1 -- 172.21.15.52:0/957960684 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963165811 0 0) 0x7fdec4125130 con 0x7fdec405ace0 2020-02-11T16:05:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec27fc700 1 -- 172.21.15.52:0/957960684 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdea4003230 con 0x7fdec405ace0 2020-02-11T16:05:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9200700 1 -- 172.21.15.52:0/957960684 >> v1:172.21.15.88:6789/0 conn(0x7fdec40a5b80 legacy=0x7fdec413e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9200700 1 -- 172.21.15.52:0/957960684 >> v1:172.21.15.52:6789/0 conn(0x7fdec405ace0 legacy=0x7fdec407e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9200700 1 -- 172.21.15.52:0/957960684 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4125360 con 0x7fdec40a3590 2020-02-11T16:05:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9200700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9200700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9200700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9200700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec27fc700 1 -- 172.21.15.52:0/957960684 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb8005cc0 con 0x7fdec40a3590 2020-02-11T16:05:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9200700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec9200700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec27fc700 1 -- 172.21.15.52:0/957960684 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8005e20 con 0x7fdec40a3590 2020-02-11T16:05:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdecb464700 1 -- 172.21.15.52:0/957960684 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec40a30c0 con 0x7fdec40a3590 2020-02-11T16:05:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.348+0000 7fdec27fc700 1 -- 172.21.15.52:0/957960684 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb80062b0 con 0x7fdec40a3590 2020-02-11T16:05:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.349+0000 7fdecb464700 1 -- 172.21.15.52:0/957960684 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec41266b0 con 0x7fdec40a3590 2020-02-11T16:05:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.349+0000 7fdec9200700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.349+0000 7fdec27fc700 1 -- 172.21.15.52:0/957960684 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7fdeb8006570 con 0x7fdec40a3590 2020-02-11T16:05:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.349+0000 7fdec9200700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.349+0000 7fdec27fc700 1 -- 172.21.15.52:0/957960684 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fdeb8028a70 con 0x7fdec40a3590 2020-02-11T16:05:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.350+0000 7fdecb464700 1 -- 172.21.15.52:0/957960684 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec41269b0 con 0x7fdec40a3590 2020-02-11T16:05:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.352+0000 7fdec9200700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.352+0000 7fdec27fc700 1 -- 172.21.15.52:0/957960684 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7fdec41269b0 con 0x7fdec40a3590 2020-02-11T16:05:21.442 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.440+0000 7fdecb464700 1 -- 172.21.15.52:0/957960684 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b686c004-a479-4f21-8ec2-3874704bab42", "id": 3} v 0) v1 -- 0x7fdec41269b0 con 0x7fdec40a3590 2020-02-11T16:05:21.445 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.443+0000 7fdec9200700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.445 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.443+0000 7fdec27fc700 1 -- 172.21.15.52:0/957960684 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b686c004-a479-4f21-8ec2-3874704bab42", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdec41269b0 con 0x7fdec40a3590 2020-02-11T16:05:21.445 INFO:teuthology.orchestra.run.smithi052.stdout:3 2020-02-11T16:05:21.446 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.444+0000 7fdecb464700 1 -- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 msgr2=0x7fdec4125800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.446 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.444+0000 7fdecb464700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fdeb80010d0 tx=0x7fdeb80108f0).stop 2020-02-11T16:05:21.446 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.444+0000 7fdecb464700 1 -- 172.21.15.52:0/957960684 shutdown_connections 2020-02-11T16:05:21.447 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.444+0000 7fdecb464700 1 --2- 172.21.15.52:0/957960684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec40a3590 0x7fdec4125800 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.447 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.444+0000 7fdecb464700 1 -- 172.21.15.52:0/957960684 >> 172.21.15.52:0/957960684 conn(0x7fdec40a9fb0 msgr2=0x7fdec4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:21.447 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.444+0000 7fdecb464700 1 -- 172.21.15.52:0/957960684 shutdown_connections 2020-02-11T16:05:21.447 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.444+0000 7fdecb464700 1 -- 172.21.15.52:0/957960684 wait complete. 2020-02-11T16:05:21.456 INFO:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 8308f9a9-ae7c-4f12-aa90-a62f92b2fedc 4 2020-02-11T16:05:21.571 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.565+0000 7f1750578700 1 Processor -- start 2020-02-11T16:05:21.571 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.565+0000 7f1750578700 1 -- start start 2020-02-11T16:05:21.571 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.566+0000 7f1750578700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17480a5b80 0x7f17480a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:21.571 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.566+0000 7f1750578700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17480a3590 0x7f174805a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:21.572 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.566+0000 7f1750578700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17480a4420 con 0x7f174805aa30 2020-02-11T16:05:21.572 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.566+0000 7f1750578700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17480a2d00 con 0x7f17480a5b80 2020-02-11T16:05:21.572 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.566+0000 7f1750578700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17480a6600 con 0x7f17480a3590 2020-02-11T16:05:21.572 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.566+0000 7f174eb15700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17480a5b80 0x7f17480a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.572 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.566+0000 7f174f316700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f174805aa30 0x7f174805aec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48098/0 (socket says 172.21.15.52:48098) 2020-02-11T16:05:21.572 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.566+0000 7f174f316700 1 -- 172.21.15.52:0/2226990243 learned_addr learned my addr 172.21.15.52:0/2226990243 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:21.573 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.566+0000 7f174e314700 1 --2- 172.21.15.52:0/2226990243 >> v2:172.21.15.88:3300/0 conn(0x7f17480a3590 0x7f174805a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.573 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174eb15700 1 -- 172.21.15.52:0/2226990243 >> v2:172.21.15.88:3300/0 conn(0x7f17480a3590 msgr2=0x7f174805a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:21.573 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174eb15700 1 --2- 172.21.15.52:0/2226990243 >> v2:172.21.15.88:3300/0 conn(0x7f17480a3590 0x7f174805a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:21.573 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174eb15700 1 -- 172.21.15.52:0/2226990243 >> v1:172.21.15.52:6789/0 conn(0x7f174805aa30 legacy=0x7f174805aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.573 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174eb15700 1 -- 172.21.15.52:0/2226990243 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17480a15a0 con 0x7f17480a5b80 2020-02-11T16:05:21.573 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174db13700 1 -- 172.21.15.52:0/2226990243 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453734687 0 0) 0x7f17480a4420 con 0x7f174805aa30 2020-02-11T16:05:21.573 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174eb15700 1 --2- 172.21.15.52:0/2226990243 >> v2:172.21.15.52:3300/0 conn(0x7f17480a5b80 0x7f17480a3130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1744002f30 tx=0x7f17480684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.574 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174eb15700 1 --2- 172.21.15.52:0/2226990243 >> v2:172.21.15.52:3300/0 conn(0x7f17480a5b80 0x7f17480a3130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1744002f30 tx=0x7f17480684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.574 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174eb15700 1 --2- 172.21.15.52:0/2226990243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17480a5b80 0x7f17480a3130 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f17480684d0).ready entity=mon.0 client_cookie=60777c67073455f8 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:21.574 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174eb15700 1 --2- 172.21.15.52:0/2226990243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17480a5b80 0x7f17480a3130 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f17480684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.574 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174db13700 1 -- 172.21.15.52:0/2226990243 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17440113c0 con 0x7f17480a5b80 2020-02-11T16:05:21.574 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174eb15700 1 --2- 172.21.15.52:0/2226990243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17480a5b80 0x7f17480a3130 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f17480684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.574 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174db13700 1 -- 172.21.15.52:0/2226990243 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1744011520 con 0x7f17480a5b80 2020-02-11T16:05:21.574 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174eb15700 1 --2- 172.21.15.52:0/2226990243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17480a5b80 0x7f17480a3130 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f17480684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.575 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f174db13700 1 -- 172.21.15.52:0/2226990243 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17440118c0 con 0x7f17480a5b80 2020-02-11T16:05:21.575 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f1750578700 1 -- 172.21.15.52:0/2226990243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17480a5b80 msgr2=0x7f17480a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.576 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f1750578700 1 --2- 172.21.15.52:0/2226990243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17480a5b80 0x7f17480a3130 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f17480684d0).stop 2020-02-11T16:05:21.576 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f1750578700 1 -- 172.21.15.52:0/2226990243 shutdown_connections 2020-02-11T16:05:21.576 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f1750578700 1 --2- 172.21.15.52:0/2226990243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17480a5b80 0x7f17480a3130 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.576 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f1750578700 1 --2- 172.21.15.52:0/2226990243 >> v2:172.21.15.88:3300/0 conn(0x7f17480a3590 0x7f174805a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:21.577 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f1750578700 1 -- 172.21.15.52:0/2226990243 >> 172.21.15.52:0/2226990243 conn(0x7f17480a9fb0 msgr2=0x7f17480aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:21.577 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.567+0000 7f1750578700 1 -- 172.21.15.52:0/2226990243 shutdown_connections 2020-02-11T16:05:21.577 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.568+0000 7f1750578700 1 -- 172.21.15.52:0/2226990243 wait complete. 2020-02-11T16:05:21.577 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f1750578700 1 Processor -- start 2020-02-11T16:05:21.577 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f1750578700 1 -- start start 2020-02-11T16:05:21.580 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f1750578700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17480a3590 0x7f1748066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:21.581 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f1750578700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17480a5b80 0x7f1748131de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:21.581 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f1750578700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1748064980 con 0x7f174805aa30 2020-02-11T16:05:21.581 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f1750578700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1748064c20 con 0x7f17480a3590 2020-02-11T16:05:21.582 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f1750578700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1748064ec0 con 0x7f17480a5b80 2020-02-11T16:05:21.582 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f174eb15700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f174805aa30 0x7f174807e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48100/0 (socket says 172.21.15.52:48100) 2020-02-11T16:05:21.582 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f174eb15700 1 -- 172.21.15.52:0/1617335462 learned_addr learned my addr 172.21.15.52:0/1617335462 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:21.582 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f174f316700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17480a5b80 0x7f1748131de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.583 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> v2:172.21.15.88:3300/0 conn(0x7f17480a3590 0x7f1748066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.583 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f173f7fe700 1 -- 172.21.15.52:0/1617335462 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85239243 0 0) 0x7f1748064980 con 0x7f174805aa30 2020-02-11T16:05:21.583 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.569+0000 7f173f7fe700 1 -- 172.21.15.52:0/1617335462 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1730003230 con 0x7f174805aa30 2020-02-11T16:05:21.583 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 -- 172.21.15.52:0/1617335462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17480a5b80 msgr2=0x7f1748131de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.583 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17480a5b80 0x7f1748131de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.590 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 -- 172.21.15.52:0/1617335462 >> v1:172.21.15.52:6789/0 conn(0x7f174805aa30 legacy=0x7f174807e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.590 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 -- 172.21.15.52:0/1617335462 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748065160 con 0x7f17480a3590 2020-02-11T16:05:21.590 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174f316700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17480a5b80 0x7f1748131de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:21.590 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> v2:172.21.15.88:3300/0 conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.591 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> v2:172.21.15.88:3300/0 conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.591 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:21.591 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.591 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f173f7fe700 1 -- 172.21.15.52:0/1617335462 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1738007340 con 0x7f17480a3590 2020-02-11T16:05:21.592 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f173f7fe700 1 -- 172.21.15.52:0/1617335462 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17380074a0 con 0x7f17480a3590 2020-02-11T16:05:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f1750578700 1 -- 172.21.15.52:0/1617335462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17480a0e60 con 0x7f17480a3590 2020-02-11T16:05:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f173f7fe700 1 -- 172.21.15.52:0/1617335462 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17380058b0 con 0x7f17480a3590 2020-02-11T16:05:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f1750578700 1 -- 172.21.15.52:0/1617335462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174807ec80 con 0x7f17480a3590 2020-02-11T16:05:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.570+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.571+0000 7f173f7fe700 1 -- 172.21.15.52:0/1617335462 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7f1738005b30 con 0x7f17480a3590 2020-02-11T16:05:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.571+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.571+0000 7f173f7fe700 1 -- 172.21.15.52:0/1617335462 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f173800d0c0 con 0x7f17480a3590 2020-02-11T16:05:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.571+0000 7f1750578700 1 -- 172.21.15.52:0/1617335462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17480565b0 con 0x7f17480a3590 2020-02-11T16:05:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.573+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.573+0000 7f173f7fe700 1 -- 172.21.15.52:0/1617335462 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f17380125b0 con 0x7f17480a3590 2020-02-11T16:05:21.665 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.663+0000 7f1750578700 1 -- 172.21.15.52:0/1617335462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8308f9a9-ae7c-4f12-aa90-a62f92b2fedc", "id": 4} v 0) v1 -- 0x7f174805e2f0 con 0x7f17480a3590 2020-02-11T16:05:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.666+0000 7f174e314700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.666+0000 7f173f7fe700 1 -- 172.21.15.52:0/1617335462 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8308f9a9-ae7c-4f12-aa90-a62f92b2fedc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1738006680 con 0x7f17480a3590 2020-02-11T16:05:21.668 INFO:teuthology.orchestra.run.smithi052.stdout:4 2020-02-11T16:05:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.667+0000 7f1750578700 1 -- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 msgr2=0x7f1748066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.667+0000 7f1750578700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 0x7f1748066170 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738010bd0).stop 2020-02-11T16:05:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.667+0000 7f1750578700 1 -- 172.21.15.52:0/1617335462 shutdown_connections 2020-02-11T16:05:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.667+0000 7f1750578700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17480a5b80 0x7f1748131de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.667+0000 7f1750578700 1 --2- 172.21.15.52:0/1617335462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17480a3590 0x7f1748066170 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.667+0000 7f1750578700 1 -- 172.21.15.52:0/1617335462 >> 172.21.15.52:0/1617335462 conn(0x7f17480a9fb0 msgr2=0x7f17480a6800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.667+0000 7f1750578700 1 -- 172.21.15.52:0/1617335462 shutdown_connections 2020-02-11T16:05:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.667+0000 7f1750578700 1 -- 172.21.15.52:0/1617335462 wait complete. 2020-02-11T16:05:21.679 INFO:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new fe73c4ac-93b9-4066-adc8-3b13e4a67261 5 2020-02-11T16:05:21.793 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.788+0000 7fb90ecec700 1 Processor -- start 2020-02-11T16:05:21.794 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.788+0000 7fb90ecec700 1 -- start start 2020-02-11T16:05:21.794 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90ecec700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 0x7fb9080a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:21.794 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90ecec700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb90805ace0 0x7fb90805b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:21.794 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90ecec700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9080a4420 con 0x7fb9080a3590 2020-02-11T16:05:21.794 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90ecec700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9080a2d00 con 0x7fb90805ace0 2020-02-11T16:05:21.794 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90ecec700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080a6600 con 0x7fb9080a5b80 2020-02-11T16:05:21.795 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90d289700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 0x7fb9080a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.795 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90ca88700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb9080a3590 0x7fb90805a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48108/0 (socket says 172.21.15.52:48108) 2020-02-11T16:05:21.795 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90ca88700 1 -- 172.21.15.52:0/3122229100 learned_addr learned my addr 172.21.15.52:0/3122229100 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:21.795 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90da8a700 1 --2- 172.21.15.52:0/3122229100 >> v2:172.21.15.88:3300/0 conn(0x7fb90805ace0 0x7fb90805b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.795 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb8fffff700 1 -- 172.21.15.52:0/3122229100 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388593057 0 0) 0x7fb9080a4420 con 0x7fb9080a3590 2020-02-11T16:05:21.795 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb8fffff700 1 -- 172.21.15.52:0/3122229100 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f4003230 con 0x7fb9080a3590 2020-02-11T16:05:21.795 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90d289700 1 -- 172.21.15.52:0/3122229100 >> v2:172.21.15.88:3300/0 conn(0x7fb90805ace0 msgr2=0x7fb90805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:21.796 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90d289700 1 --2- 172.21.15.52:0/3122229100 >> v2:172.21.15.88:3300/0 conn(0x7fb90805ace0 0x7fb90805b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:21.796 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90d289700 1 -- 172.21.15.52:0/3122229100 >> v1:172.21.15.52:6789/0 conn(0x7fb9080a3590 legacy=0x7fb90805a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.796 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90d289700 1 -- 172.21.15.52:0/3122229100 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9080a15a0 con 0x7fb9080a5b80 2020-02-11T16:05:21.796 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90d289700 1 --2- 172.21.15.52:0/3122229100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 0x7fb9080a3130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb904002f30 tx=0x7fb9080684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.796 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90d289700 1 --2- 172.21.15.52:0/3122229100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 0x7fb9080a3130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb904002f30 tx=0x7fb9080684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.796 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90d289700 1 --2- 172.21.15.52:0/3122229100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 0x7fb9080a3130 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fb904002f30 tx=0x7fb9080684d0).ready entity=mon.2 client_cookie=204f4888e9097565 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:21.796 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb90d289700 1 --2- 172.21.15.52:0/3122229100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 0x7fb9080a3130 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fb904002f30 tx=0x7fb9080684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.798 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.789+0000 7fb8fffff700 1 -- 172.21.15.52:0/3122229100 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb904008e40 con 0x7fb9080a5b80 2020-02-11T16:05:21.798 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb90d289700 1 --2- 172.21.15.52:0/3122229100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 0x7fb9080a3130 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fb904002f30 tx=0x7fb9080684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.798 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb8fffff700 1 -- 172.21.15.52:0/3122229100 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904011500 con 0x7fb9080a5b80 2020-02-11T16:05:21.799 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb90d289700 1 --2- 172.21.15.52:0/3122229100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 0x7fb9080a3130 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fb904002f30 tx=0x7fb9080684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.799 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb90ecec700 1 -- 172.21.15.52:0/3122229100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 msgr2=0x7fb9080a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.799 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb8fffff700 1 -- 172.21.15.52:0/3122229100 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9040118e0 con 0x7fb9080a5b80 2020-02-11T16:05:21.799 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb90ecec700 1 --2- 172.21.15.52:0/3122229100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 0x7fb9080a3130 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fb904002f30 tx=0x7fb9080684d0).stop 2020-02-11T16:05:21.799 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb90ecec700 1 -- 172.21.15.52:0/3122229100 shutdown_connections 2020-02-11T16:05:21.800 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb90ecec700 1 --2- 172.21.15.52:0/3122229100 >> v2:172.21.15.88:3300/0 conn(0x7fb90805ace0 0x7fb90805b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:21.800 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb90ecec700 1 --2- 172.21.15.52:0/3122229100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9080a5b80 0x7fb9080a3130 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.800 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb90ecec700 1 -- 172.21.15.52:0/3122229100 >> 172.21.15.52:0/3122229100 conn(0x7fb9080a9fb0 msgr2=0x7fb9080aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:21.800 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb90ecec700 1 -- 172.21.15.52:0/3122229100 shutdown_connections 2020-02-11T16:05:21.800 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.790+0000 7fb90ecec700 1 -- 172.21.15.52:0/3122229100 wait complete. 2020-02-11T16:05:21.800 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.791+0000 7fb90ecec700 1 Processor -- start 2020-02-11T16:05:21.800 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.791+0000 7fb90ecec700 1 -- start start 2020-02-11T16:05:21.803 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90ecec700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9080a3590 0x7fb908064f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:21.803 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90ecec700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb908120fe0 con 0x7fb9080a5b80 2020-02-11T16:05:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90ecec700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb908121280 con 0x7fb90805ace0 2020-02-11T16:05:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90ecec700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb908121520 con 0x7fb9080a3590 2020-02-11T16:05:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90ca88700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9080a3590 0x7fb908064f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90da8a700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb9080a5b80 0x7fb90813c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48116/0 (socket says 172.21.15.52:48116) 2020-02-11T16:05:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90da8a700 1 -- 172.21.15.52:0/3877051205 learned_addr learned my addr 172.21.15.52:0/3877051205 (peer_addr_for_me v1:172.21.15.52:0/0) 2020-02-11T16:05:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb8fdffb700 1 -- 172.21.15.52:0/3877051205 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954329933 0 0) 0x7fb908120fe0 con 0x7fb9080a5b80 2020-02-11T16:05:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90ca88700 1 -- 172.21.15.52:0/3877051205 >> v1:172.21.15.88:6789/0 conn(0x7fb90805ace0 legacy=0x7fb90807e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90ca88700 1 -- 172.21.15.52:0/3877051205 >> v1:172.21.15.52:6789/0 conn(0x7fb9080a5b80 legacy=0x7fb90813c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90ca88700 1 -- 172.21.15.52:0/3877051205 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9081217c0 con 0x7fb9080a3590 2020-02-11T16:05:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.792+0000 7fb90ca88700 1 --2- 172.21.15.52:0/3877051205 >> v2:172.21.15.52:3300/0 conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb90ca88700 1 --2- 172.21.15.52:0/3877051205 >> v2:172.21.15.52:3300/0 conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb90ca88700 1 --2- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:21.806 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb90ca88700 1 --2- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.806 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb8fdffb700 1 -- 172.21.15.52:0/3877051205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f8005db0 con 0x7fb9080a3590 2020-02-11T16:05:21.806 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb90ca88700 1 --2- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.806 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb90ca88700 1 --2- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.806 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb8fdffb700 1 -- 172.21.15.52:0/3877051205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f80060c0 con 0x7fb9080a3590 2020-02-11T16:05:21.806 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb90ecec700 1 -- 172.21.15.52:0/3877051205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9080641f0 con 0x7fb9080a3590 2020-02-11T16:05:21.806 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb8fdffb700 1 -- 172.21.15.52:0/3877051205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f80064a0 con 0x7fb9080a3590 2020-02-11T16:05:21.807 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb90ecec700 1 -- 172.21.15.52:0/3877051205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb908065ef0 con 0x7fb9080a3590 2020-02-11T16:05:21.807 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb90ca88700 1 --2- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.807 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb8fdffb700 1 -- 172.21.15.52:0/3877051205 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7fb8f8006710 con 0x7fb9080a3590 2020-02-11T16:05:21.807 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb90ca88700 1 --2- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.807 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.793+0000 7fb8fdffb700 1 -- 172.21.15.52:0/3877051205 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fb8f80289b0 con 0x7fb9080a3590 2020-02-11T16:05:21.808 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.794+0000 7fb90ecec700 1 -- 172.21.15.52:0/3877051205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9080565b0 con 0x7fb9080a3590 2020-02-11T16:05:21.808 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.796+0000 7fb90ca88700 1 --2- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.808 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.796+0000 7fb8fdffb700 1 -- 172.21.15.52:0/3877051205 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7fb8f80069a0 con 0x7fb9080a3590 2020-02-11T16:05:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.888+0000 7fb90ecec700 1 -- 172.21.15.52:0/3877051205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe73c4ac-93b9-4066-adc8-3b13e4a67261", "id": 5} v 0) v1 -- 0x7fb90805e2f0 con 0x7fb9080a3590 2020-02-11T16:05:21.902 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.891+0000 7fb90ca88700 1 --2- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:21.903 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.891+0000 7fb8fdffb700 1 -- 172.21.15.52:0/3877051205 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe73c4ac-93b9-4066-adc8-3b13e4a67261", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8f8011a30 con 0x7fb9080a3590 2020-02-11T16:05:21.903 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.892+0000 7fb90ecec700 1 -- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 msgr2=0x7fb908064f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:21.903 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.892+0000 7fb90ecec700 1 --2- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 0x7fb908064f70 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fb904007ed0 tx=0x7fb8f8010940).stop 2020-02-11T16:05:21.903 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.892+0000 7fb90ecec700 1 -- 172.21.15.52:0/3877051205 shutdown_connections 2020-02-11T16:05:21.904 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.892+0000 7fb90ecec700 1 --2- 172.21.15.52:0/3877051205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9080a3590 0x7fb908064f70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:21.904 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.892+0000 7fb90ecec700 1 -- 172.21.15.52:0/3877051205 >> 172.21.15.52:0/3877051205 conn(0x7fb9080a9fb0 msgr2=0x7fb908069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:21.904 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.892+0000 7fb90ecec700 1 -- 172.21.15.52:0/3877051205 shutdown_connections 2020-02-11T16:05:21.904 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:21.892+0000 7fb90ecec700 1 -- 172.21.15.52:0/3877051205 wait complete. 2020-02-11T16:05:21.905 INFO:teuthology.orchestra.run.smithi052.stdout:5 2020-02-11T16:05:21.918 INFO:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 418810c8-ca04-4604-8b83-b6570a75e62a 6 2020-02-11T16:05:22.042 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.029+0000 7f20590f2700 1 Processor -- start 2020-02-11T16:05:22.042 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.029+0000 7f20590f2700 1 -- start start 2020-02-11T16:05:22.042 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.029+0000 7f20590f2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 0x7f20540a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:22.043 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f20590f2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f205405ace0 0x7f205405b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:22.043 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f20590f2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20540a4420 con 0x7f20540a3590 2020-02-11T16:05:22.043 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f20590f2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20540a2d00 con 0x7f205405ace0 2020-02-11T16:05:22.043 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f20590f2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20540a6600 con 0x7f20540a5b80 2020-02-11T16:05:22.043 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f20588f1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f205405ace0 0x7f205405b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:22.044 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f20588f1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f205405ace0 0x7f205405b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39706/0 (socket says 172.21.15.52:39706) 2020-02-11T16:05:22.044 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f20588f1700 1 -- 172.21.15.52:0/129724200 learned_addr learned my addr 172.21.15.52:0/129724200 (peer_addr_for_me v2:172.21.15.52:0/0) 2020-02-11T16:05:22.044 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f2052d9d700 1 --1- 172.21.15.52:0/129724200 >> v1:172.21.15.52:6789/0 conn(0x7f20540a3590 0x7f205405a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48128/0 (socket says 172.21.15.52:48128) 2020-02-11T16:05:22.044 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 --2- 172.21.15.52:0/129724200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 0x7f20540a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:22.045 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 -- 172.21.15.52:0/129724200 >> v2:172.21.15.52:3300/0 conn(0x7f205405ace0 msgr2=0x7f205405b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:22.045 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 --2- 172.21.15.52:0/129724200 >> v2:172.21.15.52:3300/0 conn(0x7f205405ace0 0x7f205405b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:22.045 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 -- 172.21.15.52:0/129724200 >> v1:172.21.15.52:6789/0 conn(0x7f20540a3590 legacy=0x7f205405a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.045 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 -- 172.21.15.52:0/129724200 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540a15a0 con 0x7f20540a5b80 2020-02-11T16:05:22.046 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205259c700 1 -- 172.21.15.52:0/129724200 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20332603 0 0) 0x7f20540a4420 con 0x7f20540a3590 2020-02-11T16:05:22.046 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f20588f1700 1 --2- 172.21.15.52:0/129724200 >> v2:172.21.15.52:3300/0 conn(0x7f205405ace0 0x7f205405b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:22.046 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 --2- 172.21.15.52:0/129724200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 0x7f20540a3130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2044002f30 tx=0x7f20540684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.046 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 --2- 172.21.15.52:0/129724200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 0x7f20540a3130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2044002f30 tx=0x7f20540684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.046 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 --2- 172.21.15.52:0/129724200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 0x7f20540a3130 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f2044002f30 tx=0x7f20540684d0).ready entity=mon.2 client_cookie=7bd2cab828acca17 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:22.047 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 --2- 172.21.15.52:0/129724200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 0x7f20540a3130 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f2044002f30 tx=0x7f20540684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.047 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205259c700 1 -- 172.21.15.52:0/129724200 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2044008e40 con 0x7f20540a5b80 2020-02-11T16:05:22.047 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 --2- 172.21.15.52:0/129724200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 0x7f20540a3130 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f2044002f30 tx=0x7f20540684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.047 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205359e700 1 --2- 172.21.15.52:0/129724200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 0x7f20540a3130 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f2044002f30 tx=0x7f20540684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.048 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205259c700 1 -- 172.21.15.52:0/129724200 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20440115b0 con 0x7f20540a5b80 2020-02-11T16:05:22.048 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f205259c700 1 -- 172.21.15.52:0/129724200 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2044011950 con 0x7f20540a5b80 2020-02-11T16:05:22.048 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f20590f2700 1 -- 172.21.15.52:0/129724200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 msgr2=0x7f20540a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.048 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.030+0000 7f20590f2700 1 --2- 172.21.15.52:0/129724200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 0x7f20540a3130 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f2044002f30 tx=0x7f20540684d0).stop 2020-02-11T16:05:22.048 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.031+0000 7f20590f2700 1 -- 172.21.15.52:0/129724200 shutdown_connections 2020-02-11T16:05:22.049 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.031+0000 7f20590f2700 1 --2- 172.21.15.52:0/129724200 >> v2:172.21.15.52:3300/0 conn(0x7f205405ace0 0x7f205405b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:22.049 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.031+0000 7f20590f2700 1 --2- 172.21.15.52:0/129724200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20540a5b80 0x7f20540a3130 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:22.050 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.031+0000 7f20590f2700 1 -- 172.21.15.52:0/129724200 >> 172.21.15.52:0/129724200 conn(0x7f20540a9fb0 msgr2=0x7f20540aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:22.050 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.031+0000 7f20590f2700 1 -- 172.21.15.52:0/129724200 shutdown_connections 2020-02-11T16:05:22.051 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.031+0000 7f20590f2700 1 -- 172.21.15.52:0/129724200 wait complete. 2020-02-11T16:05:22.052 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.032+0000 7f20590f2700 1 Processor -- start 2020-02-11T16:05:22.052 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.032+0000 7f20590f2700 1 -- start start 2020-02-11T16:05:22.052 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f20590f2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20540a3590 0x7f205407e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:22.053 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f20590f2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205407f180 con 0x7f20540a5b80 2020-02-11T16:05:22.053 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f20590f2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2054135a90 con 0x7f205405ace0 2020-02-11T16:05:22.053 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f20590f2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2054135d30 con 0x7f20540a3590 2020-02-11T16:05:22.053 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20540a3590 0x7f205407e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:22.054 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20540a3590 0x7f205407e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39710/0 (socket says 172.21.15.52:39710) 2020-02-11T16:05:22.054 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f20588f1700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f20540a5b80 0x7f205407e790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48136/0 (socket says 172.21.15.52:48136) 2020-02-11T16:05:22.054 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 -- 172.21.15.52:0/342451313 learned_addr learned my addr 172.21.15.52:0/342451313 (peer_addr_for_me v2:172.21.15.52:0/0) 2020-02-11T16:05:22.054 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 -- 172.21.15.52:0/342451313 >> v1:172.21.15.88:6789/0 conn(0x7f205405ace0 legacy=0x7f20541332d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.054 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 -- 172.21.15.52:0/342451313 >> v1:172.21.15.52:6789/0 conn(0x7f20540a5b80 legacy=0x7f205407e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.055 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f204bfff700 1 -- 172.21.15.52:0/342451313 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546481028 0 0) 0x7f205407f180 con 0x7f20540a5b80 2020-02-11T16:05:22.055 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 -- 172.21.15.52:0/342451313 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054135fd0 con 0x7f20540a3590 2020-02-11T16:05:22.055 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 --2- 172.21.15.52:0/342451313 >> v2:172.21.15.52:3300/0 conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.055 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 --2- 172.21.15.52:0/342451313 >> v2:172.21.15.52:3300/0 conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.056 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:22.056 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.056 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f204bfff700 1 -- 172.21.15.52:0/342451313 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f204000c970 con 0x7f20540a3590 2020-02-11T16:05:22.056 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.057 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f204bfff700 1 -- 172.21.15.52:0/342451313 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204000cad0 con 0x7f20540a3590 2020-02-11T16:05:22.057 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f2052d9d700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.057 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f20590f2700 1 -- 172.21.15.52:0/342451313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2054135780 con 0x7f20540a3590 2020-02-11T16:05:22.057 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f204bfff700 1 -- 172.21.15.52:0/342451313 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20400044f0 con 0x7f20540a3590 2020-02-11T16:05:22.058 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.033+0000 7f20590f2700 1 -- 172.21.15.52:0/342451313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20540a8ae0 con 0x7f20540a3590 2020-02-11T16:05:22.058 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.034+0000 7f2052d9d700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.058 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.034+0000 7f2052d9d700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.058 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.034+0000 7f204bfff700 1 -- 172.21.15.52:0/342451313 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 3) v1 ==== 45077+0+0 (secure 0 0 0) 0x7f2040004770 con 0x7f20540a3590 2020-02-11T16:05:22.058 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.034+0000 7f20590f2700 1 -- 172.21.15.52:0/342451313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2054136160 con 0x7f20540a3590 2020-02-11T16:05:22.059 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.034+0000 7f204bfff700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2030039ad0 0x7f203003bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:22.059 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.035+0000 7f204bfff700 1 -- 172.21.15.52:0/342451313 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f2040049730 con 0x7f20540a3590 2020-02-11T16:05:22.059 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.035+0000 7f205359e700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2030039ad0 0x7f203003bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:22.059 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.035+0000 7f205359e700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2030039ad0 0x7f203003bf90 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:22.060 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.038+0000 7f2052d9d700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.060 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.038+0000 7f204bfff700 1 -- 172.21.15.52:0/342451313 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f204002ed70 con 0x7f20540a3590 2020-02-11T16:05:22.201 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.198+0000 7f20590f2700 1 -- 172.21.15.52:0/342451313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "418810c8-ca04-4604-8b83-b6570a75e62a", "id": 6} v 0) v1 -- 0x7f20540565b0 con 0x7f20540a3590 2020-02-11T16:05:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.201+0000 7f2052d9d700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.201+0000 7f204bfff700 1 -- 172.21.15.52:0/342451313 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "418810c8-ca04-4604-8b83-b6570a75e62a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2040031880 con 0x7f20540a3590 2020-02-11T16:05:22.203 INFO:teuthology.orchestra.run.smithi052.stdout:6 2020-02-11T16:05:22.205 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.202+0000 7f20590f2700 1 -- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2030039ad0 msgr2=0x7f203003bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.206 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.202+0000 7f20590f2700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2030039ad0 0x7f203003bf90 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:22.206 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.202+0000 7f20590f2700 1 -- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 msgr2=0x7f205407e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.206 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.202+0000 7f20590f2700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 0x7f205407e330 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f2040000b80 tx=0x7f2040001e30).stop 2020-02-11T16:05:22.206 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.202+0000 7f20590f2700 1 -- 172.21.15.52:0/342451313 shutdown_connections 2020-02-11T16:05:22.207 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.202+0000 7f20590f2700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2030039ad0 0x7f203003bf90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:22.207 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.202+0000 7f20590f2700 1 --2- 172.21.15.52:0/342451313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20540a3590 0x7f205407e330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:22.207 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.202+0000 7f20590f2700 1 -- 172.21.15.52:0/342451313 >> 172.21.15.52:0/342451313 conn(0x7f20540a9fb0 msgr2=0x7f2054069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:22.207 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.202+0000 7f20590f2700 1 -- 172.21.15.52:0/342451313 shutdown_connections 2020-02-11T16:05:22.208 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.202+0000 7f20590f2700 1 -- 172.21.15.52:0/342451313 wait complete. 2020-02-11T16:05:22.215 INFO:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 50e1714c-c39e-4dd2-bbad-d1fc70c4e304 7 2020-02-11T16:05:22.333 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.324+0000 7ff4efa68700 1 Processor -- start 2020-02-11T16:05:22.334 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.324+0000 7ff4efa68700 1 -- start start 2020-02-11T16:05:22.334 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4efa68700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4e80a5b80 0x7ff4e80a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:22.334 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4efa68700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff4e805ace0 0x7ff4e805b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:22.334 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4efa68700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e80a4420 con 0x7ff4e80a3590 2020-02-11T16:05:22.334 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4efa68700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e80a2d00 con 0x7ff4e80a5b80 2020-02-11T16:05:22.334 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4efa68700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e80a6600 con 0x7ff4e805ace0 2020-02-11T16:05:22.334 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4ee005700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4e80a5b80 0x7ff4e80a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:22.335 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4ee005700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4e80a5b80 0x7ff4e80a3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39716/0 (socket says 172.21.15.52:39716) 2020-02-11T16:05:22.335 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4ee005700 1 -- 172.21.15.52:0/3654788217 learned_addr learned my addr 172.21.15.52:0/3654788217 (peer_addr_for_me v2:172.21.15.52:0/0) 2020-02-11T16:05:22.335 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4ee806700 1 --2- 172.21.15.52:0/3654788217 >> v2:172.21.15.88:3300/0 conn(0x7ff4e805ace0 0x7ff4e805b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:22.335 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4ee005700 1 -- 172.21.15.52:0/3654788217 >> v2:172.21.15.88:3300/0 conn(0x7ff4e805ace0 msgr2=0x7ff4e805b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4ee005700 1 --2- 172.21.15.52:0/3654788217 >> v2:172.21.15.88:3300/0 conn(0x7ff4e805ace0 0x7ff4e805b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4ee005700 1 -- 172.21.15.52:0/3654788217 >> v1:172.21.15.88:6789/0 conn(0x7ff4e80a3590 legacy=0x7ff4e805a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.325+0000 7ff4ee005700 1 -- 172.21.15.52:0/3654788217 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80a15a0 con 0x7ff4e80a5b80 2020-02-11T16:05:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4ee005700 1 --2- 172.21.15.52:0/3654788217 >> v2:172.21.15.52:3300/0 conn(0x7ff4e80a5b80 0x7ff4e80a3130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4ee005700 1 --2- 172.21.15.52:0/3654788217 >> v2:172.21.15.52:3300/0 conn(0x7ff4e80a5b80 0x7ff4e80a3130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4ee005700 1 --2- 172.21.15.52:0/3654788217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e80a5b80 0x7ff4e80a3130 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).ready entity=mon.0 client_cookie=dca2717ee70c3e84 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:22.338 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4ee005700 1 --2- 172.21.15.52:0/3654788217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e80a5b80 0x7ff4e80a3130 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.339 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4ee005700 1 --2- 172.21.15.52:0/3654788217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e80a5b80 0x7ff4e80a3130 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.339 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4ed003700 1 -- 172.21.15.52:0/3654788217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e40116e0 con 0x7ff4e80a5b80 2020-02-11T16:05:22.339 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4ee005700 1 --2- 172.21.15.52:0/3654788217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e80a5b80 0x7ff4e80a3130 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.339 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4ed003700 1 -- 172.21.15.52:0/3654788217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4011840 con 0x7ff4e80a5b80 2020-02-11T16:05:22.339 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4ed003700 1 -- 172.21.15.52:0/3654788217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e4011c20 con 0x7ff4e80a5b80 2020-02-11T16:05:22.339 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4efa68700 1 -- 172.21.15.52:0/3654788217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e80a5b80 msgr2=0x7ff4e80a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.326+0000 7ff4efa68700 1 --2- 172.21.15.52:0/3654788217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e80a5b80 0x7ff4e80a3130 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).stop 2020-02-11T16:05:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.327+0000 7ff4efa68700 1 -- 172.21.15.52:0/3654788217 shutdown_connections 2020-02-11T16:05:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.327+0000 7ff4efa68700 1 --2- 172.21.15.52:0/3654788217 >> v2:172.21.15.88:3300/0 conn(0x7ff4e805ace0 0x7ff4e805b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.327+0000 7ff4efa68700 1 --2- 172.21.15.52:0/3654788217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e80a5b80 0x7ff4e80a3130 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.327+0000 7ff4efa68700 1 -- 172.21.15.52:0/3654788217 >> 172.21.15.52:0/3654788217 conn(0x7ff4e80a9fb0 msgr2=0x7ff4e80aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.327+0000 7ff4efa68700 1 -- 172.21.15.52:0/3654788217 shutdown_connections 2020-02-11T16:05:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.327+0000 7ff4efa68700 1 -- 172.21.15.52:0/3654788217 wait complete. 2020-02-11T16:05:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.328+0000 7ff4efa68700 1 Processor -- start 2020-02-11T16:05:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.328+0000 7ff4efa68700 1 -- start start 2020-02-11T16:05:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.328+0000 7ff4efa68700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4e805ace0 0x7ff4e8063980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.328+0000 7ff4efa68700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e8135490 con 0x7ff4e80a3590 2020-02-11T16:05:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.328+0000 7ff4efa68700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e807f180 con 0x7ff4e80a5b80 2020-02-11T16:05:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.328+0000 7ff4efa68700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e80660e0 con 0x7ff4e805ace0 2020-02-11T16:05:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.328+0000 7ff4ee005700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4e805ace0 0x7ff4e8063980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.328+0000 7ff4ee005700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4e805ace0 0x7ff4e8063980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39722/0 (socket says 172.21.15.52:39722) 2020-02-11T16:05:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.328+0000 7ff4ee005700 1 -- 172.21.15.52:0/512120575 learned_addr learned my addr 172.21.15.52:0/512120575 (peer_addr_for_me v2:172.21.15.52:0/0) 2020-02-11T16:05:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.328+0000 7ff4ed804700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff4e80a3590 0x7ff4e8135a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48150/0 (socket says 172.21.15.52:48150) 2020-02-11T16:05:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4deffd700 1 -- 172.21.15.52:0/512120575 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914368858 0 0) 0x7ff4e807f180 con 0x7ff4e80a5b80 2020-02-11T16:05:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4deffd700 1 -- 172.21.15.52:0/512120575 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d0003230 con 0x7ff4e80a5b80 2020-02-11T16:05:22.343 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4ee005700 1 -- 172.21.15.52:0/512120575 >> v1:172.21.15.88:6789/0 conn(0x7ff4e80a5b80 legacy=0x7ff4e813c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.343 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4ee005700 1 -- 172.21.15.52:0/512120575 >> v1:172.21.15.52:6789/0 conn(0x7ff4e80a3590 legacy=0x7ff4e8135a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.343 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4deffd700 1 -- 172.21.15.52:0/512120575 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152669946 0 0) 0x7ff4e8135490 con 0x7ff4e80a3590 2020-02-11T16:05:22.345 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4ee005700 1 -- 172.21.15.52:0/512120575 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8066380 con 0x7ff4e805ace0 2020-02-11T16:05:22.345 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4ee005700 1 --2- 172.21.15.52:0/512120575 >> v2:172.21.15.52:3300/0 conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.345 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4ee005700 1 --2- 172.21.15.52:0/512120575 >> v2:172.21.15.52:3300/0 conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4ee005700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4ee005700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4deffd700 1 -- 172.21.15.52:0/512120575 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e40058b0 con 0x7ff4e805ace0 2020-02-11T16:05:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4ee005700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4ee005700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4deffd700 1 -- 172.21.15.52:0/512120575 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4005a10 con 0x7ff4e805ace0 2020-02-11T16:05:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4efa68700 1 -- 172.21.15.52:0/512120575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e8064420 con 0x7ff4e805ace0 2020-02-11T16:05:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4deffd700 1 -- 172.21.15.52:0/512120575 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e4005d70 con 0x7ff4e805ace0 2020-02-11T16:05:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4efa68700 1 -- 172.21.15.52:0/512120575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e8064a70 con 0x7ff4e805ace0 2020-02-11T16:05:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.329+0000 7ff4ee005700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.330+0000 7ff4ee005700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.330+0000 7ff4deffd700 1 -- 172.21.15.52:0/512120575 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 3) v1 ==== 45077+0+0 (secure 0 0 0) 0x7ff4e4015250 con 0x7ff4e805ace0 2020-02-11T16:05:22.348 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.330+0000 7ff4deffd700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff4d0039ea0 0x7ff4d003c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:22.348 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.330+0000 7ff4deffd700 1 -- 172.21.15.52:0/512120575 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7ff4e4049b70 con 0x7ff4e805ace0 2020-02-11T16:05:22.348 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.330+0000 7ff4ed804700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff4d0039ea0 0x7ff4d003c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:22.348 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.330+0000 7ff4efa68700 1 -- 172.21.15.52:0/512120575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e80565b0 con 0x7ff4e805ace0 2020-02-11T16:05:22.349 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.330+0000 7ff4ed804700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff4d0039ea0 0x7ff4d003c360 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:22.349 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.334+0000 7ff4ee005700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.350 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.334+0000 7ff4deffd700 1 -- 172.21.15.52:0/512120575 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff4e40321c0 con 0x7ff4e805ace0 2020-02-11T16:05:22.495 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.493+0000 7ff4efa68700 1 -- 172.21.15.52:0/512120575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "50e1714c-c39e-4dd2-bbad-d1fc70c4e304", "id": 7} v 0) v1 -- 0x7ff4e8066970 con 0x7ff4e805ace0 2020-02-11T16:05:22.498 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.496+0000 7ff4ee005700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:22.498 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.496+0000 7ff4deffd700 1 -- 172.21.15.52:0/512120575 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50e1714c-c39e-4dd2-bbad-d1fc70c4e304", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff4e4031d80 con 0x7ff4e805ace0 2020-02-11T16:05:22.499 INFO:teuthology.orchestra.run.smithi052.stdout:7 2020-02-11T16:05:22.500 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.498+0000 7ff4efa68700 1 -- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff4d0039ea0 msgr2=0x7ff4d003c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.501 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.498+0000 7ff4efa68700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff4d0039ea0 0x7ff4d003c360 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:22.501 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.498+0000 7ff4efa68700 1 -- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 msgr2=0x7ff4e8063980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:22.501 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.498+0000 7ff4efa68700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 0x7ff4e8063980 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7ff4e80aaf20 tx=0x7ff4e80684d0).stop 2020-02-11T16:05:22.501 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.498+0000 7ff4efa68700 1 -- 172.21.15.52:0/512120575 shutdown_connections 2020-02-11T16:05:22.501 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.498+0000 7ff4efa68700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff4d0039ea0 0x7ff4d003c360 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:22.501 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.498+0000 7ff4efa68700 1 --2- 172.21.15.52:0/512120575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e805ace0 0x7ff4e8063980 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:22.501 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.498+0000 7ff4efa68700 1 -- 172.21.15.52:0/512120575 >> 172.21.15.52:0/512120575 conn(0x7ff4e80a9fb0 msgr2=0x7ff4e8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:22.502 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.498+0000 7ff4efa68700 1 -- 172.21.15.52:0/512120575 shutdown_connections 2020-02-11T16:05:22.502 INFO:teuthology.orchestra.run.smithi052.stderr:2020-02-11T16:05:22.498+0000 7ff4efa68700 1 -- 172.21.15.52:0/512120575 wait complete. 2020-02-11T16:05:22.510 INFO:tasks.ceph.osd.0:Restarting daemon 2020-02-11T16:05:22.510 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-02-11T16:05:22.513 INFO:tasks.ceph.osd.0:Started 2020-02-11T16:05:22.513 INFO:tasks.ceph.osd.1:Restarting daemon 2020-02-11T16:05:22.513 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-02-11T16:05:22.515 INFO:tasks.ceph.osd.1:Started 2020-02-11T16:05:22.515 INFO:tasks.ceph.osd.2:Restarting daemon 2020-02-11T16:05:22.516 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-02-11T16:05:22.518 INFO:tasks.ceph.osd.2:Started 2020-02-11T16:05:22.518 INFO:tasks.ceph.osd.3:Restarting daemon 2020-02-11T16:05:22.518 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-02-11T16:05:22.520 INFO:tasks.ceph.osd.3:Started 2020-02-11T16:05:22.521 INFO:tasks.ceph.osd.4:Restarting daemon 2020-02-11T16:05:22.521 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-02-11T16:05:22.523 INFO:tasks.ceph.osd.4:Started 2020-02-11T16:05:22.523 INFO:tasks.ceph.osd.5:Restarting daemon 2020-02-11T16:05:22.524 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-02-11T16:05:22.525 INFO:tasks.ceph.osd.5:Started 2020-02-11T16:05:22.526 INFO:tasks.ceph.osd.6:Restarting daemon 2020-02-11T16:05:22.526 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-02-11T16:05:22.528 INFO:tasks.ceph.osd.6:Started 2020-02-11T16:05:22.528 INFO:tasks.ceph.osd.7:Restarting daemon 2020-02-11T16:05:22.528 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-02-11T16:05:22.530 INFO:tasks.ceph.osd.7:Started 2020-02-11T16:05:22.530 INFO:tasks.ceph:Waiting for OSDs to come up 2020-02-11T16:05:23.110 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:05:23.108+0000 7f63fe8cdec0 -1 Falling back to public interface 2020-02-11T16:05:23.118 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:05:23.116+0000 7efe85eaeec0 -1 Falling back to public interface 2020-02-11T16:05:23.123 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:05:23.121+0000 7f261a59dec0 -1 Falling back to public interface 2020-02-11T16:05:23.131 INFO:tasks.ceph.osd.7.smithi052.stderr:2020-02-11T16:05:23.129+0000 7f834abbcec0 -1 Falling back to public interface 2020-02-11T16:05:23.135 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:05:23.133+0000 7f27f3a86ec0 -1 Falling back to public interface 2020-02-11T16:05:23.135 INFO:tasks.ceph.osd.2.smithi088.stderr:2020-02-11T16:05:23.133+0000 7fc4e23c9ec0 -1 Falling back to public interface 2020-02-11T16:05:23.149 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:05:23.147+0000 7f2f48b87ec0 -1 Falling back to public interface 2020-02-11T16:05:23.152 INFO:tasks.ceph.osd.6.smithi052.stderr:2020-02-11T16:05:23.150+0000 7f729f2cbec0 -1 Falling back to public interface 2020-02-11T16:05:23.346 INFO:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-02-11T16:05:23.481 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.476+0000 7eff43053700 1 Processor -- start 2020-02-11T16:05:23.481 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.476+0000 7eff43053700 1 -- start start 2020-02-11T16:05:23.481 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff43053700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a59f0 0x7eff3c0a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:23.481 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff43053700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7eff3c0a2090 0x7eff3c099750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:23.481 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff43053700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff3c099bb0 0x7eff3c09a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:23.482 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff43053700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0a32d0 con 0x7eff3c0a59f0 2020-02-11T16:05:23.482 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff43053700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c05bf20 con 0x7eff3c099bb0 2020-02-11T16:05:23.482 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff43053700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c05c1c0 con 0x7eff3c0a2090 2020-02-11T16:05:23.482 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff3c099bb0 0x7eff3c09a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:23.482 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff3c099bb0 0x7eff3c09a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51000/0 (socket says 172.21.15.88:51000) 2020-02-11T16:05:23.482 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 -- 172.21.15.88:0/3249324562 learned_addr learned my addr 172.21.15.88:0/3249324562 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:23.482 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff40def700 1 --2- 172.21.15.88:0/3249324562 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7eff3c0a2090 0x7eff3c099750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:23.483 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff415f0700 1 --2- 172.21.15.88:0/3249324562 >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a59f0 0x7eff3c0a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:23.483 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 -- 172.21.15.88:0/3249324562 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7eff3c0a2090 msgr2=0x7eff3c099750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:23.483 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 --2- 172.21.15.88:0/3249324562 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7eff3c0a2090 0x7eff3c099750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:23.483 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 -- 172.21.15.88:0/3249324562 >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a59f0 msgr2=0x7eff3c0a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:23.483 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 --2- 172.21.15.88:0/3249324562 >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a59f0 0x7eff3c0a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:23.483 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 -- 172.21.15.88:0/3249324562 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0a5dd0 con 0x7eff3c099bb0 2020-02-11T16:05:23.483 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff415f0700 1 --2- 172.21.15.88:0/3249324562 >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a59f0 0x7eff3c0a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:23.484 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 --2- 172.21.15.88:0/3249324562 >> v2:172.21.15.88:3300/0 conn(0x7eff3c099bb0 0x7eff3c09a060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff340032b0 tx=0x7eff34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.484 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 --2- 172.21.15.88:0/3249324562 >> v2:172.21.15.88:3300/0 conn(0x7eff3c099bb0 0x7eff3c09a060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff340032b0 tx=0x7eff34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.484 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.477+0000 7eff41df1700 1 --2- 172.21.15.88:0/3249324562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c09a060 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7eff340032b0 tx=0x7eff34007dc0).ready entity=mon.1 client_cookie=7688edbad53d2ae3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:23.484 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff41df1700 1 --2- 172.21.15.88:0/3249324562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c09a060 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7eff340032b0 tx=0x7eff34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.484 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff33fff700 1 -- 172.21.15.88:0/3249324562 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff3400a160 con 0x7eff3c099bb0 2020-02-11T16:05:23.484 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff41df1700 1 --2- 172.21.15.88:0/3249324562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c09a060 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7eff340032b0 tx=0x7eff34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.484 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff33fff700 1 -- 172.21.15.88:0/3249324562 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3400a2c0 con 0x7eff3c099bb0 2020-02-11T16:05:23.485 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff41df1700 1 --2- 172.21.15.88:0/3249324562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c09a060 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7eff340032b0 tx=0x7eff34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.485 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff33fff700 1 -- 172.21.15.88:0/3249324562 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff3400a6a0 con 0x7eff3c099bb0 2020-02-11T16:05:23.485 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff43053700 1 -- 172.21.15.88:0/3249324562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 msgr2=0x7eff3c09a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:23.485 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff43053700 1 --2- 172.21.15.88:0/3249324562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c09a060 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7eff340032b0 tx=0x7eff34007dc0).stop 2020-02-11T16:05:23.485 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff43053700 1 -- 172.21.15.88:0/3249324562 shutdown_connections 2020-02-11T16:05:23.485 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff43053700 1 --2- 172.21.15.88:0/3249324562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c09a060 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:23.485 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff43053700 1 --2- 172.21.15.88:0/3249324562 >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a59f0 0x7eff3c0a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:23.486 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff43053700 1 --2- 172.21.15.88:0/3249324562 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7eff3c0a2090 0x7eff3c099750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:23.486 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff43053700 1 -- 172.21.15.88:0/3249324562 >> 172.21.15.88:0/3249324562 conn(0x7eff3c0a6920 msgr2=0x7eff3c0a6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:23.486 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff43053700 1 -- 172.21.15.88:0/3249324562 shutdown_connections 2020-02-11T16:05:23.486 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.478+0000 7eff43053700 1 -- 172.21.15.88:0/3249324562 wait complete. 2020-02-11T16:05:23.489 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.480+0000 7eff43053700 1 Processor -- start 2020-02-11T16:05:23.489 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.480+0000 7eff43053700 1 -- start start 2020-02-11T16:05:23.490 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff43053700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff3c099bb0 0x7eff3c0638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:23.490 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff43053700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a2090 0x7eff3c065c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:23.490 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff43053700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7eff3c0a59f0 0x7eff3c07e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:23.490 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff43053700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c064080 con 0x7eff3c0a2090 2020-02-11T16:05:23.490 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff43053700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c09cac0 con 0x7eff3c099bb0 2020-02-11T16:05:23.490 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff43053700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c064320 con 0x7eff3c0a59f0 2020-02-11T16:05:23.490 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff415f0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff3c099bb0 0x7eff3c0638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:23.491 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff415f0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff3c099bb0 0x7eff3c0638d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51002/0 (socket says 172.21.15.88:51002) 2020-02-11T16:05:23.491 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff415f0700 1 -- 172.21.15.88:0/1066354628 learned_addr learned my addr 172.21.15.88:0/1066354628 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:23.491 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff40def700 1 --2- 172.21.15.88:0/1066354628 >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a2090 0x7eff3c065c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:23.491 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff41df1700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7eff3c0a59f0 0x7eff3c07e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:23.491 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff415f0700 1 -- 172.21.15.88:0/1066354628 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7eff3c0a59f0 msgr2=0x7eff3c07e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:23.491 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7eff3c0a59f0 0x7eff3c07e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:23.491 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.481+0000 7eff415f0700 1 -- 172.21.15.88:0/1066354628 >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a2090 msgr2=0x7eff3c065c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:23.492 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a2090 0x7eff3c065c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:23.492 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff415f0700 1 -- 172.21.15.88:0/1066354628 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c09c4a0 con 0x7eff3c099bb0 2020-02-11T16:05:23.492 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> v2:172.21.15.88:3300/0 conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.492 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> v2:172.21.15.88:3300/0 conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.492 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:23.492 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.492 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff31ffb700 1 -- 172.21.15.88:0/1066354628 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff3800a890 con 0x7eff3c099bb0 2020-02-11T16:05:23.493 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.493 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.493 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff31ffb700 1 -- 172.21.15.88:0/1066354628 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3800a9f0 con 0x7eff3c099bb0 2020-02-11T16:05:23.493 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff31ffb700 1 -- 172.21.15.88:0/1066354628 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff38009150 con 0x7eff3c099bb0 2020-02-11T16:05:23.493 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff43053700 1 -- 172.21.15.88:0/1066354628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c09c630 con 0x7eff3c099bb0 2020-02-11T16:05:23.493 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff43053700 1 -- 172.21.15.88:0/1066354628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c07ed40 con 0x7eff3c099bb0 2020-02-11T16:05:23.493 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.482+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.494 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.483+0000 7eff31ffb700 1 -- 172.21.15.88:0/1066354628 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 45077+0+0 (secure 0 0 0) 0x7eff38007170 con 0x7eff3c099bb0 2020-02-11T16:05:23.494 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.483+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.494 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.483+0000 7eff31ffb700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff1c039c20 0x7eff1c03c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:23.494 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.483+0000 7eff31ffb700 1 -- 172.21.15.88:0/1066354628 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7eff380498a0 con 0x7eff3c099bb0 2020-02-11T16:05:23.494 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.483+0000 7eff40def700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff1c039c20 0x7eff1c03c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:23.495 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.483+0000 7eff43053700 1 -- 172.21.15.88:0/1066354628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c0565b0 con 0x7eff3c099bb0 2020-02-11T16:05:23.495 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.483+0000 7eff40def700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff1c039c20 0x7eff1c03c0e0 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:23.495 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.490+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.495 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.490+0000 7eff31ffb700 1 -- 172.21.15.88:0/1066354628 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7eff3802efa0 con 0x7eff3c099bb0 2020-02-11T16:05:23.634 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.632+0000 7eff43053700 1 -- 172.21.15.88:0/1066354628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff3c05b8c0 con 0x7eff3c099bb0 2020-02-11T16:05:23.634 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.632+0000 7eff415f0700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:23.634 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.632+0000 7eff31ffb700 1 -- 172.21.15.88:0/1066354628 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7eff38031a90 con 0x7eff3c099bb0 2020-02-11T16:05:23.635 INFO:teuthology.misc.health.smithi088.stdout: 2020-02-11T16:05:23.635 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:22.494962+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:23.636 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.633+0000 7eff43053700 1 -- 172.21.15.88:0/1066354628 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff1c039c20 msgr2=0x7eff1c03c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:23.636 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.633+0000 7eff43053700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff1c039c20 0x7eff1c03c0e0 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:23.636 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.633+0000 7eff43053700 1 -- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 msgr2=0x7eff3c0638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:23.636 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.633+0000 7eff43053700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c0638d0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7eff38007920 tx=0x7eff38010ad0).stop 2020-02-11T16:05:23.636 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.634+0000 7eff43053700 1 -- 172.21.15.88:0/1066354628 shutdown_connections 2020-02-11T16:05:23.637 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.634+0000 7eff43053700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7eff3c0a59f0 0x7eff3c07e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:23.637 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.634+0000 7eff43053700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c099bb0 0x7eff3c0638d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:23.637 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.634+0000 7eff43053700 1 --2- 172.21.15.88:0/1066354628 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff1c039c20 0x7eff1c03c0e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:23.637 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.634+0000 7eff43053700 1 --2- 172.21.15.88:0/1066354628 >> v2:172.21.15.52:3300/0 conn(0x7eff3c0a2090 0x7eff3c065c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:23.637 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.634+0000 7eff43053700 1 -- 172.21.15.88:0/1066354628 >> 172.21.15.88:0/1066354628 conn(0x7eff3c0a6920 msgr2=0x7eff3c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:23.637 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.634+0000 7eff43053700 1 -- 172.21.15.88:0/1066354628 shutdown_connections 2020-02-11T16:05:23.637 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:23.634+0000 7eff43053700 1 -- 172.21.15.88:0/1066354628 wait complete. 2020-02-11T16:05:23.645 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-02-11T16:05:24.177 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:05:24.175+0000 7f63fe8cdec0 -1 osd.1 0 log_to_monitors {default=true} 2020-02-11T16:05:24.188 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:05:24.187+0000 7efe85eaeec0 -1 osd.3 0 log_to_monitors {default=true} 2020-02-11T16:05:24.191 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:05:24.189+0000 7f261a59dec0 -1 osd.4 0 log_to_monitors {default=true} 2020-02-11T16:05:24.205 INFO:tasks.ceph.osd.2.smithi088.stderr:2020-02-11T16:05:24.203+0000 7fc4e23c9ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-02-11T16:05:24.206 INFO:tasks.ceph.osd.7.smithi052.stderr:2020-02-11T16:05:24.204+0000 7f834abbcec0 -1 osd.7 0 log_to_monitors {default=true} 2020-02-11T16:05:24.207 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:05:24.205+0000 7f27f3a86ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-02-11T16:05:24.227 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:05:24.225+0000 7f2f48b87ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-02-11T16:05:24.238 INFO:tasks.ceph.osd.6.smithi052.stderr:2020-02-11T16:05:24.236+0000 7f729f2cbec0 -1 osd.6 0 log_to_monitors {default=true} 2020-02-11T16:05:25.914 INFO:tasks.ceph.osd.7.smithi052.stderr:2020-02-11T16:05:25.911+0000 7f8333388700 -1 osd.7 0 waiting for initial osdmap 2020-02-11T16:05:25.915 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:05:25.912+0000 7f63e7099700 -1 osd.1 0 waiting for initial osdmap 2020-02-11T16:05:25.915 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:05:25.912+0000 7f2602d69700 -1 osd.4 0 waiting for initial osdmap 2020-02-11T16:05:25.919 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:05:25.916+0000 7efe6e67a700 -1 osd.3 0 waiting for initial osdmap 2020-02-11T16:05:25.919 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:05:25.916+0000 7f2f31353700 -1 osd.5 0 waiting for initial osdmap 2020-02-11T16:05:25.920 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:05:25.917+0000 7f27dc252700 -1 osd.0 0 waiting for initial osdmap 2020-02-11T16:05:25.922 INFO:tasks.ceph.osd.2.smithi088.stderr:2020-02-11T16:05:25.920+0000 7fc4cab95700 -1 osd.2 0 waiting for initial osdmap 2020-02-11T16:05:25.923 INFO:tasks.ceph.osd.6.smithi052.stderr:2020-02-11T16:05:25.919+0000 7f7287a97700 -1 osd.6 0 waiting for initial osdmap 2020-02-11T16:05:30.448 INFO:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-02-11T16:05:30.555 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.549+0000 7f175aad9700 1 Processor -- start 2020-02-11T16:05:30.556 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.549+0000 7f175aad9700 1 -- start start 2020-02-11T16:05:30.556 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f175aad9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17540a59f0 0x7f17540a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:30.556 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f175aad9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 0x7f1754099750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:30.556 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f175aad9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17540a32d0 con 0x7f1754099bb0 2020-02-11T16:05:30.556 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f175aad9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175405bf20 con 0x7f17540a59f0 2020-02-11T16:05:30.557 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f175aad9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175405c1c0 con 0x7f17540a2090 2020-02-11T16:05:30.557 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f1759877700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1754099bb0 0x7f175405a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38856/0 (socket says 172.21.15.88:38856) 2020-02-11T16:05:30.557 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f1759877700 1 -- 172.21.15.88:0/1438966613 learned_addr learned my addr 172.21.15.88:0/1438966613 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:30.557 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f1759076700 1 --2- 172.21.15.88:0/1438966613 >> v2:172.21.15.52:3300/0 conn(0x7f17540a59f0 0x7f17540a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.557 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f1758875700 1 --2- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 0x7f1754099750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.558 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f174bfff700 1 -- 172.21.15.88:0/1438966613 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889917783 0 0) 0x7f17540a32d0 con 0x7f1754099bb0 2020-02-11T16:05:30.558 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f174bfff700 1 -- 172.21.15.88:0/1438966613 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1740003230 con 0x7f1754099bb0 2020-02-11T16:05:30.558 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f1759076700 1 -- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 msgr2=0x7f1754099750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:30.558 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f1759076700 1 --2- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 0x7f1754099750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:30.558 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f1759076700 1 -- 172.21.15.88:0/1438966613 >> v1:172.21.15.88:6789/0 conn(0x7f1754099bb0 legacy=0x7f175405a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:30.559 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f174bfff700 1 -- 172.21.15.88:0/1438966613 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3698266017 0 0) 0x7f1740003230 con 0x7f1754099bb0 2020-02-11T16:05:30.559 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f1759076700 1 -- 172.21.15.88:0/1438966613 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17540a5dd0 con 0x7f17540a59f0 2020-02-11T16:05:30.559 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.550+0000 7f1758875700 1 --2- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 0x7f1754099750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:30.559 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f1759076700 1 --2- 172.21.15.88:0/1438966613 >> v2:172.21.15.52:3300/0 conn(0x7f17540a59f0 0x7f17540a1c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f174c001870 tx=0x7f1750008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.559 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f1759076700 1 --2- 172.21.15.88:0/1438966613 >> v2:172.21.15.52:3300/0 conn(0x7f17540a59f0 0x7f17540a1c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f174c001870 tx=0x7f1750008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.559 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f1759076700 1 --2- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17540a59f0 0x7f17540a1c30 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f174c001870 tx=0x7f1750008c60).ready entity=mon.0 client_cookie=db1a89dcea3b621e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:30.559 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f1759076700 1 --2- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17540a59f0 0x7f17540a1c30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f174c001870 tx=0x7f1750008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.560 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f174bfff700 1 -- 172.21.15.88:0/1438966613 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f174c0016d0 con 0x7f17540a59f0 2020-02-11T16:05:30.560 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f1759076700 1 --2- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17540a59f0 0x7f17540a1c30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f174c001870 tx=0x7f1750008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.560 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f1759076700 1 --2- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17540a59f0 0x7f17540a1c30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f174c001870 tx=0x7f1750008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.560 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f174bfff700 1 -- 172.21.15.88:0/1438966613 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1750011a80 con 0x7f17540a59f0 2020-02-11T16:05:30.560 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f174bfff700 1 -- 172.21.15.88:0/1438966613 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1750011de0 con 0x7f17540a59f0 2020-02-11T16:05:30.561 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f175aad9700 1 -- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17540a59f0 msgr2=0x7f17540a1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:30.561 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f175aad9700 1 --2- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17540a59f0 0x7f17540a1c30 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f174c001870 tx=0x7f1750008c60).stop 2020-02-11T16:05:30.561 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f175aad9700 1 -- 172.21.15.88:0/1438966613 shutdown_connections 2020-02-11T16:05:30.561 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f175aad9700 1 --2- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17540a59f0 0x7f17540a1c30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:30.561 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f175aad9700 1 --2- 172.21.15.88:0/1438966613 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 0x7f1754099750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:30.561 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f175aad9700 1 -- 172.21.15.88:0/1438966613 >> 172.21.15.88:0/1438966613 conn(0x7f17540a6920 msgr2=0x7f17540a6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:30.562 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.551+0000 7f175aad9700 1 -- 172.21.15.88:0/1438966613 shutdown_connections 2020-02-11T16:05:30.562 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.552+0000 7f175aad9700 1 -- 172.21.15.88:0/1438966613 wait complete. 2020-02-11T16:05:30.562 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.553+0000 7f175aad9700 1 Processor -- start 2020-02-11T16:05:30.562 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.553+0000 7f175aad9700 1 -- start start 2020-02-11T16:05:30.565 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.553+0000 7f175aad9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 0x7f17540658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:30.566 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.553+0000 7f175aad9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17540a59f0 0x7f1754063ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:30.566 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.553+0000 7f175aad9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1754063f30 con 0x7f1754099bb0 2020-02-11T16:05:30.566 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.553+0000 7f175aad9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1754099960 con 0x7f17540a59f0 2020-02-11T16:05:30.566 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.553+0000 7f175aad9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1754063550 con 0x7f17540a2090 2020-02-11T16:05:30.566 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.553+0000 7f1759877700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17540a59f0 0x7f1754063ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.566 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.553+0000 7f1759877700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17540a59f0 0x7f1754063ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51240/0 (socket says 172.21.15.88:51240) 2020-02-11T16:05:30.567 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 -- 172.21.15.88:0/4245456464 learned_addr learned my addr 172.21.15.88:0/4245456464 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:30.567 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1758875700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 0x7f17540658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.567 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 -- 172.21.15.88:0/4245456464 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 msgr2=0x7f17540658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:30.567 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 0x7f17540658a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:30.567 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 -- 172.21.15.88:0/4245456464 >> v1:172.21.15.52:6789/0 conn(0x7f1754099bb0 legacy=0x7f175407e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:30.567 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 -- 172.21.15.88:0/4245456464 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17540637f0 con 0x7f17540a59f0 2020-02-11T16:05:30.567 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> v2:172.21.15.88:3300/0 conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.568 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> v2:172.21.15.88:3300/0 conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.568 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:30.568 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.568 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1749ffb700 1 -- 172.21.15.88:0/4245456464 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f174c012a10 con 0x7f17540a59f0 2020-02-11T16:05:30.568 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.568 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.568 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1749ffb700 1 -- 172.21.15.88:0/4245456464 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c012b70 con 0x7f17540a59f0 2020-02-11T16:05:30.569 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f175aad9700 1 -- 172.21.15.88:0/4245456464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1754065400 con 0x7f17540a59f0 2020-02-11T16:05:30.569 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f1749ffb700 1 -- 172.21.15.88:0/4245456464 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f174c00c570 con 0x7f17540a59f0 2020-02-11T16:05:30.569 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.554+0000 7f175aad9700 1 -- 172.21.15.88:0/4245456464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175407eb10 con 0x7f17540a59f0 2020-02-11T16:05:30.569 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.555+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.569 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.555+0000 7f1749ffb700 1 -- 172.21.15.88:0/4245456464 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f174c00c7e0 con 0x7f17540a59f0 2020-02-11T16:05:30.569 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.555+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.569 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.555+0000 7f1749ffb700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1734039c40 0x7f173403c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:30.570 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.555+0000 7f1749ffb700 1 -- 172.21.15.88:0/4245456464 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7f174c0499d0 con 0x7f17540a59f0 2020-02-11T16:05:30.570 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.555+0000 7f175aad9700 1 -- 172.21.15.88:0/4245456464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1754063f30 con 0x7f17540a59f0 2020-02-11T16:05:30.570 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.555+0000 7f1759076700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1734039c40 0x7f173403c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.570 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.555+0000 7f1759076700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1734039c40 0x7f173403c100 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:30.570 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.559+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.571 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.559+0000 7f1749ffb700 1 -- 172.21.15.88:0/4245456464 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f1754063f30 con 0x7f17540a59f0 2020-02-11T16:05:30.698 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.694+0000 7f175aad9700 1 -- 172.21.15.88:0/4245456464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1754063f30 con 0x7f17540a59f0 2020-02-11T16:05:30.699 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.695+0000 7f1759877700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.699 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.695+0000 7f1749ffb700 1 -- 172.21.15.88:0/4245456464 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10391 (secure 0 0 0) 0x7f1754063f30 con 0x7f17540a59f0 2020-02-11T16:05:30.699 INFO:teuthology.misc.health.smithi088.stdout: 2020-02-11T16:05:30.699 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":14,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:27.921604+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:30.709 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.696+0000 7f175aad9700 1 -- 172.21.15.88:0/4245456464 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1734039c40 msgr2=0x7f173403c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:30.710 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.696+0000 7f175aad9700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1734039c40 0x7f173403c100 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:30.710 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.696+0000 7f175aad9700 1 -- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 msgr2=0x7f1754063ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:30.710 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.696+0000 7f175aad9700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 0x7f1754063ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f17540a1ee0 tx=0x7f174c010cd0).stop 2020-02-11T16:05:30.710 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.696+0000 7f175aad9700 1 -- 172.21.15.88:0/4245456464 shutdown_connections 2020-02-11T16:05:30.711 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.696+0000 7f175aad9700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1734039c40 0x7f173403c100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:30.711 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.696+0000 7f175aad9700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540a59f0 0x7f1754063ad0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:30.711 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.696+0000 7f175aad9700 1 --2- 172.21.15.88:0/4245456464 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f17540a2090 0x7f17540658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:30.712 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.696+0000 7f175aad9700 1 -- 172.21.15.88:0/4245456464 >> 172.21.15.88:0/4245456464 conn(0x7f17540a6920 msgr2=0x7f17540a6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:30.712 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.697+0000 7f175aad9700 1 -- 172.21.15.88:0/4245456464 shutdown_connections 2020-02-11T16:05:30.712 INFO:teuthology.misc.health.smithi088.stderr:2020-02-11T16:05:30.697+0000 7f175aad9700 1 -- 172.21.15.88:0/4245456464 wait complete. 2020-02-11T16:05:30.713 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-02-11T16:05:30.714 INFO:tasks.ceph:Creating RBD pool 2020-02-11T16:05:30.714 INFO:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool create rbd 8 2020-02-11T16:05:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.816+0000 7f41af7fa700 1 Processor -- start 2020-02-11T16:05:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.816+0000 7f41af7fa700 1 -- start start 2020-02-11T16:05:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41af7fa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f41a80a5b80 0x7f41a80a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41af7fa700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41a80a3590 0x7f41a805a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41af7fa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a80a4420 con 0x7f41a805aa30 2020-02-11T16:05:30.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41af7fa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a80a2d00 con 0x7f41a80a5b80 2020-02-11T16:05:30.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41af7fa700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80a6600 con 0x7f41a80a3590 2020-02-11T16:05:30.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f41a80a5b80 0x7f41a80a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f41a80a5b80 0x7f41a80a3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51244/0 (socket says 172.21.15.88:51244) 2020-02-11T16:05:30.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 -- 172.21.15.88:0/4001566654 learned_addr learned my addr 172.21.15.88:0/4001566654 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:30.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41ad596700 1 --2- 172.21.15.88:0/4001566654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41a80a3590 0x7f41a805a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 -- 172.21.15.88:0/4001566654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41a80a3590 msgr2=0x7f41a805a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 --2- 172.21.15.88:0/4001566654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41a80a3590 0x7f41a805a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 -- 172.21.15.88:0/4001566654 >> v1:172.21.15.52:6789/0 conn(0x7f41a805aa30 legacy=0x7f41a805aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 -- 172.21.15.88:0/4001566654 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80a15a0 con 0x7f41a80a5b80 2020-02-11T16:05:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 --2- 172.21.15.88:0/4001566654 >> v2:172.21.15.88:3300/0 conn(0x7f41a80a5b80 0x7f41a80a3130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 --2- 172.21.15.88:0/4001566654 >> v2:172.21.15.88:3300/0 conn(0x7f41a80a5b80 0x7f41a80a3130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 --2- 172.21.15.88:0/4001566654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a80a5b80 0x7f41a80a3130 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).ready entity=mon.1 client_cookie=e094f4daa45e4f29 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 --2- 172.21.15.88:0/4001566654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a80a5b80 0x7f41a80a3130 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41acd95700 1 -- 172.21.15.88:0/4001566654 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a4011670 con 0x7f41a80a5b80 2020-02-11T16:05:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 --2- 172.21.15.88:0/4001566654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a80a5b80 0x7f41a80a3130 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41add97700 1 --2- 172.21.15.88:0/4001566654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a80a5b80 0x7f41a80a3130 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.817+0000 7f41acd95700 1 -- 172.21.15.88:0/4001566654 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a40117d0 con 0x7f41a80a5b80 2020-02-11T16:05:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.818+0000 7f41acd95700 1 -- 172.21.15.88:0/4001566654 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a4011bb0 con 0x7f41a80a5b80 2020-02-11T16:05:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.818+0000 7f41af7fa700 1 -- 172.21.15.88:0/4001566654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a80a5b80 msgr2=0x7f41a80a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.818+0000 7f41af7fa700 1 --2- 172.21.15.88:0/4001566654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a80a5b80 0x7f41a80a3130 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).stop 2020-02-11T16:05:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.818+0000 7f41af7fa700 1 -- 172.21.15.88:0/4001566654 shutdown_connections 2020-02-11T16:05:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.818+0000 7f41af7fa700 1 --2- 172.21.15.88:0/4001566654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a80a5b80 0x7f41a80a3130 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.818+0000 7f41af7fa700 1 --2- 172.21.15.88:0/4001566654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41a80a3590 0x7f41a805a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.818+0000 7f41af7fa700 1 -- 172.21.15.88:0/4001566654 >> 172.21.15.88:0/4001566654 conn(0x7f41a80a9fb0 msgr2=0x7f41a80aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.818+0000 7f41af7fa700 1 -- 172.21.15.88:0/4001566654 shutdown_connections 2020-02-11T16:05:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.818+0000 7f41af7fa700 1 -- 172.21.15.88:0/4001566654 wait complete. 2020-02-11T16:05:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.819+0000 7f41af7fa700 1 Processor -- start 2020-02-11T16:05:30.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.819+0000 7f41af7fa700 1 -- start start 2020-02-11T16:05:30.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41af7fa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f41a805aa30 0x7f41a80a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:30.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41af7fa700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41a80a3590 0x7f41a8121140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:30.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41af7fa700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41a80a5b80 0x7f41a81215a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:30.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41af7fa700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a81221a0 con 0x7f41a80a5b80 2020-02-11T16:05:30.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41af7fa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a807f210 con 0x7f41a805aa30 2020-02-11T16:05:30.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41af7fa700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80a8630 con 0x7f41a80a3590 2020-02-11T16:05:30.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f41a805aa30 0x7f41a80a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f41a805aa30 0x7f41a80a7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51248/0 (socket says 172.21.15.88:51248) 2020-02-11T16:05:30.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 -- 172.21.15.88:0/1221730310 learned_addr learned my addr 172.21.15.88:0/1221730310 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:30.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41ad596700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41a80a3590 0x7f41a8121140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41ae598700 1 --2- 172.21.15.88:0/1221730310 >> v2:172.21.15.52:3300/0 conn(0x7f41a80a5b80 0x7f41a81215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 -- 172.21.15.88:0/1221730310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41a80a3590 msgr2=0x7f41a8121140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:30.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41a80a3590 0x7f41a8121140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:30.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 -- 172.21.15.88:0/1221730310 >> v2:172.21.15.52:3300/0 conn(0x7f41a80a5b80 msgr2=0x7f41a81215a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:30.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> v2:172.21.15.52:3300/0 conn(0x7f41a80a5b80 0x7f41a81215a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:30.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 -- 172.21.15.88:0/1221730310 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a8123760 con 0x7f41a805aa30 2020-02-11T16:05:30.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> v2:172.21.15.88:3300/0 conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> v2:172.21.15.88:3300/0 conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:30.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f419e7fc700 1 -- 172.21.15.88:0/1221730310 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a400f910 con 0x7f41a805aa30 2020-02-11T16:05:30.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f419e7fc700 1 -- 172.21.15.88:0/1221730310 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4011c00 con 0x7f41a805aa30 2020-02-11T16:05:30.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f41af7fa700 1 -- 172.21.15.88:0/1221730310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a8123080 con 0x7f41a805aa30 2020-02-11T16:05:30.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.820+0000 7f419e7fc700 1 -- 172.21.15.88:0/1221730310 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a4007530 con 0x7f41a805aa30 2020-02-11T16:05:30.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.821+0000 7f41af7fa700 1 -- 172.21.15.88:0/1221730310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a8120b40 con 0x7f41a805aa30 2020-02-11T16:05:30.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.821+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.821+0000 7f419e7fc700 1 -- 172.21.15.88:0/1221730310 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f41a40056c0 con 0x7f41a805aa30 2020-02-11T16:05:30.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.821+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.821+0000 7f419e7fc700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4190039b80 0x7f419003c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:30.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.821+0000 7f419e7fc700 1 -- 172.21.15.88:0/1221730310 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7f41a4049ab0 con 0x7f41a805aa30 2020-02-11T16:05:30.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.822+0000 7f41af7fa700 1 -- 172.21.15.88:0/1221730310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a80565b0 con 0x7f41a805aa30 2020-02-11T16:05:30.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.822+0000 7f41ad596700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4190039b80 0x7f419003c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:30.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.822+0000 7f41ad596700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4190039b80 0x7f419003c040 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:30.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.825+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:30.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.825+0000 7f419e7fc700 1 -- 172.21.15.88:0/1221730310 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f41a40320f0 con 0x7f41a805aa30 2020-02-11T16:05:30.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:30.961+0000 7f41af7fa700 1 -- 172.21.15.88:0/1221730310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f41a805e2f0 con 0x7f41a805aa30 2020-02-11T16:05:31.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.939+0000 7f41add97700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:31.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.939+0000 7f419e7fc700 1 -- 172.21.15.88:0/1221730310 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f41a4031cb0 con 0x7f41a805aa30 2020-02-11T16:05:31.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 -- 172.21.15.88:0/1221730310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4190039b80 msgr2=0x7f419003c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:31.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4190039b80 0x7f419003c040 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:31.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 -- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 msgr2=0x7f41a80a7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:31.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 0x7f41a80a7eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a80684d0).stop 2020-02-11T16:05:31.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 -- 172.21.15.88:0/1221730310 shutdown_connections 2020-02-11T16:05:31.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4190039b80 0x7f419003c040 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:31.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 --2- 172.21.15.88:0/1221730310 >> v2:172.21.15.52:3300/0 conn(0x7f41a80a5b80 0x7f41a81215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41a805aa30 0x7f41a80a7eb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 --2- 172.21.15.88:0/1221730310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41a80a3590 0x7f41a8121140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 -- 172.21.15.88:0/1221730310 >> 172.21.15.88:0/1221730310 conn(0x7f41a80a9fb0 msgr2=0x7f41a809fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 -- 172.21.15.88:0/1221730310 shutdown_connections 2020-02-11T16:05:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:31.942+0000 7f41af7fa700 1 -- 172.21.15.88:0/1221730310 wait complete. 2020-02-11T16:05:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'rbd' created 2020-02-11T16:05:31.958 INFO:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-02-11T16:05:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.069+0000 7f3498271700 1 Processor -- start 2020-02-11T16:05:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.069+0000 7f3498271700 1 -- start start 2020-02-11T16:05:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.070+0000 7f3498271700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f349014a6a0 0x7f349014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.070+0000 7f3498271700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f349014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.070+0000 7f3498271700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349005b5e0 con 0x7f34900a1490 2020-02-11T16:05:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.070+0000 7f3498271700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34900a59f0 con 0x7f349014a6a0 2020-02-11T16:05:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.070+0000 7f3498271700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34900a26b0 con 0x7f349014cef0 2020-02-11T16:05:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.070+0000 7f349600d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f349014a6a0 0x7f349014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.070+0000 7f349600d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f349014a6a0 0x7f349014ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51256/0 (socket says 172.21.15.88:51256) 2020-02-11T16:05:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.070+0000 7f349600d700 1 -- 172.21.15.88:0/3200450391 learned_addr learned my addr 172.21.15.88:0/3200450391 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.070+0000 7f349680e700 1 --1- 172.21.15.88:0/3200450391 >> v1:172.21.15.88:6789/0 conn(0x7f34900a1490 0x7f34900a2d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38882/0 (socket says 172.21.15.88:38882) 2020-02-11T16:05:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.070+0000 7f349700f700 1 --2- 172.21.15.88:0/3200450391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f349014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349600d700 1 -- 172.21.15.88:0/3200450391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 msgr2=0x7f349014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349600d700 1 --2- 172.21.15.88:0/3200450391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f349014f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349600d700 1 -- 172.21.15.88:0/3200450391 >> v1:172.21.15.88:6789/0 conn(0x7f34900a1490 legacy=0x7f34900a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349600d700 1 -- 172.21.15.88:0/3200450391 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900a2950 con 0x7f349014a6a0 2020-02-11T16:05:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349580c700 1 -- 172.21.15.88:0/3200450391 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389879515 0 0) 0x7f349005b5e0 con 0x7f34900a1490 2020-02-11T16:05:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349600d700 1 --2- 172.21.15.88:0/3200450391 >> v2:172.21.15.88:3300/0 conn(0x7f349014a6a0 0x7f349014ca90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3480002f30 tx=0x7f34800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349600d700 1 --2- 172.21.15.88:0/3200450391 >> v2:172.21.15.88:3300/0 conn(0x7f349014a6a0 0x7f349014ca90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3480002f30 tx=0x7f34800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349600d700 1 --2- 172.21.15.88:0/3200450391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349014a6a0 0x7f349014ca90 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f3480002f30 tx=0x7f34800088e0).ready entity=mon.1 client_cookie=cd76690e7c002cef server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:32.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349600d700 1 --2- 172.21.15.88:0/3200450391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349014a6a0 0x7f349014ca90 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f3480002f30 tx=0x7f34800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349580c700 1 -- 172.21.15.88:0/3200450391 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3480011760 con 0x7f349014a6a0 2020-02-11T16:05:32.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349600d700 1 --2- 172.21.15.88:0/3200450391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349014a6a0 0x7f349014ca90 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f3480002f30 tx=0x7f34800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349580c700 1 -- 172.21.15.88:0/3200450391 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34800118c0 con 0x7f349014a6a0 2020-02-11T16:05:32.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349600d700 1 --2- 172.21.15.88:0/3200450391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349014a6a0 0x7f349014ca90 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f3480002f30 tx=0x7f34800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f349580c700 1 -- 172.21.15.88:0/3200450391 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3480011c60 con 0x7f349014a6a0 2020-02-11T16:05:32.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f3498271700 1 -- 172.21.15.88:0/3200450391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349014a6a0 msgr2=0x7f349014ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:32.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f3498271700 1 --2- 172.21.15.88:0/3200450391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349014a6a0 0x7f349014ca90 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f3480002f30 tx=0x7f34800088e0).stop 2020-02-11T16:05:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f3498271700 1 -- 172.21.15.88:0/3200450391 shutdown_connections 2020-02-11T16:05:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f3498271700 1 --2- 172.21.15.88:0/3200450391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f349014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f3498271700 1 --2- 172.21.15.88:0/3200450391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349014a6a0 0x7f349014ca90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f3498271700 1 -- 172.21.15.88:0/3200450391 >> 172.21.15.88:0/3200450391 conn(0x7f34900a9f60 msgr2=0x7f34900aa370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f3498271700 1 -- 172.21.15.88:0/3200450391 shutdown_connections 2020-02-11T16:05:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.071+0000 7f3498271700 1 -- 172.21.15.88:0/3200450391 wait complete. 2020-02-11T16:05:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.072+0000 7f3498271700 1 Processor -- start 2020-02-11T16:05:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.073+0000 7f3498271700 1 -- start start 2020-02-11T16:05:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.073+0000 7f3498271700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f349014a6a0 0x7f3490120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.073+0000 7f3498271700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.073+0000 7f3498271700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3490120a80 con 0x7f34900a1490 2020-02-11T16:05:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.073+0000 7f3498271700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3490120cc0 con 0x7f349014a6a0 2020-02-11T16:05:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.073+0000 7f3498271700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3490122870 con 0x7f349014cef0 2020-02-11T16:05:32.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.073+0000 7f349600d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f349014a6a0 0x7f3490120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:32.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.073+0000 7f349700f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:32.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.073+0000 7f349600d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f349014a6a0 0x7f3490120620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:37248/0 (socket says 172.21.15.88:37248) 2020-02-11T16:05:32.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.073+0000 7f349600d700 1 -- 172.21.15.88:0/2898167550 learned_addr learned my addr 172.21.15.88:0/2898167550 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f349700f700 1 -- 172.21.15.88:0/2898167550 >> v2:172.21.15.52:3300/0 conn(0x7f349014a6a0 msgr2=0x7f3490120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> v2:172.21.15.52:3300/0 conn(0x7f349014a6a0 0x7f3490120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f349700f700 1 -- 172.21.15.88:0/2898167550 >> v1:172.21.15.52:6789/0 conn(0x7f34900a1490 legacy=0x7f349012f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f349700f700 1 -- 172.21.15.88:0/2898167550 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490122b10 con 0x7f349014cef0 2020-02-11T16:05:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f34877fe700 1 -- 172.21.15.88:0/2898167550 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34880129a0 con 0x7f349014cef0 2020-02-11T16:05:32.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f34877fe700 1 -- 172.21.15.88:0/2898167550 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3488012b00 con 0x7f349014cef0 2020-02-11T16:05:32.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f34877fe700 1 -- 172.21.15.88:0/2898167550 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f348800a160 con 0x7f349014cef0 2020-02-11T16:05:32.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f3498271700 1 -- 172.21.15.88:0/2898167550 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3490123410 con 0x7f349014cef0 2020-02-11T16:05:32.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.074+0000 7f3498271700 1 -- 172.21.15.88:0/2898167550 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34900a6820 con 0x7f349014cef0 2020-02-11T16:05:32.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.075+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.075+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.075+0000 7f34877fe700 1 -- 172.21.15.88:0/2898167550 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f3488005a40 con 0x7f349014cef0 2020-02-11T16:05:32.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.075+0000 7f3498271700 1 -- 172.21.15.88:0/2898167550 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34900565b0 con 0x7f349014cef0 2020-02-11T16:05:32.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.075+0000 7f34877fe700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3478039d40 0x7f347803c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:32.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.075+0000 7f34877fe700 1 -- 172.21.15.88:0/2898167550 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4842+0+0 (secure 0 0 0) 0x7f348804a020 con 0x7f349014cef0 2020-02-11T16:05:32.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.075+0000 7f349680e700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3478039d40 0x7f347803c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:32.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.076+0000 7f349680e700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3478039d40 0x7f347803c200 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:32.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.080+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.080+0000 7f34877fe700 1 -- 172.21.15.88:0/2898167550 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f348802f4a0 con 0x7f349014cef0 2020-02-11T16:05:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.218+0000 7f3498271700 1 -- 172.21.15.88:0/2898167550 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f349014ccd0 con 0x7f349014cef0 2020-02-11T16:05:32.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.940+0000 7f349700f700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:32.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.941+0000 7f34877fe700 1 -- 172.21.15.88:0/2898167550 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3488032180 con 0x7f349014cef0 2020-02-11T16:05:32.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 -- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3478039d40 msgr2=0x7f347803c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:32.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3478039d40 0x7f347803c200 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:32.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 -- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 msgr2=0x7f3490122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f3490122670 tx=0x7f3488010c60).stop 2020-02-11T16:05:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 -- 172.21.15.88:0/2898167550 shutdown_connections 2020-02-11T16:05:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349014cef0 0x7f3490122fb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 --2- 172.21.15.88:0/2898167550 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3478039d40 0x7f347803c200 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 --2- 172.21.15.88:0/2898167550 >> v2:172.21.15.52:3300/0 conn(0x7f349014a6a0 0x7f3490120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 -- 172.21.15.88:0/2898167550 >> 172.21.15.88:0/2898167550 conn(0x7f34900a9f60 msgr2=0x7f3490069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 -- 172.21.15.88:0/2898167550 shutdown_connections 2020-02-11T16:05:32.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:32.944+0000 7f3498271700 1 -- 172.21.15.88:0/2898167550 wait complete. 2020-02-11T16:05:32.949 INFO:teuthology.orchestra.run.smithi088.stderr:enabled application 'rbd' on pool 'rbd' 2020-02-11T16:05:32.959 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-02-11T16:05:32.960 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:33.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.067+0000 7fced4952700 1 Processor -- start 2020-02-11T16:05:33.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.067+0000 7fced4952700 1 -- start start 2020-02-11T16:05:33.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fced4952700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fced00a5de0 0x7fced00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:33.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fced4952700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fced0134a50 0x7fced0134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:33.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fced4952700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced00a31b0 con 0x7fced00a18a0 2020-02-11T16:05:33.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fced4952700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced00a3570 con 0x7fced0134a50 2020-02-11T16:05:33.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fced4952700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced00a3810 con 0x7fced00a5de0 2020-02-11T16:05:33.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fcecdd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fced00a5de0 0x7fced00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fcecdd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fced00a5de0 0x7fced00a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51268/0 (socket says 172.21.15.88:51268) 2020-02-11T16:05:33.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fcecdd9b700 1 -- 172.21.15.88:0/1343211214 learned_addr learned my addr 172.21.15.88:0/1343211214 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:33.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fceced9d700 1 --2- 172.21.15.88:0/1343211214 >> v2:172.21.15.52:3300/0 conn(0x7fced0134a50 0x7fced0134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fcecdd9b700 1 -- 172.21.15.88:0/1343211214 >> v2:172.21.15.52:3300/0 conn(0x7fced0134a50 msgr2=0x7fced0134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:33.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/1343211214 >> v2:172.21.15.52:3300/0 conn(0x7fced0134a50 0x7fced0134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fcecdd9b700 1 -- 172.21.15.88:0/1343211214 >> v1:172.21.15.52:6789/0 conn(0x7fced00a18a0 legacy=0x7fced00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fcecdd9b700 1 -- 172.21.15.88:0/1343211214 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00a3ab0 con 0x7fced00a5de0 2020-02-11T16:05:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/1343211214 >> v2:172.21.15.88:3300/0 conn(0x7fced00a5de0 0x7fced00a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.068+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/1343211214 >> v2:172.21.15.88:3300/0 conn(0x7fced00a5de0 0x7fced00a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/1343211214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced00a6260 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).ready entity=mon.1 client_cookie=65eaabe80bcf19d9 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/1343211214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced00a6260 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fcecd59a700 1 -- 172.21.15.88:0/1343211214 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec00116e0 con 0x7fced00a5de0 2020-02-11T16:05:33.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/1343211214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced00a6260 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/1343211214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced00a6260 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fcecd59a700 1 -- 172.21.15.88:0/1343211214 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec0011840 con 0x7fced00a5de0 2020-02-11T16:05:33.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fcecd59a700 1 -- 172.21.15.88:0/1343211214 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec0011c20 con 0x7fced00a5de0 2020-02-11T16:05:33.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fced4952700 1 -- 172.21.15.88:0/1343211214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 msgr2=0x7fced00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fced4952700 1 --2- 172.21.15.88:0/1343211214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced00a6260 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).stop 2020-02-11T16:05:33.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fced4952700 1 -- 172.21.15.88:0/1343211214 shutdown_connections 2020-02-11T16:05:33.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fced4952700 1 --2- 172.21.15.88:0/1343211214 >> v2:172.21.15.52:3300/0 conn(0x7fced0134a50 0x7fced0134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:33.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fced4952700 1 --2- 172.21.15.88:0/1343211214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced00a6260 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fced4952700 1 -- 172.21.15.88:0/1343211214 >> 172.21.15.88:0/1343211214 conn(0x7fced009d110 msgr2=0x7fced009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:33.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fced4952700 1 -- 172.21.15.88:0/1343211214 shutdown_connections 2020-02-11T16:05:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.069+0000 7fced4952700 1 -- 172.21.15.88:0/1343211214 wait complete. 2020-02-11T16:05:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.070+0000 7fced4952700 1 Processor -- start 2020-02-11T16:05:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.070+0000 7fced4952700 1 -- start start 2020-02-11T16:05:33.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fced4952700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fced00a18a0 0x7fced005a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fced4952700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fced00a5de0 0x7fced0131010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fced4952700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced005aae0 con 0x7fced0134a50 2020-02-11T16:05:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fced4952700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced005ad80 con 0x7fced00a18a0 2020-02-11T16:05:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fced4952700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced005b020 con 0x7fced00a5de0 2020-02-11T16:05:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fced00a5de0 0x7fced0131010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fceced9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fced0134a50 0x7fced00a0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38900/0 (socket says 172.21.15.88:38900) 2020-02-11T16:05:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fced00a5de0 0x7fced0131010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51272/0 (socket says 172.21.15.88:51272) 2020-02-11T16:05:33.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fceced9d700 1 -- 172.21.15.88:0/3380995055 learned_addr learned my addr 172.21.15.88:0/3380995055 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:33.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcece59c700 1 --2- 172.21.15.88:0/3380995055 >> v2:172.21.15.52:3300/0 conn(0x7fced00a18a0 0x7fced005a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 -- 172.21.15.88:0/3380995055 >> v2:172.21.15.52:3300/0 conn(0x7fced00a18a0 msgr2=0x7fced005a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> v2:172.21.15.52:3300/0 conn(0x7fced00a18a0 0x7fced005a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 -- 172.21.15.88:0/3380995055 >> v1:172.21.15.88:6789/0 conn(0x7fced0134a50 legacy=0x7fced00a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcebf7fe700 1 -- 172.21.15.88:0/3380995055 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907278215 0 0) 0x7fced005aae0 con 0x7fced0134a50 2020-02-11T16:05:33.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 -- 172.21.15.88:0/3380995055 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00a0e70 con 0x7fced00a5de0 2020-02-11T16:05:33.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> v2:172.21.15.88:3300/0 conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> v2:172.21.15.88:3300/0 conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcebf7fe700 1 -- 172.21.15.88:0/3380995055 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec0007340 con 0x7fced00a5de0 2020-02-11T16:05:33.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcebf7fe700 1 -- 172.21.15.88:0/3380995055 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec00074a0 con 0x7fced00a5de0 2020-02-11T16:05:33.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fced4952700 1 -- 172.21.15.88:0/3380995055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced0131470 con 0x7fced00a5de0 2020-02-11T16:05:33.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fcebf7fe700 1 -- 172.21.15.88:0/3380995055 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec00058b0 con 0x7fced00a5de0 2020-02-11T16:05:33.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.071+0000 7fced4952700 1 -- 172.21.15.88:0/3380995055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced012ac50 con 0x7fced00a5de0 2020-02-11T16:05:33.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.072+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.072+0000 7fcebf7fe700 1 -- 172.21.15.88:0/3380995055 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fcec0005af0 con 0x7fced00a5de0 2020-02-11T16:05:33.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.072+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.072+0000 7fcebf7fe700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceac039ab0 0x7fceac03bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.072+0000 7fcebf7fe700 1 -- 172.21.15.88:0/3380995055 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcec004a0f0 con 0x7fced00a5de0 2020-02-11T16:05:33.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.073+0000 7fced4952700 1 -- 172.21.15.88:0/3380995055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced00565b0 con 0x7fced00a5de0 2020-02-11T16:05:33.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.073+0000 7fcece59c700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceac039ab0 0x7fceac03bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.073+0000 7fcece59c700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceac039ab0 0x7fceac03bf70 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.076+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.076+0000 7fcebf7fe700 1 -- 172.21.15.88:0/3380995055 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fcec0032710 con 0x7fced00a5de0 2020-02-11T16:05:33.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.212+0000 7fced4952700 1 -- 172.21.15.88:0/3380995055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fced005b190 con 0x7fced00a5de0 2020-02-11T16:05:33.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.212+0000 7fcecdd9b700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.212+0000 7fcebf7fe700 1 -- 172.21.15.88:0/3380995055 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11778 (secure 0 0 0) 0x7fcec00322d0 con 0x7fced00a5de0 2020-02-11T16:05:33.216 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:33.216 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:32.935877+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 -- 172.21.15.88:0/3380995055 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceac039ab0 msgr2=0x7fceac03bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceac039ab0 0x7fceac03bf70 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 -- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 msgr2=0x7fced0131010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced0131010 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7fced005bbc0 tx=0x7fcec0007a40).stop 2020-02-11T16:05:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 -- 172.21.15.88:0/3380995055 shutdown_connections 2020-02-11T16:05:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceac039ab0 0x7fceac03bf70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 --2- 172.21.15.88:0/3380995055 >> v2:172.21.15.52:3300/0 conn(0x7fced00a18a0 0x7fced005a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 --2- 172.21.15.88:0/3380995055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fced00a5de0 0x7fced0131010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 -- 172.21.15.88:0/3380995055 >> 172.21.15.88:0/3380995055 conn(0x7fced009d110 msgr2=0x7fced0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 -- 172.21.15.88:0/3380995055 shutdown_connections 2020-02-11T16:05:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.214+0000 7fced4952700 1 -- 172.21.15.88:0/3380995055 wait complete. 2020-02-11T16:05:33.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:30.979083+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-11T16:05:33.227 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-11T16:05:33.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.332+0000 7fd3095d5700 1 Processor -- start 2020-02-11T16:05:33.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.332+0000 7fd3095d5700 1 -- start start 2020-02-11T16:05:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3095d5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd30405b960 0x7fd3040a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3095d5700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd3040a28a0 0x7fd30409aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3095d5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd3040a5c60 0x7fd304138250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3095d5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3040a4160 con 0x7fd3040a5c60 2020-02-11T16:05:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3095d5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30409d950 con 0x7fd30405b960 2020-02-11T16:05:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3095d5700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30409dbf0 con 0x7fd3040a28a0 2020-02-11T16:05:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd30405b960 0x7fd3040a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd30405b960 0x7fd3040a67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51278/0 (socket says 172.21.15.88:51278) 2020-02-11T16:05:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 -- 172.21.15.88:0/3922284058 learned_addr learned my addr 172.21.15.88:0/3922284058 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3037fe700 1 --2- 172.21.15.88:0/3922284058 >> v2:172.21.15.52:3300/0 conn(0x7fd3040a5c60 0x7fd304138250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3027fc700 1 --2- 172.21.15.88:0/3922284058 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd3040a28a0 0x7fd30409aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 -- 172.21.15.88:0/3922284058 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd3040a28a0 msgr2=0x7fd30409aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 --2- 172.21.15.88:0/3922284058 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd3040a28a0 0x7fd30409aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 -- 172.21.15.88:0/3922284058 >> v2:172.21.15.52:3300/0 conn(0x7fd3040a5c60 msgr2=0x7fd304138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 --2- 172.21.15.88:0/3922284058 >> v2:172.21.15.52:3300/0 conn(0x7fd3040a5c60 0x7fd304138250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 -- 172.21.15.88:0/3922284058 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3040a60d0 con 0x7fd30405b960 2020-02-11T16:05:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3027fc700 1 --2- 172.21.15.88:0/3922284058 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd3040a28a0 0x7fd30409aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 --2- 172.21.15.88:0/3922284058 >> v2:172.21.15.88:3300/0 conn(0x7fd30405b960 0x7fd3040a67e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2f8002f30 tx=0x7fd2f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 --2- 172.21.15.88:0/3922284058 >> v2:172.21.15.88:3300/0 conn(0x7fd30405b960 0x7fd3040a67e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2f8002f30 tx=0x7fd2f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 --2- 172.21.15.88:0/3922284058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30405b960 0x7fd3040a67e0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fd2f8002f30 tx=0x7fd2f8007a40).ready entity=mon.1 client_cookie=7de5810bd5623ada server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 --2- 172.21.15.88:0/3922284058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30405b960 0x7fd3040a67e0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fd2f8002f30 tx=0x7fd2f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd301ffb700 1 -- 172.21.15.88:0/3922284058 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f8011720 con 0x7fd30405b960 2020-02-11T16:05:33.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 --2- 172.21.15.88:0/3922284058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30405b960 0x7fd3040a67e0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fd2f8002f30 tx=0x7fd2f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd302ffd700 1 --2- 172.21.15.88:0/3922284058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30405b960 0x7fd3040a67e0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fd2f8002f30 tx=0x7fd2f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd301ffb700 1 -- 172.21.15.88:0/3922284058 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f8011880 con 0x7fd30405b960 2020-02-11T16:05:33.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd301ffb700 1 -- 172.21.15.88:0/3922284058 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f8011c60 con 0x7fd30405b960 2020-02-11T16:05:33.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3095d5700 1 -- 172.21.15.88:0/3922284058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30405b960 msgr2=0x7fd3040a67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.333+0000 7fd3095d5700 1 --2- 172.21.15.88:0/3922284058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30405b960 0x7fd3040a67e0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fd2f8002f30 tx=0x7fd2f8007a40).stop 2020-02-11T16:05:33.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.334+0000 7fd3095d5700 1 -- 172.21.15.88:0/3922284058 shutdown_connections 2020-02-11T16:05:33.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.334+0000 7fd3095d5700 1 --2- 172.21.15.88:0/3922284058 >> v2:172.21.15.52:3300/0 conn(0x7fd3040a5c60 0x7fd304138250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:33.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.334+0000 7fd3095d5700 1 --2- 172.21.15.88:0/3922284058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30405b960 0x7fd3040a67e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.334+0000 7fd3095d5700 1 --2- 172.21.15.88:0/3922284058 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd3040a28a0 0x7fd30409aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:33.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.334+0000 7fd3095d5700 1 -- 172.21.15.88:0/3922284058 >> 172.21.15.88:0/3922284058 conn(0x7fd3040aac40 msgr2=0x7fd3040a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.334+0000 7fd3095d5700 1 -- 172.21.15.88:0/3922284058 shutdown_connections 2020-02-11T16:05:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.334+0000 7fd3095d5700 1 -- 172.21.15.88:0/3922284058 wait complete. 2020-02-11T16:05:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.335+0000 7fd3095d5700 1 Processor -- start 2020-02-11T16:05:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.335+0000 7fd3095d5700 1 -- start start 2020-02-11T16:05:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.335+0000 7fd3095d5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd30405b960 0x7fd304135e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.335+0000 7fd3095d5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd3040a5c60 0x7fd3041461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.335+0000 7fd3095d5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd304138a50 con 0x7fd3040a28a0 2020-02-11T16:05:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.335+0000 7fd3095d5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd304131d00 con 0x7fd30405b960 2020-02-11T16:05:33.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.335+0000 7fd3095d5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3040a6f60 con 0x7fd3040a5c60 2020-02-11T16:05:33.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd3040a5c60 0x7fd3041461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd3040a5c60 0x7fd3041461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51288/0 (socket says 172.21.15.88:51288) 2020-02-11T16:05:33.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 -- 172.21.15.88:0/158642898 learned_addr learned my addr 172.21.15.88:0/158642898 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:33.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd302ffd700 1 --2- 172.21.15.88:0/158642898 >> v2:172.21.15.52:3300/0 conn(0x7fd30405b960 0x7fd304135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 -- 172.21.15.88:0/158642898 >> v2:172.21.15.52:3300/0 conn(0x7fd30405b960 msgr2=0x7fd304135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> v2:172.21.15.52:3300/0 conn(0x7fd30405b960 0x7fd304135e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 -- 172.21.15.88:0/158642898 >> v1:172.21.15.52:6789/0 conn(0x7fd3040a28a0 legacy=0x7fd304145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 -- 172.21.15.88:0/158642898 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd304134620 con 0x7fd3040a5c60 2020-02-11T16:05:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> v2:172.21.15.88:3300/0 conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> v2:172.21.15.88:3300/0 conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd2f3fff700 1 -- 172.21.15.88:0/158642898 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2fc005e30 con 0x7fd3040a5c60 2020-02-11T16:05:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd2f3fff700 1 -- 172.21.15.88:0/158642898 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc007540 con 0x7fd3040a5c60 2020-02-11T16:05:33.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3095d5700 1 -- 172.21.15.88:0/158642898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3041348c0 con 0x7fd3040a5c60 2020-02-11T16:05:33.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd2f3fff700 1 -- 172.21.15.88:0/158642898 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2fc0124b0 con 0x7fd3040a5c60 2020-02-11T16:05:33.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.336+0000 7fd3095d5700 1 -- 172.21.15.88:0/158642898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd304134e00 con 0x7fd3040a5c60 2020-02-11T16:05:33.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.337+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.337+0000 7fd2f3fff700 1 -- 172.21.15.88:0/158642898 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fd2fc010180 con 0x7fd3040a5c60 2020-02-11T16:05:33.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.337+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.337+0000 7fd3095d5700 1 -- 172.21.15.88:0/158642898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd304134fc0 con 0x7fd3040a5c60 2020-02-11T16:05:33.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.337+0000 7fd2f3fff700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd2e0039cb0 0x7fd2e003c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.337+0000 7fd2f3fff700 1 -- 172.21.15.88:0/158642898 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd2fc049980 con 0x7fd3040a5c60 2020-02-11T16:05:33.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.337+0000 7fd302ffd700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd2e0039cb0 0x7fd2e003c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.338+0000 7fd302ffd700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd2e0039cb0 0x7fd2e003c170 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.340+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.340+0000 7fd2f3fff700 1 -- 172.21.15.88:0/158642898 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd2fc02eef0 con 0x7fd3040a5c60 2020-02-11T16:05:33.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.475+0000 7fd3095d5700 1 -- 172.21.15.88:0/158642898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd3040565b0 con 0x7fd3040a5c60 2020-02-11T16:05:33.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.476+0000 7fd3037fe700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.476+0000 7fd2f3fff700 1 -- 172.21.15.88:0/158642898 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2fc031a00 con 0x7fd3040a5c60 2020-02-11T16:05:33.479 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:33.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 -- 172.21.15.88:0/158642898 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd2e0039cb0 msgr2=0x7fd2e003c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd2e0039cb0 0x7fd2e003c170 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 -- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 msgr2=0x7fd3041461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 0x7fd3041461d0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fd2fc0032b0 tx=0x7fd2fc010e10).stop 2020-02-11T16:05:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 -- 172.21.15.88:0/158642898 shutdown_connections 2020-02-11T16:05:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a5c60 0x7fd3041461d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 --2- 172.21.15.88:0/158642898 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd2e0039cb0 0x7fd2e003c170 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 --2- 172.21.15.88:0/158642898 >> v2:172.21.15.52:3300/0 conn(0x7fd30405b960 0x7fd304135e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 -- 172.21.15.88:0/158642898 >> 172.21.15.88:0/158642898 conn(0x7fd3040aac40 msgr2=0x7fd3040a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 -- 172.21.15.88:0/158642898 shutdown_connections 2020-02-11T16:05:33.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.477+0000 7fd3095d5700 1 -- 172.21.15.88:0/158642898 wait complete. 2020-02-11T16:05:33.490 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-02-11T16:05:33.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.592+0000 7fb382807700 1 Processor -- start 2020-02-11T16:05:33.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.592+0000 7fb382807700 1 -- start start 2020-02-11T16:05:33.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.593+0000 7fb382807700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb37c05c1f0 0x7fb37c137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:33.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.593+0000 7fb382807700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:33.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.593+0000 7fb382807700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37c1382e0 con 0x7fb37c0a1e50 2020-02-11T16:05:33.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.593+0000 7fb382807700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c138580 con 0x7fb37c05c1f0 2020-02-11T16:05:33.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.593+0000 7fb382807700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c138820 con 0x7fb37c134e30 2020-02-11T16:05:33.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.593+0000 7fb37bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb37c05c1f0 0x7fb37c137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.593+0000 7fb380da4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb37b7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb37c0a1e50 0x7fb37c0a3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:58932/0 (socket says 172.21.15.88:58932) 2020-02-11T16:05:33.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb37b7fe700 1 -- 172.21.15.88:0/459338929 learned_addr learned my addr 172.21.15.88:0/459338929 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:33.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb380da4700 1 -- 172.21.15.88:0/459338929 >> v2:172.21.15.52:3300/0 conn(0x7fb37c05c1f0 msgr2=0x7fb37c137cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:33.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb380da4700 1 --2- 172.21.15.88:0/459338929 >> v2:172.21.15.52:3300/0 conn(0x7fb37c05c1f0 0x7fb37c137cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:33.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb380da4700 1 -- 172.21.15.88:0/459338929 >> v1:172.21.15.52:6789/0 conn(0x7fb37c0a1e50 legacy=0x7fb37c0a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb380da4700 1 -- 172.21.15.88:0/459338929 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c135720 con 0x7fb37c134e30 2020-02-11T16:05:33.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb380da4700 1 --2- 172.21.15.88:0/459338929 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1352c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb3740032b0 tx=0x7fb374008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb380da4700 1 --2- 172.21.15.88:0/459338929 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1352c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb3740032b0 tx=0x7fb374008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb380da4700 1 --2- 172.21.15.88:0/459338929 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1352c0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7fb3740032b0 tx=0x7fb374008c60).ready entity=mon.2 client_cookie=ee46de35243520de server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb380da4700 1 --2- 172.21.15.88:0/459338929 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1352c0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb3740032b0 tx=0x7fb374008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb37affd700 1 -- 172.21.15.88:0/459338929 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb374011e60 con 0x7fb37c134e30 2020-02-11T16:05:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb380da4700 1 --2- 172.21.15.88:0/459338929 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1352c0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb3740032b0 tx=0x7fb374008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb380da4700 1 --2- 172.21.15.88:0/459338929 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1352c0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb3740032b0 tx=0x7fb374008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb37affd700 1 -- 172.21.15.88:0/459338929 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37400a160 con 0x7fb37c134e30 2020-02-11T16:05:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb37affd700 1 -- 172.21.15.88:0/459338929 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb37400a500 con 0x7fb37c134e30 2020-02-11T16:05:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb382807700 1 -- 172.21.15.88:0/459338929 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 msgr2=0x7fb37c1352c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.594+0000 7fb382807700 1 --2- 172.21.15.88:0/459338929 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1352c0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7fb3740032b0 tx=0x7fb374008c60).stop 2020-02-11T16:05:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.595+0000 7fb382807700 1 -- 172.21.15.88:0/459338929 shutdown_connections 2020-02-11T16:05:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.595+0000 7fb382807700 1 --2- 172.21.15.88:0/459338929 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1352c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.595+0000 7fb382807700 1 --2- 172.21.15.88:0/459338929 >> v2:172.21.15.52:3300/0 conn(0x7fb37c05c1f0 0x7fb37c137cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.595+0000 7fb382807700 1 -- 172.21.15.88:0/459338929 >> 172.21.15.88:0/459338929 conn(0x7fb37c0ab400 msgr2=0x7fb37c0a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.595+0000 7fb382807700 1 -- 172.21.15.88:0/459338929 shutdown_connections 2020-02-11T16:05:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.595+0000 7fb382807700 1 -- 172.21.15.88:0/459338929 wait complete. 2020-02-11T16:05:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.596+0000 7fb382807700 1 Processor -- start 2020-02-11T16:05:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.596+0000 7fb382807700 1 -- start start 2020-02-11T16:05:33.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.596+0000 7fb382807700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb37c05c1f0 0x7fb37c062f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.596+0000 7fb382807700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.596+0000 7fb382807700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37c0637b0 con 0x7fb37c0a1e50 2020-02-11T16:05:33.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.596+0000 7fb382807700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c145ce0 con 0x7fb37c05c1f0 2020-02-11T16:05:33.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.596+0000 7fb382807700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c144e90 con 0x7fb37c134e30 2020-02-11T16:05:33.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.596+0000 7fb37bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb37c05c1f0 0x7fb37c062f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.596+0000 7fb37bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb37c05c1f0 0x7fb37c062f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51302/0 (socket says 172.21.15.88:51302) 2020-02-11T16:05:33.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.596+0000 7fb37bfff700 1 -- 172.21.15.88:0/4005684041 learned_addr learned my addr 172.21.15.88:0/4005684041 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:33.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb380da4700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb37bfff700 1 -- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 msgr2=0x7fb37c1477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb37bfff700 1 -- 172.21.15.88:0/4005684041 >> v1:172.21.15.88:6789/0 conn(0x7fb37c0a1e50 legacy=0x7fb37c1455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb3797fa700 1 -- 172.21.15.88:0/4005684041 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958776799 0 0) 0x7fb37c0637b0 con 0x7fb37c0a1e50 2020-02-11T16:05:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb37bfff700 1 -- 172.21.15.88:0/4005684041 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c145130 con 0x7fb37c05c1f0 2020-02-11T16:05:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb380da4700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> v2:172.21.15.88:3300/0 conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> v2:172.21.15.88:3300/0 conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb3797fa700 1 -- 172.21.15.88:0/4005684041 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb36c005e90 con 0x7fb37c05c1f0 2020-02-11T16:05:33.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb3797fa700 1 -- 172.21.15.88:0/4005684041 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c007160 con 0x7fb37c05c1f0 2020-02-11T16:05:33.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb3797fa700 1 -- 172.21.15.88:0/4005684041 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb36c007540 con 0x7fb37c05c1f0 2020-02-11T16:05:33.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb382807700 1 -- 172.21.15.88:0/4005684041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c146250 con 0x7fb37c05c1f0 2020-02-11T16:05:33.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.597+0000 7fb382807700 1 -- 172.21.15.88:0/4005684041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c0633e0 con 0x7fb37c05c1f0 2020-02-11T16:05:33.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.598+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.598+0000 7fb3797fa700 1 -- 172.21.15.88:0/4005684041 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fb36c012470 con 0x7fb37c05c1f0 2020-02-11T16:05:33.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.598+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.598+0000 7fb382807700 1 -- 172.21.15.88:0/4005684041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c062c60 con 0x7fb37c05c1f0 2020-02-11T16:05:33.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.598+0000 7fb3797fa700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb35c039bd0 0x7fb35c03c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.598+0000 7fb3797fa700 1 -- 172.21.15.88:0/4005684041 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb36c04a070 con 0x7fb37c05c1f0 2020-02-11T16:05:33.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.598+0000 7fb37b7fe700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb35c039bd0 0x7fb35c03c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.599+0000 7fb37b7fe700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb35c039bd0 0x7fb35c03c090 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.601+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.601+0000 7fb3797fa700 1 -- 172.21.15.88:0/4005684041 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb36c02f620 con 0x7fb37c05c1f0 2020-02-11T16:05:33.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.738+0000 7fb382807700 1 -- 172.21.15.88:0/4005684041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb37c145330 con 0x7fb37c05c1f0 2020-02-11T16:05:33.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.738+0000 7fb37bfff700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.738+0000 7fb3797fa700 1 -- 172.21.15.88:0/4005684041 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+64 (secure 0 0 0) 0x7fb37c145330 con 0x7fb37c05c1f0 2020-02-11T16:05:33.741 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:33.742 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2020-02-11T16:05:33.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:33.742 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2020-02-11T16:05:33.742 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "rbd" 2020-02-11T16:05:33.742 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:33.742 INFO:teuthology.orchestra.run.smithi088.stdout:] 2020-02-11T16:05:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 -- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb35c039bd0 msgr2=0x7fb35c03c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb35c039bd0 0x7fb35c03c090 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 -- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 msgr2=0x7fb37c062f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 0x7fb37c062f80 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fb36c003070 tx=0x7fb36c010d70).stop 2020-02-11T16:05:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 -- 172.21.15.88:0/4005684041 shutdown_connections 2020-02-11T16:05:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb35c039bd0 0x7fb35c03c090 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb37c134e30 0x7fb37c1477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 --2- 172.21.15.88:0/4005684041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c05c1f0 0x7fb37c062f80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 -- 172.21.15.88:0/4005684041 >> 172.21.15.88:0/4005684041 conn(0x7fb37c0ab400 msgr2=0x7fb37c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 -- 172.21.15.88:0/4005684041 shutdown_connections 2020-02-11T16:05:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.739+0000 7fb382807700 1 -- 172.21.15.88:0/4005684041 wait complete. 2020-02-11T16:05:33.753 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-02-11T16:05:33.754 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-02-11T16:05:33.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.858+0000 7f0809859700 1 Processor -- start 2020-02-11T16:05:33.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.858+0000 7f0809859700 1 -- start start 2020-02-11T16:05:33.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.859+0000 7f0809859700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f080405b960 0x7f0804138270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:33.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.859+0000 7f0809859700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08040a4a80 0x7f08040a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:33.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.859+0000 7f0809859700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0804137900 con 0x7f08040a4140 2020-02-11T16:05:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.859+0000 7f0809859700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0804137b30 con 0x7f080405b960 2020-02-11T16:05:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.859+0000 7f0809859700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0804137dd0 con 0x7f08040a4a80 2020-02-11T16:05:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.859+0000 7f0802ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f080405b960 0x7f0804138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.859+0000 7f0802ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f080405b960 0x7f0804138270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51306/0 (socket says 172.21.15.88:51306) 2020-02-11T16:05:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.859+0000 7f0802ffd700 1 -- 172.21.15.88:0/2664257045 learned_addr learned my addr 172.21.15.88:0/2664257045 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.859+0000 7f08027fc700 1 --2- 172.21.15.88:0/2664257045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08040a4a80 0x7f08040a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0802ffd700 1 -- 172.21.15.88:0/2664257045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08040a4a80 msgr2=0x7f08040a3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:33.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0802ffd700 1 --2- 172.21.15.88:0/2664257045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08040a4a80 0x7f08040a3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:33.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0802ffd700 1 -- 172.21.15.88:0/2664257045 >> v1:172.21.15.52:6789/0 conn(0x7f08040a4140 legacy=0x7f08040a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:33.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0802ffd700 1 -- 172.21.15.88:0/2664257045 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040a6870 con 0x7f080405b960 2020-02-11T16:05:33.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f08027fc700 1 --2- 172.21.15.88:0/2664257045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08040a4a80 0x7f08040a3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:33.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0802ffd700 1 --2- 172.21.15.88:0/2664257045 >> v2:172.21.15.88:3300/0 conn(0x7f080405b960 0x7f0804138270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0804138150 tx=0x7f07f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0802ffd700 1 --2- 172.21.15.88:0/2664257045 >> v2:172.21.15.88:3300/0 conn(0x7f080405b960 0x7f0804138270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0804138150 tx=0x7f07f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0802ffd700 1 --2- 172.21.15.88:0/2664257045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f080405b960 0x7f0804138270 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f0804138150 tx=0x7f07f80088e0).ready entity=mon.1 client_cookie=b3748e1f846df8df server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0802ffd700 1 --2- 172.21.15.88:0/2664257045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f080405b960 0x7f0804138270 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f0804138150 tx=0x7f07f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0801ffb700 1 -- 172.21.15.88:0/2664257045 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07f8011720 con 0x7f080405b960 2020-02-11T16:05:33.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0802ffd700 1 --2- 172.21.15.88:0/2664257045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f080405b960 0x7f0804138270 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f0804138150 tx=0x7f07f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0802ffd700 1 --2- 172.21.15.88:0/2664257045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f080405b960 0x7f0804138270 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f0804138150 tx=0x7f07f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0801ffb700 1 -- 172.21.15.88:0/2664257045 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f8011880 con 0x7f080405b960 2020-02-11T16:05:33.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0801ffb700 1 -- 172.21.15.88:0/2664257045 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07f8011c20 con 0x7f080405b960 2020-02-11T16:05:33.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0809859700 1 -- 172.21.15.88:0/2664257045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f080405b960 msgr2=0x7f0804138270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0809859700 1 --2- 172.21.15.88:0/2664257045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f080405b960 0x7f0804138270 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f0804138150 tx=0x7f07f80088e0).stop 2020-02-11T16:05:33.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0809859700 1 -- 172.21.15.88:0/2664257045 shutdown_connections 2020-02-11T16:05:33.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0809859700 1 --2- 172.21.15.88:0/2664257045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f080405b960 0x7f0804138270 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0809859700 1 --2- 172.21.15.88:0/2664257045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08040a4a80 0x7f08040a3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:33.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0809859700 1 -- 172.21.15.88:0/2664257045 >> 172.21.15.88:0/2664257045 conn(0x7f08040aac40 msgr2=0x7f08040a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0809859700 1 -- 172.21.15.88:0/2664257045 shutdown_connections 2020-02-11T16:05:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.860+0000 7f0809859700 1 -- 172.21.15.88:0/2664257045 wait complete. 2020-02-11T16:05:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.861+0000 7f0809859700 1 Processor -- start 2020-02-11T16:05:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.861+0000 7f0809859700 1 -- start start 2020-02-11T16:05:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f0809859700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f080405b960 0x7f0804134f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f0809859700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08040a4a80 0x7f0804099c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f0809859700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080409e140 con 0x7f08040a4140 2020-02-11T16:05:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f0809859700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08041316f0 con 0x7f080405b960 2020-02-11T16:05:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f0809859700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040a9500 con 0x7f08040a4a80 2020-02-11T16:05:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f08027fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f08040a4140 0x7f080409f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38938/0 (socket says 172.21.15.88:38938) 2020-02-11T16:05:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f08027fc700 1 -- 172.21.15.88:0/1210176424 learned_addr learned my addr 172.21.15.88:0/1210176424 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> v2:172.21.15.88:3300/0 conn(0x7f08040a4a80 0x7f0804099c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f0802ffd700 1 --2- 172.21.15.88:0/1210176424 >> v2:172.21.15.52:3300/0 conn(0x7f080405b960 0x7f0804134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f08037fe700 1 -- 172.21.15.88:0/1210176424 >> v2:172.21.15.52:3300/0 conn(0x7f080405b960 msgr2=0x7f0804134f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> v2:172.21.15.52:3300/0 conn(0x7f080405b960 0x7f0804134f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f08037fe700 1 -- 172.21.15.88:0/1210176424 >> v1:172.21.15.88:6789/0 conn(0x7f08040a4140 legacy=0x7f080409f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f07f3fff700 1 -- 172.21.15.88:0/1210176424 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689565178 0 0) 0x7f080409e140 con 0x7f08040a4140 2020-02-11T16:05:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f08037fe700 1 -- 172.21.15.88:0/1210176424 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080409fe40 con 0x7f08040a4a80 2020-02-11T16:05:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> v2:172.21.15.88:3300/0 conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> v2:172.21.15.88:3300/0 conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.862+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.863+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.863+0000 7f07f3fff700 1 -- 172.21.15.88:0/1210176424 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07fc0122a0 con 0x7f08040a4a80 2020-02-11T16:05:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.863+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.863+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.863+0000 7f07f3fff700 1 -- 172.21.15.88:0/1210176424 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc012400 con 0x7f08040a4a80 2020-02-11T16:05:33.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.863+0000 7f0809859700 1 -- 172.21.15.88:0/1210176424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0804132000 con 0x7f08040a4a80 2020-02-11T16:05:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.863+0000 7f07f3fff700 1 -- 172.21.15.88:0/1210176424 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07fc0127e0 con 0x7f08040a4a80 2020-02-11T16:05:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.863+0000 7f0809859700 1 -- 172.21.15.88:0/1210176424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0804128220 con 0x7f08040a4a80 2020-02-11T16:05:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.863+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.864+0000 7f07f3fff700 1 -- 172.21.15.88:0/1210176424 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f07fc012a50 con 0x7f08040a4a80 2020-02-11T16:05:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.864+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.864+0000 7f0809859700 1 -- 172.21.15.88:0/1210176424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0804131ab0 con 0x7f08040a4a80 2020-02-11T16:05:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.864+0000 7f07f3fff700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f07e0039c90 0x7f07e003c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:33.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.864+0000 7f07f3fff700 1 -- 172.21.15.88:0/1210176424 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f07fc049fc0 con 0x7f08040a4a80 2020-02-11T16:05:33.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.864+0000 7f0802ffd700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f07e0039c90 0x7f07e003c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:33.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.864+0000 7f0802ffd700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f07e0039c90 0x7f07e003c150 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:33.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.867+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:33.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:33.867+0000 7f07f3fff700 1 -- 172.21.15.88:0/1210176424 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f07fc02f480 con 0x7f08040a4a80 2020-02-11T16:05:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.005+0000 7f0809859700 1 -- 172.21.15.88:0/1210176424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f08040565b0 con 0x7f08040a4a80 2020-02-11T16:05:34.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.946+0000 7f08037fe700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:34.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.947+0000 7f07f3fff700 1 -- 172.21.15.88:0/1210176424 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f07fc032160 con 0x7f08040a4a80 2020-02-11T16:05:34.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 -- 172.21.15.88:0/1210176424 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f07e0039c90 msgr2=0x7f07e003c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:34.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f07e0039c90 0x7f07e003c150 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:34.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 -- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 msgr2=0x7f0804099c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:34.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 0x7f0804099c10 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f07fc002360 tx=0x7f07fc010c00).stop 2020-02-11T16:05:34.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 -- 172.21.15.88:0/1210176424 shutdown_connections 2020-02-11T16:05:34.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08040a4a80 0x7f0804099c10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:34.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 --2- 172.21.15.88:0/1210176424 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f07e0039c90 0x7f07e003c150 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:34.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 --2- 172.21.15.88:0/1210176424 >> v2:172.21.15.52:3300/0 conn(0x7f080405b960 0x7f0804134f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:34.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 -- 172.21.15.88:0/1210176424 >> 172.21.15.88:0/1210176424 conn(0x7f08040aac40 msgr2=0x7f08040a8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:34.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 -- 172.21.15.88:0/1210176424 shutdown_connections 2020-02-11T16:05:34.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:34.950+0000 7f0809859700 1 -- 172.21.15.88:0/1210176424 wait complete. 2020-02-11T16:05:34.955 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2020-02-11T16:05:34.966 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-02-11T16:05:34.966 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-02-11T16:05:35.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.078+0000 7f1b0d948700 1 Processor -- start 2020-02-11T16:05:35.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.078+0000 7f1b0d948700 1 -- start start 2020-02-11T16:05:35.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.078+0000 7f1b0d948700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b080a18a0 0x7f1b080a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:35.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.078+0000 7f1b0d948700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:35.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.078+0000 7f1b0d948700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b080a3570 con 0x7f1b080a5de0 2020-02-11T16:05:35.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.078+0000 7f1b0d948700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080a3810 con 0x7f1b080a18a0 2020-02-11T16:05:35.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.078+0000 7f1b0d948700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080a3ab0 con 0x7f1b080a6260 2020-02-11T16:05:35.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:35.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:45642/0 (socket says 172.21.15.88:45642) 2020-02-11T16:05:35.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b06ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b080a18a0 0x7f1b080a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:35.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 -- 172.21.15.88:0/1242140775 learned_addr learned my addr 172.21.15.88:0/1242140775 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:35.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 -- 172.21.15.88:0/1242140775 >> v2:172.21.15.52:3300/0 conn(0x7f1b080a18a0 msgr2=0x7f1b080a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:35.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 --2- 172.21.15.88:0/1242140775 >> v2:172.21.15.52:3300/0 conn(0x7f1b080a18a0 0x7f1b080a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:35.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 -- 172.21.15.88:0/1242140775 >> v1:172.21.15.52:6789/0 conn(0x7f1b080a5de0 legacy=0x7f1b0812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:35.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 -- 172.21.15.88:0/1242140775 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b080a3d50 con 0x7f1b080a6260 2020-02-11T16:05:35.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 --2- 172.21.15.88:0/1242140775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1b000032b0 tx=0x7f1b00008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 --2- 172.21.15.88:0/1242140775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1b000032b0 tx=0x7f1b00008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 --2- 172.21.15.88:0/1242140775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f1b000032b0 tx=0x7f1b00008c60).ready entity=mon.2 client_cookie=2bd006901d81dd0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:35.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 --2- 172.21.15.88:0/1242140775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1b000032b0 tx=0x7f1b00008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b067fc700 1 -- 172.21.15.88:0/1242140775 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b0000a160 con 0x7f1b080a6260 2020-02-11T16:05:35.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 --2- 172.21.15.88:0/1242140775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1b000032b0 tx=0x7f1b00008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b067fc700 1 -- 172.21.15.88:0/1242140775 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0000a2c0 con 0x7f1b080a6260 2020-02-11T16:05:35.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b077fe700 1 --2- 172.21.15.88:0/1242140775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1b000032b0 tx=0x7f1b00008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b067fc700 1 -- 172.21.15.88:0/1242140775 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b0000a6a0 con 0x7f1b080a6260 2020-02-11T16:05:35.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b0d948700 1 -- 172.21.15.88:0/1242140775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 msgr2=0x7f1b0812eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:35.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.079+0000 7f1b0d948700 1 --2- 172.21.15.88:0/1242140775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f1b000032b0 tx=0x7f1b00008c60).stop 2020-02-11T16:05:35.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.080+0000 7f1b0d948700 1 -- 172.21.15.88:0/1242140775 shutdown_connections 2020-02-11T16:05:35.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.080+0000 7f1b0d948700 1 --2- 172.21.15.88:0/1242140775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a6260 0x7f1b0812eab0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:35.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.080+0000 7f1b0d948700 1 --2- 172.21.15.88:0/1242140775 >> v2:172.21.15.52:3300/0 conn(0x7f1b080a18a0 0x7f1b080a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:35.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.080+0000 7f1b0d948700 1 -- 172.21.15.88:0/1242140775 >> 172.21.15.88:0/1242140775 conn(0x7f1b0809d110 msgr2=0x7f1b0809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:35.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.080+0000 7f1b0d948700 1 -- 172.21.15.88:0/1242140775 shutdown_connections 2020-02-11T16:05:35.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.080+0000 7f1b0d948700 1 -- 172.21.15.88:0/1242140775 wait complete. 2020-02-11T16:05:35.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.081+0000 7f1b0d948700 1 Processor -- start 2020-02-11T16:05:35.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.081+0000 7f1b0d948700 1 -- start start 2020-02-11T16:05:35.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.081+0000 7f1b0d948700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a18a0 0x7f1b0809e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:35.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.081+0000 7f1b0d948700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b080a5de0 0x7f1b081305d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:35.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.081+0000 7f1b0d948700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0809e8a0 con 0x7f1b080a6260 2020-02-11T16:05:35.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.081+0000 7f1b0d948700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b08131d50 con 0x7f1b080a5de0 2020-02-11T16:05:35.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.081+0000 7f1b0d948700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08135850 con 0x7f1b080a18a0 2020-02-11T16:05:35.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b080a5de0 0x7f1b081305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:35.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b080a5de0 0x7f1b081305d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51324/0 (socket says 172.21.15.88:51324) 2020-02-11T16:05:35.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 -- 172.21.15.88:0/3661492641 learned_addr learned my addr 172.21.15.88:0/3661492641 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:35.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1b06ffd700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a18a0 0x7f1b0809e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:35.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 -- 172.21.15.88:0/3661492641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a18a0 msgr2=0x7f1b0809e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:35.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a18a0 0x7f1b0809e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:35.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 -- 172.21.15.88:0/3661492641 >> v1:172.21.15.52:6789/0 conn(0x7f1b080a6260 legacy=0x7f1b0812d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:35.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 -- 172.21.15.88:0/3661492641 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b081330a0 con 0x7f1b080a5de0 2020-02-11T16:05:35.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> v2:172.21.15.88:3300/0 conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> v2:172.21.15.88:3300/0 conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:35.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1b04ff9700 1 -- 172.21.15.88:0/3661492641 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1af000cc20 con 0x7f1b080a5de0 2020-02-11T16:05:35.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1b04ff9700 1 -- 172.21.15.88:0/3661492641 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af000cd80 con 0x7f1b080a5de0 2020-02-11T16:05:35.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1b0d948700 1 -- 172.21.15.88:0/3661492641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b08134130 con 0x7f1b080a5de0 2020-02-11T16:05:35.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1b04ff9700 1 -- 172.21.15.88:0/3661492641 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1af0012220 con 0x7f1b080a5de0 2020-02-11T16:05:35.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.082+0000 7f1b0d948700 1 -- 172.21.15.88:0/3661492641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b080a8ff0 con 0x7f1b080a5de0 2020-02-11T16:05:35.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.083+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.083+0000 7f1b04ff9700 1 -- 172.21.15.88:0/3661492641 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f1af00064e0 con 0x7f1b080a5de0 2020-02-11T16:05:35.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.083+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.083+0000 7f1b0d948700 1 -- 172.21.15.88:0/3661492641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b080565b0 con 0x7f1b080a5de0 2020-02-11T16:05:35.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.083+0000 7f1b04ff9700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1aec039d00 0x7f1aec03c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:35.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.083+0000 7f1b04ff9700 1 -- 172.21.15.88:0/3661492641 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5207+0+0 (secure 0 0 0) 0x7f1af00495e0 con 0x7f1b080a5de0 2020-02-11T16:05:35.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.083+0000 7f1b06ffd700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1aec039d00 0x7f1aec03c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:35.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.084+0000 7f1b06ffd700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1aec039d00 0x7f1aec03c1c0 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:35.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.087+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.087+0000 7f1b04ff9700 1 -- 172.21.15.88:0/3661492641 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f1af002ebf0 con 0x7f1b080a5de0 2020-02-11T16:05:35.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.233+0000 7f1b0d948700 1 -- 172.21.15.88:0/3661492641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f1b08132440 con 0x7f1b080a5de0 2020-02-11T16:05:35.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.948+0000 7f1afe7fc700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:35.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.948+0000 7f1b04ff9700 1 -- 172.21.15.88:0/3661492641 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v19) v1 ==== 154+0+0 (secure 0 0 0) 0x7f1af0031700 con 0x7f1b080a5de0 2020-02-11T16:05:35.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.952+0000 7f1b0d948700 1 -- 172.21.15.88:0/3661492641 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1aec039d00 msgr2=0x7f1aec03c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:35.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.952+0000 7f1b0d948700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1aec039d00 0x7f1aec03c1c0 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.952+0000 7f1b0d948700 1 -- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 msgr2=0x7f1b081305d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.952+0000 7f1b0d948700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 0x7f1b081305d0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f1b0805ee20 tx=0x7f1af000c490).stop 2020-02-11T16:05:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.952+0000 7f1b0d948700 1 -- 172.21.15.88:0/3661492641 shutdown_connections 2020-02-11T16:05:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.952+0000 7f1b0d948700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1aec039d00 0x7f1aec03c1c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.952+0000 7f1b0d948700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b080a18a0 0x7f1b0809e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.952+0000 7f1b0d948700 1 --2- 172.21.15.88:0/3661492641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b080a5de0 0x7f1b081305d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.952+0000 7f1b0d948700 1 -- 172.21.15.88:0/3661492641 >> 172.21.15.88:0/3661492641 conn(0x7f1b0809d110 msgr2=0x7f1b080a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:35.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.953+0000 7f1b0d948700 1 -- 172.21.15.88:0/3661492641 shutdown_connections 2020-02-11T16:05:35.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:35.953+0000 7f1b0d948700 1 -- 172.21.15.88:0/3661492641 wait complete. 2020-02-11T16:05:35.968 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 erasure cephfs_data 2020-02-11T16:05:36.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.080+0000 7f52414f1700 1 Processor -- start 2020-02-11T16:05:36.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.080+0000 7f52414f1700 1 -- start start 2020-02-11T16:05:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f52414f1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f523c0a9730 0x7f523c05e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f52414f1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f523c13bd40 0x7f523c066890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f52414f1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f523c066cf0 0x7f523c0a5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f52414f1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c13c1f0 con 0x7f523c066cf0 2020-02-11T16:05:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f52414f1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c13b3a0 con 0x7f523c0a9730 2020-02-11T16:05:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f52414f1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c13b600 con 0x7f523c13bd40 2020-02-11T16:05:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f523c0a9730 0x7f523c05e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f523c0a9730 0x7f523c05e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51334/0 (socket says 172.21.15.88:51334) 2020-02-11T16:05:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 -- 172.21.15.88:0/2705067128 learned_addr learned my addr 172.21.15.88:0/2705067128 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f5240cf0700 1 --2- 172.21.15.88:0/2705067128 >> v2:172.21.15.52:3300/0 conn(0x7f523c066cf0 0x7f523c0a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 -- 172.21.15.88:0/2705067128 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f523c13bd40 msgr2=0x7f523c066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 --2- 172.21.15.88:0/2705067128 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f523c13bd40 0x7f523c066890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 -- 172.21.15.88:0/2705067128 >> v2:172.21.15.52:3300/0 conn(0x7f523c066cf0 msgr2=0x7f523c0a5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 --2- 172.21.15.88:0/2705067128 >> v2:172.21.15.52:3300/0 conn(0x7f523c066cf0 0x7f523c0a5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 -- 172.21.15.88:0/2705067128 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c13b8a0 con 0x7f523c0a9730 2020-02-11T16:05:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f5240cf0700 1 --2- 172.21.15.88:0/2705067128 >> v2:172.21.15.52:3300/0 conn(0x7f523c066cf0 0x7f523c0a5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 --2- 172.21.15.88:0/2705067128 >> v2:172.21.15.88:3300/0 conn(0x7f523c0a9730 0x7f523c05e8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 --2- 172.21.15.88:0/2705067128 >> v2:172.21.15.88:3300/0 conn(0x7f523c0a9730 0x7f523c05e8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 --2- 172.21.15.88:0/2705067128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c0a9730 0x7f523c05e8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).ready entity=mon.1 client_cookie=cc4bf892ee2c758a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523bfff700 1 --2- 172.21.15.88:0/2705067128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c0a9730 0x7f523c05e8f0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.081+0000 7f523affd700 1 -- 172.21.15.88:0/2705067128 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f522c011720 con 0x7f523c0a9730 2020-02-11T16:05:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f523bfff700 1 --2- 172.21.15.88:0/2705067128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c0a9730 0x7f523c05e8f0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f523affd700 1 -- 172.21.15.88:0/2705067128 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c011880 con 0x7f523c0a9730 2020-02-11T16:05:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f523bfff700 1 --2- 172.21.15.88:0/2705067128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c0a9730 0x7f523c05e8f0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f52414f1700 1 -- 172.21.15.88:0/2705067128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c0a9730 msgr2=0x7f523c05e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f523affd700 1 -- 172.21.15.88:0/2705067128 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f522c011c60 con 0x7f523c0a9730 2020-02-11T16:05:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f52414f1700 1 --2- 172.21.15.88:0/2705067128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c0a9730 0x7f523c05e8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).stop 2020-02-11T16:05:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f52414f1700 1 -- 172.21.15.88:0/2705067128 shutdown_connections 2020-02-11T16:05:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f52414f1700 1 --2- 172.21.15.88:0/2705067128 >> v2:172.21.15.52:3300/0 conn(0x7f523c066cf0 0x7f523c0a5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:36.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f52414f1700 1 --2- 172.21.15.88:0/2705067128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c0a9730 0x7f523c05e8f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:36.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f52414f1700 1 --2- 172.21.15.88:0/2705067128 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f523c13bd40 0x7f523c066890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:36.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f52414f1700 1 -- 172.21.15.88:0/2705067128 >> 172.21.15.88:0/2705067128 conn(0x7f523c0ae440 msgr2=0x7f523c0ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f52414f1700 1 -- 172.21.15.88:0/2705067128 shutdown_connections 2020-02-11T16:05:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.082+0000 7f52414f1700 1 -- 172.21.15.88:0/2705067128 wait complete. 2020-02-11T16:05:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.083+0000 7f52414f1700 1 Processor -- start 2020-02-11T16:05:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.083+0000 7f52414f1700 1 -- start start 2020-02-11T16:05:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52414f1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f523c066cf0 0x7f523c136540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52414f1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f523c13bd40 0x7f523c1369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52414f1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c05fe80 con 0x7f523c0a9730 2020-02-11T16:05:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52414f1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c0a7d70 con 0x7f523c13bd40 2020-02-11T16:05:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52414f1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c132f70 con 0x7f523c066cf0 2020-02-11T16:05:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f523c066cf0 0x7f523c136540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f523c066cf0 0x7f523c136540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51336/0 (socket says 172.21.15.88:51336) 2020-02-11T16:05:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 -- 172.21.15.88:0/3317469726 learned_addr learned my addr 172.21.15.88:0/3317469726 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523b7fe700 1 --1- 172.21.15.88:0/3317469726 >> v1:172.21.15.88:6789/0 conn(0x7f523c0a9730 0x7f523c138090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38964/0 (socket says 172.21.15.88:38964) 2020-02-11T16:05:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f5240cf0700 1 --2- 172.21.15.88:0/3317469726 >> v2:172.21.15.52:3300/0 conn(0x7f523c13bd40 0x7f523c1369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 -- 172.21.15.88:0/3317469726 >> v2:172.21.15.52:3300/0 conn(0x7f523c13bd40 msgr2=0x7f523c1369a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52397fa700 1 -- 172.21.15.88:0/3317469726 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066499419 0 0) 0x7f523c05fe80 con 0x7f523c0a9730 2020-02-11T16:05:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> v2:172.21.15.52:3300/0 conn(0x7f523c13bd40 0x7f523c1369a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 -- 172.21.15.88:0/3317469726 >> v1:172.21.15.88:6789/0 conn(0x7f523c0a9730 legacy=0x7f523c138090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 -- 172.21.15.88:0/3317469726 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c133210 con 0x7f523c066cf0 2020-02-11T16:05:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> v2:172.21.15.88:3300/0 conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> v2:172.21.15.88:3300/0 conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52397fa700 1 -- 172.21.15.88:0/3317469726 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f522c007340 con 0x7f523c066cf0 2020-02-11T16:05:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52397fa700 1 -- 172.21.15.88:0/3317469726 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0074a0 con 0x7f523c066cf0 2020-02-11T16:05:36.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52414f1700 1 -- 172.21.15.88:0/3317469726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c1334b0 con 0x7f523c066cf0 2020-02-11T16:05:36.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52397fa700 1 -- 172.21.15.88:0/3317469726 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f522c0058b0 con 0x7f523c066cf0 2020-02-11T16:05:36.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.084+0000 7f52414f1700 1 -- 172.21.15.88:0/3317469726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c145520 con 0x7f523c066cf0 2020-02-11T16:05:36.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.085+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.085+0000 7f52397fa700 1 -- 172.21.15.88:0/3317469726 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f522c005ab0 con 0x7f523c066cf0 2020-02-11T16:05:36.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.085+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.085+0000 7f52414f1700 1 -- 172.21.15.88:0/3317469726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c133640 con 0x7f523c066cf0 2020-02-11T16:05:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.085+0000 7f52397fa700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f521c039a70 0x7f521c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.085+0000 7f52397fa700 1 -- 172.21.15.88:0/3317469726 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5463+0+0 (secure 0 0 0) 0x7f522c04a4b0 con 0x7f523c066cf0 2020-02-11T16:05:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.086+0000 7f523b7fe700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f521c039a70 0x7f521c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.086+0000 7f523b7fe700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f521c039a70 0x7f521c03bf30 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.089+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.089+0000 7f52397fa700 1 -- 172.21.15.88:0/3317469726 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f522c02fbc0 con 0x7f523c066cf0 2020-02-11T16:05:36.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:36.223+0000 7f52414f1700 1 -- 172.21.15.88:0/3317469726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f523c0565b0 con 0x7f523c066cf0 2020-02-11T16:05:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.955+0000 7f523bfff700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:37.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.956+0000 7f52397fa700 1 -- 172.21.15.88:0/3317469726 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v21) v1 ==== 188+0+0 (secure 0 0 0) 0x7f522c032690 con 0x7f523c066cf0 2020-02-11T16:05:37.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.959+0000 7f52414f1700 1 -- 172.21.15.88:0/3317469726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f521c039a70 msgr2=0x7f521c03bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:37.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.959+0000 7f52414f1700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f521c039a70 0x7f521c03bf30 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:37.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.959+0000 7f52414f1700 1 -- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 msgr2=0x7f523c136540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:37.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.959+0000 7f52414f1700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 0x7f523c136540 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f522c002f30 tx=0x7f522c007a40).stop 2020-02-11T16:05:37.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.959+0000 7f52414f1700 1 -- 172.21.15.88:0/3317469726 shutdown_connections 2020-02-11T16:05:37.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.959+0000 7f52414f1700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f521c039a70 0x7f521c03bf30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:37.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.959+0000 7f52414f1700 1 --2- 172.21.15.88:0/3317469726 >> v2:172.21.15.52:3300/0 conn(0x7f523c13bd40 0x7f523c1369a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:37.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.959+0000 7f52414f1700 1 --2- 172.21.15.88:0/3317469726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f523c066cf0 0x7f523c136540 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:37.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.960+0000 7f52414f1700 1 -- 172.21.15.88:0/3317469726 >> 172.21.15.88:0/3317469726 conn(0x7f523c0ae440 msgr2=0x7f523c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:37.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.960+0000 7f52414f1700 1 -- 172.21.15.88:0/3317469726 shutdown_connections 2020-02-11T16:05:37.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:37.960+0000 7f52414f1700 1 -- 172.21.15.88:0/3317469726 wait complete. 2020-02-11T16:05:37.964 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2020-02-11T16:05:37.975 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool set cephfs_data allow_ec_overwrites true 2020-02-11T16:05:38.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.086+0000 7f33d864c700 1 Processor -- start 2020-02-11T16:05:38.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.086+0000 7f33d864c700 1 -- start start 2020-02-11T16:05:38.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d864c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f33d005b960 0x7f33d00a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:38.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d864c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d00a28a0 0x7f33d009aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:38.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d864c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d00a4160 con 0x7f33d00a5c60 2020-02-11T16:05:38.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d864c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d009d950 con 0x7f33d005b960 2020-02-11T16:05:38.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d864c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d009dbf0 con 0x7f33d00a28a0 2020-02-11T16:05:38.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d6be9700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f33d00a5c60 0x7f33d0138250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38974/0 (socket says 172.21.15.88:38974) 2020-02-11T16:05:38.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d6be9700 1 -- 172.21.15.88:0/3569100067 learned_addr learned my addr 172.21.15.88:0/3569100067 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:38.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d63e8700 1 --2- 172.21.15.88:0/3569100067 >> v2:172.21.15.52:3300/0 conn(0x7f33d005b960 0x7f33d00a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d5be7700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d00a28a0 0x7f33d009aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031509620 0 0) 0x7f33d00a4160 con 0x7f33d00a5c60 2020-02-11T16:05:38.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b8003230 con 0x7f33d00a5c60 2020-02-11T16:05:38.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1851270759 0 0) 0x7f33b8003230 con 0x7f33d00a5c60 2020-02-11T16:05:38.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d00a28a0 msgr2=0x7f33d009aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:38.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d00a28a0 0x7f33d009aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:38.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 >> v2:172.21.15.52:3300/0 conn(0x7f33d005b960 msgr2=0x7f33d00a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:38.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 --2- 172.21.15.88:0/3569100067 >> v2:172.21.15.52:3300/0 conn(0x7f33d005b960 0x7f33d00a67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:38.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00a60d0 con 0x7f33d00a5c60 2020-02-11T16:05:38.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f33cc0016d0 con 0x7f33d00a5c60 2020-02-11T16:05:38.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 >> v1:172.21.15.88:6789/0 conn(0x7f33d00a5c60 legacy=0x7f33d0138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:38.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.087+0000 7f33d53e6700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b8003720 0x7f33b8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:38.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d53e6700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d00a28a0 0x7f33b80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:38.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d53e6700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b8004930 0x7f33b8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:38.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d009d950 con 0x7f33b8004930 2020-02-11T16:05:38.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d009dbf0 con 0x7f33b8003720 2020-02-11T16:05:38.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80040f0 con 0x7f33d00a28a0 2020-02-11T16:05:38.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b8003720 0x7f33b8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d6be9700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b8004930 0x7f33b8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d5be7700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d00a28a0 0x7f33b80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 -- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d00a28a0 msgr2=0x7f33b80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:38.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d00a28a0 0x7f33b80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:38.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 -- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b8004930 msgr2=0x7f33b8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:38.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b8004930 0x7f33b8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:38.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 -- 172.21.15.88:0/3569100067 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8003230 con 0x7f33b8003720 2020-02-11T16:05:38.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d6be9700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b8004930 0x7f33b8004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:38.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b8003720 0x7f33b8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f33c80032b0 tx=0x7f33c80103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b8003720 0x7f33b8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f33c80032b0 tx=0x7f33c80103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b8003720 0x7f33b8003b40 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f33c80032b0 tx=0x7f33c80103d0).ready entity=mon.1 client_cookie=9cd04b03ea9b278d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:38.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b8003720 0x7f33b8003b40 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f33c80032b0 tx=0x7f33c80103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c80112b0 con 0x7f33b8003720 2020-02-11T16:05:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b8003720 0x7f33b8003b40 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f33c80032b0 tx=0x7f33c80103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d63e8700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b8003720 0x7f33b8003b40 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f33c80032b0 tx=0x7f33c80103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8011410 con 0x7f33b8003720 2020-02-11T16:05:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d53e6700 1 -- 172.21.15.88:0/3569100067 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c80117b0 con 0x7f33b8003720 2020-02-11T16:05:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d864c700 1 -- 172.21.15.88:0/3569100067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b8003720 msgr2=0x7f33b8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d864c700 1 --2- 172.21.15.88:0/3569100067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b8003720 0x7f33b8003b40 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f33c80032b0 tx=0x7f33c80103d0).stop 2020-02-11T16:05:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.088+0000 7f33d6be9700 1 -- 172.21.15.88:0/3569100067 reap_dead start 2020-02-11T16:05:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.089+0000 7f33d864c700 1 -- 172.21.15.88:0/3569100067 shutdown_connections 2020-02-11T16:05:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.089+0000 7f33d864c700 1 -- 172.21.15.88:0/3569100067 >> 172.21.15.88:0/3569100067 conn(0x7f33d00aac40 msgr2=0x7f33d00a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.089+0000 7f33d864c700 1 -- 172.21.15.88:0/3569100067 shutdown_connections 2020-02-11T16:05:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.089+0000 7f33d864c700 1 -- 172.21.15.88:0/3569100067 wait complete. 2020-02-11T16:05:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d864c700 1 Processor -- start 2020-02-11T16:05:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d864c700 1 -- start start 2020-02-11T16:05:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d864c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d009e340 0x7f33d0135520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d864c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f33d012c930 0x7f33d012cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d864c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d0135ae0 con 0x7f33d009ffc0 2020-02-11T16:05:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d864c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d00a4900 con 0x7f33d012c930 2020-02-11T16:05:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d864c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d009ec90 con 0x7f33d009e340 2020-02-11T16:05:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d5be7700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f33d009ffc0 0x7f33d00a0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38984/0 (socket says 172.21.15.88:38984) 2020-02-11T16:05:38.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d5be7700 1 -- 172.21.15.88:0/2109182262 learned_addr learned my addr 172.21.15.88:0/2109182262 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:38.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d6be9700 1 --2- 172.21.15.88:0/2109182262 >> v2:172.21.15.52:3300/0 conn(0x7f33d012c930 0x7f33d012cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33d63e8700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d009e340 0x7f33d0135520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243021854 0 0) 0x7f33d0135ae0 con 0x7f33d009ffc0 2020-02-11T16:05:38.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.090+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b0002fe0 con 0x7f33d009ffc0 2020-02-11T16:05:38.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2857674684 0 0) 0x7f33b0002fe0 con 0x7f33d009ffc0 2020-02-11T16:05:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f33d0135ae0 con 0x7f33d009ffc0 2020-02-11T16:05:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f33c4001490 con 0x7f33d009ffc0 2020-02-11T16:05:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d009e340 msgr2=0x7f33d0135520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d009e340 0x7f33d0135520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 >> v2:172.21.15.52:3300/0 conn(0x7f33d012c930 msgr2=0x7f33d012cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 --2- 172.21.15.88:0/2109182262 >> v2:172.21.15.52:3300/0 conn(0x7f33d012c930 0x7f33d012cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 >> v1:172.21.15.88:6789/0 conn(0x7f33d009ffc0 legacy=0x7f33d00a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b00049b0 0x7f33b0004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b00041c0 0x7f33b000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00a4900 con 0x7f33b00049b0 2020-02-11T16:05:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d009ec90 con 0x7f33b0003920 2020-02-11T16:05:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00046f0 con 0x7f33b00041c0 2020-02-11T16:05:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d6be9700 1 --2- 172.21.15.88:0/2109182262 >> v2:172.21.15.52:3300/0 conn(0x7f33d012c930 0x7f33d012cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d63e8700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33d009e340 0x7f33d0135520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d6be9700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b00041c0 0x7f33b000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d63e8700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b00049b0 0x7f33b0004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 -- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b00041c0 msgr2=0x7f33b000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b00041c0 0x7f33b000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 -- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b00049b0 msgr2=0x7f33b0004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b00049b0 0x7f33b0004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 -- 172.21.15.88:0/2109182262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d012e2a0 con 0x7f33b0003920 2020-02-11T16:05:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d864c700 1 -- 172.21.15.88:0/2109182262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d012e060 con 0x7f33b0003920 2020-02-11T16:05:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d63e8700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b00049b0 0x7f33b0004df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d864c700 1 -- 172.21.15.88:0/2109182262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d0135520 con 0x7f33b0003920 2020-02-11T16:05:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c4007540 con 0x7f33b0003920 2020-02-11T16:05:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c40059c0 con 0x7f33b0003920 2020-02-11T16:05:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.091+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c4005d60 con 0x7f33b0003920 2020-02-11T16:05:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.092+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.092+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f33c400a450 con 0x7f33b0003920 2020-02-11T16:05:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.092+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.092+0000 7f33d864c700 1 -- 172.21.15.88:0/2109182262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d00565b0 con 0x7f33b0003920 2020-02-11T16:05:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.092+0000 7f33c37fe700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f33b00423e0 0x7f33b00448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.092+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f33c404a6c0 con 0x7f33b0003920 2020-02-11T16:05:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.093+0000 7f33d63e8700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f33b00423e0 0x7f33b00448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.093+0000 7f33d63e8700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f33b00423e0 0x7f33b00448a0 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:38.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.096+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.096+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f33c402fd30 con 0x7f33b0003920 2020-02-11T16:05:38.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.231+0000 7f33d864c700 1 -- 172.21.15.88:0/2109182262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f33d005b3c0 con 0x7f33b0003920 2020-02-11T16:05:38.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.959+0000 7f33d5be7700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:38.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.959+0000 7f33c37fe700 1 -- 172.21.15.88:0/2109182262 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 3 allow_ec_overwrites to true v22) v1 ==== 166+0+0 (secure 0 0 0) 0x7f33c4032840 con 0x7f33b0003920 2020-02-11T16:05:38.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.963+0000 7f33d864c700 1 -- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f33b00423e0 msgr2=0x7f33b00448a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:38.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.963+0000 7f33d864c700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f33b00423e0 0x7f33b00448a0 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:38.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.963+0000 7f33d864c700 1 -- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 msgr2=0x7f33b0003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:38.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.963+0000 7f33d864c700 1 --2- 172.21.15.88:0/2109182262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33b0003920 0x7f33b0003d60 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f33c40082a0 tx=0x7f33c4011880).stop 2020-02-11T16:05:38.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.963+0000 7f33d6be9700 1 -- 172.21.15.88:0/2109182262 reap_dead start 2020-02-11T16:05:38.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.963+0000 7f33d6be9700 1 -- 172.21.15.88:0/2109182262 reap_dead start 2020-02-11T16:05:38.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.963+0000 7f33d864c700 1 -- 172.21.15.88:0/2109182262 shutdown_connections 2020-02-11T16:05:38.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.963+0000 7f33d864c700 1 -- 172.21.15.88:0/2109182262 >> 172.21.15.88:0/2109182262 conn(0x7f33d00aac40 msgr2=0x7f33d009d090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:38.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.963+0000 7f33d864c700 1 -- 172.21.15.88:0/2109182262 shutdown_connections 2020-02-11T16:05:38.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:38.963+0000 7f33d864c700 1 -- 172.21.15.88:0/2109182262 wait complete. 2020-02-11T16:05:38.970 INFO:teuthology.orchestra.run.smithi088.stderr:set pool 3 allow_ec_overwrites to true 2020-02-11T16:05:38.980 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-02-11T16:05:39.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.090+0000 7f2553be3700 1 Processor -- start 2020-02-11T16:05:39.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.090+0000 7f2553be3700 1 -- start start 2020-02-11T16:05:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.091+0000 7f2553be3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f254c0a4a80 0x7f254c0a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.091+0000 7f2553be3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c137900 con 0x7f254c0a4140 2020-02-11T16:05:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.091+0000 7f2553be3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c137b30 con 0x7f254c05b960 2020-02-11T16:05:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.091+0000 7f2553be3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254c137dd0 con 0x7f254c0a4a80 2020-02-11T16:05:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.091+0000 7f255117e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f254c0a4a80 0x7f254c0a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.091+0000 7f255117e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f254c0a4a80 0x7f254c0a3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51370/0 (socket says 172.21.15.88:51370) 2020-02-11T16:05:39.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.091+0000 7f255117e700 1 -- 172.21.15.88:0/1717659479 learned_addr learned my addr 172.21.15.88:0/1717659479 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:39.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.091+0000 7f255197f700 1 --1- 172.21.15.88:0/1717659479 >> v1:172.21.15.88:6789/0 conn(0x7f254c05b960 0x7f254c138270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38996/0 (socket says 172.21.15.88:38996) 2020-02-11T16:05:39.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.091+0000 7f255117e700 1 -- 172.21.15.88:0/1717659479 >> v1:172.21.15.88:6789/0 conn(0x7f254c05b960 legacy=0x7f254c138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255117e700 1 -- 172.21.15.88:0/1717659479 >> v1:172.21.15.52:6789/0 conn(0x7f254c0a4140 legacy=0x7f254c0a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255097d700 1 -- 172.21.15.88:0/1717659479 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217284918 0 0) 0x7f254c137b30 con 0x7f254c05b960 2020-02-11T16:05:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255117e700 1 -- 172.21.15.88:0/1717659479 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c0a6870 con 0x7f254c0a4a80 2020-02-11T16:05:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255117e700 1 --2- 172.21.15.88:0/1717659479 >> v2:172.21.15.88:3300/0 conn(0x7f254c0a4a80 0x7f254c0a3ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2548002f30 tx=0x7f25480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255117e700 1 --2- 172.21.15.88:0/1717659479 >> v2:172.21.15.88:3300/0 conn(0x7f254c0a4a80 0x7f254c0a3ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2548002f30 tx=0x7f25480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255117e700 1 --2- 172.21.15.88:0/1717659479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0a4a80 0x7f254c0a3ce0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f25480088e0).ready entity=mon.1 client_cookie=daab6958ec786f84 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255117e700 1 --2- 172.21.15.88:0/1717659479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0a4a80 0x7f254c0a3ce0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f25480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255097d700 1 -- 172.21.15.88:0/1717659479 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2548011760 con 0x7f254c0a4a80 2020-02-11T16:05:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255117e700 1 --2- 172.21.15.88:0/1717659479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0a4a80 0x7f254c0a3ce0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f25480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255097d700 1 -- 172.21.15.88:0/1717659479 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25480118c0 con 0x7f254c0a4a80 2020-02-11T16:05:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255117e700 1 --2- 172.21.15.88:0/1717659479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0a4a80 0x7f254c0a3ce0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f25480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f255097d700 1 -- 172.21.15.88:0/1717659479 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2548011ca0 con 0x7f254c0a4a80 2020-02-11T16:05:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f2553be3700 1 -- 172.21.15.88:0/1717659479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0a4a80 msgr2=0x7f254c0a3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f2553be3700 1 --2- 172.21.15.88:0/1717659479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0a4a80 0x7f254c0a3ce0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f25480088e0).stop 2020-02-11T16:05:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f2553be3700 1 -- 172.21.15.88:0/1717659479 shutdown_connections 2020-02-11T16:05:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f2553be3700 1 --2- 172.21.15.88:0/1717659479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0a4a80 0x7f254c0a3ce0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f2553be3700 1 -- 172.21.15.88:0/1717659479 >> 172.21.15.88:0/1717659479 conn(0x7f254c0aac40 msgr2=0x7f254c0a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f2553be3700 1 -- 172.21.15.88:0/1717659479 shutdown_connections 2020-02-11T16:05:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.092+0000 7f2553be3700 1 -- 172.21.15.88:0/1717659479 wait complete. 2020-02-11T16:05:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.093+0000 7f2553be3700 1 Processor -- start 2020-02-11T16:05:39.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.093+0000 7f2553be3700 1 -- start start 2020-02-11T16:05:39.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f2553be3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f254c0a4140 0x7f254c12fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f2553be3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c125770 con 0x7f254c05b960 2020-02-11T16:05:39.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f2553be3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c123ea0 con 0x7f254c0a4a80 2020-02-11T16:05:39.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f2553be3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c125390 con 0x7f254c0a4140 2020-02-11T16:05:39.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f2552180700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f254c0a4a80 0x7f254c131260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39006/0 (socket says 172.21.15.88:39006) 2020-02-11T16:05:39.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f2552180700 1 -- 172.21.15.88:0/3742900300 learned_addr learned my addr 172.21.15.88:0/3742900300 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:39.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f254c0a4140 0x7f254c12fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502797854 0 0) 0x7f254c123ea0 con 0x7f254c0a4a80 2020-02-11T16:05:39.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f252c002fe0 con 0x7f254c0a4a80 2020-02-11T16:05:39.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182302833 0 0) 0x7f254c125770 con 0x7f254c05b960 2020-02-11T16:05:39.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f254c123ea0 con 0x7f254c05b960 2020-02-11T16:05:39.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 921326012 0 0) 0x7f252c002fe0 con 0x7f254c0a4a80 2020-02-11T16:05:39.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f254c125770 con 0x7f254c0a4a80 2020-02-11T16:05:39.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f2544001cc0 con 0x7f254c0a4a80 2020-02-11T16:05:39.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f254c0a4140 msgr2=0x7f254c12fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f254c0a4140 0x7f254c12fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 >> v1:172.21.15.88:6789/0 conn(0x7f254c0a4a80 legacy=0x7f254c131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 >> v1:172.21.15.52:6789/0 conn(0x7f254c05b960 legacy=0x7f254c12f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f254c0a4140 0x7f252c004b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f252c003f10 0x7f252c004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c125390 con 0x7f252c003f10 2020-02-11T16:05:39.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c004930 con 0x7f252c004f80 2020-02-11T16:05:39.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c00b780 con 0x7f254c0a4140 2020-02-11T16:05:39.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f255197f700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f254c0a4140 0x7f252c004b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.094+0000 7f2552180700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f252c003f10 0x7f252c004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 -- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f254c0a4140 msgr2=0x7f252c004b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f254c0a4140 0x7f252c004b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 -- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f252c003f10 msgr2=0x7f252c004390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f252c003f10 0x7f252c004390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 -- 172.21.15.88:0/3742900300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c124140 con 0x7f252c004f80 2020-02-11T16:05:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f2553be3700 1 -- 172.21.15.88:0/3742900300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c1243e0 con 0x7f252c004f80 2020-02-11T16:05:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f2553be3700 1 -- 172.21.15.88:0/3742900300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c1286c0 con 0x7f252c004f80 2020-02-11T16:05:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2548007340 con 0x7f252c004f80 2020-02-11T16:05:39.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25480074a0 con 0x7f252c004f80 2020-02-11T16:05:39.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25480058b0 con 0x7f252c004f80 2020-02-11T16:05:39.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.095+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.096+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f2548005a10 con 0x7f252c004f80 2020-02-11T16:05:39.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.096+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.096+0000 7f2553be3700 1 -- 172.21.15.88:0/3742900300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c125580 con 0x7f252c004f80 2020-02-11T16:05:39.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.096+0000 7f253affd700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f252c042340 0x7f252c044800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.096+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f254804a1f0 con 0x7f252c004f80 2020-02-11T16:05:39.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.096+0000 7f255197f700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f252c042340 0x7f252c044800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.096+0000 7f255197f700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f252c042340 0x7f252c044800 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.099+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.099+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f254802f900 con 0x7f252c004f80 2020-02-11T16:05:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.280+0000 7f2553be3700 1 -- 172.21.15.88:0/3742900300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f254c0565b0 con 0x7f252c004f80 2020-02-11T16:05:39.284 INFO:tasks.ceph.mon.b.smithi052.stderr:2020-02-11T16:05:39.281+0000 7fd200cce700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-02-11T16:05:39.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.285+0000 7f255117e700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.285+0000 7f253affd700 1 -- 172.21.15.88:0/3742900300 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f25480323f0 con 0x7f252c004f80 2020-02-11T16:05:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.287+0000 7f2553be3700 1 -- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f252c042340 msgr2=0x7f252c044800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.287+0000 7f2553be3700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f252c042340 0x7f252c044800 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.287+0000 7f2553be3700 1 -- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 msgr2=0x7f252c003ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.287+0000 7f2553be3700 1 --2- 172.21.15.88:0/3742900300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252c004f80 0x7f252c003ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f254c0a6a00).stop 2020-02-11T16:05:39.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.287+0000 7f2552180700 1 -- 172.21.15.88:0/3742900300 reap_dead start 2020-02-11T16:05:39.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.287+0000 7f2552180700 1 -- 172.21.15.88:0/3742900300 reap_dead start 2020-02-11T16:05:39.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.287+0000 7f2553be3700 1 -- 172.21.15.88:0/3742900300 shutdown_connections 2020-02-11T16:05:39.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.287+0000 7f2553be3700 1 -- 172.21.15.88:0/3742900300 >> 172.21.15.88:0/3742900300 conn(0x7f254c0aac40 msgr2=0x7f254c0a6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:39.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.287+0000 7f2553be3700 1 -- 172.21.15.88:0/3742900300 shutdown_connections 2020-02-11T16:05:39.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.287+0000 7f2553be3700 1 -- 172.21.15.88:0/3742900300 wait complete. 2020-02-11T16:05:39.291 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 2 and data pool 3 2020-02-11T16:05:39.300 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:39.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.402+0000 7f64fd694700 1 Processor -- start 2020-02-11T16:05:39.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.402+0000 7f64fd694700 1 -- start start 2020-02-11T16:05:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64fd694700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64f80a18a0 0x7f64f80a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64fd694700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64f80a5de0 0x7f64f80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64fd694700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f64f812e3a0 0x7f64f812e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64fd694700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80a3570 con 0x7f64f812e3a0 2020-02-11T16:05:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64fd694700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80a3810 con 0x7f64f80a5de0 2020-02-11T16:05:39.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64fd694700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80a3ab0 con 0x7f64f80a18a0 2020-02-11T16:05:39.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64f80a5de0 0x7f64f80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64f80a5de0 0x7f64f80a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51392/0 (socket says 172.21.15.88:51392) 2020-02-11T16:05:39.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 -- 172.21.15.88:0/786517019 learned_addr learned my addr 172.21.15.88:0/786517019 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:39.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/786517019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64f80a18a0 0x7f64f80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f77fe700 1 --2- 172.21.15.88:0/786517019 >> v2:172.21.15.52:3300/0 conn(0x7f64f812e3a0 0x7f64f812e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 -- 172.21.15.88:0/786517019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64f80a18a0 msgr2=0x7f64f80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:39.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 --2- 172.21.15.88:0/786517019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64f80a18a0 0x7f64f80a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:39.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 -- 172.21.15.88:0/786517019 >> v2:172.21.15.52:3300/0 conn(0x7f64f812e3a0 msgr2=0x7f64f812e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:39.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 --2- 172.21.15.88:0/786517019 >> v2:172.21.15.52:3300/0 conn(0x7f64f812e3a0 0x7f64f812e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:39.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 -- 172.21.15.88:0/786517019 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80a3d50 con 0x7f64f80a5de0 2020-02-11T16:05:39.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f77fe700 1 --2- 172.21.15.88:0/786517019 >> v2:172.21.15.52:3300/0 conn(0x7f64f812e3a0 0x7f64f812e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:39.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 --2- 172.21.15.88:0/786517019 >> v2:172.21.15.88:3300/0 conn(0x7f64f80a5de0 0x7f64f80a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f64f805bbc0 tx=0x7f64e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 --2- 172.21.15.88:0/786517019 >> v2:172.21.15.88:3300/0 conn(0x7f64f80a5de0 0x7f64f80a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f64f805bbc0 tx=0x7f64e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 --2- 172.21.15.88:0/786517019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f80a5de0 0x7f64f80a6260 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f64f805bbc0 tx=0x7f64e80088e0).ready entity=mon.1 client_cookie=a08df6f68e6c38a2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 --2- 172.21.15.88:0/786517019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f80a5de0 0x7f64f80a6260 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f64f805bbc0 tx=0x7f64e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f5ffb700 1 -- 172.21.15.88:0/786517019 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e8011720 con 0x7f64f80a5de0 2020-02-11T16:05:39.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 --2- 172.21.15.88:0/786517019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f80a5de0 0x7f64f80a6260 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f64f805bbc0 tx=0x7f64e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f67fc700 1 --2- 172.21.15.88:0/786517019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f80a5de0 0x7f64f80a6260 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f64f805bbc0 tx=0x7f64e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.403+0000 7f64f5ffb700 1 -- 172.21.15.88:0/786517019 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e8011880 con 0x7f64f80a5de0 2020-02-11T16:05:39.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.404+0000 7f64f5ffb700 1 -- 172.21.15.88:0/786517019 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e8011c60 con 0x7f64f80a5de0 2020-02-11T16:05:39.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.404+0000 7f64fd694700 1 -- 172.21.15.88:0/786517019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f80a5de0 msgr2=0x7f64f80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.404+0000 7f64fd694700 1 --2- 172.21.15.88:0/786517019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f80a5de0 0x7f64f80a6260 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f64f805bbc0 tx=0x7f64e80088e0).stop 2020-02-11T16:05:39.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.404+0000 7f64fd694700 1 -- 172.21.15.88:0/786517019 shutdown_connections 2020-02-11T16:05:39.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.404+0000 7f64fd694700 1 --2- 172.21.15.88:0/786517019 >> v2:172.21.15.52:3300/0 conn(0x7f64f812e3a0 0x7f64f812e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:39.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.404+0000 7f64fd694700 1 --2- 172.21.15.88:0/786517019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64f80a18a0 0x7f64f80a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:39.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.404+0000 7f64fd694700 1 --2- 172.21.15.88:0/786517019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f80a5de0 0x7f64f80a6260 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.404+0000 7f64fd694700 1 -- 172.21.15.88:0/786517019 >> 172.21.15.88:0/786517019 conn(0x7f64f809d110 msgr2=0x7f64f809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:39.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.404+0000 7f64fd694700 1 -- 172.21.15.88:0/786517019 shutdown_connections 2020-02-11T16:05:39.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.404+0000 7f64fd694700 1 -- 172.21.15.88:0/786517019 wait complete. 2020-02-11T16:05:39.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.405+0000 7f64fd694700 1 Processor -- start 2020-02-11T16:05:39.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.405+0000 7f64fd694700 1 -- start start 2020-02-11T16:05:39.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.405+0000 7f64fd694700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f64f80a18a0 0x7f64f8130860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64fd694700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80a8ff0 con 0x7f64f80a5de0 2020-02-11T16:05:39.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64fd694700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f8133210 con 0x7f64f812e3a0 2020-02-11T16:05:39.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64fd694700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f8131660 con 0x7f64f80a18a0 2020-02-11T16:05:39.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f64f812e3a0 0x7f64f8137660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39026/0 (socket says 172.21.15.88:39026) 2020-02-11T16:05:39.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f77fe700 1 -- 172.21.15.88:0/4289209572 learned_addr learned my addr 172.21.15.88:0/4289209572 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:39.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230875722 0 0) 0x7f64f8133210 con 0x7f64f812e3a0 2020-02-11T16:05:39.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d4002fe0 con 0x7f64f812e3a0 2020-02-11T16:05:39.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> v2:172.21.15.52:3300/0 conn(0x7f64f80a18a0 0x7f64f8130860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1065114864 0 0) 0x7f64d4002fe0 con 0x7f64f812e3a0 2020-02-11T16:05:39.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64f8133210 con 0x7f64f812e3a0 2020-02-11T16:05:39.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f64f0002a20 con 0x7f64f812e3a0 2020-02-11T16:05:39.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 >> v2:172.21.15.52:3300/0 conn(0x7f64f80a18a0 msgr2=0x7f64f8130860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 --2- 172.21.15.88:0/4289209572 >> v2:172.21.15.52:3300/0 conn(0x7f64f80a18a0 0x7f64f8130860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 >> v1:172.21.15.88:6789/0 conn(0x7f64f812e3a0 legacy=0x7f64f8137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 >> v1:172.21.15.52:6789/0 conn(0x7f64f80a5de0 legacy=0x7f64f8136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64d4003920 0x7f64d4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64d40041c0 0x7f64d400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f8131660 con 0x7f64d40041c0 2020-02-11T16:05:39.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d400bbb0 con 0x7f64d4004a00 2020-02-11T16:05:39.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d400bcf0 con 0x7f64d4003920 2020-02-11T16:05:39.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f67fc700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64d4003920 0x7f64d4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f77fe700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64d40041c0 0x7f64d400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f6ffd700 1 -- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64d4003920 msgr2=0x7f64d4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64d4003920 0x7f64d4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f6ffd700 1 -- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64d40041c0 msgr2=0x7f64d400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64d40041c0 0x7f64d400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f77fe700 1 -- 172.21.15.88:0/4289209572 reap_dead start 2020-02-11T16:05:39.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.406+0000 7f64f6ffd700 1 -- 172.21.15.88:0/4289209572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f8132fe0 con 0x7f64d4004a00 2020-02-11T16:05:39.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64fd694700 1 -- 172.21.15.88:0/4289209572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f8133420 con 0x7f64d4004a00 2020-02-11T16:05:39.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64fd694700 1 -- 172.21.15.88:0/4289209572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f81303c0 con 0x7f64d4004a00 2020-02-11T16:05:39.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec008d20 con 0x7f64d4004a00 2020-02-11T16:05:39.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec008e80 con 0x7f64d4004a00 2020-02-11T16:05:39.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec0129c0 con 0x7f64d4004a00 2020-02-11T16:05:39.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f64ec012b20 con 0x7f64d4004a00 2020-02-11T16:05:39.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.407+0000 7f64fd694700 1 -- 172.21.15.88:0/4289209572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d8003340 con 0x7f64d4004a00 2020-02-11T16:05:39.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.408+0000 7f64e7fff700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f64d403dd40 0x7f64d4040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.408+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f64ec049ad0 con 0x7f64d4004a00 2020-02-11T16:05:39.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.408+0000 7f64f67fc700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f64d403dd40 0x7f64d4040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.408+0000 7f64f67fc700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f64d403dd40 0x7f64d4040200 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.411+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.411+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f64ec02f140 con 0x7f64d4004a00 2020-02-11T16:05:39.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.546+0000 7f64fd694700 1 -- 172.21.15.88:0/4289209572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64d80021d0 con 0x7f64d4004a00 2020-02-11T16:05:39.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.547+0000 7f64f6ffd700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.547+0000 7f64e7fff700 1 -- 172.21.15.88:0/4289209572 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f64ec031c50 con 0x7f64d4004a00 2020-02-11T16:05:39.550 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:39.550 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:39.282613+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-11T16:05:34.022912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-11T16:05:36.964421+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:39.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.548+0000 7f64fd694700 1 -- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f64d403dd40 msgr2=0x7f64d4040200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.548+0000 7f64fd694700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f64d403dd40 0x7f64d4040200 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.548+0000 7f64fd694700 1 -- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 msgr2=0x7f64d4004e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.548+0000 7f64fd694700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec010db0).stop 2020-02-11T16:05:39.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.548+0000 7f64fd694700 1 -- 172.21.15.88:0/4289209572 shutdown_connections 2020-02-11T16:05:39.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.548+0000 7f64fd694700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f64d403dd40 0x7f64d4040200 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.548+0000 7f64fd694700 1 --2- 172.21.15.88:0/4289209572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64d4004a00 0x7f64d4004e20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.548+0000 7f64fd694700 1 -- 172.21.15.88:0/4289209572 >> 172.21.15.88:0/4289209572 conn(0x7f64f809d110 msgr2=0x7f64f80a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:39.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.548+0000 7f64fd694700 1 -- 172.21.15.88:0/4289209572 shutdown_connections 2020-02-11T16:05:39.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.548+0000 7f64fd694700 1 -- 172.21.15.88:0/4289209572 wait complete. 2020-02-11T16:05:39.562 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.664+0000 7fc60474f700 1 Processor -- start 2020-02-11T16:05:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.664+0000 7fc60474f700 1 -- start start 2020-02-11T16:05:39.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc60474f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 0x7fc5fc135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:39.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc60474f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5fc0a31b0 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc60474f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5fc0a3570 con 0x7fc5fc0a5de0 2020-02-11T16:05:39.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc60474f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0a3810 con 0x7fc5fc0a6260 2020-02-11T16:05:39.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc601cea700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc5fc0a5de0 0x7fc5fc134a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39036/0 (socket says 172.21.15.88:39036) 2020-02-11T16:05:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc601cea700 1 -- 172.21.15.88:0/3794207026 learned_addr learned my addr 172.21.15.88:0/3794207026 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc602cec700 1 --2- 172.21.15.88:0/3794207026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 0x7fc5fc135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc6014e9700 1 -- 172.21.15.88:0/3794207026 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490908403 0 0) 0x7fc5fc0a3570 con 0x7fc5fc0a5de0 2020-02-11T16:05:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc6014e9700 1 -- 172.21.15.88:0/3794207026 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e4003230 con 0x7fc5fc0a5de0 2020-02-11T16:05:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc6014e9700 1 -- 172.21.15.88:0/3794207026 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728590306 0 0) 0x7fc5fc0a31b0 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.665+0000 7fc6014e9700 1 -- 172.21.15.88:0/3794207026 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5fc0a3570 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc602cec700 1 -- 172.21.15.88:0/3794207026 >> v1:172.21.15.88:6789/0 conn(0x7fc5fc0a5de0 legacy=0x7fc5fc134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc602cec700 1 -- 172.21.15.88:0/3794207026 >> v1:172.21.15.52:6789/0 conn(0x7fc5fc0a18a0 legacy=0x7fc5fc0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc602cec700 1 -- 172.21.15.88:0/3794207026 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc0a3ab0 con 0x7fc5fc0a6260 2020-02-11T16:05:39.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc602cec700 1 --2- 172.21.15.88:0/3794207026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 0x7fc5fc135160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5f40032b0 tx=0x7fc5f4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc602cec700 1 --2- 172.21.15.88:0/3794207026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 0x7fc5fc135160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5f40032b0 tx=0x7fc5f4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc602cec700 1 --2- 172.21.15.88:0/3794207026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 0x7fc5fc135160 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fc5f40032b0 tx=0x7fc5f4008c60).ready entity=mon.2 client_cookie=cc88399754dc8e95 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc602cec700 1 --2- 172.21.15.88:0/3794207026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 0x7fc5fc135160 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fc5f40032b0 tx=0x7fc5f4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc6014e9700 1 -- 172.21.15.88:0/3794207026 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f4011db0 con 0x7fc5fc0a6260 2020-02-11T16:05:39.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc602cec700 1 --2- 172.21.15.88:0/3794207026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 0x7fc5fc135160 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fc5f40032b0 tx=0x7fc5f4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc602cec700 1 --2- 172.21.15.88:0/3794207026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 0x7fc5fc135160 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fc5f40032b0 tx=0x7fc5f4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc6014e9700 1 -- 172.21.15.88:0/3794207026 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f400a160 con 0x7fc5fc0a6260 2020-02-11T16:05:39.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc6014e9700 1 -- 172.21.15.88:0/3794207026 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f400a500 con 0x7fc5fc0a6260 2020-02-11T16:05:39.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc60474f700 1 -- 172.21.15.88:0/3794207026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 msgr2=0x7fc5fc135160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc60474f700 1 --2- 172.21.15.88:0/3794207026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 0x7fc5fc135160 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fc5f40032b0 tx=0x7fc5f4008c60).stop 2020-02-11T16:05:39.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc60474f700 1 -- 172.21.15.88:0/3794207026 shutdown_connections 2020-02-11T16:05:39.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc60474f700 1 --2- 172.21.15.88:0/3794207026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc0a6260 0x7fc5fc135160 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc60474f700 1 -- 172.21.15.88:0/3794207026 >> 172.21.15.88:0/3794207026 conn(0x7fc5fc09d110 msgr2=0x7fc5fc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:39.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc60474f700 1 -- 172.21.15.88:0/3794207026 shutdown_connections 2020-02-11T16:05:39.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.666+0000 7fc60474f700 1 -- 172.21.15.88:0/3794207026 wait complete. 2020-02-11T16:05:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.667+0000 7fc60474f700 1 Processor -- start 2020-02-11T16:05:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.667+0000 7fc60474f700 1 -- start start 2020-02-11T16:05:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc60474f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5fc0a18a0 0x7fc5fc136710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc60474f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5fc0a6260 0x7fc5fc0a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc60474f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5fc0a0ef0 con 0x7fc5fc0a5de0 2020-02-11T16:05:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc60474f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5fc1462d0 con 0x7fc5fc0a6260 2020-02-11T16:05:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc60474f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5fc0a0930 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc6024eb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5fc0a18a0 0x7fc5fc136710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc6024eb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5fc0a18a0 0x7fc5fc136710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51414/0 (socket says 172.21.15.88:51414) 2020-02-11T16:05:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc6024eb700 1 -- 172.21.15.88:0/3487004339 learned_addr learned my addr 172.21.15.88:0/3487004339 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc602cec700 1 --2- 172.21.15.88:0/3487004339 >> v2:172.21.15.52:3300/0 conn(0x7fc5fc0a6260 0x7fc5fc0a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc6024eb700 1 -- 172.21.15.88:0/3487004339 >> v2:172.21.15.52:3300/0 conn(0x7fc5fc0a6260 msgr2=0x7fc5fc0a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> v2:172.21.15.52:3300/0 conn(0x7fc5fc0a6260 0x7fc5fc0a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc6024eb700 1 -- 172.21.15.88:0/3487004339 >> v1:172.21.15.52:6789/0 conn(0x7fc5fc0a5de0 legacy=0x7fc5fc146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc6024eb700 1 -- 172.21.15.88:0/3487004339 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc12ced0 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> v2:172.21.15.88:3300/0 conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> v2:172.21.15.88:3300/0 conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.668+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc5eb7fe700 1 -- 172.21.15.88:0/3487004339 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5ec0035d0 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc5eb7fe700 1 -- 172.21.15.88:0/3487004339 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec003730 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc60474f700 1 -- 172.21.15.88:0/3487004339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc12d180 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc5eb7fe700 1 -- 172.21.15.88:0/3487004339 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5ec003b50 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc60474f700 1 -- 172.21.15.88:0/3487004339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc1470c0 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc5eb7fe700 1 -- 172.21.15.88:0/3487004339 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fc5ec0064e0 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.669+0000 7fc5eb7fe700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc5dc039c50 0x7fc5dc03c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.670+0000 7fc5eb7fe700 1 -- 172.21.15.88:0/3487004339 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc5ec0492f0 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.670+0000 7fc60474f700 1 -- 172.21.15.88:0/3487004339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc0565b0 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.670+0000 7fc601cea700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc5dc039c50 0x7fc5dc03c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.670+0000 7fc601cea700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc5dc039c50 0x7fc5dc03c110 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.673+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.673+0000 7fc5eb7fe700 1 -- 172.21.15.88:0/3487004339 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc5ec02e980 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.807+0000 7fc60474f700 1 -- 172.21.15.88:0/3487004339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5fc05ccb0 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.808+0000 7fc6024eb700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.808+0000 7fc5eb7fe700 1 -- 172.21.15.88:0/3487004339 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14885 (secure 0 0 0) 0x7fc5ec031490 con 0x7fc5fc0a18a0 2020-02-11T16:05:39.812 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:39.282613+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-11T16:05:34.022912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-11T16:05:36.964421+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:39.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 -- 172.21.15.88:0/3487004339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc5dc039c50 msgr2=0x7fc5dc03c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc5dc039c50 0x7fc5dc03c110 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 -- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 msgr2=0x7fc5fc136710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 0x7fc5fc136710 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fc5ec001190 tx=0x7fc5ec002490).stop 2020-02-11T16:05:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 -- 172.21.15.88:0/3487004339 shutdown_connections 2020-02-11T16:05:39.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc5dc039c50 0x7fc5dc03c110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 --2- 172.21.15.88:0/3487004339 >> v2:172.21.15.52:3300/0 conn(0x7fc5fc0a6260 0x7fc5fc0a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 --2- 172.21.15.88:0/3487004339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc0a18a0 0x7fc5fc136710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 -- 172.21.15.88:0/3487004339 >> 172.21.15.88:0/3487004339 conn(0x7fc5fc09d110 msgr2=0x7fc5fc0a4980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:39.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 -- 172.21.15.88:0/3487004339 shutdown_connections 2020-02-11T16:05:39.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.809+0000 7fc60474f700 1 -- 172.21.15.88:0/3487004339 wait complete. 2020-02-11T16:05:39.824 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-02-11T16:05:39.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.930+0000 7f172ad56700 1 Processor -- start 2020-02-11T16:05:39.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.930+0000 7f172ad56700 1 -- start start 2020-02-11T16:05:39.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f172ad56700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f172405b960 0x7f17240a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:39.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f172ad56700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 0x7f17240a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:39.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f172ad56700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17240a4160 con 0x7f17240a28a0 2020-02-11T16:05:39.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f172ad56700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172409d950 con 0x7f172409aef0 2020-02-11T16:05:39.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f172ad56700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172409dbf0 con 0x7f172405b960 2020-02-11T16:05:39.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f172405b960 0x7f17240a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1723fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f17240a28a0 0x7f1724138250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39048/0 (socket says 172.21.15.88:39048) 2020-02-11T16:05:39.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1723fff700 1 -- 172.21.15.88:0/2983434725 learned_addr learned my addr 172.21.15.88:0/2983434725 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:39.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f17292f3700 1 --2- 172.21.15.88:0/2983434725 >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 0x7f17240a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 -- 172.21.15.88:0/2983434725 >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 msgr2=0x7f17240a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:39.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 --2- 172.21.15.88:0/2983434725 >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 0x7f17240a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:39.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 -- 172.21.15.88:0/2983434725 >> v1:172.21.15.88:6789/0 conn(0x7f17240a28a0 legacy=0x7f1724138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f17237fe700 1 -- 172.21.15.88:0/2983434725 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525186499 0 0) 0x7f17240a4160 con 0x7f17240a28a0 2020-02-11T16:05:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 -- 172.21.15.88:0/2983434725 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240a60c0 con 0x7f172405b960 2020-02-11T16:05:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f17292f3700 1 --2- 172.21.15.88:0/2983434725 >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 0x7f17240a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 --2- 172.21.15.88:0/2983434725 >> v2:172.21.15.88:3300/0 conn(0x7f172405b960 0x7f17240a67e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 --2- 172.21.15.88:0/2983434725 >> v2:172.21.15.88:3300/0 conn(0x7f172405b960 0x7f17240a67e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 --2- 172.21.15.88:0/2983434725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17240a67e0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).ready entity=mon.1 client_cookie=c7cf33444923fb19 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 --2- 172.21.15.88:0/2983434725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17240a67e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f17237fe700 1 -- 172.21.15.88:0/2983434725 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c00a160 con 0x7f172405b960 2020-02-11T16:05:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 --2- 172.21.15.88:0/2983434725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17240a67e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f1728af2700 1 --2- 172.21.15.88:0/2983434725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17240a67e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f17237fe700 1 -- 172.21.15.88:0/2983434725 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c00a2c0 con 0x7f172405b960 2020-02-11T16:05:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f17237fe700 1 -- 172.21.15.88:0/2983434725 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c00a660 con 0x7f172405b960 2020-02-11T16:05:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f172ad56700 1 -- 172.21.15.88:0/2983434725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 msgr2=0x7f17240a67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.931+0000 7f172ad56700 1 --2- 172.21.15.88:0/2983434725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17240a67e0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).stop 2020-02-11T16:05:39.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.932+0000 7f172ad56700 1 -- 172.21.15.88:0/2983434725 shutdown_connections 2020-02-11T16:05:39.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.932+0000 7f172ad56700 1 --2- 172.21.15.88:0/2983434725 >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 0x7f17240a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:39.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.932+0000 7f172ad56700 1 --2- 172.21.15.88:0/2983434725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17240a67e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.932+0000 7f172ad56700 1 -- 172.21.15.88:0/2983434725 >> 172.21.15.88:0/2983434725 conn(0x7f17240aac40 msgr2=0x7f17240a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:39.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.932+0000 7f172ad56700 1 -- 172.21.15.88:0/2983434725 shutdown_connections 2020-02-11T16:05:39.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.932+0000 7f172ad56700 1 -- 172.21.15.88:0/2983434725 wait complete. 2020-02-11T16:05:39.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.933+0000 7f172ad56700 1 Processor -- start 2020-02-11T16:05:39.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.933+0000 7f172ad56700 1 -- start start 2020-02-11T16:05:39.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.933+0000 7f172ad56700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f172405b960 0x7f17241465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.933+0000 7f172ad56700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 0x7f1724146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.933+0000 7f172ad56700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17240a0f30 con 0x7f17240a28a0 2020-02-11T16:05:39.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.933+0000 7f172ad56700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240a0550 con 0x7f172409aef0 2020-02-11T16:05:39.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.933+0000 7f172ad56700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240a07f0 con 0x7f172405b960 2020-02-11T16:05:39.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f172405b960 0x7f17241465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f172405b960 0x7f17241465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51424/0 (socket says 172.21.15.88:51424) 2020-02-11T16:05:39.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f17292f3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f17240a28a0 0x7f1724138580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39054/0 (socket says 172.21.15.88:39054) 2020-02-11T16:05:39.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 -- 172.21.15.88:0/517933053 learned_addr learned my addr 172.21.15.88:0/517933053 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:39.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1723fff700 1 --2- 172.21.15.88:0/517933053 >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 0x7f1724146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 -- 172.21.15.88:0/517933053 >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 msgr2=0x7f1724146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 0x7f1724146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:39.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 -- 172.21.15.88:0/517933053 >> v1:172.21.15.88:6789/0 conn(0x7f17240a28a0 legacy=0x7f1724138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:39.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1721ffb700 1 -- 172.21.15.88:0/517933053 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054049360 0 0) 0x7f17240a0f30 con 0x7f17240a28a0 2020-02-11T16:05:39.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 -- 172.21.15.88:0/517933053 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240a0a90 con 0x7f172405b960 2020-02-11T16:05:39.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1723fff700 1 --2- 172.21.15.88:0/517933053 >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 0x7f1724146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> v2:172.21.15.88:3300/0 conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> v2:172.21.15.88:3300/0 conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1721ffb700 1 -- 172.21.15.88:0/517933053 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c005c30 con 0x7f172405b960 2020-02-11T16:05:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1721ffb700 1 -- 172.21.15.88:0/517933053 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c005d90 con 0x7f172405b960 2020-02-11T16:05:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f1721ffb700 1 -- 172.21.15.88:0/517933053 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c00f760 con 0x7f172405b960 2020-02-11T16:05:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f172ad56700 1 -- 172.21.15.88:0/517933053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1724130cb0 con 0x7f172405b960 2020-02-11T16:05:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.934+0000 7f172ad56700 1 -- 172.21.15.88:0/517933053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17240a01d0 con 0x7f172405b960 2020-02-11T16:05:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.935+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.935+0000 7f1721ffb700 1 -- 172.21.15.88:0/517933053 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f171c00f990 con 0x7f172405b960 2020-02-11T16:05:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.935+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.935+0000 7f172ad56700 1 -- 172.21.15.88:0/517933053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17240565b0 con 0x7f172405b960 2020-02-11T16:05:39.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.935+0000 7f1721ffb700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1704039b90 0x7f170403c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:39.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.935+0000 7f1721ffb700 1 -- 172.21.15.88:0/517933053 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f171c04a940 con 0x7f172405b960 2020-02-11T16:05:39.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.936+0000 7f1723fff700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1704039b90 0x7f170403c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:39.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.936+0000 7f1723fff700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1704039b90 0x7f170403c050 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:39.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.939+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:39.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:39.939+0000 7f1721ffb700 1 -- 172.21.15.88:0/517933053 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f171c032f80 con 0x7f172405b960 2020-02-11T16:05:40.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.118+0000 7f172ad56700 1 -- 172.21.15.88:0/517933053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f17240ab050 con 0x7f172405b960 2020-02-11T16:05:40.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.980+0000 7f1728af2700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:40.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.980+0000 7f1721ffb700 1 -- 172.21.15.88:0/517933053 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f171c032b40 con 0x7f172405b960 2020-02-11T16:05:40.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.982+0000 7f172ad56700 1 -- 172.21.15.88:0/517933053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1704039b90 msgr2=0x7f170403c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:40.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.982+0000 7f172ad56700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1704039b90 0x7f170403c050 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:40.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.982+0000 7f172ad56700 1 -- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 msgr2=0x7f17241465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:40.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.982+0000 7f172ad56700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17241465e0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f171c0032b0 tx=0x7f171c007dc0).stop 2020-02-11T16:05:40.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.982+0000 7f172ad56700 1 -- 172.21.15.88:0/517933053 shutdown_connections 2020-02-11T16:05:40.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.982+0000 7f172ad56700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f172405b960 0x7f17241465e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:40.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.982+0000 7f172ad56700 1 --2- 172.21.15.88:0/517933053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1704039b90 0x7f170403c050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:40.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.982+0000 7f172ad56700 1 --2- 172.21.15.88:0/517933053 >> v2:172.21.15.52:3300/0 conn(0x7f172409aef0 0x7f1724146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:40.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.982+0000 7f172ad56700 1 -- 172.21.15.88:0/517933053 >> 172.21.15.88:0/517933053 conn(0x7f17240aac40 msgr2=0x7f1724131270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:40.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.983+0000 7f172ad56700 1 -- 172.21.15.88:0/517933053 shutdown_connections 2020-02-11T16:05:40.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:40.983+0000 7f172ad56700 1 -- 172.21.15.88:0/517933053 wait complete. 2020-02-11T16:05:40.998 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-02-11T16:05:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.106+0000 7ff7eae22700 1 Processor -- start 2020-02-11T16:05:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.106+0000 7ff7eae22700 1 -- start start 2020-02-11T16:05:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7eae22700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7e40a5de0 0x7ff7e40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7eae22700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e40a31b0 con 0x7ff7e4134a50 2020-02-11T16:05:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7eae22700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e40a3570 con 0x7ff7e40a18a0 2020-02-11T16:05:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7eae22700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e40a3810 con 0x7ff7e40a5de0 2020-02-11T16:05:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e8bbe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff7e40a18a0 0x7ff7e40a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39058/0 (socket says 172.21.15.88:39058) 2020-02-11T16:05:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e8bbe700 1 -- 172.21.15.88:0/2030021014 learned_addr learned my addr 172.21.15.88:0/2030021014 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185712639 0 0) 0x7ff7e40a3570 con 0x7ff7e40a18a0 2020-02-11T16:05:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e3fff700 1 --2- 172.21.15.88:0/2030021014 >> v2:172.21.15.52:3300/0 conn(0x7ff7e40a5de0 0x7ff7e40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7d0003230 con 0x7ff7e40a18a0 2020-02-11T16:05:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1854171358 0 0) 0x7ff7d0003230 con 0x7ff7e40a18a0 2020-02-11T16:05:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 >> v2:172.21.15.52:3300/0 conn(0x7ff7e40a5de0 msgr2=0x7ff7e40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 --2- 172.21.15.88:0/2030021014 >> v2:172.21.15.52:3300/0 conn(0x7ff7e40a5de0 0x7ff7e40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 >> v1:172.21.15.52:6789/0 conn(0x7ff7e4134a50 legacy=0x7ff7e4134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e40a3ab0 con 0x7ff7e40a18a0 2020-02-11T16:05:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7ff7d40016d0 con 0x7ff7e40a18a0 2020-02-11T16:05:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 >> v1:172.21.15.88:6789/0 conn(0x7ff7e40a18a0 legacy=0x7ff7e40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7d0003720 0x7ff7d0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.107+0000 7ff7e37fe700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7d00044d0 0x7ff7d0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e37fe700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7d000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e40a3810 con 0x7ff7d00044d0 2020-02-11T16:05:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00041c0 con 0x7ff7d0004db0 2020-02-11T16:05:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d000bb80 con 0x7ff7d0003720 2020-02-11T16:05:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e3fff700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7d00044d0 0x7ff7d0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7d000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7d0003720 0x7ff7d0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 -- 172.21.15.88:0/2030021014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7d0003720 msgr2=0x7ff7d0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7d0003720 0x7ff7d0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 -- 172.21.15.88:0/2030021014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7d00044d0 msgr2=0x7ff7d0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7d00044d0 0x7ff7d0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 -- 172.21.15.88:0/2030021014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d0003230 con 0x7ff7d0004db0 2020-02-11T16:05:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7d000b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7d00054a0 tx=0x7ff7dc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 -- 172.21.15.88:0/2030021014 reap_dead start 2020-02-11T16:05:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7d000b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7d00054a0 tx=0x7ff7dc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7d000b720 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7ff7d00054a0 tx=0x7ff7dc0122e0).ready entity=mon.1 client_cookie=5646141bcc8d8330 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:41.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7d000b720 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7ff7d00054a0 tx=0x7ff7dc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7dc006c40 con 0x7ff7d0004db0 2020-02-11T16:05:41.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7d000b720 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7ff7d00054a0 tx=0x7ff7dc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc006da0 con 0x7ff7d0004db0 2020-02-11T16:05:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e93bf700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7d000b720 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7ff7d00054a0 tx=0x7ff7dc0122e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7eae22700 1 -- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 msgr2=0x7ff7d000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7e37fe700 1 -- 172.21.15.88:0/2030021014 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7dc002640 con 0x7ff7d0004db0 2020-02-11T16:05:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.108+0000 7ff7eae22700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7d000b720 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7ff7d00054a0 tx=0x7ff7dc0122e0).stop 2020-02-11T16:05:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.109+0000 7ff7eae22700 1 -- 172.21.15.88:0/2030021014 shutdown_connections 2020-02-11T16:05:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.109+0000 7ff7eae22700 1 --2- 172.21.15.88:0/2030021014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7d000b720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.109+0000 7ff7eae22700 1 -- 172.21.15.88:0/2030021014 >> 172.21.15.88:0/2030021014 conn(0x7ff7e409d110 msgr2=0x7ff7e409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.109+0000 7ff7eae22700 1 -- 172.21.15.88:0/2030021014 shutdown_connections 2020-02-11T16:05:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.109+0000 7ff7eae22700 1 -- 172.21.15.88:0/2030021014 wait complete. 2020-02-11T16:05:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.109+0000 7ff7eae22700 1 Processor -- start 2020-02-11T16:05:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.110+0000 7ff7eae22700 1 -- start start 2020-02-11T16:05:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.110+0000 7ff7eae22700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7d0004db0 0x7ff7e4136cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.110+0000 7ff7eae22700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7e4149230 0x7ff7e414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.110+0000 7ff7eae22700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e4131e90 con 0x7ff7e4134170 2020-02-11T16:05:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.110+0000 7ff7eae22700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e4130010 con 0x7ff7d0004db0 2020-02-11T16:05:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.110+0000 7ff7eae22700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4137c60 con 0x7ff7e4149230 2020-02-11T16:05:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.110+0000 7ff7e8bbe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7d0004db0 0x7ff7e4136cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.110+0000 7ff7e8bbe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7d0004db0 0x7ff7e4136cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51444/0 (socket says 172.21.15.88:51444) 2020-02-11T16:05:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.110+0000 7ff7e8bbe700 1 -- 172.21.15.88:0/2317869501 learned_addr learned my addr 172.21.15.88:0/2317869501 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.110+0000 7ff7e93bf700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7e4149230 0x7ff7e414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 -- 172.21.15.88:0/2317869501 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7e4149230 msgr2=0x7ff7e414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7e4149230 0x7ff7e414fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 -- 172.21.15.88:0/2317869501 >> v1:172.21.15.88:6789/0 conn(0x7ff7e4134170 legacy=0x7ff7e4148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 -- 172.21.15.88:0/2317869501 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4132460 con 0x7ff7d0004db0 2020-02-11T16:05:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e1ffb700 1 -- 172.21.15.88:0/2317869501 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345885274 0 0) 0x7ff7e4131e90 con 0x7ff7e4134170 2020-02-11T16:05:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> v2:172.21.15.88:3300/0 conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> v2:172.21.15.88:3300/0 conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e1ffb700 1 -- 172.21.15.88:0/2317869501 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7d400e160 con 0x7ff7d0004db0 2020-02-11T16:05:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e1ffb700 1 -- 172.21.15.88:0/2317869501 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d400e2c0 con 0x7ff7d0004db0 2020-02-11T16:05:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7eae22700 1 -- 172.21.15.88:0/2317869501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e4132230 con 0x7ff7d0004db0 2020-02-11T16:05:41.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e1ffb700 1 -- 172.21.15.88:0/2317869501 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7d400e620 con 0x7ff7d0004db0 2020-02-11T16:05:41.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7eae22700 1 -- 172.21.15.88:0/2317869501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e40a7660 con 0x7ff7d0004db0 2020-02-11T16:05:41.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.111+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.112+0000 7ff7e1ffb700 1 -- 172.21.15.88:0/2317869501 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7ff7d400c250 con 0x7ff7d0004db0 2020-02-11T16:05:41.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.112+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.112+0000 7ff7eae22700 1 -- 172.21.15.88:0/2317869501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e412fe50 con 0x7ff7d0004db0 2020-02-11T16:05:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.112+0000 7ff7e1ffb700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff7c4039b40 0x7ff7c403c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.112+0000 7ff7e1ffb700 1 -- 172.21.15.88:0/2317869501 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7ff7d40497a0 con 0x7ff7d0004db0 2020-02-11T16:05:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.112+0000 7ff7e3fff700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff7c4039b40 0x7ff7c403c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.112+0000 7ff7e3fff700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff7c4039b40 0x7ff7c403c000 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:41.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.115+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.115+0000 7ff7e1ffb700 1 -- 172.21.15.88:0/2317869501 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff7d402ee70 con 0x7ff7d0004db0 2020-02-11T16:05:41.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.292+0000 7ff7eae22700 1 -- 172.21.15.88:0/2317869501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7e40565b0 con 0x7ff7d0004db0 2020-02-11T16:05:41.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.292+0000 7ff7e8bbe700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.292+0000 7ff7e1ffb700 1 -- 172.21.15.88:0/2317869501 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7ff7d4031980 con 0x7ff7d0004db0 2020-02-11T16:05:41.296 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:41.296 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-02-11T16:05:39.282829+0000","modified":"2020-02-11T16:05:40.976956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-02-11T16:05:41.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.293+0000 7ff7eae22700 1 -- 172.21.15.88:0/2317869501 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff7c4039b40 msgr2=0x7ff7c403c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.293+0000 7ff7eae22700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff7c4039b40 0x7ff7c403c000 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.293+0000 7ff7eae22700 1 -- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 msgr2=0x7ff7e4136cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.293+0000 7ff7eae22700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7e4136cb0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7ff7d4001ba0 tx=0x7ff7d4001850).stop 2020-02-11T16:05:41.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.294+0000 7ff7eae22700 1 -- 172.21.15.88:0/2317869501 shutdown_connections 2020-02-11T16:05:41.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.294+0000 7ff7eae22700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff7c4039b40 0x7ff7c403c000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.294+0000 7ff7eae22700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7e4149230 0x7ff7e414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.294+0000 7ff7eae22700 1 --2- 172.21.15.88:0/2317869501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7d0004db0 0x7ff7e4136cb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.294+0000 7ff7eae22700 1 -- 172.21.15.88:0/2317869501 >> 172.21.15.88:0/2317869501 conn(0x7ff7e409d110 msgr2=0x7ff7e4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:41.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.294+0000 7ff7eae22700 1 -- 172.21.15.88:0/2317869501 shutdown_connections 2020-02-11T16:05:41.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.294+0000 7ff7eae22700 1 -- 172.21.15.88:0/2317869501 wait complete. 2020-02-11T16:05:41.298 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2020-02-11T16:05:41.308 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:41.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.423+0000 7f50df3b2700 1 Processor -- start 2020-02-11T16:05:41.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.423+0000 7f50df3b2700 1 -- start start 2020-02-11T16:05:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50df3b2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50d805fac0 0x7f50d80a5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:41.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50df3b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d809dba0 con 0x7f50d8139550 2020-02-11T16:05:41.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50df3b2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d805bc80 con 0x7f50d81399e0 2020-02-11T16:05:41.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50df3b2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d80a5ed0 con 0x7f50d805fac0 2020-02-11T16:05:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50dd14e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50d805fac0 0x7f50d80a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50dd94f700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f50d81399e0 0x7f50d805b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39080/0 (socket says 172.21.15.88:39080) 2020-02-11T16:05:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50dd94f700 1 -- 172.21.15.88:0/283973632 learned_addr learned my addr 172.21.15.88:0/283973632 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50dd14e700 1 -- 172.21.15.88:0/283973632 >> v1:172.21.15.88:6789/0 conn(0x7f50d81399e0 legacy=0x7f50d805b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50dd14e700 1 -- 172.21.15.88:0/283973632 >> v1:172.21.15.52:6789/0 conn(0x7f50d8139550 legacy=0x7f50d805ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50dd14e700 1 -- 172.21.15.88:0/283973632 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d809ddd0 con 0x7f50d805fac0 2020-02-11T16:05:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50dd14e700 1 --2- 172.21.15.88:0/283973632 >> v2:172.21.15.88:3300/0 conn(0x7f50d805fac0 0x7f50d80a5030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f50c8002f30 tx=0x7f50c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50dd14e700 1 --2- 172.21.15.88:0/283973632 >> v2:172.21.15.88:3300/0 conn(0x7f50d805fac0 0x7f50d80a5030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f50c8002f30 tx=0x7f50c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.424+0000 7f50dd14e700 1 --2- 172.21.15.88:0/283973632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d805fac0 0x7f50d80a5030 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f50c8002f30 tx=0x7f50c80088e0).ready entity=mon.1 client_cookie=feb33785d53b7621 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:41.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50dd14e700 1 --2- 172.21.15.88:0/283973632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d805fac0 0x7f50d80a5030 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f50c8002f30 tx=0x7f50c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50c7fff700 1 -- 172.21.15.88:0/283973632 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50c8008e40 con 0x7f50d805fac0 2020-02-11T16:05:41.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50dd14e700 1 --2- 172.21.15.88:0/283973632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d805fac0 0x7f50d80a5030 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f50c8002f30 tx=0x7f50c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50dd14e700 1 --2- 172.21.15.88:0/283973632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d805fac0 0x7f50d80a5030 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f50c8002f30 tx=0x7f50c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50c7fff700 1 -- 172.21.15.88:0/283973632 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c80116a0 con 0x7f50d805fac0 2020-02-11T16:05:41.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50c7fff700 1 -- 172.21.15.88:0/283973632 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50c8011a80 con 0x7f50d805fac0 2020-02-11T16:05:41.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50df3b2700 1 -- 172.21.15.88:0/283973632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d805fac0 msgr2=0x7f50d80a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50df3b2700 1 --2- 172.21.15.88:0/283973632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d805fac0 0x7f50d80a5030 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f50c8002f30 tx=0x7f50c80088e0).stop 2020-02-11T16:05:41.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50df3b2700 1 -- 172.21.15.88:0/283973632 shutdown_connections 2020-02-11T16:05:41.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50df3b2700 1 --2- 172.21.15.88:0/283973632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d805fac0 0x7f50d80a5030 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50df3b2700 1 -- 172.21.15.88:0/283973632 >> 172.21.15.88:0/283973632 conn(0x7f50d80a7bb0 msgr2=0x7f50d80a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:41.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50df3b2700 1 -- 172.21.15.88:0/283973632 shutdown_connections 2020-02-11T16:05:41.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.425+0000 7f50df3b2700 1 -- 172.21.15.88:0/283973632 wait complete. 2020-02-11T16:05:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.426+0000 7f50df3b2700 1 Processor -- start 2020-02-11T16:05:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.426+0000 7f50df3b2700 1 -- start start 2020-02-11T16:05:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50df3b2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50d8139550 0x7f50d80a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50df3b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d81364e0 con 0x7f50d81399e0 2020-02-11T16:05:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50df3b2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d8135b70 con 0x7f50d805fac0 2020-02-11T16:05:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50df3b2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d8136fa0 con 0x7f50d8139550 2020-02-11T16:05:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dd14e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f50d805fac0 0x7f50d81468a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39082/0 (socket says 172.21.15.88:39082) 2020-02-11T16:05:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dd14e700 1 -- 172.21.15.88:0/1984762772 learned_addr learned my addr 172.21.15.88:0/1984762772 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> v2:172.21.15.88:3300/0 conn(0x7f50d8139550 0x7f50d80a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50c67fc700 1 -- 172.21.15.88:0/1984762772 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879696851 0 0) 0x7f50d8135b70 con 0x7f50d805fac0 2020-02-11T16:05:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50c67fc700 1 -- 172.21.15.88:0/1984762772 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b8002fe0 con 0x7f50d805fac0 2020-02-11T16:05:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dc94d700 1 -- 172.21.15.88:0/1984762772 >> v1:172.21.15.88:6789/0 conn(0x7f50d805fac0 legacy=0x7f50d81468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dc94d700 1 -- 172.21.15.88:0/1984762772 >> v1:172.21.15.52:6789/0 conn(0x7f50d81399e0 legacy=0x7f50d8146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dc94d700 1 -- 172.21.15.88:0/1984762772 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d81476c0 con 0x7f50d8139550 2020-02-11T16:05:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> v2:172.21.15.88:3300/0 conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> v2:172.21.15.88:3300/0 conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50c67fc700 1 -- 172.21.15.88:0/1984762772 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50d400cc00 con 0x7f50d8139550 2020-02-11T16:05:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50c67fc700 1 -- 172.21.15.88:0/1984762772 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d400cda0 con 0x7f50d8139550 2020-02-11T16:05:41.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50df3b2700 1 -- 172.21.15.88:0/1984762772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d809d110 con 0x7f50d8139550 2020-02-11T16:05:41.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50c67fc700 1 -- 172.21.15.88:0/1984762772 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50d40110f0 con 0x7f50d8139550 2020-02-11T16:05:41.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.427+0000 7f50df3b2700 1 -- 172.21.15.88:0/1984762772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d80a1750 con 0x7f50d8139550 2020-02-11T16:05:41.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.428+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.428+0000 7f50c67fc700 1 -- 172.21.15.88:0/1984762772 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f50d40064e0 con 0x7f50d8139550 2020-02-11T16:05:41.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.428+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.428+0000 7f50c67fc700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f50b8039f10 0x7f50b803c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.428+0000 7f50c67fc700 1 -- 172.21.15.88:0/1984762772 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f50d4049570 con 0x7f50d8139550 2020-02-11T16:05:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.428+0000 7f50dd14e700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f50b8039f10 0x7f50b803c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.429+0000 7f50df3b2700 1 -- 172.21.15.88:0/1984762772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d80565b0 con 0x7f50d8139550 2020-02-11T16:05:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.429+0000 7f50dd14e700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f50b8039f10 0x7f50b803c3d0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.432+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.432+0000 7f50c67fc700 1 -- 172.21.15.88:0/1984762772 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f50d402ec00 con 0x7f50d8139550 2020-02-11T16:05:41.471 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:05:41.475 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:05:41.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.573+0000 7f50df3b2700 1 -- 172.21.15.88:0/1984762772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50d8066bb0 con 0x7f50d8139550 2020-02-11T16:05:41.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.573+0000 7f50dc94d700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.573+0000 7f50c67fc700 1 -- 172.21.15.88:0/1984762772 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f50d4031710 con 0x7f50d8139550 2020-02-11T16:05:41.577 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:41.577 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:39.282613+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-11T16:05:34.022912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-11T16:05:36.964421+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:41.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.575+0000 7f50df3b2700 1 -- 172.21.15.88:0/1984762772 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f50b8039f10 msgr2=0x7f50b803c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.575+0000 7f50df3b2700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f50b8039f10 0x7f50b803c3d0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.575+0000 7f50df3b2700 1 -- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 msgr2=0x7f50d80a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.575+0000 7f50df3b2700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 0x7f50d80a1c20 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f50d40013f0 tx=0x7f50d4010910).stop 2020-02-11T16:05:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.575+0000 7f50df3b2700 1 -- 172.21.15.88:0/1984762772 shutdown_connections 2020-02-11T16:05:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.575+0000 7f50df3b2700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f50b8039f10 0x7f50b803c3d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.575+0000 7f50df3b2700 1 --2- 172.21.15.88:0/1984762772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50d8139550 0x7f50d80a1c20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.575+0000 7f50df3b2700 1 -- 172.21.15.88:0/1984762772 >> 172.21.15.88:0/1984762772 conn(0x7f50d80a7bb0 msgr2=0x7f50d81366f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:41.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.575+0000 7f50df3b2700 1 -- 172.21.15.88:0/1984762772 shutdown_connections 2020-02-11T16:05:41.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.575+0000 7f50df3b2700 1 -- 172.21.15.88:0/1984762772 wait complete. 2020-02-11T16:05:41.589 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-02-11T16:05:41.590 INFO:tasks.ceph.mds.a:Restarting daemon 2020-02-11T16:05:41.590 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-02-11T16:05:41.593 INFO:tasks.ceph.mds.a:Started 2020-02-11T16:05:41.593 INFO:tasks.ceph.mds.b:Restarting daemon 2020-02-11T16:05:41.593 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-02-11T16:05:41.596 INFO:tasks.ceph.mds.b:Started 2020-02-11T16:05:41.597 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:41.597 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-02-11T16:05:41.670 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2020-02-11T16:05:41.682 INFO:tasks.ceph.mds.b.smithi052.stdout:starting mds.b at 2020-02-11T16:05:41.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.703+0000 7fbb2c6c0700 1 Processor -- start 2020-02-11T16:05:41.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.703+0000 7fbb2c6c0700 1 -- start start 2020-02-11T16:05:41.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2c6c0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb240ad380 0x7fbb240a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2c6c0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbb24138280 0x7fbb241386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2c6c0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb2413b1c0 0x7fbb2413b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2c6c0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb24137bf0 con 0x7fbb24138280 2020-02-11T16:05:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2c6c0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb24138b40 con 0x7fbb2413b1c0 2020-02-11T16:05:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2c6c0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240adb40 con 0x7fbb240ad380 2020-02-11T16:05:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb2413b1c0 0x7fbb2413b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb2413b1c0 0x7fbb2413b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51476/0 (socket says 172.21.15.88:51476) 2020-02-11T16:05:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 -- 172.21.15.88:0/1631323029 learned_addr learned my addr 172.21.15.88:0/1631323029 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2a45c700 1 --2- 172.21.15.88:0/1631323029 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb240ad380 0x7fbb240a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1631323029 >> v2:172.21.15.52:3300/0 conn(0x7fbb24138280 0x7fbb241386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 -- 172.21.15.88:0/1631323029 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb240ad380 msgr2=0x7fbb240a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 --2- 172.21.15.88:0/1631323029 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb240ad380 0x7fbb240a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 -- 172.21.15.88:0/1631323029 >> v2:172.21.15.52:3300/0 conn(0x7fbb24138280 msgr2=0x7fbb241386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:41.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 --2- 172.21.15.88:0/1631323029 >> v2:172.21.15.52:3300/0 conn(0x7fbb24138280 0x7fbb241386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:41.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 -- 172.21.15.88:0/1631323029 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb24137de0 con 0x7fbb2413b1c0 2020-02-11T16:05:41.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1631323029 >> v2:172.21.15.52:3300/0 conn(0x7fbb24138280 0x7fbb241386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:41.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 --2- 172.21.15.88:0/1631323029 >> v2:172.21.15.88:3300/0 conn(0x7fbb2413b1c0 0x7fbb2413b600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb1c0032b0 tx=0x7fbb1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 --2- 172.21.15.88:0/1631323029 >> v2:172.21.15.88:3300/0 conn(0x7fbb2413b1c0 0x7fbb2413b600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb1c0032b0 tx=0x7fbb1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 --2- 172.21.15.88:0/1631323029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb2413b1c0 0x7fbb2413b600 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fbb1c0032b0 tx=0x7fbb1c007dc0).ready entity=mon.1 client_cookie=63c8a12e027acfe5 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:41.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 --2- 172.21.15.88:0/1631323029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb2413b1c0 0x7fbb2413b600 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fbb1c0032b0 tx=0x7fbb1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 --2- 172.21.15.88:0/1631323029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb2413b1c0 0x7fbb2413b600 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fbb1c0032b0 tx=0x7fbb1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2945a700 1 -- 172.21.15.88:0/1631323029 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1c00a160 con 0x7fbb2413b1c0 2020-02-11T16:05:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2ac5d700 1 --2- 172.21.15.88:0/1631323029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb2413b1c0 0x7fbb2413b600 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fbb1c0032b0 tx=0x7fbb1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2945a700 1 -- 172.21.15.88:0/1631323029 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c00a2c0 con 0x7fbb2413b1c0 2020-02-11T16:05:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2945a700 1 -- 172.21.15.88:0/1631323029 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1c00a660 con 0x7fbb2413b1c0 2020-02-11T16:05:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1631323029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb2413b1c0 msgr2=0x7fbb2413b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.704+0000 7fbb2c6c0700 1 --2- 172.21.15.88:0/1631323029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb2413b1c0 0x7fbb2413b600 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fbb1c0032b0 tx=0x7fbb1c007dc0).stop 2020-02-11T16:05:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.705+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1631323029 shutdown_connections 2020-02-11T16:05:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.705+0000 7fbb2c6c0700 1 --2- 172.21.15.88:0/1631323029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb2413b1c0 0x7fbb2413b600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.705+0000 7fbb2c6c0700 1 --2- 172.21.15.88:0/1631323029 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb240ad380 0x7fbb240a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.705+0000 7fbb2c6c0700 1 --2- 172.21.15.88:0/1631323029 >> v2:172.21.15.52:3300/0 conn(0x7fbb24138280 0x7fbb241386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.705+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1631323029 >> 172.21.15.88:0/1631323029 conn(0x7fbb2405ac70 msgr2=0x7fbb240ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.705+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1631323029 shutdown_connections 2020-02-11T16:05:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.705+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1631323029 wait complete. 2020-02-11T16:05:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.706+0000 7fbb2c6c0700 1 Processor -- start 2020-02-11T16:05:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.706+0000 7fbb2c6c0700 1 -- start start 2020-02-11T16:05:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.706+0000 7fbb2c6c0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbb24138280 0x7fbb24134d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.706+0000 7fbb2c6c0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2412faa0 con 0x7fbb240ad380 2020-02-11T16:05:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.706+0000 7fbb2c6c0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2412fd40 con 0x7fbb2413b1c0 2020-02-11T16:05:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.706+0000 7fbb2c6c0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb24135220 con 0x7fbb24138280 2020-02-11T16:05:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.706+0000 7fbb2ac5d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbb2413b1c0 0x7fbb2412d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39108/0 (socket says 172.21.15.88:39108) 2020-02-11T16:05:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.706+0000 7fbb2ac5d700 1 -- 172.21.15.88:0/1627387497 learned_addr learned my addr 172.21.15.88:0/1627387497 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> v2:172.21.15.52:3300/0 conn(0x7fbb24138280 0x7fbb24134d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307852126 0 0) 0x7fbb2412fd40 con 0x7fbb2413b1c0 2020-02-11T16:05:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb04002fe0 con 0x7fbb2413b1c0 2020-02-11T16:05:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1698949180 0 0) 0x7fbb04002fe0 con 0x7fbb2413b1c0 2020-02-11T16:05:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb2412fd40 con 0x7fbb2413b1c0 2020-02-11T16:05:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fbb1c011da0 con 0x7fbb2413b1c0 2020-02-11T16:05:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb29c5b700 1 -- 172.21.15.88:0/1627387497 >> v1:172.21.15.88:6789/0 conn(0x7fbb2413b1c0 legacy=0x7fbb2412d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb29c5b700 1 -- 172.21.15.88:0/1627387497 >> v1:172.21.15.52:6789/0 conn(0x7fbb240ad380 legacy=0x7fbb240667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb29c5b700 1 -- 172.21.15.88:0/1627387497 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2412ffe0 con 0x7fbb24138280 2020-02-11T16:05:41.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> v2:172.21.15.52:3300/0 conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> v2:172.21.15.52:3300/0 conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:41.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb20009dd0 con 0x7fbb24138280 2020-02-11T16:05:41.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb200091a0 con 0x7fbb24138280 2020-02-11T16:05:41.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb20009500 con 0x7fbb24138280 2020-02-11T16:05:41.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1627387497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb24130280 con 0x7fbb24138280 2020-02-11T16:05:41.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.707+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1627387497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb24132690 con 0x7fbb24138280 2020-02-11T16:05:41.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.708+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.708+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fbb20009700 con 0x7fbb24138280 2020-02-11T16:05:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.708+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.708+0000 7fbb137fe700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb0403a150 0x7fbb0403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.708+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbb20049140 con 0x7fbb24138280 2020-02-11T16:05:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.708+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1627387497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb24130410 con 0x7fbb24138280 2020-02-11T16:05:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.708+0000 7fbb2a45c700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb0403a150 0x7fbb0403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.709+0000 7fbb2a45c700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb0403a150 0x7fbb0403c610 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.713+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.713+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbb2002e750 con 0x7fbb24138280 2020-02-11T16:05:41.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.848+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1627387497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb240565b0 con 0x7fbb24138280 2020-02-11T16:05:41.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.850+0000 7fbb29c5b700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:41.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.850+0000 7fbb137fe700 1 -- 172.21.15.88:0/1627387497 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14885 (secure 0 0 0) 0x7fbb20031260 con 0x7fbb24138280 2020-02-11T16:05:41.853 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:41.853 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:39.282613+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-11T16:05:34.022912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-11T16:05:36.964421+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:41.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.851+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb0403a150 msgr2=0x7fbb0403c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.851+0000 7fbb2c6c0700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb0403a150 0x7fbb0403c610 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.851+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 msgr2=0x7fbb24134d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:41.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.851+0000 7fbb2c6c0700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 0x7fbb24134d30 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fbb14001f10 tx=0x7fbb200109c0).stop 2020-02-11T16:05:41.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.851+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1627387497 shutdown_connections 2020-02-11T16:05:41.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.851+0000 7fbb2c6c0700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb0403a150 0x7fbb0403c610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.851+0000 7fbb2c6c0700 1 --2- 172.21.15.88:0/1627387497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb24138280 0x7fbb24134d30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:41.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.851+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1627387497 >> 172.21.15.88:0/1627387497 conn(0x7fbb2405ac70 msgr2=0x7fbb24069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:41.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.851+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1627387497 shutdown_connections 2020-02-11T16:05:41.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.851+0000 7fbb2c6c0700 1 -- 172.21.15.88:0/1627387497 wait complete. 2020-02-11T16:05:41.867 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:30.979083+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:34.022912+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:36.964421+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-11T16:05:41.868 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-11T16:05:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.978+0000 7f167f328700 1 Processor -- start 2020-02-11T16:05:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.978+0000 7f167f328700 1 -- start start 2020-02-11T16:05:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f167f328700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f16780a67e0 0x7f167809aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f167f328700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1678139070 con 0x7f16780a28a0 2020-02-11T16:05:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f167f328700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16780a4160 con 0x7f167805b960 2020-02-11T16:05:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f167f328700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167809d950 con 0x7f16780a67e0 2020-02-11T16:05:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f167d0c4700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f167805b960 0x7f1678138250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39114/0 (socket says 172.21.15.88:39114) 2020-02-11T16:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f167d0c4700 1 -- 172.21.15.88:0/2408896789 learned_addr learned my addr 172.21.15.88:0/2408896789 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f167d8c5700 1 --2- 172.21.15.88:0/2408896789 >> v2:172.21.15.52:3300/0 conn(0x7f16780a67e0 0x7f167809aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f1667fff700 1 -- 172.21.15.88:0/2408896789 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913894601 0 0) 0x7f16780a4160 con 0x7f167805b960 2020-02-11T16:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f1667fff700 1 -- 172.21.15.88:0/2408896789 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1660003230 con 0x7f167805b960 2020-02-11T16:05:42.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f1667fff700 1 -- 172.21.15.88:0/2408896789 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4277558229 0 0) 0x7f1660003230 con 0x7f167805b960 2020-02-11T16:05:42.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f167d8c5700 1 -- 172.21.15.88:0/2408896789 >> v1:172.21.15.88:6789/0 conn(0x7f167805b960 legacy=0x7f1678138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f167d8c5700 1 -- 172.21.15.88:0/2408896789 >> v1:172.21.15.52:6789/0 conn(0x7f16780a28a0 legacy=0x7f1678138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.979+0000 7f167d8c5700 1 -- 172.21.15.88:0/2408896789 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167809dbf0 con 0x7f16780a67e0 2020-02-11T16:05:42.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167d8c5700 1 --2- 172.21.15.88:0/2408896789 >> v2:172.21.15.52:3300/0 conn(0x7f16780a67e0 0x7f167809aef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f16740010d0 tx=0x7f1670008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167d8c5700 1 --2- 172.21.15.88:0/2408896789 >> v2:172.21.15.52:3300/0 conn(0x7f16780a67e0 0x7f167809aef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f16740010d0 tx=0x7f1670008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167d8c5700 1 --2- 172.21.15.88:0/2408896789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16780a67e0 0x7f167809aef0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f16740010d0 tx=0x7f1670008c60).ready entity=mon.0 client_cookie=10896e049b066d6a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167d8c5700 1 --2- 172.21.15.88:0/2408896789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16780a67e0 0x7f167809aef0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f16740010d0 tx=0x7f1670008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f1667fff700 1 -- 172.21.15.88:0/2408896789 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16680016d0 con 0x7f16780a67e0 2020-02-11T16:05:42.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167d8c5700 1 --2- 172.21.15.88:0/2408896789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16780a67e0 0x7f167809aef0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f16740010d0 tx=0x7f1670008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f1667fff700 1 -- 172.21.15.88:0/2408896789 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1670010bb0 con 0x7f16780a67e0 2020-02-11T16:05:42.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167d8c5700 1 --2- 172.21.15.88:0/2408896789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16780a67e0 0x7f167809aef0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f16740010d0 tx=0x7f1670008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f1667fff700 1 -- 172.21.15.88:0/2408896789 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16700110c0 con 0x7f16780a67e0 2020-02-11T16:05:42.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167f328700 1 -- 172.21.15.88:0/2408896789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16780a67e0 msgr2=0x7f167809aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167f328700 1 --2- 172.21.15.88:0/2408896789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16780a67e0 0x7f167809aef0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f16740010d0 tx=0x7f1670008c60).stop 2020-02-11T16:05:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167f328700 1 -- 172.21.15.88:0/2408896789 shutdown_connections 2020-02-11T16:05:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167f328700 1 --2- 172.21.15.88:0/2408896789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16780a67e0 0x7f167809aef0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167f328700 1 -- 172.21.15.88:0/2408896789 >> 172.21.15.88:0/2408896789 conn(0x7f16780aac40 msgr2=0x7f16780a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167f328700 1 -- 172.21.15.88:0/2408896789 shutdown_connections 2020-02-11T16:05:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.980+0000 7f167f328700 1 -- 172.21.15.88:0/2408896789 wait complete. 2020-02-11T16:05:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.981+0000 7f167f328700 1 Processor -- start 2020-02-11T16:05:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.981+0000 7f167f328700 1 -- start start 2020-02-11T16:05:42.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167f328700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f167805b960 0x7f1678148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167f328700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167809cad0 con 0x7f16780a67e0 2020-02-11T16:05:42.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167f328700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1678134f40 con 0x7f16780a28a0 2020-02-11T16:05:42.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167f328700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16781351e0 con 0x7f167805b960 2020-02-11T16:05:42.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167d0c4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f167805b960 0x7f1678148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167d0c4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f167805b960 0x7f1678148a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51494/0 (socket says 172.21.15.88:51494) 2020-02-11T16:05:42.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167c8c3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f16780a28a0 0x7f167812fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39122/0 (socket says 172.21.15.88:39122) 2020-02-11T16:05:42.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167d0c4700 1 -- 172.21.15.88:0/209784928 learned_addr learned my addr 172.21.15.88:0/209784928 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:42.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167d0c4700 1 -- 172.21.15.88:0/209784928 >> v1:172.21.15.88:6789/0 conn(0x7f16780a28a0 legacy=0x7f167812fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167d0c4700 1 -- 172.21.15.88:0/209784928 >> v1:172.21.15.52:6789/0 conn(0x7f16780a67e0 legacy=0x7f167814fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167d0c4700 1 -- 172.21.15.88:0/209784928 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678132990 con 0x7f167805b960 2020-02-11T16:05:42.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167d0c4700 1 --2- 172.21.15.88:0/209784928 >> v2:172.21.15.88:3300/0 conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167d0c4700 1 --2- 172.21.15.88:0/209784928 >> v2:172.21.15.88:3300/0 conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167d0c4700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f167d0c4700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.982+0000 7f16667fc700 1 -- 172.21.15.88:0/209784928 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1668012a50 con 0x7f167805b960 2020-02-11T16:05:42.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.983+0000 7f167d0c4700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.983+0000 7f16667fc700 1 -- 172.21.15.88:0/209784928 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668012bb0 con 0x7f167805b960 2020-02-11T16:05:42.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.983+0000 7f167d0c4700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.983+0000 7f167f328700 1 -- 172.21.15.88:0/209784928 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16780a1900 con 0x7f167805b960 2020-02-11T16:05:42.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.983+0000 7f16667fc700 1 -- 172.21.15.88:0/209784928 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f166800c570 con 0x7f167805b960 2020-02-11T16:05:42.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.983+0000 7f167f328700 1 -- 172.21.15.88:0/209784928 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1678066ec0 con 0x7f167805b960 2020-02-11T16:05:42.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.984+0000 7f167f328700 1 -- 172.21.15.88:0/209784928 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1678069730 con 0x7f167805b960 2020-02-11T16:05:42.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.984+0000 7f167d0c4700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.985+0000 7f16667fc700 1 -- 172.21.15.88:0/209784928 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f16680101c0 con 0x7f167805b960 2020-02-11T16:05:42.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.985+0000 7f167d0c4700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.985+0000 7f16667fc700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1658039b50 0x7f165803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.985+0000 7f16667fc700 1 -- 172.21.15.88:0/209784928 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f1668049e60 con 0x7f167805b960 2020-02-11T16:05:42.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.985+0000 7f167c8c3700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1658039b50 0x7f165803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.985+0000 7f167c8c3700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1658039b50 0x7f165803c010 crc :-1 s=READY pgs=51 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.988+0000 7f167d0c4700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:41.988+0000 7f16667fc700 1 -- 172.21.15.88:0/209784928 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f166802f360 con 0x7f167805b960 2020-02-11T16:05:42.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.128+0000 7f167f328700 1 -- 172.21.15.88:0/209784928 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16780565b0 con 0x7f167805b960 2020-02-11T16:05:42.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.129+0000 7f167d0c4700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.129+0000 7f16667fc700 1 -- 172.21.15.88:0/209784928 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1668032040 con 0x7f167805b960 2020-02-11T16:05:42.132 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:42.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.130+0000 7f167f328700 1 -- 172.21.15.88:0/209784928 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1658039b50 msgr2=0x7f165803c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.130+0000 7f167f328700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1658039b50 0x7f165803c010 crc :-1 s=READY pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.130+0000 7f167f328700 1 -- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 msgr2=0x7f1678148a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.130+0000 7f167f328700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 0x7f1678148a40 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f1668001930 tx=0x7f1668010cd0).stop 2020-02-11T16:05:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.130+0000 7f167f328700 1 -- 172.21.15.88:0/209784928 shutdown_connections 2020-02-11T16:05:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.130+0000 7f167f328700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1658039b50 0x7f165803c010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.130+0000 7f167f328700 1 --2- 172.21.15.88:0/209784928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167805b960 0x7f1678148a40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.130+0000 7f167f328700 1 -- 172.21.15.88:0/209784928 >> 172.21.15.88:0/209784928 conn(0x7f16780aac40 msgr2=0x7f1678138610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.130+0000 7f167f328700 1 -- 172.21.15.88:0/209784928 shutdown_connections 2020-02-11T16:05:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.130+0000 7f167f328700 1 -- 172.21.15.88:0/209784928 wait complete. 2020-02-11T16:05:42.143 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-11T16:05:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.248+0000 7f77971c7700 1 Processor -- start 2020-02-11T16:05:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.248+0000 7f77971c7700 1 -- start start 2020-02-11T16:05:42.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f77971c7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77900a4a80 0x7f77900a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f77971c7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f77900a4140 0x7f77900a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f77971c7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7790137900 con 0x7f779005b960 2020-02-11T16:05:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f77971c7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7790137b30 con 0x7f77900a4140 2020-02-11T16:05:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f77971c7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7790137dd0 con 0x7f77900a4a80 2020-02-11T16:05:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77900a4a80 0x7f77900a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f7794f63700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f779005b960 0x7f7790138270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39132/0 (socket says 172.21.15.88:39132) 2020-02-11T16:05:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77900a4a80 0x7f77900a3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51504/0 (socket says 172.21.15.88:51504) 2020-02-11T16:05:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f7794f63700 1 -- 172.21.15.88:0/1674752625 learned_addr learned my addr 172.21.15.88:0/1674752625 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f7795764700 1 --2- 172.21.15.88:0/1674752625 >> v2:172.21.15.52:3300/0 conn(0x7f77900a4140 0x7f77900a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 -- 172.21.15.88:0/1674752625 >> v2:172.21.15.52:3300/0 conn(0x7f77900a4140 msgr2=0x7f77900a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 --2- 172.21.15.88:0/1674752625 >> v2:172.21.15.52:3300/0 conn(0x7f77900a4140 0x7f77900a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 -- 172.21.15.88:0/1674752625 >> v1:172.21.15.88:6789/0 conn(0x7f779005b960 legacy=0x7f7790138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778f7fe700 1 -- 172.21.15.88:0/1674752625 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677131000 0 0) 0x7f7790137900 con 0x7f779005b960 2020-02-11T16:05:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 -- 172.21.15.88:0/1674752625 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77900a6870 con 0x7f77900a4a80 2020-02-11T16:05:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 --2- 172.21.15.88:0/1674752625 >> v2:172.21.15.88:3300/0 conn(0x7f77900a4a80 0x7f77900a3ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7784002f30 tx=0x7f7784007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 --2- 172.21.15.88:0/1674752625 >> v2:172.21.15.88:3300/0 conn(0x7f77900a4a80 0x7f77900a3ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7784002f30 tx=0x7f7784007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 --2- 172.21.15.88:0/1674752625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77900a3ce0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f7784002f30 tx=0x7f7784007a40).ready entity=mon.1 client_cookie=5402be15b011913 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 --2- 172.21.15.88:0/1674752625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77900a3ce0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f7784002f30 tx=0x7f7784007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778f7fe700 1 -- 172.21.15.88:0/1674752625 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77840113c0 con 0x7f77900a4a80 2020-02-11T16:05:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 --2- 172.21.15.88:0/1674752625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77900a3ce0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f7784002f30 tx=0x7f7784007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778ffff700 1 --2- 172.21.15.88:0/1674752625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77900a3ce0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f7784002f30 tx=0x7f7784007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778f7fe700 1 -- 172.21.15.88:0/1674752625 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7784011520 con 0x7f77900a4a80 2020-02-11T16:05:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f778f7fe700 1 -- 172.21.15.88:0/1674752625 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77840118c0 con 0x7f77900a4a80 2020-02-11T16:05:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f77971c7700 1 -- 172.21.15.88:0/1674752625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 msgr2=0x7f77900a3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.249+0000 7f77971c7700 1 --2- 172.21.15.88:0/1674752625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77900a3ce0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f7784002f30 tx=0x7f7784007a40).stop 2020-02-11T16:05:42.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.250+0000 7f77971c7700 1 -- 172.21.15.88:0/1674752625 shutdown_connections 2020-02-11T16:05:42.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.250+0000 7f77971c7700 1 --2- 172.21.15.88:0/1674752625 >> v2:172.21.15.52:3300/0 conn(0x7f77900a4140 0x7f77900a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:42.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.250+0000 7f77971c7700 1 --2- 172.21.15.88:0/1674752625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77900a3ce0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.250+0000 7f77971c7700 1 -- 172.21.15.88:0/1674752625 >> 172.21.15.88:0/1674752625 conn(0x7f77900aac40 msgr2=0x7f77900a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.250+0000 7f77971c7700 1 -- 172.21.15.88:0/1674752625 shutdown_connections 2020-02-11T16:05:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.250+0000 7f77971c7700 1 -- 172.21.15.88:0/1674752625 wait complete. 2020-02-11T16:05:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.251+0000 7f77971c7700 1 Processor -- start 2020-02-11T16:05:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.251+0000 7f77971c7700 1 -- start start 2020-02-11T16:05:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.251+0000 7f77971c7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779005b960 0x7f779009c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f77971c7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77900a4a80 0x7f77901317f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f77971c7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7790130e10 con 0x7f77900a4140 2020-02-11T16:05:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f77971c7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779012e770 con 0x7f77900a4a80 2020-02-11T16:05:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f77971c7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77901310b0 con 0x7f779005b960 2020-02-11T16:05:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77900a4a80 0x7f77901317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f778ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f77900a4140 0x7f7790146c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39136/0 (socket says 172.21.15.88:39136) 2020-02-11T16:05:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77900a4a80 0x7f77901317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51512/0 (socket says 172.21.15.88:51512) 2020-02-11T16:05:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f778ffff700 1 -- 172.21.15.88:0/3266033591 learned_addr learned my addr 172.21.15.88:0/3266033591 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 -- 172.21.15.88:0/3266033591 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779005b960 msgr2=0x7f779009c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779005b960 0x7f779009c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f778dffb700 1 -- 172.21.15.88:0/3266033591 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777034043 0 0) 0x7f7790130e10 con 0x7f77900a4140 2020-02-11T16:05:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 -- 172.21.15.88:0/3266033591 >> v1:172.21.15.88:6789/0 conn(0x7f77900a4140 legacy=0x7f7790146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 -- 172.21.15.88:0/3266033591 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790131350 con 0x7f77900a4a80 2020-02-11T16:05:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> v2:172.21.15.88:3300/0 conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> v2:172.21.15.88:3300/0 conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f778dffb700 1 -- 172.21.15.88:0/3266033591 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f778800e350 con 0x7f77900a4a80 2020-02-11T16:05:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f778dffb700 1 -- 172.21.15.88:0/3266033591 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7788005c30 con 0x7f77900a4a80 2020-02-11T16:05:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f77971c7700 1 -- 172.21.15.88:0/3266033591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77900a20a0 con 0x7f77900a4a80 2020-02-11T16:05:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f778dffb700 1 -- 172.21.15.88:0/3266033591 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7788012a00 con 0x7f77900a4a80 2020-02-11T16:05:42.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.252+0000 7f77971c7700 1 -- 172.21.15.88:0/3266033591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7790130020 con 0x7f77900a4a80 2020-02-11T16:05:42.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.253+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.253+0000 7f778dffb700 1 -- 172.21.15.88:0/3266033591 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f7788012b60 con 0x7f77900a4a80 2020-02-11T16:05:42.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.253+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.253+0000 7f77971c7700 1 -- 172.21.15.88:0/3266033591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7790131510 con 0x7f77900a4a80 2020-02-11T16:05:42.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.253+0000 7f778dffb700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7770039c90 0x7f777003c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.253+0000 7f778dffb700 1 -- 172.21.15.88:0/3266033591 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7788049940 con 0x7f77900a4a80 2020-02-11T16:05:42.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.253+0000 7f7794f63700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7770039c90 0x7f777003c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.254+0000 7f7794f63700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7770039c90 0x7f777003c150 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.257+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.257+0000 7f778dffb700 1 -- 172.21.15.88:0/3266033591 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f778802ef70 con 0x7f77900a4a80 2020-02-11T16:05:42.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.389+0000 7f77971c7700 1 -- 172.21.15.88:0/3266033591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77900565b0 con 0x7f77900a4a80 2020-02-11T16:05:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.390+0000 7f7795764700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.390+0000 7f778dffb700 1 -- 172.21.15.88:0/3266033591 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7788031a20 con 0x7f77900a4a80 2020-02-11T16:05:42.393 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:42.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 -- 172.21.15.88:0/3266033591 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7770039c90 msgr2=0x7f777003c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7770039c90 0x7f777003c150 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 -- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 msgr2=0x7f77901317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77901317f0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f77880032b0 tx=0x7f7788010f70).stop 2020-02-11T16:05:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 -- 172.21.15.88:0/3266033591 shutdown_connections 2020-02-11T16:05:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7770039c90 0x7f777003c150 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77900a4a80 0x7f77901317f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 --2- 172.21.15.88:0/3266033591 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779005b960 0x7f779009c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 -- 172.21.15.88:0/3266033591 >> 172.21.15.88:0/3266033591 conn(0x7f77900aac40 msgr2=0x7f779005a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:42.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 -- 172.21.15.88:0/3266033591 shutdown_connections 2020-02-11T16:05:42.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.391+0000 7f77971c7700 1 -- 172.21.15.88:0/3266033591 wait complete. 2020-02-11T16:05:42.404 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-11T16:05:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.509+0000 7f328a95f700 1 Processor -- start 2020-02-11T16:05:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.509+0000 7f328a95f700 1 -- start start 2020-02-11T16:05:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.509+0000 7f328a95f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 0x7f32840a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.509+0000 7f328a95f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f32840a28a0 0x7f328409aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.509+0000 7f328a95f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840a4160 con 0x7f32840a5c60 2020-02-11T16:05:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.509+0000 7f328a95f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328409d950 con 0x7f32840a28a0 2020-02-11T16:05:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.509+0000 7f328a95f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328409dbf0 con 0x7f328405b960 2020-02-11T16:05:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f3283fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 0x7f32840a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f32840a28a0 0x7f328409aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f3288efc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f32840a5c60 0x7f3284138250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59158/0 (socket says 172.21.15.88:59158) 2020-02-11T16:05:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f3283fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 0x7f32840a67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:45842/0 (socket says 172.21.15.88:45842) 2020-02-11T16:05:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f3288efc700 1 -- 172.21.15.88:0/648903945 learned_addr learned my addr 172.21.15.88:0/648903945 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 -- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 msgr2=0x7f32840a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 --2- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 0x7f32840a67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 -- 172.21.15.88:0/648903945 >> v1:172.21.15.52:6789/0 conn(0x7f32840a5c60 legacy=0x7f3284138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 -- 172.21.15.88:0/648903945 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840a60d0 con 0x7f32840a28a0 2020-02-11T16:05:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f3282ffd700 1 -- 172.21.15.88:0/648903945 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741340579 0 0) 0x7f32840a4160 con 0x7f32840a5c60 2020-02-11T16:05:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f3283fff700 1 --2- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 0x7f32840a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 --2- 172.21.15.88:0/648903945 >> v2:172.21.15.52:3300/0 conn(0x7f32840a28a0 0x7f328409aef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3278002f30 tx=0x7f32780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 --2- 172.21.15.88:0/648903945 >> v2:172.21.15.52:3300/0 conn(0x7f32840a28a0 0x7f328409aef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3278002f30 tx=0x7f32780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 --2- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32840a28a0 0x7f328409aef0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f32780088e0).ready entity=mon.0 client_cookie=756e962f88d378ee server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 --2- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32840a28a0 0x7f328409aef0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f32780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f3282ffd700 1 -- 172.21.15.88:0/648903945 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3278008e40 con 0x7f32840a28a0 2020-02-11T16:05:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 --2- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32840a28a0 0x7f328409aef0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f32780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f3282ffd700 1 -- 172.21.15.88:0/648903945 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32780115f0 con 0x7f32840a28a0 2020-02-11T16:05:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f32837fe700 1 --2- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32840a28a0 0x7f328409aef0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f32780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f3282ffd700 1 -- 172.21.15.88:0/648903945 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3278011990 con 0x7f32840a28a0 2020-02-11T16:05:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f328a95f700 1 -- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32840a28a0 msgr2=0x7f328409aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.510+0000 7f328a95f700 1 --2- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32840a28a0 0x7f328409aef0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f32780088e0).stop 2020-02-11T16:05:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.511+0000 7f328a95f700 1 -- 172.21.15.88:0/648903945 shutdown_connections 2020-02-11T16:05:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.511+0000 7f328a95f700 1 --2- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 0x7f32840a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.511+0000 7f328a95f700 1 --2- 172.21.15.88:0/648903945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32840a28a0 0x7f328409aef0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.511+0000 7f328a95f700 1 -- 172.21.15.88:0/648903945 >> 172.21.15.88:0/648903945 conn(0x7f32840aac40 msgr2=0x7f32840a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.511+0000 7f328a95f700 1 -- 172.21.15.88:0/648903945 shutdown_connections 2020-02-11T16:05:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.511+0000 7f328a95f700 1 -- 172.21.15.88:0/648903945 wait complete. 2020-02-11T16:05:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.512+0000 7f328a95f700 1 Processor -- start 2020-02-11T16:05:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.512+0000 7f328a95f700 1 -- start start 2020-02-11T16:05:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.512+0000 7f328a95f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 0x7f32840a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.512+0000 7f328a95f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32840a28a0 0x7f3284061620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.512+0000 7f328a95f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3284061b30 con 0x7f32840a5c60 2020-02-11T16:05:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.512+0000 7f328a95f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3284061dd0 con 0x7f32840a28a0 2020-02-11T16:05:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.512+0000 7f328a95f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3284145230 con 0x7f328405b960 2020-02-11T16:05:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32840a28a0 0x7f3284061620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f3288efc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f32840a5c60 0x7f328412ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39152/0 (socket says 172.21.15.88:39152) 2020-02-11T16:05:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f3288efc700 1 -- 172.21.15.88:0/1936431507 learned_addr learned my addr 172.21.15.88:0/1936431507 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f3283fff700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 0x7f32840a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 -- 172.21.15.88:0/1936431507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 msgr2=0x7f32840a5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 0x7f32840a5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 -- 172.21.15.88:0/1936431507 >> v1:172.21.15.88:6789/0 conn(0x7f32840a5c60 legacy=0x7f328412ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32817fa700 1 -- 172.21.15.88:0/1936431507 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525485007 0 0) 0x7f3284061b30 con 0x7f32840a5c60 2020-02-11T16:05:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 -- 172.21.15.88:0/1936431507 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284132990 con 0x7f32840a28a0 2020-02-11T16:05:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> v2:172.21.15.88:3300/0 conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> v2:172.21.15.88:3300/0 conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32817fa700 1 -- 172.21.15.88:0/1936431507 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3278007150 con 0x7f32840a28a0 2020-02-11T16:05:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32817fa700 1 -- 172.21.15.88:0/1936431507 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32780072b0 con 0x7f32840a28a0 2020-02-11T16:05:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f328a95f700 1 -- 172.21.15.88:0/1936431507 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328412f520 con 0x7f32840a28a0 2020-02-11T16:05:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f32817fa700 1 -- 172.21.15.88:0/1936431507 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32780056c0 con 0x7f32840a28a0 2020-02-11T16:05:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.513+0000 7f328a95f700 1 -- 172.21.15.88:0/1936431507 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32840a5a60 con 0x7f32840a28a0 2020-02-11T16:05:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.514+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.514+0000 7f32817fa700 1 -- 172.21.15.88:0/1936431507 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f32780080a0 con 0x7f32840a28a0 2020-02-11T16:05:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.514+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.514+0000 7f328a95f700 1 -- 172.21.15.88:0/1936431507 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32840565b0 con 0x7f32840a28a0 2020-02-11T16:05:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.514+0000 7f32817fa700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3264039ba0 0x7f326403c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.514+0000 7f32817fa700 1 -- 172.21.15.88:0/1936431507 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3278049c20 con 0x7f32840a28a0 2020-02-11T16:05:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.514+0000 7f3283fff700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3264039ba0 0x7f326403c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.515+0000 7f3283fff700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3264039ba0 0x7f326403c060 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.518+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.518+0000 7f32817fa700 1 -- 172.21.15.88:0/1936431507 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3278032240 con 0x7f32840a28a0 2020-02-11T16:05:42.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.651+0000 7f328a95f700 1 -- 172.21.15.88:0/1936431507 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32840ab050 con 0x7f32840a28a0 2020-02-11T16:05:42.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.652+0000 7f32837fe700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.652+0000 7f32817fa700 1 -- 172.21.15.88:0/1936431507 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3278031e00 con 0x7f32840a28a0 2020-02-11T16:05:42.655 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:42.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 -- 172.21.15.88:0/1936431507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3264039ba0 msgr2=0x7f326403c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3264039ba0 0x7f326403c060 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 -- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 msgr2=0x7f3284061620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 0x7f3284061620 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f3278002f30 tx=0x7f328405bd40).stop 2020-02-11T16:05:42.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 -- 172.21.15.88:0/1936431507 shutdown_connections 2020-02-11T16:05:42.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3264039ba0 0x7f326403c060 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f328405b960 0x7f32840a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 --2- 172.21.15.88:0/1936431507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32840a28a0 0x7f3284061620 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 -- 172.21.15.88:0/1936431507 >> 172.21.15.88:0/1936431507 conn(0x7f32840aac40 msgr2=0x7f32841313e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:42.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 -- 172.21.15.88:0/1936431507 shutdown_connections 2020-02-11T16:05:42.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.653+0000 7f328a95f700 1 -- 172.21.15.88:0/1936431507 wait complete. 2020-02-11T16:05:42.666 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-02-11T16:05:42.666 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-02-11T16:05:42.667 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-02-11T16:05:42.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.769+0000 7f3c1295d700 1 Processor -- start 2020-02-11T16:05:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.769+0000 7f3c1295d700 1 -- start start 2020-02-11T16:05:42.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.769+0000 7f3c1295d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c0a2fa0 0x7f3c0c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:42.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.769+0000 7f3c1295d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3c0c0a5410 0x7f3c0c0a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:42.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.769+0000 7f3c1295d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c0a4350 con 0x7f3c0c0a6da0 2020-02-11T16:05:42.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.769+0000 7f3c1295d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c0a1e60 con 0x7f3c0c0a5410 2020-02-11T16:05:42.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.769+0000 7f3c1295d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0a3450 con 0x7f3c0c0a2fa0 2020-02-11T16:05:42.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.769+0000 7f3c10efa700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3c0c0a6da0 0x7f3c0c131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39156/0 (socket says 172.21.15.88:39156) 2020-02-11T16:05:42.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.769+0000 7f3c10efa700 1 -- 172.21.15.88:0/513718073 learned_addr learned my addr 172.21.15.88:0/513718073 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:42.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/513718073 >> v2:172.21.15.52:3300/0 conn(0x7f3c0c0a5410 0x7f3c0c0a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0bfff700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c0a2fa0 0x7f3c0c0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539953067 0 0) 0x7f3c0c0a4350 con 0x7f3c0c0a6da0 2020-02-11T16:05:42.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf8003230 con 0x7f3c0c0a6da0 2020-02-11T16:05:42.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1254240982 0 0) 0x7f3bf8003230 con 0x7f3c0c0a6da0 2020-02-11T16:05:42.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c0a2fa0 msgr2=0x7f3c0c0a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:42.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c0a2fa0 0x7f3c0c0a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:42.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 >> v2:172.21.15.52:3300/0 conn(0x7f3c0c0a5410 msgr2=0x7f3c0c0a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:42.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 --2- 172.21.15.88:0/513718073 >> v2:172.21.15.52:3300/0 conn(0x7f3c0c0a5410 0x7f3c0c0a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:42.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c0a3a40 con 0x7f3c0c0a6da0 2020-02-11T16:05:42.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f3c04001a50 con 0x7f3c0c0a6da0 2020-02-11T16:05:42.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 >> v1:172.21.15.88:6789/0 conn(0x7f3c0c0a6da0 legacy=0x7f3c0c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8003720 0x7f3bf8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:42.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf8004060 0x7f3bf8004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:42.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c0a2fa0 0x7f3bf8004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:42.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0a1e60 con 0x7f3bf8003720 2020-02-11T16:05:42.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8004f70 con 0x7f3bf8004060 2020-02-11T16:05:42.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8005130 con 0x7f3c0c0a2fa0 2020-02-11T16:05:42.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0bfff700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8003720 0x7f3bf8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf8004060 0x7f3bf8004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c10efa700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c0a2fa0 0x7f3bf8004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0b7fe700 1 -- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c0a2fa0 msgr2=0x7f3bf8004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:42.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c0a2fa0 0x7f3bf8004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:42.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0b7fe700 1 -- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8003720 msgr2=0x7f3bf8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:42.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8003720 0x7f3bf8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:42.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0b7fe700 1 -- 172.21.15.88:0/513718073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8003230 con 0x7f3bf8004060 2020-02-11T16:05:42.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.770+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf8004060 0x7f3bf8004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf8004060 0x7f3bf8004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf8004060 0x7f3bf8004530 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).ready entity=mon.1 client_cookie=b2f47b4ed5ca672 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf8004060 0x7f3bf8004530 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c00008d50 con 0x7f3bf8004060 2020-02-11T16:05:42.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf8004060 0x7f3bf8004530 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c00010970 con 0x7f3bf8004060 2020-02-11T16:05:42.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf8004060 0x7f3bf8004530 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c0affd700 1 -- 172.21.15.88:0/513718073 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c00010d50 con 0x7f3bf8004060 2020-02-11T16:05:42.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c1295d700 1 -- 172.21.15.88:0/513718073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf8004060 msgr2=0x7f3bf8004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c1295d700 1 --2- 172.21.15.88:0/513718073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf8004060 0x7f3bf8004530 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).stop 2020-02-11T16:05:42.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c10efa700 1 -- 172.21.15.88:0/513718073 reap_dead start 2020-02-11T16:05:42.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c1295d700 1 -- 172.21.15.88:0/513718073 shutdown_connections 2020-02-11T16:05:42.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c1295d700 1 -- 172.21.15.88:0/513718073 >> 172.21.15.88:0/513718073 conn(0x7f3c0c09d110 msgr2=0x7f3c0c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:42.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c1295d700 1 -- 172.21.15.88:0/513718073 shutdown_connections 2020-02-11T16:05:42.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.771+0000 7f3c1295d700 1 -- 172.21.15.88:0/513718073 wait complete. 2020-02-11T16:05:42.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.772+0000 7f3c1295d700 1 Processor -- start 2020-02-11T16:05:42.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.772+0000 7f3c1295d700 1 -- start start 2020-02-11T16:05:42.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c1295d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3c0c138bf0 0x7f3c0c126600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c1295d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3c0c1283a0 0x7f3c0c1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c1295d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c143710 0x7f3c0c09f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c1295d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c143ba0 con 0x7f3c0c138bf0 2020-02-11T16:05:42.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c1295d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c0a7840 con 0x7f3c0c1283a0 2020-02-11T16:05:42.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c1295d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c128840 con 0x7f3c0c143710 2020-02-11T16:05:42.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3c0c1283a0 0x7f3c0c1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3c0c138bf0 0x7f3c0c126600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3c0c1283a0 0x7f3c0c1432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51544/0 (socket says 172.21.15.88:51544) 2020-02-11T16:05:42.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 -- 172.21.15.88:0/1363521109 learned_addr learned my addr 172.21.15.88:0/1363521109 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:42.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c10efa700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c143710 0x7f3c0c09f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 -- 172.21.15.88:0/1363521109 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c143710 msgr2=0x7f3c0c09f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c143710 0x7f3c0c09f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 -- 172.21.15.88:0/1363521109 >> v2:172.21.15.52:3300/0 conn(0x7f3c0c138bf0 msgr2=0x7f3c0c126600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> v2:172.21.15.52:3300/0 conn(0x7f3c0c138bf0 0x7f3c0c126600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 -- 172.21.15.88:0/1363521109 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c128ae0 con 0x7f3c0c1283a0 2020-02-11T16:05:42.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> v2:172.21.15.88:3300/0 conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> v2:172.21.15.88:3300/0 conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c097fa700 1 -- 172.21.15.88:0/1363521109 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c0000fad0 con 0x7f3c0c1283a0 2020-02-11T16:05:42.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c097fa700 1 -- 172.21.15.88:0/1363521109 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c000078a0 con 0x7f3c0c1283a0 2020-02-11T16:05:42.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c1295d700 1 -- 172.21.15.88:0/1363521109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c128d80 con 0x7f3c0c1283a0 2020-02-11T16:05:42.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.773+0000 7f3c097fa700 1 -- 172.21.15.88:0/1363521109 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c000058b0 con 0x7f3c0c1283a0 2020-02-11T16:05:42.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.774+0000 7f3c1295d700 1 -- 172.21.15.88:0/1363521109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c09f9a0 con 0x7f3c0c1283a0 2020-02-11T16:05:42.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.774+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.774+0000 7f3c097fa700 1 -- 172.21.15.88:0/1363521109 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f3c00005b20 con 0x7f3c0c1283a0 2020-02-11T16:05:42.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.774+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.774+0000 7f3c1295d700 1 -- 172.21.15.88:0/1363521109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c128f10 con 0x7f3c0c1283a0 2020-02-11T16:05:42.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.774+0000 7f3c097fa700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3bec039d00 0x7f3bec03c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.775+0000 7f3c097fa700 1 -- 172.21.15.88:0/1363521109 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3c00049890 con 0x7f3c0c1283a0 2020-02-11T16:05:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.775+0000 7f3c0bfff700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3bec039d00 0x7f3bec03c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.775+0000 7f3c0bfff700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3bec039d00 0x7f3bec03c1c0 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.778+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.778+0000 7f3c097fa700 1 -- 172.21.15.88:0/1363521109 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3c0002efa0 con 0x7f3c0c1283a0 2020-02-11T16:05:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.948+0000 7f3c1295d700 1 -- 172.21.15.88:0/1363521109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3c0c0565b0 con 0x7f3c0c1283a0 2020-02-11T16:05:42.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.950+0000 7f3c0b7fe700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:42.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.950+0000 7f3c097fa700 1 -- 172.21.15.88:0/1363521109 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+92790 (secure 0 0 0) 0x7f3c00031a90 con 0x7f3c0c1283a0 2020-02-11T16:05:42.954 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:42.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 -- 172.21.15.88:0/1363521109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3bec039d00 msgr2=0x7f3bec03c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3bec039d00 0x7f3bec03c1c0 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 -- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 msgr2=0x7f3c0c1432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:42.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 0x7f3c0c1432b0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f3c00008910 tx=0x7f3c00010080).stop 2020-02-11T16:05:42.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 -- 172.21.15.88:0/1363521109 shutdown_connections 2020-02-11T16:05:42.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3c0c143710 0x7f3c0c09f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3bec039d00 0x7f3bec03c1c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 --2- 172.21.15.88:0/1363521109 >> v2:172.21.15.52:3300/0 conn(0x7f3c0c138bf0 0x7f3c0c126600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 --2- 172.21.15.88:0/1363521109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1283a0 0x7f3c0c1432b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:42.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 -- 172.21.15.88:0/1363521109 >> 172.21.15.88:0/1363521109 conn(0x7f3c0c09d110 msgr2=0x7f3c0c0a9980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:42.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 -- 172.21.15.88:0/1363521109 shutdown_connections 2020-02-11T16:05:42.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:42.951+0000 7f3c1295d700 1 -- 172.21.15.88:0/1363521109 wait complete. 2020-02-11T16:05:42.965 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":4,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":30001},{"type":"v1","addr":"172.21.15.52:6801","nonce":30001}]},"active_addr":"172.21.15.52:6801/30001","active_change":"2020-02-11T16:05:20.944814+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4114,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_services":{"name":"warn_on_stray_services","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_services":{"name":"warn_on_stray_services","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":3999949569}]}]}} 2020-02-11T16:05:42.970 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-02-11T16:05:42.970 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-02-11T16:05:42.970 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:43.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.073+0000 7fb03e3a8700 1 Processor -- start 2020-02-11T16:05:43.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.073+0000 7fb03e3a8700 1 -- start start 2020-02-11T16:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb03e3a8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb0380a2fa0 0x7fb0380a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb03e3a8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 0x7fb0380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb03e3a8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0380a4350 con 0x7fb038131280 2020-02-11T16:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb03e3a8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0380a1e60 con 0x7fb0380a2fa0 2020-02-11T16:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb03e3a8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380a3450 con 0x7fb0380a5410 2020-02-11T16:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb03c945700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb038131280 0x7fb0381316f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39178/0 (socket says 172.21.15.88:39178) 2020-02-11T16:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb03c945700 1 -- 172.21.15.88:0/691277145 learned_addr learned my addr 172.21.15.88:0/691277145 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb037fff700 1 --2- 172.21.15.88:0/691277145 >> v2:172.21.15.52:3300/0 conn(0x7fb0380a2fa0 0x7fb0380a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb0377fe700 1 --2- 172.21.15.88:0/691277145 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 0x7fb0380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb036ffd700 1 -- 172.21.15.88:0/691277145 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862958119 0 0) 0x7fb0380a4350 con 0x7fb038131280 2020-02-11T16:05:43.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.074+0000 7fb036ffd700 1 -- 172.21.15.88:0/691277145 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb024003230 con 0x7fb038131280 2020-02-11T16:05:43.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb0377fe700 1 -- 172.21.15.88:0/691277145 >> v2:172.21.15.52:3300/0 conn(0x7fb0380a2fa0 msgr2=0x7fb0380a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:43.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb0377fe700 1 --2- 172.21.15.88:0/691277145 >> v2:172.21.15.52:3300/0 conn(0x7fb0380a2fa0 0x7fb0380a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb0377fe700 1 -- 172.21.15.88:0/691277145 >> v1:172.21.15.88:6789/0 conn(0x7fb038131280 legacy=0x7fb0381316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb0377fe700 1 -- 172.21.15.88:0/691277145 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0380a3a40 con 0x7fb0380a5410 2020-02-11T16:05:43.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb037fff700 1 --2- 172.21.15.88:0/691277145 >> v2:172.21.15.52:3300/0 conn(0x7fb0380a2fa0 0x7fb0380a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:43.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb0377fe700 1 --2- 172.21.15.88:0/691277145 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 0x7fb0380a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb02c002f30 tx=0x7fb02c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb0377fe700 1 --2- 172.21.15.88:0/691277145 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 0x7fb0380a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb02c002f30 tx=0x7fb02c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb0377fe700 1 --2- 172.21.15.88:0/691277145 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 0x7fb0380a5870 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fb02c002f30 tx=0x7fb02c0088e0).ready entity=mon.2 client_cookie=787dc4a9afff9afb server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb0377fe700 1 --2- 172.21.15.88:0/691277145 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 0x7fb0380a5870 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fb02c002f30 tx=0x7fb02c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb036ffd700 1 -- 172.21.15.88:0/691277145 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb02c008e40 con 0x7fb0380a5410 2020-02-11T16:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb0377fe700 1 --2- 172.21.15.88:0/691277145 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 0x7fb0380a5870 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fb02c002f30 tx=0x7fb02c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb036ffd700 1 -- 172.21.15.88:0/691277145 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c011540 con 0x7fb0380a5410 2020-02-11T16:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb0377fe700 1 --2- 172.21.15.88:0/691277145 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 0x7fb0380a5870 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fb02c002f30 tx=0x7fb02c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb036ffd700 1 -- 172.21.15.88:0/691277145 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb02c0118e0 con 0x7fb0380a5410 2020-02-11T16:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb03e3a8700 1 -- 172.21.15.88:0/691277145 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 msgr2=0x7fb0380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.075+0000 7fb03e3a8700 1 --2- 172.21.15.88:0/691277145 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 0x7fb0380a5870 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fb02c002f30 tx=0x7fb02c0088e0).stop 2020-02-11T16:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.076+0000 7fb03e3a8700 1 -- 172.21.15.88:0/691277145 shutdown_connections 2020-02-11T16:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.076+0000 7fb03e3a8700 1 --2- 172.21.15.88:0/691277145 >> v2:172.21.15.52:3300/0 conn(0x7fb0380a2fa0 0x7fb0380a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.076+0000 7fb03e3a8700 1 --2- 172.21.15.88:0/691277145 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0380a5410 0x7fb0380a5870 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.076+0000 7fb03e3a8700 1 -- 172.21.15.88:0/691277145 >> 172.21.15.88:0/691277145 conn(0x7fb03809d110 msgr2=0x7fb03809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.076+0000 7fb03e3a8700 1 -- 172.21.15.88:0/691277145 shutdown_connections 2020-02-11T16:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.076+0000 7fb03e3a8700 1 -- 172.21.15.88:0/691277145 wait complete. 2020-02-11T16:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.076+0000 7fb03e3a8700 1 Processor -- start 2020-02-11T16:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.076+0000 7fb03e3a8700 1 -- start start 2020-02-11T16:05:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.077+0000 7fb03e3a8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0380a2fa0 0x7fb0381367a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.077+0000 7fb03e3a8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb038131280 0x7fb038136c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.077+0000 7fb03e3a8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb038062240 con 0x7fb0380a5410 2020-02-11T16:05:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.077+0000 7fb03e3a8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb038066e70 con 0x7fb038131280 2020-02-11T16:05:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.077+0000 7fb03e3a8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb038061d00 con 0x7fb0380a2fa0 2020-02-11T16:05:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.077+0000 7fb037fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0380a2fa0 0x7fb0381367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.077+0000 7fb037fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0380a2fa0 0x7fb0381367a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51554/0 (socket says 172.21.15.88:51554) 2020-02-11T16:05:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.077+0000 7fb0377fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb0380a5410 0x7fb0381465f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39182/0 (socket says 172.21.15.88:39182) 2020-02-11T16:05:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.077+0000 7fb037fff700 1 -- 172.21.15.88:0/3450945532 learned_addr learned my addr 172.21.15.88:0/3450945532 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.077+0000 7fb03c945700 1 --2- 172.21.15.88:0/3450945532 >> v2:172.21.15.52:3300/0 conn(0x7fb038131280 0x7fb038136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 -- 172.21.15.88:0/3450945532 >> v2:172.21.15.52:3300/0 conn(0x7fb038131280 msgr2=0x7fb038136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> v2:172.21.15.52:3300/0 conn(0x7fb038131280 0x7fb038136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb0357fa700 1 -- 172.21.15.88:0/3450945532 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097878231 0 0) 0x7fb038062240 con 0x7fb0380a5410 2020-02-11T16:05:43.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 -- 172.21.15.88:0/3450945532 >> v1:172.21.15.88:6789/0 conn(0x7fb0380a5410 legacy=0x7fb0381465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 -- 172.21.15.88:0/3450945532 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038061fa0 con 0x7fb0380a2fa0 2020-02-11T16:05:43.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> v2:172.21.15.88:3300/0 conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> v2:172.21.15.88:3300/0 conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb0357fa700 1 -- 172.21.15.88:0/3450945532 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb028007540 con 0x7fb0380a2fa0 2020-02-11T16:05:43.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb03e3a8700 1 -- 172.21.15.88:0/3450945532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0381377b0 con 0x7fb0380a2fa0 2020-02-11T16:05:43.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb0357fa700 1 -- 172.21.15.88:0/3450945532 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb028005a60 con 0x7fb0380a2fa0 2020-02-11T16:05:43.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb0357fa700 1 -- 172.21.15.88:0/3450945532 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb028005e40 con 0x7fb0380a2fa0 2020-02-11T16:05:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb03e3a8700 1 -- 172.21.15.88:0/3450945532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03805b9c0 con 0x7fb0380a2fa0 2020-02-11T16:05:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.078+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.079+0000 7fb0357fa700 1 -- 172.21.15.88:0/3450945532 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fb028010180 con 0x7fb0380a2fa0 2020-02-11T16:05:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.079+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.079+0000 7fb0357fa700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb018039a20 0x7fb01803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.079+0000 7fb03e3a8700 1 -- 172.21.15.88:0/3450945532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb038146310 con 0x7fb0380a2fa0 2020-02-11T16:05:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.079+0000 7fb0357fa700 1 -- 172.21.15.88:0/3450945532 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb028049cc0 con 0x7fb0380a2fa0 2020-02-11T16:05:43.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.079+0000 7fb0377fe700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb018039a20 0x7fb01803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.079+0000 7fb0377fe700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb018039a20 0x7fb01803bee0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.082+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.082+0000 7fb0357fa700 1 -- 172.21.15.88:0/3450945532 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb02802f1a0 con 0x7fb0380a2fa0 2020-02-11T16:05:43.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.218+0000 7fb03e3a8700 1 -- 172.21.15.88:0/3450945532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0380565b0 con 0x7fb0380a2fa0 2020-02-11T16:05:43.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.219+0000 7fb037fff700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.219+0000 7fb0357fa700 1 -- 172.21.15.88:0/3450945532 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14885 (secure 0 0 0) 0x7fb028031e40 con 0x7fb0380a2fa0 2020-02-11T16:05:43.222 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:43.222 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:39.282613+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-11T16:05:34.022912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-11T16:05:36.964421+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:43.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 -- 172.21.15.88:0/3450945532 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb018039a20 msgr2=0x7fb01803bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb018039a20 0x7fb01803bee0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 -- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 msgr2=0x7fb0381367a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 0x7fb0381367a0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7fb038130f50 tx=0x7fb028010f60).stop 2020-02-11T16:05:43.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 -- 172.21.15.88:0/3450945532 shutdown_connections 2020-02-11T16:05:43.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb018039a20 0x7fb01803bee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 --2- 172.21.15.88:0/3450945532 >> v2:172.21.15.52:3300/0 conn(0x7fb038131280 0x7fb038136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 --2- 172.21.15.88:0/3450945532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0380a2fa0 0x7fb0381367a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 -- 172.21.15.88:0/3450945532 >> 172.21.15.88:0/3450945532 conn(0x7fb03809d110 msgr2=0x7fb038069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:43.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 -- 172.21.15.88:0/3450945532 shutdown_connections 2020-02-11T16:05:43.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.220+0000 7fb03e3a8700 1 -- 172.21.15.88:0/3450945532 wait complete. 2020-02-11T16:05:43.234 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-02-11T16:05:43.234 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:43.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.336+0000 7f4b474ba700 1 Processor -- start 2020-02-11T16:05:43.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.336+0000 7f4b474ba700 1 -- start start 2020-02-11T16:05:43.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b474ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b400a18a0 0x7f4b400a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b474ba700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b400a5de0 0x7f4b400a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b474ba700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b400a31b0 con 0x7f4b4012e3a0 2020-02-11T16:05:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b474ba700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b400a3570 con 0x7f4b400a5de0 2020-02-11T16:05:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b474ba700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b400a3810 con 0x7f4b400a18a0 2020-02-11T16:05:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b45256700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b400a18a0 0x7f4b400a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b45a57700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4b4012e3a0 0x7f4b4012e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39188/0 (socket says 172.21.15.88:39188) 2020-02-11T16:05:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b45256700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b400a18a0 0x7f4b400a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51562/0 (socket says 172.21.15.88:51562) 2020-02-11T16:05:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b45a57700 1 -- 172.21.15.88:0/2818874119 learned_addr learned my addr 172.21.15.88:0/2818874119 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b44a55700 1 --2- 172.21.15.88:0/2818874119 >> v2:172.21.15.52:3300/0 conn(0x7f4b400a5de0 0x7f4b400a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b45256700 1 -- 172.21.15.88:0/2818874119 >> v2:172.21.15.52:3300/0 conn(0x7f4b400a5de0 msgr2=0x7f4b400a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:43.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.337+0000 7f4b45256700 1 --2- 172.21.15.88:0/2818874119 >> v2:172.21.15.52:3300/0 conn(0x7f4b400a5de0 0x7f4b400a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b45256700 1 -- 172.21.15.88:0/2818874119 >> v1:172.21.15.88:6789/0 conn(0x7f4b4012e3a0 legacy=0x7f4b4012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b2ffff700 1 -- 172.21.15.88:0/2818874119 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638996713 0 0) 0x7f4b400a31b0 con 0x7f4b4012e3a0 2020-02-11T16:05:43.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b45256700 1 -- 172.21.15.88:0/2818874119 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b400a3ab0 con 0x7f4b400a18a0 2020-02-11T16:05:43.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b45256700 1 --2- 172.21.15.88:0/2818874119 >> v2:172.21.15.88:3300/0 conn(0x7f4b400a18a0 0x7f4b400a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4b30002f30 tx=0x7f4b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b45256700 1 --2- 172.21.15.88:0/2818874119 >> v2:172.21.15.88:3300/0 conn(0x7f4b400a18a0 0x7f4b400a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4b30002f30 tx=0x7f4b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b45256700 1 --2- 172.21.15.88:0/2818874119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b400a18a0 0x7f4b400a6dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f4b30002f30 tx=0x7f4b30007a40).ready entity=mon.1 client_cookie=874426d9f9971f4f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b45256700 1 --2- 172.21.15.88:0/2818874119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b400a18a0 0x7f4b400a6dd0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f4b30002f30 tx=0x7f4b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b2ffff700 1 -- 172.21.15.88:0/2818874119 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b30011470 con 0x7f4b400a18a0 2020-02-11T16:05:43.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b45256700 1 --2- 172.21.15.88:0/2818874119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b400a18a0 0x7f4b400a6dd0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f4b30002f30 tx=0x7f4b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b45256700 1 --2- 172.21.15.88:0/2818874119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b400a18a0 0x7f4b400a6dd0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f4b30002f30 tx=0x7f4b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b2ffff700 1 -- 172.21.15.88:0/2818874119 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b300115d0 con 0x7f4b400a18a0 2020-02-11T16:05:43.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b2ffff700 1 -- 172.21.15.88:0/2818874119 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b30011970 con 0x7f4b400a18a0 2020-02-11T16:05:43.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b474ba700 1 -- 172.21.15.88:0/2818874119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b400a18a0 msgr2=0x7f4b400a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b474ba700 1 --2- 172.21.15.88:0/2818874119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b400a18a0 0x7f4b400a6dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f4b30002f30 tx=0x7f4b30007a40).stop 2020-02-11T16:05:43.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b474ba700 1 -- 172.21.15.88:0/2818874119 shutdown_connections 2020-02-11T16:05:43.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b474ba700 1 --2- 172.21.15.88:0/2818874119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b400a18a0 0x7f4b400a6dd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b474ba700 1 --2- 172.21.15.88:0/2818874119 >> v2:172.21.15.52:3300/0 conn(0x7f4b400a5de0 0x7f4b400a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b474ba700 1 -- 172.21.15.88:0/2818874119 >> 172.21.15.88:0/2818874119 conn(0x7f4b4009d110 msgr2=0x7f4b4009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:43.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b474ba700 1 -- 172.21.15.88:0/2818874119 shutdown_connections 2020-02-11T16:05:43.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.338+0000 7f4b474ba700 1 -- 172.21.15.88:0/2818874119 wait complete. 2020-02-11T16:05:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.339+0000 7f4b474ba700 1 Processor -- start 2020-02-11T16:05:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.339+0000 7f4b474ba700 1 -- start start 2020-02-11T16:05:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b474ba700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b400a5de0 0x7f4b4009dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b474ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b4012e3a0 0x7f4b4012f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b474ba700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b40132040 con 0x7f4b400a18a0 2020-02-11T16:05:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b474ba700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b401313f0 con 0x7f4b400a5de0 2020-02-11T16:05:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b474ba700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b40135170 con 0x7f4b4012e3a0 2020-02-11T16:05:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b4012e3a0 0x7f4b4012f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b4012e3a0 0x7f4b4012f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51570/0 (socket says 172.21.15.88:51570) 2020-02-11T16:05:43.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 -- 172.21.15.88:0/3441507672 learned_addr learned my addr 172.21.15.88:0/3441507672 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:43.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b44a55700 1 --2- 172.21.15.88:0/3441507672 >> v2:172.21.15.52:3300/0 conn(0x7f4b400a5de0 0x7f4b4009dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 -- 172.21.15.88:0/3441507672 >> v2:172.21.15.52:3300/0 conn(0x7f4b400a5de0 msgr2=0x7f4b4009dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> v2:172.21.15.52:3300/0 conn(0x7f4b400a5de0 0x7f4b4009dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 -- 172.21.15.88:0/3441507672 >> v1:172.21.15.52:6789/0 conn(0x7f4b400a18a0 legacy=0x7f4b40133b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 -- 172.21.15.88:0/3441507672 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40130700 con 0x7f4b4012e3a0 2020-02-11T16:05:43.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> v2:172.21.15.88:3300/0 conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> v2:172.21.15.88:3300/0 conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b2e7fc700 1 -- 172.21.15.88:0/3441507672 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b38005e30 con 0x7f4b4012e3a0 2020-02-11T16:05:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b2e7fc700 1 -- 172.21.15.88:0/3441507672 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b38012550 con 0x7f4b4012e3a0 2020-02-11T16:05:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b474ba700 1 -- 172.21.15.88:0/3441507672 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4012e060 con 0x7f4b4012e3a0 2020-02-11T16:05:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.340+0000 7f4b2e7fc700 1 -- 172.21.15.88:0/3441507672 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b38012970 con 0x7f4b4012e3a0 2020-02-11T16:05:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.341+0000 7f4b474ba700 1 -- 172.21.15.88:0/3441507672 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b401302b0 con 0x7f4b4012e3a0 2020-02-11T16:05:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.341+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.341+0000 7f4b2e7fc700 1 -- 172.21.15.88:0/3441507672 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f4b38012be0 con 0x7f4b4012e3a0 2020-02-11T16:05:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.341+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.341+0000 7f4b2e7fc700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b20039bc0 0x7f4b2003c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.341+0000 7f4b2e7fc700 1 -- 172.21.15.88:0/3441507672 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4b3804a030 con 0x7f4b4012e3a0 2020-02-11T16:05:43.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.342+0000 7f4b474ba700 1 -- 172.21.15.88:0/3441507672 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b400565b0 con 0x7f4b4012e3a0 2020-02-11T16:05:43.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.342+0000 7f4b45256700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b20039bc0 0x7f4b2003c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.342+0000 7f4b45256700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b20039bc0 0x7f4b2003c080 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.345+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.345+0000 7f4b2e7fc700 1 -- 172.21.15.88:0/3441507672 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4b3802f6a0 con 0x7f4b4012e3a0 2020-02-11T16:05:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.479+0000 7f4b474ba700 1 -- 172.21.15.88:0/3441507672 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b4005ccb0 con 0x7f4b4012e3a0 2020-02-11T16:05:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.480+0000 7f4b45a57700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.480+0000 7f4b2e7fc700 1 -- 172.21.15.88:0/3441507672 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f4b38032170 con 0x7f4b4012e3a0 2020-02-11T16:05:43.484 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:43.484 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:39.282613+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-11T16:05:34.022912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-11T16:05:36.964421+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:43.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.481+0000 7f4b474ba700 1 -- 172.21.15.88:0/3441507672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b20039bc0 msgr2=0x7f4b2003c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.481+0000 7f4b474ba700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b20039bc0 0x7f4b2003c080 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.482+0000 7f4b474ba700 1 -- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 msgr2=0x7f4b4012f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.482+0000 7f4b474ba700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 0x7f4b4012f800 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f4b38001210 tx=0x7f4b38010cc0).stop 2020-02-11T16:05:43.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.482+0000 7f4b474ba700 1 -- 172.21.15.88:0/3441507672 shutdown_connections 2020-02-11T16:05:43.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.482+0000 7f4b474ba700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b4012e3a0 0x7f4b4012f800 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.482+0000 7f4b474ba700 1 --2- 172.21.15.88:0/3441507672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b20039bc0 0x7f4b2003c080 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.482+0000 7f4b474ba700 1 --2- 172.21.15.88:0/3441507672 >> v2:172.21.15.52:3300/0 conn(0x7f4b400a5de0 0x7f4b4009dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.482+0000 7f4b474ba700 1 -- 172.21.15.88:0/3441507672 >> 172.21.15.88:0/3441507672 conn(0x7f4b4009d110 msgr2=0x7f4b400a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:43.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.482+0000 7f4b474ba700 1 -- 172.21.15.88:0/3441507672 shutdown_connections 2020-02-11T16:05:43.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.482+0000 7f4b474ba700 1 -- 172.21.15.88:0/3441507672 wait complete. 2020-02-11T16:05:43.495 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-02-11T16:05:43.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.598+0000 7fd7d33a2700 1 Processor -- start 2020-02-11T16:05:43.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d33a2700 1 -- start start 2020-02-11T16:05:43.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d33a2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7cc0a18a0 0x7fd7cc0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d33a2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d33a2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc12e3a0 0x7fd7cc12e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d33a2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc0a3570 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d33a2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc0a3810 con 0x7fd7cc0a5de0 2020-02-11T16:05:43.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d33a2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0a3ab0 con 0x7fd7cc12e3a0 2020-02-11T16:05:43.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d093d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d093d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51578/0 (socket says 172.21.15.88:51578) 2020-02-11T16:05:43.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d093d700 1 -- 172.21.15.88:0/3271768889 learned_addr learned my addr 172.21.15.88:0/3271768889 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:43.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3271768889 >> v2:172.21.15.52:3300/0 conn(0x7fd7cc0a18a0 0x7fd7cc0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.599+0000 7fd7d193f700 1 --2- 172.21.15.88:0/3271768889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc12e3a0 0x7fd7cc12e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 -- 172.21.15.88:0/3271768889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc12e3a0 msgr2=0x7fd7cc12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:43.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 --2- 172.21.15.88:0/3271768889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc12e3a0 0x7fd7cc12e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 -- 172.21.15.88:0/3271768889 >> v2:172.21.15.52:3300/0 conn(0x7fd7cc0a18a0 msgr2=0x7fd7cc0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:43.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 --2- 172.21.15.88:0/3271768889 >> v2:172.21.15.52:3300/0 conn(0x7fd7cc0a18a0 0x7fd7cc0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 -- 172.21.15.88:0/3271768889 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc0a3d50 con 0x7fd7cc0a5de0 2020-02-11T16:05:43.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 --2- 172.21.15.88:0/3271768889 >> v2:172.21.15.88:3300/0 conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd7c8002f30 tx=0x7fd7c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 --2- 172.21.15.88:0/3271768889 >> v2:172.21.15.88:3300/0 conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd7c8002f30 tx=0x7fd7c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 --2- 172.21.15.88:0/3271768889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fd7c8002f30 tx=0x7fd7c8007a40).ready entity=mon.1 client_cookie=d627b8b7bb04f959 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 --2- 172.21.15.88:0/3271768889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd7c8002f30 tx=0x7fd7c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7bbfff700 1 -- 172.21.15.88:0/3271768889 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7c8011670 con 0x7fd7cc0a5de0 2020-02-11T16:05:43.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 --2- 172.21.15.88:0/3271768889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd7c8002f30 tx=0x7fd7c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d093d700 1 --2- 172.21.15.88:0/3271768889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd7c8002f30 tx=0x7fd7c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7bbfff700 1 -- 172.21.15.88:0/3271768889 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c80117d0 con 0x7fd7cc0a5de0 2020-02-11T16:05:43.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7bbfff700 1 -- 172.21.15.88:0/3271768889 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7c8011bb0 con 0x7fd7cc0a5de0 2020-02-11T16:05:43.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3271768889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7cc0a5de0 msgr2=0x7fd7cc0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d33a2700 1 --2- 172.21.15.88:0/3271768889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fd7c8002f30 tx=0x7fd7c8007a40).stop 2020-02-11T16:05:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3271768889 shutdown_connections 2020-02-11T16:05:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d33a2700 1 --2- 172.21.15.88:0/3271768889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc12e3a0 0x7fd7cc12e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d33a2700 1 --2- 172.21.15.88:0/3271768889 >> v2:172.21.15.52:3300/0 conn(0x7fd7cc0a18a0 0x7fd7cc0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d33a2700 1 --2- 172.21.15.88:0/3271768889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7cc0a5de0 0x7fd7cc0a6260 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3271768889 >> 172.21.15.88:0/3271768889 conn(0x7fd7cc09d110 msgr2=0x7fd7cc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.600+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3271768889 shutdown_connections 2020-02-11T16:05:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.601+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3271768889 wait complete. 2020-02-11T16:05:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.601+0000 7fd7d33a2700 1 Processor -- start 2020-02-11T16:05:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.601+0000 7fd7d33a2700 1 -- start start 2020-02-11T16:05:43.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7d33a2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7d33a2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc1354b0 con 0x7fd7cc12e3a0 2020-02-11T16:05:43.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7d33a2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc135750 con 0x7fd7cc0a5de0 2020-02-11T16:05:43.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7d33a2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc134630 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7d093d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd7cc0a5de0 0x7fd7cc138350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39208/0 (socket says 172.21.15.88:39208) 2020-02-11T16:05:43.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7d093d700 1 -- 172.21.15.88:0/3217165914 learned_addr learned my addr 172.21.15.88:0/3217165914 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:43.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955269805 0 0) 0x7fd7cc135750 con 0x7fd7cc0a5de0 2020-02-11T16:05:43.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ac002fe0 con 0x7fd7cc0a5de0 2020-02-11T16:05:43.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014988889 0 0) 0x7fd7cc1354b0 con 0x7fd7cc12e3a0 2020-02-11T16:05:43.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.602+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7cc135750 con 0x7fd7cc12e3a0 2020-02-11T16:05:43.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d113e700 1 -- 172.21.15.88:0/3217165914 >> v1:172.21.15.88:6789/0 conn(0x7fd7cc0a5de0 legacy=0x7fd7cc138350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3852884924 0 0) 0x7fd7ac002fe0 con 0x7fd7cc0a5de0 2020-02-11T16:05:43.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d113e700 1 -- 172.21.15.88:0/3217165914 >> v1:172.21.15.52:6789/0 conn(0x7fd7cc12e3a0 legacy=0x7fd7cc1282f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d113e700 1 -- 172.21.15.88:0/3217165914 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc067110 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7cc135240 tx=0x7fd7bc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7cc135240 tx=0x7fd7bc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fd7cc135240 tx=0x7fd7bc010ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fd7cc135240 tx=0x7fd7bc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7c80085c0 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fd7cc135240 tx=0x7fd7bc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc132650 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc007340 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fd7cc135240 tx=0x7fd7bc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7bc0056c0 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc133e90 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.603+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fd7cc135240 tx=0x7fd7bc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fd7bc0058c0 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fd7cc135240 tx=0x7fd7bc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7cc065500 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7ba7fc700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd7ac03a010 0x7fd7ac03c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7d113e700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fd7cc135240 tx=0x7fd7bc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd7bc00d0c0 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7ba7fc700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.88:6816/30740,v1:172.21.15.88:6818/30740] conn(0x7fd7ac040b40 0x7fd7ac042f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7d093d700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd7ac03a010 0x7fd7ac03c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 --> [v2:172.21.15.88:6816/30740,v1:172.21.15.88:6818/30740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7ac043520 con 0x7fd7ac040b40 2020-02-11T16:05:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7bc02eaf0 con 0x7fd7cc0a18a0 2020-02-11T16:05:43.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7d193f700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.88:6816/30740,v1:172.21.15.88:6818/30740] conn(0x7fd7ac040b40 0x7fd7ac042f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7d093d700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd7ac03a010 0x7fd7ac03c4d0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.604+0000 7fd7d193f700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.88:6816/30740,v1:172.21.15.88:6818/30740] conn(0x7fd7ac040b40 0x7fd7ac042f60 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.605+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== osd.0 v2:172.21.15.88:6816/30740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fd7ac043520 con 0x7fd7ac040b40 2020-02-11T16:05:43.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.622+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 --> [v2:172.21.15.88:6816/30740,v1:172.21.15.88:6818/30740] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7cc128c40 con 0x7fd7ac040b40 2020-02-11T16:05:43.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.622+0000 7fd7ba7fc700 1 -- 172.21.15.88:0/3217165914 <== osd.0 v2:172.21.15.88:6816/30740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7cc128c40 con 0x7fd7ac040b40 2020-02-11T16:05:43.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 >> [v2:172.21.15.88:6816/30740,v1:172.21.15.88:6818/30740] conn(0x7fd7ac040b40 msgr2=0x7fd7ac042f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d33a2700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.88:6816/30740,v1:172.21.15.88:6818/30740] conn(0x7fd7ac040b40 0x7fd7ac042f60 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd7ac03a010 msgr2=0x7fd7ac03c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d33a2700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd7ac03a010 0x7fd7ac03c4d0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 msgr2=0x7fd7cc066cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d33a2700 1 --2- 172.21.15.88:0/3217165914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd7cc0a18a0 0x7fd7cc066cb0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fd7cc135240 tx=0x7fd7bc010ba0).stop 2020-02-11T16:05:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d193f700 1 -- 172.21.15.88:0/3217165914 reap_dead start 2020-02-11T16:05:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 shutdown_connections 2020-02-11T16:05:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 >> 172.21.15.88:0/3217165914 conn(0x7fd7cc09d110 msgr2=0x7fd7cc0a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 shutdown_connections 2020-02-11T16:05:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.623+0000 7fd7d33a2700 1 -- 172.21.15.88:0/3217165914 wait complete. 2020-02-11T16:05:43.642 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2020-02-11T16:05:43.643 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-02-11T16:05:43.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.746+0000 7f29b6521700 1 Processor -- start 2020-02-11T16:05:43.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.746+0000 7f29b6521700 1 -- start start 2020-02-11T16:05:43.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29b6521700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29b00a2900 0x7f29b00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29b6521700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b0136930 con 0x7f29b00a7120 2020-02-11T16:05:43.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29b6521700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00a6470 con 0x7f29b00a5cf0 2020-02-11T16:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29b6521700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b00a49b0 con 0x7f29b00a2900 2020-02-11T16:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29b4abe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f29b00a5cf0 0x7f29b013c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39220/0 (socket says 172.21.15.88:39220) 2020-02-11T16:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29b4abe700 1 -- 172.21.15.88:0/493471457 learned_addr learned my addr 172.21.15.88:0/493471457 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29af7fe700 1 --2- 172.21.15.88:0/493471457 >> v2:172.21.15.52:3300/0 conn(0x7f29b00a2900 0x7f29b00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103270646 0 0) 0x7f29b00a6470 con 0x7f29b00a5cf0 2020-02-11T16:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f299c003230 con 0x7f29b00a5cf0 2020-02-11T16:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331044108 0 0) 0x7f29b0136930 con 0x7f29b00a7120 2020-02-11T16:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b00a6470 con 0x7f29b00a7120 2020-02-11T16:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2912635882 0 0) 0x7f299c003230 con 0x7f29b00a5cf0 2020-02-11T16:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 >> v2:172.21.15.52:3300/0 conn(0x7f29b00a2900 msgr2=0x7f29b00a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 --2- 172.21.15.88:0/493471457 >> v2:172.21.15.52:3300/0 conn(0x7f29b00a2900 0x7f29b00a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 >> v1:172.21.15.52:6789/0 conn(0x7f29b00a7120 legacy=0x7f29b013c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00a4c50 con 0x7f29b00a5cf0 2020-02-11T16:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f29a8001a90 con 0x7f29b00a5cf0 2020-02-11T16:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29af7fe700 1 --2- 172.21.15.88:0/493471457 >> v2:172.21.15.52:3300/0 conn(0x7f29b00a2900 0x7f29b00a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 >> v1:172.21.15.88:6789/0 conn(0x7f29b00a5cf0 legacy=0x7f29b013c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f299c0038b0 0x7f299c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f299c0044d0 0x7f299c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 0x7f299c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00a49b0 con 0x7f299c0038b0 2020-02-11T16:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0053a0 con 0x7f299c004db0 2020-02-11T16:05:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c00bc00 con 0x7f299c0044d0 2020-02-11T16:05:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.747+0000 7f29b4abe700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 0x7f299c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29af7fe700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f299c0044d0 0x7f299c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29affff700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f299c0038b0 0x7f299c003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 -- 172.21.15.88:0/493471457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f299c0044d0 msgr2=0x7f299c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f299c0044d0 0x7f299c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 -- 172.21.15.88:0/493471457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f299c0038b0 msgr2=0x7f299c003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:43.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f299c0038b0 0x7f299c003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:43.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 -- 172.21.15.88:0/493471457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c003230 con 0x7f299c004db0 2020-02-11T16:05:43.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29affff700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f299c0038b0 0x7f299c003cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:43.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 0x7f299c00b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 -- 172.21.15.88:0/493471457 reap_dead start 2020-02-11T16:05:43.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 0x7f299c00b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 0x7f299c00b720 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).ready entity=mon.1 client_cookie=e4600cc72a5142ea server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 0x7f299c00b720 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a800e540 con 0x7f299c004db0 2020-02-11T16:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 0x7f299c00b720 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b4abe700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 0x7f299c00b720 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a800e6a0 con 0x7f299c004db0 2020-02-11T16:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29aeffd700 1 -- 172.21.15.88:0/493471457 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a80100b0 con 0x7f299c004db0 2020-02-11T16:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b6521700 1 -- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 msgr2=0x7f299c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b6521700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 0x7f299c00b720 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).stop 2020-02-11T16:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b6521700 1 -- 172.21.15.88:0/493471457 shutdown_connections 2020-02-11T16:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b6521700 1 --2- 172.21.15.88:0/493471457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f299c004db0 0x7f299c00b720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b6521700 1 -- 172.21.15.88:0/493471457 >> 172.21.15.88:0/493471457 conn(0x7f29b009d110 msgr2=0x7f29b009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b6521700 1 -- 172.21.15.88:0/493471457 shutdown_connections 2020-02-11T16:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.748+0000 7f29b6521700 1 -- 172.21.15.88:0/493471457 wait complete. 2020-02-11T16:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.749+0000 7f29b6521700 1 Processor -- start 2020-02-11T16:05:43.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.749+0000 7f29b6521700 1 -- start start 2020-02-11T16:05:43.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b6521700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00a90a0 0x7f29b009e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b6521700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29b0130a90 0x7f29b0130f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b6521700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00a7770 con 0x7f299c004db0 2020-02-11T16:05:43.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b6521700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b009e880 con 0x7f29b0130a90 2020-02-11T16:05:43.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b6521700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b0139240 con 0x7f29b00a90a0 2020-02-11T16:05:43.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b4abe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29b0130a90 0x7f29b0130f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29affff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f299c004db0 0x7f29b00a0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39230/0 (socket says 172.21.15.88:39230) 2020-02-11T16:05:43.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b4abe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29b0130a90 0x7f29b0130f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51606/0 (socket says 172.21.15.88:51606) 2020-02-11T16:05:43.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29affff700 1 -- 172.21.15.88:0/4233335009 learned_addr learned my addr 172.21.15.88:0/4233335009 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:43.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29af7fe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00a90a0 0x7f29b009e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b4abe700 1 -- 172.21.15.88:0/4233335009 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00a90a0 msgr2=0x7f29b009e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b4abe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00a90a0 0x7f29b009e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b4abe700 1 -- 172.21.15.88:0/4233335009 >> v1:172.21.15.88:6789/0 conn(0x7f299c004db0 legacy=0x7f29b00a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29ad7fa700 1 -- 172.21.15.88:0/4233335009 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582068474 0 0) 0x7f29b00a7770 con 0x7f299c004db0 2020-02-11T16:05:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b4abe700 1 -- 172.21.15.88:0/4233335009 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b01394e0 con 0x7f29b0130a90 2020-02-11T16:05:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.750+0000 7f29b4abe700 1 --2- 172.21.15.88:0/4233335009 >> v2:172.21.15.88:3300/0 conn(0x7f29b0130a90 0x7f29b0130f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29b4abe700 1 --2- 172.21.15.88:0/4233335009 >> v2:172.21.15.88:3300/0 conn(0x7f29b0130a90 0x7f29b0130f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29b4abe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b0130a90 0x7f29b0130f00 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29b4abe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b0130a90 0x7f29b0130f00 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29ad7fa700 1 -- 172.21.15.88:0/4233335009 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a800e9b0 con 0x7f29b0130a90 2020-02-11T16:05:43.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29b4abe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b0130a90 0x7f29b0130f00 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29b4abe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b0130a90 0x7f29b0130f00 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29ad7fa700 1 -- 172.21.15.88:0/4233335009 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a8004a60 con 0x7f29b0130a90 2020-02-11T16:05:43.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b009e560 con 0x7f29b0130a90 2020-02-11T16:05:43.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29ad7fa700 1 -- 172.21.15.88:0/4233335009 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a8004e00 con 0x7f29b0130a90 2020-02-11T16:05:43.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b0131360 con 0x7f29b0130a90 2020-02-11T16:05:43.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.751+0000 7f29b4abe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b0130a90 0x7f29b0130f00 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29ad7fa700 1 -- 172.21.15.88:0/4233335009 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f29a80102c0 con 0x7f29b0130a90 2020-02-11T16:05:43.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29b4abe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b0130a90 0x7f29b0130f00 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29b0139690 con 0x7f29b0130a90 2020-02-11T16:05:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29b4abe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b0130a90 0x7f29b0130f00 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29ad7fa700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2990039ae0 0x7f299003bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29ad7fa700 1 -- 172.21.15.88:0/4233335009 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f29a8049fc0 con 0x7f29b0130a90 2020-02-11T16:05:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29ad7fa700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:6800/30710,v1:172.21.15.88:6801/30710] conn(0x7f2990040730 0x7f2990042b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29ad7fa700 1 -- 172.21.15.88:0/4233335009 --> [v2:172.21.15.88:6800/30710,v1:172.21.15.88:6801/30710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2990043110 con 0x7f2990040730 2020-02-11T16:05:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29ad7fa700 1 -- 172.21.15.88:0/4233335009 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29a804b480 con 0x7f29b0130a90 2020-02-11T16:05:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29affff700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2990039ae0 0x7f299003bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29af7fe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:6800/30710,v1:172.21.15.88:6801/30710] conn(0x7f2990040730 0x7f2990042b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29affff700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2990039ae0 0x7f299003bfa0 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.752+0000 7f29af7fe700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:6800/30710,v1:172.21.15.88:6801/30710] conn(0x7f2990040730 0x7f2990042b50 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.753+0000 7f29ad7fa700 1 -- 172.21.15.88:0/4233335009 <== osd.1 v2:172.21.15.88:6800/30710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f2990043110 con 0x7f2990040730 2020-02-11T16:05:43.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.770+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 --> [v2:172.21.15.88:6800/30710,v1:172.21.15.88:6801/30710] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f29b0136280 con 0x7f2990040730 2020-02-11T16:05:43.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.770+0000 7f29ad7fa700 1 -- 172.21.15.88:0/4233335009 <== osd.1 v2:172.21.15.88:6800/30710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f29b0136280 con 0x7f2990040730 2020-02-11T16:05:43.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:6800/30710,v1:172.21.15.88:6801/30710] conn(0x7f2990040730 msgr2=0x7f2990042b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:6800/30710,v1:172.21.15.88:6801/30710] conn(0x7f2990040730 0x7f2990042b50 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2990039ae0 msgr2=0x7f299003bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2990039ae0 0x7f299003bfa0 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b0130a90 msgr2=0x7f29b0130f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b0130a90 0x7f29b0130f00 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f29a8001860 tx=0x7f29a8001ff0).stop 2020-02-11T16:05:43.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b4abe700 1 -- 172.21.15.88:0/4233335009 reap_dead start 2020-02-11T16:05:43.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 shutdown_connections 2020-02-11T16:05:43.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 --2- 172.21.15.88:0/4233335009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b0130a90 0x7f29b0130f00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 >> 172.21.15.88:0/4233335009 conn(0x7f29b009d110 msgr2=0x7f29b005a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:43.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 shutdown_connections 2020-02-11T16:05:43.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.771+0000 7f29b6521700 1 -- 172.21.15.88:0/4233335009 wait complete. 2020-02-11T16:05:43.783 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2020-02-11T16:05:43.784 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-02-11T16:05:43.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.886+0000 7f9b79da2700 1 Processor -- start 2020-02-11T16:05:43.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.886+0000 7f9b79da2700 1 -- start start 2020-02-11T16:05:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b79da2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b740a5de0 0x7f9b740a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b79da2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740a31b0 con 0x7f9b74134a50 2020-02-11T16:05:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b79da2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740a3570 con 0x7f9b740a18a0 2020-02-11T16:05:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b79da2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b740a3810 con 0x7f9b740a5de0 2020-02-11T16:05:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b72ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b740a5de0 0x7f9b740a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b737fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9b740a18a0 0x7f9b740a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39238/0 (socket says 172.21.15.88:39238) 2020-02-11T16:05:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b737fe700 1 -- 172.21.15.88:0/1958739520 learned_addr learned my addr 172.21.15.88:0/1958739520 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b72ffd700 1 -- 172.21.15.88:0/1958739520 >> v1:172.21.15.88:6789/0 conn(0x7f9b740a18a0 legacy=0x7f9b740a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b72ffd700 1 -- 172.21.15.88:0/1958739520 >> v1:172.21.15.52:6789/0 conn(0x7f9b74134a50 legacy=0x7f9b74134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:43.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b727fc700 1 -- 172.21.15.88:0/1958739520 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193162631 0 0) 0x7f9b740a3570 con 0x7f9b740a18a0 2020-02-11T16:05:43.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b72ffd700 1 -- 172.21.15.88:0/1958739520 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740a3ab0 con 0x7f9b740a5de0 2020-02-11T16:05:43.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.887+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/1958739520 >> v2:172.21.15.88:3300/0 conn(0x7f9b740a5de0 0x7f9b740a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b7405bbc0 tx=0x7f9b680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/1958739520 >> v2:172.21.15.88:3300/0 conn(0x7f9b740a5de0 0x7f9b740a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b7405bbc0 tx=0x7f9b680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/1958739520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a5de0 0x7f9b740a6260 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f9b7405bbc0 tx=0x7f9b680088e0).ready entity=mon.1 client_cookie=3bf33c074c07f176 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/1958739520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a5de0 0x7f9b740a6260 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f9b7405bbc0 tx=0x7f9b680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b727fc700 1 -- 172.21.15.88:0/1958739520 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b68008e40 con 0x7f9b740a5de0 2020-02-11T16:05:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/1958739520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a5de0 0x7f9b740a6260 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f9b7405bbc0 tx=0x7f9b680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/1958739520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a5de0 0x7f9b740a6260 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f9b7405bbc0 tx=0x7f9b680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b727fc700 1 -- 172.21.15.88:0/1958739520 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b68011660 con 0x7f9b740a5de0 2020-02-11T16:05:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b727fc700 1 -- 172.21.15.88:0/1958739520 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b68011a00 con 0x7f9b740a5de0 2020-02-11T16:05:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b79da2700 1 -- 172.21.15.88:0/1958739520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a5de0 msgr2=0x7f9b740a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b79da2700 1 --2- 172.21.15.88:0/1958739520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a5de0 0x7f9b740a6260 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f9b7405bbc0 tx=0x7f9b680088e0).stop 2020-02-11T16:05:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b79da2700 1 -- 172.21.15.88:0/1958739520 shutdown_connections 2020-02-11T16:05:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b79da2700 1 --2- 172.21.15.88:0/1958739520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a5de0 0x7f9b740a6260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b79da2700 1 -- 172.21.15.88:0/1958739520 >> 172.21.15.88:0/1958739520 conn(0x7f9b7409d110 msgr2=0x7f9b7409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b79da2700 1 -- 172.21.15.88:0/1958739520 shutdown_connections 2020-02-11T16:05:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.888+0000 7f9b79da2700 1 -- 172.21.15.88:0/1958739520 wait complete. 2020-02-11T16:05:43.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.889+0000 7f9b79da2700 1 Processor -- start 2020-02-11T16:05:43.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.889+0000 7f9b79da2700 1 -- start start 2020-02-11T16:05:43.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b79da2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b740a18a0 0x7f9b740aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b79da2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7412ad50 con 0x7f9b740a5de0 2020-02-11T16:05:43.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b79da2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7412aff0 con 0x7f9b74134a50 2020-02-11T16:05:43.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b79da2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b74136460 con 0x7f9b740a18a0 2020-02-11T16:05:43.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b737fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b740a18a0 0x7f9b740aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b73fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9b74134a50 0x7f9b741262f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39248/0 (socket says 172.21.15.88:39248) 2020-02-11T16:05:43.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b73fff700 1 -- 172.21.15.88:0/3327937178 learned_addr learned my addr 172.21.15.88:0/3327937178 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:43.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483012094 0 0) 0x7f9b7412aff0 con 0x7f9b74134a50 2020-02-11T16:05:43.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b54002fe0 con 0x7f9b74134a50 2020-02-11T16:05:43.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b737fe700 1 -- 172.21.15.88:0/3327937178 >> v1:172.21.15.88:6789/0 conn(0x7f9b74134a50 legacy=0x7f9b741262f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b737fe700 1 -- 172.21.15.88:0/3327937178 >> v1:172.21.15.52:6789/0 conn(0x7f9b740a5de0 legacy=0x7f9b7405a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b737fe700 1 -- 172.21.15.88:0/3327937178 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b741365a0 con 0x7f9b740a18a0 2020-02-11T16:05:43.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b737fe700 1 --2- 172.21.15.88:0/3327937178 >> v2:172.21.15.88:3300/0 conn(0x7f9b740a18a0 0x7f9b740aa560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b64000f00 tx=0x7f9b64010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b737fe700 1 --2- 172.21.15.88:0/3327937178 >> v2:172.21.15.88:3300/0 conn(0x7f9b740a18a0 0x7f9b740aa560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b64000f00 tx=0x7f9b64010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b737fe700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a18a0 0x7f9b740aa560 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f9b64000f00 tx=0x7f9b64010c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b737fe700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a18a0 0x7f9b740aa560 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f9b64000f00 tx=0x7f9b64010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b64005e30 con 0x7f9b740a18a0 2020-02-11T16:05:43.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b737fe700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a18a0 0x7f9b740aa560 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f9b64000f00 tx=0x7f9b64010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b737fe700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a18a0 0x7f9b740aa560 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f9b64000f00 tx=0x7f9b64010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.890+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b64012510 con 0x7f9b740a18a0 2020-02-11T16:05:43.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.891+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7405aff0 con 0x7f9b740a18a0 2020-02-11T16:05:43.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.891+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b640128f0 con 0x7f9b740a18a0 2020-02-11T16:05:43.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.891+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b74126bc0 con 0x7f9b740a18a0 2020-02-11T16:05:43.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.891+0000 7f9b737fe700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a18a0 0x7f9b740aa560 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f9b64000f00 tx=0x7f9b64010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.891+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b74136730 con 0x7f9b740a18a0 2020-02-11T16:05:43.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.891+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f9b64012a50 con 0x7f9b740a18a0 2020-02-11T16:05:43.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.891+0000 7f9b737fe700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a18a0 0x7f9b740aa560 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f9b64000f00 tx=0x7f9b64010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.891+0000 7f9b737fe700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a18a0 0x7f9b740aa560 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f9b64000f00 tx=0x7f9b64010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:43.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.892+0000 7f9b70ff9700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9b54039f30 0x7f9b5403c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.892+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f9b64049f00 con 0x7f9b740a18a0 2020-02-11T16:05:43.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.892+0000 7f9b70ff9700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:6817/30741,v1:172.21.15.88:6819/30741] conn(0x7f9b54040af0 0x7f9b54042f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:43.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.892+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 --> [v2:172.21.15.88:6817/30741,v1:172.21.15.88:6819/30741] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b540434d0 con 0x7f9b54040af0 2020-02-11T16:05:43.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.892+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b6404b3c0 con 0x7f9b740a18a0 2020-02-11T16:05:43.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.892+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9b54039f30 0x7f9b5403c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.892+0000 7f9b73fff700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:6817/30741,v1:172.21.15.88:6819/30741] conn(0x7f9b54040af0 0x7f9b54042f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:43.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.892+0000 7f9b73fff700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:6817/30741,v1:172.21.15.88:6819/30741] conn(0x7f9b54040af0 0x7f9b54042f10 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.892+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9b54039f30 0x7f9b5403c3f0 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:43.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.893+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 <== osd.2 v2:172.21.15.88:6817/30741 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f9b540434d0 con 0x7f9b54040af0 2020-02-11T16:05:43.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.910+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 --> [v2:172.21.15.88:6817/30741,v1:172.21.15.88:6819/30741] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9b7405a640 con 0x7f9b54040af0 2020-02-11T16:05:43.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.910+0000 7f9b70ff9700 1 -- 172.21.15.88:0/3327937178 <== osd.2 v2:172.21.15.88:6817/30741 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9b6c0054d0 con 0x7f9b54040af0 2020-02-11T16:05:43.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:6817/30741,v1:172.21.15.88:6819/30741] conn(0x7f9b54040af0 msgr2=0x7f9b54042f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:6817/30741,v1:172.21.15.88:6819/30741] conn(0x7f9b54040af0 0x7f9b54042f10 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9b54039f30 msgr2=0x7f9b5403c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9b54039f30 0x7f9b5403c3f0 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a18a0 msgr2=0x7f9b740aa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:43.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a18a0 0x7f9b740aa560 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f9b64000f00 tx=0x7f9b64010c80).stop 2020-02-11T16:05:43.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b73fff700 1 -- 172.21.15.88:0/3327937178 reap_dead start 2020-02-11T16:05:43.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 shutdown_connections 2020-02-11T16:05:43.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 --2- 172.21.15.88:0/3327937178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b740a18a0 0x7f9b740aa560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:43.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 >> 172.21.15.88:0/3327937178 conn(0x7f9b7409d110 msgr2=0x7f9b74069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:43.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 shutdown_connections 2020-02-11T16:05:43.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:43.911+0000 7f9b79da2700 1 -- 172.21.15.88:0/3327937178 wait complete. 2020-02-11T16:05:43.923 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2020-02-11T16:05:43.924 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-02-11T16:05:44.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.028+0000 7fdbbe5db700 1 Processor -- start 2020-02-11T16:05:44.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.028+0000 7fdbbe5db700 1 -- start start 2020-02-11T16:05:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbbe5db700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbbe5db700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbb80a2870 0x7fdbb813b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbbe5db700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdbb813b640 0x7fdbb813baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbbe5db700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb80a8630 con 0x7fdbb813b640 2020-02-11T16:05:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbbe5db700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb80a2cf0 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbbe5db700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb80a30c0 con 0x7fdbb80a2870 2020-02-11T16:05:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbb7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbb7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51628/0 (socket says 172.21.15.88:51628) 2020-02-11T16:05:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbb7fff700 1 -- 172.21.15.88:0/1347174753 learned_addr learned my addr 172.21.15.88:0/1347174753 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbbcb78700 1 --2- 172.21.15.88:0/1347174753 >> v2:172.21.15.52:3300/0 conn(0x7fdbb813b640 0x7fdbb813baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbb7fff700 1 -- 172.21.15.88:0/1347174753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbb80a2870 msgr2=0x7fdbb813b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbb7fff700 1 --2- 172.21.15.88:0/1347174753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbb80a2870 0x7fdbb813b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbb7fff700 1 -- 172.21.15.88:0/1347174753 >> v2:172.21.15.52:3300/0 conn(0x7fdbb813b640 msgr2=0x7fdbb813baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:44.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbb7fff700 1 --2- 172.21.15.88:0/1347174753 >> v2:172.21.15.52:3300/0 conn(0x7fdbb813b640 0x7fdbb813baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.029+0000 7fdbb7fff700 1 -- 172.21.15.88:0/1347174753 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb80a2130 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbb7fff700 1 --2- 172.21.15.88:0/1347174753 >> v2:172.21.15.88:3300/0 conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdba8002f30 tx=0x7fdba8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbb7fff700 1 --2- 172.21.15.88:0/1347174753 >> v2:172.21.15.88:3300/0 conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdba8002f30 tx=0x7fdba8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbb7fff700 1 --2- 172.21.15.88:0/1347174753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fdba8002f30 tx=0x7fdba8007a40).ready entity=mon.1 client_cookie=6c05a4ca9cf6f915 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbb7fff700 1 --2- 172.21.15.88:0/1347174753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fdba8002f30 tx=0x7fdba8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbb6ffd700 1 -- 172.21.15.88:0/1347174753 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdba8011720 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbb7fff700 1 --2- 172.21.15.88:0/1347174753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fdba8002f30 tx=0x7fdba8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbb7fff700 1 --2- 172.21.15.88:0/1347174753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fdba8002f30 tx=0x7fdba8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbb6ffd700 1 -- 172.21.15.88:0/1347174753 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba8011880 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbb6ffd700 1 -- 172.21.15.88:0/1347174753 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdba8011c60 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbbe5db700 1 -- 172.21.15.88:0/1347174753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 msgr2=0x7fdbb80a73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbbe5db700 1 --2- 172.21.15.88:0/1347174753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fdba8002f30 tx=0x7fdba8007a40).stop 2020-02-11T16:05:44.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbbe5db700 1 -- 172.21.15.88:0/1347174753 shutdown_connections 2020-02-11T16:05:44.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbbe5db700 1 --2- 172.21.15.88:0/1347174753 >> v2:172.21.15.52:3300/0 conn(0x7fdbb813b640 0x7fdbb813baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbbe5db700 1 --2- 172.21.15.88:0/1347174753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb80a73d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbbe5db700 1 --2- 172.21.15.88:0/1347174753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbb80a2870 0x7fdbb813b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbbe5db700 1 -- 172.21.15.88:0/1347174753 >> 172.21.15.88:0/1347174753 conn(0x7fdbb80ac2d0 msgr2=0x7fdbb80ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbbe5db700 1 -- 172.21.15.88:0/1347174753 shutdown_connections 2020-02-11T16:05:44.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.030+0000 7fdbbe5db700 1 -- 172.21.15.88:0/1347174753 wait complete. 2020-02-11T16:05:44.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.032+0000 7fdbbe5db700 1 Processor -- start 2020-02-11T16:05:44.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.032+0000 7fdbbe5db700 1 -- start start 2020-02-11T16:05:44.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.032+0000 7fdbbe5db700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdbb80a6ff0 0x7fdbb8135e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.032+0000 7fdbbe5db700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdbb813b640 0x7fdbb80a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.032+0000 7fdbbe5db700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb8136bc0 con 0x7fdbb80a2870 2020-02-11T16:05:44.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.032+0000 7fdbbe5db700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb8136e60 con 0x7fdbb813b640 2020-02-11T16:05:44.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.032+0000 7fdbbe5db700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb8137100 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.032+0000 7fdbb77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdbb80a6ff0 0x7fdbb8135e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.032+0000 7fdbb7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdbb80a2870 0x7fdbb8145080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39260/0 (socket says 172.21.15.88:39260) 2020-02-11T16:05:44.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.032+0000 7fdbb7fff700 1 -- 172.21.15.88:0/3683159511 learned_addr learned my addr 172.21.15.88:0/3683159511 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:44.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbbcb78700 1 --2- 172.21.15.88:0/3683159511 >> v2:172.21.15.52:3300/0 conn(0x7fdbb813b640 0x7fdbb80a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb77fe700 1 -- 172.21.15.88:0/3683159511 >> v2:172.21.15.52:3300/0 conn(0x7fdbb813b640 msgr2=0x7fdbb80a5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb77fe700 1 --2- 172.21.15.88:0/3683159511 >> v2:172.21.15.52:3300/0 conn(0x7fdbb813b640 0x7fdbb80a5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb77fe700 1 -- 172.21.15.88:0/3683159511 >> v1:172.21.15.88:6789/0 conn(0x7fdbb80a2870 legacy=0x7fdbb8145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb77fe700 1 -- 172.21.15.88:0/3683159511 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb813af40 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb57fa700 1 -- 172.21.15.88:0/3683159511 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445439384 0 0) 0x7fdbb8136bc0 con 0x7fdbb80a2870 2020-02-11T16:05:44.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb77fe700 1 --2- 172.21.15.88:0/3683159511 >> v2:172.21.15.88:3300/0 conn(0x7fdbb80a6ff0 0x7fdbb8135e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdbac002f30 tx=0x7fdbac0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb77fe700 1 --2- 172.21.15.88:0/3683159511 >> v2:172.21.15.88:3300/0 conn(0x7fdbb80a6ff0 0x7fdbb8135e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdbac002f30 tx=0x7fdbac0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb77fe700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb8135e30 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fdbac002f30 tx=0x7fdbac0109b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb77fe700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb8135e30 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fdbac002f30 tx=0x7fdbac0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb57fa700 1 -- 172.21.15.88:0/3683159511 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbac007540 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb77fe700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb8135e30 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fdbac002f30 tx=0x7fdbac0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb57fa700 1 -- 172.21.15.88:0/3683159511 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac0059e0 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb77fe700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb8135e30 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fdbac002f30 tx=0x7fdbac0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb8136290 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbb57fa700 1 -- 172.21.15.88:0/3683159511 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbac005dc0 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.033+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb8138c00 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbb77fe700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb8135e30 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fdbac002f30 tx=0x7fdbac0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdbb81375a0 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbb57fa700 1 -- 172.21.15.88:0/3683159511 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fdbac0088c0 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbb77fe700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb8135e30 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fdbac002f30 tx=0x7fdbac0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbb77fe700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb8135e30 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fdbac002f30 tx=0x7fdbac0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbb57fa700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb98039ac0 0x7fdb9803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbb57fa700 1 -- 172.21.15.88:0/3683159511 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fdbac049670 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbb57fa700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:6808/30711,v1:172.21.15.88:6809/30711] conn(0x7fdb98040710 0x7fdb98042b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbb57fa700 1 -- 172.21.15.88:0/3683159511 --> [v2:172.21.15.88:6808/30711,v1:172.21.15.88:6809/30711] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb980430f0 con 0x7fdb98040710 2020-02-11T16:05:44.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbb57fa700 1 -- 172.21.15.88:0/3683159511 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbac04ab90 con 0x7fdbb80a6ff0 2020-02-11T16:05:44.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbb7fff700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb98039ac0 0x7fdb9803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.034+0000 7fdbbcb78700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:6808/30711,v1:172.21.15.88:6809/30711] conn(0x7fdb98040710 0x7fdb98042b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.035+0000 7fdbbcb78700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:6808/30711,v1:172.21.15.88:6809/30711] conn(0x7fdb98040710 0x7fdb98042b30 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.035+0000 7fdbb7fff700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb98039ac0 0x7fdb9803bf80 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.035+0000 7fdbb57fa700 1 -- 172.21.15.88:0/3683159511 <== osd.3 v2:172.21.15.88:6808/30711 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fdb980430f0 con 0x7fdb98040710 2020-02-11T16:05:44.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.052+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 --> [v2:172.21.15.88:6808/30711,v1:172.21.15.88:6809/30711] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdbb80a63e0 con 0x7fdb98040710 2020-02-11T16:05:44.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbb57fa700 1 -- 172.21.15.88:0/3683159511 <== osd.3 v2:172.21.15.88:6808/30711 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdbb80a63e0 con 0x7fdb98040710 2020-02-11T16:05:44.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:6808/30711,v1:172.21.15.88:6809/30711] conn(0x7fdb98040710 msgr2=0x7fdb98042b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:6808/30711,v1:172.21.15.88:6809/30711] conn(0x7fdb98040710 0x7fdb98042b30 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb98039ac0 msgr2=0x7fdb9803bf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb98039ac0 0x7fdb9803bf80 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 msgr2=0x7fdbb8135e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb8135e30 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fdbac002f30 tx=0x7fdbac0109b0).stop 2020-02-11T16:05:44.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbcb78700 1 -- 172.21.15.88:0/3683159511 reap_dead start 2020-02-11T16:05:44.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 shutdown_connections 2020-02-11T16:05:44.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 --2- 172.21.15.88:0/3683159511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbb80a6ff0 0x7fdbb8135e30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 >> 172.21.15.88:0/3683159511 conn(0x7fdbb80ac2d0 msgr2=0x7fdbb8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 shutdown_connections 2020-02-11T16:05:44.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.053+0000 7fdbbe5db700 1 -- 172.21.15.88:0/3683159511 wait complete. 2020-02-11T16:05:44.065 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2020-02-11T16:05:44.065 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-02-11T16:05:44.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.168+0000 7f7810ca5700 1 Processor -- start 2020-02-11T16:05:44.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.168+0000 7f7810ca5700 1 -- start start 2020-02-11T16:05:44.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7810ca5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f780c0a5de0 0x7f780c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7810ca5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0a31b0 con 0x7f780c0a18a0 2020-02-11T16:05:44.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7810ca5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0a3570 con 0x7f780c134a50 2020-02-11T16:05:44.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7810ca5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c0a3810 con 0x7f780c0a5de0 2020-02-11T16:05:44.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7809d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f780c0a5de0 0x7f780c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f780ad9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f780c134a50 0x7f780c134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39272/0 (socket says 172.21.15.88:39272) 2020-02-11T16:05:44.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f780ad9d700 1 -- 172.21.15.88:0/2526598357 learned_addr learned my addr 172.21.15.88:0/2526598357 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:44.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7809d9b700 1 -- 172.21.15.88:0/2526598357 >> v1:172.21.15.88:6789/0 conn(0x7f780c134a50 legacy=0x7f780c134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7809d9b700 1 -- 172.21.15.88:0/2526598357 >> v1:172.21.15.52:6789/0 conn(0x7f780c0a18a0 legacy=0x7f780c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f780959a700 1 -- 172.21.15.88:0/2526598357 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693420847 0 0) 0x7f780c0a3570 con 0x7f780c134a50 2020-02-11T16:05:44.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7809d9b700 1 -- 172.21.15.88:0/2526598357 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0a3ab0 con 0x7f780c0a5de0 2020-02-11T16:05:44.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7809d9b700 1 --2- 172.21.15.88:0/2526598357 >> v2:172.21.15.88:3300/0 conn(0x7f780c0a5de0 0x7f780c0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f780c05bbc0 tx=0x7f77fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7809d9b700 1 --2- 172.21.15.88:0/2526598357 >> v2:172.21.15.88:3300/0 conn(0x7f780c0a5de0 0x7f780c0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f780c05bbc0 tx=0x7f77fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7809d9b700 1 --2- 172.21.15.88:0/2526598357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c0a6260 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc0088e0).ready entity=mon.1 client_cookie=e328e4d716efe64b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7809d9b700 1 --2- 172.21.15.88:0/2526598357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c0a6260 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f780959a700 1 -- 172.21.15.88:0/2526598357 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77fc008e40 con 0x7f780c0a5de0 2020-02-11T16:05:44.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7809d9b700 1 --2- 172.21.15.88:0/2526598357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c0a6260 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7809d9b700 1 --2- 172.21.15.88:0/2526598357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c0a6260 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f780959a700 1 -- 172.21.15.88:0/2526598357 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc011660 con 0x7f780c0a5de0 2020-02-11T16:05:44.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f780959a700 1 -- 172.21.15.88:0/2526598357 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77fc011a40 con 0x7f780c0a5de0 2020-02-11T16:05:44.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7810ca5700 1 -- 172.21.15.88:0/2526598357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 msgr2=0x7f780c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.169+0000 7f7810ca5700 1 --2- 172.21.15.88:0/2526598357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c0a6260 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc0088e0).stop 2020-02-11T16:05:44.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.170+0000 7f7810ca5700 1 -- 172.21.15.88:0/2526598357 shutdown_connections 2020-02-11T16:05:44.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.170+0000 7f7810ca5700 1 --2- 172.21.15.88:0/2526598357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c0a6260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.170+0000 7f7810ca5700 1 -- 172.21.15.88:0/2526598357 >> 172.21.15.88:0/2526598357 conn(0x7f780c09d110 msgr2=0x7f780c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.170+0000 7f7810ca5700 1 -- 172.21.15.88:0/2526598357 shutdown_connections 2020-02-11T16:05:44.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.170+0000 7f7810ca5700 1 -- 172.21.15.88:0/2526598357 wait complete. 2020-02-11T16:05:44.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.171+0000 7f7810ca5700 1 Processor -- start 2020-02-11T16:05:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.171+0000 7f7810ca5700 1 -- start start 2020-02-11T16:05:44.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.171+0000 7f7810ca5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f780c0a5de0 0x7f780c1232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.171+0000 7f7810ca5700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f780c134a50 0x7f780c123700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.171+0000 7f7810ca5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c065450 con 0x7f780c0a18a0 2020-02-11T16:05:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.171+0000 7f7810ca5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c065f90 con 0x7f780c0a5de0 2020-02-11T16:05:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.171+0000 7f7810ca5700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c09e240 con 0x7f780c134a50 2020-02-11T16:05:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.171+0000 7f780a59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f780c0a18a0 0x7f780c065880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39276/0 (socket says 172.21.15.88:39276) 2020-02-11T16:05:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.171+0000 7f7809d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f780c0a5de0 0x7f780c1232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.171+0000 7f780a59c700 1 -- 172.21.15.88:0/3760133291 learned_addr learned my addr 172.21.15.88:0/3760133291 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f780ad9d700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f780c134a50 0x7f780c123700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 -- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f780c134a50 msgr2=0x7f780c123700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f780c134a50 0x7f780c123700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 -- 172.21.15.88:0/3760133291 >> v1:172.21.15.88:6789/0 conn(0x7f780c0a18a0 legacy=0x7f780c065880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f77fb7fe700 1 -- 172.21.15.88:0/3760133291 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958181361 0 0) 0x7f780c065450 con 0x7f780c0a18a0 2020-02-11T16:05:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 -- 172.21.15.88:0/3760133291 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c09e4e0 con 0x7f780c0a5de0 2020-02-11T16:05:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 --2- 172.21.15.88:0/3760133291 >> v2:172.21.15.88:3300/0 conn(0x7f780c0a5de0 0x7f780c1232a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 --2- 172.21.15.88:0/3760133291 >> v2:172.21.15.88:3300/0 conn(0x7f780c0a5de0 0x7f780c1232a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c1232a0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc011410).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c1232a0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f77fb7fe700 1 -- 172.21.15.88:0/3760133291 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77fc011aa0 con 0x7f780c0a5de0 2020-02-11T16:05:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c1232a0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f77fb7fe700 1 -- 172.21.15.88:0/3760133291 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc007340 con 0x7f780c0a5de0 2020-02-11T16:05:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c1232a0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c0a8d70 con 0x7f780c0a5de0 2020-02-11T16:05:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f77fb7fe700 1 -- 172.21.15.88:0/3760133291 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77fc0056c0 con 0x7f780c0a5de0 2020-02-11T16:05:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c12eae0 con 0x7f780c0a5de0 2020-02-11T16:05:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.172+0000 7f7809d9b700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c1232a0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f77fb7fe700 1 -- 172.21.15.88:0/3760133291 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f77fc005870 con 0x7f780c0a5de0 2020-02-11T16:05:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f7809d9b700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c1232a0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f77fb7fe700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77e8039a70 0x7f77e803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f780c09e9d0 con 0x7f780c0a5de0 2020-02-11T16:05:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f77fb7fe700 1 -- 172.21.15.88:0/3760133291 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f77fc04a110 con 0x7f780c0a5de0 2020-02-11T16:05:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f77fb7fe700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:6802/30959,v1:172.21.15.52:6803/30959] conn(0x7f77e80406c0 0x7f77e8042ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f7809d9b700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c1232a0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f77fb7fe700 1 -- 172.21.15.88:0/3760133291 --> [v2:172.21.15.52:6802/30959,v1:172.21.15.52:6803/30959] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77e80430a0 con 0x7f77e80406c0 2020-02-11T16:05:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f780a59c700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77e8039a70 0x7f77e803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f77fb7fe700 1 -- 172.21.15.88:0/3760133291 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77fc0078e0 con 0x7f780c0a5de0 2020-02-11T16:05:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f780ad9d700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:6802/30959,v1:172.21.15.52:6803/30959] conn(0x7f77e80406c0 0x7f77e8042ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.173+0000 7f780a59c700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77e8039a70 0x7f77e803bf30 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.174+0000 7f780ad9d700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:6802/30959,v1:172.21.15.52:6803/30959] conn(0x7f77e80406c0 0x7f77e8042ae0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.174+0000 7f77fb7fe700 1 -- 172.21.15.88:0/3760133291 <== osd.4 v2:172.21.15.52:6802/30959 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f77e80430a0 con 0x7f77e80406c0 2020-02-11T16:05:44.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.192+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 --> [v2:172.21.15.52:6802/30959,v1:172.21.15.52:6803/30959] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f780c0655e0 con 0x7f77e80406c0 2020-02-11T16:05:44.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.192+0000 7f77fb7fe700 1 -- 172.21.15.88:0/3760133291 <== osd.4 v2:172.21.15.52:6802/30959 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7804005940 con 0x7f77e80406c0 2020-02-11T16:05:44.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:6802/30959,v1:172.21.15.52:6803/30959] conn(0x7f77e80406c0 msgr2=0x7f77e8042ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:6802/30959,v1:172.21.15.52:6803/30959] conn(0x7f77e80406c0 0x7f77e8042ae0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77e8039a70 msgr2=0x7f77e803bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77e8039a70 0x7f77e803bf30 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 msgr2=0x7f780c1232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c1232a0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f780c05bbc0 tx=0x7f77fc011410).stop 2020-02-11T16:05:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f780ad9d700 1 -- 172.21.15.88:0/3760133291 reap_dead start 2020-02-11T16:05:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 shutdown_connections 2020-02-11T16:05:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 --2- 172.21.15.88:0/3760133291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f780c0a5de0 0x7f780c1232a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 >> 172.21.15.88:0/3760133291 conn(0x7f780c09d110 msgr2=0x7f780c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 shutdown_connections 2020-02-11T16:05:44.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.193+0000 7f7810ca5700 1 -- 172.21.15.88:0/3760133291 wait complete. 2020-02-11T16:05:44.207 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2020-02-11T16:05:44.207 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-02-11T16:05:44.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.310+0000 7f7ae5ba6700 1 Processor -- start 2020-02-11T16:05:44.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.310+0000 7f7ae5ba6700 1 -- start start 2020-02-11T16:05:44.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ae5ba6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ae5ba6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7ae00a5de0 0x7f7ae00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ae5ba6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ae012e3a0 0x7f7ae012e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ae5ba6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae00a3570 con 0x7f7ae00a5de0 2020-02-11T16:05:44.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ae5ba6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae00a3810 con 0x7f7ae00a18a0 2020-02-11T16:05:44.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ae5ba6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00a3ab0 con 0x7f7ae012e3a0 2020-02-11T16:05:44.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51660/0 (socket says 172.21.15.88:51660) 2020-02-11T16:05:44.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 -- 172.21.15.88:0/901482443 learned_addr learned my addr 172.21.15.88:0/901482443 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:44.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adeffd700 1 --2- 172.21.15.88:0/901482443 >> v2:172.21.15.52:3300/0 conn(0x7f7ae00a5de0 0x7f7ae00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adffff700 1 --2- 172.21.15.88:0/901482443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ae012e3a0 0x7f7ae012e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 -- 172.21.15.88:0/901482443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ae012e3a0 msgr2=0x7f7ae012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:44.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 --2- 172.21.15.88:0/901482443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ae012e3a0 0x7f7ae012e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 -- 172.21.15.88:0/901482443 >> v2:172.21.15.52:3300/0 conn(0x7f7ae00a5de0 msgr2=0x7f7ae00a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 --2- 172.21.15.88:0/901482443 >> v2:172.21.15.52:3300/0 conn(0x7f7ae00a5de0 0x7f7ae00a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 -- 172.21.15.88:0/901482443 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00a3d50 con 0x7f7ae00a18a0 2020-02-11T16:05:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 --2- 172.21.15.88:0/901482443 >> v2:172.21.15.88:3300/0 conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ad0002f30 tx=0x7f7ad0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 --2- 172.21.15.88:0/901482443 >> v2:172.21.15.88:3300/0 conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ad0002f30 tx=0x7f7ad0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 --2- 172.21.15.88:0/901482443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f7ad0002f30 tx=0x7f7ad0007a40).ready entity=mon.1 client_cookie=c129ef724ba9e394 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 --2- 172.21.15.88:0/901482443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f7ad0002f30 tx=0x7f7ad0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ade7fc700 1 -- 172.21.15.88:0/901482443 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ad0011720 con 0x7f7ae00a18a0 2020-02-11T16:05:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 --2- 172.21.15.88:0/901482443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f7ad0002f30 tx=0x7f7ad0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7adf7fe700 1 --2- 172.21.15.88:0/901482443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f7ad0002f30 tx=0x7f7ad0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ade7fc700 1 -- 172.21.15.88:0/901482443 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0011880 con 0x7f7ae00a18a0 2020-02-11T16:05:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ade7fc700 1 -- 172.21.15.88:0/901482443 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ad0011c60 con 0x7f7ae00a18a0 2020-02-11T16:05:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/901482443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae00a18a0 msgr2=0x7f7ae00a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.311+0000 7f7ae5ba6700 1 --2- 172.21.15.88:0/901482443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f7ad0002f30 tx=0x7f7ad0007a40).stop 2020-02-11T16:05:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.312+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/901482443 shutdown_connections 2020-02-11T16:05:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.312+0000 7f7ae5ba6700 1 --2- 172.21.15.88:0/901482443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ae012e3a0 0x7f7ae012e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.312+0000 7f7ae5ba6700 1 --2- 172.21.15.88:0/901482443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae00a18a0 0x7f7ae00a6dd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.312+0000 7f7ae5ba6700 1 --2- 172.21.15.88:0/901482443 >> v2:172.21.15.52:3300/0 conn(0x7f7ae00a5de0 0x7f7ae00a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.312+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/901482443 >> 172.21.15.88:0/901482443 conn(0x7f7ae009d110 msgr2=0x7f7ae009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.312+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/901482443 shutdown_connections 2020-02-11T16:05:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.312+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/901482443 wait complete. 2020-02-11T16:05:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.313+0000 7f7ae5ba6700 1 Processor -- start 2020-02-11T16:05:44.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.313+0000 7f7ae5ba6700 1 -- start start 2020-02-11T16:05:44.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7ae5ba6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ae012e3a0 0x7f7ae0137000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7ae5ba6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae0137710 con 0x7f7ae00a18a0 2020-02-11T16:05:44.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7ae5ba6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae01379b0 con 0x7f7ae00a5de0 2020-02-11T16:05:44.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7ae5ba6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae0137c50 con 0x7f7ae012e3a0 2020-02-11T16:05:44.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ae012e3a0 0x7f7ae0137000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ae012e3a0 0x7f7ae0137000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51670/0 (socket says 172.21.15.88:51670) 2020-02-11T16:05:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adeffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7ae00a5de0 0x7f7ae0142090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39294/0 (socket says 172.21.15.88:39294) 2020-02-11T16:05:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 -- 172.21.15.88:0/2711302783 learned_addr learned my addr 172.21.15.88:0/2711302783 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 -- 172.21.15.88:0/2711302783 >> v1:172.21.15.88:6789/0 conn(0x7f7ae00a5de0 legacy=0x7f7ae0142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 -- 172.21.15.88:0/2711302783 >> v1:172.21.15.52:6789/0 conn(0x7f7ae00a18a0 legacy=0x7f7ae012a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 -- 172.21.15.88:0/2711302783 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae0135c50 con 0x7f7ae012e3a0 2020-02-11T16:05:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 --2- 172.21.15.88:0/2711302783 >> v2:172.21.15.88:3300/0 conn(0x7f7ae012e3a0 0x7f7ae0137000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ad80032b0 tx=0x7f7ad8012ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 --2- 172.21.15.88:0/2711302783 >> v2:172.21.15.88:3300/0 conn(0x7f7ae012e3a0 0x7f7ae0137000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ad80032b0 tx=0x7f7ad8012ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae012e3a0 0x7f7ae0137000 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f7ad80032b0 tx=0x7f7ad8012ff0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae012e3a0 0x7f7ae0137000 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f7ad80032b0 tx=0x7f7ad8012ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adcff9700 1 -- 172.21.15.88:0/2711302783 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ad8014d70 con 0x7f7ae012e3a0 2020-02-11T16:05:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae012e3a0 0x7f7ae0137000 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f7ad80032b0 tx=0x7f7ad8012ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adffff700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae012e3a0 0x7f7ae0137000 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f7ad80032b0 tx=0x7f7ad8012ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adcff9700 1 -- 172.21.15.88:0/2711302783 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad800c160 con 0x7f7ae012e3a0 2020-02-11T16:05:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7adcff9700 1 -- 172.21.15.88:0/2711302783 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ad800c580 con 0x7f7ae012e3a0 2020-02-11T16:05:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae0137460 con 0x7f7ae012e3a0 2020-02-11T16:05:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.314+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae012ab50 con 0x7f7ae012e3a0 2020-02-11T16:05:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7adffff700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae012e3a0 0x7f7ae0137000 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f7ad80032b0 tx=0x7f7ad8012ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ae0141df0 con 0x7f7ae012e3a0 2020-02-11T16:05:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7adcff9700 1 -- 172.21.15.88:0/2711302783 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f7ad8005a40 con 0x7f7ae012e3a0 2020-02-11T16:05:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7adffff700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae012e3a0 0x7f7ae0137000 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f7ad80032b0 tx=0x7f7ad8012ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7adffff700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae012e3a0 0x7f7ae0137000 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f7ad80032b0 tx=0x7f7ad8012ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7adcff9700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7ac0039c40 0x7f7ac003c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7adcff9700 1 -- 172.21.15.88:0/2711302783 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7ad804bd10 con 0x7f7ae012e3a0 2020-02-11T16:05:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7adcff9700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.52:6818/30989,v1:172.21.15.52:6819/30989] conn(0x7f7ac0040890 0x7f7ac0042cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7adcff9700 1 -- 172.21.15.88:0/2711302783 --> [v2:172.21.15.52:6818/30989,v1:172.21.15.52:6819/30989] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ac0043270 con 0x7f7ac0040890 2020-02-11T16:05:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7adcff9700 1 -- 172.21.15.88:0/2711302783 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ad804d170 con 0x7f7ae012e3a0 2020-02-11T16:05:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.315+0000 7f7adf7fe700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7ac0039c40 0x7f7ac003c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.316+0000 7f7adeffd700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.52:6818/30989,v1:172.21.15.52:6819/30989] conn(0x7f7ac0040890 0x7f7ac0042cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.316+0000 7f7adf7fe700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7ac0039c40 0x7f7ac003c100 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.316+0000 7f7adeffd700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.52:6818/30989,v1:172.21.15.52:6819/30989] conn(0x7f7ac0040890 0x7f7ac0042cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.317+0000 7f7adcff9700 1 -- 172.21.15.88:0/2711302783 <== osd.5 v2:172.21.15.52:6818/30989 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f7ac0043270 con 0x7f7ac0040890 2020-02-11T16:05:44.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.334+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 --> [v2:172.21.15.52:6818/30989,v1:172.21.15.52:6819/30989] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ae01429e0 con 0x7f7ac0040890 2020-02-11T16:05:44.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.334+0000 7f7adcff9700 1 -- 172.21.15.88:0/2711302783 <== osd.5 v2:172.21.15.52:6818/30989 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ae01429e0 con 0x7f7ac0040890 2020-02-11T16:05:44.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.334+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 >> [v2:172.21.15.52:6818/30989,v1:172.21.15.52:6819/30989] conn(0x7f7ac0040890 msgr2=0x7f7ac0042cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.334+0000 7f7ae5ba6700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.52:6818/30989,v1:172.21.15.52:6819/30989] conn(0x7f7ac0040890 0x7f7ac0042cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.334+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7ac0039c40 msgr2=0x7f7ac003c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.334+0000 7f7ae5ba6700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7ac0039c40 0x7f7ac003c100 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.334+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae012e3a0 msgr2=0x7f7ae0137000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.334+0000 7f7ae5ba6700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae012e3a0 0x7f7ae0137000 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f7ad80032b0 tx=0x7f7ad8012ff0).stop 2020-02-11T16:05:44.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.335+0000 7f7adffff700 1 -- 172.21.15.88:0/2711302783 reap_dead start 2020-02-11T16:05:44.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.335+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 shutdown_connections 2020-02-11T16:05:44.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.335+0000 7f7ae5ba6700 1 --2- 172.21.15.88:0/2711302783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae012e3a0 0x7f7ae0137000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.335+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 >> 172.21.15.88:0/2711302783 conn(0x7f7ae009d110 msgr2=0x7f7ae00a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.335+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 shutdown_connections 2020-02-11T16:05:44.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.335+0000 7f7ae5ba6700 1 -- 172.21.15.88:0/2711302783 wait complete. 2020-02-11T16:05:44.347 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2020-02-11T16:05:44.347 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-02-11T16:05:44.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.457+0000 7f1c33935700 1 Processor -- start 2020-02-11T16:05:44.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.457+0000 7f1c33935700 1 -- start start 2020-02-11T16:05:44.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c33935700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c2c0a50f0 0x7f1c2c0a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c33935700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c136930 con 0x7f1c2c0a2900 2020-02-11T16:05:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c33935700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c0a6470 con 0x7f1c2c0a7120 2020-02-11T16:05:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c33935700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2c0a49b0 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c316d1700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1c2c0a7120 0x7f1c2c13c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39302/0 (socket says 172.21.15.88:39302) 2020-02-11T16:05:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c316d1700 1 -- 172.21.15.88:0/2747890568 learned_addr learned my addr 172.21.15.88:0/2747890568 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c31ed2700 1 --2- 172.21.15.88:0/2747890568 >> v2:172.21.15.52:3300/0 conn(0x7f1c2c0a50f0 0x7f1c2c0a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c17fff700 1 -- 172.21.15.88:0/2747890568 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521715038 0 0) 0x7f1c2c0a6470 con 0x7f1c2c0a7120 2020-02-11T16:05:44.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c17fff700 1 -- 172.21.15.88:0/2747890568 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c10003230 con 0x7f1c2c0a7120 2020-02-11T16:05:44.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c31ed2700 1 -- 172.21.15.88:0/2747890568 >> v1:172.21.15.88:6789/0 conn(0x7f1c2c0a7120 legacy=0x7f1c2c13c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c17fff700 1 -- 172.21.15.88:0/2747890568 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2985928165 0 0) 0x7f1c10003230 con 0x7f1c2c0a7120 2020-02-11T16:05:44.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c31ed2700 1 -- 172.21.15.88:0/2747890568 >> v1:172.21.15.52:6789/0 conn(0x7f1c2c0a2900 legacy=0x7f1c2c13c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c31ed2700 1 -- 172.21.15.88:0/2747890568 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c0a4c50 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.458+0000 7f1c31ed2700 1 --2- 172.21.15.88:0/2747890568 >> v2:172.21.15.52:3300/0 conn(0x7f1c2c0a50f0 0x7f1c2c0a5cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c200010d0 tx=0x7f1c280088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c31ed2700 1 --2- 172.21.15.88:0/2747890568 >> v2:172.21.15.52:3300/0 conn(0x7f1c2c0a50f0 0x7f1c2c0a5cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c200010d0 tx=0x7f1c280088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c31ed2700 1 --2- 172.21.15.88:0/2747890568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c2c0a50f0 0x7f1c2c0a5cf0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f1c200010d0 tx=0x7f1c280088e0).ready entity=mon.0 client_cookie=f84cb30785cc677f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c31ed2700 1 --2- 172.21.15.88:0/2747890568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c2c0a50f0 0x7f1c2c0a5cf0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f1c200010d0 tx=0x7f1c280088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c17fff700 1 -- 172.21.15.88:0/2747890568 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c24001a90 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c31ed2700 1 --2- 172.21.15.88:0/2747890568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c2c0a50f0 0x7f1c2c0a5cf0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f1c200010d0 tx=0x7f1c280088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c17fff700 1 -- 172.21.15.88:0/2747890568 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c28008b40 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c31ed2700 1 --2- 172.21.15.88:0/2747890568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c2c0a50f0 0x7f1c2c0a5cf0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f1c200010d0 tx=0x7f1c280088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c17fff700 1 -- 172.21.15.88:0/2747890568 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c28008ea0 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c33935700 1 -- 172.21.15.88:0/2747890568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c2c0a50f0 msgr2=0x7f1c2c0a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c33935700 1 --2- 172.21.15.88:0/2747890568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c2c0a50f0 0x7f1c2c0a5cf0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f1c200010d0 tx=0x7f1c280088e0).stop 2020-02-11T16:05:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c33935700 1 -- 172.21.15.88:0/2747890568 shutdown_connections 2020-02-11T16:05:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c33935700 1 --2- 172.21.15.88:0/2747890568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c2c0a50f0 0x7f1c2c0a5cf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c33935700 1 -- 172.21.15.88:0/2747890568 >> 172.21.15.88:0/2747890568 conn(0x7f1c2c09d110 msgr2=0x7f1c2c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c33935700 1 -- 172.21.15.88:0/2747890568 shutdown_connections 2020-02-11T16:05:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.459+0000 7f1c33935700 1 -- 172.21.15.88:0/2747890568 wait complete. 2020-02-11T16:05:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.460+0000 7f1c33935700 1 Processor -- start 2020-02-11T16:05:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.460+0000 7f1c33935700 1 -- start start 2020-02-11T16:05:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c33935700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c2c0a2900 0x7f1c2c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c33935700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c130770 con 0x7f1c2c0a7120 2020-02-11T16:05:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c33935700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c1402d0 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c33935700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c1309a0 con 0x7f1c2c0a2900 2020-02-11T16:05:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c30ed0700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1c2c0a50f0 0x7f1c2c132350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39310/0 (socket says 172.21.15.88:39310) 2020-02-11T16:05:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c30ed0700 1 -- 172.21.15.88:0/1553740702 learned_addr learned my addr 172.21.15.88:0/1553740702 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c316d1700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c2c0a2900 0x7f1c2c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545702523 0 0) 0x7f1c200012f0 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c08002fe0 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639623658 0 0) 0x7f1c2c130770 con 0x7f1c2c0a7120 2020-02-11T16:05:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c200012f0 con 0x7f1c2c0a7120 2020-02-11T16:05:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 486011182 0 0) 0x7f1c08002fe0 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1c2c130770 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f1c20001ca0 con 0x7f1c2c0a50f0 2020-02-11T16:05:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c2c0a2900 msgr2=0x7f1c2c13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c2c0a2900 0x7f1c2c13fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 >> v1:172.21.15.88:6789/0 conn(0x7f1c2c0a50f0 legacy=0x7f1c2c132350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 >> v1:172.21.15.52:6789/0 conn(0x7f1c2c0a7120 legacy=0x7f1c2c13d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c08004b20 0x7f1c08004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c08004390 0x7f1c0800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c1309a0 con 0x7f1c08004390 2020-02-11T16:05:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c08004870 con 0x7f1c08003ab0 2020-02-11T16:05:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0800bbb0 con 0x7f1c08004b20 2020-02-11T16:05:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.461+0000 7f1c316d1700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c2c0a2900 0x7f1c2c13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:44.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c31ed2700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c08004390 0x7f1c0800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c316d1700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c08004b20 0x7f1c08004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 -- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c08004b20 msgr2=0x7f1c08004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c08004b20 0x7f1c08004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 -- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c08004390 msgr2=0x7f1c0800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c08004390 0x7f1c0800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 -- 172.21.15.88:0/1553740702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c132bb0 con 0x7f1c08003ab0 2020-02-11T16:05:44.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c0a9570 con 0x7f1c08003ab0 2020-02-11T16:05:44.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c08004a80 tx=0x7f1c20011700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c140030 con 0x7f1c08003ab0 2020-02-11T16:05:44.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c08004a80 tx=0x7f1c20011700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f1c08004a80 tx=0x7f1c20011700).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f1c08004a80 tx=0x7f1c20011700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c2000c710 con 0x7f1c08003ab0 2020-02-11T16:05:44.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f1c08004a80 tx=0x7f1c20011700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2000c870 con 0x7f1c08003ab0 2020-02-11T16:05:44.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f1c08004a80 tx=0x7f1c20011700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c2000cbd0 con 0x7f1c08003ab0 2020-02-11T16:05:44.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.462+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f1c08004a80 tx=0x7f1c20011700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c0c003580 con 0x7f1c08003ab0 2020-02-11T16:05:44.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f1c2000c0a0 con 0x7f1c08003ab0 2020-02-11T16:05:44.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f1c08004a80 tx=0x7f1c20011700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c30ed0700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f1c08004a80 tx=0x7f1c20011700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c1effd700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c08042600 0x7f1c08044ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f1c2004a4e0 con 0x7f1c08003ab0 2020-02-11T16:05:44.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c1effd700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6826/30990,v1:172.21.15.52:6827/30990] conn(0x7f1c080491d0 0x7f1c0804b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 --> [v2:172.21.15.52:6826/30990,v1:172.21.15.52:6827/30990] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c0804bc40 con 0x7f1c080491d0 2020-02-11T16:05:44.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c2004b980 con 0x7f1c08003ab0 2020-02-11T16:05:44.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c316d1700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c08042600 0x7f1c08044ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c31ed2700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6826/30990,v1:172.21.15.52:6827/30990] conn(0x7f1c080491d0 0x7f1c0804b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.463+0000 7f1c316d1700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c08042600 0x7f1c08044ac0 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.464+0000 7f1c31ed2700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6826/30990,v1:172.21.15.52:6827/30990] conn(0x7f1c080491d0 0x7f1c0804b5f0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.464+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== osd.6 v2:172.21.15.52:6826/30990 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f1c0804bc40 con 0x7f1c080491d0 2020-02-11T16:05:44.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.482+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 --> [v2:172.21.15.52:6826/30990,v1:172.21.15.52:6827/30990] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c0c002680 con 0x7f1c080491d0 2020-02-11T16:05:44.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c1effd700 1 -- 172.21.15.88:0/1553740702 <== osd.6 v2:172.21.15.52:6826/30990 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c0c002680 con 0x7f1c080491d0 2020-02-11T16:05:44.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6826/30990,v1:172.21.15.52:6827/30990] conn(0x7f1c080491d0 msgr2=0x7f1c0804b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6826/30990,v1:172.21.15.52:6827/30990] conn(0x7f1c080491d0 0x7f1c0804b5f0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c31ed2700 1 -- 172.21.15.88:0/1553740702 reap_dead start 2020-02-11T16:05:44.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c08042600 msgr2=0x7f1c08044ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c08042600 0x7f1c08044ac0 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 msgr2=0x7f1c08003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f1c08004a80 tx=0x7f1c20011700).stop 2020-02-11T16:05:44.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 shutdown_connections 2020-02-11T16:05:44.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c08003ab0 0x7f1c08003f30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 --2- 172.21.15.88:0/1553740702 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c08042600 0x7f1c08044ac0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 >> 172.21.15.88:0/1553740702 conn(0x7f1c2c09d110 msgr2=0x7f1c2c1360c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 shutdown_connections 2020-02-11T16:05:44.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.483+0000 7f1c33935700 1 -- 172.21.15.88:0/1553740702 wait complete. 2020-02-11T16:05:44.495 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2020-02-11T16:05:44.496 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-02-11T16:05:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f54369e2700 1 Processor -- start 2020-02-11T16:05:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f54369e2700 1 -- start start 2020-02-11T16:05:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f54369e2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f543013b290 0x7f543009d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f54369e2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f543013b6f0 0x7f543009d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f54369e2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54301380c0 con 0x7f5430131f50 2020-02-11T16:05:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f54369e2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5430138360 con 0x7f543013b6f0 2020-02-11T16:05:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f54369e2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5430138600 con 0x7f543013b290 2020-02-11T16:05:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f5434f7f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f543013b6f0 0x7f543009d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f5434f7f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f543013b6f0 0x7f543009d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51702/0 (socket says 172.21.15.88:51702) 2020-02-11T16:05:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f542ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5430131f50 0x7f543005f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39324/0 (socket says 172.21.15.88:39324) 2020-02-11T16:05:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.600+0000 7f5434f7f700 1 -- 172.21.15.88:0/2813181536 learned_addr learned my addr 172.21.15.88:0/2813181536 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:44.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f542f7fe700 1 --2- 172.21.15.88:0/2813181536 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f543013b290 0x7f543009d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f5434f7f700 1 -- 172.21.15.88:0/2813181536 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f543013b290 msgr2=0x7f543009d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:44.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f5434f7f700 1 --2- 172.21.15.88:0/2813181536 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f543013b290 0x7f543009d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f5434f7f700 1 -- 172.21.15.88:0/2813181536 >> v1:172.21.15.88:6789/0 conn(0x7f5430131f50 legacy=0x7f543005f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f5434f7f700 1 -- 172.21.15.88:0/2813181536 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430137d40 con 0x7f543013b6f0 2020-02-11T16:05:44.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f542effd700 1 -- 172.21.15.88:0/2813181536 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634691264 0 0) 0x7f54301380c0 con 0x7f5430131f50 2020-02-11T16:05:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f5434f7f700 1 --2- 172.21.15.88:0/2813181536 >> v2:172.21.15.88:3300/0 conn(0x7f543013b6f0 0x7f543009d600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f54280032b0 tx=0x7f5428008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f5434f7f700 1 --2- 172.21.15.88:0/2813181536 >> v2:172.21.15.88:3300/0 conn(0x7f543013b6f0 0x7f543009d600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f54280032b0 tx=0x7f5428008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f5434f7f700 1 --2- 172.21.15.88:0/2813181536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f543013b6f0 0x7f543009d600 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f54280032b0 tx=0x7f5428008c60).ready entity=mon.1 client_cookie=a231f73c73f7dee7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f5434f7f700 1 --2- 172.21.15.88:0/2813181536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f543013b6f0 0x7f543009d600 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f54280032b0 tx=0x7f5428008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f542effd700 1 -- 172.21.15.88:0/2813181536 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542800a160 con 0x7f543013b6f0 2020-02-11T16:05:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f5434f7f700 1 --2- 172.21.15.88:0/2813181536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f543013b6f0 0x7f543009d600 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f54280032b0 tx=0x7f5428008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f5434f7f700 1 --2- 172.21.15.88:0/2813181536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f543013b6f0 0x7f543009d600 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f54280032b0 tx=0x7f5428008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f542effd700 1 -- 172.21.15.88:0/2813181536 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542800a2c0 con 0x7f543013b6f0 2020-02-11T16:05:44.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f542effd700 1 -- 172.21.15.88:0/2813181536 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542800a660 con 0x7f543013b6f0 2020-02-11T16:05:44.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f54369e2700 1 -- 172.21.15.88:0/2813181536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f543013b6f0 msgr2=0x7f543009d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f54369e2700 1 --2- 172.21.15.88:0/2813181536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f543013b6f0 0x7f543009d600 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f54280032b0 tx=0x7f5428008c60).stop 2020-02-11T16:05:44.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f54369e2700 1 -- 172.21.15.88:0/2813181536 shutdown_connections 2020-02-11T16:05:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f54369e2700 1 --2- 172.21.15.88:0/2813181536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f543013b6f0 0x7f543009d600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f54369e2700 1 --2- 172.21.15.88:0/2813181536 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f543013b290 0x7f543009d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f54369e2700 1 -- 172.21.15.88:0/2813181536 >> 172.21.15.88:0/2813181536 conn(0x7f54300a7bb0 msgr2=0x7f54300a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f54369e2700 1 -- 172.21.15.88:0/2813181536 shutdown_connections 2020-02-11T16:05:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.601+0000 7f54369e2700 1 -- 172.21.15.88:0/2813181536 wait complete. 2020-02-11T16:05:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.602+0000 7f54369e2700 1 Processor -- start 2020-02-11T16:05:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.602+0000 7f54369e2700 1 -- start start 2020-02-11T16:05:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f54369e2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5430131f50 0x7f5430130410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f54369e2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f543013b290 0x7f54301452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f54369e2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5430130ca0 con 0x7f543012eeb0 2020-02-11T16:05:44.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f54369e2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5430130a00 con 0x7f5430131f50 2020-02-11T16:05:44.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f54369e2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5430144e30 con 0x7f543013b290 2020-02-11T16:05:44.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5430131f50 0x7f5430130410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5430131f50 0x7f5430130410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51706/0 (socket says 172.21.15.88:51706) 2020-02-11T16:05:44.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542ffff700 1 -- 172.21.15.88:0/743770757 learned_addr learned my addr 172.21.15.88:0/743770757 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542f7fe700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f543013b290 0x7f54301452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542ffff700 1 -- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f543013b290 msgr2=0x7f54301452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542ffff700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f543013b290 0x7f54301452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542ffff700 1 -- 172.21.15.88:0/743770757 >> v1:172.21.15.52:6789/0 conn(0x7f543012eeb0 legacy=0x7f54301485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542ffff700 1 -- 172.21.15.88:0/743770757 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430139360 con 0x7f5430131f50 2020-02-11T16:05:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542ffff700 1 --2- 172.21.15.88:0/743770757 >> v2:172.21.15.88:3300/0 conn(0x7f5430131f50 0x7f5430130410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5420000b80 tx=0x7f5420010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542ffff700 1 --2- 172.21.15.88:0/743770757 >> v2:172.21.15.88:3300/0 conn(0x7f5430131f50 0x7f5430130410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5420000b80 tx=0x7f5420010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.603+0000 7f542ffff700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5430131f50 0x7f5430130410 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f5420000b80 tx=0x7f5420010970).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.604+0000 7f542ffff700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5430131f50 0x7f5430130410 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f5420000b80 tx=0x7f5420010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.604+0000 7f542d7fa700 1 -- 172.21.15.88:0/743770757 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54200048d0 con 0x7f5430131f50 2020-02-11T16:05:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.604+0000 7f542ffff700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5430131f50 0x7f5430130410 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f5420000b80 tx=0x7f5420010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.604+0000 7f542ffff700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5430131f50 0x7f5430130410 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f5420000b80 tx=0x7f5420010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.604+0000 7f542d7fa700 1 -- 172.21.15.88:0/743770757 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5420004a30 con 0x7f5430131f50 2020-02-11T16:05:44.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.604+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54300a6470 con 0x7f5430131f50 2020-02-11T16:05:44.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.604+0000 7f542d7fa700 1 -- 172.21.15.88:0/743770757 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5420004dd0 con 0x7f5430131f50 2020-02-11T16:05:44.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.604+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5430148ea0 con 0x7f5430131f50 2020-02-11T16:05:44.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.604+0000 7f542ffff700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5430131f50 0x7f5430130410 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f5420000b80 tx=0x7f5420010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.604+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f54300565b0 con 0x7f5430131f50 2020-02-11T16:05:44.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f542d7fa700 1 -- 172.21.15.88:0/743770757 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f5420012310 con 0x7f5430131f50 2020-02-11T16:05:44.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f542ffff700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5430131f50 0x7f5430130410 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f5420000b80 tx=0x7f5420010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f542ffff700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5430131f50 0x7f5430130410 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f5420000b80 tx=0x7f5420010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f542d7fa700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5410039bd0 0x7f541003c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f542d7fa700 1 -- 172.21.15.88:0/743770757 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5420049840 con 0x7f5430131f50 2020-02-11T16:05:44.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f542d7fa700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:6810/30960,v1:172.21.15.52:6811/30960] conn(0x7f5410040820 0x7f5410042c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f542d7fa700 1 -- 172.21.15.88:0/743770757 --> [v2:172.21.15.52:6810/30960,v1:172.21.15.52:6811/30960] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5410043200 con 0x7f5410040820 2020-02-11T16:05:44.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f542d7fa700 1 -- 172.21.15.88:0/743770757 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f542004ad00 con 0x7f5430131f50 2020-02-11T16:05:44.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f542f7fe700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5410039bd0 0x7f541003c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f5434f7f700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:6810/30960,v1:172.21.15.52:6811/30960] conn(0x7f5410040820 0x7f5410042c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f542f7fe700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5410039bd0 0x7f541003c090 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.605+0000 7f5434f7f700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:6810/30960,v1:172.21.15.52:6811/30960] conn(0x7f5410040820 0x7f5410042c40 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.606+0000 7f542d7fa700 1 -- 172.21.15.88:0/743770757 <== osd.7 v2:172.21.15.52:6810/30960 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f5410043200 con 0x7f5410040820 2020-02-11T16:05:44.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.623+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 --> [v2:172.21.15.52:6810/30960,v1:172.21.15.52:6811/30960] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5430144fa0 con 0x7f5410040820 2020-02-11T16:05:44.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f542d7fa700 1 -- 172.21.15.88:0/743770757 <== osd.7 v2:172.21.15.52:6810/30960 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5430144fa0 con 0x7f5410040820 2020-02-11T16:05:44.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:6810/30960,v1:172.21.15.52:6811/30960] conn(0x7f5410040820 msgr2=0x7f5410042c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f54369e2700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:6810/30960,v1:172.21.15.52:6811/30960] conn(0x7f5410040820 0x7f5410042c40 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5410039bd0 msgr2=0x7f541003c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f54369e2700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5410039bd0 0x7f541003c090 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5430131f50 msgr2=0x7f5430130410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f54369e2700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5430131f50 0x7f5430130410 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f5420000b80 tx=0x7f5420010970).stop 2020-02-11T16:05:44.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f5434f7f700 1 -- 172.21.15.88:0/743770757 reap_dead start 2020-02-11T16:05:44.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 shutdown_connections 2020-02-11T16:05:44.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f54369e2700 1 --2- 172.21.15.88:0/743770757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5430131f50 0x7f5430130410 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.624+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 >> 172.21.15.88:0/743770757 conn(0x7f54300a7bb0 msgr2=0x7f54300a7400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.625+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 shutdown_connections 2020-02-11T16:05:44.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.625+0000 7f54369e2700 1 -- 172.21.15.88:0/743770757 wait complete. 2020-02-11T16:05:44.637 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2020-02-11T16:05:44.638 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-02-11T16:05:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.741+0000 7fe5cadc7700 1 Processor -- start 2020-02-11T16:05:44.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.741+0000 7fe5cadc7700 1 -- start start 2020-02-11T16:05:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5cadc7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5c40a5de0 0x7fe5c40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5cadc7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40a31b0 con 0x7fe5c40a18a0 2020-02-11T16:05:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5cadc7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40a3570 con 0x7fe5c4134a50 2020-02-11T16:05:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5cadc7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40a3810 con 0x7fe5c40a5de0 2020-02-11T16:05:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c9364700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe5c4134a50 0x7fe5c4134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39344/0 (socket says 172.21.15.88:39344) 2020-02-11T16:05:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c9364700 1 -- 172.21.15.88:0/3473263388 learned_addr learned my addr 172.21.15.88:0/3473263388 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625326687 0 0) 0x7fe5c40a3570 con 0x7fe5c4134a50 2020-02-11T16:05:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b0003230 con 0x7fe5c4134a50 2020-02-11T16:05:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5c40a5de0 0x7fe5c40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942222453 0 0) 0x7fe5c40a31b0 con 0x7fe5c40a18a0 2020-02-11T16:05:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c40a3570 con 0x7fe5c40a18a0 2020-02-11T16:05:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 843828270 0 0) 0x7fe5b0003230 con 0x7fe5c4134a50 2020-02-11T16:05:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5c40a5de0 msgr2=0x7fe5c40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5c40a5de0 0x7fe5c40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 >> v1:172.21.15.52:6789/0 conn(0x7fe5c40a18a0 legacy=0x7fe5c40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40a3ab0 con 0x7fe5c4134a50 2020-02-11T16:05:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe5bc001a50 con 0x7fe5c4134a50 2020-02-11T16:05:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 >> v1:172.21.15.88:6789/0 conn(0x7fe5c4134a50 legacy=0x7fe5c4134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5c40a5de0 0x7fe5b00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0003d90 0x7fe5b00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.742+0000 7fe5c37fe700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5b0004930 0x7fe5b0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:44.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40a3810 con 0x7fe5b0004930 2020-02-11T16:05:44.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0005210 con 0x7fe5b0003d90 2020-02-11T16:05:44.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00053a0 con 0x7fe5c40a5de0 2020-02-11T16:05:44.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0003d90 0x7fe5b00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c9364700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5b0004930 0x7fe5b0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c8b63700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5c40a5de0 0x7fe5b00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 -- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5c40a5de0 msgr2=0x7fe5b00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:44.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5c40a5de0 0x7fe5b00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 -- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5b0004930 msgr2=0x7fe5b0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:44.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5b0004930 0x7fe5b0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:44.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 -- 172.21.15.88:0/3473263388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0003230 con 0x7fe5b0003d90 2020-02-11T16:05:44.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c9364700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5b0004930 0x7fe5b0004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0003d90 0x7fe5b00044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0003d90 0x7fe5b00044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0003d90 0x7fe5b00044d0 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).ready entity=mon.1 client_cookie=aaba9765556b7028 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0003d90 0x7fe5b00044d0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5b8008b40 con 0x7fe5b0003d90 2020-02-11T16:05:44.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0003d90 0x7fe5b00044d0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0003d90 0x7fe5b00044d0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8008ca0 con 0x7fe5b0003d90 2020-02-11T16:05:44.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c37fe700 1 -- 172.21.15.88:0/3473263388 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5b80056c0 con 0x7fe5b0003d90 2020-02-11T16:05:44.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5cadc7700 1 -- 172.21.15.88:0/3473263388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0003d90 msgr2=0x7fe5b00044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5cadc7700 1 --2- 172.21.15.88:0/3473263388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0003d90 0x7fe5b00044d0 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).stop 2020-02-11T16:05:44.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.743+0000 7fe5c9364700 1 -- 172.21.15.88:0/3473263388 reap_dead start 2020-02-11T16:05:44.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.744+0000 7fe5cadc7700 1 -- 172.21.15.88:0/3473263388 shutdown_connections 2020-02-11T16:05:44.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.744+0000 7fe5cadc7700 1 -- 172.21.15.88:0/3473263388 >> 172.21.15.88:0/3473263388 conn(0x7fe5c409d110 msgr2=0x7fe5c409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.744+0000 7fe5cadc7700 1 -- 172.21.15.88:0/3473263388 shutdown_connections 2020-02-11T16:05:44.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.744+0000 7fe5cadc7700 1 -- 172.21.15.88:0/3473263388 wait complete. 2020-02-11T16:05:44.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.744+0000 7fe5cadc7700 1 Processor -- start 2020-02-11T16:05:44.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.744+0000 7fe5cadc7700 1 -- start start 2020-02-11T16:05:44.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5cadc7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5c40a9f00 0x7fe5c4133ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5cadc7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40a7660 con 0x7fe5c4129200 2020-02-11T16:05:44.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5cadc7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c4134000 con 0x7fe5c4132130 2020-02-11T16:05:44.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5cadc7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c4130ff0 con 0x7fe5c40a9f00 2020-02-11T16:05:44.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5c8b63700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe5c4132130 0x7fe5c40a97f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39352/0 (socket says 172.21.15.88:39352) 2020-02-11T16:05:44.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5c3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5c40a9f00 0x7fe5c4133ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5c8b63700 1 -- 172.21.15.88:0/2868031883 learned_addr learned my addr 172.21.15.88:0/2868031883 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:44.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5c3fff700 1 -- 172.21.15.88:0/2868031883 >> v1:172.21.15.88:6789/0 conn(0x7fe5c4132130 legacy=0x7fe5c40a97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5c3fff700 1 -- 172.21.15.88:0/2868031883 >> v1:172.21.15.52:6789/0 conn(0x7fe5c4129200 legacy=0x7fe5c4129640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5c3fff700 1 -- 172.21.15.88:0/2868031883 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4129d50 con 0x7fe5c40a9f00 2020-02-11T16:05:44.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5c1ffb700 1 -- 172.21.15.88:0/2868031883 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206248254 0 0) 0x7fe5c40a3570 con 0x7fe5c4132130 2020-02-11T16:05:44.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.745+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/2868031883 >> v2:172.21.15.88:3300/0 conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/2868031883 >> v2:172.21.15.88:3300/0 conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c1ffb700 1 -- 172.21.15.88:0/2868031883 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5b8007650 con 0x7fe5c40a9f00 2020-02-11T16:05:44.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c1ffb700 1 -- 172.21.15.88:0/2868031883 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8005ac0 con 0x7fe5c40a9f00 2020-02-11T16:05:44.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5cadc7700 1 -- 172.21.15.88:0/2868031883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c4138490 con 0x7fe5c40a9f00 2020-02-11T16:05:44.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c1ffb700 1 -- 172.21.15.88:0/2868031883 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5b8005e20 con 0x7fe5c40a9f00 2020-02-11T16:05:44.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5cadc7700 1 -- 172.21.15.88:0/2868031883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c40a9350 con 0x7fe5c40a9f00 2020-02-11T16:05:44.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c1ffb700 1 -- 172.21.15.88:0/2868031883 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fe5b800f1f0 con 0x7fe5c40a9f00 2020-02-11T16:05:44.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.746+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.747+0000 7fe5cadc7700 1 -- 172.21.15.88:0/2868031883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c40a9510 con 0x7fe5c40a9f00 2020-02-11T16:05:44.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.747+0000 7fe5c1ffb700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5a4039a70 0x7fe5a403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:44.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.747+0000 7fe5c1ffb700 1 -- 172.21.15.88:0/2868031883 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fe5b804bc40 con 0x7fe5c40a9f00 2020-02-11T16:05:44.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.747+0000 7fe5c8b63700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5a4039a70 0x7fe5a403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:44.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.747+0000 7fe5c8b63700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5a4039a70 0x7fe5a403bf30 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:44.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.750+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.750+0000 7fe5c1ffb700 1 -- 172.21.15.88:0/2868031883 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe5b8031390 con 0x7fe5c40a9f00 2020-02-11T16:05:44.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.885+0000 7fe5cadc7700 1 -- 172.21.15.88:0/2868031883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe5c40565b0 con 0x7fe5c40a9f00 2020-02-11T16:05:44.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.886+0000 7fe5c3fff700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:44.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.886+0000 7fe5c1ffb700 1 -- 172.21.15.88:0/2868031883 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5b8033e40 con 0x7fe5c40a9f00 2020-02-11T16:05:44.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.887+0000 7fe5cadc7700 1 -- 172.21.15.88:0/2868031883 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5a4039a70 msgr2=0x7fe5a403bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.887+0000 7fe5cadc7700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5a4039a70 0x7fe5a403bf30 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.887+0000 7fe5cadc7700 1 -- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 msgr2=0x7fe5c4133ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:44.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.887+0000 7fe5cadc7700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 0x7fe5c4133ba0 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7fe5b8002f30 tx=0x7fe5b80122f0).stop 2020-02-11T16:05:44.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.887+0000 7fe5cadc7700 1 -- 172.21.15.88:0/2868031883 shutdown_connections 2020-02-11T16:05:44.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.887+0000 7fe5cadc7700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5a4039a70 0x7fe5a403bf30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.887+0000 7fe5cadc7700 1 --2- 172.21.15.88:0/2868031883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c40a9f00 0x7fe5c4133ba0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:44.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.887+0000 7fe5cadc7700 1 -- 172.21.15.88:0/2868031883 >> 172.21.15.88:0/2868031883 conn(0x7fe5c409d110 msgr2=0x7fe5c4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:44.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.887+0000 7fe5cadc7700 1 -- 172.21.15.88:0/2868031883 shutdown_connections 2020-02-11T16:05:44.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:44.887+0000 7fe5cadc7700 1 -- 172.21.15.88:0/2868031883 wait complete. 2020-02-11T16:05:44.892 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2020-02-11T16:05:44.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2020-02-11T16:05:45.900 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-02-11T16:05:46.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.015+0000 7f0fefb73700 1 Processor -- start 2020-02-11T16:05:46.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.015+0000 7f0fefb73700 1 -- start start 2020-02-11T16:05:46.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.016+0000 7f0fefb73700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0fe80a1520 0x7f0fe8131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:46.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.016+0000 7f0fefb73700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe80a4350 con 0x7f0fe80a2fa0 2020-02-11T16:05:46.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.016+0000 7f0fefb73700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe80a3a40 con 0x7f0fe80a5b20 2020-02-11T16:05:46.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.016+0000 7f0fefb73700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe80a1e60 con 0x7f0fe80a1520 2020-02-11T16:05:46.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.016+0000 7f0fed10e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0fe80a5b20 0x7f0fe8131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39362/0 (socket says 172.21.15.88:39362) 2020-02-11T16:05:46.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.016+0000 7f0fed10e700 1 -- 172.21.15.88:0/1094949411 learned_addr learned my addr 172.21.15.88:0/1094949411 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:46.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.016+0000 7f0fee110700 1 --2- 172.21.15.88:0/1094949411 >> v2:172.21.15.52:3300/0 conn(0x7f0fe80a1520 0x7f0fe8131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fec90d700 1 -- 172.21.15.88:0/1094949411 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518582920 0 0) 0x7f0fe80a3a40 con 0x7f0fe80a5b20 2020-02-11T16:05:46.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fec90d700 1 -- 172.21.15.88:0/1094949411 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd0003230 con 0x7f0fe80a5b20 2020-02-11T16:05:46.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fee110700 1 -- 172.21.15.88:0/1094949411 >> v1:172.21.15.88:6789/0 conn(0x7f0fe80a5b20 legacy=0x7f0fe8131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fee110700 1 -- 172.21.15.88:0/1094949411 >> v1:172.21.15.52:6789/0 conn(0x7f0fe80a2fa0 legacy=0x7f0fe80a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fec90d700 1 -- 172.21.15.88:0/1094949411 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 548144512 0 0) 0x7f0fd0003230 con 0x7f0fe80a5b20 2020-02-11T16:05:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fee110700 1 -- 172.21.15.88:0/1094949411 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80a3ce0 con 0x7f0fe80a1520 2020-02-11T16:05:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fee110700 1 --2- 172.21.15.88:0/1094949411 >> v2:172.21.15.52:3300/0 conn(0x7f0fe80a1520 0x7f0fe8131990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0fe40010d0 tx=0x7f0fe0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fee110700 1 --2- 172.21.15.88:0/1094949411 >> v2:172.21.15.52:3300/0 conn(0x7f0fe80a1520 0x7f0fe8131990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0fe40010d0 tx=0x7f0fe0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fee110700 1 --2- 172.21.15.88:0/1094949411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fe80a1520 0x7f0fe8131990 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f0fe40010d0 tx=0x7f0fe0008c60).ready entity=mon.0 client_cookie=39f4fbf11dbe270f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fee110700 1 --2- 172.21.15.88:0/1094949411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fe80a1520 0x7f0fe8131990 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f0fe40010d0 tx=0x7f0fe0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fec90d700 1 -- 172.21.15.88:0/1094949411 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fe0010cb0 con 0x7f0fe80a1520 2020-02-11T16:05:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fee110700 1 --2- 172.21.15.88:0/1094949411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fe80a1520 0x7f0fe8131990 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f0fe40010d0 tx=0x7f0fe0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fec90d700 1 -- 172.21.15.88:0/1094949411 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0010e10 con 0x7f0fe80a1520 2020-02-11T16:05:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fee110700 1 --2- 172.21.15.88:0/1094949411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fe80a1520 0x7f0fe8131990 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f0fe40010d0 tx=0x7f0fe0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fec90d700 1 -- 172.21.15.88:0/1094949411 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fe00112b0 con 0x7f0fe80a1520 2020-02-11T16:05:46.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fefb73700 1 -- 172.21.15.88:0/1094949411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fe80a1520 msgr2=0x7f0fe8131990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.017+0000 7f0fefb73700 1 --2- 172.21.15.88:0/1094949411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fe80a1520 0x7f0fe8131990 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f0fe40010d0 tx=0x7f0fe0008c60).stop 2020-02-11T16:05:46.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.018+0000 7f0fefb73700 1 -- 172.21.15.88:0/1094949411 shutdown_connections 2020-02-11T16:05:46.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.018+0000 7f0fefb73700 1 --2- 172.21.15.88:0/1094949411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fe80a1520 0x7f0fe8131990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.018+0000 7f0fefb73700 1 -- 172.21.15.88:0/1094949411 >> 172.21.15.88:0/1094949411 conn(0x7f0fe809d110 msgr2=0x7f0fe809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:46.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.018+0000 7f0fefb73700 1 -- 172.21.15.88:0/1094949411 shutdown_connections 2020-02-11T16:05:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.018+0000 7f0fefb73700 1 -- 172.21.15.88:0/1094949411 wait complete. 2020-02-11T16:05:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.018+0000 7f0fefb73700 1 Processor -- start 2020-02-11T16:05:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fefb73700 1 -- start start 2020-02-11T16:05:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fefb73700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fe80a1520 0x7f0fe81285e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fefb73700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0fe80a5b20 0x7f0fe812c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fefb73700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe8128af0 con 0x7f0fe80a2fa0 2020-02-11T16:05:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fefb73700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe8131df0 con 0x7f0fe80a5b20 2020-02-11T16:05:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fefb73700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe8142e10 con 0x7f0fe80a1520 2020-02-11T16:05:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fed10e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0fe80a2fa0 0x7f0fe8125390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39368/0 (socket says 172.21.15.88:39368) 2020-02-11T16:05:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fed10e700 1 -- 172.21.15.88:0/374216884 learned_addr learned my addr 172.21.15.88:0/374216884 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:46.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fee110700 1 --2- 172.21.15.88:0/374216884 >> v2:172.21.15.52:3300/0 conn(0x7f0fe80a5b20 0x7f0fe812c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fe80a1520 0x7f0fe81285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015301963 0 0) 0x7f0fe8128af0 con 0x7f0fe80a2fa0 2020-02-11T16:05:46.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.019+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc8002fe0 con 0x7f0fe80a2fa0 2020-02-11T16:05:46.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1724638798 0 0) 0x7f0fc8002fe0 con 0x7f0fe80a2fa0 2020-02-11T16:05:46.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0fe8128af0 con 0x7f0fe80a2fa0 2020-02-11T16:05:46.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f0fdc001980 con 0x7f0fe80a2fa0 2020-02-11T16:05:46.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fe80a1520 msgr2=0x7f0fe81285e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fe80a1520 0x7f0fe81285e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 >> v2:172.21.15.52:3300/0 conn(0x7f0fe80a5b20 msgr2=0x7f0fe812c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 --2- 172.21.15.88:0/374216884 >> v2:172.21.15.52:3300/0 conn(0x7f0fe80a5b20 0x7f0fe812c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 >> v1:172.21.15.88:6789/0 conn(0x7f0fe80a2fa0 legacy=0x7f0fe8125390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fc80052b0 0x7f0fc80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fe80a1520 0x7f0fc8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe8131df0 con 0x7f0fc80052b0 2020-02-11T16:05:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8004490 con 0x7f0fc80049b0 2020-02-11T16:05:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8004650 con 0x7f0fe80a1520 2020-02-11T16:05:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed10e700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fc80052b0 0x7f0fc80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fee110700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fe80a1520 0x7f0fc8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 -- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fe80a1520 msgr2=0x7f0fc8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fe80a1520 0x7f0fc8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 -- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fc80052b0 msgr2=0x7f0fc80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fc80052b0 0x7f0fc80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 -- 172.21.15.88:0/374216884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8128d90 con 0x7f0fc80049b0 2020-02-11T16:05:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fefb73700 1 -- 172.21.15.88:0/374216884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe80a98e0 con 0x7f0fc80049b0 2020-02-11T16:05:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fefb73700 1 -- 172.21.15.88:0/374216884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe80a7120 con 0x7f0fc80049b0 2020-02-11T16:05:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fe40066d0 con 0x7f0fc80049b0 2020-02-11T16:05:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4006830 con 0x7f0fc80049b0 2020-02-11T16:05:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.020+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fe4006bd0 con 0x7f0fc80049b0 2020-02-11T16:05:46.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.021+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.021+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f0fe4006d30 con 0x7f0fc80049b0 2020-02-11T16:05:46.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.021+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.021+0000 7f0fefb73700 1 -- 172.21.15.88:0/374216884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe8128960 con 0x7f0fc80049b0 2020-02-11T16:05:46.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.021+0000 7f0fdaffd700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0fc8042070 0x7f0fc8044530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.021+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f0fe4049960 con 0x7f0fc80049b0 2020-02-11T16:05:46.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.021+0000 7f0fed10e700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0fc8042070 0x7f0fc8044530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.022+0000 7f0fed10e700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0fc8042070 0x7f0fc8044530 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.025+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.025+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f0fe402ee80 con 0x7f0fc80049b0 2020-02-11T16:05:46.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.162+0000 7f0fefb73700 1 -- 172.21.15.88:0/374216884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0fe80565b0 con 0x7f0fc80049b0 2020-02-11T16:05:46.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.162+0000 7f0fed90f700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.162+0000 7f0fdaffd700 1 -- 172.21.15.88:0/374216884 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fe4031b60 con 0x7f0fc80049b0 2020-02-11T16:05:46.166 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2020-02-11T16:05:46.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.163+0000 7f0fefb73700 1 -- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0fc8042070 msgr2=0x7f0fc8044530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.163+0000 7f0fefb73700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0fc8042070 0x7f0fc8044530 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.163+0000 7f0fefb73700 1 -- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 msgr2=0x7f0fc8004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.163+0000 7f0fefb73700 1 --2- 172.21.15.88:0/374216884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80049b0 0x7f0fc8004d90 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f0fe4001190 tx=0x7f0fe4010d80).stop 2020-02-11T16:05:46.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.163+0000 7f0fee110700 1 -- 172.21.15.88:0/374216884 reap_dead start 2020-02-11T16:05:46.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.163+0000 7f0fee110700 1 -- 172.21.15.88:0/374216884 reap_dead start 2020-02-11T16:05:46.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.163+0000 7f0fefb73700 1 -- 172.21.15.88:0/374216884 shutdown_connections 2020-02-11T16:05:46.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.163+0000 7f0fefb73700 1 -- 172.21.15.88:0/374216884 >> 172.21.15.88:0/374216884 conn(0x7f0fe809d110 msgr2=0x7f0fe8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:46.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.164+0000 7f0fefb73700 1 -- 172.21.15.88:0/374216884 shutdown_connections 2020-02-11T16:05:46.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.164+0000 7f0fefb73700 1 -- 172.21.15.88:0/374216884 wait complete. 2020-02-11T16:05:46.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2020-02-11T16:05:46.177 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-02-11T16:05:46.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.281+0000 7f05be32e700 1 Processor -- start 2020-02-11T16:05:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.281+0000 7f05be32e700 1 -- start start 2020-02-11T16:05:46.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.281+0000 7f05be32e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f05b80a7120 0x7f05b80a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:46.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.281+0000 7f05be32e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05b80a3e70 0x7f05b812ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:46.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.281+0000 7f05be32e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b80a5320 con 0x7f05b80a39e0 2020-02-11T16:05:46.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.281+0000 7f05be32e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b8130400 con 0x7f05b80a7120 2020-02-11T16:05:46.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.281+0000 7f05be32e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b809e7a0 con 0x7f05b80a3e70 2020-02-11T16:05:46.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05b80a3e70 0x7f05b812ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05b77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f05b80a39e0 0x7f05b812f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39380/0 (socket says 172.21.15.88:39380) 2020-02-11T16:05:46.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05b77fe700 1 -- 172.21.15.88:0/392885677 learned_addr learned my addr 172.21.15.88:0/392885677 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:46.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 --2- 172.21.15.88:0/392885677 >> v2:172.21.15.88:3300/0 conn(0x7f05b80a3e70 0x7f05b812ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51754/0 (socket says 172.21.15.88:51754) 2020-02-11T16:05:46.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05b7fff700 1 --2- 172.21.15.88:0/392885677 >> v2:172.21.15.52:3300/0 conn(0x7f05b80a7120 0x7f05b80a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 -- 172.21.15.88:0/392885677 >> v2:172.21.15.52:3300/0 conn(0x7f05b80a7120 msgr2=0x7f05b80a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:46.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 --2- 172.21.15.88:0/392885677 >> v2:172.21.15.52:3300/0 conn(0x7f05b80a7120 0x7f05b80a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:46.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 -- 172.21.15.88:0/392885677 >> v1:172.21.15.88:6789/0 conn(0x7f05b80a39e0 legacy=0x7f05b812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05b6ffd700 1 -- 172.21.15.88:0/392885677 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160260926 0 0) 0x7f05ac0010d0 con 0x7f05b80a39e0 2020-02-11T16:05:46.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 -- 172.21.15.88:0/392885677 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80a5560 con 0x7f05b80a3e70 2020-02-11T16:05:46.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 --2- 172.21.15.88:0/392885677 >> v2:172.21.15.88:3300/0 conn(0x7f05b80a3e70 0x7f05b812ffa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f05b00032b0 tx=0x7f05b0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 --2- 172.21.15.88:0/392885677 >> v2:172.21.15.88:3300/0 conn(0x7f05b80a3e70 0x7f05b812ffa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f05b00032b0 tx=0x7f05b0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 --2- 172.21.15.88:0/392885677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812ffa0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f05b00032b0 tx=0x7f05b0007dc0).ready entity=mon.1 client_cookie=155153b84759f45a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 --2- 172.21.15.88:0/392885677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812ffa0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f05b00032b0 tx=0x7f05b0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05b6ffd700 1 -- 172.21.15.88:0/392885677 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b000a160 con 0x7f05b80a3e70 2020-02-11T16:05:46.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 --2- 172.21.15.88:0/392885677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812ffa0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f05b00032b0 tx=0x7f05b0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05bc8cb700 1 --2- 172.21.15.88:0/392885677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812ffa0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f05b00032b0 tx=0x7f05b0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05b6ffd700 1 -- 172.21.15.88:0/392885677 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b000a2c0 con 0x7f05b80a3e70 2020-02-11T16:05:46.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05b6ffd700 1 -- 172.21.15.88:0/392885677 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b000a660 con 0x7f05b80a3e70 2020-02-11T16:05:46.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05be32e700 1 -- 172.21.15.88:0/392885677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 msgr2=0x7f05b812ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.282+0000 7f05be32e700 1 --2- 172.21.15.88:0/392885677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812ffa0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f05b00032b0 tx=0x7f05b0007dc0).stop 2020-02-11T16:05:46.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.283+0000 7f05be32e700 1 -- 172.21.15.88:0/392885677 shutdown_connections 2020-02-11T16:05:46.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.283+0000 7f05be32e700 1 --2- 172.21.15.88:0/392885677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812ffa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.283+0000 7f05be32e700 1 --2- 172.21.15.88:0/392885677 >> v2:172.21.15.52:3300/0 conn(0x7f05b80a7120 0x7f05b80a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:46.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.283+0000 7f05be32e700 1 -- 172.21.15.88:0/392885677 >> 172.21.15.88:0/392885677 conn(0x7f05b809d110 msgr2=0x7f05b809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:46.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.283+0000 7f05be32e700 1 -- 172.21.15.88:0/392885677 shutdown_connections 2020-02-11T16:05:46.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.283+0000 7f05be32e700 1 -- 172.21.15.88:0/392885677 wait complete. 2020-02-11T16:05:46.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.283+0000 7f05be32e700 1 Processor -- start 2020-02-11T16:05:46.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.284+0000 7f05be32e700 1 -- start start 2020-02-11T16:05:46.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.284+0000 7f05be32e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05b80a3e70 0x7f05b812a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.284+0000 7f05be32e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05b80a7120 0x7f05b812a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.284+0000 7f05be32e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b8136d10 con 0x7f05b80a39e0 2020-02-11T16:05:46.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.284+0000 7f05be32e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b81352d0 con 0x7f05b80a3e70 2020-02-11T16:05:46.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.284+0000 7f05be32e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8135570 con 0x7f05b80a7120 2020-02-11T16:05:46.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.284+0000 7f05b77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05b80a3e70 0x7f05b812a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.284+0000 7f05b7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f05b80a39e0 0x7f05b8144490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39386/0 (socket says 172.21.15.88:39386) 2020-02-11T16:05:46.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.284+0000 7f05b7fff700 1 -- 172.21.15.88:0/4207338582 learned_addr learned my addr 172.21.15.88:0/4207338582 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:46.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05bc8cb700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05b80a7120 0x7f05b812a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 -- 172.21.15.88:0/4207338582 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05b80a7120 msgr2=0x7f05b812a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05b80a7120 0x7f05b812a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 -- 172.21.15.88:0/4207338582 >> v1:172.21.15.88:6789/0 conn(0x7f05b80a39e0 legacy=0x7f05b8144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b57fa700 1 -- 172.21.15.88:0/4207338582 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843933358 0 0) 0x7f05b8136d10 con 0x7f05b80a39e0 2020-02-11T16:05:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 -- 172.21.15.88:0/4207338582 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8135810 con 0x7f05b80a3e70 2020-02-11T16:05:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> v2:172.21.15.88:3300/0 conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> v2:172.21.15.88:3300/0 conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b57fa700 1 -- 172.21.15.88:0/4207338582 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05ac005ca0 con 0x7f05b80a3e70 2020-02-11T16:05:46.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b57fa700 1 -- 172.21.15.88:0/4207338582 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac005e00 con 0x7f05b80a3e70 2020-02-11T16:05:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05be32e700 1 -- 172.21.15.88:0/4207338582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b812ac10 con 0x7f05b80a3e70 2020-02-11T16:05:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b57fa700 1 -- 172.21.15.88:0/4207338582 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05ac0062b0 con 0x7f05b80a3e70 2020-02-11T16:05:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05be32e700 1 -- 172.21.15.88:0/4207338582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b81345b0 con 0x7f05b80a3e70 2020-02-11T16:05:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.285+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.286+0000 7f05b57fa700 1 -- 172.21.15.88:0/4207338582 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f05ac0064f0 con 0x7f05b80a3e70 2020-02-11T16:05:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.286+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.286+0000 7f05be32e700 1 -- 172.21.15.88:0/4207338582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b80565b0 con 0x7f05b80a3e70 2020-02-11T16:05:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.286+0000 7f05b57fa700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0598039a50 0x7f059803bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.286+0000 7f05b57fa700 1 -- 172.21.15.88:0/4207338582 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f05ac0497e0 con 0x7f05b80a3e70 2020-02-11T16:05:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.286+0000 7f05b7fff700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0598039a50 0x7f059803bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.286+0000 7f05b7fff700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0598039a50 0x7f059803bf10 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.290+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.290+0000 7f05b57fa700 1 -- 172.21.15.88:0/4207338582 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f05ac02ec20 con 0x7f05b80a3e70 2020-02-11T16:05:46.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.424+0000 7f05be32e700 1 -- 172.21.15.88:0/4207338582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f05b80a5320 con 0x7f05b80a3e70 2020-02-11T16:05:46.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.425+0000 7f05b77fe700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.425+0000 7f05b57fa700 1 -- 172.21.15.88:0/4207338582 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05b80a5320 con 0x7f05b80a3e70 2020-02-11T16:05:46.429 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2020-02-11T16:05:46.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 -- 172.21.15.88:0/4207338582 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0598039a50 msgr2=0x7f059803bf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0598039a50 0x7f059803bf10 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 -- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 msgr2=0x7f05b812a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812a350 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f05ac000b80 tx=0x7f05ac010970).stop 2020-02-11T16:05:46.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 -- 172.21.15.88:0/4207338582 shutdown_connections 2020-02-11T16:05:46.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0598039a50 0x7f059803bf10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05b80a7120 0x7f05b812a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 --2- 172.21.15.88:0/4207338582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05b80a3e70 0x7f05b812a350 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 -- 172.21.15.88:0/4207338582 >> 172.21.15.88:0/4207338582 conn(0x7f05b809d110 msgr2=0x7f05b812c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:46.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 -- 172.21.15.88:0/4207338582 shutdown_connections 2020-02-11T16:05:46.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.426+0000 7f05be32e700 1 -- 172.21.15.88:0/4207338582 wait complete. 2020-02-11T16:05:46.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2020-02-11T16:05:46.440 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-02-11T16:05:46.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.543+0000 7f31660a4700 1 Processor -- start 2020-02-11T16:05:46.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.543+0000 7f31660a4700 1 -- start start 2020-02-11T16:05:46.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f31660a4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31600a18a0 0x7f31600a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f31660a4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31600a5de0 0x7f31600a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f31660a4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31600a31b0 con 0x7f316012e3a0 2020-02-11T16:05:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f31660a4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31600a3570 con 0x7f31600a5de0 2020-02-11T16:05:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f31660a4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31600a3810 con 0x7f31600a18a0 2020-02-11T16:05:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f316012e3a0 0x7f316012e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39392/0 (socket says 172.21.15.88:39392) 2020-02-11T16:05:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315ffff700 1 -- 172.21.15.88:0/120144152 learned_addr learned my addr 172.21.15.88:0/120144152 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315effd700 1 --2- 172.21.15.88:0/120144152 >> v2:172.21.15.52:3300/0 conn(0x7f31600a5de0 0x7f31600a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315431209 0 0) 0x7f31600a31b0 con 0x7f316012e3a0 2020-02-11T16:05:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f314c003230 con 0x7f316012e3a0 2020-02-11T16:05:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315f7fe700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31600a18a0 0x7f31600a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 557123560 0 0) 0x7f314c003230 con 0x7f316012e3a0 2020-02-11T16:05:46.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31600a18a0 msgr2=0x7f31600a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:46.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31600a18a0 0x7f31600a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:46.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 >> v2:172.21.15.52:3300/0 conn(0x7f31600a5de0 msgr2=0x7f31600a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:46.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 --2- 172.21.15.88:0/120144152 >> v2:172.21.15.52:3300/0 conn(0x7f31600a5de0 0x7f31600a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:46.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600a3ab0 con 0x7f316012e3a0 2020-02-11T16:05:46.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f3158001a50 con 0x7f316012e3a0 2020-02-11T16:05:46.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 >> v1:172.21.15.88:6789/0 conn(0x7f316012e3a0 legacy=0x7f316012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c003720 0x7f314c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:46.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c004060 0x7f314c004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:46.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31600a18a0 0x7f314c004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:46.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600a3570 con 0x7f314c004060 2020-02-11T16:05:46.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600a3810 con 0x7f314c003720 2020-02-11T16:05:46.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.544+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c004ff0 con 0x7f31600a18a0 2020-02-11T16:05:46.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c003720 0x7f314c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315effd700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c004060 0x7f314c004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315ffff700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31600a18a0 0x7f314c004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 -- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31600a18a0 msgr2=0x7f314c004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:46.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31600a18a0 0x7f314c004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:46.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 -- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c004060 msgr2=0x7f314c004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:46.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c004060 0x7f314c004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:46.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 -- 172.21.15.88:0/120144152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c003230 con 0x7f314c003720 2020-02-11T16:05:46.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c003720 0x7f314c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c003720 0x7f314c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c003720 0x7f314c003b40 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).ready entity=mon.1 client_cookie=eb96edda555b548 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c003720 0x7f314c003b40 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c003720 0x7f314c003b40 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3150010d60 con 0x7f314c003720 2020-02-11T16:05:46.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315f7fe700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c003720 0x7f314c003b40 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3150008950 con 0x7f314c003720 2020-02-11T16:05:46.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315e7fc700 1 -- 172.21.15.88:0/120144152 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3150008d30 con 0x7f314c003720 2020-02-11T16:05:46.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f31660a4700 1 -- 172.21.15.88:0/120144152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c003720 msgr2=0x7f314c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f31660a4700 1 --2- 172.21.15.88:0/120144152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c003720 0x7f314c003b40 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).stop 2020-02-11T16:05:46.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f315ffff700 1 -- 172.21.15.88:0/120144152 reap_dead start 2020-02-11T16:05:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f31660a4700 1 -- 172.21.15.88:0/120144152 shutdown_connections 2020-02-11T16:05:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f31660a4700 1 -- 172.21.15.88:0/120144152 >> 172.21.15.88:0/120144152 conn(0x7f316009d110 msgr2=0x7f316009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f31660a4700 1 -- 172.21.15.88:0/120144152 shutdown_connections 2020-02-11T16:05:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.545+0000 7f31660a4700 1 -- 172.21.15.88:0/120144152 wait complete. 2020-02-11T16:05:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.546+0000 7f31660a4700 1 Processor -- start 2020-02-11T16:05:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.546+0000 7f31660a4700 1 -- start start 2020-02-11T16:05:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f31660a4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f31600aa480 0x7f3160061b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f31660a4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3160130a30 0x7f31601281f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f31660a4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31600aae40 con 0x7f3160128650 2020-02-11T16:05:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f31660a4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3160138c30 con 0x7f3160130a30 2020-02-11T16:05:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f31660a4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316012fce0 con 0x7f31600aa480 2020-02-11T16:05:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f31600aa480 0x7f3160061b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f31600aa480 0x7f3160061b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51778/0 (socket says 172.21.15.88:51778) 2020-02-11T16:05:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315f7fe700 1 -- 172.21.15.88:0/3048354135 learned_addr learned my addr 172.21.15.88:0/3048354135 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315effd700 1 --2- 172.21.15.88:0/3048354135 >> v2:172.21.15.52:3300/0 conn(0x7f3160130a30 0x7f31601281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315f7fe700 1 -- 172.21.15.88:0/3048354135 >> v2:172.21.15.52:3300/0 conn(0x7f3160130a30 msgr2=0x7f31601281f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> v2:172.21.15.52:3300/0 conn(0x7f3160130a30 0x7f31601281f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315f7fe700 1 -- 172.21.15.88:0/3048354135 >> v1:172.21.15.52:6789/0 conn(0x7f3160128650 legacy=0x7f316005a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315f7fe700 1 -- 172.21.15.88:0/3048354135 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316012ff80 con 0x7f31600aa480 2020-02-11T16:05:46.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> v2:172.21.15.88:3300/0 conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> v2:172.21.15.88:3300/0 conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.547+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.548+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.548+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.548+0000 7f315cff9700 1 -- 172.21.15.88:0/3048354135 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3150008e50 con 0x7f31600aa480 2020-02-11T16:05:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.548+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.548+0000 7f315cff9700 1 -- 172.21.15.88:0/3048354135 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31500058b0 con 0x7f31600aa480 2020-02-11T16:05:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.548+0000 7f31660a4700 1 -- 172.21.15.88:0/3048354135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3160130220 con 0x7f31600aa480 2020-02-11T16:05:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.548+0000 7f315cff9700 1 -- 172.21.15.88:0/3048354135 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3150005c10 con 0x7f31600aa480 2020-02-11T16:05:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.548+0000 7f31660a4700 1 -- 172.21.15.88:0/3048354135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31601306c0 con 0x7f31600aa480 2020-02-11T16:05:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.548+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.548+0000 7f315cff9700 1 -- 172.21.15.88:0/3048354135 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f3150005d70 con 0x7f31600aa480 2020-02-11T16:05:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.549+0000 7f31660a4700 1 -- 172.21.15.88:0/3048354135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31601303b0 con 0x7f31600aa480 2020-02-11T16:05:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.549+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.549+0000 7f315cff9700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3140039be0 0x7f314003c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.549+0000 7f315cff9700 1 -- 172.21.15.88:0/3048354135 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3150049a60 con 0x7f31600aa480 2020-02-11T16:05:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.549+0000 7f315effd700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3140039be0 0x7f314003c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.549+0000 7f315effd700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3140039be0 0x7f314003c0a0 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.552+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.552+0000 7f315cff9700 1 -- 172.21.15.88:0/3048354135 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f31500320a0 con 0x7f31600aa480 2020-02-11T16:05:46.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.687+0000 7f31660a4700 1 -- 172.21.15.88:0/3048354135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f31600565b0 con 0x7f31600aa480 2020-02-11T16:05:46.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.687+0000 7f315f7fe700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.687+0000 7f315cff9700 1 -- 172.21.15.88:0/3048354135 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f315004ae60 con 0x7f31600aa480 2020-02-11T16:05:46.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 -- 172.21.15.88:0/3048354135 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3140039be0 msgr2=0x7f314003c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3140039be0 0x7f314003c0a0 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 -- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 msgr2=0x7f3160061b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 0x7f3160061b00 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f3150002f30 tx=0x7f3150010050).stop 2020-02-11T16:05:46.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 -- 172.21.15.88:0/3048354135 shutdown_connections 2020-02-11T16:05:46.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31600aa480 0x7f3160061b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 --2- 172.21.15.88:0/3048354135 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3140039be0 0x7f314003c0a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 --2- 172.21.15.88:0/3048354135 >> v2:172.21.15.52:3300/0 conn(0x7f3160130a30 0x7f31601281f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 -- 172.21.15.88:0/3048354135 >> 172.21.15.88:0/3048354135 conn(0x7f316009d110 msgr2=0x7f31600a6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:46.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 -- 172.21.15.88:0/3048354135 shutdown_connections 2020-02-11T16:05:46.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.689+0000 7f31660a4700 1 -- 172.21.15.88:0/3048354135 wait complete. 2020-02-11T16:05:46.695 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2020-02-11T16:05:46.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2020-02-11T16:05:46.702 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-02-11T16:05:46.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.805+0000 7fad10266700 1 Processor -- start 2020-02-11T16:05:46.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.806+0000 7fad10266700 1 -- start start 2020-02-11T16:05:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.806+0000 7fad10266700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fad08131f50 0x7fad0805f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.806+0000 7fad10266700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0813b6f0 0x7fad08142630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:46.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.806+0000 7fad10266700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad08138360 con 0x7fad0813b290 2020-02-11T16:05:46.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.806+0000 7fad10266700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad08138180 con 0x7fad08131f50 2020-02-11T16:05:46.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.806+0000 7fad10266700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad08138600 con 0x7fad0813b6f0 2020-02-11T16:05:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fad08131f50 0x7fad0805f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e803700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0813b6f0 0x7fad08142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0d801700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fad0813b290 0x7fad0809d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59430/0 (socket says 172.21.15.88:59430) 2020-02-11T16:05:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0d801700 1 -- 172.21.15.88:0/3544556913 learned_addr learned my addr 172.21.15.88:0/3544556913 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 -- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0813b6f0 msgr2=0x7fad08142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 --2- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0813b6f0 0x7fad08142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 -- 172.21.15.88:0/3544556913 >> v1:172.21.15.52:6789/0 conn(0x7fad0813b290 legacy=0x7fad0809d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 -- 172.21.15.88:0/3544556913 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0809d8b0 con 0x7fad08131f50 2020-02-11T16:05:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e803700 1 --2- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0813b6f0 0x7fad08142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 --2- 172.21.15.88:0/3544556913 >> v2:172.21.15.52:3300/0 conn(0x7fad08131f50 0x7fad0805f900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad04002f30 tx=0x7fad040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 --2- 172.21.15.88:0/3544556913 >> v2:172.21.15.52:3300/0 conn(0x7fad08131f50 0x7fad0805f900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad04002f30 tx=0x7fad040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 --2- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08131f50 0x7fad0805f900 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fad04002f30 tx=0x7fad040088e0).ready entity=mon.0 client_cookie=4f5bdd57f2d35b70 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 --2- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08131f50 0x7fad0805f900 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fad04002f30 tx=0x7fad040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0d000700 1 -- 172.21.15.88:0/3544556913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad04008e40 con 0x7fad08131f50 2020-02-11T16:05:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 --2- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08131f50 0x7fad0805f900 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fad04002f30 tx=0x7fad040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0d000700 1 -- 172.21.15.88:0/3544556913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad040115f0 con 0x7fad08131f50 2020-02-11T16:05:46.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0e002700 1 --2- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08131f50 0x7fad0805f900 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fad04002f30 tx=0x7fad040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad10266700 1 -- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08131f50 msgr2=0x7fad0805f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad0d000700 1 -- 172.21.15.88:0/3544556913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad040119d0 con 0x7fad08131f50 2020-02-11T16:05:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.807+0000 7fad10266700 1 --2- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08131f50 0x7fad0805f900 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fad04002f30 tx=0x7fad040088e0).stop 2020-02-11T16:05:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.808+0000 7fad10266700 1 -- 172.21.15.88:0/3544556913 shutdown_connections 2020-02-11T16:05:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.808+0000 7fad10266700 1 --2- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0813b6f0 0x7fad08142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.808+0000 7fad10266700 1 --2- 172.21.15.88:0/3544556913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08131f50 0x7fad0805f900 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.808+0000 7fad10266700 1 -- 172.21.15.88:0/3544556913 >> 172.21.15.88:0/3544556913 conn(0x7fad080a7bb0 msgr2=0x7fad080a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.808+0000 7fad10266700 1 -- 172.21.15.88:0/3544556913 shutdown_connections 2020-02-11T16:05:46.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.808+0000 7fad10266700 1 -- 172.21.15.88:0/3544556913 wait complete. 2020-02-11T16:05:46.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.809+0000 7fad10266700 1 Processor -- start 2020-02-11T16:05:46.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.809+0000 7fad10266700 1 -- start start 2020-02-11T16:05:46.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad10266700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fad0813b290 0x7fad08136890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad10266700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad081344e0 0x7fad0812b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad10266700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad08136da0 con 0x7fad08131f50 2020-02-11T16:05:46.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad10266700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad08133db0 con 0x7fad0813b290 2020-02-11T16:05:46.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad10266700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad08135050 con 0x7fad081344e0 2020-02-11T16:05:46.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad081344e0 0x7fad0812b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad081344e0 0x7fad0812b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51796/0 (socket says 172.21.15.88:51796) 2020-02-11T16:05:46.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 -- 172.21.15.88:0/1519393762 learned_addr learned my addr 172.21.15.88:0/1519393762 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:46.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0d801700 1 --2- 172.21.15.88:0/1519393762 >> v2:172.21.15.52:3300/0 conn(0x7fad0813b290 0x7fad08136890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 -- 172.21.15.88:0/1519393762 >> v2:172.21.15.52:3300/0 conn(0x7fad0813b290 msgr2=0x7fad08136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> v2:172.21.15.52:3300/0 conn(0x7fad0813b290 0x7fad08136890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 -- 172.21.15.88:0/1519393762 >> v1:172.21.15.52:6789/0 conn(0x7fad08131f50 legacy=0x7fad08134940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 -- 172.21.15.88:0/1519393762 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad08134250 con 0x7fad081344e0 2020-02-11T16:05:46.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> v2:172.21.15.88:3300/0 conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> v2:172.21.15.88:3300/0 conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7facfaffd700 1 -- 172.21.15.88:0/1519393762 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad00005e30 con 0x7fad081344e0 2020-02-11T16:05:46.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7facfaffd700 1 -- 172.21.15.88:0/1519393762 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0000cbf0 con 0x7fad081344e0 2020-02-11T16:05:46.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.810+0000 7facfaffd700 1 -- 172.21.15.88:0/1519393762 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad0000ce20 con 0x7fad081344e0 2020-02-11T16:05:46.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.811+0000 7fad10266700 1 -- 172.21.15.88:0/1519393762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad08133aa0 con 0x7fad081344e0 2020-02-11T16:05:46.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.811+0000 7fad10266700 1 -- 172.21.15.88:0/1519393762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad08130f50 con 0x7fad081344e0 2020-02-11T16:05:46.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.811+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.811+0000 7facfaffd700 1 -- 172.21.15.88:0/1519393762 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fad00012980 con 0x7fad081344e0 2020-02-11T16:05:46.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.811+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.812+0000 7facfaffd700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7face8039bf0 0x7face803c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:46.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.812+0000 7facfaffd700 1 -- 172.21.15.88:0/1519393762 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fad00049bc0 con 0x7fad081344e0 2020-02-11T16:05:46.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.812+0000 7fad10266700 1 -- 172.21.15.88:0/1519393762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad080565b0 con 0x7fad081344e0 2020-02-11T16:05:46.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.812+0000 7fad0e002700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7face8039bf0 0x7face803c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:46.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.812+0000 7fad0e002700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7face8039bf0 0x7face803c0b0 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:46.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.815+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.815+0000 7facfaffd700 1 -- 172.21.15.88:0/1519393762 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fad0002f210 con 0x7fad081344e0 2020-02-11T16:05:46.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.950+0000 7fad10266700 1 -- 172.21.15.88:0/1519393762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad0805fd90 con 0x7fad081344e0 2020-02-11T16:05:46.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.950+0000 7fad0e803700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:46.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.950+0000 7facfaffd700 1 -- 172.21.15.88:0/1519393762 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad00031d00 con 0x7fad081344e0 2020-02-11T16:05:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2020-02-11T16:05:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 -- 172.21.15.88:0/1519393762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7face8039bf0 msgr2=0x7face803c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7face8039bf0 0x7face803c0b0 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 -- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 msgr2=0x7fad0812b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 0x7fad0812b470 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7fad000033f0 tx=0x7fad00011130).stop 2020-02-11T16:05:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 -- 172.21.15.88:0/1519393762 shutdown_connections 2020-02-11T16:05:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad081344e0 0x7fad0812b470 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 --2- 172.21.15.88:0/1519393762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7face8039bf0 0x7face803c0b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 --2- 172.21.15.88:0/1519393762 >> v2:172.21.15.52:3300/0 conn(0x7fad0813b290 0x7fad08136890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 -- 172.21.15.88:0/1519393762 >> 172.21.15.88:0/1519393762 conn(0x7fad080a7bb0 msgr2=0x7fad0809d180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 -- 172.21.15.88:0/1519393762 shutdown_connections 2020-02-11T16:05:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:46.951+0000 7fad10266700 1 -- 172.21.15.88:0/1519393762 wait complete. 2020-02-11T16:05:46.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2020-02-11T16:05:46.965 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-02-11T16:05:47.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.068+0000 7f98499e6700 1 Processor -- start 2020-02-11T16:05:47.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.068+0000 7f98499e6700 1 -- start start 2020-02-11T16:05:47.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f98499e6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98440a7120 0x7f98440a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f98499e6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98440a39e0 0x7f98440a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f98499e6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98440a5320 con 0x7f984412f890 2020-02-11T16:05:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f98499e6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984409e7a0 con 0x7f98440a7120 2020-02-11T16:05:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f98499e6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98441303c0 con 0x7f98440a39e0 2020-02-11T16:05:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98440a7120 0x7f98440a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98440a7120 0x7f98440a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51800/0 (socket says 172.21.15.88:51800) 2020-02-11T16:05:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 -- 172.21.15.88:0/164464174 learned_addr learned my addr 172.21.15.88:0/164464174 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f98427fc700 1 --2- 172.21.15.88:0/164464174 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98440a39e0 0x7f98440a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 -- 172.21.15.88:0/164464174 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98440a39e0 msgr2=0x7f98440a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:47.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 --2- 172.21.15.88:0/164464174 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98440a39e0 0x7f98440a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:47.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 -- 172.21.15.88:0/164464174 >> v1:172.21.15.52:6789/0 conn(0x7f984412f890 legacy=0x7f984412fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:47.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 -- 172.21.15.88:0/164464174 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98440a5560 con 0x7f98440a7120 2020-02-11T16:05:47.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f98427fc700 1 --2- 172.21.15.88:0/164464174 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98440a39e0 0x7f98440a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:47.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 --2- 172.21.15.88:0/164464174 >> v2:172.21.15.88:3300/0 conn(0x7f98440a7120 0x7f98440a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f984405ef00 tx=0x7f983c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 --2- 172.21.15.88:0/164464174 >> v2:172.21.15.88:3300/0 conn(0x7f98440a7120 0x7f98440a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f984405ef00 tx=0x7f983c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 --2- 172.21.15.88:0/164464174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98440a4ec0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f984405ef00 tx=0x7f983c008c60).ready entity=mon.1 client_cookie=894d6f52505cc46 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 --2- 172.21.15.88:0/164464174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98440a4ec0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f984405ef00 tx=0x7f983c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9841ffb700 1 -- 172.21.15.88:0/164464174 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f983c00a160 con 0x7f98440a7120 2020-02-11T16:05:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 --2- 172.21.15.88:0/164464174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98440a4ec0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f984405ef00 tx=0x7f983c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9842ffd700 1 --2- 172.21.15.88:0/164464174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98440a4ec0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f984405ef00 tx=0x7f983c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9841ffb700 1 -- 172.21.15.88:0/164464174 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c00a2c0 con 0x7f98440a7120 2020-02-11T16:05:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f9841ffb700 1 -- 172.21.15.88:0/164464174 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f983c00a660 con 0x7f98440a7120 2020-02-11T16:05:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f98499e6700 1 -- 172.21.15.88:0/164464174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 msgr2=0x7f98440a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.069+0000 7f98499e6700 1 --2- 172.21.15.88:0/164464174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98440a4ec0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f984405ef00 tx=0x7f983c008c60).stop 2020-02-11T16:05:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.070+0000 7f98499e6700 1 -- 172.21.15.88:0/164464174 shutdown_connections 2020-02-11T16:05:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.070+0000 7f98499e6700 1 --2- 172.21.15.88:0/164464174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98440a4ec0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.070+0000 7f98499e6700 1 --2- 172.21.15.88:0/164464174 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98440a39e0 0x7f98440a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.070+0000 7f98499e6700 1 -- 172.21.15.88:0/164464174 >> 172.21.15.88:0/164464174 conn(0x7f984409d110 msgr2=0x7f984409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.070+0000 7f98499e6700 1 -- 172.21.15.88:0/164464174 shutdown_connections 2020-02-11T16:05:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.070+0000 7f98499e6700 1 -- 172.21.15.88:0/164464174 wait complete. 2020-02-11T16:05:47.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f98499e6700 1 Processor -- start 2020-02-11T16:05:47.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f98499e6700 1 -- start start 2020-02-11T16:05:47.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f98499e6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f98440a39e0 0x7f9844129ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f98499e6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98440a7120 0x7f98441322f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f98499e6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98441306e0 con 0x7f984412f890 2020-02-11T16:05:47.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f98499e6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98441313e0 con 0x7f98440a39e0 2020-02-11T16:05:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f98499e6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9844130940 con 0x7f98440a7120 2020-02-11T16:05:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f98427fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98440a7120 0x7f98441322f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f98427fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98440a7120 0x7f98441322f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51804/0 (socket says 172.21.15.88:51804) 2020-02-11T16:05:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f98427fc700 1 -- 172.21.15.88:0/3670651328 learned_addr learned my addr 172.21.15.88:0/3670651328 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.071+0000 7f9842ffd700 1 --2- 172.21.15.88:0/3670651328 >> v2:172.21.15.52:3300/0 conn(0x7f98440a39e0 0x7f9844129ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 -- 172.21.15.88:0/3670651328 >> v2:172.21.15.52:3300/0 conn(0x7f98440a39e0 msgr2=0x7f9844129ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> v2:172.21.15.52:3300/0 conn(0x7f98440a39e0 0x7f9844129ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 -- 172.21.15.88:0/3670651328 >> v1:172.21.15.52:6789/0 conn(0x7f984412f890 legacy=0x7f9844127610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 -- 172.21.15.88:0/3670651328 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984412a320 con 0x7f98440a7120 2020-02-11T16:05:47.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f9842ffd700 1 --2- 172.21.15.88:0/3670651328 >> v2:172.21.15.52:3300/0 conn(0x7f98440a39e0 0x7f9844129ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:47.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> v2:172.21.15.88:3300/0 conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> v2:172.21.15.88:3300/0 conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f983bfff700 1 -- 172.21.15.88:0/3670651328 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f982c007160 con 0x7f98440a7120 2020-02-11T16:05:47.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f983bfff700 1 -- 172.21.15.88:0/3670651328 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c0072c0 con 0x7f98440a7120 2020-02-11T16:05:47.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98499e6700 1 -- 172.21.15.88:0/3670651328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9844129370 con 0x7f98440a7120 2020-02-11T16:05:47.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f983bfff700 1 -- 172.21.15.88:0/3670651328 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f982c0059c0 con 0x7f98440a7120 2020-02-11T16:05:47.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98499e6700 1 -- 172.21.15.88:0/3670651328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9844132910 con 0x7f98440a7120 2020-02-11T16:05:47.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.072+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.073+0000 7f983bfff700 1 -- 172.21.15.88:0/3670651328 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f982c005c30 con 0x7f98440a7120 2020-02-11T16:05:47.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.073+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.073+0000 7f983bfff700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9828039bf0 0x7f982803c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.073+0000 7f98499e6700 1 -- 172.21.15.88:0/3670651328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98440565b0 con 0x7f98440a7120 2020-02-11T16:05:47.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.073+0000 7f983bfff700 1 -- 172.21.15.88:0/3670651328 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f982c049a10 con 0x7f98440a7120 2020-02-11T16:05:47.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.073+0000 7f9842ffd700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9828039bf0 0x7f982803c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.073+0000 7f9842ffd700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9828039bf0 0x7f982803c0b0 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.076+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.076+0000 7f983bfff700 1 -- 172.21.15.88:0/3670651328 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f982c032050 con 0x7f98440a7120 2020-02-11T16:05:47.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.212+0000 7f98499e6700 1 -- 172.21.15.88:0/3670651328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9844130c10 con 0x7f98440a7120 2020-02-11T16:05:47.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.212+0000 7f98427fc700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.212+0000 7f983bfff700 1 -- 172.21.15.88:0/3670651328 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f982c031c10 con 0x7f98440a7120 2020-02-11T16:05:47.216 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2020-02-11T16:05:47.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 -- 172.21.15.88:0/3670651328 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9828039bf0 msgr2=0x7f982803c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9828039bf0 0x7f982803c0b0 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 -- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 msgr2=0x7f98441322f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98441322f0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f982c002f30 tx=0x7f982c010b70).stop 2020-02-11T16:05:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 -- 172.21.15.88:0/3670651328 shutdown_connections 2020-02-11T16:05:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9828039bf0 0x7f982803c0b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 --2- 172.21.15.88:0/3670651328 >> v2:172.21.15.52:3300/0 conn(0x7f98440a39e0 0x7f9844129ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 --2- 172.21.15.88:0/3670651328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98440a7120 0x7f98441322f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 -- 172.21.15.88:0/3670651328 >> 172.21.15.88:0/3670651328 conn(0x7f984409d110 msgr2=0x7f9844069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 -- 172.21.15.88:0/3670651328 shutdown_connections 2020-02-11T16:05:47.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.214+0000 7f98499e6700 1 -- 172.21.15.88:0/3670651328 wait complete. 2020-02-11T16:05:47.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2020-02-11T16:05:47.227 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-02-11T16:05:47.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.330+0000 7f47f2267700 1 Processor -- start 2020-02-11T16:05:47.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.330+0000 7f47f2267700 1 -- start start 2020-02-11T16:05:47.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.330+0000 7f47f2267700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:47.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.330+0000 7f47f2267700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47ec0a6260 0x7f47ec12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:47.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.330+0000 7f47f2267700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec0a3570 con 0x7f47ec0a5de0 2020-02-11T16:05:47.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.330+0000 7f47f2267700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec0a3810 con 0x7f47ec0a18a0 2020-02-11T16:05:47.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.330+0000 7f47f2267700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0a3ab0 con 0x7f47ec0a6260 2020-02-11T16:05:47.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51810/0 (socket says 172.21.15.88:51810) 2020-02-11T16:05:47.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 -- 172.21.15.88:0/1019384882 learned_addr learned my addr 172.21.15.88:0/1019384882 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:47.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47f0804700 1 --2- 172.21.15.88:0/1019384882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47ec0a6260 0x7f47ec12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 -- 172.21.15.88:0/1019384882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47ec0a6260 msgr2=0x7f47ec12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:47.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 --2- 172.21.15.88:0/1019384882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47ec0a6260 0x7f47ec12eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:47.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 -- 172.21.15.88:0/1019384882 >> v1:172.21.15.52:6789/0 conn(0x7f47ec0a5de0 legacy=0x7f47ec12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 -- 172.21.15.88:0/1019384882 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec0a3d50 con 0x7f47ec0a18a0 2020-02-11T16:05:47.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47f0804700 1 --2- 172.21.15.88:0/1019384882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47ec0a6260 0x7f47ec12eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:47.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 --2- 172.21.15.88:0/1019384882 >> v2:172.21.15.88:3300/0 conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47dc002f30 tx=0x7f47dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 --2- 172.21.15.88:0/1019384882 >> v2:172.21.15.88:3300/0 conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47dc002f30 tx=0x7f47dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 --2- 172.21.15.88:0/1019384882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f47dc002f30 tx=0x7f47dc0088e0).ready entity=mon.1 client_cookie=1c089eeb03d08f56 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 --2- 172.21.15.88:0/1019384882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f47dc002f30 tx=0x7f47dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47eaffd700 1 -- 172.21.15.88:0/1019384882 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47dc011760 con 0x7f47ec0a18a0 2020-02-11T16:05:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 --2- 172.21.15.88:0/1019384882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f47dc002f30 tx=0x7f47dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47ebfff700 1 --2- 172.21.15.88:0/1019384882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f47dc002f30 tx=0x7f47dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47eaffd700 1 -- 172.21.15.88:0/1019384882 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc0118c0 con 0x7f47ec0a18a0 2020-02-11T16:05:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47eaffd700 1 -- 172.21.15.88:0/1019384882 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47dc011ca0 con 0x7f47ec0a18a0 2020-02-11T16:05:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47f2267700 1 -- 172.21.15.88:0/1019384882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a18a0 msgr2=0x7f47ec0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.331+0000 7f47f2267700 1 --2- 172.21.15.88:0/1019384882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f47dc002f30 tx=0x7f47dc0088e0).stop 2020-02-11T16:05:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.332+0000 7f47f2267700 1 -- 172.21.15.88:0/1019384882 shutdown_connections 2020-02-11T16:05:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.332+0000 7f47f2267700 1 --2- 172.21.15.88:0/1019384882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47ec0a6260 0x7f47ec12eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.332+0000 7f47f2267700 1 --2- 172.21.15.88:0/1019384882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a18a0 0x7f47ec0a6dd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.332+0000 7f47f2267700 1 -- 172.21.15.88:0/1019384882 >> 172.21.15.88:0/1019384882 conn(0x7f47ec09d110 msgr2=0x7f47ec09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.332+0000 7f47f2267700 1 -- 172.21.15.88:0/1019384882 shutdown_connections 2020-02-11T16:05:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.332+0000 7f47f2267700 1 -- 172.21.15.88:0/1019384882 wait complete. 2020-02-11T16:05:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47f2267700 1 Processor -- start 2020-02-11T16:05:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47f2267700 1 -- start start 2020-02-11T16:05:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47f2267700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47ec0a18a0 0x7f47ec146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47f2267700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47ec0a6260 0x7f47ec146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47f2267700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec1315f0 con 0x7f47ec0a5de0 2020-02-11T16:05:47.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47f2267700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec131890 con 0x7f47ec0a18a0 2020-02-11T16:05:47.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47f2267700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec146470 con 0x7f47ec0a6260 2020-02-11T16:05:47.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47f0804700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47ec0a6260 0x7f47ec146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47f0804700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47ec0a6260 0x7f47ec146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51818/0 (socket says 172.21.15.88:51818) 2020-02-11T16:05:47.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47f0804700 1 -- 172.21.15.88:0/4112686037 learned_addr learned my addr 172.21.15.88:0/4112686037 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:47.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47eb7fe700 1 --1- 172.21.15.88:0/4112686037 >> v1:172.21.15.88:6789/0 conn(0x7f47ec0a5de0 0x7f47ec05a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39440/0 (socket says 172.21.15.88:39440) 2020-02-11T16:05:47.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.333+0000 7f47ebfff700 1 --2- 172.21.15.88:0/4112686037 >> v2:172.21.15.52:3300/0 conn(0x7f47ec0a18a0 0x7f47ec146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 -- 172.21.15.88:0/4112686037 >> v2:172.21.15.52:3300/0 conn(0x7f47ec0a18a0 msgr2=0x7f47ec146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> v2:172.21.15.52:3300/0 conn(0x7f47ec0a18a0 0x7f47ec146910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 -- 172.21.15.88:0/4112686037 >> v1:172.21.15.88:6789/0 conn(0x7f47ec0a5de0 legacy=0x7f47ec05a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47e97fa700 1 -- 172.21.15.88:0/4112686037 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754376892 0 0) 0x7f47ec1315f0 con 0x7f47ec0a5de0 2020-02-11T16:05:47.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 -- 172.21.15.88:0/4112686037 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec12b380 con 0x7f47ec0a6260 2020-02-11T16:05:47.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> v2:172.21.15.88:3300/0 conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> v2:172.21.15.88:3300/0 conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47e97fa700 1 -- 172.21.15.88:0/4112686037 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e4007350 con 0x7f47ec0a6260 2020-02-11T16:05:47.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47e97fa700 1 -- 172.21.15.88:0/4112686037 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e40074b0 con 0x7f47ec0a6260 2020-02-11T16:05:47.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f2267700 1 -- 172.21.15.88:0/4112686037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec0a0f50 con 0x7f47ec0a6260 2020-02-11T16:05:47.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47e97fa700 1 -- 172.21.15.88:0/4112686037 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e4007850 con 0x7f47ec0a6260 2020-02-11T16:05:47.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f2267700 1 -- 172.21.15.88:0/4112686037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec1471d0 con 0x7f47ec0a6260 2020-02-11T16:05:47.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.334+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.335+0000 7f47e97fa700 1 -- 172.21.15.88:0/4112686037 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f47e4012400 con 0x7f47ec0a6260 2020-02-11T16:05:47.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.335+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.335+0000 7f47e97fa700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47cc039b70 0x7f47cc03c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.335+0000 7f47e97fa700 1 -- 172.21.15.88:0/4112686037 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f47e4049ba0 con 0x7f47ec0a6260 2020-02-11T16:05:47.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.335+0000 7f47f2267700 1 -- 172.21.15.88:0/4112686037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec146640 con 0x7f47ec0a6260 2020-02-11T16:05:47.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.335+0000 7f47ebfff700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47cc039b70 0x7f47cc03c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.335+0000 7f47ebfff700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47cc039b70 0x7f47cc03c030 crc :-1 s=READY pgs=73 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.338+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.339+0000 7f47e97fa700 1 -- 172.21.15.88:0/4112686037 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f47e402f1b0 con 0x7f47ec0a6260 2020-02-11T16:05:47.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.474+0000 7f47f2267700 1 -- 172.21.15.88:0/4112686037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f47ec0565b0 con 0x7f47ec0a6260 2020-02-11T16:05:47.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.474+0000 7f47f0804700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.474+0000 7f47e97fa700 1 -- 172.21.15.88:0/4112686037 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47e4031cc0 con 0x7f47ec0a6260 2020-02-11T16:05:47.478 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2020-02-11T16:05:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 -- 172.21.15.88:0/4112686037 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47cc039b70 msgr2=0x7f47cc03c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47cc039b70 0x7f47cc03c030 crc :-1 s=READY pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 -- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 msgr2=0x7f47ec146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 0x7f47ec146d70 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f47ec12b020 tx=0x7f47e4010e20).stop 2020-02-11T16:05:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 -- 172.21.15.88:0/4112686037 shutdown_connections 2020-02-11T16:05:47.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47ec0a6260 0x7f47ec146d70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 --2- 172.21.15.88:0/4112686037 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47cc039b70 0x7f47cc03c030 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 --2- 172.21.15.88:0/4112686037 >> v2:172.21.15.52:3300/0 conn(0x7f47ec0a18a0 0x7f47ec146910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 -- 172.21.15.88:0/4112686037 >> 172.21.15.88:0/4112686037 conn(0x7f47ec09d110 msgr2=0x7f47ec0a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:47.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 -- 172.21.15.88:0/4112686037 shutdown_connections 2020-02-11T16:05:47.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.476+0000 7f47f2267700 1 -- 172.21.15.88:0/4112686037 wait complete. 2020-02-11T16:05:47.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2020-02-11T16:05:47.489 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-02-11T16:05:47.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.592+0000 7f9632d79700 1 Processor -- start 2020-02-11T16:05:47.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.592+0000 7f9632d79700 1 -- start start 2020-02-11T16:05:47.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f9632d79700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f962c0a18a0 0x7f962c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:47.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f9632d79700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f962c0a5de0 0x7f962c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:47.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f9632d79700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f962c12e3a0 0x7f962c12e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:47.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f9632d79700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c0a3570 con 0x7f962c0a18a0 2020-02-11T16:05:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f9632d79700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c0a3810 con 0x7f962c0a5de0 2020-02-11T16:05:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f9632d79700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0a3ab0 con 0x7f962c12e3a0 2020-02-11T16:05:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f962c0a5de0 0x7f962c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f962c0a5de0 0x7f962c0a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51822/0 (socket says 172.21.15.88:51822) 2020-02-11T16:05:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 -- 172.21.15.88:0/300262463 learned_addr learned my addr 172.21.15.88:0/300262463 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f9630b15700 1 --2- 172.21.15.88:0/300262463 >> v2:172.21.15.52:3300/0 conn(0x7f962c0a18a0 0x7f962c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f9631316700 1 --2- 172.21.15.88:0/300262463 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f962c12e3a0 0x7f962c12e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 -- 172.21.15.88:0/300262463 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f962c12e3a0 msgr2=0x7f962c12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 --2- 172.21.15.88:0/300262463 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f962c12e3a0 0x7f962c12e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 -- 172.21.15.88:0/300262463 >> v2:172.21.15.52:3300/0 conn(0x7f962c0a18a0 msgr2=0x7f962c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 --2- 172.21.15.88:0/300262463 >> v2:172.21.15.52:3300/0 conn(0x7f962c0a18a0 0x7f962c0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 -- 172.21.15.88:0/300262463 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0a3d50 con 0x7f962c0a5de0 2020-02-11T16:05:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f9630b15700 1 --2- 172.21.15.88:0/300262463 >> v2:172.21.15.52:3300/0 conn(0x7f962c0a18a0 0x7f962c0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f9631316700 1 --2- 172.21.15.88:0/300262463 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f962c12e3a0 0x7f962c12e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:47.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 --2- 172.21.15.88:0/300262463 >> v2:172.21.15.88:3300/0 conn(0x7f962c0a5de0 0x7f962c0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9620002f30 tx=0x7f9620007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 --2- 172.21.15.88:0/300262463 >> v2:172.21.15.88:3300/0 conn(0x7f962c0a5de0 0x7f962c0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9620002f30 tx=0x7f9620007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 --2- 172.21.15.88:0/300262463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a5de0 0x7f962c0a6260 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f9620002f30 tx=0x7f9620007a40).ready entity=mon.1 client_cookie=378751aecbeae5d8 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.593+0000 7f962bfff700 1 --2- 172.21.15.88:0/300262463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a5de0 0x7f962c0a6260 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f9620002f30 tx=0x7f9620007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f962bfff700 1 --2- 172.21.15.88:0/300262463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a5de0 0x7f962c0a6260 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f9620002f30 tx=0x7f9620007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f962b7fe700 1 -- 172.21.15.88:0/300262463 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9620011720 con 0x7f962c0a5de0 2020-02-11T16:05:47.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f962bfff700 1 --2- 172.21.15.88:0/300262463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a5de0 0x7f962c0a6260 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f9620002f30 tx=0x7f9620007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f962b7fe700 1 -- 172.21.15.88:0/300262463 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9620011880 con 0x7f962c0a5de0 2020-02-11T16:05:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f962b7fe700 1 -- 172.21.15.88:0/300262463 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9620011c20 con 0x7f962c0a5de0 2020-02-11T16:05:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f9632d79700 1 -- 172.21.15.88:0/300262463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a5de0 msgr2=0x7f962c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f9632d79700 1 --2- 172.21.15.88:0/300262463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a5de0 0x7f962c0a6260 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f9620002f30 tx=0x7f9620007a40).stop 2020-02-11T16:05:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f9632d79700 1 -- 172.21.15.88:0/300262463 shutdown_connections 2020-02-11T16:05:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f9632d79700 1 --2- 172.21.15.88:0/300262463 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f962c12e3a0 0x7f962c12e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f9632d79700 1 --2- 172.21.15.88:0/300262463 >> v2:172.21.15.52:3300/0 conn(0x7f962c0a18a0 0x7f962c0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f9632d79700 1 --2- 172.21.15.88:0/300262463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a5de0 0x7f962c0a6260 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f9632d79700 1 -- 172.21.15.88:0/300262463 >> 172.21.15.88:0/300262463 conn(0x7f962c09d110 msgr2=0x7f962c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f9632d79700 1 -- 172.21.15.88:0/300262463 shutdown_connections 2020-02-11T16:05:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.594+0000 7f9632d79700 1 -- 172.21.15.88:0/300262463 wait complete. 2020-02-11T16:05:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.595+0000 7f9632d79700 1 Processor -- start 2020-02-11T16:05:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.595+0000 7f9632d79700 1 -- start start 2020-02-11T16:05:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9632d79700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f962c0a18a0 0x7f962c1455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9632d79700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f962c0a5de0 0x7f962c145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9632d79700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962c133850 con 0x7f962c12e3a0 2020-02-11T16:05:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9632d79700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c1335b0 con 0x7f962c0a5de0 2020-02-11T16:05:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9632d79700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c133b20 con 0x7f962c0a18a0 2020-02-11T16:05:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f962c0a18a0 0x7f962c1455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f962c0a18a0 0x7f962c1455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51826/0 (socket says 172.21.15.88:51826) 2020-02-11T16:05:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 -- 172.21.15.88:0/3359861249 learned_addr learned my addr 172.21.15.88:0/3359861249 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f962bfff700 1 --2- 172.21.15.88:0/3359861249 >> v2:172.21.15.52:3300/0 conn(0x7f962c0a5de0 0x7f962c145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 -- 172.21.15.88:0/3359861249 >> v2:172.21.15.52:3300/0 conn(0x7f962c0a5de0 msgr2=0x7f962c145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> v2:172.21.15.52:3300/0 conn(0x7f962c0a5de0 0x7f962c145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 -- 172.21.15.88:0/3359861249 >> v1:172.21.15.52:6789/0 conn(0x7f962c12e3a0 legacy=0x7f962c0a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 -- 172.21.15.88:0/3359861249 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c133dc0 con 0x7f962c0a18a0 2020-02-11T16:05:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> v2:172.21.15.88:3300/0 conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> v2:172.21.15.88:3300/0 conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9629ffb700 1 -- 172.21.15.88:0/3359861249 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f961c008e80 con 0x7f962c0a18a0 2020-02-11T16:05:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9629ffb700 1 -- 172.21.15.88:0/3359861249 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c007160 con 0x7f962c0a18a0 2020-02-11T16:05:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9632d79700 1 -- 172.21.15.88:0/3359861249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c134260 con 0x7f962c0a18a0 2020-02-11T16:05:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9629ffb700 1 -- 172.21.15.88:0/3359861249 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f961c007540 con 0x7f962c0a18a0 2020-02-11T16:05:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.596+0000 7f9632d79700 1 -- 172.21.15.88:0/3359861249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c132140 con 0x7f962c0a18a0 2020-02-11T16:05:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.597+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.597+0000 7f9629ffb700 1 -- 172.21.15.88:0/3359861249 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f961c005a10 con 0x7f962c0a18a0 2020-02-11T16:05:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.597+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.597+0000 7f9632d79700 1 -- 172.21.15.88:0/3359861249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c135870 con 0x7f962c0a18a0 2020-02-11T16:05:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.597+0000 7f9629ffb700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f960c039c20 0x7f960c03c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.597+0000 7f9629ffb700 1 -- 172.21.15.88:0/3359861249 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f961c0498e0 con 0x7f962c0a18a0 2020-02-11T16:05:47.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.598+0000 7f962bfff700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f960c039c20 0x7f960c03c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.598+0000 7f962bfff700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f960c039c20 0x7f960c03c0e0 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.601+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.601+0000 7f9629ffb700 1 -- 172.21.15.88:0/3359861249 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f961c02ef70 con 0x7f962c0a18a0 2020-02-11T16:05:47.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.735+0000 7f9632d79700 1 -- 172.21.15.88:0/3359861249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f962c0565b0 con 0x7f962c0a18a0 2020-02-11T16:05:47.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.735+0000 7f9630b15700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.735+0000 7f9629ffb700 1 -- 172.21.15.88:0/3359861249 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f961c031a80 con 0x7f962c0a18a0 2020-02-11T16:05:47.739 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2020-02-11T16:05:47.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 -- 172.21.15.88:0/3359861249 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f960c039c20 msgr2=0x7f960c03c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f960c039c20 0x7f960c03c0e0 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 -- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 msgr2=0x7f962c1455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 0x7f962c1455f0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f961c002f30 tx=0x7f961c010ac0).stop 2020-02-11T16:05:47.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 -- 172.21.15.88:0/3359861249 shutdown_connections 2020-02-11T16:05:47.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c0a18a0 0x7f962c1455f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 --2- 172.21.15.88:0/3359861249 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f960c039c20 0x7f960c03c0e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 --2- 172.21.15.88:0/3359861249 >> v2:172.21.15.52:3300/0 conn(0x7f962c0a5de0 0x7f962c145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 -- 172.21.15.88:0/3359861249 >> 172.21.15.88:0/3359861249 conn(0x7f962c09d110 msgr2=0x7f962c0a6240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:47.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 -- 172.21.15.88:0/3359861249 shutdown_connections 2020-02-11T16:05:47.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.737+0000 7f9632d79700 1 -- 172.21.15.88:0/3359861249 wait complete. 2020-02-11T16:05:47.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2020-02-11T16:05:47.750 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-02-11T16:05:47.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.854+0000 7f3378196700 1 Processor -- start 2020-02-11T16:05:47.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.854+0000 7f3378196700 1 -- start start 2020-02-11T16:05:47.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3378196700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33700a18a0 0x7f33700a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:47.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3378196700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33700a5de0 0x7f33700a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:47.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3378196700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33700a31b0 con 0x7f337012e3a0 2020-02-11T16:05:47.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3378196700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33700a3570 con 0x7f33700a18a0 2020-02-11T16:05:47.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3378196700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33700a3810 con 0x7f33700a5de0 2020-02-11T16:05:47.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33700a18a0 0x7f33700a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3376733700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f337012e3a0 0x7f337012e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39464/0 (socket says 172.21.15.88:39464) 2020-02-11T16:05:47.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3376733700 1 -- 172.21.15.88:0/1685253331 learned_addr learned my addr 172.21.15.88:0/1685253331 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:47.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375731700 1 --2- 172.21.15.88:0/1685253331 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33700a5de0 0x7f33700a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 -- 172.21.15.88:0/1685253331 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33700a5de0 msgr2=0x7f33700a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:47.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 --2- 172.21.15.88:0/1685253331 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33700a5de0 0x7f33700a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:47.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 -- 172.21.15.88:0/1685253331 >> v1:172.21.15.88:6789/0 conn(0x7f337012e3a0 legacy=0x7f337012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 -- 172.21.15.88:0/1685253331 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33700a3ab0 con 0x7f33700a18a0 2020-02-11T16:05:47.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3374f30700 1 -- 172.21.15.88:0/1685253331 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195482939 0 0) 0x7f33700a31b0 con 0x7f337012e3a0 2020-02-11T16:05:47.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 --2- 172.21.15.88:0/1685253331 >> v2:172.21.15.88:3300/0 conn(0x7f33700a18a0 0x7f33700a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f33680032b0 tx=0x7f3368008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 --2- 172.21.15.88:0/1685253331 >> v2:172.21.15.88:3300/0 conn(0x7f33700a18a0 0x7f33700a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f33680032b0 tx=0x7f3368008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 --2- 172.21.15.88:0/1685253331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33700a18a0 0x7f33700a6dd0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f33680032b0 tx=0x7f3368008c60).ready entity=mon.1 client_cookie=9bcee944eb30284f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 --2- 172.21.15.88:0/1685253331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33700a18a0 0x7f33700a6dd0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f33680032b0 tx=0x7f3368008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3374f30700 1 -- 172.21.15.88:0/1685253331 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f336800a160 con 0x7f33700a18a0 2020-02-11T16:05:47.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 --2- 172.21.15.88:0/1685253331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33700a18a0 0x7f33700a6dd0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f33680032b0 tx=0x7f3368008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3375f32700 1 --2- 172.21.15.88:0/1685253331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33700a18a0 0x7f33700a6dd0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f33680032b0 tx=0x7f3368008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3374f30700 1 -- 172.21.15.88:0/1685253331 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336800a2c0 con 0x7f33700a18a0 2020-02-11T16:05:47.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3374f30700 1 -- 172.21.15.88:0/1685253331 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f336800a660 con 0x7f33700a18a0 2020-02-11T16:05:47.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3378196700 1 -- 172.21.15.88:0/1685253331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33700a18a0 msgr2=0x7f33700a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.855+0000 7f3378196700 1 --2- 172.21.15.88:0/1685253331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33700a18a0 0x7f33700a6dd0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f33680032b0 tx=0x7f3368008c60).stop 2020-02-11T16:05:47.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.856+0000 7f3378196700 1 -- 172.21.15.88:0/1685253331 shutdown_connections 2020-02-11T16:05:47.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.856+0000 7f3378196700 1 --2- 172.21.15.88:0/1685253331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33700a18a0 0x7f33700a6dd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.856+0000 7f3378196700 1 --2- 172.21.15.88:0/1685253331 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33700a5de0 0x7f33700a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:47.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.856+0000 7f3378196700 1 -- 172.21.15.88:0/1685253331 >> 172.21.15.88:0/1685253331 conn(0x7f337009d110 msgr2=0x7f337009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:47.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.856+0000 7f3378196700 1 -- 172.21.15.88:0/1685253331 shutdown_connections 2020-02-11T16:05:47.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.856+0000 7f3378196700 1 -- 172.21.15.88:0/1685253331 wait complete. 2020-02-11T16:05:47.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.857+0000 7f3378196700 1 Processor -- start 2020-02-11T16:05:47.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.857+0000 7f3378196700 1 -- start start 2020-02-11T16:05:47.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.857+0000 7f3378196700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f33700a18a0 0x7f33701336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.857+0000 7f3378196700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3370065fd0 con 0x7f33700a5de0 2020-02-11T16:05:47.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.857+0000 7f3378196700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3370066270 con 0x7f337012e3a0 2020-02-11T16:05:47.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.857+0000 7f3378196700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3370133ed0 con 0x7f33700a18a0 2020-02-11T16:05:47.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.857+0000 7f3376733700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f337012e3a0 0x7f33701487c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39470/0 (socket says 172.21.15.88:39470) 2020-02-11T16:05:47.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.857+0000 7f3376733700 1 -- 172.21.15.88:0/1897714153 learned_addr learned my addr 172.21.15.88:0/1897714153 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:47.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3375f32700 1 --2- 172.21.15.88:0/1897714153 >> v2:172.21.15.52:3300/0 conn(0x7f33700a18a0 0x7f33701336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358341104 0 0) 0x7f3370066270 con 0x7f337012e3a0 2020-02-11T16:05:47.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3350002fe0 con 0x7f337012e3a0 2020-02-11T16:05:47.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2685679132 0 0) 0x7f3350002fe0 con 0x7f337012e3a0 2020-02-11T16:05:47.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3370066270 con 0x7f337012e3a0 2020-02-11T16:05:47.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f3364001860 con 0x7f337012e3a0 2020-02-11T16:05:47.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 >> v2:172.21.15.52:3300/0 conn(0x7f33700a18a0 msgr2=0x7f33701336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 --2- 172.21.15.88:0/1897714153 >> v2:172.21.15.52:3300/0 conn(0x7f33700a18a0 0x7f33701336e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 >> v1:172.21.15.88:6789/0 conn(0x7f337012e3a0 legacy=0x7f33701487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 >> v1:172.21.15.52:6789/0 conn(0x7f33700a5de0 legacy=0x7f3370066710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33500049b0 0x7f3350004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3350005290 0x7f33500039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3370133ed0 con 0x7f3350005290 2020-02-11T16:05:47.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335000b8b0 con 0x7f3350003f10 2020-02-11T16:05:47.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335000ba70 con 0x7f33500049b0 2020-02-11T16:05:47.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3375f32700 1 --2- 172.21.15.88:0/1897714153 >> v2:172.21.15.52:3300/0 conn(0x7f33700a18a0 0x7f33701336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:47.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3375731700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3350005290 0x7f33500039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3375f32700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33500049b0 0x7f3350004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3376733700 1 -- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33500049b0 msgr2=0x7f3350004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33500049b0 0x7f3350004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3376733700 1 -- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3350005290 msgr2=0x7f33500039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:47.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3350005290 0x7f33500039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:47.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3376733700 1 -- 172.21.15.88:0/1897714153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3370133b40 con 0x7f3350003f10 2020-02-11T16:05:47.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3378196700 1 -- 172.21.15.88:0/1897714153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3370131810 con 0x7f3350003f10 2020-02-11T16:05:47.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3375f32700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33500049b0 0x7f3350004d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:47.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3378196700 1 -- 172.21.15.88:0/1897714153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3370148ed0 con 0x7f3350003f10 2020-02-11T16:05:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3376733700 1 -- 172.21.15.88:0/1897714153 reap_dead start 2020-02-11T16:05:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.858+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.859+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.859+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3364001a80 con 0x7f3350003f10 2020-02-11T16:05:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.859+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.859+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.859+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336400ee40 con 0x7f3350003f10 2020-02-11T16:05:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.859+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33640055c0 con 0x7f3350003f10 2020-02-11T16:05:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.859+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.859+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f3364005720 con 0x7f3350003f10 2020-02-11T16:05:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.859+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.860+0000 7f3378196700 1 -- 172.21.15.88:0/1897714153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337006a320 con 0x7f3350003f10 2020-02-11T16:05:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.860+0000 7f3362ffd700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f335003dba0 0x7f3350040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.860+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3364049a40 con 0x7f3350003f10 2020-02-11T16:05:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.860+0000 7f3375f32700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f335003dba0 0x7f3350040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.860+0000 7f3375f32700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f335003dba0 0x7f3350040060 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:47.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.863+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:47.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.863+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f336402efa0 con 0x7f3350003f10 2020-02-11T16:05:48.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.999+0000 7f3378196700 1 -- 172.21.15.88:0/1897714153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3370066400 con 0x7f3350003f10 2020-02-11T16:05:48.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.999+0000 7f3376733700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:47.999+0000 7f3362ffd700 1 -- 172.21.15.88:0/1897714153 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3364031c40 con 0x7f3350003f10 2020-02-11T16:05:48.003 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2020-02-11T16:05:48.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.000+0000 7f3378196700 1 -- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f335003dba0 msgr2=0x7f3350040060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.000+0000 7f3378196700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f335003dba0 0x7f3350040060 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.000+0000 7f3378196700 1 -- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 msgr2=0x7f33500043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.000+0000 7f3378196700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f3364005540 tx=0x7f33640113f0).stop 2020-02-11T16:05:48.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.000+0000 7f3378196700 1 -- 172.21.15.88:0/1897714153 shutdown_connections 2020-02-11T16:05:48.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.000+0000 7f3378196700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f335003dba0 0x7f3350040060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.000+0000 7f3378196700 1 --2- 172.21.15.88:0/1897714153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3350003f10 0x7f33500043c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.000+0000 7f3378196700 1 -- 172.21.15.88:0/1897714153 >> 172.21.15.88:0/1897714153 conn(0x7f337009d110 msgr2=0x7f33700aa050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:48.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.001+0000 7f3378196700 1 -- 172.21.15.88:0/1897714153 shutdown_connections 2020-02-11T16:05:48.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.001+0000 7f3378196700 1 -- 172.21.15.88:0/1897714153 wait complete. 2020-02-11T16:05:48.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2020-02-11T16:05:48.014 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-02-11T16:05:48.014 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-02-11T16:05:48.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.119+0000 7f9a19c83700 1 Processor -- start 2020-02-11T16:05:48.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.119+0000 7f9a19c83700 1 -- start start 2020-02-11T16:05:48.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.120+0000 7f9a19c83700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a140a18a0 0x7f9a140a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:48.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.120+0000 7f9a19c83700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140a31b0 con 0x7f9a140a6260 2020-02-11T16:05:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.120+0000 7f9a19c83700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140a3570 con 0x7f9a140a5de0 2020-02-11T16:05:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.120+0000 7f9a19c83700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a140a3810 con 0x7f9a140a18a0 2020-02-11T16:05:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.120+0000 7f9a12ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9a140a5de0 0x7f9a1412e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39480/0 (socket says 172.21.15.88:39480) 2020-02-11T16:05:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.120+0000 7f9a12ffd700 1 -- 172.21.15.88:0/165114568 learned_addr learned my addr 172.21.15.88:0/165114568 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.120+0000 7f9a137fe700 1 --2- 172.21.15.88:0/165114568 >> v2:172.21.15.52:3300/0 conn(0x7f9a140a18a0 0x7f9a140a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.120+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970974297 0 0) 0x7f9a140a3570 con 0x7f9a140a5de0 2020-02-11T16:05:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.120+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a00003230 con 0x7f9a140a5de0 2020-02-11T16:05:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4263411531 0 0) 0x7f9a00003230 con 0x7f9a140a5de0 2020-02-11T16:05:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 >> v2:172.21.15.52:3300/0 conn(0x7f9a140a18a0 msgr2=0x7f9a140a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 --2- 172.21.15.88:0/165114568 >> v2:172.21.15.52:3300/0 conn(0x7f9a140a18a0 0x7f9a140a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 >> v1:172.21.15.52:6789/0 conn(0x7f9a140a6260 legacy=0x7f9a1412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140a3ab0 con 0x7f9a140a5de0 2020-02-11T16:05:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f9a080016d0 con 0x7f9a140a5de0 2020-02-11T16:05:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 >> v1:172.21.15.88:6789/0 conn(0x7f9a140a5de0 legacy=0x7f9a1412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a00003720 0x7f9a00003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:48.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 0x7f9a00004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:48.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a00004db0 0x7f9a0000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:48.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140a3810 con 0x7f9a00003720 2020-02-11T16:05:48.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000041c0 con 0x7f9a000044d0 2020-02-11T16:05:48.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0000bb80 con 0x7f9a00004db0 2020-02-11T16:05:48.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 0x7f9a00004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a137fe700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a00003720 0x7f9a00003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a13fff700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a00004db0 0x7f9a0000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 -- 172.21.15.88:0/165114568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a00004db0 msgr2=0x7f9a0000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:48.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a00004db0 0x7f9a0000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:48.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 -- 172.21.15.88:0/165114568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a00003720 msgr2=0x7f9a00003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:48.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a00003720 0x7f9a00003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:48.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 -- 172.21.15.88:0/165114568 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00003230 con 0x7f9a000044d0 2020-02-11T16:05:48.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a13fff700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a00004db0 0x7f9a0000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:48.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a13fff700 1 -- 172.21.15.88:0/165114568 reap_dead start 2020-02-11T16:05:48.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 0x7f9a00004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a000054a0 tx=0x7f9a0800c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 0x7f9a00004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a000054a0 tx=0x7f9a0800c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 0x7f9a00004950 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f9a000054a0 tx=0x7f9a0800c370).ready entity=mon.1 client_cookie=e929a28a34395b31 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 0x7f9a00004950 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f9a000054a0 tx=0x7f9a0800c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a0800ce70 con 0x7f9a000044d0 2020-02-11T16:05:48.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 0x7f9a00004950 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f9a000054a0 tx=0x7f9a0800c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 0x7f9a00004950 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f9a000054a0 tx=0x7f9a0800c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0800e350 con 0x7f9a000044d0 2020-02-11T16:05:48.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a127fc700 1 -- 172.21.15.88:0/165114568 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a0800e6f0 con 0x7f9a000044d0 2020-02-11T16:05:48.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a19c83700 1 -- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 msgr2=0x7f9a00004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.121+0000 7f9a19c83700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 0x7f9a00004950 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f9a000054a0 tx=0x7f9a0800c370).stop 2020-02-11T16:05:48.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.122+0000 7f9a19c83700 1 -- 172.21.15.88:0/165114568 shutdown_connections 2020-02-11T16:05:48.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.122+0000 7f9a19c83700 1 --2- 172.21.15.88:0/165114568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a000044d0 0x7f9a00004950 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.122+0000 7f9a19c83700 1 -- 172.21.15.88:0/165114568 >> 172.21.15.88:0/165114568 conn(0x7f9a1409d110 msgr2=0x7f9a1409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:48.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.122+0000 7f9a19c83700 1 -- 172.21.15.88:0/165114568 shutdown_connections 2020-02-11T16:05:48.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.122+0000 7f9a19c83700 1 -- 172.21.15.88:0/165114568 wait complete. 2020-02-11T16:05:48.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.123+0000 7f9a19c83700 1 Processor -- start 2020-02-11T16:05:48.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.123+0000 7f9a19c83700 1 -- start start 2020-02-11T16:05:48.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.123+0000 7f9a19c83700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a000044d0 0x7f9a1412a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.123+0000 7f9a19c83700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a141345d0 0x7f9a141284b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.123+0000 7f9a19c83700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a141384e0 con 0x7f9a14128910 2020-02-11T16:05:48.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.123+0000 7f9a19c83700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a140a4780 con 0x7f9a000044d0 2020-02-11T16:05:48.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.123+0000 7f9a19c83700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140a7660 con 0x7f9a141345d0 2020-02-11T16:05:48.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.123+0000 7f9a13fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9a14128910 0x7f9a14135b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39494/0 (socket says 172.21.15.88:39494) 2020-02-11T16:05:48.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.123+0000 7f9a13fff700 1 -- 172.21.15.88:0/1186024785 learned_addr learned my addr 172.21.15.88:0/1186024785 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:48.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> v2:172.21.15.52:3300/0 conn(0x7f9a000044d0 0x7f9a1412a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a141345d0 0x7f9a141284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a10ff9700 1 -- 172.21.15.88:0/1186024785 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915934786 0 0) 0x7f9a141384e0 con 0x7f9a14128910 2020-02-11T16:05:48.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a10ff9700 1 -- 172.21.15.88:0/1186024785 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f4002fe0 con 0x7f9a14128910 2020-02-11T16:05:48.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 -- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a141345d0 msgr2=0x7f9a141284b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a141345d0 0x7f9a141284b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 -- 172.21.15.88:0/1186024785 >> v1:172.21.15.88:6789/0 conn(0x7f9a14128910 legacy=0x7f9a14135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 -- 172.21.15.88:0/1186024785 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a14138710 con 0x7f9a000044d0 2020-02-11T16:05:48.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> v2:172.21.15.52:3300/0 conn(0x7f9a000044d0 0x7f9a1412a3c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a14132d10 tx=0x7f9a04010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> v2:172.21.15.52:3300/0 conn(0x7f9a000044d0 0x7f9a1412a3c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a14132d10 tx=0x7f9a04010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a000044d0 0x7f9a1412a3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f9a14132d10 tx=0x7f9a04010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a000044d0 0x7f9a1412a3c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f9a14132d10 tx=0x7f9a04010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a10ff9700 1 -- 172.21.15.88:0/1186024785 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a04013060 con 0x7f9a000044d0 2020-02-11T16:05:48.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a000044d0 0x7f9a1412a3c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f9a14132d10 tx=0x7f9a04010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a10ff9700 1 -- 172.21.15.88:0/1186024785 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04005e90 con 0x7f9a000044d0 2020-02-11T16:05:48.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a000044d0 0x7f9a1412a3c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f9a14132d10 tx=0x7f9a04010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a19c83700 1 -- 172.21.15.88:0/1186024785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a14133bb0 con 0x7f9a000044d0 2020-02-11T16:05:48.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a10ff9700 1 -- 172.21.15.88:0/1186024785 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a04007fa0 con 0x7f9a000044d0 2020-02-11T16:05:48.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.124+0000 7f9a19c83700 1 -- 172.21.15.88:0/1186024785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a14132990 con 0x7f9a000044d0 2020-02-11T16:05:48.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.125+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a000044d0 0x7f9a1412a3c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f9a14132d10 tx=0x7f9a04010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.125+0000 7f9a19c83700 1 -- 172.21.15.88:0/1186024785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a14133a10 con 0x7f9a000044d0 2020-02-11T16:05:48.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.125+0000 7f9a10ff9700 1 -- 172.21.15.88:0/1186024785 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f9a04007430 con 0x7f9a000044d0 2020-02-11T16:05:48.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.125+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a000044d0 0x7f9a1412a3c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f9a14132d10 tx=0x7f9a04010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.126+0000 7f9a10ff9700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f99f4039f10 0x7f99f403c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.126+0000 7f9a10ff9700 1 -- 172.21.15.88:0/1186024785 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f9a04049890 con 0x7f9a000044d0 2020-02-11T16:05:48.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.126+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f99f4039f10 0x7f99f403c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.126+0000 7f9a12ffd700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f99f4039f10 0x7f99f403c3d0 crc :-1 s=READY pgs=76 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.130+0000 7f9a137fe700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a000044d0 0x7f9a1412a3c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f9a14132d10 tx=0x7f9a04010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.130+0000 7f9a10ff9700 1 -- 172.21.15.88:0/1186024785 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f9a14133a10 con 0x7f9a000044d0 2020-02-11T16:05:48.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.262+0000 7f9a19c83700 1 -- 172.21.15.88:0/1186024785 --> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a14132b90 con 0x7f99f4039f10 2020-02-11T16:05:48.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.264+0000 7f9a10ff9700 1 -- 172.21.15.88:0/1186024785 <== mgr.4105 v2:172.21.15.52:6800/30001 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66341 (crc 0 0 0) 0x7f9a08001b70 con 0x7f99f4039f10 2020-02-11T16:05:48.268 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:48.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 -- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f99f4039f10 msgr2=0x7f99f403c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f99f4039f10 0x7f99f403c3d0 crc :-1 s=READY pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 -- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a000044d0 msgr2=0x7f9a1412a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a000044d0 0x7f9a1412a3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f9a14132d10 tx=0x7f9a04010b80).stop 2020-02-11T16:05:48.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 -- 172.21.15.88:0/1186024785 shutdown_connections 2020-02-11T16:05:48.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f99f4039f10 0x7f99f403c3d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a000044d0 0x7f9a1412a3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 --2- 172.21.15.88:0/1186024785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a141345d0 0x7f9a141284b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 -- 172.21.15.88:0/1186024785 >> 172.21.15.88:0/1186024785 conn(0x7f9a1409d110 msgr2=0x7f9a140a6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:48.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 -- 172.21.15.88:0/1186024785 shutdown_connections 2020-02-11T16:05:48.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.266+0000 7f9a19c83700 1 -- 172.21.15.88:0/1186024785 wait complete. 2020-02-11T16:05:48.271 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2020-02-11T16:05:48.284 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-02-11T16:05:46.953156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390624,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584096,"statfs":{"total":773094113280,"available":764502114304,"internally_reserved":8589934592,"allocated":1998848,"data_stored":719508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000963"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.212979+0000","last_change":"2020-02-11T16:05:39.212597+0000","last_active":"2020-02-11T16:05:39.212979+0000","last_peered":"2020-02-11T16:05:39.212979+0000","last_clean":"2020-02-11T16:05:39.212979+0000","last_became_active":"2020-02-11T16:05:39.212054+0000","last_became_peered":"2020-02-11T16:05:39.212054+0000","last_unstale":"2020-02-11T16:05:39.212979+0000","last_undegraded":"2020-02-11T16:05:39.212979+0000","last_fullsized":"2020-02-11T16:05:39.212979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.957217+0000","last_change":"2020-02-11T16:05:32.944206+0000","last_active":"2020-02-11T16:05:38.957217+0000","last_peered":"2020-02-11T16:05:38.957217+0000","last_clean":"2020-02-11T16:05:38.957217+0000","last_became_active":"2020-02-11T16:05:32.943706+0000","last_became_peered":"2020-02-11T16:05:32.943706+0000","last_unstale":"2020-02-11T16:05:38.957217+0000","last_undegraded":"2020-02-11T16:05:38.957217+0000","last_fullsized":"2020-02-11T16:05:38.957217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'3","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.995820+0000","last_change":"2020-02-11T16:05:35.954092+0000","last_active":"2020-02-11T16:05:41.995820+0000","last_peered":"2020-02-11T16:05:41.995820+0000","last_clean":"2020-02-11T16:05:41.995820+0000","last_became_active":"2020-02-11T16:05:35.953688+0000","last_became_peered":"2020-02-11T16:05:35.953688+0000","last_unstale":"2020-02-11T16:05:41.995820+0000","last_undegraded":"2020-02-11T16:05:41.995820+0000","last_fullsized":"2020-02-11T16:05:41.995820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.212828+0000","last_change":"2020-02-11T16:05:39.212531+0000","last_active":"2020-02-11T16:05:39.212828+0000","last_peered":"2020-02-11T16:05:39.212828+0000","last_clean":"2020-02-11T16:05:39.212828+0000","last_became_active":"2020-02-11T16:05:39.212022+0000","last_became_peered":"2020-02-11T16:05:39.212022+0000","last_unstale":"2020-02-11T16:05:39.212828+0000","last_undegraded":"2020-02-11T16:05:39.212828+0000","last_fullsized":"2020-02-11T16:05:39.212828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.959924+0000","last_change":"2020-02-11T16:05:32.945570+0000","last_active":"2020-02-11T16:05:38.959924+0000","last_peered":"2020-02-11T16:05:38.959924+0000","last_clean":"2020-02-11T16:05:38.959924+0000","last_became_active":"2020-02-11T16:05:32.945196+0000","last_became_peered":"2020-02-11T16:05:32.945196+0000","last_unstale":"2020-02-11T16:05:38.959924+0000","last_undegraded":"2020-02-11T16:05:38.959924+0000","last_fullsized":"2020-02-11T16:05:38.959924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:42.001478+0000","last_change":"2020-02-11T16:05:35.953882+0000","last_active":"2020-02-11T16:05:42.001478+0000","last_peered":"2020-02-11T16:05:42.001478+0000","last_clean":"2020-02-11T16:05:42.001478+0000","last_became_active":"2020-02-11T16:05:35.953459+0000","last_became_peered":"2020-02-11T16:05:35.953459+0000","last_unstale":"2020-02-11T16:05:42.001478+0000","last_undegraded":"2020-02-11T16:05:42.001478+0000","last_fullsized":"2020-02-11T16:05:42.001478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.967103+0000","last_change":"2020-02-11T16:05:38.966724+0000","last_active":"2020-02-11T16:05:38.967103+0000","last_peered":"2020-02-11T16:05:38.967103+0000","last_clean":"2020-02-11T16:05:38.967103+0000","last_became_active":"2020-02-11T16:05:38.966258+0000","last_became_peered":"2020-02-11T16:05:38.966258+0000","last_unstale":"2020-02-11T16:05:38.967103+0000","last_undegraded":"2020-02-11T16:05:38.967103+0000","last_fullsized":"2020-02-11T16:05:38.967103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.958839+0000","last_change":"2020-02-11T16:05:32.946055+0000","last_active":"2020-02-11T16:05:38.958839+0000","last_peered":"2020-02-11T16:05:38.958839+0000","last_clean":"2020-02-11T16:05:38.958839+0000","last_became_active":"2020-02-11T16:05:32.945635+0000","last_became_peered":"2020-02-11T16:05:32.945635+0000","last_unstale":"2020-02-11T16:05:38.958839+0000","last_undegraded":"2020-02-11T16:05:38.958839+0000","last_fullsized":"2020-02-11T16:05:38.958839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:42.000893+0000","last_change":"2020-02-11T16:05:35.954928+0000","last_active":"2020-02-11T16:05:42.000893+0000","last_peered":"2020-02-11T16:05:42.000893+0000","last_clean":"2020-02-11T16:05:42.000893+0000","last_became_active":"2020-02-11T16:05:35.954408+0000","last_became_peered":"2020-02-11T16:05:35.954408+0000","last_unstale":"2020-02-11T16:05:42.000893+0000","last_undegraded":"2020-02-11T16:05:42.000893+0000","last_fullsized":"2020-02-11T16:05:42.000893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133317+0000","last_change":"2020-02-11T16:05:39.132833+0000","last_active":"2020-02-11T16:05:39.133317+0000","last_peered":"2020-02-11T16:05:39.133317+0000","last_clean":"2020-02-11T16:05:39.133317+0000","last_became_active":"2020-02-11T16:05:39.132197+0000","last_became_peered":"2020-02-11T16:05:39.132197+0000","last_unstale":"2020-02-11T16:05:39.133317+0000","last_undegraded":"2020-02-11T16:05:39.133317+0000","last_fullsized":"2020-02-11T16:05:39.133317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.210805+0000","last_change":"2020-02-11T16:05:33.373076+0000","last_active":"2020-02-11T16:05:39.210805+0000","last_peered":"2020-02-11T16:05:39.210805+0000","last_clean":"2020-02-11T16:05:39.210805+0000","last_became_active":"2020-02-11T16:05:33.372511+0000","last_became_peered":"2020-02-11T16:05:33.372511+0000","last_unstale":"2020-02-11T16:05:39.210805+0000","last_undegraded":"2020-02-11T16:05:39.210805+0000","last_fullsized":"2020-02-11T16:05:39.210805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.958696+0000","last_change":"2020-02-11T16:05:36.059923+0000","last_active":"2020-02-11T16:05:38.958696+0000","last_peered":"2020-02-11T16:05:38.958696+0000","last_clean":"2020-02-11T16:05:38.958696+0000","last_became_active":"2020-02-11T16:05:36.059547+0000","last_became_peered":"2020-02-11T16:05:36.059547+0000","last_unstale":"2020-02-11T16:05:38.958696+0000","last_undegraded":"2020-02-11T16:05:38.958696+0000","last_fullsized":"2020-02-11T16:05:38.958696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133165+0000","last_change":"2020-02-11T16:05:39.132633+0000","last_active":"2020-02-11T16:05:39.133165+0000","last_peered":"2020-02-11T16:05:39.133165+0000","last_clean":"2020-02-11T16:05:39.133165+0000","last_became_active":"2020-02-11T16:05:39.132026+0000","last_became_peered":"2020-02-11T16:05:39.132026+0000","last_unstale":"2020-02-11T16:05:39.133165+0000","last_undegraded":"2020-02-11T16:05:39.133165+0000","last_fullsized":"2020-02-11T16:05:39.133165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.210935+0000","last_change":"2020-02-11T16:05:33.373028+0000","last_active":"2020-02-11T16:05:39.210935+0000","last_peered":"2020-02-11T16:05:39.210935+0000","last_clean":"2020-02-11T16:05:39.210935+0000","last_became_active":"2020-02-11T16:05:33.372511+0000","last_became_peered":"2020-02-11T16:05:33.372511+0000","last_unstale":"2020-02-11T16:05:39.210935+0000","last_undegraded":"2020-02-11T16:05:39.210935+0000","last_fullsized":"2020-02-11T16:05:39.210935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'5","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.999209+0000","last_change":"2020-02-11T16:05:35.953148+0000","last_active":"2020-02-11T16:05:41.999209+0000","last_peered":"2020-02-11T16:05:41.999209+0000","last_clean":"2020-02-11T16:05:41.999209+0000","last_became_active":"2020-02-11T16:05:35.952768+0000","last_became_peered":"2020-02-11T16:05:35.952768+0000","last_unstale":"2020-02-11T16:05:41.999209+0000","last_undegraded":"2020-02-11T16:05:41.999209+0000","last_fullsized":"2020-02-11T16:05:41.999209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133555+0000","last_change":"2020-02-11T16:05:39.132883+0000","last_active":"2020-02-11T16:05:39.133555+0000","last_peered":"2020-02-11T16:05:39.133555+0000","last_clean":"2020-02-11T16:05:39.133555+0000","last_became_active":"2020-02-11T16:05:39.132022+0000","last_became_peered":"2020-02-11T16:05:39.132022+0000","last_unstale":"2020-02-11T16:05:39.133555+0000","last_undegraded":"2020-02-11T16:05:39.133555+0000","last_fullsized":"2020-02-11T16:05:39.133555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.964797+0000","last_change":"2020-02-11T16:05:33.373034+0000","last_active":"2020-02-11T16:05:38.964797+0000","last_peered":"2020-02-11T16:05:38.964797+0000","last_clean":"2020-02-11T16:05:38.964797+0000","last_became_active":"2020-02-11T16:05:33.372467+0000","last_became_peered":"2020-02-11T16:05:33.372467+0000","last_unstale":"2020-02-11T16:05:38.964797+0000","last_undegraded":"2020-02-11T16:05:38.964797+0000","last_fullsized":"2020-02-11T16:05:38.964797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:39.842584+0000","last_change":"2020-02-11T16:05:35.953255+0000","last_active":"2020-02-11T16:05:39.842584+0000","last_peered":"2020-02-11T16:05:39.842584+0000","last_clean":"2020-02-11T16:05:39.842584+0000","last_became_active":"2020-02-11T16:05:35.952898+0000","last_became_peered":"2020-02-11T16:05:35.952898+0000","last_unstale":"2020-02-11T16:05:39.842584+0000","last_undegraded":"2020-02-11T16:05:39.842584+0000","last_fullsized":"2020-02-11T16:05:39.842584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.965927+0000","last_change":"2020-02-11T16:05:38.965473+0000","last_active":"2020-02-11T16:05:38.965927+0000","last_peered":"2020-02-11T16:05:38.965927+0000","last_clean":"2020-02-11T16:05:38.965927+0000","last_became_active":"2020-02-11T16:05:38.965054+0000","last_became_peered":"2020-02-11T16:05:38.965054+0000","last_unstale":"2020-02-11T16:05:38.965927+0000","last_undegraded":"2020-02-11T16:05:38.965927+0000","last_fullsized":"2020-02-11T16:05:38.965927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.131237+0000","last_change":"2020-02-11T16:05:33.372976+0000","last_active":"2020-02-11T16:05:39.131237+0000","last_peered":"2020-02-11T16:05:39.131237+0000","last_clean":"2020-02-11T16:05:39.131237+0000","last_became_active":"2020-02-11T16:05:33.372444+0000","last_became_peered":"2020-02-11T16:05:33.372444+0000","last_unstale":"2020-02-11T16:05:39.131237+0000","last_undegraded":"2020-02-11T16:05:39.131237+0000","last_fullsized":"2020-02-11T16:05:39.131237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"23'6","reported_seq":"17","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.999159+0000","last_change":"2020-02-11T16:05:35.954548+0000","last_active":"2020-02-11T16:05:41.999159+0000","last_peered":"2020-02-11T16:05:41.999159+0000","last_clean":"2020-02-11T16:05:41.999159+0000","last_became_active":"2020-02-11T16:05:35.954103+0000","last_became_peered":"2020-02-11T16:05:35.954103+0000","last_unstale":"2020-02-11T16:05:41.999159+0000","last_undegraded":"2020-02-11T16:05:41.999159+0000","last_fullsized":"2020-02-11T16:05:41.999159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133272+0000","last_change":"2020-02-11T16:05:39.132840+0000","last_active":"2020-02-11T16:05:39.133272+0000","last_peered":"2020-02-11T16:05:39.133272+0000","last_clean":"2020-02-11T16:05:39.133272+0000","last_became_active":"2020-02-11T16:05:39.132263+0000","last_became_peered":"2020-02-11T16:05:39.132263+0000","last_unstale":"2020-02-11T16:05:39.133272+0000","last_undegraded":"2020-02-11T16:05:39.133272+0000","last_fullsized":"2020-02-11T16:05:39.133272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.131385+0000","last_change":"2020-02-11T16:05:32.946664+0000","last_active":"2020-02-11T16:05:39.131385+0000","last_peered":"2020-02-11T16:05:39.131385+0000","last_clean":"2020-02-11T16:05:39.131385+0000","last_became_active":"2020-02-11T16:05:32.946378+0000","last_became_peered":"2020-02-11T16:05:32.946378+0000","last_unstale":"2020-02-11T16:05:39.131385+0000","last_undegraded":"2020-02-11T16:05:39.131385+0000","last_fullsized":"2020-02-11T16:05:39.131385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.998476+0000","last_change":"2020-02-11T16:05:35.952928+0000","last_active":"2020-02-11T16:05:41.998476+0000","last_peered":"2020-02-11T16:05:41.998476+0000","last_clean":"2020-02-11T16:05:41.998476+0000","last_became_active":"2020-02-11T16:05:35.952595+0000","last_became_peered":"2020-02-11T16:05:35.952595+0000","last_unstale":"2020-02-11T16:05:41.998476+0000","last_undegraded":"2020-02-11T16:05:41.998476+0000","last_fullsized":"2020-02-11T16:05:41.998476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":90093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":91053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":89401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":89401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-02-11T16:05:48.287 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-02-11T16:05:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.389+0000 7f0dcdce8700 1 Processor -- start 2020-02-11T16:05:48.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.389+0000 7f0dcdce8700 1 -- start start 2020-02-11T16:05:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.389+0000 7f0dcdce8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0dc80a5de0 0x7f0dc80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.389+0000 7f0dcdce8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0dc8134a50 0x7f0dc8134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:48.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.389+0000 7f0dcdce8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc80a31b0 con 0x7f0dc80a18a0 2020-02-11T16:05:48.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.389+0000 7f0dcdce8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc80a3570 con 0x7f0dc80a5de0 2020-02-11T16:05:48.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.389+0000 7f0dcdce8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80a3810 con 0x7f0dc8134a50 2020-02-11T16:05:48.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.389+0000 7f0dc6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0dc80a5de0 0x7f0dc80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.389+0000 7f0dc6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0dc80a5de0 0x7f0dc80a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51874/0 (socket says 172.21.15.88:51874) 2020-02-11T16:05:48.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.389+0000 7f0dc6ffd700 1 -- 172.21.15.88:0/4217920866 learned_addr learned my addr 172.21.15.88:0/4217920866 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:48.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/4217920866 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0dc8134a50 0x7f0dc8134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc6ffd700 1 -- 172.21.15.88:0/4217920866 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0dc8134a50 msgr2=0x7f0dc8134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc6ffd700 1 --2- 172.21.15.88:0/4217920866 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0dc8134a50 0x7f0dc8134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc6ffd700 1 -- 172.21.15.88:0/4217920866 >> v1:172.21.15.52:6789/0 conn(0x7f0dc80a18a0 legacy=0x7f0dc80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc6ffd700 1 -- 172.21.15.88:0/4217920866 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80a3ab0 con 0x7f0dc80a5de0 2020-02-11T16:05:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/4217920866 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0dc8134a50 0x7f0dc8134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc6ffd700 1 --2- 172.21.15.88:0/4217920866 >> v2:172.21.15.88:3300/0 conn(0x7f0dc80a5de0 0x7f0dc80a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0dbc002f30 tx=0x7f0dbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc6ffd700 1 --2- 172.21.15.88:0/4217920866 >> v2:172.21.15.88:3300/0 conn(0x7f0dc80a5de0 0x7f0dc80a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0dbc002f30 tx=0x7f0dbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc6ffd700 1 --2- 172.21.15.88:0/4217920866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc80a5de0 0x7f0dc80a6260 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f0dbc002f30 tx=0x7f0dbc0088e0).ready entity=mon.1 client_cookie=35ca106872cef22e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc6ffd700 1 --2- 172.21.15.88:0/4217920866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc80a5de0 0x7f0dc80a6260 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f0dbc002f30 tx=0x7f0dbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc67fc700 1 -- 172.21.15.88:0/4217920866 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dbc011760 con 0x7f0dc80a5de0 2020-02-11T16:05:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc6ffd700 1 --2- 172.21.15.88:0/4217920866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc80a5de0 0x7f0dc80a6260 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f0dbc002f30 tx=0x7f0dbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc6ffd700 1 --2- 172.21.15.88:0/4217920866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc80a5de0 0x7f0dc80a6260 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f0dbc002f30 tx=0x7f0dbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc67fc700 1 -- 172.21.15.88:0/4217920866 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0118c0 con 0x7f0dc80a5de0 2020-02-11T16:05:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dc67fc700 1 -- 172.21.15.88:0/4217920866 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dbc011ca0 con 0x7f0dc80a5de0 2020-02-11T16:05:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dcdce8700 1 -- 172.21.15.88:0/4217920866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc80a5de0 msgr2=0x7f0dc80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dcdce8700 1 --2- 172.21.15.88:0/4217920866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc80a5de0 0x7f0dc80a6260 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f0dbc002f30 tx=0x7f0dbc0088e0).stop 2020-02-11T16:05:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dcdce8700 1 -- 172.21.15.88:0/4217920866 shutdown_connections 2020-02-11T16:05:48.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dcdce8700 1 --2- 172.21.15.88:0/4217920866 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0dc8134a50 0x7f0dc8134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:48.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dcdce8700 1 --2- 172.21.15.88:0/4217920866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc80a5de0 0x7f0dc80a6260 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dcdce8700 1 -- 172.21.15.88:0/4217920866 >> 172.21.15.88:0/4217920866 conn(0x7f0dc809d110 msgr2=0x7f0dc809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:48.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dcdce8700 1 -- 172.21.15.88:0/4217920866 shutdown_connections 2020-02-11T16:05:48.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.390+0000 7f0dcdce8700 1 -- 172.21.15.88:0/4217920866 wait complete. 2020-02-11T16:05:48.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.391+0000 7f0dcdce8700 1 Processor -- start 2020-02-11T16:05:48.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dcdce8700 1 -- start start 2020-02-11T16:05:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dcdce8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0dc80a5de0 0x7f0dc8125e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dcdce8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0dc8134a50 0x7f0dc81262d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dcdce8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc812d920 con 0x7f0dc80a18a0 2020-02-11T16:05:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dcdce8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc81292a0 con 0x7f0dc80a5de0 2020-02-11T16:05:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dcdce8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc8131050 con 0x7f0dc8134a50 2020-02-11T16:05:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dc77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0dc80a18a0 0x7f0dc812d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39504/0 (socket says 172.21.15.88:39504) 2020-02-11T16:05:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dc77fe700 1 -- 172.21.15.88:0/1413846798 learned_addr learned my addr 172.21.15.88:0/1413846798 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> v2:172.21.15.88:3300/0 conn(0x7f0dc8134a50 0x7f0dc81262d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dc6ffd700 1 --2- 172.21.15.88:0/1413846798 >> v2:172.21.15.52:3300/0 conn(0x7f0dc80a5de0 0x7f0dc8125e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dc7fff700 1 -- 172.21.15.88:0/1413846798 >> v2:172.21.15.52:3300/0 conn(0x7f0dc80a5de0 msgr2=0x7f0dc8125e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> v2:172.21.15.52:3300/0 conn(0x7f0dc80a5de0 0x7f0dc8125e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dc7fff700 1 -- 172.21.15.88:0/1413846798 >> v1:172.21.15.88:6789/0 conn(0x7f0dc80a18a0 legacy=0x7f0dc812d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dc7fff700 1 -- 172.21.15.88:0/1413846798 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc81312f0 con 0x7f0dc8134a50 2020-02-11T16:05:48.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dc4ff9700 1 -- 172.21.15.88:0/1413846798 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867488324 0 0) 0x7f0dc812d920 con 0x7f0dc80a18a0 2020-02-11T16:05:48.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.392+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> v2:172.21.15.88:3300/0 conn(0x7f0dc8134a50 0x7f0dc81262d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0dc8130d70 tx=0x7f0dc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> v2:172.21.15.88:3300/0 conn(0x7f0dc8134a50 0x7f0dc81262d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0dc8130d70 tx=0x7f0dc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc8134a50 0x7f0dc81262d0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f0dc8130d70 tx=0x7f0dc0010d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc8134a50 0x7f0dc81262d0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0dc8130d70 tx=0x7f0dc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dc4ff9700 1 -- 172.21.15.88:0/1413846798 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dc0005e30 con 0x7f0dc8134a50 2020-02-11T16:05:48.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc8134a50 0x7f0dc81262d0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0dc8130d70 tx=0x7f0dc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc8134a50 0x7f0dc81262d0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0dc8130d70 tx=0x7f0dc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dc4ff9700 1 -- 172.21.15.88:0/1413846798 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc0007540 con 0x7f0dc8134a50 2020-02-11T16:05:48.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dc4ff9700 1 -- 172.21.15.88:0/1413846798 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dc00078e0 con 0x7f0dc8134a50 2020-02-11T16:05:48.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dcdce8700 1 -- 172.21.15.88:0/1413846798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc8131590 con 0x7f0dc8134a50 2020-02-11T16:05:48.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dcdce8700 1 -- 172.21.15.88:0/1413846798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc812f8e0 con 0x7f0dc8134a50 2020-02-11T16:05:48.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.393+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc8134a50 0x7f0dc81262d0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0dc8130d70 tx=0x7f0dc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.394+0000 7f0dc4ff9700 1 -- 172.21.15.88:0/1413846798 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f0dc000e400 con 0x7f0dc8134a50 2020-02-11T16:05:48.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.394+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc8134a50 0x7f0dc81262d0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0dc8130d70 tx=0x7f0dc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.394+0000 7f0dcdce8700 1 -- 172.21.15.88:0/1413846798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc8131790 con 0x7f0dc8134a50 2020-02-11T16:05:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.394+0000 7f0dc4ff9700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0da8039b30 0x7f0da803bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.394+0000 7f0dc4ff9700 1 -- 172.21.15.88:0/1413846798 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f0dc004a3c0 con 0x7f0dc8134a50 2020-02-11T16:05:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.394+0000 7f0dc77fe700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0da8039b30 0x7f0da803bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.394+0000 7f0dc77fe700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0da8039b30 0x7f0da803bff0 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.397+0000 7f0dc7fff700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc8134a50 0x7f0dc81262d0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0dc8130d70 tx=0x7f0dc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.397+0000 7f0dc4ff9700 1 -- 172.21.15.88:0/1413846798 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f0dc8131790 con 0x7f0dc8134a50 2020-02-11T16:05:48.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.528+0000 7f0dcdce8700 1 -- 172.21.15.88:0/1413846798 --> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0dc8131790 con 0x7f0da8039b30 2020-02-11T16:05:48.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.531+0000 7f0dc4ff9700 1 -- 172.21.15.88:0/1413846798 <== mgr.4105 v2:172.21.15.52:6800/30001 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66341 (crc 0 0 0) 0x7f0dc8131790 con 0x7f0da8039b30 2020-02-11T16:05:48.535 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:48.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 -- 172.21.15.88:0/1413846798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0da8039b30 msgr2=0x7f0da803bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0da8039b30 0x7f0da803bff0 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 -- 172.21.15.88:0/1413846798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc8134a50 msgr2=0x7f0dc81262d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc8134a50 0x7f0dc81262d0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f0dc8130d70 tx=0x7f0dc0010d50).stop 2020-02-11T16:05:48.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 -- 172.21.15.88:0/1413846798 shutdown_connections 2020-02-11T16:05:48.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc8134a50 0x7f0dc81262d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 --2- 172.21.15.88:0/1413846798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0da8039b30 0x7f0da803bff0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 --2- 172.21.15.88:0/1413846798 >> v2:172.21.15.52:3300/0 conn(0x7f0dc80a5de0 0x7f0dc8125e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 -- 172.21.15.88:0/1413846798 >> 172.21.15.88:0/1413846798 conn(0x7f0dc809d110 msgr2=0x7f0dc8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:48.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 -- 172.21.15.88:0/1413846798 shutdown_connections 2020-02-11T16:05:48.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.532+0000 7f0dcdce8700 1 -- 172.21.15.88:0/1413846798 wait complete. 2020-02-11T16:05:48.538 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2020-02-11T16:05:48.545 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-02-11T16:05:46.953156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390624,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584096,"statfs":{"total":773094113280,"available":764502114304,"internally_reserved":8589934592,"allocated":1998848,"data_stored":719508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000963"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.212979+0000","last_change":"2020-02-11T16:05:39.212597+0000","last_active":"2020-02-11T16:05:39.212979+0000","last_peered":"2020-02-11T16:05:39.212979+0000","last_clean":"2020-02-11T16:05:39.212979+0000","last_became_active":"2020-02-11T16:05:39.212054+0000","last_became_peered":"2020-02-11T16:05:39.212054+0000","last_unstale":"2020-02-11T16:05:39.212979+0000","last_undegraded":"2020-02-11T16:05:39.212979+0000","last_fullsized":"2020-02-11T16:05:39.212979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.957217+0000","last_change":"2020-02-11T16:05:32.944206+0000","last_active":"2020-02-11T16:05:38.957217+0000","last_peered":"2020-02-11T16:05:38.957217+0000","last_clean":"2020-02-11T16:05:38.957217+0000","last_became_active":"2020-02-11T16:05:32.943706+0000","last_became_peered":"2020-02-11T16:05:32.943706+0000","last_unstale":"2020-02-11T16:05:38.957217+0000","last_undegraded":"2020-02-11T16:05:38.957217+0000","last_fullsized":"2020-02-11T16:05:38.957217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'3","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.995820+0000","last_change":"2020-02-11T16:05:35.954092+0000","last_active":"2020-02-11T16:05:41.995820+0000","last_peered":"2020-02-11T16:05:41.995820+0000","last_clean":"2020-02-11T16:05:41.995820+0000","last_became_active":"2020-02-11T16:05:35.953688+0000","last_became_peered":"2020-02-11T16:05:35.953688+0000","last_unstale":"2020-02-11T16:05:41.995820+0000","last_undegraded":"2020-02-11T16:05:41.995820+0000","last_fullsized":"2020-02-11T16:05:41.995820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.212828+0000","last_change":"2020-02-11T16:05:39.212531+0000","last_active":"2020-02-11T16:05:39.212828+0000","last_peered":"2020-02-11T16:05:39.212828+0000","last_clean":"2020-02-11T16:05:39.212828+0000","last_became_active":"2020-02-11T16:05:39.212022+0000","last_became_peered":"2020-02-11T16:05:39.212022+0000","last_unstale":"2020-02-11T16:05:39.212828+0000","last_undegraded":"2020-02-11T16:05:39.212828+0000","last_fullsized":"2020-02-11T16:05:39.212828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.959924+0000","last_change":"2020-02-11T16:05:32.945570+0000","last_active":"2020-02-11T16:05:38.959924+0000","last_peered":"2020-02-11T16:05:38.959924+0000","last_clean":"2020-02-11T16:05:38.959924+0000","last_became_active":"2020-02-11T16:05:32.945196+0000","last_became_peered":"2020-02-11T16:05:32.945196+0000","last_unstale":"2020-02-11T16:05:38.959924+0000","last_undegraded":"2020-02-11T16:05:38.959924+0000","last_fullsized":"2020-02-11T16:05:38.959924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:42.001478+0000","last_change":"2020-02-11T16:05:35.953882+0000","last_active":"2020-02-11T16:05:42.001478+0000","last_peered":"2020-02-11T16:05:42.001478+0000","last_clean":"2020-02-11T16:05:42.001478+0000","last_became_active":"2020-02-11T16:05:35.953459+0000","last_became_peered":"2020-02-11T16:05:35.953459+0000","last_unstale":"2020-02-11T16:05:42.001478+0000","last_undegraded":"2020-02-11T16:05:42.001478+0000","last_fullsized":"2020-02-11T16:05:42.001478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.967103+0000","last_change":"2020-02-11T16:05:38.966724+0000","last_active":"2020-02-11T16:05:38.967103+0000","last_peered":"2020-02-11T16:05:38.967103+0000","last_clean":"2020-02-11T16:05:38.967103+0000","last_became_active":"2020-02-11T16:05:38.966258+0000","last_became_peered":"2020-02-11T16:05:38.966258+0000","last_unstale":"2020-02-11T16:05:38.967103+0000","last_undegraded":"2020-02-11T16:05:38.967103+0000","last_fullsized":"2020-02-11T16:05:38.967103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.958839+0000","last_change":"2020-02-11T16:05:32.946055+0000","last_active":"2020-02-11T16:05:38.958839+0000","last_peered":"2020-02-11T16:05:38.958839+0000","last_clean":"2020-02-11T16:05:38.958839+0000","last_became_active":"2020-02-11T16:05:32.945635+0000","last_became_peered":"2020-02-11T16:05:32.945635+0000","last_unstale":"2020-02-11T16:05:38.958839+0000","last_undegraded":"2020-02-11T16:05:38.958839+0000","last_fullsized":"2020-02-11T16:05:38.958839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:42.000893+0000","last_change":"2020-02-11T16:05:35.954928+0000","last_active":"2020-02-11T16:05:42.000893+0000","last_peered":"2020-02-11T16:05:42.000893+0000","last_clean":"2020-02-11T16:05:42.000893+0000","last_became_active":"2020-02-11T16:05:35.954408+0000","last_became_peered":"2020-02-11T16:05:35.954408+0000","last_unstale":"2020-02-11T16:05:42.000893+0000","last_undegraded":"2020-02-11T16:05:42.000893+0000","last_fullsized":"2020-02-11T16:05:42.000893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133317+0000","last_change":"2020-02-11T16:05:39.132833+0000","last_active":"2020-02-11T16:05:39.133317+0000","last_peered":"2020-02-11T16:05:39.133317+0000","last_clean":"2020-02-11T16:05:39.133317+0000","last_became_active":"2020-02-11T16:05:39.132197+0000","last_became_peered":"2020-02-11T16:05:39.132197+0000","last_unstale":"2020-02-11T16:05:39.133317+0000","last_undegraded":"2020-02-11T16:05:39.133317+0000","last_fullsized":"2020-02-11T16:05:39.133317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.210805+0000","last_change":"2020-02-11T16:05:33.373076+0000","last_active":"2020-02-11T16:05:39.210805+0000","last_peered":"2020-02-11T16:05:39.210805+0000","last_clean":"2020-02-11T16:05:39.210805+0000","last_became_active":"2020-02-11T16:05:33.372511+0000","last_became_peered":"2020-02-11T16:05:33.372511+0000","last_unstale":"2020-02-11T16:05:39.210805+0000","last_undegraded":"2020-02-11T16:05:39.210805+0000","last_fullsized":"2020-02-11T16:05:39.210805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.958696+0000","last_change":"2020-02-11T16:05:36.059923+0000","last_active":"2020-02-11T16:05:38.958696+0000","last_peered":"2020-02-11T16:05:38.958696+0000","last_clean":"2020-02-11T16:05:38.958696+0000","last_became_active":"2020-02-11T16:05:36.059547+0000","last_became_peered":"2020-02-11T16:05:36.059547+0000","last_unstale":"2020-02-11T16:05:38.958696+0000","last_undegraded":"2020-02-11T16:05:38.958696+0000","last_fullsized":"2020-02-11T16:05:38.958696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133165+0000","last_change":"2020-02-11T16:05:39.132633+0000","last_active":"2020-02-11T16:05:39.133165+0000","last_peered":"2020-02-11T16:05:39.133165+0000","last_clean":"2020-02-11T16:05:39.133165+0000","last_became_active":"2020-02-11T16:05:39.132026+0000","last_became_peered":"2020-02-11T16:05:39.132026+0000","last_unstale":"2020-02-11T16:05:39.133165+0000","last_undegraded":"2020-02-11T16:05:39.133165+0000","last_fullsized":"2020-02-11T16:05:39.133165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.210935+0000","last_change":"2020-02-11T16:05:33.373028+0000","last_active":"2020-02-11T16:05:39.210935+0000","last_peered":"2020-02-11T16:05:39.210935+0000","last_clean":"2020-02-11T16:05:39.210935+0000","last_became_active":"2020-02-11T16:05:33.372511+0000","last_became_peered":"2020-02-11T16:05:33.372511+0000","last_unstale":"2020-02-11T16:05:39.210935+0000","last_undegraded":"2020-02-11T16:05:39.210935+0000","last_fullsized":"2020-02-11T16:05:39.210935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'5","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.999209+0000","last_change":"2020-02-11T16:05:35.953148+0000","last_active":"2020-02-11T16:05:41.999209+0000","last_peered":"2020-02-11T16:05:41.999209+0000","last_clean":"2020-02-11T16:05:41.999209+0000","last_became_active":"2020-02-11T16:05:35.952768+0000","last_became_peered":"2020-02-11T16:05:35.952768+0000","last_unstale":"2020-02-11T16:05:41.999209+0000","last_undegraded":"2020-02-11T16:05:41.999209+0000","last_fullsized":"2020-02-11T16:05:41.999209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133555+0000","last_change":"2020-02-11T16:05:39.132883+0000","last_active":"2020-02-11T16:05:39.133555+0000","last_peered":"2020-02-11T16:05:39.133555+0000","last_clean":"2020-02-11T16:05:39.133555+0000","last_became_active":"2020-02-11T16:05:39.132022+0000","last_became_peered":"2020-02-11T16:05:39.132022+0000","last_unstale":"2020-02-11T16:05:39.133555+0000","last_undegraded":"2020-02-11T16:05:39.133555+0000","last_fullsized":"2020-02-11T16:05:39.133555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.964797+0000","last_change":"2020-02-11T16:05:33.373034+0000","last_active":"2020-02-11T16:05:38.964797+0000","last_peered":"2020-02-11T16:05:38.964797+0000","last_clean":"2020-02-11T16:05:38.964797+0000","last_became_active":"2020-02-11T16:05:33.372467+0000","last_became_peered":"2020-02-11T16:05:33.372467+0000","last_unstale":"2020-02-11T16:05:38.964797+0000","last_undegraded":"2020-02-11T16:05:38.964797+0000","last_fullsized":"2020-02-11T16:05:38.964797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:39.842584+0000","last_change":"2020-02-11T16:05:35.953255+0000","last_active":"2020-02-11T16:05:39.842584+0000","last_peered":"2020-02-11T16:05:39.842584+0000","last_clean":"2020-02-11T16:05:39.842584+0000","last_became_active":"2020-02-11T16:05:35.952898+0000","last_became_peered":"2020-02-11T16:05:35.952898+0000","last_unstale":"2020-02-11T16:05:39.842584+0000","last_undegraded":"2020-02-11T16:05:39.842584+0000","last_fullsized":"2020-02-11T16:05:39.842584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.965927+0000","last_change":"2020-02-11T16:05:38.965473+0000","last_active":"2020-02-11T16:05:38.965927+0000","last_peered":"2020-02-11T16:05:38.965927+0000","last_clean":"2020-02-11T16:05:38.965927+0000","last_became_active":"2020-02-11T16:05:38.965054+0000","last_became_peered":"2020-02-11T16:05:38.965054+0000","last_unstale":"2020-02-11T16:05:38.965927+0000","last_undegraded":"2020-02-11T16:05:38.965927+0000","last_fullsized":"2020-02-11T16:05:38.965927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.131237+0000","last_change":"2020-02-11T16:05:33.372976+0000","last_active":"2020-02-11T16:05:39.131237+0000","last_peered":"2020-02-11T16:05:39.131237+0000","last_clean":"2020-02-11T16:05:39.131237+0000","last_became_active":"2020-02-11T16:05:33.372444+0000","last_became_peered":"2020-02-11T16:05:33.372444+0000","last_unstale":"2020-02-11T16:05:39.131237+0000","last_undegraded":"2020-02-11T16:05:39.131237+0000","last_fullsized":"2020-02-11T16:05:39.131237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"23'6","reported_seq":"17","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.999159+0000","last_change":"2020-02-11T16:05:35.954548+0000","last_active":"2020-02-11T16:05:41.999159+0000","last_peered":"2020-02-11T16:05:41.999159+0000","last_clean":"2020-02-11T16:05:41.999159+0000","last_became_active":"2020-02-11T16:05:35.954103+0000","last_became_peered":"2020-02-11T16:05:35.954103+0000","last_unstale":"2020-02-11T16:05:41.999159+0000","last_undegraded":"2020-02-11T16:05:41.999159+0000","last_fullsized":"2020-02-11T16:05:41.999159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133272+0000","last_change":"2020-02-11T16:05:39.132840+0000","last_active":"2020-02-11T16:05:39.133272+0000","last_peered":"2020-02-11T16:05:39.133272+0000","last_clean":"2020-02-11T16:05:39.133272+0000","last_became_active":"2020-02-11T16:05:39.132263+0000","last_became_peered":"2020-02-11T16:05:39.132263+0000","last_unstale":"2020-02-11T16:05:39.133272+0000","last_undegraded":"2020-02-11T16:05:39.133272+0000","last_fullsized":"2020-02-11T16:05:39.133272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.131385+0000","last_change":"2020-02-11T16:05:32.946664+0000","last_active":"2020-02-11T16:05:39.131385+0000","last_peered":"2020-02-11T16:05:39.131385+0000","last_clean":"2020-02-11T16:05:39.131385+0000","last_became_active":"2020-02-11T16:05:32.946378+0000","last_became_peered":"2020-02-11T16:05:32.946378+0000","last_unstale":"2020-02-11T16:05:39.131385+0000","last_undegraded":"2020-02-11T16:05:39.131385+0000","last_fullsized":"2020-02-11T16:05:39.131385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.998476+0000","last_change":"2020-02-11T16:05:35.952928+0000","last_active":"2020-02-11T16:05:41.998476+0000","last_peered":"2020-02-11T16:05:41.998476+0000","last_clean":"2020-02-11T16:05:41.998476+0000","last_became_active":"2020-02-11T16:05:35.952595+0000","last_became_peered":"2020-02-11T16:05:35.952595+0000","last_unstale":"2020-02-11T16:05:41.998476+0000","last_undegraded":"2020-02-11T16:05:41.998476+0000","last_fullsized":"2020-02-11T16:05:41.998476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":90093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":91053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":89401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":89401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-02-11T16:05:48.548 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-02-11T16:05:48.549 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-02-11T16:05:48.549 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-02-11T16:05:48.549 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-02-11T16:05:48.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.651+0000 7f1cd80d9700 1 Processor -- start 2020-02-11T16:05:48.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.651+0000 7f1cd80d9700 1 -- start start 2020-02-11T16:05:48.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.651+0000 7f1cd80d9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:48.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.651+0000 7f1cd80d9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1cd00a5de0 0x7f1cd00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:48.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.651+0000 7f1cd80d9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd00a31b0 con 0x7f1cd012e3a0 2020-02-11T16:05:48.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.651+0000 7f1cd80d9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd00a3570 con 0x7f1cd00a5de0 2020-02-11T16:05:48.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.651+0000 7f1cd80d9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd00a3810 con 0x7f1cd00a18a0 2020-02-11T16:05:48.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51890/0 (socket says 172.21.15.88:51890) 2020-02-11T16:05:48.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 -- 172.21.15.88:0/4217692679 learned_addr learned my addr 172.21.15.88:0/4217692679 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:48.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 -- 172.21.15.88:0/4217692679 >> v2:172.21.15.52:3300/0 conn(0x7f1cd00a5de0 msgr2=0x7f1cd00a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:48.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/4217692679 >> v2:172.21.15.52:3300/0 conn(0x7f1cd00a5de0 0x7f1cd00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:48.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 -- 172.21.15.88:0/4217692679 >> v1:172.21.15.52:6789/0 conn(0x7f1cd012e3a0 legacy=0x7f1cd012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:48.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 -- 172.21.15.88:0/4217692679 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd00a3ab0 con 0x7f1cd00a18a0 2020-02-11T16:05:48.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/4217692679 >> v2:172.21.15.88:3300/0 conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1cd005bbc0 tx=0x7f1cc8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/4217692679 >> v2:172.21.15.88:3300/0 conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1cd005bbc0 tx=0x7f1cc8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/4217692679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f1cd005bbc0 tx=0x7f1cc8007dc0).ready entity=mon.1 client_cookie=5836e83b18b6b323 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/4217692679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f1cd005bbc0 tx=0x7f1cc8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/4217692679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f1cd005bbc0 tx=0x7f1cc8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd4e73700 1 -- 172.21.15.88:0/4217692679 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc800a160 con 0x7f1cd00a18a0 2020-02-11T16:05:48.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/4217692679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f1cd005bbc0 tx=0x7f1cc8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd4e73700 1 -- 172.21.15.88:0/4217692679 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc800a2c0 con 0x7f1cd00a18a0 2020-02-11T16:05:48.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd4e73700 1 -- 172.21.15.88:0/4217692679 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc800a6a0 con 0x7f1cd00a18a0 2020-02-11T16:05:48.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd80d9700 1 -- 172.21.15.88:0/4217692679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a18a0 msgr2=0x7f1cd00a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.652+0000 7f1cd80d9700 1 --2- 172.21.15.88:0/4217692679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f1cd005bbc0 tx=0x7f1cc8007dc0).stop 2020-02-11T16:05:48.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.653+0000 7f1cd80d9700 1 -- 172.21.15.88:0/4217692679 shutdown_connections 2020-02-11T16:05:48.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.653+0000 7f1cd80d9700 1 --2- 172.21.15.88:0/4217692679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a18a0 0x7f1cd00a6dd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.653+0000 7f1cd80d9700 1 --2- 172.21.15.88:0/4217692679 >> v2:172.21.15.52:3300/0 conn(0x7f1cd00a5de0 0x7f1cd00a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:48.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.653+0000 7f1cd80d9700 1 -- 172.21.15.88:0/4217692679 >> 172.21.15.88:0/4217692679 conn(0x7f1cd009d110 msgr2=0x7f1cd009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:48.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.653+0000 7f1cd80d9700 1 -- 172.21.15.88:0/4217692679 shutdown_connections 2020-02-11T16:05:48.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.653+0000 7f1cd80d9700 1 -- 172.21.15.88:0/4217692679 wait complete. 2020-02-11T16:05:48.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd80d9700 1 Processor -- start 2020-02-11T16:05:48.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd80d9700 1 -- start start 2020-02-11T16:05:48.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd80d9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1cd00a18a0 0x7f1cd005aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd80d9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1cd00a5de0 0x7f1cd005b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd80d9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd005a5d0 con 0x7f1cd012e3a0 2020-02-11T16:05:48.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd80d9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd009e200 con 0x7f1cd00a18a0 2020-02-11T16:05:48.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd80d9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd009ed30 con 0x7f1cd00a5de0 2020-02-11T16:05:48.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd5674700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1cd00a5de0 0x7f1cd005b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd6676700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1cd012e3a0 0x7f1cd0146700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39520/0 (socket says 172.21.15.88:39520) 2020-02-11T16:05:48.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd6676700 1 -- 172.21.15.88:0/2890922300 learned_addr learned my addr 172.21.15.88:0/2890922300 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:48.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.654+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/2890922300 >> v2:172.21.15.52:3300/0 conn(0x7f1cd00a18a0 0x7f1cd005aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 -- 172.21.15.88:0/2890922300 >> v2:172.21.15.52:3300/0 conn(0x7f1cd00a18a0 msgr2=0x7f1cd005aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> v2:172.21.15.52:3300/0 conn(0x7f1cd00a18a0 0x7f1cd005aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cc2ffd700 1 -- 172.21.15.88:0/2890922300 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111647966 0 0) 0x7f1cd005a5d0 con 0x7f1cd012e3a0 2020-02-11T16:05:48.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 -- 172.21.15.88:0/2890922300 >> v1:172.21.15.88:6789/0 conn(0x7f1cd012e3a0 legacy=0x7f1cd0146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 -- 172.21.15.88:0/2890922300 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd005a800 con 0x7f1cd00a5de0 2020-02-11T16:05:48.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/2890922300 >> v2:172.21.15.52:3300/0 conn(0x7f1cd00a18a0 0x7f1cd005aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:48.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> v2:172.21.15.88:3300/0 conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> v2:172.21.15.88:3300/0 conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cc2ffd700 1 -- 172.21.15.88:0/2890922300 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc4005df0 con 0x7f1cd00a5de0 2020-02-11T16:05:48.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cc2ffd700 1 -- 172.21.15.88:0/2890922300 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc4007160 con 0x7f1cd00a5de0 2020-02-11T16:05:48.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd80d9700 1 -- 172.21.15.88:0/2890922300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd005b560 con 0x7f1cd00a5de0 2020-02-11T16:05:48.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cc2ffd700 1 -- 172.21.15.88:0/2890922300 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc4007500 con 0x7f1cd00a5de0 2020-02-11T16:05:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd80d9700 1 -- 172.21.15.88:0/2890922300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd0131e90 con 0x7f1cd00a5de0 2020-02-11T16:05:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.655+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.656+0000 7f1cc2ffd700 1 -- 172.21.15.88:0/2890922300 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f1cc4008980 con 0x7f1cd00a5de0 2020-02-11T16:05:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.656+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.656+0000 7f1cc2ffd700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1cb0039a80 0x7f1cb003bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.656+0000 7f1cc2ffd700 1 -- 172.21.15.88:0/2890922300 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f1cc40495c0 con 0x7f1cd00a5de0 2020-02-11T16:05:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.656+0000 7f1cd80d9700 1 -- 172.21.15.88:0/2890922300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd009e040 con 0x7f1cd00a5de0 2020-02-11T16:05:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.656+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1cb0039a80 0x7f1cb003bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.656+0000 7f1cd5e75700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1cb0039a80 0x7f1cb003bf40 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.659+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.659+0000 7f1cc2ffd700 1 -- 172.21.15.88:0/2890922300 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f1cc402ec50 con 0x7f1cd00a5de0 2020-02-11T16:05:48.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.841+0000 7f1cd80d9700 1 -- 172.21.15.88:0/2890922300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1cd00565b0 con 0x7f1cd00a5de0 2020-02-11T16:05:48.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.841+0000 7f1cd5674700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.841+0000 7f1cc2ffd700 1 -- 172.21.15.88:0/2890922300 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f1cc4031740 con 0x7f1cd00a5de0 2020-02-11T16:05:48.844 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:48.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 -- 172.21.15.88:0/2890922300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1cb0039a80 msgr2=0x7f1cb003bf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1cb0039a80 0x7f1cb003bf40 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 -- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 msgr2=0x7f1cd005b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 0x7f1cd005b100 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f1cc4002f30 tx=0x7f1cc4010930).stop 2020-02-11T16:05:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 -- 172.21.15.88:0/2890922300 shutdown_connections 2020-02-11T16:05:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1cb0039a80 0x7f1cb003bf40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 --2- 172.21.15.88:0/2890922300 >> v2:172.21.15.52:3300/0 conn(0x7f1cd00a18a0 0x7f1cd005aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 --2- 172.21.15.88:0/2890922300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cd00a5de0 0x7f1cd005b100 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 -- 172.21.15.88:0/2890922300 >> 172.21.15.88:0/2890922300 conn(0x7f1cd009d110 msgr2=0x7f1cd00a6240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:48.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 -- 172.21.15.88:0/2890922300 shutdown_connections 2020-02-11T16:05:48.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.842+0000 7f1cd80d9700 1 -- 172.21.15.88:0/2890922300 wait complete. 2020-02-11T16:05:48.855 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-02-11T16:05:48.855 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-02-11T16:05:48.856 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.958+0000 7fbca694f700 1 Processor -- start 2020-02-11T16:05:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.958+0000 7fbca694f700 1 -- start start 2020-02-11T16:05:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.959+0000 7fbca694f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbca00a73d0 0x7fbca00a2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.959+0000 7fbca694f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbca013b8f0 0x7fbca0142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:48.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.959+0000 7fbca694f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca00a2cd0 con 0x7fbca00a6ff0 2020-02-11T16:05:48.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.959+0000 7fbca694f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca0132460 con 0x7fbca013b8f0 2020-02-11T16:05:48.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.959+0000 7fbca694f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca00a8630 con 0x7fbca00a73d0 2020-02-11T16:05:48.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.959+0000 7fbc9f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbca00a73d0 0x7fbca00a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.959+0000 7fbc9ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbca00a6ff0 0x7fbca013b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39526/0 (socket says 172.21.15.88:39526) 2020-02-11T16:05:48.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.959+0000 7fbc9ffff700 1 -- 172.21.15.88:0/129705393 learned_addr learned my addr 172.21.15.88:0/129705393 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:48.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.959+0000 7fbca4eec700 1 --2- 172.21.15.88:0/129705393 >> v2:172.21.15.52:3300/0 conn(0x7fbca013b8f0 0x7fbca0142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9f7fe700 1 -- 172.21.15.88:0/129705393 >> v2:172.21.15.52:3300/0 conn(0x7fbca013b8f0 msgr2=0x7fbca0142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:48.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9f7fe700 1 --2- 172.21.15.88:0/129705393 >> v2:172.21.15.52:3300/0 conn(0x7fbca013b8f0 0x7fbca0142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9f7fe700 1 -- 172.21.15.88:0/129705393 >> v1:172.21.15.88:6789/0 conn(0x7fbca00a6ff0 legacy=0x7fbca013b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9effd700 1 -- 172.21.15.88:0/129705393 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989280267 0 0) 0x7fbca00a2cd0 con 0x7fbca00a6ff0 2020-02-11T16:05:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9f7fe700 1 -- 172.21.15.88:0/129705393 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca00a30c0 con 0x7fbca00a73d0 2020-02-11T16:05:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9f7fe700 1 --2- 172.21.15.88:0/129705393 >> v2:172.21.15.88:3300/0 conn(0x7fbca00a73d0 0x7fbca00a2870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc94002f30 tx=0x7fbc94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9f7fe700 1 --2- 172.21.15.88:0/129705393 >> v2:172.21.15.88:3300/0 conn(0x7fbca00a73d0 0x7fbca00a2870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc94002f30 tx=0x7fbc94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9f7fe700 1 --2- 172.21.15.88:0/129705393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a73d0 0x7fbca00a2870 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fbc94002f30 tx=0x7fbc94007a40).ready entity=mon.1 client_cookie=188935c3ce2d317a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9f7fe700 1 --2- 172.21.15.88:0/129705393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a73d0 0x7fbca00a2870 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fbc94002f30 tx=0x7fbc94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9effd700 1 -- 172.21.15.88:0/129705393 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc94011470 con 0x7fbca00a73d0 2020-02-11T16:05:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9f7fe700 1 --2- 172.21.15.88:0/129705393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a73d0 0x7fbca00a2870 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fbc94002f30 tx=0x7fbc94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9effd700 1 -- 172.21.15.88:0/129705393 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc940115d0 con 0x7fbca00a73d0 2020-02-11T16:05:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9f7fe700 1 --2- 172.21.15.88:0/129705393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a73d0 0x7fbca00a2870 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fbc94002f30 tx=0x7fbc94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbc9effd700 1 -- 172.21.15.88:0/129705393 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc94011970 con 0x7fbca00a73d0 2020-02-11T16:05:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbca694f700 1 -- 172.21.15.88:0/129705393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a73d0 msgr2=0x7fbca00a2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbca694f700 1 --2- 172.21.15.88:0/129705393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a73d0 0x7fbca00a2870 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fbc94002f30 tx=0x7fbc94007a40).stop 2020-02-11T16:05:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbca694f700 1 -- 172.21.15.88:0/129705393 shutdown_connections 2020-02-11T16:05:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbca694f700 1 --2- 172.21.15.88:0/129705393 >> v2:172.21.15.52:3300/0 conn(0x7fbca013b8f0 0x7fbca0142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbca694f700 1 --2- 172.21.15.88:0/129705393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a73d0 0x7fbca00a2870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbca694f700 1 -- 172.21.15.88:0/129705393 >> 172.21.15.88:0/129705393 conn(0x7fbca00ac2d0 msgr2=0x7fbca00ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbca694f700 1 -- 172.21.15.88:0/129705393 shutdown_connections 2020-02-11T16:05:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.960+0000 7fbca694f700 1 -- 172.21.15.88:0/129705393 wait complete. 2020-02-11T16:05:48.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.961+0000 7fbca694f700 1 Processor -- start 2020-02-11T16:05:48.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.961+0000 7fbca694f700 1 -- start start 2020-02-11T16:05:48.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbca694f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbca00a6ff0 0x7fbca01349a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbca694f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbca00a73d0 0x7fbca00a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbca694f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca0134030 con 0x7fbca013b8f0 2020-02-11T16:05:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbca694f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca0131800 con 0x7fbca00a6ff0 2020-02-11T16:05:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbca694f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca00a3870 con 0x7fbca00a73d0 2020-02-11T16:05:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbca00a6ff0 0x7fbca01349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbca00a6ff0 0x7fbca01349a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51906/0 (socket says 172.21.15.88:51906) 2020-02-11T16:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 -- 172.21.15.88:0/2102303071 learned_addr learned my addr 172.21.15.88:0/2102303071 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9f7fe700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbca00a73d0 0x7fbca00a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 -- 172.21.15.88:0/2102303071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbca00a73d0 msgr2=0x7fbca00a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbca00a73d0 0x7fbca00a3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 -- 172.21.15.88:0/2102303071 >> v1:172.21.15.52:6789/0 conn(0x7fbca013b8f0 legacy=0x7fbca01310f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 -- 172.21.15.88:0/2102303071 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0131a50 con 0x7fbca00a6ff0 2020-02-11T16:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> v2:172.21.15.88:3300/0 conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> v2:172.21.15.88:3300/0 conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9d7fa700 1 -- 172.21.15.88:0/2102303071 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc90005ca0 con 0x7fbca00a6ff0 2020-02-11T16:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.962+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.963+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.963+0000 7fbc9d7fa700 1 -- 172.21.15.88:0/2102303071 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc90005e00 con 0x7fbca00a6ff0 2020-02-11T16:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.963+0000 7fbca694f700 1 -- 172.21.15.88:0/2102303071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca0134260 con 0x7fbca00a6ff0 2020-02-11T16:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.963+0000 7fbc9d7fa700 1 -- 172.21.15.88:0/2102303071 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc900062b0 con 0x7fbca00a6ff0 2020-02-11T16:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.963+0000 7fbca694f700 1 -- 172.21.15.88:0/2102303071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca00a1650 con 0x7fbca00a6ff0 2020-02-11T16:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.963+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.963+0000 7fbc9d7fa700 1 -- 172.21.15.88:0/2102303071 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fbc90006520 con 0x7fbca00a6ff0 2020-02-11T16:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.963+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.963+0000 7fbca694f700 1 -- 172.21.15.88:0/2102303071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca00a3a10 con 0x7fbca00a6ff0 2020-02-11T16:05:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.964+0000 7fbc9d7fa700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbc80039bc0 0x7fbc8003c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.964+0000 7fbc9d7fa700 1 -- 172.21.15.88:0/2102303071 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbc900499d0 con 0x7fbca00a6ff0 2020-02-11T16:05:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.964+0000 7fbc9f7fe700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbc80039bc0 0x7fbc8003c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.964+0000 7fbc9f7fe700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbc80039bc0 0x7fbc8003c080 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.967+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:48.967+0000 7fbc9d7fa700 1 -- 172.21.15.88:0/2102303071 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbc9002efa0 con 0x7fbca00a6ff0 2020-02-11T16:05:49.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.103+0000 7fbca694f700 1 -- 172.21.15.88:0/2102303071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbca00565b0 con 0x7fbca00a6ff0 2020-02-11T16:05:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.104+0000 7fbc9ffff700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.104+0000 7fbc9d7fa700 1 -- 172.21.15.88:0/2102303071 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14885 (secure 0 0 0) 0x7fbc90031ab0 con 0x7fbca00a6ff0 2020-02-11T16:05:49.107 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:49.107 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:39.282613+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-11T16:05:34.022912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-11T16:05:36.964421+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:49.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.105+0000 7fbca694f700 1 -- 172.21.15.88:0/2102303071 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbc80039bc0 msgr2=0x7fbc8003c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.105+0000 7fbca694f700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbc80039bc0 0x7fbc8003c080 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.105+0000 7fbca694f700 1 -- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 msgr2=0x7fbca01349a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.105+0000 7fbca694f700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 0x7fbca01349a0 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fbc90000b80 tx=0x7fbc90010960).stop 2020-02-11T16:05:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.105+0000 7fbca694f700 1 -- 172.21.15.88:0/2102303071 shutdown_connections 2020-02-11T16:05:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.105+0000 7fbca694f700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbc80039bc0 0x7fbc8003c080 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.105+0000 7fbca694f700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbca00a6ff0 0x7fbca01349a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.105+0000 7fbca694f700 1 --2- 172.21.15.88:0/2102303071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbca00a73d0 0x7fbca00a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.105+0000 7fbca694f700 1 -- 172.21.15.88:0/2102303071 >> 172.21.15.88:0/2102303071 conn(0x7fbca00ac2d0 msgr2=0x7fbca0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:49.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.105+0000 7fbca694f700 1 -- 172.21.15.88:0/2102303071 shutdown_connections 2020-02-11T16:05:49.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.106+0000 7fbca694f700 1 -- 172.21.15.88:0/2102303071 wait complete. 2020-02-11T16:05:49.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:30.979083+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:34.022912+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:36.964421+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-11T16:05:49.120 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-11T16:05:49.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.226+0000 7f76e7ee1700 1 Processor -- start 2020-02-11T16:05:49.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.226+0000 7f76e7ee1700 1 -- start start 2020-02-11T16:05:49.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e7ee1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f76e005f430 0x7f76e009d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:49.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e7ee1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e009d770 con 0x7f76e00a5fa0 2020-02-11T16:05:49.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e7ee1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e009da10 con 0x7f76e00abc90 2020-02-11T16:05:49.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e7ee1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e009d570 con 0x7f76e005f430 2020-02-11T16:05:49.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e5c7d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f76e00abc90 0x7f76e005ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39540/0 (socket says 172.21.15.88:39540) 2020-02-11T16:05:49.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e5c7d700 1 -- 172.21.15.88:0/2344578901 learned_addr learned my addr 172.21.15.88:0/2344578901 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:49.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e547c700 1 --2- 172.21.15.88:0/2344578901 >> v2:172.21.15.52:3300/0 conn(0x7f76e005f430 0x7f76e009d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301412304 0 0) 0x7f76e009da10 con 0x7f76e00abc90 2020-02-11T16:05:49.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c8003230 con 0x7f76e00abc90 2020-02-11T16:05:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3595320615 0 0) 0x7f76c8003230 con 0x7f76e00abc90 2020-02-11T16:05:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 >> v2:172.21.15.52:3300/0 conn(0x7f76e005f430 msgr2=0x7f76e009d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 --2- 172.21.15.88:0/2344578901 >> v2:172.21.15.52:3300/0 conn(0x7f76e005f430 0x7f76e009d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 >> v1:172.21.15.52:6789/0 conn(0x7f76e00a5fa0 legacy=0x7f76e012f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e012fa50 con 0x7f76e00abc90 2020-02-11T16:05:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f76dc0016d0 con 0x7f76e00abc90 2020-02-11T16:05:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 >> v1:172.21.15.88:6789/0 conn(0x7f76e00abc90 legacy=0x7f76e005ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76c8003720 0x7f76c8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76c80044d0 0x7f76c8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 0x7f76c800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e009d570 con 0x7f76c80044d0 2020-02-11T16:05:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c80041c0 con 0x7f76c8004db0 2020-02-11T16:05:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c800bb80 con 0x7f76c8003720 2020-02-11T16:05:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e647e700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 0x7f76c800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e547c700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76c80044d0 0x7f76c8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.227+0000 7f76e5c7d700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76c8003720 0x7f76c8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 -- 172.21.15.88:0/2344578901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76c8003720 msgr2=0x7f76c8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76c8003720 0x7f76c8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 -- 172.21.15.88:0/2344578901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76c80044d0 msgr2=0x7f76c8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76c80044d0 0x7f76c8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 -- 172.21.15.88:0/2344578901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c8003230 con 0x7f76c8004db0 2020-02-11T16:05:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e5c7d700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76c8003720 0x7f76c8003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 0x7f76c800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76c80054a0 tx=0x7f76d80100c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 -- 172.21.15.88:0/2344578901 reap_dead start 2020-02-11T16:05:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 0x7f76c800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76c80054a0 tx=0x7f76d80100c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 0x7f76c800b720 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f76c80054a0 tx=0x7f76d80100c0).ready entity=mon.1 client_cookie=899ff9efa5262671 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 0x7f76c800b720 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f76c80054a0 tx=0x7f76d80100c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76d8006c40 con 0x7f76c8004db0 2020-02-11T16:05:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 0x7f76c800b720 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f76c80054a0 tx=0x7f76d80100c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d8006da0 con 0x7f76c8004db0 2020-02-11T16:05:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e647e700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 0x7f76c800b720 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f76c80054a0 tx=0x7f76d80100c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e4c7b700 1 -- 172.21.15.88:0/2344578901 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76d8002730 con 0x7f76c8004db0 2020-02-11T16:05:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e7ee1700 1 -- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 msgr2=0x7f76c800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e7ee1700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 0x7f76c800b720 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f76c80054a0 tx=0x7f76d80100c0).stop 2020-02-11T16:05:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e7ee1700 1 -- 172.21.15.88:0/2344578901 shutdown_connections 2020-02-11T16:05:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e7ee1700 1 --2- 172.21.15.88:0/2344578901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c8004db0 0x7f76c800b720 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e7ee1700 1 -- 172.21.15.88:0/2344578901 >> 172.21.15.88:0/2344578901 conn(0x7f76e0061890 msgr2=0x7f76e00ab200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e7ee1700 1 -- 172.21.15.88:0/2344578901 shutdown_connections 2020-02-11T16:05:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.228+0000 7f76e7ee1700 1 -- 172.21.15.88:0/2344578901 wait complete. 2020-02-11T16:05:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.229+0000 7f76e7ee1700 1 Processor -- start 2020-02-11T16:05:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.229+0000 7f76e7ee1700 1 -- start start 2020-02-11T16:05:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e7ee1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76e01437b0 0x7f76e0130bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e7ee1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e00a10f0 con 0x7f76e012c570 2020-02-11T16:05:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e7ee1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e0132900 con 0x7f76c8004db0 2020-02-11T16:05:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e7ee1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e00a1350 con 0x7f76e01437b0 2020-02-11T16:05:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e5c7d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f76c8004db0 0x7f76e01430a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39552/0 (socket says 172.21.15.88:39552) 2020-02-11T16:05:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e547c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76e01437b0 0x7f76e0130bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e5c7d700 1 -- 172.21.15.88:0/1315429638 learned_addr learned my addr 172.21.15.88:0/1315429638 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76ceffd700 1 -- 172.21.15.88:0/1315429638 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860531473 0 0) 0x7f76e0132900 con 0x7f76c8004db0 2020-02-11T16:05:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e547c700 1 -- 172.21.15.88:0/1315429638 >> v1:172.21.15.88:6789/0 conn(0x7f76c8004db0 legacy=0x7f76e01430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e547c700 1 -- 172.21.15.88:0/1315429638 >> v1:172.21.15.52:6789/0 conn(0x7f76e012c570 legacy=0x7f76e012c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e547c700 1 -- 172.21.15.88:0/1315429638 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00a1580 con 0x7f76e01437b0 2020-02-11T16:05:49.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e547c700 1 --2- 172.21.15.88:0/1315429638 >> v2:172.21.15.88:3300/0 conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e547c700 1 --2- 172.21.15.88:0/1315429638 >> v2:172.21.15.88:3300/0 conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e547c700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:49.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e547c700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76ceffd700 1 -- 172.21.15.88:0/1315429638 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76d0005aa0 con 0x7f76e01437b0 2020-02-11T16:05:49.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e547c700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e547c700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76ceffd700 1 -- 172.21.15.88:0/1315429638 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d0005c00 con 0x7f76e01437b0 2020-02-11T16:05:49.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76e7ee1700 1 -- 172.21.15.88:0/1315429638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e00ab3d0 con 0x7f76e01437b0 2020-02-11T16:05:49.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.230+0000 7f76ceffd700 1 -- 172.21.15.88:0/1315429638 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76d0008410 con 0x7f76e01437b0 2020-02-11T16:05:49.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.231+0000 7f76e7ee1700 1 -- 172.21.15.88:0/1315429638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e00a0bb0 con 0x7f76e01437b0 2020-02-11T16:05:49.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.231+0000 7f76e547c700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.231+0000 7f76ceffd700 1 -- 172.21.15.88:0/1315429638 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f76d0007140 con 0x7f76e01437b0 2020-02-11T16:05:49.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.231+0000 7f76e547c700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.231+0000 7f76ceffd700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0039a30 0x7f76c003bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:49.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.231+0000 7f76ceffd700 1 -- 172.21.15.88:0/1315429638 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f76d0049510 con 0x7f76e01437b0 2020-02-11T16:05:49.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.232+0000 7f76e7ee1700 1 -- 172.21.15.88:0/1315429638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e0132740 con 0x7f76e01437b0 2020-02-11T16:05:49.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.232+0000 7f76e5c7d700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0039a30 0x7f76c003bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.232+0000 7f76e5c7d700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0039a30 0x7f76c003bef0 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:49.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.235+0000 7f76e547c700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.235+0000 7f76ceffd700 1 -- 172.21.15.88:0/1315429638 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f76d002eba0 con 0x7f76e01437b0 2020-02-11T16:05:49.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.369+0000 7f76e7ee1700 1 -- 172.21.15.88:0/1315429638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f76e00565b0 con 0x7f76e01437b0 2020-02-11T16:05:49.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.369+0000 7f76e547c700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.369+0000 7f76ceffd700 1 -- 172.21.15.88:0/1315429638 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76d0031650 con 0x7f76e01437b0 2020-02-11T16:05:49.372 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:49.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.370+0000 7f76e7ee1700 1 -- 172.21.15.88:0/1315429638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0039a30 msgr2=0x7f76c003bef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.370+0000 7f76e7ee1700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0039a30 0x7f76c003bef0 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.370+0000 7f76e7ee1700 1 -- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 msgr2=0x7f76e0130bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.370+0000 7f76e7ee1700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 0x7f76e0130bc0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f76e0132110 tx=0x7f76d0010ad0).stop 2020-02-11T16:05:49.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.370+0000 7f76e7ee1700 1 -- 172.21.15.88:0/1315429638 shutdown_connections 2020-02-11T16:05:49.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.370+0000 7f76e7ee1700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0039a30 0x7f76c003bef0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.370+0000 7f76e7ee1700 1 --2- 172.21.15.88:0/1315429638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e01437b0 0x7f76e0130bc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.370+0000 7f76e7ee1700 1 -- 172.21.15.88:0/1315429638 >> 172.21.15.88:0/1315429638 conn(0x7f76e0061890 msgr2=0x7f76e0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:49.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.370+0000 7f76e7ee1700 1 -- 172.21.15.88:0/1315429638 shutdown_connections 2020-02-11T16:05:49.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.370+0000 7f76e7ee1700 1 -- 172.21.15.88:0/1315429638 wait complete. 2020-02-11T16:05:49.383 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-11T16:05:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.487+0000 7f2b648ea700 1 Processor -- start 2020-02-11T16:05:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.487+0000 7f2b648ea700 1 -- start start 2020-02-11T16:05:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b648ea700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b600a28a0 0x7f2b600a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:49.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b648ea700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b6009aef0 0x7f2b600a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:49.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b648ea700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b600a4160 con 0x7f2b6005b960 2020-02-11T16:05:49.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b648ea700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6009d950 con 0x7f2b6009aef0 2020-02-11T16:05:49.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b648ea700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6009dbf0 con 0x7f2b600a28a0 2020-02-11T16:05:49.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b600a28a0 0x7f2b600a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5e59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2b6005b960 0x7f2b60138250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39560/0 (socket says 172.21.15.88:39560) 2020-02-11T16:05:49.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5e59c700 1 -- 172.21.15.88:0/3842598758 learned_addr learned my addr 172.21.15.88:0/3842598758 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5ed9d700 1 --2- 172.21.15.88:0/3842598758 >> v2:172.21.15.52:3300/0 conn(0x7f2b6009aef0 0x7f2b600a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 -- 172.21.15.88:0/3842598758 >> v2:172.21.15.52:3300/0 conn(0x7f2b6009aef0 msgr2=0x7f2b600a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 --2- 172.21.15.88:0/3842598758 >> v2:172.21.15.52:3300/0 conn(0x7f2b6009aef0 0x7f2b600a5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 -- 172.21.15.88:0/3842598758 >> v1:172.21.15.88:6789/0 conn(0x7f2b6005b960 legacy=0x7f2b60138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 -- 172.21.15.88:0/3842598758 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600a60c0 con 0x7f2b600a28a0 2020-02-11T16:05:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5d59a700 1 -- 172.21.15.88:0/3842598758 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840546181 0 0) 0x7f2b600a4160 con 0x7f2b6005b960 2020-02-11T16:05:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 --2- 172.21.15.88:0/3842598758 >> v2:172.21.15.88:3300/0 conn(0x7f2b600a28a0 0x7f2b600a67e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b50002f30 tx=0x7f2b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 --2- 172.21.15.88:0/3842598758 >> v2:172.21.15.88:3300/0 conn(0x7f2b600a28a0 0x7f2b600a67e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b50002f30 tx=0x7f2b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 --2- 172.21.15.88:0/3842598758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a28a0 0x7f2b600a67e0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f2b50002f30 tx=0x7f2b50007a40).ready entity=mon.1 client_cookie=bdb5fa61f5bd561d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 --2- 172.21.15.88:0/3842598758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a28a0 0x7f2b600a67e0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f2b50002f30 tx=0x7f2b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5d59a700 1 -- 172.21.15.88:0/3842598758 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b50011470 con 0x7f2b600a28a0 2020-02-11T16:05:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 --2- 172.21.15.88:0/3842598758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a28a0 0x7f2b600a67e0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f2b50002f30 tx=0x7f2b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5dd9b700 1 --2- 172.21.15.88:0/3842598758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a28a0 0x7f2b600a67e0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f2b50002f30 tx=0x7f2b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5d59a700 1 -- 172.21.15.88:0/3842598758 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b500115d0 con 0x7f2b600a28a0 2020-02-11T16:05:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b5d59a700 1 -- 172.21.15.88:0/3842598758 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b50011970 con 0x7f2b600a28a0 2020-02-11T16:05:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b648ea700 1 -- 172.21.15.88:0/3842598758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a28a0 msgr2=0x7f2b600a67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.488+0000 7f2b648ea700 1 --2- 172.21.15.88:0/3842598758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a28a0 0x7f2b600a67e0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f2b50002f30 tx=0x7f2b50007a40).stop 2020-02-11T16:05:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.489+0000 7f2b648ea700 1 -- 172.21.15.88:0/3842598758 shutdown_connections 2020-02-11T16:05:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.489+0000 7f2b648ea700 1 --2- 172.21.15.88:0/3842598758 >> v2:172.21.15.52:3300/0 conn(0x7f2b6009aef0 0x7f2b600a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.489+0000 7f2b648ea700 1 --2- 172.21.15.88:0/3842598758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a28a0 0x7f2b600a67e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.489+0000 7f2b648ea700 1 -- 172.21.15.88:0/3842598758 >> 172.21.15.88:0/3842598758 conn(0x7f2b600aac40 msgr2=0x7f2b600a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.489+0000 7f2b648ea700 1 -- 172.21.15.88:0/3842598758 shutdown_connections 2020-02-11T16:05:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.489+0000 7f2b648ea700 1 -- 172.21.15.88:0/3842598758 wait complete. 2020-02-11T16:05:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b648ea700 1 Processor -- start 2020-02-11T16:05:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b648ea700 1 -- start start 2020-02-11T16:05:49.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b648ea700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b6005b960 0x7f2b60135200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:49.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b648ea700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b6009aef0 0x7f2b60146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:49.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b648ea700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6012d760 con 0x7f2b600a28a0 2020-02-11T16:05:49.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b648ea700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6012da00 con 0x7f2b6005b960 2020-02-11T16:05:49.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b648ea700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6012dca0 con 0x7f2b6009aef0 2020-02-11T16:05:49.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b5e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b6005b960 0x7f2b60135200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b5ed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2b600a28a0 0x7f2b60099bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39570/0 (socket says 172.21.15.88:39570) 2020-02-11T16:05:49.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b5e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b6005b960 0x7f2b60135200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51940/0 (socket says 172.21.15.88:51940) 2020-02-11T16:05:49.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.490+0000 7f2b5ed9d700 1 -- 172.21.15.88:0/2544319031 learned_addr learned my addr 172.21.15.88:0/2544319031 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:49.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5dd9b700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b6009aef0 0x7f2b60146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 -- 172.21.15.88:0/2544319031 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b6009aef0 msgr2=0x7f2b60146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b6009aef0 0x7f2b60146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 -- 172.21.15.88:0/2544319031 >> v1:172.21.15.88:6789/0 conn(0x7f2b600a28a0 legacy=0x7f2b60099bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b4f7fe700 1 -- 172.21.15.88:0/2544319031 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157590863 0 0) 0x7f2b6012d760 con 0x7f2b600a28a0 2020-02-11T16:05:49.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 -- 172.21.15.88:0/2544319031 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6012ca50 con 0x7f2b6005b960 2020-02-11T16:05:49.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> v2:172.21.15.88:3300/0 conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> v2:172.21.15.88:3300/0 conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:49.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b4f7fe700 1 -- 172.21.15.88:0/2544319031 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b54005ca0 con 0x7f2b6005b960 2020-02-11T16:05:49.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b4f7fe700 1 -- 172.21.15.88:0/2544319031 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54005e00 con 0x7f2b6005b960 2020-02-11T16:05:49.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b648ea700 1 -- 172.21.15.88:0/2544319031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b60135660 con 0x7f2b6005b960 2020-02-11T16:05:49.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b4f7fe700 1 -- 172.21.15.88:0/2544319031 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b540062b0 con 0x7f2b6005b960 2020-02-11T16:05:49.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b648ea700 1 -- 172.21.15.88:0/2544319031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b601328f0 con 0x7f2b6005b960 2020-02-11T16:05:49.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.491+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.492+0000 7f2b4f7fe700 1 -- 172.21.15.88:0/2544319031 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f2b540064f0 con 0x7f2b6005b960 2020-02-11T16:05:49.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.492+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.492+0000 7f2b4f7fe700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039be0 0x7f2b3c03c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:49.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.492+0000 7f2b4f7fe700 1 -- 172.21.15.88:0/2544319031 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2b54049970 con 0x7f2b6005b960 2020-02-11T16:05:49.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.492+0000 7f2b648ea700 1 -- 172.21.15.88:0/2544319031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b600565b0 con 0x7f2b6005b960 2020-02-11T16:05:49.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.492+0000 7f2b5dd9b700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039be0 0x7f2b3c03c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.492+0000 7f2b5dd9b700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039be0 0x7f2b3c03c0a0 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:49.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.496+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.496+0000 7f2b4f7fe700 1 -- 172.21.15.88:0/2544319031 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f2b5402ef80 con 0x7f2b6005b960 2020-02-11T16:05:49.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.630+0000 7f2b648ea700 1 -- 172.21.15.88:0/2544319031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b600a6400 con 0x7f2b6005b960 2020-02-11T16:05:49.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.631+0000 7f2b5e59c700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.631+0000 7f2b4f7fe700 1 -- 172.21.15.88:0/2544319031 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2b54031a90 con 0x7f2b6005b960 2020-02-11T16:05:49.634 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 -- 172.21.15.88:0/2544319031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039be0 msgr2=0x7f2b3c03c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039be0 0x7f2b3c03c0a0 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 -- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 msgr2=0x7f2b60135200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 0x7f2b60135200 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f2b54000b80 tx=0x7f2b540109b0).stop 2020-02-11T16:05:49.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 -- 172.21.15.88:0/2544319031 shutdown_connections 2020-02-11T16:05:49.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039be0 0x7f2b3c03c0a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b6005b960 0x7f2b60135200 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 --2- 172.21.15.88:0/2544319031 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b6009aef0 0x7f2b60146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 -- 172.21.15.88:0/2544319031 >> 172.21.15.88:0/2544319031 conn(0x7f2b600aac40 msgr2=0x7f2b60131e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 -- 172.21.15.88:0/2544319031 shutdown_connections 2020-02-11T16:05:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.632+0000 7f2b648ea700 1 -- 172.21.15.88:0/2544319031 wait complete. 2020-02-11T16:05:49.645 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-11T16:05:49.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.750+0000 7fe27e5bb700 1 Processor -- start 2020-02-11T16:05:49.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.750+0000 7fe27e5bb700 1 -- start start 2020-02-11T16:05:49.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe27e5bb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe27805b960 0x7fe2780a3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:49.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe27e5bb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2780a65e0 con 0x7fe2780a5e00 2020-02-11T16:05:49.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe27e5bb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27809ba80 con 0x7fe2780a3c60 2020-02-11T16:05:49.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe27e5bb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27809ad70 con 0x7fe27805b960 2020-02-11T16:05:49.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe27cb58700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe2780a3c60 0x7fe278140620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39576/0 (socket says 172.21.15.88:39576) 2020-02-11T16:05:49.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe27cb58700 1 -- 172.21.15.88:0/4167322310 learned_addr learned my addr 172.21.15.88:0/4167322310 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:49.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505311888 0 0) 0x7fe27809ba80 con 0x7fe2780a3c60 2020-02-11T16:05:49.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe264003230 con 0x7fe2780a3c60 2020-02-11T16:05:49.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> v2:172.21.15.52:3300/0 conn(0x7fe27805b960 0x7fe2780a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3735363041 0 0) 0x7fe264003230 con 0x7fe2780a3c60 2020-02-11T16:05:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 >> v2:172.21.15.52:3300/0 conn(0x7fe27805b960 msgr2=0x7fe2780a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe276ffd700 1 --2- 172.21.15.88:0/4167322310 >> v2:172.21.15.52:3300/0 conn(0x7fe27805b960 0x7fe2780a3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 >> v1:172.21.15.52:6789/0 conn(0x7fe2780a5e00 legacy=0x7fe278132c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27809bd20 con 0x7fe2780a3c60 2020-02-11T16:05:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe270001a50 con 0x7fe2780a3c60 2020-02-11T16:05:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> v2:172.21.15.52:3300/0 conn(0x7fe27805b960 0x7fe2780a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 >> v1:172.21.15.88:6789/0 conn(0x7fe2780a3c60 legacy=0x7fe278140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.751+0000 7fe276ffd700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 0x7fe264003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe276ffd700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe264004090 0x7fe264004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe276ffd700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe264004ae0 0x7fe264004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27809ad70 con 0x7fe264004090 2020-02-11T16:05:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26400b8b0 con 0x7fe264003720 2020-02-11T16:05:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26400ba70 con 0x7fe264004ae0 2020-02-11T16:05:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 0x7fe264003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe2777fe700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe264004090 0x7fe264004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe27cb58700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe264004ae0 0x7fe264004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 -- 172.21.15.88:0/4167322310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe264004ae0 msgr2=0x7fe264004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe264004ae0 0x7fe264004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 -- 172.21.15.88:0/4167322310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe264004090 msgr2=0x7fe264004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe264004090 0x7fe264004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe27cb58700 1 -- 172.21.15.88:0/4167322310 reap_dead start 2020-02-11T16:05:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 -- 172.21.15.88:0/4167322310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264003230 con 0x7fe264003720 2020-02-11T16:05:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 0x7fe264003b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe268002f30 tx=0x7fe26800ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 0x7fe264003b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe268002f30 tx=0x7fe26800ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 0x7fe264003b20 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fe268002f30 tx=0x7fe26800ff30).ready entity=mon.1 client_cookie=6694726b9d78cdb server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 0x7fe264003b20 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fe268002f30 tx=0x7fe26800ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 0x7fe264003b20 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fe268002f30 tx=0x7fe26800ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe268008d10 con 0x7fe264003720 2020-02-11T16:05:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe277fff700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 0x7fe264003b20 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fe268002f30 tx=0x7fe26800ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe268008e70 con 0x7fe264003720 2020-02-11T16:05:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe276ffd700 1 -- 172.21.15.88:0/4167322310 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe268010a50 con 0x7fe264003720 2020-02-11T16:05:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe27e5bb700 1 -- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 msgr2=0x7fe264003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.752+0000 7fe27e5bb700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 0x7fe264003b20 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fe268002f30 tx=0x7fe26800ff30).stop 2020-02-11T16:05:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.753+0000 7fe27e5bb700 1 -- 172.21.15.88:0/4167322310 shutdown_connections 2020-02-11T16:05:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.753+0000 7fe27e5bb700 1 --2- 172.21.15.88:0/4167322310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe264003720 0x7fe264003b20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.753+0000 7fe27e5bb700 1 -- 172.21.15.88:0/4167322310 >> 172.21.15.88:0/4167322310 conn(0x7fe2780aac40 msgr2=0x7fe2780a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.753+0000 7fe27e5bb700 1 -- 172.21.15.88:0/4167322310 shutdown_connections 2020-02-11T16:05:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.753+0000 7fe27e5bb700 1 -- 172.21.15.88:0/4167322310 wait complete. 2020-02-11T16:05:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.753+0000 7fe27e5bb700 1 Processor -- start 2020-02-11T16:05:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.753+0000 7fe27e5bb700 1 -- start start 2020-02-11T16:05:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.754+0000 7fe27e5bb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe27812cc00 0x7fe27812e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.754+0000 7fe27e5bb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe27809a4f0 0x7fe27812c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.754+0000 7fe27e5bb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe278132680 con 0x7fe264003720 2020-02-11T16:05:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.754+0000 7fe27e5bb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe278132920 con 0x7fe27809a4f0 2020-02-11T16:05:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.754+0000 7fe27e5bb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2780a4850 con 0x7fe27812cc00 2020-02-11T16:05:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.754+0000 7fe27cb58700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe27809a4f0 0x7fe27812c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.754+0000 7fe27cb58700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe27809a4f0 0x7fe27812c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51962/0 (socket says 172.21.15.88:51962) 2020-02-11T16:05:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.754+0000 7fe27cb58700 1 -- 172.21.15.88:0/1440609931 learned_addr learned my addr 172.21.15.88:0/1440609931 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.754+0000 7fe2777fe700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe27812cc00 0x7fe27812e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 -- 172.21.15.88:0/1440609931 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe27812cc00 msgr2=0x7fe27812e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe27812cc00 0x7fe27812e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 -- 172.21.15.88:0/1440609931 >> v1:172.21.15.52:6789/0 conn(0x7fe264003720 legacy=0x7fe278099de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe2757fa700 1 -- 172.21.15.88:0/1440609931 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316310778 0 0) 0x7fe278132680 con 0x7fe264003720 2020-02-11T16:05:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 -- 172.21.15.88:0/1440609931 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27812d0a0 con 0x7fe27809a4f0 2020-02-11T16:05:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> v2:172.21.15.88:3300/0 conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> v2:172.21.15.88:3300/0 conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe2757fa700 1 -- 172.21.15.88:0/1440609931 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe27000ccb0 con 0x7fe27809a4f0 2020-02-11T16:05:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe2757fa700 1 -- 172.21.15.88:0/1440609931 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27000ce10 con 0x7fe27809a4f0 2020-02-11T16:05:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe2757fa700 1 -- 172.21.15.88:0/1440609931 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe270004a60 con 0x7fe27809a4f0 2020-02-11T16:05:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27e5bb700 1 -- 172.21.15.88:0/1440609931 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2780a95d0 con 0x7fe27809a4f0 2020-02-11T16:05:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27e5bb700 1 -- 172.21.15.88:0/1440609931 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27812bcf0 con 0x7fe27809a4f0 2020-02-11T16:05:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.755+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.756+0000 7fe2757fa700 1 -- 172.21.15.88:0/1440609931 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fe270004bc0 con 0x7fe27809a4f0 2020-02-11T16:05:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.756+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.756+0000 7fe27e5bb700 1 -- 172.21.15.88:0/1440609931 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe278132a60 con 0x7fe27809a4f0 2020-02-11T16:05:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.756+0000 7fe2757fa700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe258039b90 0x7fe25803c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.756+0000 7fe2757fa700 1 -- 172.21.15.88:0/1440609931 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fe270049860 con 0x7fe27809a4f0 2020-02-11T16:05:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.756+0000 7fe277fff700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe258039b90 0x7fe25803c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.756+0000 7fe277fff700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe258039b90 0x7fe25803c050 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.760+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.760+0000 7fe2757fa700 1 -- 172.21.15.88:0/1440609931 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe278132a60 con 0x7fe27809a4f0 2020-02-11T16:05:49.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.893+0000 7fe27e5bb700 1 -- 172.21.15.88:0/1440609931 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe278132a60 con 0x7fe27809a4f0 2020-02-11T16:05:49.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.893+0000 7fe27cb58700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:49.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.893+0000 7fe2757fa700 1 -- 172.21.15.88:0/1440609931 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe278132a60 con 0x7fe27809a4f0 2020-02-11T16:05:49.897 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:49.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 -- 172.21.15.88:0/1440609931 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe258039b90 msgr2=0x7fe25803c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe258039b90 0x7fe25803c050 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 -- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 msgr2=0x7fe27812c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 0x7fe27812c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7fe270001450 tx=0x7fe27000c870).stop 2020-02-11T16:05:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 -- 172.21.15.88:0/1440609931 shutdown_connections 2020-02-11T16:05:49.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe258039b90 0x7fe25803c050 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe27809a4f0 0x7fe27812c5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 --2- 172.21.15.88:0/1440609931 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe27812cc00 0x7fe27812e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:49.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 -- 172.21.15.88:0/1440609931 >> 172.21.15.88:0/1440609931 conn(0x7fe2780aac40 msgr2=0x7fe27809ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:49.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 -- 172.21.15.88:0/1440609931 shutdown_connections 2020-02-11T16:05:49.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:49.895+0000 7fe27e5bb700 1 -- 172.21.15.88:0/1440609931 wait complete. 2020-02-11T16:05:49.908 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-02-11T16:05:50.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.009+0000 7f68a8e33700 1 Processor -- start 2020-02-11T16:05:50.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.009+0000 7f68a8e33700 1 -- start start 2020-02-11T16:05:50.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.010+0000 7f68a8e33700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f68a40a18a0 0x7f68a40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:50.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.010+0000 7f68a8e33700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a6260 0x7f68a412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:50.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.010+0000 7f68a8e33700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a40a3570 con 0x7f68a40a5de0 2020-02-11T16:05:50.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.010+0000 7f68a8e33700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a40a3810 con 0x7f68a40a18a0 2020-02-11T16:05:50.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.010+0000 7f68a8e33700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40a3ab0 con 0x7f68a40a6260 2020-02-11T16:05:50.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.010+0000 7f68a2d9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a6260 0x7f68a412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.010+0000 7f68a259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f68a40a18a0 0x7f68a40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.010+0000 7f68a1d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f68a40a5de0 0x7f68a412e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59608/0 (socket says 172.21.15.88:59608) 2020-02-11T16:05:50.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.010+0000 7f68a1d9b700 1 -- 172.21.15.88:0/2948871866 learned_addr learned my addr 172.21.15.88:0/2948871866 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:50.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.010+0000 7f68a259c700 1 --2- 172.21.15.88:0/2948871866 >> v2:172.21.15.52:3300/0 conn(0x7f68a40a18a0 0x7f68a40a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:37952/0 (socket says 172.21.15.88:37952) 2020-02-11T16:05:50.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a259c700 1 -- 172.21.15.88:0/2948871866 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a6260 msgr2=0x7f68a412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:50.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a259c700 1 --2- 172.21.15.88:0/2948871866 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a6260 0x7f68a412eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:50.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a259c700 1 -- 172.21.15.88:0/2948871866 >> v1:172.21.15.52:6789/0 conn(0x7f68a40a5de0 legacy=0x7f68a412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a259c700 1 -- 172.21.15.88:0/2948871866 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a40a3d50 con 0x7f68a40a18a0 2020-02-11T16:05:50.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a259c700 1 --2- 172.21.15.88:0/2948871866 >> v2:172.21.15.52:3300/0 conn(0x7f68a40a18a0 0x7f68a40a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f688c002f30 tx=0x7f688c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a259c700 1 --2- 172.21.15.88:0/2948871866 >> v2:172.21.15.52:3300/0 conn(0x7f68a40a18a0 0x7f68a40a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f688c002f30 tx=0x7f688c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a259c700 1 --2- 172.21.15.88:0/2948871866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a40a18a0 0x7f68a40a6dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f688c0088e0).ready entity=mon.0 client_cookie=4f7686861f1accd7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:50.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a259c700 1 --2- 172.21.15.88:0/2948871866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a40a18a0 0x7f68a40a6dd0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f688c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a159a700 1 -- 172.21.15.88:0/2948871866 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688c00ae80 con 0x7f68a40a18a0 2020-02-11T16:05:50.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a259c700 1 --2- 172.21.15.88:0/2948871866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a40a18a0 0x7f68a40a6dd0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f688c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a159a700 1 -- 172.21.15.88:0/2948871866 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c0139f0 con 0x7f68a40a18a0 2020-02-11T16:05:50.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a259c700 1 --2- 172.21.15.88:0/2948871866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a40a18a0 0x7f68a40a6dd0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f688c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a159a700 1 -- 172.21.15.88:0/2948871866 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688c013dd0 con 0x7f68a40a18a0 2020-02-11T16:05:50.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a8e33700 1 -- 172.21.15.88:0/2948871866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a40a18a0 msgr2=0x7f68a40a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.011+0000 7f68a8e33700 1 --2- 172.21.15.88:0/2948871866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a40a18a0 0x7f68a40a6dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f688c0088e0).stop 2020-02-11T16:05:50.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.012+0000 7f68a8e33700 1 -- 172.21.15.88:0/2948871866 shutdown_connections 2020-02-11T16:05:50.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.012+0000 7f68a8e33700 1 --2- 172.21.15.88:0/2948871866 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a6260 0x7f68a412eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:50.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.012+0000 7f68a8e33700 1 --2- 172.21.15.88:0/2948871866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a40a18a0 0x7f68a40a6dd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.012+0000 7f68a8e33700 1 -- 172.21.15.88:0/2948871866 >> 172.21.15.88:0/2948871866 conn(0x7f68a409d110 msgr2=0x7f68a409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:50.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.012+0000 7f68a8e33700 1 -- 172.21.15.88:0/2948871866 shutdown_connections 2020-02-11T16:05:50.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.012+0000 7f68a8e33700 1 -- 172.21.15.88:0/2948871866 wait complete. 2020-02-11T16:05:50.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.012+0000 7f68a8e33700 1 Processor -- start 2020-02-11T16:05:50.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.012+0000 7f68a8e33700 1 -- start start 2020-02-11T16:05:50.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f68a8e33700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:50.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f68a8e33700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a40a9690 con 0x7f68a40a5de0 2020-02-11T16:05:50.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f68a8e33700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a41301e0 con 0x7f68a40a6260 2020-02-11T16:05:50.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f68a8e33700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4135550 con 0x7f68a40a18a0 2020-02-11T16:05:50.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f68a2d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f68a40a6260 0x7f68a412fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39600/0 (socket says 172.21.15.88:39600) 2020-02-11T16:05:50.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f68a2d9d700 1 -- 172.21.15.88:0/186227681 learned_addr learned my addr 172.21.15.88:0/186227681 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:50.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028019779 0 0) 0x7f68a41301e0 con 0x7f68a40a6260 2020-02-11T16:05:50.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6888002fe0 con 0x7f68a40a6260 2020-02-11T16:05:50.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4640980 0 0) 0x7f68a40a3570 con 0x7f68a40a5de0 2020-02-11T16:05:50.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a41301e0 con 0x7f68a40a5de0 2020-02-11T16:05:50.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f68a259c700 1 -- 172.21.15.88:0/186227681 >> v1:172.21.15.88:6789/0 conn(0x7f68a40a6260 legacy=0x7f68a412fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f68a259c700 1 -- 172.21.15.88:0/186227681 >> v1:172.21.15.52:6789/0 conn(0x7f68a40a5de0 legacy=0x7f68a412f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.013+0000 7f68a259c700 1 -- 172.21.15.88:0/186227681 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a41314c0 con 0x7f68a40a18a0 2020-02-11T16:05:50.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:50.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688c00ae80 con 0x7f68a40a18a0 2020-02-11T16:05:50.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c007150 con 0x7f68a40a18a0 2020-02-11T16:05:50.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f68a8e33700 1 -- 172.21.15.88:0/186227681 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a4131760 con 0x7f68a40a18a0 2020-02-11T16:05:50.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688c0074b0 con 0x7f68a40a18a0 2020-02-11T16:05:50.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f68a8e33700 1 -- 172.21.15.88:0/186227681 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a412bf70 con 0x7f68a40a18a0 2020-02-11T16:05:50.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.014+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.015+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f688c0056c0 con 0x7f68a40a18a0 2020-02-11T16:05:50.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.015+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.015+0000 7f689b7fe700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f688803a090 0x7f688803c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:50.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.015+0000 7f68a8e33700 1 -- 172.21.15.88:0/186227681 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a40565b0 con 0x7f68a40a18a0 2020-02-11T16:05:50.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.015+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f688c04c0c0 con 0x7f68a40a18a0 2020-02-11T16:05:50.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.015+0000 7f68a1d9b700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f688803a090 0x7f688803c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.016+0000 7f68a1d9b700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f688803a090 0x7f688803c550 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:50.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.019+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.019+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f688c031770 con 0x7f68a40a18a0 2020-02-11T16:05:50.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.195+0000 7f68a8e33700 1 -- 172.21.15.88:0/186227681 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68a40a5920 con 0x7f68a40a18a0 2020-02-11T16:05:50.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.196+0000 7f68a259c700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.196+0000 7f689b7fe700 1 -- 172.21.15.88:0/186227681 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f688c034280 con 0x7f68a40a18a0 2020-02-11T16:05:50.199 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/4168884093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":4168884093},{"type":"v1","addr":"172.21.15.88:6833","nonce":4168884093}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-02-11T16:05:39.282829+0000","modified":"2020-02-11T16:05:42.987581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.52:6835/3175516603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3175516603},{"type":"v1","addr":"172.21.15.52:6835","nonce":3175516603}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-02-11T16:05:50.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.197+0000 7f68a8e33700 1 -- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f688803a090 msgr2=0x7f688803c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.197+0000 7f68a8e33700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f688803a090 0x7f688803c550 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.197+0000 7f68a8e33700 1 -- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 msgr2=0x7f68a412dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.197+0000 7f68a8e33700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f68a40a1c80).stop 2020-02-11T16:05:50.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.197+0000 7f68a8e33700 1 -- 172.21.15.88:0/186227681 shutdown_connections 2020-02-11T16:05:50.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.197+0000 7f68a8e33700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f688803a090 0x7f688803c550 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.197+0000 7f68a8e33700 1 --2- 172.21.15.88:0/186227681 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68a40a18a0 0x7f68a412dc90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.197+0000 7f68a8e33700 1 -- 172.21.15.88:0/186227681 >> 172.21.15.88:0/186227681 conn(0x7f68a409d110 msgr2=0x7f68a40a9830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:50.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.198+0000 7f68a8e33700 1 -- 172.21.15.88:0/186227681 shutdown_connections 2020-02-11T16:05:50.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.198+0000 7f68a8e33700 1 -- 172.21.15.88:0/186227681 wait complete. 2020-02-11T16:05:50.202 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2020-02-11T16:05:50.413 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4372}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4372': {u'export_targets': [], u'name': u'b', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4372, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3175516603, u'type': u'v2', u'addr': u'172.21.15.52:6834'}, {u'nonce': 3175516603, u'type': u'v1', u'addr': u'172.21.15.52:6835'}]}, u'addr': u'172.21.15.52:6835/3175516603'}}, u'fs_name': u'cephfs', u'created': u'2020-02-11T16:05:39.282829+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-02-11T16:05:42.987581+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-02-11T16:05:50.413 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-02-11T16:05:50.413 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-02-11T16:05:50.551 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2020-02-11T16:05:50.552 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:05:50.552 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2020-02-11T16:05:50.552 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4372, 2020-02-11T16:05:50.552 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2020-02-11T16:05:50.552 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2020-02-11T16:05:50.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 8.5601872419999996, 2020-02-11T16:05:50.553 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 6, 2020-02-11T16:05:50.553 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 23, 2020-02-11T16:05:50.553 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 23, 2020-02-11T16:05:50.553 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 8.8671275820000002 2020-02-11T16:05:50.553 INFO:teuthology.orchestra.run.smithi052.stdout:} 2020-02-11T16:05:50.560 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", "whoami": 0, "id": 4372, "want_state": "up:active", "state": "up:active", "rank_uptime": 8.5601872419999996, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 8.8671275820000002 } 2020-02-11T16:05:50.561 INFO:teuthology.run_tasks:Running task mon_thrash... 2020-02-11T16:05:50.605 INFO:tasks.mon_thrash:Beginning mon_thrash... 2020-02-11T16:05:50.606 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:50.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.711+0000 7f221f1d7700 1 Processor -- start 2020-02-11T16:05:50.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.711+0000 7f221f1d7700 1 -- start start 2020-02-11T16:05:50.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.711+0000 7f221f1d7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f221805fac0 0x7f22180a5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:50.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.711+0000 7f221f1d7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22181399e0 0x7f221805b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:50.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.711+0000 7f221f1d7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221809dba0 con 0x7f2218139550 2020-02-11T16:05:50.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.711+0000 7f221f1d7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22180a5ed0 con 0x7f221805fac0 2020-02-11T16:05:50.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.711+0000 7f221f1d7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221809ddd0 con 0x7f22181399e0 2020-02-11T16:05:50.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f221805fac0 0x7f22180a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f2217fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2218139550 0x7f221805ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39604/0 (socket says 172.21.15.88:39604) 2020-02-11T16:05:50.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f2217fff700 1 -- 172.21.15.88:0/2908872706 learned_addr learned my addr 172.21.15.88:0/2908872706 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:50.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221d774700 1 --2- 172.21.15.88:0/2908872706 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22181399e0 0x7f221805b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 -- 172.21.15.88:0/2908872706 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22181399e0 msgr2=0x7f221805b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:50.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 --2- 172.21.15.88:0/2908872706 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22181399e0 0x7f221805b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:50.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 -- 172.21.15.88:0/2908872706 >> v1:172.21.15.88:6789/0 conn(0x7f2218139550 legacy=0x7f221805ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 -- 172.21.15.88:0/2908872706 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221809e070 con 0x7f221805fac0 2020-02-11T16:05:50.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221d774700 1 --2- 172.21.15.88:0/2908872706 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22181399e0 0x7f221805b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:50.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 --2- 172.21.15.88:0/2908872706 >> v2:172.21.15.88:3300/0 conn(0x7f221805fac0 0x7f22180a5030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f220c0010d0 tx=0x7f22080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 --2- 172.21.15.88:0/2908872706 >> v2:172.21.15.88:3300/0 conn(0x7f221805fac0 0x7f22180a5030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f220c0010d0 tx=0x7f22080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 --2- 172.21.15.88:0/2908872706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f221805fac0 0x7f22180a5030 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7f220c0010d0 tx=0x7f22080088e0).ready entity=mon.1 client_cookie=e4150ff2b5436fb0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:50.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 --2- 172.21.15.88:0/2908872706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f221805fac0 0x7f22180a5030 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f220c0010d0 tx=0x7f22080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 --2- 172.21.15.88:0/2908872706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f221805fac0 0x7f22180a5030 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f220c0010d0 tx=0x7f22080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f22177fe700 1 -- 172.21.15.88:0/2908872706 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2208008e40 con 0x7f221805fac0 2020-02-11T16:05:50.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221cf73700 1 --2- 172.21.15.88:0/2908872706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f221805fac0 0x7f22180a5030 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f220c0010d0 tx=0x7f22080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f22177fe700 1 -- 172.21.15.88:0/2908872706 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208011560 con 0x7f221805fac0 2020-02-11T16:05:50.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f22177fe700 1 -- 172.21.15.88:0/2908872706 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2208011940 con 0x7f221805fac0 2020-02-11T16:05:50.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221f1d7700 1 -- 172.21.15.88:0/2908872706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f221805fac0 msgr2=0x7f22180a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.712+0000 7f221f1d7700 1 --2- 172.21.15.88:0/2908872706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f221805fac0 0x7f22180a5030 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7f220c0010d0 tx=0x7f22080088e0).stop 2020-02-11T16:05:50.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.713+0000 7f221f1d7700 1 -- 172.21.15.88:0/2908872706 shutdown_connections 2020-02-11T16:05:50.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.713+0000 7f221f1d7700 1 --2- 172.21.15.88:0/2908872706 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22181399e0 0x7f221805b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:50.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.713+0000 7f221f1d7700 1 --2- 172.21.15.88:0/2908872706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f221805fac0 0x7f22180a5030 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.713+0000 7f221f1d7700 1 -- 172.21.15.88:0/2908872706 >> 172.21.15.88:0/2908872706 conn(0x7f22180a7bb0 msgr2=0x7f22180a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:50.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.713+0000 7f221f1d7700 1 -- 172.21.15.88:0/2908872706 shutdown_connections 2020-02-11T16:05:50.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.713+0000 7f221f1d7700 1 -- 172.21.15.88:0/2908872706 wait complete. 2020-02-11T16:05:50.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221f1d7700 1 Processor -- start 2020-02-11T16:05:50.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221f1d7700 1 -- start start 2020-02-11T16:05:50.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221f1d7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f221805fac0 0x7f2218132c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:50.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221f1d7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2218139550 0x7f22180a2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:50.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221f1d7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22181399e0 0x7f22180a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:50.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221f1d7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2218148650 con 0x7f221805fac0 2020-02-11T16:05:50.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221f1d7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22180aa6e0 con 0x7f22181399e0 2020-02-11T16:05:50.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221f1d7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22180aa980 con 0x7f2218139550 2020-02-11T16:05:50.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221d774700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22181399e0 0x7f22180a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221d774700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22181399e0 0x7f22180a2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51988/0 (socket says 172.21.15.88:51988) 2020-02-11T16:05:50.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.714+0000 7f221d774700 1 -- 172.21.15.88:0/1060312845 learned_addr learned my addr 172.21.15.88:0/1060312845 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:50.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f2217fff700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2218139550 0x7f22180a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221cf73700 1 --2- 172.21.15.88:0/1060312845 >> v2:172.21.15.52:3300/0 conn(0x7f221805fac0 0x7f2218132c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 -- 172.21.15.88:0/1060312845 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2218139550 msgr2=0x7f22180a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2218139550 0x7f22180a2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 -- 172.21.15.88:0/1060312845 >> v2:172.21.15.52:3300/0 conn(0x7f221805fac0 msgr2=0x7f2218132c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> v2:172.21.15.52:3300/0 conn(0x7f221805fac0 0x7f2218132c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 -- 172.21.15.88:0/1060312845 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22180aac20 con 0x7f22181399e0 2020-02-11T16:05:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> v2:172.21.15.88:3300/0 conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> v2:172.21.15.88:3300/0 conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f2215ffb700 1 -- 172.21.15.88:0/1060312845 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2210005e30 con 0x7f22181399e0 2020-02-11T16:05:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f2215ffb700 1 -- 172.21.15.88:0/1060312845 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210007540 con 0x7f22181399e0 2020-02-11T16:05:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221f1d7700 1 -- 172.21.15.88:0/1060312845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221809f200 con 0x7f22181399e0 2020-02-11T16:05:50.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f2215ffb700 1 -- 172.21.15.88:0/1060312845 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2210012520 con 0x7f22181399e0 2020-02-11T16:05:50.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221f1d7700 1 -- 172.21.15.88:0/1060312845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221809f6d0 con 0x7f22181399e0 2020-02-11T16:05:50.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.715+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.716+0000 7f2215ffb700 1 -- 172.21.15.88:0/1060312845 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f2210010180 con 0x7f22181399e0 2020-02-11T16:05:50.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.716+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.716+0000 7f221f1d7700 1 -- 172.21.15.88:0/1060312845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f4003340 con 0x7f22181399e0 2020-02-11T16:05:50.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.716+0000 7f2215ffb700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f21f8039ca0 0x7f21f803c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:50.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.716+0000 7f2215ffb700 1 -- 172.21.15.88:0/1060312845 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2210049ae0 con 0x7f22181399e0 2020-02-11T16:05:50.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.716+0000 7f221cf73700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f21f8039ca0 0x7f21f803c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.717+0000 7f221cf73700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f21f8039ca0 0x7f21f803c160 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:50.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.719+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.719+0000 7f2215ffb700 1 -- 172.21.15.88:0/1060312845 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f221002f110 con 0x7f22181399e0 2020-02-11T16:05:50.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.855+0000 7f221f1d7700 1 -- 172.21.15.88:0/1060312845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21f40021d0 con 0x7f22181399e0 2020-02-11T16:05:50.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.856+0000 7f221d774700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.856+0000 7f2215ffb700 1 -- 172.21.15.88:0/1060312845 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f2210031c20 con 0x7f22181399e0 2020-02-11T16:05:50.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 -- 172.21.15.88:0/1060312845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f21f8039ca0 msgr2=0x7f21f803c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f21f8039ca0 0x7f21f803c160 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 -- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 msgr2=0x7f22180a2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 0x7f22180a2ca0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f22100032b0 tx=0x7f2210010ec0).stop 2020-02-11T16:05:50.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 -- 172.21.15.88:0/1060312845 shutdown_connections 2020-02-11T16:05:50.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22181399e0 0x7f22180a2ca0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f21f8039ca0 0x7f21f803c160 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 --2- 172.21.15.88:0/1060312845 >> v2:172.21.15.52:3300/0 conn(0x7f221805fac0 0x7f2218132c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 --2- 172.21.15.88:0/1060312845 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2218139550 0x7f22180a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 -- 172.21.15.88:0/1060312845 >> 172.21.15.88:0/1060312845 conn(0x7f22180a7bb0 msgr2=0x7f22181337f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 -- 172.21.15.88:0/1060312845 shutdown_connections 2020-02-11T16:05:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.857+0000 7f221f1d7700 1 -- 172.21.15.88:0/1060312845 wait complete. 2020-02-11T16:05:50.866 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:50.866 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:39.282613+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-11T16:05:34.022912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-11T16:05:36.964421+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:50.870 INFO:tasks.mon_thrash.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:30.979083+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:34.022912+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:36.964421+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-11T16:05:50.870 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-11T16:05:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f03292f8700 1 Processor -- start 2020-02-11T16:05:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f03292f8700 1 -- start start 2020-02-11T16:05:50.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f03292f8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f032405b960 0x7f03240a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:50.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f03292f8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f03240a28a0 0x7f032409aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:50.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f03292f8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03240a4160 con 0x7f03240a5c60 2020-02-11T16:05:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f03292f8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032409d950 con 0x7f03240a28a0 2020-02-11T16:05:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f03292f8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032409dbf0 con 0x7f032405b960 2020-02-11T16:05:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f0322ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f032405b960 0x7f03240a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f03237fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f03240a5c60 0x7f0324138250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39618/0 (socket says 172.21.15.88:39618) 2020-02-11T16:05:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f0322ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f032405b960 0x7f03240a67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51992/0 (socket says 172.21.15.88:51992) 2020-02-11T16:05:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f03237fe700 1 -- 172.21.15.88:0/1262083723 learned_addr learned my addr 172.21.15.88:0/1262083723 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.977+0000 7f031a7fc700 1 --2- 172.21.15.88:0/1262083723 >> v2:172.21.15.52:3300/0 conn(0x7f03240a28a0 0x7f032409aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f0322ffd700 1 -- 172.21.15.88:0/1262083723 >> v2:172.21.15.52:3300/0 conn(0x7f03240a28a0 msgr2=0x7f032409aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1262083723 >> v2:172.21.15.52:3300/0 conn(0x7f03240a28a0 0x7f032409aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f0322ffd700 1 -- 172.21.15.88:0/1262083723 >> v1:172.21.15.88:6789/0 conn(0x7f03240a5c60 legacy=0x7f0324138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f0322ffd700 1 -- 172.21.15.88:0/1262083723 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03240a60c0 con 0x7f032405b960 2020-02-11T16:05:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1262083723 >> v2:172.21.15.88:3300/0 conn(0x7f032405b960 0x7f03240a67e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1262083723 >> v2:172.21.15.88:3300/0 conn(0x7f032405b960 0x7f03240a67e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1262083723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f03240a67e0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).ready entity=mon.1 client_cookie=56087b89b5acb2bd server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1262083723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f03240a67e0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1262083723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f03240a67e0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03227fc700 1 -- 172.21.15.88:0/1262083723 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0314011470 con 0x7f032405b960 2020-02-11T16:05:50.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1262083723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f03240a67e0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03227fc700 1 -- 172.21.15.88:0/1262083723 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03140115d0 con 0x7f032405b960 2020-02-11T16:05:50.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03227fc700 1 -- 172.21.15.88:0/1262083723 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0314011970 con 0x7f032405b960 2020-02-11T16:05:50.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03292f8700 1 -- 172.21.15.88:0/1262083723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 msgr2=0x7f03240a67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03292f8700 1 --2- 172.21.15.88:0/1262083723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f03240a67e0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).stop 2020-02-11T16:05:50.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03292f8700 1 -- 172.21.15.88:0/1262083723 shutdown_connections 2020-02-11T16:05:50.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03292f8700 1 --2- 172.21.15.88:0/1262083723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f03240a67e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03292f8700 1 --2- 172.21.15.88:0/1262083723 >> v2:172.21.15.52:3300/0 conn(0x7f03240a28a0 0x7f032409aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:50.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03292f8700 1 -- 172.21.15.88:0/1262083723 >> 172.21.15.88:0/1262083723 conn(0x7f03240aac40 msgr2=0x7f03240a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:50.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03292f8700 1 -- 172.21.15.88:0/1262083723 shutdown_connections 2020-02-11T16:05:50.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.978+0000 7f03292f8700 1 -- 172.21.15.88:0/1262083723 wait complete. 2020-02-11T16:05:50.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.979+0000 7f03292f8700 1 Processor -- start 2020-02-11T16:05:50.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.979+0000 7f03292f8700 1 -- start start 2020-02-11T16:05:50.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f03292f8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f032405b960 0x7f032409dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:50.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f03292f8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03240a28a0 0x7f0324136730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:50.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f03292f8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f03240a5c60 0x7f0324141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:50.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f03292f8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03241390e0 con 0x7f03240a5c60 2020-02-11T16:05:50.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f03292f8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0324135ff0 con 0x7f032405b960 2020-02-11T16:05:50.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f03292f8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0324136290 con 0x7f03240a28a0 2020-02-11T16:05:50.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f032405b960 0x7f032409dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f032405b960 0x7f032409dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51998/0 (socket says 172.21.15.88:51998) 2020-02-11T16:05:50.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 -- 172.21.15.88:0/1237052723 learned_addr learned my addr 172.21.15.88:0/1237052723 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:50.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f03237fe700 1 --2- 172.21.15.88:0/1237052723 >> v2:172.21.15.52:3300/0 conn(0x7f03240a5c60 0x7f0324141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f031a7fc700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03240a28a0 0x7f0324136730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:50.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 -- 172.21.15.88:0/1237052723 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03240a28a0 msgr2=0x7f0324136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03240a28a0 0x7f0324136730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 -- 172.21.15.88:0/1237052723 >> v2:172.21.15.52:3300/0 conn(0x7f03240a5c60 msgr2=0x7f0324141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:50.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> v2:172.21.15.52:3300/0 conn(0x7f03240a5c60 0x7f0324141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:50.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 -- 172.21.15.88:0/1237052723 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324132990 con 0x7f032405b960 2020-02-11T16:05:50.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f03237fe700 1 --2- 172.21.15.88:0/1237052723 >> v2:172.21.15.52:3300/0 conn(0x7f03240a5c60 0x7f0324141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:50.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> v2:172.21.15.88:3300/0 conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:50.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> v2:172.21.15.88:3300/0 conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.980+0000 7f0320ff9700 1 -- 172.21.15.88:0/1237052723 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0314007150 con 0x7f032405b960 2020-02-11T16:05:51.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.981+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.981+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.981+0000 7f0320ff9700 1 -- 172.21.15.88:0/1237052723 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03140072b0 con 0x7f032405b960 2020-02-11T16:05:51.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.981+0000 7f03292f8700 1 -- 172.21.15.88:0/1237052723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0324142360 con 0x7f032405b960 2020-02-11T16:05:51.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.981+0000 7f0320ff9700 1 -- 172.21.15.88:0/1237052723 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03140056c0 con 0x7f032405b960 2020-02-11T16:05:51.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.981+0000 7f03292f8700 1 -- 172.21.15.88:0/1237052723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0324136f90 con 0x7f032405b960 2020-02-11T16:05:51.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.981+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.982+0000 7f0320ff9700 1 -- 172.21.15.88:0/1237052723 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f0314005930 con 0x7f032405b960 2020-02-11T16:05:51.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.982+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.982+0000 7f03292f8700 1 -- 172.21.15.88:0/1237052723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0324138f30 con 0x7f032405b960 2020-02-11T16:05:51.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.982+0000 7f0320ff9700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0308039e30 0x7f030803c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:51.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.982+0000 7f0320ff9700 1 -- 172.21.15.88:0/1237052723 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f0314049fe0 con 0x7f032405b960 2020-02-11T16:05:51.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.982+0000 7f031a7fc700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0308039e30 0x7f030803c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.982+0000 7f031a7fc700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0308039e30 0x7f030803c2f0 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.985+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:50.985+0000 7f0320ff9700 1 -- 172.21.15.88:0/1237052723 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f031402f6d0 con 0x7f032405b960 2020-02-11T16:05:51.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.120+0000 7f03292f8700 1 -- 172.21.15.88:0/1237052723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03240565b0 con 0x7f032405b960 2020-02-11T16:05:51.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.121+0000 7f0322ffd700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.121+0000 7f0320ff9700 1 -- 172.21.15.88:0/1237052723 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03140321e0 con 0x7f032405b960 2020-02-11T16:05:51.123 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:51.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 -- 172.21.15.88:0/1237052723 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0308039e30 msgr2=0x7f030803c2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0308039e30 0x7f030803c2f0 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 -- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 msgr2=0x7f032409dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f032409dfc0 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f0314002f30 tx=0x7f0314007a40).stop 2020-02-11T16:05:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 -- 172.21.15.88:0/1237052723 shutdown_connections 2020-02-11T16:05:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0308039e30 0x7f030803c2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 --2- 172.21.15.88:0/1237052723 >> v2:172.21.15.52:3300/0 conn(0x7f03240a5c60 0x7f0324141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f032405b960 0x7f032409dfc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 --2- 172.21.15.88:0/1237052723 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03240a28a0 0x7f0324136730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 -- 172.21.15.88:0/1237052723 >> 172.21.15.88:0/1237052723 conn(0x7f03240aac40 msgr2=0x7f03240a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 -- 172.21.15.88:0/1237052723 shutdown_connections 2020-02-11T16:05:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.122+0000 7f03292f8700 1 -- 172.21.15.88:0/1237052723 wait complete. 2020-02-11T16:05:51.134 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-11T16:05:51.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.241+0000 7fd6b8960700 1 Processor -- start 2020-02-11T16:05:51.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.241+0000 7fd6b8960700 1 -- start start 2020-02-11T16:05:51.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b8960700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6b40a28a0 0x7fd6b40a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:51.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b8960700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b4139070 con 0x7fd6b409aef0 2020-02-11T16:05:51.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b8960700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b40a4160 con 0x7fd6b405b960 2020-02-11T16:05:51.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b8960700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b409d950 con 0x7fd6b40a28a0 2020-02-11T16:05:51.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6abfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6b40a28a0 0x7fd6b40a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd6b405b960 0x7fd6b4138250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39632/0 (socket says 172.21.15.88:39632) 2020-02-11T16:05:51.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b259c700 1 -- 172.21.15.88:0/3824467955 learned_addr learned my addr 172.21.15.88:0/3824467955 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:51.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6abfff700 1 -- 172.21.15.88:0/3824467955 >> v1:172.21.15.88:6789/0 conn(0x7fd6b405b960 legacy=0x7fd6b4138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6abfff700 1 -- 172.21.15.88:0/3824467955 >> v1:172.21.15.52:6789/0 conn(0x7fd6b409aef0 legacy=0x7fd6b4138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:51.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b1d9b700 1 -- 172.21.15.88:0/3824467955 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815768790 0 0) 0x7fd6b40a4160 con 0x7fd6b405b960 2020-02-11T16:05:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6abfff700 1 -- 172.21.15.88:0/3824467955 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b409dbf0 con 0x7fd6b40a28a0 2020-02-11T16:05:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6abfff700 1 --2- 172.21.15.88:0/3824467955 >> v2:172.21.15.88:3300/0 conn(0x7fd6b40a28a0 0x7fd6b40a67e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd6b4068f90 tx=0x7fd69c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6abfff700 1 --2- 172.21.15.88:0/3824467955 >> v2:172.21.15.88:3300/0 conn(0x7fd6b40a28a0 0x7fd6b40a67e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd6b4068f90 tx=0x7fd69c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6abfff700 1 --2- 172.21.15.88:0/3824467955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b40a28a0 0x7fd6b40a67e0 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd69c0088e0).ready entity=mon.1 client_cookie=91c5c91d59189c19 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6abfff700 1 --2- 172.21.15.88:0/3824467955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b40a28a0 0x7fd6b40a67e0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd69c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b1d9b700 1 -- 172.21.15.88:0/3824467955 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd69c008e40 con 0x7fd6b40a28a0 2020-02-11T16:05:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6abfff700 1 --2- 172.21.15.88:0/3824467955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b40a28a0 0x7fd6b40a67e0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd69c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6abfff700 1 --2- 172.21.15.88:0/3824467955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b40a28a0 0x7fd6b40a67e0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd69c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b1d9b700 1 -- 172.21.15.88:0/3824467955 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c011660 con 0x7fd6b40a28a0 2020-02-11T16:05:51.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b1d9b700 1 -- 172.21.15.88:0/3824467955 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd69c011a00 con 0x7fd6b40a28a0 2020-02-11T16:05:51.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b8960700 1 -- 172.21.15.88:0/3824467955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b40a28a0 msgr2=0x7fd6b40a67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.242+0000 7fd6b8960700 1 --2- 172.21.15.88:0/3824467955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b40a28a0 0x7fd6b40a67e0 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd69c0088e0).stop 2020-02-11T16:05:51.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.243+0000 7fd6b8960700 1 -- 172.21.15.88:0/3824467955 shutdown_connections 2020-02-11T16:05:51.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.243+0000 7fd6b8960700 1 --2- 172.21.15.88:0/3824467955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b40a28a0 0x7fd6b40a67e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.243+0000 7fd6b8960700 1 -- 172.21.15.88:0/3824467955 >> 172.21.15.88:0/3824467955 conn(0x7fd6b40aac40 msgr2=0x7fd6b40a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:51.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.243+0000 7fd6b8960700 1 -- 172.21.15.88:0/3824467955 shutdown_connections 2020-02-11T16:05:51.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.243+0000 7fd6b8960700 1 -- 172.21.15.88:0/3824467955 wait complete. 2020-02-11T16:05:51.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6b8960700 1 Processor -- start 2020-02-11T16:05:51.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6b8960700 1 -- start start 2020-02-11T16:05:51.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6b8960700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd6b409aef0 0x7fd6b4132990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:51.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6b8960700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a28a0 0x7fd6b409f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:51.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6b8960700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b409f5a0 con 0x7fd6b405b960 2020-02-11T16:05:51.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6b8960700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b41368e0 con 0x7fd6b409aef0 2020-02-11T16:05:51.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6b8960700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b409ed50 con 0x7fd6b40a28a0 2020-02-11T16:05:51.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6b259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd6b405b960 0x7fd6b412de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39638/0 (socket says 172.21.15.88:39638) 2020-02-11T16:05:51.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6b259c700 1 -- 172.21.15.88:0/2635709017 learned_addr learned my addr 172.21.15.88:0/2635709017 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:51.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> v2:172.21.15.52:3300/0 conn(0x7fd6b409aef0 0x7fd6b4132990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6b2d9d700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a28a0 0x7fd6b409f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685106160 0 0) 0x7fd6b409f5a0 con 0x7fd6b405b960 2020-02-11T16:05:51.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.244+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd698002fe0 con 0x7fd6b405b960 2020-02-11T16:05:51.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3478720328 0 0) 0x7fd698002fe0 con 0x7fd6b405b960 2020-02-11T16:05:51.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd6b409f5a0 con 0x7fd6b405b960 2020-02-11T16:05:51.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fd6a4001860 con 0x7fd6b405b960 2020-02-11T16:05:51.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6abfff700 1 -- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a28a0 msgr2=0x7fd6b409f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a28a0 0x7fd6b409f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6abfff700 1 -- 172.21.15.88:0/2635709017 >> v1:172.21.15.88:6789/0 conn(0x7fd6b405b960 legacy=0x7fd6b412de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6abfff700 1 -- 172.21.15.88:0/2635709017 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40a0a80 con 0x7fd6b409aef0 2020-02-11T16:05:51.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> v2:172.21.15.52:3300/0 conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> v2:172.21.15.52:3300/0 conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd69c0118a0 con 0x7fd6b409aef0 2020-02-11T16:05:51.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6b8960700 1 -- 172.21.15.88:0/2635709017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b4135210 con 0x7fd6b409aef0 2020-02-11T16:05:51.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c011a00 con 0x7fd6b409aef0 2020-02-11T16:05:51.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd69c007340 con 0x7fd6b409aef0 2020-02-11T16:05:51.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.245+0000 7fd6b8960700 1 -- 172.21.15.88:0/2635709017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b4136520 con 0x7fd6b409aef0 2020-02-11T16:05:51.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.246+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.246+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fd69c0056c0 con 0x7fd6b409aef0 2020-02-11T16:05:51.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.246+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.246+0000 7fd6b8960700 1 -- 172.21.15.88:0/2635709017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b40565b0 con 0x7fd6b409aef0 2020-02-11T16:05:51.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.246+0000 7fd6ab7fe700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69803a1d0 0x7fd69803c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:51.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.246+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd69c049c60 con 0x7fd6b409aef0 2020-02-11T16:05:51.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.246+0000 7fd6b259c700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69803a1d0 0x7fd69803c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.247+0000 7fd6b259c700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69803a1d0 0x7fd69803c690 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.250+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.251+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd69c032220 con 0x7fd6b409aef0 2020-02-11T16:05:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.384+0000 7fd6b8960700 1 -- 172.21.15.88:0/2635709017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6b40ab050 con 0x7fd6b409aef0 2020-02-11T16:05:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.385+0000 7fd6abfff700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.385+0000 7fd6ab7fe700 1 -- 172.21.15.88:0/2635709017 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd69c031de0 con 0x7fd6b409aef0 2020-02-11T16:05:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 -- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69803a1d0 msgr2=0x7fd69803c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69803a1d0 0x7fd69803c690 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 -- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 msgr2=0x7fd6b4132990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 0x7fd6b4132990 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fd6b4068f90 tx=0x7fd6b4139200).stop 2020-02-11T16:05:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 -- 172.21.15.88:0/2635709017 shutdown_connections 2020-02-11T16:05:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a28a0 0x7fd6b409f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69803a1d0 0x7fd69803c690 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 --2- 172.21.15.88:0/2635709017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b409aef0 0x7fd6b4132990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 -- 172.21.15.88:0/2635709017 >> 172.21.15.88:0/2635709017 conn(0x7fd6b40aac40 msgr2=0x7fd6b405a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:51.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 -- 172.21.15.88:0/2635709017 shutdown_connections 2020-02-11T16:05:51.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.386+0000 7fd6b8960700 1 -- 172.21.15.88:0/2635709017 wait complete. 2020-02-11T16:05:51.395 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:51.398 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-11T16:05:51.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.506+0000 7fd4ce04f700 1 Processor -- start 2020-02-11T16:05:51.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.506+0000 7fd4ce04f700 1 -- start start 2020-02-11T16:05:51.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4ce04f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c805b960 0x7fd4c80a4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:51.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4ce04f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4c80a66d0 0x7fd4c80a1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:51.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4ce04f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd4c80a38d0 0x7fd4c8130a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:51.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4ce04f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c80a4150 con 0x7fd4c80a38d0 2020-02-11T16:05:51.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4ce04f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c80a5f90 con 0x7fd4c80a66d0 2020-02-11T16:05:51.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4ce04f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c80a6230 con 0x7fd4c805b960 2020-02-11T16:05:51.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4c80a66d0 0x7fd4c80a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4c80a66d0 0x7fd4c80a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52022/0 (socket says 172.21.15.88:52022) 2020-02-11T16:05:51.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 -- 172.21.15.88:0/2550238556 learned_addr learned my addr 172.21.15.88:0/2550238556 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:51.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2550238556 >> v2:172.21.15.52:3300/0 conn(0x7fd4c80a38d0 0x7fd4c8130a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c77fe700 1 --2- 172.21.15.88:0/2550238556 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c805b960 0x7fd4c80a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 -- 172.21.15.88:0/2550238556 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c805b960 msgr2=0x7fd4c80a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:51.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 --2- 172.21.15.88:0/2550238556 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c805b960 0x7fd4c80a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:51.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 -- 172.21.15.88:0/2550238556 >> v2:172.21.15.52:3300/0 conn(0x7fd4c80a38d0 msgr2=0x7fd4c8130a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:51.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 --2- 172.21.15.88:0/2550238556 >> v2:172.21.15.52:3300/0 conn(0x7fd4c80a38d0 0x7fd4c8130a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:51.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 -- 172.21.15.88:0/2550238556 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c80a3d80 con 0x7fd4c80a66d0 2020-02-11T16:05:51.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 --2- 172.21.15.88:0/2550238556 >> v2:172.21.15.88:3300/0 conn(0x7fd4c80a66d0 0x7fd4c80a1900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 --2- 172.21.15.88:0/2550238556 >> v2:172.21.15.88:3300/0 conn(0x7fd4c80a66d0 0x7fd4c80a1900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 --2- 172.21.15.88:0/2550238556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80a66d0 0x7fd4c80a1900 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).ready entity=mon.1 client_cookie=e37b316d4beacbfb server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 --2- 172.21.15.88:0/2550238556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80a66d0 0x7fd4c80a1900 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c67fc700 1 -- 172.21.15.88:0/2550238556 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4bc008400 con 0x7fd4c80a66d0 2020-02-11T16:05:51.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 --2- 172.21.15.88:0/2550238556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80a66d0 0x7fd4c80a1900 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c6ffd700 1 --2- 172.21.15.88:0/2550238556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80a66d0 0x7fd4c80a1900 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c67fc700 1 -- 172.21.15.88:0/2550238556 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc008a30 con 0x7fd4c80a66d0 2020-02-11T16:05:51.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4c67fc700 1 -- 172.21.15.88:0/2550238556 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4bc008e10 con 0x7fd4c80a66d0 2020-02-11T16:05:51.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2550238556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80a66d0 msgr2=0x7fd4c80a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.507+0000 7fd4ce04f700 1 --2- 172.21.15.88:0/2550238556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80a66d0 0x7fd4c80a1900 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).stop 2020-02-11T16:05:51.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.508+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2550238556 shutdown_connections 2020-02-11T16:05:51.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.508+0000 7fd4ce04f700 1 --2- 172.21.15.88:0/2550238556 >> v2:172.21.15.52:3300/0 conn(0x7fd4c80a38d0 0x7fd4c8130a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:51.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.508+0000 7fd4ce04f700 1 --2- 172.21.15.88:0/2550238556 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c805b960 0x7fd4c80a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:51.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.508+0000 7fd4ce04f700 1 --2- 172.21.15.88:0/2550238556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80a66d0 0x7fd4c80a1900 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.508+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2550238556 >> 172.21.15.88:0/2550238556 conn(0x7fd4c80aac40 msgr2=0x7fd4c80a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:51.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.508+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2550238556 shutdown_connections 2020-02-11T16:05:51.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.508+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2550238556 wait complete. 2020-02-11T16:05:51.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.509+0000 7fd4ce04f700 1 Processor -- start 2020-02-11T16:05:51.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.509+0000 7fd4ce04f700 1 -- start start 2020-02-11T16:05:51.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4ce04f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c80a38d0 0x7fd4c8144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:51.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4ce04f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd4c80a66d0 0x7fd4c8145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:51.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4ce04f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c809e660 con 0x7fd4c805b960 2020-02-11T16:05:51.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4ce04f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c809ec70 con 0x7fd4c80a66d0 2020-02-11T16:05:51.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4ce04f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c809cb70 con 0x7fd4c80a38d0 2020-02-11T16:05:51.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4c6ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c80a38d0 0x7fd4c8144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4c7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd4c80a66d0 0x7fd4c8145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4c6ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c80a38d0 0x7fd4c8144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:46352/0 (socket says 172.21.15.88:46352) 2020-02-11T16:05:51.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4c6ffd700 1 -- 172.21.15.88:0/2642717110 learned_addr learned my addr 172.21.15.88:0/2642717110 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:51.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4c7fff700 1 -- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c80a38d0 msgr2=0x7fd4c8144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c80a38d0 0x7fd4c8144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4c7fff700 1 -- 172.21.15.88:0/2642717110 >> v1:172.21.15.52:6789/0 conn(0x7fd4c805b960 legacy=0x7fd4c809f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4c4ff9700 1 -- 172.21.15.88:0/2642717110 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444558645 0 0) 0x7fd4c809e660 con 0x7fd4c805b960 2020-02-11T16:05:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4c7fff700 1 -- 172.21.15.88:0/2642717110 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c81457b0 con 0x7fd4c80a66d0 2020-02-11T16:05:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.510+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> v2:172.21.15.52:3300/0 conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> v2:172.21.15.52:3300/0 conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4c4ff9700 1 -- 172.21.15.88:0/2642717110 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c0005e30 con 0x7fd4c80a66d0 2020-02-11T16:05:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4c4ff9700 1 -- 172.21.15.88:0/2642717110 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c0007540 con 0x7fd4c80a66d0 2020-02-11T16:05:51.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2642717110 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c809cf10 con 0x7fd4c80a66d0 2020-02-11T16:05:51.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4c4ff9700 1 -- 172.21.15.88:0/2642717110 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c00078e0 con 0x7fd4c80a66d0 2020-02-11T16:05:51.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2642717110 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c80611f0 con 0x7fd4c80a66d0 2020-02-11T16:05:51.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.511+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.512+0000 7fd4c4ff9700 1 -- 172.21.15.88:0/2642717110 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fd4c0010180 con 0x7fd4c80a66d0 2020-02-11T16:05:51.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.512+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.512+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2642717110 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c80a5c30 con 0x7fd4c80a66d0 2020-02-11T16:05:51.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.512+0000 7fd4c4ff9700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4a8039b30 0x7fd4a803bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:51.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.512+0000 7fd4c4ff9700 1 -- 172.21.15.88:0/2642717110 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd4c0049860 con 0x7fd4c80a66d0 2020-02-11T16:05:51.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.512+0000 7fd4c77fe700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4a8039b30 0x7fd4a803bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.512+0000 7fd4c77fe700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4a8039b30 0x7fd4a803bff0 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.516+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.516+0000 7fd4c4ff9700 1 -- 172.21.15.88:0/2642717110 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd4c002eeb0 con 0x7fd4c80a66d0 2020-02-11T16:05:51.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.650+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2642717110 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4c80565b0 con 0x7fd4c80a66d0 2020-02-11T16:05:51.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.651+0000 7fd4c7fff700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.651+0000 7fd4c4ff9700 1 -- 172.21.15.88:0/2642717110 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd4c0031980 con 0x7fd4c80a66d0 2020-02-11T16:05:51.653 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4a8039b30 msgr2=0x7fd4a803bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4a8039b30 0x7fd4a803bff0 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 msgr2=0x7fd4c8145350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 0x7fd4c8145350 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fd4c00032b0 tx=0x7fd4c0010dd0).stop 2020-02-11T16:05:51.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2642717110 shutdown_connections 2020-02-11T16:05:51.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4a8039b30 0x7fd4a803bff0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4c80a66d0 0x7fd4c8145350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 --2- 172.21.15.88:0/2642717110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4c80a38d0 0x7fd4c8144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2642717110 >> 172.21.15.88:0/2642717110 conn(0x7fd4c80aac40 msgr2=0x7fd4c8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:51.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2642717110 shutdown_connections 2020-02-11T16:05:51.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.652+0000 7fd4ce04f700 1 -- 172.21.15.88:0/2642717110 wait complete. 2020-02-11T16:05:51.664 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2020-02-11T16:05:51.664 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-02-11T16:05:51.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.767+0000 7f7206962700 1 Processor -- start 2020-02-11T16:05:51.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.768+0000 7f7206962700 1 -- start start 2020-02-11T16:05:51.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.768+0000 7f7206962700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72000ad380 0x7f72000a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:51.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.768+0000 7f7206962700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7200138280 0x7f72001386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:51.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.768+0000 7f7206962700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72000adb40 con 0x7f720013b1c0 2020-02-11T16:05:51.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.768+0000 7f7206962700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7200137bf0 con 0x7f72000ad380 2020-02-11T16:05:51.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.768+0000 7f7206962700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7200138b40 con 0x7f7200138280 2020-02-11T16:05:51.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72000ad380 0x7f72000a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71ff7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7200138280 0x7f72001386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72000ad380 0x7f72000a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38020/0 (socket says 172.21.15.88:38020) 2020-02-11T16:05:51.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 -- 172.21.15.88:0/492944486 learned_addr learned my addr 172.21.15.88:0/492944486 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:51.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f7204eff700 1 --1- 172.21.15.88:0/492944486 >> v1:172.21.15.52:6789/0 conn(0x7f720013b1c0 0x7f720013b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59674/0 (socket says 172.21.15.88:59674) 2020-02-11T16:05:51.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 -- 172.21.15.88:0/492944486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7200138280 msgr2=0x7f72001386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:51.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 --2- 172.21.15.88:0/492944486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7200138280 0x7f72001386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:51.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 -- 172.21.15.88:0/492944486 >> v1:172.21.15.52:6789/0 conn(0x7f720013b1c0 legacy=0x7f720013b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 -- 172.21.15.88:0/492944486 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200137de0 con 0x7f72000ad380 2020-02-11T16:05:51.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 --2- 172.21.15.88:0/492944486 >> v2:172.21.15.52:3300/0 conn(0x7f72000ad380 0x7f72000a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f71f0002f30 tx=0x7f71f00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 --2- 172.21.15.88:0/492944486 >> v2:172.21.15.52:3300/0 conn(0x7f72000ad380 0x7f72000a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f71f0002f30 tx=0x7f71f00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 --2- 172.21.15.88:0/492944486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000a9130 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f00088e0).ready entity=mon.0 client_cookie=8634132570dc0e8b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 --2- 172.21.15.88:0/492944486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000a9130 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71feffd700 1 -- 172.21.15.88:0/492944486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f00116b0 con 0x7f72000ad380 2020-02-11T16:05:51.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 --2- 172.21.15.88:0/492944486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000a9130 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71fffff700 1 --2- 172.21.15.88:0/492944486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000a9130 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71feffd700 1 -- 172.21.15.88:0/492944486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f0011810 con 0x7f72000ad380 2020-02-11T16:05:51.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f71feffd700 1 -- 172.21.15.88:0/492944486 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f0011bf0 con 0x7f72000ad380 2020-02-11T16:05:51.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f7206962700 1 -- 172.21.15.88:0/492944486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 msgr2=0x7f72000a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.769+0000 7f7206962700 1 --2- 172.21.15.88:0/492944486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000a9130 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f00088e0).stop 2020-02-11T16:05:51.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.770+0000 7f7206962700 1 -- 172.21.15.88:0/492944486 shutdown_connections 2020-02-11T16:05:51.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.770+0000 7f7206962700 1 --2- 172.21.15.88:0/492944486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000a9130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.770+0000 7f7206962700 1 --2- 172.21.15.88:0/492944486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7200138280 0x7f72001386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:51.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.770+0000 7f7206962700 1 -- 172.21.15.88:0/492944486 >> 172.21.15.88:0/492944486 conn(0x7f720005ac70 msgr2=0x7f72000ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:51.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.770+0000 7f7206962700 1 -- 172.21.15.88:0/492944486 shutdown_connections 2020-02-11T16:05:51.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.770+0000 7f7206962700 1 -- 172.21.15.88:0/492944486 wait complete. 2020-02-11T16:05:51.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.771+0000 7f7206962700 1 Processor -- start 2020-02-11T16:05:51.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.771+0000 7f7206962700 1 -- start start 2020-02-11T16:05:51.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.771+0000 7f7206962700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72000ad380 0x7f72000670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:51.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.771+0000 7f7206962700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7200138280 0x7f720012b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:51.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.771+0000 7f7206962700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7200138dc0 con 0x7f720013b1c0 2020-02-11T16:05:51.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.771+0000 7f7206962700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7200132bc0 con 0x7f72000ad380 2020-02-11T16:05:51.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.771+0000 7f7206962700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7200132e60 con 0x7f7200138280 2020-02-11T16:05:51.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f7204eff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f720013b1c0 0x7f720012cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39668/0 (socket says 172.21.15.88:39668) 2020-02-11T16:05:51.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f7204eff700 1 -- 172.21.15.88:0/1314779311 learned_addr learned my addr 172.21.15.88:0/1314779311 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:51.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> v2:172.21.15.52:3300/0 conn(0x7f72000ad380 0x7f72000670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71ff7fe700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7200138280 0x7f720012b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fd7fa700 1 -- 172.21.15.88:0/1314779311 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072623335 0 0) 0x7f7200138dc0 con 0x7f720013b1c0 2020-02-11T16:05:51.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fd7fa700 1 -- 172.21.15.88:0/1314779311 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e0002fe0 con 0x7f720013b1c0 2020-02-11T16:05:51.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 -- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7200138280 msgr2=0x7f720012b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7200138280 0x7f720012b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 -- 172.21.15.88:0/1314779311 >> v1:172.21.15.88:6789/0 conn(0x7f720013b1c0 legacy=0x7f720012cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 -- 172.21.15.88:0/1314779311 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200133100 con 0x7f72000ad380 2020-02-11T16:05:51.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> v2:172.21.15.52:3300/0 conn(0x7f72000ad380 0x7f72000670b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> v2:172.21.15.52:3300/0 conn(0x7f72000ad380 0x7f72000670b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000670b0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f0011460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000670b0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fd7fa700 1 -- 172.21.15.88:0/1314779311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f0011e30 con 0x7f72000ad380 2020-02-11T16:05:51.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000670b0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fd7fa700 1 -- 172.21.15.88:0/1314779311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f0011c00 con 0x7f72000ad380 2020-02-11T16:05:51.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000670b0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f7206962700 1 -- 172.21.15.88:0/1314779311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720013abc0 con 0x7f72000ad380 2020-02-11T16:05:51.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f71fd7fa700 1 -- 172.21.15.88:0/1314779311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f0007530 con 0x7f72000ad380 2020-02-11T16:05:51.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.772+0000 7f7206962700 1 -- 172.21.15.88:0/1314779311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720013a2e0 con 0x7f72000ad380 2020-02-11T16:05:51.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.773+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000670b0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.773+0000 7f71fd7fa700 1 -- 172.21.15.88:0/1314779311 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f71f00056c0 con 0x7f72000ad380 2020-02-11T16:05:51.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.773+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000670b0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.773+0000 7f7206962700 1 -- 172.21.15.88:0/1314779311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72000565b0 con 0x7f72000ad380 2020-02-11T16:05:51.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.773+0000 7f71fd7fa700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71e0039ef0 0x7f71e003c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:51.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.773+0000 7f71fd7fa700 1 -- 172.21.15.88:0/1314779311 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f71f0049e50 con 0x7f72000ad380 2020-02-11T16:05:51.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.773+0000 7f71ff7fe700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71e0039ef0 0x7f71e003c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:51.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.774+0000 7f71ff7fe700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71e0039ef0 0x7f71e003c3b0 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:51.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.777+0000 7f71fffff700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000670b0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:51.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.777+0000 7f71fd7fa700 1 -- 172.21.15.88:0/1314779311 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f71f00323b0 con 0x7f72000ad380 2020-02-11T16:05:51.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.906+0000 7f7206962700 1 -- 172.21.15.88:0/1314779311 --> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7200133290 con 0x7f71e0039ef0 2020-02-11T16:05:51.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.909+0000 7f71fd7fa700 1 -- 172.21.15.88:0/1314779311 <== mgr.4105 v2:172.21.15.52:6800/30001 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66341 (crc 0 0 0) 0x7f7200133290 con 0x7f71e0039ef0 2020-02-11T16:05:51.912 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:51.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 -- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71e0039ef0 msgr2=0x7f71e003c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71e0039ef0 0x7f71e003c3b0 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 -- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 msgr2=0x7f72000670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000670b0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f71f0002f30 tx=0x7f71f0011460).stop 2020-02-11T16:05:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 -- 172.21.15.88:0/1314779311 shutdown_connections 2020-02-11T16:05:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71e0039ef0 0x7f71e003c3b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000ad380 0x7f72000670b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 --2- 172.21.15.88:0/1314779311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7200138280 0x7f720012b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 -- 172.21.15.88:0/1314779311 >> 172.21.15.88:0/1314779311 conn(0x7f720005ac70 msgr2=0x7f7200069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:51.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 -- 172.21.15.88:0/1314779311 shutdown_connections 2020-02-11T16:05:51.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:51.911+0000 7f7206962700 1 -- 172.21.15.88:0/1314779311 wait complete. 2020-02-11T16:05:51.915 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2020-02-11T16:05:51.923 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2020-02-11T16:05:50.954133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390624,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584096,"statfs":{"total":773094113280,"available":764502114304,"internally_reserved":8589934592,"allocated":1998848,"data_stored":719508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001940"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.212979+0000","last_change":"2020-02-11T16:05:39.212597+0000","last_active":"2020-02-11T16:05:39.212979+0000","last_peered":"2020-02-11T16:05:39.212979+0000","last_clean":"2020-02-11T16:05:39.212979+0000","last_became_active":"2020-02-11T16:05:39.212054+0000","last_became_peered":"2020-02-11T16:05:39.212054+0000","last_unstale":"2020-02-11T16:05:39.212979+0000","last_undegraded":"2020-02-11T16:05:39.212979+0000","last_fullsized":"2020-02-11T16:05:39.212979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.957217+0000","last_change":"2020-02-11T16:05:32.944206+0000","last_active":"2020-02-11T16:05:38.957217+0000","last_peered":"2020-02-11T16:05:38.957217+0000","last_clean":"2020-02-11T16:05:38.957217+0000","last_became_active":"2020-02-11T16:05:32.943706+0000","last_became_peered":"2020-02-11T16:05:32.943706+0000","last_unstale":"2020-02-11T16:05:38.957217+0000","last_undegraded":"2020-02-11T16:05:38.957217+0000","last_fullsized":"2020-02-11T16:05:38.957217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'4","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.995924+0000","last_change":"2020-02-11T16:05:35.954092+0000","last_active":"2020-02-11T16:05:41.995924+0000","last_peered":"2020-02-11T16:05:41.995924+0000","last_clean":"2020-02-11T16:05:41.995924+0000","last_became_active":"2020-02-11T16:05:35.953688+0000","last_became_peered":"2020-02-11T16:05:35.953688+0000","last_unstale":"2020-02-11T16:05:41.995924+0000","last_undegraded":"2020-02-11T16:05:41.995924+0000","last_fullsized":"2020-02-11T16:05:41.995924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.212828+0000","last_change":"2020-02-11T16:05:39.212531+0000","last_active":"2020-02-11T16:05:39.212828+0000","last_peered":"2020-02-11T16:05:39.212828+0000","last_clean":"2020-02-11T16:05:39.212828+0000","last_became_active":"2020-02-11T16:05:39.212022+0000","last_became_peered":"2020-02-11T16:05:39.212022+0000","last_unstale":"2020-02-11T16:05:39.212828+0000","last_undegraded":"2020-02-11T16:05:39.212828+0000","last_fullsized":"2020-02-11T16:05:39.212828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.959924+0000","last_change":"2020-02-11T16:05:32.945570+0000","last_active":"2020-02-11T16:05:38.959924+0000","last_peered":"2020-02-11T16:05:38.959924+0000","last_clean":"2020-02-11T16:05:38.959924+0000","last_became_active":"2020-02-11T16:05:32.945196+0000","last_became_peered":"2020-02-11T16:05:32.945196+0000","last_unstale":"2020-02-11T16:05:38.959924+0000","last_undegraded":"2020-02-11T16:05:38.959924+0000","last_fullsized":"2020-02-11T16:05:38.959924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:42.001478+0000","last_change":"2020-02-11T16:05:35.953882+0000","last_active":"2020-02-11T16:05:42.001478+0000","last_peered":"2020-02-11T16:05:42.001478+0000","last_clean":"2020-02-11T16:05:42.001478+0000","last_became_active":"2020-02-11T16:05:35.953459+0000","last_became_peered":"2020-02-11T16:05:35.953459+0000","last_unstale":"2020-02-11T16:05:42.001478+0000","last_undegraded":"2020-02-11T16:05:42.001478+0000","last_fullsized":"2020-02-11T16:05:42.001478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.967103+0000","last_change":"2020-02-11T16:05:38.966724+0000","last_active":"2020-02-11T16:05:38.967103+0000","last_peered":"2020-02-11T16:05:38.967103+0000","last_clean":"2020-02-11T16:05:38.967103+0000","last_became_active":"2020-02-11T16:05:38.966258+0000","last_became_peered":"2020-02-11T16:05:38.966258+0000","last_unstale":"2020-02-11T16:05:38.967103+0000","last_undegraded":"2020-02-11T16:05:38.967103+0000","last_fullsized":"2020-02-11T16:05:38.967103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.958839+0000","last_change":"2020-02-11T16:05:32.946055+0000","last_active":"2020-02-11T16:05:38.958839+0000","last_peered":"2020-02-11T16:05:38.958839+0000","last_clean":"2020-02-11T16:05:38.958839+0000","last_became_active":"2020-02-11T16:05:32.945635+0000","last_became_peered":"2020-02-11T16:05:32.945635+0000","last_unstale":"2020-02-11T16:05:38.958839+0000","last_undegraded":"2020-02-11T16:05:38.958839+0000","last_fullsized":"2020-02-11T16:05:38.958839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:42.000893+0000","last_change":"2020-02-11T16:05:35.954928+0000","last_active":"2020-02-11T16:05:42.000893+0000","last_peered":"2020-02-11T16:05:42.000893+0000","last_clean":"2020-02-11T16:05:42.000893+0000","last_became_active":"2020-02-11T16:05:35.954408+0000","last_became_peered":"2020-02-11T16:05:35.954408+0000","last_unstale":"2020-02-11T16:05:42.000893+0000","last_undegraded":"2020-02-11T16:05:42.000893+0000","last_fullsized":"2020-02-11T16:05:42.000893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133317+0000","last_change":"2020-02-11T16:05:39.132833+0000","last_active":"2020-02-11T16:05:39.133317+0000","last_peered":"2020-02-11T16:05:39.133317+0000","last_clean":"2020-02-11T16:05:39.133317+0000","last_became_active":"2020-02-11T16:05:39.132197+0000","last_became_peered":"2020-02-11T16:05:39.132197+0000","last_unstale":"2020-02-11T16:05:39.133317+0000","last_undegraded":"2020-02-11T16:05:39.133317+0000","last_fullsized":"2020-02-11T16:05:39.133317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.210805+0000","last_change":"2020-02-11T16:05:33.373076+0000","last_active":"2020-02-11T16:05:39.210805+0000","last_peered":"2020-02-11T16:05:39.210805+0000","last_clean":"2020-02-11T16:05:39.210805+0000","last_became_active":"2020-02-11T16:05:33.372511+0000","last_became_peered":"2020-02-11T16:05:33.372511+0000","last_unstale":"2020-02-11T16:05:39.210805+0000","last_undegraded":"2020-02-11T16:05:39.210805+0000","last_fullsized":"2020-02-11T16:05:39.210805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.958696+0000","last_change":"2020-02-11T16:05:36.059923+0000","last_active":"2020-02-11T16:05:38.958696+0000","last_peered":"2020-02-11T16:05:38.958696+0000","last_clean":"2020-02-11T16:05:38.958696+0000","last_became_active":"2020-02-11T16:05:36.059547+0000","last_became_peered":"2020-02-11T16:05:36.059547+0000","last_unstale":"2020-02-11T16:05:38.958696+0000","last_undegraded":"2020-02-11T16:05:38.958696+0000","last_fullsized":"2020-02-11T16:05:38.958696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133165+0000","last_change":"2020-02-11T16:05:39.132633+0000","last_active":"2020-02-11T16:05:39.133165+0000","last_peered":"2020-02-11T16:05:39.133165+0000","last_clean":"2020-02-11T16:05:39.133165+0000","last_became_active":"2020-02-11T16:05:39.132026+0000","last_became_peered":"2020-02-11T16:05:39.132026+0000","last_unstale":"2020-02-11T16:05:39.133165+0000","last_undegraded":"2020-02-11T16:05:39.133165+0000","last_fullsized":"2020-02-11T16:05:39.133165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.210935+0000","last_change":"2020-02-11T16:05:33.373028+0000","last_active":"2020-02-11T16:05:39.210935+0000","last_peered":"2020-02-11T16:05:39.210935+0000","last_clean":"2020-02-11T16:05:39.210935+0000","last_became_active":"2020-02-11T16:05:33.372511+0000","last_became_peered":"2020-02-11T16:05:33.372511+0000","last_unstale":"2020-02-11T16:05:39.210935+0000","last_undegraded":"2020-02-11T16:05:39.210935+0000","last_fullsized":"2020-02-11T16:05:39.210935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'5","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.999209+0000","last_change":"2020-02-11T16:05:35.953148+0000","last_active":"2020-02-11T16:05:41.999209+0000","last_peered":"2020-02-11T16:05:41.999209+0000","last_clean":"2020-02-11T16:05:41.999209+0000","last_became_active":"2020-02-11T16:05:35.952768+0000","last_became_peered":"2020-02-11T16:05:35.952768+0000","last_unstale":"2020-02-11T16:05:41.999209+0000","last_undegraded":"2020-02-11T16:05:41.999209+0000","last_fullsized":"2020-02-11T16:05:41.999209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133555+0000","last_change":"2020-02-11T16:05:39.132883+0000","last_active":"2020-02-11T16:05:39.133555+0000","last_peered":"2020-02-11T16:05:39.133555+0000","last_clean":"2020-02-11T16:05:39.133555+0000","last_became_active":"2020-02-11T16:05:39.132022+0000","last_became_peered":"2020-02-11T16:05:39.132022+0000","last_unstale":"2020-02-11T16:05:39.133555+0000","last_undegraded":"2020-02-11T16:05:39.133555+0000","last_fullsized":"2020-02-11T16:05:39.133555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.964797+0000","last_change":"2020-02-11T16:05:33.373034+0000","last_active":"2020-02-11T16:05:38.964797+0000","last_peered":"2020-02-11T16:05:38.964797+0000","last_clean":"2020-02-11T16:05:38.964797+0000","last_became_active":"2020-02-11T16:05:33.372467+0000","last_became_peered":"2020-02-11T16:05:33.372467+0000","last_unstale":"2020-02-11T16:05:38.964797+0000","last_undegraded":"2020-02-11T16:05:38.964797+0000","last_fullsized":"2020-02-11T16:05:38.964797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:39.842584+0000","last_change":"2020-02-11T16:05:35.953255+0000","last_active":"2020-02-11T16:05:39.842584+0000","last_peered":"2020-02-11T16:05:39.842584+0000","last_clean":"2020-02-11T16:05:39.842584+0000","last_became_active":"2020-02-11T16:05:35.952898+0000","last_became_peered":"2020-02-11T16:05:35.952898+0000","last_unstale":"2020-02-11T16:05:39.842584+0000","last_undegraded":"2020-02-11T16:05:39.842584+0000","last_fullsized":"2020-02-11T16:05:39.842584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.965927+0000","last_change":"2020-02-11T16:05:38.965473+0000","last_active":"2020-02-11T16:05:38.965927+0000","last_peered":"2020-02-11T16:05:38.965927+0000","last_clean":"2020-02-11T16:05:38.965927+0000","last_became_active":"2020-02-11T16:05:38.965054+0000","last_became_peered":"2020-02-11T16:05:38.965054+0000","last_unstale":"2020-02-11T16:05:38.965927+0000","last_undegraded":"2020-02-11T16:05:38.965927+0000","last_fullsized":"2020-02-11T16:05:38.965927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.131237+0000","last_change":"2020-02-11T16:05:33.372976+0000","last_active":"2020-02-11T16:05:39.131237+0000","last_peered":"2020-02-11T16:05:39.131237+0000","last_clean":"2020-02-11T16:05:39.131237+0000","last_became_active":"2020-02-11T16:05:33.372444+0000","last_became_peered":"2020-02-11T16:05:33.372444+0000","last_unstale":"2020-02-11T16:05:39.131237+0000","last_undegraded":"2020-02-11T16:05:39.131237+0000","last_fullsized":"2020-02-11T16:05:39.131237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"23'6","reported_seq":"17","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.999159+0000","last_change":"2020-02-11T16:05:35.954548+0000","last_active":"2020-02-11T16:05:41.999159+0000","last_peered":"2020-02-11T16:05:41.999159+0000","last_clean":"2020-02-11T16:05:41.999159+0000","last_became_active":"2020-02-11T16:05:35.954103+0000","last_became_peered":"2020-02-11T16:05:35.954103+0000","last_unstale":"2020-02-11T16:05:41.999159+0000","last_undegraded":"2020-02-11T16:05:41.999159+0000","last_fullsized":"2020-02-11T16:05:41.999159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133272+0000","last_change":"2020-02-11T16:05:39.132840+0000","last_active":"2020-02-11T16:05:39.133272+0000","last_peered":"2020-02-11T16:05:39.133272+0000","last_clean":"2020-02-11T16:05:39.133272+0000","last_became_active":"2020-02-11T16:05:39.132263+0000","last_became_peered":"2020-02-11T16:05:39.132263+0000","last_unstale":"2020-02-11T16:05:39.133272+0000","last_undegraded":"2020-02-11T16:05:39.133272+0000","last_fullsized":"2020-02-11T16:05:39.133272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.131385+0000","last_change":"2020-02-11T16:05:32.946664+0000","last_active":"2020-02-11T16:05:39.131385+0000","last_peered":"2020-02-11T16:05:39.131385+0000","last_clean":"2020-02-11T16:05:39.131385+0000","last_became_active":"2020-02-11T16:05:32.946378+0000","last_became_peered":"2020-02-11T16:05:32.946378+0000","last_unstale":"2020-02-11T16:05:39.131385+0000","last_undegraded":"2020-02-11T16:05:39.131385+0000","last_fullsized":"2020-02-11T16:05:39.131385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.998476+0000","last_change":"2020-02-11T16:05:35.952928+0000","last_active":"2020-02-11T16:05:41.998476+0000","last_peered":"2020-02-11T16:05:41.998476+0000","last_clean":"2020-02-11T16:05:41.998476+0000","last_became_active":"2020-02-11T16:05:35.952595+0000","last_became_peered":"2020-02-11T16:05:35.952595+0000","last_unstale":"2020-02-11T16:05:41.998476+0000","last_undegraded":"2020-02-11T16:05:41.998476+0000","last_fullsized":"2020-02-11T16:05:41.998476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":90093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":91053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":89401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":89401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-02-11T16:05:51.926 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-02-11T16:05:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.030+0000 7fe4cfc86700 1 Processor -- start 2020-02-11T16:05:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.030+0000 7fe4cfc86700 1 -- start start 2020-02-11T16:05:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cfc86700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4c80a4ec0 0x7fe4c812f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cfc86700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe4c812fcf0 0x7fe4c8140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cfc86700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c80a5560 con 0x7fe4c80a7120 2020-02-11T16:05:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cfc86700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c80a5350 con 0x7fe4c812fcf0 2020-02-11T16:05:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cfc86700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c809e060 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cd221700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4c80a4ec0 0x7fe4c812f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cd221700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4c80a4ec0 0x7fe4c812f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52048/0 (socket says 172.21.15.88:52048) 2020-02-11T16:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cda22700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe4c80a7120 0x7fe4c80a39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39672/0 (socket says 172.21.15.88:39672) 2020-02-11T16:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cd221700 1 -- 172.21.15.88:0/396512804 learned_addr learned my addr 172.21.15.88:0/396512804 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4ce223700 1 --2- 172.21.15.88:0/396512804 >> v2:172.21.15.52:3300/0 conn(0x7fe4c812fcf0 0x7fe4c8140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cd221700 1 -- 172.21.15.88:0/396512804 >> v2:172.21.15.52:3300/0 conn(0x7fe4c812fcf0 msgr2=0x7fe4c8140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cd221700 1 --2- 172.21.15.88:0/396512804 >> v2:172.21.15.52:3300/0 conn(0x7fe4c812fcf0 0x7fe4c8140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cd221700 1 -- 172.21.15.88:0/396512804 >> v1:172.21.15.88:6789/0 conn(0x7fe4c80a7120 legacy=0x7fe4c80a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cd221700 1 -- 172.21.15.88:0/396512804 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c809e300 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cca20700 1 -- 172.21.15.88:0/396512804 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816772417 0 0) 0x7fe4c80a5560 con 0x7fe4c80a7120 2020-02-11T16:05:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.031+0000 7fe4cd221700 1 --2- 172.21.15.88:0/396512804 >> v2:172.21.15.88:3300/0 conn(0x7fe4c80a4ec0 0x7fe4c812f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe4c4002f30 tx=0x7fe4c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cd221700 1 --2- 172.21.15.88:0/396512804 >> v2:172.21.15.88:3300/0 conn(0x7fe4c80a4ec0 0x7fe4c812f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe4c4002f30 tx=0x7fe4c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cd221700 1 --2- 172.21.15.88:0/396512804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c812f890 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fe4c4002f30 tx=0x7fe4c4007a40).ready entity=mon.1 client_cookie=1295715dd83633e3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cd221700 1 --2- 172.21.15.88:0/396512804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c812f890 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fe4c4002f30 tx=0x7fe4c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cca20700 1 -- 172.21.15.88:0/396512804 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4c4011720 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cd221700 1 --2- 172.21.15.88:0/396512804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c812f890 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fe4c4002f30 tx=0x7fe4c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cd221700 1 --2- 172.21.15.88:0/396512804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c812f890 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fe4c4002f30 tx=0x7fe4c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cca20700 1 -- 172.21.15.88:0/396512804 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c4011880 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cca20700 1 -- 172.21.15.88:0/396512804 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4c4011c20 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cfc86700 1 -- 172.21.15.88:0/396512804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c80a4ec0 msgr2=0x7fe4c812f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cfc86700 1 --2- 172.21.15.88:0/396512804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c812f890 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fe4c4002f30 tx=0x7fe4c4007a40).stop 2020-02-11T16:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cfc86700 1 -- 172.21.15.88:0/396512804 shutdown_connections 2020-02-11T16:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cfc86700 1 --2- 172.21.15.88:0/396512804 >> v2:172.21.15.52:3300/0 conn(0x7fe4c812fcf0 0x7fe4c8140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cfc86700 1 --2- 172.21.15.88:0/396512804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c812f890 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cfc86700 1 -- 172.21.15.88:0/396512804 >> 172.21.15.88:0/396512804 conn(0x7fe4c809d110 msgr2=0x7fe4c809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cfc86700 1 -- 172.21.15.88:0/396512804 shutdown_connections 2020-02-11T16:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.032+0000 7fe4cfc86700 1 -- 172.21.15.88:0/396512804 wait complete. 2020-02-11T16:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.033+0000 7fe4cfc86700 1 Processor -- start 2020-02-11T16:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.033+0000 7fe4cfc86700 1 -- start start 2020-02-11T16:05:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cfc86700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe4c80a4ec0 0x7fe4c8133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cfc86700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe4c812fcf0 0x7fe4c812a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cfc86700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c8134790 con 0x7fe4c80a7120 2020-02-11T16:05:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cfc86700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c8134580 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cfc86700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c81484c0 con 0x7fe4c812fcf0 2020-02-11T16:05:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cda22700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe4c80a4ec0 0x7fe4c8133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4ce223700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe4c812fcf0 0x7fe4c812a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cd221700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe4c80a7120 0x7fe4c8148960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59694/0 (socket says 172.21.15.88:59694) 2020-02-11T16:05:52.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cda22700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe4c80a4ec0 0x7fe4c8133f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38038/0 (socket says 172.21.15.88:38038) 2020-02-11T16:05:52.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cd221700 1 -- 172.21.15.88:0/3670516671 learned_addr learned my addr 172.21.15.88:0/3670516671 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:52.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cda22700 1 -- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe4c812fcf0 msgr2=0x7fe4c812a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cda22700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe4c812fcf0 0x7fe4c812a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cda22700 1 -- 172.21.15.88:0/3670516671 >> v1:172.21.15.52:6789/0 conn(0x7fe4c80a7120 legacy=0x7fe4c8148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cda22700 1 -- 172.21.15.88:0/3670516671 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c80a0370 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4b6ffd700 1 -- 172.21.15.88:0/3670516671 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258620610 0 0) 0x7fe4c8134790 con 0x7fe4c80a7120 2020-02-11T16:05:52.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.034+0000 7fe4cda22700 1 --2- 172.21.15.88:0/3670516671 >> v2:172.21.15.52:3300/0 conn(0x7fe4c80a4ec0 0x7fe4c8133f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe4b8000b80 tx=0x7fe4b80108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4cda22700 1 --2- 172.21.15.88:0/3670516671 >> v2:172.21.15.52:3300/0 conn(0x7fe4c80a4ec0 0x7fe4c8133f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe4b8000b80 tx=0x7fe4b80108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4cda22700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c8133f70 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fe4b8000b80 tx=0x7fe4b80108a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4cda22700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c8133f70 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fe4b8000b80 tx=0x7fe4b80108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4b6ffd700 1 -- 172.21.15.88:0/3670516671 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4b8011650 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4cda22700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c8133f70 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fe4b8000b80 tx=0x7fe4b80108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4b6ffd700 1 -- 172.21.15.88:0/3670516671 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b80117b0 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4cda22700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c8133f70 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fe4b8000b80 tx=0x7fe4b80108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4cfc86700 1 -- 172.21.15.88:0/3670516671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c8149070 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4b6ffd700 1 -- 172.21.15.88:0/3670516671 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4b8011bd0 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4cfc86700 1 -- 172.21.15.88:0/3670516671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c809fef0 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.035+0000 7fe4cda22700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c8133f70 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fe4b8000b80 tx=0x7fe4b80108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.036+0000 7fe4b6ffd700 1 -- 172.21.15.88:0/3670516671 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fe4b800b0a0 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.036+0000 7fe4cda22700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c8133f70 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fe4b8000b80 tx=0x7fe4b80108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.036+0000 7fe4cfc86700 1 -- 172.21.15.88:0/3670516671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c8149260 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.036+0000 7fe4b6ffd700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe4a80399c0 0x7fe4a803be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.036+0000 7fe4b6ffd700 1 -- 172.21.15.88:0/3670516671 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fe4b80498d0 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.036+0000 7fe4cd221700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe4a80399c0 0x7fe4a803be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.036+0000 7fe4cd221700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe4a80399c0 0x7fe4a803be80 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.040+0000 7fe4cda22700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c8133f70 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fe4b8000b80 tx=0x7fe4b80108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.040+0000 7fe4b6ffd700 1 -- 172.21.15.88:0/3670516671 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe4b802ef40 con 0x7fe4c80a4ec0 2020-02-11T16:05:52.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.172+0000 7fe4cfc86700 1 -- 172.21.15.88:0/3670516671 --> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4c80565b0 con 0x7fe4a80399c0 2020-02-11T16:05:52.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.174+0000 7fe4b6ffd700 1 -- 172.21.15.88:0/3670516671 <== mgr.4105 v2:172.21.15.52:6800/30001 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66341 (crc 0 0 0) 0x7fe4c80565b0 con 0x7fe4a80399c0 2020-02-11T16:05:52.177 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:52.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 -- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe4a80399c0 msgr2=0x7fe4a803be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe4a80399c0 0x7fe4a803be80 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 -- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4c80a4ec0 msgr2=0x7fe4c8133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c8133f70 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fe4b8000b80 tx=0x7fe4b80108a0).stop 2020-02-11T16:05:52.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 -- 172.21.15.88:0/3670516671 shutdown_connections 2020-02-11T16:05:52.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe4c812fcf0 0x7fe4c812a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe4a80399c0 0x7fe4a803be80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 --2- 172.21.15.88:0/3670516671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4c80a4ec0 0x7fe4c8133f70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 -- 172.21.15.88:0/3670516671 >> 172.21.15.88:0/3670516671 conn(0x7fe4c809d110 msgr2=0x7fe4c80a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:52.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 -- 172.21.15.88:0/3670516671 shutdown_connections 2020-02-11T16:05:52.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.176+0000 7fe4cfc86700 1 -- 172.21.15.88:0/3670516671 wait complete. 2020-02-11T16:05:52.180 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2020-02-11T16:05:52.188 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2020-02-11T16:05:50.954133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390624,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584096,"statfs":{"total":773094113280,"available":764502114304,"internally_reserved":8589934592,"allocated":1998848,"data_stored":719508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001940"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.212979+0000","last_change":"2020-02-11T16:05:39.212597+0000","last_active":"2020-02-11T16:05:39.212979+0000","last_peered":"2020-02-11T16:05:39.212979+0000","last_clean":"2020-02-11T16:05:39.212979+0000","last_became_active":"2020-02-11T16:05:39.212054+0000","last_became_peered":"2020-02-11T16:05:39.212054+0000","last_unstale":"2020-02-11T16:05:39.212979+0000","last_undegraded":"2020-02-11T16:05:39.212979+0000","last_fullsized":"2020-02-11T16:05:39.212979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.957217+0000","last_change":"2020-02-11T16:05:32.944206+0000","last_active":"2020-02-11T16:05:38.957217+0000","last_peered":"2020-02-11T16:05:38.957217+0000","last_clean":"2020-02-11T16:05:38.957217+0000","last_became_active":"2020-02-11T16:05:32.943706+0000","last_became_peered":"2020-02-11T16:05:32.943706+0000","last_unstale":"2020-02-11T16:05:38.957217+0000","last_undegraded":"2020-02-11T16:05:38.957217+0000","last_fullsized":"2020-02-11T16:05:38.957217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'4","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.995924+0000","last_change":"2020-02-11T16:05:35.954092+0000","last_active":"2020-02-11T16:05:41.995924+0000","last_peered":"2020-02-11T16:05:41.995924+0000","last_clean":"2020-02-11T16:05:41.995924+0000","last_became_active":"2020-02-11T16:05:35.953688+0000","last_became_peered":"2020-02-11T16:05:35.953688+0000","last_unstale":"2020-02-11T16:05:41.995924+0000","last_undegraded":"2020-02-11T16:05:41.995924+0000","last_fullsized":"2020-02-11T16:05:41.995924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.212828+0000","last_change":"2020-02-11T16:05:39.212531+0000","last_active":"2020-02-11T16:05:39.212828+0000","last_peered":"2020-02-11T16:05:39.212828+0000","last_clean":"2020-02-11T16:05:39.212828+0000","last_became_active":"2020-02-11T16:05:39.212022+0000","last_became_peered":"2020-02-11T16:05:39.212022+0000","last_unstale":"2020-02-11T16:05:39.212828+0000","last_undegraded":"2020-02-11T16:05:39.212828+0000","last_fullsized":"2020-02-11T16:05:39.212828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.959924+0000","last_change":"2020-02-11T16:05:32.945570+0000","last_active":"2020-02-11T16:05:38.959924+0000","last_peered":"2020-02-11T16:05:38.959924+0000","last_clean":"2020-02-11T16:05:38.959924+0000","last_became_active":"2020-02-11T16:05:32.945196+0000","last_became_peered":"2020-02-11T16:05:32.945196+0000","last_unstale":"2020-02-11T16:05:38.959924+0000","last_undegraded":"2020-02-11T16:05:38.959924+0000","last_fullsized":"2020-02-11T16:05:38.959924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:42.001478+0000","last_change":"2020-02-11T16:05:35.953882+0000","last_active":"2020-02-11T16:05:42.001478+0000","last_peered":"2020-02-11T16:05:42.001478+0000","last_clean":"2020-02-11T16:05:42.001478+0000","last_became_active":"2020-02-11T16:05:35.953459+0000","last_became_peered":"2020-02-11T16:05:35.953459+0000","last_unstale":"2020-02-11T16:05:42.001478+0000","last_undegraded":"2020-02-11T16:05:42.001478+0000","last_fullsized":"2020-02-11T16:05:42.001478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.967103+0000","last_change":"2020-02-11T16:05:38.966724+0000","last_active":"2020-02-11T16:05:38.967103+0000","last_peered":"2020-02-11T16:05:38.967103+0000","last_clean":"2020-02-11T16:05:38.967103+0000","last_became_active":"2020-02-11T16:05:38.966258+0000","last_became_peered":"2020-02-11T16:05:38.966258+0000","last_unstale":"2020-02-11T16:05:38.967103+0000","last_undegraded":"2020-02-11T16:05:38.967103+0000","last_fullsized":"2020-02-11T16:05:38.967103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.958839+0000","last_change":"2020-02-11T16:05:32.946055+0000","last_active":"2020-02-11T16:05:38.958839+0000","last_peered":"2020-02-11T16:05:38.958839+0000","last_clean":"2020-02-11T16:05:38.958839+0000","last_became_active":"2020-02-11T16:05:32.945635+0000","last_became_peered":"2020-02-11T16:05:32.945635+0000","last_unstale":"2020-02-11T16:05:38.958839+0000","last_undegraded":"2020-02-11T16:05:38.958839+0000","last_fullsized":"2020-02-11T16:05:38.958839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:42.000893+0000","last_change":"2020-02-11T16:05:35.954928+0000","last_active":"2020-02-11T16:05:42.000893+0000","last_peered":"2020-02-11T16:05:42.000893+0000","last_clean":"2020-02-11T16:05:42.000893+0000","last_became_active":"2020-02-11T16:05:35.954408+0000","last_became_peered":"2020-02-11T16:05:35.954408+0000","last_unstale":"2020-02-11T16:05:42.000893+0000","last_undegraded":"2020-02-11T16:05:42.000893+0000","last_fullsized":"2020-02-11T16:05:42.000893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133317+0000","last_change":"2020-02-11T16:05:39.132833+0000","last_active":"2020-02-11T16:05:39.133317+0000","last_peered":"2020-02-11T16:05:39.133317+0000","last_clean":"2020-02-11T16:05:39.133317+0000","last_became_active":"2020-02-11T16:05:39.132197+0000","last_became_peered":"2020-02-11T16:05:39.132197+0000","last_unstale":"2020-02-11T16:05:39.133317+0000","last_undegraded":"2020-02-11T16:05:39.133317+0000","last_fullsized":"2020-02-11T16:05:39.133317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.210805+0000","last_change":"2020-02-11T16:05:33.373076+0000","last_active":"2020-02-11T16:05:39.210805+0000","last_peered":"2020-02-11T16:05:39.210805+0000","last_clean":"2020-02-11T16:05:39.210805+0000","last_became_active":"2020-02-11T16:05:33.372511+0000","last_became_peered":"2020-02-11T16:05:33.372511+0000","last_unstale":"2020-02-11T16:05:39.210805+0000","last_undegraded":"2020-02-11T16:05:39.210805+0000","last_fullsized":"2020-02-11T16:05:39.210805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.958696+0000","last_change":"2020-02-11T16:05:36.059923+0000","last_active":"2020-02-11T16:05:38.958696+0000","last_peered":"2020-02-11T16:05:38.958696+0000","last_clean":"2020-02-11T16:05:38.958696+0000","last_became_active":"2020-02-11T16:05:36.059547+0000","last_became_peered":"2020-02-11T16:05:36.059547+0000","last_unstale":"2020-02-11T16:05:38.958696+0000","last_undegraded":"2020-02-11T16:05:38.958696+0000","last_fullsized":"2020-02-11T16:05:38.958696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133165+0000","last_change":"2020-02-11T16:05:39.132633+0000","last_active":"2020-02-11T16:05:39.133165+0000","last_peered":"2020-02-11T16:05:39.133165+0000","last_clean":"2020-02-11T16:05:39.133165+0000","last_became_active":"2020-02-11T16:05:39.132026+0000","last_became_peered":"2020-02-11T16:05:39.132026+0000","last_unstale":"2020-02-11T16:05:39.133165+0000","last_undegraded":"2020-02-11T16:05:39.133165+0000","last_fullsized":"2020-02-11T16:05:39.133165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.210935+0000","last_change":"2020-02-11T16:05:33.373028+0000","last_active":"2020-02-11T16:05:39.210935+0000","last_peered":"2020-02-11T16:05:39.210935+0000","last_clean":"2020-02-11T16:05:39.210935+0000","last_became_active":"2020-02-11T16:05:33.372511+0000","last_became_peered":"2020-02-11T16:05:33.372511+0000","last_unstale":"2020-02-11T16:05:39.210935+0000","last_undegraded":"2020-02-11T16:05:39.210935+0000","last_fullsized":"2020-02-11T16:05:39.210935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'5","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.999209+0000","last_change":"2020-02-11T16:05:35.953148+0000","last_active":"2020-02-11T16:05:41.999209+0000","last_peered":"2020-02-11T16:05:41.999209+0000","last_clean":"2020-02-11T16:05:41.999209+0000","last_became_active":"2020-02-11T16:05:35.952768+0000","last_became_peered":"2020-02-11T16:05:35.952768+0000","last_unstale":"2020-02-11T16:05:41.999209+0000","last_undegraded":"2020-02-11T16:05:41.999209+0000","last_fullsized":"2020-02-11T16:05:41.999209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133555+0000","last_change":"2020-02-11T16:05:39.132883+0000","last_active":"2020-02-11T16:05:39.133555+0000","last_peered":"2020-02-11T16:05:39.133555+0000","last_clean":"2020-02-11T16:05:39.133555+0000","last_became_active":"2020-02-11T16:05:39.132022+0000","last_became_peered":"2020-02-11T16:05:39.132022+0000","last_unstale":"2020-02-11T16:05:39.133555+0000","last_undegraded":"2020-02-11T16:05:39.133555+0000","last_fullsized":"2020-02-11T16:05:39.133555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.964797+0000","last_change":"2020-02-11T16:05:33.373034+0000","last_active":"2020-02-11T16:05:38.964797+0000","last_peered":"2020-02-11T16:05:38.964797+0000","last_clean":"2020-02-11T16:05:38.964797+0000","last_became_active":"2020-02-11T16:05:33.372467+0000","last_became_peered":"2020-02-11T16:05:33.372467+0000","last_unstale":"2020-02-11T16:05:38.964797+0000","last_undegraded":"2020-02-11T16:05:38.964797+0000","last_fullsized":"2020-02-11T16:05:38.964797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:39.842584+0000","last_change":"2020-02-11T16:05:35.953255+0000","last_active":"2020-02-11T16:05:39.842584+0000","last_peered":"2020-02-11T16:05:39.842584+0000","last_clean":"2020-02-11T16:05:39.842584+0000","last_became_active":"2020-02-11T16:05:35.952898+0000","last_became_peered":"2020-02-11T16:05:35.952898+0000","last_unstale":"2020-02-11T16:05:39.842584+0000","last_undegraded":"2020-02-11T16:05:39.842584+0000","last_fullsized":"2020-02-11T16:05:39.842584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:38.965927+0000","last_change":"2020-02-11T16:05:38.965473+0000","last_active":"2020-02-11T16:05:38.965927+0000","last_peered":"2020-02-11T16:05:38.965927+0000","last_clean":"2020-02-11T16:05:38.965927+0000","last_became_active":"2020-02-11T16:05:38.965054+0000","last_became_peered":"2020-02-11T16:05:38.965054+0000","last_unstale":"2020-02-11T16:05:38.965927+0000","last_undegraded":"2020-02-11T16:05:38.965927+0000","last_fullsized":"2020-02-11T16:05:38.965927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.131237+0000","last_change":"2020-02-11T16:05:33.372976+0000","last_active":"2020-02-11T16:05:39.131237+0000","last_peered":"2020-02-11T16:05:39.131237+0000","last_clean":"2020-02-11T16:05:39.131237+0000","last_became_active":"2020-02-11T16:05:33.372444+0000","last_became_peered":"2020-02-11T16:05:33.372444+0000","last_unstale":"2020-02-11T16:05:39.131237+0000","last_undegraded":"2020-02-11T16:05:39.131237+0000","last_fullsized":"2020-02-11T16:05:39.131237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"23'6","reported_seq":"17","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.999159+0000","last_change":"2020-02-11T16:05:35.954548+0000","last_active":"2020-02-11T16:05:41.999159+0000","last_peered":"2020-02-11T16:05:41.999159+0000","last_clean":"2020-02-11T16:05:41.999159+0000","last_became_active":"2020-02-11T16:05:35.954103+0000","last_became_peered":"2020-02-11T16:05:35.954103+0000","last_unstale":"2020-02-11T16:05:41.999159+0000","last_undegraded":"2020-02-11T16:05:41.999159+0000","last_fullsized":"2020-02-11T16:05:41.999159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.133272+0000","last_change":"2020-02-11T16:05:39.132840+0000","last_active":"2020-02-11T16:05:39.133272+0000","last_peered":"2020-02-11T16:05:39.133272+0000","last_clean":"2020-02-11T16:05:39.133272+0000","last_became_active":"2020-02-11T16:05:39.132263+0000","last_became_peered":"2020-02-11T16:05:39.132263+0000","last_unstale":"2020-02-11T16:05:39.133272+0000","last_undegraded":"2020-02-11T16:05:39.133272+0000","last_fullsized":"2020-02-11T16:05:39.133272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:37.952461+0000","last_clean_scrub_stamp":"2020-02-11T16:05:37.952461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-02-11T16:05:39.131385+0000","last_change":"2020-02-11T16:05:32.946664+0000","last_active":"2020-02-11T16:05:39.131385+0000","last_peered":"2020-02-11T16:05:39.131385+0000","last_clean":"2020-02-11T16:05:39.131385+0000","last_became_active":"2020-02-11T16:05:32.946378+0000","last_became_peered":"2020-02-11T16:05:32.946378+0000","last_unstale":"2020-02-11T16:05:39.131385+0000","last_undegraded":"2020-02-11T16:05:39.131385+0000","last_fullsized":"2020-02-11T16:05:39.131385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:31.931194+0000","last_clean_scrub_stamp":"2020-02-11T16:05:31.931194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-11T16:05:41.998476+0000","last_change":"2020-02-11T16:05:35.952928+0000","last_active":"2020-02-11T16:05:41.998476+0000","last_peered":"2020-02-11T16:05:41.998476+0000","last_clean":"2020-02-11T16:05:41.998476+0000","last_became_active":"2020-02-11T16:05:35.952595+0000","last_became_peered":"2020-02-11T16:05:35.952595+0000","last_unstale":"2020-02-11T16:05:41.998476+0000","last_undegraded":"2020-02-11T16:05:41.998476+0000","last_fullsized":"2020-02-11T16:05:41.998476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-11T16:05:34.943695+0000","last_clean_scrub_stamp":"2020-02-11T16:05:34.943695+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":90093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":91053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":89401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":89401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-02-11T16:05:52.191 INFO:tasks.mon_thrash.ceph_manager:clean! 2020-02-11T16:05:52.193 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:52.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.296+0000 7f7c60e70700 1 Processor -- start 2020-02-11T16:05:52.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.296+0000 7f7c60e70700 1 -- start start 2020-02-11T16:05:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c60e70700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c0a5b20 0x7f7c5c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c60e70700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c5c131280 0x7f7c5c131710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c60e70700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5c0a4350 con 0x7f7c5c0a2fa0 2020-02-11T16:05:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c60e70700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0a1e60 con 0x7f7c5c131280 2020-02-11T16:05:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c60e70700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0a3450 con 0x7f7c5c0a5b20 2020-02-11T16:05:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5a59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7c5c0a2fa0 0x7f7c5c0a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39686/0 (socket says 172.21.15.88:39686) 2020-02-11T16:05:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5a59c700 1 -- 172.21.15.88:0/1834538405 learned_addr learned my addr 172.21.15.88:0/1834538405 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5ad9d700 1 --2- 172.21.15.88:0/1834538405 >> v2:172.21.15.52:3300/0 conn(0x7f7c5c131280 0x7f7c5c131710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986224863 0 0) 0x7f7c5c0a4350 con 0x7f7c5c0a2fa0 2020-02-11T16:05:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c0a5b20 0x7f7c5c0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c40003230 con 0x7f7c5c0a2fa0 2020-02-11T16:05:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4182505974 0 0) 0x7f7c40003230 con 0x7f7c5c0a2fa0 2020-02-11T16:05:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c0a5b20 msgr2=0x7f7c5c0a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5959a700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c0a5b20 0x7f7c5c0a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 >> v2:172.21.15.52:3300/0 conn(0x7f7c5c131280 msgr2=0x7f7c5c131710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5959a700 1 --2- 172.21.15.88:0/1834538405 >> v2:172.21.15.52:3300/0 conn(0x7f7c5c131280 0x7f7c5c131710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.297+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0a3a40 con 0x7f7c5c0a2fa0 2020-02-11T16:05:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f7c500016d0 con 0x7f7c5c0a2fa0 2020-02-11T16:05:52.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 >> v1:172.21.15.88:6789/0 conn(0x7f7c5c0a2fa0 legacy=0x7f7c5c0a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c40003720 0x7f7c40003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:52.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c40004060 0x7f7c40004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:52.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c0a5b20 0x7f7c40004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:52.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0a1e60 con 0x7f7c40003720 2020-02-11T16:05:52.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c40004f70 con 0x7f7c40004060 2020-02-11T16:05:52.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c40005130 con 0x7f7c5c0a5b20 2020-02-11T16:05:52.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c40004060 0x7f7c40004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5a59c700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c40003720 0x7f7c40003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5ad9d700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c0a5b20 0x7f7c40004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 -- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c0a5b20 msgr2=0x7f7c40004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:52.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c0a5b20 0x7f7c40004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:52.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 -- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c40003720 msgr2=0x7f7c40003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:52.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c40003720 0x7f7c40003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:52.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 -- 172.21.15.88:0/1834538405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c40003230 con 0x7f7c40004060 2020-02-11T16:05:52.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c40004060 0x7f7c40004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c40004060 0x7f7c40004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c40004060 0x7f7c40004530 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).ready entity=mon.1 client_cookie=9e984ba9c6c04b5d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c40004060 0x7f7c40004530 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4c008d30 con 0x7f7c40004060 2020-02-11T16:05:52.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c40004060 0x7f7c40004530 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c40004060 0x7f7c40004530 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c008e90 con 0x7f7c40004060 2020-02-11T16:05:52.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5959a700 1 -- 172.21.15.88:0/1834538405 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4c010a80 con 0x7f7c40004060 2020-02-11T16:05:52.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c60e70700 1 -- 172.21.15.88:0/1834538405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c40004060 msgr2=0x7f7c40004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c60e70700 1 --2- 172.21.15.88:0/1834538405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c40004060 0x7f7c40004530 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).stop 2020-02-11T16:05:52.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.298+0000 7f7c5ad9d700 1 -- 172.21.15.88:0/1834538405 reap_dead start 2020-02-11T16:05:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.299+0000 7f7c60e70700 1 -- 172.21.15.88:0/1834538405 shutdown_connections 2020-02-11T16:05:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.299+0000 7f7c60e70700 1 -- 172.21.15.88:0/1834538405 >> 172.21.15.88:0/1834538405 conn(0x7f7c5c09d110 msgr2=0x7f7c5c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.299+0000 7f7c60e70700 1 -- 172.21.15.88:0/1834538405 shutdown_connections 2020-02-11T16:05:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.299+0000 7f7c60e70700 1 -- 172.21.15.88:0/1834538405 wait complete. 2020-02-11T16:05:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c60e70700 1 Processor -- start 2020-02-11T16:05:52.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c60e70700 1 -- start start 2020-02-11T16:05:52.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c60e70700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c139100 0x7f7c5c0667e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c60e70700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c5c066c40 0x7f7c5c0a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c60e70700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5c062fa0 con 0x7f7c5c0a0460 2020-02-11T16:05:52.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c60e70700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c062d90 con 0x7f7c5c066c40 2020-02-11T16:05:52.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c60e70700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c138280 con 0x7f7c5c139100 2020-02-11T16:05:52.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c59d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c5c066c40 0x7f7c5c0a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c59d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c5c066c40 0x7f7c5c0a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52070/0 (socket says 172.21.15.88:52070) 2020-02-11T16:05:52.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c59d9b700 1 -- 172.21.15.88:0/2791621589 learned_addr learned my addr 172.21.15.88:0/2791621589 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:52.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c5a59c700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c139100 0x7f7c5c0667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c59d9b700 1 -- 172.21.15.88:0/2791621589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c139100 msgr2=0x7f7c5c0667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c139100 0x7f7c5c0667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.300+0000 7f7c59d9b700 1 -- 172.21.15.88:0/2791621589 >> v1:172.21.15.52:6789/0 conn(0x7f7c5c0a0460 legacy=0x7f7c5c0a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c59d9b700 1 -- 172.21.15.88:0/2791621589 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0629f0 con 0x7f7c5c066c40 2020-02-11T16:05:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> v2:172.21.15.88:3300/0 conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> v2:172.21.15.88:3300/0 conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c4b7fe700 1 -- 172.21.15.88:0/2791621589 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4c0056c0 con 0x7f7c5c066c40 2020-02-11T16:05:52.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c4b7fe700 1 -- 172.21.15.88:0/2791621589 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c005860 con 0x7f7c5c066c40 2020-02-11T16:05:52.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c60e70700 1 -- 172.21.15.88:0/2791621589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5c0670a0 con 0x7f7c5c066c40 2020-02-11T16:05:52.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c4b7fe700 1 -- 172.21.15.88:0/2791621589 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4c005c80 con 0x7f7c5c066c40 2020-02-11T16:05:52.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c60e70700 1 -- 172.21.15.88:0/2791621589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c137cc0 con 0x7f7c5c066c40 2020-02-11T16:05:52.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.301+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.302+0000 7f7c4b7fe700 1 -- 172.21.15.88:0/2791621589 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f7c4c00f1f0 con 0x7f7c5c066c40 2020-02-11T16:05:52.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.302+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.302+0000 7f7c4b7fe700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c38039d10 0x7f7c3803c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.302+0000 7f7c4b7fe700 1 -- 172.21.15.88:0/2791621589 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7c4c0497d0 con 0x7f7c5c066c40 2020-02-11T16:05:52.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.302+0000 7f7c60e70700 1 -- 172.21.15.88:0/2791621589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c061700 con 0x7f7c5c066c40 2020-02-11T16:05:52.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.302+0000 7f7c5a59c700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c38039d10 0x7f7c3803c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.302+0000 7f7c5a59c700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c38039d10 0x7f7c3803c1d0 crc :-1 s=READY pgs=90 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.305+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.305+0000 7f7c4b7fe700 1 -- 172.21.15.88:0/2791621589 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f7c5c061700 con 0x7f7c5c066c40 2020-02-11T16:05:52.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.440+0000 7f7c60e70700 1 -- 172.21.15.88:0/2791621589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c5c061700 con 0x7f7c5c066c40 2020-02-11T16:05:52.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.441+0000 7f7c59d9b700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.441+0000 7f7c4b7fe700 1 -- 172.21.15.88:0/2791621589 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f7c5c061700 con 0x7f7c5c066c40 2020-02-11T16:05:52.443 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:52.443 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:39.282613+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-11T16:05:34.022912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-11T16:05:36.964421+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:52.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 -- 172.21.15.88:0/2791621589 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c38039d10 msgr2=0x7f7c3803c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c38039d10 0x7f7c3803c1d0 crc :-1 s=READY pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 -- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 msgr2=0x7f7c5c0a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 0x7f7c5c0a0000 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f7c4c008910 tx=0x7f7c4c010050).stop 2020-02-11T16:05:52.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 -- 172.21.15.88:0/2791621589 shutdown_connections 2020-02-11T16:05:52.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c38039d10 0x7f7c3803c1d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c5c139100 0x7f7c5c0667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 --2- 172.21.15.88:0/2791621589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c066c40 0x7f7c5c0a0000 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 -- 172.21.15.88:0/2791621589 >> 172.21.15.88:0/2791621589 conn(0x7f7c5c09d110 msgr2=0x7f7c5c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:52.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 -- 172.21.15.88:0/2791621589 shutdown_connections 2020-02-11T16:05:52.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.442+0000 7f7c60e70700 1 -- 172.21.15.88:0/2791621589 wait complete. 2020-02-11T16:05:52.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:30.979083+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:34.022912+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:36.964421+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-11T16:05:52.460 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-11T16:05:52.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.567+0000 7fc5198ef700 1 Processor -- start 2020-02-11T16:05:52.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.567+0000 7fc5198ef700 1 -- start start 2020-02-11T16:05:52.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc5198ef700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc5140a3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:52.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc5198ef700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5140a3c60 0x7fc514133360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:52.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc5198ef700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5141337c0 con 0x7fc5140a5e00 2020-02-11T16:05:52.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc5198ef700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5140a65e0 con 0x7fc5140a3c60 2020-02-11T16:05:52.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc5198ef700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51409ba80 con 0x7fc51405b960 2020-02-11T16:05:52.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc5127fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc5140a5e00 0x7fc514132c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39702/0 (socket says 172.21.15.88:39702) 2020-02-11T16:05:52.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc5127fc700 1 -- 172.21.15.88:0/195425889 learned_addr learned my addr 172.21.15.88:0/195425889 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:52.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc512ffd700 1 --2- 172.21.15.88:0/195425889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc5140a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc5137fe700 1 --2- 172.21.15.88:0/195425889 >> v2:172.21.15.52:3300/0 conn(0x7fc5140a3c60 0x7fc514133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc511ffb700 1 -- 172.21.15.88:0/195425889 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999739717 0 0) 0x7fc5141337c0 con 0x7fc5140a5e00 2020-02-11T16:05:52.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc511ffb700 1 -- 172.21.15.88:0/195425889 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f4003230 con 0x7fc5140a5e00 2020-02-11T16:05:52.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc511ffb700 1 -- 172.21.15.88:0/195425889 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3364488549 0 0) 0x7fc4f4003230 con 0x7fc5140a5e00 2020-02-11T16:05:52.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc512ffd700 1 -- 172.21.15.88:0/195425889 >> v2:172.21.15.52:3300/0 conn(0x7fc5140a3c60 msgr2=0x7fc514133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:52.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc512ffd700 1 --2- 172.21.15.88:0/195425889 >> v2:172.21.15.52:3300/0 conn(0x7fc5140a3c60 0x7fc514133360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:52.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc512ffd700 1 -- 172.21.15.88:0/195425889 >> v1:172.21.15.88:6789/0 conn(0x7fc5140a5e00 legacy=0x7fc514132c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc512ffd700 1 -- 172.21.15.88:0/195425889 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51409bd20 con 0x7fc51405b960 2020-02-11T16:05:52.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.568+0000 7fc512ffd700 1 --2- 172.21.15.88:0/195425889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc5140a3800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc4fc001870 tx=0x7fc5040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc512ffd700 1 --2- 172.21.15.88:0/195425889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc5140a3800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc4fc001870 tx=0x7fc5040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc512ffd700 1 --2- 172.21.15.88:0/195425889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc5140a3800 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fc4fc001870 tx=0x7fc5040088e0).ready entity=mon.2 client_cookie=6a54f2a934bc552a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc512ffd700 1 --2- 172.21.15.88:0/195425889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc5140a3800 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fc4fc001870 tx=0x7fc5040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc511ffb700 1 -- 172.21.15.88:0/195425889 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4fc0016d0 con 0x7fc51405b960 2020-02-11T16:05:52.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc512ffd700 1 --2- 172.21.15.88:0/195425889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc5140a3800 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fc4fc001870 tx=0x7fc5040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc511ffb700 1 -- 172.21.15.88:0/195425889 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc504008e40 con 0x7fc51405b960 2020-02-11T16:05:52.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc512ffd700 1 --2- 172.21.15.88:0/195425889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc5140a3800 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fc4fc001870 tx=0x7fc5040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc511ffb700 1 -- 172.21.15.88:0/195425889 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc504011400 con 0x7fc51405b960 2020-02-11T16:05:52.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc5198ef700 1 -- 172.21.15.88:0/195425889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 msgr2=0x7fc5140a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc5198ef700 1 --2- 172.21.15.88:0/195425889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc5140a3800 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fc4fc001870 tx=0x7fc5040088e0).stop 2020-02-11T16:05:52.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc5198ef700 1 -- 172.21.15.88:0/195425889 shutdown_connections 2020-02-11T16:05:52.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc5198ef700 1 --2- 172.21.15.88:0/195425889 >> v2:172.21.15.52:3300/0 conn(0x7fc5140a3c60 0x7fc514133360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:52.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc5198ef700 1 --2- 172.21.15.88:0/195425889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc5140a3800 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc5198ef700 1 -- 172.21.15.88:0/195425889 >> 172.21.15.88:0/195425889 conn(0x7fc5140aac40 msgr2=0x7fc5140a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:52.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc5198ef700 1 -- 172.21.15.88:0/195425889 shutdown_connections 2020-02-11T16:05:52.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.569+0000 7fc5198ef700 1 -- 172.21.15.88:0/195425889 wait complete. 2020-02-11T16:05:52.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.570+0000 7fc5198ef700 1 Processor -- start 2020-02-11T16:05:52.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.570+0000 7fc5198ef700 1 -- start start 2020-02-11T16:05:52.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5198ef700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc514136e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5198ef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5140a3c60 0x7fc5141351b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5198ef700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc514133a20 con 0x7fc5140a5e00 2020-02-11T16:05:52.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5198ef700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc514130d40 con 0x7fc5140a3c60 2020-02-11T16:05:52.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5198ef700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5141349b0 con 0x7fc51405b960 2020-02-11T16:05:52.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5140a3c60 0x7fc5141351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5137fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc5140a5e00 0x7fc514133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39710/0 (socket says 172.21.15.88:39710) 2020-02-11T16:05:52.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5137fe700 1 -- 172.21.15.88:0/2196119644 learned_addr learned my addr 172.21.15.88:0/2196119644 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:52.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc512ffd700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc514136e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 -- 172.21.15.88:0/2196119644 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 msgr2=0x7fc514136e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc50bfff700 1 -- 172.21.15.88:0/2196119644 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309108066 0 0) 0x7fc514133a20 con 0x7fc5140a5e00 2020-02-11T16:05:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc514136e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 -- 172.21.15.88:0/2196119644 >> v1:172.21.15.88:6789/0 conn(0x7fc5140a5e00 legacy=0x7fc514133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 -- 172.21.15.88:0/2196119644 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc514134560 con 0x7fc5140a3c60 2020-02-11T16:05:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> v2:172.21.15.88:3300/0 conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> v2:172.21.15.88:3300/0 conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc50bfff700 1 -- 172.21.15.88:0/2196119644 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4fc00c950 con 0x7fc5140a3c60 2020-02-11T16:05:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc50bfff700 1 -- 172.21.15.88:0/2196119644 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc00cab0 con 0x7fc5140a3c60 2020-02-11T16:05:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5198ef700 1 -- 172.21.15.88:0/2196119644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5140a96e0 con 0x7fc5140a3c60 2020-02-11T16:05:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc50bfff700 1 -- 172.21.15.88:0/2196119644 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4fc00ce10 con 0x7fc5140a3c60 2020-02-11T16:05:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.571+0000 7fc5198ef700 1 -- 172.21.15.88:0/2196119644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc514099e40 con 0x7fc5140a3c60 2020-02-11T16:05:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.572+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.572+0000 7fc50bfff700 1 -- 172.21.15.88:0/2196119644 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fc4fc012540 con 0x7fc5140a3c60 2020-02-11T16:05:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.572+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.573+0000 7fc5198ef700 1 -- 172.21.15.88:0/2196119644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc514134af0 con 0x7fc5140a3c60 2020-02-11T16:05:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.573+0000 7fc50bfff700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc4f8039c40 0x7fc4f803c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.573+0000 7fc50bfff700 1 -- 172.21.15.88:0/2196119644 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc4fc0498e0 con 0x7fc5140a3c60 2020-02-11T16:05:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.573+0000 7fc512ffd700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc4f8039c40 0x7fc4f803c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.573+0000 7fc512ffd700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc4f8039c40 0x7fc4f803c100 crc :-1 s=READY pgs=91 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.576+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.576+0000 7fc50bfff700 1 -- 172.21.15.88:0/2196119644 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc4fc02efd0 con 0x7fc5140a3c60 2020-02-11T16:05:52.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.710+0000 7fc5198ef700 1 -- 172.21.15.88:0/2196119644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc5140565b0 con 0x7fc5140a3c60 2020-02-11T16:05:52.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.711+0000 7fc5127fc700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.711+0000 7fc50bfff700 1 -- 172.21.15.88:0/2196119644 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc4fc031ac0 con 0x7fc5140a3c60 2020-02-11T16:05:52.714 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:52.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 -- 172.21.15.88:0/2196119644 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc4f8039c40 msgr2=0x7fc4f803c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc4f8039c40 0x7fc4f803c100 crc :-1 s=READY pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 -- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 msgr2=0x7fc5141351b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 0x7fc5141351b0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7fc4fc001930 tx=0x7fc4fc010ba0).stop 2020-02-11T16:05:52.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 -- 172.21.15.88:0/2196119644 shutdown_connections 2020-02-11T16:05:52.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc4f8039c40 0x7fc4f803c100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc51405b960 0x7fc514136e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 --2- 172.21.15.88:0/2196119644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5140a3c60 0x7fc5141351b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 -- 172.21.15.88:0/2196119644 >> 172.21.15.88:0/2196119644 conn(0x7fc5140aac40 msgr2=0x7fc5140a8200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:52.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 -- 172.21.15.88:0/2196119644 shutdown_connections 2020-02-11T16:05:52.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.712+0000 7fc5198ef700 1 -- 172.21.15.88:0/2196119644 wait complete. 2020-02-11T16:05:52.724 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-11T16:05:52.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.830+0000 7fd4fca13700 1 Processor -- start 2020-02-11T16:05:52.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.830+0000 7fd4fca13700 1 -- start start 2020-02-11T16:05:52.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4fca13700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4f80a2840 0x7fd4f80a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:52.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4fca13700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f80a5a40 con 0x7fd4f805ace0 2020-02-11T16:05:52.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4fca13700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f80a3ab0 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4fca13700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f80a2360 con 0x7fd4f80a2840 2020-02-11T16:05:52.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4f80a2840 0x7fd4f80a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f6ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd4f80a1eb0 0x7fd4f805a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39718/0 (socket says 172.21.15.88:39718) 2020-02-11T16:05:52.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f6ffd700 1 -- 172.21.15.88:0/3378507938 learned_addr learned my addr 172.21.15.88:0/3378507938 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:52.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f77fe700 1 -- 172.21.15.88:0/3378507938 >> v1:172.21.15.88:6789/0 conn(0x7fd4f80a1eb0 legacy=0x7fd4f805a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f77fe700 1 -- 172.21.15.88:0/3378507938 >> v1:172.21.15.52:6789/0 conn(0x7fd4f805ace0 legacy=0x7fd4f813f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f67fc700 1 -- 172.21.15.88:0/3378507938 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395770774 0 0) 0x7fd4f80a3ab0 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f77fe700 1 -- 172.21.15.88:0/3378507938 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f80a4260 con 0x7fd4f80a2840 2020-02-11T16:05:52.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f77fe700 1 --2- 172.21.15.88:0/3378507938 >> v2:172.21.15.88:3300/0 conn(0x7fd4f80a2840 0x7fd4f80a1a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4e8002f30 tx=0x7fd4f80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f77fe700 1 --2- 172.21.15.88:0/3378507938 >> v2:172.21.15.88:3300/0 conn(0x7fd4f80a2840 0x7fd4f80a1a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4e8002f30 tx=0x7fd4f80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f77fe700 1 --2- 172.21.15.88:0/3378507938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4f80a2840 0x7fd4f80a1a50 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fd4e8002f30 tx=0x7fd4f80684d0).ready entity=mon.1 client_cookie=43bcb9f727b8727a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f77fe700 1 --2- 172.21.15.88:0/3378507938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4f80a2840 0x7fd4f80a1a50 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fd4e8002f30 tx=0x7fd4f80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f67fc700 1 -- 172.21.15.88:0/3378507938 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e800ae80 con 0x7fd4f80a2840 2020-02-11T16:05:52.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f77fe700 1 --2- 172.21.15.88:0/3378507938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4f80a2840 0x7fd4f80a1a50 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fd4e8002f30 tx=0x7fd4f80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f77fe700 1 --2- 172.21.15.88:0/3378507938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4f80a2840 0x7fd4f80a1a50 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fd4e8002f30 tx=0x7fd4f80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f67fc700 1 -- 172.21.15.88:0/3378507938 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e8013a60 con 0x7fd4f80a2840 2020-02-11T16:05:52.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4f67fc700 1 -- 172.21.15.88:0/3378507938 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e8013e40 con 0x7fd4f80a2840 2020-02-11T16:05:52.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4fca13700 1 -- 172.21.15.88:0/3378507938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4f80a2840 msgr2=0x7fd4f80a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.831+0000 7fd4fca13700 1 --2- 172.21.15.88:0/3378507938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4f80a2840 0x7fd4f80a1a50 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fd4e8002f30 tx=0x7fd4f80684d0).stop 2020-02-11T16:05:52.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.832+0000 7fd4fca13700 1 -- 172.21.15.88:0/3378507938 shutdown_connections 2020-02-11T16:05:52.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.832+0000 7fd4fca13700 1 --2- 172.21.15.88:0/3378507938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4f80a2840 0x7fd4f80a1a50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.832+0000 7fd4fca13700 1 -- 172.21.15.88:0/3378507938 >> 172.21.15.88:0/3378507938 conn(0x7fd4f80a9f90 msgr2=0x7fd4f80aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:52.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.832+0000 7fd4fca13700 1 -- 172.21.15.88:0/3378507938 shutdown_connections 2020-02-11T16:05:52.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.832+0000 7fd4fca13700 1 -- 172.21.15.88:0/3378507938 wait complete. 2020-02-11T16:05:52.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.833+0000 7fd4fca13700 1 Processor -- start 2020-02-11T16:05:52.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.833+0000 7fd4fca13700 1 -- start start 2020-02-11T16:05:52.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.833+0000 7fd4fca13700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4fca13700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f809a950 con 0x7fd4f80a2840 2020-02-11T16:05:52.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4fca13700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f809abf0 con 0x7fd4f805ace0 2020-02-11T16:05:52.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4fca13700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f80a7660 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd4f805ace0 0x7fd4f809fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39722/0 (socket says 172.21.15.88:39722) 2020-02-11T16:05:52.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f77fe700 1 -- 172.21.15.88:0/1641002592 learned_addr learned my addr 172.21.15.88:0/1641002592 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:52.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021068063 0 0) 0x7fd4f809abf0 con 0x7fd4f805ace0 2020-02-11T16:05:52.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d8002fe0 con 0x7fd4f805ace0 2020-02-11T16:05:52.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129211289 0 0) 0x7fd4f809a950 con 0x7fd4f80a2840 2020-02-11T16:05:52.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f809abf0 con 0x7fd4f80a2840 2020-02-11T16:05:52.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1456500186 0 0) 0x7fd4d8002fe0 con 0x7fd4f805ace0 2020-02-11T16:05:52.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f6ffd700 1 -- 172.21.15.88:0/1641002592 >> v1:172.21.15.88:6789/0 conn(0x7fd4f805ace0 legacy=0x7fd4f809fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f6ffd700 1 -- 172.21.15.88:0/1641002592 >> v1:172.21.15.52:6789/0 conn(0x7fd4f80a2840 legacy=0x7fd4f8144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f6ffd700 1 -- 172.21.15.88:0/1641002592 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f80a77a0 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e800ae80 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec005ba0 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4ec0060c0 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4fca13700 1 -- 172.21.15.88:0/1641002592 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f809cfe0 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.834+0000 7fd4fca13700 1 -- 172.21.15.88:0/1641002592 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f81449a0 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.835+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.835+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fd4ec00a320 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.835+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.835+0000 7fd4fca13700 1 -- 172.21.15.88:0/1641002592 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f80a02c0 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.835+0000 7fd4f4ff9700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4d803a030 0x7fd4d803c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:52.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.835+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd4ec049560 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.836+0000 7fd4f77fe700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4d803a030 0x7fd4d803c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:52.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.836+0000 7fd4f77fe700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4d803a030 0x7fd4d803c4f0 crc :-1 s=READY pgs=92 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:52.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.839+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.839+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd4ec02eb10 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.974+0000 7fd4fca13700 1 -- 172.21.15.88:0/1641002592 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4f809ad80 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.974+0000 7fd4f6ffd700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:52.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.975+0000 7fd4f4ff9700 1 -- 172.21.15.88:0/1641002592 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd4ec031620 con 0x7fd4f80a1eb0 2020-02-11T16:05:52.977 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:52.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.976+0000 7fd4fca13700 1 -- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4d803a030 msgr2=0x7fd4d803c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.976+0000 7fd4fca13700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4d803a030 0x7fd4d803c4f0 crc :-1 s=READY pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.976+0000 7fd4fca13700 1 -- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 msgr2=0x7fd4f809b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:52.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.976+0000 7fd4fca13700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fd4f809c4e0 tx=0x7fd4ec010870).stop 2020-02-11T16:05:52.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.976+0000 7fd4fca13700 1 -- 172.21.15.88:0/1641002592 shutdown_connections 2020-02-11T16:05:52.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.976+0000 7fd4fca13700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd4d803a030 0x7fd4d803c4f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.976+0000 7fd4fca13700 1 --2- 172.21.15.88:0/1641002592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4f80a1eb0 0x7fd4f809b090 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:52.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.976+0000 7fd4fca13700 1 -- 172.21.15.88:0/1641002592 >> 172.21.15.88:0/1641002592 conn(0x7fd4f80a9f90 msgr2=0x7fd4f8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:52.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.976+0000 7fd4fca13700 1 -- 172.21.15.88:0/1641002592 shutdown_connections 2020-02-11T16:05:52.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:52.976+0000 7fd4fca13700 1 -- 172.21.15.88:0/1641002592 wait complete. 2020-02-11T16:05:52.990 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-11T16:05:53.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.096+0000 7f559f62b700 1 Processor -- start 2020-02-11T16:05:53.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.096+0000 7f559f62b700 1 -- start start 2020-02-11T16:05:53.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559f62b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f559805b960 0x7f55980a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559f62b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f559809aef0 0x7f55980a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559f62b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55980a4160 con 0x7f55980a28a0 2020-02-11T16:05:53.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559f62b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559809d950 con 0x7f559805b960 2020-02-11T16:05:53.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559f62b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559809dbf0 con 0x7f559809aef0 2020-02-11T16:05:53.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559cbc6700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f55980a28a0 0x7f5598138250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39732/0 (socket says 172.21.15.88:39732) 2020-02-11T16:05:53.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559cbc6700 1 -- 172.21.15.88:0/1169436155 learned_addr learned my addr 172.21.15.88:0/1169436155 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:53.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559d3c7700 1 --2- 172.21.15.88:0/1169436155 >> v2:172.21.15.52:3300/0 conn(0x7f559805b960 0x7f55980a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f559809aef0 0x7f55980a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f5587fff700 1 -- 172.21.15.88:0/1169436155 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017470949 0 0) 0x7f55980a4160 con 0x7f55980a28a0 2020-02-11T16:05:53.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f5587fff700 1 -- 172.21.15.88:0/1169436155 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5580003230 con 0x7f55980a28a0 2020-02-11T16:05:53.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559d3c7700 1 -- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f559809aef0 msgr2=0x7f55980a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:53.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559d3c7700 1 --2- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f559809aef0 0x7f55980a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f5587fff700 1 -- 172.21.15.88:0/1169436155 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1019610833 0 0) 0x7f5580003230 con 0x7f55980a28a0 2020-02-11T16:05:53.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559d3c7700 1 -- 172.21.15.88:0/1169436155 >> v1:172.21.15.88:6789/0 conn(0x7f55980a28a0 legacy=0x7f5598138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559d3c7700 1 -- 172.21.15.88:0/1169436155 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55980a60c0 con 0x7f559805b960 2020-02-11T16:05:53.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559d3c7700 1 --2- 172.21.15.88:0/1169436155 >> v2:172.21.15.52:3300/0 conn(0x7f559805b960 0x7f55980a67e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5594001870 tx=0x7f55880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559d3c7700 1 --2- 172.21.15.88:0/1169436155 >> v2:172.21.15.52:3300/0 conn(0x7f559805b960 0x7f55980a67e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5594001870 tx=0x7f55880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.097+0000 7f559d3c7700 1 --2- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f559805b960 0x7f55980a67e0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f5594001870 tx=0x7f55880088e0).ready entity=mon.0 client_cookie=dfe5e5b85d0546fc server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559d3c7700 1 --2- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f559805b960 0x7f55980a67e0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5594001870 tx=0x7f55880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f5587fff700 1 -- 172.21.15.88:0/1169436155 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55940016d0 con 0x7f559805b960 2020-02-11T16:05:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559d3c7700 1 --2- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f559805b960 0x7f55980a67e0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5594001870 tx=0x7f55880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559d3c7700 1 --2- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f559805b960 0x7f55980a67e0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5594001870 tx=0x7f55880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f5587fff700 1 -- 172.21.15.88:0/1169436155 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5588008e40 con 0x7f559805b960 2020-02-11T16:05:53.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f5587fff700 1 -- 172.21.15.88:0/1169436155 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5588011400 con 0x7f559805b960 2020-02-11T16:05:53.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559f62b700 1 -- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f559805b960 msgr2=0x7f55980a67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559f62b700 1 --2- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f559805b960 0x7f55980a67e0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f5594001870 tx=0x7f55880088e0).stop 2020-02-11T16:05:53.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559f62b700 1 -- 172.21.15.88:0/1169436155 shutdown_connections 2020-02-11T16:05:53.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559f62b700 1 --2- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f559809aef0 0x7f55980a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559f62b700 1 --2- 172.21.15.88:0/1169436155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f559805b960 0x7f55980a67e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559f62b700 1 -- 172.21.15.88:0/1169436155 >> 172.21.15.88:0/1169436155 conn(0x7f55980aac40 msgr2=0x7f55980a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:53.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559f62b700 1 -- 172.21.15.88:0/1169436155 shutdown_connections 2020-02-11T16:05:53.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.098+0000 7f559f62b700 1 -- 172.21.15.88:0/1169436155 wait complete. 2020-02-11T16:05:53.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.099+0000 7f559f62b700 1 Processor -- start 2020-02-11T16:05:53.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.099+0000 7f559f62b700 1 -- start start 2020-02-11T16:05:53.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559f62b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55980a28a0 0x7f5598131540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559f62b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559809ee90 con 0x7f559809aef0 2020-02-11T16:05:53.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559f62b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5598146480 con 0x7f559805b960 2020-02-11T16:05:53.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559f62b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559809ecb0 con 0x7f55980a28a0 2020-02-11T16:05:53.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559d3c7700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f559805b960 0x7f5598146920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39736/0 (socket says 172.21.15.88:39736) 2020-02-11T16:05:53.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559dbc8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55980a28a0 0x7f5598131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559d3c7700 1 -- 172.21.15.88:0/1948345798 learned_addr learned my addr 172.21.15.88:0/1948345798 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:53.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559dbc8700 1 -- 172.21.15.88:0/1948345798 >> v1:172.21.15.88:6789/0 conn(0x7f559805b960 legacy=0x7f5598146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559dbc8700 1 -- 172.21.15.88:0/1948345798 >> v1:172.21.15.52:6789/0 conn(0x7f559809aef0 legacy=0x7f5598130e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f55867fc700 1 -- 172.21.15.88:0/1948345798 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012308492 0 0) 0x7f5598146480 con 0x7f559805b960 2020-02-11T16:05:53.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559dbc8700 1 -- 172.21.15.88:0/1948345798 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598138d60 con 0x7f55980a28a0 2020-02-11T16:05:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1948345798 >> v2:172.21.15.88:3300/0 conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1948345798 >> v2:172.21.15.88:3300/0 conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f55867fc700 1 -- 172.21.15.88:0/1948345798 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5590005e30 con 0x7f55980a28a0 2020-02-11T16:05:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f55867fc700 1 -- 172.21.15.88:0/1948345798 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590007540 con 0x7f55980a28a0 2020-02-11T16:05:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f55867fc700 1 -- 172.21.15.88:0/1948345798 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55900078e0 con 0x7f55980a28a0 2020-02-11T16:05:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559f62b700 1 -- 172.21.15.88:0/1948345798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5598138400 con 0x7f55980a28a0 2020-02-11T16:05:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.100+0000 7f559f62b700 1 -- 172.21.15.88:0/1948345798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5598147270 con 0x7f55980a28a0 2020-02-11T16:05:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.101+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.101+0000 7f55867fc700 1 -- 172.21.15.88:0/1948345798 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f55900125f0 con 0x7f55980a28a0 2020-02-11T16:05:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.101+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.101+0000 7f55867fc700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5578039a70 0x7f557803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.101+0000 7f55867fc700 1 -- 172.21.15.88:0/1948345798 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5590049eb0 con 0x7f55980a28a0 2020-02-11T16:05:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.101+0000 7f559f62b700 1 -- 172.21.15.88:0/1948345798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5598146610 con 0x7f55980a28a0 2020-02-11T16:05:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.102+0000 7f559d3c7700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5578039a70 0x7f557803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.102+0000 7f559d3c7700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5578039a70 0x7f557803bf30 crc :-1 s=READY pgs=93 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.105+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.105+0000 7f55867fc700 1 -- 172.21.15.88:0/1948345798 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f559002f4c0 con 0x7f55980a28a0 2020-02-11T16:05:53.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.239+0000 7f559f62b700 1 -- 172.21.15.88:0/1948345798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f559809e9f0 con 0x7f55980a28a0 2020-02-11T16:05:53.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.240+0000 7f559dbc8700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.240+0000 7f55867fc700 1 -- 172.21.15.88:0/1948345798 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5590031fd0 con 0x7f55980a28a0 2020-02-11T16:05:53.243 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:53.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.241+0000 7f559f62b700 1 -- 172.21.15.88:0/1948345798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5578039a70 msgr2=0x7f557803bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.241+0000 7f559f62b700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5578039a70 0x7f557803bf30 crc :-1 s=READY pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.241+0000 7f559f62b700 1 -- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 msgr2=0x7f5598131540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.241+0000 7f559f62b700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 0x7f5598131540 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f5598061310 tx=0x7f5590010f90).stop 2020-02-11T16:05:53.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.241+0000 7f559f62b700 1 -- 172.21.15.88:0/1948345798 shutdown_connections 2020-02-11T16:05:53.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.241+0000 7f559f62b700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5578039a70 0x7f557803bf30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.241+0000 7f559f62b700 1 --2- 172.21.15.88:0/1948345798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55980a28a0 0x7f5598131540 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.241+0000 7f559f62b700 1 -- 172.21.15.88:0/1948345798 >> 172.21.15.88:0/1948345798 conn(0x7f55980aac40 msgr2=0x7f55980a1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:53.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.241+0000 7f559f62b700 1 -- 172.21.15.88:0/1948345798 shutdown_connections 2020-02-11T16:05:53.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.241+0000 7f559f62b700 1 -- 172.21.15.88:0/1948345798 wait complete. 2020-02-11T16:05:53.253 DEBUG:tasks.mon_thrash:Yielding 2020-02-11T16:05:53.253 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-02-11T16:05:53.275 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-02-11T16:05:53.275 INFO:tasks.ceph_fuse:config is None 2020-02-11T16:05:53.276 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-02-11T16:05:53.276 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-02-11T16:05:53.276 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-11T16:05:53.277 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-02-11T16:05:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7fe58a48f700 1 Processor -- start 2020-02-11T16:05:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7fe58a48f700 1 -- start start 2020-02-11T16:05:53.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7fe58a48f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe58405fc80 0x7fe58413bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7fe58a48f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5840670f0 0x7fe58409d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7fe58a48f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5841325d0 con 0x7fe5840a9750 2020-02-11T16:05:53.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7fe58a48f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5840a9bb0 con 0x7fe5840670f0 2020-02-11T16:05:53.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7fe58a48f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58405c1a0 con 0x7fe58405fc80 2020-02-11T16:05:53.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5840670f0 0x7fe58409d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe588c8c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe5840a9750 0x7fe5840669e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39744/0 (socket says 172.21.15.88:39744) 2020-02-11T16:05:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe588c8c700 1 -- 172.21.15.88:0/2199503559 learned_addr learned my addr 172.21.15.88:0/2199503559 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe58948d700 1 --2- 172.21.15.88:0/2199503559 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe58405fc80 0x7fe58413bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 -- 172.21.15.88:0/2199503559 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe58405fc80 msgr2=0x7fe58413bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 --2- 172.21.15.88:0/2199503559 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe58405fc80 0x7fe58413bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 -- 172.21.15.88:0/2199503559 >> v1:172.21.15.88:6789/0 conn(0x7fe5840a9750 legacy=0x7fe5840669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe573fff700 1 -- 172.21.15.88:0/2199503559 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836757923 0 0) 0x7fe5841325d0 con 0x7fe5840a9750 2020-02-11T16:05:53.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 -- 172.21.15.88:0/2199503559 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58413b2f0 con 0x7fe5840670f0 2020-02-11T16:05:53.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 --2- 172.21.15.88:0/2199503559 >> v2:172.21.15.88:3300/0 conn(0x7fe5840670f0 0x7fe58409d110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe57c0032b0 tx=0x7fe57c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 --2- 172.21.15.88:0/2199503559 >> v2:172.21.15.88:3300/0 conn(0x7fe5840670f0 0x7fe58409d110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe57c0032b0 tx=0x7fe57c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 --2- 172.21.15.88:0/2199503559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840670f0 0x7fe58409d110 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fe57c0032b0 tx=0x7fe57c008c60).ready entity=mon.1 client_cookie=ebbb710b8f0b53c3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 --2- 172.21.15.88:0/2199503559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840670f0 0x7fe58409d110 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fe57c0032b0 tx=0x7fe57c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 --2- 172.21.15.88:0/2199503559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840670f0 0x7fe58409d110 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fe57c0032b0 tx=0x7fe57c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe573fff700 1 -- 172.21.15.88:0/2199503559 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe57c00a160 con 0x7fe5840670f0 2020-02-11T16:05:53.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe589c8e700 1 --2- 172.21.15.88:0/2199503559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840670f0 0x7fe58409d110 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fe57c0032b0 tx=0x7fe57c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe573fff700 1 -- 172.21.15.88:0/2199503559 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c00a2c0 con 0x7fe5840670f0 2020-02-11T16:05:53.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe573fff700 1 -- 172.21.15.88:0/2199503559 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe57c00a660 con 0x7fe5840670f0 2020-02-11T16:05:53.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe58a48f700 1 -- 172.21.15.88:0/2199503559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840670f0 msgr2=0x7fe58409d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7fe58a48f700 1 --2- 172.21.15.88:0/2199503559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840670f0 0x7fe58409d110 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fe57c0032b0 tx=0x7fe57c008c60).stop 2020-02-11T16:05:53.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7fe58a48f700 1 -- 172.21.15.88:0/2199503559 shutdown_connections 2020-02-11T16:05:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7fe58a48f700 1 --2- 172.21.15.88:0/2199503559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840670f0 0x7fe58409d110 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7fe58a48f700 1 --2- 172.21.15.88:0/2199503559 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe58405fc80 0x7fe58413bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7fe58a48f700 1 -- 172.21.15.88:0/2199503559 >> 172.21.15.88:0/2199503559 conn(0x7fe5840aeea0 msgr2=0x7fe5840aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7fe58a48f700 1 -- 172.21.15.88:0/2199503559 shutdown_connections 2020-02-11T16:05:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7fe58a48f700 1 -- 172.21.15.88:0/2199503559 wait complete. 2020-02-11T16:05:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.388+0000 7fe58a48f700 1 Processor -- start 2020-02-11T16:05:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.388+0000 7fe58a48f700 1 -- start start 2020-02-11T16:05:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.389+0000 7fe58a48f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe58405fc80 0x7fe584136730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.389+0000 7fe58a48f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5841371b0 con 0x7fe5840a9750 2020-02-11T16:05:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.389+0000 7fe58a48f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5840a1ed0 con 0x7fe5840670f0 2020-02-11T16:05:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.389+0000 7fe58a48f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe584135d50 con 0x7fe58405fc80 2020-02-11T16:05:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.389+0000 7fe58948d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe58405fc80 0x7fe584136730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe58405fc80 0x7fe584136730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52132/0 (socket says 172.21.15.88:52132) 2020-02-11T16:05:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 -- 172.21.15.88:0/4179485375 learned_addr learned my addr 172.21.15.88:0/4179485375 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 -- 172.21.15.88:0/4179485375 >> v1:172.21.15.88:6789/0 conn(0x7fe5840670f0 legacy=0x7fe58413ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 -- 172.21.15.88:0/4179485375 >> v1:172.21.15.52:6789/0 conn(0x7fe5840a9750 legacy=0x7fe584144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 -- 172.21.15.88:0/4179485375 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe584135ff0 con 0x7fe58405fc80 2020-02-11T16:05:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 --2- 172.21.15.88:0/4179485375 >> v2:172.21.15.88:3300/0 conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 --2- 172.21.15.88:0/4179485375 >> v2:172.21.15.88:3300/0 conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe5727fc700 1 -- 172.21.15.88:0/4179485375 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe580012b40 con 0x7fe58405fc80 2020-02-11T16:05:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58948d700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe5727fc700 1 -- 172.21.15.88:0/4179485375 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580012ca0 con 0x7fe58405fc80 2020-02-11T16:05:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe5727fc700 1 -- 172.21.15.88:0/4179485375 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe580012e50 con 0x7fe58405fc80 2020-02-11T16:05:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7fe58a48f700 1 -- 172.21.15.88:0/4179485375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe584136290 con 0x7fe58405fc80 2020-02-11T16:05:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.391+0000 7fe58a48f700 1 -- 172.21.15.88:0/4179485375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5840ad8c0 con 0x7fe58405fc80 2020-02-11T16:05:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.391+0000 7fe58948d700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7fe5727fc700 1 -- 172.21.15.88:0/4179485375 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fe580009460 con 0x7fe58405fc80 2020-02-11T16:05:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7fe58a48f700 1 -- 172.21.15.88:0/4179485375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe584136420 con 0x7fe58405fc80 2020-02-11T16:05:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7fe58948d700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7fe5727fc700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe564039ba0 0x7fe56403c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7fe5727fc700 1 -- 172.21.15.88:0/4179485375 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fe580049e70 con 0x7fe58405fc80 2020-02-11T16:05:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7fe588c8c700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe564039ba0 0x7fe56403c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7fe588c8c700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe564039ba0 0x7fe56403c060 crc :-1 s=READY pgs=94 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.396+0000 7fe58948d700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.396+0000 7fe5727fc700 1 -- 172.21.15.88:0/4179485375 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe58002f410 con 0x7fe58405fc80 2020-02-11T16:05:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7f81f0d6a700 1 Processor -- start 2020-02-11T16:05:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7f81f0d6a700 1 -- start start 2020-02-11T16:05:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7f81f0d6a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81ec0ad380 0x7f81ec0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7f81f0d6a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 0x7f81ec1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7f81f0d6a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81ec13b1c0 0x7f81ec13b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.385+0000 7f81f0d6a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec137bf0 con 0x7f81ec0ad380 2020-02-11T16:05:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81f0d6a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec138b40 con 0x7f81ec13b1c0 2020-02-11T16:05:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81f0d6a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec0adb40 con 0x7f81ec138280 2020-02-11T16:05:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81ec13b1c0 0x7f81ec13b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81ec13b1c0 0x7f81ec13b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52128/0 (socket says 172.21.15.88:52128) 2020-02-11T16:05:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 -- 172.21.15.88:0/2377888911 learned_addr learned my addr 172.21.15.88:0/2377888911 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ea59c700 1 --2- 172.21.15.88:0/2377888911 >> v2:172.21.15.52:3300/0 conn(0x7f81ec0ad380 0x7f81ec0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81e9d9b700 1 --2- 172.21.15.88:0/2377888911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 0x7f81ec1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 -- 172.21.15.88:0/2377888911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 msgr2=0x7f81ec1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:53.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 --2- 172.21.15.88:0/2377888911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 0x7f81ec1386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 -- 172.21.15.88:0/2377888911 >> v2:172.21.15.52:3300/0 conn(0x7f81ec0ad380 msgr2=0x7f81ec0a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:53.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 --2- 172.21.15.88:0/2377888911 >> v2:172.21.15.52:3300/0 conn(0x7f81ec0ad380 0x7f81ec0a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 -- 172.21.15.88:0/2377888911 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec137de0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81e9d9b700 1 --2- 172.21.15.88:0/2377888911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 0x7f81ec1386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:05:53.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 --2- 172.21.15.88:0/2377888911 >> v2:172.21.15.88:3300/0 conn(0x7f81ec13b1c0 0x7f81ec13b600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 --2- 172.21.15.88:0/2377888911 >> v2:172.21.15.88:3300/0 conn(0x7f81ec13b1c0 0x7f81ec13b600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 --2- 172.21.15.88:0/2377888911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec13b600 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).ready entity=mon.1 client_cookie=4eb16aae88e17942 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 --2- 172.21.15.88:0/2377888911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec13b600 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 --2- 172.21.15.88:0/2377888911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec13b600 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81ead9d700 1 --2- 172.21.15.88:0/2377888911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec13b600 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81e959a700 1 -- 172.21.15.88:0/2377888911 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc011670 con 0x7f81ec13b1c0 2020-02-11T16:05:53.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81e959a700 1 -- 172.21.15.88:0/2377888911 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc0117d0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81e959a700 1 -- 172.21.15.88:0/2377888911 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc011b70 con 0x7f81ec13b1c0 2020-02-11T16:05:53.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81f0d6a700 1 -- 172.21.15.88:0/2377888911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 msgr2=0x7f81ec13b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.386+0000 7f81f0d6a700 1 --2- 172.21.15.88:0/2377888911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec13b600 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).stop 2020-02-11T16:05:53.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7f81f0d6a700 1 -- 172.21.15.88:0/2377888911 shutdown_connections 2020-02-11T16:05:53.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7f81f0d6a700 1 --2- 172.21.15.88:0/2377888911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec13b600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7f81f0d6a700 1 --2- 172.21.15.88:0/2377888911 >> v2:172.21.15.52:3300/0 conn(0x7f81ec0ad380 0x7f81ec0a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7f81f0d6a700 1 --2- 172.21.15.88:0/2377888911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 0x7f81ec1386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7f81f0d6a700 1 -- 172.21.15.88:0/2377888911 >> 172.21.15.88:0/2377888911 conn(0x7f81ec05ac70 msgr2=0x7f81ec0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:53.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7f81f0d6a700 1 -- 172.21.15.88:0/2377888911 shutdown_connections 2020-02-11T16:05:53.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.387+0000 7f81f0d6a700 1 -- 172.21.15.88:0/2377888911 wait complete. 2020-02-11T16:05:53.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.388+0000 7f81f0d6a700 1 Processor -- start 2020-02-11T16:05:53.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.388+0000 7f81f0d6a700 1 -- start start 2020-02-11T16:05:53.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.389+0000 7f81f0d6a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 0x7f81ec134a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.389+0000 7f81f0d6a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81ec13b1c0 0x7f81ec12da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.389+0000 7f81f0d6a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec132570 con 0x7f81ec0ad380 2020-02-11T16:05:53.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.389+0000 7f81f0d6a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec13ae10 con 0x7f81ec13b1c0 2020-02-11T16:05:53.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.389+0000 7f81f0d6a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec135160 con 0x7f81ec138280 2020-02-11T16:05:53.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ea59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f81ec0ad380 0x7f81ec13a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39756/0 (socket says 172.21.15.88:39756) 2020-02-11T16:05:53.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ea59c700 1 -- 172.21.15.88:0/3019516335 learned_addr learned my addr 172.21.15.88:0/3019516335 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:53.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> v2:172.21.15.88:3300/0 conn(0x7f81ec13b1c0 0x7f81ec12da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81e9d9b700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 0x7f81ec134a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81db7fe700 1 -- 172.21.15.88:0/3019516335 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599761388 0 0) 0x7f81ec132570 con 0x7f81ec0ad380 2020-02-11T16:05:53.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81db7fe700 1 -- 172.21.15.88:0/3019516335 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c8002fe0 con 0x7f81ec0ad380 2020-02-11T16:05:53.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 -- 172.21.15.88:0/3019516335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 msgr2=0x7f81ec134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 0x7f81ec134a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 -- 172.21.15.88:0/3019516335 >> v1:172.21.15.88:6789/0 conn(0x7f81ec0ad380 legacy=0x7f81ec13a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 -- 172.21.15.88:0/3019516335 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec1327a0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> v2:172.21.15.88:3300/0 conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> v2:172.21.15.88:3300/0 conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81db7fe700 1 -- 172.21.15.88:0/3019516335 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc011db0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81db7fe700 1 -- 172.21.15.88:0/3019516335 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc007150 con 0x7f81ec13b1c0 2020-02-11T16:05:53.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81db7fe700 1 -- 172.21.15.88:0/3019516335 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc0074b0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.390+0000 7f81f0d6a700 1 -- 172.21.15.88:0/3019516335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ec134eb0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.391+0000 7f81f0d6a700 1 -- 172.21.15.88:0/3019516335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ec130300 con 0x7f81ec13b1c0 2020-02-11T16:05:53.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.391+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7f81f0d6a700 1 -- 172.21.15.88:0/3019516335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ec1352d0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7f81db7fe700 1 -- 172.21.15.88:0/3019516335 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f81dc0056c0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7f81db7fe700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81c8039f10 0x7f81c803c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.392+0000 7f81db7fe700 1 -- 172.21.15.88:0/3019516335 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f81dc049f60 con 0x7f81ec13b1c0 2020-02-11T16:05:53.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.393+0000 7f81ea59c700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81c8039f10 0x7f81c803c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.393+0000 7f81ea59c700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81c8039f10 0x7f81c803c3d0 crc :-1 s=READY pgs=95 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.401+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.401+0000 7f81db7fe700 1 -- 172.21.15.88:0/3019516335 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f81ec1352d0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.545+0000 7fe58a48f700 1 -- 172.21.15.88:0/4179485375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5841371b0 con 0x7fe58405fc80 2020-02-11T16:05:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.546+0000 7fe58948d700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.546+0000 7fe5727fc700 1 -- 172.21.15.88:0/4179485375 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14885 (secure 0 0 0) 0x7fe5841371b0 con 0x7fe58405fc80 2020-02-11T16:05:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:53.549 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","created":"2020-02-11T16:05:17.938772+0000","modified":"2020-02-11T16:05:39.282613+0000","last_up_change":"2020-02-11T16:05:26.914554+0000","last_in_change":"2020-02-11T16:05:26.914554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-11T16:05:30.979083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-11T16:05:34.022912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-11T16:05:36.964421+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"809323e5-6c36-494b-84da-c02a9e07821b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":30740},{"type":"v1","addr":"172.21.15.88:6818","nonce":30740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":30740},{"type":"v1","addr":"172.21.15.88:6822","nonce":30740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":30740},{"type":"v1","addr":"172.21.15.88:6830","nonce":30740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":30740},{"type":"v1","addr":"172.21.15.88:6826","nonce":30740}]},"public_addr":"172.21.15.88:6818/30740","cluster_addr":"172.21.15.88:6822/30740","heartbeat_back_addr":"172.21.15.88:6830/30740","heartbeat_front_addr":"172.21.15.88:6826/30740","state":["exists","up"]},{"osd":1,"uuid":"0760ed1f-9e02-4585-a5f9-449338628583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":30710},{"type":"v1","addr":"172.21.15.88:6801","nonce":30710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":30710},{"type":"v1","addr":"172.21.15.88:6803","nonce":30710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":30710},{"type":"v1","addr":"172.21.15.88:6807","nonce":30710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":30710},{"type":"v1","addr":"172.21.15.88:6805","nonce":30710}]},"public_addr":"172.21.15.88:6801/30710","cluster_addr":"172.21.15.88:6803/30710","heartbeat_back_addr":"172.21.15.88:6807/30710","heartbeat_front_addr":"172.21.15.88:6805/30710","state":["exists","up"]},{"osd":2,"uuid":"d6372c66-ded4-496f-bf0a-43938f97dd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":30741},{"type":"v1","addr":"172.21.15.88:6819","nonce":30741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":30741},{"type":"v1","addr":"172.21.15.88:6823","nonce":30741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":30741},{"type":"v1","addr":"172.21.15.88:6831","nonce":30741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":30741},{"type":"v1","addr":"172.21.15.88:6827","nonce":30741}]},"public_addr":"172.21.15.88:6819/30741","cluster_addr":"172.21.15.88:6823/30741","heartbeat_back_addr":"172.21.15.88:6831/30741","heartbeat_front_addr":"172.21.15.88:6827/30741","state":["exists","up"]},{"osd":3,"uuid":"b686c004-a479-4f21-8ec2-3874704bab42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":30711},{"type":"v1","addr":"172.21.15.88:6809","nonce":30711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":30711},{"type":"v1","addr":"172.21.15.88:6811","nonce":30711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":30711},{"type":"v1","addr":"172.21.15.88:6815","nonce":30711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":30711},{"type":"v1","addr":"172.21.15.88:6813","nonce":30711}]},"public_addr":"172.21.15.88:6809/30711","cluster_addr":"172.21.15.88:6811/30711","heartbeat_back_addr":"172.21.15.88:6815/30711","heartbeat_front_addr":"172.21.15.88:6813/30711","state":["exists","up"]},{"osd":4,"uuid":"8308f9a9-ae7c-4f12-aa90-a62f92b2fedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":30959},{"type":"v1","addr":"172.21.15.52:6803","nonce":30959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":30959},{"type":"v1","addr":"172.21.15.52:6805","nonce":30959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":30959},{"type":"v1","addr":"172.21.15.52:6809","nonce":30959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":30959},{"type":"v1","addr":"172.21.15.52:6807","nonce":30959}]},"public_addr":"172.21.15.52:6803/30959","cluster_addr":"172.21.15.52:6805/30959","heartbeat_back_addr":"172.21.15.52:6809/30959","heartbeat_front_addr":"172.21.15.52:6807/30959","state":["exists","up"]},{"osd":5,"uuid":"fe73c4ac-93b9-4066-adc8-3b13e4a67261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":30989},{"type":"v1","addr":"172.21.15.52:6819","nonce":30989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":30989},{"type":"v1","addr":"172.21.15.52:6821","nonce":30989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":30989},{"type":"v1","addr":"172.21.15.52:6825","nonce":30989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":30989},{"type":"v1","addr":"172.21.15.52:6823","nonce":30989}]},"public_addr":"172.21.15.52:6819/30989","cluster_addr":"172.21.15.52:6821/30989","heartbeat_back_addr":"172.21.15.52:6825/30989","heartbeat_front_addr":"172.21.15.52:6823/30989","state":["exists","up"]},{"osd":6,"uuid":"418810c8-ca04-4604-8b83-b6570a75e62a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":30990},{"type":"v1","addr":"172.21.15.52:6827","nonce":30990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":30990},{"type":"v1","addr":"172.21.15.52:6829","nonce":30990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":30990},{"type":"v1","addr":"172.21.15.52:6833","nonce":30990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":30990},{"type":"v1","addr":"172.21.15.52:6831","nonce":30990}]},"public_addr":"172.21.15.52:6827/30990","cluster_addr":"172.21.15.52:6829/30990","heartbeat_back_addr":"172.21.15.52:6833/30990","heartbeat_front_addr":"172.21.15.52:6831/30990","state":["exists","up"]},{"osd":7,"uuid":"50e1714c-c39e-4dd2-bbad-d1fc70c4e304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":30960},{"type":"v1","addr":"172.21.15.52:6811","nonce":30960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":30960},{"type":"v1","addr":"172.21.15.52:6813","nonce":30960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":30960},{"type":"v1","addr":"172.21.15.52:6817","nonce":30960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":30960},{"type":"v1","addr":"172.21.15.52:6815","nonce":30960}]},"public_addr":"172.21.15.52:6811/30960","cluster_addr":"172.21.15.52:6813/30960","heartbeat_back_addr":"172.21.15.52:6817/30960","heartbeat_front_addr":"172.21.15.52:6815/30960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.210583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.157199+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.178257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.217464+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.182450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.265172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.240367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-11T16:05:25.200655+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-11T16:05:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.547+0000 7fe58a48f700 1 -- 172.21.15.88:0/4179485375 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe564039ba0 msgr2=0x7fe56403c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.547+0000 7fe58a48f700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe564039ba0 0x7fe56403c060 crc :-1 s=READY pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.547+0000 7fe58a48f700 1 -- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 msgr2=0x7fe584136730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.547+0000 7fe58a48f700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 0x7fe584136730 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7fe5840ae0d0 tx=0x7fe580010d10).stop 2020-02-11T16:05:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.547+0000 7fe58a48f700 1 -- 172.21.15.88:0/4179485375 shutdown_connections 2020-02-11T16:05:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.547+0000 7fe58a48f700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe564039ba0 0x7fe56403c060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.547+0000 7fe58a48f700 1 --2- 172.21.15.88:0/4179485375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58405fc80 0x7fe584136730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.547+0000 7fe58a48f700 1 -- 172.21.15.88:0/4179485375 >> 172.21.15.88:0/4179485375 conn(0x7fe5840aeea0 msgr2=0x7fe584069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:53.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.547+0000 7fe58a48f700 1 -- 172.21.15.88:0/4179485375 shutdown_connections 2020-02-11T16:05:53.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.547+0000 7fe58a48f700 1 -- 172.21.15.88:0/4179485375 wait complete. 2020-02-11T16:05:53.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:30.979083+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:34.022912+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-11T16:05:36.964421+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-11T16:05:53.560 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-11T16:05:53.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.595+0000 7f81f0d6a700 1 -- 172.21.15.88:0/3019516335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81ec1352d0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.595+0000 7f81ead9d700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.595+0000 7f81db7fe700 1 -- 172.21.15.88:0/3019516335 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f81ec1352d0 con 0x7f81ec13b1c0 2020-02-11T16:05:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:53.598 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/4168884093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":4168884093},{"type":"v1","addr":"172.21.15.88:6833","nonce":4168884093}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-02-11T16:05:39.282829+0000","modified":"2020-02-11T16:05:42.987581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.52:6835/3175516603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3175516603},{"type":"v1","addr":"172.21.15.52:6835","nonce":3175516603}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-02-11T16:05:53.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 -- 172.21.15.88:0/3019516335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81c8039f10 msgr2=0x7f81c803c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81c8039f10 0x7f81c803c3d0 crc :-1 s=READY pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 -- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 msgr2=0x7f81ec12da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec12da90 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f81dc002f30 tx=0x7f81dc007a40).stop 2020-02-11T16:05:53.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 -- 172.21.15.88:0/3019516335 shutdown_connections 2020-02-11T16:05:53.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81c8039f10 0x7f81c803c3d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81ec13b1c0 0x7f81ec12da90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 --2- 172.21.15.88:0/3019516335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81ec138280 0x7f81ec134a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 -- 172.21.15.88:0/3019516335 >> 172.21.15.88:0/3019516335 conn(0x7f81ec05ac70 msgr2=0x7f81ec069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 -- 172.21.15.88:0/3019516335 shutdown_connections 2020-02-11T16:05:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.597+0000 7f81f0d6a700 1 -- 172.21.15.88:0/3019516335 wait complete. 2020-02-11T16:05:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2020-02-11T16:05:53.609 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2020-02-11T16:05:53.609 INFO:tasks.mon_thrash.mon_thrasher:seed: 1581437152, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2020-02-11T16:05:53.609 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:05:53.610 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:05:53.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.672+0000 7f5a5dd9d700 1 Processor -- start 2020-02-11T16:05:53.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.672+0000 7f5a5dd9d700 1 -- start start 2020-02-11T16:05:53.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.672+0000 7f5a5dd9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a5813bd40 0x7f5a580a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.672+0000 7f5a5dd9d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5813b3a0 con 0x7f5a580a9730 2020-02-11T16:05:53.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.672+0000 7f5a5dd9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a580a6180 con 0x7f5a5805e8f0 2020-02-11T16:05:53.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a5dd9d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5813c1f0 con 0x7f5a5813bd40 2020-02-11T16:05:53.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a57fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5a5805e8f0 0x7f5a580a5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39774/0 (socket says 172.21.15.88:39774) 2020-02-11T16:05:53.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a57fff700 1 -- 172.21.15.88:0/3910069605 learned_addr learned my addr 172.21.15.88:0/3910069605 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:53.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/3910069605 >> v2:172.21.15.52:3300/0 conn(0x7f5a5813bd40 0x7f5a580a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134283039 0 0) 0x7f5a580a6180 con 0x7f5a5805e8f0 2020-02-11T16:05:53.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a3c003230 con 0x7f5a5805e8f0 2020-02-11T16:05:53.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3233675658 0 0) 0x7f5a3c003230 con 0x7f5a5805e8f0 2020-02-11T16:05:53.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 >> v2:172.21.15.52:3300/0 conn(0x7f5a5813bd40 msgr2=0x7f5a580a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:53.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 --2- 172.21.15.88:0/3910069605 >> v2:172.21.15.52:3300/0 conn(0x7f5a5813bd40 0x7f5a580a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 >> v1:172.21.15.52:6789/0 conn(0x7f5a580a9730 legacy=0x7f5a58066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5813b600 con 0x7f5a5805e8f0 2020-02-11T16:05:53.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f5a440016d0 con 0x7f5a5805e8f0 2020-02-11T16:05:53.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 >> v1:172.21.15.88:6789/0 conn(0x7f5a5805e8f0 legacy=0x7f5a580a5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a3c003720 0x7f5a3c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 0x7f5a3c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a3c004db0 0x7f5a3c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5813c1f0 con 0x7f5a3c003720 2020-02-11T16:05:53.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0041c0 con 0x7f5a3c0044d0 2020-02-11T16:05:53.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c00bb80 con 0x7f5a3c004db0 2020-02-11T16:05:53.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a5cd9b700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a3c003720 0x7f5a3c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a57fff700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 0x7f5a3c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.673+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a3c004db0 0x7f5a3c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 -- 172.21.15.88:0/3910069605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a3c004db0 msgr2=0x7f5a3c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:53.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a3c004db0 0x7f5a3c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 -- 172.21.15.88:0/3910069605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a3c003720 msgr2=0x7f5a3c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:53.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a3c003720 0x7f5a3c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a5d59c700 1 -- 172.21.15.88:0/3910069605 reap_dead start 2020-02-11T16:05:53.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 -- 172.21.15.88:0/3910069605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c003230 con 0x7f5a3c0044d0 2020-02-11T16:05:53.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 0x7f5a3c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a44001d70 tx=0x7f5a580a6310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 0x7f5a3c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a44001d70 tx=0x7f5a580a6310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 0x7f5a3c004950 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f5a44001d70 tx=0x7f5a580a6310).ready entity=mon.1 client_cookie=ccbee0f65c4e8d43 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 0x7f5a3c004950 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f5a44001d70 tx=0x7f5a580a6310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 0x7f5a3c004950 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f5a44001d70 tx=0x7f5a580a6310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a4400ca80 con 0x7f5a3c0044d0 2020-02-11T16:05:53.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a57fff700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 0x7f5a3c004950 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f5a44001d70 tx=0x7f5a580a6310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4400cbe0 con 0x7f5a3c0044d0 2020-02-11T16:05:53.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a577fe700 1 -- 172.21.15.88:0/3910069605 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a440111b0 con 0x7f5a3c0044d0 2020-02-11T16:05:53.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 msgr2=0x7f5a3c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.674+0000 7f5a5dd9d700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 0x7f5a3c004950 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f5a44001d70 tx=0x7f5a580a6310).stop 2020-02-11T16:05:53.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.675+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/3910069605 shutdown_connections 2020-02-11T16:05:53.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.675+0000 7f5a5dd9d700 1 --2- 172.21.15.88:0/3910069605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a3c0044d0 0x7f5a3c004950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.675+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/3910069605 >> 172.21.15.88:0/3910069605 conn(0x7f5a580ae440 msgr2=0x7f5a580ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:53.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.675+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/3910069605 shutdown_connections 2020-02-11T16:05:53.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.675+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/3910069605 wait complete. 2020-02-11T16:05:53.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.676+0000 7f5a5dd9d700 1 Processor -- start 2020-02-11T16:05:53.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.676+0000 7f5a5dd9d700 1 -- start start 2020-02-11T16:05:53.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.676+0000 7f5a5dd9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a3c0044d0 0x7f5a581361e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.676+0000 7f5a5dd9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a58137ae0 0x7f5a58136640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5dd9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a5812d950 0x7f5a5812ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5dd9d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a58137480 con 0x7f5a58137ae0 2020-02-11T16:05:53.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5dd9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a58138a90 con 0x7f5a5812d950 2020-02-11T16:05:53.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5dd9d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a58135b80 con 0x7f5a3c0044d0 2020-02-11T16:05:53.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a5812d950 0x7f5a5812ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a5812d950 0x7f5a5812ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52160/0 (socket says 172.21.15.88:52160) 2020-02-11T16:05:53.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 -- 172.21.15.88:0/1387679729 learned_addr learned my addr 172.21.15.88:0/1387679729 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:53.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a57fff700 1 --2- 172.21.15.88:0/1387679729 >> v2:172.21.15.52:3300/0 conn(0x7f5a58137ae0 0x7f5a58136640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5cd9b700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a3c0044d0 0x7f5a581361e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 -- 172.21.15.88:0/1387679729 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a3c0044d0 msgr2=0x7f5a581361e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a3c0044d0 0x7f5a581361e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 -- 172.21.15.88:0/1387679729 >> v2:172.21.15.52:3300/0 conn(0x7f5a58137ae0 msgr2=0x7f5a58136640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> v2:172.21.15.52:3300/0 conn(0x7f5a58137ae0 0x7f5a58136640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 -- 172.21.15.88:0/1387679729 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a580a29b0 con 0x7f5a5812d950 2020-02-11T16:05:53.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> v2:172.21.15.88:3300/0 conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> v2:172.21.15.88:3300/0 conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a55ffb700 1 -- 172.21.15.88:0/1387679729 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a50005e20 con 0x7f5a5812d950 2020-02-11T16:05:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a55ffb700 1 -- 172.21.15.88:0/1387679729 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a50008720 con 0x7f5a5812d950 2020-02-11T16:05:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/1387679729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a580a2c50 con 0x7f5a5812d950 2020-02-11T16:05:53.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a55ffb700 1 -- 172.21.15.88:0/1387679729 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a50008ac0 con 0x7f5a5812d950 2020-02-11T16:05:53.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.677+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/1387679729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a58130e90 con 0x7f5a5812d950 2020-02-11T16:05:53.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.678+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.678+0000 7f5a55ffb700 1 -- 172.21.15.88:0/1387679729 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f5a50008c20 con 0x7f5a5812d950 2020-02-11T16:05:53.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.678+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.678+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/1387679729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a580565b0 con 0x7f5a5812d950 2020-02-11T16:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.678+0000 7f5a55ffb700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a40039c40 0x7f5a4003c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.678+0000 7f5a55ffb700 1 -- 172.21.15.88:0/1387679729 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5a500499d0 con 0x7f5a5812d950 2020-02-11T16:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.679+0000 7f5a5cd9b700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a40039c40 0x7f5a4003c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.679+0000 7f5a5cd9b700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a40039c40 0x7f5a4003c100 crc :-1 s=READY pgs=96 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.682+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.682+0000 7f5a55ffb700 1 -- 172.21.15.88:0/1387679729 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f5a5002efa0 con 0x7f5a5812d950 2020-02-11T16:05:53.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.757+0000 7f169af14700 1 Processor -- start 2020-02-11T16:05:53.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.757+0000 7f169af14700 1 -- start start 2020-02-11T16:05:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.757+0000 7f169af14700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f16940ad380 0x7f16940a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.757+0000 7f169af14700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1694138710 0x7f169413b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:53.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.757+0000 7f169af14700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16940adb40 con 0x7f1694138280 2020-02-11T16:05:53.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.757+0000 7f169af14700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1694137bf0 con 0x7f1694138710 2020-02-11T16:05:53.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.757+0000 7f169af14700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1694138b50 con 0x7f16940ad380 2020-02-11T16:05:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f16940ad380 0x7f16940a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1693fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1694138280 0x7f169413b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39794/0 (socket says 172.21.15.88:39794) 2020-02-11T16:05:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f16940ad380 0x7f16940a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52166/0 (socket says 172.21.15.88:52166) 2020-02-11T16:05:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1693fff700 1 -- 172.21.15.88:0/1885149382 learned_addr learned my addr 172.21.15.88:0/1885149382 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f16994b1700 1 --2- 172.21.15.88:0/1885149382 >> v2:172.21.15.52:3300/0 conn(0x7f1694138710 0x7f169413b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 -- 172.21.15.88:0/1885149382 >> v2:172.21.15.52:3300/0 conn(0x7f1694138710 msgr2=0x7f169413b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 --2- 172.21.15.88:0/1885149382 >> v2:172.21.15.52:3300/0 conn(0x7f1694138710 0x7f169413b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 -- 172.21.15.88:0/1885149382 >> v1:172.21.15.88:6789/0 conn(0x7f1694138280 legacy=0x7f169413b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f16937fe700 1 -- 172.21.15.88:0/1885149382 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411047499 0 0) 0x7f16940adb40 con 0x7f1694138280 2020-02-11T16:05:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 -- 172.21.15.88:0/1885149382 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694137de0 con 0x7f16940ad380 2020-02-11T16:05:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 --2- 172.21.15.88:0/1885149382 >> v2:172.21.15.88:3300/0 conn(0x7f16940ad380 0x7f16940a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1688002f30 tx=0x7f1688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 --2- 172.21.15.88:0/1885149382 >> v2:172.21.15.88:3300/0 conn(0x7f16940ad380 0x7f16940a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1688002f30 tx=0x7f1688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 --2- 172.21.15.88:0/1885149382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16940ad380 0x7f16940a9130 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f1688002f30 tx=0x7f1688007a40).ready entity=mon.1 client_cookie=c95a7f4a034f086b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 --2- 172.21.15.88:0/1885149382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16940ad380 0x7f16940a9130 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f1688002f30 tx=0x7f1688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f16937fe700 1 -- 172.21.15.88:0/1885149382 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1688011470 con 0x7f16940ad380 2020-02-11T16:05:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 --2- 172.21.15.88:0/1885149382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16940ad380 0x7f16940a9130 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f1688002f30 tx=0x7f1688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f16937fe700 1 -- 172.21.15.88:0/1885149382 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16880115d0 con 0x7f16940ad380 2020-02-11T16:05:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f1698cb0700 1 --2- 172.21.15.88:0/1885149382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16940ad380 0x7f16940a9130 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f1688002f30 tx=0x7f1688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f16937fe700 1 -- 172.21.15.88:0/1885149382 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1688011970 con 0x7f16940ad380 2020-02-11T16:05:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f169af14700 1 -- 172.21.15.88:0/1885149382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16940ad380 msgr2=0x7f16940a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.758+0000 7f169af14700 1 --2- 172.21.15.88:0/1885149382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16940ad380 0x7f16940a9130 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f1688002f30 tx=0x7f1688007a40).stop 2020-02-11T16:05:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.759+0000 7f169af14700 1 -- 172.21.15.88:0/1885149382 shutdown_connections 2020-02-11T16:05:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.759+0000 7f169af14700 1 --2- 172.21.15.88:0/1885149382 >> v2:172.21.15.52:3300/0 conn(0x7f1694138710 0x7f169413b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.759+0000 7f169af14700 1 --2- 172.21.15.88:0/1885149382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16940ad380 0x7f16940a9130 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.759+0000 7f169af14700 1 -- 172.21.15.88:0/1885149382 >> 172.21.15.88:0/1885149382 conn(0x7f169405ac70 msgr2=0x7f16940ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:53.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.759+0000 7f169af14700 1 -- 172.21.15.88:0/1885149382 shutdown_connections 2020-02-11T16:05:53.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.759+0000 7f169af14700 1 -- 172.21.15.88:0/1885149382 wait complete. 2020-02-11T16:05:53.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.759+0000 7f169af14700 1 Processor -- start 2020-02-11T16:05:53.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.759+0000 7f169af14700 1 -- start start 2020-02-11T16:05:53.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.760+0000 7f169af14700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f16940ad380 0x7f16940a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.760+0000 7f169af14700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1694138280 0x7f16941484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.760+0000 7f169af14700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1694148f90 con 0x7f1694138710 2020-02-11T16:05:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.760+0000 7f169af14700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1694149230 con 0x7f16940ad380 2020-02-11T16:05:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.760+0000 7f169af14700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1694148920 con 0x7f1694138280 2020-02-11T16:05:53.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.760+0000 7f1693fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1694138280 0x7f16941484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.760+0000 7f1693fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1694138280 0x7f16941484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52174/0 (socket says 172.21.15.88:52174) 2020-02-11T16:05:53.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.760+0000 7f1693fff700 1 -- 172.21.15.88:0/626772344 learned_addr learned my addr 172.21.15.88:0/626772344 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:53.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.760+0000 7f1698cb0700 1 --2- 172.21.15.88:0/626772344 >> v2:172.21.15.52:3300/0 conn(0x7f16940ad380 0x7f16940a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 -- 172.21.15.88:0/626772344 >> v2:172.21.15.52:3300/0 conn(0x7f16940ad380 msgr2=0x7f16940a61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> v2:172.21.15.52:3300/0 conn(0x7f16940ad380 0x7f16940a61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 -- 172.21.15.88:0/626772344 >> v1:172.21.15.52:6789/0 conn(0x7f1694138710 legacy=0x7f16941450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 -- 172.21.15.88:0/626772344 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694148a90 con 0x7f1694138280 2020-02-11T16:05:53.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> v2:172.21.15.88:3300/0 conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> v2:172.21.15.88:3300/0 conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1691ffb700 1 -- 172.21.15.88:0/626772344 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f168000ca40 con 0x7f1694138280 2020-02-11T16:05:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1691ffb700 1 -- 172.21.15.88:0/626772344 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168000cba0 con 0x7f1694138280 2020-02-11T16:05:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f169af14700 1 -- 172.21.15.88:0/626772344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169412d990 con 0x7f1694138280 2020-02-11T16:05:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1691ffb700 1 -- 172.21.15.88:0/626772344 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f168000d0c0 con 0x7f1694138280 2020-02-11T16:05:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f169af14700 1 -- 172.21.15.88:0/626772344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1694145a40 con 0x7f1694138280 2020-02-11T16:05:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.761+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.762+0000 7f1691ffb700 1 -- 172.21.15.88:0/626772344 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f16800055c0 con 0x7f1694138280 2020-02-11T16:05:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.762+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.762+0000 7f169af14700 1 -- 172.21.15.88:0/626772344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16940565b0 con 0x7f1694138280 2020-02-11T16:05:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.762+0000 7f1691ffb700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f167c039ce0 0x7f167c03c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.762+0000 7f1691ffb700 1 -- 172.21.15.88:0/626772344 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f16800493e0 con 0x7f1694138280 2020-02-11T16:05:53.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.762+0000 7f1698cb0700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f167c039ce0 0x7f167c03c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:53.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.763+0000 7f1698cb0700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f167c039ce0 0x7f167c03c1a0 crc :-1 s=READY pgs=97 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:53.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.766+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.766+0000 7f1691ffb700 1 -- 172.21.15.88:0/626772344 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f168002e9d0 con 0x7f1694138280 2020-02-11T16:05:53.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.823+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/1387679729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a580a88e0 con 0x7f5a5812d950 2020-02-11T16:05:53.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.823+0000 7f5a5d59c700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.823+0000 7f5a55ffb700 1 -- 172.21.15.88:0/1387679729 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a50031ab0 con 0x7f5a5812d950 2020-02-11T16:05:53.825 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:53.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/1387679729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a40039c40 msgr2=0x7f5a4003c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a40039c40 0x7f5a4003c100 crc :-1 s=READY pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 msgr2=0x7f5a5812ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 0x7f5a5812ddc0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f5a440014a0 tx=0x7f5a50010db0).stop 2020-02-11T16:05:53.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/1387679729 shutdown_connections 2020-02-11T16:05:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a5812d950 0x7f5a5812ddc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a3c0044d0 0x7f5a581361e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 --2- 172.21.15.88:0/1387679729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a40039c40 0x7f5a4003c100 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 --2- 172.21.15.88:0/1387679729 >> v2:172.21.15.52:3300/0 conn(0x7f5a58137ae0 0x7f5a58136640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/1387679729 >> 172.21.15.88:0/1387679729 conn(0x7f5a580ae440 msgr2=0x7f5a5805eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/1387679729 shutdown_connections 2020-02-11T16:05:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.825+0000 7f5a5dd9d700 1 -- 172.21.15.88:0/1387679729 wait complete. 2020-02-11T16:05:53.837 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-11T16:05:53.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.954+0000 7f169af14700 1 -- 172.21.15.88:0/626772344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f16940a5350 con 0x7f1694138280 2020-02-11T16:05:53.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.954+0000 7f1693fff700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:53.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.954+0000 7f1691ffb700 1 -- 172.21.15.88:0/626772344 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7f16800100b0 con 0x7f1694138280 2020-02-11T16:05:53.956 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":36,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:05:53.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.955+0000 7f169af14700 1 -- 172.21.15.88:0/626772344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f167c039ce0 msgr2=0x7f167c03c1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.955+0000 7f169af14700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f167c039ce0 0x7f167c03c1a0 crc :-1 s=READY pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.955+0000 7f169af14700 1 -- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 msgr2=0x7f16941484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.955+0000 7f169af14700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 0x7f16941484c0 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7f1694144f20 tx=0x7f1680001e40).stop 2020-02-11T16:05:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.955+0000 7f169af14700 1 -- 172.21.15.88:0/626772344 shutdown_connections 2020-02-11T16:05:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.955+0000 7f169af14700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f167c039ce0 0x7f167c03c1a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.956+0000 7f169af14700 1 --2- 172.21.15.88:0/626772344 >> v2:172.21.15.52:3300/0 conn(0x7f16940ad380 0x7f16940a61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.956+0000 7f169af14700 1 --2- 172.21.15.88:0/626772344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1694138280 0x7f16941484c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:53.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.956+0000 7f169af14700 1 -- 172.21.15.88:0/626772344 >> 172.21.15.88:0/626772344 conn(0x7f169405ac70 msgr2=0x7f1694069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:53.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.956+0000 7f169af14700 1 -- 172.21.15.88:0/626772344 shutdown_connections 2020-02-11T16:05:53.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.956+0000 7f169af14700 1 -- 172.21.15.88:0/626772344 wait complete. 2020-02-11T16:05:53.967 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":8,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":36,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:05:53.968 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:05:53.968 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:05:53.968 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:05:53.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.989+0000 7fb229fb1700 1 Processor -- start 2020-02-11T16:05:53.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.989+0000 7fb229fb1700 1 -- start start 2020-02-11T16:05:54.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb229fb1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2240a9460 0x7fb22405f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb229fb1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb224137f20 0x7fb22413b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb229fb1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb224132750 con 0x7fb2240a9080 2020-02-11T16:05:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb229fb1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb224138dd0 con 0x7fb2240a9460 2020-02-11T16:05:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb229fb1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2241383f0 con 0x7fb224137f20 2020-02-11T16:05:54.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb223fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb224137f20 0x7fb22413b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb223fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb224137f20 0x7fb22413b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52182/0 (socket says 172.21.15.88:52182) 2020-02-11T16:05:54.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb223fff700 1 -- 172.21.15.88:0/2517359700 learned_addr learned my addr 172.21.15.88:0/2517359700 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:54.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2517359700 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a9460 0x7fb22405f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb223fff700 1 -- 172.21.15.88:0/2517359700 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a9460 msgr2=0x7fb22405f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:54.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb223fff700 1 --2- 172.21.15.88:0/2517359700 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a9460 0x7fb22405f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb223fff700 1 -- 172.21.15.88:0/2517359700 >> v1:172.21.15.52:6789/0 conn(0x7fb2240a9080 legacy=0x7fb224065cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb223fff700 1 -- 172.21.15.88:0/2517359700 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224138690 con 0x7fb224137f20 2020-02-11T16:05:54.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb223fff700 1 --2- 172.21.15.88:0/2517359700 >> v2:172.21.15.88:3300/0 conn(0x7fb224137f20 0x7fb22413b4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb21c0032b0 tx=0x7fb21c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb223fff700 1 --2- 172.21.15.88:0/2517359700 >> v2:172.21.15.88:3300/0 conn(0x7fb224137f20 0x7fb22413b4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb21c0032b0 tx=0x7fb21c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.990+0000 7fb223fff700 1 --2- 172.21.15.88:0/2517359700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224137f20 0x7fb22413b4d0 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c007dc0).ready entity=mon.1 client_cookie=78fc65b5a1034cf5 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb223fff700 1 --2- 172.21.15.88:0/2517359700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224137f20 0x7fb22413b4d0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb2227fc700 1 -- 172.21.15.88:0/2517359700 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21c00a160 con 0x7fb224137f20 2020-02-11T16:05:54.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb223fff700 1 --2- 172.21.15.88:0/2517359700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224137f20 0x7fb22413b4d0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb2227fc700 1 -- 172.21.15.88:0/2517359700 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c00a2c0 con 0x7fb224137f20 2020-02-11T16:05:54.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb223fff700 1 --2- 172.21.15.88:0/2517359700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224137f20 0x7fb22413b4d0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb2227fc700 1 -- 172.21.15.88:0/2517359700 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21c00a6a0 con 0x7fb224137f20 2020-02-11T16:05:54.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb229fb1700 1 -- 172.21.15.88:0/2517359700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224137f20 msgr2=0x7fb22413b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb229fb1700 1 --2- 172.21.15.88:0/2517359700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224137f20 0x7fb22413b4d0 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c007dc0).stop 2020-02-11T16:05:54.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb229fb1700 1 -- 172.21.15.88:0/2517359700 shutdown_connections 2020-02-11T16:05:54.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb229fb1700 1 --2- 172.21.15.88:0/2517359700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224137f20 0x7fb22413b4d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb229fb1700 1 --2- 172.21.15.88:0/2517359700 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a9460 0x7fb22405f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb229fb1700 1 -- 172.21.15.88:0/2517359700 >> 172.21.15.88:0/2517359700 conn(0x7fb2240ab0a0 msgr2=0x7fb2240ab4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb229fb1700 1 -- 172.21.15.88:0/2517359700 shutdown_connections 2020-02-11T16:05:54.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.991+0000 7fb229fb1700 1 -- 172.21.15.88:0/2517359700 wait complete. 2020-02-11T16:05:54.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.992+0000 7fb229fb1700 1 Processor -- start 2020-02-11T16:05:54.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.992+0000 7fb229fb1700 1 -- start start 2020-02-11T16:05:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb229fb1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2240a9080 0x7fb2241328e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb229fb1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2240a9460 0x7fb2241334f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb229fb1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb224135240 con 0x7fb224137f20 2020-02-11T16:05:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb229fb1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb224139160 con 0x7fb2240a9080 2020-02-11T16:05:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb229fb1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2241354e0 con 0x7fb2240a9460 2020-02-11T16:05:54.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb222ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2240a9460 0x7fb2241334f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb222ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2240a9460 0x7fb2241334f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52186/0 (socket says 172.21.15.88:52186) 2020-02-11T16:05:54.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb223fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb224137f20 0x7fb224145740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39814/0 (socket says 172.21.15.88:39814) 2020-02-11T16:05:54.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb222ffd700 1 -- 172.21.15.88:0/3576978170 learned_addr learned my addr 172.21.15.88:0/3576978170 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:54.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb2237fe700 1 --2- 172.21.15.88:0/3576978170 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a9080 0x7fb2241328e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb222ffd700 1 -- 172.21.15.88:0/3576978170 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a9080 msgr2=0x7fb2241328e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a9080 0x7fb2241328e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb222ffd700 1 -- 172.21.15.88:0/3576978170 >> v1:172.21.15.88:6789/0 conn(0x7fb224137f20 legacy=0x7fb224145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb220ff9700 1 -- 172.21.15.88:0/3576978170 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820137889 0 0) 0x7fb224135240 con 0x7fb224137f20 2020-02-11T16:05:54.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb222ffd700 1 -- 172.21.15.88:0/3576978170 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224135780 con 0x7fb2240a9460 2020-02-11T16:05:54.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> v2:172.21.15.88:3300/0 conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> v2:172.21.15.88:3300/0 conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.993+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.994+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.994+0000 7fb220ff9700 1 -- 172.21.15.88:0/3576978170 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb218005e90 con 0x7fb2240a9460 2020-02-11T16:05:54.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.994+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.994+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.994+0000 7fb220ff9700 1 -- 172.21.15.88:0/3576978170 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2180071a0 con 0x7fb2240a9460 2020-02-11T16:05:54.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.994+0000 7fb220ff9700 1 -- 172.21.15.88:0/3576978170 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb218007580 con 0x7fb2240a9460 2020-02-11T16:05:54.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.994+0000 7fb229fb1700 1 -- 172.21.15.88:0/3576978170 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb224137c20 con 0x7fb2240a9460 2020-02-11T16:05:54.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.994+0000 7fb229fb1700 1 -- 172.21.15.88:0/3576978170 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb224132d40 con 0x7fb2240a9460 2020-02-11T16:05:54.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.994+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.995+0000 7fb220ff9700 1 -- 172.21.15.88:0/3576978170 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fb218012400 con 0x7fb2240a9460 2020-02-11T16:05:54.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.995+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.995+0000 7fb229fb1700 1 -- 172.21.15.88:0/3576978170 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2240565b0 con 0x7fb2240a9460 2020-02-11T16:05:54.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.995+0000 7fb220ff9700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb204039b90 0x7fb20403c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.995+0000 7fb220ff9700 1 -- 172.21.15.88:0/3576978170 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb218049f30 con 0x7fb2240a9460 2020-02-11T16:05:54.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.995+0000 7fb2237fe700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb204039b90 0x7fb20403c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.995+0000 7fb2237fe700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb204039b90 0x7fb20403c050 crc :-1 s=READY pgs=98 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.998+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:53.998+0000 7fb220ff9700 1 -- 172.21.15.88:0/3576978170 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb21802f500 con 0x7fb2240a9460 2020-02-11T16:05:54.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.078+0000 7fbfd0a43700 1 Processor -- start 2020-02-11T16:05:54.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.078+0000 7fbfd0a43700 1 -- start start 2020-02-11T16:05:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.079+0000 7fbfd0a43700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 0x7fbfcc0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.079+0000 7fbfd0a43700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbfcc1386e0 0x7fbfcc13b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.079+0000 7fbfd0a43700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfcc138b20 con 0x7fbfcc138280 2020-02-11T16:05:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.079+0000 7fbfd0a43700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc137bf0 con 0x7fbfcc1386e0 2020-02-11T16:05:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.079+0000 7fbfd0a43700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0adb40 con 0x7fbfcc0ad380 2020-02-11T16:05:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.079+0000 7fbfca59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 0x7fbfcc0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.079+0000 7fbfcad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbfcc1386e0 0x7fbfcc13b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfc9d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbfcc138280 0x7fbfcc13b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59834/0 (socket says 172.21.15.88:59834) 2020-02-11T16:05:54.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfca59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 0x7fbfcc0a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:46516/0 (socket says 172.21.15.88:46516) 2020-02-11T16:05:54.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfc9d9b700 1 -- 172.21.15.88:0/363391542 learned_addr learned my addr 172.21.15.88:0/363391542 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:54.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfcad9d700 1 -- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 msgr2=0x7fbfcc0a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 0x7fbfcc0a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfcad9d700 1 -- 172.21.15.88:0/363391542 >> v1:172.21.15.52:6789/0 conn(0x7fbfcc138280 legacy=0x7fbfcc13b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfcad9d700 1 -- 172.21.15.88:0/363391542 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc137de0 con 0x7fbfcc1386e0 2020-02-11T16:05:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfc959a700 1 -- 172.21.15.88:0/363391542 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449931363 0 0) 0x7fbfb4001450 con 0x7fbfcc138280 2020-02-11T16:05:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfca59c700 1 --2- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 0x7fbfcc0a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/363391542 >> v2:172.21.15.52:3300/0 conn(0x7fbfcc1386e0 0x7fbfcc13b8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbfbc002f30 tx=0x7fbfbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/363391542 >> v2:172.21.15.52:3300/0 conn(0x7fbfcc1386e0 0x7fbfcc13b8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbfbc002f30 tx=0x7fbfbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc13b8d0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0088e0).ready entity=mon.0 client_cookie=66f4daf98ed6aa79 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc13b8d0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfc959a700 1 -- 172.21.15.88:0/363391542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfbc008e40 con 0x7fbfcc1386e0 2020-02-11T16:05:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc13b8d0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc13b8d0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfc959a700 1 -- 172.21.15.88:0/363391542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc0115f0 con 0x7fbfcc1386e0 2020-02-11T16:05:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfc959a700 1 -- 172.21.15.88:0/363391542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfbc011990 con 0x7fbfcc1386e0 2020-02-11T16:05:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfd0a43700 1 -- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfcc1386e0 msgr2=0x7fbfcc13b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.080+0000 7fbfd0a43700 1 --2- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc13b8d0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0088e0).stop 2020-02-11T16:05:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.081+0000 7fbfd0a43700 1 -- 172.21.15.88:0/363391542 shutdown_connections 2020-02-11T16:05:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.081+0000 7fbfd0a43700 1 --2- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc13b8d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.081+0000 7fbfd0a43700 1 --2- 172.21.15.88:0/363391542 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 0x7fbfcc0a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.081+0000 7fbfd0a43700 1 -- 172.21.15.88:0/363391542 >> 172.21.15.88:0/363391542 conn(0x7fbfcc05ac70 msgr2=0x7fbfcc0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.081+0000 7fbfd0a43700 1 -- 172.21.15.88:0/363391542 shutdown_connections 2020-02-11T16:05:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.081+0000 7fbfd0a43700 1 -- 172.21.15.88:0/363391542 wait complete. 2020-02-11T16:05:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfd0a43700 1 Processor -- start 2020-02-11T16:05:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfd0a43700 1 -- start start 2020-02-11T16:05:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfd0a43700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 0x7fbfcc1375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfd0a43700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbfcc1386e0 0x7fbfcc1266a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfd0a43700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfcc128c20 con 0x7fbfcc138280 2020-02-11T16:05:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfd0a43700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc137360 con 0x7fbfcc1386e0 2020-02-11T16:05:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfd0a43700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc127440 con 0x7fbfcc0ad380 2020-02-11T16:05:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfc9d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbfcc138280 0x7fbfcc129660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39826/0 (socket says 172.21.15.88:39826) 2020-02-11T16:05:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfc9d9b700 1 -- 172.21.15.88:0/2905525540 learned_addr learned my addr 172.21.15.88:0/2905525540 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/2905525540 >> v2:172.21.15.88:3300/0 conn(0x7fbfcc1386e0 0x7fbfcc1266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.082+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 0x7fbfcc1375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82850008 0 0) 0x7fbfcc128c20 con 0x7fbfcc138280 2020-02-11T16:05:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb0002fe0 con 0x7fbfcc138280 2020-02-11T16:05:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfcad9d700 1 -- 172.21.15.88:0/2905525540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 msgr2=0x7fbfcc1375c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbfcc0ad380 0x7fbfcc1375c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfcad9d700 1 -- 172.21.15.88:0/2905525540 >> v1:172.21.15.88:6789/0 conn(0x7fbfcc138280 legacy=0x7fbfcc129660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfcad9d700 1 -- 172.21.15.88:0/2905525540 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc1276e0 con 0x7fbfcc1386e0 2020-02-11T16:05:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/2905525540 >> v2:172.21.15.88:3300/0 conn(0x7fbfcc1386e0 0x7fbfcc1266a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/2905525540 >> v2:172.21.15.88:3300/0 conn(0x7fbfcc1386e0 0x7fbfcc1266a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc1266a0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0113a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc1266a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfbc00f760 con 0x7fbfcc1386e0 2020-02-11T16:05:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc1266a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc1266a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc007150 con 0x7fbfcc1386e0 2020-02-11T16:05:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfd0a43700 1 -- 172.21.15.88:0/2905525540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfcc128e80 con 0x7fbfcc1386e0 2020-02-11T16:05:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfbc0074b0 con 0x7fbfcc1386e0 2020-02-11T16:05:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.083+0000 7fbfd0a43700 1 -- 172.21.15.88:0/2905525540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfcc129320 con 0x7fbfcc1386e0 2020-02-11T16:05:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.084+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc1266a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.084+0000 7fbfd0a43700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 0x7fbfcc05ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.084+0000 7fbfd0a43700 1 -- 172.21.15.88:0/2905525540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc05e2f0 con 0x7fbfcc126b00 2020-02-11T16:05:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.084+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fbfbc0056c0 con 0x7fbfcc1386e0 2020-02-11T16:05:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.084+0000 7fbfcad9d700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc1266a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.084+0000 7fbfc37fe700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbfb0039f40 0x7fbfb003c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.084+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbfbc049d00 con 0x7fbfcc1386e0 2020-02-11T16:05:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.084+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 0x7fbfcc05ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.084+0000 7fbfc9d9b700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbfb0039f40 0x7fbfb003c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfca59c700 1 -- 172.21.15.88:0/2905525540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfcc129010 con 0x7fbfcc126b00 2020-02-11T16:05:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 0x7fbfcc05ed10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfc9d9b700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbfb0039f40 0x7fbfb003c400 crc :-1 s=READY pgs=99 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 0x7fbfcc05ed10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 0x7fbfcc05ed10 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 0x7fbfcc05ed10 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc4012a60 con 0x7fbfcc126b00 2020-02-11T16:05:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 0x7fbfcc05ed10 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fbfc4012bc0 con 0x7fbfcc126b00 2020-02-11T16:05:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 msgr2=0x7fbfcc05ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfc37fe700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 0x7fbfcc05ed10 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).stop 2020-02-11T16:05:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 msgr2=0x7fbfcc05ed10 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:05:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.085+0000 7fbfc37fe700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc126b00 0x7fbfcc05ed10 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).stop 2020-02-11T16:05:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.093+0000 7fbfd0a43700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 0x7fbfcc12f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.093+0000 7fbfd0a43700 1 -- 172.21.15.88:0/2905525540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc127580 con 0x7fbfcc12f090 2020-02-11T16:05:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.093+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 0x7fbfcc12f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.093+0000 7fbfca59c700 1 -- 172.21.15.88:0/2905525540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbfcc0565b0 con 0x7fbfcc12f090 2020-02-11T16:05:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 0x7fbfcc12f4a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 0x7fbfcc12f4a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 0x7fbfcc12f4a0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 0x7fbfcc12f4a0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc4005ea0 con 0x7fbfcc12f090 2020-02-11T16:05:54.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfca59c700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 0x7fbfcc12f4a0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7fbfc400c720 con 0x7fbfcc12f090 2020-02-11T16:05:54.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 msgr2=0x7fbfcc12f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfc37fe700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 0x7fbfcc12f4a0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).stop 2020-02-11T16:05:54.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfc37fe700 1 -- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 msgr2=0x7fbfcc12f4a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:05:54.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfc37fe700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc12f090 0x7fbfcc12f4a0 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0x7fbfc4002f30 tx=0x7fbfc4010fd0).stop 2020-02-11T16:05:54.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfd0a43700 1 -- 172.21.15.88:0/2905525540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbfb0039f40 msgr2=0x7fbfb003c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfd0a43700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbfb0039f40 0x7fbfb003c400 crc :-1 s=READY pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfd0a43700 1 -- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc1386e0 msgr2=0x7fbfcc1266a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfd0a43700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc1266a0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7fbfbc002f30 tx=0x7fbfbc0113a0).stop 2020-02-11T16:05:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfcad9d700 1 -- 172.21.15.88:0/2905525540 reap_dead start 2020-02-11T16:05:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfcad9d700 1 -- 172.21.15.88:0/2905525540 reap_dead start 2020-02-11T16:05:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfd0a43700 1 -- 172.21.15.88:0/2905525540 shutdown_connections 2020-02-11T16:05:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfd0a43700 1 --2- 172.21.15.88:0/2905525540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfcc1386e0 0x7fbfcc1266a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.094+0000 7fbfd0a43700 1 -- 172.21.15.88:0/2905525540 >> 172.21.15.88:0/2905525540 conn(0x7fbfcc05ac70 msgr2=0x7fbfcc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.095+0000 7fbfd0a43700 1 -- 172.21.15.88:0/2905525540 shutdown_connections 2020-02-11T16:05:54.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.095+0000 7fbfd0a43700 1 -- 172.21.15.88:0/2905525540 wait complete. 2020-02-11T16:05:54.109 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:05:54.109 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:05:54.109 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:05:54.109 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:05:54.109 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 8, 2020-02-11T16:05:54.110 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:05:54.110 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:05:54.110 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:05:54.110 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:05:54.110 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.110 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 36, 2020-02-11T16:05:54.110 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:05:54.111 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:05:54.111 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:05:54.111 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:05:54.111 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:05:54.111 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:05:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:05:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:05:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:05:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:05:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:05:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:05:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:05:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:05:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:05:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:05:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:05:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:05:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:05:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:05:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:05:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:05:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:05:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:05:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:05:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:05:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:05:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:05:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:05:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:05:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:05:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:05:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:05:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:05:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:05:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:05:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:05:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:05:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:05:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:05:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:05:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:05:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:05:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:05:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:05:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:05:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:05:54.120 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:05:54.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.120 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:05:54.120 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:05:54.120 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:05:54.120 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:05:54.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.121 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:05:54.121 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:05:54.121 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:05:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:05:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:05:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:05:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:05:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:05:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:05:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:05:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:05:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.126 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:05:54.127 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:05:54.127 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.127 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:54.128 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:05:54.128 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.128 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.128 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.128 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:05:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:05:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:05:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:05:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:05:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:05:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:05:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:05:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:05:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:05:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:05:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:05:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.134 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.134 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:05:54.134 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.135 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.135 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:05:54.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.136 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.136 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.136 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:05:54.137 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.137 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.137 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.137 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:05:54.138 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:05:54.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.146+0000 7fb229fb1700 1 -- 172.21.15.88:0/3576978170 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb224068bd0 con 0x7fb2240a9460 2020-02-11T16:05:54.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.147+0000 7fb222ffd700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.147+0000 7fb220ff9700 1 -- 172.21.15.88:0/3576978170 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb218032010 con 0x7fb2240a9460 2020-02-11T16:05:54.149 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:54.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 -- 172.21.15.88:0/3576978170 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb204039b90 msgr2=0x7fb20403c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb204039b90 0x7fb20403c050 crc :-1 s=READY pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 -- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 msgr2=0x7fb2241334f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 0x7fb2241334f0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fb218003070 tx=0x7fb218010cd0).stop 2020-02-11T16:05:54.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 -- 172.21.15.88:0/3576978170 shutdown_connections 2020-02-11T16:05:54.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb204039b90 0x7fb20403c050 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 --2- 172.21.15.88:0/3576978170 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a9080 0x7fb2241328e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 --2- 172.21.15.88:0/3576978170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a9460 0x7fb2241334f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 -- 172.21.15.88:0/3576978170 >> 172.21.15.88:0/3576978170 conn(0x7fb2240ab0a0 msgr2=0x7fb2240a9980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 -- 172.21.15.88:0/3576978170 shutdown_connections 2020-02-11T16:05:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.148+0000 7fb229fb1700 1 -- 172.21.15.88:0/3576978170 wait complete. 2020-02-11T16:05:54.161 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-11T16:05:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.257+0000 7f51c3ba7700 1 Processor -- start 2020-02-11T16:05:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.257+0000 7f51c3ba7700 1 -- start start 2020-02-11T16:05:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c3ba7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a6ff0 0x7f51bc0a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c3ba7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51bc0a2870 0x7f51bc13b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c3ba7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc0a2cf0 con 0x7f51bc13b640 2020-02-11T16:05:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c3ba7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc0a8630 con 0x7f51bc0a2870 2020-02-11T16:05:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c3ba7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0a30c0 con 0x7f51bc0a6ff0 2020-02-11T16:05:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51bc0a2870 0x7f51bc13b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c2144700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f51bc13b640 0x7f51bc137c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39838/0 (socket says 172.21.15.88:39838) 2020-02-11T16:05:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c2144700 1 -- 172.21.15.88:0/1998944635 learned_addr learned my addr 172.21.15.88:0/1998944635 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:54.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1943700 1 --2- 172.21.15.88:0/1998944635 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a6ff0 0x7f51bc0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 -- 172.21.15.88:0/1998944635 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a6ff0 msgr2=0x7f51bc0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:54.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 --2- 172.21.15.88:0/1998944635 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a6ff0 0x7f51bc0a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 -- 172.21.15.88:0/1998944635 >> v1:172.21.15.88:6789/0 conn(0x7f51bc13b640 legacy=0x7f51bc137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c0941700 1 -- 172.21.15.88:0/1998944635 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403869404 0 0) 0x7f51b4001450 con 0x7f51bc13b640 2020-02-11T16:05:54.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 -- 172.21.15.88:0/1998944635 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0a2130 con 0x7f51bc0a2870 2020-02-11T16:05:54.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 --2- 172.21.15.88:0/1998944635 >> v2:172.21.15.88:3300/0 conn(0x7f51bc0a2870 0x7f51bc13b1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51ac002f30 tx=0x7f51ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 --2- 172.21.15.88:0/1998944635 >> v2:172.21.15.88:3300/0 conn(0x7f51bc0a2870 0x7f51bc13b1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51ac002f30 tx=0x7f51ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 --2- 172.21.15.88:0/1998944635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0a2870 0x7f51bc13b1e0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac0088e0).ready entity=mon.1 client_cookie=7ad7c722ed483f5e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 --2- 172.21.15.88:0/1998944635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0a2870 0x7f51bc13b1e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c0941700 1 -- 172.21.15.88:0/1998944635 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ac008e40 con 0x7f51bc0a2870 2020-02-11T16:05:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 --2- 172.21.15.88:0/1998944635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0a2870 0x7f51bc13b1e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c1142700 1 --2- 172.21.15.88:0/1998944635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0a2870 0x7f51bc13b1e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c0941700 1 -- 172.21.15.88:0/1998944635 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac0116a0 con 0x7f51bc0a2870 2020-02-11T16:05:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c0941700 1 -- 172.21.15.88:0/1998944635 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ac011a40 con 0x7f51bc0a2870 2020-02-11T16:05:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c3ba7700 1 -- 172.21.15.88:0/1998944635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0a2870 msgr2=0x7f51bc13b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.258+0000 7f51c3ba7700 1 --2- 172.21.15.88:0/1998944635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0a2870 0x7f51bc13b1e0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac0088e0).stop 2020-02-11T16:05:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.259+0000 7f51c3ba7700 1 -- 172.21.15.88:0/1998944635 shutdown_connections 2020-02-11T16:05:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.259+0000 7f51c3ba7700 1 --2- 172.21.15.88:0/1998944635 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a6ff0 0x7f51bc0a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.259+0000 7f51c3ba7700 1 --2- 172.21.15.88:0/1998944635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0a2870 0x7f51bc13b1e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.259+0000 7f51c3ba7700 1 -- 172.21.15.88:0/1998944635 >> 172.21.15.88:0/1998944635 conn(0x7f51bc0ac2d0 msgr2=0x7f51bc0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.259+0000 7f51c3ba7700 1 -- 172.21.15.88:0/1998944635 shutdown_connections 2020-02-11T16:05:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.259+0000 7f51c3ba7700 1 -- 172.21.15.88:0/1998944635 wait complete. 2020-02-11T16:05:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.260+0000 7f51c3ba7700 1 Processor -- start 2020-02-11T16:05:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.260+0000 7f51c3ba7700 1 -- start start 2020-02-11T16:05:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.261+0000 7f51c3ba7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.261+0000 7f51c3ba7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51bc0a6ff0 0x7f51bc136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.261+0000 7f51c3ba7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc138de0 con 0x7f51bc13b640 2020-02-11T16:05:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.261+0000 7f51c3ba7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc135c30 con 0x7f51bc0a6ff0 2020-02-11T16:05:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.261+0000 7f51c3ba7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc135ed0 con 0x7f51bc0a2870 2020-02-11T16:05:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1142700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51bc0a6ff0 0x7f51bc136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c2144700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f51bc13b640 0x7f51bc130d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59858/0 (socket says 172.21.15.88:59858) 2020-02-11T16:05:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:46538/0 (socket says 172.21.15.88:46538) 2020-02-11T16:05:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1142700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51bc0a6ff0 0x7f51bc136ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38202/0 (socket says 172.21.15.88:38202) 2020-02-11T16:05:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 -- 172.21.15.88:0/956867523 learned_addr learned my addr 172.21.15.88:0/956867523 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216919301 0 0) 0x7f51bc138de0 con 0x7f51bc13b640 2020-02-11T16:05:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f519c002fe0 con 0x7f51bc13b640 2020-02-11T16:05:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 -- 172.21.15.88:0/956867523 >> v2:172.21.15.52:3300/0 conn(0x7f51bc0a6ff0 msgr2=0x7f51bc136ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 --2- 172.21.15.88:0/956867523 >> v2:172.21.15.52:3300/0 conn(0x7f51bc0a6ff0 0x7f51bc136ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 -- 172.21.15.88:0/956867523 >> v1:172.21.15.52:6789/0 conn(0x7f51bc13b640 legacy=0x7f51bc130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 -- 172.21.15.88:0/956867523 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc136170 con 0x7f51bc0a2870 2020-02-11T16:05:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> v2:172.21.15.52:3300/0 conn(0x7f51bc0a6ff0 0x7f51bc136ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51b8002f30 tx=0x7f51b8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51b8002f30 tx=0x7f51b8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f51b8002f30 tx=0x7f51b8010c60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51c1943700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f51b8002f30 tx=0x7f51b8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.262+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51b8012a20 con 0x7f51bc0a2870 2020-02-11T16:05:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51c1943700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f51b8002f30 tx=0x7f51b8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51c1943700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f51b8002f30 tx=0x7f51b8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8012b80 con 0x7f51bc0a2870 2020-02-11T16:05:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51c3ba7700 1 -- 172.21.15.88:0/956867523 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc136f10 con 0x7f51bc0a2870 2020-02-11T16:05:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51b80091a0 con 0x7f51bc0a2870 2020-02-11T16:05:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51c3ba7700 1 -- 172.21.15.88:0/956867523 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc134620 con 0x7f51bc0a2870 2020-02-11T16:05:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51c1943700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f51b8002f30 tx=0x7f51b8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f51b8007170 con 0x7f51bc0a2870 2020-02-11T16:05:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51c1943700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f51b8002f30 tx=0x7f51b8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51c3ba7700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 0x7f51bc13cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.263+0000 7f51c3ba7700 1 -- 172.21.15.88:0/956867523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc05e2f0 con 0x7f51bc131410 2020-02-11T16:05:54.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51aaffd700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f519c039f30 0x7f519c03c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f51b8049de0 con 0x7f51bc0a2870 2020-02-11T16:05:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 0x7f51bc13cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51c2144700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f519c039f30 0x7f519c03c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51c2144700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f519c039f30 0x7f519c03c3f0 crc :-1 s=READY pgs=100 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51c1142700 1 -- 172.21.15.88:0/956867523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51bc136300 con 0x7f51bc131410 2020-02-11T16:05:54.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 0x7f51bc13cbe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51bc0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 0x7f51bc13cbe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51bc0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 0x7f51bc13cbe0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51bc0ac270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 0x7f51bc13cbe0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51bc0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.264+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ac007340 con 0x7f51bc131410 2020-02-11T16:05:54.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.265+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 0x7f51bc13cbe0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51bc0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.265+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f51ac0074a0 con 0x7f51bc131410 2020-02-11T16:05:54.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.265+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 msgr2=0x7f51bc13cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.265+0000 7f51aaffd700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 0x7f51bc13cbe0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51bc0ac270).stop 2020-02-11T16:05:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.265+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 msgr2=0x7f51bc13cbe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:05:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.265+0000 7f51aaffd700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc131410 0x7f51bc13cbe0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51bc0ac270).stop 2020-02-11T16:05:54.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.273+0000 7f51c3ba7700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 0x7f51bc0aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.273+0000 7f51c3ba7700 1 -- 172.21.15.88:0/956867523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc1354d0 con 0x7f51bc0aa1d0 2020-02-11T16:05:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.273+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 0x7f51bc0aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.273+0000 7f51c1142700 1 -- 172.21.15.88:0/956867523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f51bc0565b0 con 0x7f51bc0aa1d0 2020-02-11T16:05:54.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.273+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 0x7f51bc0aa5e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac003050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 0x7f51bc0aa5e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac003050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 0x7f51bc0aa5e0 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac003050).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 0x7f51bc0aa5e0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac003050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ac00ea40 con 0x7f51bc0aa1d0 2020-02-11T16:05:54.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c1142700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 0x7f51bc0aa5e0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac003050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4191 (secure 0 0 0) 0x7f51ac00eba0 con 0x7f51bc0aa1d0 2020-02-11T16:05:54.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 msgr2=0x7f51bc0aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51aaffd700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 0x7f51bc0aa5e0 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac003050).stop 2020-02-11T16:05:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51aaffd700 1 -- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 msgr2=0x7f51bc0aa5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:05:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51aaffd700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51bc0aa1d0 0x7f51bc0aa5e0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0x7f51ac002f30 tx=0x7f51ac003050).stop 2020-02-11T16:05:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c3ba7700 1 -- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f519c039f30 msgr2=0x7f519c03c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c3ba7700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f519c039f30 0x7f519c03c3f0 crc :-1 s=READY pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c3ba7700 1 -- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 msgr2=0x7f51bc136650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c3ba7700 1 --2- 172.21.15.88:0/956867523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51bc0a2870 0x7f51bc136650 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f51b8002f30 tx=0x7f51b8010c60).stop 2020-02-11T16:05:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c2144700 1 -- 172.21.15.88:0/956867523 reap_dead start 2020-02-11T16:05:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c2144700 1 -- 172.21.15.88:0/956867523 reap_dead start 2020-02-11T16:05:54.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c3ba7700 1 -- 172.21.15.88:0/956867523 shutdown_connections 2020-02-11T16:05:54.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c3ba7700 1 -- 172.21.15.88:0/956867523 >> 172.21.15.88:0/956867523 conn(0x7f51bc0ac2d0 msgr2=0x7f51bc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c3ba7700 1 -- 172.21.15.88:0/956867523 shutdown_connections 2020-02-11T16:05:54.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.274+0000 7f51c3ba7700 1 -- 172.21.15.88:0/956867523 wait complete. 2020-02-11T16:05:54.295 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:05:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:05:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:05:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:05:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 8, 2020-02-11T16:05:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:05:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:05:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:05:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:05:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 36, 2020-02-11T16:05:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:05:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:05:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:05:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:05:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:05:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:05:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:05:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:05:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:05:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:05:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:05:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:05:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:05:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:05:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:05:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:05:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:05:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:05:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:05:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:05:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:05:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:05:54.303 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:05:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:05:54.304 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:05:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:05:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:05:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:05:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:05:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:05:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:05:54.306 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:05:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:05:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:05:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:05:54.307 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:05:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:05:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.308 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:05:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:05:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:05:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:05:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.309 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:05:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:05:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:05:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.311 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:05:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:05:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:05:54.312 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:05:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:05:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:05:54.313 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:05:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:05:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:05:54.314 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:05:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:05:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.316 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:05:54.317 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:05:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:05:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:05:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:05:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:05:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:05:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:05:54.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:05:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:05:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:05:54.321 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.322 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:05:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:05:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:05:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:05:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:05:54.324 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:05:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.325 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:05:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:05:54.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.327 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:05:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:05:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.328 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:05:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.329 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:05:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.330 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:05:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.331 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:05:54.332 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:05:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.313+0000 7f98c0578700 1 Processor -- start 2020-02-11T16:05:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.313+0000 7f98c0578700 1 -- start start 2020-02-11T16:05:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.313+0000 7f98c0578700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f98b80a9080 0x7f98b8065cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.313+0000 7f98c0578700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b805f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.313+0000 7f98c0578700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b8132750 con 0x7f98b8137f20 2020-02-11T16:05:54.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.313+0000 7f98c0578700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b80a98f0 con 0x7f98b80a9080 2020-02-11T16:05:54.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.313+0000 7f98c0578700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8138dd0 con 0x7f98b80a9460 2020-02-11T16:05:54.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f98b80a9080 0x7f98b8065cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98bdb13700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b805f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98beb15700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f98b8137f20 0x7f98b813b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59866/0 (socket says 172.21.15.88:59866) 2020-02-11T16:05:54.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f98b80a9080 0x7f98b8065cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38212/0 (socket says 172.21.15.88:38212) 2020-02-11T16:05:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98beb15700 1 -- 172.21.15.88:0/2854970014 learned_addr learned my addr 172.21.15.88:0/2854970014 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98bdb13700 1 --2- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b805f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:46550/0 (socket says 172.21.15.88:46550) 2020-02-11T16:05:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98bd312700 1 -- 172.21.15.88:0/2854970014 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581464765 0 0) 0x7f98b8132750 con 0x7f98b8137f20 2020-02-11T16:05:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98bd312700 1 -- 172.21.15.88:0/2854970014 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a4003230 con 0x7f98b8137f20 2020-02-11T16:05:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 -- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 msgr2=0x7f98b805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 --2- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b805f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 -- 172.21.15.88:0/2854970014 >> v1:172.21.15.52:6789/0 conn(0x7f98b8137f20 legacy=0x7f98b813b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 -- 172.21.15.88:0/2854970014 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b81383f0 con 0x7f98b80a9080 2020-02-11T16:05:54.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98bdb13700 1 --2- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b805f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:54.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 --2- 172.21.15.88:0/2854970014 >> v2:172.21.15.52:3300/0 conn(0x7f98b80a9080 0x7f98b8065cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98b40032b0 tx=0x7f98b4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 --2- 172.21.15.88:0/2854970014 >> v2:172.21.15.52:3300/0 conn(0x7f98b80a9080 0x7f98b8065cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98b40032b0 tx=0x7f98b4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 --2- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98b80a9080 0x7f98b8065cd0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f98b40032b0 tx=0x7f98b4008c60).ready entity=mon.0 client_cookie=e4cfddce829a8608 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 --2- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98b80a9080 0x7f98b8065cd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f98b40032b0 tx=0x7f98b4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98bd312700 1 -- 172.21.15.88:0/2854970014 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b4011db0 con 0x7f98b80a9080 2020-02-11T16:05:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.314+0000 7f98be314700 1 --2- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98b80a9080 0x7f98b8065cd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f98b40032b0 tx=0x7f98b4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98be314700 1 --2- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98b80a9080 0x7f98b8065cd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f98b40032b0 tx=0x7f98b4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98bd312700 1 -- 172.21.15.88:0/2854970014 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b400a160 con 0x7f98b80a9080 2020-02-11T16:05:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98bd312700 1 -- 172.21.15.88:0/2854970014 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b400a540 con 0x7f98b80a9080 2020-02-11T16:05:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98c0578700 1 -- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98b80a9080 msgr2=0x7f98b8065cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98c0578700 1 --2- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98b80a9080 0x7f98b8065cd0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f98b40032b0 tx=0x7f98b4008c60).stop 2020-02-11T16:05:54.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98c0578700 1 -- 172.21.15.88:0/2854970014 shutdown_connections 2020-02-11T16:05:54.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98c0578700 1 --2- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98b80a9080 0x7f98b8065cd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98c0578700 1 --2- 172.21.15.88:0/2854970014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b805f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98c0578700 1 -- 172.21.15.88:0/2854970014 >> 172.21.15.88:0/2854970014 conn(0x7f98b80ab0a0 msgr2=0x7f98b80ab4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98c0578700 1 -- 172.21.15.88:0/2854970014 shutdown_connections 2020-02-11T16:05:54.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.315+0000 7f98c0578700 1 -- 172.21.15.88:0/2854970014 wait complete. 2020-02-11T16:05:54.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.316+0000 7f98c0578700 1 Processor -- start 2020-02-11T16:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.316+0000 7f98c0578700 1 -- start start 2020-02-11T16:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98c0578700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98c0578700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f98b8137f20 0x7f98b8135200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98c0578700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b8137d30 con 0x7f98b80a9080 2020-02-11T16:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98c0578700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b8133380 con 0x7f98b8137f20 2020-02-11T16:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98c0578700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8137550 con 0x7f98b80a9460 2020-02-11T16:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98be314700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f98b80a9080 0x7f98b8132c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59872/0 (socket says 172.21.15.88:59872) 2020-02-11T16:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98be314700 1 -- 172.21.15.88:0/4287217604 learned_addr learned my addr 172.21.15.88:0/4287217604 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98beb15700 1 --2- 172.21.15.88:0/4287217604 >> v2:172.21.15.52:3300/0 conn(0x7f98b8137f20 0x7f98b8135200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98af7fe700 1 -- 172.21.15.88:0/4287217604 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37263955 0 0) 0x7f98b8137d30 con 0x7f98b80a9080 2020-02-11T16:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98af7fe700 1 -- 172.21.15.88:0/4287217604 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9898002fe0 con 0x7f98b80a9080 2020-02-11T16:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98bdb13700 1 -- 172.21.15.88:0/4287217604 >> v2:172.21.15.52:3300/0 conn(0x7f98b8137f20 msgr2=0x7f98b8135200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> v2:172.21.15.52:3300/0 conn(0x7f98b8137f20 0x7f98b8135200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98bdb13700 1 -- 172.21.15.88:0/4287217604 >> v1:172.21.15.52:6789/0 conn(0x7f98b80a9080 legacy=0x7f98b8132c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98bdb13700 1 -- 172.21.15.88:0/4287217604 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b81377f0 con 0x7f98b80a9460 2020-02-11T16:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.317+0000 7f98af7fe700 1 -- 172.21.15.88:0/4287217604 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98a800c940 con 0x7f98b80a9460 2020-02-11T16:05:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.318+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.318+0000 7f98c0578700 1 -- 172.21.15.88:0/4287217604 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b8137a90 con 0x7f98b80a9460 2020-02-11T16:05:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.318+0000 7f98af7fe700 1 -- 172.21.15.88:0/4287217604 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a800caa0 con 0x7f98b80a9460 2020-02-11T16:05:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.318+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.318+0000 7f98af7fe700 1 -- 172.21.15.88:0/4287217604 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98a80056c0 con 0x7f98b80a9460 2020-02-11T16:05:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.318+0000 7f98c0578700 1 -- 172.21.15.88:0/4287217604 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b8131160 con 0x7f98b80a9460 2020-02-11T16:05:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.318+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.318+0000 7f98af7fe700 1 -- 172.21.15.88:0/4287217604 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f98a8007180 con 0x7f98b80a9460 2020-02-11T16:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.318+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.319+0000 7f98c0578700 1 -- 172.21.15.88:0/4287217604 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b80565b0 con 0x7f98b80a9460 2020-02-11T16:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.319+0000 7f98af7fe700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9898039f40 0x7f989803c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.319+0000 7f98af7fe700 1 -- 172.21.15.88:0/4287217604 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f98a8049b50 con 0x7f98b80a9460 2020-02-11T16:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.319+0000 7f98be314700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9898039f40 0x7f989803c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.319+0000 7f98be314700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9898039f40 0x7f989803c400 crc :-1 s=READY pgs=101 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.323+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.323+0000 7f98af7fe700 1 -- 172.21.15.88:0/4287217604 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f98a802f140 con 0x7f98b80a9460 2020-02-11T16:05:54.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.457+0000 7fab82099700 1 Processor -- start 2020-02-11T16:05:54.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.457+0000 7fab82099700 1 -- start start 2020-02-11T16:05:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab82099700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fab7c0a7120 0x7fab7c0a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab82099700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a39e0 0x7fab7c0a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab82099700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fab7c12f890 0x7fab7c12fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab82099700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7c09e7a0 con 0x7fab7c12f890 2020-02-11T16:05:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab82099700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7c0a5320 con 0x7fab7c0a7120 2020-02-11T16:05:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab82099700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0a5560 con 0x7fab7c0a39e0 2020-02-11T16:05:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fab7c0a7120 0x7fab7c0a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fab7c0a7120 0x7fab7c0a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52240/0 (socket says 172.21.15.88:52240) 2020-02-11T16:05:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7b7fe700 1 -- 172.21.15.88:0/3849198081 learned_addr learned my addr 172.21.15.88:0/3849198081 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7bfff700 1 --2- 172.21.15.88:0/3849198081 >> v2:172.21.15.52:3300/0 conn(0x7fab7c12f890 0x7fab7c12fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7affd700 1 --2- 172.21.15.88:0/3849198081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a39e0 0x7fab7c0a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7b7fe700 1 -- 172.21.15.88:0/3849198081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a39e0 msgr2=0x7fab7c0a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3849198081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a39e0 0x7fab7c0a3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7b7fe700 1 -- 172.21.15.88:0/3849198081 >> v2:172.21.15.52:3300/0 conn(0x7fab7c12f890 msgr2=0x7fab7c12fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3849198081 >> v2:172.21.15.52:3300/0 conn(0x7fab7c12f890 0x7fab7c12fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7b7fe700 1 -- 172.21.15.88:0/3849198081 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c09e060 con 0x7fab7c0a7120 2020-02-11T16:05:54.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7bfff700 1 --2- 172.21.15.88:0/3849198081 >> v2:172.21.15.52:3300/0 conn(0x7fab7c12f890 0x7fab7c12fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:05:54.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.458+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3849198081 >> v2:172.21.15.88:3300/0 conn(0x7fab7c0a7120 0x7fab7c0a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3849198081 >> v2:172.21.15.88:3300/0 conn(0x7fab7c0a7120 0x7fab7c0a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3849198081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab7c0a7120 0x7fab7c0a4ec0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).ready entity=mon.1 client_cookie=82d2e7fcbdaf9639 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3849198081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab7c0a7120 0x7fab7c0a4ec0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3849198081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab7c0a7120 0x7fab7c0a4ec0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab7a7fc700 1 -- 172.21.15.88:0/3849198081 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab64011720 con 0x7fab7c0a7120 2020-02-11T16:05:54.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3849198081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab7c0a7120 0x7fab7c0a4ec0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab7a7fc700 1 -- 172.21.15.88:0/3849198081 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab64011880 con 0x7fab7c0a7120 2020-02-11T16:05:54.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab7a7fc700 1 -- 172.21.15.88:0/3849198081 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab64011c20 con 0x7fab7c0a7120 2020-02-11T16:05:54.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab82099700 1 -- 172.21.15.88:0/3849198081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab7c0a7120 msgr2=0x7fab7c0a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab82099700 1 --2- 172.21.15.88:0/3849198081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab7c0a7120 0x7fab7c0a4ec0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).stop 2020-02-11T16:05:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab82099700 1 -- 172.21.15.88:0/3849198081 shutdown_connections 2020-02-11T16:05:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab82099700 1 --2- 172.21.15.88:0/3849198081 >> v2:172.21.15.52:3300/0 conn(0x7fab7c12f890 0x7fab7c12fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab82099700 1 --2- 172.21.15.88:0/3849198081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab7c0a7120 0x7fab7c0a4ec0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab82099700 1 --2- 172.21.15.88:0/3849198081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a39e0 0x7fab7c0a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab82099700 1 -- 172.21.15.88:0/3849198081 >> 172.21.15.88:0/3849198081 conn(0x7fab7c09d110 msgr2=0x7fab7c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab82099700 1 -- 172.21.15.88:0/3849198081 shutdown_connections 2020-02-11T16:05:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.459+0000 7fab82099700 1 -- 172.21.15.88:0/3849198081 wait complete. 2020-02-11T16:05:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.460+0000 7fab82099700 1 Processor -- start 2020-02-11T16:05:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.460+0000 7fab82099700 1 -- start start 2020-02-11T16:05:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab82099700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fab7c0a39e0 0x7fab7c0a9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab82099700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7c0a96b0 con 0x7fab7c12f890 2020-02-11T16:05:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab82099700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7c145210 con 0x7fab7c0a7120 2020-02-11T16:05:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab82099700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7c0a08e0 con 0x7fab7c0a39e0 2020-02-11T16:05:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab7affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fab7c0a7120 0x7fab7c12a0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39874/0 (socket says 172.21.15.88:39874) 2020-02-11T16:05:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab7affd700 1 -- 172.21.15.88:0/3164073045 learned_addr learned my addr 172.21.15.88:0/3164073045 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3164073045 >> v2:172.21.15.52:3300/0 conn(0x7fab7c0a39e0 0x7fab7c0a9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198697938 0 0) 0x7fab7c145210 con 0x7fab7c0a7120 2020-02-11T16:05:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab60002fe0 con 0x7fab7c0a7120 2020-02-11T16:05:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab7b7fe700 1 -- 172.21.15.88:0/3164073045 >> v1:172.21.15.88:6789/0 conn(0x7fab7c0a7120 legacy=0x7fab7c12a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab7b7fe700 1 -- 172.21.15.88:0/3164073045 >> v1:172.21.15.52:6789/0 conn(0x7fab7c12f890 legacy=0x7fab7c0a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab7b7fe700 1 -- 172.21.15.88:0/3164073045 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c1454b0 con 0x7fab7c0a39e0 2020-02-11T16:05:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441035774 0 0) 0x7fab74001260 con 0x7fab7c12f890 2020-02-11T16:05:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3164073045 >> v2:172.21.15.52:3300/0 conn(0x7fab7c0a39e0 0x7fab7c0a9250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.461+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3164073045 >> v2:172.21.15.52:3300/0 conn(0x7fab7c0a39e0 0x7fab7c0a9250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c0a39e0 0x7fab7c0a9250 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c0a39e0 0x7fab7c0a9250 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab64007150 con 0x7fab7c0a39e0 2020-02-11T16:05:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c0a39e0 0x7fab7c0a9250 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab640072b0 con 0x7fab7c0a39e0 2020-02-11T16:05:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab82099700 1 -- 172.21.15.88:0/3164073045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7c145750 con 0x7fab7c0a39e0 2020-02-11T16:05:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c0a39e0 0x7fab7c0a9250 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab640056c0 con 0x7fab7c0a39e0 2020-02-11T16:05:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab82099700 1 -- 172.21.15.88:0/3164073045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7c144e20 con 0x7fab7c0a39e0 2020-02-11T16:05:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c0a39e0 0x7fab7c0a9250 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab82099700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 0x7fab7c12d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.462+0000 7fab82099700 1 -- 172.21.15.88:0/3164073045 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c05e2f0 con 0x7fab7c066e90 2020-02-11T16:05:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 0x7fab7c12d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fab64005900 con 0x7fab7c0a39e0 2020-02-11T16:05:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab7b7fe700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c0a39e0 0x7fab7c0a9250 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab78ff9700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fab60039e80 0x7fab6003c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fab64049f70 con 0x7fab7c0a39e0 2020-02-11T16:05:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab7bfff700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fab60039e80 0x7fab6003c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab7affd700 1 -- 172.21.15.88:0/3164073045 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab7c0672a0 con 0x7fab7c066e90 2020-02-11T16:05:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 0x7fab7c12d8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 0x7fab7c12d8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 0x7fab7c12d8a0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab7bfff700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fab60039e80 0x7fab6003c340 crc :-1 s=READY pgs=102 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 0x7fab7c12d8a0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.463+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab6c007540 con 0x7fab7c066e90 2020-02-11T16:05:54.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.464+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 0x7fab7c12d8a0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.464+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fab6c0059c0 con 0x7fab7c066e90 2020-02-11T16:05:54.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.464+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 msgr2=0x7fab7c12d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.464+0000 7fab78ff9700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 0x7fab7c12d8a0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).stop 2020-02-11T16:05:54.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.464+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 msgr2=0x7fab7c12d8a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:05:54.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.464+0000 7fab78ff9700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c066e90 0x7fab7c12d8a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.464+0000 7f98c0578700 1 -- 172.21.15.88:0/4287217604 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98b8068bd0 con 0x7f98b80a9460 2020-02-11T16:05:54.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.465+0000 7f98bdb13700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.465+0000 7f98af7fe700 1 -- 172.21.15.88:0/4287217604 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f98a8031c10 con 0x7f98b80a9460 2020-02-11T16:05:54.481 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2020-02-11T16:05:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 -- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9898039f40 msgr2=0x7f989803c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9898039f40 0x7f989803c400 crc :-1 s=READY pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 -- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 msgr2=0x7f98b8134da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f98a8002f30 tx=0x7f98a8010d80).stop 2020-02-11T16:05:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 -- 172.21.15.88:0/4287217604 shutdown_connections 2020-02-11T16:05:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9898039f40 0x7f989803c400 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 --2- 172.21.15.88:0/4287217604 >> v2:172.21.15.52:3300/0 conn(0x7f98b8137f20 0x7f98b8135200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 --2- 172.21.15.88:0/4287217604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f98b80a9460 0x7f98b8134da0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 -- 172.21.15.88:0/4287217604 >> 172.21.15.88:0/4287217604 conn(0x7f98b80ab0a0 msgr2=0x7f98b8131ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 -- 172.21.15.88:0/4287217604 shutdown_connections 2020-02-11T16:05:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.466+0000 7f98c0578700 1 -- 172.21.15.88:0/4287217604 wait complete. 2020-02-11T16:05:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.472+0000 7fab82099700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 0x7fab7c0a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.472+0000 7fab82099700 1 -- 172.21.15.88:0/3164073045 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c1458e0 con 0x7fab7c0a7f10 2020-02-11T16:05:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.472+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 0x7fab7c0a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab7affd700 1 -- 172.21.15.88:0/3164073045 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fab7c0565b0 con 0x7fab7c0a7f10 2020-02-11T16:05:54.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 0x7fab7c0a8320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 0x7fab7c0a8320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 0x7fab7c0a8320 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 0x7fab7c0a8320 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab6c00c8a0 con 0x7fab7c0a7f10 2020-02-11T16:05:54.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab7affd700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 0x7fab7c0a8320 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4019 (secure 0 0 0) 0x7fab6c00ffd0 con 0x7fab7c0a7f10 2020-02-11T16:05:54.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 msgr2=0x7fab7c0a8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab78ff9700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 0x7fab7c0a8320 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fab6c002060 tx=0x7fab6c010ca0).stop 2020-02-11T16:05:54.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab78ff9700 1 -- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 msgr2=0x7fab7c0a8320 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:05:54.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.473+0000 7fab78ff9700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab7c0a7f10 0x7fab7c0a8320 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab82099700 1 -- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fab60039e80 msgr2=0x7fab6003c340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab82099700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fab60039e80 0x7fab6003c340 crc :-1 s=READY pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab82099700 1 -- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c0a39e0 msgr2=0x7fab7c0a9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab82099700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c0a39e0 0x7fab7c0a9250 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fab64002f30 tx=0x7fab64007a40).stop 2020-02-11T16:05:54.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab7bfff700 1 -- 172.21.15.88:0/3164073045 reap_dead start 2020-02-11T16:05:54.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab7bfff700 1 -- 172.21.15.88:0/3164073045 reap_dead start 2020-02-11T16:05:54.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab82099700 1 -- 172.21.15.88:0/3164073045 shutdown_connections 2020-02-11T16:05:54.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab82099700 1 --2- 172.21.15.88:0/3164073045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c0a39e0 0x7fab7c0a9250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab82099700 1 -- 172.21.15.88:0/3164073045 >> 172.21.15.88:0/3164073045 conn(0x7fab7c09d110 msgr2=0x7fab7c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab82099700 1 -- 172.21.15.88:0/3164073045 shutdown_connections 2020-02-11T16:05:54.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.474+0000 7fab82099700 1 -- 172.21.15.88:0/3164073045 wait complete. 2020-02-11T16:05:54.491 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:05:54.491 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:05:54.492 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:05:54.492 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:05:54.492 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 8, 2020-02-11T16:05:54.492 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:05:54.492 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:05:54.492 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:05:54.492 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:05:54.492 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.493 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 36, 2020-02-11T16:05:54.493 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:05:54.493 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:05:54.493 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:05:54.493 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:05:54.493 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:05:54.493 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:05:54.494 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:05:54.494 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:05:54.494 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:05:54.495 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.495 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:05:54.495 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:05:54.495 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:05:54.495 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:05:54.495 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:05:54.496 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:05:54.496 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:05:54.496 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:05:54.496 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.496 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:05:54.496 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:05:54.497 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:05:54.497 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:05:54.497 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:05:54.497 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:05:54.497 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:05:54.497 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:05:54.497 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:05:54.498 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:05:54.498 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:05:54.498 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:05:54.498 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:05:54.498 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:05:54.498 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:05:54.498 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:05:54.498 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:05:54.499 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:05:54.499 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.499 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:05:54.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.499 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:05:54.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.499 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:05:54.500 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:05:54.500 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:05:54.500 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:05:54.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.500 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:05:54.500 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:05:54.500 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.501 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:54.501 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:05:54.501 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.501 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.501 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.502 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:05:54.502 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:05:54.502 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:05:54.502 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:05:54.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.503 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:05:54.503 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:05:54.503 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:05:54.503 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:05:54.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.504 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:05:54.504 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:05:54.505 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.505 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:54.505 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:05:54.505 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.505 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.506 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:05:54.506 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:05:54.506 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:05:54.506 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:05:54.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.507 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:05:54.507 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:05:54.507 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:05:54.507 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:05:54.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.508 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:05:54.508 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:05:54.508 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.508 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:54.508 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:05:54.509 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:05:54.509 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.509 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.509 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:05:54.509 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:05:54.509 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:05:54.510 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:05:54.510 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.510 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:54.510 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:05:54.510 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:05:54.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.510 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.511 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.511 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:05:54.511 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.511 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.511 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:05:54.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.511 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.512 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.512 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:05:54.512 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.512 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:05:54.512 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:05:54.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:05:54.512 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:05:54.512 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:05:54.513 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:05:54.513 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.513 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:05:54.513 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:54.513 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:05:54.514 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-02-11T16:05:54.514 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-02-11T16:05:54.515 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:05:54.515 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:05:54.515 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:05:54.515 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:05:54.516 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:05:54.516 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:05:54.526 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:05:54.526 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:05:54.526 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:05:54.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.631+0000 7f2126a09700 1 Processor -- start 2020-02-11T16:05:54.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.631+0000 7f2126a09700 1 -- start start 2020-02-11T16:05:54.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.631+0000 7f2126a09700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21200a6260 0x7f2120135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.631+0000 7f2126a09700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21200a31b0 con 0x7f21200a18a0 2020-02-11T16:05:54.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.631+0000 7f2126a09700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21200a3570 con 0x7f21200a5de0 2020-02-11T16:05:54.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.631+0000 7f2126a09700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21200a3810 con 0x7f21200a6260 2020-02-11T16:05:54.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.631+0000 7f211f7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f21200a5de0 legacy=0x7f2120134a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:05:54.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21200a6260 0x7f2120135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21200a6260 0x7f2120135160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38270/0 (socket says 172.21.15.88:38270) 2020-02-11T16:05:54.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 -- 172.21.15.88:0/4144311451 learned_addr learned my addr 172.21.15.88:0/4144311451 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:54.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 -- 172.21.15.88:0/4144311451 >> v1:172.21.15.88:6789/0 conn(0x7f21200a5de0 legacy=0x7f2120134a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:05:54.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 -- 172.21.15.88:0/4144311451 >> v1:172.21.15.52:6789/0 conn(0x7f21200a18a0 legacy=0x7f21200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 -- 172.21.15.88:0/4144311451 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200a3ab0 con 0x7f21200a6260 2020-02-11T16:05:54.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 --2- 172.21.15.88:0/4144311451 >> v2:172.21.15.52:3300/0 conn(0x7f21200a6260 0x7f2120135160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f21200a5cc0 tx=0x7f2118008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 --2- 172.21.15.88:0/4144311451 >> v2:172.21.15.52:3300/0 conn(0x7f21200a6260 0x7f2120135160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f21200a5cc0 tx=0x7f2118008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 --2- 172.21.15.88:0/4144311451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a6260 0x7f2120135160 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f21200a5cc0 tx=0x7f2118008c60).ready entity=mon.0 client_cookie=db2feec8630f10c7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 --2- 172.21.15.88:0/4144311451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a6260 0x7f2120135160 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f21200a5cc0 tx=0x7f2118008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f211effd700 1 -- 172.21.15.88:0/4144311451 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f211800a160 con 0x7f21200a6260 2020-02-11T16:05:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 --2- 172.21.15.88:0/4144311451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a6260 0x7f2120135160 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f21200a5cc0 tx=0x7f2118008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2124fa6700 1 --2- 172.21.15.88:0/4144311451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a6260 0x7f2120135160 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f21200a5cc0 tx=0x7f2118008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f211effd700 1 -- 172.21.15.88:0/4144311451 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211800a2c0 con 0x7f21200a6260 2020-02-11T16:05:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f211effd700 1 -- 172.21.15.88:0/4144311451 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f211800a660 con 0x7f21200a6260 2020-02-11T16:05:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2126a09700 1 -- 172.21.15.88:0/4144311451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a6260 msgr2=0x7f2120135160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.632+0000 7f2126a09700 1 --2- 172.21.15.88:0/4144311451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a6260 0x7f2120135160 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f21200a5cc0 tx=0x7f2118008c60).stop 2020-02-11T16:05:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.633+0000 7f2126a09700 1 -- 172.21.15.88:0/4144311451 shutdown_connections 2020-02-11T16:05:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.633+0000 7f2126a09700 1 --2- 172.21.15.88:0/4144311451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a6260 0x7f2120135160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.633+0000 7f2126a09700 1 -- 172.21.15.88:0/4144311451 >> 172.21.15.88:0/4144311451 conn(0x7f212009d110 msgr2=0x7f212009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.633+0000 7f2126a09700 1 -- 172.21.15.88:0/4144311451 shutdown_connections 2020-02-11T16:05:54.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.633+0000 7f2126a09700 1 -- 172.21.15.88:0/4144311451 wait complete. 2020-02-11T16:05:54.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.634+0000 7f2126a09700 1 Processor -- start 2020-02-11T16:05:54.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.634+0000 7f2126a09700 1 -- start start 2020-02-11T16:05:54.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.634+0000 7f2126a09700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21200a18a0 0x7f2120128130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.634+0000 7f2126a09700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21200a5de0 0x7f2120134250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.634+0000 7f2126a09700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212005a750 con 0x7f21200a6260 2020-02-11T16:05:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.634+0000 7f2126a09700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212005b7d0 con 0x7f21200a5de0 2020-02-11T16:05:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.634+0000 7f2126a09700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212005b530 con 0x7f21200a18a0 2020-02-11T16:05:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.634+0000 7f2124fa6700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f21200a6260 legacy=0x7f2120123230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:05:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21200a5de0 0x7f2120134250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211ffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21200a18a0 0x7f2120128130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21200a5de0 0x7f2120134250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38274/0 (socket says 172.21.15.88:38274) 2020-02-11T16:05:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 -- 172.21.15.88:0/257130041 learned_addr learned my addr 172.21.15.88:0/257130041 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 -- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21200a18a0 msgr2=0x7f2120128130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21200a18a0 0x7f2120128130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 -- 172.21.15.88:0/257130041 >> v1:172.21.15.88:6789/0 conn(0x7f21200a6260 legacy=0x7f2120123230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:05:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 -- 172.21.15.88:0/257130041 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200a25f0 con 0x7f21200a5de0 2020-02-11T16:05:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211ffff700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21200a18a0 0x7f2120128130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> v2:172.21.15.52:3300/0 conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> v2:172.21.15.52:3300/0 conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211d7fa700 1 -- 172.21.15.88:0/257130041 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2114011600 con 0x7f21200a5de0 2020-02-11T16:05:54.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211d7fa700 1 -- 172.21.15.88:0/257130041 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2114011760 con 0x7f21200a5de0 2020-02-11T16:05:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f2126a09700 1 -- 172.21.15.88:0/257130041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212005abb0 con 0x7f21200a5de0 2020-02-11T16:05:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f211d7fa700 1 -- 172.21.15.88:0/257130041 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2114011b40 con 0x7f21200a5de0 2020-02-11T16:05:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.635+0000 7f2126a09700 1 -- 172.21.15.88:0/257130041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212005b090 con 0x7f21200a5de0 2020-02-11T16:05:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.636+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.636+0000 7f2126a09700 1 -- 172.21.15.88:0/257130041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21200565b0 con 0x7f21200a5de0 2020-02-11T16:05:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.637+0000 7f211d7fa700 1 -- 172.21.15.88:0/257130041 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f211400b180 con 0x7f21200a5de0 2020-02-11T16:05:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.637+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.637+0000 7f211d7fa700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2100039cb0 0x7f210003c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.637+0000 7f211d7fa700 1 -- 172.21.15.88:0/257130041 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2114049580 con 0x7f21200a5de0 2020-02-11T16:05:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.637+0000 7f211ffff700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2100039cb0 0x7f210003c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.637+0000 7f211ffff700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2100039cb0 0x7f210003c170 crc :-1 s=READY pgs=103 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.641+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.641+0000 7f211d7fa700 1 -- 172.21.15.88:0/257130041 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f211402ec30 con 0x7f21200a5de0 2020-02-11T16:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.679+0000 7fec8852f700 1 Processor -- start 2020-02-11T16:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.679+0000 7fec8852f700 1 -- start start 2020-02-11T16:05:54.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.680+0000 7fec8852f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fec80131bd0 0x7fec80132010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:54.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.680+0000 7fec8852f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800adb40 con 0x7fec800a9130 2020-02-11T16:05:54.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.680+0000 7fec8852f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec80137de0 con 0x7fec800ad380 2020-02-11T16:05:54.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.680+0000 7fec8852f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec80137bf0 con 0x7fec80131bd0 2020-02-11T16:05:54.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.680+0000 7fec862cb700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fec800ad380 legacy=0x7fec80138280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:05:54.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec86acc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fec80131bd0 0x7fec80132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec85aca700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fec800a9130 0x7fec801314c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59936/0 (socket says 172.21.15.88:59936) 2020-02-11T16:05:54.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec85aca700 1 -- 172.21.15.88:0/2704920074 learned_addr learned my addr 172.21.15.88:0/2704920074 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:54.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec852c9700 1 -- 172.21.15.88:0/2704920074 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119923234 0 0) 0x7fec800adb40 con 0x7fec800a9130 2020-02-11T16:05:54.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec852c9700 1 -- 172.21.15.88:0/2704920074 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec68003230 con 0x7fec800a9130 2020-02-11T16:05:54.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec86acc700 1 -- 172.21.15.88:0/2704920074 >> v1:172.21.15.88:6789/0 conn(0x7fec800ad380 legacy=0x7fec80138280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:05:54.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec86acc700 1 -- 172.21.15.88:0/2704920074 >> v1:172.21.15.52:6789/0 conn(0x7fec800a9130 legacy=0x7fec801314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec86acc700 1 -- 172.21.15.88:0/2704920074 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800a95c0 con 0x7fec80131bd0 2020-02-11T16:05:54.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec86acc700 1 --2- 172.21.15.88:0/2704920074 >> v2:172.21.15.52:3300/0 conn(0x7fec80131bd0 0x7fec80132010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec800aa970 tx=0x7fec7c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec86acc700 1 --2- 172.21.15.88:0/2704920074 >> v2:172.21.15.52:3300/0 conn(0x7fec80131bd0 0x7fec80132010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec800aa970 tx=0x7fec7c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec86acc700 1 --2- 172.21.15.88:0/2704920074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80131bd0 0x7fec80132010 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fec800aa970 tx=0x7fec7c0088e0).ready entity=mon.0 client_cookie=9ca01f0cb62f0cf6 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec86acc700 1 --2- 172.21.15.88:0/2704920074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80131bd0 0x7fec80132010 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fec800aa970 tx=0x7fec7c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec852c9700 1 -- 172.21.15.88:0/2704920074 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7c008e40 con 0x7fec80131bd0 2020-02-11T16:05:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec86acc700 1 --2- 172.21.15.88:0/2704920074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80131bd0 0x7fec80132010 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fec800aa970 tx=0x7fec7c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec86acc700 1 --2- 172.21.15.88:0/2704920074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80131bd0 0x7fec80132010 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fec800aa970 tx=0x7fec7c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec852c9700 1 -- 172.21.15.88:0/2704920074 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c0115b0 con 0x7fec80131bd0 2020-02-11T16:05:54.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec852c9700 1 -- 172.21.15.88:0/2704920074 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7c011910 con 0x7fec80131bd0 2020-02-11T16:05:54.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec8852f700 1 -- 172.21.15.88:0/2704920074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80131bd0 msgr2=0x7fec80132010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.681+0000 7fec8852f700 1 --2- 172.21.15.88:0/2704920074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80131bd0 0x7fec80132010 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fec800aa970 tx=0x7fec7c0088e0).stop 2020-02-11T16:05:54.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.682+0000 7fec8852f700 1 -- 172.21.15.88:0/2704920074 shutdown_connections 2020-02-11T16:05:54.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.682+0000 7fec8852f700 1 --2- 172.21.15.88:0/2704920074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80131bd0 0x7fec80132010 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.682+0000 7fec8852f700 1 -- 172.21.15.88:0/2704920074 >> 172.21.15.88:0/2704920074 conn(0x7fec8005ac70 msgr2=0x7fec800ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.682+0000 7fec8852f700 1 -- 172.21.15.88:0/2704920074 shutdown_connections 2020-02-11T16:05:54.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.682+0000 7fec8852f700 1 -- 172.21.15.88:0/2704920074 wait complete. 2020-02-11T16:05:54.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec8852f700 1 Processor -- start 2020-02-11T16:05:54.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec8852f700 1 -- start start 2020-02-11T16:05:54.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec8852f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fec800ad380 0x7fec80126a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec8852f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8012c5c0 con 0x7fec800a9130 2020-02-11T16:05:54.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec8852f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8012c120 con 0x7fec80131bd0 2020-02-11T16:05:54.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec8852f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8012e4c0 con 0x7fec800ad380 2020-02-11T16:05:54.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec86acc700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fec80131bd0 legacy=0x7fec80126e80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:05:54.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec85aca700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fec800ad380 0x7fec80126a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec85aca700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fec800ad380 0x7fec80126a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38288/0 (socket says 172.21.15.88:38288) 2020-02-11T16:05:54.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec862cb700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fec800a9130 0x7fec80129580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59940/0 (socket says 172.21.15.88:59940) 2020-02-11T16:05:54.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.683+0000 7fec85aca700 1 -- 172.21.15.88:0/3254237619 learned_addr learned my addr 172.21.15.88:0/3254237619 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:54.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec85aca700 1 -- 172.21.15.88:0/3254237619 >> v1:172.21.15.88:6789/0 conn(0x7fec80131bd0 legacy=0x7fec80126e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:05:54.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec85aca700 1 -- 172.21.15.88:0/3254237619 >> v1:172.21.15.52:6789/0 conn(0x7fec800a9130 legacy=0x7fec80129580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec85aca700 1 -- 172.21.15.88:0/3254237619 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8012a160 con 0x7fec800ad380 2020-02-11T16:05:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec737fe700 1 -- 172.21.15.88:0/3254237619 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091563885 0 0) 0x7fec8012c5c0 con 0x7fec800a9130 2020-02-11T16:05:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec85aca700 1 --2- 172.21.15.88:0/3254237619 >> v2:172.21.15.52:3300/0 conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec85aca700 1 --2- 172.21.15.88:0/3254237619 >> v2:172.21.15.52:3300/0 conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec85aca700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec85aca700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec737fe700 1 -- 172.21.15.88:0/3254237619 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7400c840 con 0x7fec800ad380 2020-02-11T16:05:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec85aca700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec737fe700 1 -- 172.21.15.88:0/3254237619 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7400c9a0 con 0x7fec800ad380 2020-02-11T16:05:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec85aca700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec8852f700 1 -- 172.21.15.88:0/3254237619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8012a400 con 0x7fec800ad380 2020-02-11T16:05:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec737fe700 1 -- 172.21.15.88:0/3254237619 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7400cd00 con 0x7fec800ad380 2020-02-11T16:05:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.684+0000 7fec8852f700 1 -- 172.21.15.88:0/3254237619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec80136fc0 con 0x7fec800ad380 2020-02-11T16:05:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.685+0000 7fec85aca700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.685+0000 7fec737fe700 1 -- 172.21.15.88:0/3254237619 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fec740055c0 con 0x7fec800ad380 2020-02-11T16:05:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.685+0000 7fec85aca700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.685+0000 7fec737fe700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec60039a60 0x7fec6003bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.685+0000 7fec737fe700 1 -- 172.21.15.88:0/3254237619 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fec74049480 con 0x7fec800ad380 2020-02-11T16:05:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.685+0000 7fec8852f700 1 -- 172.21.15.88:0/3254237619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec800565b0 con 0x7fec800ad380 2020-02-11T16:05:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.685+0000 7fec862cb700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec60039a60 0x7fec6003bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.686+0000 7fec862cb700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec60039a60 0x7fec6003bf20 crc :-1 s=READY pgs=104 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:54.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.689+0000 7fec85aca700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.689+0000 7fec737fe700 1 -- 172.21.15.88:0/3254237619 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fec7402ea90 con 0x7fec800ad380 2020-02-11T16:05:54.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.822+0000 7f2126a09700 1 -- 172.21.15.88:0/257130041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f212005ccb0 con 0x7f21200a5de0 2020-02-11T16:05:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.823+0000 7f211f7fe700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.823+0000 7f211d7fa700 1 -- 172.21.15.88:0/257130041 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f21140316c0 con 0x7f21200a5de0 2020-02-11T16:05:54.825 INFO:teuthology.orchestra.run.smithi088.stdout: 2020-02-11T16:05:54.825 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/4168884093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":4168884093},{"type":"v1","addr":"172.21.15.88:6833","nonce":4168884093}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-02-11T16:05:39.282829+0000","modified":"2020-02-11T16:05:42.987581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.52:6835/3175516603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3175516603},{"type":"v1","addr":"172.21.15.52:6835","nonce":3175516603}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-02-11T16:05:54.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.824+0000 7f2126a09700 1 -- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2100039cb0 msgr2=0x7f210003c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.824+0000 7f2126a09700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2100039cb0 0x7f210003c170 crc :-1 s=READY pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.824+0000 7f2126a09700 1 -- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 msgr2=0x7f2120134250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.824+0000 7f2126a09700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 0x7f2120134250 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f2120135620 tx=0x7f2114010970).stop 2020-02-11T16:05:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.825+0000 7f2126a09700 1 -- 172.21.15.88:0/257130041 shutdown_connections 2020-02-11T16:05:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.825+0000 7f2126a09700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21200a18a0 0x7f2120128130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.825+0000 7f2126a09700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2100039cb0 0x7f210003c170 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.825+0000 7f2126a09700 1 --2- 172.21.15.88:0/257130041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21200a5de0 0x7f2120134250 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.825+0000 7f2126a09700 1 -- 172.21.15.88:0/257130041 >> 172.21.15.88:0/257130041 conn(0x7f212009d110 msgr2=0x7f2120069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.825+0000 7f2126a09700 1 -- 172.21.15.88:0/257130041 shutdown_connections 2020-02-11T16:05:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.825+0000 7f2126a09700 1 -- 172.21.15.88:0/257130041 wait complete. 2020-02-11T16:05:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2020-02-11T16:05:54.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.873+0000 7fec8852f700 1 -- 172.21.15.88:0/3254237619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fec800af350 con 0x7fec800ad380 2020-02-11T16:05:54.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.874+0000 7fec85aca700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:54.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.874+0000 7fec737fe700 1 -- 172.21.15.88:0/3254237619 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7fec74008510 con 0x7fec800ad380 2020-02-11T16:05:54.876 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":36,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:05:54.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.875+0000 7fec8852f700 1 -- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec60039a60 msgr2=0x7fec6003bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.875+0000 7fec8852f700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec60039a60 0x7fec6003bf20 crc :-1 s=READY pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.875+0000 7fec8852f700 1 -- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 msgr2=0x7fec80126a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:54.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.875+0000 7fec8852f700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 0x7fec80126a20 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7fec8012bfe0 tx=0x7fec74010aa0).stop 2020-02-11T16:05:54.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.875+0000 7fec8852f700 1 -- 172.21.15.88:0/3254237619 shutdown_connections 2020-02-11T16:05:54.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.875+0000 7fec8852f700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec60039a60 0x7fec6003bf20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.875+0000 7fec8852f700 1 --2- 172.21.15.88:0/3254237619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec800ad380 0x7fec80126a20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:54.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.875+0000 7fec8852f700 1 -- 172.21.15.88:0/3254237619 >> 172.21.15.88:0/3254237619 conn(0x7fec8005ac70 msgr2=0x7fec80069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:54.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.875+0000 7fec8852f700 1 -- 172.21.15.88:0/3254237619 shutdown_connections 2020-02-11T16:05:54.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:54.875+0000 7fec8852f700 1 -- 172.21.15.88:0/3254237619 wait complete. 2020-02-11T16:05:54.887 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":8,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":36,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:05:55.039 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4372}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4372': {u'export_targets': [], u'name': u'b', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4372, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3175516603, u'type': u'v2', u'addr': u'172.21.15.52:6834'}, {u'nonce': 3175516603, u'type': u'v1', u'addr': u'172.21.15.52:6835'}]}, u'addr': u'172.21.15.52:6835/3175516603'}}, u'fs_name': u'cephfs', u'created': u'2020-02-11T16:05:39.282829+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-02-11T16:05:42.987581+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-02-11T16:05:55.039 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-02-11T16:05:55.039 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-02-11T16:05:55.177 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2020-02-11T16:05:55.178 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:05:55.178 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2020-02-11T16:05:55.178 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4372, 2020-02-11T16:05:55.178 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2020-02-11T16:05:55.178 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2020-02-11T16:05:55.178 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 13.186185704, 2020-02-11T16:05:55.179 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 6, 2020-02-11T16:05:55.179 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 23, 2020-02-11T16:05:55.179 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 23, 2020-02-11T16:05:55.179 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 13.493125926999999 2020-02-11T16:05:55.179 INFO:teuthology.orchestra.run.smithi052.stdout:} 2020-02-11T16:05:55.186 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", "whoami": 0, "id": 4372, "want_state": "up:active", "state": "up:active", "rank_uptime": 13.186185704, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 13.493125926999999 } 2020-02-11T16:05:55.187 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-02-11T16:05:55.187 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-02-11T16:05:55.187 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi088.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-02-11T16:05:55.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:55.187 INFO:teuthology.orchestra.run.smithi088:> mkdir -p /home/ubuntu/cephtest/mnt.0 2020-02-11T16:05:55.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:55.207 INFO:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-02-11T16:05:55.272 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-02-11T16:05:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-02-11T16:05:55.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:55.280 INFO:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2020-02-11T16:05:55.331 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-02-11T16:05:55.332 INFO:teuthology.orchestra.run.smithi088.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-02-11T16:05:55.333 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-02-11T16:05:55.333 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2020-02-11T16:05:55.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:55.374 INFO:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-02-11T16:05:55.402 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-02-11T16:05:55.410 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-02-11T16:05:55.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:55.411 INFO:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2020-02-11T16:05:55.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:2020-02-11T16:05:55.446+0000 7f04cb3b61c0 -1 init, newargv = 0x55b3aec2db70 newargc=7 2020-02-11T16:05:55.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[34449]: starting ceph client 2020-02-11T16:05:55.459 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-02-11T16:05:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-02-11T16:05:55.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[34449]: starting fuse 2020-02-11T16:05:56.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:56.566 INFO:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-02-11T16:05:56.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:56.603 INFO:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2020-02-11T16:05:56.660 INFO:teuthology.orchestra.run.smithi088.stdout:45 2020-02-11T16:05:56.660 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2020-02-11T16:05:56.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:56.660 INFO:teuthology.orchestra.run.smithi088:> sudo python3 -c ' 2020-02-11T16:05:56.660 INFO:teuthology.orchestra.run.smithi088:> import glob 2020-02-11T16:05:56.661 INFO:teuthology.orchestra.run.smithi088:> import re 2020-02-11T16:05:56.661 INFO:teuthology.orchestra.run.smithi088:> import os 2020-02-11T16:05:56.661 INFO:teuthology.orchestra.run.smithi088:> import subprocess 2020-02-11T16:05:56.661 INFO:teuthology.orchestra.run.smithi088:> 2020-02-11T16:05:56.661 INFO:teuthology.orchestra.run.smithi088:> def find_socket(client_name): 2020-02-11T16:05:56.661 INFO:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-02-11T16:05:56.661 INFO:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2020-02-11T16:05:56.661 INFO:teuthology.orchestra.run.smithi088:> 2020-02-11T16:05:56.662 INFO:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2020-02-11T16:05:56.662 INFO:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2020-02-11T16:05:56.662 INFO:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2020-02-11T16:05:56.662 INFO:teuthology.orchestra.run.smithi088:> return files[0] 2020-02-11T16:05:56.662 INFO:teuthology.orchestra.run.smithi088:> 2020-02-11T16:05:56.662 INFO:teuthology.orchestra.run.smithi088:> for f in files: 2020-02-11T16:05:56.662 INFO:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-02-11T16:05:56.662 INFO:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2020-02-11T16:05:56.663 INFO:teuthology.orchestra.run.smithi088:> return f 2020-02-11T16:05:56.663 INFO:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-02-11T16:05:56.663 INFO:teuthology.orchestra.run.smithi088:> 2020-02-11T16:05:56.663 INFO:teuthology.orchestra.run.smithi088:> print(find_socket("client.0")) 2020-02-11T16:05:56.663 INFO:teuthology.orchestra.run.smithi088:> ' 2020-02-11T16:05:56.765 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.0.34449.asok 2020-02-11T16:05:56.765 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34449.asok 2020-02-11T16:05:56.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:56.766 INFO:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34449.asok status 2020-02-11T16:05:56.884 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:05:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2020-02-11T16:05:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "71281e48a442b0f38f812cad32658ed72c6d8ff5", 2020-02-11T16:05:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 15.1.0-486-g71281e4 (71281e48a442b0f38f812cad32658ed72c6d8ff5) octopus (rc)", 2020-02-11T16:05:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "0", 2020-02-11T16:05:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2020-02-11T16:05:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-02-11T16:05:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "34449", 2020-02-11T16:05:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2020-02-11T16:05:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2020-02-11T16:05:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2020-02-11T16:05:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4695, 2020-02-11T16:05:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2020-02-11T16:05:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2020-02-11T16:05:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2020-02-11T16:05:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4695 2020-02-11T16:05:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2020-02-11T16:05:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:0", 2020-02-11T16:05:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 2318864291 2020-02-11T16:05:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:05:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2020-02-11T16:05:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:05:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:0", 2020-02-11T16:05:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 2318864291 2020-02-11T16:05:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:05:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4695 172.21.15.88:0/2318864291", 2020-02-11T16:05:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "172.21.15.88:0/2318864291", 2020-02-11T16:05:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2020-02-11T16:05:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 6, 2020-02-11T16:05:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 23, 2020-02-11T16:05:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2020-02-11T16:05:56.890 INFO:teuthology.orchestra.run.smithi088.stdout: "blacklisted": false 2020-02-11T16:05:56.890 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:05:56.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:56.890 INFO:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2020-02-11T16:05:56.890 INFO:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.0 2020-02-11T16:05:56.911 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2020-02-11T16:05:56.911 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-02-11T16:05:56.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-11T16:05:56.911 INFO:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2020-02-11T16:05:56.980 INFO:teuthology.run_tasks:Running task workunit... 2020-02-11T16:05:57.000 INFO:tasks.workunit:Pulling workunits from ref 71281e48a442b0f38f812cad32658ed72c6d8ff5 2020-02-11T16:05:57.000 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-02-11T16:05:57.001 INFO:tasks.workunit:timeout=3h 2020-02-11T16:05:57.001 INFO:tasks.workunit:cleanup=True 2020-02-11T16:05:57.001 INFO:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2020-02-11T16:05:57.029 INFO:teuthology.orchestra.run.smithi088.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-02-11T16:05:57.029 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-02-11T16:05:57.029 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 2dh/45d Inode: 1 Links: 2 2020-02-11T16:05:57.029 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-11T16:05:57.029 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:fusefs_t:s0 2020-02-11T16:05:57.030 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-02-11T16:05:57.030 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2020-02-11 16:05:41.990864686 +0000 2020-02-11T16:05:57.030 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2020-02-11 16:05:56.970259079 +0000 2020-02-11T16:05:57.030 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2020-02-11T16:05:57.030 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-02-11T16:05:57.030 INFO:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-02-11T16:05:57.102 INFO:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 71281e48a442b0f38f812cad32658ed72c6d8ff5 2020-02-11T16:05:57.205 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-02-11T16:05:57.888 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:05:57.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.994+0000 7f6ad98eb700 1 Processor -- start 2020-02-11T16:05:57.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.994+0000 7f6ad98eb700 1 -- start start 2020-02-11T16:05:57.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad98eb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ad4134bf0 0x7f6ad40a1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:57.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad98eb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ad4135310 0x7f6ad41357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:05:57.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad98eb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad40a1b30 con 0x7f6ad40a5c00 2020-02-11T16:05:57.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad98eb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad40a1e50 con 0x7f6ad4135310 2020-02-11T16:05:58.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad98eb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad40a20f0 con 0x7f6ad4134bf0 2020-02-11T16:05:58.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad88e9700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f6ad40a5c00 legacy=0x7f6ad40a2590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:05:58.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad90ea700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ad4135310 0x7f6ad41357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:58.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad3fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ad4134bf0 0x7f6ad40a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:58.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad90ea700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ad4135310 0x7f6ad41357a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38314/0 (socket says 172.21.15.88:38314) 2020-02-11T16:05:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad90ea700 1 -- 172.21.15.88:0/1070123152 learned_addr learned my addr 172.21.15.88:0/1070123152 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:05:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad90ea700 1 -- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ad4134bf0 msgr2=0x7f6ad40a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:05:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad90ea700 1 --2- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ad4134bf0 0x7f6ad40a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad90ea700 1 -- 172.21.15.88:0/1070123152 >> v1:172.21.15.88:6789/0 conn(0x7f6ad40a5c00 legacy=0x7f6ad40a2590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:05:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad90ea700 1 -- 172.21.15.88:0/1070123152 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad40a5fe0 con 0x7f6ad4135310 2020-02-11T16:05:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad3fff700 1 --2- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ad4134bf0 0x7f6ad40a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:05:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.995+0000 7f6ad90ea700 1 --2- 172.21.15.88:0/1070123152 >> v2:172.21.15.52:3300/0 conn(0x7f6ad4135310 0x7f6ad41357a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ad40a62e0 tx=0x7f6acc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad90ea700 1 --2- 172.21.15.88:0/1070123152 >> v2:172.21.15.52:3300/0 conn(0x7f6ad4135310 0x7f6ad41357a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ad40a62e0 tx=0x7f6acc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad90ea700 1 --2- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ad4135310 0x7f6ad41357a0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f6ad40a62e0 tx=0x7f6acc008c60).ready entity=mon.0 client_cookie=56309b1bc96d891a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad90ea700 1 --2- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ad4135310 0x7f6ad41357a0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f6ad40a62e0 tx=0x7f6acc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad37fe700 1 -- 172.21.15.88:0/1070123152 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6acc00a160 con 0x7f6ad4135310 2020-02-11T16:05:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad90ea700 1 --2- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ad4135310 0x7f6ad41357a0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f6ad40a62e0 tx=0x7f6acc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad37fe700 1 -- 172.21.15.88:0/1070123152 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc00a2c0 con 0x7f6ad4135310 2020-02-11T16:05:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad90ea700 1 --2- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ad4135310 0x7f6ad41357a0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f6ad40a62e0 tx=0x7f6acc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad37fe700 1 -- 172.21.15.88:0/1070123152 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6acc00a660 con 0x7f6ad4135310 2020-02-11T16:05:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ad4135310 msgr2=0x7f6ad41357a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad98eb700 1 --2- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ad4135310 0x7f6ad41357a0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f6ad40a62e0 tx=0x7f6acc008c60).stop 2020-02-11T16:05:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1070123152 shutdown_connections 2020-02-11T16:05:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad98eb700 1 --2- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ad4135310 0x7f6ad41357a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad98eb700 1 --2- 172.21.15.88:0/1070123152 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ad4134bf0 0x7f6ad40a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:05:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1070123152 >> 172.21.15.88:0/1070123152 conn(0x7f6ad40a9f90 msgr2=0x7f6ad40aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1070123152 shutdown_connections 2020-02-11T16:05:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.996+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1070123152 wait complete. 2020-02-11T16:05:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.997+0000 7f6ad98eb700 1 Processor -- start 2020-02-11T16:05:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.997+0000 7f6ad98eb700 1 -- start start 2020-02-11T16:05:58.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad98eb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ad40a5c00 0x7f6ad409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:58.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad98eb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad409ceb0 con 0x7f6ad4134bf0 2020-02-11T16:05:58.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad88e9700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f6ad40a5c00 msgr2=0x7f6ad409aa40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:05:58.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad98eb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad405ba50 con 0x7f6ad4135310 2020-02-11T16:05:58.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad98eb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad409b8b0 con 0x7f6ad40a5c00 2020-02-11T16:05:58.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad90ea700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f6ad4135310 legacy=0x7f6ad414db20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:05:58.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad88e9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ad40a5c00 0x7f6ad409aa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:05:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad3fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6ad4134bf0 0x7f6ad4146c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59972/0 (socket says 172.21.15.88:59972) 2020-02-11T16:05:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad3fff700 1 -- 172.21.15.88:0/1024027590 learned_addr learned my addr 172.21.15.88:0/1024027590 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:05:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482961097 0 0) 0x7f6ad409ceb0 con 0x7f6ad4134bf0 2020-02-11T16:05:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.998+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6abc002fe0 con 0x7f6ad4134bf0 2020-02-11T16:05:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2333641472 0 0) 0x7f6abc002fe0 con 0x7f6ad4134bf0 2020-02-11T16:05:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ad409ceb0 con 0x7f6ad4134bf0 2020-02-11T16:05:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f6ac00024c0 con 0x7f6ad4134bf0 2020-02-11T16:05:58.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 >> v2:172.21.15.88:3300/0 conn(0x7f6ad40a5c00 msgr2=0x7f6ad409aa40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:05:58.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 --2- 172.21.15.88:0/1024027590 >> v2:172.21.15.88:3300/0 conn(0x7f6ad40a5c00 0x7f6ad409aa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:58.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 >> v1:172.21.15.88:6789/0 conn(0x7f6ad4135310 legacy=0x7f6ad414db20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:05:58.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 >> v1:172.21.15.52:6789/0 conn(0x7f6ad4134bf0 legacy=0x7f6ad4146c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:58.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:58.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6abc005230 0x7f6abc003940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:58.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6abc003eb0 0x7f6abc004330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:58.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad409b8b0 con 0x7f6abc0049b0 2020-02-11T16:05:58.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc00b840 con 0x7f6abc003eb0 2020-02-11T16:05:58.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc00ba00 con 0x7f6abc005230 2020-02-11T16:05:58.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad90ea700 1 -- 172.21.15.88:0/1024027590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6abc003eb0 msgr2=0x7f6abc004330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:05:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad90ea700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6abc003eb0 0x7f6abc004330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:05:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad3fff700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6abc005230 0x7f6abc003940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad88e9700 1 -- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6abc005230 msgr2=0x7f6abc003940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6abc005230 0x7f6abc003940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad88e9700 1 -- 172.21.15.88:0/1024027590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6abc003eb0 msgr2=0x7f6abc004330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:05:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6abc003eb0 0x7f6abc004330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad90ea700 1 -- 172.21.15.88:0/1024027590 reap_dead start 2020-02-11T16:05:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad88e9700 1 -- 172.21.15.88:0/1024027590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad409bb50 con 0x7f6abc0049b0 2020-02-11T16:05:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1024027590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad409bdf0 con 0x7f6abc0049b0 2020-02-11T16:05:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1024027590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad4060ff0 con 0x7f6abc0049b0 2020-02-11T16:05:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:57.999+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.000+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.000+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ac8011690 con 0x7f6abc0049b0 2020-02-11T16:05:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.000+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.000+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac80117f0 con 0x7f6abc0049b0 2020-02-11T16:05:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.000+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.000+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ac8011b50 con 0x7f6abc0049b0 2020-02-11T16:05:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.000+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.000+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1024027590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab0003340 con 0x7f6abc0049b0 2020-02-11T16:05:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.000+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f6ac8011cb0 con 0x7f6abc0049b0 2020-02-11T16:05:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.000+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.001+0000 7f6ad1ffb700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6abc03dae0 0x7f6abc03ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:05:58.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.001+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6ac8049370 con 0x7f6abc0049b0 2020-02-11T16:05:58.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.001+0000 7f6ad3fff700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6abc03dae0 0x7f6abc03ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:05:58.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.001+0000 7f6ad3fff700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6abc03dae0 0x7f6abc03ffa0 crc :-1 s=READY pgs=105 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:05:58.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.005+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.005+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f6ac802ea20 con 0x7f6abc0049b0 2020-02-11T16:05:58.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.186+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1024027590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6ab00036e0 con 0x7f6abc0049b0 2020-02-11T16:05:58.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.186+0000 7f6ad88e9700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:05:58.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.186+0000 7f6ad1ffb700 1 -- 172.21.15.88:0/1024027590 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7f6ac80314f0 con 0x7f6abc0049b0 2020-02-11T16:05:58.188 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":40,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:05:58.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.188+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6abc03dae0 msgr2=0x7f6abc03ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:58.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.188+0000 7f6ad98eb700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6abc03dae0 0x7f6abc03ffa0 crc :-1 s=READY pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:58.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.188+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 msgr2=0x7f6abc004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:05:58.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.188+0000 7f6ad98eb700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f6ac8003480 tx=0x7f6ad40684d0).stop 2020-02-11T16:05:58.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.188+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1024027590 shutdown_connections 2020-02-11T16:05:58.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.188+0000 7f6ad98eb700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6abc03dae0 0x7f6abc03ffa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:58.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.188+0000 7f6ad98eb700 1 --2- 172.21.15.88:0/1024027590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0049b0 0x7f6abc004db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:05:58.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.188+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1024027590 >> 172.21.15.88:0/1024027590 conn(0x7f6ad40a9f90 msgr2=0x7f6ad41341b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:05:58.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.188+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1024027590 shutdown_connections 2020-02-11T16:05:58.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:05:58.188+0000 7f6ad98eb700 1 -- 172.21.15.88:0/1024027590 wait complete. 2020-02-11T16:05:58.199 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":8,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":40,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:01.200 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:06:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.314+0000 7f23d35cc700 1 Processor -- start 2020-02-11T16:06:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.314+0000 7f23d35cc700 1 -- start start 2020-02-11T16:06:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d35cc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23cc0ad380 0x7f23cc0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d35cc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f23cc138710 0x7f23cc13b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d35cc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc0adb40 con 0x7f23cc138280 2020-02-11T16:06:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d35cc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23cc137bf0 con 0x7f23cc0ad380 2020-02-11T16:06:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d35cc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23cc138b50 con 0x7f23cc138710 2020-02-11T16:06:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d1b69700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f23cc138710 msgr2=0x7f23cc13b8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:06:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d1b69700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f23cc138710 0x7f23cc13b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d1368700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23cc0ad380 0x7f23cc0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d1368700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23cc0ad380 0x7f23cc0a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38330/0 (socket says 172.21.15.88:38330) 2020-02-11T16:06:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d1368700 1 -- 172.21.15.88:0/4131362066 learned_addr learned my addr 172.21.15.88:0/4131362066 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.315+0000 7f23d0b67700 1 --1- 172.21.15.88:0/4131362066 >> v1:172.21.15.52:6789/0 conn(0x7f23cc138280 0x7f23cc13b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59986/0 (socket says 172.21.15.88:59986) 2020-02-11T16:06:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d1368700 1 -- 172.21.15.88:0/4131362066 >> v2:172.21.15.88:3300/0 conn(0x7f23cc138710 msgr2=0x7f23cc13b8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:06:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d1368700 1 --2- 172.21.15.88:0/4131362066 >> v2:172.21.15.88:3300/0 conn(0x7f23cc138710 0x7f23cc13b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d1368700 1 -- 172.21.15.88:0/4131362066 >> v1:172.21.15.52:6789/0 conn(0x7f23cc138280 legacy=0x7f23cc13b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d1368700 1 -- 172.21.15.88:0/4131362066 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc137de0 con 0x7f23cc0ad380 2020-02-11T16:06:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d1368700 1 --2- 172.21.15.88:0/4131362066 >> v2:172.21.15.52:3300/0 conn(0x7f23cc0ad380 0x7f23cc0a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23bc002f30 tx=0x7f23bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d1368700 1 --2- 172.21.15.88:0/4131362066 >> v2:172.21.15.52:3300/0 conn(0x7f23cc0ad380 0x7f23cc0a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23bc002f30 tx=0x7f23bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:01.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d1368700 1 --2- 172.21.15.88:0/4131362066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23cc0ad380 0x7f23cc0a9130 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f23bc002f30 tx=0x7f23bc007a40).ready entity=mon.0 client_cookie=928b0f2784f5f9c7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:01.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d1368700 1 --2- 172.21.15.88:0/4131362066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23cc0ad380 0x7f23cc0a9130 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f23bc002f30 tx=0x7f23bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:01.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23bbfff700 1 -- 172.21.15.88:0/4131362066 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23bc008e20 con 0x7f23cc0ad380 2020-02-11T16:06:01.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d1368700 1 --2- 172.21.15.88:0/4131362066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23cc0ad380 0x7f23cc0a9130 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f23bc002f30 tx=0x7f23bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:01.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d1368700 1 --2- 172.21.15.88:0/4131362066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23cc0ad380 0x7f23cc0a9130 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f23bc002f30 tx=0x7f23bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:01.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23bbfff700 1 -- 172.21.15.88:0/4131362066 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc011910 con 0x7f23cc0ad380 2020-02-11T16:06:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23bbfff700 1 -- 172.21.15.88:0/4131362066 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23bc011cf0 con 0x7f23cc0ad380 2020-02-11T16:06:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d35cc700 1 -- 172.21.15.88:0/4131362066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23cc0ad380 msgr2=0x7f23cc0a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d35cc700 1 --2- 172.21.15.88:0/4131362066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23cc0ad380 0x7f23cc0a9130 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f23bc002f30 tx=0x7f23bc007a40).stop 2020-02-11T16:06:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.316+0000 7f23d35cc700 1 -- 172.21.15.88:0/4131362066 shutdown_connections 2020-02-11T16:06:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.317+0000 7f23d35cc700 1 --2- 172.21.15.88:0/4131362066 >> v2:172.21.15.88:3300/0 conn(0x7f23cc138710 0x7f23cc13b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.317+0000 7f23d35cc700 1 --2- 172.21.15.88:0/4131362066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23cc0ad380 0x7f23cc0a9130 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.317+0000 7f23d35cc700 1 -- 172.21.15.88:0/4131362066 >> 172.21.15.88:0/4131362066 conn(0x7f23cc05ac70 msgr2=0x7f23cc0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.317+0000 7f23d35cc700 1 -- 172.21.15.88:0/4131362066 shutdown_connections 2020-02-11T16:06:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.317+0000 7f23d35cc700 1 -- 172.21.15.88:0/4131362066 wait complete. 2020-02-11T16:06:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.317+0000 7f23d35cc700 1 Processor -- start 2020-02-11T16:06:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.317+0000 7f23d35cc700 1 -- start start 2020-02-11T16:06:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.318+0000 7f23d35cc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 0x7f23cc12d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.318+0000 7f23d35cc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc0a77c0 con 0x7f23cc138280 2020-02-11T16:06:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.318+0000 7f23d1368700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 msgr2=0x7f23cc12d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:06:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.318+0000 7f23d35cc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc0a7a60 con 0x7f23cc138710 2020-02-11T16:06:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.318+0000 7f23d35cc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23cc0a8030 con 0x7f23cc0ad380 2020-02-11T16:06:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.318+0000 7f23d1368700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 0x7f23cc12d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.318+0000 7f23d1b69700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f23cc138710 legacy=0x7f23cc0a5ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:06:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.318+0000 7f23d0b67700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f23cc138280 0x7f23cc12b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:59992/0 (socket says 172.21.15.88:59992) 2020-02-11T16:06:01.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.318+0000 7f23d0b67700 1 -- 172.21.15.88:0/1492567436 learned_addr learned my addr 172.21.15.88:0/1492567436 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:01.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.519+0000 7f23d1b69700 1 -- 172.21.15.88:0/1492567436 >> v1:172.21.15.88:6789/0 conn(0x7f23cc138710 legacy=0x7f23cc0a5ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:06:01.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.519+0000 7f23d1368700 1 -- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 msgr2=0x7f23cc12d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:06:01.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.519+0000 7f23d1368700 1 --2- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 0x7f23cc12d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:06:01.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.920+0000 7f23d1368700 1 -- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 msgr2=0x7f23cc12d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:06:01.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.920+0000 7f23d1b69700 1 -- 172.21.15.88:0/1492567436 >> v1:172.21.15.88:6789/0 conn(0x7f23cc138710 legacy=0x7f23cc0a5ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:06:01.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:01.920+0000 7f23d1368700 1 --2- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 0x7f23cc12d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:06:02.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:02.721+0000 7f23d1368700 1 -- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 msgr2=0x7f23cc12d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:06:02.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:02.721+0000 7f23d1b69700 1 -- 172.21.15.88:0/1492567436 >> v1:172.21.15.88:6789/0 conn(0x7f23cc138710 legacy=0x7f23cc0a5ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:06:02.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:02.721+0000 7f23d1368700 1 --2- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 0x7f23cc12d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:06:04.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:04.322+0000 7f23d1b69700 1 -- 172.21.15.88:0/1492567436 >> v1:172.21.15.88:6789/0 conn(0x7f23cc138710 legacy=0x7f23cc0a5ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:06:04.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:04.322+0000 7f23d1368700 1 -- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 msgr2=0x7f23cc12d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:06:04.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:04.322+0000 7f23d1368700 1 --2- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 0x7f23cc12d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:06:07.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:07.524+0000 7f23d1368700 1 -- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 msgr2=0x7f23cc12d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:06:07.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:07.524+0000 7f23d1368700 1 --2- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 0x7f23cc12d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:06:07.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:07.525+0000 7f23d1b69700 1 -- 172.21.15.88:0/1492567436 >> v1:172.21.15.88:6789/0 conn(0x7f23cc138710 legacy=0x7f23cc0a5ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:06:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.242+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898475251 0 0) 0x7f23cc0a77c0 con 0x7f23cc138280 2020-02-11T16:06:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.242+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23ac002fe0 con 0x7f23cc138280 2020-02-11T16:06:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.245+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 17290299 0 0) 0x7f23ac002fe0 con 0x7f23cc138280 2020-02-11T16:06:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f23cc0a77c0 con 0x7f23cc138280 2020-02-11T16:06:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f23c8001820 con 0x7f23cc138280 2020-02-11T16:06:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 msgr2=0x7f23cc12d860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:06:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 --2- 172.21.15.88:0/1492567436 >> v2:172.21.15.88:3300/0 conn(0x7f23cc0ad380 0x7f23cc12d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 >> v1:172.21.15.88:6789/0 conn(0x7f23cc138710 legacy=0x7f23cc0a5ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:06:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 >> v1:172.21.15.52:6789/0 conn(0x7f23cc138280 legacy=0x7f23cc12b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23ac0049b0 0x7f23ac004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac005210 0x7f23ac003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0a8030 con 0x7f23ac003ed0 2020-02-11T16:06:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac00b840 con 0x7f23ac0049b0 2020-02-11T16:06:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac00ba00 con 0x7f23ac005210 2020-02-11T16:06:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23d1368700 1 -- 172.21.15.88:0/1492567436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23ac0049b0 msgr2=0x7f23ac004d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:06:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23d1368700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23ac0049b0 0x7f23ac004d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23d0b67700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac005210 0x7f23ac003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23d1b69700 1 -- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac005210 msgr2=0x7f23ac003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac005210 0x7f23ac003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23d1b69700 1 -- 172.21.15.88:0/1492567436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23ac0049b0 msgr2=0x7f23ac004d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:06:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23ac0049b0 0x7f23ac004d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.246+0000 7f23d1b69700 1 -- 172.21.15.88:0/1492567436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc12e3a0 con 0x7f23ac003ed0 2020-02-11T16:06:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23d35cc700 1 -- 172.21.15.88:0/1492567436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23cc132040 con 0x7f23ac003ed0 2020-02-11T16:06:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23d1b69700 1 -- 172.21.15.88:0/1492567436 reap_dead start 2020-02-11T16:06:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23d35cc700 1 -- 172.21.15.88:0/1492567436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23cc12da20 con 0x7f23ac003ed0 2020-02-11T16:06:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c400e8b0 con 0x7f23ac003ed0 2020-02-11T16:06:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c400ea10 con 0x7f23ac003ed0 2020-02-11T16:06:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.247+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c400ed70 con 0x7f23ac003ed0 2020-02-11T16:06:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.248+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.248+0000 7f23d35cc700 1 -- 172.21.15.88:0/1492567436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a8003340 con 0x7f23ac003ed0 2020-02-11T16:06:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.248+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f23c4011420 con 0x7f23ac003ed0 2020-02-11T16:06:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.248+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.248+0000 7f23ba7fc700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23ac03dac0 0x7f23ac03ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.248+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f23c4049310 con 0x7f23ac003ed0 2020-02-11T16:06:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.249+0000 7f23d1368700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23ac03dac0 0x7f23ac03ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.249+0000 7f23d1368700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23ac03dac0 0x7f23ac03ff80 crc :-1 s=READY pgs=106 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.252+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.252+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f23c402e9c0 con 0x7f23ac003ed0 2020-02-11T16:06:09.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.437+0000 7f23d35cc700 1 -- 172.21.15.88:0/1492567436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f23a80036e0 con 0x7f23ac003ed0 2020-02-11T16:06:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.437+0000 7f23d1b69700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.437+0000 7f23ba7fc700 1 -- 172.21.15.88:0/1492567436 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7f23c40314d0 con 0x7f23ac003ed0 2020-02-11T16:06:09.440 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":12,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.439+0000 7f23d35cc700 1 -- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23ac03dac0 msgr2=0x7f23ac03ff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.439+0000 7f23d35cc700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23ac03dac0 0x7f23ac03ff80 crc :-1 s=READY pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.439+0000 7f23d35cc700 1 -- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 msgr2=0x7f23ac004350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.439+0000 7f23d35cc700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f23c4003800 tx=0x7f23c4010e30).stop 2020-02-11T16:06:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.439+0000 7f23d35cc700 1 -- 172.21.15.88:0/1492567436 shutdown_connections 2020-02-11T16:06:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.439+0000 7f23d35cc700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23ac03dac0 0x7f23ac03ff80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.439+0000 7f23d35cc700 1 --2- 172.21.15.88:0/1492567436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac003ed0 0x7f23ac004350 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.439+0000 7f23d35cc700 1 -- 172.21.15.88:0/1492567436 >> 172.21.15.88:0/1492567436 conn(0x7f23cc05ac70 msgr2=0x7f23cc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.439+0000 7f23d35cc700 1 -- 172.21.15.88:0/1492567436 shutdown_connections 2020-02-11T16:06:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.439+0000 7f23d35cc700 1 -- 172.21.15.88:0/1492567436 wait complete. 2020-02-11T16:06:09.452 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":12,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:09.452 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:06:09.452 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:06:09.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.555+0000 7f22472c2700 1 Processor -- start 2020-02-11T16:06:09.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.555+0000 7f22472c2700 1 -- start start 2020-02-11T16:06:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.556+0000 7f22472c2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 0x7f22400a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.556+0000 7f22472c2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22400a6260 0x7f224012eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.556+0000 7f22472c2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22400a3570 con 0x7f22400a5de0 2020-02-11T16:06:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.556+0000 7f22472c2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22400a3810 con 0x7f22400a6260 2020-02-11T16:06:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.556+0000 7f22472c2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22400a3ab0 con 0x7f22400a18a0 2020-02-11T16:06:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.556+0000 7f224485d700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f22400a5de0 legacy=0x7f224012e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:06:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.556+0000 7f224585f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22400a6260 0x7f224012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.556+0000 7f224585f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22400a6260 0x7f224012eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38370/0 (socket says 172.21.15.88:38370) 2020-02-11T16:06:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.556+0000 7f224505e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 0x7f22400a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.556+0000 7f224585f700 1 -- 172.21.15.88:0/2337651641 learned_addr learned my addr 172.21.15.88:0/2337651641 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:09.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f224505e700 1 -- 172.21.15.88:0/2337651641 >> v2:172.21.15.52:3300/0 conn(0x7f22400a6260 msgr2=0x7f224012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:06:09.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f224505e700 1 --2- 172.21.15.88:0/2337651641 >> v2:172.21.15.52:3300/0 conn(0x7f22400a6260 0x7f224012eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:09.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f224505e700 1 -- 172.21.15.88:0/2337651641 >> v1:172.21.15.88:6789/0 conn(0x7f22400a5de0 legacy=0x7f224012e3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:06:09.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f224505e700 1 -- 172.21.15.88:0/2337651641 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22400a3d50 con 0x7f22400a18a0 2020-02-11T16:06:09.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f224505e700 1 --2- 172.21.15.88:0/2337651641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 0x7f22400a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f224005b910 tx=0x7f22300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f224505e700 1 --2- 172.21.15.88:0/2337651641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 0x7f22400a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f224005b910 tx=0x7f22300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f224505e700 1 --2- 172.21.15.88:0/2337651641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 0x7f22400a6dd0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f224005b910 tx=0x7f22300088e0).ready entity=mon.2 client_cookie=a6270685ffa4403 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f224505e700 1 --2- 172.21.15.88:0/2337651641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 0x7f22400a6dd0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f224005b910 tx=0x7f22300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f222ffff700 1 -- 172.21.15.88:0/2337651641 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2230008e40 con 0x7f22400a18a0 2020-02-11T16:06:09.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f224505e700 1 --2- 172.21.15.88:0/2337651641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 0x7f22400a6dd0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f224005b910 tx=0x7f22300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f222ffff700 1 -- 172.21.15.88:0/2337651641 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2230011570 con 0x7f22400a18a0 2020-02-11T16:06:09.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f224505e700 1 --2- 172.21.15.88:0/2337651641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 0x7f22400a6dd0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f224005b910 tx=0x7f22300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f22472c2700 1 -- 172.21.15.88:0/2337651641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 msgr2=0x7f22400a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f222ffff700 1 -- 172.21.15.88:0/2337651641 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2230011950 con 0x7f22400a18a0 2020-02-11T16:06:09.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f22472c2700 1 --2- 172.21.15.88:0/2337651641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 0x7f22400a6dd0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f224005b910 tx=0x7f22300088e0).stop 2020-02-11T16:06:09.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f22472c2700 1 -- 172.21.15.88:0/2337651641 shutdown_connections 2020-02-11T16:06:09.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f22472c2700 1 --2- 172.21.15.88:0/2337651641 >> v2:172.21.15.52:3300/0 conn(0x7f22400a6260 0x7f224012eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:09.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f22472c2700 1 --2- 172.21.15.88:0/2337651641 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a18a0 0x7f22400a6dd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.557+0000 7f22472c2700 1 -- 172.21.15.88:0/2337651641 >> 172.21.15.88:0/2337651641 conn(0x7f224009d110 msgr2=0x7f224009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:09.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.558+0000 7f22472c2700 1 -- 172.21.15.88:0/2337651641 shutdown_connections 2020-02-11T16:06:09.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.558+0000 7f22472c2700 1 -- 172.21.15.88:0/2337651641 wait complete. 2020-02-11T16:06:09.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.558+0000 7f22472c2700 1 Processor -- start 2020-02-11T16:06:09.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.558+0000 7f22472c2700 1 -- start start 2020-02-11T16:06:09.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.559+0000 7f22472c2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.559+0000 7f22472c2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2240146780 con 0x7f22400a5de0 2020-02-11T16:06:09.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.559+0000 7f22472c2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2240146a20 con 0x7f22400a18a0 2020-02-11T16:06:09.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.559+0000 7f22472c2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22400a5a40 con 0x7f22400a6260 2020-02-11T16:06:09.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.559+0000 7f224505e700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f22400a18a0 legacy=0x7f2240146ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:06:09.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.559+0000 7f224485d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f22400a5de0 0x7f22401283c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60030/0 (socket says 172.21.15.88:60030) 2020-02-11T16:06:09.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.559+0000 7f224485d700 1 -- 172.21.15.88:0/93358234 learned_addr learned my addr 172.21.15.88:0/93358234 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:09.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.559+0000 7f224585f700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275302669 0 0) 0x7f2240146780 con 0x7f22400a5de0 2020-02-11T16:06:09.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2220002fe0 con 0x7f22400a5de0 2020-02-11T16:06:09.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f224585f700 1 -- 172.21.15.88:0/93358234 >> v1:172.21.15.88:6789/0 conn(0x7f22400a18a0 legacy=0x7f2240146ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:06:09.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f224585f700 1 -- 172.21.15.88:0/93358234 >> v1:172.21.15.52:6789/0 conn(0x7f22400a5de0 legacy=0x7f22401283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f224585f700 1 -- 172.21.15.88:0/93358234 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240136ec0 con 0x7f22400a6260 2020-02-11T16:06:09.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f224585f700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f224012e970 tx=0x7f2238010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f224585f700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f224012e970 tx=0x7f2238010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f224585f700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f224012e970 tx=0x7f2238010ef0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f224585f700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f224012e970 tx=0x7f2238010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223800ebf0 con 0x7f22400a6260 2020-02-11T16:06:09.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f224585f700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f224012e970 tx=0x7f2238010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f22472c2700 1 -- 172.21.15.88:0/93358234 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2240135bc0 con 0x7f22400a6260 2020-02-11T16:06:09.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223800ed50 con 0x7f22400a6260 2020-02-11T16:06:09.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f224585f700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f224012e970 tx=0x7f2238010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22380118e0 con 0x7f22400a6260 2020-02-11T16:06:09.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.560+0000 7f22472c2700 1 -- 172.21.15.88:0/93358234 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2240137570 con 0x7f22400a6260 2020-02-11T16:06:09.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f224585f700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f224012e970 tx=0x7f2238010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f22472c2700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 0x7f22400a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f22472c2700 1 -- 172.21.15.88:0/93358234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224005e2f0 con 0x7f2240134f50 2020-02-11T16:06:09.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f2238011ae0 con 0x7f22400a6260 2020-02-11T16:06:09.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f224585f700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f224012e970 tx=0x7f2238010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 0x7f22400a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f222e7fc700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2220039eb0 0x7f222003c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2238049730 con 0x7f22400a6260 2020-02-11T16:06:09.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f224485d700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2220039eb0 0x7f222003c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f224505e700 1 -- 172.21.15.88:0/93358234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2240146600 con 0x7f2240134f50 2020-02-11T16:06:09.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.561+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 0x7f22400a4990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f224485d700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2220039eb0 0x7f222003c370 crc :-1 s=READY pgs=107 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 0x7f22400a4990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 0x7f22400a4990 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 0x7f22400a4990 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2230007340 con 0x7f2240134f50 2020-02-11T16:06:09.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 0x7f22400a4990 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f22300074a0 con 0x7f2240134f50 2020-02-11T16:06:09.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 msgr2=0x7f22400a4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f222e7fc700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 0x7f22400a4990 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).stop 2020-02-11T16:06:09.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 msgr2=0x7f22400a4990 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:09.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.562+0000 7f222e7fc700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2240134f50 0x7f22400a4990 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).stop 2020-02-11T16:06:09.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.570+0000 7f22472c2700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 0x7f22400a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.570+0000 7f22472c2700 1 -- 172.21.15.88:0/93358234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2240146bb0 con 0x7f22400a8ce0 2020-02-11T16:06:09.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.570+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 0x7f22400a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f224505e700 1 -- 172.21.15.88:0/93358234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f22400565b0 con 0x7f22400a8ce0 2020-02-11T16:06:09.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 0x7f22400a90f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 0x7f22400a90f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 0x7f22400a90f0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 0x7f22400a90f0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2230005e40 con 0x7f22400a8ce0 2020-02-11T16:06:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f224505e700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 0x7f22400a90f0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4350 (secure 0 0 0) 0x7f223000e540 con 0x7f22400a8ce0 2020-02-11T16:06:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 msgr2=0x7f22400a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f222e7fc700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 0x7f22400a90f0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).stop 2020-02-11T16:06:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f222e7fc700 1 -- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 msgr2=0x7f22400a90f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:09.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f222e7fc700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22400a8ce0 0x7f22400a90f0 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0x7f2230010150 tx=0x7f22400a1c80).stop 2020-02-11T16:06:09.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f22472c2700 1 -- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2220039eb0 msgr2=0x7f222003c370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.571+0000 7f22472c2700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2220039eb0 0x7f222003c370 crc :-1 s=READY pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.572+0000 7f22472c2700 1 -- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 msgr2=0x7f224014e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.572+0000 7f22472c2700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f224012e970 tx=0x7f2238010ef0).stop 2020-02-11T16:06:09.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.572+0000 7f224585f700 1 -- 172.21.15.88:0/93358234 reap_dead start 2020-02-11T16:06:09.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.572+0000 7f22472c2700 1 -- 172.21.15.88:0/93358234 shutdown_connections 2020-02-11T16:06:09.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.572+0000 7f22472c2700 1 --2- 172.21.15.88:0/93358234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22400a6260 0x7f224014e950 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.572+0000 7f22472c2700 1 -- 172.21.15.88:0/93358234 >> 172.21.15.88:0/93358234 conn(0x7f224009d110 msgr2=0x7f22400a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:09.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.572+0000 7f22472c2700 1 -- 172.21.15.88:0/93358234 shutdown_connections 2020-02-11T16:06:09.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.572+0000 7f22472c2700 1 -- 172.21.15.88:0/93358234 wait complete. 2020-02-11T16:06:09.586 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:06:09.586 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:09.587 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:09.587 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:06:09.587 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 12, 2020-02-11T16:06:09.587 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:06:09.587 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:06:09.588 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:06:09.588 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.588 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:06:09.588 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:09.588 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:06:09.588 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:06:09.588 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:09.589 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:09.589 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:09.589 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:09.589 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:09.589 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:09.590 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.590 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:06:09.590 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:06:09.590 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:09.590 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:09.591 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:09.591 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:09.591 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:09.591 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:09.591 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.592 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:06:09.592 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:06:09.592 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:06:09.592 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:06:09.593 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:06:09.593 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:06:09.593 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:09.593 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:09.594 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:06:09.594 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:06:09.594 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:09.594 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:06:09.595 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:09.595 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:09.595 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:09.595 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:09.595 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:09.596 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:09.596 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.596 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:06:09.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.597 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:06:09.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.597 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:09.597 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:09.597 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:09.598 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:09.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.598 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:09.598 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:06:09.599 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.599 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:09.599 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:06:09.600 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.600 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.600 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.601 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:06:09.601 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:06:09.601 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:09.601 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:09.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.602 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:06:09.602 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:06:09.602 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:09.603 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:09.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.603 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:09.603 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:06:09.604 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.604 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:09.604 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:06:09.605 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.605 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.605 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.606 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:06:09.606 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:06:09.606 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:09.606 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:09.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.607 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:09.608 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:09.608 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:09.608 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:09.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.609 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:09.609 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:06:09.609 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.610 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:09.610 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:06:09.610 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.610 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.611 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.611 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:06:09.611 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:06:09.612 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:09.612 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:09.612 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.613 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.613 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:06:09.613 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:06:09.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.614 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:09.614 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:09.614 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:09.614 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.615 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.615 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:06:09.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.617 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:09.617 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:09.617 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:09.617 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.617 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.617 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:06:09.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.618 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:09.618 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:09.618 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:06:09.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.619 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.619 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:06:09.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.620 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:09.620 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:09.620 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:06:09.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.620 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.620 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:06:09.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.621 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:09.621 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:09.621 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:06:09.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.622 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.622 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:06:09.623 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:06:09.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.727+0000 7f783001e700 1 Processor -- start 2020-02-11T16:06:09.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.727+0000 7f783001e700 1 -- start start 2020-02-11T16:06:09.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f783001e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78280ad380 0x7f78280a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:09.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f783001e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828138280 0x7f78281386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:09.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f783001e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f782813b1c0 0x7f782813b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:09.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f783001e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7828137bf0 con 0x7f78280ad380 2020-02-11T16:06:09.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f783001e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7828138b40 con 0x7f782813b1c0 2020-02-11T16:06:09.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f783001e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78280adb40 con 0x7f7828138280 2020-02-11T16:06:09.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f782e5bb700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f782813b1c0 msgr2=0x7f782813b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:06:09.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f782e5bb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f782813b1c0 0x7f782813b600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:09.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f782ddba700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78280ad380 0x7f78280a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f782ddba700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78280ad380 0x7f78280a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38386/0 (socket says 172.21.15.88:38386) 2020-02-11T16:06:09.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f782ddba700 1 -- 172.21.15.88:0/3147655564 learned_addr learned my addr 172.21.15.88:0/3147655564 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:09.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.728+0000 7f782d5b9700 1 --2- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828138280 0x7f78281386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 -- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828138280 msgr2=0x7f78281386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:06:09.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 --2- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828138280 0x7f78281386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:09.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 -- 172.21.15.88:0/3147655564 >> v2:172.21.15.88:3300/0 conn(0x7f782813b1c0 msgr2=0x7f782813b600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:06:09.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 --2- 172.21.15.88:0/3147655564 >> v2:172.21.15.88:3300/0 conn(0x7f782813b1c0 0x7f782813b600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:09.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 -- 172.21.15.88:0/3147655564 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828137de0 con 0x7f78280ad380 2020-02-11T16:06:09.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 --2- 172.21.15.88:0/3147655564 >> v2:172.21.15.52:3300/0 conn(0x7f78280ad380 0x7f78280a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7828138c80 tx=0x7f78180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 --2- 172.21.15.88:0/3147655564 >> v2:172.21.15.52:3300/0 conn(0x7f78280ad380 0x7f78280a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7828138c80 tx=0x7f78180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 --2- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f78280a9130 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f78180088e0).ready entity=mon.0 client_cookie=a1b11a3b5da07919 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 --2- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f78280a9130 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f78180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782cdb8700 1 -- 172.21.15.88:0/3147655564 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7818011670 con 0x7f78280ad380 2020-02-11T16:06:09.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 --2- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f78280a9130 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f78180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782ddba700 1 --2- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f78280a9130 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f78180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782cdb8700 1 -- 172.21.15.88:0/3147655564 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78180117d0 con 0x7f78280ad380 2020-02-11T16:06:09.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f782cdb8700 1 -- 172.21.15.88:0/3147655564 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7818011bb0 con 0x7f78280ad380 2020-02-11T16:06:09.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f783001e700 1 -- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 msgr2=0x7f78280a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f783001e700 1 --2- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f78280a9130 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f78180088e0).stop 2020-02-11T16:06:09.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f783001e700 1 -- 172.21.15.88:0/3147655564 shutdown_connections 2020-02-11T16:06:09.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f783001e700 1 --2- 172.21.15.88:0/3147655564 >> v2:172.21.15.88:3300/0 conn(0x7f782813b1c0 0x7f782813b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f783001e700 1 --2- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f78280a9130 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f783001e700 1 --2- 172.21.15.88:0/3147655564 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828138280 0x7f78281386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f783001e700 1 -- 172.21.15.88:0/3147655564 >> 172.21.15.88:0/3147655564 conn(0x7f782805ac70 msgr2=0x7f78280ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f783001e700 1 -- 172.21.15.88:0/3147655564 shutdown_connections 2020-02-11T16:06:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.729+0000 7f783001e700 1 -- 172.21.15.88:0/3147655564 wait complete. 2020-02-11T16:06:09.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.730+0000 7f783001e700 1 Processor -- start 2020-02-11T16:06:09.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.730+0000 7f783001e700 1 -- start start 2020-02-11T16:06:09.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f783001e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78280ad380 0x7f782812c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f783001e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828138280 0x7f78281484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f783001e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7828138dc0 con 0x7f782813b1c0 2020-02-11T16:06:09.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f783001e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7828128430 con 0x7f78280ad380 2020-02-11T16:06:09.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f783001e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78281286d0 con 0x7f7828138280 2020-02-11T16:06:09.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782ddba700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78280ad380 0x7f782812c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782ddba700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78280ad380 0x7f782812c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38392/0 (socket says 172.21.15.88:38392) 2020-02-11T16:06:09.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782ddba700 1 -- 172.21.15.88:0/2708254335 learned_addr learned my addr 172.21.15.88:0/2708254335 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:09.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828138280 0x7f78281484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782ddba700 1 -- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828138280 msgr2=0x7f78281484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782ddba700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828138280 0x7f78281484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782ddba700 1 -- 172.21.15.88:0/2708254335 >> v1:172.21.15.52:6789/0 conn(0x7f782813b1c0 legacy=0x7f7828148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259767344 0 0) 0x7f7828138dc0 con 0x7f782813b1c0 2020-02-11T16:06:09.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782ddba700 1 -- 172.21.15.88:0/2708254335 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828128970 con 0x7f78280ad380 2020-02-11T16:06:09.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828138280 0x7f78281484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:06:09.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782ddba700 1 --2- 172.21.15.88:0/2708254335 >> v2:172.21.15.52:3300/0 conn(0x7f78280ad380 0x7f782812c490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f7818011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782ddba700 1 --2- 172.21.15.88:0/2708254335 >> v2:172.21.15.52:3300/0 conn(0x7f78280ad380 0x7f782812c490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f7818011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.731+0000 7f782ddba700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f782812c490 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f7818011420).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.732+0000 7f782ddba700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f782812c490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f7818011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.732+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7818011b70 con 0x7f78280ad380 2020-02-11T16:06:09.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.732+0000 7f782ddba700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f782812c490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f7818011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.732+0000 7f782ddba700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f782812c490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f7818011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.732+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7818007150 con 0x7f78280ad380 2020-02-11T16:06:09.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.732+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78180074b0 con 0x7f78280ad380 2020-02-11T16:06:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.732+0000 7f783001e700 1 -- 172.21.15.88:0/2708254335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782812c8f0 con 0x7f78280ad380 2020-02-11T16:06:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.732+0000 7f783001e700 1 -- 172.21.15.88:0/2708254335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7828128e10 con 0x7f78280ad380 2020-02-11T16:06:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.732+0000 7f782ddba700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f782812c490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f7818011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f78180056c0 con 0x7f78280ad380 2020-02-11T16:06:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f782ddba700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f782812c490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f7818011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f783001e700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 0x7f7828149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f783001e700 1 -- 172.21.15.88:0/2708254335 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782805e2f0 con 0x7f782813a380 2020-02-11T16:06:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f7816ffd700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7808039b30 0x7f780803bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f781804a050 con 0x7f78280ad380 2020-02-11T16:06:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 0x7f7828149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f782e5bb700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7808039b30 0x7f780803bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f782d5b9700 1 -- 172.21.15.88:0/2708254335 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7828128b30 con 0x7f782813a380 2020-02-11T16:06:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 0x7f7828149060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f782e5bb700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7808039b30 0x7f780803bff0 crc :-1 s=READY pgs=108 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 0x7f7828149060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 0x7f7828149060 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 0x7f7828149060 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.733+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7824007150 con 0x7f782813a380 2020-02-11T16:06:09.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.734+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 0x7f7828149060 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.734+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f782400aed0 con 0x7f782813a380 2020-02-11T16:06:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.734+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 msgr2=0x7f7828149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.734+0000 7f7816ffd700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 0x7f7828149060 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).stop 2020-02-11T16:06:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.734+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 msgr2=0x7f7828149060 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.734+0000 7f7816ffd700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f782813a380 0x7f7828149060 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).stop 2020-02-11T16:06:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.742+0000 7f783001e700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 0x7f782805ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.742+0000 7f783001e700 1 -- 172.21.15.88:0/2708254335 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782812ca80 con 0x7f7828129560 2020-02-11T16:06:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.742+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 0x7f782805ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.742+0000 7f782d5b9700 1 -- 172.21.15.88:0/2708254335 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f78280565b0 con 0x7f7828129560 2020-02-11T16:06:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.742+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 0x7f782805ec90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.742+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 0x7f782805ec90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.742+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 0x7f782805ec90 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.742+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 0x7f782805ec90 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782400a640 con 0x7f7828129560 2020-02-11T16:06:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f782d5b9700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 0x7f782805ec90 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4178 (secure 0 0 0) 0x7f782400a7a0 con 0x7f7828129560 2020-02-11T16:06:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 msgr2=0x7f782805ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f7816ffd700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 0x7f782805ec90 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).stop 2020-02-11T16:06:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f7816ffd700 1 -- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 msgr2=0x7f782805ec90 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f7816ffd700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7828129560 0x7f782805ec90 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0x7f7824002f30 tx=0x7f78240111e0).stop 2020-02-11T16:06:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f783001e700 1 -- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7808039b30 msgr2=0x7f780803bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f783001e700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7808039b30 0x7f780803bff0 crc :-1 s=READY pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f783001e700 1 -- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 msgr2=0x7f782812c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f783001e700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f782812c490 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f7828138c80 tx=0x7f7818011420).stop 2020-02-11T16:06:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f782e5bb700 1 -- 172.21.15.88:0/2708254335 reap_dead start 2020-02-11T16:06:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f782e5bb700 1 -- 172.21.15.88:0/2708254335 reap_dead start 2020-02-11T16:06:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f783001e700 1 -- 172.21.15.88:0/2708254335 shutdown_connections 2020-02-11T16:06:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f783001e700 1 --2- 172.21.15.88:0/2708254335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78280ad380 0x7f782812c490 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:09.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f783001e700 1 -- 172.21.15.88:0/2708254335 >> 172.21.15.88:0/2708254335 conn(0x7f782805ac70 msgr2=0x7f7828069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:09.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f783001e700 1 -- 172.21.15.88:0/2708254335 shutdown_connections 2020-02-11T16:06:09.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:09.743+0000 7f783001e700 1 -- 172.21.15.88:0/2708254335 wait complete. 2020-02-11T16:06:09.774 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:06:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:06:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 12, 2020-02-11T16:06:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:06:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:06:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:06:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:06:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:06:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:06:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:06:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:06:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:06:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:06:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:06:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:06:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:06:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:06:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:06:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:06:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:06:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:06:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:06:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:06:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:06:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:06:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:06:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:06:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:06:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:06:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:06:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:06:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:06:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:06:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:06:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:06:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:06:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:06:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:06:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:09.798 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:06:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.799 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:06:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:06:09.800 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:06:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:09.801 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:09.802 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:09.802 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:06:09.802 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:06:11.571 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:06:11.573 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:06:29.807 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:06:29.807 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:06:29.807 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:06:29.808 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:06:29.811 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:06:29.811 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:06:29.811 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:06:29.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.926+0000 7f82ff254700 1 Processor -- start 2020-02-11T16:06:29.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.926+0000 7f82ff254700 1 -- start start 2020-02-11T16:06:29.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.927+0000 7f82ff254700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 0x7f82f80a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:29.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.927+0000 7f82ff254700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:29.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.927+0000 7f82ff254700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f80a31b0 con 0x7f82f812e3a0 2020-02-11T16:06:29.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.927+0000 7f82ff254700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80a3570 con 0x7f82f80a18a0 2020-02-11T16:06:29.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.927+0000 7f82ff254700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80a3810 con 0x7f82f80a5de0 2020-02-11T16:06:29.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.927+0000 7f82fd7f1700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f82f812e3a0 0x7f82f812e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40054/0 (socket says 172.21.15.88:40054) 2020-02-11T16:06:29.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.927+0000 7f82fd7f1700 1 -- 172.21.15.88:0/782370460 learned_addr learned my addr 172.21.15.88:0/782370460 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:29.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.927+0000 7f82f7fff700 1 --2- 172.21.15.88:0/782370460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.927+0000 7f82fcff0700 1 --2- 172.21.15.88:0/782370460 >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 0x7f82f80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f7fff700 1 -- 172.21.15.88:0/782370460 >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 msgr2=0x7f82f80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:06:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f7fff700 1 --2- 172.21.15.88:0/782370460 >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 0x7f82f80a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f7fff700 1 -- 172.21.15.88:0/782370460 >> v1:172.21.15.88:6789/0 conn(0x7f82f812e3a0 legacy=0x7f82f812e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:29.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f7fff700 1 -- 172.21.15.88:0/782370460 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80a3ab0 con 0x7f82f80a5de0 2020-02-11T16:06:29.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82fcff0700 1 --2- 172.21.15.88:0/782370460 >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 0x7f82f80a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:06:29.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f7fff700 1 --2- 172.21.15.88:0/782370460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f80a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f82e4002f30 tx=0x7f82e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f7fff700 1 --2- 172.21.15.88:0/782370460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f80a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f82e4002f30 tx=0x7f82e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f7fff700 1 --2- 172.21.15.88:0/782370460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f80a6260 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f82e4002f30 tx=0x7f82e40088e0).ready entity=mon.2 client_cookie=880b202a04af213b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f7fff700 1 --2- 172.21.15.88:0/782370460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f80a6260 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f82e4002f30 tx=0x7f82e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f77fe700 1 -- 172.21.15.88:0/782370460 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82e4008e40 con 0x7f82f80a5de0 2020-02-11T16:06:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f7fff700 1 --2- 172.21.15.88:0/782370460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f80a6260 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f82e4002f30 tx=0x7f82e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f7fff700 1 --2- 172.21.15.88:0/782370460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f80a6260 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f82e4002f30 tx=0x7f82e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f77fe700 1 -- 172.21.15.88:0/782370460 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e40115f0 con 0x7f82f80a5de0 2020-02-11T16:06:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82f77fe700 1 -- 172.21.15.88:0/782370460 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82e40119d0 con 0x7f82f80a5de0 2020-02-11T16:06:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82ff254700 1 -- 172.21.15.88:0/782370460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 msgr2=0x7f82f80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.928+0000 7f82ff254700 1 --2- 172.21.15.88:0/782370460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f80a6260 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f82e4002f30 tx=0x7f82e40088e0).stop 2020-02-11T16:06:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.929+0000 7f82ff254700 1 -- 172.21.15.88:0/782370460 shutdown_connections 2020-02-11T16:06:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.929+0000 7f82ff254700 1 --2- 172.21.15.88:0/782370460 >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 0x7f82f80a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.929+0000 7f82ff254700 1 --2- 172.21.15.88:0/782370460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f80a6260 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:29.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.929+0000 7f82ff254700 1 -- 172.21.15.88:0/782370460 >> 172.21.15.88:0/782370460 conn(0x7f82f809d110 msgr2=0x7f82f809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:29.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.929+0000 7f82ff254700 1 -- 172.21.15.88:0/782370460 shutdown_connections 2020-02-11T16:06:29.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.929+0000 7f82ff254700 1 -- 172.21.15.88:0/782370460 wait complete. 2020-02-11T16:06:29.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.929+0000 7f82ff254700 1 Processor -- start 2020-02-11T16:06:29.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.930+0000 7f82ff254700 1 -- start start 2020-02-11T16:06:29.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.930+0000 7f82ff254700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 0x7f82f8134e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:29.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.930+0000 7f82ff254700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f8122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:29.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.930+0000 7f82ff254700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f81343d0 con 0x7f82f812e3a0 2020-02-11T16:06:29.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.930+0000 7f82ff254700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f8134670 con 0x7f82f80a18a0 2020-02-11T16:06:29.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.930+0000 7f82ff254700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8067100 con 0x7f82f80a5de0 2020-02-11T16:06:29.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.930+0000 7f82fcff0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 0x7f82f8134e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:29.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.930+0000 7f82fcff0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 0x7f82f8134e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38416/0 (socket says 172.21.15.88:38416) 2020-02-11T16:06:29.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.930+0000 7f82fcff0700 1 -- 172.21.15.88:0/461578209 learned_addr learned my addr 172.21.15.88:0/461578209 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:29.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82f7fff700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f8122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:29.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82fcff0700 1 -- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 msgr2=0x7f82f8122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:29.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f8122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:29.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82fcff0700 1 -- 172.21.15.88:0/461578209 >> v1:172.21.15.52:6789/0 conn(0x7f82f812e3a0 legacy=0x7f82f8123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82f5ffb700 1 -- 172.21.15.88:0/461578209 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089918820 0 0) 0x7f82f81343d0 con 0x7f82f812e3a0 2020-02-11T16:06:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82fcff0700 1 -- 172.21.15.88:0/461578209 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8135290 con 0x7f82f80a18a0 2020-02-11T16:06:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> v2:172.21.15.52:3300/0 conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82f5ffb700 1 -- 172.21.15.88:0/461578209 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82ec0075e0 con 0x7f82f80a18a0 2020-02-11T16:06:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82ff254700 1 -- 172.21.15.88:0/461578209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f8122a70 con 0x7f82f80a18a0 2020-02-11T16:06:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82f5ffb700 1 -- 172.21.15.88:0/461578209 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec005a50 con 0x7f82f80a18a0 2020-02-11T16:06:29.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82f5ffb700 1 -- 172.21.15.88:0/461578209 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82ec005e30 con 0x7f82f80a18a0 2020-02-11T16:06:29.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.931+0000 7f82ff254700 1 -- 172.21.15.88:0/461578209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f812dee0 con 0x7f82f80a18a0 2020-02-11T16:06:29.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.932+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.932+0000 7f82ff254700 1 -- 172.21.15.88:0/461578209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f8134210 con 0x7f82f80a18a0 2020-02-11T16:06:29.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.932+0000 7f82f5ffb700 1 -- 172.21.15.88:0/461578209 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f82ec010180 con 0x7f82f80a18a0 2020-02-11T16:06:29.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.932+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.932+0000 7f82f5ffb700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f82e0039b70 0x7f82e003c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:29.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.932+0000 7f82f5ffb700 1 -- 172.21.15.88:0/461578209 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f82ec049cc0 con 0x7f82f80a18a0 2020-02-11T16:06:29.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.932+0000 7f82f7fff700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f82e0039b70 0x7f82e003c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:29.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.933+0000 7f82f7fff700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f82e0039b70 0x7f82e003c030 crc :-1 s=READY pgs=111 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:29.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.936+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:29.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:29.936+0000 7f82f5ffb700 1 -- 172.21.15.88:0/461578209 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f82ec02f320 con 0x7f82f80a18a0 2020-02-11T16:06:30.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.118+0000 7f82ff254700 1 -- 172.21.15.88:0/461578209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f82f80565b0 con 0x7f82f80a18a0 2020-02-11T16:06:30.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.132+0000 7f82fcff0700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.132+0000 7f82f5ffb700 1 -- 172.21.15.88:0/461578209 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7f82ec031df0 con 0x7f82f80a18a0 2020-02-11T16:06:30.136 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:30.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 -- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f82e0039b70 msgr2=0x7f82e003c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:30.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f82e0039b70 0x7f82e003c030 crc :-1 s=READY pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:30.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 -- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 msgr2=0x7f82f8134e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:30.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 0x7f82f8134e30 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f82ec002ef0 tx=0x7f82ec010eb0).stop 2020-02-11T16:06:30.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 -- 172.21.15.88:0/461578209 shutdown_connections 2020-02-11T16:06:30.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f82e0039b70 0x7f82e003c030 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:30.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82f80a18a0 0x7f82f8134e30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:30.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 --2- 172.21.15.88:0/461578209 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82f80a5de0 0x7f82f8122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:30.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 -- 172.21.15.88:0/461578209 >> 172.21.15.88:0/461578209 conn(0x7f82f809d110 msgr2=0x7f82f80a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:30.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 -- 172.21.15.88:0/461578209 shutdown_connections 2020-02-11T16:06:30.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.134+0000 7f82ff254700 1 -- 172.21.15.88:0/461578209 wait complete. 2020-02-11T16:06:30.147 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":18,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:30.147 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:06:30.148 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:06:30.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.251+0000 7f6793590700 1 Processor -- start 2020-02-11T16:06:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.251+0000 7f6793590700 1 -- start start 2020-02-11T16:06:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6793590700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f678c0a5de0 0x7f678c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6793590700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f678c134a50 0x7f678c134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6793590700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c0a31b0 con 0x7f678c0a18a0 2020-02-11T16:06:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6793590700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678c0a3570 con 0x7f678c0a5de0 2020-02-11T16:06:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6793590700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678c0a3810 con 0x7f678c134a50 2020-02-11T16:06:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6791b2d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f678c134a50 0x7f678c134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6791b2d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f678c134a50 0x7f678c134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52444/0 (socket says 172.21.15.88:52444) 2020-02-11T16:06:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6791b2d700 1 -- 172.21.15.88:0/4257570151 learned_addr learned my addr 172.21.15.88:0/4257570151 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6791b2d700 1 -- 172.21.15.88:0/4257570151 >> v2:172.21.15.88:3300/0 conn(0x7f678c134a50 msgr2=0x7f678c134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:06:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6791b2d700 1 -- 172.21.15.88:0/4257570151 >> v2:172.21.15.88:3300/0 conn(0x7f678c134a50 msgr2=0x7f678c134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:06:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6791b2d700 1 --2- 172.21.15.88:0/4257570151 >> v2:172.21.15.88:3300/0 conn(0x7f678c134a50 0x7f678c134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:06:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6791b2d700 1 --2- 172.21.15.88:0/4257570151 >> v2:172.21.15.88:3300/0 conn(0x7f678c134a50 0x7f678c134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6790b2b700 1 --2- 172.21.15.88:0/4257570151 >> v2:172.21.15.52:3300/0 conn(0x7f678c0a5de0 0x7f678c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6790b2b700 1 -- 172.21.15.88:0/4257570151 >> v2:172.21.15.88:3300/0 conn(0x7f678c134a50 msgr2=0x7f678c134ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:06:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6790b2b700 1 --2- 172.21.15.88:0/4257570151 >> v2:172.21.15.88:3300/0 conn(0x7f678c134a50 0x7f678c134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6790b2b700 1 -- 172.21.15.88:0/4257570151 >> v1:172.21.15.52:6789/0 conn(0x7f678c0a18a0 legacy=0x7f678c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f677ffff700 1 -- 172.21.15.88:0/4257570151 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910025006 0 0) 0x7f678c0a31b0 con 0x7f678c0a18a0 2020-02-11T16:06:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6790b2b700 1 -- 172.21.15.88:0/4257570151 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c0a3ab0 con 0x7f678c0a5de0 2020-02-11T16:06:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6790b2b700 1 --2- 172.21.15.88:0/4257570151 >> v2:172.21.15.52:3300/0 conn(0x7f678c0a5de0 0x7f678c0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6780002f30 tx=0x7f6780007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6790b2b700 1 --2- 172.21.15.88:0/4257570151 >> v2:172.21.15.52:3300/0 conn(0x7f678c0a5de0 0x7f678c0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6780002f30 tx=0x7f6780007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.252+0000 7f6790b2b700 1 --2- 172.21.15.88:0/4257570151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f678c0a5de0 0x7f678c0a6260 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f6780002f30 tx=0x7f6780007a40).ready entity=mon.0 client_cookie=5989d305e8d4742d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6790b2b700 1 --2- 172.21.15.88:0/4257570151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f678c0a5de0 0x7f678c0a6260 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f6780002f30 tx=0x7f6780007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f677ffff700 1 -- 172.21.15.88:0/4257570151 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6780011470 con 0x7f678c0a5de0 2020-02-11T16:06:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6790b2b700 1 --2- 172.21.15.88:0/4257570151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f678c0a5de0 0x7f678c0a6260 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f6780002f30 tx=0x7f6780007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f677ffff700 1 -- 172.21.15.88:0/4257570151 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67800115d0 con 0x7f678c0a5de0 2020-02-11T16:06:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6790b2b700 1 --2- 172.21.15.88:0/4257570151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f678c0a5de0 0x7f678c0a6260 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f6780002f30 tx=0x7f6780007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f677ffff700 1 -- 172.21.15.88:0/4257570151 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6780011970 con 0x7f678c0a5de0 2020-02-11T16:06:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6793590700 1 -- 172.21.15.88:0/4257570151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f678c0a5de0 msgr2=0x7f678c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6793590700 1 --2- 172.21.15.88:0/4257570151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f678c0a5de0 0x7f678c0a6260 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f6780002f30 tx=0x7f6780007a40).stop 2020-02-11T16:06:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6793590700 1 -- 172.21.15.88:0/4257570151 shutdown_connections 2020-02-11T16:06:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6793590700 1 --2- 172.21.15.88:0/4257570151 >> v2:172.21.15.88:3300/0 conn(0x7f678c134a50 0x7f678c134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:30.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6793590700 1 --2- 172.21.15.88:0/4257570151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f678c0a5de0 0x7f678c0a6260 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:30.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6793590700 1 -- 172.21.15.88:0/4257570151 >> 172.21.15.88:0/4257570151 conn(0x7f678c09d110 msgr2=0x7f678c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:30.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6793590700 1 -- 172.21.15.88:0/4257570151 shutdown_connections 2020-02-11T16:06:30.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.253+0000 7f6793590700 1 -- 172.21.15.88:0/4257570151 wait complete. 2020-02-11T16:06:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.254+0000 7f6793590700 1 Processor -- start 2020-02-11T16:06:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.254+0000 7f6793590700 1 -- start start 2020-02-11T16:06:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6793590700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f678c0a18a0 0x7f678c1302f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6793590700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6793590700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c1318a0 con 0x7f678c0a5de0 2020-02-11T16:06:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6793590700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678c131690 con 0x7f678c0a18a0 2020-02-11T16:06:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6793590700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c131b40 con 0x7f678c134a50 2020-02-11T16:06:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f679132c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f678c0a18a0 0x7f678c1302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6791b2d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f679132c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f678c0a18a0 0x7f678c1302f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38432/0 (socket says 172.21.15.88:38432) 2020-02-11T16:06:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 learned_addr learned my addr 172.21.15.88:0/3060323142 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6790b2b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f678c0a5de0 0x7f678c09ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60088/0 (socket says 172.21.15.88:60088) 2020-02-11T16:06:30.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6791b2d700 1 -- 172.21.15.88:0/3060323142 >> v2:172.21.15.52:3300/0 conn(0x7f678c0a18a0 msgr2=0x7f678c1302f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:30.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6791b2d700 1 --2- 172.21.15.88:0/3060323142 >> v2:172.21.15.52:3300/0 conn(0x7f678c0a18a0 0x7f678c1302f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:30.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6791b2d700 1 -- 172.21.15.88:0/3060323142 >> v1:172.21.15.52:6789/0 conn(0x7f678c0a5de0 legacy=0x7f678c09ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:30.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6791b2d700 1 -- 172.21.15.88:0/3060323142 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c131f70 con 0x7f678c134a50 2020-02-11T16:06:30.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6791b2d700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f678c131e80 tx=0x7f6788010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6791b2d700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f678c131e80 tx=0x7f6788010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.255+0000 7f6791b2d700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f678c131e80 tx=0x7f6788010b20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f6791b2d700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f678c131e80 tx=0x7f6788010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6788005aa0 con 0x7f678c134a50 2020-02-11T16:06:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f6791b2d700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f678c131e80 tx=0x7f6788010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f6791b2d700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f678c131e80 tx=0x7f6788010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6788005c00 con 0x7f678c134a50 2020-02-11T16:06:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6788012570 con 0x7f678c134a50 2020-02-11T16:06:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f6793590700 1 -- 172.21.15.88:0/3060323142 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c132210 con 0x7f678c134a50 2020-02-11T16:06:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f6793590700 1 -- 172.21.15.88:0/3060323142 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c136020 con 0x7f678c134a50 2020-02-11T16:06:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f6791b2d700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f678c131e80 tx=0x7f6788010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6788007180 con 0x7f678c134a50 2020-02-11T16:06:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f6793590700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f6791b2d700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f678c131e80 tx=0x7f6788010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.256+0000 7f6793590700 1 -- 172.21.15.88:0/3060323142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c05e2f0 con 0x7f678c06a0b0 2020-02-11T16:06:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.257+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.257+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:06:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.257+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:06:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.257+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:06:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.257+0000 7f677e7fc700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f676c039b20 0x7f676c03bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:30.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.257+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:30.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.257+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6788049a60 con 0x7f678c134a50 2020-02-11T16:06:30.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.257+0000 7f6790b2b700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f676c039b20 0x7f676c03bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:30.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.257+0000 7f6790b2b700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f676c039b20 0x7f676c03bfe0 crc :-1 s=READY pgs=112 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:30.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.458+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:30.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.458+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:06:30.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.458+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:06:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.458+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:06:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.458+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:06:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.859+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.859+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:06:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.859+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:06:30.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.859+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:06:30.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:30.859+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:06:31.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:31.660+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:31.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:31.660+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:06:31.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:31.660+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:06:31.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:31.660+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:06:31.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:31.660+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:06:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:33.262+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:33.262+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:06:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:33.262+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:06:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:33.262+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:06:33.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:33.262+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:06:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.467+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.467+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f678c12ffa0 con 0x7f678c06a0b0 2020-02-11T16:06:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.467+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.467+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.467+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.467+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.467+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f678400ce50 con 0x7f678c06a0b0 2020-02-11T16:06:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.467+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.468+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6784012890 con 0x7f678c06a0b0 2020-02-11T16:06:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.468+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.468+0000 7f677e7fc700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).stop 2020-02-11T16:06:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.468+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 msgr2=0x7f678c09f560 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.468+0000 7f677e7fc700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c06a0b0 0x7f678c09f560 secure :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).stop 2020-02-11T16:06:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.477+0000 7f6793590700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 0x7f678c1329c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.477+0000 7f6793590700 1 -- 172.21.15.88:0/3060323142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c131c80 con 0x7f678c09f9c0 2020-02-11T16:06:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.477+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 0x7f678c1329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.477+0000 7f679132c700 1 -- 172.21.15.88:0/3060323142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f678c0565b0 con 0x7f678c09f9c0 2020-02-11T16:06:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.477+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 0x7f678c1329c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.477+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 0x7f678c1329c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.477+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 0x7f678c1329c0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.477+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 0x7f678c1329c0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.477+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67840039d0 con 0x7f678c09f9c0 2020-02-11T16:06:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f679132c700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 0x7f678c1329c0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3849 (secure 0 0 0) 0x7f6784003b30 con 0x7f678c09f9c0 2020-02-11T16:06:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 msgr2=0x7f678c1329c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f677e7fc700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 0x7f678c1329c0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f6784000f00 tx=0x7f6784011000).stop 2020-02-11T16:06:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f677e7fc700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 msgr2=0x7f678c1329c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f677e7fc700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f678c09f9c0 0x7f678c1329c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f6793590700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f676c039b20 msgr2=0x7f676c03bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f6793590700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f676c039b20 0x7f676c03bfe0 crc :-1 s=READY pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f6793590700 1 -- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 msgr2=0x7f678c135bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f6793590700 1 --2- 172.21.15.88:0/3060323142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f678c134a50 0x7f678c135bc0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f678c131e80 tx=0x7f6788010b20).stop 2020-02-11T16:06:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f6791b2d700 1 -- 172.21.15.88:0/3060323142 reap_dead start 2020-02-11T16:06:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f6791b2d700 1 -- 172.21.15.88:0/3060323142 reap_dead start 2020-02-11T16:06:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f6793590700 1 -- 172.21.15.88:0/3060323142 shutdown_connections 2020-02-11T16:06:36.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.478+0000 7f6793590700 1 -- 172.21.15.88:0/3060323142 >> 172.21.15.88:0/3060323142 conn(0x7f678c09d110 msgr2=0x7f678c05abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:36.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.479+0000 7f6793590700 1 -- 172.21.15.88:0/3060323142 shutdown_connections 2020-02-11T16:06:36.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.479+0000 7f6793590700 1 -- 172.21.15.88:0/3060323142 wait complete. 2020-02-11T16:06:36.487 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:06:36.487 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:06:36.487 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:06:36.487 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:06:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 18, 2020-02-11T16:06:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:06:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:06:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:06:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:06:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 6, 2020-02-11T16:06:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:06:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:06:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:06:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:06:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:06:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:06:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:06:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:06:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:06:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:06:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:06:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:06:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:06:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:06:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:06:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:06:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:06:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:06:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:06:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:06:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:06:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:06:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:06:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:06:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:06:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:06:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:06:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:06:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:06:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.504 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.504 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:06:36.504 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:06:36.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.504 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.504 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.504 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:36.505 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.505 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.505 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:06:36.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.505 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.505 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.505 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:36.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.506 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:06:36.507 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:06:36.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.619+0000 7fc481c09700 1 Processor -- start 2020-02-11T16:06:36.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.619+0000 7fc481c09700 1 -- start start 2020-02-11T16:06:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.620+0000 7fc481c09700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.620+0000 7fc481c09700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc47c0a6260 0x7fc47c12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.620+0000 7fc481c09700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c0a3570 con 0x7fc47c0a5de0 2020-02-11T16:06:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.620+0000 7fc481c09700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0a3810 con 0x7fc47c0a18a0 2020-02-11T16:06:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.620+0000 7fc481c09700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0a3ab0 con 0x7fc47c0a6260 2020-02-11T16:06:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.620+0000 7fc47b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.620+0000 7fc47b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52468/0 (socket says 172.21.15.88:52468) 2020-02-11T16:06:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.620+0000 7fc47b7fe700 1 -- 172.21.15.88:0/1556190882 learned_addr learned my addr 172.21.15.88:0/1556190882 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.620+0000 7fc47bfff700 1 --2- 172.21.15.88:0/1556190882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc47c0a6260 0x7fc47c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47b7fe700 1 -- 172.21.15.88:0/1556190882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc47c0a6260 msgr2=0x7fc47c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:06:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/1556190882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc47c0a6260 0x7fc47c12eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47b7fe700 1 -- 172.21.15.88:0/1556190882 >> v1:172.21.15.52:6789/0 conn(0x7fc47c0a5de0 legacy=0x7fc47c12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47b7fe700 1 -- 172.21.15.88:0/1556190882 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0a3d50 con 0x7fc47c0a18a0 2020-02-11T16:06:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/1556190882 >> v2:172.21.15.88:3300/0 conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc46c002f30 tx=0x7fc46c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/1556190882 >> v2:172.21.15.88:3300/0 conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc46c002f30 tx=0x7fc46c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/1556190882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fc46c002f30 tx=0x7fc46c0088e0).ready entity=mon.1 client_cookie=724851288a70ecad server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/1556190882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc46c002f30 tx=0x7fc46c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47a7fc700 1 -- 172.21.15.88:0/1556190882 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c0116b0 con 0x7fc47c0a18a0 2020-02-11T16:06:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/1556190882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc46c002f30 tx=0x7fc46c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/1556190882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc46c002f30 tx=0x7fc46c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47a7fc700 1 -- 172.21.15.88:0/1556190882 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c011810 con 0x7fc47c0a18a0 2020-02-11T16:06:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc47a7fc700 1 -- 172.21.15.88:0/1556190882 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c011bf0 con 0x7fc47c0a18a0 2020-02-11T16:06:36.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc481c09700 1 -- 172.21.15.88:0/1556190882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 msgr2=0x7fc47c0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc481c09700 1 --2- 172.21.15.88:0/1556190882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fc46c002f30 tx=0x7fc46c0088e0).stop 2020-02-11T16:06:36.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc481c09700 1 -- 172.21.15.88:0/1556190882 shutdown_connections 2020-02-11T16:06:36.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc481c09700 1 --2- 172.21.15.88:0/1556190882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc47c0a6260 0x7fc47c12eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:36.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc481c09700 1 --2- 172.21.15.88:0/1556190882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c0a6dd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc481c09700 1 -- 172.21.15.88:0/1556190882 >> 172.21.15.88:0/1556190882 conn(0x7fc47c09d110 msgr2=0x7fc47c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:36.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc481c09700 1 -- 172.21.15.88:0/1556190882 shutdown_connections 2020-02-11T16:06:36.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.621+0000 7fc481c09700 1 -- 172.21.15.88:0/1556190882 wait complete. 2020-02-11T16:06:36.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.622+0000 7fc481c09700 1 Processor -- start 2020-02-11T16:06:36.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.622+0000 7fc481c09700 1 -- start start 2020-02-11T16:06:36.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc481c09700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc47c0a18a0 0x7fc47c1355a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc481c09700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc47c0a6260 0x7fc47c128350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc481c09700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c132fc0 con 0x7fc47c0a5de0 2020-02-11T16:06:36.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc481c09700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c1331f0 con 0x7fc47c0a18a0 2020-02-11T16:06:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc481c09700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c133330 con 0x7fc47c0a6260 2020-02-11T16:06:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc47b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc47c0a18a0 0x7fc47c1355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc47b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc47c0a18a0 0x7fc47c1355a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52474/0 (socket says 172.21.15.88:52474) 2020-02-11T16:06:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc47b7fe700 1 -- 172.21.15.88:0/2602983031 learned_addr learned my addr 172.21.15.88:0/2602983031 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc47bfff700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc47c0a6260 0x7fc47c128350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc47b7fe700 1 -- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc47c0a6260 msgr2=0x7fc47c128350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc47c0a6260 0x7fc47c128350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc47b7fe700 1 -- 172.21.15.88:0/2602983031 >> v1:172.21.15.52:6789/0 conn(0x7fc47c0a5de0 legacy=0x7fc47c135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc47b7fe700 1 -- 172.21.15.88:0/2602983031 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c066d00 con 0x7fc47c0a18a0 2020-02-11T16:06:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc47bfff700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc47c0a6260 0x7fc47c128350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:06:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.623+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/2602983031 >> v2:172.21.15.88:3300/0 conn(0x7fc47c0a18a0 0x7fc47c1355a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc47c145240 tx=0x7fc47c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/2602983031 >> v2:172.21.15.88:3300/0 conn(0x7fc47c0a18a0 0x7fc47c1355a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc47c145240 tx=0x7fc47c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c1355a0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fc47c145240 tx=0x7fc47c0a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c1355a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc47c145240 tx=0x7fc47c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c1355a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc47c145240 tx=0x7fc47c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c011e60 con 0x7fc47c0a18a0 2020-02-11T16:06:36.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c1355a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc47c145240 tx=0x7fc47c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c007340 con 0x7fc47c0a18a0 2020-02-11T16:06:36.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc481c09700 1 -- 172.21.15.88:0/2602983031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c132ca0 con 0x7fc47c0a18a0 2020-02-11T16:06:36.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c0056c0 con 0x7fc47c0a18a0 2020-02-11T16:06:36.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc481c09700 1 -- 172.21.15.88:0/2602983031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c1334a0 con 0x7fc47c0a18a0 2020-02-11T16:06:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c1355a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc47c145240 tx=0x7fc47c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc46c005820 con 0x7fc47c0a18a0 2020-02-11T16:06:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.624+0000 7fc47b7fe700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c1355a0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc47c145240 tx=0x7fc47c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc481c09700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 0x7fc47c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc481c09700 1 -- 172.21.15.88:0/2602983031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c05e2f0 con 0x7fc47c1287b0 2020-02-11T16:06:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc478ff9700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039d30 0x7fc45c03c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc46c049fc0 con 0x7fc47c0a18a0 2020-02-11T16:06:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 0x7fc47c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc47bfff700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039d30 0x7fc45c03c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc47bfff700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039d30 0x7fc45c03c1f0 crc :-1 s=READY pgs=113 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc47affd700 1 -- 172.21.15.88:0/2602983031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc47c0565b0 con 0x7fc47c1287b0 2020-02-11T16:06:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 0x7fc47c0a4d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 0x7fc47c0a4d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 0x7fc47c0a4d10 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 0x7fc47c0a4d10 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.625+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc47000cd10 con 0x7fc47c1287b0 2020-02-11T16:06:36.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.626+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 0x7fc47c0a4d10 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.626+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fc47000ce70 con 0x7fc47c1287b0 2020-02-11T16:06:36.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.626+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 msgr2=0x7fc47c0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.626+0000 7fc478ff9700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 0x7fc47c0a4d10 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).stop 2020-02-11T16:06:36.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.626+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 msgr2=0x7fc47c0a4d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:36.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.626+0000 7fc478ff9700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c1287b0 0x7fc47c0a4d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.634+0000 7fc481c09700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 0x7fc47c129570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.634+0000 7fc481c09700 1 -- 172.21.15.88:0/2602983031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0a7980 con 0x7fc47c129160 2020-02-11T16:06:36.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.634+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 0x7fc47c129570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.634+0000 7fc47affd700 1 -- 172.21.15.88:0/2602983031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc47c05ccb0 con 0x7fc47c129160 2020-02-11T16:06:36.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.634+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 0x7fc47c129570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.634+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 0x7fc47c129570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.634+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 0x7fc47c129570 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.634+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 0x7fc47c129570 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.634+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc47000ee60 con 0x7fc47c129160 2020-02-11T16:06:36.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc47affd700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 0x7fc47c129570 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7fc47000b380 con 0x7fc47c129160 2020-02-11T16:06:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 msgr2=0x7fc47c129570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc478ff9700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 0x7fc47c129570 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fc47c05b270 tx=0x7fc4700023d0).stop 2020-02-11T16:06:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc478ff9700 1 -- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 msgr2=0x7fc47c129570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:36.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc478ff9700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc47c129160 0x7fc47c129570 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc481c09700 1 -- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039d30 msgr2=0x7fc45c03c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc481c09700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039d30 0x7fc45c03c1f0 crc :-1 s=READY pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc481c09700 1 -- 172.21.15.88:0/2602983031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 msgr2=0x7fc47c1355a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc481c09700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c1355a0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fc47c145240 tx=0x7fc47c0a1c80).stop 2020-02-11T16:06:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc47bfff700 1 -- 172.21.15.88:0/2602983031 reap_dead start 2020-02-11T16:06:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc47bfff700 1 -- 172.21.15.88:0/2602983031 reap_dead start 2020-02-11T16:06:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc481c09700 1 -- 172.21.15.88:0/2602983031 shutdown_connections 2020-02-11T16:06:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc481c09700 1 --2- 172.21.15.88:0/2602983031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47c0a18a0 0x7fc47c1355a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc481c09700 1 -- 172.21.15.88:0/2602983031 >> 172.21.15.88:0/2602983031 conn(0x7fc47c09d110 msgr2=0x7fc47c0a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc481c09700 1 -- 172.21.15.88:0/2602983031 shutdown_connections 2020-02-11T16:06:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.635+0000 7fc481c09700 1 -- 172.21.15.88:0/2602983031 wait complete. 2020-02-11T16:06:36.650 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:06:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:06:36.650 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 18, 2020-02-11T16:06:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:06:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:06:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:06:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:06:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 6, 2020-02-11T16:06:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:06:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:06:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:36.652 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:06:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:06:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:36.653 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:06:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:06:36.654 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:06:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:06:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:06:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:06:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:06:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:06:36.655 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:06:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:36.656 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:06:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:06:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:36.657 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:06:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:06:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:06:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:06:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:06:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:06:36.660 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:06:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:06:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.662 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:06:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:06:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:36.663 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:06:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:06:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:06:36.665 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:06:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:06:36.666 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:06:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:06:36.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:06:36.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:06:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:06:36.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:06:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:06:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.670 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:06:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.671 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.671 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:06:36.672 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:06:36.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.776+0000 7ff487de0700 1 Processor -- start 2020-02-11T16:06:36.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.776+0000 7ff487de0700 1 -- start start 2020-02-11T16:06:36.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.777+0000 7ff487de0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff4800ad380 0x7ff4800a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:36.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.777+0000 7ff487de0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48013bfe0 con 0x7ff480138710 2020-02-11T16:06:36.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.777+0000 7ff487de0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4800adb40 con 0x7ff480138280 2020-02-11T16:06:36.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.777+0000 7ff487de0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff480137bf0 con 0x7ff4800ad380 2020-02-11T16:06:36.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.777+0000 7ff485b7c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff4800ad380 0x7ff4800a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.777+0000 7ff48537b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff480138280 0x7ff48013b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40112/0 (socket says 172.21.15.88:40112) 2020-02-11T16:06:36.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.777+0000 7ff48537b700 1 -- 172.21.15.88:0/1992974423 learned_addr learned my addr 172.21.15.88:0/1992974423 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:36.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff485b7c700 1 -- 172.21.15.88:0/1992974423 >> v1:172.21.15.88:6789/0 conn(0x7ff480138280 legacy=0x7ff48013b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff485b7c700 1 -- 172.21.15.88:0/1992974423 >> v1:172.21.15.52:6789/0 conn(0x7ff480138710 legacy=0x7ff48013b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff485b7c700 1 -- 172.21.15.88:0/1992974423 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480137de0 con 0x7ff4800ad380 2020-02-11T16:06:36.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1992974423 >> v2:172.21.15.88:3300/0 conn(0x7ff4800ad380 0x7ff4800a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff470002f30 tx=0x7ff4700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1992974423 >> v2:172.21.15.88:3300/0 conn(0x7ff4800ad380 0x7ff4800a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff470002f30 tx=0x7ff4700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1992974423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4800ad380 0x7ff4800a9130 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff4700088e0).ready entity=mon.1 client_cookie=e77261716ef0feda server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1992974423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4800ad380 0x7ff4800a9130 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff4700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff484b7a700 1 -- 172.21.15.88:0/1992974423 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff470008e40 con 0x7ff4800ad380 2020-02-11T16:06:36.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1992974423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4800ad380 0x7ff4800a9130 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff4700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1992974423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4800ad380 0x7ff4800a9130 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff4700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff484b7a700 1 -- 172.21.15.88:0/1992974423 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4700116a0 con 0x7ff4800ad380 2020-02-11T16:06:36.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff484b7a700 1 -- 172.21.15.88:0/1992974423 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff470011a80 con 0x7ff4800ad380 2020-02-11T16:06:36.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff487de0700 1 -- 172.21.15.88:0/1992974423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4800ad380 msgr2=0x7ff4800a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff487de0700 1 --2- 172.21.15.88:0/1992974423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4800ad380 0x7ff4800a9130 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff4700088e0).stop 2020-02-11T16:06:36.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff487de0700 1 -- 172.21.15.88:0/1992974423 shutdown_connections 2020-02-11T16:06:36.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff487de0700 1 --2- 172.21.15.88:0/1992974423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4800ad380 0x7ff4800a9130 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff487de0700 1 -- 172.21.15.88:0/1992974423 >> 172.21.15.88:0/1992974423 conn(0x7ff48005ac70 msgr2=0x7ff4800ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:36.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff487de0700 1 -- 172.21.15.88:0/1992974423 shutdown_connections 2020-02-11T16:06:36.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.778+0000 7ff487de0700 1 -- 172.21.15.88:0/1992974423 wait complete. 2020-02-11T16:06:36.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.779+0000 7ff487de0700 1 Processor -- start 2020-02-11T16:06:36.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.779+0000 7ff487de0700 1 -- start start 2020-02-11T16:06:36.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff487de0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4800ad380 0x7ff480134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff487de0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480138710 0x7ff4800a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff487de0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff480148b40 con 0x7ff480138280 2020-02-11T16:06:36.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff487de0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff480132d30 con 0x7ff4800ad380 2020-02-11T16:06:36.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff487de0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff480132fd0 con 0x7ff480138710 2020-02-11T16:06:36.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff485b7c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4800ad380 0x7ff480134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff48537b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff480138280 0x7ff480148430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60132/0 (socket says 172.21.15.88:60132) 2020-02-11T16:06:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff485b7c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4800ad380 0x7ff480134390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38476/0 (socket says 172.21.15.88:38476) 2020-02-11T16:06:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff48537b700 1 -- 172.21.15.88:0/1563664848 learned_addr learned my addr 172.21.15.88:0/1563664848 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff48637d700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480138710 0x7ff4800a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff485b7c700 1 -- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480138710 msgr2=0x7ff4800a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480138710 0x7ff4800a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff485b7c700 1 -- 172.21.15.88:0/1563664848 >> v1:172.21.15.52:6789/0 conn(0x7ff480138280 legacy=0x7ff480148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff485b7c700 1 -- 172.21.15.88:0/1563664848 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480133270 con 0x7ff4800ad380 2020-02-11T16:06:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380070142 0 0) 0x7ff480148b40 con 0x7ff480138280 2020-02-11T16:06:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.780+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1563664848 >> v2:172.21.15.52:3300/0 conn(0x7ff4800ad380 0x7ff480134390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff470011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1563664848 >> v2:172.21.15.52:3300/0 conn(0x7ff4800ad380 0x7ff480134390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff470011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4800ad380 0x7ff480134390 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff470011450).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4800ad380 0x7ff480134390 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff470011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff470007150 con 0x7ff4800ad380 2020-02-11T16:06:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4800ad380 0x7ff480134390 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff470011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4700072b0 con 0x7ff4800ad380 2020-02-11T16:06:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff487de0700 1 -- 172.21.15.88:0/1563664848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff480133510 con 0x7ff4800ad380 2020-02-11T16:06:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4800ad380 0x7ff480134390 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff470011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4700056c0 con 0x7ff4800ad380 2020-02-11T16:06:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff487de0700 1 -- 172.21.15.88:0/1563664848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4801378d0 con 0x7ff4800ad380 2020-02-11T16:06:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.781+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4800ad380 0x7ff480134390 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff470011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff487de0700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 0x7ff48005ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff487de0700 1 -- 172.21.15.88:0/1563664848 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48005e2f0 con 0x7ff4800a8560 2020-02-11T16:06:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff4700058c0 con 0x7ff4800ad380 2020-02-11T16:06:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff485b7c700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4800ad380 0x7ff480134390 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff470011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 0x7ff48005ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff46effd700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff460039c50 0x7ff46003c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7ff47004a2d0 con 0x7ff4800ad380 2020-02-11T16:06:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff48637d700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff460039c50 0x7ff46003c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff48537b700 1 -- 172.21.15.88:0/1563664848 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4801336a0 con 0x7ff4800a8560 2020-02-11T16:06:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 0x7ff48005ec20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 0x7ff48005ec20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.782+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 0x7ff48005ec20 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.783+0000 7ff48637d700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff460039c50 0x7ff46003c110 crc :-1 s=READY pgs=114 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.783+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 0x7ff48005ec20 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.783+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47c00c740 con 0x7ff4800a8560 2020-02-11T16:06:36.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.783+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 0x7ff48005ec20 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.783+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff47c00c8a0 con 0x7ff4800a8560 2020-02-11T16:06:36.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.783+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 msgr2=0x7ff48005ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.783+0000 7ff46effd700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 0x7ff48005ec20 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).stop 2020-02-11T16:06:36.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.783+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 msgr2=0x7ff48005ec20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:36.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.783+0000 7ff46effd700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4800a8560 0x7ff48005ec20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.791+0000 7ff487de0700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 0x7ff480135f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.791+0000 7ff487de0700 1 -- 172.21.15.88:0/1563664848 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff480132e70 con 0x7ff480135b60 2020-02-11T16:06:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.791+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 0x7ff480135f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.791+0000 7ff48537b700 1 -- 172.21.15.88:0/1563664848 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff4800565b0 con 0x7ff480135b60 2020-02-11T16:06:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.791+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 0x7ff480135f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 0x7ff480135f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 0x7ff480135f40 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 0x7ff480135f40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47c00b920 con 0x7ff480135b60 2020-02-11T16:06:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff48537b700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 0x7ff480135f40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4189 (secure 0 0 0) 0x7ff47c0174c0 con 0x7ff480135b60 2020-02-11T16:06:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 msgr2=0x7ff480135f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff46effd700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 0x7ff480135f40 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7ff47c005500 tx=0x7ff47c010b80).stop 2020-02-11T16:06:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff46effd700 1 -- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 msgr2=0x7ff480135f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff46effd700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff480135b60 0x7ff480135f40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff487de0700 1 -- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff460039c50 msgr2=0x7ff46003c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff487de0700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff460039c50 0x7ff46003c110 crc :-1 s=READY pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff487de0700 1 -- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4800ad380 msgr2=0x7ff480134390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff487de0700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4800ad380 0x7ff480134390 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7ff470002f30 tx=0x7ff470011450).stop 2020-02-11T16:06:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff48637d700 1 -- 172.21.15.88:0/1563664848 reap_dead start 2020-02-11T16:06:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff48637d700 1 -- 172.21.15.88:0/1563664848 reap_dead start 2020-02-11T16:06:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff487de0700 1 -- 172.21.15.88:0/1563664848 shutdown_connections 2020-02-11T16:06:36.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff487de0700 1 --2- 172.21.15.88:0/1563664848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4800ad380 0x7ff480134390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff487de0700 1 -- 172.21.15.88:0/1563664848 >> 172.21.15.88:0/1563664848 conn(0x7ff48005ac70 msgr2=0x7ff480069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:36.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff487de0700 1 -- 172.21.15.88:0/1563664848 shutdown_connections 2020-02-11T16:06:36.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.792+0000 7ff487de0700 1 -- 172.21.15.88:0/1563664848 wait complete. 2020-02-11T16:06:36.809 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:06:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:36.810 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:36.810 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:06:36.811 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 18, 2020-02-11T16:06:36.811 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:06:36.811 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:06:36.811 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:06:36.811 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:06:36.811 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.811 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 6, 2020-02-11T16:06:36.812 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:36.812 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:06:36.812 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:06:36.812 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:36.812 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:36.812 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:36.812 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:36.813 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:36.813 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:36.813 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.813 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:06:36.813 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:06:36.813 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:36.813 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:36.814 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:36.814 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:36.814 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:36.814 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:36.814 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.814 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:06:36.814 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:06:36.815 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:06:36.815 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:06:36.815 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:06:36.815 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:06:36.815 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:36.815 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:36.815 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:06:36.816 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:06:36.816 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:36.816 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:06:36.816 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:36.816 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:36.816 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:36.816 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:36.817 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:36.817 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:36.817 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.817 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:06:36.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.817 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:06:36.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.818 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:36.818 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:36.818 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:36.818 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:36.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.819 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:36.819 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:06:36.819 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.819 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:36.819 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:06:36.820 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.820 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.820 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.820 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:06:36.820 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:06:36.820 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:36.821 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:36.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.821 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:06:36.821 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:06:36.821 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:36.821 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:36.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.822 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:36.822 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:06:36.822 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.822 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:36.823 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:06:36.824 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.824 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.824 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.825 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:06:36.825 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:06:36.825 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:36.825 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:36.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.826 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:36.826 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:36.826 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:36.826 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:36.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.826 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:36.826 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:06:36.826 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.827 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:36.827 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:06:36.827 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:36.827 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.827 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.828 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:06:36.828 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:06:36.828 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:36.828 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:36.828 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.828 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:36.829 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:06:36.829 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:06:36.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.829 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.829 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.829 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:36.831 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.831 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.831 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:06:36.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.831 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.832 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.832 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:36.832 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.832 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.832 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:06:36.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.832 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.832 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.833 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:06:36.833 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.833 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:36.833 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:06:36.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:36.833 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:36.833 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:36.834 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:06:36.834 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.834 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:36.834 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:36.834 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:06:36.835 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:06:36.835 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:06:36.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.939+0000 7fdfca1be700 1 Processor -- start 2020-02-11T16:06:36.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.939+0000 7fdfca1be700 1 -- start start 2020-02-11T16:06:36.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.940+0000 7fdfca1be700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:36.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.940+0000 7fdfca1be700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfc40a5de0 0x7fdfc40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:36.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.940+0000 7fdfca1be700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40a31b0 con 0x7fdfc412e3a0 2020-02-11T16:06:36.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.940+0000 7fdfca1be700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc40a3570 con 0x7fdfc40a18a0 2020-02-11T16:06:36.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.940+0000 7fdfca1be700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40a3810 con 0x7fdfc40a5de0 2020-02-11T16:06:36.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.940+0000 7fdfc37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.940+0000 7fdfc37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52502/0 (socket says 172.21.15.88:52502) 2020-02-11T16:06:36.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.940+0000 7fdfc37fe700 1 -- 172.21.15.88:0/1259025438 learned_addr learned my addr 172.21.15.88:0/1259025438 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:36.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc37fe700 1 -- 172.21.15.88:0/1259025438 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfc40a5de0 msgr2=0x7fdfc40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:06:36.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/1259025438 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfc40a5de0 0x7fdfc40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc37fe700 1 --2- 172.21.15.88:0/1259025438 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfc40a5de0 0x7fdfc40a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:36.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc37fe700 1 -- 172.21.15.88:0/1259025438 >> v1:172.21.15.52:6789/0 conn(0x7fdfc412e3a0 legacy=0x7fdfc412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:06:36.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc37fe700 1 -- 172.21.15.88:0/1259025438 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40a3ab0 con 0x7fdfc40a18a0 2020-02-11T16:06:36.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc37fe700 1 --2- 172.21.15.88:0/1259025438 >> v2:172.21.15.88:3300/0 conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdfc405b910 tx=0x7fdfb40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc37fe700 1 --2- 172.21.15.88:0/1259025438 >> v2:172.21.15.88:3300/0 conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdfc405b910 tx=0x7fdfb40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc37fe700 1 --2- 172.21.15.88:0/1259025438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fdfc405b910 tx=0x7fdfb40088e0).ready entity=mon.1 client_cookie=b3a18a9916a120ac server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc37fe700 1 --2- 172.21.15.88:0/1259025438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fdfc405b910 tx=0x7fdfb40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc27fc700 1 -- 172.21.15.88:0/1259025438 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb4011720 con 0x7fdfc40a18a0 2020-02-11T16:06:36.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc37fe700 1 --2- 172.21.15.88:0/1259025438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fdfc405b910 tx=0x7fdfb40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc37fe700 1 --2- 172.21.15.88:0/1259025438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fdfc405b910 tx=0x7fdfb40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc27fc700 1 -- 172.21.15.88:0/1259025438 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4011880 con 0x7fdfc40a18a0 2020-02-11T16:06:36.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfc27fc700 1 -- 172.21.15.88:0/1259025438 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb4011c20 con 0x7fdfc40a18a0 2020-02-11T16:06:36.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfca1be700 1 -- 172.21.15.88:0/1259025438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a18a0 msgr2=0x7fdfc40a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfca1be700 1 --2- 172.21.15.88:0/1259025438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fdfc405b910 tx=0x7fdfb40088e0).stop 2020-02-11T16:06:36.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfca1be700 1 -- 172.21.15.88:0/1259025438 shutdown_connections 2020-02-11T16:06:36.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfca1be700 1 --2- 172.21.15.88:0/1259025438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a18a0 0x7fdfc40a6dd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfca1be700 1 --2- 172.21.15.88:0/1259025438 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfc40a5de0 0x7fdfc40a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:36.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfca1be700 1 -- 172.21.15.88:0/1259025438 >> 172.21.15.88:0/1259025438 conn(0x7fdfc409d110 msgr2=0x7fdfc409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:36.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfca1be700 1 -- 172.21.15.88:0/1259025438 shutdown_connections 2020-02-11T16:06:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.941+0000 7fdfca1be700 1 -- 172.21.15.88:0/1259025438 wait complete. 2020-02-11T16:06:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.942+0000 7fdfca1be700 1 Processor -- start 2020-02-11T16:06:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.942+0000 7fdfca1be700 1 -- start start 2020-02-11T16:06:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfca1be700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdfc40a5de0 0x7fdfc4122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfca1be700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfc412e3a0 0x7fdfc41232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfca1be700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40a9120 con 0x7fdfc40a18a0 2020-02-11T16:06:36.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfca1be700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc406a280 con 0x7fdfc40a5de0 2020-02-11T16:06:36.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfca1be700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4136a10 con 0x7fdfc412e3a0 2020-02-11T16:06:36.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc2ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdfc40a5de0 0x7fdfc4122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc2ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdfc40a5de0 0x7fdfc4122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52510/0 (socket says 172.21.15.88:52510) 2020-02-11T16:06:36.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc2ffd700 1 -- 172.21.15.88:0/377269095 learned_addr learned my addr 172.21.15.88:0/377269095 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:36.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc3fff700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfc412e3a0 0x7fdfc41232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc2ffd700 1 -- 172.21.15.88:0/377269095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfc412e3a0 msgr2=0x7fdfc41232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfc412e3a0 0x7fdfc41232a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:36.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc2ffd700 1 -- 172.21.15.88:0/377269095 >> v1:172.21.15.52:6789/0 conn(0x7fdfc40a18a0 legacy=0x7fdfc4134ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:36.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc2ffd700 1 -- 172.21.15.88:0/377269095 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4130560 con 0x7fdfc40a5de0 2020-02-11T16:06:36.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> v2:172.21.15.88:3300/0 conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> v2:172.21.15.88:3300/0 conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.943+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.944+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.944+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.944+0000 7fdfc0ff9700 1 -- 172.21.15.88:0/377269095 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb800a350 con 0x7fdfc40a5de0 2020-02-11T16:06:36.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.944+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.944+0000 7fdfc0ff9700 1 -- 172.21.15.88:0/377269095 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb800a4f0 con 0x7fdfc40a5de0 2020-02-11T16:06:36.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.944+0000 7fdfc0ff9700 1 -- 172.21.15.88:0/377269095 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb800a910 con 0x7fdfc40a5de0 2020-02-11T16:06:36.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.944+0000 7fdfca1be700 1 -- 172.21.15.88:0/377269095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc4135bc0 con 0x7fdfc40a5de0 2020-02-11T16:06:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.944+0000 7fdfca1be700 1 -- 172.21.15.88:0/377269095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc4130fb0 con 0x7fdfc40a5de0 2020-02-11T16:06:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.944+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.945+0000 7fdfc0ff9700 1 -- 172.21.15.88:0/377269095 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdfb800ab80 con 0x7fdfc40a5de0 2020-02-11T16:06:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.945+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.945+0000 7fdfca1be700 1 -- 172.21.15.88:0/377269095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc41306f0 con 0x7fdfc40a5de0 2020-02-11T16:06:36.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.945+0000 7fdfc0ff9700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdfa4039c70 0x7fdfa403c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:36.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.945+0000 7fdfc0ff9700 1 -- 172.21.15.88:0/377269095 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fdfb8049920 con 0x7fdfc40a5de0 2020-02-11T16:06:36.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.945+0000 7fdfc37fe700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdfa4039c70 0x7fdfa403c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:36.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.945+0000 7fdfc37fe700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdfa4039c70 0x7fdfa403c130 crc :-1 s=READY pgs=115 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:36.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.948+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:36.948+0000 7fdfc0ff9700 1 -- 172.21.15.88:0/377269095 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fdfb802ef00 con 0x7fdfc40a5de0 2020-02-11T16:06:37.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.132+0000 7fdfca1be700 1 -- 172.21.15.88:0/377269095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fdfc40565b0 con 0x7fdfc40a5de0 2020-02-11T16:06:37.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.134+0000 7fdfc2ffd700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:37.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.134+0000 7fdfc0ff9700 1 -- 172.21.15.88:0/377269095 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fdfb8031a10 con 0x7fdfc40a5de0 2020-02-11T16:06:37.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 -- 172.21.15.88:0/377269095 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdfa4039c70 msgr2=0x7fdfa403c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:37.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdfa4039c70 0x7fdfa403c130 crc :-1 s=READY pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:37.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 -- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 msgr2=0x7fdfc4122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:37.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 0x7fdfc4122e40 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fdfb8002f30 tx=0x7fdfb8010ab0).stop 2020-02-11T16:06:37.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 -- 172.21.15.88:0/377269095 shutdown_connections 2020-02-11T16:06:37.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdfa4039c70 0x7fdfa403c130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:37.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfc412e3a0 0x7fdfc41232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:37.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 --2- 172.21.15.88:0/377269095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc40a5de0 0x7fdfc4122e40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:37.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 -- 172.21.15.88:0/377269095 >> 172.21.15.88:0/377269095 conn(0x7fdfc409d110 msgr2=0x7fdfc40a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:37.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 -- 172.21.15.88:0/377269095 shutdown_connections 2020-02-11T16:06:37.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:37.136+0000 7fdfca1be700 1 -- 172.21.15.88:0/377269095 wait complete. 2020-02-11T16:06:37.148 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:06:41.676 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:06:41.681 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:06:47.148 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:06:47.149 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:06:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.262+0000 7fee0949b700 1 Processor -- start 2020-02-11T16:06:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.262+0000 7fee0949b700 1 -- start start 2020-02-11T16:06:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.263+0000 7fee0949b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a5de0 0x7fee040a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.263+0000 7fee0949b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fee04134a50 0x7fee04134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.263+0000 7fee0949b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee040a31b0 con 0x7fee040a18a0 2020-02-11T16:06:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.263+0000 7fee0949b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee040a3570 con 0x7fee04134a50 2020-02-11T16:06:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.263+0000 7fee0949b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee040a3810 con 0x7fee040a5de0 2020-02-11T16:06:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fee04134a50 0x7fee04134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee027fc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a5de0 0x7fee040a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee02ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fee040a18a0 0x7fee040a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60156/0 (socket says 172.21.15.88:60156) 2020-02-11T16:06:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fee04134a50 0x7fee04134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:38506/0 (socket says 172.21.15.88:38506) 2020-02-11T16:06:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee02ffd700 1 -- 172.21.15.88:0/417614176 learned_addr learned my addr 172.21.15.88:0/417614176 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee027fc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a5de0 0x7fee040a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:46842/0 (socket says 172.21.15.88:46842) 2020-02-11T16:06:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee01ffb700 1 -- 172.21.15.88:0/417614176 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243440829 0 0) 0x7fee040a31b0 con 0x7fee040a18a0 2020-02-11T16:06:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee01ffb700 1 -- 172.21.15.88:0/417614176 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fede8003230 con 0x7fee040a18a0 2020-02-11T16:06:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 -- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a5de0 msgr2=0x7fee040a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:06:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 --2- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a5de0 0x7fee040a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 -- 172.21.15.88:0/417614176 >> v1:172.21.15.52:6789/0 conn(0x7fee040a18a0 legacy=0x7fee040a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 -- 172.21.15.88:0/417614176 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee040a3ab0 con 0x7fee04134a50 2020-02-11T16:06:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee027fc700 1 --2- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a5de0 0x7fee040a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:06:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 --2- 172.21.15.88:0/417614176 >> v2:172.21.15.52:3300/0 conn(0x7fee04134a50 0x7fee04134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee040a5cc0 tx=0x7fedfc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 --2- 172.21.15.88:0/417614176 >> v2:172.21.15.52:3300/0 conn(0x7fee04134a50 0x7fee04134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee040a5cc0 tx=0x7fedfc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 --2- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee04134a50 0x7fee04134ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7fee040a5cc0 tx=0x7fedfc008c60).ready entity=mon.0 client_cookie=3b7650eb3b9ca6de server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 --2- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee04134a50 0x7fee04134ee0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fee040a5cc0 tx=0x7fedfc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee01ffb700 1 -- 172.21.15.88:0/417614176 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedfc011d70 con 0x7fee04134a50 2020-02-11T16:06:47.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.264+0000 7fee037fe700 1 --2- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee04134a50 0x7fee04134ee0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fee040a5cc0 tx=0x7fedfc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee01ffb700 1 -- 172.21.15.88:0/417614176 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc00a160 con 0x7fee04134a50 2020-02-11T16:06:47.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee037fe700 1 --2- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee04134a50 0x7fee04134ee0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fee040a5cc0 tx=0x7fedfc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee01ffb700 1 -- 172.21.15.88:0/417614176 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedfc00a500 con 0x7fee04134a50 2020-02-11T16:06:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee0949b700 1 -- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee04134a50 msgr2=0x7fee04134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee0949b700 1 --2- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee04134a50 0x7fee04134ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7fee040a5cc0 tx=0x7fedfc008c60).stop 2020-02-11T16:06:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee0949b700 1 -- 172.21.15.88:0/417614176 shutdown_connections 2020-02-11T16:06:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee0949b700 1 --2- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee04134a50 0x7fee04134ee0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee0949b700 1 --2- 172.21.15.88:0/417614176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a5de0 0x7fee040a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee0949b700 1 -- 172.21.15.88:0/417614176 >> 172.21.15.88:0/417614176 conn(0x7fee0409d110 msgr2=0x7fee0409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee0949b700 1 -- 172.21.15.88:0/417614176 shutdown_connections 2020-02-11T16:06:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.265+0000 7fee0949b700 1 -- 172.21.15.88:0/417614176 wait complete. 2020-02-11T16:06:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.266+0000 7fee0949b700 1 Processor -- start 2020-02-11T16:06:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.266+0000 7fee0949b700 1 -- start start 2020-02-11T16:06:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee0949b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a18a0 0x7fee0412ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee0949b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee04134a50 0x7fee04130a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee0949b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee04130e90 con 0x7fee040a5de0 2020-02-11T16:06:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee0949b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee041310a0 con 0x7fee04134a50 2020-02-11T16:06:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee0949b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0412a5c0 con 0x7fee040a18a0 2020-02-11T16:06:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee04134a50 0x7fee04130a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee027fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fee040a5de0 0x7fee04129eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40150/0 (socket says 172.21.15.88:40150) 2020-02-11T16:06:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee02ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a18a0 0x7fee0412ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee04134a50 0x7fee04130a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52526/0 (socket says 172.21.15.88:52526) 2020-02-11T16:06:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee027fc700 1 -- 172.21.15.88:0/2644984103 learned_addr learned my addr 172.21.15.88:0/2644984103 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 -- 172.21.15.88:0/2644984103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a18a0 msgr2=0x7fee0412ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a18a0 0x7fee0412ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 -- 172.21.15.88:0/2644984103 >> v1:172.21.15.88:6789/0 conn(0x7fee040a5de0 legacy=0x7fee04129eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fedf3fff700 1 -- 172.21.15.88:0/2644984103 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477240388 0 0) 0x7fedf4008360 con 0x7fee040a5de0 2020-02-11T16:06:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 -- 172.21.15.88:0/2644984103 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0412d110 con 0x7fee04134a50 2020-02-11T16:06:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> v2:172.21.15.88:3300/0 conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> v2:172.21.15.88:3300/0 conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fedf3fff700 1 -- 172.21.15.88:0/2644984103 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedfc005c30 con 0x7fee04134a50 2020-02-11T16:06:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fedf3fff700 1 -- 172.21.15.88:0/2644984103 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc005dd0 con 0x7fee04134a50 2020-02-11T16:06:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee0949b700 1 -- 172.21.15.88:0/2644984103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0412c730 con 0x7fee04134a50 2020-02-11T16:06:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fedf3fff700 1 -- 172.21.15.88:0/2644984103 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedfc007340 con 0x7fee04134a50 2020-02-11T16:06:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.267+0000 7fee0949b700 1 -- 172.21.15.88:0/2644984103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0412cc70 con 0x7fee04134a50 2020-02-11T16:06:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.268+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.268+0000 7fedf3fff700 1 -- 172.21.15.88:0/2644984103 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fedfc008420 con 0x7fee04134a50 2020-02-11T16:06:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.268+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.268+0000 7fee0949b700 1 -- 172.21.15.88:0/2644984103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee040565b0 con 0x7fee04134a50 2020-02-11T16:06:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.268+0000 7fedf3fff700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039ac0 0x7fede003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.268+0000 7fedf3fff700 1 -- 172.21.15.88:0/2644984103 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fedfc04a430 con 0x7fee04134a50 2020-02-11T16:06:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.269+0000 7fee02ffd700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039ac0 0x7fede003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.269+0000 7fee02ffd700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039ac0 0x7fede003bf80 crc :-1 s=READY pgs=116 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.272+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.272+0000 7fedf3fff700 1 -- 172.21.15.88:0/2644984103 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fedfc02fb90 con 0x7fee04134a50 2020-02-11T16:06:47.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.453+0000 7fee0949b700 1 -- 172.21.15.88:0/2644984103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fee0412ce00 con 0x7fee04134a50 2020-02-11T16:06:47.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.454+0000 7fee037fe700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.454+0000 7fedf3fff700 1 -- 172.21.15.88:0/2644984103 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fedfc0325c0 con 0x7fee04134a50 2020-02-11T16:06:47.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 -- 172.21.15.88:0/2644984103 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039ac0 msgr2=0x7fede003bf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039ac0 0x7fede003bf80 crc :-1 s=READY pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 -- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 msgr2=0x7fee04130a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 0x7fee04130a30 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fee04130830 tx=0x7fee0412f3b0).stop 2020-02-11T16:06:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 -- 172.21.15.88:0/2644984103 shutdown_connections 2020-02-11T16:06:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039ac0 0x7fede003bf80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee04134a50 0x7fee04130a30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 --2- 172.21.15.88:0/2644984103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee040a18a0 0x7fee0412ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 -- 172.21.15.88:0/2644984103 >> 172.21.15.88:0/2644984103 conn(0x7fee0409d110 msgr2=0x7fee04069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:47.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 -- 172.21.15.88:0/2644984103 shutdown_connections 2020-02-11T16:06:47.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.455+0000 7fee0949b700 1 -- 172.21.15.88:0/2644984103 wait complete. 2020-02-11T16:06:47.459 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:47.470 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":18,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:47.470 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:06:47.471 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:06:47.471 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:06:47.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.574+0000 7f6ebb5f4700 1 Processor -- start 2020-02-11T16:06:47.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.574+0000 7f6ebb5f4700 1 -- start start 2020-02-11T16:06:47.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.575+0000 7f6ebb5f4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:47.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.575+0000 7f6ebb5f4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6eb40a6260 0x7f6eb412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:47.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.575+0000 7f6ebb5f4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40a3570 con 0x7f6eb40a5de0 2020-02-11T16:06:47.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.575+0000 7f6ebb5f4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb40a3810 con 0x7f6eb40a6260 2020-02-11T16:06:47.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.575+0000 7f6ebb5f4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb40a3ab0 con 0x7f6eb40a18a0 2020-02-11T16:06:47.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.575+0000 7f6eb9390700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.575+0000 7f6eb9390700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52534/0 (socket says 172.21.15.88:52534) 2020-02-11T16:06:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.575+0000 7f6eb9390700 1 -- 172.21.15.88:0/2573525896 learned_addr learned my addr 172.21.15.88:0/2573525896 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.575+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/2573525896 >> v2:172.21.15.52:3300/0 conn(0x7f6eb40a6260 0x7f6eb412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6eb9390700 1 -- 172.21.15.88:0/2573525896 >> v2:172.21.15.52:3300/0 conn(0x7f6eb40a6260 msgr2=0x7f6eb412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:06:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6eb9390700 1 --2- 172.21.15.88:0/2573525896 >> v2:172.21.15.52:3300/0 conn(0x7f6eb40a6260 0x7f6eb412eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6eb9390700 1 -- 172.21.15.88:0/2573525896 >> v1:172.21.15.52:6789/0 conn(0x7f6eb40a5de0 legacy=0x7f6eb412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:06:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6eb9390700 1 -- 172.21.15.88:0/2573525896 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40a3d50 con 0x7f6eb40a18a0 2020-02-11T16:06:47.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6eb9390700 1 --2- 172.21.15.88:0/2573525896 >> v2:172.21.15.88:3300/0 conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6eb405bbc0 tx=0x7f6ea4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6eb9390700 1 --2- 172.21.15.88:0/2573525896 >> v2:172.21.15.88:3300/0 conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6eb405bbc0 tx=0x7f6ea4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6eb9390700 1 --2- 172.21.15.88:0/2573525896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f6eb405bbc0 tx=0x7f6ea4007a40).ready entity=mon.1 client_cookie=8345984a8f0f7de server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6eb9390700 1 --2- 172.21.15.88:0/2573525896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f6eb405bbc0 tx=0x7f6ea4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ea3fff700 1 -- 172.21.15.88:0/2573525896 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea40116e0 con 0x7f6eb40a18a0 2020-02-11T16:06:47.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6eb9390700 1 --2- 172.21.15.88:0/2573525896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f6eb405bbc0 tx=0x7f6ea4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6eb9390700 1 --2- 172.21.15.88:0/2573525896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f6eb405bbc0 tx=0x7f6ea4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ea3fff700 1 -- 172.21.15.88:0/2573525896 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4011840 con 0x7f6eb40a18a0 2020-02-11T16:06:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ea3fff700 1 -- 172.21.15.88:0/2573525896 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea4011c20 con 0x7f6eb40a18a0 2020-02-11T16:06:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/2573525896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a18a0 msgr2=0x7f6eb40a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ebb5f4700 1 --2- 172.21.15.88:0/2573525896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f6eb405bbc0 tx=0x7f6ea4007a40).stop 2020-02-11T16:06:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/2573525896 shutdown_connections 2020-02-11T16:06:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ebb5f4700 1 --2- 172.21.15.88:0/2573525896 >> v2:172.21.15.52:3300/0 conn(0x7f6eb40a6260 0x7f6eb412eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ebb5f4700 1 --2- 172.21.15.88:0/2573525896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a18a0 0x7f6eb40a6dd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/2573525896 >> 172.21.15.88:0/2573525896 conn(0x7f6eb409d110 msgr2=0x7f6eb409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/2573525896 shutdown_connections 2020-02-11T16:06:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.576+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/2573525896 wait complete. 2020-02-11T16:06:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.577+0000 7f6ebb5f4700 1 Processor -- start 2020-02-11T16:06:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.577+0000 7f6ebb5f4700 1 -- start start 2020-02-11T16:06:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6ebb5f4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6eb40a5de0 0x7f6eb4135050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6ebb5f4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6eb40a6260 0x7f6eb41283c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6ebb5f4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb4148680 con 0x7f6eb40a18a0 2020-02-11T16:06:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6ebb5f4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb4134350 con 0x7f6eb40a6260 2020-02-11T16:06:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6ebb5f4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb4148920 con 0x7f6eb40a5de0 2020-02-11T16:06:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6eb40a5de0 0x7f6eb4135050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6eb40a5de0 0x7f6eb4135050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52538/0 (socket says 172.21.15.88:52538) 2020-02-11T16:06:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 -- 172.21.15.88:0/3296611433 learned_addr learned my addr 172.21.15.88:0/3296611433 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> v2:172.21.15.52:3300/0 conn(0x7f6eb40a6260 0x7f6eb41283c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 -- 172.21.15.88:0/3296611433 >> v2:172.21.15.52:3300/0 conn(0x7f6eb40a6260 msgr2=0x7f6eb41283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 --2- 172.21.15.88:0/3296611433 >> v2:172.21.15.52:3300/0 conn(0x7f6eb40a6260 0x7f6eb41283c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 -- 172.21.15.88:0/3296611433 >> v1:172.21.15.52:6789/0 conn(0x7f6eb40a18a0 legacy=0x7f6eb4148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 -- 172.21.15.88:0/3296611433 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb412a530 con 0x7f6eb40a5de0 2020-02-11T16:06:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 --2- 172.21.15.88:0/3296611433 >> v2:172.21.15.88:3300/0 conn(0x7f6eb40a5de0 0x7f6eb4135050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6eb4134f60 tx=0x7f6eb0002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 --2- 172.21.15.88:0/3296611433 >> v2:172.21.15.88:3300/0 conn(0x7f6eb40a5de0 0x7f6eb4135050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6eb4134f60 tx=0x7f6eb0002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a5de0 0x7f6eb4135050 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f6eb4134f60 tx=0x7f6eb0002e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a5de0 0x7f6eb4135050 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f6eb4134f60 tx=0x7f6eb0002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eb000cc20 con 0x7f6eb40a5de0 2020-02-11T16:06:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a5de0 0x7f6eb4135050 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f6eb4134f60 tx=0x7f6eb0002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6eb8b8f700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a5de0 0x7f6eb4135050 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f6eb4134f60 tx=0x7f6eb0002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb000cd80 con 0x7f6eb40a5de0 2020-02-11T16:06:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/3296611433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb4065a90 con 0x7f6eb40a5de0 2020-02-11T16:06:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.578+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eb000e350 con 0x7f6eb40a5de0 2020-02-11T16:06:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.579+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/3296611433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4135670 con 0x7f6eb40a5de0 2020-02-11T16:06:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.579+0000 7f6eb8b8f700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a5de0 0x7f6eb4135050 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f6eb4134f60 tx=0x7f6eb0002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.579+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6eb000e5c0 con 0x7f6eb40a5de0 2020-02-11T16:06:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.579+0000 7f6eb8b8f700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a5de0 0x7f6eb4135050 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f6eb4134f60 tx=0x7f6eb0002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.579+0000 7f6ea27fc700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e94039da0 0x7f6e9403c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.579+0000 7f6ebb5f4700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 0x7f6eb412e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.579+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6eb0049790 con 0x7f6eb40a5de0 2020-02-11T16:06:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.579+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/3296611433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb405e2f0 con 0x7f6eb4128820 2020-02-11T16:06:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.579+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 0x7f6eb412e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6eb9390700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e94039da0 0x7f6e9403c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6eb9b91700 1 -- 172.21.15.88:0/3296611433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6eb4148b20 con 0x7f6eb4128820 2020-02-11T16:06:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 0x7f6eb412e900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 0x7f6eb412e900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6eb9390700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e94039da0 0x7f6e9403c260 crc :-1 s=READY pgs=117 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 0x7f6eb412e900 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 0x7f6eb412e900 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eac00b240 con 0x7f6eb4128820 2020-02-11T16:06:47.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 0x7f6eb412e900 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6eac00b3a0 con 0x7f6eb4128820 2020-02-11T16:06:47.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 msgr2=0x7f6eb412e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6ea27fc700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 0x7f6eb412e900 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).stop 2020-02-11T16:06:47.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 msgr2=0x7f6eb412e900 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:47.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.580+0000 7f6ea27fc700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb4128820 0x7f6eb412e900 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.588+0000 7f6ebb5f4700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 0x7f6eb40a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.588+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/3296611433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb412a270 con 0x7f6eb40a87d0 2020-02-11T16:06:47.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.588+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 0x7f6eb40a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.588+0000 7f6eb9b91700 1 -- 172.21.15.88:0/3296611433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6eb4135800 con 0x7f6eb40a87d0 2020-02-11T16:06:47.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.588+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 0x7f6eb40a8bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 0x7f6eb40a8bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 0x7f6eb40a8bb0 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 0x7f6eb40a8bb0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eac00f230 con 0x7f6eb40a87d0 2020-02-11T16:06:47.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6eb9b91700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 0x7f6eb40a8bb0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f6eac00f390 con 0x7f6eb40a87d0 2020-02-11T16:06:47.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 msgr2=0x7f6eb40a8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ea27fc700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 0x7f6eb40a8bb0 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).stop 2020-02-11T16:06:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ea27fc700 1 -- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 msgr2=0x7f6eb40a8bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ea27fc700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a87d0 0x7f6eb40a8bb0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0x7f6eac0032b0 tx=0x7f6eac00cc30).stop 2020-02-11T16:06:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/3296611433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e94039da0 msgr2=0x7f6e9403c260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ebb5f4700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e94039da0 0x7f6e9403c260 crc :-1 s=READY pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a5de0 msgr2=0x7f6eb4135050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ebb5f4700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a5de0 0x7f6eb4135050 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f6eb4134f60 tx=0x7f6eb0002e60).stop 2020-02-11T16:06:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6eb9b91700 1 -- 172.21.15.88:0/3296611433 reap_dead start 2020-02-11T16:06:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6eb9b91700 1 -- 172.21.15.88:0/3296611433 reap_dead start 2020-02-11T16:06:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/3296611433 shutdown_connections 2020-02-11T16:06:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ebb5f4700 1 --2- 172.21.15.88:0/3296611433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eb40a5de0 0x7f6eb4135050 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/3296611433 >> 172.21.15.88:0/3296611433 conn(0x7f6eb409d110 msgr2=0x7f6eb40a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:47.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/3296611433 shutdown_connections 2020-02-11T16:06:47.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.589+0000 7f6ebb5f4700 1 -- 172.21.15.88:0/3296611433 wait complete. 2020-02-11T16:06:47.604 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:06:47.604 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:06:47.604 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:06:47.604 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:06:47.604 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 18, 2020-02-11T16:06:47.605 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:06:47.605 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:06:47.605 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:06:47.611 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:06:47.611 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.611 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 17, 2020-02-11T16:06:47.611 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:47.612 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:06:47.612 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:06:47.612 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:47.612 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:47.612 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:47.612 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:47.612 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:47.613 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:47.613 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.613 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:06:47.613 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:06:47.613 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:47.613 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:47.613 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:47.614 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:47.614 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:47.614 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:47.614 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.614 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:06:47.614 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:06:47.615 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:06:47.615 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:06:47.615 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:06:47.615 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:06:47.615 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:47.615 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:47.615 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:06:47.616 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:06:47.616 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:47.616 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:06:47.616 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:47.616 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:47.616 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:47.616 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:47.616 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:47.617 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:47.617 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.617 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:06:47.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.617 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:06:47.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.617 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:47.618 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:47.618 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:47.618 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:47.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.618 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:47.618 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:06:47.618 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.619 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:47.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:06:47.619 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.619 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:06:47.620 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:06:47.620 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:47.620 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:47.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.620 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:06:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:06:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:06:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.622 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:47.622 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:06:47.622 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.623 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.623 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:06:47.623 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:06:47.623 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:47.623 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:47.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.624 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:47.624 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:47.624 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:47.624 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:47.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.624 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:47.625 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:06:47.625 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.625 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:47.625 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:06:47.625 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.625 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.626 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.626 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:06:47.626 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:06:47.626 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:47.626 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:47.626 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.627 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.627 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:06:47.627 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:06:47.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.627 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.628 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.628 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:47.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.628 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.628 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:06:47.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.629 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.629 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.629 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:06:47.629 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.629 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.629 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.629 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:06:47.631 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:06:47.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.734+0000 7f63181ea700 1 Processor -- start 2020-02-11T16:06:47.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.734+0000 7f63181ea700 1 -- start start 2020-02-11T16:06:47.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f63181ea700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f63100a6bf0 0x7f631009df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:47.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f63181ea700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6310139050 0x7f63101394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:47.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f63181ea700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631009e7e0 con 0x7f631005c1f0 2020-02-11T16:06:47.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f63181ea700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63100a4cd0 con 0x7f63100a6bf0 2020-02-11T16:06:47.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f63181ea700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631009e540 con 0x7f6310139050 2020-02-11T16:06:47.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6316787700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6310139050 0x7f63101394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6315f86700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f631005c1f0 0x7f63100a45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40174/0 (socket says 172.21.15.88:40174) 2020-02-11T16:06:47.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6315f86700 1 -- 172.21.15.88:0/2593984853 learned_addr learned my addr 172.21.15.88:0/2593984853 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:47.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6314f84700 1 -- 172.21.15.88:0/2593984853 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474313751 0 0) 0x7f631009e7e0 con 0x7f631005c1f0 2020-02-11T16:06:47.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6314f84700 1 -- 172.21.15.88:0/2593984853 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f8003230 con 0x7f631005c1f0 2020-02-11T16:06:47.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6315785700 1 --2- 172.21.15.88:0/2593984853 >> v2:172.21.15.52:3300/0 conn(0x7f63100a6bf0 0x7f631009df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6316787700 1 -- 172.21.15.88:0/2593984853 >> v2:172.21.15.52:3300/0 conn(0x7f63100a6bf0 msgr2=0x7f631009df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:06:47.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6316787700 1 --2- 172.21.15.88:0/2593984853 >> v2:172.21.15.52:3300/0 conn(0x7f63100a6bf0 0x7f631009df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:47.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6316787700 1 -- 172.21.15.88:0/2593984853 >> v1:172.21.15.88:6789/0 conn(0x7f631005c1f0 legacy=0x7f63100a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6316787700 1 -- 172.21.15.88:0/2593984853 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63100a4120 con 0x7f6310139050 2020-02-11T16:06:47.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6316787700 1 --2- 172.21.15.88:0/2593984853 >> v2:172.21.15.88:3300/0 conn(0x7f6310139050 0x7f63101394e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f63080032b0 tx=0x7f6308007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6316787700 1 --2- 172.21.15.88:0/2593984853 >> v2:172.21.15.88:3300/0 conn(0x7f6310139050 0x7f63101394e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f63080032b0 tx=0x7f6308007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.735+0000 7f6316787700 1 --2- 172.21.15.88:0/2593984853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6310139050 0x7f63101394e0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f63080032b0 tx=0x7f6308007dc0).ready entity=mon.1 client_cookie=c43eeee56e7396fb server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f6316787700 1 --2- 172.21.15.88:0/2593984853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6310139050 0x7f63101394e0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f63080032b0 tx=0x7f6308007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f6314f84700 1 -- 172.21.15.88:0/2593984853 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6308011e20 con 0x7f6310139050 2020-02-11T16:06:47.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f6316787700 1 --2- 172.21.15.88:0/2593984853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6310139050 0x7f63101394e0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f63080032b0 tx=0x7f6308007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f6316787700 1 --2- 172.21.15.88:0/2593984853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6310139050 0x7f63101394e0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f63080032b0 tx=0x7f6308007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f6314f84700 1 -- 172.21.15.88:0/2593984853 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630800a160 con 0x7f6310139050 2020-02-11T16:06:47.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f6314f84700 1 -- 172.21.15.88:0/2593984853 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f630800a540 con 0x7f6310139050 2020-02-11T16:06:47.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f63181ea700 1 -- 172.21.15.88:0/2593984853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6310139050 msgr2=0x7f63101394e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f63181ea700 1 --2- 172.21.15.88:0/2593984853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6310139050 0x7f63101394e0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f63080032b0 tx=0x7f6308007dc0).stop 2020-02-11T16:06:47.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f63181ea700 1 -- 172.21.15.88:0/2593984853 shutdown_connections 2020-02-11T16:06:47.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f63181ea700 1 --2- 172.21.15.88:0/2593984853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6310139050 0x7f63101394e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f63181ea700 1 --2- 172.21.15.88:0/2593984853 >> v2:172.21.15.52:3300/0 conn(0x7f63100a6bf0 0x7f631009df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:47.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f63181ea700 1 -- 172.21.15.88:0/2593984853 >> 172.21.15.88:0/2593984853 conn(0x7f63100ab400 msgr2=0x7f63100a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:47.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f63181ea700 1 -- 172.21.15.88:0/2593984853 shutdown_connections 2020-02-11T16:06:47.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.736+0000 7f63181ea700 1 -- 172.21.15.88:0/2593984853 wait complete. 2020-02-11T16:06:47.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.737+0000 7f63181ea700 1 Processor -- start 2020-02-11T16:06:47.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.737+0000 7f63181ea700 1 -- start start 2020-02-11T16:06:47.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f63181ea700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f631005c1f0 0x7f6310143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f63181ea700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f63100a6bf0 0x7f6310143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f63181ea700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63100a0780 con 0x7f6310139050 2020-02-11T16:06:47.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f63181ea700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6310061f10 con 0x7f631005c1f0 2020-02-11T16:06:47.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f63181ea700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63100a09b0 con 0x7f63100a6bf0 2020-02-11T16:06:47.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f631005c1f0 0x7f6310143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f631005c1f0 0x7f6310143000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52554/0 (socket says 172.21.15.88:52554) 2020-02-11T16:06:47.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 -- 172.21.15.88:0/2236875654 learned_addr learned my addr 172.21.15.88:0/2236875654 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:47.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 -- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f63100a6bf0 msgr2=0x7f6310143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f63100a6bf0 0x7f6310143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 -- 172.21.15.88:0/2236875654 >> v1:172.21.15.52:6789/0 conn(0x7f6310139050 legacy=0x7f631009fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 -- 172.21.15.88:0/2236875654 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6310062960 con 0x7f631005c1f0 2020-02-11T16:06:47.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 --2- 172.21.15.88:0/2236875654 >> v2:172.21.15.88:3300/0 conn(0x7f631005c1f0 0x7f6310143000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6310062250 tx=0x7f6300010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 --2- 172.21.15.88:0/2236875654 >> v2:172.21.15.88:3300/0 conn(0x7f631005c1f0 0x7f6310143000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6310062250 tx=0x7f6300010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631005c1f0 0x7f6310143000 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f6310062250 tx=0x7f6300010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631005c1f0 0x7f6310143000 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6310062250 tx=0x7f6300010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631005c1f0 0x7f6310143000 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6310062250 tx=0x7f6300010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6300005cc0 con 0x7f631005c1f0 2020-02-11T16:06:47.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f6315f86700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631005c1f0 0x7f6310143000 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6310062250 tx=0x7f6300010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300005e20 con 0x7f631005c1f0 2020-02-11T16:06:47.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f63181ea700 1 -- 172.21.15.88:0/2236875654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6310136c70 con 0x7f631005c1f0 2020-02-11T16:06:47.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63000062b0 con 0x7f631005c1f0 2020-02-11T16:06:47.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.738+0000 7f63181ea700 1 -- 172.21.15.88:0/2236875654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63101438c0 con 0x7f631005c1f0 2020-02-11T16:06:47.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.739+0000 7f6315f86700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631005c1f0 0x7f6310143000 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6310062250 tx=0x7f6300010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.739+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f63000064e0 con 0x7f631005c1f0 2020-02-11T16:06:47.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.739+0000 7f6315f86700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631005c1f0 0x7f6310143000 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6310062250 tx=0x7f6300010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.739+0000 7f63181ea700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 0x7f63100a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.739+0000 7f63181ea700 1 -- 172.21.15.88:0/2236875654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631005c630 con 0x7f63100a0130 2020-02-11T16:06:47.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.739+0000 7f62feffd700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f62f0039cd0 0x7f62f003c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.739+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6300049b00 con 0x7f631005c1f0 2020-02-11T16:06:47.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.739+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 0x7f63100a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.739+0000 7f6316787700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f62f0039cd0 0x7f62f003c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f6316787700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f62f0039cd0 0x7f62f003c190 crc :-1 s=READY pgs=118 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f6315785700 1 -- 172.21.15.88:0/2236875654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63100565b0 con 0x7f63100a0130 2020-02-11T16:06:47.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 0x7f63100a4fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c00bfc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 0x7f63100a4fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c00bfc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 0x7f63100a4fd0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c00bfc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 0x7f63100a4fd0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c00bfc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f630c007160 con 0x7f63100a0130 2020-02-11T16:06:47.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 0x7f63100a4fd0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c00bfc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f630c0072c0 con 0x7f63100a0130 2020-02-11T16:06:47.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 msgr2=0x7f63100a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f62feffd700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 0x7f63100a4fd0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c00bfc0).stop 2020-02-11T16:06:47.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 msgr2=0x7f63100a4fd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:47.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.740+0000 7f62feffd700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63100a0130 0x7f63100a4fd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.748+0000 7f63181ea700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 0x7f6310133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.748+0000 7f63181ea700 1 -- 172.21.15.88:0/2236875654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6310060fc0 con 0x7f6310133a70 2020-02-11T16:06:47.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.749+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 0x7f6310133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.749+0000 7f6315785700 1 -- 172.21.15.88:0/2236875654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f63100a0510 con 0x7f6310133a70 2020-02-11T16:06:47.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.749+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 0x7f6310133e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c0121b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.749+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 0x7f6310133e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c0121b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.749+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 0x7f6310133e50 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c0121b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.749+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 0x7f6310133e50 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c0121b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.749+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f630c012690 con 0x7f6310133a70 2020-02-11T16:06:47.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f6315785700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 0x7f6310133e50 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c0121b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4362 (secure 0 0 0) 0x7f630c0127f0 con 0x7f6310133a70 2020-02-11T16:06:47.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 msgr2=0x7f6310133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f62feffd700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 0x7f6310133e50 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f630c002f30 tx=0x7f630c0121b0).stop 2020-02-11T16:06:47.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f62feffd700 1 -- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 msgr2=0x7f6310133e50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:47.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f62feffd700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310133a70 0x7f6310133e50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f63181ea700 1 -- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f62f0039cd0 msgr2=0x7f62f003c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f63181ea700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f62f0039cd0 0x7f62f003c190 crc :-1 s=READY pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f63181ea700 1 -- 172.21.15.88:0/2236875654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631005c1f0 msgr2=0x7f6310143000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f63181ea700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631005c1f0 0x7f6310143000 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f6310062250 tx=0x7f6300010a40).stop 2020-02-11T16:06:47.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f6316787700 1 -- 172.21.15.88:0/2236875654 reap_dead start 2020-02-11T16:06:47.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f6316787700 1 -- 172.21.15.88:0/2236875654 reap_dead start 2020-02-11T16:06:47.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f63181ea700 1 -- 172.21.15.88:0/2236875654 shutdown_connections 2020-02-11T16:06:47.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f63181ea700 1 --2- 172.21.15.88:0/2236875654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631005c1f0 0x7f6310143000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f63181ea700 1 -- 172.21.15.88:0/2236875654 >> 172.21.15.88:0/2236875654 conn(0x7f63100ab400 msgr2=0x7f6310069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:47.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f63181ea700 1 -- 172.21.15.88:0/2236875654 shutdown_connections 2020-02-11T16:06:47.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.750+0000 7f63181ea700 1 -- 172.21.15.88:0/2236875654 wait complete. 2020-02-11T16:06:47.761 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:06:47.761 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:47.762 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:47.762 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:06:47.762 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 18, 2020-02-11T16:06:47.762 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:06:47.762 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:06:47.762 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:06:47.762 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:06:47.763 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.763 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 17, 2020-02-11T16:06:47.763 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:47.763 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:06:47.763 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:06:47.763 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:47.763 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:47.763 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:47.764 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:47.764 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:47.764 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:47.764 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.764 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:06:47.764 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:06:47.764 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:47.765 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:47.765 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:47.765 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:47.765 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:47.765 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:47.765 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.766 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:06:47.766 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:06:47.766 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:06:47.766 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:06:47.766 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:06:47.766 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:06:47.767 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:47.767 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:47.767 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:06:47.767 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:06:47.767 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:47.767 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:06:47.767 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:47.767 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:47.768 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:47.768 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:47.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:47.768 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:47.768 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.768 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:06:47.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.769 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:06:47.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.769 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:47.769 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:47.769 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:47.770 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:47.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.770 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:47.770 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:06:47.770 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.771 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:47.771 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:06:47.771 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.771 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.771 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:06:47.772 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:06:47.772 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:47.772 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:47.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.772 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:06:47.772 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:06:47.773 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:47.773 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:47.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.773 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:47.773 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:06:47.773 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:06:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.774 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:06:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:06:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:47.775 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:06:47.776 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:47.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:06:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.778 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:06:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:06:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.779 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:06:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:06:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.780 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:06:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:06:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.782 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:06:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:06:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:06:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:06:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:06:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.785 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:06:47.786 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:06:47.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.890+0000 7f133710c700 1 Processor -- start 2020-02-11T16:06:47.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.890+0000 7f133710c700 1 -- start start 2020-02-11T16:06:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f133710c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13300a6260 0x7f1330135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f133710c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13300a31b0 con 0x7f13300a5de0 2020-02-11T16:06:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f133710c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13300a3570 con 0x7f13300a18a0 2020-02-11T16:06:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f133710c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13300a3810 con 0x7f13300a6260 2020-02-11T16:06:47.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f13356a9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13300a6260 0x7f1330135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f1334ea8700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f13300a18a0 0x7f13300a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40192/0 (socket says 172.21.15.88:40192) 2020-02-11T16:06:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f1334ea8700 1 -- 172.21.15.88:0/3849186910 learned_addr learned my addr 172.21.15.88:0/3849186910 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f13356a9700 1 -- 172.21.15.88:0/3849186910 >> v1:172.21.15.88:6789/0 conn(0x7f13300a18a0 legacy=0x7f13300a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f13356a9700 1 -- 172.21.15.88:0/3849186910 >> v1:172.21.15.52:6789/0 conn(0x7f13300a5de0 legacy=0x7f1330134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f13356a9700 1 -- 172.21.15.88:0/3849186910 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300a3ab0 con 0x7f13300a6260 2020-02-11T16:06:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f132f7fe700 1 -- 172.21.15.88:0/3849186910 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499949810 0 0) 0x7f13300a3570 con 0x7f13300a18a0 2020-02-11T16:06:47.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f13356a9700 1 --2- 172.21.15.88:0/3849186910 >> v2:172.21.15.88:3300/0 conn(0x7f13300a6260 0x7f1330135160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f13280032b0 tx=0x7f1328008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f13356a9700 1 --2- 172.21.15.88:0/3849186910 >> v2:172.21.15.88:3300/0 conn(0x7f13300a6260 0x7f1330135160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f13280032b0 tx=0x7f1328008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.891+0000 7f13356a9700 1 --2- 172.21.15.88:0/3849186910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a6260 0x7f1330135160 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f13280032b0 tx=0x7f1328008c60).ready entity=mon.1 client_cookie=3881a85aaea1f891 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f13356a9700 1 --2- 172.21.15.88:0/3849186910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a6260 0x7f1330135160 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f13280032b0 tx=0x7f1328008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f132f7fe700 1 -- 172.21.15.88:0/3849186910 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f132800a350 con 0x7f13300a6260 2020-02-11T16:06:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f13356a9700 1 --2- 172.21.15.88:0/3849186910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a6260 0x7f1330135160 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f13280032b0 tx=0x7f1328008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f13356a9700 1 --2- 172.21.15.88:0/3849186910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a6260 0x7f1330135160 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f13280032b0 tx=0x7f1328008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f132f7fe700 1 -- 172.21.15.88:0/3849186910 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132800a4b0 con 0x7f13300a6260 2020-02-11T16:06:47.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f132f7fe700 1 -- 172.21.15.88:0/3849186910 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f132800a890 con 0x7f13300a6260 2020-02-11T16:06:47.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f133710c700 1 -- 172.21.15.88:0/3849186910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a6260 msgr2=0x7f1330135160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f133710c700 1 --2- 172.21.15.88:0/3849186910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a6260 0x7f1330135160 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f13280032b0 tx=0x7f1328008c60).stop 2020-02-11T16:06:47.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f133710c700 1 -- 172.21.15.88:0/3849186910 shutdown_connections 2020-02-11T16:06:47.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f133710c700 1 --2- 172.21.15.88:0/3849186910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a6260 0x7f1330135160 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f133710c700 1 -- 172.21.15.88:0/3849186910 >> 172.21.15.88:0/3849186910 conn(0x7f133009d110 msgr2=0x7f133009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:47.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f133710c700 1 -- 172.21.15.88:0/3849186910 shutdown_connections 2020-02-11T16:06:47.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.892+0000 7f133710c700 1 -- 172.21.15.88:0/3849186910 wait complete. 2020-02-11T16:06:47.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.893+0000 7f133710c700 1 Processor -- start 2020-02-11T16:06:47.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.893+0000 7f133710c700 1 -- start start 2020-02-11T16:06:47.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f133710c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13300a18a0 0x7f133012fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f133710c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13300a5de0 0x7f1330134600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f133710c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13300a6260 0x7f1330140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f133710c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1330135280 con 0x7f13300a6260 2020-02-11T16:06:47.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f133710c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133012ffe0 con 0x7f13300a5de0 2020-02-11T16:06:47.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f133710c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13301444b0 con 0x7f13300a18a0 2020-02-11T16:06:47.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13300a5de0 0x7f1330134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13300a5de0 0x7f1330134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52572/0 (socket says 172.21.15.88:52572) 2020-02-11T16:06:47.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 -- 172.21.15.88:0/589724333 learned_addr learned my addr 172.21.15.88:0/589724333 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:47.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13300a18a0 0x7f133012fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f13356a9700 1 --2- 172.21.15.88:0/589724333 >> v2:172.21.15.52:3300/0 conn(0x7f13300a6260 0x7f1330140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 -- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13300a18a0 msgr2=0x7f133012fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13300a18a0 0x7f133012fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 -- 172.21.15.88:0/589724333 >> v2:172.21.15.52:3300/0 conn(0x7f13300a6260 msgr2=0x7f1330140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 --2- 172.21.15.88:0/589724333 >> v2:172.21.15.52:3300/0 conn(0x7f13300a6260 0x7f1330140ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 -- 172.21.15.88:0/589724333 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330144750 con 0x7f13300a5de0 2020-02-11T16:06:47.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f13356a9700 1 --2- 172.21.15.88:0/589724333 >> v2:172.21.15.52:3300/0 conn(0x7f13300a6260 0x7f1330140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:06:47.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13300a18a0 0x7f133012fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:06:47.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 --2- 172.21.15.88:0/589724333 >> v2:172.21.15.88:3300/0 conn(0x7f13300a5de0 0x7f1330134600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f133005bbc0 tx=0x7f132400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 --2- 172.21.15.88:0/589724333 >> v2:172.21.15.88:3300/0 conn(0x7f13300a5de0 0x7f1330134600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f133005bbc0 tx=0x7f132400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a5de0 0x7f1330134600 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f133005bbc0 tx=0x7f132400c490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a5de0 0x7f1330134600 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f133005bbc0 tx=0x7f132400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a5de0 0x7f1330134600 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f133005bbc0 tx=0x7f132400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f132400cc20 con 0x7f13300a5de0 2020-02-11T16:06:47.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132ffff700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a5de0 0x7f1330134600 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f133005bbc0 tx=0x7f132400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132400cd80 con 0x7f13300a5de0 2020-02-11T16:06:47.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f133710c700 1 -- 172.21.15.88:0/589724333 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13301449f0 con 0x7f13300a5de0 2020-02-11T16:06:47.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1324012260 con 0x7f13300a5de0 2020-02-11T16:06:47.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.894+0000 7f133710c700 1 -- 172.21.15.88:0/589724333 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1330134a60 con 0x7f13300a5de0 2020-02-11T16:06:47.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.895+0000 7f132ffff700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a5de0 0x7f1330134600 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f133005bbc0 tx=0x7f132400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.895+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f13240064e0 con 0x7f13300a5de0 2020-02-11T16:06:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.895+0000 7f132ffff700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a5de0 0x7f1330134600 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f133005bbc0 tx=0x7f132400c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.895+0000 7f133710c700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 0x7f13301411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.895+0000 7f133710c700 1 -- 172.21.15.88:0/589724333 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1330144370 con 0x7f133012d960 2020-02-11T16:06:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.895+0000 7f132dffb700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1310039d00 0x7f131003c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.895+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 0x7f13301411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.895+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f13240496b0 con 0x7f13300a5de0 2020-02-11T16:06:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.895+0000 7f13356a9700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1310039d00 0x7f131003c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f13356a9700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1310039d00 0x7f131003c1c0 crc :-1 s=READY pgs=119 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f1334ea8700 1 -- 172.21.15.88:0/589724333 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1330144bf0 con 0x7f133012d960 2020-02-11T16:06:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 0x7f13301411c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 0x7f13301411c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 0x7f13301411c0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 0x7f13301411c0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1320005d40 con 0x7f133012d960 2020-02-11T16:06:47.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 0x7f13301411c0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f13200060c0 con 0x7f133012d960 2020-02-11T16:06:47.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 msgr2=0x7f13301411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f132dffb700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 0x7f13301411c0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).stop 2020-02-11T16:06:47.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 msgr2=0x7f13301411c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:47.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.896+0000 7f132dffb700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f133012d960 0x7f13301411c0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).stop 2020-02-11T16:06:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.904+0000 7f133710c700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 0x7f1330133000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.904+0000 7f133710c700 1 -- 172.21.15.88:0/589724333 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1330145050 con 0x7f1330141620 2020-02-11T16:06:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 0x7f1330133000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f1334ea8700 1 -- 172.21.15.88:0/589724333 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1330141a30 con 0x7f1330141620 2020-02-11T16:06:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 0x7f1330133000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 0x7f1330133000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 0x7f1330133000 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:47.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 0x7f1330133000 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f132000bc40 con 0x7f1330141620 2020-02-11T16:06:47.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f1334ea8700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 0x7f1330133000 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:47.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4190 (secure 0 0 0) 0x7f1320008650 con 0x7f1330141620 2020-02-11T16:06:47.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 msgr2=0x7f1330133000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f132dffb700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 0x7f1330133000 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f1320000b80 tx=0x7f1320010900).stop 2020-02-11T16:06:47.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f132dffb700 1 -- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 msgr2=0x7f1330133000 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:06:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.905+0000 7f132dffb700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1330141620 0x7f1330133000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f133710c700 1 -- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1310039d00 msgr2=0x7f131003c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f133710c700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1310039d00 0x7f131003c1c0 crc :-1 s=READY pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f133710c700 1 -- 172.21.15.88:0/589724333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a5de0 msgr2=0x7f1330134600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f133710c700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a5de0 0x7f1330134600 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f133005bbc0 tx=0x7f132400c490).stop 2020-02-11T16:06:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f13356a9700 1 -- 172.21.15.88:0/589724333 reap_dead start 2020-02-11T16:06:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f13356a9700 1 -- 172.21.15.88:0/589724333 reap_dead start 2020-02-11T16:06:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f133710c700 1 -- 172.21.15.88:0/589724333 shutdown_connections 2020-02-11T16:06:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f133710c700 1 --2- 172.21.15.88:0/589724333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13300a5de0 0x7f1330134600 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f133710c700 1 -- 172.21.15.88:0/589724333 >> 172.21.15.88:0/589724333 conn(0x7f133009d110 msgr2=0x7f1330069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f133710c700 1 -- 172.21.15.88:0/589724333 shutdown_connections 2020-02-11T16:06:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:47.906+0000 7f133710c700 1 -- 172.21.15.88:0/589724333 wait complete. 2020-02-11T16:06:47.919 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:06:47.920 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:47.920 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:47.920 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:06:47.920 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 18, 2020-02-11T16:06:47.920 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:06:47.920 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:06:47.920 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:06:47.921 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:06:47.921 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.921 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 17, 2020-02-11T16:06:47.921 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:47.921 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:06:47.921 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:06:47.921 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:47.922 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:47.923 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:47.923 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:47.923 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:47.923 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:47.923 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.923 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:06:47.923 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:06:47.924 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:47.924 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:47.924 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:47.924 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:47.924 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:47.924 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:47.924 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.925 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:06:47.925 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:06:47.925 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:06:47.925 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:06:47.925 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:06:47.925 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:06:47.926 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:47.926 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:06:47.926 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:06:47.926 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:06:47.926 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:06:47.926 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:06:47.927 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:06:47.927 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:06:47.927 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:06:47.927 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:06:47.927 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:06:47.927 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:06:47.927 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.928 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:06:47.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.928 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:06:47.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.929 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:06:47.929 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:06:47.929 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:47.929 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:47.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.929 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:47.929 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:06:47.930 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.930 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:47.930 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:06:47.931 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.931 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.931 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.931 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:06:47.931 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:06:47.931 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:47.932 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:47.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.932 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:06:47.932 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:06:47.932 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:47.932 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:47.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:47.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:06:47.933 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:47.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:06:47.934 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:06:47.934 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:06:47.935 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:47.935 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:47.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.935 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:06:47.935 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:06:47.935 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:06:47.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:06:47.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.936 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:06:47.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:06:47.936 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.937 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:06:47.937 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:06:47.937 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:06:47.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.937 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.937 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:06:47.938 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:06:47.938 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:06:47.938 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:06:47.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.938 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:06:47.938 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:06:47.938 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:06:47.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.939 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.939 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.939 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:47.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.939 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.939 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:06:47.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.940 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.940 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.940 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:06:47.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.940 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.940 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:06:47.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.941 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.941 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.941 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:06:47.941 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.941 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:06:47.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:06:47.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:06:47.942 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:06:47.942 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:06:47.942 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:06:47.942 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.942 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:06:47.943 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:06:47.943 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:06:47.944 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2020-02-11T16:06:47.944 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:06:47.944 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2020-02-11T16:06:47.944 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:06:47.945 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-02-11T16:06:47.945 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:06:47.958 INFO:tasks.ceph.mon.b:Stopped 2020-02-11T16:06:47.958 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:06:47.959 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:06:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.061+0000 7f2dd4c33700 1 Processor -- start 2020-02-11T16:06:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.061+0000 7f2dd4c33700 1 -- start start 2020-02-11T16:06:48.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.061+0000 7f2dd4c33700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.061+0000 7f2dd4c33700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a5de0 0x7f2dd00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.061+0000 7f2dd4c33700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd00a31b0 con 0x7f2dd012e3a0 2020-02-11T16:06:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.061+0000 7f2dd4c33700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd00a3570 con 0x7f2dd00a5de0 2020-02-11T16:06:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.061+0000 7f2dd4c33700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd00a3810 con 0x7f2dd00a18a0 2020-02-11T16:06:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.061+0000 7f2dce59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.061+0000 7f2dced9d700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f2dd012e3a0 legacy=0x7f2dd012e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:06:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.061+0000 7f2dcdd9b700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a5de0 msgr2=0x7f2dd00a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:06:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52614/0 (socket says 172.21.15.88:52614) 2020-02-11T16:06:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 -- 172.21.15.88:0/1453106477 learned_addr learned my addr 172.21.15.88:0/1453106477 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/1453106477 >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a5de0 0x7f2dd00a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 -- 172.21.15.88:0/1453106477 >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a5de0 msgr2=0x7f2dd00a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:06:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 --2- 172.21.15.88:0/1453106477 >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a5de0 0x7f2dd00a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 -- 172.21.15.88:0/1453106477 >> v1:172.21.15.52:6789/0 conn(0x7f2dd012e3a0 legacy=0x7f2dd012e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:06:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 -- 172.21.15.88:0/1453106477 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd00a3ab0 con 0x7f2dd00a18a0 2020-02-11T16:06:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 --2- 172.21.15.88:0/1453106477 >> v2:172.21.15.88:3300/0 conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2dd005bbc0 tx=0x7f2dc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 --2- 172.21.15.88:0/1453106477 >> v2:172.21.15.88:3300/0 conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2dd005bbc0 tx=0x7f2dc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 --2- 172.21.15.88:0/1453106477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f2dd005bbc0 tx=0x7f2dc4007a40).ready entity=mon.1 client_cookie=f718951b016bba66 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 --2- 172.21.15.88:0/1453106477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2dd005bbc0 tx=0x7f2dc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 --2- 172.21.15.88:0/1453106477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2dd005bbc0 tx=0x7f2dc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dcd59a700 1 -- 172.21.15.88:0/1453106477 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dc4008e20 con 0x7f2dd00a18a0 2020-02-11T16:06:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dce59c700 1 --2- 172.21.15.88:0/1453106477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2dd005bbc0 tx=0x7f2dc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dcd59a700 1 -- 172.21.15.88:0/1453106477 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc40118d0 con 0x7f2dd00a18a0 2020-02-11T16:06:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dcd59a700 1 -- 172.21.15.88:0/1453106477 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dc4011cb0 con 0x7f2dd00a18a0 2020-02-11T16:06:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dd4c33700 1 -- 172.21.15.88:0/1453106477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd00a18a0 msgr2=0x7f2dd00a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dd4c33700 1 --2- 172.21.15.88:0/1453106477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f2dd005bbc0 tx=0x7f2dc4007a40).stop 2020-02-11T16:06:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dd4c33700 1 -- 172.21.15.88:0/1453106477 shutdown_connections 2020-02-11T16:06:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dd4c33700 1 --2- 172.21.15.88:0/1453106477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd00a18a0 0x7f2dd00a6dd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.062+0000 7f2dd4c33700 1 --2- 172.21.15.88:0/1453106477 >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a5de0 0x7f2dd00a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.063+0000 7f2dd4c33700 1 -- 172.21.15.88:0/1453106477 >> 172.21.15.88:0/1453106477 conn(0x7f2dd009d110 msgr2=0x7f2dd009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.063+0000 7f2dd4c33700 1 -- 172.21.15.88:0/1453106477 shutdown_connections 2020-02-11T16:06:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.063+0000 7f2dd4c33700 1 -- 172.21.15.88:0/1453106477 wait complete. 2020-02-11T16:06:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.063+0000 7f2dd4c33700 1 Processor -- start 2020-02-11T16:06:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.063+0000 7f2dd4c33700 1 -- start start 2020-02-11T16:06:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dd4c33700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a18a0 0x7f2dd0135010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dd4c33700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dd4c33700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd0135470 con 0x7f2dd012e3a0 2020-02-11T16:06:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dd4c33700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd0136b00 con 0x7f2dd00a18a0 2020-02-11T16:06:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dd4c33700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00a29d0 con 0x7f2dd00a5de0 2020-02-11T16:06:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dce59c700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a18a0 msgr2=0x7f2dd0135010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:06:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dced9d700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f2dd012e3a0 legacy=0x7f2dd0128280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:06:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dce59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a18a0 0x7f2dd0135010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:48.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dcdd9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:48.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dcdd9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:46944/0 (socket says 172.21.15.88:46944) 2020-02-11T16:06:48.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.064+0000 7f2dcdd9b700 1 -- 172.21.15.88:0/914003610 learned_addr learned my addr 172.21.15.88:0/914003610 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:06:48.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dcdd9b700 1 -- 172.21.15.88:0/914003610 >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a18a0 msgr2=0x7f2dd0135010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:06:48.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a18a0 0x7f2dd0135010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:48.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dcdd9b700 1 -- 172.21.15.88:0/914003610 >> v1:172.21.15.52:6789/0 conn(0x7f2dd012e3a0 legacy=0x7f2dd0128280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:06:48.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dcdd9b700 1 -- 172.21.15.88:0/914003610 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0134490 con 0x7f2dd00a5de0 2020-02-11T16:06:48.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:48.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dbf7fe700 1 -- 172.21.15.88:0/914003610 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dc0008db0 con 0x7f2dd00a5de0 2020-02-11T16:06:48.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dd4c33700 1 -- 172.21.15.88:0/914003610 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd01356b0 con 0x7f2dd00a5de0 2020-02-11T16:06:48.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dbf7fe700 1 -- 172.21.15.88:0/914003610 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc00037c0 con 0x7f2dd00a5de0 2020-02-11T16:06:48.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dbf7fe700 1 -- 172.21.15.88:0/914003610 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dc0003be0 con 0x7f2dd00a5de0 2020-02-11T16:06:48.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.065+0000 7f2dd4c33700 1 -- 172.21.15.88:0/914003610 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd0137930 con 0x7f2dd00a5de0 2020-02-11T16:06:48.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.066+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.066+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.066+0000 7f2dbf7fe700 1 -- 172.21.15.88:0/914003610 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2dc00123a0 con 0x7f2dd00a5de0 2020-02-11T16:06:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.066+0000 7f2dd4c33700 1 -- 172.21.15.88:0/914003610 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd0128d10 con 0x7f2dd00a5de0 2020-02-11T16:06:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.066+0000 7f2dbf7fe700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2dac039bf0 0x7f2dac03c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.066+0000 7f2dbf7fe700 1 -- 172.21.15.88:0/914003610 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2dc0049670 con 0x7f2dd00a5de0 2020-02-11T16:06:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.067+0000 7f2dce59c700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2dac039bf0 0x7f2dac03c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.067+0000 7f2dce59c700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2dac039bf0 0x7f2dac03c0b0 crc :-1 s=READY pgs=120 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.070+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.070+0000 7f2dbf7fe700 1 -- 172.21.15.88:0/914003610 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f2dc002eb50 con 0x7f2dd00a5de0 2020-02-11T16:06:48.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.250+0000 7f2dd4c33700 1 -- 172.21.15.88:0/914003610 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2dd00565b0 con 0x7f2dd00a5de0 2020-02-11T16:06:48.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.251+0000 7f2dcdd9b700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:48.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.251+0000 7f2dbf7fe700 1 -- 172.21.15.88:0/914003610 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f2dc0031640 con 0x7f2dd00a5de0 2020-02-11T16:06:48.253 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:48.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.252+0000 7f2dd4c33700 1 -- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2dac039bf0 msgr2=0x7f2dac03c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.252+0000 7f2dd4c33700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2dac039bf0 0x7f2dac03c0b0 crc :-1 s=READY pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.252+0000 7f2dd4c33700 1 -- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 msgr2=0x7f2dd0132f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.252+0000 7f2dd4c33700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f2dd00437c0 tx=0x7f2dc0010a40).stop 2020-02-11T16:06:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.252+0000 7f2dd4c33700 1 -- 172.21.15.88:0/914003610 shutdown_connections 2020-02-11T16:06:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.252+0000 7f2dd4c33700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2dac039bf0 0x7f2dac03c0b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.252+0000 7f2dd4c33700 1 --2- 172.21.15.88:0/914003610 >> v2:172.21.15.52:3300/0 conn(0x7f2dd00a18a0 0x7f2dd0135010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:48.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.252+0000 7f2dd4c33700 1 --2- 172.21.15.88:0/914003610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dd00a5de0 0x7f2dd0132f10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:48.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.252+0000 7f2dd4c33700 1 -- 172.21.15.88:0/914003610 >> 172.21.15.88:0/914003610 conn(0x7f2dd009d110 msgr2=0x7f2dd00a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:48.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.253+0000 7f2dd4c33700 1 -- 172.21.15.88:0/914003610 shutdown_connections 2020-02-11T16:06:48.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:48.253+0000 7f2dd4c33700 1 -- 172.21.15.88:0/914003610 wait complete. 2020-02-11T16:06:48.264 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":18,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:51.265 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:06:51.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.377+0000 7fec0916f700 1 Processor -- start 2020-02-11T16:06:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.378+0000 7fec0916f700 1 -- start start 2020-02-11T16:06:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.378+0000 7fec0916f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fec040a5de0 0x7fec040a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.378+0000 7fec0916f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec04134a50 0x7fec04134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.378+0000 7fec0916f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040a31b0 con 0x7fec040a18a0 2020-02-11T16:06:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.378+0000 7fec0916f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec040a3570 con 0x7fec040a5de0 2020-02-11T16:06:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.378+0000 7fec0916f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec040a3810 con 0x7fec04134a50 2020-02-11T16:06:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0259c700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fec040a5de0 msgr2=0x7fec040a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:06:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec04134a50 0x7fec04134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fec040a5de0 0x7fec040a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec02d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fec040a18a0 0x7fec040a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40262/0 (socket says 172.21.15.88:40262) 2020-02-11T16:06:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec02d9d700 1 -- 172.21.15.88:0/3563631434 learned_addr learned my addr 172.21.15.88:0/3563631434 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 -- 172.21.15.88:0/3563631434 >> v2:172.21.15.52:3300/0 conn(0x7fec040a5de0 msgr2=0x7fec040a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:06:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 --2- 172.21.15.88:0/3563631434 >> v2:172.21.15.52:3300/0 conn(0x7fec040a5de0 0x7fec040a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 -- 172.21.15.88:0/3563631434 >> v1:172.21.15.88:6789/0 conn(0x7fec040a18a0 legacy=0x7fec040a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 -- 172.21.15.88:0/3563631434 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040a3ab0 con 0x7fec04134a50 2020-02-11T16:06:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 --2- 172.21.15.88:0/3563631434 >> v2:172.21.15.88:3300/0 conn(0x7fec04134a50 0x7fec04134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7febfc0032b0 tx=0x7febfc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 --2- 172.21.15.88:0/3563631434 >> v2:172.21.15.88:3300/0 conn(0x7fec04134a50 0x7fec04134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7febfc0032b0 tx=0x7febfc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 --2- 172.21.15.88:0/3563631434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec04134a50 0x7fec04134ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7febfc0032b0 tx=0x7febfc007dc0).ready entity=mon.1 client_cookie=98ca5cabb7ed77b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 --2- 172.21.15.88:0/3563631434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec04134a50 0x7fec04134ee0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7febfc0032b0 tx=0x7febfc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec01d9b700 1 -- 172.21.15.88:0/3563631434 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febfc00a160 con 0x7fec04134a50 2020-02-11T16:06:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 --2- 172.21.15.88:0/3563631434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec04134a50 0x7fec04134ee0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7febfc0032b0 tx=0x7febfc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec01d9b700 1 -- 172.21.15.88:0/3563631434 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc00a2c0 con 0x7fec04134a50 2020-02-11T16:06:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0359e700 1 --2- 172.21.15.88:0/3563631434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec04134a50 0x7fec04134ee0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7febfc0032b0 tx=0x7febfc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec01d9b700 1 -- 172.21.15.88:0/3563631434 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febfc00a620 con 0x7fec04134a50 2020-02-11T16:06:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0916f700 1 -- 172.21.15.88:0/3563631434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec04134a50 msgr2=0x7fec04134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:51.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.379+0000 7fec0916f700 1 --2- 172.21.15.88:0/3563631434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec04134a50 0x7fec04134ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7febfc0032b0 tx=0x7febfc007dc0).stop 2020-02-11T16:06:51.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.380+0000 7fec0916f700 1 -- 172.21.15.88:0/3563631434 shutdown_connections 2020-02-11T16:06:51.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.380+0000 7fec0916f700 1 --2- 172.21.15.88:0/3563631434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec04134a50 0x7fec04134ee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:51.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.380+0000 7fec0916f700 1 --2- 172.21.15.88:0/3563631434 >> v2:172.21.15.52:3300/0 conn(0x7fec040a5de0 0x7fec040a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:51.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.380+0000 7fec0916f700 1 -- 172.21.15.88:0/3563631434 >> 172.21.15.88:0/3563631434 conn(0x7fec0409d110 msgr2=0x7fec0409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:51.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.380+0000 7fec0916f700 1 -- 172.21.15.88:0/3563631434 shutdown_connections 2020-02-11T16:06:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.380+0000 7fec0916f700 1 -- 172.21.15.88:0/3563631434 wait complete. 2020-02-11T16:06:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0916f700 1 Processor -- start 2020-02-11T16:06:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0916f700 1 -- start start 2020-02-11T16:06:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0916f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fec040a18a0 0x7fec0412ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0916f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec040a5de0 0x7fec0412a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0916f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec041309a0 con 0x7fec04134a50 2020-02-11T16:06:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0916f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0412f4b0 con 0x7fec040a18a0 2020-02-11T16:06:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0916f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0412f750 con 0x7fec040a5de0 2020-02-11T16:06:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec040a5de0 0x7fec0412a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0359e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fec04134a50 0x7fec04141f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40270/0 (socket says 172.21.15.88:40270) 2020-02-11T16:06:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec02d9d700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fec040a18a0 msgr2=0x7fec0412ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:06:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0359e700 1 -- 172.21.15.88:0/2873948062 learned_addr learned my addr 172.21.15.88:0/2873948062 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> v2:172.21.15.88:3300/0 conn(0x7fec040a5de0 0x7fec0412a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52646/0 (socket says 172.21.15.88:52646) 2020-02-11T16:06:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.381+0000 7fec02d9d700 1 --2- 172.21.15.88:0/2873948062 >> v2:172.21.15.52:3300/0 conn(0x7fec040a18a0 0x7fec0412ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 -- 172.21.15.88:0/2873948062 >> v2:172.21.15.52:3300/0 conn(0x7fec040a18a0 msgr2=0x7fec0412ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:06:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> v2:172.21.15.52:3300/0 conn(0x7fec040a18a0 0x7fec0412ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 -- 172.21.15.88:0/2873948062 >> v1:172.21.15.88:6789/0 conn(0x7fec04134a50 legacy=0x7fec04141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7febfbfff700 1 -- 172.21.15.88:0/2873948062 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356310819 0 0) 0x7fec041309a0 con 0x7fec04134a50 2020-02-11T16:06:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 -- 172.21.15.88:0/2873948062 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0412f9f0 con 0x7fec040a5de0 2020-02-11T16:06:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> v2:172.21.15.88:3300/0 conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> v2:172.21.15.88:3300/0 conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7febfbfff700 1 -- 172.21.15.88:0/2873948062 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febec008d00 con 0x7fec040a5de0 2020-02-11T16:06:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7febfbfff700 1 -- 172.21.15.88:0/2873948062 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec0037c0 con 0x7fec040a5de0 2020-02-11T16:06:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0916f700 1 -- 172.21.15.88:0/2873948062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec04142640 con 0x7fec040a5de0 2020-02-11T16:06:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7febfbfff700 1 -- 172.21.15.88:0/2873948062 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febec008ea0 con 0x7fec040a5de0 2020-02-11T16:06:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0916f700 1 -- 172.21.15.88:0/2873948062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0412a520 con 0x7fec040a5de0 2020-02-11T16:06:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.382+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.383+0000 7fec0916f700 1 -- 172.21.15.88:0/2873948062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec040565b0 con 0x7fec040a5de0 2020-02-11T16:06:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.383+0000 7febfbfff700 1 -- 172.21.15.88:0/2873948062 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7febec003be0 con 0x7fec040a5de0 2020-02-11T16:06:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.383+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.383+0000 7febfbfff700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febe8039a20 0x7febe803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:51.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.383+0000 7febfbfff700 1 -- 172.21.15.88:0/2873948062 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7febec049580 con 0x7fec040a5de0 2020-02-11T16:06:51.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.384+0000 7fec02d9d700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febe8039a20 0x7febe803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:51.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.384+0000 7fec02d9d700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febe8039a20 0x7febe803bee0 crc :-1 s=READY pgs=121 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:51.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.387+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.387+0000 7febfbfff700 1 -- 172.21.15.88:0/2873948062 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7febec02eba0 con 0x7fec040a5de0 2020-02-11T16:06:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.567+0000 7fec0916f700 1 -- 172.21.15.88:0/2873948062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fec0405ccb0 con 0x7fec040a5de0 2020-02-11T16:06:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.568+0000 7fec0259c700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.568+0000 7febfbfff700 1 -- 172.21.15.88:0/2873948062 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7febec031650 con 0x7fec040a5de0 2020-02-11T16:06:51.570 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 -- 172.21.15.88:0/2873948062 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febe8039a20 msgr2=0x7febe803bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febe8039a20 0x7febe803bee0 crc :-1 s=READY pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 -- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 msgr2=0x7fec0412a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:51.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 0x7fec0412a0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7febec000b20 tx=0x7febec010980).stop 2020-02-11T16:06:51.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 -- 172.21.15.88:0/2873948062 shutdown_connections 2020-02-11T16:06:51.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febe8039a20 0x7febe803bee0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:51.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 --2- 172.21.15.88:0/2873948062 >> v2:172.21.15.52:3300/0 conn(0x7fec040a18a0 0x7fec0412ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:51.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 --2- 172.21.15.88:0/2873948062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec040a5de0 0x7fec0412a0c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:51.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 -- 172.21.15.88:0/2873948062 >> 172.21.15.88:0/2873948062 conn(0x7fec0409d110 msgr2=0x7fec04069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:51.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 -- 172.21.15.88:0/2873948062 shutdown_connections 2020-02-11T16:06:51.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:51.569+0000 7fec0916f700 1 -- 172.21.15.88:0/2873948062 wait complete. 2020-02-11T16:06:51.581 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":18,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:06:54.582 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:06:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.695+0000 7f7e42ad4700 1 Processor -- start 2020-02-11T16:06:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.695+0000 7f7e42ad4700 1 -- start start 2020-02-11T16:06:54.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.696+0000 7f7e42ad4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7e3c0a18a0 0x7f7e3c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:54.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.696+0000 7f7e42ad4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 0x7f7e3c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:06:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.696+0000 7f7e42ad4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3c0a31b0 con 0x7f7e3c12e3a0 2020-02-11T16:06:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.696+0000 7f7e42ad4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c0a3570 con 0x7f7e3c0a18a0 2020-02-11T16:06:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.696+0000 7f7e42ad4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0a3810 con 0x7f7e3c0a5de0 2020-02-11T16:06:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.696+0000 7f7e40870700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f7e3c0a18a0 msgr2=0x7f7e3c0a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:06:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.696+0000 7f7e40870700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7e3c0a18a0 0x7f7e3c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.696+0000 7f7e41071700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7e3c12e3a0 0x7f7e3c12e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40282/0 (socket says 172.21.15.88:40282) 2020-02-11T16:06:54.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.696+0000 7f7e41071700 1 -- 172.21.15.88:0/1739681748 learned_addr learned my addr 172.21.15.88:0/1739681748 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.696+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/1739681748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 0x7f7e3c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:06:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3bfff700 1 -- 172.21.15.88:0/1739681748 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c0a18a0 msgr2=0x7f7e3c0a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:06:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/1739681748 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c0a18a0 0x7f7e3c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3bfff700 1 -- 172.21.15.88:0/1739681748 >> v1:172.21.15.88:6789/0 conn(0x7f7e3c12e3a0 legacy=0x7f7e3c12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3bfff700 1 -- 172.21.15.88:0/1739681748 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c0a3ab0 con 0x7f7e3c0a5de0 2020-02-11T16:06:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/1739681748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 0x7f7e3c0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7e30002f30 tx=0x7f7e300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:54.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/1739681748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 0x7f7e3c0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7e30002f30 tx=0x7f7e300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/1739681748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 0x7f7e3c0a6260 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f7e30002f30 tx=0x7f7e300088e0).ready entity=mon.2 client_cookie=667b811ed2c79fae server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:06:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/1739681748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 0x7f7e3c0a6260 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f7e30002f30 tx=0x7f7e300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3b7fe700 1 -- 172.21.15.88:0/1739681748 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e300116a0 con 0x7f7e3c0a5de0 2020-02-11T16:06:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/1739681748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 0x7f7e3c0a6260 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f7e30002f30 tx=0x7f7e300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3b7fe700 1 -- 172.21.15.88:0/1739681748 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30011800 con 0x7f7e3c0a5de0 2020-02-11T16:06:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/1739681748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 0x7f7e3c0a6260 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f7e30002f30 tx=0x7f7e300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:06:54.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e3b7fe700 1 -- 172.21.15.88:0/1739681748 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e30011be0 con 0x7f7e3c0a5de0 2020-02-11T16:06:54.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e42ad4700 1 -- 172.21.15.88:0/1739681748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 msgr2=0x7f7e3c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:06:54.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e42ad4700 1 --2- 172.21.15.88:0/1739681748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 0x7f7e3c0a6260 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f7e30002f30 tx=0x7f7e300088e0).stop 2020-02-11T16:06:54.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e42ad4700 1 -- 172.21.15.88:0/1739681748 shutdown_connections 2020-02-11T16:06:54.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e42ad4700 1 --2- 172.21.15.88:0/1739681748 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c0a18a0 0x7f7e3c0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:06:54.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e42ad4700 1 --2- 172.21.15.88:0/1739681748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e3c0a5de0 0x7f7e3c0a6260 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:06:54.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e42ad4700 1 -- 172.21.15.88:0/1739681748 >> 172.21.15.88:0/1739681748 conn(0x7f7e3c09d110 msgr2=0x7f7e3c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:06:54.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.697+0000 7f7e42ad4700 1 -- 172.21.15.88:0/1739681748 shutdown_connections 2020-02-11T16:06:54.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.698+0000 7f7e42ad4700 1 -- 172.21.15.88:0/1739681748 wait complete. 2020-02-11T16:06:54.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.698+0000 7f7e42ad4700 1 Processor -- start 2020-02-11T16:06:54.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.698+0000 7f7e42ad4700 1 -- start start 2020-02-11T16:06:54.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.699+0000 7f7e42ad4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 0x7f7e3c123550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:06:54.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.699+0000 7f7e42ad4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3c09f480 con 0x7f7e3c0a18a0 2020-02-11T16:06:54.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.699+0000 7f7e42ad4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3c0a0d20 con 0x7f7e3c0a5de0 2020-02-11T16:06:54.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.699+0000 7f7e42ad4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c0a0b30 con 0x7f7e3c12e3a0 2020-02-11T16:06:54.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.699+0000 7f7e40870700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f7e3c0a18a0 legacy=0x7f7e3c134ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:06:54.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.699+0000 7f7e41071700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 msgr2=0x7f7e3c123550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:06:54.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.699+0000 7f7e41071700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 0x7f7e3c123550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:06:54.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.699+0000 7f7e3bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7e3c0a5de0 0x7f7e3c122e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40286/0 (socket says 172.21.15.88:40286) 2020-02-11T16:06:54.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.699+0000 7f7e3bfff700 1 -- 172.21.15.88:0/816642446 learned_addr learned my addr 172.21.15.88:0/816642446 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:06:54.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.900+0000 7f7e41071700 1 -- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 msgr2=0x7f7e3c123550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:06:54.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.900+0000 7f7e40870700 1 -- 172.21.15.88:0/816642446 >> v1:172.21.15.52:6789/0 conn(0x7f7e3c0a18a0 legacy=0x7f7e3c134ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:06:54.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:54.900+0000 7f7e41071700 1 --2- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 0x7f7e3c123550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:06:55.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:55.301+0000 7f7e41071700 1 -- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 msgr2=0x7f7e3c123550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:06:55.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:55.301+0000 7f7e40870700 1 -- 172.21.15.88:0/816642446 >> v1:172.21.15.52:6789/0 conn(0x7f7e3c0a18a0 legacy=0x7f7e3c134ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:06:55.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:55.301+0000 7f7e41071700 1 --2- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 0x7f7e3c123550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:06:56.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:56.102+0000 7f7e40870700 1 -- 172.21.15.88:0/816642446 >> v1:172.21.15.52:6789/0 conn(0x7f7e3c0a18a0 legacy=0x7f7e3c134ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:06:56.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:56.102+0000 7f7e41071700 1 -- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 msgr2=0x7f7e3c123550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:06:56.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:56.102+0000 7f7e41071700 1 --2- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 0x7f7e3c123550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:06:57.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:57.703+0000 7f7e41071700 1 -- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 msgr2=0x7f7e3c123550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:06:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:57.703+0000 7f7e41071700 1 --2- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 0x7f7e3c123550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:06:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:06:57.703+0000 7f7e40870700 1 -- 172.21.15.88:0/816642446 >> v1:172.21.15.52:6789/0 conn(0x7f7e3c0a18a0 legacy=0x7f7e3c134ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:07:00.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:00.906+0000 7f7e41071700 1 -- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 msgr2=0x7f7e3c123550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:07:00.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:00.906+0000 7f7e41071700 1 --2- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 0x7f7e3c123550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:07:00.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:00.907+0000 7f7e40870700 1 -- 172.21.15.88:0/816642446 >> v1:172.21.15.52:6789/0 conn(0x7f7e3c0a18a0 legacy=0x7f7e3c134ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:07:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.926+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993462521 0 0) 0x7f7e3c0a0d20 con 0x7f7e3c0a5de0 2020-02-11T16:07:02.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.926+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e1c002fe0 con 0x7f7e3c0a5de0 2020-02-11T16:07:02.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.929+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4225006278 0 0) 0x7f7e1c002fe0 con 0x7f7e3c0a5de0 2020-02-11T16:07:02.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7e3c0a0d20 con 0x7f7e3c0a5de0 2020-02-11T16:07:02.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f7e30008660 con 0x7f7e3c0a5de0 2020-02-11T16:07:02.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 msgr2=0x7f7e3c123550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:02.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 --2- 172.21.15.88:0/816642446 >> v2:172.21.15.52:3300/0 conn(0x7f7e3c12e3a0 0x7f7e3c123550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:02.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 >> v1:172.21.15.88:6789/0 conn(0x7f7e3c0a5de0 legacy=0x7f7e3c122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:02.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 >> v1:172.21.15.52:6789/0 conn(0x7f7e3c0a18a0 legacy=0x7f7e3c134ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:02.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:02.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e1c005230 0x7f7e1c003940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:02.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e1c003e60 0x7f7e1c004310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:02.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c00b7e0 con 0x7f7e1c003e60 2020-02-11T16:07:02.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c00b950 con 0x7f7e1c0049b0 2020-02-11T16:07:02.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c00bb10 con 0x7f7e1c005230 2020-02-11T16:07:02.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:02.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e41071700 1 -- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e1c003e60 msgr2=0x7f7e1c004310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:07:02.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e41071700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e1c003e60 0x7f7e1c004310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:02.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e1c005230 0x7f7e1c003940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:02.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e40870700 1 -- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e1c005230 msgr2=0x7f7e1c003940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:02.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7e1c005230 0x7f7e1c003940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:02.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e40870700 1 -- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e1c003e60 msgr2=0x7f7e1c004310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:02.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e1c003e60 0x7f7e1c004310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:02.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e40870700 1 -- 172.21.15.88:0/816642446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c0a7900 con 0x7f7e1c0049b0 2020-02-11T16:07:02.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e41071700 1 -- 172.21.15.88:0/816642446 reap_dead start 2020-02-11T16:07:02.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e42ad4700 1 -- 172.21.15.88:0/816642446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c136290 con 0x7f7e1c0049b0 2020-02-11T16:07:02.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:02.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e42ad4700 1 -- 172.21.15.88:0/816642446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c136730 con 0x7f7e1c0049b0 2020-02-11T16:07:02.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:02.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.930+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:02.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.931+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:02.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.931+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:02.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.931+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:02.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.931+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:02.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.931+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e2c00f230 con 0x7f7e1c0049b0 2020-02-11T16:07:02.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.932+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c00f390 con 0x7f7e1c0049b0 2020-02-11T16:07:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.932+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e2c00f7b0 con 0x7f7e1c0049b0 2020-02-11T16:07:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.932+0000 7f7e42ad4700 1 -- 172.21.15.88:0/816642446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3c1360a0 con 0x7f7e1c0049b0 2020-02-11T16:07:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.932+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7e2c00f9d0 con 0x7f7e1c0049b0 2020-02-11T16:07:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.932+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:02.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.932+0000 7f7e39ffb700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7e1c03dc80 0x7f7e1c040140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.932+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7e2c04a0c0 con 0x7f7e1c0049b0 2020-02-11T16:07:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.932+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7e1c03dc80 0x7f7e1c040140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:02.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.933+0000 7f7e3bfff700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7e1c03dc80 0x7f7e1c040140 crc :-1 s=READY pgs=122 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:02.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.935+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:02.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:02.935+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f7e2c02f6a0 con 0x7f7e1c0049b0 2020-02-11T16:07:03.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.121+0000 7f7e42ad4700 1 -- 172.21.15.88:0/816642446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7e3c0565b0 con 0x7f7e1c0049b0 2020-02-11T16:07:03.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.122+0000 7f7e40870700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.122+0000 7f7e39ffb700 1 -- 172.21.15.88:0/816642446 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7f7e2c0321b0 con 0x7f7e1c0049b0 2020-02-11T16:07:03.125 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":20,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:03.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.123+0000 7f7e42ad4700 1 -- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7e1c03dc80 msgr2=0x7f7e1c040140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.123+0000 7f7e42ad4700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7e1c03dc80 0x7f7e1c040140 crc :-1 s=READY pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.123+0000 7f7e42ad4700 1 -- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 msgr2=0x7f7e1c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.123+0000 7f7e42ad4700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f7e2c003780 tx=0x7f7e2c010c80).stop 2020-02-11T16:07:03.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.123+0000 7f7e42ad4700 1 -- 172.21.15.88:0/816642446 shutdown_connections 2020-02-11T16:07:03.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.123+0000 7f7e42ad4700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7e1c03dc80 0x7f7e1c040140 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.123+0000 7f7e42ad4700 1 --2- 172.21.15.88:0/816642446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e1c0049b0 0x7f7e1c004db0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.123+0000 7f7e42ad4700 1 -- 172.21.15.88:0/816642446 >> 172.21.15.88:0/816642446 conn(0x7f7e3c09d110 msgr2=0x7f7e3c0a4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:03.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.123+0000 7f7e42ad4700 1 -- 172.21.15.88:0/816642446 shutdown_connections 2020-02-11T16:07:03.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.123+0000 7f7e42ad4700 1 -- 172.21.15.88:0/816642446 wait complete. 2020-02-11T16:07:03.136 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":20,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:03.136 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:07:03.136 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:07:03.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.239+0000 7fcc4528e700 1 Processor -- start 2020-02-11T16:07:03.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.239+0000 7fcc4528e700 1 -- start start 2020-02-11T16:07:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.239+0000 7fcc4528e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc400a5de0 0x7fcc400a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc4528e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc40134a50 0x7fcc40134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:03.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc4528e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc400a31b0 con 0x7fcc400a18a0 2020-02-11T16:07:03.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc4528e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc400a3570 con 0x7fcc40134a50 2020-02-11T16:07:03.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc4528e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc400a3810 con 0x7fcc400a5de0 2020-02-11T16:07:03.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3effd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcc400a18a0 0x7fcc400a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40320/0 (socket says 172.21.15.88:40320) 2020-02-11T16:07:03.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3f7fe700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fcc40134a50 msgr2=0x7fcc40134ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:07:03.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3effd700 1 -- 172.21.15.88:0/390652599 learned_addr learned my addr 172.21.15.88:0/390652599 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:03.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/390652599 >> v2:172.21.15.52:3300/0 conn(0x7fcc40134a50 0x7fcc40134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:03.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc400a5de0 0x7fcc400a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713430001 0 0) 0x7fcc400a31b0 con 0x7fcc400a18a0 2020-02-11T16:07:03.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc20003230 con 0x7fcc400a18a0 2020-02-11T16:07:03.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4058174035 0 0) 0x7fcc20003230 con 0x7fcc400a18a0 2020-02-11T16:07:03.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc400a5de0 msgr2=0x7fcc400a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:03.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc400a5de0 0x7fcc400a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:03.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 >> v2:172.21.15.52:3300/0 conn(0x7fcc40134a50 msgr2=0x7fcc40134ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:03.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 --2- 172.21.15.88:0/390652599 >> v2:172.21.15.52:3300/0 conn(0x7fcc40134a50 0x7fcc40134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:03.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc400a3ab0 con 0x7fcc400a18a0 2020-02-11T16:07:03.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fcc38001a50 con 0x7fcc400a18a0 2020-02-11T16:07:03.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 >> v1:172.21.15.88:6789/0 conn(0x7fcc400a18a0 legacy=0x7fcc400a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc20003750 0x7fcc20003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:03.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc400a5de0 0x7fcc200044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:03.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc20004930 0x7fcc20004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:03.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc400a3570 con 0x7fcc20003750 2020-02-11T16:07:03.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc400a3810 con 0x7fcc20004930 2020-02-11T16:07:03.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20005380 con 0x7fcc400a5de0 2020-02-11T16:07:03.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3effd700 1 -- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc20003750 msgr2=0x7fcc20003b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:07:03.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3effd700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc20003750 0x7fcc20003b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:03.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc20004930 0x7fcc20004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.240+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc400a5de0 0x7fcc200044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 -- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc400a5de0 msgr2=0x7fcc200044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:03.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc400a5de0 0x7fcc200044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:03.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 -- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc20003750 msgr2=0x7fcc20003b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:03.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc20003750 0x7fcc20003b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 -- 172.21.15.88:0/390652599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc20003230 con 0x7fcc20004930 2020-02-11T16:07:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc20004930 0x7fcc20004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcc30005750 tx=0x7fcc300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc20004930 0x7fcc20004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcc30005750 tx=0x7fcc300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc20004930 0x7fcc20004db0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fcc30005750 tx=0x7fcc300088e0).ready entity=mon.1 client_cookie=dc860da0d7bcc63b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc20004930 0x7fcc20004db0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fcc30005750 tx=0x7fcc300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc30003e10 con 0x7fcc20004930 2020-02-11T16:07:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc20004930 0x7fcc20004db0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fcc30005750 tx=0x7fcc300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc20004930 0x7fcc20004db0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fcc30005750 tx=0x7fcc300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc30008950 con 0x7fcc20004930 2020-02-11T16:07:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3dffb700 1 -- 172.21.15.88:0/390652599 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc30008d30 con 0x7fcc20004930 2020-02-11T16:07:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc4528e700 1 -- 172.21.15.88:0/390652599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc20004930 msgr2=0x7fcc20004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc4528e700 1 --2- 172.21.15.88:0/390652599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc20004930 0x7fcc20004db0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fcc30005750 tx=0x7fcc300088e0).stop 2020-02-11T16:07:03.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc3f7fe700 1 -- 172.21.15.88:0/390652599 reap_dead start 2020-02-11T16:07:03.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc4528e700 1 -- 172.21.15.88:0/390652599 shutdown_connections 2020-02-11T16:07:03.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc4528e700 1 -- 172.21.15.88:0/390652599 >> 172.21.15.88:0/390652599 conn(0x7fcc4009d110 msgr2=0x7fcc4009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:03.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc4528e700 1 -- 172.21.15.88:0/390652599 shutdown_connections 2020-02-11T16:07:03.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.241+0000 7fcc4528e700 1 -- 172.21.15.88:0/390652599 wait complete. 2020-02-11T16:07:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.242+0000 7fcc4528e700 1 Processor -- start 2020-02-11T16:07:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.242+0000 7fcc4528e700 1 -- start start 2020-02-11T16:07:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc4528e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc400a94e0 0x7fcc40066c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc4528e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc40130e30 0x7fcc401312e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc4528e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc400a7660 con 0x7fcc40129030 2020-02-11T16:07:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc4528e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc400a4780 con 0x7fcc40130e30 2020-02-11T16:07:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc4528e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc40130a00 con 0x7fcc400a94e0 2020-02-11T16:07:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3e7fc700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fcc40130e30 msgr2=0x7fcc401312e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:07:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc400a94e0 0x7fcc40066c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3e7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc40130e30 0x7fcc401312e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:03.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcc40129030 0x7fcc401294a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40336/0 (socket says 172.21.15.88:40336) 2020-02-11T16:07:03.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc400a94e0 0x7fcc40066c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52706/0 (socket says 172.21.15.88:52706) 2020-02-11T16:07:03.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3f7fe700 1 -- 172.21.15.88:0/364524627 learned_addr learned my addr 172.21.15.88:0/364524627 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:03.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3effd700 1 -- 172.21.15.88:0/364524627 >> v2:172.21.15.52:3300/0 conn(0x7fcc40130e30 msgr2=0x7fcc401312e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:03.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3effd700 1 --2- 172.21.15.88:0/364524627 >> v2:172.21.15.52:3300/0 conn(0x7fcc40130e30 0x7fcc401312e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3effd700 1 -- 172.21.15.88:0/364524627 >> v1:172.21.15.88:6789/0 conn(0x7fcc40129030 legacy=0x7fcc401294a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503072312 0 0) 0x7fcc400a7660 con 0x7fcc40129030 2020-02-11T16:07:03.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3effd700 1 -- 172.21.15.88:0/364524627 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc40067160 con 0x7fcc400a94e0 2020-02-11T16:07:03.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3effd700 1 --2- 172.21.15.88:0/364524627 >> v2:172.21.15.88:3300/0 conn(0x7fcc400a94e0 0x7fcc40066c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc38001510 tx=0x7fcc4012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3effd700 1 --2- 172.21.15.88:0/364524627 >> v2:172.21.15.88:3300/0 conn(0x7fcc400a94e0 0x7fcc40066c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc38001510 tx=0x7fcc4012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3effd700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc400a94e0 0x7fcc40066c50 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fcc38001510 tx=0x7fcc4012f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:03.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.243+0000 7fcc3effd700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc400a94e0 0x7fcc40066c50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fcc38001510 tx=0x7fcc4012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc3800ce70 con 0x7fcc400a94e0 2020-02-11T16:07:03.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc3effd700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc400a94e0 0x7fcc40066c50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fcc38001510 tx=0x7fcc4012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc4528e700 1 -- 172.21.15.88:0/364524627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc40065e90 con 0x7fcc400a94e0 2020-02-11T16:07:03.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc3effd700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc400a94e0 0x7fcc40066c50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fcc38001510 tx=0x7fcc4012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc38004b20 con 0x7fcc400a94e0 2020-02-11T16:07:03.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc3800d0c0 con 0x7fcc400a94e0 2020-02-11T16:07:03.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc4528e700 1 -- 172.21.15.88:0/364524627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc40129bb0 con 0x7fcc400a94e0 2020-02-11T16:07:03.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc3effd700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc400a94e0 0x7fcc40066c50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fcc38001510 tx=0x7fcc4012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc4528e700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 0x7fcc400a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc4528e700 1 -- 172.21.15.88:0/364524627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4005e2f0 con 0x7fcc4012a520 2020-02-11T16:07:03.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fcc3800d380 con 0x7fcc400a94e0 2020-02-11T16:07:03.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.244+0000 7fcc3effd700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc400a94e0 0x7fcc40066c50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fcc38001510 tx=0x7fcc4012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 0x7fcc400a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc37fff700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc24039ab0 0x7fcc2403bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fcc38049b00 con 0x7fcc400a94e0 2020-02-11T16:07:03.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc3e7fc700 1 -- 172.21.15.88:0/364524627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc40129ec0 con 0x7fcc4012a520 2020-02-11T16:07:03.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 0x7fcc400a7fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 0x7fcc400a7fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 0x7fcc400a7fe0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:03.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc24039ab0 0x7fcc2403bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 0x7fcc400a7fe0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc28005e90 con 0x7fcc4012a520 2020-02-11T16:07:03.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc3f7fe700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc24039ab0 0x7fcc2403bf70 crc :-1 s=READY pgs=123 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:03.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 0x7fcc400a7fe0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fcc2800af10 con 0x7fcc4012a520 2020-02-11T16:07:03.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 msgr2=0x7fcc400a7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc37fff700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 0x7fcc400a7fe0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28010bb0).stop 2020-02-11T16:07:03.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 msgr2=0x7fcc400a7fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:03.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.245+0000 7fcc37fff700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a520 0x7fcc400a7fe0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28010bb0).stop 2020-02-11T16:07:03.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.253+0000 7fcc4528e700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 0x7fcc400a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.253+0000 7fcc4528e700 1 -- 172.21.15.88:0/364524627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc40130b40 con 0x7fcc4012a900 2020-02-11T16:07:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.253+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 0x7fcc400a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc3e7fc700 1 -- 172.21.15.88:0/364524627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcc40130840 con 0x7fcc4012a900 2020-02-11T16:07:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 0x7fcc400a8440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28008370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 0x7fcc400a8440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28008370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 0x7fcc400a8440 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28008370).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 0x7fcc400a8440 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28008370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc28008e30 con 0x7fcc4012a900 2020-02-11T16:07:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc3e7fc700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 0x7fcc400a8440 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28008370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4350 (secure 0 0 0) 0x7fcc28010110 con 0x7fcc4012a900 2020-02-11T16:07:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 msgr2=0x7fcc400a8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc37fff700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 0x7fcc400a8440 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fcc28000e50 tx=0x7fcc28008370).stop 2020-02-11T16:07:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc37fff700 1 -- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 msgr2=0x7fcc400a8440 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc37fff700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4012a900 0x7fcc400a8440 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc4528e700 1 -- 172.21.15.88:0/364524627 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc24039ab0 msgr2=0x7fcc2403bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc4528e700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc24039ab0 0x7fcc2403bf70 crc :-1 s=READY pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc4528e700 1 -- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc400a94e0 msgr2=0x7fcc40066c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc4528e700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc400a94e0 0x7fcc40066c50 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fcc38001510 tx=0x7fcc4012f3b0).stop 2020-02-11T16:07:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc3f7fe700 1 -- 172.21.15.88:0/364524627 reap_dead start 2020-02-11T16:07:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.254+0000 7fcc3f7fe700 1 -- 172.21.15.88:0/364524627 reap_dead start 2020-02-11T16:07:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.255+0000 7fcc4528e700 1 -- 172.21.15.88:0/364524627 shutdown_connections 2020-02-11T16:07:03.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.255+0000 7fcc4528e700 1 --2- 172.21.15.88:0/364524627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc400a94e0 0x7fcc40066c50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.255+0000 7fcc4528e700 1 -- 172.21.15.88:0/364524627 >> 172.21.15.88:0/364524627 conn(0x7fcc4009d110 msgr2=0x7fcc40069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:03.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.255+0000 7fcc4528e700 1 -- 172.21.15.88:0/364524627 shutdown_connections 2020-02-11T16:07:03.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.255+0000 7fcc4528e700 1 -- 172.21.15.88:0/364524627 wait complete. 2020-02-11T16:07:03.290 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:07:03.290 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:07:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 20, 2020-02-11T16:07:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:07:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:07:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:07:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:07:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:07:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:07:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:03.292 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:07:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:07:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:03.293 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:07:03.294 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:07:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:07:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:07:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:07:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:07:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:03.295 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:07:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:07:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:07:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:03.296 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:07:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:07:03.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:03.298 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:07:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:07:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.299 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:07:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:07:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:03.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.301 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:07:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:07:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.302 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:07:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:07:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:03.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.304 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:07:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:07:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.305 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:07:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:07:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:03.306 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:07:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:07:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:03.307 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:07:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:03.308 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:07:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:03.309 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:07:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:07:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:03.310 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:07:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:07:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:03.311 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.312 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:07:03.312 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:07:03.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.426+0000 7f6071012700 1 Processor -- start 2020-02-11T16:07:03.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.427+0000 7f6071012700 1 -- start start 2020-02-11T16:07:03.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.427+0000 7f6071012700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f606c0a0d90 0x7f606c1322f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:03.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.427+0000 7f6071012700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c09de90 con 0x7f606c0a2980 2020-02-11T16:07:03.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.427+0000 7f6071012700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c0a3e10 con 0x7f606c0a5de0 2020-02-11T16:07:03.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.427+0000 7f6071012700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606c0a3c00 con 0x7f606c0a0d90 2020-02-11T16:07:03.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.427+0000 7f606bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f606c0a5de0 0x7f606c131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40344/0 (socket says 172.21.15.88:40344) 2020-02-11T16:07:03.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.427+0000 7f606bfff700 1 -- 172.21.15.88:0/3888506250 learned_addr learned my addr 172.21.15.88:0/3888506250 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:03.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.427+0000 7f6070811700 1 -- 172.21.15.88:0/3888506250 >> v1:172.21.15.52:6789/0 conn(0x7f606c0a2980 legacy=0x7f606c13f3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:07:03.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.427+0000 7f606b7fe700 1 -- 172.21.15.88:0/3888506250 >> v2:172.21.15.52:3300/0 conn(0x7f606c0a0d90 msgr2=0x7f606c1322f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:07:03.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.427+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3888506250 >> v2:172.21.15.52:3300/0 conn(0x7f606c0a0d90 0x7f606c1322f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:03.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109115925 0 0) 0x7f606c0a3e10 con 0x7f606c0a5de0 2020-02-11T16:07:03.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f604c003230 con 0x7f606c0a5de0 2020-02-11T16:07:03.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3741492399 0 0) 0x7f604c003230 con 0x7f606c0a5de0 2020-02-11T16:07:03.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 >> v2:172.21.15.52:3300/0 conn(0x7f606c0a0d90 msgr2=0x7f606c1322f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:03.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 --2- 172.21.15.88:0/3888506250 >> v2:172.21.15.52:3300/0 conn(0x7f606c0a0d90 0x7f606c1322f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:03.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 >> v1:172.21.15.52:6789/0 conn(0x7f606c0a2980 legacy=0x7f606c13f3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:03.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c09e0c0 con 0x7f606c0a5de0 2020-02-11T16:07:03.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f6054001850 con 0x7f606c0a5de0 2020-02-11T16:07:03.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 >> v1:172.21.15.88:6789/0 conn(0x7f606c0a5de0 legacy=0x7f606c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f604c003720 0x7f604c003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:03.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 0x7f604c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:03.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f604c004a40 0x7f604c004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:03.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c0a3c00 con 0x7f604c004a40 2020-02-11T16:07:03.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c00b810 con 0x7f604c003ff0 2020-02-11T16:07:03.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c00dbe0 con 0x7f604c003720 2020-02-11T16:07:03.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f6070811700 1 -- 172.21.15.88:0/3888506250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f604c004a40 msgr2=0x7f604c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:07:03.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 0x7f604c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f6070811700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f604c004a40 0x7f604c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:03.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606bfff700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f604c003720 0x7f604c003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606b7fe700 1 -- 172.21.15.88:0/3888506250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f604c003720 msgr2=0x7f604c003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:03.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f604c003720 0x7f604c003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:03.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606b7fe700 1 -- 172.21.15.88:0/3888506250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f604c004a40 msgr2=0x7f604c004ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:03.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f604c004a40 0x7f604c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:03.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606b7fe700 1 -- 172.21.15.88:0/3888506250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c003230 con 0x7f604c003ff0 2020-02-11T16:07:03.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f6070811700 1 -- 172.21.15.88:0/3888506250 reap_dead start 2020-02-11T16:07:03.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606bfff700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f604c003720 0x7f604c003b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:07:03.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 0x7f604c0044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f605c005800 tx=0x7f605c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 0x7f604c0044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f605c005800 tx=0x7f605c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.428+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 0x7f604c0044d0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f605c005800 tx=0x7f605c00fe20).ready entity=mon.1 client_cookie=e33d2ac57c9528d1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:03.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 0x7f604c0044d0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f605c005800 tx=0x7f605c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605c0089d0 con 0x7f604c003ff0 2020-02-11T16:07:03.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 0x7f604c0044d0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f605c005800 tx=0x7f605c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c008b30 con 0x7f604c003ff0 2020-02-11T16:07:03.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 0x7f604c0044d0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f605c005800 tx=0x7f605c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f606affd700 1 -- 172.21.15.88:0/3888506250 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605c010410 con 0x7f604c003ff0 2020-02-11T16:07:03.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f6071012700 1 -- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 msgr2=0x7f604c0044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f6071012700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 0x7f604c0044d0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f605c005800 tx=0x7f605c00fe20).stop 2020-02-11T16:07:03.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f6071012700 1 -- 172.21.15.88:0/3888506250 shutdown_connections 2020-02-11T16:07:03.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f6071012700 1 --2- 172.21.15.88:0/3888506250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f604c003ff0 0x7f604c0044d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f6071012700 1 -- 172.21.15.88:0/3888506250 >> 172.21.15.88:0/3888506250 conn(0x7f606c0a9fb0 msgr2=0x7f606c0aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:03.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f6071012700 1 -- 172.21.15.88:0/3888506250 shutdown_connections 2020-02-11T16:07:03.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.429+0000 7f6071012700 1 -- 172.21.15.88:0/3888506250 wait complete. 2020-02-11T16:07:03.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.430+0000 7f6071012700 1 Processor -- start 2020-02-11T16:07:03.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.430+0000 7f6071012700 1 -- start start 2020-02-11T16:07:03.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6071012700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f604c003ff0 0x7f606c1348e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6071012700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c066160 0x7f606c140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6071012700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f606c138dd0 0x7f606c139220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6071012700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606c0670b0 con 0x7f604c003ff0 2020-02-11T16:07:03.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6071012700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606c065a40 con 0x7f606c138dd0 2020-02-11T16:07:03.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6071012700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c066670 con 0x7f606c066160 2020-02-11T16:07:03.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f606c138dd0 0x7f606c139220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f606bfff700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f604c003ff0 msgr2=0x7f606c1348e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:07:03.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f606bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f604c003ff0 0x7f606c1348e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:03.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f606c138dd0 0x7f606c139220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52734/0 (socket says 172.21.15.88:52734) 2020-02-11T16:07:03.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 -- 172.21.15.88:0/3386564282 learned_addr learned my addr 172.21.15.88:0/3386564282 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:03.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c066160 0x7f606c140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 -- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c066160 msgr2=0x7f606c140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c066160 0x7f606c140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 -- 172.21.15.88:0/3386564282 >> v2:172.21.15.52:3300/0 conn(0x7f604c003ff0 msgr2=0x7f606c1348e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:03.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 --2- 172.21.15.88:0/3386564282 >> v2:172.21.15.52:3300/0 conn(0x7f604c003ff0 0x7f606c1348e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 -- 172.21.15.88:0/3386564282 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c0672e0 con 0x7f606c138dd0 2020-02-11T16:07:03.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c066160 0x7f606c140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:07:03.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 --2- 172.21.15.88:0/3386564282 >> v2:172.21.15.88:3300/0 conn(0x7f606c138dd0 0x7f606c139220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f606c0a7ab0 tx=0x7f604c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 --2- 172.21.15.88:0/3386564282 >> v2:172.21.15.88:3300/0 conn(0x7f606c138dd0 0x7f606c139220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f606c0a7ab0 tx=0x7f604c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c138dd0 0x7f606c139220 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f606c0a7ab0 tx=0x7f604c005480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:03.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c138dd0 0x7f606c139220 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f606c0a7ab0 tx=0x7f604c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c138dd0 0x7f606c139220 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f606c0a7ab0 tx=0x7f604c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60640115c0 con 0x7f606c138dd0 2020-02-11T16:07:03.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6070811700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c138dd0 0x7f606c139220 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f606c0a7ab0 tx=0x7f604c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064011720 con 0x7f606c138dd0 2020-02-11T16:07:03.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6071012700 1 -- 172.21.15.88:0/3386564282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606c134440 con 0x7f606c138dd0 2020-02-11T16:07:03.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6064011a80 con 0x7f606c138dd0 2020-02-11T16:07:03.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.432+0000 7f6071012700 1 -- 172.21.15.88:0/3386564282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c132e70 con 0x7f606c138dd0 2020-02-11T16:07:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.433+0000 7f6070811700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c138dd0 0x7f606c139220 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f606c0a7ab0 tx=0x7f604c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.433+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6064003b40 con 0x7f606c138dd0 2020-02-11T16:07:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.433+0000 7f6070811700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c138dd0 0x7f606c139220 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f606c0a7ab0 tx=0x7f604c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.433+0000 7f6071012700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 0x7f606c0a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.433+0000 7f6071012700 1 -- 172.21.15.88:0/3386564282 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c0565b0 con 0x7f606c139680 2020-02-11T16:07:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.433+0000 7f60697fa700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6050039b20 0x7f605003bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.433+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 0x7f606c0a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.433+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f60640496c0 con 0x7f606c138dd0 2020-02-11T16:07:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.433+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6050039b20 0x7f605003bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f606bfff700 1 -- 172.21.15.88:0/3386564282 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f606c05e2f0 con 0x7f606c139680 2020-02-11T16:07:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 0x7f606c0a8df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f606b7fe700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6050039b20 0x7f605003bfe0 crc :-1 s=READY pgs=124 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 0x7f606c0a8df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 0x7f606c0a8df0 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 0x7f606c0a8df0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605400c9f0 con 0x7f606c139680 2020-02-11T16:07:03.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 0x7f606c0a8df0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f605400cb50 con 0x7f606c139680 2020-02-11T16:07:03.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 msgr2=0x7f606c0a8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f60697fa700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 0x7f606c0a8df0 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).stop 2020-02-11T16:07:03.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 msgr2=0x7f606c0a8df0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:03.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.434+0000 7f60697fa700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c139680 0x7f606c0a8df0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.442+0000 7f6071012700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 0x7f606c1448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:03.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.442+0000 7f6071012700 1 -- 172.21.15.88:0/3386564282 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c066e50 con 0x7f606c1444c0 2020-02-11T16:07:03.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.442+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 0x7f606c1448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:03.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f606bfff700 1 -- 172.21.15.88:0/3386564282 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f606c134640 con 0x7f606c1444c0 2020-02-11T16:07:03.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 0x7f606c1448a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 0x7f606c1448a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 0x7f606c1448a0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:03.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 0x7f606c1448a0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605400b870 con 0x7f606c1444c0 2020-02-11T16:07:03.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f606bfff700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 0x7f606c1448a0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:03.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4348 (secure 0 0 0) 0x7f605400fe30 con 0x7f606c1444c0 2020-02-11T16:07:03.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 msgr2=0x7f606c1448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f60697fa700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 0x7f606c1448a0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f6054002e00 tx=0x7f606c0a61c0).stop 2020-02-11T16:07:03.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f60697fa700 1 -- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 msgr2=0x7f606c1448a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:03.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.443+0000 7f60697fa700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f606c1444c0 0x7f606c1448a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.444+0000 7f6071012700 1 -- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6050039b20 msgr2=0x7f605003bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.444+0000 7f6071012700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6050039b20 0x7f605003bfe0 crc :-1 s=READY pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.444+0000 7f6071012700 1 -- 172.21.15.88:0/3386564282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c138dd0 msgr2=0x7f606c139220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.444+0000 7f6071012700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c138dd0 0x7f606c139220 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f606c0a7ab0 tx=0x7f604c005480).stop 2020-02-11T16:07:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.444+0000 7f6070811700 1 -- 172.21.15.88:0/3386564282 reap_dead start 2020-02-11T16:07:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.444+0000 7f6071012700 1 -- 172.21.15.88:0/3386564282 shutdown_connections 2020-02-11T16:07:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.444+0000 7f6071012700 1 --2- 172.21.15.88:0/3386564282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c138dd0 0x7f606c139220 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.444+0000 7f6071012700 1 -- 172.21.15.88:0/3386564282 >> 172.21.15.88:0/3386564282 conn(0x7f606c0a9fb0 msgr2=0x7f606c0a1320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:03.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.444+0000 7f6071012700 1 -- 172.21.15.88:0/3386564282 shutdown_connections 2020-02-11T16:07:03.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:03.444+0000 7f6071012700 1 -- 172.21.15.88:0/3386564282 wait complete. 2020-02-11T16:07:03.482 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:07:03.482 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:03.482 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:03.482 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:07:03.482 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 20, 2020-02-11T16:07:03.483 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:07:03.483 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:07:03.483 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:07:03.483 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.483 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:07:03.483 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:03.483 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:07:03.484 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:07:03.484 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:03.484 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:03.484 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:03.484 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:03.484 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:03.486 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:03.487 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.487 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:07:03.487 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:07:03.487 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:03.487 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:03.487 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:03.488 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:03.488 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:03.488 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:03.488 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.488 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:07:03.488 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:07:03.488 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:07:03.489 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:07:03.489 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:07:03.489 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:07:03.489 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:03.489 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:03.489 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:07:03.490 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:07:03.490 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:03.490 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:07:03.490 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:03.490 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:03.490 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:03.490 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:03.490 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:03.491 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:03.491 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.491 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:07:03.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.491 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:07:03.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.491 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:03.492 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:03.492 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:03.492 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:03.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.492 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:03.492 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:07:03.492 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.493 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:03.493 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:07:03.493 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.493 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.493 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.494 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:07:03.494 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:07:03.494 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:03.494 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:03.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.494 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:03.495 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:03.495 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:03.495 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:03.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.495 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:03.495 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:07:03.495 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.496 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:03.496 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:07:03.496 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.496 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.496 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.497 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:07:03.497 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:07:03.497 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:03.497 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:03.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.497 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:03.498 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:03.498 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:03.498 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:03.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.498 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:03.498 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:07:03.498 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.499 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:03.499 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:07:03.499 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:03.499 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.499 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.500 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:07:03.500 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:07:03.500 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:03.500 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:03.500 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.500 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:03.500 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:07:03.501 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:07:03.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.501 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:03.501 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:03.501 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:03.501 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.501 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.502 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:07:03.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.502 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:03.502 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:03.502 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:03.502 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.502 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.503 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:07:03.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.503 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:03.503 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:03.503 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:07:03.503 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.503 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.503 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:07:03.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.504 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:03.504 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:03.504 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:07:03.504 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.504 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:03.504 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:07:03.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:03.505 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:03.505 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:03.505 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:03.505 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.505 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:03.505 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:03.506 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:07:03.506 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:07:11.749 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:07:11.752 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:07:23.506 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:07:23.507 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2020-02-11T16:07:23.507 INFO:tasks.ceph.mon.b:Restarting daemon 2020-02-11T16:07:23.507 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-02-11T16:07:23.510 INFO:tasks.ceph.mon.b:Started 2020-02-11T16:07:23.510 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:07:23.510 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:07:23.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.635+0000 7f9d72701700 1 Processor -- start 2020-02-11T16:07:23.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.635+0000 7f9d72701700 1 -- start start 2020-02-11T16:07:23.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.635+0000 7f9d72701700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:23.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.635+0000 7f9d72701700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:23.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.635+0000 7f9d72701700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6c0a3570 con 0x7f9d6c0a5de0 2020-02-11T16:07:23.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.635+0000 7f9d72701700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6c0a3810 con 0x7f9d6c0a6260 2020-02-11T16:07:23.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.635+0000 7f9d72701700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c0a3ab0 con 0x7f9d6c0a18a0 2020-02-11T16:07:23.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.635+0000 7f9d6b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9d6c0a5de0 0x7f9d6c12e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40370/0 (socket says 172.21.15.88:40370) 2020-02-11T16:07:23.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.635+0000 7f9d6b7fe700 1 -- 172.21.15.88:0/1149428603 learned_addr learned my addr 172.21.15.88:0/1149428603 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:23.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.636+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:23.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.636+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:23.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.636+0000 7f9d6bfff700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:07:23.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.636+0000 7f9d6bfff700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:23.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.636+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:07:23.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.636+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:23.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.636+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:23.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.636+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:23.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.636+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:23.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.636+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:23.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.837+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:23.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.837+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:23.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.837+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:07:23.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.837+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:23.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.837+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:23.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.837+0000 7f9d6bfff700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:07:23.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.837+0000 7f9d6bfff700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:23.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.837+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:07:23.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.837+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:23.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:23.837+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:07:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:24.238+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:24.238+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:24.238+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:07:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:24.238+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:24.238+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:24.238+0000 7f9d6bfff700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:07:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:24.238+0000 7f9d6bfff700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:24.238+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:24.238+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:07:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:24.238+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:07:25.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:25.039+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:25.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:25.039+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:25.039+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:07:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:25.039+0000 7f9d6bfff700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:07:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:25.039+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:25.039+0000 7f9d6bfff700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:25.040+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:25.039+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:25.040+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:07:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:25.040+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:07:26.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:26.642+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:26.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:26.642+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:26.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:26.642+0000 7f9d6bfff700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:07:26.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:26.642+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:07:26.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:26.642+0000 7f9d6bfff700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:26.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:26.642+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:26.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:26.642+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:26.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:26.642+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:26.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:26.642+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:07:26.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:26.642+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:07:26.857 INFO:tasks.workunit.client.0.smithi088.stderr:Note: checking out '71281e48a442b0f38f812cad32658ed72c6d8ff5'. 2020-02-11T16:07:26.858 INFO:tasks.workunit.client.0.smithi088.stderr: 2020-02-11T16:07:26.858 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-02-11T16:07:26.858 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2020-02-11T16:07:26.858 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by performing another checkout. 2020-02-11T16:07:26.859 INFO:tasks.workunit.client.0.smithi088.stderr: 2020-02-11T16:07:26.861 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2020-02-11T16:07:26.861 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-02-11T16:07:26.861 INFO:tasks.workunit.client.0.smithi088.stderr: 2020-02-11T16:07:26.861 INFO:tasks.workunit.client.0.smithi088.stderr: git checkout -b 2020-02-11T16:07:26.862 INFO:tasks.workunit.client.0.smithi088.stderr: 2020-02-11T16:07:26.862 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at 71281e48a4 Merge PR #33194 into wip-pdonnell-testing-20200211.032856 2020-02-11T16:07:26.863 INFO:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-02-11T16:07:26.882 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-02-11T16:07:26.883 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-02-11T16:07:26.884 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-02-11T16:07:27.439 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-02-11T16:07:27.490 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-02-11T16:07:27.527 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-02-11T16:07:27.528 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-02-11T16:07:27.528 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-02-11T16:07:27.564 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-02-11T16:07:27.624 DEBUG:teuthology.orchestra.remote:smithi088:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-02-11T16:07:27.672 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2020-02-11T16:07:27.672 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2020-02-11T16:07:27.673 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2020-02-11T16:07:27.698 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:07:29.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.845+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.845+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.845+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 msgr2=0x7f9d6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:29.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.845+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:29.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.845+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 >> v1:172.21.15.88:6789/0 conn(0x7f9d6c0a5de0 legacy=0x7f9d6c12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:29.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.845+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1149428603 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c0a3d50 con 0x7f9d6c0a6260 2020-02-11T16:07:29.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.845+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.845+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c12eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.845+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c12eab0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).ready entity=mon.0 client_cookie=ff28b3a795b6be6e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:29.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.848+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c12eab0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.848+0000 7f9d6affd700 1 -- 172.21.15.88:0/1149428603 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d64014160 con 0x7f9d6c0a6260 2020-02-11T16:07:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.849+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c12eab0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.849+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c12eab0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.849+0000 7f9d6affd700 1 -- 172.21.15.88:0/1149428603 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d640142c0 con 0x7f9d6c0a6260 2020-02-11T16:07:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.849+0000 7f9d6affd700 1 -- 172.21.15.88:0/1149428603 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d640146a0 con 0x7f9d6c0a6260 2020-02-11T16:07:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.849+0000 7f9d72701700 1 -- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 msgr2=0x7f9d6c12eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.849+0000 7f9d72701700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c12eab0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).stop 2020-02-11T16:07:29.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.850+0000 7f9d72701700 1 -- 172.21.15.88:0/1149428603 shutdown_connections 2020-02-11T16:07:29.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.850+0000 7f9d72701700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c12eab0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:29.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.850+0000 7f9d72701700 1 --2- 172.21.15.88:0/1149428603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d6c0a18a0 0x7f9d6c0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:29.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.850+0000 7f9d72701700 1 -- 172.21.15.88:0/1149428603 >> 172.21.15.88:0/1149428603 conn(0x7f9d6c09d110 msgr2=0x7f9d6c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:29.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.850+0000 7f9d72701700 1 -- 172.21.15.88:0/1149428603 shutdown_connections 2020-02-11T16:07:29.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.850+0000 7f9d72701700 1 -- 172.21.15.88:0/1149428603 wait complete. 2020-02-11T16:07:29.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.851+0000 7f9d72701700 1 Processor -- start 2020-02-11T16:07:29.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.851+0000 7f9d72701700 1 -- start start 2020-02-11T16:07:29.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f9d72701700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c135190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:29.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f9d72701700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6c1357c0 con 0x7f9d6c0a18a0 2020-02-11T16:07:29.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f9d72701700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6c1328f0 con 0x7f9d6c0a5de0 2020-02-11T16:07:29.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f9d72701700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6c132b90 con 0x7f9d6c0a6260 2020-02-11T16:07:29.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f9d6b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9d6c0a5de0 0x7f9d6c133030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40418/0 (socket says 172.21.15.88:40418) 2020-02-11T16:07:29.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f9d6bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9d6c0a18a0 0x7f9d6c128420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60430/0 (socket says 172.21.15.88:60430) 2020-02-11T16:07:29.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f9d6b7fe700 1 -- 172.21.15.88:0/1381231354 learned_addr learned my addr 172.21.15.88:0/1381231354 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:29.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995085477 0 0) 0x7f9d6c1328f0 con 0x7f9d6c0a5de0 2020-02-11T16:07:29.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d4c002fe0 con 0x7f9d6c0a5de0 2020-02-11T16:07:29.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246190387 0 0) 0x7f9d6c1357c0 con 0x7f9d6c0a18a0 2020-02-11T16:07:29.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d6c1328f0 con 0x7f9d6c0a18a0 2020-02-11T16:07:29.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1381231354 >> v1:172.21.15.88:6789/0 conn(0x7f9d6c0a5de0 legacy=0x7f9d6c133030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:29.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1381231354 >> v1:172.21.15.52:6789/0 conn(0x7f9d6c0a18a0 legacy=0x7f9d6c128420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:29.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d70c9e700 1 -- 172.21.15.88:0/1381231354 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c128b30 con 0x7f9d6c0a6260 2020-02-11T16:07:29.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> v2:172.21.15.52:3300/0 conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:29.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d64005c30 con 0x7f9d6c0a6260 2020-02-11T16:07:29.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d64005d90 con 0x7f9d6c0a6260 2020-02-11T16:07:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d72701700 1 -- 172.21.15.88:0/1381231354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6c133740 con 0x7f9d6c0a6260 2020-02-11T16:07:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d64007340 con 0x7f9d6c0a6260 2020-02-11T16:07:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f9d72701700 1 -- 172.21.15.88:0/1381231354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6c0a85a0 con 0x7f9d6c0a6260 2020-02-11T16:07:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.854+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.854+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f9d640075b0 con 0x7f9d6c0a6260 2020-02-11T16:07:29.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.854+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.854+0000 7f9d72701700 1 -- 172.21.15.88:0/1381231354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6c1355f0 con 0x7f9d6c0a6260 2020-02-11T16:07:29.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.854+0000 7f9d697fa700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d4c03a160 0x7f9d4c03c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:29.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.855+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f9d6404e320 con 0x7f9d6c0a6260 2020-02-11T16:07:29.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.855+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d4c03a160 0x7f9d4c03c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.855+0000 7f9d6bfff700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d4c03a160 0x7f9d4c03c620 crc :-1 s=READY pgs=126 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:29.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.859+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:29.859+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f9d64033a00 con 0x7f9d6c0a6260 2020-02-11T16:07:29.869 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.781+0000 7f20b9da3700 1 Processor -- start 2020-02-11T16:07:29.869 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.781+0000 7f20b9da3700 1 -- start start 2020-02-11T16:07:29.869 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.781+0000 7f20b9da3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:29.869 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.781+0000 7f20b9da3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:29.870 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.781+0000 7f20b9da3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b40a37e0 con 0x7f20b40a14c0 2020-02-11T16:07:29.870 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.781+0000 7f20b9da3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b40a24e0 con 0x7f20b4099fa0 2020-02-11T16:07:29.870 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.781+0000 7f20b9da3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40a4350 con 0x7f20b405ac40 2020-02-11T16:07:29.870 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.781+0000 7f20b8b41700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.870 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b8b41700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52762/0 (socket says 172.21.15.88:52762) 2020-02-11T16:07:29.870 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 learned_addr learned my addr 172.21.15.88:0/736665745 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:29.870 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 msgr2=0x7f20b414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-02-11T16:07:29.870 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 msgr2=0x7f20b414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:29.871 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:29.871 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:29.871 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.871 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b3fff700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 msgr2=0x7f20b40a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:07:29.871 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b3fff700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 msgr2=0x7f20b40a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:29.871 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:29.871 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.782+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:29.872 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.983+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.872 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.983+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 msgr2=0x7f20b414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-02-11T16:07:29.872 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.983+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 msgr2=0x7f20b414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:29.872 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.983+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:29.872 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.983+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:07:29.872 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.983+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.872 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.983+0000 7f20b3fff700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 msgr2=0x7f20b40a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:07:29.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.983+0000 7f20b3fff700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 msgr2=0x7f20b40a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:29.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.983+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:29.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:27.983+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:07:29.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:28.384+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:28.384+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 msgr2=0x7f20b414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-02-11T16:07:29.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:28.384+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 msgr2=0x7f20b414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:29.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:28.384+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:29.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:28.384+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:07:29.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:28.384+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:28.384+0000 7f20b3fff700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 msgr2=0x7f20b40a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:07:29.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:28.384+0000 7f20b3fff700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 msgr2=0x7f20b40a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:29.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:28.384+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:29.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:28.384+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:07:29.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.185+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.185+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.185+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 msgr2=0x7f20b414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:07:29.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.185+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 msgr2=0x7f20b414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:29.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.185+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:29.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.185+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:07:29.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.185+0000 7f20b3fff700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 msgr2=0x7f20b40a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-02-11T16:07:29.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.185+0000 7f20b3fff700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 msgr2=0x7f20b40a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:29.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.185+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:29.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.185+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:07:29.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.846+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066975010 0 0) 0x7f20b40a37e0 con 0x7f20b40a14c0 2020-02-11T16:07:29.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.846+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a0003230 con 0x7f20b40a14c0 2020-02-11T16:07:29.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.851+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1296196927 0 0) 0x7f20a0003230 con 0x7f20b40a14c0 2020-02-11T16:07:29.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.851+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 msgr2=0x7f20b40a2da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:29.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.851+0000 7f20b37fe700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20b40a2da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:29.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.851+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 msgr2=0x7f20b414f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:29.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.851+0000 7f20b37fe700 1 --2- 172.21.15.88:0/736665745 >> v2:172.21.15.88:3300/0 conn(0x7f20b4099fa0 0x7f20b414f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:29.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.851+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b40a26d0 con 0x7f20b40a14c0 2020-02-11T16:07:29.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.851+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f209c0016d0 con 0x7f20b40a14c0 2020-02-11T16:07:29.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.851+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 >> v1:172.21.15.52:6789/0 conn(0x7f20b40a14c0 legacy=0x7f20b4099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:29.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b37fe700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20a00037d0 0x7f20a0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:29.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b37fe700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20a00044d0 0x7f20a0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:29.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b37fe700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20a0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:29.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40a4350 con 0x7f20a00044d0 2020-02-11T16:07:29.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00042e0 con 0x7f20a00037d0 2020-02-11T16:07:29.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0005240 con 0x7f20b405ac40 2020-02-11T16:07:29.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20a00037d0 0x7f20a0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20a0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20abfff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20a00044d0 0x7f20a0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20a00037d0 msgr2=0x7f20a0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:29.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20a00037d0 0x7f20a0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:29.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20a00044d0 msgr2=0x7f20a0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:29.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20a00044d0 0x7f20a0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:29.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0003230 con 0x7f20b405ac40 2020-02-11T16:07:29.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20abfff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20a00044d0 0x7f20a0004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:07:29.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b3fff700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20a00037d0 0x7f20a0003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:07:29.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20a0004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20ac0032b0 tx=0x7f20a0004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20a0004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20ac0032b0 tx=0x7f20a0004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.852+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20a0004db0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f20ac0032b0 tx=0x7f20a0004420).ready entity=mon.2 client_cookie=8f485d2d729b962b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:29.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20a0004db0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f20ac0032b0 tx=0x7f20a0004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20ac0550c0 con 0x7f20b405ac40 2020-02-11T16:07:29.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20a0004db0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f20ac0032b0 tx=0x7f20a0004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f20b8b41700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20a0004db0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f20ac0032b0 tx=0x7f20a0004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac055220 con 0x7f20b405ac40 2020-02-11T16:07:29.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f20b9da3700 1 -- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 msgr2=0x7f20a0004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:29.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f20b37fe700 1 -- 172.21.15.88:0/736665745 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20ac055580 con 0x7f20b405ac40 2020-02-11T16:07:29.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f20b9da3700 1 --2- 172.21.15.88:0/736665745 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f20b405ac40 0x7f20a0004db0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f20ac0032b0 tx=0x7f20a0004420).stop 2020-02-11T16:07:29.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.853+0000 7f20b8b41700 1 -- 172.21.15.88:0/736665745 reap_dead start 2020-02-11T16:07:29.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.854+0000 7f20b9da3700 1 -- 172.21.15.88:0/736665745 shutdown_connections 2020-02-11T16:07:29.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.854+0000 7f20b9da3700 1 -- 172.21.15.88:0/736665745 >> 172.21.15.88:0/736665745 conn(0x7f20b405c170 msgr2=0x7f20b405a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:29.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.854+0000 7f20b9da3700 1 -- 172.21.15.88:0/736665745 shutdown_connections 2020-02-11T16:07:29.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.854+0000 7f20b9da3700 1 -- 172.21.15.88:0/736665745 wait complete. 2020-02-11T16:07:29.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.855+0000 7f20b9da3700 1 Processor -- start 2020-02-11T16:07:29.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.855+0000 7f20b9da3700 1 -- start start 2020-02-11T16:07:29.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b9da3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20b4077db0 0x7f20b409d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:29.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b9da3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b4077610 con 0x7f20b409dbe0 2020-02-11T16:07:29.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b9da3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b40798f0 con 0x7f20b413c2b0 2020-02-11T16:07:29.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b9da3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b40a4590 con 0x7f20b4077db0 2020-02-11T16:07:29.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b8b41700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f20b413c2b0 0x7f20b4143170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40428/0 (socket says 172.21.15.88:40428) 2020-02-11T16:07:29.883 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b8b41700 1 -- 172.21.15.88:0/3914309884 learned_addr learned my addr 172.21.15.88:0/3914309884 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:29.883 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> v2:172.21.15.52:3300/0 conn(0x7f20b4077db0 0x7f20b409d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.883 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b17fa700 1 -- 172.21.15.88:0/3914309884 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035401841 0 0) 0x7f20b40798f0 con 0x7f20b413c2b0 2020-02-11T16:07:29.883 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b17fa700 1 -- 172.21.15.88:0/3914309884 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2098003230 con 0x7f20b413c2b0 2020-02-11T16:07:29.883 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b3fff700 1 -- 172.21.15.88:0/3914309884 >> v1:172.21.15.88:6789/0 conn(0x7f20b413c2b0 legacy=0x7f20b4143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:29.883 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b3fff700 1 -- 172.21.15.88:0/3914309884 >> v1:172.21.15.52:6789/0 conn(0x7f20b409dbe0 legacy=0x7f20b413bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:29.883 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b3fff700 1 -- 172.21.15.88:0/3914309884 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b40a03c0 con 0x7f20b4077db0 2020-02-11T16:07:29.883 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> v2:172.21.15.52:3300/0 conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> v2:172.21.15.52:3300/0 conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.856+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:29.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.858+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.858+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.858+0000 7f20b17fa700 1 -- 172.21.15.88:0/3914309884 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a4005e90 con 0x7f20b4077db0 2020-02-11T16:07:29.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.858+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.858+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b4079d90 con 0x7f20b4077db0 2020-02-11T16:07:29.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.858+0000 7f20b17fa700 1 -- 172.21.15.88:0/3914309884 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a4007160 con 0x7f20b4077db0 2020-02-11T16:07:29.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.858+0000 7f20b17fa700 1 -- 172.21.15.88:0/3914309884 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a40074c0 con 0x7f20b4077db0 2020-02-11T16:07:29.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.858+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b409f380 con 0x7f20b4077db0 2020-02-11T16:07:29.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.859+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.859+0000 7f20b17fa700 1 -- 172.21.15.88:0/3914309884 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f20a4012370 con 0x7f20b4077db0 2020-02-11T16:07:29.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.859+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.859+0000 7f20b17fa700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2098039f70 0x7f209803c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:29.886 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.860+0000 7f20b17fa700 1 -- 172.21.15.88:0/3914309884 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f20a4049f70 con 0x7f20b4077db0 2020-02-11T16:07:29.886 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.860+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b4079a80 con 0x7f20b4077db0 2020-02-11T16:07:29.886 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.860+0000 7f20abfff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2098039f70 0x7f209803c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:29.886 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.860+0000 7f20abfff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2098039f70 0x7f209803c430 crc :-1 s=READY pgs=127 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:29.886 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.863+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:29.886 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:29.863+0000 7f20b17fa700 1 -- 172.21.15.88:0/3914309884 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f20a402f650 con 0x7f20b4077db0 2020-02-11T16:07:30.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.047+0000 7f9d72701700 1 -- 172.21.15.88:0/1381231354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9d6c133930 con 0x7f9d6c0a6260 2020-02-11T16:07:30.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.047+0000 7f9d70c9e700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.047+0000 7f9d697fa700 1 -- 172.21.15.88:0/1381231354 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7f9d640364d0 con 0x7f9d6c0a6260 2020-02-11T16:07:30.049 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:30.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f9d72701700 1 -- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d4c03a160 msgr2=0x7f9d4c03c620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f9d72701700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d4c03a160 0x7f9d4c03c620 crc :-1 s=READY pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f9d72701700 1 -- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 msgr2=0x7f9d6c135190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f9d72701700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c135190 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f9d6c05bbc0 tx=0x7f9d640101c0).stop 2020-02-11T16:07:30.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f9d72701700 1 -- 172.21.15.88:0/1381231354 shutdown_connections 2020-02-11T16:07:30.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f9d72701700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d4c03a160 0x7f9d4c03c620 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f9d72701700 1 --2- 172.21.15.88:0/1381231354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d6c0a6260 0x7f9d6c135190 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f9d72701700 1 -- 172.21.15.88:0/1381231354 >> 172.21.15.88:0/1381231354 conn(0x7f9d6c09d110 msgr2=0x7f9d6c0a9850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:30.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f9d72701700 1 -- 172.21.15.88:0/1381231354 shutdown_connections 2020-02-11T16:07:30.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f9d72701700 1 -- 172.21.15.88:0/1381231354 wait complete. 2020-02-11T16:07:30.052 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:30.049+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f20b40565b0 con 0x7f20b4077db0 2020-02-11T16:07:30.061 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":28,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:30.061 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:07:30.061 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:07:30.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.166+0000 7f47167f4700 1 Processor -- start 2020-02-11T16:07:30.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.166+0000 7f47167f4700 1 -- start start 2020-02-11T16:07:30.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f47167f4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47100a18a0 0x7f47100a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:30.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f47167f4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47100a5de0 0x7f47100a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:30.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f47167f4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47100a31b0 con 0x7f471012e3a0 2020-02-11T16:07:30.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f47167f4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47100a3570 con 0x7f47100a5de0 2020-02-11T16:07:30.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f47167f4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47100a3810 con 0x7f47100a18a0 2020-02-11T16:07:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47100a5de0 0x7f47100a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f4714d91700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f471012e3a0 0x7f471012e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40436/0 (socket says 172.21.15.88:40436) 2020-02-11T16:07:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47100a5de0 0x7f47100a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52806/0 (socket says 172.21.15.88:52806) 2020-02-11T16:07:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f4714d91700 1 -- 172.21.15.88:0/2836105017 learned_addr learned my addr 172.21.15.88:0/2836105017 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470ffff700 1 --2- 172.21.15.88:0/2836105017 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47100a18a0 0x7f47100a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 -- 172.21.15.88:0/2836105017 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47100a18a0 msgr2=0x7f47100a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:30.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 --2- 172.21.15.88:0/2836105017 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47100a18a0 0x7f47100a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 -- 172.21.15.88:0/2836105017 >> v1:172.21.15.88:6789/0 conn(0x7f471012e3a0 legacy=0x7f471012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 -- 172.21.15.88:0/2836105017 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100a3ab0 con 0x7f47100a5de0 2020-02-11T16:07:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470effd700 1 -- 172.21.15.88:0/2836105017 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944041926 0 0) 0x7f47100a31b0 con 0x7f471012e3a0 2020-02-11T16:07:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470ffff700 1 --2- 172.21.15.88:0/2836105017 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47100a18a0 0x7f47100a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:07:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 --2- 172.21.15.88:0/2836105017 >> v2:172.21.15.88:3300/0 conn(0x7f47100a5de0 0x7f47100a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4704002f30 tx=0x7f47040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 --2- 172.21.15.88:0/2836105017 >> v2:172.21.15.88:3300/0 conn(0x7f47100a5de0 0x7f47100a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4704002f30 tx=0x7f47040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 --2- 172.21.15.88:0/2836105017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a5de0 0x7f47100a6260 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f4704002f30 tx=0x7f47040088e0).ready entity=mon.1 client_cookie=d417a5206858c6f0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 --2- 172.21.15.88:0/2836105017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a5de0 0x7f47100a6260 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4704002f30 tx=0x7f47040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470effd700 1 -- 172.21.15.88:0/2836105017 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4704008e40 con 0x7f47100a5de0 2020-02-11T16:07:30.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 --2- 172.21.15.88:0/2836105017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a5de0 0x7f47100a6260 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4704002f30 tx=0x7f47040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470f7fe700 1 --2- 172.21.15.88:0/2836105017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a5de0 0x7f47100a6260 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4704002f30 tx=0x7f47040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470effd700 1 -- 172.21.15.88:0/2836105017 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47040116a0 con 0x7f47100a5de0 2020-02-11T16:07:30.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f470effd700 1 -- 172.21.15.88:0/2836105017 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4704011a40 con 0x7f47100a5de0 2020-02-11T16:07:30.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f47167f4700 1 -- 172.21.15.88:0/2836105017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a5de0 msgr2=0x7f47100a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.167+0000 7f47167f4700 1 --2- 172.21.15.88:0/2836105017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a5de0 0x7f47100a6260 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f4704002f30 tx=0x7f47040088e0).stop 2020-02-11T16:07:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.168+0000 7f47167f4700 1 -- 172.21.15.88:0/2836105017 shutdown_connections 2020-02-11T16:07:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.168+0000 7f47167f4700 1 --2- 172.21.15.88:0/2836105017 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47100a18a0 0x7f47100a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.168+0000 7f47167f4700 1 --2- 172.21.15.88:0/2836105017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a5de0 0x7f47100a6260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.168+0000 7f47167f4700 1 -- 172.21.15.88:0/2836105017 >> 172.21.15.88:0/2836105017 conn(0x7f471009d110 msgr2=0x7f471009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.168+0000 7f47167f4700 1 -- 172.21.15.88:0/2836105017 shutdown_connections 2020-02-11T16:07:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.168+0000 7f47167f4700 1 -- 172.21.15.88:0/2836105017 wait complete. 2020-02-11T16:07:30.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.169+0000 7f47167f4700 1 Processor -- start 2020-02-11T16:07:30.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.169+0000 7f47167f4700 1 -- start start 2020-02-11T16:07:30.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.169+0000 7f47167f4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47100a18a0 0x7f471009ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f47167f4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f471012e3a0 0x7f471011c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f47167f4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47101365b0 con 0x7f47100a5de0 2020-02-11T16:07:30.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f47167f4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4710066900 con 0x7f471012e3a0 2020-02-11T16:07:30.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f47167f4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4710136b60 con 0x7f47100a18a0 2020-02-11T16:07:30.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f470f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f47100a5de0 0x7f471011bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40440/0 (socket says 172.21.15.88:40440) 2020-02-11T16:07:30.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f470f7fe700 1 -- 172.21.15.88:0/1370147277 learned_addr learned my addr 172.21.15.88:0/1370147277 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:30.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 --2- 172.21.15.88:0/1370147277 >> v2:172.21.15.88:3300/0 conn(0x7f471012e3a0 0x7f471011c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47100a18a0 0x7f471009ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441306730 0 0) 0x7f47101365b0 con 0x7f47100a5de0 2020-02-11T16:07:30.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46f0002fe0 con 0x7f47100a5de0 2020-02-11T16:07:30.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 -- 172.21.15.88:0/1370147277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47100a18a0 msgr2=0x7f471009ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47100a18a0 0x7f471009ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 -- 172.21.15.88:0/1370147277 >> v1:172.21.15.88:6789/0 conn(0x7f47100a5de0 legacy=0x7f471011bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 -- 172.21.15.88:0/1370147277 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100a7600 con 0x7f471012e3a0 2020-02-11T16:07:30.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 --2- 172.21.15.88:0/1370147277 >> v2:172.21.15.88:3300/0 conn(0x7f471012e3a0 0x7f471011c4e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4708001210 tx=0x7f4708010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 --2- 172.21.15.88:0/1370147277 >> v2:172.21.15.88:3300/0 conn(0x7f471012e3a0 0x7f471011c4e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4708001210 tx=0x7f4708010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471012e3a0 0x7f471011c4e0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f4708001210 tx=0x7f4708010c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471012e3a0 0x7f471011c4e0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f4708001210 tx=0x7f4708010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4708005e30 con 0x7f471012e3a0 2020-02-11T16:07:30.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471012e3a0 0x7f471011c4e0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f4708001210 tx=0x7f4708010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f4714d91700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471012e3a0 0x7f471011c4e0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f4708001210 tx=0x7f4708010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4708012400 con 0x7f471012e3a0 2020-02-11T16:07:30.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f47167f4700 1 -- 172.21.15.88:0/1370147277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4710135bc0 con 0x7f471012e3a0 2020-02-11T16:07:30.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4708012820 con 0x7f471012e3a0 2020-02-11T16:07:30.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.170+0000 7f47167f4700 1 -- 172.21.15.88:0/1370147277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471009f4a0 con 0x7f471012e3a0 2020-02-11T16:07:30.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f4714d91700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471012e3a0 0x7f471011c4e0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f4708001210 tx=0x7f4708010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4708012a90 con 0x7f471012e3a0 2020-02-11T16:07:30.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f4714d91700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471012e3a0 0x7f471011c4e0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f4708001210 tx=0x7f4708010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f47167f4700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 0x7f4710066460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f47167f4700 1 -- 172.21.15.88:0/1370147277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471005e2f0 con 0x7f47100a0430 2020-02-11T16:07:30.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 0x7f4710066460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f470d7fa700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f46f0039f70 0x7f46f003c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4708049d50 con 0x7f471012e3a0 2020-02-11T16:07:30.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f470f7fe700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f46f0039f70 0x7f46f003c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f470ffff700 1 -- 172.21.15.88:0/1370147277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47100565b0 con 0x7f47100a0430 2020-02-11T16:07:30.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 0x7f4710066460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 0x7f4710066460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.171+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 0x7f4710066460 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.172+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 0x7f4710066460 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.172+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4700005ab0 con 0x7f47100a0430 2020-02-11T16:07:30.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.172+0000 7f470f7fe700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f46f0039f70 0x7f46f003c430 crc :-1 s=READY pgs=128 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.172+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 0x7f4710066460 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.172+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f4700005c10 con 0x7f47100a0430 2020-02-11T16:07:30.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.172+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 msgr2=0x7f4710066460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.172+0000 7f470d7fa700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 0x7f4710066460 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).stop 2020-02-11T16:07:30.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.172+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 msgr2=0x7f4710066460 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:30.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.172+0000 7f470d7fa700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47100a0430 0x7f4710066460 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).stop 2020-02-11T16:07:30.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f47167f4700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 0x7f47100aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f47167f4700 1 -- 172.21.15.88:0/1370147277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4710136ca0 con 0x7f471011c940 2020-02-11T16:07:30.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 0x7f47100aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470ffff700 1 -- 172.21.15.88:0/1370147277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f471005ccb0 con 0x7f471011c940 2020-02-11T16:07:30.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 0x7f47100aa050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 0x7f47100aa050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 0x7f47100aa050 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 0x7f47100aa050 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4700015c80 con 0x7f471011c940 2020-02-11T16:07:30.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470ffff700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 0x7f47100aa050 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7f470000a430 con 0x7f471011c940 2020-02-11T16:07:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 msgr2=0x7f47100aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470d7fa700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 0x7f47100aa050 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).stop 2020-02-11T16:07:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470d7fa700 1 -- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 msgr2=0x7f47100aa050 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.180+0000 7f470d7fa700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471011c940 0x7f47100aa050 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0x7f4700002f30 tx=0x7f4700010c90).stop 2020-02-11T16:07:30.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f47167f4700 1 -- 172.21.15.88:0/1370147277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f46f0039f70 msgr2=0x7f46f003c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f47167f4700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f46f0039f70 0x7f46f003c430 crc :-1 s=READY pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f47167f4700 1 -- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471012e3a0 msgr2=0x7f471011c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f47167f4700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471012e3a0 0x7f471011c4e0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f4708001210 tx=0x7f4708010c20).stop 2020-02-11T16:07:30.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f4714d91700 1 -- 172.21.15.88:0/1370147277 reap_dead start 2020-02-11T16:07:30.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f4714d91700 1 -- 172.21.15.88:0/1370147277 reap_dead start 2020-02-11T16:07:30.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f47167f4700 1 -- 172.21.15.88:0/1370147277 shutdown_connections 2020-02-11T16:07:30.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f47167f4700 1 --2- 172.21.15.88:0/1370147277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471012e3a0 0x7f471011c4e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f47167f4700 1 -- 172.21.15.88:0/1370147277 >> 172.21.15.88:0/1370147277 conn(0x7f471009d110 msgr2=0x7f47100a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:30.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f47167f4700 1 -- 172.21.15.88:0/1370147277 shutdown_connections 2020-02-11T16:07:30.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.181+0000 7f47167f4700 1 -- 172.21.15.88:0/1370147277 wait complete. 2020-02-11T16:07:30.193 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:07:30.193 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:07:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2020-02-11T16:07:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:07:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:07:30.194 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:07:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:07:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:07:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:07:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:07:30.195 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:30.196 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:07:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:07:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:30.197 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:30.198 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:07:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:07:30.199 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:07:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:07:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:07:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:07:30.200 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:07:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:07:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:30.201 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:07:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:30.202 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.203 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:07:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:07:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:30.204 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.205 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:07:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.208 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:07:30.209 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:07:30.210 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:07:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:30.212 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:07:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:07:30.214 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:07:30.215 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:07:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:07:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:07:30.218 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:07:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:07:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:07:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:07:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:07:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:07:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:07:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:07:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:07:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:07:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.225 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:07:30.227 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:07:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.331+0000 7fcbe49b2700 1 Processor -- start 2020-02-11T16:07:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.331+0000 7fcbe49b2700 1 -- start start 2020-02-11T16:07:30.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.331+0000 7fcbe49b2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcbe00a18a0 0x7fcbe00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:30.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.331+0000 7fcbe49b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe00a31b0 con 0x7fcbe00a5de0 2020-02-11T16:07:30.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.331+0000 7fcbe49b2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe00a3570 con 0x7fcbe00a6260 2020-02-11T16:07:30.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.331+0000 7fcbe49b2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00a3810 con 0x7fcbe00a18a0 2020-02-11T16:07:30.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbded9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcbe00a6260 0x7fcbe012eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40450/0 (socket says 172.21.15.88:40450) 2020-02-11T16:07:30.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbded9d700 1 -- 172.21.15.88:0/2586812207 learned_addr learned my addr 172.21.15.88:0/2586812207 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:30.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbde59c700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcbe00a18a0 0x7fcbe00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377016427 0 0) 0x7fcbe00a3570 con 0x7fcbe00a6260 2020-02-11T16:07:30.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc0003230 con 0x7fcbe00a6260 2020-02-11T16:07:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 752642520 0 0) 0x7fcbc0003230 con 0x7fcbe00a6260 2020-02-11T16:07:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcbe00a18a0 msgr2=0x7fcbe00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcbe00a18a0 0x7fcbe00a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 >> v1:172.21.15.52:6789/0 conn(0x7fcbe00a5de0 legacy=0x7fcbe012e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00a3ab0 con 0x7fcbe00a6260 2020-02-11T16:07:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fcbd8001a50 con 0x7fcbe00a6260 2020-02-11T16:07:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 >> v1:172.21.15.88:6789/0 conn(0x7fcbe00a6260 legacy=0x7fcbe012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcbe00a18a0 0x7fcbc0003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbc0003bb0 0x7fcbc0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbc00045e0 0x7fcbc0004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00a3810 con 0x7fcbc00045e0 2020-02-11T16:07:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0005010 con 0x7fcbc0003bb0 2020-02-11T16:07:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00051d0 con 0x7fcbe00a18a0 2020-02-11T16:07:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbc0003bb0 0x7fcbc0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbde59c700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcbe00a18a0 0x7fcbc0003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbded9d700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbc00045e0 0x7fcbc0004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbddd9b700 1 -- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcbe00a18a0 msgr2=0x7fcbc0003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcbe00a18a0 0x7fcbc0003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbddd9b700 1 -- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbc00045e0 msgr2=0x7fcbc0004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbc00045e0 0x7fcbc0004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.332+0000 7fcbddd9b700 1 -- 172.21.15.88:0/2586812207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0003230 con 0x7fcbc0003bb0 2020-02-11T16:07:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbc0003bb0 0x7fcbc0004010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcbe005b910 tx=0x7fcbc800fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbc0003bb0 0x7fcbc0004010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcbe005b910 tx=0x7fcbc800fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbc0003bb0 0x7fcbc0004010 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7fcbe005b910 tx=0x7fcbc800fd10).ready entity=mon.1 client_cookie=738666d3ab79b261 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbc0003bb0 0x7fcbc0004010 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fcbe005b910 tx=0x7fcbc800fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc8003540 con 0x7fcbc0003bb0 2020-02-11T16:07:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbc0003bb0 0x7fcbc0004010 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fcbe005b910 tx=0x7fcbc800fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbc0003bb0 0x7fcbc0004010 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fcbe005b910 tx=0x7fcbc800fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc80036e0 con 0x7fcbc0003bb0 2020-02-11T16:07:30.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbdd59a700 1 -- 172.21.15.88:0/2586812207 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc8003ac0 con 0x7fcbc0003bb0 2020-02-11T16:07:30.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbe49b2700 1 -- 172.21.15.88:0/2586812207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbc0003bb0 msgr2=0x7fcbc0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbe49b2700 1 --2- 172.21.15.88:0/2586812207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbc0003bb0 0x7fcbc0004010 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7fcbe005b910 tx=0x7fcbc800fd10).stop 2020-02-11T16:07:30.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbded9d700 1 -- 172.21.15.88:0/2586812207 reap_dead start 2020-02-11T16:07:30.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbe49b2700 1 -- 172.21.15.88:0/2586812207 shutdown_connections 2020-02-11T16:07:30.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbe49b2700 1 -- 172.21.15.88:0/2586812207 >> 172.21.15.88:0/2586812207 conn(0x7fcbe009d110 msgr2=0x7fcbe009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbe49b2700 1 -- 172.21.15.88:0/2586812207 shutdown_connections 2020-02-11T16:07:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.333+0000 7fcbe49b2700 1 -- 172.21.15.88:0/2586812207 wait complete. 2020-02-11T16:07:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.334+0000 7fcbe49b2700 1 Processor -- start 2020-02-11T16:07:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.334+0000 7fcbe49b2700 1 -- start start 2020-02-11T16:07:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbe49b2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcbe0137e10 0x7fcbe0131570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbe49b2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcbe0132df0 0x7fcbe0144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbe49b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe0130e20 con 0x7fcbe0132960 2020-02-11T16:07:30.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbe49b2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe01310c0 con 0x7fcbe0132df0 2020-02-11T16:07:30.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbe49b2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe01381f0 con 0x7fcbe0137e10 2020-02-11T16:07:30.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcbe0137e10 0x7fcbe0131570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcbe0137e10 0x7fcbe0131570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52836/0 (socket says 172.21.15.88:52836) 2020-02-11T16:07:30.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 -- 172.21.15.88:0/1801830552 learned_addr learned my addr 172.21.15.88:0/1801830552 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:30.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> v2:172.21.15.52:3300/0 conn(0x7fcbe0132df0 0x7fcbe0144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 -- 172.21.15.88:0/1801830552 >> v2:172.21.15.52:3300/0 conn(0x7fcbe0132df0 msgr2=0x7fcbe0144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 --2- 172.21.15.88:0/1801830552 >> v2:172.21.15.52:3300/0 conn(0x7fcbe0132df0 0x7fcbe0144ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 -- 172.21.15.88:0/1801830552 >> v1:172.21.15.52:6789/0 conn(0x7fcbe0132960 legacy=0x7fcbe0144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 -- 172.21.15.88:0/1801830552 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe0133ac0 con 0x7fcbe0137e10 2020-02-11T16:07:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 --2- 172.21.15.88:0/1801830552 >> v2:172.21.15.88:3300/0 conn(0x7fcbe0137e10 0x7fcbe0131570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcbe0132260 tx=0x7fcbd0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 --2- 172.21.15.88:0/1801830552 >> v2:172.21.15.88:3300/0 conn(0x7fcbe0137e10 0x7fcbe0131570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcbe0132260 tx=0x7fcbd0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbe0137e10 0x7fcbe0131570 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fcbe0132260 tx=0x7fcbd0010db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbe0137e10 0x7fcbe0131570 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fcbe0132260 tx=0x7fcbd0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd0005e90 con 0x7fcbe0137e10 2020-02-11T16:07:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbe0137e10 0x7fcbe0131570 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fcbe0132260 tx=0x7fcbd0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbde59c700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbe0137e10 0x7fcbe0131570 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fcbe0132260 tx=0x7fcbd0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd0007160 con 0x7fcbe0137e10 2020-02-11T16:07:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbe49b2700 1 -- 172.21.15.88:0/1801830552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe0133260 con 0x7fcbe0137e10 2020-02-11T16:07:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd0007540 con 0x7fcbe0137e10 2020-02-11T16:07:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.335+0000 7fcbe49b2700 1 -- 172.21.15.88:0/1801830552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe01387e0 con 0x7fcbe0137e10 2020-02-11T16:07:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.336+0000 7fcbde59c700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbe0137e10 0x7fcbe0131570 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fcbe0132260 tx=0x7fcbd0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.336+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fcbd0010170 con 0x7fcbe0137e10 2020-02-11T16:07:30.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.336+0000 7fcbde59c700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbe0137e10 0x7fcbe0131570 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fcbe0132260 tx=0x7fcbd0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.336+0000 7fcbd77fe700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcbc4039cd0 0x7fcbc403c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.336+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fcbd0049fb0 con 0x7fcbe0137e10 2020-02-11T16:07:30.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.336+0000 7fcbe49b2700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 0x7fcbe0135b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.336+0000 7fcbe49b2700 1 -- 172.21.15.88:0/1801830552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe0130cd0 con 0x7fcbe012a580 2020-02-11T16:07:30.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.337+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcbc4039cd0 0x7fcbc403c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.337+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 0x7fcbe0135b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.337+0000 7fcbddd9b700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcbc4039cd0 0x7fcbc403c190 crc :-1 s=READY pgs=129 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.337+0000 7fcbded9d700 1 -- 172.21.15.88:0/1801830552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcbe00565b0 con 0x7fcbe012a580 2020-02-11T16:07:30.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.337+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 0x7fcbe0135b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.337+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 0x7fcbe0135b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.337+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 0x7fcbe0135b40 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.337+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 0x7fcbe0135b40 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.337+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd8004d10 con 0x7fcbe012a580 2020-02-11T16:07:30.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.338+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 0x7fcbe0135b40 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.338+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fcbd8004e70 con 0x7fcbe012a580 2020-02-11T16:07:30.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.338+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 msgr2=0x7fcbe0135b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.338+0000 7fcbd77fe700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 0x7fcbe0135b40 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).stop 2020-02-11T16:07:30.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.338+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 msgr2=0x7fcbe0135b40 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:30.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.338+0000 7fcbd77fe700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a580 0x7fcbe0135b40 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).stop 2020-02-11T16:07:30.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.345+0000 7fcbe49b2700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 0x7fcbe0135fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.345+0000 7fcbe49b2700 1 -- 172.21.15.88:0/1801830552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe005e2f0 con 0x7fcbe012a960 2020-02-11T16:07:30.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.346+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 0x7fcbe0135fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.346+0000 7fcbded9d700 1 -- 172.21.15.88:0/1801830552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcbe0131200 con 0x7fcbe012a960 2020-02-11T16:07:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.346+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 0x7fcbe0135fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.346+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 0x7fcbe0135fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.346+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 0x7fcbe0135fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 0x7fcbe0135fa0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd8008ae0 con 0x7fcbe012a960 2020-02-11T16:07:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbded9d700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 0x7fcbe0135fa0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7fcbd8008c40 con 0x7fcbe012a960 2020-02-11T16:07:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 msgr2=0x7fcbe0135fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbd77fe700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 0x7fcbe0135fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fcbd8001820 tx=0x7fcbe00a1c80).stop 2020-02-11T16:07:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbd77fe700 1 -- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 msgr2=0x7fcbe0135fa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbd77fe700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbe012a960 0x7fcbe0135fa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbe49b2700 1 -- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcbc4039cd0 msgr2=0x7fcbc403c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbe49b2700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcbc4039cd0 0x7fcbc403c190 crc :-1 s=READY pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbe49b2700 1 -- 172.21.15.88:0/1801830552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbe0137e10 msgr2=0x7fcbe0131570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbe49b2700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbe0137e10 0x7fcbe0131570 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fcbe0132260 tx=0x7fcbd0010db0).stop 2020-02-11T16:07:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbded9d700 1 -- 172.21.15.88:0/1801830552 reap_dead start 2020-02-11T16:07:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbded9d700 1 -- 172.21.15.88:0/1801830552 reap_dead start 2020-02-11T16:07:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbe49b2700 1 -- 172.21.15.88:0/1801830552 shutdown_connections 2020-02-11T16:07:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbe49b2700 1 --2- 172.21.15.88:0/1801830552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbe0137e10 0x7fcbe0131570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbe49b2700 1 -- 172.21.15.88:0/1801830552 >> 172.21.15.88:0/1801830552 conn(0x7fcbe009d110 msgr2=0x7fcbe00a6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbe49b2700 1 -- 172.21.15.88:0/1801830552 shutdown_connections 2020-02-11T16:07:30.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.347+0000 7fcbe49b2700 1 -- 172.21.15.88:0/1801830552 wait complete. 2020-02-11T16:07:30.360 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:07:30.360 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:30.360 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:30.360 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:07:30.360 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2020-02-11T16:07:30.360 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:07:30.361 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:07:30.361 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:07:30.361 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:07:30.361 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.361 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:07:30.361 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:30.361 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:07:30.362 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:07:30.362 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:30.362 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:30.362 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:30.362 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:30.362 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:30.362 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:30.363 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.363 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:07:30.363 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:07:30.363 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:30.363 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:30.363 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:30.363 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:30.363 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:30.364 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:30.364 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.364 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:07:30.364 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:07:30.364 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:07:30.364 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:07:30.365 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:07:30.365 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:07:30.365 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:30.365 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:30.365 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:07:30.365 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:07:30.365 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:30.366 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:07:30.366 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:30.366 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:30.366 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:30.366 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:30.366 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:30.367 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:30.367 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.367 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:07:30.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.367 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:07:30.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.367 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:30.368 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:30.368 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:30.368 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:30.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.368 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:30.368 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:07:30.368 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.369 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:30.369 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:07:30.369 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.369 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.369 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.370 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:07:30.370 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:07:30.370 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:30.370 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:30.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.370 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:30.371 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:30.371 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:30.371 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:30.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.371 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:30.371 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:07:30.371 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.372 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:30.372 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:07:30.372 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.372 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.372 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.373 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:07:30.373 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:07:30.373 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:30.373 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:30.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.373 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:30.373 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:30.374 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:30.374 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:30.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.374 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:30.374 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:07:30.374 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.375 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:30.375 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:07:30.375 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.375 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.375 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.376 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:07:30.376 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:07:30.376 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:30.376 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:30.376 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.376 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.376 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:07:30.377 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:07:30.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.377 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.377 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.377 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:30.377 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.377 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.378 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:07:30.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.378 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.378 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.378 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:07:30.378 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.378 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.378 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.379 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:07:30.380 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:07:30.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.484+0000 7f2d8eae4700 1 Processor -- start 2020-02-11T16:07:30.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.484+0000 7f2d8eae4700 1 -- start start 2020-02-11T16:07:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8eae4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2d8805c1f0 0x7f2d88137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8eae4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d88134e30 0x7f2d881352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8eae4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d881382e0 con 0x7f2d880a1e50 2020-02-11T16:07:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8eae4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d88138580 con 0x7f2d8805c1f0 2020-02-11T16:07:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8eae4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d88138820 con 0x7f2d88134e30 2020-02-11T16:07:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8d081700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d88134e30 0x7f2d881352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8d081700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d88134e30 0x7f2d881352c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52850/0 (socket says 172.21.15.88:52850) 2020-02-11T16:07:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8d081700 1 -- 172.21.15.88:0/3690837697 learned_addr learned my addr 172.21.15.88:0/3690837697 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8d081700 1 -- 172.21.15.88:0/3690837697 >> v2:172.21.15.52:3300/0 conn(0x7f2d8805c1f0 msgr2=0x7f2d88137cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8c880700 1 --2- 172.21.15.88:0/3690837697 >> v2:172.21.15.52:3300/0 conn(0x7f2d8805c1f0 0x7f2d88137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8d081700 1 --2- 172.21.15.88:0/3690837697 >> v2:172.21.15.52:3300/0 conn(0x7f2d8805c1f0 0x7f2d88137cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8d081700 1 -- 172.21.15.88:0/3690837697 >> v1:172.21.15.52:6789/0 conn(0x7f2d880a1e50 legacy=0x7f2d880a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8d081700 1 -- 172.21.15.88:0/3690837697 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d88135720 con 0x7f2d88134e30 2020-02-11T16:07:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8d081700 1 --2- 172.21.15.88:0/3690837697 >> v2:172.21.15.88:3300/0 conn(0x7f2d88134e30 0x7f2d881352c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8d081700 1 --2- 172.21.15.88:0/3690837697 >> v2:172.21.15.88:3300/0 conn(0x7f2d88134e30 0x7f2d881352c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.485+0000 7f2d8d081700 1 --2- 172.21.15.88:0/3690837697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d88134e30 0x7f2d881352c0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).ready entity=mon.1 client_cookie=454a0133e603010e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8d081700 1 --2- 172.21.15.88:0/3690837697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d88134e30 0x7f2d881352c0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8d081700 1 --2- 172.21.15.88:0/3690837697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d88134e30 0x7f2d881352c0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d877fe700 1 -- 172.21.15.88:0/3690837697 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d8000a160 con 0x7f2d88134e30 2020-02-11T16:07:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8d081700 1 --2- 172.21.15.88:0/3690837697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d88134e30 0x7f2d881352c0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d877fe700 1 -- 172.21.15.88:0/3690837697 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8000a2c0 con 0x7f2d88134e30 2020-02-11T16:07:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d877fe700 1 -- 172.21.15.88:0/3690837697 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d8000a6a0 con 0x7f2d88134e30 2020-02-11T16:07:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8eae4700 1 -- 172.21.15.88:0/3690837697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d88134e30 msgr2=0x7f2d881352c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8eae4700 1 --2- 172.21.15.88:0/3690837697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d88134e30 0x7f2d881352c0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).stop 2020-02-11T16:07:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8eae4700 1 -- 172.21.15.88:0/3690837697 shutdown_connections 2020-02-11T16:07:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8eae4700 1 --2- 172.21.15.88:0/3690837697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d88134e30 0x7f2d881352c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8eae4700 1 --2- 172.21.15.88:0/3690837697 >> v2:172.21.15.52:3300/0 conn(0x7f2d8805c1f0 0x7f2d88137cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8eae4700 1 -- 172.21.15.88:0/3690837697 >> 172.21.15.88:0/3690837697 conn(0x7f2d880ab400 msgr2=0x7f2d880a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8eae4700 1 -- 172.21.15.88:0/3690837697 shutdown_connections 2020-02-11T16:07:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.486+0000 7f2d8eae4700 1 -- 172.21.15.88:0/3690837697 wait complete. 2020-02-11T16:07:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.487+0000 7f2d8eae4700 1 Processor -- start 2020-02-11T16:07:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.487+0000 7f2d8eae4700 1 -- start start 2020-02-11T16:07:30.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8eae4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2d880a1e50 0x7f2d88137ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8eae4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8eae4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8812c620 con 0x7f2d8805c1f0 2020-02-11T16:07:30.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8eae4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d88137350 con 0x7f2d880a1e50 2020-02-11T16:07:30.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8eae4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d881375f0 con 0x7f2d88134e30 2020-02-11T16:07:30.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8c880700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2d8805c1f0 0x7f2d8812bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60492/0 (socket says 172.21.15.88:60492) 2020-02-11T16:07:30.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8c880700 1 -- 172.21.15.88:0/2504861104 learned_addr learned my addr 172.21.15.88:0/2504861104 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:30.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8d081700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d87fff700 1 --2- 172.21.15.88:0/2504861104 >> v2:172.21.15.52:3300/0 conn(0x7f2d880a1e50 0x7f2d88137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933113344 0 0) 0x7f2d78001fd0 con 0x7f2d8805c1f0 2020-02-11T16:07:30.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d68002fe0 con 0x7f2d8805c1f0 2020-02-11T16:07:30.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8d081700 1 -- 172.21.15.88:0/2504861104 >> v2:172.21.15.52:3300/0 conn(0x7f2d880a1e50 msgr2=0x7f2d88137ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8d081700 1 --2- 172.21.15.88:0/2504861104 >> v2:172.21.15.52:3300/0 conn(0x7f2d880a1e50 0x7f2d88137ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8d081700 1 -- 172.21.15.88:0/2504861104 >> v1:172.21.15.52:6789/0 conn(0x7f2d8805c1f0 legacy=0x7f2d8812bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8d081700 1 -- 172.21.15.88:0/2504861104 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d88137890 con 0x7f2d88134e30 2020-02-11T16:07:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.488+0000 7f2d8d081700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d8d081700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d8d081700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d8d081700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d80005c30 con 0x7f2d88134e30 2020-02-11T16:07:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d8d081700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d80005d90 con 0x7f2d88134e30 2020-02-11T16:07:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d8d081700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d8eae4700 1 -- 172.21.15.88:0/2504861104 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d88133940 con 0x7f2d88134e30 2020-02-11T16:07:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d80007340 con 0x7f2d88134e30 2020-02-11T16:07:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d8eae4700 1 -- 172.21.15.88:0/2504861104 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8812e200 con 0x7f2d88134e30 2020-02-11T16:07:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d8d081700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d8eae4700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 0x7f2d880a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.489+0000 7f2d8eae4700 1 -- 172.21.15.88:0/2504861104 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8805c630 con 0x7f2d88132690 2020-02-11T16:07:30.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2d80007600 con 0x7f2d88134e30 2020-02-11T16:07:30.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 0x7f2d880a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d8d081700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d85ffb700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2d68039f70 0x7f2d6803c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2d8004a7f0 con 0x7f2d88134e30 2020-02-11T16:07:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d8c880700 1 -- 172.21.15.88:0/2504861104 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d88132180 con 0x7f2d88132690 2020-02-11T16:07:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d87fff700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2d68039f70 0x7f2d6803c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 0x7f2d880a6340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 0x7f2d880a6340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 0x7f2d880a6340 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 0x7f2d880a6340 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d78007540 con 0x7f2d88132690 2020-02-11T16:07:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d87fff700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2d68039f70 0x7f2d6803c430 crc :-1 s=READY pgs=130 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 0x7f2d880a6340 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f2d780059c0 con 0x7f2d88132690 2020-02-11T16:07:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.490+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 msgr2=0x7f2d880a6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.491+0000 7f2d85ffb700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 0x7f2d880a6340 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).stop 2020-02-11T16:07:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.491+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 msgr2=0x7f2d880a6340 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.491+0000 7f2d85ffb700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88132690 0x7f2d880a6340 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).stop 2020-02-11T16:07:30.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.498+0000 7f2d8eae4700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 0x7f2d8812cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.498+0000 7f2d8eae4700 1 -- 172.21.15.88:0/2504861104 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d88137a50 con 0x7f2d8812cac0 2020-02-11T16:07:30.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.499+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 0x7f2d8812cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.499+0000 7f2d8c880700 1 -- 172.21.15.88:0/2504861104 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2d880565b0 con 0x7f2d8812cac0 2020-02-11T16:07:30.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.499+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 0x7f2d8812cea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.499+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 0x7f2d8812cea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.499+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 0x7f2d8812cea0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.499+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 0x7f2d8812cea0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.499+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d78007a70 con 0x7f2d8812cac0 2020-02-11T16:07:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8c880700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 0x7f2d8812cea0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7f2d7800b120 con 0x7f2d8812cac0 2020-02-11T16:07:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 msgr2=0x7f2d8812cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d85ffb700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 0x7f2d8812cea0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).stop 2020-02-11T16:07:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d85ffb700 1 -- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 msgr2=0x7f2d8812cea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d85ffb700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d8812cac0 0x7f2d8812cea0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0x7f2d78002160 tx=0x7f2d7800c820).stop 2020-02-11T16:07:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8eae4700 1 -- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2d68039f70 msgr2=0x7f2d6803c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8eae4700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2d68039f70 0x7f2d6803c430 crc :-1 s=READY pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8eae4700 1 -- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 msgr2=0x7f2d88135b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8eae4700 1 --2- 172.21.15.88:0/2504861104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2d88134e30 0x7f2d88135b50 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f2d880a87d0 tx=0x7f2d80007dc0).stop 2020-02-11T16:07:30.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8d081700 1 -- 172.21.15.88:0/2504861104 reap_dead start 2020-02-11T16:07:30.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8d081700 1 -- 172.21.15.88:0/2504861104 reap_dead start 2020-02-11T16:07:30.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8eae4700 1 -- 172.21.15.88:0/2504861104 shutdown_connections 2020-02-11T16:07:30.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8eae4700 1 -- 172.21.15.88:0/2504861104 >> 172.21.15.88:0/2504861104 conn(0x7f2d880ab400 msgr2=0x7f2d880a42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:30.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8eae4700 1 -- 172.21.15.88:0/2504861104 shutdown_connections 2020-02-11T16:07:30.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.500+0000 7f2d8eae4700 1 -- 172.21.15.88:0/2504861104 wait complete. 2020-02-11T16:07:30.515 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:07:30.515 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:30.515 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:30.515 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:07:30.516 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2020-02-11T16:07:30.516 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:07:30.516 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:07:30.516 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:07:30.517 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:07:30.517 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.517 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:07:30.517 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:30.517 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:07:30.518 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:07:30.518 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:30.518 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:30.518 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:30.519 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:30.519 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:30.519 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:30.519 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.520 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:07:30.520 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:07:30.520 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:30.520 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:30.520 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:30.521 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:30.521 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:30.521 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:30.521 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.522 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:07:30.522 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:07:30.522 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:07:30.523 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:07:30.523 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:07:30.523 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:07:30.523 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:30.524 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:30.524 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:07:30.524 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:07:30.524 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:30.524 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:07:30.525 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:30.525 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:30.525 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:30.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:30.526 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:30.526 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:30.526 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.526 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:07:30.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.527 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:07:30.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.527 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:30.528 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:30.528 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:30.528 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:30.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.529 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:30.529 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:07:30.529 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.530 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:30.530 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:07:30.530 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.530 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.531 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.531 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:07:30.531 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:07:30.532 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:30.532 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:30.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.532 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:30.533 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:30.533 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:30.533 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:30.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.534 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:30.534 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:07:30.534 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.535 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:30.535 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:07:30.535 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.536 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.536 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.536 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:07:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:07:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:07:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:07:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:07:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:07:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:07:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:07:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:07:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:07:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:07:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:07:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:07:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:07:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:30.549 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:07:30.551 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:07:30.551 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:07:30.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.655+0000 7f353dff4700 1 Processor -- start 2020-02-11T16:07:30.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.655+0000 7f353dff4700 1 -- start start 2020-02-11T16:07:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f353dff4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35380a7120 0x7f35380a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f353dff4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35380a39e0 0x7f35380a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f353dff4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380a5320 con 0x7f353812f890 2020-02-11T16:07:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f353dff4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353809e7a0 con 0x7f35380a39e0 2020-02-11T16:07:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f353dff4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35381303f0 con 0x7f35380a7120 2020-02-11T16:07:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35380a7120 0x7f35380a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35380a7120 0x7f35380a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52864/0 (socket says 172.21.15.88:52864) 2020-02-11T16:07:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 -- 172.21.15.88:0/2211824767 learned_addr learned my addr 172.21.15.88:0/2211824767 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f3536ffd700 1 --2- 172.21.15.88:0/2211824767 >> v2:172.21.15.52:3300/0 conn(0x7f35380a39e0 0x7f35380a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 -- 172.21.15.88:0/2211824767 >> v2:172.21.15.52:3300/0 conn(0x7f35380a39e0 msgr2=0x7f35380a3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 --2- 172.21.15.88:0/2211824767 >> v2:172.21.15.52:3300/0 conn(0x7f35380a39e0 0x7f35380a3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 -- 172.21.15.88:0/2211824767 >> v1:172.21.15.52:6789/0 conn(0x7f353812f890 legacy=0x7f353812fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 -- 172.21.15.88:0/2211824767 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380a5560 con 0x7f35380a7120 2020-02-11T16:07:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 --2- 172.21.15.88:0/2211824767 >> v2:172.21.15.88:3300/0 conn(0x7f35380a7120 0x7f35380a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3528002f30 tx=0x7f3528007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 --2- 172.21.15.88:0/2211824767 >> v2:172.21.15.88:3300/0 conn(0x7f35380a7120 0x7f35380a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3528002f30 tx=0x7f3528007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 --2- 172.21.15.88:0/2211824767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35380a7120 0x7f35380a4ec0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f3528002f30 tx=0x7f3528007a40).ready entity=mon.1 client_cookie=45be8d472b6179a9 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 --2- 172.21.15.88:0/2211824767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35380a7120 0x7f35380a4ec0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f3528002f30 tx=0x7f3528007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35367fc700 1 -- 172.21.15.88:0/2211824767 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3528011720 con 0x7f35380a7120 2020-02-11T16:07:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 --2- 172.21.15.88:0/2211824767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35380a7120 0x7f35380a4ec0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f3528002f30 tx=0x7f3528007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35377fe700 1 --2- 172.21.15.88:0/2211824767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35380a7120 0x7f35380a4ec0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f3528002f30 tx=0x7f3528007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35367fc700 1 -- 172.21.15.88:0/2211824767 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3528011880 con 0x7f35380a7120 2020-02-11T16:07:30.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f35367fc700 1 -- 172.21.15.88:0/2211824767 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3528011c20 con 0x7f35380a7120 2020-02-11T16:07:30.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f353dff4700 1 -- 172.21.15.88:0/2211824767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35380a7120 msgr2=0x7f35380a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.656+0000 7f353dff4700 1 --2- 172.21.15.88:0/2211824767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35380a7120 0x7f35380a4ec0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f3528002f30 tx=0x7f3528007a40).stop 2020-02-11T16:07:30.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.657+0000 7f353dff4700 1 -- 172.21.15.88:0/2211824767 shutdown_connections 2020-02-11T16:07:30.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.657+0000 7f353dff4700 1 --2- 172.21.15.88:0/2211824767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35380a7120 0x7f35380a4ec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.657+0000 7f353dff4700 1 --2- 172.21.15.88:0/2211824767 >> v2:172.21.15.52:3300/0 conn(0x7f35380a39e0 0x7f35380a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.657+0000 7f353dff4700 1 -- 172.21.15.88:0/2211824767 >> 172.21.15.88:0/2211824767 conn(0x7f353809d110 msgr2=0x7f353809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.657+0000 7f353dff4700 1 -- 172.21.15.88:0/2211824767 shutdown_connections 2020-02-11T16:07:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.657+0000 7f353dff4700 1 -- 172.21.15.88:0/2211824767 wait complete. 2020-02-11T16:07:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.658+0000 7f353dff4700 1 Processor -- start 2020-02-11T16:07:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.658+0000 7f353dff4700 1 -- start start 2020-02-11T16:07:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.658+0000 7f353dff4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f35380a7120 0x7f35380a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.658+0000 7f353dff4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f353812f890 0x7f35381486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.658+0000 7f353dff4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353809f1e0 con 0x7f35380a39e0 2020-02-11T16:07:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.658+0000 7f353dff4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353809eaa0 con 0x7f353812f890 2020-02-11T16:07:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.658+0000 7f353dff4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353809ed40 con 0x7f35380a7120 2020-02-11T16:07:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f353812f890 0x7f35381486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f353812f890 0x7f35381486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52872/0 (socket says 172.21.15.88:52872) 2020-02-11T16:07:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 -- 172.21.15.88:0/3475281690 learned_addr learned my addr 172.21.15.88:0/3475281690 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3536ffd700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f35380a7120 0x7f35380a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 -- 172.21.15.88:0/3475281690 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f35380a7120 msgr2=0x7f35380a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f35380a7120 0x7f35380a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 -- 172.21.15.88:0/3475281690 >> v1:172.21.15.52:6789/0 conn(0x7f35380a39e0 legacy=0x7f35380a30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 -- 172.21.15.88:0/3475281690 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380a37c0 con 0x7f353812f890 2020-02-11T16:07:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> v2:172.21.15.88:3300/0 conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> v2:172.21.15.88:3300/0 conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3534ff9700 1 -- 172.21.15.88:0/3475281690 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35300101c0 con 0x7f353812f890 2020-02-11T16:07:30.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3534ff9700 1 -- 172.21.15.88:0/3475281690 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3530010320 con 0x7f353812f890 2020-02-11T16:07:30.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f3534ff9700 1 -- 172.21.15.88:0/3475281690 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3530010740 con 0x7f353812f890 2020-02-11T16:07:30.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f353dff4700 1 -- 172.21.15.88:0/3475281690 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353812b190 con 0x7f353812f890 2020-02-11T16:07:30.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.659+0000 7f353dff4700 1 -- 172.21.15.88:0/3475281690 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35380a06e0 con 0x7f353812f890 2020-02-11T16:07:30.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.660+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.660+0000 7f3534ff9700 1 -- 172.21.15.88:0/3475281690 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3530006860 con 0x7f353812f890 2020-02-11T16:07:30.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.660+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.660+0000 7f353dff4700 1 -- 172.21.15.88:0/3475281690 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35380a0870 con 0x7f353812f890 2020-02-11T16:07:30.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.660+0000 7f3534ff9700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3518039cf0 0x7f351803c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:30.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.660+0000 7f3534ff9700 1 -- 172.21.15.88:0/3475281690 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3530049cd0 con 0x7f353812f890 2020-02-11T16:07:30.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.660+0000 7f35377fe700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3518039cf0 0x7f351803c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:30.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.661+0000 7f35377fe700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3518039cf0 0x7f351803c1b0 crc :-1 s=READY pgs=131 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:30.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.664+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.664+0000 7f3534ff9700 1 -- 172.21.15.88:0/3475281690 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f353002f390 con 0x7f353812f890 2020-02-11T16:07:30.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.852+0000 7f353dff4700 1 -- 172.21.15.88:0/3475281690 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f35380a5320 con 0x7f353812f890 2020-02-11T16:07:30.854 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:30.852+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.855 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:30.852+0000 7f20b17fa700 1 -- 172.21.15.88:0/3914309884 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v7) v1 ==== 167+0+0 (secure 0 0 0) 0x7f20a4032120 con 0x7f20b4077db0 2020-02-11T16:07:30.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.854+0000 7f3537fff700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:30.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.854+0000 7f3534ff9700 1 -- 172.21.15.88:0/3475281690 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f35380a5320 con 0x7f353812f890 2020-02-11T16:07:30.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 -- 172.21.15.88:0/3475281690 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3518039cf0 msgr2=0x7f351803c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3518039cf0 0x7f351803c1b0 crc :-1 s=READY pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 -- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 msgr2=0x7f35381486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:30.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 0x7f35381486f0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f3530001710 tx=0x7f3530010d90).stop 2020-02-11T16:07:30.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 -- 172.21.15.88:0/3475281690 shutdown_connections 2020-02-11T16:07:30.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3518039cf0 0x7f351803c1b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353812f890 0x7f35381486f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 --2- 172.21.15.88:0/3475281690 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f35380a7120 0x7f35380a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:30.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 -- 172.21.15.88:0/3475281690 >> 172.21.15.88:0/3475281690 conn(0x7f353809d110 msgr2=0x7f3538069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:30.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 -- 172.21.15.88:0/3475281690 shutdown_connections 2020-02-11T16:07:30.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:30.855+0000 7f353dff4700 1 -- 172.21.15.88:0/3475281690 wait complete. 2020-02-11T16:07:30.867 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:07:30.992 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:30.990+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f20b407ec40 con 0x7f20b4077db0 2020-02-11T16:07:31.858 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.856+0000 7f20b3fff700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:31.858 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.856+0000 7f20b17fa700 1 -- 172.21.15.88:0/3914309884 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v8) v1 ==== 167+0+0 (secure 0 0 0) 0x7f20a4032560 con 0x7f20b4077db0 2020-02-11T16:07:31.860 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.858+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2098039f70 msgr2=0x7f209803c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:31.861 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.858+0000 7f20b9da3700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2098039f70 0x7f209803c430 crc :-1 s=READY pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:31.861 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.858+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 msgr2=0x7f20b409d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:31.861 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.858+0000 7f20b9da3700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f20a4002f30 tx=0x7f20a4010c80).stop 2020-02-11T16:07:31.861 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.858+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 shutdown_connections 2020-02-11T16:07:31.861 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.858+0000 7f20b9da3700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2098039f70 0x7f209803c430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:31.861 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.858+0000 7f20b9da3700 1 --2- 172.21.15.88:0/3914309884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20b4077db0 0x7f20b409d780 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:31.862 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.858+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 >> 172.21.15.88:0/3914309884 conn(0x7f20b405c170 msgr2=0x7f20b40a6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:31.862 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.859+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 shutdown_connections 2020-02-11T16:07:31.862 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:31.859+0000 7f20b9da3700 1 -- 172.21.15.88:0/3914309884 wait complete. 2020-02-11T16:07:31.862 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:07:31.871 INFO:tasks.workunit.client.0.smithi088.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2020-02-11T16:07:34.280 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir foo 2020-02-11T16:07:34.287 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 foo 2020-02-11T16:07:35.327 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir foo/.snap/barsnap 2020-02-11T16:07:35.342 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm foo/linux-2.6.33.tar.bz2 2020-02-11T16:07:35.354 INFO:tasks.workunit.client.0.smithi088.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2020-02-11T16:07:35.469 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 'passed: files are identical' 2020-02-11T16:07:35.469 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir foo/.snap/barsnap 2020-02-11T16:07:35.470 INFO:tasks.workunit.client.0.smithi088.stdout:passed: files are identical 2020-02-11T16:07:35.479 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:07:35.479 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:07:35.479 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:07:35.479 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:07:35.547 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-0.sh... 2020-02-11T16:07:35.548 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-0.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-0.sh 2020-02-11T16:07:35.570 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:07:35.570 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps false 2020-02-11T16:07:35.657 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.652+0000 7f8807723700 1 Processor -- start 2020-02-11T16:07:35.657 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.652+0000 7f8807723700 1 -- start start 2020-02-11T16:07:35.658 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.652+0000 7f8807723700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88000a5e50 0x7f88000a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:35.658 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.652+0000 7f8807723700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88000a50f0 con 0x7f88000a24c0 2020-02-11T16:07:35.658 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.652+0000 7f8807723700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88000a7780 con 0x7f88000aa220 2020-02-11T16:07:35.658 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.652+0000 7f8807723700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88000a1df0 con 0x7f88000a5e50 2020-02-11T16:07:35.658 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88000a5e50 0x7f88000a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:35.658 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f8805cc0700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f88000aa220 0x7f88000a6960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40516/0 (socket says 172.21.15.88:40516) 2020-02-11T16:07:35.659 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88000a5e50 0x7f88000a57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52890/0 (socket says 172.21.15.88:52890) 2020-02-11T16:07:35.659 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f8805cc0700 1 -- 172.21.15.88:0/3554125855 learned_addr learned my addr 172.21.15.88:0/3554125855 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:35.659 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 -- 172.21.15.88:0/3554125855 >> v1:172.21.15.88:6789/0 conn(0x7f88000aa220 legacy=0x7f88000a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:35.659 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 -- 172.21.15.88:0/3554125855 >> v1:172.21.15.52:6789/0 conn(0x7f88000a24c0 legacy=0x7f88000a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:35.659 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f8804cbe700 1 -- 172.21.15.88:0/3554125855 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936738605 0 0) 0x7f88000a7780 con 0x7f88000aa220 2020-02-11T16:07:35.659 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 -- 172.21.15.88:0/3554125855 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000a2090 con 0x7f88000a5e50 2020-02-11T16:07:35.660 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 --2- 172.21.15.88:0/3554125855 >> v2:172.21.15.88:3300/0 conn(0x7f88000a5e50 0x7f88000a57c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f880007fa30 tx=0x7f87f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.660 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 --2- 172.21.15.88:0/3554125855 >> v2:172.21.15.88:3300/0 conn(0x7f88000a5e50 0x7f88000a57c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f880007fa30 tx=0x7f87f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.660 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 --2- 172.21.15.88:0/3554125855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a5e50 0x7f88000a57c0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f880007fa30 tx=0x7f87f40088e0).ready entity=mon.1 client_cookie=569879b40e5ba974 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:35.660 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 --2- 172.21.15.88:0/3554125855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a5e50 0x7f88000a57c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f880007fa30 tx=0x7f87f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.660 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f8804cbe700 1 -- 172.21.15.88:0/3554125855 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87f4008e40 con 0x7f88000a5e50 2020-02-11T16:07:35.661 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 --2- 172.21.15.88:0/3554125855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a5e50 0x7f88000a57c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f880007fa30 tx=0x7f87f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.661 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f8804cbe700 1 -- 172.21.15.88:0/3554125855 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f4011660 con 0x7f88000a5e50 2020-02-11T16:07:35.661 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f88054bf700 1 --2- 172.21.15.88:0/3554125855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a5e50 0x7f88000a57c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f880007fa30 tx=0x7f87f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.661 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f8804cbe700 1 -- 172.21.15.88:0/3554125855 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87f4011a00 con 0x7f88000a5e50 2020-02-11T16:07:35.661 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f8807723700 1 -- 172.21.15.88:0/3554125855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a5e50 msgr2=0x7f88000a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:35.661 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.653+0000 7f8807723700 1 --2- 172.21.15.88:0/3554125855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a5e50 0x7f88000a57c0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f880007fa30 tx=0x7f87f40088e0).stop 2020-02-11T16:07:35.662 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.654+0000 7f8807723700 1 -- 172.21.15.88:0/3554125855 shutdown_connections 2020-02-11T16:07:35.662 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.654+0000 7f8807723700 1 --2- 172.21.15.88:0/3554125855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a5e50 0x7f88000a57c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:35.662 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.654+0000 7f8807723700 1 -- 172.21.15.88:0/3554125855 >> 172.21.15.88:0/3554125855 conn(0x7f880005b3d0 msgr2=0x7f880009d250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:35.662 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.654+0000 7f8807723700 1 -- 172.21.15.88:0/3554125855 shutdown_connections 2020-02-11T16:07:35.663 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.654+0000 7f8807723700 1 -- 172.21.15.88:0/3554125855 wait complete. 2020-02-11T16:07:35.663 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.655+0000 7f8807723700 1 Processor -- start 2020-02-11T16:07:35.663 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.655+0000 7f8807723700 1 -- start start 2020-02-11T16:07:35.666 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.655+0000 7f8807723700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88000a24c0 0x7f8800063d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:35.667 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.655+0000 7f8807723700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88000aa220 0x7f8800063250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:35.667 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.655+0000 7f8807723700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8800066900 con 0x7f88000a01d0 2020-02-11T16:07:35.667 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.655+0000 7f8807723700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880011ec40 con 0x7f88000a24c0 2020-02-11T16:07:35.667 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.655+0000 7f8807723700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8800066ba0 con 0x7f88000aa220 2020-02-11T16:07:35.667 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.655+0000 7f8805cc0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88000a24c0 0x7f8800063d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:35.667 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.655+0000 7f8805cc0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88000a24c0 0x7f8800063d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52896/0 (socket says 172.21.15.88:52896) 2020-02-11T16:07:35.667 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 -- 172.21.15.88:0/2599525600 learned_addr learned my addr 172.21.15.88:0/2599525600 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:35.668 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f88054bf700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88000aa220 0x7f8800063250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:35.672 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 -- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88000aa220 msgr2=0x7f8800063250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:35.673 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88000aa220 0x7f8800063250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:35.673 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 -- 172.21.15.88:0/2599525600 >> v1:172.21.15.52:6789/0 conn(0x7f88000a01d0 legacy=0x7f8800066060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:35.673 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 -- 172.21.15.88:0/2599525600 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000636b0 con 0x7f88000a24c0 2020-02-11T16:07:35.673 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f88054bf700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88000aa220 0x7f8800063250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:07:35.673 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> v2:172.21.15.88:3300/0 conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.677 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> v2:172.21.15.88:3300/0 conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.677 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:35.677 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.678 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.678 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.679 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f87fe7fc700 1 -- 172.21.15.88:0/2599525600 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87f0005e30 con 0x7f88000a24c0 2020-02-11T16:07:35.679 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f87fe7fc700 1 -- 172.21.15.88:0/2599525600 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f0012630 con 0x7f88000a24c0 2020-02-11T16:07:35.680 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8800063a00 con 0x7f88000a24c0 2020-02-11T16:07:35.680 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f87fe7fc700 1 -- 172.21.15.88:0/2599525600 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87f0012a10 con 0x7f88000a24c0 2020-02-11T16:07:35.681 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8800135c30 con 0x7f88000a24c0 2020-02-11T16:07:35.681 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.656+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.681 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.657+0000 7f87fe7fc700 1 -- 172.21.15.88:0/2599525600 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f87f0012c80 con 0x7f88000a24c0 2020-02-11T16:07:35.681 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.657+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.682 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.657+0000 7f87fe7fc700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87e0039c40 0x7f87e003c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:35.682 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.657+0000 7f87fe7fc700 1 -- 172.21.15.88:0/2599525600 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f87f0049e60 con 0x7f88000a24c0 2020-02-11T16:07:35.682 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.657+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880005bbc0 con 0x7f88000a24c0 2020-02-11T16:07:35.682 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.657+0000 7f88054bf700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87e0039c40 0x7f87e003c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:35.683 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.657+0000 7f88054bf700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87e0039c40 0x7f87e003c100 crc :-1 s=READY pgs=132 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:35.683 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.661+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:35.683 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.661+0000 7f87fe7fc700 1 -- 172.21.15.88:0/2599525600 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f87f002f440 con 0x7f88000a24c0 2020-02-11T16:07:35.841 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:35.839+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"} v 0) v1 -- 0x7f88000565b0 con 0x7f88000a24c0 2020-02-11T16:07:36.038 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:36.037+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:36.039 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:36.037+0000 7f87fe7fc700 1 -- 172.21.15.88:0/2599525600 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"}]=0 disabled new snapshots v9) v1 ==== 139+0+0 (secure 0 0 0) 0x7f87f0031f50 con 0x7f88000a24c0 2020-02-11T16:07:36.174 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:36.172+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"} v 0) v1 -- 0x7f88000a3b50 con 0x7f88000a24c0 2020-02-11T16:07:37.041 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.039+0000 7f8805cc0700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.041 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.039+0000 7f87fe7fc700 1 -- 172.21.15.88:0/2599525600 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"}]=0 disabled new snapshots v10) v1 ==== 139+0+0 (secure 0 0 0) 0x7f87f0032390 con 0x7f88000a24c0 2020-02-11T16:07:37.044 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87e0039c40 msgr2=0x7f87e003c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:37.044 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87e0039c40 0x7f87e003c100 crc :-1 s=READY pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:37.044 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 msgr2=0x7f8800063d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:37.045 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f8800127d00 tx=0x7f87f0010de0).stop 2020-02-11T16:07:37.045 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 shutdown_connections 2020-02-11T16:07:37.045 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87e0039c40 0x7f87e003c100 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:37.045 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88000a24c0 0x7f8800063d60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:37.045 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 --2- 172.21.15.88:0/2599525600 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88000aa220 0x7f8800063250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:37.045 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 >> 172.21.15.88:0/2599525600 conn(0x7f880005b3d0 msgr2=0x7f88000a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:37.046 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 shutdown_connections 2020-02-11T16:07:37.046 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.042+0000 7f8807723700 1 -- 172.21.15.88:0/2599525600 wait complete. 2020-02-11T16:07:37.046 INFO:tasks.workunit.client.0.smithi088.stderr:disabled new snapshots 2020-02-11T16:07:37.054 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_failure mkdir .snap/foo 2020-02-11T16:07:37.054 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/foo 2020-02-11T16:07:37.057 INFO:tasks.workunit.client.0.smithi088.stderr:mkdir: cannot create directory ‘.snap/foo’: Operation not permitted 2020-02-11T16:07:37.057 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2020-02-11T16:07:37.057 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:07:37.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.143+0000 7fe94fb6a700 1 Processor -- start 2020-02-11T16:07:37.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.143+0000 7fe94fb6a700 1 -- start start 2020-02-11T16:07:37.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.143+0000 7fe94fb6a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9480a14c0 0x7fe948150670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:37.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.143+0000 7fe94fb6a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9480a37e0 con 0x7fe94805ac40 2020-02-11T16:07:37.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.143+0000 7fe94fb6a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9480a26d0 con 0x7fe9480a2da0 2020-02-11T16:07:37.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.143+0000 7fe94fb6a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9480a24e0 con 0x7fe9480a14c0 2020-02-11T16:07:37.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d906700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe9480a2da0 0x7fe948099fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40530/0 (socket says 172.21.15.88:40530) 2020-02-11T16:07:37.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d906700 1 -- 172.21.15.88:0/1416055254 learned_addr learned my addr 172.21.15.88:0/1416055254 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:37.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94e908700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9480a14c0 0x7fe948150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:37.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406297830 0 0) 0x7fe9480a26d0 con 0x7fe9480a2da0 2020-02-11T16:07:37.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe934003230 con 0x7fe9480a2da0 2020-02-11T16:07:37.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2296428449 0 0) 0x7fe934003230 con 0x7fe9480a2da0 2020-02-11T16:07:37.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9480a14c0 msgr2=0x7fe948150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:37.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9480a14c0 0x7fe948150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:37.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 >> v1:172.21.15.52:6789/0 conn(0x7fe94805ac40 legacy=0x7fe948099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:37.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9480a2970 con 0x7fe9480a2da0 2020-02-11T16:07:37.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe9380016d0 con 0x7fe9480a2da0 2020-02-11T16:07:37.154 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 >> v1:172.21.15.88:6789/0 conn(0x7fe9480a2da0 legacy=0x7fe948099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:37.154 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934003750 0x7fe934003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:37.154 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9480a14c0 0x7fe9340044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:37.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe934004930 0x7fe934004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:37.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340052d0 con 0x7fe934004930 2020-02-11T16:07:37.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe934004120 con 0x7fe934003750 2020-02-11T16:07:37.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340042e0 con 0x7fe9480a14c0 2020-02-11T16:07:37.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94e107700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934003750 0x7fe934003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:37.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94d906700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9480a14c0 0x7fe9340044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:37.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94e908700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe934004930 0x7fe934004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:37.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94e107700 1 -- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9480a14c0 msgr2=0x7fe9340044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:37.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94e107700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9480a14c0 0x7fe9340044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:37.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94e107700 1 -- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe934004930 msgr2=0x7fe934004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:37.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94e107700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe934004930 0x7fe934004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:37.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94e107700 1 -- 172.21.15.88:0/1416055254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe934003230 con 0x7fe934003750 2020-02-11T16:07:37.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94e908700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe934004930 0x7fe934004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:07:37.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.144+0000 7fe94e107700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934003750 0x7fe934003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe94805faa0 tx=0x7fe934004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.157 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94e107700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934003750 0x7fe934003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe94805faa0 tx=0x7fe934004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.157 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94e107700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934003750 0x7fe934003b70 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7fe94805faa0 tx=0x7fe934004420).ready entity=mon.1 client_cookie=334d920f862adee7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:37.157 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94e107700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934003750 0x7fe934003b70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7fe94805faa0 tx=0x7fe934004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.157 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe944003540 con 0x7fe934003750 2020-02-11T16:07:37.157 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94e107700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934003750 0x7fe934003b70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7fe94805faa0 tx=0x7fe934004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.157 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94e107700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934003750 0x7fe934003b70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7fe94805faa0 tx=0x7fe934004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.157 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9440036a0 con 0x7fe934003750 2020-02-11T16:07:37.158 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94d105700 1 -- 172.21.15.88:0/1416055254 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe944003ac0 con 0x7fe934003750 2020-02-11T16:07:37.158 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1416055254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934003750 msgr2=0x7fe934003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:37.158 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94fb6a700 1 --2- 172.21.15.88:0/1416055254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934003750 0x7fe934003b70 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7fe94805faa0 tx=0x7fe934004420).stop 2020-02-11T16:07:37.158 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94e908700 1 -- 172.21.15.88:0/1416055254 reap_dead start 2020-02-11T16:07:37.158 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1416055254 shutdown_connections 2020-02-11T16:07:37.158 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1416055254 >> 172.21.15.88:0/1416055254 conn(0x7fe94805c170 msgr2=0x7fe94805a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:37.158 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1416055254 shutdown_connections 2020-02-11T16:07:37.159 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.145+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1416055254 wait complete. 2020-02-11T16:07:37.159 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.146+0000 7fe94fb6a700 1 Processor -- start 2020-02-11T16:07:37.159 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.146+0000 7fe94fb6a700 1 -- start start 2020-02-11T16:07:37.159 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94fb6a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe948129480 0x7fe948120990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:37.159 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94fb6a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe94809fc30 0x7fe9480a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:37.159 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94fb6a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9481345d0 0x7fe948134a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:37.159 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94fb6a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9481221d0 con 0x7fe948129480 2020-02-11T16:07:37.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94fb6a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe948120df0 con 0x7fe9481345d0 2020-02-11T16:07:37.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94fb6a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94809de90 con 0x7fe94809fc30 2020-02-11T16:07:37.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9481345d0 0x7fe948134a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:37.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9481345d0 0x7fe948134a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52918/0 (socket says 172.21.15.88:52918) 2020-02-11T16:07:37.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 -- 172.21.15.88:0/1908224760 learned_addr learned my addr 172.21.15.88:0/1908224760 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:37.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e107700 1 --2- 172.21.15.88:0/1908224760 >> v2:172.21.15.52:3300/0 conn(0x7fe948129480 0x7fe948120990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:37.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94d906700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe94809fc30 0x7fe9480a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:37.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 -- 172.21.15.88:0/1908224760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe94809fc30 msgr2=0x7fe9480a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:37.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe94809fc30 0x7fe9480a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:37.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 -- 172.21.15.88:0/1908224760 >> v2:172.21.15.52:3300/0 conn(0x7fe948129480 msgr2=0x7fe948120990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:37.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> v2:172.21.15.52:3300/0 conn(0x7fe948129480 0x7fe948120990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:37.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 -- 172.21.15.88:0/1908224760 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9481223c0 con 0x7fe9481345d0 2020-02-11T16:07:37.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> v2:172.21.15.88:3300/0 conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.162 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> v2:172.21.15.88:3300/0 conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.162 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:37.162 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.162 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe93effd700 1 -- 172.21.15.88:0/1908224760 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe940005e20 con 0x7fe9481345d0 2020-02-11T16:07:37.162 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.162 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.147+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.162 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.148+0000 7fe93effd700 1 -- 172.21.15.88:0/1908224760 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9400124b0 con 0x7fe9481345d0 2020-02-11T16:07:37.163 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.148+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe948122660 con 0x7fe9481345d0 2020-02-11T16:07:37.163 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.148+0000 7fe93effd700 1 -- 172.21.15.88:0/1908224760 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe940012890 con 0x7fe9481345d0 2020-02-11T16:07:37.163 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.148+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9480a4aa0 con 0x7fe9481345d0 2020-02-11T16:07:37.163 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.148+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.163 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.148+0000 7fe93effd700 1 -- 172.21.15.88:0/1908224760 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe9400129f0 con 0x7fe9481345d0 2020-02-11T16:07:37.163 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.148+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.163 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.149+0000 7fe93effd700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe930039d50 0x7fe93003c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:37.164 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.149+0000 7fe93effd700 1 -- 172.21.15.88:0/1908224760 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fe940049260 con 0x7fe9481345d0 2020-02-11T16:07:37.164 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.149+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94809faa0 con 0x7fe9481345d0 2020-02-11T16:07:37.164 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.149+0000 7fe94e107700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe930039d50 0x7fe93003c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:37.164 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.149+0000 7fe94e107700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe930039d50 0x7fe93003c210 crc :-1 s=READY pgs=133 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:37.165 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.152+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:37.165 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.153+0000 7fe93effd700 1 -- 172.21.15.88:0/1908224760 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe94002e940 con 0x7fe9481345d0 2020-02-11T16:07:37.336 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:37.334+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe9480565b0 con 0x7fe9481345d0 2020-02-11T16:07:38.042 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:38.039+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:38.042 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:38.039+0000 7fe93effd700 1 -- 172.21.15.88:0/1908224760 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v11) v1 ==== 167+0+0 (secure 0 0 0) 0x7fe940031410 con 0x7fe9481345d0 2020-02-11T16:07:38.180 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:38.177+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe948135210 con 0x7fe9481345d0 2020-02-11T16:07:39.046 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.043+0000 7fe94e908700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.046 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.043+0000 7fe93effd700 1 -- 172.21.15.88:0/1908224760 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v12) v1 ==== 167+0+0 (secure 0 0 0) 0x7fe940031850 con 0x7fe9481345d0 2020-02-11T16:07:39.048 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.045+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe930039d50 msgr2=0x7fe93003c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:39.049 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.045+0000 7fe94fb6a700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe930039d50 0x7fe93003c210 crc :-1 s=READY pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:39.049 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.045+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 msgr2=0x7fe948134a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:39.049 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.045+0000 7fe94fb6a700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fe9380010d0 tx=0x7fe940010b90).stop 2020-02-11T16:07:39.049 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.046+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 shutdown_connections 2020-02-11T16:07:39.049 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.046+0000 7fe94fb6a700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9481345d0 0x7fe948134a30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:39.049 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.046+0000 7fe94fb6a700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe930039d50 0x7fe93003c210 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:39.049 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.046+0000 7fe94fb6a700 1 --2- 172.21.15.88:0/1908224760 >> v2:172.21.15.52:3300/0 conn(0x7fe948129480 0x7fe948120990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:39.050 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.046+0000 7fe94fb6a700 1 --2- 172.21.15.88:0/1908224760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe94809fc30 0x7fe9480a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:39.050 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.046+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 >> 172.21.15.88:0/1908224760 conn(0x7fe94805c170 msgr2=0x7fe9480a6290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:39.050 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.046+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 shutdown_connections 2020-02-11T16:07:39.050 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.046+0000 7fe94fb6a700 1 -- 172.21.15.88:0/1908224760 wait complete. 2020-02-11T16:07:39.050 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:07:39.059 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo asdf 2020-02-11T16:07:39.062 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/foo 2020-02-11T16:07:39.072 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep asdf .snap/foo/foo 2020-02-11T16:07:39.080 INFO:tasks.workunit.client.0.smithi088.stdout:asdf 2020-02-11T16:07:39.080 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/foo 2020-02-11T16:07:39.087 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo asdf 2020-02-11T16:07:39.088 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/bar 2020-02-11T16:07:39.097 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm bar 2020-02-11T16:07:39.100 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep asdf .snap/bar/bar 2020-02-11T16:07:39.106 INFO:tasks.workunit.client.0.smithi088.stdout:asdf 2020-02-11T16:07:39.107 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/bar 2020-02-11T16:07:39.113 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm foo 2020-02-11T16:07:39.116 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps false 2020-02-11T16:07:39.207 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.197+0000 7f3efeafc700 1 Processor -- start 2020-02-11T16:07:39.207 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.198+0000 7f3efeafc700 1 -- start start 2020-02-11T16:07:39.207 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.198+0000 7f3efeafc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ef80a57c0 0x7f3ef80a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:39.207 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.198+0000 7f3efeafc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef80a50f0 con 0x7f3ef80a5e50 2020-02-11T16:07:39.207 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.198+0000 7f3efeafc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef80a7780 con 0x7f3ef80aa220 2020-02-11T16:07:39.207 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.198+0000 7f3efeafc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80a1df0 con 0x7f3ef80a57c0 2020-02-11T16:07:39.208 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.198+0000 7f3efd099700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3ef80aa220 0x7f3ef80a6960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40548/0 (socket says 172.21.15.88:40548) 2020-02-11T16:07:39.208 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.198+0000 7f3efd099700 1 -- 172.21.15.88:0/3031378440 learned_addr learned my addr 172.21.15.88:0/3031378440 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:39.208 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.198+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977774803 0 0) 0x7f3ef80a7780 con 0x7f3ef80aa220 2020-02-11T16:07:39.208 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efd89a700 1 --2- 172.21.15.88:0/3031378440 >> v2:172.21.15.52:3300/0 conn(0x7f3ef80a57c0 0x7f3ef80a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:39.208 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee4003230 con 0x7f3ef80aa220 2020-02-11T16:07:39.208 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2323737529 0 0) 0x7f3ee4003230 con 0x7f3ef80aa220 2020-02-11T16:07:39.208 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 >> v2:172.21.15.52:3300/0 conn(0x7f3ef80a57c0 msgr2=0x7f3ef80a24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:39.209 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 --2- 172.21.15.88:0/3031378440 >> v2:172.21.15.52:3300/0 conn(0x7f3ef80a57c0 0x7f3ef80a24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:39.209 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 >> v1:172.21.15.52:6789/0 conn(0x7f3ef80a5e50 legacy=0x7f3ef80a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:39.209 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80a2090 con 0x7f3ef80aa220 2020-02-11T16:07:39.209 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f3ef4001a50 con 0x7f3ef80aa220 2020-02-11T16:07:39.209 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 >> v1:172.21.15.88:6789/0 conn(0x7f3ef80aa220 legacy=0x7f3ef80a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:39.209 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ee4003720 0x7f3ee4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:39.210 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 0x7f3ee4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:39.210 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee4004db0 0x7f3ee400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:39.210 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80a1df0 con 0x7f3ee4004db0 2020-02-11T16:07:39.210 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40041c0 con 0x7f3ee40044d0 2020-02-11T16:07:39.211 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee404fb90 con 0x7f3ee4003720 2020-02-11T16:07:39.211 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 0x7f3ee4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:39.211 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efd89a700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee4004db0 0x7f3ee400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:39.211 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efd099700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ee4003720 0x7f3ee4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:39.211 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 -- 172.21.15.88:0/3031378440 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ee4003720 msgr2=0x7f3ee4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:39.211 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ee4003720 0x7f3ee4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:39.211 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 -- 172.21.15.88:0/3031378440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee4004db0 msgr2=0x7f3ee400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:39.212 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee4004db0 0x7f3ee400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:39.212 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 -- 172.21.15.88:0/3031378440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4003230 con 0x7f3ee40044d0 2020-02-11T16:07:39.212 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efd89a700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee4004db0 0x7f3ee400b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:07:39.212 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efd89a700 1 -- 172.21.15.88:0/3031378440 reap_dead start 2020-02-11T16:07:39.212 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 0x7f3ee4004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ee40054a0 tx=0x7f3ee800fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.212 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 0x7f3ee4004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ee40054a0 tx=0x7f3ee800fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.212 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 0x7f3ee4004950 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f3ee40054a0 tx=0x7f3ee800fd40).ready entity=mon.1 client_cookie=d1644379d586568a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:39.213 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 0x7f3ee4004950 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f3ee40054a0 tx=0x7f3ee800fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.213 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee8003540 con 0x7f3ee40044d0 2020-02-11T16:07:39.213 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 0x7f3ee4004950 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f3ee40054a0 tx=0x7f3ee800fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.213 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efc898700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 0x7f3ee4004950 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f3ee40054a0 tx=0x7f3ee800fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.213 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee80036a0 con 0x7f3ee40044d0 2020-02-11T16:07:39.213 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3eeffff700 1 -- 172.21.15.88:0/3031378440 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee8003a80 con 0x7f3ee40044d0 2020-02-11T16:07:39.213 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efeafc700 1 -- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 msgr2=0x7f3ee4004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:39.214 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.199+0000 7f3efeafc700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 0x7f3ee4004950 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f3ee40054a0 tx=0x7f3ee800fd40).stop 2020-02-11T16:07:39.214 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.200+0000 7f3efeafc700 1 -- 172.21.15.88:0/3031378440 shutdown_connections 2020-02-11T16:07:39.214 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.200+0000 7f3efeafc700 1 --2- 172.21.15.88:0/3031378440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40044d0 0x7f3ee4004950 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:39.214 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.200+0000 7f3efeafc700 1 -- 172.21.15.88:0/3031378440 >> 172.21.15.88:0/3031378440 conn(0x7f3ef805b3d0 msgr2=0x7f3ef809d250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:39.214 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.200+0000 7f3efeafc700 1 -- 172.21.15.88:0/3031378440 shutdown_connections 2020-02-11T16:07:39.214 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.200+0000 7f3efeafc700 1 -- 172.21.15.88:0/3031378440 wait complete. 2020-02-11T16:07:39.214 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.201+0000 7f3efeafc700 1 Processor -- start 2020-02-11T16:07:39.215 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.201+0000 7f3efeafc700 1 -- start start 2020-02-11T16:07:39.215 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efeafc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ef8063d30 0x7f3ef80a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:39.215 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efeafc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef8063120 con 0x7f3ef80a27d0 2020-02-11T16:07:39.215 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efeafc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef80aa6f0 con 0x7f3ee40044d0 2020-02-11T16:07:39.215 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efeafc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef809fce0 con 0x7f3ef8063d30 2020-02-11T16:07:39.215 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efd099700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3ee40044d0 0x7f3ef809eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40560/0 (socket says 172.21.15.88:40560) 2020-02-11T16:07:39.215 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efd099700 1 -- 172.21.15.88:0/682138025 learned_addr learned my addr 172.21.15.88:0/682138025 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:39.216 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> v2:172.21.15.52:3300/0 conn(0x7f3ef8063d30 0x7f3ef80a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:39.216 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089447644 0 0) 0x7f3ef80aa6f0 con 0x7f3ee40044d0 2020-02-11T16:07:39.216 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003230 con 0x7f3ee40044d0 2020-02-11T16:07:39.216 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efd89a700 1 -- 172.21.15.88:0/682138025 >> v1:172.21.15.88:6789/0 conn(0x7f3ee40044d0 legacy=0x7f3ef809eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:39.216 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143983620 0 0) 0x7f3ef8063120 con 0x7f3ef80a27d0 2020-02-11T16:07:39.216 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efd89a700 1 -- 172.21.15.88:0/682138025 >> v1:172.21.15.52:6789/0 conn(0x7f3ef80a27d0 legacy=0x7f3ef809f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:39.216 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efd89a700 1 -- 172.21.15.88:0/682138025 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80635f0 con 0x7f3ef8063d30 2020-02-11T16:07:39.217 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> v2:172.21.15.52:3300/0 conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.217 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> v2:172.21.15.52:3300/0 conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.217 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.202+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:39.217 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.217 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef0005aa0 con 0x7f3ef8063d30 2020-02-11T16:07:39.217 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.218 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef8063890 con 0x7f3ef8063d30 2020-02-11T16:07:39.218 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef0005c00 con 0x7f3ef8063d30 2020-02-11T16:07:39.218 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.218 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef00085e0 con 0x7f3ef8063d30 2020-02-11T16:07:39.218 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef8135830 con 0x7f3ef8063d30 2020-02-11T16:07:39.218 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.218 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3ef0007140 con 0x7f3ef8063d30 2020-02-11T16:07:39.219 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.203+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.219 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.204+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef80565b0 con 0x7f3ef8063d30 2020-02-11T16:07:39.219 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.204+0000 7f3eedffb700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3ed8039f20 0x7f3ed803c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:39.219 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.204+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f3ef0049320 con 0x7f3ef8063d30 2020-02-11T16:07:39.219 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.204+0000 7f3efd099700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3ed8039f20 0x7f3ed803c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:39.219 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.204+0000 7f3efd099700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3ed8039f20 0x7f3ed803c3e0 crc :-1 s=READY pgs=134 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:39.220 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.208+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:39.220 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.208+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3ef002e8e0 con 0x7f3ef8063d30 2020-02-11T16:07:39.387 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:39.384+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"} v 0) v1 -- 0x7f3ef805fff0 con 0x7f3ef8063d30 2020-02-11T16:07:40.052 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:40.050+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:40.053 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:40.050+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"}]=0 disabled new snapshots v13) v1 ==== 139+0+0 (secure 0 0 0) 0x7f3ef00313f0 con 0x7f3ef8063d30 2020-02-11T16:07:40.192 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:40.189+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"} v 0) v1 -- 0x7f3ef805e8e0 con 0x7f3ef8063d30 2020-02-11T16:07:40.869 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:07:40.869 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:07:40.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.978+0000 7faad7fd2700 1 Processor -- start 2020-02-11T16:07:40.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.978+0000 7faad7fd2700 1 -- start start 2020-02-11T16:07:40.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad7fd2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faad00a2fa0 0x7faad00a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:40.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad7fd2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faad00a5410 0x7faad00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:40.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad7fd2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad00a4350 con 0x7faad0131280 2020-02-11T16:07:40.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad7fd2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad00a1e60 con 0x7faad00a2fa0 2020-02-11T16:07:40.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad7fd2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad00a3450 con 0x7faad00a5410 2020-02-11T16:07:40.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faad00a5410 0x7faad00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:40.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad656f700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faad0131280 0x7faad01316d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40572/0 (socket says 172.21.15.88:40572) 2020-02-11T16:07:40.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad656f700 1 -- 172.21.15.88:0/803000312 learned_addr learned my addr 172.21.15.88:0/803000312 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:40.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad5d6e700 1 --2- 172.21.15.88:0/803000312 >> v2:172.21.15.52:3300/0 conn(0x7faad00a2fa0 0x7faad00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:40.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 -- 172.21.15.88:0/803000312 >> v2:172.21.15.52:3300/0 conn(0x7faad00a2fa0 msgr2=0x7faad00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:40.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 --2- 172.21.15.88:0/803000312 >> v2:172.21.15.52:3300/0 conn(0x7faad00a2fa0 0x7faad00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:40.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 -- 172.21.15.88:0/803000312 >> v1:172.21.15.88:6789/0 conn(0x7faad0131280 legacy=0x7faad01316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:40.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad4d6c700 1 -- 172.21.15.88:0/803000312 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382721850 0 0) 0x7faad00a4350 con 0x7faad0131280 2020-02-11T16:07:40.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 -- 172.21.15.88:0/803000312 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00a3a40 con 0x7faad00a5410 2020-02-11T16:07:40.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 --2- 172.21.15.88:0/803000312 >> v2:172.21.15.88:3300/0 conn(0x7faad00a5410 0x7faad00a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faacc002f30 tx=0x7faacc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:40.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 --2- 172.21.15.88:0/803000312 >> v2:172.21.15.88:3300/0 conn(0x7faad00a5410 0x7faad00a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faacc002f30 tx=0x7faacc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:40.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 --2- 172.21.15.88:0/803000312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faad00a5410 0x7faad00a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7faacc002f30 tx=0x7faacc007a40).ready entity=mon.1 client_cookie=b927c8c6614067fe server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:40.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 --2- 172.21.15.88:0/803000312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faad00a5410 0x7faad00a5870 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7faacc002f30 tx=0x7faacc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:40.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 --2- 172.21.15.88:0/803000312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faad00a5410 0x7faad00a5870 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7faacc002f30 tx=0x7faacc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad556d700 1 --2- 172.21.15.88:0/803000312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faad00a5410 0x7faad00a5870 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7faacc002f30 tx=0x7faacc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.979+0000 7faad4d6c700 1 -- 172.21.15.88:0/803000312 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faacc011470 con 0x7faad00a5410 2020-02-11T16:07:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.980+0000 7faad4d6c700 1 -- 172.21.15.88:0/803000312 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc0115d0 con 0x7faad00a5410 2020-02-11T16:07:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.980+0000 7faad4d6c700 1 -- 172.21.15.88:0/803000312 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faacc011970 con 0x7faad00a5410 2020-02-11T16:07:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.980+0000 7faad7fd2700 1 -- 172.21.15.88:0/803000312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faad00a5410 msgr2=0x7faad00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.980+0000 7faad7fd2700 1 --2- 172.21.15.88:0/803000312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faad00a5410 0x7faad00a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7faacc002f30 tx=0x7faacc007a40).stop 2020-02-11T16:07:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.980+0000 7faad7fd2700 1 -- 172.21.15.88:0/803000312 shutdown_connections 2020-02-11T16:07:40.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.980+0000 7faad7fd2700 1 --2- 172.21.15.88:0/803000312 >> v2:172.21.15.52:3300/0 conn(0x7faad00a2fa0 0x7faad00a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:40.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.980+0000 7faad7fd2700 1 --2- 172.21.15.88:0/803000312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faad00a5410 0x7faad00a5870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:40.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.980+0000 7faad7fd2700 1 -- 172.21.15.88:0/803000312 >> 172.21.15.88:0/803000312 conn(0x7faad009d110 msgr2=0x7faad009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:40.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.980+0000 7faad7fd2700 1 -- 172.21.15.88:0/803000312 shutdown_connections 2020-02-11T16:07:40.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.980+0000 7faad7fd2700 1 -- 172.21.15.88:0/803000312 wait complete. 2020-02-11T16:07:40.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.981+0000 7faad7fd2700 1 Processor -- start 2020-02-11T16:07:40.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.981+0000 7faad7fd2700 1 -- start start 2020-02-11T16:07:40.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.981+0000 7faad7fd2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faad00a5410 0x7faad0065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:40.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad7fd2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad0065cf0 con 0x7faad0131280 2020-02-11T16:07:40.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad7fd2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad01326c0 con 0x7faad00a2fa0 2020-02-11T16:07:40.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad7fd2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad01324d0 con 0x7faad00a5410 2020-02-11T16:07:40.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad5d6e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faad00a2fa0 0x7faad00655e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40574/0 (socket says 172.21.15.88:40574) 2020-02-11T16:07:40.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad5d6e700 1 -- 172.21.15.88:0/1489163083 learned_addr learned my addr 172.21.15.88:0/1489163083 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:40.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064361071 0 0) 0x7faad01326c0 con 0x7faad00a2fa0 2020-02-11T16:07:40.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab0002fe0 con 0x7faad00a2fa0 2020-02-11T16:07:40.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad556d700 1 --2- 172.21.15.88:0/1489163083 >> v2:172.21.15.52:3300/0 conn(0x7faad00a5410 0x7faad0065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:40.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1790859105 0 0) 0x7faab0002fe0 con 0x7faad00a2fa0 2020-02-11T16:07:40.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faad01326c0 con 0x7faad00a2fa0 2020-02-11T16:07:40.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7faac00015a0 con 0x7faad00a2fa0 2020-02-11T16:07:40.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 >> v2:172.21.15.52:3300/0 conn(0x7faad00a5410 msgr2=0x7faad0065fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:40.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 --2- 172.21.15.88:0/1489163083 >> v2:172.21.15.52:3300/0 conn(0x7faad00a5410 0x7faad0065fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:40.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 >> v1:172.21.15.88:6789/0 conn(0x7faad00a2fa0 legacy=0x7faad00655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:40.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 >> v1:172.21.15.52:6789/0 conn(0x7faad0131280 legacy=0x7faad01489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:40.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab0004a00 0x7faab0004e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:40.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faab0003920 0x7faab0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:40.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab0004720 con 0x7faab0004a00 2020-02-11T16:07:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab000bbb0 con 0x7faab00041c0 2020-02-11T16:07:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab000bcf0 con 0x7faab0003920 2020-02-11T16:07:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad5d6e700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab0004a00 0x7faab0004e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad556d700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faab0003920 0x7faab0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad656f700 1 -- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faab0003920 msgr2=0x7faab0003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:40.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faab0003920 0x7faab0003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:40.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad656f700 1 -- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab0004a00 msgr2=0x7faab0004e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:40.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab0004a00 0x7faab0004e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:40.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad656f700 1 -- 172.21.15.88:0/1489163083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad0132920 con 0x7faab00041c0 2020-02-11T16:07:40.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad7fd2700 1 -- 172.21.15.88:0/1489163083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad0148460 con 0x7faab00041c0 2020-02-11T16:07:40.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.982+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:40.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faad7fd2700 1 -- 172.21.15.88:0/1489163083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad012e4b0 con 0x7faab00041c0 2020-02-11T16:07:40.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faad656f700 1 -- 172.21.15.88:0/1489163083 reap_dead start 2020-02-11T16:07:40.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:40.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:40.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faac8005d40 con 0x7faab00041c0 2020-02-11T16:07:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac8012540 con 0x7faab00041c0 2020-02-11T16:07:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faac8005ea0 con 0x7faab00041c0 2020-02-11T16:07:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7faac80128e0 con 0x7faab00041c0 2020-02-11T16:07:41.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.983+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.984+0000 7faabeffd700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faab003dda0 0x7faab0040260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.984+0000 7faad7fd2700 1 -- 172.21.15.88:0/1489163083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad00565b0 con 0x7faab00041c0 2020-02-11T16:07:41.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.984+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7faac8049700 con 0x7faab00041c0 2020-02-11T16:07:41.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.984+0000 7faad5d6e700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faab003dda0 0x7faab0040260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.984+0000 7faad5d6e700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faab003dda0 0x7faab0040260 crc :-1 s=READY pgs=135 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.987+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:40.987+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7faac802ebd0 con 0x7faab00041c0 2020-02-11T16:07:41.056 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.053+0000 7f3efd89a700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.056 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.053+0000 7f3eedffb700 1 -- 172.21.15.88:0/682138025 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false"}]=0 disabled new snapshots v14) v1 ==== 139+0+0 (secure 0 0 0) 0x7f3ef0031830 con 0x7f3ef8063d30 2020-02-11T16:07:41.058 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.055+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3ed8039f20 msgr2=0x7f3ed803c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.058 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.055+0000 7f3efeafc700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3ed8039f20 0x7f3ed803c3e0 crc :-1 s=READY pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.055+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 msgr2=0x7f3ef80a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.055+0000 7f3efeafc700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f3ef8066de0 tx=0x7f3ef000c5c0).stop 2020-02-11T16:07:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.055+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 shutdown_connections 2020-02-11T16:07:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.055+0000 7f3efeafc700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3ed8039f20 0x7f3ed803c3e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.055+0000 7f3efeafc700 1 --2- 172.21.15.88:0/682138025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef8063d30 0x7f3ef80a0a20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.055+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 >> 172.21.15.88:0/682138025 conn(0x7f3ef805b3d0 msgr2=0x7f3ef80a9720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.055+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 shutdown_connections 2020-02-11T16:07:41.060 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.055+0000 7f3efeafc700 1 -- 172.21.15.88:0/682138025 wait complete. 2020-02-11T16:07:41.060 INFO:tasks.workunit.client.0.smithi088.stderr:disabled new snapshots 2020-02-11T16:07:41.067 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_failure mkdir .snap/baz 2020-02-11T16:07:41.067 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/baz 2020-02-11T16:07:41.071 INFO:tasks.workunit.client.0.smithi088.stderr:mkdir: cannot create directory ‘.snap/baz’: Operation not permitted 2020-02-11T16:07:41.071 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2020-02-11T16:07:41.071 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:07:41.071 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:07:41.071 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:07:41.072 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:07:41.139 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2020-02-11T16:07:41.139 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2020-02-11T16:07:41.171 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:07:41.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.183+0000 7faad7fd2700 1 -- 172.21.15.88:0/1489163083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7faad005ccb0 con 0x7faab00041c0 2020-02-11T16:07:41.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.184+0000 7faad656f700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.184+0000 7faabeffd700 1 -- 172.21.15.88:0/1489163083 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7faac8030b30 con 0x7faab00041c0 2020-02-11T16:07:41.187 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:41.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.185+0000 7faad7fd2700 1 -- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faab003dda0 msgr2=0x7faab0040260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.185+0000 7faad7fd2700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faab003dda0 0x7faab0040260 crc :-1 s=READY pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.185+0000 7faad7fd2700 1 -- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 msgr2=0x7faab000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.185+0000 7faad7fd2700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7faad01323e0 tx=0x7faac8010bd0).stop 2020-02-11T16:07:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.185+0000 7faad7fd2700 1 -- 172.21.15.88:0/1489163083 shutdown_connections 2020-02-11T16:07:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.185+0000 7faad7fd2700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faab003dda0 0x7faab0040260 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.185+0000 7faad7fd2700 1 --2- 172.21.15.88:0/1489163083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab00041c0 0x7faab000b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.185+0000 7faad7fd2700 1 -- 172.21.15.88:0/1489163083 >> 172.21.15.88:0/1489163083 conn(0x7faad009d110 msgr2=0x7faad0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:41.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.185+0000 7faad7fd2700 1 -- 172.21.15.88:0/1489163083 shutdown_connections 2020-02-11T16:07:41.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.186+0000 7faad7fd2700 1 -- 172.21.15.88:0/1489163083 wait complete. 2020-02-11T16:07:41.199 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":28,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:41.199 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:07:41.199 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:07:41.199 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:07:41.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.257+0000 7f070eba1700 1 Processor -- start 2020-02-11T16:07:41.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.257+0000 7f070eba1700 1 -- start start 2020-02-11T16:07:41.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070eba1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07080a73e0 0x7f070809e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:41.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070eba1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f070809d700 0x7f0708024e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:41.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070eba1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0708067310 con 0x7f070809d250 2020-02-11T16:07:41.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070eba1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07080a5dc0 con 0x7f070809d700 2020-02-11T16:07:41.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070eba1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070809ed50 con 0x7f07080a73e0 2020-02-11T16:07:41.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07080a73e0 0x7f070809e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07080a73e0 0x7f070809e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52962/0 (socket says 172.21.15.88:52962) 2020-02-11T16:07:41.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 -- 172.21.15.88:0/251123168 learned_addr learned my addr 172.21.15.88:0/251123168 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:41.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070fe03700 1 --2- 172.21.15.88:0/251123168 >> v2:172.21.15.52:3300/0 conn(0x7f070809d700 0x7f0708024e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 -- 172.21.15.88:0/251123168 >> v2:172.21.15.52:3300/0 conn(0x7f070809d700 msgr2=0x7f0708024e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:41.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 --2- 172.21.15.88:0/251123168 >> v2:172.21.15.52:3300/0 conn(0x7f070809d700 0x7f0708024e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:41.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 -- 172.21.15.88:0/251123168 >> v1:172.21.15.52:6789/0 conn(0x7f070809d250 legacy=0x7f0708024760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:41.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 -- 172.21.15.88:0/251123168 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07080a6bc0 con 0x7f07080a73e0 2020-02-11T16:07:41.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070fe03700 1 --2- 172.21.15.88:0/251123168 >> v2:172.21.15.52:3300/0 conn(0x7f070809d700 0x7f0708024e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:07:41.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 --2- 172.21.15.88:0/251123168 >> v2:172.21.15.88:3300/0 conn(0x7f07080a73e0 0x7f070809e8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07080a6f40 tx=0x7f0704007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 --2- 172.21.15.88:0/251123168 >> v2:172.21.15.88:3300/0 conn(0x7f07080a73e0 0x7f070809e8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07080a6f40 tx=0x7f0704007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 --2- 172.21.15.88:0/251123168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f070809e8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f07080a6f40 tx=0x7f0704007a40).ready entity=mon.1 client_cookie=3cd9d7018ffeee4c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070e3a0700 1 --2- 172.21.15.88:0/251123168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f070809e8f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f07080a6f40 tx=0x7f0704007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.258+0000 7f070d39e700 1 -- 172.21.15.88:0/251123168 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07040116e0 con 0x7f07080a73e0 2020-02-11T16:07:41.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070e3a0700 1 --2- 172.21.15.88:0/251123168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f070809e8f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f07080a6f40 tx=0x7f0704007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070e3a0700 1 --2- 172.21.15.88:0/251123168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f070809e8f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f07080a6f40 tx=0x7f0704007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070d39e700 1 -- 172.21.15.88:0/251123168 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704011840 con 0x7f07080a73e0 2020-02-11T16:07:41.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070d39e700 1 -- 172.21.15.88:0/251123168 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0704011c20 con 0x7f07080a73e0 2020-02-11T16:07:41.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070eba1700 1 -- 172.21.15.88:0/251123168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 msgr2=0x7f070809e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070eba1700 1 --2- 172.21.15.88:0/251123168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f070809e8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f07080a6f40 tx=0x7f0704007a40).stop 2020-02-11T16:07:41.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070eba1700 1 -- 172.21.15.88:0/251123168 shutdown_connections 2020-02-11T16:07:41.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070eba1700 1 --2- 172.21.15.88:0/251123168 >> v2:172.21.15.52:3300/0 conn(0x7f070809d700 0x7f0708024e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:41.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070eba1700 1 --2- 172.21.15.88:0/251123168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f070809e8f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070eba1700 1 -- 172.21.15.88:0/251123168 >> 172.21.15.88:0/251123168 conn(0x7f070805b610 msgr2=0x7f070805ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:41.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070eba1700 1 -- 172.21.15.88:0/251123168 shutdown_connections 2020-02-11T16:07:41.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.259+0000 7f070eba1700 1 -- 172.21.15.88:0/251123168 wait complete. 2020-02-11T16:07:41.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.260+0000 7f070eba1700 1 Processor -- start 2020-02-11T16:07:41.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.260+0000 7f070eba1700 1 -- start start 2020-02-11T16:07:41.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070eba1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f070809d250 0x7f070807e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070eba1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f070809d700 0x7f07080640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070eba1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07080a73e0 0x7f07080635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070eba1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0708064540 con 0x7f070809d700 2020-02-11T16:07:41.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070eba1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0708063a40 con 0x7f07080a73e0 2020-02-11T16:07:41.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070eba1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0708063d20 con 0x7f070809d250 2020-02-11T16:07:41.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07080a73e0 0x7f07080635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07080a73e0 0x7f07080635e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52972/0 (socket says 172.21.15.88:52972) 2020-02-11T16:07:41.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 -- 172.21.15.88:0/3626676720 learned_addr learned my addr 172.21.15.88:0/3626676720 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:41.273 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> v2:172.21.15.52:3300/0 conn(0x7f070809d700 0x7f07080640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.273 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070e3a0700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f070809d250 0x7f070807e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.273 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 -- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f070809d250 msgr2=0x7f070807e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.273 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f070809d250 0x7f070807e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.273 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 -- 172.21.15.88:0/3626676720 >> v2:172.21.15.52:3300/0 conn(0x7f070809d700 msgr2=0x7f07080640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.273 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> v2:172.21.15.52:3300/0 conn(0x7f070809d700 0x7f07080640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.274 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 -- 172.21.15.88:0/3626676720 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070807ea30 con 0x7f07080a73e0 2020-02-11T16:07:41.274 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> v2:172.21.15.88:3300/0 conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.274 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> v2:172.21.15.88:3300/0 conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.274 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.274 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.261+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.274 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.262+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.274 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.262+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0700007350 con 0x7f07080a73e0 2020-02-11T16:07:41.275 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.262+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.275 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.262+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07000074b0 con 0x7f07080a73e0 2020-02-11T16:07:41.275 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.262+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0708063140 con 0x7f07080a73e0 2020-02-11T16:07:41.275 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.262+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0700007890 con 0x7f07080a73e0 2020-02-11T16:07:41.275 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.262+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070806ed60 con 0x7f07080a73e0 2020-02-11T16:07:41.275 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.262+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.276 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.263+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0700012370 con 0x7f07080a73e0 2020-02-11T16:07:41.276 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.263+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.276 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.263+0000 7f06feffd700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f06f0039c10 0x7f06f003c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.276 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.263+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f0700049f70 con 0x7f07080a73e0 2020-02-11T16:07:41.276 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.263+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07080565b0 con 0x7f07080a73e0 2020-02-11T16:07:41.276 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.263+0000 7f070e3a0700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f06f0039c10 0x7f06f003c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.276 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.263+0000 7f070e3a0700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f06f0039c10 0x7f06f003c0d0 crc :-1 s=READY pgs=136 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.277 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.266+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.277 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.266+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f070002f510 con 0x7f07080a73e0 2020-02-11T16:07:41.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.345+0000 7f605ea04700 1 Processor -- start 2020-02-11T16:07:41.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.345+0000 7f605ea04700 1 -- start start 2020-02-11T16:07:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.346+0000 7f605ea04700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f605813bf00 0x7f60580a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.346+0000 7f605ea04700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60581325d0 con 0x7f605805fc80 2020-02-11T16:07:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.346+0000 7f605ea04700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605813b2f0 con 0x7f60580670f0 2020-02-11T16:07:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.346+0000 7f605ea04700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60580a9bb0 con 0x7f605813bf00 2020-02-11T16:07:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.346+0000 7f605da02700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f605805fc80 0x7f60580669e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60616/0 (socket says 172.21.15.88:60616) 2020-02-11T16:07:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.346+0000 7f605da02700 1 -- 172.21.15.88:0/1998786389 learned_addr learned my addr 172.21.15.88:0/1998786389 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.346+0000 7f605d201700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f60580670f0 0x7f6058140680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40604/0 (socket says 172.21.15.88:40604) 2020-02-11T16:07:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.346+0000 7f605e203700 1 --2- 172.21.15.88:0/1998786389 >> v2:172.21.15.88:3300/0 conn(0x7f605813bf00 0x7f60580a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.346+0000 7f605ca00700 1 -- 172.21.15.88:0/1998786389 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295352314 0 0) 0x7f605813b2f0 con 0x7f60580670f0 2020-02-11T16:07:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605ca00700 1 -- 172.21.15.88:0/1998786389 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6040003230 con 0x7f60580670f0 2020-02-11T16:07:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605e203700 1 -- 172.21.15.88:0/1998786389 >> v1:172.21.15.88:6789/0 conn(0x7f60580670f0 legacy=0x7f6058140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605e203700 1 -- 172.21.15.88:0/1998786389 >> v1:172.21.15.52:6789/0 conn(0x7f605805fc80 legacy=0x7f60580669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605e203700 1 -- 172.21.15.88:0/1998786389 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605805c1a0 con 0x7f605813bf00 2020-02-11T16:07:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605e203700 1 --2- 172.21.15.88:0/1998786389 >> v2:172.21.15.88:3300/0 conn(0x7f605813bf00 0x7f60580a9750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f60540010d0 tx=0x7f6050008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605e203700 1 --2- 172.21.15.88:0/1998786389 >> v2:172.21.15.88:3300/0 conn(0x7f605813bf00 0x7f60580a9750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f60540010d0 tx=0x7f6050008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605e203700 1 --2- 172.21.15.88:0/1998786389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f605813bf00 0x7f60580a9750 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f60540010d0 tx=0x7f6050008c60).ready entity=mon.1 client_cookie=a5fb3df38b563a55 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605e203700 1 --2- 172.21.15.88:0/1998786389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f605813bf00 0x7f60580a9750 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f60540010d0 tx=0x7f6050008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605ca00700 1 -- 172.21.15.88:0/1998786389 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6050011d20 con 0x7f605813bf00 2020-02-11T16:07:41.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605e203700 1 --2- 172.21.15.88:0/1998786389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f605813bf00 0x7f60580a9750 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f60540010d0 tx=0x7f6050008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605ca00700 1 -- 172.21.15.88:0/1998786389 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050011e80 con 0x7f605813bf00 2020-02-11T16:07:41.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605e203700 1 --2- 172.21.15.88:0/1998786389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f605813bf00 0x7f60580a9750 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f60540010d0 tx=0x7f6050008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605ca00700 1 -- 172.21.15.88:0/1998786389 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605000a350 con 0x7f605813bf00 2020-02-11T16:07:41.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605ea04700 1 -- 172.21.15.88:0/1998786389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f605813bf00 msgr2=0x7f60580a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.347+0000 7f605ea04700 1 --2- 172.21.15.88:0/1998786389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f605813bf00 0x7f60580a9750 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f60540010d0 tx=0x7f6050008c60).stop 2020-02-11T16:07:41.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.348+0000 7f605ea04700 1 -- 172.21.15.88:0/1998786389 shutdown_connections 2020-02-11T16:07:41.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.348+0000 7f605ea04700 1 --2- 172.21.15.88:0/1998786389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f605813bf00 0x7f60580a9750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.348+0000 7f605ea04700 1 -- 172.21.15.88:0/1998786389 >> 172.21.15.88:0/1998786389 conn(0x7f60580aeea0 msgr2=0x7f60580aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:41.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.348+0000 7f605ea04700 1 -- 172.21.15.88:0/1998786389 shutdown_connections 2020-02-11T16:07:41.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.348+0000 7f605ea04700 1 -- 172.21.15.88:0/1998786389 wait complete. 2020-02-11T16:07:41.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.349+0000 7f605ea04700 1 Processor -- start 2020-02-11T16:07:41.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.349+0000 7f605ea04700 1 -- start start 2020-02-11T16:07:41.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.350+0000 7f605ea04700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f60580670f0 0x7f6058148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.350+0000 7f605ea04700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6058138330 con 0x7f605805fc80 2020-02-11T16:07:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.350+0000 7f605ea04700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605812d860 con 0x7f605813bf00 2020-02-11T16:07:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.350+0000 7f605ea04700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605812db00 con 0x7f60580670f0 2020-02-11T16:07:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.350+0000 7f605d201700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f60580670f0 0x7f6058148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.350+0000 7f605e203700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f605813bf00 0x7f605814f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40612/0 (socket says 172.21.15.88:40612) 2020-02-11T16:07:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.350+0000 7f605e203700 1 -- 172.21.15.88:0/413553930 learned_addr learned my addr 172.21.15.88:0/413553930 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605d201700 1 -- 172.21.15.88:0/413553930 >> v1:172.21.15.88:6789/0 conn(0x7f605813bf00 legacy=0x7f605814f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605d201700 1 -- 172.21.15.88:0/413553930 >> v1:172.21.15.52:6789/0 conn(0x7f605805fc80 legacy=0x7f6058148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564189178 0 0) 0x7f605812d860 con 0x7f605813bf00 2020-02-11T16:07:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605d201700 1 -- 172.21.15.88:0/413553930 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058138e90 con 0x7f60580670f0 2020-02-11T16:07:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605d201700 1 --2- 172.21.15.88:0/413553930 >> v2:172.21.15.88:3300/0 conn(0x7f60580670f0 0x7f6058148580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6058137710 tx=0x7f60480109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605d201700 1 --2- 172.21.15.88:0/413553930 >> v2:172.21.15.88:3300/0 conn(0x7f60580670f0 0x7f6058148580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6058137710 tx=0x7f60480109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605d201700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580670f0 0x7f6058148580 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f6058137710 tx=0x7f60480109e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605d201700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580670f0 0x7f6058148580 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f6058137710 tx=0x7f60480109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6048010440 con 0x7f60580670f0 2020-02-11T16:07:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605d201700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580670f0 0x7f6058148580 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f6058137710 tx=0x7f60480109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605d201700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580670f0 0x7f6058148580 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f6058137710 tx=0x7f60480109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800ca60 con 0x7f60580670f0 2020-02-11T16:07:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605ea04700 1 -- 172.21.15.88:0/413553930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6058149400 con 0x7f60580670f0 2020-02-11T16:07:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f604800cdc0 con 0x7f60580670f0 2020-02-11T16:07:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.351+0000 7f605ea04700 1 -- 172.21.15.88:0/413553930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605812d3a0 con 0x7f60580670f0 2020-02-11T16:07:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f605d201700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580670f0 0x7f6058148580 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f6058137710 tx=0x7f60480109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6048005520 con 0x7f60580670f0 2020-02-11T16:07:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f605ea04700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 0x7f60580ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f605d201700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580670f0 0x7f6058148580 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f6058137710 tx=0x7f60480109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f605ea04700 1 -- 172.21.15.88:0/413553930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605805e2f0 con 0x7f6058138680 2020-02-11T16:07:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 0x7f60580ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f6046ffd700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6038039a40 0x7f603803bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f605da02700 1 -- 172.21.15.88:0/413553930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f605812dd00 con 0x7f6058138680 2020-02-11T16:07:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f60480493b0 con 0x7f60580670f0 2020-02-11T16:07:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 0x7f60580ad970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 0x7f60580ad970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 0x7f60580ad970 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.352+0000 7f605e203700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6038039a40 0x7f603803bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.353+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 0x7f60580ad970 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.353+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6054005d00 con 0x7f6058138680 2020-02-11T16:07:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.353+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 0x7f60580ad970 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.353+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6054005e60 con 0x7f6058138680 2020-02-11T16:07:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.353+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 msgr2=0x7f60580ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.353+0000 7f6046ffd700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 0x7f60580ad970 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).stop 2020-02-11T16:07:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.353+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 msgr2=0x7f60580ad970 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.353+0000 7f6046ffd700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058138680 0x7f60580ad970 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).stop 2020-02-11T16:07:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.353+0000 7f605e203700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6038039a40 0x7f603803bf00 crc :-1 s=READY pgs=137 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.361+0000 7f605ea04700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 0x7f60580ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.361+0000 7f605ea04700 1 -- 172.21.15.88:0/413553930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60581384c0 con 0x7f60580ac200 2020-02-11T16:07:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.361+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 0x7f60580ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.361+0000 7f605da02700 1 -- 172.21.15.88:0/413553930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f605812d680 con 0x7f60580ac200 2020-02-11T16:07:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.361+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 0x7f60580ac5e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.361+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 0x7f60580ac5e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.361+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 0x7f60580ac5e0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.361+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 0x7f60580ac5e0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.361+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6054009650 con 0x7f60580ac200 2020-02-11T16:07:41.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605da02700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 0x7f60580ac5e0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f60540097b0 con 0x7f60580ac200 2020-02-11T16:07:41.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 msgr2=0x7f60580ac5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f6046ffd700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 0x7f60580ac5e0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).stop 2020-02-11T16:07:41.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f6046ffd700 1 -- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 msgr2=0x7f60580ac5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:41.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f6046ffd700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580ac200 0x7f60580ac5e0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0x7f6054001190 tx=0x7f6054010930).stop 2020-02-11T16:07:41.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605ea04700 1 -- 172.21.15.88:0/413553930 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6038039a40 msgr2=0x7f603803bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605ea04700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6038039a40 0x7f603803bf00 crc :-1 s=READY pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605ea04700 1 -- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580670f0 msgr2=0x7f6058148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605ea04700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580670f0 0x7f6058148580 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f6058137710 tx=0x7f60480109e0).stop 2020-02-11T16:07:41.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605e203700 1 -- 172.21.15.88:0/413553930 reap_dead start 2020-02-11T16:07:41.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605e203700 1 -- 172.21.15.88:0/413553930 reap_dead start 2020-02-11T16:07:41.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605ea04700 1 -- 172.21.15.88:0/413553930 shutdown_connections 2020-02-11T16:07:41.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605ea04700 1 --2- 172.21.15.88:0/413553930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60580670f0 0x7f6058148580 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605ea04700 1 -- 172.21.15.88:0/413553930 >> 172.21.15.88:0/413553930 conn(0x7f60580aeea0 msgr2=0x7f605809de30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:41.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605ea04700 1 -- 172.21.15.88:0/413553930 shutdown_connections 2020-02-11T16:07:41.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.362+0000 7f605ea04700 1 -- 172.21.15.88:0/413553930 wait complete. 2020-02-11T16:07:41.372 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:07:41.372 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:41.372 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:41.373 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:07:41.373 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2020-02-11T16:07:41.373 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:07:41.373 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:07:41.373 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:07:41.373 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:07:41.374 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.374 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:07:41.374 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:41.374 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:07:41.374 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:07:41.374 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:41.374 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:41.375 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:41.375 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:41.375 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:41.375 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:41.375 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.375 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:07:41.375 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:07:41.376 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:41.376 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:41.376 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:41.376 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:41.376 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:41.376 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:41.376 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.377 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:07:41.377 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:07:41.377 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:07:41.377 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:07:41.377 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:07:41.377 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:07:41.377 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:41.378 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:41.378 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:07:41.378 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:07:41.378 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:41.378 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:07:41.378 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:41.378 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:07:41.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.380 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:07:41.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.380 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:41.380 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:41.380 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:41.380 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:41.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.381 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:41.381 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:07:41.381 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.381 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:41.381 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:07:41.382 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.382 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.382 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.382 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:07:41.382 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:07:41.382 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:41.383 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:41.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.383 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:41.383 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:41.383 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:41.383 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:41.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.384 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:41.384 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:07:41.384 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.384 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:41.385 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:07:41.385 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.385 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.385 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.385 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:07:41.385 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:07:41.386 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:41.386 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:41.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.386 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:41.386 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:41.386 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:41.387 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:41.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.387 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:41.387 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:07:41.387 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.388 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:41.388 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:07:41.388 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.388 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.388 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.389 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:07:41.389 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:07:41.389 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:41.389 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:41.389 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.389 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.390 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:07:41.390 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:07:41.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.390 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.390 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.390 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:41.391 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.391 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.391 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:07:41.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.391 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.391 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.391 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:41.392 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.392 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.392 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:07:41.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.392 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.392 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.392 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:07:41.393 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.393 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.393 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:07:41.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.393 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.393 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.393 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:07:41.394 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.394 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.394 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:07:41.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.394 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.394 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.394 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:41.395 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.395 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.395 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.395 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:07:41.396 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:07:41.464 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.461+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f070805e8e0 con 0x7f07080a73e0 2020-02-11T16:07:41.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.540+0000 7f999120a700 1 Processor -- start 2020-02-11T16:07:41.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.540+0000 7f999120a700 1 -- start start 2020-02-11T16:07:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.540+0000 7f999120a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f998c0a1520 0x7f998c131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.540+0000 7f999120a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0a4350 con 0x7f998c0a2fa0 2020-02-11T16:07:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.540+0000 7f999120a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0a3a40 con 0x7f998c0a5b20 2020-02-11T16:07:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.540+0000 7f999120a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c0a1e60 con 0x7f998c0a1520 2020-02-11T16:07:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.540+0000 7f998b59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f998c0a1520 0x7f998c131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.540+0000 7f998b59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f998c0a1520 0x7f998c131990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52994/0 (socket says 172.21.15.88:52994) 2020-02-11T16:07:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.540+0000 7f998a59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f998c0a5b20 0x7f998c131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40620/0 (socket says 172.21.15.88:40620) 2020-02-11T16:07:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.540+0000 7f998b59e700 1 -- 172.21.15.88:0/2248320204 learned_addr learned my addr 172.21.15.88:0/2248320204 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f998b59e700 1 -- 172.21.15.88:0/2248320204 >> v1:172.21.15.88:6789/0 conn(0x7f998c0a5b20 legacy=0x7f998c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f998b59e700 1 -- 172.21.15.88:0/2248320204 >> v1:172.21.15.52:6789/0 conn(0x7f998c0a2fa0 legacy=0x7f998c0a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f998b59e700 1 -- 172.21.15.88:0/2248320204 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0a3ce0 con 0x7f998c0a1520 2020-02-11T16:07:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f998b59e700 1 --2- 172.21.15.88:0/2248320204 >> v2:172.21.15.88:3300/0 conn(0x7f998c0a1520 0x7f998c131990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f998c05ef00 tx=0x7f9984008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f998b59e700 1 --2- 172.21.15.88:0/2248320204 >> v2:172.21.15.88:3300/0 conn(0x7f998c0a1520 0x7f998c131990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f998c05ef00 tx=0x7f9984008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f998b59e700 1 --2- 172.21.15.88:0/2248320204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a1520 0x7f998c131990 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984008c60).ready entity=mon.1 client_cookie=96b2d2f211a53613 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f998b59e700 1 --2- 172.21.15.88:0/2248320204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a1520 0x7f998c131990 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f998b59e700 1 --2- 172.21.15.88:0/2248320204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a1520 0x7f998c131990 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f9989d9b700 1 -- 172.21.15.88:0/2248320204 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f998400a160 con 0x7f998c0a1520 2020-02-11T16:07:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f998b59e700 1 --2- 172.21.15.88:0/2248320204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a1520 0x7f998c131990 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f9989d9b700 1 -- 172.21.15.88:0/2248320204 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998400a2c0 con 0x7f998c0a1520 2020-02-11T16:07:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f9989d9b700 1 -- 172.21.15.88:0/2248320204 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f998400a660 con 0x7f998c0a1520 2020-02-11T16:07:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f999120a700 1 -- 172.21.15.88:0/2248320204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a1520 msgr2=0x7f998c131990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f999120a700 1 --2- 172.21.15.88:0/2248320204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a1520 0x7f998c131990 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984008c60).stop 2020-02-11T16:07:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f999120a700 1 -- 172.21.15.88:0/2248320204 shutdown_connections 2020-02-11T16:07:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.541+0000 7f999120a700 1 --2- 172.21.15.88:0/2248320204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a1520 0x7f998c131990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.542+0000 7f999120a700 1 -- 172.21.15.88:0/2248320204 >> 172.21.15.88:0/2248320204 conn(0x7f998c09d110 msgr2=0x7f998c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.542+0000 7f999120a700 1 -- 172.21.15.88:0/2248320204 shutdown_connections 2020-02-11T16:07:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.542+0000 7f999120a700 1 -- 172.21.15.88:0/2248320204 wait complete. 2020-02-11T16:07:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.542+0000 7f999120a700 1 Processor -- start 2020-02-11T16:07:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.542+0000 7f999120a700 1 -- start start 2020-02-11T16:07:41.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f999120a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f998c0a2fa0 0x7f998c135330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f999120a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f998c0a5b20 0x7f998c135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f999120a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c061700 con 0x7f998c0a1520 2020-02-11T16:07:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f999120a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c131df0 con 0x7f998c0a5b20 2020-02-11T16:07:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f999120a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0614f0 con 0x7f998c0a2fa0 2020-02-11T16:07:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f998c0a5b20 0x7f998c135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f998c0a5b20 0x7f998c135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53002/0 (socket says 172.21.15.88:53002) 2020-02-11T16:07:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 -- 172.21.15.88:0/3101617967 learned_addr learned my addr 172.21.15.88:0/3101617967 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998a59c700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f998c0a2fa0 0x7f998c135330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 -- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f998c0a2fa0 msgr2=0x7f998c135330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f998c0a2fa0 0x7f998c135330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 -- 172.21.15.88:0/3101617967 >> v1:172.21.15.52:6789/0 conn(0x7f998c0a1520 legacy=0x7f998c061e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 -- 172.21.15.88:0/3101617967 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c1375c0 con 0x7f998c0a5b20 2020-02-11T16:07:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998a59c700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f998c0a2fa0 0x7f998c135330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:07:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 --2- 172.21.15.88:0/3101617967 >> v2:172.21.15.88:3300/0 conn(0x7f998c0a5b20 0x7f998c135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 --2- 172.21.15.88:0/3101617967 >> v2:172.21.15.88:3300/0 conn(0x7f998c0a5b20 0x7f998c135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a5b20 0x7f998c135790 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984011850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a5b20 0x7f998c135790 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a5b20 0x7f998c135790 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9984005c30 con 0x7f998c0a5b20 2020-02-11T16:07:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.543+0000 7f998b59e700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a5b20 0x7f998c135790 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9984005d90 con 0x7f998c0a5b20 2020-02-11T16:07:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f998400f760 con 0x7f998c0a5b20 2020-02-11T16:07:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f999120a700 1 -- 172.21.15.88:0/3101617967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c137300 con 0x7f998c0a5b20 2020-02-11T16:07:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f999120a700 1 -- 172.21.15.88:0/3101617967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c130e00 con 0x7f998c0a5b20 2020-02-11T16:07:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f998b59e700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a5b20 0x7f998c135790 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f999120a700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 0x7f998c135bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f999120a700 1 -- 172.21.15.88:0/3101617967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c05e2f0 con 0x7f998c137c50 2020-02-11T16:07:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f998400f990 con 0x7f998c0a5b20 2020-02-11T16:07:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f998b59e700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a5b20 0x7f998c135790 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 0x7f998c135bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.544+0000 7f997bfff700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9968039c40 0x7f996803c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f998404ac90 con 0x7f998c0a5b20 2020-02-11T16:07:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f998a59c700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9968039c40 0x7f996803c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f998ad9d700 1 -- 172.21.15.88:0/3101617967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f998c0aa3e0 con 0x7f998c137c50 2020-02-11T16:07:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 0x7f998c135bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 0x7f998c135bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f998a59c700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9968039c40 0x7f996803c100 crc :-1 s=READY pgs=138 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 0x7f998c135bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 0x7f998c135bf0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9980007540 con 0x7f998c137c50 2020-02-11T16:07:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 0x7f998c135bf0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f9980005980 con 0x7f998c137c50 2020-02-11T16:07:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 msgr2=0x7f998c135bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.545+0000 7f997bfff700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 0x7f998c135bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).stop 2020-02-11T16:07:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.546+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 msgr2=0x7f998c135bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.546+0000 7f997bfff700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c137c50 0x7f998c135bf0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).stop 2020-02-11T16:07:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.553+0000 7f999120a700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 0x7f998c0a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.553+0000 7f999120a700 1 -- 172.21.15.88:0/3101617967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0565b0 con 0x7f998c136050 2020-02-11T16:07:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.554+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 0x7f998c0a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.554+0000 7f998ad9d700 1 -- 172.21.15.88:0/3101617967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f998c05ccb0 con 0x7f998c136050 2020-02-11T16:07:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.554+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 0x7f998c0a7fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.554+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 0x7f998c0a7fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.554+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 0x7f998c0a7fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.554+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 0x7f998c0a7fc0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.554+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f998000f6f0 con 0x7f998c136050 2020-02-11T16:07:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f998ad9d700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 0x7f998c0a7fc0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3852 (secure 0 0 0) 0x7f998000b240 con 0x7f998c136050 2020-02-11T16:07:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 msgr2=0x7f998c0a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f997bfff700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 0x7f998c0a7fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f998c061a40 tx=0x7f9980010830).stop 2020-02-11T16:07:41.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f997bfff700 1 -- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 msgr2=0x7f998c0a7fc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:41.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f997bfff700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f998c136050 0x7f998c0a7fc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f999120a700 1 -- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9968039c40 msgr2=0x7f996803c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f999120a700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9968039c40 0x7f996803c100 crc :-1 s=READY pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f999120a700 1 -- 172.21.15.88:0/3101617967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a5b20 msgr2=0x7f998c135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f998b59e700 1 -- 172.21.15.88:0/3101617967 reap_dead start 2020-02-11T16:07:41.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f999120a700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a5b20 0x7f998c135790 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f998c05ef00 tx=0x7f9984011850).stop 2020-02-11T16:07:41.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f999120a700 1 -- 172.21.15.88:0/3101617967 shutdown_connections 2020-02-11T16:07:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f999120a700 1 --2- 172.21.15.88:0/3101617967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998c0a5b20 0x7f998c135790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f999120a700 1 -- 172.21.15.88:0/3101617967 >> 172.21.15.88:0/3101617967 conn(0x7f998c09d110 msgr2=0x7f998c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f999120a700 1 -- 172.21.15.88:0/3101617967 shutdown_connections 2020-02-11T16:07:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.555+0000 7f999120a700 1 -- 172.21.15.88:0/3101617967 wait complete. 2020-02-11T16:07:41.566 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:07:41.566 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:41.567 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:41.567 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:07:41.567 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2020-02-11T16:07:41.567 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:07:41.567 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:07:41.567 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:07:41.568 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:07:41.568 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.568 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:07:41.568 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:41.568 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:07:41.568 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:07:41.568 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:41.569 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:41.569 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:41.569 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:41.569 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:41.569 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:41.569 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.569 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:07:41.569 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:07:41.570 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:41.570 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:41.570 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:41.570 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:41.570 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:41.570 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:41.570 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.571 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:07:41.571 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:07:41.571 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:07:41.571 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:07:41.571 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:07:41.571 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:07:41.572 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:41.572 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:41.572 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:07:41.572 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:07:41.572 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:41.572 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:07:41.572 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:41.573 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:41.573 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:41.573 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:41.573 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:41.573 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:41.573 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.573 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:07:41.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.574 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:07:41.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.574 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:41.574 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:41.574 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:41.574 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:41.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:07:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:07:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:07:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:07:41.577 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:41.577 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:41.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.577 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:41.577 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:41.578 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:41.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:41.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.578 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:41.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:07:41.578 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.579 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:41.579 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:07:41.579 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.579 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.579 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:07:41.580 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:07:41.580 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:41.580 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:41.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.580 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:41.580 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:41.581 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:41.581 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:41.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.581 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:41.581 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:07:41.581 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.582 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:41.582 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:07:41.582 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.582 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.583 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:07:41.583 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:07:41.583 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:41.583 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:41.583 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.583 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.584 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:07:41.584 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:07:41.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.584 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.584 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.584 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:41.585 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.585 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.585 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:07:41.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.585 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.585 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.586 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:41.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.586 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.587 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:07:41.588 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:07:41.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.733+0000 7fa6293bd700 1 Processor -- start 2020-02-11T16:07:41.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.734+0000 7fa6293bd700 1 -- start start 2020-02-11T16:07:41.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.734+0000 7fa6293bd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa6240a5de0 0x7fa6240a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:41.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.734+0000 7fa6293bd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa624134a50 0x7fa624134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:41.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.734+0000 7fa6293bd700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6240a31b0 con 0x7fa6240a18a0 2020-02-11T16:07:41.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.734+0000 7fa6293bd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6240a3570 con 0x7fa6240a5de0 2020-02-11T16:07:41.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.734+0000 7fa6293bd700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240a3810 con 0x7fa624134a50 2020-02-11T16:07:41.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.734+0000 7fa622ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa6240a18a0 0x7fa6240a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40636/0 (socket says 172.21.15.88:40636) 2020-02-11T16:07:41.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.734+0000 7fa622ffd700 1 -- 172.21.15.88:0/3769227409 learned_addr learned my addr 172.21.15.88:0/3769227409 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:41.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 --2- 172.21.15.88:0/3769227409 >> v2:172.21.15.52:3300/0 conn(0x7fa6240a5de0 0x7fa6240a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6237fe700 1 --2- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa624134a50 0x7fa624134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa621ffb700 1 -- 172.21.15.88:0/3769227409 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335880498 0 0) 0x7fa6240a31b0 con 0x7fa6240a18a0 2020-02-11T16:07:41.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa621ffb700 1 -- 172.21.15.88:0/3769227409 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa608003230 con 0x7fa6240a18a0 2020-02-11T16:07:41.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 -- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa624134a50 msgr2=0x7fa624134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:41.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 --2- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa624134a50 0x7fa624134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:41.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa621ffb700 1 -- 172.21.15.88:0/3769227409 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 276561732 0 0) 0x7fa608003230 con 0x7fa6240a18a0 2020-02-11T16:07:41.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 -- 172.21.15.88:0/3769227409 >> v1:172.21.15.88:6789/0 conn(0x7fa6240a18a0 legacy=0x7fa6240a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 -- 172.21.15.88:0/3769227409 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6240a3ab0 con 0x7fa6240a5de0 2020-02-11T16:07:41.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6237fe700 1 --2- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa624134a50 0x7fa624134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:07:41.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 --2- 172.21.15.88:0/3769227409 >> v2:172.21.15.52:3300/0 conn(0x7fa6240a5de0 0x7fa6240a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa618001870 tx=0x7fa6140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 --2- 172.21.15.88:0/3769227409 >> v2:172.21.15.52:3300/0 conn(0x7fa6240a5de0 0x7fa6240a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa618001870 tx=0x7fa6140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 --2- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6240a5de0 0x7fa6240a6260 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fa618001870 tx=0x7fa6140088e0).ready entity=mon.0 client_cookie=ce75ebbd85bb818b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 --2- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6240a5de0 0x7fa6240a6260 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fa618001870 tx=0x7fa6140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa621ffb700 1 -- 172.21.15.88:0/3769227409 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6180016d0 con 0x7fa6240a5de0 2020-02-11T16:07:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 --2- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6240a5de0 0x7fa6240a6260 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fa618001870 tx=0x7fa6140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa621ffb700 1 -- 172.21.15.88:0/3769227409 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614008e40 con 0x7fa6240a5de0 2020-02-11T16:07:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6227fc700 1 --2- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6240a5de0 0x7fa6240a6260 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fa618001870 tx=0x7fa6140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6293bd700 1 -- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6240a5de0 msgr2=0x7fa6240a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa621ffb700 1 -- 172.21.15.88:0/3769227409 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa614011400 con 0x7fa6240a5de0 2020-02-11T16:07:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.735+0000 7fa6293bd700 1 --2- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6240a5de0 0x7fa6240a6260 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fa618001870 tx=0x7fa6140088e0).stop 2020-02-11T16:07:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.736+0000 7fa6293bd700 1 -- 172.21.15.88:0/3769227409 shutdown_connections 2020-02-11T16:07:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.736+0000 7fa6293bd700 1 --2- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa624134a50 0x7fa624134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.736+0000 7fa6293bd700 1 --2- 172.21.15.88:0/3769227409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6240a5de0 0x7fa6240a6260 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.736+0000 7fa6293bd700 1 -- 172.21.15.88:0/3769227409 >> 172.21.15.88:0/3769227409 conn(0x7fa62409d110 msgr2=0x7fa62409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.736+0000 7fa6293bd700 1 -- 172.21.15.88:0/3769227409 shutdown_connections 2020-02-11T16:07:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.736+0000 7fa6293bd700 1 -- 172.21.15.88:0/3769227409 wait complete. 2020-02-11T16:07:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.737+0000 7fa6293bd700 1 Processor -- start 2020-02-11T16:07:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.737+0000 7fa6293bd700 1 -- start start 2020-02-11T16:07:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.737+0000 7fa6293bd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6240a18a0 0x7fa62409e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.737+0000 7fa6293bd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa624134a50 0x7fa624123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.737+0000 7fa6293bd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6241328f0 con 0x7fa6240a5de0 2020-02-11T16:07:41.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.737+0000 7fa6293bd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62409ea70 con 0x7fa624134a50 2020-02-11T16:07:41.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.737+0000 7fa6293bd700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa624132b20 con 0x7fa6240a18a0 2020-02-11T16:07:41.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa624134a50 0x7fa624123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6227fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa6240a5de0 0x7fa624133260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60656/0 (socket says 172.21.15.88:60656) 2020-02-11T16:07:41.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa622ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6240a18a0 0x7fa62409e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6227fc700 1 -- 172.21.15.88:0/1008706254 learned_addr learned my addr 172.21.15.88:0/1008706254 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:41.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 -- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6240a18a0 msgr2=0x7fa62409e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6240a18a0 0x7fa62409e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 -- 172.21.15.88:0/1008706254 >> v1:172.21.15.52:6789/0 conn(0x7fa6240a5de0 legacy=0x7fa624133260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663559615 0 0) 0x7fa6241328f0 con 0x7fa6240a5de0 2020-02-11T16:07:41.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 -- 172.21.15.88:0/1008706254 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624132dc0 con 0x7fa624134a50 2020-02-11T16:07:41.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6240a18a0 0x7fa62409e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:07:41.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 --2- 172.21.15.88:0/1008706254 >> v2:172.21.15.52:3300/0 conn(0x7fa624134a50 0x7fa624123370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa61c0032b0 tx=0x7fa61c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 --2- 172.21.15.88:0/1008706254 >> v2:172.21.15.52:3300/0 conn(0x7fa624134a50 0x7fa624123370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa61c0032b0 tx=0x7fa61c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa624134a50 0x7fa624123370 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fa61c0032b0 tx=0x7fa61c011040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa624134a50 0x7fa624123370 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fa61c0032b0 tx=0x7fa61c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa61c005e30 con 0x7fa624134a50 2020-02-11T16:07:41.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa624134a50 0x7fa624123370 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fa61c0032b0 tx=0x7fa61c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c00cb00 con 0x7fa624134a50 2020-02-11T16:07:41.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6237fe700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa624134a50 0x7fa624123370 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fa61c0032b0 tx=0x7fa61c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa61c007160 con 0x7fa624134a50 2020-02-11T16:07:41.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6293bd700 1 -- 172.21.15.88:0/1008706254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa624130d70 con 0x7fa624134a50 2020-02-11T16:07:41.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.738+0000 7fa6293bd700 1 -- 172.21.15.88:0/1008706254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa624130890 con 0x7fa624134a50 2020-02-11T16:07:41.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.739+0000 7fa6237fe700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa624134a50 0x7fa624123370 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fa61c0032b0 tx=0x7fa61c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.739+0000 7fa6293bd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 0x7fa6240a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.739+0000 7fa6293bd700 1 -- 172.21.15.88:0/1008706254 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62405e2f0 con 0x7fa6241237d0 2020-02-11T16:07:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.739+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa61c00e180 con 0x7fa624134a50 2020-02-11T16:07:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.739+0000 7fa6237fe700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa624134a50 0x7fa624123370 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fa61c0032b0 tx=0x7fa61c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.739+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 0x7fa6240a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.739+0000 7fa613fff700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa600039b20 0x7fa60003bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.739+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fa61c049b50 con 0x7fa624134a50 2020-02-11T16:07:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa6227fc700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa600039b20 0x7fa60003bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa622ffd700 1 -- 172.21.15.88:0/1008706254 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa624132fc0 con 0x7fa6241237d0 2020-02-11T16:07:41.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 0x7fa6240a9490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 0x7fa6240a9490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 0x7fa6240a9490 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa6227fc700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa600039b20 0x7fa60003bfe0 crc :-1 s=READY pgs=139 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 0x7fa6240a9490 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa61800cba0 con 0x7fa6241237d0 2020-02-11T16:07:41.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 0x7fa6240a9490 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa61800cd00 con 0x7fa6241237d0 2020-02-11T16:07:41.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 msgr2=0x7fa6240a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa613fff700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 0x7fa6240a9490 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).stop 2020-02-11T16:07:41.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 msgr2=0x7fa6240a9490 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:41.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.740+0000 7fa613fff700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6241237d0 0x7fa6240a9490 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).stop 2020-02-11T16:07:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.748+0000 7fa6293bd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 0x7fa62405a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.748+0000 7fa6293bd700 1 -- 172.21.15.88:0/1008706254 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62409ded0 con 0x7fa62405a5d0 2020-02-11T16:07:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.749+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 0x7fa62405a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.749+0000 7fa622ffd700 1 -- 172.21.15.88:0/1008706254 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa6240565b0 con 0x7fa62405a5d0 2020-02-11T16:07:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.749+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 0x7fa62405a9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.749+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 0x7fa62405a9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.749+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 0x7fa62405a9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.749+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 0x7fa62405a9e0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.749+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6180046e0 con 0x7fa62405a5d0 2020-02-11T16:07:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa622ffd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 0x7fa62405a9e0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7fa618004840 con 0x7fa62405a5d0 2020-02-11T16:07:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 msgr2=0x7fa62405a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa613fff700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 0x7fa62405a9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).stop 2020-02-11T16:07:41.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa613fff700 1 -- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 msgr2=0x7fa62405a9e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:41.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa613fff700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa62405a5d0 0x7fa62405a9e0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0x7fa618001930 tx=0x7fa61800c950).stop 2020-02-11T16:07:41.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6293bd700 1 -- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa600039b20 msgr2=0x7fa60003bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6293bd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa600039b20 0x7fa60003bfe0 crc :-1 s=READY pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6293bd700 1 -- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa624134a50 msgr2=0x7fa624123370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6293bd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa624134a50 0x7fa624123370 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fa61c0032b0 tx=0x7fa61c011040).stop 2020-02-11T16:07:41.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6237fe700 1 -- 172.21.15.88:0/1008706254 reap_dead start 2020-02-11T16:07:41.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6237fe700 1 -- 172.21.15.88:0/1008706254 reap_dead start 2020-02-11T16:07:41.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6293bd700 1 -- 172.21.15.88:0/1008706254 shutdown_connections 2020-02-11T16:07:41.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6293bd700 1 --2- 172.21.15.88:0/1008706254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa624134a50 0x7fa624123370 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6293bd700 1 -- 172.21.15.88:0/1008706254 >> 172.21.15.88:0/1008706254 conn(0x7fa62409d110 msgr2=0x7fa6240a5100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:41.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6293bd700 1 -- 172.21.15.88:0/1008706254 shutdown_connections 2020-02-11T16:07:41.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.750+0000 7fa6293bd700 1 -- 172.21.15.88:0/1008706254 wait complete. 2020-02-11T16:07:41.763 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:07:41.763 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:41.763 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:41.763 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:07:41.763 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2020-02-11T16:07:41.763 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:07:41.764 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:07:41.764 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:07:41.764 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:07:41.764 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.764 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:07:41.764 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:41.764 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:07:41.765 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:07:41.765 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:41.765 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:41.765 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:41.765 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:41.765 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:41.765 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:41.766 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.766 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:07:41.766 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:07:41.766 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:41.766 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:41.766 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:41.766 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:41.767 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:41.767 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:41.767 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.767 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:07:41.767 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:07:41.767 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:07:41.768 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:07:41.768 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:07:41.768 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:07:41.768 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:41.768 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:41.768 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:07:41.768 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:07:41.769 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:41.769 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:07:41.769 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:41.769 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:41.769 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:41.769 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:41.769 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:41.770 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:41.770 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.770 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:07:41.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.770 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:07:41.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.771 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:41.771 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:41.771 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:41.771 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:41.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.771 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:41.772 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:07:41.772 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.772 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:41.772 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:07:41.772 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.773 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.773 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.773 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:07:41.773 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:07:41.773 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:41.773 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:07:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:07:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:07:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:07:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:07:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:41.779 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:07:41.779 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:41.779 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.779 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.779 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:07:41.779 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:07:41.779 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:41.780 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:41.780 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.780 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:41.780 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:07:41.780 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:07:41.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.781 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.781 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.781 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:41.781 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.781 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.781 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:07:41.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.782 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.782 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.782 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:41.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.782 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.782 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:07:41.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.783 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.783 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.783 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:07:41.783 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.783 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.783 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:07:41.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.784 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.784 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.784 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:07:41.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.784 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:41.784 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:07:41.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:41.784 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:41.785 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:41.785 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:41.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.785 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:41.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:41.785 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:07:41.786 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:07:41.787 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:07:41.787 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:07:41.787 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:07:41.787 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:07:41.787 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:07:41.790 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.787+0000 7f070fe03700 1 -- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 msgr2=0x7f07080635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:07:41.790 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.787+0000 7f070fe03700 1 -- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 msgr2=0x7f07080635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:07:41.790 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.787+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:41.791 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.787+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f0700003270 tx=0x7f0700010dc0).stop 2020-02-11T16:07:41.791 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.787+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 msgr2=0x7f07080635e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:41.791 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.787+0000 7f06feffd700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.791 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.787+0000 7f06feffd700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.791 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.787+0000 7f06feffd700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f0042b60 0x7f06f0044ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.791 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.788+0000 7f06feffd700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f070809d250 0x7f06f0047710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.791 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.788+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f0047b90 con 0x7f06f00401f0 2020-02-11T16:07:41.792 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.788+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f0047d00 con 0x7f06f0042b60 2020-02-11T16:07:41.792 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.788+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f0047ec0 con 0x7f070809d250 2020-02-11T16:07:41.794 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.788+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.794 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.788+0000 7f070e3a0700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f070809d250 0x7f06f0047710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.794 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.788+0000 7f070fe03700 1 -- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f0042b60 msgr2=0x7f06f0044ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:41.794 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.788+0000 7f070fe03700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f0042b60 0x7f06f0044ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:41.794 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 -- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f070809d250 msgr2=0x7f06f0047710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.794 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f070809d250 0x7f06f0047710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.795 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 -- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f0042b60 msgr2=0x7f06f0044ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:41.795 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f0042b60 0x7f06f0044ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.795 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 -- 172.21.15.88:0/3626676720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) v3 -- 0x7f06f0048140 con 0x7f06f00401f0 2020-02-11T16:07:41.795 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 -- 172.21.15.88:0/3626676720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f06f8010990 con 0x7f06f00401f0 2020-02-11T16:07:41.795 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06f80028b0 tx=0x7f06f8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.796 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06f80028b0 tx=0x7f06f8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.796 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f06f80028b0 tx=0x7f06f8010eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.796 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f06f80028b0 tx=0x7f06f8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.796 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06f8002e40 con 0x7f06f00401f0 2020-02-11T16:07:41.796 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f06f80028b0 tx=0x7f06f8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.796 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.789+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f80032b0 con 0x7f06f00401f0 2020-02-11T16:07:41.796 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.790+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f06f80028b0 tx=0x7f06f8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.797 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:41.790+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f06f8003420 con 0x7f06f00401f0 2020-02-11T16:07:41.797 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:07:41.798 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:07:41.798 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:07:41.822 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:07:41.824 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:07:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.941+0000 7fb5bcdf7700 1 Processor -- start 2020-02-11T16:07:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.941+0000 7fb5bcdf7700 1 -- start start 2020-02-11T16:07:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.942+0000 7fb5bcdf7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b80a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.942+0000 7fb5bcdf7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb5b80a5410 0x7fb5b80a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.942+0000 7fb5bcdf7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b80a4350 con 0x7fb5b8131280 2020-02-11T16:07:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.942+0000 7fb5bcdf7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b80a1e60 con 0x7fb5b80a5410 2020-02-11T16:07:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.942+0000 7fb5bcdf7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b80a3450 con 0x7fb5b80a2fa0 2020-02-11T16:07:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.942+0000 7fb5b5d9b700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fb5b80a5410 msgr2=0x7fb5b80a5890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.942+0000 7fb5b5d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb5b80a5410 0x7fb5b80a5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b6d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb5b8131280 0x7fb5b81316f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60704/0 (socket says 172.21.15.88:60704) 2020-02-11T16:07:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b6d9d700 1 -- 172.21.15.88:0/1370648119 learned_addr learned my addr 172.21.15.88:0/1370648119 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 --2- 172.21.15.88:0/1370648119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b80a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b559a700 1 -- 172.21.15.88:0/1370648119 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896739236 0 0) 0x7fb5b80a4350 con 0x7fb5b8131280 2020-02-11T16:07:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b559a700 1 -- 172.21.15.88:0/1370648119 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb59c003230 con 0x7fb5b8131280 2020-02-11T16:07:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 -- 172.21.15.88:0/1370648119 >> v2:172.21.15.88:3300/0 conn(0x7fb5b80a5410 msgr2=0x7fb5b80a5890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 --2- 172.21.15.88:0/1370648119 >> v2:172.21.15.88:3300/0 conn(0x7fb5b80a5410 0x7fb5b80a5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 -- 172.21.15.88:0/1370648119 >> v1:172.21.15.52:6789/0 conn(0x7fb5b8131280 legacy=0x7fb5b81316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 -- 172.21.15.88:0/1370648119 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b80a3a40 con 0x7fb5b80a2fa0 2020-02-11T16:07:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 --2- 172.21.15.88:0/1370648119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b80a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb5ac002f30 tx=0x7fb5ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 --2- 172.21.15.88:0/1370648119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b80a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb5ac002f30 tx=0x7fb5ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 --2- 172.21.15.88:0/1370648119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b80a1520 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fb5ac002f30 tx=0x7fb5ac0088e0).ready entity=mon.2 client_cookie=2ec249e96ffc8d42 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 --2- 172.21.15.88:0/1370648119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b80a1520 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fb5ac002f30 tx=0x7fb5ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b559a700 1 -- 172.21.15.88:0/1370648119 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5ac0115f0 con 0x7fb5b80a2fa0 2020-02-11T16:07:41.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 --2- 172.21.15.88:0/1370648119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b80a1520 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fb5ac002f30 tx=0x7fb5ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b559a700 1 -- 172.21.15.88:0/1370648119 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac011750 con 0x7fb5b80a2fa0 2020-02-11T16:07:41.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b659c700 1 --2- 172.21.15.88:0/1370648119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b80a1520 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fb5ac002f30 tx=0x7fb5ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5b559a700 1 -- 172.21.15.88:0/1370648119 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5ac011af0 con 0x7fb5b80a2fa0 2020-02-11T16:07:41.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/1370648119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 msgr2=0x7fb5b80a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.943+0000 7fb5bcdf7700 1 --2- 172.21.15.88:0/1370648119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b80a1520 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fb5ac002f30 tx=0x7fb5ac0088e0).stop 2020-02-11T16:07:41.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.944+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/1370648119 shutdown_connections 2020-02-11T16:07:41.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.944+0000 7fb5bcdf7700 1 --2- 172.21.15.88:0/1370648119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b80a1520 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.944+0000 7fb5bcdf7700 1 --2- 172.21.15.88:0/1370648119 >> v2:172.21.15.88:3300/0 conn(0x7fb5b80a5410 0x7fb5b80a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:41.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.944+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/1370648119 >> 172.21.15.88:0/1370648119 conn(0x7fb5b809d110 msgr2=0x7fb5b809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:41.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.944+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/1370648119 shutdown_connections 2020-02-11T16:07:41.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.944+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/1370648119 wait complete. 2020-02-11T16:07:41.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.945+0000 7fb5bcdf7700 1 Processor -- start 2020-02-11T16:07:41.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.945+0000 7fb5bcdf7700 1 -- start start 2020-02-11T16:07:41.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.945+0000 7fb5bcdf7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b8137f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.945+0000 7fb5bcdf7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5b80a5410 0x7fb5b812d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.945+0000 7fb5bcdf7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b812bc80 con 0x7fb5b8131280 2020-02-11T16:07:41.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.945+0000 7fb5bcdf7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b81353a0 con 0x7fb5b80a5410 2020-02-11T16:07:41.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.945+0000 7fb5bcdf7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b81383d0 con 0x7fb5b80a2fa0 2020-02-11T16:07:41.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.945+0000 7fb5b6d9d700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fb5b8131280 legacy=0x7fb5b812a440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:07:41.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5b80a5410 0x7fb5b812d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b659c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b8137f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5b80a5410 0x7fb5b812d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:39058/0 (socket says 172.21.15.88:39058) 2020-02-11T16:07:41.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 -- 172.21.15.88:0/2350303834 learned_addr learned my addr 172.21.15.88:0/2350303834 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:41.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 -- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 msgr2=0x7fb5b8137f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:41.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b8137f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:41.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 -- 172.21.15.88:0/2350303834 >> v1:172.21.15.88:6789/0 conn(0x7fb5b8131280 legacy=0x7fb5b812a440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:41.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 -- 172.21.15.88:0/2350303834 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b812dd40 con 0x7fb5b80a5410 2020-02-11T16:07:41.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> v2:172.21.15.52:3300/0 conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> v2:172.21.15.52:3300/0 conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5a77fe700 1 -- 172.21.15.88:0/2350303834 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5a8011610 con 0x7fb5b80a5410 2020-02-11T16:07:41.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5a77fe700 1 -- 172.21.15.88:0/2350303834 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a8011770 con 0x7fb5b80a5410 2020-02-11T16:07:41.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/2350303834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b8130cb0 con 0x7fb5b80a5410 2020-02-11T16:07:41.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5a77fe700 1 -- 172.21.15.88:0/2350303834 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5a8011b90 con 0x7fb5b80a5410 2020-02-11T16:07:41.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.946+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/2350303834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b812ab50 con 0x7fb5b80a5410 2020-02-11T16:07:41.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.947+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.947+0000 7fb5a77fe700 1 -- 172.21.15.88:0/2350303834 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb5a800b180 con 0x7fb5b80a5410 2020-02-11T16:07:41.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.947+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.947+0000 7fb5a77fe700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb594039c40 0x7fb59403c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:41.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.948+0000 7fb5a77fe700 1 -- 172.21.15.88:0/2350303834 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fb5a8049670 con 0x7fb5b80a5410 2020-02-11T16:07:41.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.948+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/2350303834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b80565b0 con 0x7fb5b80a5410 2020-02-11T16:07:41.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.948+0000 7fb5b659c700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb594039c40 0x7fb59403c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:41.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.948+0000 7fb5b659c700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb594039c40 0x7fb59403c100 crc :-1 s=READY pgs=140 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:41.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.952+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:41.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:41.952+0000 7fb5a77fe700 1 -- 172.21.15.88:0/2350303834 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb5a802ebf0 con 0x7fb5b80a5410 2020-02-11T16:07:42.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.135+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/2350303834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb5b805ccb0 con 0x7fb5b80a5410 2020-02-11T16:07:42.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.136+0000 7fb5b5d9b700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:42.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.136+0000 7fb5a77fe700 1 -- 172.21.15.88:0/2350303834 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fb5a8031700 con 0x7fb5b80a5410 2020-02-11T16:07:42.139 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:42.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb594039c40 msgr2=0x7fb59403c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:42.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb594039c40 0x7fb59403c100 crc :-1 s=READY pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:42.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 msgr2=0x7fb5b812d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:42.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 0x7fb5b812d8e0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fb5b812cf30 tx=0x7fb5a8010940).stop 2020-02-11T16:07:42.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/2350303834 shutdown_connections 2020-02-11T16:07:42.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b80a2fa0 0x7fb5b8137f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:42.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb594039c40 0x7fb59403c100 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:42.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 --2- 172.21.15.88:0/2350303834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b80a5410 0x7fb5b812d8e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:42.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/2350303834 >> 172.21.15.88:0/2350303834 conn(0x7fb5b809d110 msgr2=0x7fb5b8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:42.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/2350303834 shutdown_connections 2020-02-11T16:07:42.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:42.137+0000 7fb5bcdf7700 1 -- 172.21.15.88:0/2350303834 wait complete. 2020-02-11T16:07:42.150 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":28,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:45.151 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:07:45.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.264+0000 7fabf88de700 1 Processor -- start 2020-02-11T16:07:45.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.264+0000 7fabf88de700 1 -- start start 2020-02-11T16:07:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf88de700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 0x7fabf40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf88de700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fabf40a5de0 0x7fabf40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf88de700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf40a31b0 con 0x7fabf412e3a0 2020-02-11T16:07:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf88de700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf40a3570 con 0x7fabf40a5de0 2020-02-11T16:07:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf88de700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf40a3810 con 0x7fabf40a18a0 2020-02-11T16:07:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf259c700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 msgr2=0x7fabf40a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 0x7fabf40a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf1d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fabf40a5de0 0x7fabf40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf1d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fabf40a5de0 0x7fabf40a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:39064/0 (socket says 172.21.15.88:39064) 2020-02-11T16:07:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf2d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fabf412e3a0 0x7fabf412e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60722/0 (socket says 172.21.15.88:60722) 2020-02-11T16:07:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.265+0000 7fabf1d9b700 1 -- 172.21.15.88:0/1505940378 learned_addr learned my addr 172.21.15.88:0/1505940378 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf1d9b700 1 -- 172.21.15.88:0/1505940378 >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 msgr2=0x7fabf40a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/1505940378 >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 0x7fabf40a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf1d9b700 1 -- 172.21.15.88:0/1505940378 >> v1:172.21.15.52:6789/0 conn(0x7fabf412e3a0 legacy=0x7fabf412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf1d9b700 1 -- 172.21.15.88:0/1505940378 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf40a3ab0 con 0x7fabf40a5de0 2020-02-11T16:07:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf159a700 1 -- 172.21.15.88:0/1505940378 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280002934 0 0) 0x7fabf40a31b0 con 0x7fabf412e3a0 2020-02-11T16:07:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/1505940378 >> v2:172.21.15.52:3300/0 conn(0x7fabf40a5de0 0x7fabf40a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/1505940378 >> v2:172.21.15.52:3300/0 conn(0x7fabf40a5de0 0x7fabf40a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/1505940378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf40a5de0 0x7fabf40a6260 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).ready entity=mon.0 client_cookie=1090a014cbb957b7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/1505940378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf40a5de0 0x7fabf40a6260 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf159a700 1 -- 172.21.15.88:0/1505940378 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe8008e20 con 0x7fabf40a5de0 2020-02-11T16:07:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/1505940378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf40a5de0 0x7fabf40a6260 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/1505940378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf40a5de0 0x7fabf40a6260 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf159a700 1 -- 172.21.15.88:0/1505940378 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe8011910 con 0x7fabf40a5de0 2020-02-11T16:07:45.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf159a700 1 -- 172.21.15.88:0/1505940378 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe8011cf0 con 0x7fabf40a5de0 2020-02-11T16:07:45.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf88de700 1 -- 172.21.15.88:0/1505940378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf40a5de0 msgr2=0x7fabf40a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:45.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.266+0000 7fabf88de700 1 --2- 172.21.15.88:0/1505940378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf40a5de0 0x7fabf40a6260 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).stop 2020-02-11T16:07:45.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.267+0000 7fabf88de700 1 -- 172.21.15.88:0/1505940378 shutdown_connections 2020-02-11T16:07:45.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.267+0000 7fabf88de700 1 --2- 172.21.15.88:0/1505940378 >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 0x7fabf40a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:45.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.267+0000 7fabf88de700 1 --2- 172.21.15.88:0/1505940378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf40a5de0 0x7fabf40a6260 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:45.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.267+0000 7fabf88de700 1 -- 172.21.15.88:0/1505940378 >> 172.21.15.88:0/1505940378 conn(0x7fabf409d110 msgr2=0x7fabf409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:45.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.267+0000 7fabf88de700 1 -- 172.21.15.88:0/1505940378 shutdown_connections 2020-02-11T16:07:45.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.267+0000 7fabf88de700 1 -- 172.21.15.88:0/1505940378 wait complete. 2020-02-11T16:07:45.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf88de700 1 Processor -- start 2020-02-11T16:07:45.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf88de700 1 -- start start 2020-02-11T16:07:45.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf88de700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 0x7fabf4138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:45.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf88de700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:45.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf88de700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf4135bc0 con 0x7fabf412e3a0 2020-02-11T16:07:45.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf88de700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf4127340 con 0x7fabf40a18a0 2020-02-11T16:07:45.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf88de700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf4139110 con 0x7fabf40a5de0 2020-02-11T16:07:45.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf259c700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 msgr2=0x7fabf4138260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:45.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 0x7fabf4138260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:45.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf2d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fabf412e3a0 0x7fabf4124240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60728/0 (socket says 172.21.15.88:60728) 2020-02-11T16:07:45.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf2d9d700 1 -- 172.21.15.88:0/4227372624 learned_addr learned my addr 172.21.15.88:0/4227372624 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:45.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.268+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:45.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabe37fe700 1 -- 172.21.15.88:0/4227372624 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057358576 0 0) 0x7fabf4135bc0 con 0x7fabf412e3a0 2020-02-11T16:07:45.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabe37fe700 1 -- 172.21.15.88:0/4227372624 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd0002fe0 con 0x7fabf412e3a0 2020-02-11T16:07:45.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf1d9b700 1 -- 172.21.15.88:0/4227372624 >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 msgr2=0x7fabf4138260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:45.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 0x7fabf4138260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:45.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf1d9b700 1 -- 172.21.15.88:0/4227372624 >> v1:172.21.15.52:6789/0 conn(0x7fabf412e3a0 legacy=0x7fabf4124240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:45.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf1d9b700 1 -- 172.21.15.88:0/4227372624 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4126ab0 con 0x7fabf40a5de0 2020-02-11T16:07:45.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:45.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabe37fe700 1 -- 172.21.15.88:0/4227372624 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe8007150 con 0x7fabf40a5de0 2020-02-11T16:07:45.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf88de700 1 -- 172.21.15.88:0/4227372624 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf4138820 con 0x7fabf40a5de0 2020-02-11T16:07:45.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabe37fe700 1 -- 172.21.15.88:0/4227372624 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe80072b0 con 0x7fabf40a5de0 2020-02-11T16:07:45.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabe37fe700 1 -- 172.21.15.88:0/4227372624 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe80056c0 con 0x7fabf40a5de0 2020-02-11T16:07:45.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.269+0000 7fabf88de700 1 -- 172.21.15.88:0/4227372624 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf40a3d20 con 0x7fabf40a5de0 2020-02-11T16:07:45.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.270+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.270+0000 7fabe37fe700 1 -- 172.21.15.88:0/4227372624 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fabe80058c0 con 0x7fabf40a5de0 2020-02-11T16:07:45.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.270+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.270+0000 7fabe37fe700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fabd0039f40 0x7fabd003c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:45.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.270+0000 7fabf88de700 1 -- 172.21.15.88:0/4227372624 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf412f760 con 0x7fabf40a5de0 2020-02-11T16:07:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.270+0000 7fabe37fe700 1 -- 172.21.15.88:0/4227372624 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fabe804a320 con 0x7fabf40a5de0 2020-02-11T16:07:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.270+0000 7fabf259c700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fabd0039f40 0x7fabd003c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.271+0000 7fabf259c700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fabd0039f40 0x7fabd003c400 crc :-1 s=READY pgs=141 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.274+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.274+0000 7fabe37fe700 1 -- 172.21.15.88:0/4227372624 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fabe80323f0 con 0x7fabf40a5de0 2020-02-11T16:07:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.457+0000 7fabf88de700 1 -- 172.21.15.88:0/4227372624 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fabf40565b0 con 0x7fabf40a5de0 2020-02-11T16:07:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.457+0000 7fabf1d9b700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.457+0000 7fabe37fe700 1 -- 172.21.15.88:0/4227372624 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fabe80323f0 con 0x7fabf40a5de0 2020-02-11T16:07:45.460 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 -- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fabd0039f40 msgr2=0x7fabd003c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fabd0039f40 0x7fabd003c400 crc :-1 s=READY pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 -- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 msgr2=0x7fabf4126160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fabe8002f30 tx=0x7fabe8007a40).stop 2020-02-11T16:07:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 -- 172.21.15.88:0/4227372624 shutdown_connections 2020-02-11T16:07:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fabd0039f40 0x7fabd003c400 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 --2- 172.21.15.88:0/4227372624 >> v2:172.21.15.88:3300/0 conn(0x7fabf40a18a0 0x7fabf4138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 --2- 172.21.15.88:0/4227372624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fabf40a5de0 0x7fabf4126160 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 -- 172.21.15.88:0/4227372624 >> 172.21.15.88:0/4227372624 conn(0x7fabf409d110 msgr2=0x7fabf40a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 -- 172.21.15.88:0/4227372624 shutdown_connections 2020-02-11T16:07:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:45.459+0000 7fabf88de700 1 -- 172.21.15.88:0/4227372624 wait complete. 2020-02-11T16:07:45.472 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":28,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:48.473 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:07:48.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.587+0000 7fbd93055700 1 Processor -- start 2020-02-11T16:07:48.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.587+0000 7fbd93055700 1 -- start start 2020-02-11T16:07:48.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.587+0000 7fbd93055700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 0x7fbd8c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:48.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.587+0000 7fbd93055700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:48.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.587+0000 7fbd93055700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c0a31b0 con 0x7fbd8c0a18a0 2020-02-11T16:07:48.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.587+0000 7fbd93055700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c0a3570 con 0x7fbd8c134a50 2020-02-11T16:07:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd93055700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0a3810 con 0x7fbd8c0a5de0 2020-02-11T16:07:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd90df1700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fbd8c0a18a0 legacy=0x7fbd8c0a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:07:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd915f2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd8bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 0x7fbd8c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd915f2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:39080/0 (socket says 172.21.15.88:39080) 2020-02-11T16:07:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd915f2700 1 -- 172.21.15.88:0/2480811604 learned_addr learned my addr 172.21.15.88:0/2480811604 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd8bfff700 1 -- 172.21.15.88:0/2480811604 >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 msgr2=0x7fbd8c134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:48.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd8bfff700 1 --2- 172.21.15.88:0/2480811604 >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:48.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd8bfff700 1 -- 172.21.15.88:0/2480811604 >> v1:172.21.15.88:6789/0 conn(0x7fbd8c0a18a0 legacy=0x7fbd8c0a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:48.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd8bfff700 1 -- 172.21.15.88:0/2480811604 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0a3ab0 con 0x7fbd8c0a5de0 2020-02-11T16:07:48.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd915f2700 1 --2- 172.21.15.88:0/2480811604 >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:07:48.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd8bfff700 1 --2- 172.21.15.88:0/2480811604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 0x7fbd8c0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd8c05b910 tx=0x7fbd800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd8bfff700 1 --2- 172.21.15.88:0/2480811604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 0x7fbd8c0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd8c05b910 tx=0x7fbd800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.588+0000 7fbd8bfff700 1 --2- 172.21.15.88:0/2480811604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 0x7fbd8c0a6260 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fbd8c05b910 tx=0x7fbd800088e0).ready entity=mon.2 client_cookie=c86c2911c84b31a1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd8bfff700 1 --2- 172.21.15.88:0/2480811604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 0x7fbd8c0a6260 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fbd8c05b910 tx=0x7fbd800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd8b7fe700 1 -- 172.21.15.88:0/2480811604 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd80008e40 con 0x7fbd8c0a5de0 2020-02-11T16:07:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd8bfff700 1 --2- 172.21.15.88:0/2480811604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 0x7fbd8c0a6260 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fbd8c05b910 tx=0x7fbd800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd8bfff700 1 --2- 172.21.15.88:0/2480811604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 0x7fbd8c0a6260 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fbd8c05b910 tx=0x7fbd800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd8b7fe700 1 -- 172.21.15.88:0/2480811604 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80011570 con 0x7fbd8c0a5de0 2020-02-11T16:07:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd8b7fe700 1 -- 172.21.15.88:0/2480811604 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd80011950 con 0x7fbd8c0a5de0 2020-02-11T16:07:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd93055700 1 -- 172.21.15.88:0/2480811604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 msgr2=0x7fbd8c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:48.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd93055700 1 --2- 172.21.15.88:0/2480811604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 0x7fbd8c0a6260 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fbd8c05b910 tx=0x7fbd800088e0).stop 2020-02-11T16:07:48.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd93055700 1 -- 172.21.15.88:0/2480811604 shutdown_connections 2020-02-11T16:07:48.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd93055700 1 --2- 172.21.15.88:0/2480811604 >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:48.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd93055700 1 --2- 172.21.15.88:0/2480811604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd8c0a5de0 0x7fbd8c0a6260 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:48.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd93055700 1 -- 172.21.15.88:0/2480811604 >> 172.21.15.88:0/2480811604 conn(0x7fbd8c09d110 msgr2=0x7fbd8c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:48.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd93055700 1 -- 172.21.15.88:0/2480811604 shutdown_connections 2020-02-11T16:07:48.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.589+0000 7fbd93055700 1 -- 172.21.15.88:0/2480811604 wait complete. 2020-02-11T16:07:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.590+0000 7fbd93055700 1 Processor -- start 2020-02-11T16:07:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.590+0000 7fbd93055700 1 -- start start 2020-02-11T16:07:48.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd93055700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbd8c0a18a0 0x7fbd8c137d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:48.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd93055700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c12ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:48.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd93055700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c137950 con 0x7fbd8c0a5de0 2020-02-11T16:07:48.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd90df1700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fbd8c0a18a0 msgr2=0x7fbd8c137d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd93055700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c136b60 con 0x7fbd8c134a50 2020-02-11T16:07:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd93055700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c132430 con 0x7fbd8c0a18a0 2020-02-11T16:07:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd90df1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbd8c0a18a0 0x7fbd8c137d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd915f2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c12ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd915f2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c12ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:39086/0 (socket says 172.21.15.88:39086) 2020-02-11T16:07:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd8bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbd8c0a5de0 0x7fbd8c12d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60738/0 (socket says 172.21.15.88:60738) 2020-02-11T16:07:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd915f2700 1 -- 172.21.15.88:0/72882670 learned_addr learned my addr 172.21.15.88:0/72882670 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd915f2700 1 -- 172.21.15.88:0/72882670 >> v2:172.21.15.88:3300/0 conn(0x7fbd8c0a18a0 msgr2=0x7fbd8c137d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> v2:172.21.15.88:3300/0 conn(0x7fbd8c0a18a0 0x7fbd8c137d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd915f2700 1 -- 172.21.15.88:0/72882670 >> v1:172.21.15.52:6789/0 conn(0x7fbd8c0a5de0 legacy=0x7fbd8c12d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd915f2700 1 -- 172.21.15.88:0/72882670 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c138c80 con 0x7fbd8c134a50 2020-02-11T16:07:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.591+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> v2:172.21.15.52:3300/0 conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd89ffb700 1 -- 172.21.15.88:0/72882670 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd84005e30 con 0x7fbd8c134a50 2020-02-11T16:07:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd89ffb700 1 -- 172.21.15.88:0/72882670 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8400cbf0 con 0x7fbd8c134a50 2020-02-11T16:07:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd93055700 1 -- 172.21.15.88:0/72882670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c135c10 con 0x7fbd8c134a50 2020-02-11T16:07:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd89ffb700 1 -- 172.21.15.88:0/72882670 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd8400ce20 con 0x7fbd8c134a50 2020-02-11T16:07:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd93055700 1 -- 172.21.15.88:0/72882670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c0661a0 con 0x7fbd8c134a50 2020-02-11T16:07:48.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.592+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.593+0000 7fbd89ffb700 1 -- 172.21.15.88:0/72882670 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fbd840129f0 con 0x7fbd8c134a50 2020-02-11T16:07:48.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.593+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.593+0000 7fbd93055700 1 -- 172.21.15.88:0/72882670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c0565b0 con 0x7fbd8c134a50 2020-02-11T16:07:48.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.593+0000 7fbd89ffb700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbd6c039ce0 0x7fbd6c03c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:48.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.593+0000 7fbd89ffb700 1 -- 172.21.15.88:0/72882670 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fbd84049d30 con 0x7fbd8c134a50 2020-02-11T16:07:48.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.593+0000 7fbd90df1700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbd6c039ce0 0x7fbd6c03c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:48.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.593+0000 7fbd90df1700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbd6c039ce0 0x7fbd6c03c1a0 crc :-1 s=READY pgs=142 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:48.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.597+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.597+0000 7fbd89ffb700 1 -- 172.21.15.88:0/72882670 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbd8402f2d0 con 0x7fbd8c134a50 2020-02-11T16:07:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.779+0000 7fbd93055700 1 -- 172.21.15.88:0/72882670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbd8c0670f0 con 0x7fbd8c134a50 2020-02-11T16:07:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.780+0000 7fbd915f2700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.780+0000 7fbd89ffb700 1 -- 172.21.15.88:0/72882670 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fbd84031dc0 con 0x7fbd8c134a50 2020-02-11T16:07:48.783 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 -- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbd6c039ce0 msgr2=0x7fbd6c03c1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbd6c039ce0 0x7fbd6c03c1a0 crc :-1 s=READY pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 -- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 msgr2=0x7fbd8c12ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 0x7fbd8c12ddf0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fbd8c1375d0 tx=0x7fbd840111e0).stop 2020-02-11T16:07:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 -- 172.21.15.88:0/72882670 shutdown_connections 2020-02-11T16:07:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbd6c039ce0 0x7fbd6c03c1a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 --2- 172.21.15.88:0/72882670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd8c134a50 0x7fbd8c12ddf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 --2- 172.21.15.88:0/72882670 >> v2:172.21.15.88:3300/0 conn(0x7fbd8c0a18a0 0x7fbd8c137d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 -- 172.21.15.88:0/72882670 >> 172.21.15.88:0/72882670 conn(0x7fbd8c09d110 msgr2=0x7fbd8c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 -- 172.21.15.88:0/72882670 shutdown_connections 2020-02-11T16:07:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:48.781+0000 7fbd93055700 1 -- 172.21.15.88:0/72882670 wait complete. 2020-02-11T16:07:48.794 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":28,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:51.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:51.262+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f06f80028b0 tx=0x7f06f8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:51.795 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:07:51.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.908+0000 7fa24eef9700 1 Processor -- start 2020-02-11T16:07:51.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.908+0000 7fa24eef9700 1 -- start start 2020-02-11T16:07:51.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.909+0000 7fa24eef9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:51.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.909+0000 7fa24eef9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 0x7fa2480a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:51.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.909+0000 7fa24eef9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2480a31b0 con 0x7fa24812e3a0 2020-02-11T16:07:51.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.909+0000 7fa24eef9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2480a3570 con 0x7fa2480a5de0 2020-02-11T16:07:51.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.909+0000 7fa24eef9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480a3810 con 0x7fa2480a18a0 2020-02-11T16:07:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.909+0000 7fa247fff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 msgr2=0x7fa2480a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.909+0000 7fa247fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 0x7fa2480a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.909+0000 7fa24d496700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa24812e3a0 0x7fa24812e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60748/0 (socket says 172.21.15.88:60748) 2020-02-11T16:07:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.910+0000 7fa24d496700 1 -- 172.21.15.88:0/3557134995 learned_addr learned my addr 172.21.15.88:0/3557134995 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.910+0000 7fa24cc95700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:51.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.910+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:07:51.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.910+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:51.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.910+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:51.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:51.910+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:52.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.110+0000 7fa247fff700 1 -- 172.21.15.88:0/3557134995 >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 msgr2=0x7fa2480a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:52.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.110+0000 7fa247fff700 1 --2- 172.21.15.88:0/3557134995 >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 0x7fa2480a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:07:52.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.111+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:52.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.111+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:07:52.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.111+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:52.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.111+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:52.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.111+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:07:52.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.511+0000 7fa247fff700 1 -- 172.21.15.88:0/3557134995 >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 msgr2=0x7fa2480a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:52.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.511+0000 7fa247fff700 1 --2- 172.21.15.88:0/3557134995 >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 0x7fa2480a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:07:52.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.512+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:52.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.512+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:07:52.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.512+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:52.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.512+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:52.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:52.512+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:07:53.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:53.312+0000 7fa247fff700 1 -- 172.21.15.88:0/3557134995 >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 msgr2=0x7fa2480a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:53.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:53.312+0000 7fa247fff700 1 --2- 172.21.15.88:0/3557134995 >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 0x7fa2480a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:07:53.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:53.313+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:53.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:53.314+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:07:53.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:53.314+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:53.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:53.314+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:53.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:53.314+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:07:54.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:54.913+0000 7fa247fff700 1 -- 172.21.15.88:0/3557134995 >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 msgr2=0x7fa2480a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:54.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:54.913+0000 7fa247fff700 1 --2- 172.21.15.88:0/3557134995 >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 0x7fa2480a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:07:54.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:54.916+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:54.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:54.916+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:07:54.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:54.916+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:07:54.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:54.916+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:07:54.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:54.916+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:07:56.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.062+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078646297 0 0) 0x7fa2480a31b0 con 0x7fa24812e3a0 2020-02-11T16:07:56.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.062+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa234003230 con 0x7fa24812e3a0 2020-02-11T16:07:56.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2841983080 0 0) 0x7fa234003230 con 0x7fa24812e3a0 2020-02-11T16:07:56.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa2480a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:56.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa2480a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:56.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 msgr2=0x7fa2480a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:56.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 --2- 172.21.15.88:0/3557134995 >> v2:172.21.15.88:3300/0 conn(0x7fa2480a5de0 0x7fa2480a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:56.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480a3ab0 con 0x7fa24812e3a0 2020-02-11T16:07:56.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa240001a30 con 0x7fa24812e3a0 2020-02-11T16:07:56.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 >> v1:172.21.15.52:6789/0 conn(0x7fa24812e3a0 legacy=0x7fa24812e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa234003720 0x7fa234003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:56.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa234003fc0 0x7fa2340044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:56.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa234004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:56.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480a3570 con 0x7fa234003fc0 2020-02-11T16:07:56.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480a3810 con 0x7fa234003720 2020-02-11T16:07:56.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa234004f50 con 0x7fa2480a18a0 2020-02-11T16:07:56.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa24cc95700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa234003720 msgr2=0x7fa234003b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:56.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa234003720 0x7fa234003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:56.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.063+0000 7fa247fff700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa234003fc0 0x7fa2340044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa234004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa234003720 msgr2=0x7fa234003b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:56.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa234003720 0x7fa234003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:56.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa234003fc0 msgr2=0x7fa2340044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:56.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa234003fc0 0x7fa2340044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:56.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 -- 172.21.15.88:0/3557134995 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234003230 con 0x7fa2480a18a0 2020-02-11T16:07:56.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa234004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa240001800 tx=0x7fa2480a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa234004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa240001800 tx=0x7fa2480a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa234004a20 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fa240001800 tx=0x7fa2480a1c80).ready entity=mon.2 client_cookie=ec01ad6e143f3004 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa234004a20 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fa240001800 tx=0x7fa2480a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa24000e350 con 0x7fa2480a18a0 2020-02-11T16:07:56.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa234004a20 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fa240001800 tx=0x7fa2480a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa234004a20 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fa240001800 tx=0x7fa2480a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24000e4b0 con 0x7fa2480a18a0 2020-02-11T16:07:56.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa2477fe700 1 -- 172.21.15.88:0/3557134995 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa24000e810 con 0x7fa2480a18a0 2020-02-11T16:07:56.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24eef9700 1 -- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 msgr2=0x7fa234004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24eef9700 1 --2- 172.21.15.88:0/3557134995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2480a18a0 0x7fa234004a20 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fa240001800 tx=0x7fa2480a1c80).stop 2020-02-11T16:07:56.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.064+0000 7fa24d496700 1 -- 172.21.15.88:0/3557134995 reap_dead start 2020-02-11T16:07:56.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.065+0000 7fa24eef9700 1 -- 172.21.15.88:0/3557134995 shutdown_connections 2020-02-11T16:07:56.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.065+0000 7fa24eef9700 1 -- 172.21.15.88:0/3557134995 >> 172.21.15.88:0/3557134995 conn(0x7fa24809d110 msgr2=0x7fa24809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:56.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.065+0000 7fa24eef9700 1 -- 172.21.15.88:0/3557134995 shutdown_connections 2020-02-11T16:07:56.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.065+0000 7fa24eef9700 1 -- 172.21.15.88:0/3557134995 wait complete. 2020-02-11T16:07:56.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.066+0000 7fa24eef9700 1 Processor -- start 2020-02-11T16:07:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.066+0000 7fa24eef9700 1 -- start start 2020-02-11T16:07:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.067+0000 7fa24eef9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2481319a0 0x7fa248134f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.067+0000 7fa24eef9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2480a0a90 con 0x7fa2480a0600 2020-02-11T16:07:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.067+0000 7fa24eef9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24809e470 con 0x7fa24809e000 2020-02-11T16:07:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.067+0000 7fa24eef9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2480a0210 con 0x7fa2481319a0 2020-02-11T16:07:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.067+0000 7fa24d496700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa24809e000 legacy=0x7fa24805ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:07:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.068+0000 7fa24cc95700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2481319a0 0x7fa248134f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.068+0000 7fa24cc95700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2481319a0 0x7fa248134f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:39118/0 (socket says 172.21.15.88:39118) 2020-02-11T16:07:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.068+0000 7fa247fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa2480a0600 0x7fa24805a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60774/0 (socket says 172.21.15.88:60774) 2020-02-11T16:07:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.068+0000 7fa24cc95700 1 -- 172.21.15.88:0/3648500966 learned_addr learned my addr 172.21.15.88:0/3648500966 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.068+0000 7fa24cc95700 1 -- 172.21.15.88:0/3648500966 >> v1:172.21.15.88:6789/0 conn(0x7fa24809e000 legacy=0x7fa24805ace0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.068+0000 7fa24cc95700 1 -- 172.21.15.88:0/3648500966 >> v1:172.21.15.52:6789/0 conn(0x7fa2480a0600 legacy=0x7fa24805a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.068+0000 7fa24cc95700 1 -- 172.21.15.88:0/3648500966 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24805b3f0 con 0x7fa2481319a0 2020-02-11T16:07:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.068+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3648500966 >> v2:172.21.15.52:3300/0 conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.068+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3648500966 >> v2:172.21.15.52:3300/0 conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.068+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.069+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.069+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.069+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.069+0000 7fa245ffb700 1 -- 172.21.15.88:0/3648500966 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa238005e90 con 0x7fa2481319a0 2020-02-11T16:07:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.069+0000 7fa245ffb700 1 -- 172.21.15.88:0/3648500966 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa238007160 con 0x7fa2481319a0 2020-02-11T16:07:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.069+0000 7fa245ffb700 1 -- 172.21.15.88:0/3648500966 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa238007580 con 0x7fa2481319a0 2020-02-11T16:07:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.069+0000 7fa24eef9700 1 -- 172.21.15.88:0/3648500966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24809e9a0 con 0x7fa2481319a0 2020-02-11T16:07:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.069+0000 7fa24eef9700 1 -- 172.21.15.88:0/3648500966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa248132130 con 0x7fa2481319a0 2020-02-11T16:07:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.070+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.070+0000 7fa245ffb700 1 -- 172.21.15.88:0/3648500966 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa2380121a0 con 0x7fa2481319a0 2020-02-11T16:07:56.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.070+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.070+0000 7fa245ffb700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa228039bf0 0x7fa22803c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.070+0000 7fa245ffb700 1 -- 172.21.15.88:0/3648500966 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fa238049a80 con 0x7fa2481319a0 2020-02-11T16:07:56.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.070+0000 7fa24eef9700 1 -- 172.21.15.88:0/3648500966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24809ee00 con 0x7fa2481319a0 2020-02-11T16:07:56.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.070+0000 7fa247fff700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa228039bf0 0x7fa22803c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.071+0000 7fa247fff700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa228039bf0 0x7fa22803c0b0 crc :-1 s=READY pgs=143 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.075+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.075+0000 7fa245ffb700 1 -- 172.21.15.88:0/3648500966 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fa23802f080 con 0x7fa2481319a0 2020-02-11T16:07:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.262+0000 7fa24eef9700 1 -- 172.21.15.88:0/3648500966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa2480565b0 con 0x7fa2481319a0 2020-02-11T16:07:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.262+0000 7fa24cc95700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.262+0000 7fa245ffb700 1 -- 172.21.15.88:0/3648500966 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7fa23800a510 con 0x7fa2481319a0 2020-02-11T16:07:56.266 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":32,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:56.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.264+0000 7fa24eef9700 1 -- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa228039bf0 msgr2=0x7fa22803c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.264+0000 7fa24eef9700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa228039bf0 0x7fa22803c0b0 crc :-1 s=READY pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.264+0000 7fa24eef9700 1 -- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 msgr2=0x7fa248134f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.264+0000 7fa24eef9700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 0x7fa248134f60 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fa2480a0160 tx=0x7fa238010bc0).stop 2020-02-11T16:07:56.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.264+0000 7fa24eef9700 1 -- 172.21.15.88:0/3648500966 shutdown_connections 2020-02-11T16:07:56.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.264+0000 7fa24eef9700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa228039bf0 0x7fa22803c0b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.264+0000 7fa24eef9700 1 --2- 172.21.15.88:0/3648500966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2481319a0 0x7fa248134f60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.264+0000 7fa24eef9700 1 -- 172.21.15.88:0/3648500966 >> 172.21.15.88:0/3648500966 conn(0x7fa24809d110 msgr2=0x7fa2480a6240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:56.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.264+0000 7fa24eef9700 1 -- 172.21.15.88:0/3648500966 shutdown_connections 2020-02-11T16:07:56.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.264+0000 7fa24eef9700 1 -- 172.21.15.88:0/3648500966 wait complete. 2020-02-11T16:07:56.277 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":32,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:07:56.277 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:07:56.277 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:07:56.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.380+0000 7f7018e36700 1 Processor -- start 2020-02-11T16:07:56.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.380+0000 7f7018e36700 1 -- start start 2020-02-11T16:07:56.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.381+0000 7f7018e36700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70140a18a0 0x7f70140a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:56.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.381+0000 7f7018e36700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 0x7f701412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:56.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.381+0000 7f7018e36700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70140a3570 con 0x7f70140a5de0 2020-02-11T16:07:56.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.381+0000 7f7018e36700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70140a3810 con 0x7f70140a18a0 2020-02-11T16:07:56.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.381+0000 7f7018e36700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70140a3ab0 con 0x7f70140a6260 2020-02-11T16:07:56.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.381+0000 7f701259c700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f70140a18a0 msgr2=0x7f70140a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:56.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.381+0000 7f701259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70140a18a0 0x7f70140a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:56.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.381+0000 7f7011d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f70140a5de0 0x7f701412e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60780/0 (socket says 172.21.15.88:60780) 2020-02-11T16:07:56.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.381+0000 7f7011d9b700 1 -- 172.21.15.88:0/1105464100 learned_addr learned my addr 172.21.15.88:0/1105464100 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:56.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.381+0000 7f7012d9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 0x7f701412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f701159a700 1 -- 172.21.15.88:0/1105464100 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179039165 0 0) 0x7f70140a3570 con 0x7f70140a5de0 2020-02-11T16:07:56.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f701159a700 1 -- 172.21.15.88:0/1105464100 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff8003230 con 0x7f70140a5de0 2020-02-11T16:07:56.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7012d9d700 1 -- 172.21.15.88:0/1105464100 >> v2:172.21.15.88:3300/0 conn(0x7f70140a18a0 msgr2=0x7f70140a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:56.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7012d9d700 1 --2- 172.21.15.88:0/1105464100 >> v2:172.21.15.88:3300/0 conn(0x7f70140a18a0 0x7f70140a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:56.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7012d9d700 1 -- 172.21.15.88:0/1105464100 >> v1:172.21.15.52:6789/0 conn(0x7f70140a5de0 legacy=0x7f701412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7012d9d700 1 -- 172.21.15.88:0/1105464100 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140a3d50 con 0x7f70140a6260 2020-02-11T16:07:56.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7012d9d700 1 --2- 172.21.15.88:0/1105464100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 0x7f701412eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f700c0032b0 tx=0x7f700c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7012d9d700 1 --2- 172.21.15.88:0/1105464100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 0x7f701412eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f700c0032b0 tx=0x7f700c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7012d9d700 1 --2- 172.21.15.88:0/1105464100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 0x7f701412eab0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f700c0032b0 tx=0x7f700c008c60).ready entity=mon.2 client_cookie=e0e424d740d063f7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7012d9d700 1 --2- 172.21.15.88:0/1105464100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 0x7f701412eab0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f700c0032b0 tx=0x7f700c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f701159a700 1 -- 172.21.15.88:0/1105464100 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f700c00a160 con 0x7f70140a6260 2020-02-11T16:07:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7012d9d700 1 --2- 172.21.15.88:0/1105464100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 0x7f701412eab0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f700c0032b0 tx=0x7f700c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f701159a700 1 -- 172.21.15.88:0/1105464100 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c00a2c0 con 0x7f70140a6260 2020-02-11T16:07:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7012d9d700 1 --2- 172.21.15.88:0/1105464100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 0x7f701412eab0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f700c0032b0 tx=0x7f700c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f701159a700 1 -- 172.21.15.88:0/1105464100 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f700c00a660 con 0x7f70140a6260 2020-02-11T16:07:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7018e36700 1 -- 172.21.15.88:0/1105464100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 msgr2=0x7f701412eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.382+0000 7f7018e36700 1 --2- 172.21.15.88:0/1105464100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 0x7f701412eab0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f700c0032b0 tx=0x7f700c008c60).stop 2020-02-11T16:07:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.383+0000 7f7018e36700 1 -- 172.21.15.88:0/1105464100 shutdown_connections 2020-02-11T16:07:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.383+0000 7f7018e36700 1 --2- 172.21.15.88:0/1105464100 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70140a6260 0x7f701412eab0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.383+0000 7f7018e36700 1 --2- 172.21.15.88:0/1105464100 >> v2:172.21.15.88:3300/0 conn(0x7f70140a18a0 0x7f70140a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.383+0000 7f7018e36700 1 -- 172.21.15.88:0/1105464100 >> 172.21.15.88:0/1105464100 conn(0x7f701409d110 msgr2=0x7f701409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:56.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.383+0000 7f7018e36700 1 -- 172.21.15.88:0/1105464100 shutdown_connections 2020-02-11T16:07:56.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.383+0000 7f7018e36700 1 -- 172.21.15.88:0/1105464100 wait complete. 2020-02-11T16:07:56.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.383+0000 7f7018e36700 1 Processor -- start 2020-02-11T16:07:56.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.383+0000 7f7018e36700 1 -- start start 2020-02-11T16:07:56.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f7018e36700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70140a6260 0x7f70140a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f7018e36700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70140a3f50 con 0x7f70140a5de0 2020-02-11T16:07:56.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f701259c700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f70140a18a0 legacy=0x7f7014128350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:07:56.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f7018e36700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7014135120 con 0x7f70140a18a0 2020-02-11T16:07:56.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f7012d9d700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f70140a6260 msgr2=0x7f70140a0940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:56.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f7018e36700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70141353c0 con 0x7f70140a6260 2020-02-11T16:07:56.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f7012d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70140a6260 0x7f70140a0940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:56.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f7011d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f70140a5de0 0x7f701409e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60786/0 (socket says 172.21.15.88:60786) 2020-02-11T16:07:56.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f7011d9b700 1 -- 172.21.15.88:0/3909332577 learned_addr learned my addr 172.21.15.88:0/3909332577 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:56.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087243340 0 0) 0x7f70140a3f50 con 0x7f70140a5de0 2020-02-11T16:07:56.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.384+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff0002fe0 con 0x7f70140a5de0 2020-02-11T16:07:56.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1851714496 0 0) 0x7f6ff0002fe0 con 0x7f70140a5de0 2020-02-11T16:07:56.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f70140a3f50 con 0x7f70140a5de0 2020-02-11T16:07:56.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f7004001940 con 0x7f70140a5de0 2020-02-11T16:07:56.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 >> v2:172.21.15.88:3300/0 conn(0x7f70140a6260 msgr2=0x7f70140a0940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:56.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 --2- 172.21.15.88:0/3909332577 >> v2:172.21.15.88:3300/0 conn(0x7f70140a6260 0x7f70140a0940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 >> v1:172.21.15.88:6789/0 conn(0x7f70140a18a0 legacy=0x7f7014128350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:56.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 >> v1:172.21.15.52:6789/0 conn(0x7f70140a5de0 legacy=0x7f701409e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ff0005210 0x7f6ff0003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff0003f20 0x7f6ff00043d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70141353c0 con 0x7f6ff00049b0 2020-02-11T16:07:56.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff000b8e0 con 0x7f6ff0003f20 2020-02-11T16:07:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff000baa0 con 0x7f6ff0005210 2020-02-11T16:07:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f7012d9d700 1 -- 172.21.15.88:0/3909332577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff0003f20 msgr2=0x7f6ff00043d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f7012d9d700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff0003f20 0x7f6ff00043d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ff0005210 0x7f6ff0003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f701259c700 1 -- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ff0005210 msgr2=0x7f6ff0003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ff0005210 0x7f6ff0003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f701259c700 1 -- 172.21.15.88:0/3909332577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff0003f20 msgr2=0x7f6ff00043d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff0003f20 0x7f6ff00043d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f7012d9d700 1 -- 172.21.15.88:0/3909332577 reap_dead start 2020-02-11T16:07:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f701259c700 1 -- 172.21.15.88:0/3909332577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7014135660 con 0x7f6ff00049b0 2020-02-11T16:07:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f7018e36700 1 -- 172.21.15.88:0/3909332577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701409dec0 con 0x7f6ff00049b0 2020-02-11T16:07:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7008003480 tx=0x7f7008012b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f7018e36700 1 -- 172.21.15.88:0/3909332577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701412d190 con 0x7f6ff00049b0 2020-02-11T16:07:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7008003480 tx=0x7f7008012b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.385+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f7008003480 tx=0x7f7008012b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f7008003480 tx=0x7f7008012b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7008013860 con 0x7f6ff00049b0 2020-02-11T16:07:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f7008003480 tx=0x7f7008012b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f7008003480 tx=0x7f7008012b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70080139c0 con 0x7f6ff00049b0 2020-02-11T16:07:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7008013da0 con 0x7f6ff00049b0 2020-02-11T16:07:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f7008003480 tx=0x7f7008012b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f7018e36700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 0x7f6fec0058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f7018e36700 1 -- 172.21.15.88:0/3909332577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec005ea0 con 0x7f6fec003420 2020-02-11T16:07:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f700800d0c0 con 0x7f6ff00049b0 2020-02-11T16:07:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f701259c700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f7008003480 tx=0x7f7008012b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.386+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 0x7f6fec0058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f70037fe700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ff003db90 0x7f6ff0040050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f7008015060 con 0x7f6ff00049b0 2020-02-11T16:07:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f7011d9b700 1 -- 172.21.15.88:0/3909332577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fec006060 con 0x7f6fec003420 2020-02-11T16:07:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f7012d9d700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ff003db90 0x7f6ff0040050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 0x7f6fec0058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 0x7f6fec0058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 0x7f6fec0058e0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f7012d9d700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ff003db90 0x7f6ff0040050 crc :-1 s=READY pgs=144 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 0x7f6fec0058e0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7004008ae0 con 0x7f6fec003420 2020-02-11T16:07:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 0x7f6fec0058e0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f7004008c40 con 0x7f6fec003420 2020-02-11T16:07:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 msgr2=0x7f6fec0058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f70037fe700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 0x7f6fec0058e0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).stop 2020-02-11T16:07:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 msgr2=0x7f6fec0058e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.387+0000 7f70037fe700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 0x7f6fec0058e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.395+0000 7f7018e36700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 0x7f6fec0068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.395+0000 7f7018e36700 1 -- 172.21.15.88:0/3909332577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec006d80 con 0x7f6fec006440 2020-02-11T16:07:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.396+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 0x7f6fec0068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.396+0000 7f7011d9b700 1 -- 172.21.15.88:0/3909332577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6fec006f40 con 0x7f6fec006440 2020-02-11T16:07:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.396+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 0x7f6fec0068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.396+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 0x7f6fec0068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.396+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 0x7f6fec0068f0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.396+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 0x7f6fec0068f0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.396+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7004008420 con 0x7f6fec006440 2020-02-11T16:07:56.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7011d9b700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 0x7f6fec0068f0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4010 (secure 0 0 0) 0x7f70040055e0 con 0x7f6fec006440 2020-02-11T16:07:56.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 msgr2=0x7f6fec0068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f70037fe700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 0x7f6fec0068f0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f7004005520 tx=0x7f7004011600).stop 2020-02-11T16:07:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f70037fe700 1 -- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 msgr2=0x7f6fec0068f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f70037fe700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 0x7f6fec0068f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 -- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ff003db90 msgr2=0x7f6ff0040050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ff003db90 0x7f6ff0040050 crc :-1 s=READY pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 -- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 msgr2=0x7f6ff0004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f7008003480 tx=0x7f7008012b50).stop 2020-02-11T16:07:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 -- 172.21.15.88:0/3909332577 shutdown_connections 2020-02-11T16:07:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ff003db90 0x7f6ff0040050 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff00049b0 0x7f6ff0004d90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec003420 0x7f6fec0058e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 --2- 172.21.15.88:0/3909332577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec006440 0x7f6fec0068f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 -- 172.21.15.88:0/3909332577 >> 172.21.15.88:0/3909332577 conn(0x7f701409d110 msgr2=0x7f70140a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 -- 172.21.15.88:0/3909332577 shutdown_connections 2020-02-11T16:07:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.397+0000 7f7018e36700 1 -- 172.21.15.88:0/3909332577 wait complete. 2020-02-11T16:07:56.418 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:07:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:07:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 32, 2020-02-11T16:07:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:07:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:07:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:07:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:07:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:07:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:07:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:07:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:07:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:07:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:07:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:07:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:07:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:07:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:07:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:07:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:07:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:07:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:07:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:07:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:07:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:07:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:07:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:07:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:07:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:07:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:07:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:07:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:07:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:07:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:07:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:07:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:07:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:07:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.435 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:07:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:07:56.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:07:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.437 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:07:56.439 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:07:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.542+0000 7f46147cc700 1 Processor -- start 2020-02-11T16:07:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.542+0000 7f46147cc700 1 -- start start 2020-02-11T16:07:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.543+0000 7f46147cc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f460c0a5b20 0x7f460c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.543+0000 7f46147cc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c0a4350 con 0x7f460c131280 2020-02-11T16:07:56.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.543+0000 7f46147cc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c0a3a40 con 0x7f460c0a2fa0 2020-02-11T16:07:56.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.543+0000 7f46147cc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c0a1e60 con 0x7f460c0a5b20 2020-02-11T16:07:56.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.543+0000 7f4612568700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f460c0a2fa0 legacy=0x7f460c0a5410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:07:56.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.543+0000 7f4611d67700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f460c0a5b20 msgr2=0x7f460c0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:56.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.543+0000 7f4611d67700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f460c0a5b20 0x7f460c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:56.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.543+0000 7f4612d69700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f460c131280 0x7f460c1316f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60802/0 (socket says 172.21.15.88:60802) 2020-02-11T16:07:56.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.543+0000 7f4612d69700 1 -- 172.21.15.88:0/635194132 learned_addr learned my addr 172.21.15.88:0/635194132 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:56.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319462868 0 0) 0x7f460c0a4350 con 0x7f460c131280 2020-02-11T16:07:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f4003230 con 0x7f460c131280 2020-02-11T16:07:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 19082265 0 0) 0x7f45f4003230 con 0x7f460c131280 2020-02-11T16:07:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 >> v2:172.21.15.88:3300/0 conn(0x7f460c0a5b20 msgr2=0x7f460c0a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 --2- 172.21.15.88:0/635194132 >> v2:172.21.15.88:3300/0 conn(0x7f460c0a5b20 0x7f460c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:56.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 >> v1:172.21.15.88:6789/0 conn(0x7f460c0a2fa0 legacy=0x7f460c0a5410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:56.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c0a3ce0 con 0x7f460c131280 2020-02-11T16:07:56.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f4604001a50 con 0x7f460c131280 2020-02-11T16:07:56.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 >> v1:172.21.15.52:6789/0 conn(0x7f460c131280 legacy=0x7f460c1316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 0x7f45f4003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:56.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45f4004040 0x7f45f4004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:56.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45f4004a80 0x7f45f4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:56.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0a1e60 con 0x7f45f4003720 2020-02-11T16:07:56.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f400b860 con 0x7f45f4004a80 2020-02-11T16:07:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f400ba20 con 0x7f45f4004040 2020-02-11T16:07:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4612d69700 1 -- 172.21.15.88:0/635194132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45f4004a80 msgr2=0x7f45f4004f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4612d69700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45f4004a80 0x7f45f4004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4612568700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 0x7f45f4003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4611d67700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45f4004040 0x7f45f4004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4612568700 1 -- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45f4004040 msgr2=0x7f45f4004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:07:56.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4612568700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45f4004040 0x7f45f4004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:56.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4612568700 1 -- 172.21.15.88:0/635194132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45f4004a80 msgr2=0x7f45f4004f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:56.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4612568700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45f4004a80 0x7f45f4004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:56.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4612d69700 1 -- 172.21.15.88:0/635194132 reap_dead start 2020-02-11T16:07:56.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.544+0000 7f4612568700 1 -- 172.21.15.88:0/635194132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4003230 con 0x7f45f4003720 2020-02-11T16:07:56.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f4612568700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 0x7f45f4003b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f45fc005750 tx=0x7f45fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f4612568700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 0x7f45f4003b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f45fc005750 tx=0x7f45fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f4612568700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 0x7f45f4003b20 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f45fc005750 tx=0x7f45fc0088e0).ready entity=mon.0 client_cookie=82a1dec297ca3d43 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f4612568700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 0x7f45f4003b20 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f45fc005750 tx=0x7f45fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45fc003e10 con 0x7f45f4003720 2020-02-11T16:07:56.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f4612568700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 0x7f45f4003b20 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f45fc005750 tx=0x7f45fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f4612568700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 0x7f45f4003b20 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f45fc005750 tx=0x7f45fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc008950 con 0x7f45f4003720 2020-02-11T16:07:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f4611566700 1 -- 172.21.15.88:0/635194132 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45fc008d70 con 0x7f45f4003720 2020-02-11T16:07:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f46147cc700 1 -- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 msgr2=0x7f45f4003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f46147cc700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 0x7f45f4003b20 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f45fc005750 tx=0x7f45fc0088e0).stop 2020-02-11T16:07:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f46147cc700 1 -- 172.21.15.88:0/635194132 shutdown_connections 2020-02-11T16:07:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f46147cc700 1 --2- 172.21.15.88:0/635194132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f4003720 0x7f45f4003b20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f46147cc700 1 -- 172.21.15.88:0/635194132 >> 172.21.15.88:0/635194132 conn(0x7f460c09d110 msgr2=0x7f460c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f46147cc700 1 -- 172.21.15.88:0/635194132 shutdown_connections 2020-02-11T16:07:56.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.545+0000 7f46147cc700 1 -- 172.21.15.88:0/635194132 wait complete. 2020-02-11T16:07:56.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.546+0000 7f46147cc700 1 Processor -- start 2020-02-11T16:07:56.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.546+0000 7f46147cc700 1 -- start start 2020-02-11T16:07:56.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f46147cc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f460c0a0850 0x7f460c130a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f4612568700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f45f4003720 legacy=0x7f460c136cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:07:56.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f46147cc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c137400 con 0x7f460c137730 2020-02-11T16:07:56.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f46147cc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c0a9180 con 0x7f45f4003720 2020-02-11T16:07:56.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f46147cc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c135160 con 0x7f460c0a0850 2020-02-11T16:07:56.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f4612d69700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f460c0a0850 msgr2=0x7f460c130a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:56.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f4612d69700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f460c0a0850 0x7f460c130a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:56.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f4611d67700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f460c137730 0x7f460c130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60814/0 (socket says 172.21.15.88:60814) 2020-02-11T16:07:56.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f4611d67700 1 -- 172.21.15.88:0/281654553 learned_addr learned my addr 172.21.15.88:0/281654553 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:07:56.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880103048 0 0) 0x7f460c137400 con 0x7f460c137730 2020-02-11T16:07:56.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45ec002fe0 con 0x7f460c137730 2020-02-11T16:07:56.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1938071833 0 0) 0x7f45ec002fe0 con 0x7f460c137730 2020-02-11T16:07:56.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f460c137400 con 0x7f460c137730 2020-02-11T16:07:56.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f4608003cd0 con 0x7f460c137730 2020-02-11T16:07:56.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 >> v2:172.21.15.88:3300/0 conn(0x7f460c0a0850 msgr2=0x7f460c130a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:56.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 --2- 172.21.15.88:0/281654553 >> v2:172.21.15.88:3300/0 conn(0x7f460c0a0850 0x7f460c130a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 >> v1:172.21.15.88:6789/0 conn(0x7f45f4003720 legacy=0x7f460c136cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:56.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 >> v1:172.21.15.52:6789/0 conn(0x7f460c137730 legacy=0x7f460c130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45ec0049b0 0x7f45ec004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec005210 0x7f45ec003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.547+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec00b7e0 con 0x7f45ec003e90 2020-02-11T16:07:56.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec00b950 con 0x7f45ec005210 2020-02-11T16:07:56.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec00bb10 con 0x7f45ec0049b0 2020-02-11T16:07:56.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4611d67700 1 -- 172.21.15.88:0/281654553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec005210 msgr2=0x7f45ec003920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:56.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4611d67700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec005210 0x7f45ec003920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:56.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45ec0049b0 0x7f45ec004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 -- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45ec0049b0 msgr2=0x7f45ec004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45ec0049b0 0x7f45ec004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 -- 172.21.15.88:0/281654553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec005210 msgr2=0x7f45ec003920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:56.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec005210 0x7f45ec003920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 -- 172.21.15.88:0/281654553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c05b9a0 con 0x7f45ec003e90 2020-02-11T16:07:56.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f46147cc700 1 -- 172.21.15.88:0/281654553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c137ea0 con 0x7f45ec003e90 2020-02-11T16:07:56.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f460c0a1410 tx=0x7f460400c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 -- 172.21.15.88:0/281654553 reap_dead start 2020-02-11T16:07:56.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f46147cc700 1 -- 172.21.15.88:0/281654553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c137b90 con 0x7f45ec003e90 2020-02-11T16:07:56.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f460c0a1410 tx=0x7f460400c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f460c0a1410 tx=0x7f460400c810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f460c0a1410 tx=0x7f460400c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4604001910 con 0x7f45ec003e90 2020-02-11T16:07:56.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f460c0a1410 tx=0x7f460400c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460400ccd0 con 0x7f45ec003e90 2020-02-11T16:07:56.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f460c0a1410 tx=0x7f460400c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.548+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f460400ce40 con 0x7f45ec003e90 2020-02-11T16:07:56.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f460c0a1410 tx=0x7f460400c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f46147cc700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 0x7f45e80058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f46147cc700 1 -- 172.21.15.88:0/281654553 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8005ea0 con 0x7f45e8003420 2020-02-11T16:07:56.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4604004870 con 0x7f45ec003e90 2020-02-11T16:07:56.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f4612d69700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f460c0a1410 tx=0x7f460400c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 0x7f45e80058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f45fb7fe700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f45ec03d370 0x7f45ec03f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f4604049190 con 0x7f45ec003e90 2020-02-11T16:07:56.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f4611d67700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f45ec03d370 0x7f45ec03f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f4612568700 1 -- 172.21.15.88:0/281654553 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45e8006060 con 0x7f45e8003420 2020-02-11T16:07:56.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 0x7f45e80058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 0x7f45e80058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.549+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 0x7f45e80058e0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.550+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 0x7f45e80058e0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.550+0000 7f4611d67700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f45ec03d370 0x7f45ec03f830 crc :-1 s=READY pgs=145 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.550+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45fc00f5f0 con 0x7f45e8003420 2020-02-11T16:07:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.550+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 0x7f45e80058e0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.550+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f45fc00f750 con 0x7f45e8003420 2020-02-11T16:07:56.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.550+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 msgr2=0x7f45e80058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.550+0000 7f45fb7fe700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 0x7f45e80058e0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).stop 2020-02-11T16:07:56.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.550+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 msgr2=0x7f45e80058e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.550+0000 7f45fb7fe700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 0x7f45e80058e0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).stop 2020-02-11T16:07:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.558+0000 7f46147cc700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 0x7f45e80068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.558+0000 7f46147cc700 1 -- 172.21.15.88:0/281654553 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8006d80 con 0x7f45e8006440 2020-02-11T16:07:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.558+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 0x7f45e80068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:56.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.558+0000 7f4612568700 1 -- 172.21.15.88:0/281654553 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f45e8006f40 con 0x7f45e8006440 2020-02-11T16:07:56.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.558+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 0x7f45e80068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.558+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 0x7f45e80068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.558+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 0x7f45e80068f0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:56.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 0x7f45e80068f0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45fc0078a0 con 0x7f45e8006440 2020-02-11T16:07:56.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f4612568700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 0x7f45e80068f0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:56.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4348 (secure 0 0 0) 0x7f45fc012620 con 0x7f45e8006440 2020-02-11T16:07:56.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 msgr2=0x7f45e80068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f45fb7fe700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 0x7f45e80068f0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).stop 2020-02-11T16:07:56.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f45fb7fe700 1 -- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 msgr2=0x7f45e80068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:07:56.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f45fb7fe700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 0x7f45e80068f0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0x7f45fc000b20 tx=0x7f45f400cdb0).stop 2020-02-11T16:07:56.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 -- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f45ec03d370 msgr2=0x7f45ec03f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f45ec03d370 0x7f45ec03f830 crc :-1 s=READY pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 -- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 msgr2=0x7f45ec004310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:56.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f460c0a1410 tx=0x7f460400c810).stop 2020-02-11T16:07:56.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 -- 172.21.15.88:0/281654553 shutdown_connections 2020-02-11T16:07:56.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f45ec03d370 0x7f45ec03f830 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45ec003e90 0x7f45ec004310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8003420 0x7f45e80058e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 --2- 172.21.15.88:0/281654553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45e8006440 0x7f45e80068f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 -- 172.21.15.88:0/281654553 >> 172.21.15.88:0/281654553 conn(0x7f460c09d110 msgr2=0x7f460c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:56.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 -- 172.21.15.88:0/281654553 shutdown_connections 2020-02-11T16:07:56.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:07:56.559+0000 7f46147cc700 1 -- 172.21.15.88:0/281654553 wait complete. 2020-02-11T16:07:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:07:56.607 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:56.608 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:56.608 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:07:56.608 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 32, 2020-02-11T16:07:56.608 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:07:56.609 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:07:56.609 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:07:56.609 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.609 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:07:56.609 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:56.610 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:07:56.610 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:07:56.610 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:56.610 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:56.611 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:56.611 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:56.611 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:56.611 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:56.611 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.612 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:07:56.612 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:07:56.612 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:56.612 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:56.613 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:56.613 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:56.613 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:56.613 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:56.613 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.614 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:07:56.614 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:07:56.614 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:07:56.615 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:07:56.615 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:07:56.615 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:07:56.615 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:56.615 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:07:56.616 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:07:56.616 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:07:56.616 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:07:56.616 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:07:56.616 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:07:56.616 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:07:56.616 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:07:56.617 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:07:56.617 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:07:56.617 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:07:56.617 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.617 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:07:56.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.617 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:07:56.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.618 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:07:56.618 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:07:56.618 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:56.618 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:56.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.618 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:56.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:07:56.619 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.619 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:56.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:07:56.619 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:07:56.620 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:07:56.620 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:56.620 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:56.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.621 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:07:56.621 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:07:56.621 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:56.621 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:56.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.621 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:56.622 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:07:56.622 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.622 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:56.622 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:07:56.622 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.623 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.623 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.623 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:07:56.623 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:07:56.623 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:56.623 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:56.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.624 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:07:56.624 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:07:56.624 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:07:56.624 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:07:56.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.625 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:07:56.625 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:07:56.625 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.625 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:07:56.625 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:07:56.625 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:07:56.626 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.626 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.626 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:07:56.626 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:07:56.626 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:07:56.626 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:07:56.627 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.627 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:07:56.627 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:07:56.627 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:07:56.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.627 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:56.628 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:56.628 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:56.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.628 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.628 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:07:56.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.628 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:56.629 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:56.629 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:07:56.629 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.629 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.629 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:07:56.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.629 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:56.629 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:56.630 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:07:56.630 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.630 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.630 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:07:56.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.630 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:56.630 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:56.631 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:07:56.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.631 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:07:56.631 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:07:56.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:07:56.631 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:07:56.631 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:07:56.632 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:07:56.632 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.632 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:07:56.632 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:07:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:07:56.633 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:07:57.067 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:57.065+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f06f80028b0 tx=0x7f06f8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:57.068 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:57.065+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v16) v1 ==== 167+0+0 (secure 0 0 0) 0x7f06f80312e0 con 0x7f06f00401f0 2020-02-11T16:07:57.203 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:57.200+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f070807e3e0 con 0x7f06f00401f0 2020-02-11T16:07:58.068 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.065+0000 7f070db9f700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f06f80028b0 tx=0x7f06f8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.068 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.065+0000 7f06feffd700 1 -- 172.21.15.88:0/3626676720 <== mon.0 v2:172.21.15.52:3300/0 5 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v17) v1 ==== 167+0+0 (secure 0 0 0) 0x7f06f80314c0 con 0x7f06f00401f0 2020-02-11T16:07:58.070 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.067+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f06f0039c10 msgr2=0x7f06f003c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:58.070 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.067+0000 7f070eba1700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f06f0039c10 0x7f06f003c0d0 crc :-1 s=READY pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:58.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.067+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 msgr2=0x7f06f00425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:58.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.067+0000 7f070eba1700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06f00401f0 0x7f06f00425e0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f06f80028b0 tx=0x7f06f8010eb0).stop 2020-02-11T16:07:58.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.067+0000 7f070fe03700 1 -- 172.21.15.88:0/3626676720 reap_dead start 2020-02-11T16:07:58.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.067+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 shutdown_connections 2020-02-11T16:07:58.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.067+0000 7f070eba1700 1 --2- 172.21.15.88:0/3626676720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a73e0 0x7f07080635e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:58.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.067+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 >> 172.21.15.88:0/3626676720 conn(0x7f070805b610 msgr2=0x7f0708069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:58.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.067+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 shutdown_connections 2020-02-11T16:07:58.072 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.067+0000 7f070eba1700 1 -- 172.21.15.88:0/3626676720 wait complete. 2020-02-11T16:07:58.072 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:07:58.082 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 1 2020-02-11T16:07:58.084 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 2 2020-02-11T16:07:58.086 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 3 2020-02-11T16:07:58.089 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -e file4 ']' 2020-02-11T16:07:58.089 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/snap1 2020-02-11T16:07:58.101 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 4 2020-02-11T16:07:58.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ ls 2020-02-11T16:07:58.109 INFO:tasks.workunit.client.0.smithi088.stderr:+ now='file1 2020-02-11T16:07:58.109 INFO:tasks.workunit.client.0.smithi088.stderr:file2 2020-02-11T16:07:58.109 INFO:tasks.workunit.client.0.smithi088.stderr:file3 2020-02-11T16:07:58.110 INFO:tasks.workunit.client.0.smithi088.stderr:file4' 2020-02-11T16:07:58.110 INFO:tasks.workunit.client.0.smithi088.stderr:++ ls .snap/snap1 2020-02-11T16:07:58.115 INFO:tasks.workunit.client.0.smithi088.stderr:+ then='file1 2020-02-11T16:07:58.115 INFO:tasks.workunit.client.0.smithi088.stderr:file2 2020-02-11T16:07:58.115 INFO:tasks.workunit.client.0.smithi088.stderr:file3' 2020-02-11T16:07:58.115 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/snap1 2020-02-11T16:07:58.122 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' 'file1 2020-02-11T16:07:58.122 INFO:tasks.workunit.client.0.smithi088.stderr:file2 2020-02-11T16:07:58.122 INFO:tasks.workunit.client.0.smithi088.stderr:file3 2020-02-11T16:07:58.122 INFO:tasks.workunit.client.0.smithi088.stderr:file4' = 'file1 2020-02-11T16:07:58.123 INFO:tasks.workunit.client.0.smithi088.stderr:file2 2020-02-11T16:07:58.123 INFO:tasks.workunit.client.0.smithi088.stderr:file3' ']' 2020-02-11T16:07:58.123 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 1 2020-02-11T16:07:58.127 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 2 2020-02-11T16:07:58.133 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 3 2020-02-11T16:07:58.139 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/snap1 2020-02-11T16:07:58.146 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 4 2020-02-11T16:07:58.153 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/snap1 2020-02-11T16:07:58.161 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm file1 file2 file3 file4 2020-02-11T16:07:58.170 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:07:58.170 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:07:58.171 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:07:58.171 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:07:58.238 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2020-02-11T16:07:58.239 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2020-02-11T16:07:58.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.354+0000 7f7786814700 1 Processor -- start 2020-02-11T16:07:58.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.354+0000 7f7786814700 1 -- start start 2020-02-11T16:07:58.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.354+0000 7f7786814700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:58.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.354+0000 7f7786814700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77800a14c0 0x7f7780099890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:07:58.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.354+0000 7f7786814700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77800a37e0 con 0x7f7780099cf0 2020-02-11T16:07:58.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.354+0000 7f7786814700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77800a24e0 con 0x7f77800a14c0 2020-02-11T16:07:58.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.354+0000 7f7786814700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77800a4350 con 0x7f778005ac40 2020-02-11T16:07:58.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.354+0000 7f777ffff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f77800a14c0 msgr2=0x7f7780099890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:58.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.354+0000 7f77855b2700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f7780099cf0 legacy=0x7f77800a6290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:07:58.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.354+0000 7f777ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77800a14c0 0x7f7780099890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:58.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:58.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:47514/0 (socket says 172.21.15.88:47514) 2020-02-11T16:07:58.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 -- 172.21.15.88:0/4187284696 learned_addr learned my addr 172.21.15.88:0/4187284696 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:58.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 -- 172.21.15.88:0/4187284696 >> v2:172.21.15.88:3300/0 conn(0x7f77800a14c0 msgr2=0x7f7780099890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:58.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 --2- 172.21.15.88:0/4187284696 >> v2:172.21.15.88:3300/0 conn(0x7f77800a14c0 0x7f7780099890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:58.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 -- 172.21.15.88:0/4187284696 >> v1:172.21.15.88:6789/0 conn(0x7f7780099cf0 legacy=0x7f77800a6290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:07:58.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 -- 172.21.15.88:0/4187284696 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77800a26d0 con 0x7f778005ac40 2020-02-11T16:07:58.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 --2- 172.21.15.88:0/4187284696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f778005fc10 tx=0x7f77680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 --2- 172.21.15.88:0/4187284696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f778005fc10 tx=0x7f77680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 --2- 172.21.15.88:0/4187284696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f778005fc10 tx=0x7f77680088e0).ready entity=mon.2 client_cookie=aafe35a582f1eeed server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:58.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 --2- 172.21.15.88:0/4187284696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f778005fc10 tx=0x7f77680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f777f7fe700 1 -- 172.21.15.88:0/4187284696 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7768008e20 con 0x7f778005ac40 2020-02-11T16:07:58.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 --2- 172.21.15.88:0/4187284696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f778005fc10 tx=0x7f77680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7784db1700 1 --2- 172.21.15.88:0/4187284696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f778005fc10 tx=0x7f77680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f777f7fe700 1 -- 172.21.15.88:0/4187284696 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7768011910 con 0x7f778005ac40 2020-02-11T16:07:58.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f777f7fe700 1 -- 172.21.15.88:0/4187284696 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7768011c70 con 0x7f778005ac40 2020-02-11T16:07:58.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7786814700 1 -- 172.21.15.88:0/4187284696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 msgr2=0x7f77800a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:07:58.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.355+0000 7f7786814700 1 --2- 172.21.15.88:0/4187284696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f778005fc10 tx=0x7f77680088e0).stop 2020-02-11T16:07:58.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.356+0000 7f7786814700 1 -- 172.21.15.88:0/4187284696 shutdown_connections 2020-02-11T16:07:58.364 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.356+0000 7f7786814700 1 --2- 172.21.15.88:0/4187284696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f778005ac40 0x7f77800a2da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:58.364 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.356+0000 7f7786814700 1 --2- 172.21.15.88:0/4187284696 >> v2:172.21.15.88:3300/0 conn(0x7f77800a14c0 0x7f7780099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:07:58.364 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.356+0000 7f7786814700 1 -- 172.21.15.88:0/4187284696 >> 172.21.15.88:0/4187284696 conn(0x7f778005c170 msgr2=0x7f778005a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:07:58.364 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.356+0000 7f7786814700 1 -- 172.21.15.88:0/4187284696 shutdown_connections 2020-02-11T16:07:58.364 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.356+0000 7f7786814700 1 -- 172.21.15.88:0/4187284696 wait complete. 2020-02-11T16:07:58.367 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.357+0000 7f7786814700 1 Processor -- start 2020-02-11T16:07:58.368 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.357+0000 7f7786814700 1 -- start start 2020-02-11T16:07:58.368 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f7786814700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f778005ac40 0x7f778009c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:58.368 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f7786814700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:58.368 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f7786814700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778007f2c0 con 0x7f7780099cf0 2020-02-11T16:07:58.368 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f7786814700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7780123890 con 0x7f778005ac40 2020-02-11T16:07:58.368 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f7786814700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7780123b30 con 0x7f77800a14c0 2020-02-11T16:07:58.369 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f7784db1700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f778005ac40 msgr2=0x7f778009c030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:07:58.369 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f777ffff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f7780099cf0 legacy=0x7f778009b230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:07:58.369 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f7784db1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f778005ac40 0x7f778009c030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:07:58.369 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f77855b2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:58.369 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f77855b2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:47522/0 (socket says 172.21.15.88:47522) 2020-02-11T16:07:58.369 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f77855b2700 1 -- 172.21.15.88:0/1714914261 learned_addr learned my addr 172.21.15.88:0/1714914261 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:07:58.369 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f77855b2700 1 -- 172.21.15.88:0/1714914261 >> v2:172.21.15.88:3300/0 conn(0x7f778005ac40 msgr2=0x7f778009c030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:58.370 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> v2:172.21.15.88:3300/0 conn(0x7f778005ac40 0x7f778009c030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:07:58.370 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f77855b2700 1 -- 172.21.15.88:0/1714914261 >> v1:172.21.15.88:6789/0 conn(0x7f7780099cf0 legacy=0x7f778009b230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:07:58.370 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f77855b2700 1 -- 172.21.15.88:0/1714914261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7780123dd0 con 0x7f77800a14c0 2020-02-11T16:07:58.370 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.371 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.371 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.358+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:58.371 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.371 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.371 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f777d7fa700 1 -- 172.21.15.88:0/1714914261 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777800d4a0 con 0x7f77800a14c0 2020-02-11T16:07:58.372 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.372 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f777d7fa700 1 -- 172.21.15.88:0/1714914261 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777800d600 con 0x7f77800a14c0 2020-02-11T16:07:58.372 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778009c490 con 0x7f77800a14c0 2020-02-11T16:07:58.372 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f777d7fa700 1 -- 172.21.15.88:0/1714914261 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777800da20 con 0x7f77800a14c0 2020-02-11T16:07:58.372 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778009fd90 con 0x7f77800a14c0 2020-02-11T16:07:58.372 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.372 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f777d7fa700 1 -- 172.21.15.88:0/1714914261 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f777800dc90 con 0x7f77800a14c0 2020-02-11T16:07:58.373 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.359+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.373 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.360+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77800565b0 con 0x7f77800a14c0 2020-02-11T16:07:58.373 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.360+0000 7f777d7fa700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7764039b60 0x7f776403c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:07:58.373 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.360+0000 7f777d7fa700 1 -- 172.21.15.88:0/1714914261 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f777804a490 con 0x7f77800a14c0 2020-02-11T16:07:58.373 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.360+0000 7f7784db1700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7764039b60 0x7f776403c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:07:58.373 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.360+0000 7f7784db1700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7764039b60 0x7f776403c020 crc :-1 s=READY pgs=146 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:07:58.373 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.364+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:58.374 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.364+0000 7f777d7fa700 1 -- 172.21.15.88:0/1714914261 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f777802fa70 con 0x7f77800a14c0 2020-02-11T16:07:58.544 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:58.541+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7780123f60 con 0x7f77800a14c0 2020-02-11T16:07:59.072 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:59.069+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:07:59.072 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:59.069+0000 7f777d7fa700 1 -- 172.21.15.88:0/1714914261 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v18) v1 ==== 167+0+0 (secure 0 0 0) 0x7f7778032580 con 0x7f77800a14c0 2020-02-11T16:07:59.208 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:07:59.205+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f778005e8e0 con 0x7f77800a14c0 2020-02-11T16:08:00.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.075+0000 7f77855b2700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:00.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.076+0000 7f777d7fa700 1 -- 172.21.15.88:0/1714914261 <== mon.2 v2:172.21.15.52:3301/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v19) v1 ==== 167+0+0 (secure 0 0 0) 0x7f77780329c0 con 0x7f77800a14c0 2020-02-11T16:08:00.081 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7764039b60 msgr2=0x7f776403c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:00.081 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7764039b60 0x7f776403c020 crc :-1 s=READY pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:00.081 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 msgr2=0x7f778007e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:00.081 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f77800a4930 tx=0x7f7778010ce0).stop 2020-02-11T16:08:00.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 shutdown_connections 2020-02-11T16:08:00.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7764039b60 0x7f776403c020 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:00.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 --2- 172.21.15.88:0/1714914261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77800a14c0 0x7f778007e4e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:00.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 --2- 172.21.15.88:0/1714914261 >> v2:172.21.15.88:3300/0 conn(0x7f778005ac40 0x7f778009c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:00.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 >> 172.21.15.88:0/1714914261 conn(0x7f778005c170 msgr2=0x7f77800a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:00.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 shutdown_connections 2020-02-11T16:08:00.083 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:00.078+0000 7f7786814700 1 -- 172.21.15.88:0/1714914261 wait complete. 2020-02-11T16:08:00.083 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:08:00.092 INFO:tasks.workunit.client.0.smithi088.stdout:Create dir 100 to 199 ... 2020-02-11T16:08:00.104 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 100 2020-02-11T16:08:00.131 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 101 2020-02-11T16:08:00.155 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 102 2020-02-11T16:08:00.181 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 103 2020-02-11T16:08:00.205 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 104 2020-02-11T16:08:00.226 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 105 2020-02-11T16:08:00.248 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 106 2020-02-11T16:08:00.272 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 107 2020-02-11T16:08:00.294 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 108 2020-02-11T16:08:00.316 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 109 2020-02-11T16:08:00.340 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 110 2020-02-11T16:08:00.361 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 111 2020-02-11T16:08:00.383 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 112 2020-02-11T16:08:00.407 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 113 2020-02-11T16:08:00.428 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 114 2020-02-11T16:08:00.451 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 115 2020-02-11T16:08:00.473 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 116 2020-02-11T16:08:00.496 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 117 2020-02-11T16:08:00.519 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 118 2020-02-11T16:08:00.541 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 119 2020-02-11T16:08:00.564 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 120 2020-02-11T16:08:00.586 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 121 2020-02-11T16:08:00.609 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 122 2020-02-11T16:08:00.632 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 123 2020-02-11T16:08:00.654 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 124 2020-02-11T16:08:00.677 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 125 2020-02-11T16:08:00.698 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 126 2020-02-11T16:08:00.721 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 127 2020-02-11T16:08:00.743 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 128 2020-02-11T16:08:00.766 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 129 2020-02-11T16:08:00.790 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 130 2020-02-11T16:08:00.812 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 131 2020-02-11T16:08:00.834 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 132 2020-02-11T16:08:00.862 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 133 2020-02-11T16:08:00.880 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 134 2020-02-11T16:08:00.903 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 135 2020-02-11T16:08:00.926 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 136 2020-02-11T16:08:00.947 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 137 2020-02-11T16:08:00.970 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 138 2020-02-11T16:08:00.992 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 139 2020-02-11T16:08:01.014 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 140 2020-02-11T16:08:01.037 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 141 2020-02-11T16:08:01.059 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 142 2020-02-11T16:08:01.082 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 143 2020-02-11T16:08:01.105 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 144 2020-02-11T16:08:01.128 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 145 2020-02-11T16:08:01.151 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 146 2020-02-11T16:08:01.172 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 147 2020-02-11T16:08:01.195 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 148 2020-02-11T16:08:01.216 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 149 2020-02-11T16:08:01.239 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 150 2020-02-11T16:08:01.262 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 151 2020-02-11T16:08:01.285 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 152 2020-02-11T16:08:01.307 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 153 2020-02-11T16:08:01.331 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 154 2020-02-11T16:08:01.353 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 155 2020-02-11T16:08:01.377 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 156 2020-02-11T16:08:01.399 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 157 2020-02-11T16:08:01.422 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 158 2020-02-11T16:08:01.446 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 159 2020-02-11T16:08:01.469 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 160 2020-02-11T16:08:01.492 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 161 2020-02-11T16:08:01.515 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 162 2020-02-11T16:08:01.538 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 163 2020-02-11T16:08:01.560 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 164 2020-02-11T16:08:01.583 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 165 2020-02-11T16:08:01.609 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 166 2020-02-11T16:08:01.628 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 167 2020-02-11T16:08:01.651 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 168 2020-02-11T16:08:01.701 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 169 2020-02-11T16:08:01.732 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 170 2020-02-11T16:08:01.763 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 171 2020-02-11T16:08:01.800 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 172 2020-02-11T16:08:01.887 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 173 2020-02-11T16:08:01.922 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 174 2020-02-11T16:08:01.959 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 175 2020-02-11T16:08:01.989 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 176 2020-02-11T16:08:02.012 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 177 2020-02-11T16:08:02.034 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 178 2020-02-11T16:08:02.056 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 179 2020-02-11T16:08:02.079 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 180 2020-02-11T16:08:02.102 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 181 2020-02-11T16:08:02.127 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 182 2020-02-11T16:08:02.150 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 183 2020-02-11T16:08:02.172 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 184 2020-02-11T16:08:02.195 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 185 2020-02-11T16:08:02.219 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 186 2020-02-11T16:08:02.241 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 187 2020-02-11T16:08:02.264 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 188 2020-02-11T16:08:02.287 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 189 2020-02-11T16:08:02.309 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 190 2020-02-11T16:08:02.332 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 191 2020-02-11T16:08:02.354 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 192 2020-02-11T16:08:02.377 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 193 2020-02-11T16:08:02.399 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 194 2020-02-11T16:08:02.422 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 195 2020-02-11T16:08:02.446 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 196 2020-02-11T16:08:02.470 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 197 2020-02-11T16:08:02.493 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 198 2020-02-11T16:08:02.516 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 199 2020-02-11T16:08:02.539 INFO:tasks.workunit.client.0.smithi088.stdout:Take first snapshot .snap/test1 2020-02-11T16:08:02.707 INFO:tasks.workunit.client.0.smithi088.stdout:Create dir 200 to 299 ... 2020-02-11T16:08:02.708 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 200 2020-02-11T16:08:03.179 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 201 2020-02-11T16:08:03.200 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 202 2020-02-11T16:08:03.223 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 203 2020-02-11T16:08:03.243 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 204 2020-02-11T16:08:03.264 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 205 2020-02-11T16:08:03.285 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 206 2020-02-11T16:08:03.307 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 207 2020-02-11T16:08:03.329 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 208 2020-02-11T16:08:03.349 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 209 2020-02-11T16:08:03.371 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 210 2020-02-11T16:08:03.392 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 211 2020-02-11T16:08:03.415 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 212 2020-02-11T16:08:03.436 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 213 2020-02-11T16:08:03.457 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 214 2020-02-11T16:08:03.479 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 215 2020-02-11T16:08:03.500 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 216 2020-02-11T16:08:03.522 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 217 2020-02-11T16:08:03.543 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 218 2020-02-11T16:08:03.563 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 219 2020-02-11T16:08:03.584 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 220 2020-02-11T16:08:03.606 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 221 2020-02-11T16:08:03.630 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 222 2020-02-11T16:08:03.652 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 223 2020-02-11T16:08:03.674 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 224 2020-02-11T16:08:03.696 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 225 2020-02-11T16:08:03.717 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 226 2020-02-11T16:08:03.738 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 227 2020-02-11T16:08:03.759 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 228 2020-02-11T16:08:03.780 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 229 2020-02-11T16:08:03.801 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 230 2020-02-11T16:08:03.822 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 231 2020-02-11T16:08:03.843 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 232 2020-02-11T16:08:03.865 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 233 2020-02-11T16:08:03.886 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 234 2020-02-11T16:08:03.907 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 235 2020-02-11T16:08:03.929 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 236 2020-02-11T16:08:03.951 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 237 2020-02-11T16:08:03.972 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 238 2020-02-11T16:08:03.994 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 239 2020-02-11T16:08:04.016 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 240 2020-02-11T16:08:04.037 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 241 2020-02-11T16:08:04.058 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 242 2020-02-11T16:08:04.080 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 243 2020-02-11T16:08:04.101 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 244 2020-02-11T16:08:04.124 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 245 2020-02-11T16:08:04.145 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 246 2020-02-11T16:08:04.167 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 247 2020-02-11T16:08:04.189 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 248 2020-02-11T16:08:04.210 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 249 2020-02-11T16:08:04.233 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 250 2020-02-11T16:08:04.263 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 251 2020-02-11T16:08:06.825 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 252 2020-02-11T16:08:06.847 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 253 2020-02-11T16:08:06.869 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 254 2020-02-11T16:08:06.890 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 255 2020-02-11T16:08:06.911 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 256 2020-02-11T16:08:06.933 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 257 2020-02-11T16:08:06.955 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 258 2020-02-11T16:08:06.978 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 259 2020-02-11T16:08:07.002 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 260 2020-02-11T16:08:07.023 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 261 2020-02-11T16:08:07.044 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 262 2020-02-11T16:08:07.066 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 263 2020-02-11T16:08:07.087 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 264 2020-02-11T16:08:07.107 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 265 2020-02-11T16:08:07.129 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 266 2020-02-11T16:08:07.150 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 267 2020-02-11T16:08:07.172 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 268 2020-02-11T16:08:07.194 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 269 2020-02-11T16:08:07.217 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 270 2020-02-11T16:08:07.237 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 271 2020-02-11T16:08:07.258 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 272 2020-02-11T16:08:07.279 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 273 2020-02-11T16:08:07.301 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 274 2020-02-11T16:08:07.323 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 275 2020-02-11T16:08:07.344 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 276 2020-02-11T16:08:07.367 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 277 2020-02-11T16:08:07.389 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 278 2020-02-11T16:08:07.411 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 279 2020-02-11T16:08:07.433 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 280 2020-02-11T16:08:07.454 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 281 2020-02-11T16:08:07.780 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 282 2020-02-11T16:08:07.803 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 283 2020-02-11T16:08:07.823 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 284 2020-02-11T16:08:07.845 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 285 2020-02-11T16:08:07.866 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 286 2020-02-11T16:08:07.889 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 287 2020-02-11T16:08:07.911 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 288 2020-02-11T16:08:07.932 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 289 2020-02-11T16:08:07.954 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 290 2020-02-11T16:08:07.976 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 291 2020-02-11T16:08:07.997 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 292 2020-02-11T16:08:08.019 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 293 2020-02-11T16:08:08.040 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 294 2020-02-11T16:08:08.062 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 295 2020-02-11T16:08:08.084 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 296 2020-02-11T16:08:08.106 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 297 2020-02-11T16:08:08.129 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 298 2020-02-11T16:08:08.151 INFO:tasks.workunit.client.0.smithi088.stdout: create dir 299 2020-02-11T16:08:08.174 INFO:tasks.workunit.client.0.smithi088.stdout:Create a snapshot in every first level dir ... 2020-02-11T16:08:08.314 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/.snap/snap-subdir-test 2020-02-11T16:08:08.334 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/30 file after the snapshot 2020-02-11T16:08:08.336 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/31 file after the snapshot 2020-02-11T16:08:08.338 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/32 file after the snapshot 2020-02-11T16:08:08.340 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/33 file after the snapshot 2020-02-11T16:08:08.342 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/34 file after the snapshot 2020-02-11T16:08:08.344 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/35 file after the snapshot 2020-02-11T16:08:08.345 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/36 file after the snapshot 2020-02-11T16:08:08.347 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/37 file after the snapshot 2020-02-11T16:08:08.349 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/38 file after the snapshot 2020-02-11T16:08:08.351 INFO:tasks.workunit.client.0.smithi088.stdout: create 100/39 file after the snapshot 2020-02-11T16:08:08.353 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/.snap/snap-subdir-test 2020-02-11T16:08:08.375 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/30 file after the snapshot 2020-02-11T16:08:08.377 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/31 file after the snapshot 2020-02-11T16:08:08.379 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/32 file after the snapshot 2020-02-11T16:08:08.381 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/33 file after the snapshot 2020-02-11T16:08:08.382 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/34 file after the snapshot 2020-02-11T16:08:08.385 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/35 file after the snapshot 2020-02-11T16:08:08.387 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/36 file after the snapshot 2020-02-11T16:08:08.388 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/37 file after the snapshot 2020-02-11T16:08:08.390 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/38 file after the snapshot 2020-02-11T16:08:08.392 INFO:tasks.workunit.client.0.smithi088.stdout: create 101/39 file after the snapshot 2020-02-11T16:08:08.394 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/.snap/snap-subdir-test 2020-02-11T16:08:08.416 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/30 file after the snapshot 2020-02-11T16:08:08.418 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/31 file after the snapshot 2020-02-11T16:08:08.420 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/32 file after the snapshot 2020-02-11T16:08:08.422 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/33 file after the snapshot 2020-02-11T16:08:08.424 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/34 file after the snapshot 2020-02-11T16:08:08.426 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/35 file after the snapshot 2020-02-11T16:08:08.428 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/36 file after the snapshot 2020-02-11T16:08:08.430 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/37 file after the snapshot 2020-02-11T16:08:08.431 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/38 file after the snapshot 2020-02-11T16:08:08.433 INFO:tasks.workunit.client.0.smithi088.stdout: create 102/39 file after the snapshot 2020-02-11T16:08:08.435 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/.snap/snap-subdir-test 2020-02-11T16:08:08.456 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/30 file after the snapshot 2020-02-11T16:08:08.458 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/31 file after the snapshot 2020-02-11T16:08:08.459 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/32 file after the snapshot 2020-02-11T16:08:08.467 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/33 file after the snapshot 2020-02-11T16:08:08.544 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/34 file after the snapshot 2020-02-11T16:08:08.546 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/35 file after the snapshot 2020-02-11T16:08:08.548 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/36 file after the snapshot 2020-02-11T16:08:08.550 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/37 file after the snapshot 2020-02-11T16:08:08.552 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/38 file after the snapshot 2020-02-11T16:08:08.554 INFO:tasks.workunit.client.0.smithi088.stdout: create 103/39 file after the snapshot 2020-02-11T16:08:08.556 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/.snap/snap-subdir-test 2020-02-11T16:08:08.615 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/30 file after the snapshot 2020-02-11T16:08:08.616 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/31 file after the snapshot 2020-02-11T16:08:08.618 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/32 file after the snapshot 2020-02-11T16:08:08.620 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/33 file after the snapshot 2020-02-11T16:08:08.622 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/34 file after the snapshot 2020-02-11T16:08:08.625 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/35 file after the snapshot 2020-02-11T16:08:08.627 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/36 file after the snapshot 2020-02-11T16:08:08.630 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/37 file after the snapshot 2020-02-11T16:08:08.630 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/38 file after the snapshot 2020-02-11T16:08:08.632 INFO:tasks.workunit.client.0.smithi088.stdout: create 104/39 file after the snapshot 2020-02-11T16:08:08.634 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/.snap/snap-subdir-test 2020-02-11T16:08:08.655 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/30 file after the snapshot 2020-02-11T16:08:08.657 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/31 file after the snapshot 2020-02-11T16:08:08.658 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/32 file after the snapshot 2020-02-11T16:08:08.660 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/33 file after the snapshot 2020-02-11T16:08:08.662 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/34 file after the snapshot 2020-02-11T16:08:08.664 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/35 file after the snapshot 2020-02-11T16:08:08.666 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/36 file after the snapshot 2020-02-11T16:08:08.669 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/37 file after the snapshot 2020-02-11T16:08:08.671 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/38 file after the snapshot 2020-02-11T16:08:08.672 INFO:tasks.workunit.client.0.smithi088.stdout: create 105/39 file after the snapshot 2020-02-11T16:08:08.674 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/.snap/snap-subdir-test 2020-02-11T16:08:08.704 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/30 file after the snapshot 2020-02-11T16:08:08.706 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/31 file after the snapshot 2020-02-11T16:08:08.707 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/32 file after the snapshot 2020-02-11T16:08:08.709 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/33 file after the snapshot 2020-02-11T16:08:08.711 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/34 file after the snapshot 2020-02-11T16:08:08.713 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/35 file after the snapshot 2020-02-11T16:08:08.715 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/36 file after the snapshot 2020-02-11T16:08:08.717 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/37 file after the snapshot 2020-02-11T16:08:08.719 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/38 file after the snapshot 2020-02-11T16:08:08.720 INFO:tasks.workunit.client.0.smithi088.stdout: create 106/39 file after the snapshot 2020-02-11T16:08:08.723 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/.snap/snap-subdir-test 2020-02-11T16:08:08.745 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/30 file after the snapshot 2020-02-11T16:08:08.747 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/31 file after the snapshot 2020-02-11T16:08:08.749 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/32 file after the snapshot 2020-02-11T16:08:08.751 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/33 file after the snapshot 2020-02-11T16:08:08.753 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/34 file after the snapshot 2020-02-11T16:08:08.755 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/35 file after the snapshot 2020-02-11T16:08:08.757 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/36 file after the snapshot 2020-02-11T16:08:08.759 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/37 file after the snapshot 2020-02-11T16:08:08.761 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/38 file after the snapshot 2020-02-11T16:08:08.763 INFO:tasks.workunit.client.0.smithi088.stdout: create 107/39 file after the snapshot 2020-02-11T16:08:08.765 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/.snap/snap-subdir-test 2020-02-11T16:08:08.788 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/30 file after the snapshot 2020-02-11T16:08:08.790 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/31 file after the snapshot 2020-02-11T16:08:08.792 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/32 file after the snapshot 2020-02-11T16:08:08.794 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/33 file after the snapshot 2020-02-11T16:08:08.796 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/34 file after the snapshot 2020-02-11T16:08:08.798 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/35 file after the snapshot 2020-02-11T16:08:08.800 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/36 file after the snapshot 2020-02-11T16:08:08.802 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/37 file after the snapshot 2020-02-11T16:08:08.804 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/38 file after the snapshot 2020-02-11T16:08:08.806 INFO:tasks.workunit.client.0.smithi088.stdout: create 108/39 file after the snapshot 2020-02-11T16:08:08.807 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/.snap/snap-subdir-test 2020-02-11T16:08:08.830 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/30 file after the snapshot 2020-02-11T16:08:08.831 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/31 file after the snapshot 2020-02-11T16:08:08.833 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/32 file after the snapshot 2020-02-11T16:08:08.835 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/33 file after the snapshot 2020-02-11T16:08:08.837 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/34 file after the snapshot 2020-02-11T16:08:08.838 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/35 file after the snapshot 2020-02-11T16:08:08.840 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/36 file after the snapshot 2020-02-11T16:08:08.842 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/37 file after the snapshot 2020-02-11T16:08:08.844 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/38 file after the snapshot 2020-02-11T16:08:08.846 INFO:tasks.workunit.client.0.smithi088.stdout: create 109/39 file after the snapshot 2020-02-11T16:08:08.848 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/.snap/snap-subdir-test 2020-02-11T16:08:08.870 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/30 file after the snapshot 2020-02-11T16:08:08.872 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/31 file after the snapshot 2020-02-11T16:08:08.875 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/32 file after the snapshot 2020-02-11T16:08:08.877 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/33 file after the snapshot 2020-02-11T16:08:08.879 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/34 file after the snapshot 2020-02-11T16:08:08.881 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/35 file after the snapshot 2020-02-11T16:08:08.883 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/36 file after the snapshot 2020-02-11T16:08:08.884 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/37 file after the snapshot 2020-02-11T16:08:08.886 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/38 file after the snapshot 2020-02-11T16:08:08.888 INFO:tasks.workunit.client.0.smithi088.stdout: create 110/39 file after the snapshot 2020-02-11T16:08:08.891 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/.snap/snap-subdir-test 2020-02-11T16:08:08.915 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/30 file after the snapshot 2020-02-11T16:08:08.917 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/31 file after the snapshot 2020-02-11T16:08:08.918 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/32 file after the snapshot 2020-02-11T16:08:08.920 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/33 file after the snapshot 2020-02-11T16:08:08.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/34 file after the snapshot 2020-02-11T16:08:08.925 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/35 file after the snapshot 2020-02-11T16:08:08.927 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/36 file after the snapshot 2020-02-11T16:08:08.929 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/37 file after the snapshot 2020-02-11T16:08:08.931 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/38 file after the snapshot 2020-02-11T16:08:08.932 INFO:tasks.workunit.client.0.smithi088.stdout: create 111/39 file after the snapshot 2020-02-11T16:08:08.934 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/.snap/snap-subdir-test 2020-02-11T16:08:08.956 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/30 file after the snapshot 2020-02-11T16:08:08.958 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/31 file after the snapshot 2020-02-11T16:08:08.960 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/32 file after the snapshot 2020-02-11T16:08:08.961 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/33 file after the snapshot 2020-02-11T16:08:08.964 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/34 file after the snapshot 2020-02-11T16:08:08.965 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/35 file after the snapshot 2020-02-11T16:08:08.967 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/36 file after the snapshot 2020-02-11T16:08:08.969 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/37 file after the snapshot 2020-02-11T16:08:08.971 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/38 file after the snapshot 2020-02-11T16:08:08.973 INFO:tasks.workunit.client.0.smithi088.stdout: create 112/39 file after the snapshot 2020-02-11T16:08:08.975 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/.snap/snap-subdir-test 2020-02-11T16:08:08.998 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/30 file after the snapshot 2020-02-11T16:08:09.000 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/31 file after the snapshot 2020-02-11T16:08:09.001 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/32 file after the snapshot 2020-02-11T16:08:09.004 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/33 file after the snapshot 2020-02-11T16:08:09.006 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/34 file after the snapshot 2020-02-11T16:08:09.007 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/35 file after the snapshot 2020-02-11T16:08:09.009 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/36 file after the snapshot 2020-02-11T16:08:09.011 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/37 file after the snapshot 2020-02-11T16:08:09.013 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/38 file after the snapshot 2020-02-11T16:08:09.015 INFO:tasks.workunit.client.0.smithi088.stdout: create 113/39 file after the snapshot 2020-02-11T16:08:09.017 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/.snap/snap-subdir-test 2020-02-11T16:08:09.038 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/30 file after the snapshot 2020-02-11T16:08:09.040 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/31 file after the snapshot 2020-02-11T16:08:09.042 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/32 file after the snapshot 2020-02-11T16:08:09.044 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/33 file after the snapshot 2020-02-11T16:08:09.046 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/34 file after the snapshot 2020-02-11T16:08:09.048 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/35 file after the snapshot 2020-02-11T16:08:09.050 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/36 file after the snapshot 2020-02-11T16:08:09.051 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/37 file after the snapshot 2020-02-11T16:08:09.053 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/38 file after the snapshot 2020-02-11T16:08:09.055 INFO:tasks.workunit.client.0.smithi088.stdout: create 114/39 file after the snapshot 2020-02-11T16:08:09.057 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/.snap/snap-subdir-test 2020-02-11T16:08:09.080 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/30 file after the snapshot 2020-02-11T16:08:09.082 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/31 file after the snapshot 2020-02-11T16:08:09.084 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/32 file after the snapshot 2020-02-11T16:08:09.086 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/33 file after the snapshot 2020-02-11T16:08:09.087 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/34 file after the snapshot 2020-02-11T16:08:09.089 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/35 file after the snapshot 2020-02-11T16:08:09.091 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/36 file after the snapshot 2020-02-11T16:08:09.093 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/37 file after the snapshot 2020-02-11T16:08:09.095 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/38 file after the snapshot 2020-02-11T16:08:09.097 INFO:tasks.workunit.client.0.smithi088.stdout: create 115/39 file after the snapshot 2020-02-11T16:08:09.098 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/.snap/snap-subdir-test 2020-02-11T16:08:09.120 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/30 file after the snapshot 2020-02-11T16:08:09.121 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/31 file after the snapshot 2020-02-11T16:08:09.123 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/32 file after the snapshot 2020-02-11T16:08:09.125 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/33 file after the snapshot 2020-02-11T16:08:09.127 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/34 file after the snapshot 2020-02-11T16:08:09.129 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/35 file after the snapshot 2020-02-11T16:08:09.131 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/36 file after the snapshot 2020-02-11T16:08:09.133 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/37 file after the snapshot 2020-02-11T16:08:09.134 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/38 file after the snapshot 2020-02-11T16:08:09.136 INFO:tasks.workunit.client.0.smithi088.stdout: create 116/39 file after the snapshot 2020-02-11T16:08:09.138 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/.snap/snap-subdir-test 2020-02-11T16:08:09.160 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/30 file after the snapshot 2020-02-11T16:08:09.161 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/31 file after the snapshot 2020-02-11T16:08:09.163 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/32 file after the snapshot 2020-02-11T16:08:09.165 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/33 file after the snapshot 2020-02-11T16:08:09.167 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/34 file after the snapshot 2020-02-11T16:08:09.168 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/35 file after the snapshot 2020-02-11T16:08:09.170 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/36 file after the snapshot 2020-02-11T16:08:09.172 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/37 file after the snapshot 2020-02-11T16:08:09.174 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/38 file after the snapshot 2020-02-11T16:08:09.176 INFO:tasks.workunit.client.0.smithi088.stdout: create 117/39 file after the snapshot 2020-02-11T16:08:09.178 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/.snap/snap-subdir-test 2020-02-11T16:08:09.199 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/30 file after the snapshot 2020-02-11T16:08:09.200 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/31 file after the snapshot 2020-02-11T16:08:09.202 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/32 file after the snapshot 2020-02-11T16:08:09.204 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/33 file after the snapshot 2020-02-11T16:08:09.206 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/34 file after the snapshot 2020-02-11T16:08:09.208 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/35 file after the snapshot 2020-02-11T16:08:09.210 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/36 file after the snapshot 2020-02-11T16:08:09.212 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/37 file after the snapshot 2020-02-11T16:08:09.214 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/38 file after the snapshot 2020-02-11T16:08:09.216 INFO:tasks.workunit.client.0.smithi088.stdout: create 118/39 file after the snapshot 2020-02-11T16:08:09.218 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/.snap/snap-subdir-test 2020-02-11T16:08:09.251 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/30 file after the snapshot 2020-02-11T16:08:09.252 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/31 file after the snapshot 2020-02-11T16:08:09.255 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/32 file after the snapshot 2020-02-11T16:08:09.256 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/33 file after the snapshot 2020-02-11T16:08:09.258 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/34 file after the snapshot 2020-02-11T16:08:09.260 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/35 file after the snapshot 2020-02-11T16:08:09.262 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/36 file after the snapshot 2020-02-11T16:08:09.263 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/37 file after the snapshot 2020-02-11T16:08:09.266 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/38 file after the snapshot 2020-02-11T16:08:09.269 INFO:tasks.workunit.client.0.smithi088.stdout: create 119/39 file after the snapshot 2020-02-11T16:08:09.270 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/.snap/snap-subdir-test 2020-02-11T16:08:09.291 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/30 file after the snapshot 2020-02-11T16:08:09.293 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/31 file after the snapshot 2020-02-11T16:08:09.295 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/32 file after the snapshot 2020-02-11T16:08:09.297 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/33 file after the snapshot 2020-02-11T16:08:09.299 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/34 file after the snapshot 2020-02-11T16:08:09.301 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/35 file after the snapshot 2020-02-11T16:08:09.303 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/36 file after the snapshot 2020-02-11T16:08:09.306 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/37 file after the snapshot 2020-02-11T16:08:09.307 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/38 file after the snapshot 2020-02-11T16:08:09.308 INFO:tasks.workunit.client.0.smithi088.stdout: create 120/39 file after the snapshot 2020-02-11T16:08:09.317 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/.snap/snap-subdir-test 2020-02-11T16:08:09.332 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/30 file after the snapshot 2020-02-11T16:08:09.333 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/31 file after the snapshot 2020-02-11T16:08:09.335 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/32 file after the snapshot 2020-02-11T16:08:09.337 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/33 file after the snapshot 2020-02-11T16:08:09.339 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/34 file after the snapshot 2020-02-11T16:08:09.340 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/35 file after the snapshot 2020-02-11T16:08:09.343 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/36 file after the snapshot 2020-02-11T16:08:09.344 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/37 file after the snapshot 2020-02-11T16:08:09.346 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/38 file after the snapshot 2020-02-11T16:08:09.348 INFO:tasks.workunit.client.0.smithi088.stdout: create 121/39 file after the snapshot 2020-02-11T16:08:09.350 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/.snap/snap-subdir-test 2020-02-11T16:08:09.372 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/30 file after the snapshot 2020-02-11T16:08:09.375 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/31 file after the snapshot 2020-02-11T16:08:09.376 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/32 file after the snapshot 2020-02-11T16:08:09.378 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/33 file after the snapshot 2020-02-11T16:08:09.380 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/34 file after the snapshot 2020-02-11T16:08:09.382 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/35 file after the snapshot 2020-02-11T16:08:09.384 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/36 file after the snapshot 2020-02-11T16:08:09.386 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/37 file after the snapshot 2020-02-11T16:08:09.388 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/38 file after the snapshot 2020-02-11T16:08:09.390 INFO:tasks.workunit.client.0.smithi088.stdout: create 122/39 file after the snapshot 2020-02-11T16:08:09.392 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/.snap/snap-subdir-test 2020-02-11T16:08:09.413 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/30 file after the snapshot 2020-02-11T16:08:09.415 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/31 file after the snapshot 2020-02-11T16:08:09.417 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/32 file after the snapshot 2020-02-11T16:08:09.418 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/33 file after the snapshot 2020-02-11T16:08:09.421 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/34 file after the snapshot 2020-02-11T16:08:09.422 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/35 file after the snapshot 2020-02-11T16:08:09.424 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/36 file after the snapshot 2020-02-11T16:08:09.426 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/37 file after the snapshot 2020-02-11T16:08:09.428 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/38 file after the snapshot 2020-02-11T16:08:09.430 INFO:tasks.workunit.client.0.smithi088.stdout: create 123/39 file after the snapshot 2020-02-11T16:08:09.433 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/.snap/snap-subdir-test 2020-02-11T16:08:09.454 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/30 file after the snapshot 2020-02-11T16:08:09.455 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/31 file after the snapshot 2020-02-11T16:08:09.457 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/32 file after the snapshot 2020-02-11T16:08:09.459 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/33 file after the snapshot 2020-02-11T16:08:09.473 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/34 file after the snapshot 2020-02-11T16:08:09.621 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/35 file after the snapshot 2020-02-11T16:08:09.623 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/36 file after the snapshot 2020-02-11T16:08:09.624 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/37 file after the snapshot 2020-02-11T16:08:09.626 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/38 file after the snapshot 2020-02-11T16:08:09.628 INFO:tasks.workunit.client.0.smithi088.stdout: create 124/39 file after the snapshot 2020-02-11T16:08:09.631 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/.snap/snap-subdir-test 2020-02-11T16:08:09.729 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/30 file after the snapshot 2020-02-11T16:08:09.730 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/31 file after the snapshot 2020-02-11T16:08:09.732 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/32 file after the snapshot 2020-02-11T16:08:09.734 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/33 file after the snapshot 2020-02-11T16:08:09.736 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/34 file after the snapshot 2020-02-11T16:08:09.738 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/35 file after the snapshot 2020-02-11T16:08:09.740 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/36 file after the snapshot 2020-02-11T16:08:09.742 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/37 file after the snapshot 2020-02-11T16:08:09.744 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/38 file after the snapshot 2020-02-11T16:08:09.746 INFO:tasks.workunit.client.0.smithi088.stdout: create 125/39 file after the snapshot 2020-02-11T16:08:09.748 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/.snap/snap-subdir-test 2020-02-11T16:08:09.786 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/30 file after the snapshot 2020-02-11T16:08:09.787 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/31 file after the snapshot 2020-02-11T16:08:09.787 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/32 file after the snapshot 2020-02-11T16:08:09.787 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/33 file after the snapshot 2020-02-11T16:08:09.788 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/34 file after the snapshot 2020-02-11T16:08:09.790 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/35 file after the snapshot 2020-02-11T16:08:09.791 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/36 file after the snapshot 2020-02-11T16:08:09.794 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/37 file after the snapshot 2020-02-11T16:08:09.796 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/38 file after the snapshot 2020-02-11T16:08:09.798 INFO:tasks.workunit.client.0.smithi088.stdout: create 126/39 file after the snapshot 2020-02-11T16:08:09.799 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/.snap/snap-subdir-test 2020-02-11T16:08:09.821 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/30 file after the snapshot 2020-02-11T16:08:09.823 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/31 file after the snapshot 2020-02-11T16:08:09.824 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/32 file after the snapshot 2020-02-11T16:08:09.826 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/33 file after the snapshot 2020-02-11T16:08:09.828 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/34 file after the snapshot 2020-02-11T16:08:09.830 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/35 file after the snapshot 2020-02-11T16:08:09.832 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/36 file after the snapshot 2020-02-11T16:08:09.834 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/37 file after the snapshot 2020-02-11T16:08:09.836 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/38 file after the snapshot 2020-02-11T16:08:09.838 INFO:tasks.workunit.client.0.smithi088.stdout: create 127/39 file after the snapshot 2020-02-11T16:08:09.841 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/.snap/snap-subdir-test 2020-02-11T16:08:09.875 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/30 file after the snapshot 2020-02-11T16:08:09.876 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/31 file after the snapshot 2020-02-11T16:08:09.876 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/32 file after the snapshot 2020-02-11T16:08:09.876 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/33 file after the snapshot 2020-02-11T16:08:09.876 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/34 file after the snapshot 2020-02-11T16:08:09.877 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/35 file after the snapshot 2020-02-11T16:08:09.877 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/36 file after the snapshot 2020-02-11T16:08:09.877 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/37 file after the snapshot 2020-02-11T16:08:09.878 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/38 file after the snapshot 2020-02-11T16:08:09.878 INFO:tasks.workunit.client.0.smithi088.stdout: create 128/39 file after the snapshot 2020-02-11T16:08:09.880 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/.snap/snap-subdir-test 2020-02-11T16:08:09.902 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/30 file after the snapshot 2020-02-11T16:08:09.903 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/31 file after the snapshot 2020-02-11T16:08:09.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/32 file after the snapshot 2020-02-11T16:08:09.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/33 file after the snapshot 2020-02-11T16:08:09.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/34 file after the snapshot 2020-02-11T16:08:09.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/35 file after the snapshot 2020-02-11T16:08:09.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/36 file after the snapshot 2020-02-11T16:08:09.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/37 file after the snapshot 2020-02-11T16:08:09.924 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/38 file after the snapshot 2020-02-11T16:08:09.924 INFO:tasks.workunit.client.0.smithi088.stdout: create 129/39 file after the snapshot 2020-02-11T16:08:09.924 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/.snap/snap-subdir-test 2020-02-11T16:08:09.942 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/30 file after the snapshot 2020-02-11T16:08:09.943 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/31 file after the snapshot 2020-02-11T16:08:09.945 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/32 file after the snapshot 2020-02-11T16:08:09.947 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/33 file after the snapshot 2020-02-11T16:08:09.949 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/34 file after the snapshot 2020-02-11T16:08:09.951 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/35 file after the snapshot 2020-02-11T16:08:09.953 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/36 file after the snapshot 2020-02-11T16:08:09.955 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/37 file after the snapshot 2020-02-11T16:08:09.956 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/38 file after the snapshot 2020-02-11T16:08:09.958 INFO:tasks.workunit.client.0.smithi088.stdout: create 130/39 file after the snapshot 2020-02-11T16:08:09.960 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/.snap/snap-subdir-test 2020-02-11T16:08:09.992 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/30 file after the snapshot 2020-02-11T16:08:09.994 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/31 file after the snapshot 2020-02-11T16:08:09.996 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/32 file after the snapshot 2020-02-11T16:08:09.998 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/33 file after the snapshot 2020-02-11T16:08:10.000 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/34 file after the snapshot 2020-02-11T16:08:10.002 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/35 file after the snapshot 2020-02-11T16:08:10.003 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/36 file after the snapshot 2020-02-11T16:08:10.005 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/37 file after the snapshot 2020-02-11T16:08:10.007 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/38 file after the snapshot 2020-02-11T16:08:10.009 INFO:tasks.workunit.client.0.smithi088.stdout: create 131/39 file after the snapshot 2020-02-11T16:08:10.011 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/.snap/snap-subdir-test 2020-02-11T16:08:10.032 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/30 file after the snapshot 2020-02-11T16:08:10.034 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/31 file after the snapshot 2020-02-11T16:08:10.036 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/32 file after the snapshot 2020-02-11T16:08:10.038 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/33 file after the snapshot 2020-02-11T16:08:10.040 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/34 file after the snapshot 2020-02-11T16:08:10.041 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/35 file after the snapshot 2020-02-11T16:08:10.046 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/36 file after the snapshot 2020-02-11T16:08:10.046 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/37 file after the snapshot 2020-02-11T16:08:10.048 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/38 file after the snapshot 2020-02-11T16:08:10.050 INFO:tasks.workunit.client.0.smithi088.stdout: create 132/39 file after the snapshot 2020-02-11T16:08:10.051 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/.snap/snap-subdir-test 2020-02-11T16:08:10.072 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/30 file after the snapshot 2020-02-11T16:08:10.073 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/31 file after the snapshot 2020-02-11T16:08:10.075 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/32 file after the snapshot 2020-02-11T16:08:10.077 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/33 file after the snapshot 2020-02-11T16:08:10.079 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/34 file after the snapshot 2020-02-11T16:08:10.081 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/35 file after the snapshot 2020-02-11T16:08:10.093 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/36 file after the snapshot 2020-02-11T16:08:10.094 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/37 file after the snapshot 2020-02-11T16:08:10.094 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/38 file after the snapshot 2020-02-11T16:08:10.094 INFO:tasks.workunit.client.0.smithi088.stdout: create 133/39 file after the snapshot 2020-02-11T16:08:10.094 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/.snap/snap-subdir-test 2020-02-11T16:08:10.111 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/30 file after the snapshot 2020-02-11T16:08:10.113 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/31 file after the snapshot 2020-02-11T16:08:10.115 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/32 file after the snapshot 2020-02-11T16:08:10.117 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/33 file after the snapshot 2020-02-11T16:08:10.119 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/34 file after the snapshot 2020-02-11T16:08:10.121 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/35 file after the snapshot 2020-02-11T16:08:10.123 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/36 file after the snapshot 2020-02-11T16:08:10.125 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/37 file after the snapshot 2020-02-11T16:08:10.127 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/38 file after the snapshot 2020-02-11T16:08:10.129 INFO:tasks.workunit.client.0.smithi088.stdout: create 134/39 file after the snapshot 2020-02-11T16:08:10.131 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/.snap/snap-subdir-test 2020-02-11T16:08:10.153 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/30 file after the snapshot 2020-02-11T16:08:10.155 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/31 file after the snapshot 2020-02-11T16:08:10.157 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/32 file after the snapshot 2020-02-11T16:08:10.158 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/33 file after the snapshot 2020-02-11T16:08:10.160 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/34 file after the snapshot 2020-02-11T16:08:10.163 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/35 file after the snapshot 2020-02-11T16:08:10.164 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/36 file after the snapshot 2020-02-11T16:08:10.166 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/37 file after the snapshot 2020-02-11T16:08:10.168 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/38 file after the snapshot 2020-02-11T16:08:10.170 INFO:tasks.workunit.client.0.smithi088.stdout: create 135/39 file after the snapshot 2020-02-11T16:08:10.173 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/.snap/snap-subdir-test 2020-02-11T16:08:10.195 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/30 file after the snapshot 2020-02-11T16:08:10.197 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/31 file after the snapshot 2020-02-11T16:08:10.199 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/32 file after the snapshot 2020-02-11T16:08:10.201 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/33 file after the snapshot 2020-02-11T16:08:10.203 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/34 file after the snapshot 2020-02-11T16:08:10.205 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/35 file after the snapshot 2020-02-11T16:08:10.207 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/36 file after the snapshot 2020-02-11T16:08:10.209 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/37 file after the snapshot 2020-02-11T16:08:10.211 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/38 file after the snapshot 2020-02-11T16:08:10.213 INFO:tasks.workunit.client.0.smithi088.stdout: create 136/39 file after the snapshot 2020-02-11T16:08:10.215 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/.snap/snap-subdir-test 2020-02-11T16:08:10.236 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/30 file after the snapshot 2020-02-11T16:08:10.238 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/31 file after the snapshot 2020-02-11T16:08:10.239 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/32 file after the snapshot 2020-02-11T16:08:10.241 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/33 file after the snapshot 2020-02-11T16:08:10.243 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/34 file after the snapshot 2020-02-11T16:08:10.245 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/35 file after the snapshot 2020-02-11T16:08:10.247 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/36 file after the snapshot 2020-02-11T16:08:10.249 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/37 file after the snapshot 2020-02-11T16:08:10.251 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/38 file after the snapshot 2020-02-11T16:08:10.253 INFO:tasks.workunit.client.0.smithi088.stdout: create 137/39 file after the snapshot 2020-02-11T16:08:10.255 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/.snap/snap-subdir-test 2020-02-11T16:08:10.276 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/30 file after the snapshot 2020-02-11T16:08:10.278 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/31 file after the snapshot 2020-02-11T16:08:10.279 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/32 file after the snapshot 2020-02-11T16:08:10.281 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/33 file after the snapshot 2020-02-11T16:08:10.283 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/34 file after the snapshot 2020-02-11T16:08:10.285 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/35 file after the snapshot 2020-02-11T16:08:10.287 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/36 file after the snapshot 2020-02-11T16:08:10.289 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/37 file after the snapshot 2020-02-11T16:08:10.291 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/38 file after the snapshot 2020-02-11T16:08:10.293 INFO:tasks.workunit.client.0.smithi088.stdout: create 138/39 file after the snapshot 2020-02-11T16:08:10.295 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/.snap/snap-subdir-test 2020-02-11T16:08:10.316 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/30 file after the snapshot 2020-02-11T16:08:10.317 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/31 file after the snapshot 2020-02-11T16:08:10.319 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/32 file after the snapshot 2020-02-11T16:08:10.321 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/33 file after the snapshot 2020-02-11T16:08:10.323 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/34 file after the snapshot 2020-02-11T16:08:10.325 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/35 file after the snapshot 2020-02-11T16:08:10.326 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/36 file after the snapshot 2020-02-11T16:08:10.328 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/37 file after the snapshot 2020-02-11T16:08:10.330 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/38 file after the snapshot 2020-02-11T16:08:10.332 INFO:tasks.workunit.client.0.smithi088.stdout: create 139/39 file after the snapshot 2020-02-11T16:08:10.334 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/.snap/snap-subdir-test 2020-02-11T16:08:10.354 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/30 file after the snapshot 2020-02-11T16:08:10.355 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/31 file after the snapshot 2020-02-11T16:08:10.357 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/32 file after the snapshot 2020-02-11T16:08:10.359 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/33 file after the snapshot 2020-02-11T16:08:10.361 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/34 file after the snapshot 2020-02-11T16:08:10.363 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/35 file after the snapshot 2020-02-11T16:08:10.365 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/36 file after the snapshot 2020-02-11T16:08:10.367 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/37 file after the snapshot 2020-02-11T16:08:10.369 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/38 file after the snapshot 2020-02-11T16:08:10.372 INFO:tasks.workunit.client.0.smithi088.stdout: create 140/39 file after the snapshot 2020-02-11T16:08:10.373 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/.snap/snap-subdir-test 2020-02-11T16:08:10.393 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/30 file after the snapshot 2020-02-11T16:08:10.395 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/31 file after the snapshot 2020-02-11T16:08:10.397 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/32 file after the snapshot 2020-02-11T16:08:10.399 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/33 file after the snapshot 2020-02-11T16:08:10.401 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/34 file after the snapshot 2020-02-11T16:08:10.403 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/35 file after the snapshot 2020-02-11T16:08:10.405 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/36 file after the snapshot 2020-02-11T16:08:10.407 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/37 file after the snapshot 2020-02-11T16:08:10.409 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/38 file after the snapshot 2020-02-11T16:08:10.411 INFO:tasks.workunit.client.0.smithi088.stdout: create 141/39 file after the snapshot 2020-02-11T16:08:10.413 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/.snap/snap-subdir-test 2020-02-11T16:08:10.444 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/30 file after the snapshot 2020-02-11T16:08:10.445 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/31 file after the snapshot 2020-02-11T16:08:10.447 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/32 file after the snapshot 2020-02-11T16:08:10.449 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/33 file after the snapshot 2020-02-11T16:08:10.451 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/34 file after the snapshot 2020-02-11T16:08:10.453 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/35 file after the snapshot 2020-02-11T16:08:10.455 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/36 file after the snapshot 2020-02-11T16:08:10.456 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/37 file after the snapshot 2020-02-11T16:08:10.458 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/38 file after the snapshot 2020-02-11T16:08:10.460 INFO:tasks.workunit.client.0.smithi088.stdout: create 142/39 file after the snapshot 2020-02-11T16:08:10.462 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/.snap/snap-subdir-test 2020-02-11T16:08:10.486 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/30 file after the snapshot 2020-02-11T16:08:10.488 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/31 file after the snapshot 2020-02-11T16:08:10.490 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/32 file after the snapshot 2020-02-11T16:08:10.491 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/33 file after the snapshot 2020-02-11T16:08:10.493 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/34 file after the snapshot 2020-02-11T16:08:10.495 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/35 file after the snapshot 2020-02-11T16:08:10.498 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/36 file after the snapshot 2020-02-11T16:08:10.499 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/37 file after the snapshot 2020-02-11T16:08:10.501 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/38 file after the snapshot 2020-02-11T16:08:10.507 INFO:tasks.workunit.client.0.smithi088.stdout: create 143/39 file after the snapshot 2020-02-11T16:08:10.508 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/.snap/snap-subdir-test 2020-02-11T16:08:10.526 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/30 file after the snapshot 2020-02-11T16:08:10.527 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/31 file after the snapshot 2020-02-11T16:08:10.529 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/32 file after the snapshot 2020-02-11T16:08:10.531 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/33 file after the snapshot 2020-02-11T16:08:10.534 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/34 file after the snapshot 2020-02-11T16:08:10.535 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/35 file after the snapshot 2020-02-11T16:08:10.537 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/36 file after the snapshot 2020-02-11T16:08:10.539 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/37 file after the snapshot 2020-02-11T16:08:10.541 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/38 file after the snapshot 2020-02-11T16:08:10.542 INFO:tasks.workunit.client.0.smithi088.stdout: create 144/39 file after the snapshot 2020-02-11T16:08:10.545 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/.snap/snap-subdir-test 2020-02-11T16:08:10.565 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/30 file after the snapshot 2020-02-11T16:08:10.566 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/31 file after the snapshot 2020-02-11T16:08:10.568 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/32 file after the snapshot 2020-02-11T16:08:10.570 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/33 file after the snapshot 2020-02-11T16:08:10.572 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/34 file after the snapshot 2020-02-11T16:08:10.574 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/35 file after the snapshot 2020-02-11T16:08:10.575 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/36 file after the snapshot 2020-02-11T16:08:10.578 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/37 file after the snapshot 2020-02-11T16:08:10.581 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/38 file after the snapshot 2020-02-11T16:08:10.581 INFO:tasks.workunit.client.0.smithi088.stdout: create 145/39 file after the snapshot 2020-02-11T16:08:10.583 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/.snap/snap-subdir-test 2020-02-11T16:08:10.603 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/30 file after the snapshot 2020-02-11T16:08:10.605 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/31 file after the snapshot 2020-02-11T16:08:10.606 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/32 file after the snapshot 2020-02-11T16:08:10.608 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/33 file after the snapshot 2020-02-11T16:08:10.610 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/34 file after the snapshot 2020-02-11T16:08:10.612 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/35 file after the snapshot 2020-02-11T16:08:10.614 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/36 file after the snapshot 2020-02-11T16:08:10.616 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/37 file after the snapshot 2020-02-11T16:08:10.619 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/38 file after the snapshot 2020-02-11T16:08:10.621 INFO:tasks.workunit.client.0.smithi088.stdout: create 146/39 file after the snapshot 2020-02-11T16:08:10.623 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/.snap/snap-subdir-test 2020-02-11T16:08:10.643 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/30 file after the snapshot 2020-02-11T16:08:10.644 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/31 file after the snapshot 2020-02-11T16:08:10.646 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/32 file after the snapshot 2020-02-11T16:08:10.648 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/33 file after the snapshot 2020-02-11T16:08:10.650 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/34 file after the snapshot 2020-02-11T16:08:10.652 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/35 file after the snapshot 2020-02-11T16:08:10.654 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/36 file after the snapshot 2020-02-11T16:08:10.656 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/37 file after the snapshot 2020-02-11T16:08:10.658 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/38 file after the snapshot 2020-02-11T16:08:10.660 INFO:tasks.workunit.client.0.smithi088.stdout: create 147/39 file after the snapshot 2020-02-11T16:08:10.661 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/.snap/snap-subdir-test 2020-02-11T16:08:10.683 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/30 file after the snapshot 2020-02-11T16:08:10.684 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/31 file after the snapshot 2020-02-11T16:08:10.686 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/32 file after the snapshot 2020-02-11T16:08:10.688 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/33 file after the snapshot 2020-02-11T16:08:10.690 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/34 file after the snapshot 2020-02-11T16:08:10.692 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/35 file after the snapshot 2020-02-11T16:08:10.694 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/36 file after the snapshot 2020-02-11T16:08:10.696 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/37 file after the snapshot 2020-02-11T16:08:10.706 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/38 file after the snapshot 2020-02-11T16:08:10.706 INFO:tasks.workunit.client.0.smithi088.stdout: create 148/39 file after the snapshot 2020-02-11T16:08:10.706 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/.snap/snap-subdir-test 2020-02-11T16:08:10.730 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/30 file after the snapshot 2020-02-11T16:08:10.731 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/31 file after the snapshot 2020-02-11T16:08:10.733 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/32 file after the snapshot 2020-02-11T16:08:10.735 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/33 file after the snapshot 2020-02-11T16:08:10.737 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/34 file after the snapshot 2020-02-11T16:08:10.744 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/35 file after the snapshot 2020-02-11T16:08:10.744 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/36 file after the snapshot 2020-02-11T16:08:10.745 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/37 file after the snapshot 2020-02-11T16:08:10.745 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/38 file after the snapshot 2020-02-11T16:08:10.746 INFO:tasks.workunit.client.0.smithi088.stdout: create 149/39 file after the snapshot 2020-02-11T16:08:10.748 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/.snap/snap-subdir-test 2020-02-11T16:08:10.769 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/30 file after the snapshot 2020-02-11T16:08:10.770 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/31 file after the snapshot 2020-02-11T16:08:10.772 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/32 file after the snapshot 2020-02-11T16:08:10.774 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/33 file after the snapshot 2020-02-11T16:08:10.776 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/34 file after the snapshot 2020-02-11T16:08:10.778 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/35 file after the snapshot 2020-02-11T16:08:10.780 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/36 file after the snapshot 2020-02-11T16:08:10.782 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/37 file after the snapshot 2020-02-11T16:08:10.784 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/38 file after the snapshot 2020-02-11T16:08:10.786 INFO:tasks.workunit.client.0.smithi088.stdout: create 150/39 file after the snapshot 2020-02-11T16:08:10.788 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/.snap/snap-subdir-test 2020-02-11T16:08:10.808 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/30 file after the snapshot 2020-02-11T16:08:10.810 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/31 file after the snapshot 2020-02-11T16:08:10.812 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/32 file after the snapshot 2020-02-11T16:08:10.813 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/33 file after the snapshot 2020-02-11T16:08:10.815 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/34 file after the snapshot 2020-02-11T16:08:10.817 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/35 file after the snapshot 2020-02-11T16:08:10.819 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/36 file after the snapshot 2020-02-11T16:08:10.821 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/37 file after the snapshot 2020-02-11T16:08:10.823 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/38 file after the snapshot 2020-02-11T16:08:10.825 INFO:tasks.workunit.client.0.smithi088.stdout: create 151/39 file after the snapshot 2020-02-11T16:08:10.826 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/.snap/snap-subdir-test 2020-02-11T16:08:10.847 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/30 file after the snapshot 2020-02-11T16:08:10.853 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/31 file after the snapshot 2020-02-11T16:08:10.853 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/32 file after the snapshot 2020-02-11T16:08:10.853 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/33 file after the snapshot 2020-02-11T16:08:10.854 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/34 file after the snapshot 2020-02-11T16:08:10.856 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/35 file after the snapshot 2020-02-11T16:08:10.858 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/36 file after the snapshot 2020-02-11T16:08:10.860 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/37 file after the snapshot 2020-02-11T16:08:10.863 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/38 file after the snapshot 2020-02-11T16:08:10.864 INFO:tasks.workunit.client.0.smithi088.stdout: create 152/39 file after the snapshot 2020-02-11T16:08:10.866 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/.snap/snap-subdir-test 2020-02-11T16:08:10.887 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/30 file after the snapshot 2020-02-11T16:08:10.888 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/31 file after the snapshot 2020-02-11T16:08:10.891 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/32 file after the snapshot 2020-02-11T16:08:10.893 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/33 file after the snapshot 2020-02-11T16:08:10.895 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/34 file after the snapshot 2020-02-11T16:08:10.896 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/35 file after the snapshot 2020-02-11T16:08:10.898 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/36 file after the snapshot 2020-02-11T16:08:10.900 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/37 file after the snapshot 2020-02-11T16:08:10.902 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/38 file after the snapshot 2020-02-11T16:08:10.904 INFO:tasks.workunit.client.0.smithi088.stdout: create 153/39 file after the snapshot 2020-02-11T16:08:10.907 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/.snap/snap-subdir-test 2020-02-11T16:08:10.928 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/30 file after the snapshot 2020-02-11T16:08:10.930 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/31 file after the snapshot 2020-02-11T16:08:10.932 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/32 file after the snapshot 2020-02-11T16:08:10.934 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/33 file after the snapshot 2020-02-11T16:08:10.936 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/34 file after the snapshot 2020-02-11T16:08:10.938 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/35 file after the snapshot 2020-02-11T16:08:10.940 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/36 file after the snapshot 2020-02-11T16:08:10.942 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/37 file after the snapshot 2020-02-11T16:08:10.944 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/38 file after the snapshot 2020-02-11T16:08:10.946 INFO:tasks.workunit.client.0.smithi088.stdout: create 154/39 file after the snapshot 2020-02-11T16:08:10.948 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/.snap/snap-subdir-test 2020-02-11T16:08:10.968 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/30 file after the snapshot 2020-02-11T16:08:10.970 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/31 file after the snapshot 2020-02-11T16:08:10.971 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/32 file after the snapshot 2020-02-11T16:08:10.974 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/33 file after the snapshot 2020-02-11T16:08:10.975 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/34 file after the snapshot 2020-02-11T16:08:10.977 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/35 file after the snapshot 2020-02-11T16:08:10.994 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/36 file after the snapshot 2020-02-11T16:08:10.995 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/37 file after the snapshot 2020-02-11T16:08:10.995 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/38 file after the snapshot 2020-02-11T16:08:10.995 INFO:tasks.workunit.client.0.smithi088.stdout: create 155/39 file after the snapshot 2020-02-11T16:08:10.995 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/.snap/snap-subdir-test 2020-02-11T16:08:11.008 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/30 file after the snapshot 2020-02-11T16:08:11.009 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/31 file after the snapshot 2020-02-11T16:08:11.011 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/32 file after the snapshot 2020-02-11T16:08:11.018 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/33 file after the snapshot 2020-02-11T16:08:11.018 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/34 file after the snapshot 2020-02-11T16:08:11.018 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/35 file after the snapshot 2020-02-11T16:08:11.019 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/36 file after the snapshot 2020-02-11T16:08:11.021 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/37 file after the snapshot 2020-02-11T16:08:11.023 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/38 file after the snapshot 2020-02-11T16:08:11.025 INFO:tasks.workunit.client.0.smithi088.stdout: create 156/39 file after the snapshot 2020-02-11T16:08:11.027 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/.snap/snap-subdir-test 2020-02-11T16:08:11.047 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/30 file after the snapshot 2020-02-11T16:08:11.049 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/31 file after the snapshot 2020-02-11T16:08:11.050 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/32 file after the snapshot 2020-02-11T16:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/33 file after the snapshot 2020-02-11T16:08:11.055 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/34 file after the snapshot 2020-02-11T16:08:11.058 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/35 file after the snapshot 2020-02-11T16:08:11.059 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/36 file after the snapshot 2020-02-11T16:08:11.060 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/37 file after the snapshot 2020-02-11T16:08:11.062 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/38 file after the snapshot 2020-02-11T16:08:11.064 INFO:tasks.workunit.client.0.smithi088.stdout: create 157/39 file after the snapshot 2020-02-11T16:08:11.066 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/.snap/snap-subdir-test 2020-02-11T16:08:11.087 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/30 file after the snapshot 2020-02-11T16:08:11.088 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/31 file after the snapshot 2020-02-11T16:08:11.090 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/32 file after the snapshot 2020-02-11T16:08:11.092 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/33 file after the snapshot 2020-02-11T16:08:11.093 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/34 file after the snapshot 2020-02-11T16:08:11.095 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/35 file after the snapshot 2020-02-11T16:08:11.097 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/36 file after the snapshot 2020-02-11T16:08:11.099 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/37 file after the snapshot 2020-02-11T16:08:11.101 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/38 file after the snapshot 2020-02-11T16:08:11.103 INFO:tasks.workunit.client.0.smithi088.stdout: create 158/39 file after the snapshot 2020-02-11T16:08:11.105 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/.snap/snap-subdir-test 2020-02-11T16:08:11.126 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/30 file after the snapshot 2020-02-11T16:08:11.127 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/31 file after the snapshot 2020-02-11T16:08:11.129 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/32 file after the snapshot 2020-02-11T16:08:11.130 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/33 file after the snapshot 2020-02-11T16:08:11.133 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/34 file after the snapshot 2020-02-11T16:08:11.134 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/35 file after the snapshot 2020-02-11T16:08:11.137 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/36 file after the snapshot 2020-02-11T16:08:11.138 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/37 file after the snapshot 2020-02-11T16:08:11.140 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/38 file after the snapshot 2020-02-11T16:08:11.142 INFO:tasks.workunit.client.0.smithi088.stdout: create 159/39 file after the snapshot 2020-02-11T16:08:11.144 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/.snap/snap-subdir-test 2020-02-11T16:08:11.164 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/30 file after the snapshot 2020-02-11T16:08:11.166 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/31 file after the snapshot 2020-02-11T16:08:11.167 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/32 file after the snapshot 2020-02-11T16:08:11.169 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/33 file after the snapshot 2020-02-11T16:08:11.171 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/34 file after the snapshot 2020-02-11T16:08:11.173 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/35 file after the snapshot 2020-02-11T16:08:11.175 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/36 file after the snapshot 2020-02-11T16:08:11.177 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/37 file after the snapshot 2020-02-11T16:08:11.179 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/38 file after the snapshot 2020-02-11T16:08:11.180 INFO:tasks.workunit.client.0.smithi088.stdout: create 160/39 file after the snapshot 2020-02-11T16:08:11.182 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/.snap/snap-subdir-test 2020-02-11T16:08:11.202 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/30 file after the snapshot 2020-02-11T16:08:11.205 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/31 file after the snapshot 2020-02-11T16:08:11.206 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/32 file after the snapshot 2020-02-11T16:08:11.209 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/33 file after the snapshot 2020-02-11T16:08:11.211 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/34 file after the snapshot 2020-02-11T16:08:11.212 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/35 file after the snapshot 2020-02-11T16:08:11.214 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/36 file after the snapshot 2020-02-11T16:08:11.216 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/37 file after the snapshot 2020-02-11T16:08:11.218 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/38 file after the snapshot 2020-02-11T16:08:11.223 INFO:tasks.workunit.client.0.smithi088.stdout: create 161/39 file after the snapshot 2020-02-11T16:08:11.223 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/.snap/snap-subdir-test 2020-02-11T16:08:11.241 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/30 file after the snapshot 2020-02-11T16:08:11.243 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/31 file after the snapshot 2020-02-11T16:08:11.245 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/32 file after the snapshot 2020-02-11T16:08:11.247 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/33 file after the snapshot 2020-02-11T16:08:11.249 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/34 file after the snapshot 2020-02-11T16:08:11.250 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/35 file after the snapshot 2020-02-11T16:08:11.254 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/36 file after the snapshot 2020-02-11T16:08:11.254 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/37 file after the snapshot 2020-02-11T16:08:11.256 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/38 file after the snapshot 2020-02-11T16:08:11.258 INFO:tasks.workunit.client.0.smithi088.stdout: create 162/39 file after the snapshot 2020-02-11T16:08:11.260 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/.snap/snap-subdir-test 2020-02-11T16:08:11.280 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/30 file after the snapshot 2020-02-11T16:08:11.282 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/31 file after the snapshot 2020-02-11T16:08:11.284 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/32 file after the snapshot 2020-02-11T16:08:11.286 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/33 file after the snapshot 2020-02-11T16:08:11.289 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/34 file after the snapshot 2020-02-11T16:08:11.291 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/35 file after the snapshot 2020-02-11T16:08:11.293 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/36 file after the snapshot 2020-02-11T16:08:11.294 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/37 file after the snapshot 2020-02-11T16:08:11.297 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/38 file after the snapshot 2020-02-11T16:08:11.298 INFO:tasks.workunit.client.0.smithi088.stdout: create 163/39 file after the snapshot 2020-02-11T16:08:11.300 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/.snap/snap-subdir-test 2020-02-11T16:08:11.320 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/30 file after the snapshot 2020-02-11T16:08:11.321 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/31 file after the snapshot 2020-02-11T16:08:11.325 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/32 file after the snapshot 2020-02-11T16:08:11.326 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/33 file after the snapshot 2020-02-11T16:08:11.327 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/34 file after the snapshot 2020-02-11T16:08:11.329 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/35 file after the snapshot 2020-02-11T16:08:11.331 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/36 file after the snapshot 2020-02-11T16:08:11.334 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/37 file after the snapshot 2020-02-11T16:08:11.335 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/38 file after the snapshot 2020-02-11T16:08:11.337 INFO:tasks.workunit.client.0.smithi088.stdout: create 164/39 file after the snapshot 2020-02-11T16:08:11.338 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/.snap/snap-subdir-test 2020-02-11T16:08:11.357 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/30 file after the snapshot 2020-02-11T16:08:11.359 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/31 file after the snapshot 2020-02-11T16:08:11.360 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/32 file after the snapshot 2020-02-11T16:08:11.363 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/33 file after the snapshot 2020-02-11T16:08:11.365 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/34 file after the snapshot 2020-02-11T16:08:11.366 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/35 file after the snapshot 2020-02-11T16:08:11.368 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/36 file after the snapshot 2020-02-11T16:08:11.370 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/37 file after the snapshot 2020-02-11T16:08:11.372 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/38 file after the snapshot 2020-02-11T16:08:11.374 INFO:tasks.workunit.client.0.smithi088.stdout: create 165/39 file after the snapshot 2020-02-11T16:08:11.376 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/.snap/snap-subdir-test 2020-02-11T16:08:11.395 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/30 file after the snapshot 2020-02-11T16:08:11.397 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/31 file after the snapshot 2020-02-11T16:08:11.399 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/32 file after the snapshot 2020-02-11T16:08:11.401 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/33 file after the snapshot 2020-02-11T16:08:11.402 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/34 file after the snapshot 2020-02-11T16:08:11.404 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/35 file after the snapshot 2020-02-11T16:08:11.406 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/36 file after the snapshot 2020-02-11T16:08:11.408 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/37 file after the snapshot 2020-02-11T16:08:11.410 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/38 file after the snapshot 2020-02-11T16:08:11.412 INFO:tasks.workunit.client.0.smithi088.stdout: create 166/39 file after the snapshot 2020-02-11T16:08:11.414 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/.snap/snap-subdir-test 2020-02-11T16:08:11.434 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/30 file after the snapshot 2020-02-11T16:08:11.436 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/31 file after the snapshot 2020-02-11T16:08:11.437 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/32 file after the snapshot 2020-02-11T16:08:11.439 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/33 file after the snapshot 2020-02-11T16:08:11.442 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/34 file after the snapshot 2020-02-11T16:08:11.444 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/35 file after the snapshot 2020-02-11T16:08:11.446 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/36 file after the snapshot 2020-02-11T16:08:11.448 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/37 file after the snapshot 2020-02-11T16:08:11.450 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/38 file after the snapshot 2020-02-11T16:08:11.451 INFO:tasks.workunit.client.0.smithi088.stdout: create 167/39 file after the snapshot 2020-02-11T16:08:11.453 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/.snap/snap-subdir-test 2020-02-11T16:08:11.473 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/30 file after the snapshot 2020-02-11T16:08:11.479 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/31 file after the snapshot 2020-02-11T16:08:11.479 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/32 file after the snapshot 2020-02-11T16:08:11.479 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/33 file after the snapshot 2020-02-11T16:08:11.480 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/34 file after the snapshot 2020-02-11T16:08:11.481 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/35 file after the snapshot 2020-02-11T16:08:11.483 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/36 file after the snapshot 2020-02-11T16:08:11.485 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/37 file after the snapshot 2020-02-11T16:08:11.487 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/38 file after the snapshot 2020-02-11T16:08:11.494 INFO:tasks.workunit.client.0.smithi088.stdout: create 168/39 file after the snapshot 2020-02-11T16:08:11.494 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/.snap/snap-subdir-test 2020-02-11T16:08:11.510 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/30 file after the snapshot 2020-02-11T16:08:11.512 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/31 file after the snapshot 2020-02-11T16:08:11.513 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/32 file after the snapshot 2020-02-11T16:08:11.515 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/33 file after the snapshot 2020-02-11T16:08:11.517 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/34 file after the snapshot 2020-02-11T16:08:11.519 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/35 file after the snapshot 2020-02-11T16:08:11.521 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/36 file after the snapshot 2020-02-11T16:08:11.523 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/37 file after the snapshot 2020-02-11T16:08:11.525 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/38 file after the snapshot 2020-02-11T16:08:11.527 INFO:tasks.workunit.client.0.smithi088.stdout: create 169/39 file after the snapshot 2020-02-11T16:08:11.529 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/.snap/snap-subdir-test 2020-02-11T16:08:11.550 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/30 file after the snapshot 2020-02-11T16:08:11.552 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/31 file after the snapshot 2020-02-11T16:08:11.554 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/32 file after the snapshot 2020-02-11T16:08:11.556 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/33 file after the snapshot 2020-02-11T16:08:11.557 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/34 file after the snapshot 2020-02-11T16:08:11.559 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/35 file after the snapshot 2020-02-11T16:08:11.561 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/36 file after the snapshot 2020-02-11T16:08:11.563 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/37 file after the snapshot 2020-02-11T16:08:11.565 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/38 file after the snapshot 2020-02-11T16:08:11.567 INFO:tasks.workunit.client.0.smithi088.stdout: create 170/39 file after the snapshot 2020-02-11T16:08:11.569 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/.snap/snap-subdir-test 2020-02-11T16:08:11.588 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/30 file after the snapshot 2020-02-11T16:08:11.590 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/31 file after the snapshot 2020-02-11T16:08:11.591 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/32 file after the snapshot 2020-02-11T16:08:11.593 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/33 file after the snapshot 2020-02-11T16:08:11.595 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/34 file after the snapshot 2020-02-11T16:08:11.597 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/35 file after the snapshot 2020-02-11T16:08:11.599 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/36 file after the snapshot 2020-02-11T16:08:11.601 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/37 file after the snapshot 2020-02-11T16:08:11.602 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/38 file after the snapshot 2020-02-11T16:08:11.604 INFO:tasks.workunit.client.0.smithi088.stdout: create 171/39 file after the snapshot 2020-02-11T16:08:11.606 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/.snap/snap-subdir-test 2020-02-11T16:08:11.625 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/30 file after the snapshot 2020-02-11T16:08:11.626 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/31 file after the snapshot 2020-02-11T16:08:11.628 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/32 file after the snapshot 2020-02-11T16:08:11.630 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/33 file after the snapshot 2020-02-11T16:08:11.632 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/34 file after the snapshot 2020-02-11T16:08:11.634 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/35 file after the snapshot 2020-02-11T16:08:11.639 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/36 file after the snapshot 2020-02-11T16:08:11.639 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/37 file after the snapshot 2020-02-11T16:08:11.640 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/38 file after the snapshot 2020-02-11T16:08:11.645 INFO:tasks.workunit.client.0.smithi088.stdout: create 172/39 file after the snapshot 2020-02-11T16:08:11.645 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/.snap/snap-subdir-test 2020-02-11T16:08:11.662 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/30 file after the snapshot 2020-02-11T16:08:11.664 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/31 file after the snapshot 2020-02-11T16:08:11.667 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/32 file after the snapshot 2020-02-11T16:08:11.668 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/33 file after the snapshot 2020-02-11T16:08:11.671 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/34 file after the snapshot 2020-02-11T16:08:11.672 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/35 file after the snapshot 2020-02-11T16:08:11.674 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/36 file after the snapshot 2020-02-11T16:08:11.676 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/37 file after the snapshot 2020-02-11T16:08:11.678 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/38 file after the snapshot 2020-02-11T16:08:11.679 INFO:tasks.workunit.client.0.smithi088.stdout: create 173/39 file after the snapshot 2020-02-11T16:08:11.681 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/.snap/snap-subdir-test 2020-02-11T16:08:11.778 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/30 file after the snapshot 2020-02-11T16:08:11.790 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/31 file after the snapshot 2020-02-11T16:08:11.791 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/32 file after the snapshot 2020-02-11T16:08:11.794 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/33 file after the snapshot 2020-02-11T16:08:11.795 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/34 file after the snapshot 2020-02-11T16:08:11.797 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/35 file after the snapshot 2020-02-11T16:08:11.799 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/36 file after the snapshot 2020-02-11T16:08:11.801 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/37 file after the snapshot 2020-02-11T16:08:11.803 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/38 file after the snapshot 2020-02-11T16:08:11.805 INFO:tasks.workunit.client.0.smithi088.stdout: create 174/39 file after the snapshot 2020-02-11T16:08:11.807 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/.snap/snap-subdir-test 2020-02-11T16:08:11.834 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/30 file after the snapshot 2020-02-11T16:08:11.836 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/31 file after the snapshot 2020-02-11T16:08:11.838 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/32 file after the snapshot 2020-02-11T16:08:11.840 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/33 file after the snapshot 2020-02-11T16:08:11.841 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/34 file after the snapshot 2020-02-11T16:08:11.844 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/35 file after the snapshot 2020-02-11T16:08:11.846 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/36 file after the snapshot 2020-02-11T16:08:11.848 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/37 file after the snapshot 2020-02-11T16:08:11.850 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/38 file after the snapshot 2020-02-11T16:08:11.852 INFO:tasks.workunit.client.0.smithi088.stdout: create 175/39 file after the snapshot 2020-02-11T16:08:11.854 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/.snap/snap-subdir-test 2020-02-11T16:08:11.872 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/30 file after the snapshot 2020-02-11T16:08:11.874 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/31 file after the snapshot 2020-02-11T16:08:11.876 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/32 file after the snapshot 2020-02-11T16:08:11.878 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/33 file after the snapshot 2020-02-11T16:08:11.880 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/34 file after the snapshot 2020-02-11T16:08:11.882 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/35 file after the snapshot 2020-02-11T16:08:11.884 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/36 file after the snapshot 2020-02-11T16:08:11.886 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/37 file after the snapshot 2020-02-11T16:08:11.888 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/38 file after the snapshot 2020-02-11T16:08:11.889 INFO:tasks.workunit.client.0.smithi088.stdout: create 176/39 file after the snapshot 2020-02-11T16:08:11.891 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/.snap/snap-subdir-test 2020-02-11T16:08:11.910 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/30 file after the snapshot 2020-02-11T16:08:11.911 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/31 file after the snapshot 2020-02-11T16:08:11.913 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/32 file after the snapshot 2020-02-11T16:08:11.915 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/33 file after the snapshot 2020-02-11T16:08:11.917 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/34 file after the snapshot 2020-02-11T16:08:11.919 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/35 file after the snapshot 2020-02-11T16:08:11.921 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:08:11.921 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/36 file after the snapshot 2020-02-11T16:08:11.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/37 file after the snapshot 2020-02-11T16:08:11.924 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:08:11.926 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/38 file after the snapshot 2020-02-11T16:08:11.927 INFO:tasks.workunit.client.0.smithi088.stdout: create 177/39 file after the snapshot 2020-02-11T16:08:11.929 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/.snap/snap-subdir-test 2020-02-11T16:08:11.956 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/30 file after the snapshot 2020-02-11T16:08:11.957 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/31 file after the snapshot 2020-02-11T16:08:11.959 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/32 file after the snapshot 2020-02-11T16:08:11.961 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/33 file after the snapshot 2020-02-11T16:08:11.963 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/34 file after the snapshot 2020-02-11T16:08:11.964 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/35 file after the snapshot 2020-02-11T16:08:11.966 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/36 file after the snapshot 2020-02-11T16:08:11.969 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/37 file after the snapshot 2020-02-11T16:08:11.971 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/38 file after the snapshot 2020-02-11T16:08:11.973 INFO:tasks.workunit.client.0.smithi088.stdout: create 178/39 file after the snapshot 2020-02-11T16:08:11.974 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/.snap/snap-subdir-test 2020-02-11T16:08:11.994 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/30 file after the snapshot 2020-02-11T16:08:11.995 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/31 file after the snapshot 2020-02-11T16:08:11.997 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/32 file after the snapshot 2020-02-11T16:08:11.999 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/33 file after the snapshot 2020-02-11T16:08:12.001 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/34 file after the snapshot 2020-02-11T16:08:12.003 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/35 file after the snapshot 2020-02-11T16:08:12.004 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/36 file after the snapshot 2020-02-11T16:08:12.006 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/37 file after the snapshot 2020-02-11T16:08:12.008 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/38 file after the snapshot 2020-02-11T16:08:12.010 INFO:tasks.workunit.client.0.smithi088.stdout: create 179/39 file after the snapshot 2020-02-11T16:08:12.012 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/.snap/snap-subdir-test 2020-02-11T16:08:12.031 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/30 file after the snapshot 2020-02-11T16:08:12.032 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/31 file after the snapshot 2020-02-11T16:08:12.034 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/32 file after the snapshot 2020-02-11T16:08:12.036 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/33 file after the snapshot 2020-02-11T16:08:12.038 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/34 file after the snapshot 2020-02-11T16:08:12.040 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/35 file after the snapshot 2020-02-11T16:08:12.042 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/36 file after the snapshot 2020-02-11T16:08:12.044 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/37 file after the snapshot 2020-02-11T16:08:12.046 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/38 file after the snapshot 2020-02-11T16:08:12.048 INFO:tasks.workunit.client.0.smithi088.stdout: create 180/39 file after the snapshot 2020-02-11T16:08:12.049 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/.snap/snap-subdir-test 2020-02-11T16:08:12.070 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/30 file after the snapshot 2020-02-11T16:08:12.071 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/31 file after the snapshot 2020-02-11T16:08:12.073 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/32 file after the snapshot 2020-02-11T16:08:12.075 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/33 file after the snapshot 2020-02-11T16:08:12.077 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/34 file after the snapshot 2020-02-11T16:08:12.079 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/35 file after the snapshot 2020-02-11T16:08:12.081 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/36 file after the snapshot 2020-02-11T16:08:12.173 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/37 file after the snapshot 2020-02-11T16:08:12.174 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/38 file after the snapshot 2020-02-11T16:08:12.174 INFO:tasks.workunit.client.0.smithi088.stdout: create 181/39 file after the snapshot 2020-02-11T16:08:12.174 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/.snap/snap-subdir-test 2020-02-11T16:08:12.174 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/30 file after the snapshot 2020-02-11T16:08:12.174 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/31 file after the snapshot 2020-02-11T16:08:12.174 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/32 file after the snapshot 2020-02-11T16:08:12.175 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/33 file after the snapshot 2020-02-11T16:08:12.175 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/34 file after the snapshot 2020-02-11T16:08:12.175 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/35 file after the snapshot 2020-02-11T16:08:12.175 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/36 file after the snapshot 2020-02-11T16:08:12.175 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/37 file after the snapshot 2020-02-11T16:08:12.175 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/38 file after the snapshot 2020-02-11T16:08:12.175 INFO:tasks.workunit.client.0.smithi088.stdout: create 182/39 file after the snapshot 2020-02-11T16:08:12.175 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/.snap/snap-subdir-test 2020-02-11T16:08:12.176 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/30 file after the snapshot 2020-02-11T16:08:12.176 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/31 file after the snapshot 2020-02-11T16:08:12.176 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/32 file after the snapshot 2020-02-11T16:08:12.176 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/33 file after the snapshot 2020-02-11T16:08:12.176 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/34 file after the snapshot 2020-02-11T16:08:12.176 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/35 file after the snapshot 2020-02-11T16:08:12.176 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/36 file after the snapshot 2020-02-11T16:08:12.177 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/37 file after the snapshot 2020-02-11T16:08:12.177 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/38 file after the snapshot 2020-02-11T16:08:12.177 INFO:tasks.workunit.client.0.smithi088.stdout: create 183/39 file after the snapshot 2020-02-11T16:08:12.177 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/.snap/snap-subdir-test 2020-02-11T16:08:12.184 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/30 file after the snapshot 2020-02-11T16:08:12.185 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/31 file after the snapshot 2020-02-11T16:08:12.187 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/32 file after the snapshot 2020-02-11T16:08:12.189 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/33 file after the snapshot 2020-02-11T16:08:12.191 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/34 file after the snapshot 2020-02-11T16:08:12.193 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/35 file after the snapshot 2020-02-11T16:08:12.194 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/36 file after the snapshot 2020-02-11T16:08:12.198 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/37 file after the snapshot 2020-02-11T16:08:12.199 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/38 file after the snapshot 2020-02-11T16:08:12.201 INFO:tasks.workunit.client.0.smithi088.stdout: create 184/39 file after the snapshot 2020-02-11T16:08:12.203 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/.snap/snap-subdir-test 2020-02-11T16:08:12.222 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/30 file after the snapshot 2020-02-11T16:08:12.227 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/31 file after the snapshot 2020-02-11T16:08:12.227 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/32 file after the snapshot 2020-02-11T16:08:12.227 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/33 file after the snapshot 2020-02-11T16:08:12.228 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/34 file after the snapshot 2020-02-11T16:08:12.231 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/35 file after the snapshot 2020-02-11T16:08:12.232 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/36 file after the snapshot 2020-02-11T16:08:12.234 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/37 file after the snapshot 2020-02-11T16:08:12.236 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/38 file after the snapshot 2020-02-11T16:08:12.238 INFO:tasks.workunit.client.0.smithi088.stdout: create 185/39 file after the snapshot 2020-02-11T16:08:12.240 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/.snap/snap-subdir-test 2020-02-11T16:08:12.259 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/30 file after the snapshot 2020-02-11T16:08:12.260 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/31 file after the snapshot 2020-02-11T16:08:12.262 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/32 file after the snapshot 2020-02-11T16:08:12.264 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/33 file after the snapshot 2020-02-11T16:08:12.267 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/34 file after the snapshot 2020-02-11T16:08:12.269 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/35 file after the snapshot 2020-02-11T16:08:12.271 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/36 file after the snapshot 2020-02-11T16:08:12.273 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/37 file after the snapshot 2020-02-11T16:08:12.274 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/38 file after the snapshot 2020-02-11T16:08:12.277 INFO:tasks.workunit.client.0.smithi088.stdout: create 186/39 file after the snapshot 2020-02-11T16:08:12.280 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/.snap/snap-subdir-test 2020-02-11T16:08:12.298 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/30 file after the snapshot 2020-02-11T16:08:12.300 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/31 file after the snapshot 2020-02-11T16:08:12.302 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/32 file after the snapshot 2020-02-11T16:08:12.304 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/33 file after the snapshot 2020-02-11T16:08:12.305 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/34 file after the snapshot 2020-02-11T16:08:12.308 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/35 file after the snapshot 2020-02-11T16:08:12.310 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/36 file after the snapshot 2020-02-11T16:08:12.311 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/37 file after the snapshot 2020-02-11T16:08:12.314 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/38 file after the snapshot 2020-02-11T16:08:12.316 INFO:tasks.workunit.client.0.smithi088.stdout: create 187/39 file after the snapshot 2020-02-11T16:08:12.317 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/.snap/snap-subdir-test 2020-02-11T16:08:12.336 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/30 file after the snapshot 2020-02-11T16:08:12.337 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/31 file after the snapshot 2020-02-11T16:08:12.339 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/32 file after the snapshot 2020-02-11T16:08:12.341 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/33 file after the snapshot 2020-02-11T16:08:12.343 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/34 file after the snapshot 2020-02-11T16:08:12.345 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/35 file after the snapshot 2020-02-11T16:08:12.347 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/36 file after the snapshot 2020-02-11T16:08:12.350 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/37 file after the snapshot 2020-02-11T16:08:12.351 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/38 file after the snapshot 2020-02-11T16:08:12.353 INFO:tasks.workunit.client.0.smithi088.stdout: create 188/39 file after the snapshot 2020-02-11T16:08:12.356 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/.snap/snap-subdir-test 2020-02-11T16:08:12.374 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/30 file after the snapshot 2020-02-11T16:08:12.375 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/31 file after the snapshot 2020-02-11T16:08:12.377 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/32 file after the snapshot 2020-02-11T16:08:12.379 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/33 file after the snapshot 2020-02-11T16:08:12.381 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/34 file after the snapshot 2020-02-11T16:08:12.383 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/35 file after the snapshot 2020-02-11T16:08:12.385 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/36 file after the snapshot 2020-02-11T16:08:12.387 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/37 file after the snapshot 2020-02-11T16:08:12.389 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/38 file after the snapshot 2020-02-11T16:08:12.390 INFO:tasks.workunit.client.0.smithi088.stdout: create 189/39 file after the snapshot 2020-02-11T16:08:12.393 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/.snap/snap-subdir-test 2020-02-11T16:08:12.419 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/30 file after the snapshot 2020-02-11T16:08:12.420 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/31 file after the snapshot 2020-02-11T16:08:12.422 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/32 file after the snapshot 2020-02-11T16:08:12.424 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/33 file after the snapshot 2020-02-11T16:08:12.426 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/34 file after the snapshot 2020-02-11T16:08:12.428 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/35 file after the snapshot 2020-02-11T16:08:12.430 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/36 file after the snapshot 2020-02-11T16:08:12.432 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/37 file after the snapshot 2020-02-11T16:08:12.434 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/38 file after the snapshot 2020-02-11T16:08:12.437 INFO:tasks.workunit.client.0.smithi088.stdout: create 190/39 file after the snapshot 2020-02-11T16:08:12.438 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/.snap/snap-subdir-test 2020-02-11T16:08:12.456 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/30 file after the snapshot 2020-02-11T16:08:12.458 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/31 file after the snapshot 2020-02-11T16:08:12.459 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/32 file after the snapshot 2020-02-11T16:08:12.461 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/33 file after the snapshot 2020-02-11T16:08:12.601 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/34 file after the snapshot 2020-02-11T16:08:12.602 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/35 file after the snapshot 2020-02-11T16:08:12.604 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/36 file after the snapshot 2020-02-11T16:08:12.606 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/37 file after the snapshot 2020-02-11T16:08:12.608 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/38 file after the snapshot 2020-02-11T16:08:12.610 INFO:tasks.workunit.client.0.smithi088.stdout: create 191/39 file after the snapshot 2020-02-11T16:08:12.612 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/.snap/snap-subdir-test 2020-02-11T16:08:12.691 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/30 file after the snapshot 2020-02-11T16:08:12.693 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/31 file after the snapshot 2020-02-11T16:08:12.694 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/32 file after the snapshot 2020-02-11T16:08:12.696 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/33 file after the snapshot 2020-02-11T16:08:12.698 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/34 file after the snapshot 2020-02-11T16:08:12.700 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/35 file after the snapshot 2020-02-11T16:08:12.702 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/36 file after the snapshot 2020-02-11T16:08:12.704 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/37 file after the snapshot 2020-02-11T16:08:12.706 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/38 file after the snapshot 2020-02-11T16:08:12.707 INFO:tasks.workunit.client.0.smithi088.stdout: create 192/39 file after the snapshot 2020-02-11T16:08:12.709 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/.snap/snap-subdir-test 2020-02-11T16:08:12.729 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/30 file after the snapshot 2020-02-11T16:08:12.731 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/31 file after the snapshot 2020-02-11T16:08:12.733 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/32 file after the snapshot 2020-02-11T16:08:12.735 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/33 file after the snapshot 2020-02-11T16:08:12.737 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/34 file after the snapshot 2020-02-11T16:08:12.739 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/35 file after the snapshot 2020-02-11T16:08:12.741 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/36 file after the snapshot 2020-02-11T16:08:12.743 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/37 file after the snapshot 2020-02-11T16:08:12.745 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/38 file after the snapshot 2020-02-11T16:08:12.746 INFO:tasks.workunit.client.0.smithi088.stdout: create 193/39 file after the snapshot 2020-02-11T16:08:12.748 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/.snap/snap-subdir-test 2020-02-11T16:08:12.766 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/30 file after the snapshot 2020-02-11T16:08:12.768 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/31 file after the snapshot 2020-02-11T16:08:12.770 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/32 file after the snapshot 2020-02-11T16:08:12.772 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/33 file after the snapshot 2020-02-11T16:08:12.773 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/34 file after the snapshot 2020-02-11T16:08:12.775 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/35 file after the snapshot 2020-02-11T16:08:12.778 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/36 file after the snapshot 2020-02-11T16:08:12.780 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/37 file after the snapshot 2020-02-11T16:08:12.782 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/38 file after the snapshot 2020-02-11T16:08:12.783 INFO:tasks.workunit.client.0.smithi088.stdout: create 194/39 file after the snapshot 2020-02-11T16:08:12.785 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/.snap/snap-subdir-test 2020-02-11T16:08:12.804 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/30 file after the snapshot 2020-02-11T16:08:12.805 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/31 file after the snapshot 2020-02-11T16:08:12.807 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/32 file after the snapshot 2020-02-11T16:08:12.809 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/33 file after the snapshot 2020-02-11T16:08:12.811 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/34 file after the snapshot 2020-02-11T16:08:12.813 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/35 file after the snapshot 2020-02-11T16:08:12.815 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/36 file after the snapshot 2020-02-11T16:08:12.816 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/37 file after the snapshot 2020-02-11T16:08:12.818 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/38 file after the snapshot 2020-02-11T16:08:12.820 INFO:tasks.workunit.client.0.smithi088.stdout: create 195/39 file after the snapshot 2020-02-11T16:08:12.822 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/.snap/snap-subdir-test 2020-02-11T16:08:12.842 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/30 file after the snapshot 2020-02-11T16:08:12.844 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/31 file after the snapshot 2020-02-11T16:08:12.846 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/32 file after the snapshot 2020-02-11T16:08:12.848 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/33 file after the snapshot 2020-02-11T16:08:12.849 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/34 file after the snapshot 2020-02-11T16:08:12.853 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/35 file after the snapshot 2020-02-11T16:08:12.853 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/36 file after the snapshot 2020-02-11T16:08:12.856 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/37 file after the snapshot 2020-02-11T16:08:12.857 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/38 file after the snapshot 2020-02-11T16:08:12.859 INFO:tasks.workunit.client.0.smithi088.stdout: create 196/39 file after the snapshot 2020-02-11T16:08:12.861 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/.snap/snap-subdir-test 2020-02-11T16:08:12.878 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/30 file after the snapshot 2020-02-11T16:08:12.880 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/31 file after the snapshot 2020-02-11T16:08:12.882 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/32 file after the snapshot 2020-02-11T16:08:12.883 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/33 file after the snapshot 2020-02-11T16:08:12.886 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/34 file after the snapshot 2020-02-11T16:08:12.887 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/35 file after the snapshot 2020-02-11T16:08:12.889 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/36 file after the snapshot 2020-02-11T16:08:12.891 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/37 file after the snapshot 2020-02-11T16:08:12.893 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/38 file after the snapshot 2020-02-11T16:08:12.895 INFO:tasks.workunit.client.0.smithi088.stdout: create 197/39 file after the snapshot 2020-02-11T16:08:12.897 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/.snap/snap-subdir-test 2020-02-11T16:08:12.915 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/30 file after the snapshot 2020-02-11T16:08:12.916 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/31 file after the snapshot 2020-02-11T16:08:12.918 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/32 file after the snapshot 2020-02-11T16:08:12.920 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/33 file after the snapshot 2020-02-11T16:08:12.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/34 file after the snapshot 2020-02-11T16:08:12.925 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/35 file after the snapshot 2020-02-11T16:08:12.927 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/36 file after the snapshot 2020-02-11T16:08:12.929 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/37 file after the snapshot 2020-02-11T16:08:12.931 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/38 file after the snapshot 2020-02-11T16:08:12.933 INFO:tasks.workunit.client.0.smithi088.stdout: create 198/39 file after the snapshot 2020-02-11T16:08:12.936 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/.snap/snap-subdir-test 2020-02-11T16:08:12.954 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/30 file after the snapshot 2020-02-11T16:08:12.956 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/31 file after the snapshot 2020-02-11T16:08:12.957 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/32 file after the snapshot 2020-02-11T16:08:12.959 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/33 file after the snapshot 2020-02-11T16:08:12.962 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/34 file after the snapshot 2020-02-11T16:08:12.964 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/35 file after the snapshot 2020-02-11T16:08:12.966 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/36 file after the snapshot 2020-02-11T16:08:12.969 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/37 file after the snapshot 2020-02-11T16:08:12.970 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/38 file after the snapshot 2020-02-11T16:08:12.971 INFO:tasks.workunit.client.0.smithi088.stdout: create 199/39 file after the snapshot 2020-02-11T16:08:12.973 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/.snap/snap-subdir-test 2020-02-11T16:08:12.992 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/30 file after the snapshot 2020-02-11T16:08:12.993 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/31 file after the snapshot 2020-02-11T16:08:12.995 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/32 file after the snapshot 2020-02-11T16:08:12.997 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/33 file after the snapshot 2020-02-11T16:08:12.999 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/34 file after the snapshot 2020-02-11T16:08:13.002 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/35 file after the snapshot 2020-02-11T16:08:13.003 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/36 file after the snapshot 2020-02-11T16:08:13.006 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/37 file after the snapshot 2020-02-11T16:08:13.008 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/38 file after the snapshot 2020-02-11T16:08:13.010 INFO:tasks.workunit.client.0.smithi088.stdout: create 200/39 file after the snapshot 2020-02-11T16:08:13.011 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/.snap/snap-subdir-test 2020-02-11T16:08:13.030 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/30 file after the snapshot 2020-02-11T16:08:13.033 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/31 file after the snapshot 2020-02-11T16:08:13.035 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/32 file after the snapshot 2020-02-11T16:08:13.036 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/33 file after the snapshot 2020-02-11T16:08:13.039 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/34 file after the snapshot 2020-02-11T16:08:13.040 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/35 file after the snapshot 2020-02-11T16:08:13.042 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/36 file after the snapshot 2020-02-11T16:08:13.044 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/37 file after the snapshot 2020-02-11T16:08:13.046 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/38 file after the snapshot 2020-02-11T16:08:13.048 INFO:tasks.workunit.client.0.smithi088.stdout: create 201/39 file after the snapshot 2020-02-11T16:08:13.050 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/.snap/snap-subdir-test 2020-02-11T16:08:13.075 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/30 file after the snapshot 2020-02-11T16:08:13.076 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/31 file after the snapshot 2020-02-11T16:08:13.078 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/32 file after the snapshot 2020-02-11T16:08:13.080 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/33 file after the snapshot 2020-02-11T16:08:13.082 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/34 file after the snapshot 2020-02-11T16:08:13.084 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/35 file after the snapshot 2020-02-11T16:08:13.086 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/36 file after the snapshot 2020-02-11T16:08:13.088 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/37 file after the snapshot 2020-02-11T16:08:13.090 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/38 file after the snapshot 2020-02-11T16:08:13.091 INFO:tasks.workunit.client.0.smithi088.stdout: create 202/39 file after the snapshot 2020-02-11T16:08:13.094 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/.snap/snap-subdir-test 2020-02-11T16:08:13.112 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/30 file after the snapshot 2020-02-11T16:08:13.113 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/31 file after the snapshot 2020-02-11T16:08:13.115 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/32 file after the snapshot 2020-02-11T16:08:13.117 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/33 file after the snapshot 2020-02-11T16:08:13.119 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/34 file after the snapshot 2020-02-11T16:08:13.121 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/35 file after the snapshot 2020-02-11T16:08:13.122 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/36 file after the snapshot 2020-02-11T16:08:13.124 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/37 file after the snapshot 2020-02-11T16:08:13.126 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/38 file after the snapshot 2020-02-11T16:08:13.128 INFO:tasks.workunit.client.0.smithi088.stdout: create 203/39 file after the snapshot 2020-02-11T16:08:13.130 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/.snap/snap-subdir-test 2020-02-11T16:08:13.148 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/30 file after the snapshot 2020-02-11T16:08:13.150 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/31 file after the snapshot 2020-02-11T16:08:13.151 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/32 file after the snapshot 2020-02-11T16:08:13.153 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/33 file after the snapshot 2020-02-11T16:08:13.155 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/34 file after the snapshot 2020-02-11T16:08:13.158 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/35 file after the snapshot 2020-02-11T16:08:13.160 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/36 file after the snapshot 2020-02-11T16:08:13.162 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/37 file after the snapshot 2020-02-11T16:08:13.164 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/38 file after the snapshot 2020-02-11T16:08:13.166 INFO:tasks.workunit.client.0.smithi088.stdout: create 204/39 file after the snapshot 2020-02-11T16:08:13.169 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/.snap/snap-subdir-test 2020-02-11T16:08:13.185 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/30 file after the snapshot 2020-02-11T16:08:13.187 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/31 file after the snapshot 2020-02-11T16:08:13.189 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/32 file after the snapshot 2020-02-11T16:08:13.191 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/33 file after the snapshot 2020-02-11T16:08:13.193 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/34 file after the snapshot 2020-02-11T16:08:13.195 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/35 file after the snapshot 2020-02-11T16:08:13.197 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/36 file after the snapshot 2020-02-11T16:08:13.198 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/37 file after the snapshot 2020-02-11T16:08:13.200 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/38 file after the snapshot 2020-02-11T16:08:13.202 INFO:tasks.workunit.client.0.smithi088.stdout: create 205/39 file after the snapshot 2020-02-11T16:08:13.205 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/.snap/snap-subdir-test 2020-02-11T16:08:13.224 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/30 file after the snapshot 2020-02-11T16:08:13.226 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/31 file after the snapshot 2020-02-11T16:08:13.228 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/32 file after the snapshot 2020-02-11T16:08:13.230 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/33 file after the snapshot 2020-02-11T16:08:13.232 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/34 file after the snapshot 2020-02-11T16:08:13.234 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/35 file after the snapshot 2020-02-11T16:08:13.236 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/36 file after the snapshot 2020-02-11T16:08:13.238 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/37 file after the snapshot 2020-02-11T16:08:13.239 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/38 file after the snapshot 2020-02-11T16:08:13.242 INFO:tasks.workunit.client.0.smithi088.stdout: create 206/39 file after the snapshot 2020-02-11T16:08:13.243 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/.snap/snap-subdir-test 2020-02-11T16:08:13.261 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/30 file after the snapshot 2020-02-11T16:08:13.262 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/31 file after the snapshot 2020-02-11T16:08:13.264 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/32 file after the snapshot 2020-02-11T16:08:13.266 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/33 file after the snapshot 2020-02-11T16:08:13.268 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/34 file after the snapshot 2020-02-11T16:08:13.270 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/35 file after the snapshot 2020-02-11T16:08:13.271 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/36 file after the snapshot 2020-02-11T16:08:13.273 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/37 file after the snapshot 2020-02-11T16:08:13.275 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/38 file after the snapshot 2020-02-11T16:08:13.277 INFO:tasks.workunit.client.0.smithi088.stdout: create 207/39 file after the snapshot 2020-02-11T16:08:13.279 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/.snap/snap-subdir-test 2020-02-11T16:08:13.297 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/30 file after the snapshot 2020-02-11T16:08:13.298 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/31 file after the snapshot 2020-02-11T16:08:13.300 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/32 file after the snapshot 2020-02-11T16:08:13.302 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/33 file after the snapshot 2020-02-11T16:08:13.304 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/34 file after the snapshot 2020-02-11T16:08:13.306 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/35 file after the snapshot 2020-02-11T16:08:13.308 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/36 file after the snapshot 2020-02-11T16:08:13.309 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/37 file after the snapshot 2020-02-11T16:08:13.311 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/38 file after the snapshot 2020-02-11T16:08:13.313 INFO:tasks.workunit.client.0.smithi088.stdout: create 208/39 file after the snapshot 2020-02-11T16:08:13.315 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/.snap/snap-subdir-test 2020-02-11T16:08:13.335 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/30 file after the snapshot 2020-02-11T16:08:13.337 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/31 file after the snapshot 2020-02-11T16:08:13.339 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/32 file after the snapshot 2020-02-11T16:08:13.340 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/33 file after the snapshot 2020-02-11T16:08:13.342 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/34 file after the snapshot 2020-02-11T16:08:13.344 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/35 file after the snapshot 2020-02-11T16:08:13.346 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/36 file after the snapshot 2020-02-11T16:08:13.348 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/37 file after the snapshot 2020-02-11T16:08:13.350 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/38 file after the snapshot 2020-02-11T16:08:13.352 INFO:tasks.workunit.client.0.smithi088.stdout: create 209/39 file after the snapshot 2020-02-11T16:08:13.353 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/.snap/snap-subdir-test 2020-02-11T16:08:13.373 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/30 file after the snapshot 2020-02-11T16:08:13.373 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/31 file after the snapshot 2020-02-11T16:08:13.374 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/32 file after the snapshot 2020-02-11T16:08:13.376 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/33 file after the snapshot 2020-02-11T16:08:13.378 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/34 file after the snapshot 2020-02-11T16:08:13.380 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/35 file after the snapshot 2020-02-11T16:08:13.382 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/36 file after the snapshot 2020-02-11T16:08:13.384 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/37 file after the snapshot 2020-02-11T16:08:13.386 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/38 file after the snapshot 2020-02-11T16:08:13.388 INFO:tasks.workunit.client.0.smithi088.stdout: create 210/39 file after the snapshot 2020-02-11T16:08:13.390 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/.snap/snap-subdir-test 2020-02-11T16:08:13.407 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/30 file after the snapshot 2020-02-11T16:08:13.409 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/31 file after the snapshot 2020-02-11T16:08:13.411 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/32 file after the snapshot 2020-02-11T16:08:13.413 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/33 file after the snapshot 2020-02-11T16:08:13.415 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/34 file after the snapshot 2020-02-11T16:08:13.417 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/35 file after the snapshot 2020-02-11T16:08:13.419 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/36 file after the snapshot 2020-02-11T16:08:13.421 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/37 file after the snapshot 2020-02-11T16:08:13.423 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/38 file after the snapshot 2020-02-11T16:08:13.425 INFO:tasks.workunit.client.0.smithi088.stdout: create 211/39 file after the snapshot 2020-02-11T16:08:13.427 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/.snap/snap-subdir-test 2020-02-11T16:08:13.445 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/30 file after the snapshot 2020-02-11T16:08:13.446 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/31 file after the snapshot 2020-02-11T16:08:13.448 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/32 file after the snapshot 2020-02-11T16:08:13.450 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/33 file after the snapshot 2020-02-11T16:08:13.452 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/34 file after the snapshot 2020-02-11T16:08:13.455 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/35 file after the snapshot 2020-02-11T16:08:13.457 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/36 file after the snapshot 2020-02-11T16:08:13.459 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/37 file after the snapshot 2020-02-11T16:08:13.461 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/38 file after the snapshot 2020-02-11T16:08:13.472 INFO:tasks.workunit.client.0.smithi088.stdout: create 212/39 file after the snapshot 2020-02-11T16:08:13.616 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/.snap/snap-subdir-test 2020-02-11T16:08:13.653 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/30 file after the snapshot 2020-02-11T16:08:13.655 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/31 file after the snapshot 2020-02-11T16:08:13.657 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/32 file after the snapshot 2020-02-11T16:08:13.658 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/33 file after the snapshot 2020-02-11T16:08:13.660 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/34 file after the snapshot 2020-02-11T16:08:13.662 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/35 file after the snapshot 2020-02-11T16:08:13.664 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/36 file after the snapshot 2020-02-11T16:08:13.666 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/37 file after the snapshot 2020-02-11T16:08:13.668 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/38 file after the snapshot 2020-02-11T16:08:13.670 INFO:tasks.workunit.client.0.smithi088.stdout: create 213/39 file after the snapshot 2020-02-11T16:08:13.672 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/.snap/snap-subdir-test 2020-02-11T16:08:13.695 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/30 file after the snapshot 2020-02-11T16:08:13.697 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/31 file after the snapshot 2020-02-11T16:08:13.699 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/32 file after the snapshot 2020-02-11T16:08:13.701 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/33 file after the snapshot 2020-02-11T16:08:13.702 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/34 file after the snapshot 2020-02-11T16:08:13.705 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/35 file after the snapshot 2020-02-11T16:08:13.706 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/36 file after the snapshot 2020-02-11T16:08:13.708 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/37 file after the snapshot 2020-02-11T16:08:13.710 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/38 file after the snapshot 2020-02-11T16:08:13.712 INFO:tasks.workunit.client.0.smithi088.stdout: create 214/39 file after the snapshot 2020-02-11T16:08:13.714 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/.snap/snap-subdir-test 2020-02-11T16:08:13.733 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/30 file after the snapshot 2020-02-11T16:08:13.734 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/31 file after the snapshot 2020-02-11T16:08:13.736 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/32 file after the snapshot 2020-02-11T16:08:13.738 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/33 file after the snapshot 2020-02-11T16:08:13.740 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/34 file after the snapshot 2020-02-11T16:08:13.742 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/35 file after the snapshot 2020-02-11T16:08:13.744 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/36 file after the snapshot 2020-02-11T16:08:13.745 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/37 file after the snapshot 2020-02-11T16:08:13.747 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/38 file after the snapshot 2020-02-11T16:08:13.749 INFO:tasks.workunit.client.0.smithi088.stdout: create 215/39 file after the snapshot 2020-02-11T16:08:13.751 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/.snap/snap-subdir-test 2020-02-11T16:08:13.769 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/30 file after the snapshot 2020-02-11T16:08:13.770 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/31 file after the snapshot 2020-02-11T16:08:13.772 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/32 file after the snapshot 2020-02-11T16:08:13.774 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/33 file after the snapshot 2020-02-11T16:08:13.776 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/34 file after the snapshot 2020-02-11T16:08:13.778 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/35 file after the snapshot 2020-02-11T16:08:13.779 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/36 file after the snapshot 2020-02-11T16:08:13.781 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/37 file after the snapshot 2020-02-11T16:08:13.783 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/38 file after the snapshot 2020-02-11T16:08:13.785 INFO:tasks.workunit.client.0.smithi088.stdout: create 216/39 file after the snapshot 2020-02-11T16:08:13.787 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/.snap/snap-subdir-test 2020-02-11T16:08:13.805 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/30 file after the snapshot 2020-02-11T16:08:13.807 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/31 file after the snapshot 2020-02-11T16:08:13.808 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/32 file after the snapshot 2020-02-11T16:08:13.810 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/33 file after the snapshot 2020-02-11T16:08:13.812 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/34 file after the snapshot 2020-02-11T16:08:13.814 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/35 file after the snapshot 2020-02-11T16:08:13.816 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/36 file after the snapshot 2020-02-11T16:08:13.818 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/37 file after the snapshot 2020-02-11T16:08:13.819 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/38 file after the snapshot 2020-02-11T16:08:13.821 INFO:tasks.workunit.client.0.smithi088.stdout: create 217/39 file after the snapshot 2020-02-11T16:08:13.823 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/.snap/snap-subdir-test 2020-02-11T16:08:13.840 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/30 file after the snapshot 2020-02-11T16:08:13.842 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/31 file after the snapshot 2020-02-11T16:08:13.843 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/32 file after the snapshot 2020-02-11T16:08:13.845 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/33 file after the snapshot 2020-02-11T16:08:13.847 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/34 file after the snapshot 2020-02-11T16:08:13.849 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/35 file after the snapshot 2020-02-11T16:08:13.851 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/36 file after the snapshot 2020-02-11T16:08:13.853 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/37 file after the snapshot 2020-02-11T16:08:13.855 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/38 file after the snapshot 2020-02-11T16:08:13.857 INFO:tasks.workunit.client.0.smithi088.stdout: create 218/39 file after the snapshot 2020-02-11T16:08:13.859 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/.snap/snap-subdir-test 2020-02-11T16:08:13.876 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/30 file after the snapshot 2020-02-11T16:08:13.878 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/31 file after the snapshot 2020-02-11T16:08:13.880 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/32 file after the snapshot 2020-02-11T16:08:13.882 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/33 file after the snapshot 2020-02-11T16:08:13.883 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/34 file after the snapshot 2020-02-11T16:08:13.886 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/35 file after the snapshot 2020-02-11T16:08:13.887 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/36 file after the snapshot 2020-02-11T16:08:13.889 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/37 file after the snapshot 2020-02-11T16:08:13.891 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/38 file after the snapshot 2020-02-11T16:08:13.893 INFO:tasks.workunit.client.0.smithi088.stdout: create 219/39 file after the snapshot 2020-02-11T16:08:13.896 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/.snap/snap-subdir-test 2020-02-11T16:08:13.920 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/30 file after the snapshot 2020-02-11T16:08:13.921 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/31 file after the snapshot 2020-02-11T16:08:13.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/32 file after the snapshot 2020-02-11T16:08:13.925 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/33 file after the snapshot 2020-02-11T16:08:13.927 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/34 file after the snapshot 2020-02-11T16:08:13.929 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/35 file after the snapshot 2020-02-11T16:08:13.931 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/36 file after the snapshot 2020-02-11T16:08:13.933 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/37 file after the snapshot 2020-02-11T16:08:13.935 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/38 file after the snapshot 2020-02-11T16:08:13.937 INFO:tasks.workunit.client.0.smithi088.stdout: create 220/39 file after the snapshot 2020-02-11T16:08:13.939 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/.snap/snap-subdir-test 2020-02-11T16:08:13.958 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/30 file after the snapshot 2020-02-11T16:08:13.959 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/31 file after the snapshot 2020-02-11T16:08:13.961 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/32 file after the snapshot 2020-02-11T16:08:13.963 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/33 file after the snapshot 2020-02-11T16:08:13.965 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/34 file after the snapshot 2020-02-11T16:08:13.967 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/35 file after the snapshot 2020-02-11T16:08:13.969 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/36 file after the snapshot 2020-02-11T16:08:13.971 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/37 file after the snapshot 2020-02-11T16:08:13.973 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/38 file after the snapshot 2020-02-11T16:08:13.974 INFO:tasks.workunit.client.0.smithi088.stdout: create 221/39 file after the snapshot 2020-02-11T16:08:13.976 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/.snap/snap-subdir-test 2020-02-11T16:08:13.994 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/30 file after the snapshot 2020-02-11T16:08:13.995 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/31 file after the snapshot 2020-02-11T16:08:13.997 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/32 file after the snapshot 2020-02-11T16:08:13.999 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/33 file after the snapshot 2020-02-11T16:08:14.001 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/34 file after the snapshot 2020-02-11T16:08:14.004 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/35 file after the snapshot 2020-02-11T16:08:14.005 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/36 file after the snapshot 2020-02-11T16:08:14.007 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/37 file after the snapshot 2020-02-11T16:08:14.010 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/38 file after the snapshot 2020-02-11T16:08:14.011 INFO:tasks.workunit.client.0.smithi088.stdout: create 222/39 file after the snapshot 2020-02-11T16:08:14.013 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/.snap/snap-subdir-test 2020-02-11T16:08:14.031 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/30 file after the snapshot 2020-02-11T16:08:14.033 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/31 file after the snapshot 2020-02-11T16:08:14.034 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/32 file after the snapshot 2020-02-11T16:08:14.036 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/33 file after the snapshot 2020-02-11T16:08:14.038 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/34 file after the snapshot 2020-02-11T16:08:14.040 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/35 file after the snapshot 2020-02-11T16:08:14.042 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/36 file after the snapshot 2020-02-11T16:08:14.044 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/37 file after the snapshot 2020-02-11T16:08:14.046 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/38 file after the snapshot 2020-02-11T16:08:14.048 INFO:tasks.workunit.client.0.smithi088.stdout: create 223/39 file after the snapshot 2020-02-11T16:08:14.050 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/.snap/snap-subdir-test 2020-02-11T16:08:14.069 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/30 file after the snapshot 2020-02-11T16:08:14.069 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/31 file after the snapshot 2020-02-11T16:08:14.071 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/32 file after the snapshot 2020-02-11T16:08:14.073 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/33 file after the snapshot 2020-02-11T16:08:14.075 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/34 file after the snapshot 2020-02-11T16:08:14.077 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/35 file after the snapshot 2020-02-11T16:08:14.098 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/36 file after the snapshot 2020-02-11T16:08:14.098 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/37 file after the snapshot 2020-02-11T16:08:14.098 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/38 file after the snapshot 2020-02-11T16:08:14.099 INFO:tasks.workunit.client.0.smithi088.stdout: create 224/39 file after the snapshot 2020-02-11T16:08:14.099 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/.snap/snap-subdir-test 2020-02-11T16:08:14.103 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/30 file after the snapshot 2020-02-11T16:08:14.105 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/31 file after the snapshot 2020-02-11T16:08:14.106 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/32 file after the snapshot 2020-02-11T16:08:14.108 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/33 file after the snapshot 2020-02-11T16:08:14.110 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/34 file after the snapshot 2020-02-11T16:08:14.112 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/35 file after the snapshot 2020-02-11T16:08:14.114 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/36 file after the snapshot 2020-02-11T16:08:14.116 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/37 file after the snapshot 2020-02-11T16:08:14.117 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/38 file after the snapshot 2020-02-11T16:08:14.119 INFO:tasks.workunit.client.0.smithi088.stdout: create 225/39 file after the snapshot 2020-02-11T16:08:14.121 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/.snap/snap-subdir-test 2020-02-11T16:08:14.139 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/30 file after the snapshot 2020-02-11T16:08:14.141 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/31 file after the snapshot 2020-02-11T16:08:14.142 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/32 file after the snapshot 2020-02-11T16:08:14.144 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/33 file after the snapshot 2020-02-11T16:08:14.146 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/34 file after the snapshot 2020-02-11T16:08:14.148 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/35 file after the snapshot 2020-02-11T16:08:14.150 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/36 file after the snapshot 2020-02-11T16:08:14.151 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/37 file after the snapshot 2020-02-11T16:08:14.154 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/38 file after the snapshot 2020-02-11T16:08:14.156 INFO:tasks.workunit.client.0.smithi088.stdout: create 226/39 file after the snapshot 2020-02-11T16:08:14.157 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/.snap/snap-subdir-test 2020-02-11T16:08:14.174 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/30 file after the snapshot 2020-02-11T16:08:14.176 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/31 file after the snapshot 2020-02-11T16:08:14.178 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/32 file after the snapshot 2020-02-11T16:08:14.179 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/33 file after the snapshot 2020-02-11T16:08:14.181 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/34 file after the snapshot 2020-02-11T16:08:14.183 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/35 file after the snapshot 2020-02-11T16:08:14.185 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/36 file after the snapshot 2020-02-11T16:08:14.187 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/37 file after the snapshot 2020-02-11T16:08:14.190 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/38 file after the snapshot 2020-02-11T16:08:14.191 INFO:tasks.workunit.client.0.smithi088.stdout: create 227/39 file after the snapshot 2020-02-11T16:08:14.193 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/.snap/snap-subdir-test 2020-02-11T16:08:14.210 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/30 file after the snapshot 2020-02-11T16:08:14.212 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/31 file after the snapshot 2020-02-11T16:08:14.215 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/32 file after the snapshot 2020-02-11T16:08:14.216 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/33 file after the snapshot 2020-02-11T16:08:14.218 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/34 file after the snapshot 2020-02-11T16:08:14.220 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/35 file after the snapshot 2020-02-11T16:08:14.222 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/36 file after the snapshot 2020-02-11T16:08:14.234 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/37 file after the snapshot 2020-02-11T16:08:14.234 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/38 file after the snapshot 2020-02-11T16:08:14.234 INFO:tasks.workunit.client.0.smithi088.stdout: create 228/39 file after the snapshot 2020-02-11T16:08:14.235 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/.snap/snap-subdir-test 2020-02-11T16:08:14.247 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/30 file after the snapshot 2020-02-11T16:08:14.248 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/31 file after the snapshot 2020-02-11T16:08:14.250 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/32 file after the snapshot 2020-02-11T16:08:14.252 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/33 file after the snapshot 2020-02-11T16:08:14.254 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/34 file after the snapshot 2020-02-11T16:08:14.256 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/35 file after the snapshot 2020-02-11T16:08:14.258 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/36 file after the snapshot 2020-02-11T16:08:14.260 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/37 file after the snapshot 2020-02-11T16:08:14.262 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/38 file after the snapshot 2020-02-11T16:08:14.264 INFO:tasks.workunit.client.0.smithi088.stdout: create 229/39 file after the snapshot 2020-02-11T16:08:14.266 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/.snap/snap-subdir-test 2020-02-11T16:08:14.284 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/30 file after the snapshot 2020-02-11T16:08:14.286 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/31 file after the snapshot 2020-02-11T16:08:14.288 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/32 file after the snapshot 2020-02-11T16:08:14.290 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/33 file after the snapshot 2020-02-11T16:08:14.292 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/34 file after the snapshot 2020-02-11T16:08:14.294 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/35 file after the snapshot 2020-02-11T16:08:14.296 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/36 file after the snapshot 2020-02-11T16:08:14.298 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/37 file after the snapshot 2020-02-11T16:08:14.300 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/38 file after the snapshot 2020-02-11T16:08:14.302 INFO:tasks.workunit.client.0.smithi088.stdout: create 230/39 file after the snapshot 2020-02-11T16:08:14.304 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/.snap/snap-subdir-test 2020-02-11T16:08:14.322 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/30 file after the snapshot 2020-02-11T16:08:14.323 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/31 file after the snapshot 2020-02-11T16:08:14.325 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/32 file after the snapshot 2020-02-11T16:08:14.327 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/33 file after the snapshot 2020-02-11T16:08:14.329 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/34 file after the snapshot 2020-02-11T16:08:14.331 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/35 file after the snapshot 2020-02-11T16:08:14.333 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/36 file after the snapshot 2020-02-11T16:08:14.335 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/37 file after the snapshot 2020-02-11T16:08:14.336 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/38 file after the snapshot 2020-02-11T16:08:14.338 INFO:tasks.workunit.client.0.smithi088.stdout: create 231/39 file after the snapshot 2020-02-11T16:08:14.341 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/.snap/snap-subdir-test 2020-02-11T16:08:14.358 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/30 file after the snapshot 2020-02-11T16:08:14.360 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/31 file after the snapshot 2020-02-11T16:08:14.362 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/32 file after the snapshot 2020-02-11T16:08:14.363 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/33 file after the snapshot 2020-02-11T16:08:14.365 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/34 file after the snapshot 2020-02-11T16:08:14.367 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/35 file after the snapshot 2020-02-11T16:08:14.369 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/36 file after the snapshot 2020-02-11T16:08:14.371 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/37 file after the snapshot 2020-02-11T16:08:14.373 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/38 file after the snapshot 2020-02-11T16:08:14.375 INFO:tasks.workunit.client.0.smithi088.stdout: create 232/39 file after the snapshot 2020-02-11T16:08:14.377 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/.snap/snap-subdir-test 2020-02-11T16:08:14.395 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/30 file after the snapshot 2020-02-11T16:08:14.395 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/31 file after the snapshot 2020-02-11T16:08:14.396 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/32 file after the snapshot 2020-02-11T16:08:14.398 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/33 file after the snapshot 2020-02-11T16:08:14.400 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/34 file after the snapshot 2020-02-11T16:08:14.402 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/35 file after the snapshot 2020-02-11T16:08:14.404 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/36 file after the snapshot 2020-02-11T16:08:14.406 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/37 file after the snapshot 2020-02-11T16:08:14.407 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/38 file after the snapshot 2020-02-11T16:08:14.410 INFO:tasks.workunit.client.0.smithi088.stdout: create 233/39 file after the snapshot 2020-02-11T16:08:14.411 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/.snap/snap-subdir-test 2020-02-11T16:08:14.428 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/30 file after the snapshot 2020-02-11T16:08:14.430 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/31 file after the snapshot 2020-02-11T16:08:14.431 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/32 file after the snapshot 2020-02-11T16:08:14.434 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/33 file after the snapshot 2020-02-11T16:08:14.435 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/34 file after the snapshot 2020-02-11T16:08:14.437 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/35 file after the snapshot 2020-02-11T16:08:14.439 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/36 file after the snapshot 2020-02-11T16:08:14.441 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/37 file after the snapshot 2020-02-11T16:08:14.443 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/38 file after the snapshot 2020-02-11T16:08:14.445 INFO:tasks.workunit.client.0.smithi088.stdout: create 234/39 file after the snapshot 2020-02-11T16:08:14.446 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/.snap/snap-subdir-test 2020-02-11T16:08:14.471 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/30 file after the snapshot 2020-02-11T16:08:14.562 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/31 file after the snapshot 2020-02-11T16:08:14.563 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/32 file after the snapshot 2020-02-11T16:08:14.565 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/33 file after the snapshot 2020-02-11T16:08:14.567 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/34 file after the snapshot 2020-02-11T16:08:14.569 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/35 file after the snapshot 2020-02-11T16:08:14.571 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/36 file after the snapshot 2020-02-11T16:08:14.572 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/37 file after the snapshot 2020-02-11T16:08:14.574 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/38 file after the snapshot 2020-02-11T16:08:14.576 INFO:tasks.workunit.client.0.smithi088.stdout: create 235/39 file after the snapshot 2020-02-11T16:08:14.578 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/.snap/snap-subdir-test 2020-02-11T16:08:14.640 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/30 file after the snapshot 2020-02-11T16:08:14.641 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/31 file after the snapshot 2020-02-11T16:08:14.643 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/32 file after the snapshot 2020-02-11T16:08:14.645 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/33 file after the snapshot 2020-02-11T16:08:14.647 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/34 file after the snapshot 2020-02-11T16:08:14.649 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/35 file after the snapshot 2020-02-11T16:08:14.650 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/36 file after the snapshot 2020-02-11T16:08:14.652 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/37 file after the snapshot 2020-02-11T16:08:14.654 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/38 file after the snapshot 2020-02-11T16:08:14.656 INFO:tasks.workunit.client.0.smithi088.stdout: create 236/39 file after the snapshot 2020-02-11T16:08:14.658 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/.snap/snap-subdir-test 2020-02-11T16:08:14.675 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/30 file after the snapshot 2020-02-11T16:08:14.676 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/31 file after the snapshot 2020-02-11T16:08:14.678 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/32 file after the snapshot 2020-02-11T16:08:14.680 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/33 file after the snapshot 2020-02-11T16:08:14.682 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/34 file after the snapshot 2020-02-11T16:08:14.684 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/35 file after the snapshot 2020-02-11T16:08:14.686 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/36 file after the snapshot 2020-02-11T16:08:14.688 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/37 file after the snapshot 2020-02-11T16:08:14.690 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/38 file after the snapshot 2020-02-11T16:08:14.692 INFO:tasks.workunit.client.0.smithi088.stdout: create 237/39 file after the snapshot 2020-02-11T16:08:14.694 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/.snap/snap-subdir-test 2020-02-11T16:08:14.710 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/30 file after the snapshot 2020-02-11T16:08:14.712 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/31 file after the snapshot 2020-02-11T16:08:14.714 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/32 file after the snapshot 2020-02-11T16:08:14.715 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/33 file after the snapshot 2020-02-11T16:08:14.717 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/34 file after the snapshot 2020-02-11T16:08:14.719 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/35 file after the snapshot 2020-02-11T16:08:14.721 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/36 file after the snapshot 2020-02-11T16:08:14.723 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/37 file after the snapshot 2020-02-11T16:08:14.726 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/38 file after the snapshot 2020-02-11T16:08:14.727 INFO:tasks.workunit.client.0.smithi088.stdout: create 238/39 file after the snapshot 2020-02-11T16:08:14.729 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/.snap/snap-subdir-test 2020-02-11T16:08:14.747 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/30 file after the snapshot 2020-02-11T16:08:14.748 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/31 file after the snapshot 2020-02-11T16:08:14.750 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/32 file after the snapshot 2020-02-11T16:08:14.752 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/33 file after the snapshot 2020-02-11T16:08:14.754 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/34 file after the snapshot 2020-02-11T16:08:14.762 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/35 file after the snapshot 2020-02-11T16:08:14.763 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/36 file after the snapshot 2020-02-11T16:08:14.763 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/37 file after the snapshot 2020-02-11T16:08:14.763 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/38 file after the snapshot 2020-02-11T16:08:14.763 INFO:tasks.workunit.client.0.smithi088.stdout: create 239/39 file after the snapshot 2020-02-11T16:08:14.766 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/.snap/snap-subdir-test 2020-02-11T16:08:14.782 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/30 file after the snapshot 2020-02-11T16:08:14.783 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/31 file after the snapshot 2020-02-11T16:08:14.785 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/32 file after the snapshot 2020-02-11T16:08:14.787 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/33 file after the snapshot 2020-02-11T16:08:14.789 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/34 file after the snapshot 2020-02-11T16:08:14.791 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/35 file after the snapshot 2020-02-11T16:08:14.793 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/36 file after the snapshot 2020-02-11T16:08:14.795 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/37 file after the snapshot 2020-02-11T16:08:14.797 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/38 file after the snapshot 2020-02-11T16:08:14.799 INFO:tasks.workunit.client.0.smithi088.stdout: create 240/39 file after the snapshot 2020-02-11T16:08:14.801 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/.snap/snap-subdir-test 2020-02-11T16:08:14.817 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/30 file after the snapshot 2020-02-11T16:08:14.819 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/31 file after the snapshot 2020-02-11T16:08:14.820 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/32 file after the snapshot 2020-02-11T16:08:14.823 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/33 file after the snapshot 2020-02-11T16:08:14.825 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/34 file after the snapshot 2020-02-11T16:08:14.827 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/35 file after the snapshot 2020-02-11T16:08:14.829 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/36 file after the snapshot 2020-02-11T16:08:14.831 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/37 file after the snapshot 2020-02-11T16:08:14.832 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/38 file after the snapshot 2020-02-11T16:08:14.835 INFO:tasks.workunit.client.0.smithi088.stdout: create 241/39 file after the snapshot 2020-02-11T16:08:14.836 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/.snap/snap-subdir-test 2020-02-11T16:08:14.853 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/30 file after the snapshot 2020-02-11T16:08:14.855 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/31 file after the snapshot 2020-02-11T16:08:14.857 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/32 file after the snapshot 2020-02-11T16:08:14.858 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/33 file after the snapshot 2020-02-11T16:08:14.860 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/34 file after the snapshot 2020-02-11T16:08:14.862 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/35 file after the snapshot 2020-02-11T16:08:14.864 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/36 file after the snapshot 2020-02-11T16:08:14.866 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/37 file after the snapshot 2020-02-11T16:08:14.868 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/38 file after the snapshot 2020-02-11T16:08:14.870 INFO:tasks.workunit.client.0.smithi088.stdout: create 242/39 file after the snapshot 2020-02-11T16:08:14.872 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/.snap/snap-subdir-test 2020-02-11T16:08:14.888 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/30 file after the snapshot 2020-02-11T16:08:14.890 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/31 file after the snapshot 2020-02-11T16:08:14.891 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/32 file after the snapshot 2020-02-11T16:08:14.893 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/33 file after the snapshot 2020-02-11T16:08:14.895 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/34 file after the snapshot 2020-02-11T16:08:14.897 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/35 file after the snapshot 2020-02-11T16:08:14.899 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/36 file after the snapshot 2020-02-11T16:08:14.901 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/37 file after the snapshot 2020-02-11T16:08:14.902 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/38 file after the snapshot 2020-02-11T16:08:14.904 INFO:tasks.workunit.client.0.smithi088.stdout: create 243/39 file after the snapshot 2020-02-11T16:08:14.907 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/.snap/snap-subdir-test 2020-02-11T16:08:14.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/30 file after the snapshot 2020-02-11T16:08:14.925 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/31 file after the snapshot 2020-02-11T16:08:14.927 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/32 file after the snapshot 2020-02-11T16:08:14.929 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/33 file after the snapshot 2020-02-11T16:08:14.930 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/34 file after the snapshot 2020-02-11T16:08:14.933 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/35 file after the snapshot 2020-02-11T16:08:14.934 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/36 file after the snapshot 2020-02-11T16:08:14.936 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/37 file after the snapshot 2020-02-11T16:08:14.939 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/38 file after the snapshot 2020-02-11T16:08:14.941 INFO:tasks.workunit.client.0.smithi088.stdout: create 244/39 file after the snapshot 2020-02-11T16:08:14.943 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/.snap/snap-subdir-test 2020-02-11T16:08:14.960 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/30 file after the snapshot 2020-02-11T16:08:14.961 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/31 file after the snapshot 2020-02-11T16:08:14.963 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/32 file after the snapshot 2020-02-11T16:08:14.965 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/33 file after the snapshot 2020-02-11T16:08:14.968 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/34 file after the snapshot 2020-02-11T16:08:14.969 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/35 file after the snapshot 2020-02-11T16:08:14.971 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/36 file after the snapshot 2020-02-11T16:08:14.973 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/37 file after the snapshot 2020-02-11T16:08:14.975 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/38 file after the snapshot 2020-02-11T16:08:14.977 INFO:tasks.workunit.client.0.smithi088.stdout: create 245/39 file after the snapshot 2020-02-11T16:08:14.979 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/.snap/snap-subdir-test 2020-02-11T16:08:14.999 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/30 file after the snapshot 2020-02-11T16:08:15.001 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/31 file after the snapshot 2020-02-11T16:08:15.003 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/32 file after the snapshot 2020-02-11T16:08:15.004 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/33 file after the snapshot 2020-02-11T16:08:15.016 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/34 file after the snapshot 2020-02-11T16:08:15.017 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/35 file after the snapshot 2020-02-11T16:08:15.017 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/36 file after the snapshot 2020-02-11T16:08:15.017 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/37 file after the snapshot 2020-02-11T16:08:15.017 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/38 file after the snapshot 2020-02-11T16:08:15.018 INFO:tasks.workunit.client.0.smithi088.stdout: create 246/39 file after the snapshot 2020-02-11T16:08:15.018 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/.snap/snap-subdir-test 2020-02-11T16:08:15.034 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/30 file after the snapshot 2020-02-11T16:08:15.036 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/31 file after the snapshot 2020-02-11T16:08:15.038 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/32 file after the snapshot 2020-02-11T16:08:15.039 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/33 file after the snapshot 2020-02-11T16:08:15.042 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/34 file after the snapshot 2020-02-11T16:08:15.044 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/35 file after the snapshot 2020-02-11T16:08:15.046 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/36 file after the snapshot 2020-02-11T16:08:15.047 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/37 file after the snapshot 2020-02-11T16:08:15.049 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/38 file after the snapshot 2020-02-11T16:08:15.051 INFO:tasks.workunit.client.0.smithi088.stdout: create 247/39 file after the snapshot 2020-02-11T16:08:15.053 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/.snap/snap-subdir-test 2020-02-11T16:08:15.072 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/30 file after the snapshot 2020-02-11T16:08:15.072 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/31 file after the snapshot 2020-02-11T16:08:15.073 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/32 file after the snapshot 2020-02-11T16:08:15.080 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/33 file after the snapshot 2020-02-11T16:08:15.080 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/34 file after the snapshot 2020-02-11T16:08:15.080 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/35 file after the snapshot 2020-02-11T16:08:15.081 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/36 file after the snapshot 2020-02-11T16:08:15.083 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/37 file after the snapshot 2020-02-11T16:08:15.085 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/38 file after the snapshot 2020-02-11T16:08:15.087 INFO:tasks.workunit.client.0.smithi088.stdout: create 248/39 file after the snapshot 2020-02-11T16:08:15.089 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/.snap/snap-subdir-test 2020-02-11T16:08:15.111 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/30 file after the snapshot 2020-02-11T16:08:15.113 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/31 file after the snapshot 2020-02-11T16:08:15.113 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/32 file after the snapshot 2020-02-11T16:08:15.113 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/33 file after the snapshot 2020-02-11T16:08:15.114 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/34 file after the snapshot 2020-02-11T16:08:15.114 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/35 file after the snapshot 2020-02-11T16:08:15.116 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/36 file after the snapshot 2020-02-11T16:08:15.118 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/37 file after the snapshot 2020-02-11T16:08:15.120 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/38 file after the snapshot 2020-02-11T16:08:15.121 INFO:tasks.workunit.client.0.smithi088.stdout: create 249/39 file after the snapshot 2020-02-11T16:08:15.123 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/.snap/snap-subdir-test 2020-02-11T16:08:15.141 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/30 file after the snapshot 2020-02-11T16:08:15.142 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/31 file after the snapshot 2020-02-11T16:08:15.145 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/32 file after the snapshot 2020-02-11T16:08:15.147 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/33 file after the snapshot 2020-02-11T16:08:15.149 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/34 file after the snapshot 2020-02-11T16:08:15.152 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/35 file after the snapshot 2020-02-11T16:08:15.154 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/36 file after the snapshot 2020-02-11T16:08:15.156 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/37 file after the snapshot 2020-02-11T16:08:15.158 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/38 file after the snapshot 2020-02-11T16:08:15.161 INFO:tasks.workunit.client.0.smithi088.stdout: create 250/39 file after the snapshot 2020-02-11T16:08:15.162 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/.snap/snap-subdir-test 2020-02-11T16:08:15.179 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/30 file after the snapshot 2020-02-11T16:08:15.180 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/31 file after the snapshot 2020-02-11T16:08:15.182 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/32 file after the snapshot 2020-02-11T16:08:15.184 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/33 file after the snapshot 2020-02-11T16:08:15.186 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/34 file after the snapshot 2020-02-11T16:08:15.188 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/35 file after the snapshot 2020-02-11T16:08:15.190 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/36 file after the snapshot 2020-02-11T16:08:15.192 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/37 file after the snapshot 2020-02-11T16:08:15.193 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/38 file after the snapshot 2020-02-11T16:08:15.196 INFO:tasks.workunit.client.0.smithi088.stdout: create 251/39 file after the snapshot 2020-02-11T16:08:15.197 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/.snap/snap-subdir-test 2020-02-11T16:08:15.214 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/30 file after the snapshot 2020-02-11T16:08:15.216 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/31 file after the snapshot 2020-02-11T16:08:15.217 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/32 file after the snapshot 2020-02-11T16:08:15.221 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/33 file after the snapshot 2020-02-11T16:08:15.221 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/34 file after the snapshot 2020-02-11T16:08:15.223 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/35 file after the snapshot 2020-02-11T16:08:15.225 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/36 file after the snapshot 2020-02-11T16:08:15.226 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/37 file after the snapshot 2020-02-11T16:08:15.229 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/38 file after the snapshot 2020-02-11T16:08:15.230 INFO:tasks.workunit.client.0.smithi088.stdout: create 252/39 file after the snapshot 2020-02-11T16:08:15.232 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/.snap/snap-subdir-test 2020-02-11T16:08:15.249 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/30 file after the snapshot 2020-02-11T16:08:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/31 file after the snapshot 2020-02-11T16:08:15.253 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/32 file after the snapshot 2020-02-11T16:08:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/33 file after the snapshot 2020-02-11T16:08:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/34 file after the snapshot 2020-02-11T16:08:15.258 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/35 file after the snapshot 2020-02-11T16:08:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/36 file after the snapshot 2020-02-11T16:08:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/37 file after the snapshot 2020-02-11T16:08:15.264 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/38 file after the snapshot 2020-02-11T16:08:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: create 253/39 file after the snapshot 2020-02-11T16:08:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/.snap/snap-subdir-test 2020-02-11T16:08:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/30 file after the snapshot 2020-02-11T16:08:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/31 file after the snapshot 2020-02-11T16:08:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/32 file after the snapshot 2020-02-11T16:08:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/33 file after the snapshot 2020-02-11T16:08:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/34 file after the snapshot 2020-02-11T16:08:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/35 file after the snapshot 2020-02-11T16:08:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/36 file after the snapshot 2020-02-11T16:08:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/37 file after the snapshot 2020-02-11T16:08:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/38 file after the snapshot 2020-02-11T16:08:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: create 254/39 file after the snapshot 2020-02-11T16:08:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/.snap/snap-subdir-test 2020-02-11T16:08:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/30 file after the snapshot 2020-02-11T16:08:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/31 file after the snapshot 2020-02-11T16:08:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/32 file after the snapshot 2020-02-11T16:08:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/33 file after the snapshot 2020-02-11T16:08:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/34 file after the snapshot 2020-02-11T16:08:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/35 file after the snapshot 2020-02-11T16:08:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/36 file after the snapshot 2020-02-11T16:08:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/37 file after the snapshot 2020-02-11T16:08:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/38 file after the snapshot 2020-02-11T16:08:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: create 255/39 file after the snapshot 2020-02-11T16:08:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/.snap/snap-subdir-test 2020-02-11T16:08:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/30 file after the snapshot 2020-02-11T16:08:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/31 file after the snapshot 2020-02-11T16:08:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/32 file after the snapshot 2020-02-11T16:08:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/33 file after the snapshot 2020-02-11T16:08:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/34 file after the snapshot 2020-02-11T16:08:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/35 file after the snapshot 2020-02-11T16:08:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/36 file after the snapshot 2020-02-11T16:08:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/37 file after the snapshot 2020-02-11T16:08:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/38 file after the snapshot 2020-02-11T16:08:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: create 256/39 file after the snapshot 2020-02-11T16:08:15.371 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/.snap/snap-subdir-test 2020-02-11T16:08:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/30 file after the snapshot 2020-02-11T16:08:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/31 file after the snapshot 2020-02-11T16:08:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/32 file after the snapshot 2020-02-11T16:08:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/33 file after the snapshot 2020-02-11T16:08:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/34 file after the snapshot 2020-02-11T16:08:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/35 file after the snapshot 2020-02-11T16:08:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/36 file after the snapshot 2020-02-11T16:08:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/37 file after the snapshot 2020-02-11T16:08:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/38 file after the snapshot 2020-02-11T16:08:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: create 257/39 file after the snapshot 2020-02-11T16:08:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/.snap/snap-subdir-test 2020-02-11T16:08:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/30 file after the snapshot 2020-02-11T16:08:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/31 file after the snapshot 2020-02-11T16:08:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/32 file after the snapshot 2020-02-11T16:08:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/33 file after the snapshot 2020-02-11T16:08:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/34 file after the snapshot 2020-02-11T16:08:15.431 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/35 file after the snapshot 2020-02-11T16:08:15.432 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/36 file after the snapshot 2020-02-11T16:08:15.434 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/37 file after the snapshot 2020-02-11T16:08:15.436 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/38 file after the snapshot 2020-02-11T16:08:15.438 INFO:tasks.workunit.client.0.smithi088.stdout: create 258/39 file after the snapshot 2020-02-11T16:08:15.440 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/.snap/snap-subdir-test 2020-02-11T16:08:15.456 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/30 file after the snapshot 2020-02-11T16:08:15.458 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/31 file after the snapshot 2020-02-11T16:08:15.459 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/32 file after the snapshot 2020-02-11T16:08:15.461 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/33 file after the snapshot 2020-02-11T16:08:15.549 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/34 file after the snapshot 2020-02-11T16:08:15.573 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/35 file after the snapshot 2020-02-11T16:08:15.574 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/36 file after the snapshot 2020-02-11T16:08:15.574 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/37 file after the snapshot 2020-02-11T16:08:15.574 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/38 file after the snapshot 2020-02-11T16:08:15.574 INFO:tasks.workunit.client.0.smithi088.stdout: create 259/39 file after the snapshot 2020-02-11T16:08:15.575 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/.snap/snap-subdir-test 2020-02-11T16:08:15.614 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/30 file after the snapshot 2020-02-11T16:08:15.615 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/31 file after the snapshot 2020-02-11T16:08:15.617 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/32 file after the snapshot 2020-02-11T16:08:15.619 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/33 file after the snapshot 2020-02-11T16:08:15.621 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/34 file after the snapshot 2020-02-11T16:08:15.623 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/35 file after the snapshot 2020-02-11T16:08:15.625 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/36 file after the snapshot 2020-02-11T16:08:15.627 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/37 file after the snapshot 2020-02-11T16:08:15.629 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/38 file after the snapshot 2020-02-11T16:08:15.630 INFO:tasks.workunit.client.0.smithi088.stdout: create 260/39 file after the snapshot 2020-02-11T16:08:15.632 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/.snap/snap-subdir-test 2020-02-11T16:08:15.652 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/30 file after the snapshot 2020-02-11T16:08:15.654 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/31 file after the snapshot 2020-02-11T16:08:15.655 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/32 file after the snapshot 2020-02-11T16:08:15.658 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/33 file after the snapshot 2020-02-11T16:08:15.659 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/34 file after the snapshot 2020-02-11T16:08:15.661 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/35 file after the snapshot 2020-02-11T16:08:15.663 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/36 file after the snapshot 2020-02-11T16:08:15.665 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/37 file after the snapshot 2020-02-11T16:08:15.667 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/38 file after the snapshot 2020-02-11T16:08:15.669 INFO:tasks.workunit.client.0.smithi088.stdout: create 261/39 file after the snapshot 2020-02-11T16:08:15.671 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/.snap/snap-subdir-test 2020-02-11T16:08:15.687 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/30 file after the snapshot 2020-02-11T16:08:15.688 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/31 file after the snapshot 2020-02-11T16:08:15.690 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/32 file after the snapshot 2020-02-11T16:08:15.693 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/33 file after the snapshot 2020-02-11T16:08:15.694 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/34 file after the snapshot 2020-02-11T16:08:15.696 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/35 file after the snapshot 2020-02-11T16:08:15.698 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/36 file after the snapshot 2020-02-11T16:08:15.700 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/37 file after the snapshot 2020-02-11T16:08:15.701 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/38 file after the snapshot 2020-02-11T16:08:15.703 INFO:tasks.workunit.client.0.smithi088.stdout: create 262/39 file after the snapshot 2020-02-11T16:08:15.705 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/.snap/snap-subdir-test 2020-02-11T16:08:15.725 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/30 file after the snapshot 2020-02-11T16:08:15.726 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/31 file after the snapshot 2020-02-11T16:08:15.729 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/32 file after the snapshot 2020-02-11T16:08:15.731 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/33 file after the snapshot 2020-02-11T16:08:15.733 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/34 file after the snapshot 2020-02-11T16:08:15.735 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/35 file after the snapshot 2020-02-11T16:08:15.737 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/36 file after the snapshot 2020-02-11T16:08:15.738 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/37 file after the snapshot 2020-02-11T16:08:15.741 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/38 file after the snapshot 2020-02-11T16:08:15.743 INFO:tasks.workunit.client.0.smithi088.stdout: create 263/39 file after the snapshot 2020-02-11T16:08:15.745 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/.snap/snap-subdir-test 2020-02-11T16:08:15.761 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/30 file after the snapshot 2020-02-11T16:08:15.763 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/31 file after the snapshot 2020-02-11T16:08:15.764 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/32 file after the snapshot 2020-02-11T16:08:15.766 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/33 file after the snapshot 2020-02-11T16:08:15.768 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/34 file after the snapshot 2020-02-11T16:08:15.772 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/35 file after the snapshot 2020-02-11T16:08:15.773 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/36 file after the snapshot 2020-02-11T16:08:15.775 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/37 file after the snapshot 2020-02-11T16:08:15.778 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/38 file after the snapshot 2020-02-11T16:08:15.779 INFO:tasks.workunit.client.0.smithi088.stdout: create 264/39 file after the snapshot 2020-02-11T16:08:15.781 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/.snap/snap-subdir-test 2020-02-11T16:08:15.796 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/30 file after the snapshot 2020-02-11T16:08:15.799 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/31 file after the snapshot 2020-02-11T16:08:15.801 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/32 file after the snapshot 2020-02-11T16:08:15.803 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/33 file after the snapshot 2020-02-11T16:08:15.805 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/34 file after the snapshot 2020-02-11T16:08:15.806 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/35 file after the snapshot 2020-02-11T16:08:15.809 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/36 file after the snapshot 2020-02-11T16:08:15.810 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/37 file after the snapshot 2020-02-11T16:08:15.812 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/38 file after the snapshot 2020-02-11T16:08:15.814 INFO:tasks.workunit.client.0.smithi088.stdout: create 265/39 file after the snapshot 2020-02-11T16:08:15.816 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/.snap/snap-subdir-test 2020-02-11T16:08:15.833 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/30 file after the snapshot 2020-02-11T16:08:15.834 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/31 file after the snapshot 2020-02-11T16:08:15.836 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/32 file after the snapshot 2020-02-11T16:08:15.841 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/33 file after the snapshot 2020-02-11T16:08:15.841 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/34 file after the snapshot 2020-02-11T16:08:15.842 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/35 file after the snapshot 2020-02-11T16:08:15.844 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/36 file after the snapshot 2020-02-11T16:08:15.846 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/37 file after the snapshot 2020-02-11T16:08:15.848 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/38 file after the snapshot 2020-02-11T16:08:15.850 INFO:tasks.workunit.client.0.smithi088.stdout: create 266/39 file after the snapshot 2020-02-11T16:08:15.852 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/.snap/snap-subdir-test 2020-02-11T16:08:15.868 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/30 file after the snapshot 2020-02-11T16:08:15.870 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/31 file after the snapshot 2020-02-11T16:08:15.871 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/32 file after the snapshot 2020-02-11T16:08:15.874 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/33 file after the snapshot 2020-02-11T16:08:15.876 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/34 file after the snapshot 2020-02-11T16:08:15.877 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/35 file after the snapshot 2020-02-11T16:08:15.879 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/36 file after the snapshot 2020-02-11T16:08:15.881 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/37 file after the snapshot 2020-02-11T16:08:15.883 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/38 file after the snapshot 2020-02-11T16:08:15.885 INFO:tasks.workunit.client.0.smithi088.stdout: create 267/39 file after the snapshot 2020-02-11T16:08:15.887 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/.snap/snap-subdir-test 2020-02-11T16:08:15.902 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/30 file after the snapshot 2020-02-11T16:08:15.904 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/31 file after the snapshot 2020-02-11T16:08:15.906 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/32 file after the snapshot 2020-02-11T16:08:15.908 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/33 file after the snapshot 2020-02-11T16:08:15.909 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/34 file after the snapshot 2020-02-11T16:08:15.912 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/35 file after the snapshot 2020-02-11T16:08:15.914 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/36 file after the snapshot 2020-02-11T16:08:15.916 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/37 file after the snapshot 2020-02-11T16:08:15.918 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/38 file after the snapshot 2020-02-11T16:08:15.919 INFO:tasks.workunit.client.0.smithi088.stdout: create 268/39 file after the snapshot 2020-02-11T16:08:15.922 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/.snap/snap-subdir-test 2020-02-11T16:08:15.937 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/30 file after the snapshot 2020-02-11T16:08:15.938 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/31 file after the snapshot 2020-02-11T16:08:15.940 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/32 file after the snapshot 2020-02-11T16:08:15.942 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/33 file after the snapshot 2020-02-11T16:08:15.944 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/34 file after the snapshot 2020-02-11T16:08:15.946 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/35 file after the snapshot 2020-02-11T16:08:15.948 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/36 file after the snapshot 2020-02-11T16:08:15.950 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/37 file after the snapshot 2020-02-11T16:08:15.952 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/38 file after the snapshot 2020-02-11T16:08:15.954 INFO:tasks.workunit.client.0.smithi088.stdout: create 269/39 file after the snapshot 2020-02-11T16:08:15.956 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/.snap/snap-subdir-test 2020-02-11T16:08:15.972 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/30 file after the snapshot 2020-02-11T16:08:15.973 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/31 file after the snapshot 2020-02-11T16:08:15.975 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/32 file after the snapshot 2020-02-11T16:08:15.977 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/33 file after the snapshot 2020-02-11T16:08:15.979 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/34 file after the snapshot 2020-02-11T16:08:15.981 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/35 file after the snapshot 2020-02-11T16:08:15.983 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/36 file after the snapshot 2020-02-11T16:08:15.986 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/37 file after the snapshot 2020-02-11T16:08:15.988 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/38 file after the snapshot 2020-02-11T16:08:15.990 INFO:tasks.workunit.client.0.smithi088.stdout: create 270/39 file after the snapshot 2020-02-11T16:08:15.992 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/.snap/snap-subdir-test 2020-02-11T16:08:16.007 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/30 file after the snapshot 2020-02-11T16:08:16.009 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/31 file after the snapshot 2020-02-11T16:08:16.010 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/32 file after the snapshot 2020-02-11T16:08:16.012 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/33 file after the snapshot 2020-02-11T16:08:16.015 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/34 file after the snapshot 2020-02-11T16:08:16.016 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/35 file after the snapshot 2020-02-11T16:08:16.018 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/36 file after the snapshot 2020-02-11T16:08:16.020 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/37 file after the snapshot 2020-02-11T16:08:16.022 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/38 file after the snapshot 2020-02-11T16:08:16.023 INFO:tasks.workunit.client.0.smithi088.stdout: create 271/39 file after the snapshot 2020-02-11T16:08:16.025 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/.snap/snap-subdir-test 2020-02-11T16:08:16.041 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/30 file after the snapshot 2020-02-11T16:08:16.042 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/31 file after the snapshot 2020-02-11T16:08:16.044 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/32 file after the snapshot 2020-02-11T16:08:16.046 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/33 file after the snapshot 2020-02-11T16:08:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/34 file after the snapshot 2020-02-11T16:08:16.050 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/35 file after the snapshot 2020-02-11T16:08:16.052 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/36 file after the snapshot 2020-02-11T16:08:16.054 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/37 file after the snapshot 2020-02-11T16:08:16.057 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/38 file after the snapshot 2020-02-11T16:08:16.058 INFO:tasks.workunit.client.0.smithi088.stdout: create 272/39 file after the snapshot 2020-02-11T16:08:16.061 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/.snap/snap-subdir-test 2020-02-11T16:08:16.078 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/30 file after the snapshot 2020-02-11T16:08:16.079 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/31 file after the snapshot 2020-02-11T16:08:16.081 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/32 file after the snapshot 2020-02-11T16:08:16.083 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/33 file after the snapshot 2020-02-11T16:08:16.085 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/34 file after the snapshot 2020-02-11T16:08:16.087 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/35 file after the snapshot 2020-02-11T16:08:16.089 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/36 file after the snapshot 2020-02-11T16:08:16.091 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/37 file after the snapshot 2020-02-11T16:08:16.093 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/38 file after the snapshot 2020-02-11T16:08:16.094 INFO:tasks.workunit.client.0.smithi088.stdout: create 273/39 file after the snapshot 2020-02-11T16:08:16.097 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/.snap/snap-subdir-test 2020-02-11T16:08:16.114 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/30 file after the snapshot 2020-02-11T16:08:16.116 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/31 file after the snapshot 2020-02-11T16:08:16.118 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/32 file after the snapshot 2020-02-11T16:08:16.120 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/33 file after the snapshot 2020-02-11T16:08:16.122 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/34 file after the snapshot 2020-02-11T16:08:16.123 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/35 file after the snapshot 2020-02-11T16:08:16.125 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/36 file after the snapshot 2020-02-11T16:08:16.127 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/37 file after the snapshot 2020-02-11T16:08:16.130 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/38 file after the snapshot 2020-02-11T16:08:16.132 INFO:tasks.workunit.client.0.smithi088.stdout: create 274/39 file after the snapshot 2020-02-11T16:08:16.134 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/.snap/snap-subdir-test 2020-02-11T16:08:16.149 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/30 file after the snapshot 2020-02-11T16:08:16.151 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/31 file after the snapshot 2020-02-11T16:08:16.153 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/32 file after the snapshot 2020-02-11T16:08:16.155 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/33 file after the snapshot 2020-02-11T16:08:16.157 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/34 file after the snapshot 2020-02-11T16:08:16.159 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/35 file after the snapshot 2020-02-11T16:08:16.161 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/36 file after the snapshot 2020-02-11T16:08:16.163 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/37 file after the snapshot 2020-02-11T16:08:16.165 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/38 file after the snapshot 2020-02-11T16:08:16.167 INFO:tasks.workunit.client.0.smithi088.stdout: create 275/39 file after the snapshot 2020-02-11T16:08:16.169 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/.snap/snap-subdir-test 2020-02-11T16:08:16.185 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/30 file after the snapshot 2020-02-11T16:08:16.186 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/31 file after the snapshot 2020-02-11T16:08:16.188 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/32 file after the snapshot 2020-02-11T16:08:16.190 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/33 file after the snapshot 2020-02-11T16:08:16.192 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/34 file after the snapshot 2020-02-11T16:08:16.194 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/35 file after the snapshot 2020-02-11T16:08:16.195 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/36 file after the snapshot 2020-02-11T16:08:16.197 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/37 file after the snapshot 2020-02-11T16:08:16.199 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/38 file after the snapshot 2020-02-11T16:08:16.201 INFO:tasks.workunit.client.0.smithi088.stdout: create 276/39 file after the snapshot 2020-02-11T16:08:16.203 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/.snap/snap-subdir-test 2020-02-11T16:08:16.218 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/30 file after the snapshot 2020-02-11T16:08:16.220 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/31 file after the snapshot 2020-02-11T16:08:16.222 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/32 file after the snapshot 2020-02-11T16:08:16.224 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/33 file after the snapshot 2020-02-11T16:08:16.226 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/34 file after the snapshot 2020-02-11T16:08:16.227 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/35 file after the snapshot 2020-02-11T16:08:16.229 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/36 file after the snapshot 2020-02-11T16:08:16.231 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/37 file after the snapshot 2020-02-11T16:08:16.233 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/38 file after the snapshot 2020-02-11T16:08:16.235 INFO:tasks.workunit.client.0.smithi088.stdout: create 277/39 file after the snapshot 2020-02-11T16:08:16.238 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/.snap/snap-subdir-test 2020-02-11T16:08:16.253 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/30 file after the snapshot 2020-02-11T16:08:16.254 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/31 file after the snapshot 2020-02-11T16:08:16.256 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/32 file after the snapshot 2020-02-11T16:08:16.258 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/33 file after the snapshot 2020-02-11T16:08:16.260 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/34 file after the snapshot 2020-02-11T16:08:16.262 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/35 file after the snapshot 2020-02-11T16:08:16.264 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/36 file after the snapshot 2020-02-11T16:08:16.266 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/37 file after the snapshot 2020-02-11T16:08:16.268 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/38 file after the snapshot 2020-02-11T16:08:16.270 INFO:tasks.workunit.client.0.smithi088.stdout: create 278/39 file after the snapshot 2020-02-11T16:08:16.272 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/.snap/snap-subdir-test 2020-02-11T16:08:16.291 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/30 file after the snapshot 2020-02-11T16:08:16.292 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/31 file after the snapshot 2020-02-11T16:08:16.295 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/32 file after the snapshot 2020-02-11T16:08:16.296 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/33 file after the snapshot 2020-02-11T16:08:16.298 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/34 file after the snapshot 2020-02-11T16:08:16.300 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/35 file after the snapshot 2020-02-11T16:08:16.303 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/36 file after the snapshot 2020-02-11T16:08:16.305 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/37 file after the snapshot 2020-02-11T16:08:16.309 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/38 file after the snapshot 2020-02-11T16:08:16.309 INFO:tasks.workunit.client.0.smithi088.stdout: create 279/39 file after the snapshot 2020-02-11T16:08:16.311 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/.snap/snap-subdir-test 2020-02-11T16:08:16.326 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/30 file after the snapshot 2020-02-11T16:08:16.328 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/31 file after the snapshot 2020-02-11T16:08:16.330 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/32 file after the snapshot 2020-02-11T16:08:16.332 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/33 file after the snapshot 2020-02-11T16:08:16.334 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/34 file after the snapshot 2020-02-11T16:08:16.336 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/35 file after the snapshot 2020-02-11T16:08:16.337 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/36 file after the snapshot 2020-02-11T16:08:16.339 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/37 file after the snapshot 2020-02-11T16:08:16.342 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/38 file after the snapshot 2020-02-11T16:08:16.343 INFO:tasks.workunit.client.0.smithi088.stdout: create 280/39 file after the snapshot 2020-02-11T16:08:16.345 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/.snap/snap-subdir-test 2020-02-11T16:08:16.361 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/30 file after the snapshot 2020-02-11T16:08:16.362 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/31 file after the snapshot 2020-02-11T16:08:16.364 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/32 file after the snapshot 2020-02-11T16:08:16.366 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/33 file after the snapshot 2020-02-11T16:08:16.368 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/34 file after the snapshot 2020-02-11T16:08:16.370 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/35 file after the snapshot 2020-02-11T16:08:16.372 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/36 file after the snapshot 2020-02-11T16:08:16.374 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/37 file after the snapshot 2020-02-11T16:08:16.376 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/38 file after the snapshot 2020-02-11T16:08:16.378 INFO:tasks.workunit.client.0.smithi088.stdout: create 281/39 file after the snapshot 2020-02-11T16:08:16.380 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/.snap/snap-subdir-test 2020-02-11T16:08:16.396 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/30 file after the snapshot 2020-02-11T16:08:16.398 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/31 file after the snapshot 2020-02-11T16:08:16.400 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/32 file after the snapshot 2020-02-11T16:08:16.402 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/33 file after the snapshot 2020-02-11T16:08:16.405 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/34 file after the snapshot 2020-02-11T16:08:16.406 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/35 file after the snapshot 2020-02-11T16:08:16.408 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/36 file after the snapshot 2020-02-11T16:08:16.410 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/37 file after the snapshot 2020-02-11T16:08:16.412 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/38 file after the snapshot 2020-02-11T16:08:16.414 INFO:tasks.workunit.client.0.smithi088.stdout: create 282/39 file after the snapshot 2020-02-11T16:08:16.415 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/.snap/snap-subdir-test 2020-02-11T16:08:16.431 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/30 file after the snapshot 2020-02-11T16:08:16.432 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/31 file after the snapshot 2020-02-11T16:08:16.434 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/32 file after the snapshot 2020-02-11T16:08:16.436 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/33 file after the snapshot 2020-02-11T16:08:16.438 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/34 file after the snapshot 2020-02-11T16:08:16.440 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/35 file after the snapshot 2020-02-11T16:08:16.442 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/36 file after the snapshot 2020-02-11T16:08:16.444 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/37 file after the snapshot 2020-02-11T16:08:16.446 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/38 file after the snapshot 2020-02-11T16:08:16.448 INFO:tasks.workunit.client.0.smithi088.stdout: create 283/39 file after the snapshot 2020-02-11T16:08:16.449 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/.snap/snap-subdir-test 2020-02-11T16:08:16.475 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/30 file after the snapshot 2020-02-11T16:08:16.577 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/31 file after the snapshot 2020-02-11T16:08:16.578 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/32 file after the snapshot 2020-02-11T16:08:16.581 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/33 file after the snapshot 2020-02-11T16:08:16.583 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/34 file after the snapshot 2020-02-11T16:08:16.585 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/35 file after the snapshot 2020-02-11T16:08:16.587 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/36 file after the snapshot 2020-02-11T16:08:16.589 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/37 file after the snapshot 2020-02-11T16:08:16.590 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/38 file after the snapshot 2020-02-11T16:08:16.592 INFO:tasks.workunit.client.0.smithi088.stdout: create 284/39 file after the snapshot 2020-02-11T16:08:16.594 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/.snap/snap-subdir-test 2020-02-11T16:08:16.634 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:08:16.635 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:08:16.635 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:08:16.635 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:08:16.639 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:08:16.639 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:08:16.640 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:08:16.661 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/30 file after the snapshot 2020-02-11T16:08:16.662 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/31 file after the snapshot 2020-02-11T16:08:16.664 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/32 file after the snapshot 2020-02-11T16:08:16.667 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/33 file after the snapshot 2020-02-11T16:08:16.669 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/34 file after the snapshot 2020-02-11T16:08:16.672 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/35 file after the snapshot 2020-02-11T16:08:16.674 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/36 file after the snapshot 2020-02-11T16:08:16.677 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/37 file after the snapshot 2020-02-11T16:08:16.680 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/38 file after the snapshot 2020-02-11T16:08:16.682 INFO:tasks.workunit.client.0.smithi088.stdout: create 285/39 file after the snapshot 2020-02-11T16:08:16.684 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/.snap/snap-subdir-test 2020-02-11T16:08:16.717 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/30 file after the snapshot 2020-02-11T16:08:16.719 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/31 file after the snapshot 2020-02-11T16:08:16.721 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/32 file after the snapshot 2020-02-11T16:08:16.723 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/33 file after the snapshot 2020-02-11T16:08:16.726 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/34 file after the snapshot 2020-02-11T16:08:16.729 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/35 file after the snapshot 2020-02-11T16:08:16.730 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/36 file after the snapshot 2020-02-11T16:08:16.733 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/37 file after the snapshot 2020-02-11T16:08:16.735 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/38 file after the snapshot 2020-02-11T16:08:16.738 INFO:tasks.workunit.client.0.smithi088.stdout: create 286/39 file after the snapshot 2020-02-11T16:08:16.740 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/.snap/snap-subdir-test 2020-02-11T16:08:16.756 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/30 file after the snapshot 2020-02-11T16:08:16.757 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/31 file after the snapshot 2020-02-11T16:08:16.759 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/32 file after the snapshot 2020-02-11T16:08:16.762 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/33 file after the snapshot 2020-02-11T16:08:16.764 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/34 file after the snapshot 2020-02-11T16:08:16.766 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/35 file after the snapshot 2020-02-11T16:08:16.768 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/36 file after the snapshot 2020-02-11T16:08:16.770 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/37 file after the snapshot 2020-02-11T16:08:16.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.770+0000 7f4dbbcb7700 1 Processor -- start 2020-02-11T16:08:16.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.771+0000 7f4dbbcb7700 1 -- start start 2020-02-11T16:08:16.773 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/38 file after the snapshot 2020-02-11T16:08:16.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.771+0000 7f4dbbcb7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 0x7f4db40a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:16.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.771+0000 7f4dbbcb7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db4138b20 con 0x7f4db41386e0 2020-02-11T16:08:16.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.771+0000 7f4dbbcb7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db413bfe0 con 0x7f4db4138280 2020-02-11T16:08:16.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.771+0000 7f4dbbcb7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4137bf0 con 0x7f4db40ad380 2020-02-11T16:08:16.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9252700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4db4138280 0x7f4db413b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40836/0 (socket says 172.21.15.88:40836) 2020-02-11T16:08:16.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9252700 1 -- 172.21.15.88:0/2441336365 learned_addr learned my addr 172.21.15.88:0/2441336365 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:16.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9a53700 1 --2- 172.21.15.88:0/2441336365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 0x7f4db40a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:16.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db8a51700 1 -- 172.21.15.88:0/2441336365 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708443490 0 0) 0x7f4dac001450 con 0x7f4db41386e0 2020-02-11T16:08:16.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db8a51700 1 -- 172.21.15.88:0/2441336365 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d9c003230 con 0x7f4db41386e0 2020-02-11T16:08:16.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9a53700 1 -- 172.21.15.88:0/2441336365 >> v1:172.21.15.88:6789/0 conn(0x7f4db4138280 legacy=0x7f4db413b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:16.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9a53700 1 -- 172.21.15.88:0/2441336365 >> v1:172.21.15.52:6789/0 conn(0x7f4db41386e0 legacy=0x7f4db413b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:16.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9a53700 1 -- 172.21.15.88:0/2441336365 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db40adb40 con 0x7f4db40ad380 2020-02-11T16:08:16.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9a53700 1 --2- 172.21.15.88:0/2441336365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 0x7f4db40a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4db0002f30 tx=0x7f4db00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9a53700 1 --2- 172.21.15.88:0/2441336365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 0x7f4db40a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4db0002f30 tx=0x7f4db00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9a53700 1 --2- 172.21.15.88:0/2441336365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 0x7f4db40a9130 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f4db0002f30 tx=0x7f4db00088e0).ready entity=mon.2 client_cookie=f4c4384ba98ab587 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:16.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9a53700 1 --2- 172.21.15.88:0/2441336365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 0x7f4db40a9130 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4db0002f30 tx=0x7f4db00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9a53700 1 --2- 172.21.15.88:0/2441336365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 0x7f4db40a9130 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4db0002f30 tx=0x7f4db00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db8a51700 1 -- 172.21.15.88:0/2441336365 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db0008e40 con 0x7f4db40ad380 2020-02-11T16:08:16.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db9a53700 1 --2- 172.21.15.88:0/2441336365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 0x7f4db40a9130 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4db0002f30 tx=0x7f4db00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db8a51700 1 -- 172.21.15.88:0/2441336365 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db00115f0 con 0x7f4db40ad380 2020-02-11T16:08:16.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.772+0000 7f4db8a51700 1 -- 172.21.15.88:0/2441336365 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db0011950 con 0x7f4db40ad380 2020-02-11T16:08:16.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.773+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2441336365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 msgr2=0x7f4db40a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:16.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.773+0000 7f4dbbcb7700 1 --2- 172.21.15.88:0/2441336365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 0x7f4db40a9130 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f4db0002f30 tx=0x7f4db00088e0).stop 2020-02-11T16:08:16.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.773+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2441336365 shutdown_connections 2020-02-11T16:08:16.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.773+0000 7f4dbbcb7700 1 --2- 172.21.15.88:0/2441336365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4db40ad380 0x7f4db40a9130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:16.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.773+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2441336365 >> 172.21.15.88:0/2441336365 conn(0x7f4db405ac70 msgr2=0x7f4db40ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:16.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.773+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2441336365 shutdown_connections 2020-02-11T16:08:16.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.773+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2441336365 wait complete. 2020-02-11T16:08:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.774+0000 7f4dbbcb7700 1 Processor -- start 2020-02-11T16:08:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.774+0000 7f4dbbcb7700 1 -- start start 2020-02-11T16:08:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4dbbcb7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4db4138280 0x7f4db4133d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4dbbcb7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4db41386e0 0x7f4db40a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4dbbcb7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db4138dc0 con 0x7f4db40ad380 2020-02-11T16:08:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4dbbcb7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40a68d0 con 0x7f4db4138280 2020-02-11T16:08:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4dbbcb7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40a5c40 con 0x7f4db41386e0 2020-02-11T16:08:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4db9a53700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4db40ad380 0x7f4db40a61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40842/0 (socket says 172.21.15.88:40842) 2020-02-11T16:08:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4db9a53700 1 -- 172.21.15.88:0/2948578773 learned_addr learned my addr 172.21.15.88:0/2948578773 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4dba254700 1 --2- 172.21.15.88:0/2948578773 >> v2:172.21.15.88:3300/0 conn(0x7f4db41386e0 0x7f4db40a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> v2:172.21.15.52:3300/0 conn(0x7f4db4138280 0x7f4db4133d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4dba254700 1 -- 172.21.15.88:0/2948578773 >> v2:172.21.15.88:3300/0 conn(0x7f4db41386e0 msgr2=0x7f4db40a7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:08:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4dba254700 1 -- 172.21.15.88:0/2948578773 >> v2:172.21.15.88:3300/0 conn(0x7f4db41386e0 msgr2=0x7f4db40a7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:08:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4dba254700 1 --2- 172.21.15.88:0/2948578773 >> v2:172.21.15.88:3300/0 conn(0x7f4db41386e0 0x7f4db40a7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:08:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4dba254700 1 --2- 172.21.15.88:0/2948578773 >> v2:172.21.15.88:3300/0 conn(0x7f4db41386e0 0x7f4db40a7f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4db9252700 1 -- 172.21.15.88:0/2948578773 >> v2:172.21.15.88:3300/0 conn(0x7f4db41386e0 msgr2=0x7f4db40a7f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:08:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> v2:172.21.15.88:3300/0 conn(0x7f4db41386e0 0x7f4db40a7f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4db9252700 1 -- 172.21.15.88:0/2948578773 >> v1:172.21.15.88:6789/0 conn(0x7f4db40ad380 legacy=0x7f4db40a61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4db9252700 1 -- 172.21.15.88:0/2948578773 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4132570 con 0x7f4db4138280 2020-02-11T16:08:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.775+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> v2:172.21.15.52:3300/0 conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> v2:172.21.15.52:3300/0 conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4da6ffd700 1 -- 172.21.15.88:0/2948578773 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da8005ca0 con 0x7f4db4138280 2020-02-11T16:08:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4da6ffd700 1 -- 172.21.15.88:0/2948578773 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da8005e00 con 0x7f4db4138280 2020-02-11T16:08:16.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4da6ffd700 1 -- 172.21.15.88:0/2948578773 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da80062b0 con 0x7f4db4138280 2020-02-11T16:08:16.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2948578773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db4134470 con 0x7f4db4138280 2020-02-11T16:08:16.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2948578773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db41349b0 con 0x7f4db4138280 2020-02-11T16:08:16.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.776+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.777+0000 7f4da6ffd700 1 -- 172.21.15.88:0/2948578773 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4da8006520 con 0x7f4db4138280 2020-02-11T16:08:16.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.777+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.777+0000 7f4da6ffd700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d94039c20 0x7f4d9403c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:16.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.777+0000 7f4da6ffd700 1 -- 172.21.15.88:0/2948578773 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4da80499c0 con 0x7f4db4138280 2020-02-11T16:08:16.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.777+0000 7f4db9a53700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d94039c20 0x7f4d9403c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:16.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.778+0000 7f4db9a53700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d94039c20 0x7f4d9403c0e0 crc :-1 s=READY pgs=148 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:16.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.778+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2948578773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db4134b70 con 0x7f4db4138280 2020-02-11T16:08:16.789 INFO:tasks.workunit.client.0.smithi088.stdout: create 287/39 file after the snapshot 2020-02-11T16:08:16.789 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/.snap/snap-subdir-test 2020-02-11T16:08:16.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.782+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:16.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:16.782+0000 7f4da6ffd700 1 -- 172.21.15.88:0/2948578773 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4da802ef60 con 0x7f4db4138280 2020-02-11T16:08:16.794 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/30 file after the snapshot 2020-02-11T16:08:16.799 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/31 file after the snapshot 2020-02-11T16:08:16.799 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/32 file after the snapshot 2020-02-11T16:08:16.800 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/33 file after the snapshot 2020-02-11T16:08:16.802 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/34 file after the snapshot 2020-02-11T16:08:16.804 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/35 file after the snapshot 2020-02-11T16:08:16.808 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/36 file after the snapshot 2020-02-11T16:08:16.809 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/37 file after the snapshot 2020-02-11T16:08:16.811 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/38 file after the snapshot 2020-02-11T16:08:16.813 INFO:tasks.workunit.client.0.smithi088.stdout: create 288/39 file after the snapshot 2020-02-11T16:08:16.816 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/.snap/snap-subdir-test 2020-02-11T16:08:16.833 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/30 file after the snapshot 2020-02-11T16:08:16.834 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/31 file after the snapshot 2020-02-11T16:08:16.836 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/32 file after the snapshot 2020-02-11T16:08:16.838 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/33 file after the snapshot 2020-02-11T16:08:16.840 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/34 file after the snapshot 2020-02-11T16:08:16.842 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/35 file after the snapshot 2020-02-11T16:08:16.845 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/36 file after the snapshot 2020-02-11T16:08:16.848 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/37 file after the snapshot 2020-02-11T16:08:16.849 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/38 file after the snapshot 2020-02-11T16:08:16.851 INFO:tasks.workunit.client.0.smithi088.stdout: create 289/39 file after the snapshot 2020-02-11T16:08:16.854 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/.snap/snap-subdir-test 2020-02-11T16:08:16.869 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/30 file after the snapshot 2020-02-11T16:08:16.871 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/31 file after the snapshot 2020-02-11T16:08:16.873 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/32 file after the snapshot 2020-02-11T16:08:16.875 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/33 file after the snapshot 2020-02-11T16:08:16.877 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/34 file after the snapshot 2020-02-11T16:08:16.879 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/35 file after the snapshot 2020-02-11T16:08:16.881 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/36 file after the snapshot 2020-02-11T16:08:16.883 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/37 file after the snapshot 2020-02-11T16:08:16.885 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/38 file after the snapshot 2020-02-11T16:08:16.887 INFO:tasks.workunit.client.0.smithi088.stdout: create 290/39 file after the snapshot 2020-02-11T16:08:16.890 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/.snap/snap-subdir-test 2020-02-11T16:08:16.904 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/30 file after the snapshot 2020-02-11T16:08:16.906 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/31 file after the snapshot 2020-02-11T16:08:16.908 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/32 file after the snapshot 2020-02-11T16:08:16.910 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/33 file after the snapshot 2020-02-11T16:08:16.912 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/34 file after the snapshot 2020-02-11T16:08:16.914 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/35 file after the snapshot 2020-02-11T16:08:16.915 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/36 file after the snapshot 2020-02-11T16:08:16.917 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/37 file after the snapshot 2020-02-11T16:08:16.919 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/38 file after the snapshot 2020-02-11T16:08:16.921 INFO:tasks.workunit.client.0.smithi088.stdout: create 291/39 file after the snapshot 2020-02-11T16:08:16.923 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/.snap/snap-subdir-test 2020-02-11T16:08:16.938 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/30 file after the snapshot 2020-02-11T16:08:16.940 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/31 file after the snapshot 2020-02-11T16:08:16.942 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/32 file after the snapshot 2020-02-11T16:08:16.944 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/33 file after the snapshot 2020-02-11T16:08:16.946 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/34 file after the snapshot 2020-02-11T16:08:16.948 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/35 file after the snapshot 2020-02-11T16:08:16.950 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/36 file after the snapshot 2020-02-11T16:08:16.952 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/37 file after the snapshot 2020-02-11T16:08:16.954 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/38 file after the snapshot 2020-02-11T16:08:16.957 INFO:tasks.workunit.client.0.smithi088.stdout: create 292/39 file after the snapshot 2020-02-11T16:08:16.959 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/.snap/snap-subdir-test 2020-02-11T16:08:16.998 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/30 file after the snapshot 2020-02-11T16:08:16.999 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/31 file after the snapshot 2020-02-11T16:08:17.001 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/32 file after the snapshot 2020-02-11T16:08:17.003 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/33 file after the snapshot 2020-02-11T16:08:17.005 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/34 file after the snapshot 2020-02-11T16:08:17.007 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/35 file after the snapshot 2020-02-11T16:08:17.009 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/36 file after the snapshot 2020-02-11T16:08:17.012 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/37 file after the snapshot 2020-02-11T16:08:17.013 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/38 file after the snapshot 2020-02-11T16:08:17.015 INFO:tasks.workunit.client.0.smithi088.stdout: create 293/39 file after the snapshot 2020-02-11T16:08:17.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:17.015+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2948578773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4db40565b0 con 0x7f4db4138280 2020-02-11T16:08:17.017 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/.snap/snap-subdir-test 2020-02-11T16:08:17.032 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/30 file after the snapshot 2020-02-11T16:08:17.033 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/31 file after the snapshot 2020-02-11T16:08:17.035 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/32 file after the snapshot 2020-02-11T16:08:17.037 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/33 file after the snapshot 2020-02-11T16:08:17.039 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/34 file after the snapshot 2020-02-11T16:08:17.041 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/35 file after the snapshot 2020-02-11T16:08:17.043 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/36 file after the snapshot 2020-02-11T16:08:17.045 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/37 file after the snapshot 2020-02-11T16:08:17.046 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/38 file after the snapshot 2020-02-11T16:08:17.048 INFO:tasks.workunit.client.0.smithi088.stdout: create 294/39 file after the snapshot 2020-02-11T16:08:17.050 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/.snap/snap-subdir-test 2020-02-11T16:08:17.066 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/30 file after the snapshot 2020-02-11T16:08:17.067 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/31 file after the snapshot 2020-02-11T16:08:17.069 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/32 file after the snapshot 2020-02-11T16:08:17.071 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/33 file after the snapshot 2020-02-11T16:08:17.073 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/34 file after the snapshot 2020-02-11T16:08:17.075 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/35 file after the snapshot 2020-02-11T16:08:17.077 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/36 file after the snapshot 2020-02-11T16:08:17.079 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/37 file after the snapshot 2020-02-11T16:08:17.081 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/38 file after the snapshot 2020-02-11T16:08:17.083 INFO:tasks.workunit.client.0.smithi088.stdout: create 295/39 file after the snapshot 2020-02-11T16:08:17.085 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/.snap/snap-subdir-test 2020-02-11T16:08:17.100 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/30 file after the snapshot 2020-02-11T16:08:17.102 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/31 file after the snapshot 2020-02-11T16:08:17.104 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/32 file after the snapshot 2020-02-11T16:08:17.106 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/33 file after the snapshot 2020-02-11T16:08:17.108 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/34 file after the snapshot 2020-02-11T16:08:17.110 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/35 file after the snapshot 2020-02-11T16:08:17.112 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/36 file after the snapshot 2020-02-11T16:08:17.114 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/37 file after the snapshot 2020-02-11T16:08:17.116 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/38 file after the snapshot 2020-02-11T16:08:17.118 INFO:tasks.workunit.client.0.smithi088.stdout: create 296/39 file after the snapshot 2020-02-11T16:08:17.119 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/.snap/snap-subdir-test 2020-02-11T16:08:17.134 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/30 file after the snapshot 2020-02-11T16:08:17.136 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/31 file after the snapshot 2020-02-11T16:08:17.138 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/32 file after the snapshot 2020-02-11T16:08:17.140 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/33 file after the snapshot 2020-02-11T16:08:17.142 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/34 file after the snapshot 2020-02-11T16:08:17.143 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/35 file after the snapshot 2020-02-11T16:08:17.145 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/36 file after the snapshot 2020-02-11T16:08:17.147 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/37 file after the snapshot 2020-02-11T16:08:17.149 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/38 file after the snapshot 2020-02-11T16:08:17.151 INFO:tasks.workunit.client.0.smithi088.stdout: create 297/39 file after the snapshot 2020-02-11T16:08:17.153 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/.snap/snap-subdir-test 2020-02-11T16:08:17.168 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/30 file after the snapshot 2020-02-11T16:08:17.170 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/31 file after the snapshot 2020-02-11T16:08:17.172 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/32 file after the snapshot 2020-02-11T16:08:17.174 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/33 file after the snapshot 2020-02-11T16:08:17.176 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/34 file after the snapshot 2020-02-11T16:08:17.178 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/35 file after the snapshot 2020-02-11T16:08:17.182 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/36 file after the snapshot 2020-02-11T16:08:17.183 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/37 file after the snapshot 2020-02-11T16:08:17.187 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/38 file after the snapshot 2020-02-11T16:08:17.188 INFO:tasks.workunit.client.0.smithi088.stdout: create 298/39 file after the snapshot 2020-02-11T16:08:17.188 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/.snap/snap-subdir-test 2020-02-11T16:08:17.201 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/30 file after the snapshot 2020-02-11T16:08:17.203 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/31 file after the snapshot 2020-02-11T16:08:17.204 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/32 file after the snapshot 2020-02-11T16:08:17.206 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/33 file after the snapshot 2020-02-11T16:08:17.208 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/34 file after the snapshot 2020-02-11T16:08:17.210 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/35 file after the snapshot 2020-02-11T16:08:17.212 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/36 file after the snapshot 2020-02-11T16:08:17.214 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/37 file after the snapshot 2020-02-11T16:08:17.216 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/38 file after the snapshot 2020-02-11T16:08:17.217 INFO:tasks.workunit.client.0.smithi088.stdout: create 299/39 file after the snapshot 2020-02-11T16:08:17.219 INFO:tasks.workunit.client.0.smithi088.stdout:Take second snapshot .snap/test2 2020-02-11T16:08:17.339 INFO:tasks.workunit.client.0.smithi088.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2020-02-11T16:08:18.957 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2020-02-11T16:08:18.958 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2020-02-11T16:08:18.958 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2020-02-11T16:08:18.958 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2020-02-11T16:08:18.958 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2020-02-11T16:08:18.958 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2020-02-11T16:08:18.958 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2020-02-11T16:08:18.959 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2020-02-11T16:08:18.959 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2020-02-11T16:08:18.959 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2020-02-11T16:08:18.959 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2020-02-11T16:08:18.959 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2020-02-11T16:08:18.959 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2020-02-11T16:08:18.959 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2020-02-11T16:08:18.960 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2020-02-11T16:08:18.960 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2020-02-11T16:08:18.960 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2020-02-11T16:08:18.960 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2020-02-11T16:08:18.960 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2020-02-11T16:08:18.960 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2020-02-11T16:08:18.961 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2020-02-11T16:08:18.961 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2020-02-11T16:08:18.961 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2020-02-11T16:08:18.961 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2020-02-11T16:08:18.961 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2020-02-11T16:08:18.962 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2020-02-11T16:08:18.962 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2020-02-11T16:08:18.962 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2020-02-11T16:08:18.962 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2020-02-11T16:08:18.962 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2020-02-11T16:08:18.962 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2020-02-11T16:08:18.962 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2020-02-11T16:08:18.962 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2020-02-11T16:08:18.963 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2020-02-11T16:08:18.963 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2020-02-11T16:08:18.963 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2020-02-11T16:08:18.963 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2020-02-11T16:08:18.963 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2020-02-11T16:08:18.963 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2020-02-11T16:08:18.963 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2020-02-11T16:08:18.964 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2020-02-11T16:08:18.964 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2020-02-11T16:08:18.964 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2020-02-11T16:08:18.964 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2020-02-11T16:08:18.964 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2020-02-11T16:08:18.964 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2020-02-11T16:08:18.964 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2020-02-11T16:08:18.965 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2020-02-11T16:08:18.965 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2020-02-11T16:08:18.965 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2020-02-11T16:08:18.965 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2020-02-11T16:08:18.965 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2020-02-11T16:08:18.965 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2020-02-11T16:08:18.966 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2020-02-11T16:08:18.966 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2020-02-11T16:08:18.966 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2020-02-11T16:08:18.966 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2020-02-11T16:08:18.966 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2020-02-11T16:08:18.966 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2020-02-11T16:08:18.966 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2020-02-11T16:08:18.967 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2020-02-11T16:08:18.967 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2020-02-11T16:08:18.967 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2020-02-11T16:08:18.967 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2020-02-11T16:08:18.968 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2020-02-11T16:08:18.968 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2020-02-11T16:08:18.968 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2020-02-11T16:08:18.968 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2020-02-11T16:08:18.968 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2020-02-11T16:08:18.968 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2020-02-11T16:08:18.969 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2020-02-11T16:08:18.969 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2020-02-11T16:08:18.969 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2020-02-11T16:08:18.969 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2020-02-11T16:08:18.969 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2020-02-11T16:08:18.969 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2020-02-11T16:08:18.969 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2020-02-11T16:08:18.970 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2020-02-11T16:08:18.970 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2020-02-11T16:08:18.970 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2020-02-11T16:08:18.970 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2020-02-11T16:08:19.676 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2020-02-11T16:08:19.676 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2020-02-11T16:08:19.676 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2020-02-11T16:08:19.676 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2020-02-11T16:08:19.676 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2020-02-11T16:08:19.676 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2020-02-11T16:08:19.677 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2020-02-11T16:08:19.677 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2020-02-11T16:08:19.677 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2020-02-11T16:08:19.677 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2020-02-11T16:08:19.677 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2020-02-11T16:08:19.677 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2020-02-11T16:08:19.677 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2020-02-11T16:08:19.678 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2020-02-11T16:08:19.678 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2020-02-11T16:08:19.678 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2020-02-11T16:08:19.678 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2020-02-11T16:08:19.678 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2020-02-11T16:08:19.678 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2020-02-11T16:08:19.678 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2020-02-11T16:08:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2020-02-11T16:08:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2020-02-11T16:08:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2020-02-11T16:08:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2020-02-11T16:08:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2020-02-11T16:08:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2020-02-11T16:08:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2020-02-11T16:08:19.680 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2020-02-11T16:08:19.680 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2020-02-11T16:08:19.680 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2020-02-11T16:08:19.680 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2020-02-11T16:08:19.680 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2020-02-11T16:08:19.680 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2020-02-11T16:08:19.680 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2020-02-11T16:08:19.681 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2020-02-11T16:08:19.681 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2020-02-11T16:08:19.681 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2020-02-11T16:08:19.682 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2020-02-11T16:08:19.682 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2020-02-11T16:08:19.682 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2020-02-11T16:08:19.682 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2020-02-11T16:08:19.682 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2020-02-11T16:08:19.682 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2020-02-11T16:08:19.682 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2020-02-11T16:08:19.682 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2020-02-11T16:08:19.683 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2020-02-11T16:08:19.683 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2020-02-11T16:08:19.683 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2020-02-11T16:08:19.683 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2020-02-11T16:08:19.683 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2020-02-11T16:08:19.683 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2020-02-11T16:08:19.683 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2020-02-11T16:08:19.684 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2020-02-11T16:08:19.684 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2020-02-11T16:08:19.684 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2020-02-11T16:08:19.684 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2020-02-11T16:08:19.684 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2020-02-11T16:08:19.685 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2020-02-11T16:08:19.685 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2020-02-11T16:08:19.685 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2020-02-11T16:08:19.685 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2020-02-11T16:08:19.685 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2020-02-11T16:08:19.685 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2020-02-11T16:08:19.686 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2020-02-11T16:08:19.686 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2020-02-11T16:08:19.686 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2020-02-11T16:08:19.686 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2020-02-11T16:08:19.686 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2020-02-11T16:08:19.686 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2020-02-11T16:08:19.686 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2020-02-11T16:08:19.686 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2020-02-11T16:08:19.687 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2020-02-11T16:08:19.687 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2020-02-11T16:08:19.687 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2020-02-11T16:08:19.687 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2020-02-11T16:08:19.688 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2020-02-11T16:08:19.688 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2020-02-11T16:08:19.688 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2020-02-11T16:08:19.688 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2020-02-11T16:08:19.688 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2020-02-11T16:08:19.689 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2020-02-11T16:08:20.243 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2020-02-11T16:08:20.243 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2020-02-11T16:08:20.243 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2020-02-11T16:08:20.243 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2020-02-11T16:08:20.244 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2020-02-11T16:08:20.244 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2020-02-11T16:08:20.244 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2020-02-11T16:08:20.244 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2020-02-11T16:08:20.245 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2020-02-11T16:08:20.245 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2020-02-11T16:08:20.245 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2020-02-11T16:08:20.245 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2020-02-11T16:08:20.246 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2020-02-11T16:08:20.246 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2020-02-11T16:08:20.246 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2020-02-11T16:08:20.246 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2020-02-11T16:08:20.246 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2020-02-11T16:08:20.247 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2020-02-11T16:08:20.247 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2020-02-11T16:08:20.247 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2020-02-11T16:08:20.247 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2020-02-11T16:08:20.248 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2020-02-11T16:08:20.248 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2020-02-11T16:08:20.248 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2020-02-11T16:08:20.248 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2020-02-11T16:08:20.249 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2020-02-11T16:08:20.249 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2020-02-11T16:08:20.249 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2020-02-11T16:08:20.249 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2020-02-11T16:08:20.249 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2020-02-11T16:08:20.250 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2020-02-11T16:08:20.250 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2020-02-11T16:08:20.250 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2020-02-11T16:08:20.250 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2020-02-11T16:08:20.251 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2020-02-11T16:08:20.251 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2020-02-11T16:08:20.251 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2020-02-11T16:08:20.251 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2020-02-11T16:08:20.252 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2020-02-11T16:08:20.252 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2020-02-11T16:08:20.252 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2020-02-11T16:08:20.252 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2020-02-11T16:08:20.252 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2020-02-11T16:08:20.253 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2020-02-11T16:08:20.253 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2020-02-11T16:08:20.253 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2020-02-11T16:08:20.253 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2020-02-11T16:08:20.254 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2020-02-11T16:08:20.254 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2020-02-11T16:08:20.254 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2020-02-11T16:08:20.254 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2020-02-11T16:08:20.254 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2020-02-11T16:08:20.255 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2020-02-11T16:08:20.255 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2020-02-11T16:08:20.255 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2020-02-11T16:08:20.255 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2020-02-11T16:08:20.256 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2020-02-11T16:08:20.256 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2020-02-11T16:08:20.256 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2020-02-11T16:08:20.256 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2020-02-11T16:08:20.256 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2020-02-11T16:08:20.257 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2020-02-11T16:08:20.257 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2020-02-11T16:08:20.257 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2020-02-11T16:08:20.257 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2020-02-11T16:08:20.258 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2020-02-11T16:08:20.258 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2020-02-11T16:08:20.258 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2020-02-11T16:08:20.258 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2020-02-11T16:08:20.258 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2020-02-11T16:08:20.259 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2020-02-11T16:08:20.259 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2020-02-11T16:08:20.259 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2020-02-11T16:08:20.259 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2020-02-11T16:08:20.260 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2020-02-11T16:08:20.260 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2020-02-11T16:08:20.260 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2020-02-11T16:08:20.260 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2020-02-11T16:08:20.260 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2020-02-11T16:08:20.261 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2020-02-11T16:08:20.261 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2020-02-11T16:08:21.030 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2020-02-11T16:08:21.030 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2020-02-11T16:08:21.030 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2020-02-11T16:08:21.030 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2020-02-11T16:08:21.030 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2020-02-11T16:08:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2020-02-11T16:08:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2020-02-11T16:08:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2020-02-11T16:08:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2020-02-11T16:08:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2020-02-11T16:08:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2020-02-11T16:08:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2020-02-11T16:08:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2020-02-11T16:08:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2020-02-11T16:08:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2020-02-11T16:08:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2020-02-11T16:08:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2020-02-11T16:08:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2020-02-11T16:08:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2020-02-11T16:08:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2020-02-11T16:08:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2020-02-11T16:08:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2020-02-11T16:08:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2020-02-11T16:08:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2020-02-11T16:08:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2020-02-11T16:08:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2020-02-11T16:08:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2020-02-11T16:08:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2020-02-11T16:08:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2020-02-11T16:08:21.037 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2020-02-11T16:08:21.037 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2020-02-11T16:08:21.038 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2020-02-11T16:08:21.038 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2020-02-11T16:08:21.038 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2020-02-11T16:08:21.038 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2020-02-11T16:08:21.041 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2020-02-11T16:08:21.041 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2020-02-11T16:08:21.041 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2020-02-11T16:08:21.041 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2020-02-11T16:08:21.042 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2020-02-11T16:08:21.042 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2020-02-11T16:08:21.042 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2020-02-11T16:08:21.042 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2020-02-11T16:08:21.042 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2020-02-11T16:08:21.043 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2020-02-11T16:08:21.043 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2020-02-11T16:08:21.043 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2020-02-11T16:08:21.043 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2020-02-11T16:08:21.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2020-02-11T16:08:21.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2020-02-11T16:08:21.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2020-02-11T16:08:21.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2020-02-11T16:08:21.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2020-02-11T16:08:21.045 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2020-02-11T16:08:21.045 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2020-02-11T16:08:21.045 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2020-02-11T16:08:21.045 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2020-02-11T16:08:21.046 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2020-02-11T16:08:21.046 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2020-02-11T16:08:21.046 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2020-02-11T16:08:21.047 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2020-02-11T16:08:21.047 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2020-02-11T16:08:21.047 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2020-02-11T16:08:21.047 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2020-02-11T16:08:21.047 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2020-02-11T16:08:21.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2020-02-11T16:08:21.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2020-02-11T16:08:21.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2020-02-11T16:08:21.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2020-02-11T16:08:21.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2020-02-11T16:08:21.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2020-02-11T16:08:21.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2020-02-11T16:08:21.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2020-02-11T16:08:21.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2020-02-11T16:08:21.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2020-02-11T16:08:21.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2020-02-11T16:08:21.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2020-02-11T16:08:21.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2020-02-11T16:08:21.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2020-02-11T16:08:21.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2020-02-11T16:08:21.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2020-02-11T16:08:21.766 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2020-02-11T16:08:21.766 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2020-02-11T16:08:21.766 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2020-02-11T16:08:21.766 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2020-02-11T16:08:21.767 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2020-02-11T16:08:21.767 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2020-02-11T16:08:21.767 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2020-02-11T16:08:21.767 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2020-02-11T16:08:21.769 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2020-02-11T16:08:21.769 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2020-02-11T16:08:21.769 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2020-02-11T16:08:21.770 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2020-02-11T16:08:21.770 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2020-02-11T16:08:21.770 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2020-02-11T16:08:21.770 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2020-02-11T16:08:21.770 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2020-02-11T16:08:21.770 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2020-02-11T16:08:21.771 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2020-02-11T16:08:21.771 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2020-02-11T16:08:21.771 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2020-02-11T16:08:21.771 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2020-02-11T16:08:21.771 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2020-02-11T16:08:21.772 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2020-02-11T16:08:21.772 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2020-02-11T16:08:21.772 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2020-02-11T16:08:21.772 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2020-02-11T16:08:21.772 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2020-02-11T16:08:21.772 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2020-02-11T16:08:21.773 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2020-02-11T16:08:21.773 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2020-02-11T16:08:21.773 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2020-02-11T16:08:21.773 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2020-02-11T16:08:21.773 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2020-02-11T16:08:21.773 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2020-02-11T16:08:21.774 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2020-02-11T16:08:21.774 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2020-02-11T16:08:21.774 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2020-02-11T16:08:21.774 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2020-02-11T16:08:21.774 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2020-02-11T16:08:21.774 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2020-02-11T16:08:21.775 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2020-02-11T16:08:21.775 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2020-02-11T16:08:21.775 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2020-02-11T16:08:21.775 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2020-02-11T16:08:21.775 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2020-02-11T16:08:21.775 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2020-02-11T16:08:21.775 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2020-02-11T16:08:21.776 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2020-02-11T16:08:21.776 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2020-02-11T16:08:21.776 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2020-02-11T16:08:21.776 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2020-02-11T16:08:21.776 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2020-02-11T16:08:21.776 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2020-02-11T16:08:21.776 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2020-02-11T16:08:21.777 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2020-02-11T16:08:21.777 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2020-02-11T16:08:21.777 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2020-02-11T16:08:21.777 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2020-02-11T16:08:21.777 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2020-02-11T16:08:21.777 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2020-02-11T16:08:21.778 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2020-02-11T16:08:21.778 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2020-02-11T16:08:21.778 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2020-02-11T16:08:21.778 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2020-02-11T16:08:21.778 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2020-02-11T16:08:21.778 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2020-02-11T16:08:21.778 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2020-02-11T16:08:21.779 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2020-02-11T16:08:21.779 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2020-02-11T16:08:21.779 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2020-02-11T16:08:21.779 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2020-02-11T16:08:21.779 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2020-02-11T16:08:21.779 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2020-02-11T16:08:21.780 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2020-02-11T16:08:21.780 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2020-02-11T16:08:21.780 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2020-02-11T16:08:21.780 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2020-02-11T16:08:21.780 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2020-02-11T16:08:21.780 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2020-02-11T16:08:21.781 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2020-02-11T16:08:21.781 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2020-02-11T16:08:21.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.958+0000 7f4db9252700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:21.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.958+0000 7f4da6ffd700 1 -- 172.21.15.88:0/2948578773 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7f4da8031a50 con 0x7f4db4138280 2020-02-11T16:08:21.961 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":36,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:21.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d94039c20 msgr2=0x7f4d9403c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:21.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d94039c20 0x7f4d9403c0e0 crc :-1 s=READY pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:21.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 msgr2=0x7f4db4133d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:21.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 0x7f4db4133d40 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f4db413c170 tx=0x7f4da8010920).stop 2020-02-11T16:08:21.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2948578773 shutdown_connections 2020-02-11T16:08:21.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 --2- 172.21.15.88:0/2948578773 >> v2:172.21.15.88:3300/0 conn(0x7f4db41386e0 0x7f4db40a7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:21.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d94039c20 0x7f4d9403c0e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:21.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 --2- 172.21.15.88:0/2948578773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db4138280 0x7f4db4133d40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:21.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2948578773 >> 172.21.15.88:0/2948578773 conn(0x7f4db405ac70 msgr2=0x7f4db4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:21.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2948578773 shutdown_connections 2020-02-11T16:08:21.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:21.960+0000 7f4dbbcb7700 1 -- 172.21.15.88:0/2948578773 wait complete. 2020-02-11T16:08:21.975 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":36,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:22.350 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2020-02-11T16:08:22.350 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2020-02-11T16:08:22.350 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2020-02-11T16:08:22.351 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2020-02-11T16:08:22.351 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2020-02-11T16:08:22.351 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2020-02-11T16:08:22.351 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2020-02-11T16:08:22.351 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2020-02-11T16:08:22.351 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2020-02-11T16:08:22.351 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2020-02-11T16:08:22.351 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2020-02-11T16:08:22.352 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2020-02-11T16:08:22.352 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2020-02-11T16:08:22.352 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2020-02-11T16:08:22.352 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2020-02-11T16:08:22.352 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2020-02-11T16:08:22.352 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2020-02-11T16:08:22.352 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2020-02-11T16:08:22.353 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2020-02-11T16:08:22.353 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2020-02-11T16:08:22.353 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2020-02-11T16:08:22.353 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2020-02-11T16:08:22.353 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2020-02-11T16:08:22.353 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2020-02-11T16:08:22.354 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2020-02-11T16:08:22.354 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2020-02-11T16:08:22.354 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2020-02-11T16:08:22.354 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2020-02-11T16:08:22.354 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2020-02-11T16:08:22.354 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2020-02-11T16:08:22.355 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2020-02-11T16:08:22.355 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2020-02-11T16:08:22.355 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2020-02-11T16:08:22.355 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2020-02-11T16:08:22.355 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2020-02-11T16:08:22.355 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2020-02-11T16:08:22.355 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2020-02-11T16:08:22.356 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2020-02-11T16:08:22.358 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2020-02-11T16:08:22.358 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2020-02-11T16:08:22.359 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2020-02-11T16:08:22.359 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2020-02-11T16:08:22.360 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2020-02-11T16:08:22.360 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2020-02-11T16:08:22.360 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2020-02-11T16:08:22.360 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2020-02-11T16:08:22.360 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2020-02-11T16:08:22.360 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2020-02-11T16:08:22.360 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2020-02-11T16:08:22.361 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2020-02-11T16:08:22.361 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2020-02-11T16:08:22.361 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2020-02-11T16:08:22.361 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2020-02-11T16:08:22.361 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2020-02-11T16:08:22.361 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2020-02-11T16:08:22.361 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2020-02-11T16:08:22.362 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2020-02-11T16:08:22.362 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2020-02-11T16:08:22.362 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2020-02-11T16:08:22.362 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2020-02-11T16:08:22.362 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2020-02-11T16:08:22.362 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2020-02-11T16:08:22.362 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2020-02-11T16:08:22.371 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2020-02-11T16:08:22.371 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2020-02-11T16:08:22.371 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2020-02-11T16:08:22.371 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2020-02-11T16:08:22.371 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2020-02-11T16:08:22.372 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2020-02-11T16:08:22.372 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2020-02-11T16:08:22.372 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2020-02-11T16:08:22.372 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2020-02-11T16:08:22.372 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2020-02-11T16:08:22.372 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2020-02-11T16:08:22.372 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2020-02-11T16:08:22.373 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2020-02-11T16:08:22.373 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2020-02-11T16:08:22.373 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2020-02-11T16:08:22.373 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2020-02-11T16:08:22.373 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2020-02-11T16:08:22.373 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2020-02-11T16:08:23.043 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2020-02-11T16:08:23.043 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2020-02-11T16:08:23.043 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2020-02-11T16:08:23.043 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2020-02-11T16:08:23.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2020-02-11T16:08:23.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2020-02-11T16:08:23.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2020-02-11T16:08:23.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2020-02-11T16:08:23.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2020-02-11T16:08:23.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2020-02-11T16:08:23.044 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2020-02-11T16:08:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2020-02-11T16:08:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2020-02-11T16:08:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2020-02-11T16:08:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2020-02-11T16:08:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2020-02-11T16:08:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2020-02-11T16:08:23.046 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2020-02-11T16:08:23.046 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2020-02-11T16:08:23.046 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2020-02-11T16:08:23.046 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2020-02-11T16:08:23.046 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2020-02-11T16:08:23.046 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2020-02-11T16:08:23.046 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2020-02-11T16:08:23.047 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2020-02-11T16:08:23.047 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2020-02-11T16:08:23.047 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2020-02-11T16:08:23.047 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2020-02-11T16:08:23.047 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2020-02-11T16:08:23.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2020-02-11T16:08:23.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2020-02-11T16:08:23.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2020-02-11T16:08:23.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2020-02-11T16:08:23.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2020-02-11T16:08:23.048 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2020-02-11T16:08:23.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2020-02-11T16:08:23.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2020-02-11T16:08:23.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2020-02-11T16:08:23.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2020-02-11T16:08:23.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2020-02-11T16:08:23.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2020-02-11T16:08:23.049 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2020-02-11T16:08:23.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2020-02-11T16:08:23.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2020-02-11T16:08:23.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2020-02-11T16:08:23.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2020-02-11T16:08:23.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2020-02-11T16:08:23.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2020-02-11T16:08:23.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2020-02-11T16:08:23.050 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2020-02-11T16:08:23.051 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2020-02-11T16:08:23.051 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2020-02-11T16:08:23.051 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2020-02-11T16:08:23.051 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2020-02-11T16:08:23.051 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2020-02-11T16:08:23.051 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2020-02-11T16:08:23.051 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2020-02-11T16:08:23.052 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2020-02-11T16:08:23.052 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2020-02-11T16:08:23.052 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2020-02-11T16:08:23.052 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2020-02-11T16:08:23.052 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2020-02-11T16:08:23.052 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2020-02-11T16:08:23.053 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2020-02-11T16:08:23.053 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2020-02-11T16:08:23.053 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2020-02-11T16:08:23.053 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2020-02-11T16:08:23.053 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2020-02-11T16:08:23.053 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2020-02-11T16:08:23.054 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2020-02-11T16:08:23.054 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2020-02-11T16:08:23.054 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2020-02-11T16:08:23.054 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2020-02-11T16:08:23.054 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2020-02-11T16:08:23.055 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2020-02-11T16:08:23.055 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2020-02-11T16:08:23.055 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2020-02-11T16:08:23.055 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2020-02-11T16:08:23.055 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2020-02-11T16:08:23.055 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2020-02-11T16:08:23.055 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2020-02-11T16:08:23.056 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2020-02-11T16:08:23.641 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2020-02-11T16:08:23.641 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2020-02-11T16:08:23.641 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2020-02-11T16:08:23.641 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2020-02-11T16:08:23.641 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2020-02-11T16:08:23.642 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2020-02-11T16:08:23.642 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2020-02-11T16:08:23.642 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2020-02-11T16:08:23.642 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2020-02-11T16:08:23.642 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2020-02-11T16:08:23.642 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2020-02-11T16:08:23.643 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2020-02-11T16:08:23.643 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2020-02-11T16:08:23.643 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2020-02-11T16:08:23.643 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2020-02-11T16:08:23.643 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2020-02-11T16:08:23.643 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2020-02-11T16:08:23.643 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2020-02-11T16:08:23.644 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2020-02-11T16:08:23.644 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2020-02-11T16:08:23.644 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2020-02-11T16:08:23.644 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2020-02-11T16:08:23.644 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2020-02-11T16:08:23.644 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2020-02-11T16:08:23.644 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2020-02-11T16:08:23.645 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2020-02-11T16:08:23.645 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2020-02-11T16:08:23.645 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2020-02-11T16:08:23.645 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2020-02-11T16:08:23.645 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2020-02-11T16:08:23.645 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2020-02-11T16:08:23.645 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2020-02-11T16:08:23.646 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2020-02-11T16:08:23.646 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2020-02-11T16:08:23.646 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2020-02-11T16:08:23.646 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2020-02-11T16:08:23.646 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2020-02-11T16:08:23.646 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2020-02-11T16:08:23.646 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2020-02-11T16:08:23.646 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2020-02-11T16:08:23.647 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2020-02-11T16:08:23.647 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2020-02-11T16:08:23.647 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2020-02-11T16:08:23.647 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2020-02-11T16:08:23.647 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2020-02-11T16:08:23.647 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2020-02-11T16:08:23.647 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2020-02-11T16:08:23.648 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2020-02-11T16:08:23.648 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2020-02-11T16:08:23.648 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2020-02-11T16:08:23.648 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2020-02-11T16:08:23.648 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2020-02-11T16:08:23.648 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2020-02-11T16:08:23.649 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2020-02-11T16:08:23.649 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2020-02-11T16:08:23.649 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2020-02-11T16:08:23.649 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2020-02-11T16:08:23.649 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2020-02-11T16:08:23.650 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2020-02-11T16:08:23.650 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2020-02-11T16:08:23.650 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2020-02-11T16:08:23.650 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2020-02-11T16:08:23.650 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2020-02-11T16:08:23.650 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2020-02-11T16:08:23.650 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2020-02-11T16:08:23.651 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2020-02-11T16:08:23.651 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2020-02-11T16:08:23.651 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2020-02-11T16:08:23.651 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2020-02-11T16:08:23.651 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2020-02-11T16:08:23.651 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2020-02-11T16:08:23.651 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2020-02-11T16:08:23.651 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2020-02-11T16:08:23.652 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2020-02-11T16:08:23.652 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2020-02-11T16:08:23.652 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2020-02-11T16:08:23.652 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2020-02-11T16:08:23.652 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2020-02-11T16:08:23.652 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2020-02-11T16:08:23.652 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2020-02-11T16:08:23.653 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2020-02-11T16:08:24.209 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2020-02-11T16:08:24.210 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2020-02-11T16:08:24.210 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2020-02-11T16:08:24.210 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2020-02-11T16:08:24.210 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2020-02-11T16:08:24.210 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2020-02-11T16:08:24.210 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2020-02-11T16:08:24.211 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2020-02-11T16:08:24.211 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2020-02-11T16:08:24.211 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2020-02-11T16:08:24.211 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2020-02-11T16:08:24.211 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2020-02-11T16:08:24.211 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2020-02-11T16:08:24.211 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2020-02-11T16:08:24.212 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2020-02-11T16:08:24.212 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2020-02-11T16:08:24.212 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2020-02-11T16:08:24.212 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2020-02-11T16:08:24.212 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2020-02-11T16:08:24.212 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2020-02-11T16:08:24.212 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2020-02-11T16:08:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2020-02-11T16:08:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2020-02-11T16:08:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2020-02-11T16:08:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2020-02-11T16:08:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2020-02-11T16:08:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2020-02-11T16:08:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2020-02-11T16:08:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2020-02-11T16:08:24.214 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2020-02-11T16:08:24.214 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2020-02-11T16:08:24.214 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2020-02-11T16:08:24.214 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2020-02-11T16:08:24.214 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2020-02-11T16:08:24.214 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2020-02-11T16:08:24.214 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2020-02-11T16:08:24.215 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2020-02-11T16:08:24.215 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2020-02-11T16:08:24.215 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2020-02-11T16:08:24.215 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2020-02-11T16:08:24.215 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2020-02-11T16:08:24.215 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2020-02-11T16:08:24.215 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2020-02-11T16:08:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2020-02-11T16:08:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2020-02-11T16:08:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2020-02-11T16:08:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2020-02-11T16:08:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2020-02-11T16:08:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2020-02-11T16:08:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2020-02-11T16:08:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2020-02-11T16:08:24.217 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2020-02-11T16:08:24.217 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2020-02-11T16:08:24.217 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2020-02-11T16:08:24.217 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2020-02-11T16:08:24.217 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2020-02-11T16:08:24.217 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2020-02-11T16:08:24.217 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2020-02-11T16:08:24.218 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2020-02-11T16:08:24.218 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2020-02-11T16:08:24.218 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2020-02-11T16:08:24.218 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2020-02-11T16:08:24.218 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2020-02-11T16:08:24.218 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2020-02-11T16:08:24.219 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2020-02-11T16:08:24.219 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2020-02-11T16:08:24.220 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2020-02-11T16:08:24.220 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2020-02-11T16:08:24.220 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2020-02-11T16:08:24.220 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2020-02-11T16:08:24.220 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2020-02-11T16:08:24.220 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2020-02-11T16:08:24.220 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2020-02-11T16:08:24.220 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2020-02-11T16:08:24.221 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2020-02-11T16:08:24.221 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2020-02-11T16:08:24.221 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2020-02-11T16:08:24.221 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2020-02-11T16:08:24.221 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2020-02-11T16:08:24.221 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2020-02-11T16:08:24.221 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2020-02-11T16:08:24.857 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2020-02-11T16:08:24.857 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2020-02-11T16:08:24.857 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2020-02-11T16:08:24.857 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2020-02-11T16:08:24.857 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2020-02-11T16:08:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2020-02-11T16:08:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2020-02-11T16:08:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2020-02-11T16:08:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2020-02-11T16:08:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2020-02-11T16:08:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2020-02-11T16:08:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2020-02-11T16:08:24.859 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2020-02-11T16:08:24.859 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2020-02-11T16:08:24.859 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2020-02-11T16:08:24.859 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2020-02-11T16:08:24.859 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2020-02-11T16:08:24.859 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2020-02-11T16:08:24.859 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2020-02-11T16:08:24.860 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2020-02-11T16:08:24.860 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2020-02-11T16:08:24.860 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2020-02-11T16:08:24.860 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2020-02-11T16:08:24.860 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2020-02-11T16:08:24.860 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2020-02-11T16:08:24.860 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2020-02-11T16:08:24.861 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2020-02-11T16:08:24.861 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2020-02-11T16:08:24.861 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2020-02-11T16:08:24.861 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2020-02-11T16:08:24.861 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2020-02-11T16:08:24.861 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2020-02-11T16:08:24.861 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2020-02-11T16:08:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2020-02-11T16:08:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2020-02-11T16:08:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2020-02-11T16:08:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2020-02-11T16:08:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2020-02-11T16:08:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2020-02-11T16:08:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2020-02-11T16:08:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2020-02-11T16:08:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2020-02-11T16:08:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2020-02-11T16:08:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2020-02-11T16:08:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2020-02-11T16:08:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2020-02-11T16:08:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2020-02-11T16:08:24.864 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2020-02-11T16:08:24.864 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2020-02-11T16:08:24.864 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2020-02-11T16:08:24.864 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2020-02-11T16:08:24.864 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2020-02-11T16:08:24.864 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2020-02-11T16:08:24.864 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2020-02-11T16:08:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2020-02-11T16:08:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2020-02-11T16:08:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2020-02-11T16:08:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2020-02-11T16:08:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2020-02-11T16:08:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2020-02-11T16:08:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2020-02-11T16:08:24.866 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2020-02-11T16:08:24.866 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2020-02-11T16:08:24.866 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2020-02-11T16:08:24.866 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2020-02-11T16:08:24.866 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2020-02-11T16:08:24.866 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2020-02-11T16:08:24.866 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2020-02-11T16:08:24.866 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2020-02-11T16:08:24.867 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2020-02-11T16:08:24.867 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2020-02-11T16:08:24.867 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2020-02-11T16:08:24.867 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2020-02-11T16:08:24.867 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2020-02-11T16:08:24.867 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2020-02-11T16:08:24.867 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2020-02-11T16:08:24.868 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2020-02-11T16:08:24.868 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2020-02-11T16:08:24.868 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2020-02-11T16:08:24.868 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2020-02-11T16:08:24.868 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2020-02-11T16:08:24.976 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:08:25.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.097+0000 7f2c95696700 1 Processor -- start 2020-02-11T16:08:25.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.097+0000 7f2c95696700 1 -- start start 2020-02-11T16:08:25.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c95696700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 0x7f2c900a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:25.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c95696700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c90138280 0x7f2c901386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:25.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c95696700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c900adb40 con 0x7f2c9013b1c0 2020-02-11T16:08:25.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c95696700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c90137bf0 con 0x7f2c90138280 2020-02-11T16:08:25.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c95696700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90138b40 con 0x7f2c900ad380 2020-02-11T16:08:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c90138280 0x7f2c901386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c90138280 0x7f2c901386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53234/0 (socket says 172.21.15.88:53234) 2020-02-11T16:08:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8e7fc700 1 -- 172.21.15.88:0/4104755697 learned_addr learned my addr 172.21.15.88:0/4104755697 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8effd700 1 --2- 172.21.15.88:0/4104755697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 0x7f2c900a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8e7fc700 1 -- 172.21.15.88:0/4104755697 >> v2:172.21.15.88:3300/0 conn(0x7f2c90138280 msgr2=0x7f2c901386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:08:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8e7fc700 1 -- 172.21.15.88:0/4104755697 >> v2:172.21.15.88:3300/0 conn(0x7f2c90138280 msgr2=0x7f2c901386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:08:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/4104755697 >> v2:172.21.15.88:3300/0 conn(0x7f2c90138280 0x7f2c901386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:08:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/4104755697 >> v2:172.21.15.88:3300/0 conn(0x7f2c90138280 0x7f2c901386e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8dffb700 1 -- 172.21.15.88:0/4104755697 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360238460 0 0) 0x7f2c900adb40 con 0x7f2c9013b1c0 2020-02-11T16:08:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8dffb700 1 -- 172.21.15.88:0/4104755697 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c74003230 con 0x7f2c9013b1c0 2020-02-11T16:08:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8effd700 1 -- 172.21.15.88:0/4104755697 >> v2:172.21.15.88:3300/0 conn(0x7f2c90138280 msgr2=0x7f2c901386e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:08:25.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8effd700 1 --2- 172.21.15.88:0/4104755697 >> v2:172.21.15.88:3300/0 conn(0x7f2c90138280 0x7f2c901386e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:25.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8effd700 1 -- 172.21.15.88:0/4104755697 >> v1:172.21.15.52:6789/0 conn(0x7f2c9013b1c0 legacy=0x7f2c9013b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8effd700 1 -- 172.21.15.88:0/4104755697 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c90137de0 con 0x7f2c900ad380 2020-02-11T16:08:25.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8effd700 1 --2- 172.21.15.88:0/4104755697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 0x7f2c900a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2c84002f30 tx=0x7f2c840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8effd700 1 --2- 172.21.15.88:0/4104755697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 0x7f2c900a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2c84002f30 tx=0x7f2c840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8effd700 1 --2- 172.21.15.88:0/4104755697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 0x7f2c900a9130 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f2c84002f30 tx=0x7f2c840088e0).ready entity=mon.2 client_cookie=7c5c5fdd37c3d656 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8effd700 1 --2- 172.21.15.88:0/4104755697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 0x7f2c900a9130 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2c84002f30 tx=0x7f2c840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.098+0000 7f2c8dffb700 1 -- 172.21.15.88:0/4104755697 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c84008e40 con 0x7f2c900ad380 2020-02-11T16:08:25.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c8effd700 1 --2- 172.21.15.88:0/4104755697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 0x7f2c900a9130 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2c84002f30 tx=0x7f2c840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c8dffb700 1 -- 172.21.15.88:0/4104755697 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c840115f0 con 0x7f2c900ad380 2020-02-11T16:08:25.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c8effd700 1 --2- 172.21.15.88:0/4104755697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 0x7f2c900a9130 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2c84002f30 tx=0x7f2c840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c8dffb700 1 -- 172.21.15.88:0/4104755697 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c840119d0 con 0x7f2c900ad380 2020-02-11T16:08:25.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c95696700 1 -- 172.21.15.88:0/4104755697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 msgr2=0x7f2c900a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c95696700 1 --2- 172.21.15.88:0/4104755697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 0x7f2c900a9130 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f2c84002f30 tx=0x7f2c840088e0).stop 2020-02-11T16:08:25.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c95696700 1 -- 172.21.15.88:0/4104755697 shutdown_connections 2020-02-11T16:08:25.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c95696700 1 --2- 172.21.15.88:0/4104755697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c900ad380 0x7f2c900a9130 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c95696700 1 --2- 172.21.15.88:0/4104755697 >> v2:172.21.15.88:3300/0 conn(0x7f2c90138280 0x7f2c901386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:25.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c95696700 1 -- 172.21.15.88:0/4104755697 >> 172.21.15.88:0/4104755697 conn(0x7f2c9005ac70 msgr2=0x7f2c900ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:25.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c95696700 1 -- 172.21.15.88:0/4104755697 shutdown_connections 2020-02-11T16:08:25.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.099+0000 7f2c95696700 1 -- 172.21.15.88:0/4104755697 wait complete. 2020-02-11T16:08:25.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.100+0000 7f2c95696700 1 Processor -- start 2020-02-11T16:08:25.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.100+0000 7f2c95696700 1 -- start start 2020-02-11T16:08:25.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c95696700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c9013b1c0 0x7f2c9012d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c95696700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c901302e0 con 0x7f2c900ad380 2020-02-11T16:08:25.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c95696700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c90130580 con 0x7f2c90138280 2020-02-11T16:08:25.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c95696700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c901300d0 con 0x7f2c9013b1c0 2020-02-11T16:08:25.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c8e7fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2c90138280 0x7f2c900a5820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40868/0 (socket says 172.21.15.88:40868) 2020-02-11T16:08:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c8e7fc700 1 -- 172.21.15.88:0/898243764 learned_addr learned my addr 172.21.15.88:0/898243764 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c8f7fe700 1 --2- 172.21.15.88:0/898243764 >> v2:172.21.15.88:3300/0 conn(0x7f2c9013b1c0 0x7f2c9012d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c8f7fe700 1 -- 172.21.15.88:0/898243764 >> v2:172.21.15.88:3300/0 conn(0x7f2c9013b1c0 msgr2=0x7f2c9012d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:08:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c8f7fe700 1 -- 172.21.15.88:0/898243764 >> v2:172.21.15.88:3300/0 conn(0x7f2c9013b1c0 msgr2=0x7f2c9012d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:08:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c8f7fe700 1 --2- 172.21.15.88:0/898243764 >> v2:172.21.15.88:3300/0 conn(0x7f2c9013b1c0 0x7f2c9012d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:08:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c8f7fe700 1 --2- 172.21.15.88:0/898243764 >> v2:172.21.15.88:3300/0 conn(0x7f2c9013b1c0 0x7f2c9012d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:25.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805915179 0 0) 0x7f2c901302e0 con 0x7f2c900ad380 2020-02-11T16:08:25.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.101+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c6c002fe0 con 0x7f2c900ad380 2020-02-11T16:08:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2605899113 0 0) 0x7f2c6c002fe0 con 0x7f2c900ad380 2020-02-11T16:08:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c901302e0 con 0x7f2c900ad380 2020-02-11T16:08:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f2c84008e40 con 0x7f2c900ad380 2020-02-11T16:08:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 >> v2:172.21.15.88:3300/0 conn(0x7f2c9013b1c0 msgr2=0x7f2c9012d750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:08:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 --2- 172.21.15.88:0/898243764 >> v2:172.21.15.88:3300/0 conn(0x7f2c9013b1c0 0x7f2c9012d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 >> v1:172.21.15.88:6789/0 conn(0x7f2c90138280 legacy=0x7f2c900a5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 >> v1:172.21.15.52:6789/0 conn(0x7f2c900ad380 legacy=0x7f2c900a7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c0049b0 0x7f2c6c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c6c0041c0 0x7f2c6c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c901300d0 con 0x7f2c6c003920 2020-02-11T16:08:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0046d0 con 0x7f2c6c0049b0 2020-02-11T16:08:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c00bbb0 con 0x7f2c6c0041c0 2020-02-11T16:08:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c8effd700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c0049b0 0x7f2c6c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c8effd700 1 -- 172.21.15.88:0/898243764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c0049b0 msgr2=0x7f2c6c004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:08:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c8effd700 1 -- 172.21.15.88:0/898243764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c0049b0 msgr2=0x7f2c6c004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:08:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c8effd700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c0049b0 0x7f2c6c004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:08:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.102+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8effd700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c0049b0 0x7f2c6c004dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8f7fe700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c6c0041c0 0x7f2c6c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8e7fc700 1 -- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c6c0041c0 msgr2=0x7f2c6c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c6c0041c0 0x7f2c6c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8e7fc700 1 -- 172.21.15.88:0/898243764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c0049b0 msgr2=0x7f2c6c004dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:08:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c0049b0 0x7f2c6c004dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8e7fc700 1 -- 172.21.15.88:0/898243764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c900a8630 con 0x7f2c6c003920 2020-02-11T16:08:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c95696700 1 -- 172.21.15.88:0/898243764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c900a5f30 con 0x7f2c6c003920 2020-02-11T16:08:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8f7fe700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c6c0041c0 0x7f2c6c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:08:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c95696700 1 -- 172.21.15.88:0/898243764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9013a360 con 0x7f2c6c003920 2020-02-11T16:08:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8f7fe700 1 -- 172.21.15.88:0/898243764 reap_dead start 2020-02-11T16:08:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.103+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.104+0000 7f2c95696700 1 -- 172.21.15.88:0/898243764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c900565b0 con 0x7f2c6c003920 2020-02-11T16:08:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.105+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.105+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c80007540 con 0x7f2c6c003920 2020-02-11T16:08:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.105+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.105+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.105+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c80012710 con 0x7f2c6c003920 2020-02-11T16:08:25.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.105+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c80012a70 con 0x7f2c6c003920 2020-02-11T16:08:25.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.105+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.106+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2c80012bd0 con 0x7f2c6c003920 2020-02-11T16:08:25.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.106+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.106+0000 7f2c7ffff700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2c6c03dc70 0x7f2c6c040130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.106+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f2c80049eb0 con 0x7f2c6c003920 2020-02-11T16:08:25.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.106+0000 7f2c8effd700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2c6c03dc70 0x7f2c6c040130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.106+0000 7f2c8effd700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2c6c03dc70 0x7f2c6c040130 crc :-1 s=READY pgs=149 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.110+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.110+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f2c8002f380 con 0x7f2c6c003920 2020-02-11T16:08:25.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.336+0000 7f2c95696700 1 -- 172.21.15.88:0/898243764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2c9005ccb0 con 0x7f2c6c003920 2020-02-11T16:08:25.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.336+0000 7f2c8e7fc700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.336+0000 7f2c7ffff700 1 -- 172.21.15.88:0/898243764 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7f2c80032060 con 0x7f2c6c003920 2020-02-11T16:08:25.340 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.338+0000 7f2c95696700 1 -- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2c6c03dc70 msgr2=0x7f2c6c040130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.338+0000 7f2c95696700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2c6c03dc70 0x7f2c6c040130 crc :-1 s=READY pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.338+0000 7f2c95696700 1 -- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 msgr2=0x7f2c6c003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.338+0000 7f2c95696700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f2c9006a3e0 tx=0x7f2c80010c00).stop 2020-02-11T16:08:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.338+0000 7f2c95696700 1 -- 172.21.15.88:0/898243764 shutdown_connections 2020-02-11T16:08:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.338+0000 7f2c95696700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2c6c03dc70 0x7f2c6c040130 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.338+0000 7f2c95696700 1 --2- 172.21.15.88:0/898243764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6c003920 0x7f2c6c003d60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.338+0000 7f2c95696700 1 -- 172.21.15.88:0/898243764 >> 172.21.15.88:0/898243764 conn(0x7f2c9005ac70 msgr2=0x7f2c901374e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.338+0000 7f2c95696700 1 -- 172.21.15.88:0/898243764 shutdown_connections 2020-02-11T16:08:25.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.338+0000 7f2c95696700 1 -- 172.21.15.88:0/898243764 wait complete. 2020-02-11T16:08:25.351 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":38,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:25.351 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:08:25.352 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:08:25.449 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2020-02-11T16:08:25.449 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2020-02-11T16:08:25.449 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2020-02-11T16:08:25.450 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2020-02-11T16:08:25.450 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2020-02-11T16:08:25.450 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2020-02-11T16:08:25.450 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2020-02-11T16:08:25.450 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2020-02-11T16:08:25.451 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2020-02-11T16:08:25.451 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2020-02-11T16:08:25.451 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2020-02-11T16:08:25.451 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2020-02-11T16:08:25.451 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2020-02-11T16:08:25.452 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2020-02-11T16:08:25.452 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2020-02-11T16:08:25.452 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2020-02-11T16:08:25.452 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2020-02-11T16:08:25.452 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2020-02-11T16:08:25.452 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2020-02-11T16:08:25.452 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2020-02-11T16:08:25.453 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2020-02-11T16:08:25.453 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2020-02-11T16:08:25.453 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2020-02-11T16:08:25.453 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2020-02-11T16:08:25.453 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2020-02-11T16:08:25.453 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2020-02-11T16:08:25.454 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2020-02-11T16:08:25.454 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2020-02-11T16:08:25.454 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2020-02-11T16:08:25.454 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2020-02-11T16:08:25.455 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2020-02-11T16:08:25.455 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2020-02-11T16:08:25.455 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2020-02-11T16:08:25.455 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2020-02-11T16:08:25.456 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2020-02-11T16:08:25.456 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2020-02-11T16:08:25.456 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2020-02-11T16:08:25.456 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2020-02-11T16:08:25.457 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2020-02-11T16:08:25.457 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2020-02-11T16:08:25.457 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2020-02-11T16:08:25.457 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2020-02-11T16:08:25.462 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2020-02-11T16:08:25.462 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2020-02-11T16:08:25.463 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2020-02-11T16:08:25.463 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2020-02-11T16:08:25.469 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2020-02-11T16:08:25.470 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2020-02-11T16:08:25.470 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2020-02-11T16:08:25.471 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2020-02-11T16:08:25.471 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2020-02-11T16:08:25.471 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2020-02-11T16:08:25.471 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2020-02-11T16:08:25.471 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2020-02-11T16:08:25.472 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2020-02-11T16:08:25.472 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2020-02-11T16:08:25.472 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2020-02-11T16:08:25.472 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2020-02-11T16:08:25.473 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2020-02-11T16:08:25.473 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2020-02-11T16:08:25.473 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2020-02-11T16:08:25.473 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2020-02-11T16:08:25.474 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2020-02-11T16:08:25.474 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2020-02-11T16:08:25.474 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2020-02-11T16:08:25.474 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2020-02-11T16:08:25.474 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2020-02-11T16:08:25.475 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2020-02-11T16:08:25.475 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2020-02-11T16:08:25.475 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2020-02-11T16:08:25.475 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2020-02-11T16:08:25.476 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2020-02-11T16:08:25.476 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2020-02-11T16:08:25.476 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2020-02-11T16:08:25.476 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2020-02-11T16:08:25.477 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2020-02-11T16:08:25.477 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2020-02-11T16:08:25.478 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2020-02-11T16:08:25.478 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2020-02-11T16:08:25.479 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2020-02-11T16:08:25.479 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2020-02-11T16:08:25.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.471+0000 7f468beef700 1 Processor -- start 2020-02-11T16:08:25.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.471+0000 7f468beef700 1 -- start start 2020-02-11T16:08:25.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468beef700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46840a8690 0x7f4684136040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:25.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468beef700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46841364a0 0x7f4684140370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:25.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468beef700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46840a4af0 con 0x7f46840a3a90 2020-02-11T16:08:25.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468beef700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46841302a0 con 0x7f46841364a0 2020-02-11T16:08:25.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468beef700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4684135a20 con 0x7f46840a8690 2020-02-11T16:08:25.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f4689c8b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f46840a3a90 0x7f46840a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40880/0 (socket says 172.21.15.88:40880) 2020-02-11T16:08:25.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f4689c8b700 1 -- 172.21.15.88:0/1174802453 learned_addr learned my addr 172.21.15.88:0/1174802453 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:25.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468948a700 1 --2- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46840a8690 0x7f4684136040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 --2- 172.21.15.88:0/1174802453 >> v2:172.21.15.52:3300/0 conn(0x7f46841364a0 0x7f4684140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f4688c89700 1 -- 172.21.15.88:0/1174802453 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833210284 0 0) 0x7f46840a4af0 con 0x7f46840a3a90 2020-02-11T16:08:25.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f4688c89700 1 -- 172.21.15.88:0/1174802453 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466c003230 con 0x7f46840a3a90 2020-02-11T16:08:25.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 -- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46840a8690 msgr2=0x7f4684136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:08:25.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 --2- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46840a8690 0x7f4684136040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:25.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 -- 172.21.15.88:0/1174802453 >> v1:172.21.15.88:6789/0 conn(0x7f46840a3a90 legacy=0x7f46840a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 -- 172.21.15.88:0/1174802453 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46840a4d90 con 0x7f46841364a0 2020-02-11T16:08:25.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 --2- 172.21.15.88:0/1174802453 >> v2:172.21.15.52:3300/0 conn(0x7f46841364a0 0x7f4684140370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f467c0032b0 tx=0x7f467c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 --2- 172.21.15.88:0/1174802453 >> v2:172.21.15.52:3300/0 conn(0x7f46841364a0 0x7f4684140370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f467c0032b0 tx=0x7f467c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 --2- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841364a0 0x7f4684140370 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f467c0032b0 tx=0x7f467c008c60).ready entity=mon.0 client_cookie=db9936826131faf7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 --2- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841364a0 0x7f4684140370 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f467c0032b0 tx=0x7f467c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f4688c89700 1 -- 172.21.15.88:0/1174802453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f467c011db0 con 0x7f46841364a0 2020-02-11T16:08:25.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 --2- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841364a0 0x7f4684140370 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f467c0032b0 tx=0x7f467c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468a48c700 1 --2- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841364a0 0x7f4684140370 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f467c0032b0 tx=0x7f467c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f4688c89700 1 -- 172.21.15.88:0/1174802453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c00a160 con 0x7f46841364a0 2020-02-11T16:08:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f4688c89700 1 -- 172.21.15.88:0/1174802453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f467c00a540 con 0x7f46841364a0 2020-02-11T16:08:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468beef700 1 -- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841364a0 msgr2=0x7f4684140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.472+0000 7f468beef700 1 --2- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841364a0 0x7f4684140370 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f467c0032b0 tx=0x7f467c008c60).stop 2020-02-11T16:08:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.473+0000 7f468beef700 1 -- 172.21.15.88:0/1174802453 shutdown_connections 2020-02-11T16:08:25.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.473+0000 7f468beef700 1 --2- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841364a0 0x7f4684140370 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.473+0000 7f468beef700 1 --2- 172.21.15.88:0/1174802453 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46840a8690 0x7f4684136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:25.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.473+0000 7f468beef700 1 -- 172.21.15.88:0/1174802453 >> 172.21.15.88:0/1174802453 conn(0x7f46840ac2d0 msgr2=0x7f46840ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:25.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.473+0000 7f468beef700 1 -- 172.21.15.88:0/1174802453 shutdown_connections 2020-02-11T16:08:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.473+0000 7f468beef700 1 -- 172.21.15.88:0/1174802453 wait complete. 2020-02-11T16:08:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.474+0000 7f468beef700 1 Processor -- start 2020-02-11T16:08:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.474+0000 7f468beef700 1 -- start start 2020-02-11T16:08:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.474+0000 7f468beef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46840a8690 0x7f4684148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.474+0000 7f468beef700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46841364a0 0x7f4684148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468beef700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4684148270 con 0x7f46840a3a90 2020-02-11T16:08:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468beef700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46840608c0 con 0x7f46840a8690 2020-02-11T16:08:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468beef700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4684130480 con 0x7f46841364a0 2020-02-11T16:08:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46840a8690 0x7f4684148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46840a8690 0x7f4684148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53262/0 (socket says 172.21.15.88:53262) 2020-02-11T16:08:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 -- 172.21.15.88:0/3132163232 learned_addr learned my addr 172.21.15.88:0/3132163232 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468a48c700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46841364a0 0x7f4684148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 -- 172.21.15.88:0/3132163232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46841364a0 msgr2=0x7f4684148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46841364a0 0x7f4684148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 -- 172.21.15.88:0/3132163232 >> v1:172.21.15.88:6789/0 conn(0x7f46840a3a90 legacy=0x7f46840a2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 -- 172.21.15.88:0/3132163232 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4684130720 con 0x7f46840a8690 2020-02-11T16:08:25.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 --2- 172.21.15.88:0/3132163232 >> v2:172.21.15.88:3300/0 conn(0x7f46840a8690 0x7f4684148810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4674003070 tx=0x7f4674010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 --2- 172.21.15.88:0/3132163232 >> v2:172.21.15.88:3300/0 conn(0x7f46840a8690 0x7f4684148810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4674003070 tx=0x7f4674010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46840a8690 0x7f4684148810 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f4674003070 tx=0x7f4674010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46840a8690 0x7f4684148810 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f4674003070 tx=0x7f4674010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4674005e90 con 0x7f46840a8690 2020-02-11T16:08:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46840a8690 0x7f4684148810 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f4674003070 tx=0x7f4674010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468948a700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46840a8690 0x7f4684148810 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f4674003070 tx=0x7f4674010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674007160 con 0x7f46840a8690 2020-02-11T16:08:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4674007580 con 0x7f46840a8690 2020-02-11T16:08:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468beef700 1 -- 172.21.15.88:0/3132163232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46841490d0 con 0x7f46840a8690 2020-02-11T16:08:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.475+0000 7f468beef700 1 -- 172.21.15.88:0/3132163232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46840a15b0 con 0x7f46840a8690 2020-02-11T16:08:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f468948a700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46840a8690 0x7f4684148810 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f4674003070 tx=0x7f4674010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4674012440 con 0x7f46840a8690 2020-02-11T16:08:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f468948a700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46840a8690 0x7f4684148810 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f4674003070 tx=0x7f4674010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f468beef700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 0x7f46840a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f468beef700 1 -- 172.21.15.88:0/3132163232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468405e2f0 con 0x7f468412f8b0 2020-02-11T16:08:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f4672ffd700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4664039c40 0x7f466403c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f467404a090 con 0x7f46840a8690 2020-02-11T16:08:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 0x7f46840a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f468a48c700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4664039c40 0x7f466403c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f4689c8b700 1 -- 172.21.15.88:0/3132163232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46840a2170 con 0x7f468412f8b0 2020-02-11T16:08:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 0x7f46840a9560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.476+0000 7f468a48c700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4664039c40 0x7f466403c100 crc :-1 s=READY pgs=150 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.477+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 0x7f46840a9560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.477+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 0x7f46840a9560 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.477+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 0x7f46840a9560 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.477+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4680005cc0 con 0x7f468412f8b0 2020-02-11T16:08:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.477+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 0x7f46840a9560 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.477+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f4680005e20 con 0x7f468412f8b0 2020-02-11T16:08:25.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.477+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 msgr2=0x7f46840a9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.477+0000 7f4672ffd700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 0x7f46840a9560 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).stop 2020-02-11T16:08:25.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.477+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 msgr2=0x7f46840a9560 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:25.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.477+0000 7f4672ffd700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f468412f8b0 0x7f46840a9560 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).stop 2020-02-11T16:08:25.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.485+0000 7f468beef700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 0x7f4684133d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.485+0000 7f468beef700 1 -- 172.21.15.88:0/3132163232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46840a30c0 con 0x7f4684133990 2020-02-11T16:08:25.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.485+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 0x7f4684133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.485+0000 7f4689c8b700 1 -- 172.21.15.88:0/3132163232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f46840565b0 con 0x7f4684133990 2020-02-11T16:08:25.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.485+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 0x7f4684133d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.485+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 0x7f4684133d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.485+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 0x7f4684133d70 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.485+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 0x7f4684133d70 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.485+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4680008650 con 0x7f4684133990 2020-02-11T16:08:25.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f4689c8b700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 0x7f4684133d70 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3849 (secure 0 0 0) 0x7f46800087b0 con 0x7f4684133990 2020-02-11T16:08:25.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 msgr2=0x7f4684133d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f4672ffd700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 0x7f4684133d70 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).stop 2020-02-11T16:08:25.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f4672ffd700 1 -- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 msgr2=0x7f4684133d70 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:25.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f4672ffd700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4684133990 0x7f4684133d70 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0x7f46841300e0 tx=0x7f4680010860).stop 2020-02-11T16:08:25.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f468beef700 1 -- 172.21.15.88:0/3132163232 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4664039c40 msgr2=0x7f466403c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f468beef700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4664039c40 0x7f466403c100 crc :-1 s=READY pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f468beef700 1 -- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46840a8690 msgr2=0x7f4684148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f468beef700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46840a8690 0x7f4684148810 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f4674003070 tx=0x7f4674010cd0).stop 2020-02-11T16:08:25.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f468a48c700 1 -- 172.21.15.88:0/3132163232 reap_dead start 2020-02-11T16:08:25.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f468beef700 1 -- 172.21.15.88:0/3132163232 shutdown_connections 2020-02-11T16:08:25.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f468beef700 1 --2- 172.21.15.88:0/3132163232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46840a8690 0x7f4684148810 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f468beef700 1 -- 172.21.15.88:0/3132163232 >> 172.21.15.88:0/3132163232 conn(0x7f46840ac2d0 msgr2=0x7f4684069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:25.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f468beef700 1 -- 172.21.15.88:0/3132163232 shutdown_connections 2020-02-11T16:08:25.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.486+0000 7f468beef700 1 -- 172.21.15.88:0/3132163232 wait complete. 2020-02-11T16:08:25.517 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:08:25.517 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:25.517 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:25.517 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:08:25.518 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 38, 2020-02-11T16:08:25.518 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:08:25.518 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:08:25.519 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:08:25.519 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:08:25.519 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.519 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2020-02-11T16:08:25.520 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:25.520 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:08:25.520 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:08:25.520 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:25.522 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:25.522 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:25.522 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:25.522 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:25.523 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:25.523 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.523 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:08:25.523 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:08:25.523 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:25.523 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:25.524 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:25.524 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:25.524 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:25.524 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:25.524 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.524 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:08:25.525 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:08:25.525 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:08:25.525 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:08:25.525 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:08:25.525 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:08:25.525 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:25.526 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:25.526 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:08:25.526 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:08:25.526 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:25.527 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:08:25.527 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:25.527 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:25.527 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:25.527 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:25.527 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:25.528 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:25.528 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.528 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:08:25.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.528 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:08:25.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.528 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:25.529 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:25.529 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:25.529 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:25.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.529 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:25.529 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:08:25.529 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.530 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:25.530 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:08:25.530 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.530 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.530 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.531 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:08:25.531 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:08:25.531 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:25.531 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:25.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.532 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:25.532 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:25.532 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:25.532 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:25.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.533 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:25.533 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:08:25.533 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.533 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:25.533 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:08:25.534 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.534 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.534 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.534 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:08:25.534 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:08:25.535 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:25.535 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:25.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.535 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:08:25.535 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:08:25.536 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:25.536 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:25.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.536 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:25.536 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:08:25.536 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.537 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:25.537 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:08:25.537 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.537 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.538 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.539 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:08:25.539 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:08:25.539 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:25.540 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:25.540 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.540 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.540 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:08:25.540 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:08:25.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.540 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:25.541 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:25.541 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:25.541 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.541 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.541 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:08:25.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.542 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:25.542 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:25.542 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:08:25.542 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.542 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.542 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.542 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:08:25.544 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:08:25.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.664+0000 7fe8a743b700 1 Processor -- start 2020-02-11T16:08:25.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.664+0000 7fe8a743b700 1 -- start start 2020-02-11T16:08:25.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.665+0000 7fe8a743b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8a0131f50 0x7fe8a005f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:25.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.665+0000 7fe8a743b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a013b290 0x7fe8a009d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:25.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.665+0000 7fe8a743b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a0138360 con 0x7fe8a013b6f0 2020-02-11T16:08:25.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.665+0000 7fe8a743b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a0138150 con 0x7fe8a0131f50 2020-02-11T16:08:25.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.665+0000 7fe8a743b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0138600 con 0x7fe8a013b290 2020-02-11T16:08:25.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.665+0000 7fe8a51d7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8a0131f50 0x7fe8a005f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.665+0000 7fe8a49d6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a013b290 0x7fe8a009d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.665+0000 7fe8a59d8700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe8a013b6f0 0x7fe8a005ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60914/0 (socket says 172.21.15.88:60914) 2020-02-11T16:08:25.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.665+0000 7fe8a59d8700 1 -- 172.21.15.88:0/428903824 learned_addr learned my addr 172.21.15.88:0/428903824 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:25.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a51d7700 1 -- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a013b290 msgr2=0x7fe8a009d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:08:25.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a013b290 0x7fe8a009d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a51d7700 1 -- 172.21.15.88:0/428903824 >> v1:172.21.15.52:6789/0 conn(0x7fe8a013b6f0 legacy=0x7fe8a005ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe88ffff700 1 -- 172.21.15.88:0/428903824 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108204101 0 0) 0x7fe8a0138360 con 0x7fe8a013b6f0 2020-02-11T16:08:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a51d7700 1 -- 172.21.15.88:0/428903824 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a0137d40 con 0x7fe8a0131f50 2020-02-11T16:08:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a013b290 0x7fe8a009d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:08:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/428903824 >> v2:172.21.15.52:3300/0 conn(0x7fe8a0131f50 0x7fe8a005f900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe890002f30 tx=0x7fe8900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/428903824 >> v2:172.21.15.52:3300/0 conn(0x7fe8a0131f50 0x7fe8a005f900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe890002f30 tx=0x7fe8900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a005f900 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8900088e0).ready entity=mon.0 client_cookie=d44b1794cac97a52 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a005f900 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe88ffff700 1 -- 172.21.15.88:0/428903824 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe890008e40 con 0x7fe8a0131f50 2020-02-11T16:08:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a005f900 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a005f900 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe88ffff700 1 -- 172.21.15.88:0/428903824 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8900115f0 con 0x7fe8a0131f50 2020-02-11T16:08:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a743b700 1 -- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 msgr2=0x7fe8a005f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe8a743b700 1 --2- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a005f900 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8900088e0).stop 2020-02-11T16:08:25.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.666+0000 7fe88ffff700 1 -- 172.21.15.88:0/428903824 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe890011990 con 0x7fe8a0131f50 2020-02-11T16:08:25.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.667+0000 7fe8a743b700 1 -- 172.21.15.88:0/428903824 shutdown_connections 2020-02-11T16:08:25.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.667+0000 7fe8a743b700 1 --2- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a005f900 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.667+0000 7fe8a743b700 1 --2- 172.21.15.88:0/428903824 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a013b290 0x7fe8a009d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:25.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.667+0000 7fe8a743b700 1 -- 172.21.15.88:0/428903824 >> 172.21.15.88:0/428903824 conn(0x7fe8a00a7bb0 msgr2=0x7fe8a00a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:25.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.667+0000 7fe8a743b700 1 -- 172.21.15.88:0/428903824 shutdown_connections 2020-02-11T16:08:25.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.667+0000 7fe8a743b700 1 -- 172.21.15.88:0/428903824 wait complete. 2020-02-11T16:08:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.668+0000 7fe8a743b700 1 Processor -- start 2020-02-11T16:08:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.668+0000 7fe8a743b700 1 -- start start 2020-02-11T16:08:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a743b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8a0131f50 0x7fe8a0139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a743b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a005b9b0 0x7fe8a0136c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a743b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a013a9c0 con 0x7fe8a013b290 2020-02-11T16:08:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a743b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a01370a0 con 0x7fe8a0131f50 2020-02-11T16:08:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a743b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a013a590 con 0x7fe8a005b9b0 2020-02-11T16:08:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8a0131f50 0x7fe8a0139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a59d8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a005b9b0 0x7fe8a0136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a49d6700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe8a013b290 0x7fe8a0148550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60920/0 (socket says 172.21.15.88:60920) 2020-02-11T16:08:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a49d6700 1 -- 172.21.15.88:0/793718457 learned_addr learned my addr 172.21.15.88:0/793718457 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8a0131f50 0x7fe8a0139230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:39264/0 (socket says 172.21.15.88:39264) 2020-02-11T16:08:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 -- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a005b9b0 msgr2=0x7fe8a0136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969664084 0 0) 0x7fe8a013a9c0 con 0x7fe8a013b290 2020-02-11T16:08:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a005b9b0 0x7fe8a0136c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 -- 172.21.15.88:0/793718457 >> v1:172.21.15.52:6789/0 conn(0x7fe8a013b290 legacy=0x7fe8a0148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 -- 172.21.15.88:0/793718457 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a013ac20 con 0x7fe8a0131f50 2020-02-11T16:08:25.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a59d8700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a005b9b0 0x7fe8a0136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:08:25.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/793718457 >> v2:172.21.15.52:3300/0 conn(0x7fe8a0131f50 0x7fe8a0139230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8a00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/793718457 >> v2:172.21.15.52:3300/0 conn(0x7fe8a0131f50 0x7fe8a0139230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8a00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a0139230 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8a00600c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a0139230 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8a00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a0139230 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8a00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe890011880 con 0x7fe8a0131f50 2020-02-11T16:08:25.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a0139230 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8a00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8900119e0 con 0x7fe8a0131f50 2020-02-11T16:08:25.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe890007340 con 0x7fe8a0131f50 2020-02-11T16:08:25.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.669+0000 7fe8a743b700 1 -- 172.21.15.88:0/793718457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a013aec0 con 0x7fe8a0131f50 2020-02-11T16:08:25.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.670+0000 7fe8a743b700 1 -- 172.21.15.88:0/793718457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a012f130 con 0x7fe8a0131f50 2020-02-11T16:08:25.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.670+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a0139230 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8a00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.670+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe8900056c0 con 0x7fe8a0131f50 2020-02-11T16:08:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.670+0000 7fe8a51d7700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a0139230 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8a00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.670+0000 7fe8a743b700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 0x7fe8a0148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.670+0000 7fe8a743b700 1 -- 172.21.15.88:0/793718457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a005e2f0 con 0x7fe8a013b6f0 2020-02-11T16:08:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 0x7fe8a0148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe88e7fc700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe880039b50 0x7fe88003c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe890049c60 con 0x7fe8a0131f50 2020-02-11T16:08:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe8a59d8700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe880039b50 0x7fe88003c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe8a49d6700 1 -- 172.21.15.88:0/793718457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8a00565b0 con 0x7fe8a013b6f0 2020-02-11T16:08:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 0x7fe8a0148e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 0x7fe8a0148e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 0x7fe8a0148e20 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c00c490).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe8a59d8700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe880039b50 0x7fe88003c010 crc :-1 s=READY pgs=151 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 0x7fe8a0148e20 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c012aa0 con 0x7fe8a013b6f0 2020-02-11T16:08:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 0x7fe8a0148e20 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fe89c0105b0 con 0x7fe8a013b6f0 2020-02-11T16:08:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 msgr2=0x7fe8a0148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe88e7fc700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 0x7fe8a0148e20 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c00c490).stop 2020-02-11T16:08:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 msgr2=0x7fe8a0148e20 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:25.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.671+0000 7fe88e7fc700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a013b6f0 0x7fe8a0148e20 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c00c490).stop 2020-02-11T16:08:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.680+0000 7fe8a743b700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 0x7fe8a005e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.680+0000 7fe8a743b700 1 -- 172.21.15.88:0/793718457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0138f70 con 0x7fe8a005ae60 2020-02-11T16:08:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.680+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 0x7fe8a005e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.680+0000 7fe8a49d6700 1 -- 172.21.15.88:0/793718457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe8a0149280 con 0x7fe8a005ae60 2020-02-11T16:08:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.680+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 0x7fe8a005e8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c012600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.680+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 0x7fe8a005e8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c012600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 0x7fe8a005e8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c012600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 0x7fe8a005e8f0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c012600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c010350 con 0x7fe8a005ae60 2020-02-11T16:08:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a49d6700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 0x7fe8a005e8f0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c012600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4021 (secure 0 0 0) 0x7fe89c00b0a0 con 0x7fe8a005ae60 2020-02-11T16:08:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 msgr2=0x7fe8a005e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe88e7fc700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 0x7fe8a005e8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fe89c007a80 tx=0x7fe89c012600).stop 2020-02-11T16:08:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe88e7fc700 1 -- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 msgr2=0x7fe8a005e8f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe88e7fc700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a005ae60 0x7fe8a005e8f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a743b700 1 -- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe880039b50 msgr2=0x7fe88003c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a743b700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe880039b50 0x7fe88003c010 crc :-1 s=READY pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a743b700 1 -- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 msgr2=0x7fe8a0139230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a743b700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a0139230 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe8a00600c0).stop 2020-02-11T16:08:25.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a59d8700 1 -- 172.21.15.88:0/793718457 reap_dead start 2020-02-11T16:08:25.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a59d8700 1 -- 172.21.15.88:0/793718457 reap_dead start 2020-02-11T16:08:25.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a743b700 1 -- 172.21.15.88:0/793718457 shutdown_connections 2020-02-11T16:08:25.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a743b700 1 --2- 172.21.15.88:0/793718457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a0131f50 0x7fe8a0139230 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a743b700 1 -- 172.21.15.88:0/793718457 >> 172.21.15.88:0/793718457 conn(0x7fe8a00a7bb0 msgr2=0x7fe8a012e770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:25.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a743b700 1 -- 172.21.15.88:0/793718457 shutdown_connections 2020-02-11T16:08:25.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.681+0000 7fe8a743b700 1 -- 172.21.15.88:0/793718457 wait complete. 2020-02-11T16:08:25.693 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:08:25.693 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:25.693 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:25.693 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:08:25.694 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 38, 2020-02-11T16:08:25.694 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:08:25.694 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:08:25.694 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:08:25.694 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:08:25.694 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.694 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2020-02-11T16:08:25.695 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:25.695 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:08:25.695 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:08:25.695 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:25.695 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:25.695 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:25.695 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:25.696 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:25.696 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:25.696 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.696 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:08:25.696 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:08:25.696 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:25.696 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:25.696 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:25.697 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:25.697 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:25.697 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:25.697 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.697 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:08:25.697 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:08:25.698 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:08:25.698 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:08:25.698 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:08:25.698 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:08:25.698 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:25.698 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:25.698 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:08:25.699 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:08:25.699 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:25.699 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:08:25.699 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:25.699 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:25.699 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:25.699 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:25.700 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:25.700 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:25.700 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.700 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:08:25.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.700 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:08:25.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.700 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:25.701 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:25.701 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:25.701 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:25.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.701 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:25.701 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:08:25.702 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.702 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:25.702 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:08:25.702 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.702 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.703 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.703 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:08:25.703 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:08:25.703 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:25.703 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:25.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.704 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:25.704 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:25.704 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:25.704 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:25.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.704 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:25.705 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:08:25.705 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.705 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:25.705 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:08:25.705 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.706 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.706 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.706 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:08:25.706 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:08:25.706 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:25.706 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:25.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.707 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:08:25.707 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:08:25.707 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:25.707 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:25.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.707 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:25.708 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:08:25.708 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.708 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:25.708 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:08:25.708 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.709 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.709 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.709 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:08:25.709 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:08:25.709 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:25.709 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:25.710 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.710 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.710 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:08:25.710 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:08:25.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.710 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:25.710 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:25.711 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:25.711 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.711 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.711 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:08:25.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.711 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:25.711 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:25.712 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:25.712 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.712 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.712 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:08:25.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.712 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:25.712 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:25.713 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:08:25.713 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.713 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.713 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.713 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:08:25.714 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:08:25.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.838+0000 7f37bfe25700 1 Processor -- start 2020-02-11T16:08:25.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.838+0000 7f37bfe25700 1 -- start start 2020-02-11T16:08:25.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bfe25700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f37b80ad380 0x7f37b80a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:25.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bfe25700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37b8138280 0x7f37b8138710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:25.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bfe25700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b80adb40 con 0x7f37b813b1c0 2020-02-11T16:08:25.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bfe25700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b8137bf0 con 0x7f37b80ad380 2020-02-11T16:08:25.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bfe25700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b8138b70 con 0x7f37b8138280 2020-02-11T16:08:25.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bd3c0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37b8138280 0x7f37b8138710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bd3c0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37b8138280 0x7f37b8138710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53290/0 (socket says 172.21.15.88:53290) 2020-02-11T16:08:25.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bd3c0700 1 -- 172.21.15.88:0/4049549340 learned_addr learned my addr 172.21.15.88:0/4049549340 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:25.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bdbc1700 1 --2- 172.21.15.88:0/4049549340 >> v2:172.21.15.52:3300/0 conn(0x7f37b80ad380 0x7f37b80a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bd3c0700 1 -- 172.21.15.88:0/4049549340 >> v2:172.21.15.52:3300/0 conn(0x7f37b80ad380 msgr2=0x7f37b80a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:08:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4049549340 >> v2:172.21.15.52:3300/0 conn(0x7f37b80ad380 0x7f37b80a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bd3c0700 1 -- 172.21.15.88:0/4049549340 >> v1:172.21.15.52:6789/0 conn(0x7f37b813b1c0 legacy=0x7f37b813b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bd3c0700 1 -- 172.21.15.88:0/4049549340 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8137de0 con 0x7f37b8138280 2020-02-11T16:08:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4049549340 >> v2:172.21.15.88:3300/0 conn(0x7f37b8138280 0x7f37b8138710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4049549340 >> v2:172.21.15.88:3300/0 conn(0x7f37b8138280 0x7f37b8138710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.839+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4049549340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37b8138280 0x7f37b8138710 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).ready entity=mon.1 client_cookie=f2ec950348a7a8d4 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.840+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4049549340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37b8138280 0x7f37b8138710 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.840+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4049549340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37b8138280 0x7f37b8138710 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.840+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4049549340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37b8138280 0x7f37b8138710 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.840+0000 7f37bcbbf700 1 -- 172.21.15.88:0/4049549340 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37a8008e10 con 0x7f37b8138280 2020-02-11T16:08:25.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.840+0000 7f37bcbbf700 1 -- 172.21.15.88:0/4049549340 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8011700 con 0x7f37b8138280 2020-02-11T16:08:25.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.840+0000 7f37bcbbf700 1 -- 172.21.15.88:0/4049549340 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37a8011aa0 con 0x7f37b8138280 2020-02-11T16:08:25.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.840+0000 7f37bfe25700 1 -- 172.21.15.88:0/4049549340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37b8138280 msgr2=0x7f37b8138710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.840+0000 7f37bfe25700 1 --2- 172.21.15.88:0/4049549340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37b8138280 0x7f37b8138710 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).stop 2020-02-11T16:08:25.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.841+0000 7f37bfe25700 1 -- 172.21.15.88:0/4049549340 shutdown_connections 2020-02-11T16:08:25.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.841+0000 7f37bfe25700 1 --2- 172.21.15.88:0/4049549340 >> v2:172.21.15.52:3300/0 conn(0x7f37b80ad380 0x7f37b80a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:25.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.841+0000 7f37bfe25700 1 --2- 172.21.15.88:0/4049549340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37b8138280 0x7f37b8138710 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.841+0000 7f37bfe25700 1 -- 172.21.15.88:0/4049549340 >> 172.21.15.88:0/4049549340 conn(0x7f37b805ac70 msgr2=0x7f37b80ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:25.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.841+0000 7f37bfe25700 1 -- 172.21.15.88:0/4049549340 shutdown_connections 2020-02-11T16:08:25.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.841+0000 7f37bfe25700 1 -- 172.21.15.88:0/4049549340 wait complete. 2020-02-11T16:08:25.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.842+0000 7f37bfe25700 1 Processor -- start 2020-02-11T16:08:25.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.842+0000 7f37bfe25700 1 -- start start 2020-02-11T16:08:25.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.842+0000 7f37bfe25700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.842+0000 7f37bfe25700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f37b813b1c0 0x7f37b812e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.842+0000 7f37bfe25700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b81328b0 con 0x7f37b80ad380 2020-02-11T16:08:25.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.842+0000 7f37bfe25700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b812f440 con 0x7f37b813b1c0 2020-02-11T16:08:25.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.842+0000 7f37bfe25700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b812f630 con 0x7f37b8138280 2020-02-11T16:08:25.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.842+0000 7f37bdbc1700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f37b80ad380 0x7f37b8138dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40922/0 (socket says 172.21.15.88:40922) 2020-02-11T16:08:25.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.842+0000 7f37bdbc1700 1 -- 172.21.15.88:0/4094612482 learned_addr learned my addr 172.21.15.88:0/4094612482 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:25.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> v2:172.21.15.52:3300/0 conn(0x7f37b813b1c0 0x7f37b812e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208923625 0 0) 0x7f37b81328b0 con 0x7f37b80ad380 2020-02-11T16:08:25.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3798002fe0 con 0x7f37b80ad380 2020-02-11T16:08:25.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 -- 172.21.15.88:0/4094612482 >> v2:172.21.15.52:3300/0 conn(0x7f37b813b1c0 msgr2=0x7f37b812e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4094612482 >> v2:172.21.15.52:3300/0 conn(0x7f37b813b1c0 0x7f37b812e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 -- 172.21.15.88:0/4094612482 >> v1:172.21.15.88:6789/0 conn(0x7f37b80ad380 legacy=0x7f37b8138dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 -- 172.21.15.88:0/4094612482 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b812f8d0 con 0x7f37b8138280 2020-02-11T16:08:25.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> v2:172.21.15.52:3300/0 conn(0x7f37b813b1c0 0x7f37b812e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:08:25.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37a800f680 con 0x7f37b8138280 2020-02-11T16:08:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a800f7e0 con 0x7f37b8138280 2020-02-11T16:08:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37a80058b0 con 0x7f37b8138280 2020-02-11T16:08:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bfe25700 1 -- 172.21.15.88:0/4094612482 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b812edd0 con 0x7f37b8138280 2020-02-11T16:08:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.843+0000 7f37bfe25700 1 -- 172.21.15.88:0/4094612482 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b81375c0 con 0x7f37b8138280 2020-02-11T16:08:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.844+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.844+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f37a8005af0 con 0x7f37b8138280 2020-02-11T16:08:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.844+0000 7f37bd3c0700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.844+0000 7f37a6ffd700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3798039ef0 0x7f379803c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.844+0000 7f37bfe25700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 0x7f37b812b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.844+0000 7f37bfe25700 1 -- 172.21.15.88:0/4094612482 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b805e2f0 con 0x7f37b8131850 2020-02-11T16:08:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.844+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f37a800f0c0 con 0x7f37b8138280 2020-02-11T16:08:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.844+0000 7f37bdbc1700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3798039ef0 0x7f379803c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.844+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 0x7f37b812b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37bdbc1700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3798039ef0 0x7f379803c3b0 crc :-1 s=READY pgs=152 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37be3c2700 1 -- 172.21.15.88:0/4094612482 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37b81326f0 con 0x7f37b8131850 2020-02-11T16:08:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 0x7f37b812b9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 0x7f37b812b9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 0x7f37b812b9e0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 0x7f37b812b9e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b00103b0 con 0x7f37b8131850 2020-02-11T16:08:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 0x7f37b812b9e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f37b0010510 con 0x7f37b8131850 2020-02-11T16:08:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 msgr2=0x7f37b812b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37a6ffd700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 0x7f37b812b9e0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).stop 2020-02-11T16:08:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 msgr2=0x7f37b812b9e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.845+0000 7f37a6ffd700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131850 0x7f37b812b9e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.855+0000 7f37bfe25700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 0x7f37b812c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.855+0000 7f37bfe25700 1 -- 172.21.15.88:0/4094612482 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b812fa60 con 0x7f37b8131c30 2020-02-11T16:08:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.855+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 0x7f37b812c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37be3c2700 1 -- 172.21.15.88:0/4094612482 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f37b80565b0 con 0x7f37b8131c30 2020-02-11T16:08:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 0x7f37b812c4b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 0x7f37b812c4b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 0x7f37b812c4b0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 0x7f37b812c4b0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b0002220 con 0x7f37b8131c30 2020-02-11T16:08:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37be3c2700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 0x7f37b812c4b0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7f37b00183c0 con 0x7f37b8131c30 2020-02-11T16:08:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 msgr2=0x7f37b812c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37a6ffd700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 0x7f37b812c4b0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).stop 2020-02-11T16:08:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37a6ffd700 1 -- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 msgr2=0x7f37b812c4b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.856+0000 7f37a6ffd700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8131c30 0x7f37b812c4b0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0x7f37b0001510 tx=0x7f37b0011380).stop 2020-02-11T16:08:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.857+0000 7f37bfe25700 1 -- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3798039ef0 msgr2=0x7f379803c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.857+0000 7f37bfe25700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3798039ef0 0x7f379803c3b0 crc :-1 s=READY pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.857+0000 7f37bfe25700 1 -- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 msgr2=0x7f37b812fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.857+0000 7f37bfe25700 1 --2- 172.21.15.88:0/4094612482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37b8138280 0x7f37b812fd70 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f37b0001450 tx=0x7f37a8007a40).stop 2020-02-11T16:08:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.857+0000 7f37be3c2700 1 -- 172.21.15.88:0/4094612482 reap_dead start 2020-02-11T16:08:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.857+0000 7f37be3c2700 1 -- 172.21.15.88:0/4094612482 reap_dead start 2020-02-11T16:08:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.857+0000 7f37bfe25700 1 -- 172.21.15.88:0/4094612482 shutdown_connections 2020-02-11T16:08:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.857+0000 7f37bfe25700 1 -- 172.21.15.88:0/4094612482 >> 172.21.15.88:0/4094612482 conn(0x7f37b805ac70 msgr2=0x7f37b8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.857+0000 7f37bfe25700 1 -- 172.21.15.88:0/4094612482 shutdown_connections 2020-02-11T16:08:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:25.857+0000 7f37bfe25700 1 -- 172.21.15.88:0/4094612482 wait complete. 2020-02-11T16:08:25.864 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:08:25.864 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:08:25.865 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:08:25.865 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:08:25.865 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 38, 2020-02-11T16:08:25.865 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:08:25.865 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:08:25.865 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:08:25.865 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:08:25.865 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.866 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2020-02-11T16:08:25.866 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:25.866 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:08:25.866 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:08:25.866 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:25.866 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:25.866 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:25.867 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:25.867 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:25.867 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:25.867 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.867 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:08:25.867 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:08:25.868 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:25.868 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:25.868 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:25.868 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:25.868 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:25.868 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:25.868 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.869 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:08:25.869 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:08:25.869 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:08:25.869 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:08:25.869 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:08:25.869 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:08:25.869 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:25.870 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:25.870 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:08:25.870 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:08:25.870 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:25.870 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:08:25.870 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:25.870 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:25.871 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:25.871 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:25.871 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:25.871 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:25.871 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.871 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:08:25.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.872 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:08:25.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.872 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:25.872 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:25.872 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:25.872 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:25.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.873 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:25.873 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:08:25.873 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.873 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:25.873 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:08:25.874 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.874 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.874 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.874 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:08:25.874 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:08:25.874 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:25.875 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:25.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.875 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:25.875 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:25.875 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:25.875 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:25.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.876 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:25.876 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:08:25.876 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.876 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:25.876 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:08:25.877 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.877 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.877 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.877 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:08:25.877 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:08:25.877 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:25.878 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:25.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.878 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:08:25.878 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:08:25.878 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:25.878 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:25.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.879 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:25.879 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:08:25.879 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.879 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:25.880 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:08:25.880 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:25.880 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.880 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.880 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:08:25.880 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:08:25.880 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:25.881 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:25.881 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.881 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:25.881 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:08:25.881 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:08:25.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.882 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:25.882 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:25.882 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:25.882 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.882 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.882 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:08:25.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.882 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:25.883 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:25.883 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:25.883 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.883 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.883 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:08:25.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.883 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:25.884 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:25.884 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:08:25.884 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.884 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.884 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:08:25.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.884 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:25.884 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:25.885 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:08:25.885 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.885 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:25.885 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:08:25.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:25.885 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:25.885 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:25.886 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:08:25.886 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.886 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:25.886 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:25.886 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:08:25.887 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:08:25.887 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:08:26.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.009+0000 7f77a265c700 1 Processor -- start 2020-02-11T16:08:26.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.009+0000 7f77a265c700 1 -- start start 2020-02-11T16:08:26.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.009+0000 7f77a265c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f779c0a18a0 0x7f779c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:26.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.009+0000 7f77a265c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a6260 0x7f779c12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:26.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.009+0000 7f77a265c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0a3570 con 0x7f779c0a5de0 2020-02-11T16:08:26.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.009+0000 7f77a265c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c0a3810 con 0x7f779c0a18a0 2020-02-11T16:08:26.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.009+0000 7f77a265c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0a3ab0 con 0x7f779c0a6260 2020-02-11T16:08:26.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.009+0000 7f779bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f779c0a18a0 0x7f779c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:26.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f779c0a18a0 0x7f779c0a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53308/0 (socket says 172.21.15.88:53308) 2020-02-11T16:08:26.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f77a0bf9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a6260 0x7f779c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:26.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 -- 172.21.15.88:0/2073547038 learned_addr learned my addr 172.21.15.88:0/2073547038 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:26.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779b7fe700 1 --1- 172.21.15.88:0/2073547038 >> v1:172.21.15.52:6789/0 conn(0x7f779c0a5de0 0x7f779c12e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60948/0 (socket says 172.21.15.88:60948) 2020-02-11T16:08:26.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 -- 172.21.15.88:0/2073547038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a6260 msgr2=0x7f779c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:08:26.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 --2- 172.21.15.88:0/2073547038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a6260 0x7f779c12eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:26.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 -- 172.21.15.88:0/2073547038 >> v1:172.21.15.52:6789/0 conn(0x7f779c0a5de0 legacy=0x7f779c12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:26.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779affd700 1 -- 172.21.15.88:0/2073547038 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498271217 0 0) 0x7f779c0a3570 con 0x7f779c0a5de0 2020-02-11T16:08:26.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 -- 172.21.15.88:0/2073547038 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0a3d50 con 0x7f779c0a18a0 2020-02-11T16:08:26.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 --2- 172.21.15.88:0/2073547038 >> v2:172.21.15.88:3300/0 conn(0x7f779c0a18a0 0x7f779c0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f778c002f30 tx=0x7f778c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 --2- 172.21.15.88:0/2073547038 >> v2:172.21.15.88:3300/0 conn(0x7f779c0a18a0 0x7f779c0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f778c002f30 tx=0x7f778c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 --2- 172.21.15.88:0/2073547038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f779c0a18a0 0x7f779c0a6dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f778c002f30 tx=0x7f778c0088e0).ready entity=mon.1 client_cookie=27a44b6208119c4a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:26.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 --2- 172.21.15.88:0/2073547038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f779c0a18a0 0x7f779c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f778c002f30 tx=0x7f778c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 --2- 172.21.15.88:0/2073547038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f779c0a18a0 0x7f779c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f778c002f30 tx=0x7f778c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779bfff700 1 --2- 172.21.15.88:0/2073547038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f779c0a18a0 0x7f779c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f778c002f30 tx=0x7f778c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779affd700 1 -- 172.21.15.88:0/2073547038 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f778c0138c0 con 0x7f779c0a18a0 2020-02-11T16:08:26.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779affd700 1 -- 172.21.15.88:0/2073547038 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c013a20 con 0x7f779c0a18a0 2020-02-11T16:08:26.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f779affd700 1 -- 172.21.15.88:0/2073547038 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f778c013e00 con 0x7f779c0a18a0 2020-02-11T16:08:26.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f77a265c700 1 -- 172.21.15.88:0/2073547038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f779c0a18a0 msgr2=0x7f779c0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:26.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.010+0000 7f77a265c700 1 --2- 172.21.15.88:0/2073547038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f779c0a18a0 0x7f779c0a6dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f778c002f30 tx=0x7f778c0088e0).stop 2020-02-11T16:08:26.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.011+0000 7f77a265c700 1 -- 172.21.15.88:0/2073547038 shutdown_connections 2020-02-11T16:08:26.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.011+0000 7f77a265c700 1 --2- 172.21.15.88:0/2073547038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a6260 0x7f779c12eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:26.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.011+0000 7f77a265c700 1 --2- 172.21.15.88:0/2073547038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f779c0a18a0 0x7f779c0a6dd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:26.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.011+0000 7f77a265c700 1 -- 172.21.15.88:0/2073547038 >> 172.21.15.88:0/2073547038 conn(0x7f779c09d110 msgr2=0x7f779c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:26.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.011+0000 7f77a265c700 1 -- 172.21.15.88:0/2073547038 shutdown_connections 2020-02-11T16:08:26.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.011+0000 7f77a265c700 1 -- 172.21.15.88:0/2073547038 wait complete. 2020-02-11T16:08:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.012+0000 7f77a265c700 1 Processor -- start 2020-02-11T16:08:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.012+0000 7f77a265c700 1 -- start start 2020-02-11T16:08:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f77a265c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f77a265c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f779c0a5de0 0x7f779c128880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f77a265c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c1328f0 con 0x7f779c0a6260 2020-02-11T16:08:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f77a265c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c09df70 con 0x7f779c0a5de0 2020-02-11T16:08:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f77a265c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c128ce0 con 0x7f779c0a18a0 2020-02-11T16:08:26.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f779c0a5de0 0x7f779c128880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:26.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:26.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f779c0a5de0 0x7f779c128880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53316/0 (socket says 172.21.15.88:53316) 2020-02-11T16:08:26.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779b7fe700 1 -- 172.21.15.88:0/859996283 learned_addr learned my addr 172.21.15.88:0/859996283 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:26.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:47638/0 (socket says 172.21.15.88:47638) 2020-02-11T16:08:26.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779bfff700 1 -- 172.21.15.88:0/859996283 >> v2:172.21.15.88:3300/0 conn(0x7f779c0a5de0 msgr2=0x7f779c128880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:26.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> v2:172.21.15.88:3300/0 conn(0x7f779c0a5de0 0x7f779c128880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:26.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779bfff700 1 -- 172.21.15.88:0/859996283 >> v1:172.21.15.88:6789/0 conn(0x7f779c0a6260 legacy=0x7f779c132fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:26.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779bfff700 1 -- 172.21.15.88:0/859996283 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c066c90 con 0x7f779c0a18a0 2020-02-11T16:08:26.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779b7fe700 1 --2- 172.21.15.88:0/859996283 >> v2:172.21.15.88:3300/0 conn(0x7f779c0a5de0 0x7f779c128880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:08:26.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:26.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.013+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.014+0000 7f77997fa700 1 -- 172.21.15.88:0/859996283 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f778c00f8f0 con 0x7f779c0a18a0 2020-02-11T16:08:26.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.014+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.014+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.014+0000 7f77997fa700 1 -- 172.21.15.88:0/859996283 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c007340 con 0x7f779c0a18a0 2020-02-11T16:08:26.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.014+0000 7f77a265c700 1 -- 172.21.15.88:0/859996283 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c132b20 con 0x7f779c0a18a0 2020-02-11T16:08:26.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.014+0000 7f77997fa700 1 -- 172.21.15.88:0/859996283 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f778c0056c0 con 0x7f779c0a18a0 2020-02-11T16:08:26.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.014+0000 7f77a265c700 1 -- 172.21.15.88:0/859996283 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c135b40 con 0x7f779c0a18a0 2020-02-11T16:08:26.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.014+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.014+0000 7f77997fa700 1 -- 172.21.15.88:0/859996283 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f778c00fba0 con 0x7f779c0a18a0 2020-02-11T16:08:26.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.014+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.015+0000 7f77997fa700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f777c039c20 0x7f777c03c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:26.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.015+0000 7f77a265c700 1 -- 172.21.15.88:0/859996283 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c132d20 con 0x7f779c0a18a0 2020-02-11T16:08:26.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.015+0000 7f77997fa700 1 -- 172.21.15.88:0/859996283 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f778c049950 con 0x7f779c0a18a0 2020-02-11T16:08:26.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.015+0000 7f779b7fe700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f777c039c20 0x7f777c03c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:26.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.015+0000 7f779b7fe700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f777c039c20 0x7f777c03c0e0 crc :-1 s=READY pgs=153 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:26.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.019+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.019+0000 7f77997fa700 1 -- 172.21.15.88:0/859996283 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f779c132d20 con 0x7f779c0a18a0 2020-02-11T16:08:26.130 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2020-02-11T16:08:26.130 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2020-02-11T16:08:26.130 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2020-02-11T16:08:26.131 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2020-02-11T16:08:26.131 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2020-02-11T16:08:26.131 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2020-02-11T16:08:26.131 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2020-02-11T16:08:26.131 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2020-02-11T16:08:26.131 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2020-02-11T16:08:26.131 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2020-02-11T16:08:26.131 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2020-02-11T16:08:26.132 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2020-02-11T16:08:26.132 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2020-02-11T16:08:26.132 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2020-02-11T16:08:26.132 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2020-02-11T16:08:26.132 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2020-02-11T16:08:26.132 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2020-02-11T16:08:26.132 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2020-02-11T16:08:26.133 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2020-02-11T16:08:26.133 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2020-02-11T16:08:26.133 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2020-02-11T16:08:26.133 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2020-02-11T16:08:26.133 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2020-02-11T16:08:26.133 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2020-02-11T16:08:26.133 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2020-02-11T16:08:26.134 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2020-02-11T16:08:26.134 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2020-02-11T16:08:26.134 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2020-02-11T16:08:26.134 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2020-02-11T16:08:26.134 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2020-02-11T16:08:26.134 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2020-02-11T16:08:26.134 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2020-02-11T16:08:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2020-02-11T16:08:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2020-02-11T16:08:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2020-02-11T16:08:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2020-02-11T16:08:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2020-02-11T16:08:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2020-02-11T16:08:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2020-02-11T16:08:26.136 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2020-02-11T16:08:26.136 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2020-02-11T16:08:26.136 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2020-02-11T16:08:26.136 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2020-02-11T16:08:26.136 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2020-02-11T16:08:26.136 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2020-02-11T16:08:26.137 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2020-02-11T16:08:26.137 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2020-02-11T16:08:26.137 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2020-02-11T16:08:26.137 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2020-02-11T16:08:26.137 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2020-02-11T16:08:26.137 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2020-02-11T16:08:26.137 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2020-02-11T16:08:26.138 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2020-02-11T16:08:26.138 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2020-02-11T16:08:26.138 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2020-02-11T16:08:26.138 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2020-02-11T16:08:26.138 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2020-02-11T16:08:26.138 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2020-02-11T16:08:26.138 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2020-02-11T16:08:26.139 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2020-02-11T16:08:26.139 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2020-02-11T16:08:26.139 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2020-02-11T16:08:26.139 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2020-02-11T16:08:26.139 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2020-02-11T16:08:26.139 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2020-02-11T16:08:26.139 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2020-02-11T16:08:26.140 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2020-02-11T16:08:26.140 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2020-02-11T16:08:26.140 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2020-02-11T16:08:26.140 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2020-02-11T16:08:26.140 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2020-02-11T16:08:26.140 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2020-02-11T16:08:26.141 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2020-02-11T16:08:26.141 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2020-02-11T16:08:26.141 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2020-02-11T16:08:26.141 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2020-02-11T16:08:26.141 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2020-02-11T16:08:26.141 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2020-02-11T16:08:26.141 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2020-02-11T16:08:26.141 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2020-02-11T16:08:26.142 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2020-02-11T16:08:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.251+0000 7f77a265c700 1 -- 172.21.15.88:0/859996283 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f779c132d20 con 0x7f779c0a18a0 2020-02-11T16:08:26.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.252+0000 7f779bfff700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:26.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.252+0000 7f77997fa700 1 -- 172.21.15.88:0/859996283 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f779c132d20 con 0x7f779c0a18a0 2020-02-11T16:08:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 -- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f777c039c20 msgr2=0x7f777c03c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f777c039c20 0x7f777c03c0e0 crc :-1 s=READY pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 -- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 msgr2=0x7f779c128420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).stop 2020-02-11T16:08:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 -- 172.21.15.88:0/859996283 shutdown_connections 2020-02-11T16:08:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f777c039c20 0x7f777c03c0e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 --2- 172.21.15.88:0/859996283 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f779c0a18a0 0x7f779c128420 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0x7f779c138960 tx=0x7f779c0a1c80).stop 2020-02-11T16:08:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 --2- 172.21.15.88:0/859996283 >> v2:172.21.15.88:3300/0 conn(0x7f779c0a5de0 0x7f779c128880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 -- 172.21.15.88:0/859996283 >> 172.21.15.88:0/859996283 conn(0x7f779c09d110 msgr2=0x7f779c0a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 -- 172.21.15.88:0/859996283 shutdown_connections 2020-02-11T16:08:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:26.254+0000 7f77a265c700 1 -- 172.21.15.88:0/859996283 wait complete. 2020-02-11T16:08:26.268 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:08:26.790 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2020-02-11T16:08:26.790 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2020-02-11T16:08:26.791 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2020-02-11T16:08:26.791 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2020-02-11T16:08:26.791 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2020-02-11T16:08:26.791 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2020-02-11T16:08:26.791 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2020-02-11T16:08:26.791 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2020-02-11T16:08:26.791 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2020-02-11T16:08:26.792 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2020-02-11T16:08:26.792 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2020-02-11T16:08:26.792 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2020-02-11T16:08:26.792 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2020-02-11T16:08:26.792 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2020-02-11T16:08:26.792 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2020-02-11T16:08:26.792 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2020-02-11T16:08:26.792 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2020-02-11T16:08:26.793 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2020-02-11T16:08:26.793 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2020-02-11T16:08:26.793 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2020-02-11T16:08:26.793 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2020-02-11T16:08:26.793 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2020-02-11T16:08:26.793 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2020-02-11T16:08:26.793 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2020-02-11T16:08:26.794 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2020-02-11T16:08:26.794 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2020-02-11T16:08:26.794 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2020-02-11T16:08:26.794 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2020-02-11T16:08:26.794 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2020-02-11T16:08:26.794 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2020-02-11T16:08:26.794 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2020-02-11T16:08:26.795 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2020-02-11T16:08:26.795 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2020-02-11T16:08:26.795 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2020-02-11T16:08:26.795 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2020-02-11T16:08:26.795 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2020-02-11T16:08:26.795 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2020-02-11T16:08:26.795 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2020-02-11T16:08:26.795 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2020-02-11T16:08:26.796 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2020-02-11T16:08:26.796 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2020-02-11T16:08:26.796 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2020-02-11T16:08:26.796 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2020-02-11T16:08:26.797 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2020-02-11T16:08:26.797 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2020-02-11T16:08:26.797 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2020-02-11T16:08:26.797 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2020-02-11T16:08:26.797 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2020-02-11T16:08:26.797 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2020-02-11T16:08:26.798 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2020-02-11T16:08:26.798 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2020-02-11T16:08:26.798 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2020-02-11T16:08:26.798 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2020-02-11T16:08:26.798 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2020-02-11T16:08:26.799 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2020-02-11T16:08:26.799 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2020-02-11T16:08:26.799 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2020-02-11T16:08:26.799 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2020-02-11T16:08:26.799 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2020-02-11T16:08:26.799 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2020-02-11T16:08:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2020-02-11T16:08:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2020-02-11T16:08:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2020-02-11T16:08:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2020-02-11T16:08:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2020-02-11T16:08:26.801 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2020-02-11T16:08:26.801 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2020-02-11T16:08:26.801 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2020-02-11T16:08:26.801 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2020-02-11T16:08:26.801 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2020-02-11T16:08:26.801 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2020-02-11T16:08:26.801 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2020-02-11T16:08:26.802 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2020-02-11T16:08:26.802 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2020-02-11T16:08:26.802 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2020-02-11T16:08:26.802 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2020-02-11T16:08:26.802 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2020-02-11T16:08:26.802 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2020-02-11T16:08:26.802 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2020-02-11T16:08:26.803 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2020-02-11T16:08:26.803 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2020-02-11T16:08:27.382 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2020-02-11T16:08:27.382 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2020-02-11T16:08:27.382 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2020-02-11T16:08:27.382 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2020-02-11T16:08:27.382 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2020-02-11T16:08:27.382 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2020-02-11T16:08:27.383 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2020-02-11T16:08:27.383 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2020-02-11T16:08:27.383 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2020-02-11T16:08:27.383 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2020-02-11T16:08:27.383 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2020-02-11T16:08:27.383 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2020-02-11T16:08:27.383 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2020-02-11T16:08:27.383 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2020-02-11T16:08:27.384 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2020-02-11T16:08:27.384 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2020-02-11T16:08:27.384 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2020-02-11T16:08:27.384 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2020-02-11T16:08:27.384 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2020-02-11T16:08:27.384 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2020-02-11T16:08:27.384 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2020-02-11T16:08:27.385 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2020-02-11T16:08:27.385 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2020-02-11T16:08:27.385 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2020-02-11T16:08:27.385 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2020-02-11T16:08:27.385 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2020-02-11T16:08:27.385 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2020-02-11T16:08:27.386 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2020-02-11T16:08:27.386 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2020-02-11T16:08:27.386 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2020-02-11T16:08:27.386 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2020-02-11T16:08:27.386 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2020-02-11T16:08:27.386 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2020-02-11T16:08:27.387 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2020-02-11T16:08:27.387 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2020-02-11T16:08:27.387 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2020-02-11T16:08:27.387 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2020-02-11T16:08:27.387 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2020-02-11T16:08:27.388 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2020-02-11T16:08:27.388 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2020-02-11T16:08:27.388 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2020-02-11T16:08:27.388 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2020-02-11T16:08:27.388 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2020-02-11T16:08:27.388 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2020-02-11T16:08:27.389 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2020-02-11T16:08:27.389 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2020-02-11T16:08:27.389 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2020-02-11T16:08:27.389 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2020-02-11T16:08:27.389 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2020-02-11T16:08:27.389 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2020-02-11T16:08:27.389 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2020-02-11T16:08:27.390 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2020-02-11T16:08:27.390 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2020-02-11T16:08:27.390 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2020-02-11T16:08:27.390 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2020-02-11T16:08:27.390 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2020-02-11T16:08:27.390 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2020-02-11T16:08:27.390 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2020-02-11T16:08:27.391 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2020-02-11T16:08:27.391 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2020-02-11T16:08:27.391 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2020-02-11T16:08:27.391 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2020-02-11T16:08:27.391 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2020-02-11T16:08:27.391 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2020-02-11T16:08:27.391 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2020-02-11T16:08:27.392 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2020-02-11T16:08:27.392 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2020-02-11T16:08:27.392 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2020-02-11T16:08:27.392 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2020-02-11T16:08:27.392 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2020-02-11T16:08:27.392 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2020-02-11T16:08:27.392 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2020-02-11T16:08:27.393 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2020-02-11T16:08:27.393 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2020-02-11T16:08:27.393 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2020-02-11T16:08:27.393 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2020-02-11T16:08:27.393 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2020-02-11T16:08:27.393 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2020-02-11T16:08:27.394 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2020-02-11T16:08:27.394 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2020-02-11T16:08:27.394 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2020-02-11T16:08:27.937 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2020-02-11T16:08:27.937 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2020-02-11T16:08:27.937 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2020-02-11T16:08:27.938 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2020-02-11T16:08:27.938 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2020-02-11T16:08:27.938 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2020-02-11T16:08:27.938 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2020-02-11T16:08:27.938 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2020-02-11T16:08:27.938 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2020-02-11T16:08:27.938 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2020-02-11T16:08:27.939 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2020-02-11T16:08:27.939 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2020-02-11T16:08:27.939 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2020-02-11T16:08:27.939 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2020-02-11T16:08:27.939 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2020-02-11T16:08:27.939 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2020-02-11T16:08:27.939 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2020-02-11T16:08:27.940 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2020-02-11T16:08:27.940 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2020-02-11T16:08:27.940 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2020-02-11T16:08:27.940 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2020-02-11T16:08:27.940 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2020-02-11T16:08:27.940 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2020-02-11T16:08:27.940 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2020-02-11T16:08:27.941 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2020-02-11T16:08:27.941 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2020-02-11T16:08:27.941 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2020-02-11T16:08:27.941 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2020-02-11T16:08:27.941 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2020-02-11T16:08:27.941 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2020-02-11T16:08:27.941 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2020-02-11T16:08:27.942 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2020-02-11T16:08:27.942 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2020-02-11T16:08:27.942 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2020-02-11T16:08:27.942 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2020-02-11T16:08:27.942 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2020-02-11T16:08:27.942 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2020-02-11T16:08:27.942 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2020-02-11T16:08:27.942 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2020-02-11T16:08:27.943 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2020-02-11T16:08:27.943 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2020-02-11T16:08:27.943 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2020-02-11T16:08:27.943 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2020-02-11T16:08:27.943 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2020-02-11T16:08:27.943 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2020-02-11T16:08:27.943 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2020-02-11T16:08:27.944 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2020-02-11T16:08:27.944 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2020-02-11T16:08:27.944 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2020-02-11T16:08:27.944 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2020-02-11T16:08:27.945 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2020-02-11T16:08:27.945 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2020-02-11T16:08:27.945 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2020-02-11T16:08:27.945 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2020-02-11T16:08:27.945 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2020-02-11T16:08:27.945 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2020-02-11T16:08:27.945 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2020-02-11T16:08:27.946 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2020-02-11T16:08:27.946 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2020-02-11T16:08:27.946 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2020-02-11T16:08:27.946 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2020-02-11T16:08:27.946 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2020-02-11T16:08:27.946 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2020-02-11T16:08:27.946 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2020-02-11T16:08:27.947 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2020-02-11T16:08:27.947 INFO:tasks.workunit.client.0.smithi088.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2020-02-11T16:08:27.947 INFO:tasks.workunit.client.0.smithi088.stdout:Take third snapshot .snap/test3 2020-02-11T16:08:28.034 INFO:tasks.workunit.client.0.smithi088.stdout:Delete the snapshots... 2020-02-11T16:08:29.044 INFO:tasks.workunit.client.0.smithi088.stdout:.//.snap/test1 2020-02-11T16:08:29.044 INFO:tasks.workunit.client.0.smithi088.stdout:.//.snap/test2 2020-02-11T16:08:29.044 INFO:tasks.workunit.client.0.smithi088.stdout:.//.snap/test3 2020-02-11T16:08:29.052 INFO:tasks.workunit.client.0.smithi088.stdout:./274/.snap/snap-subdir-test 2020-02-11T16:08:29.061 INFO:tasks.workunit.client.0.smithi088.stdout:./166/.snap/snap-subdir-test 2020-02-11T16:08:29.070 INFO:tasks.workunit.client.0.smithi088.stdout:./256/.snap/snap-subdir-test 2020-02-11T16:08:29.078 INFO:tasks.workunit.client.0.smithi088.stdout:./247/.snap/snap-subdir-test 2020-02-11T16:08:29.086 INFO:tasks.workunit.client.0.smithi088.stdout:./248/.snap/snap-subdir-test 2020-02-11T16:08:29.095 INFO:tasks.workunit.client.0.smithi088.stdout:./147/.snap/snap-subdir-test 2020-02-11T16:08:29.104 INFO:tasks.workunit.client.0.smithi088.stdout:./151/.snap/snap-subdir-test 2020-02-11T16:08:29.113 INFO:tasks.workunit.client.0.smithi088.stdout:./170/.snap/snap-subdir-test 2020-02-11T16:08:29.122 INFO:tasks.workunit.client.0.smithi088.stdout:./167/.snap/snap-subdir-test 2020-02-11T16:08:29.130 INFO:tasks.workunit.client.0.smithi088.stdout:./140/.snap/snap-subdir-test 2020-02-11T16:08:29.139 INFO:tasks.workunit.client.0.smithi088.stdout:./142/.snap/snap-subdir-test 2020-02-11T16:08:29.148 INFO:tasks.workunit.client.0.smithi088.stdout:./150/.snap/snap-subdir-test 2020-02-11T16:08:29.156 INFO:tasks.workunit.client.0.smithi088.stdout:./273/.snap/snap-subdir-test 2020-02-11T16:08:29.165 INFO:tasks.workunit.client.0.smithi088.stdout:./269/.snap/snap-subdir-test 2020-02-11T16:08:29.173 INFO:tasks.workunit.client.0.smithi088.stdout:./105/.snap/snap-subdir-test 2020-02-11T16:08:29.182 INFO:tasks.workunit.client.0.smithi088.stdout:./210/.snap/snap-subdir-test 2020-02-11T16:08:29.190 INFO:tasks.workunit.client.0.smithi088.stdout:./265/.snap/snap-subdir-test 2020-02-11T16:08:29.198 INFO:tasks.workunit.client.0.smithi088.stdout:./218/.snap/snap-subdir-test 2020-02-11T16:08:29.208 INFO:tasks.workunit.client.0.smithi088.stdout:./290/.snap/snap-subdir-test 2020-02-11T16:08:29.215 INFO:tasks.workunit.client.0.smithi088.stdout:./149/.snap/snap-subdir-test 2020-02-11T16:08:29.224 INFO:tasks.workunit.client.0.smithi088.stdout:./109/.snap/snap-subdir-test 2020-02-11T16:08:29.232 INFO:tasks.workunit.client.0.smithi088.stdout:./292/.snap/snap-subdir-test 2020-02-11T16:08:29.240 INFO:tasks.workunit.client.0.smithi088.stdout:./242/.snap/snap-subdir-test 2020-02-11T16:08:29.249 INFO:tasks.workunit.client.0.smithi088.stdout:./158/.snap/snap-subdir-test 2020-02-11T16:08:29.257 INFO:tasks.workunit.client.0.smithi088.stdout:./243/.snap/snap-subdir-test 2020-02-11T16:08:29.266 INFO:tasks.workunit.client.0.smithi088.stdout:./106/.snap/snap-subdir-test 2020-02-11T16:08:29.274 INFO:tasks.workunit.client.0.smithi088.stdout:./250/.snap/snap-subdir-test 2020-02-11T16:08:29.282 INFO:tasks.workunit.client.0.smithi088.stdout:./221/.snap/snap-subdir-test 2020-02-11T16:08:29.290 INFO:tasks.workunit.client.0.smithi088.stdout:./244/.snap/snap-subdir-test 2020-02-11T16:08:29.298 INFO:tasks.workunit.client.0.smithi088.stdout:./258/.snap/snap-subdir-test 2020-02-11T16:08:29.306 INFO:tasks.workunit.client.0.smithi088.stdout:./268/.snap/snap-subdir-test 2020-02-11T16:08:29.315 INFO:tasks.workunit.client.0.smithi088.stdout:./189/.snap/snap-subdir-test 2020-02-11T16:08:29.323 INFO:tasks.workunit.client.0.smithi088.stdout:./285/.snap/snap-subdir-test 2020-02-11T16:08:29.330 INFO:tasks.workunit.client.0.smithi088.stdout:./208/.snap/snap-subdir-test 2020-02-11T16:08:29.338 INFO:tasks.workunit.client.0.smithi088.stdout:./288/.snap/snap-subdir-test 2020-02-11T16:08:29.347 INFO:tasks.workunit.client.0.smithi088.stdout:./209/.snap/snap-subdir-test 2020-02-11T16:08:29.355 INFO:tasks.workunit.client.0.smithi088.stdout:./253/.snap/snap-subdir-test 2020-02-11T16:08:29.363 INFO:tasks.workunit.client.0.smithi088.stdout:./249/.snap/snap-subdir-test 2020-02-11T16:08:29.372 INFO:tasks.workunit.client.0.smithi088.stdout:./133/.snap/snap-subdir-test 2020-02-11T16:08:29.379 INFO:tasks.workunit.client.0.smithi088.stdout:./291/.snap/snap-subdir-test 2020-02-11T16:08:29.387 INFO:tasks.workunit.client.0.smithi088.stdout:./226/.snap/snap-subdir-test 2020-02-11T16:08:29.396 INFO:tasks.workunit.client.0.smithi088.stdout:./173/.snap/snap-subdir-test 2020-02-11T16:08:29.404 INFO:tasks.workunit.client.0.smithi088.stdout:./174/.snap/snap-subdir-test 2020-02-11T16:08:29.412 INFO:tasks.workunit.client.0.smithi088.stdout:./299/.snap/snap-subdir-test 2020-02-11T16:08:29.421 INFO:tasks.workunit.client.0.smithi088.stdout:./262/.snap/snap-subdir-test 2020-02-11T16:08:29.429 INFO:tasks.workunit.client.0.smithi088.stdout:./231/.snap/snap-subdir-test 2020-02-11T16:08:29.439 INFO:tasks.workunit.client.0.smithi088.stdout:./214/.snap/snap-subdir-test 2020-02-11T16:08:29.446 INFO:tasks.workunit.client.0.smithi088.stdout:./281/.snap/snap-subdir-test 2020-02-11T16:08:29.453 INFO:tasks.workunit.client.0.smithi088.stdout:./289/.snap/snap-subdir-test 2020-02-11T16:08:29.461 INFO:tasks.workunit.client.0.smithi088.stdout:./283/.snap/snap-subdir-test 2020-02-11T16:08:29.587 INFO:tasks.workunit.client.0.smithi088.stdout:./232/.snap/snap-subdir-test 2020-02-11T16:08:29.678 INFO:tasks.workunit.client.0.smithi088.stdout:./298/.snap/snap-subdir-test 2020-02-11T16:08:29.689 INFO:tasks.workunit.client.0.smithi088.stdout:./233/.snap/snap-subdir-test 2020-02-11T16:08:29.697 INFO:tasks.workunit.client.0.smithi088.stdout:./155/.snap/snap-subdir-test 2020-02-11T16:08:29.706 INFO:tasks.workunit.client.0.smithi088.stdout:./114/.snap/snap-subdir-test 2020-02-11T16:08:29.714 INFO:tasks.workunit.client.0.smithi088.stdout:./159/.snap/snap-subdir-test 2020-02-11T16:08:29.723 INFO:tasks.workunit.client.0.smithi088.stdout:./187/.snap/snap-subdir-test 2020-02-11T16:08:29.731 INFO:tasks.workunit.client.0.smithi088.stdout:./185/.snap/snap-subdir-test 2020-02-11T16:08:29.740 INFO:tasks.workunit.client.0.smithi088.stdout:./293/.snap/snap-subdir-test 2020-02-11T16:08:29.749 INFO:tasks.workunit.client.0.smithi088.stdout:./228/.snap/snap-subdir-test 2020-02-11T16:08:29.758 INFO:tasks.workunit.client.0.smithi088.stdout:./120/.snap/snap-subdir-test 2020-02-11T16:08:29.766 INFO:tasks.workunit.client.0.smithi088.stdout:./110/.snap/snap-subdir-test 2020-02-11T16:08:29.774 INFO:tasks.workunit.client.0.smithi088.stdout:./267/.snap/snap-subdir-test 2020-02-11T16:08:29.783 INFO:tasks.workunit.client.0.smithi088.stdout:./202/.snap/snap-subdir-test 2020-02-11T16:08:29.791 INFO:tasks.workunit.client.0.smithi088.stdout:./137/.snap/snap-subdir-test 2020-02-11T16:08:29.799 INFO:tasks.workunit.client.0.smithi088.stdout:./246/.snap/snap-subdir-test 2020-02-11T16:08:29.807 INFO:tasks.workunit.client.0.smithi088.stdout:./219/.snap/snap-subdir-test 2020-02-11T16:08:29.816 INFO:tasks.workunit.client.0.smithi088.stdout:./198/.snap/snap-subdir-test 2020-02-11T16:08:29.825 INFO:tasks.workunit.client.0.smithi088.stdout:./136/.snap/snap-subdir-test 2020-02-11T16:08:29.834 INFO:tasks.workunit.client.0.smithi088.stdout:./270/.snap/snap-subdir-test 2020-02-11T16:08:29.842 INFO:tasks.workunit.client.0.smithi088.stdout:./125/.snap/snap-subdir-test 2020-02-11T16:08:29.851 INFO:tasks.workunit.client.0.smithi088.stdout:./194/.snap/snap-subdir-test 2020-02-11T16:08:29.860 INFO:tasks.workunit.client.0.smithi088.stdout:./119/.snap/snap-subdir-test 2020-02-11T16:08:29.868 INFO:tasks.workunit.client.0.smithi088.stdout:./297/.snap/snap-subdir-test 2020-02-11T16:08:29.876 INFO:tasks.workunit.client.0.smithi088.stdout:./230/.snap/snap-subdir-test 2020-02-11T16:08:29.884 INFO:tasks.workunit.client.0.smithi088.stdout:./260/.snap/snap-subdir-test 2020-02-11T16:08:29.893 INFO:tasks.workunit.client.0.smithi088.stdout:./157/.snap/snap-subdir-test 2020-02-11T16:08:29.902 INFO:tasks.workunit.client.0.smithi088.stdout:./172/.snap/snap-subdir-test 2020-02-11T16:08:29.910 INFO:tasks.workunit.client.0.smithi088.stdout:./277/.snap/snap-subdir-test 2020-02-11T16:08:29.919 INFO:tasks.workunit.client.0.smithi088.stdout:./186/.snap/snap-subdir-test 2020-02-11T16:08:29.927 INFO:tasks.workunit.client.0.smithi088.stdout:./237/.snap/snap-subdir-test 2020-02-11T16:08:29.936 INFO:tasks.workunit.client.0.smithi088.stdout:./190/.snap/snap-subdir-test 2020-02-11T16:08:29.944 INFO:tasks.workunit.client.0.smithi088.stdout:./213/.snap/snap-subdir-test 2020-02-11T16:08:29.953 INFO:tasks.workunit.client.0.smithi088.stdout:./104/.snap/snap-subdir-test 2020-02-11T16:08:29.961 INFO:tasks.workunit.client.0.smithi088.stdout:./164/.snap/snap-subdir-test 2020-02-11T16:08:29.970 INFO:tasks.workunit.client.0.smithi088.stdout:./112/.snap/snap-subdir-test 2020-02-11T16:08:29.978 INFO:tasks.workunit.client.0.smithi088.stdout:./295/.snap/snap-subdir-test 2020-02-11T16:08:29.986 INFO:tasks.workunit.client.0.smithi088.stdout:./272/.snap/snap-subdir-test 2020-02-11T16:08:29.994 INFO:tasks.workunit.client.0.smithi088.stdout:./100/.snap/snap-subdir-test 2020-02-11T16:08:30.003 INFO:tasks.workunit.client.0.smithi088.stdout:./134/.snap/snap-subdir-test 2020-02-11T16:08:30.012 INFO:tasks.workunit.client.0.smithi088.stdout:./200/.snap/snap-subdir-test 2020-02-11T16:08:30.026 INFO:tasks.workunit.client.0.smithi088.stdout:./115/.snap/snap-subdir-test 2020-02-11T16:08:30.028 INFO:tasks.workunit.client.0.smithi088.stdout:./284/.snap/snap-subdir-test 2020-02-11T16:08:30.036 INFO:tasks.workunit.client.0.smithi088.stdout:./280/.snap/snap-subdir-test 2020-02-11T16:08:30.045 INFO:tasks.workunit.client.0.smithi088.stdout:./116/.snap/snap-subdir-test 2020-02-11T16:08:30.053 INFO:tasks.workunit.client.0.smithi088.stdout:./245/.snap/snap-subdir-test 2020-02-11T16:08:30.062 INFO:tasks.workunit.client.0.smithi088.stdout:./195/.snap/snap-subdir-test 2020-02-11T16:08:30.070 INFO:tasks.workunit.client.0.smithi088.stdout:./138/.snap/snap-subdir-test 2020-02-11T16:08:30.079 INFO:tasks.workunit.client.0.smithi088.stdout:./135/.snap/snap-subdir-test 2020-02-11T16:08:30.088 INFO:tasks.workunit.client.0.smithi088.stdout:./117/.snap/snap-subdir-test 2020-02-11T16:08:30.097 INFO:tasks.workunit.client.0.smithi088.stdout:./241/.snap/snap-subdir-test 2020-02-11T16:08:30.106 INFO:tasks.workunit.client.0.smithi088.stdout:./143/.snap/snap-subdir-test 2020-02-11T16:08:30.114 INFO:tasks.workunit.client.0.smithi088.stdout:./180/.snap/snap-subdir-test 2020-02-11T16:08:30.123 INFO:tasks.workunit.client.0.smithi088.stdout:./126/.snap/snap-subdir-test 2020-02-11T16:08:30.132 INFO:tasks.workunit.client.0.smithi088.stdout:./161/.snap/snap-subdir-test 2020-02-11T16:08:30.141 INFO:tasks.workunit.client.0.smithi088.stdout:./204/.snap/snap-subdir-test 2020-02-11T16:08:30.149 INFO:tasks.workunit.client.0.smithi088.stdout:./176/.snap/snap-subdir-test 2020-02-11T16:08:30.157 INFO:tasks.workunit.client.0.smithi088.stdout:./255/.snap/snap-subdir-test 2020-02-11T16:08:30.166 INFO:tasks.workunit.client.0.smithi088.stdout:./215/.snap/snap-subdir-test 2020-02-11T16:08:30.174 INFO:tasks.workunit.client.0.smithi088.stdout:./111/.snap/snap-subdir-test 2020-02-11T16:08:30.182 INFO:tasks.workunit.client.0.smithi088.stdout:./238/.snap/snap-subdir-test 2020-02-11T16:08:30.190 INFO:tasks.workunit.client.0.smithi088.stdout:./191/.snap/snap-subdir-test 2020-02-11T16:08:30.198 INFO:tasks.workunit.client.0.smithi088.stdout:./184/.snap/snap-subdir-test 2020-02-11T16:08:30.207 INFO:tasks.workunit.client.0.smithi088.stdout:./192/.snap/snap-subdir-test 2020-02-11T16:08:30.215 INFO:tasks.workunit.client.0.smithi088.stdout:./103/.snap/snap-subdir-test 2020-02-11T16:08:30.224 INFO:tasks.workunit.client.0.smithi088.stdout:./128/.snap/snap-subdir-test 2020-02-11T16:08:30.232 INFO:tasks.workunit.client.0.smithi088.stdout:./229/.snap/snap-subdir-test 2020-02-11T16:08:30.240 INFO:tasks.workunit.client.0.smithi088.stdout:./144/.snap/snap-subdir-test 2020-02-11T16:08:30.249 INFO:tasks.workunit.client.0.smithi088.stdout:./146/.snap/snap-subdir-test 2020-02-11T16:08:30.257 INFO:tasks.workunit.client.0.smithi088.stdout:./227/.snap/snap-subdir-test 2020-02-11T16:08:30.266 INFO:tasks.workunit.client.0.smithi088.stdout:./278/.snap/snap-subdir-test 2020-02-11T16:08:30.274 INFO:tasks.workunit.client.0.smithi088.stdout:./141/.snap/snap-subdir-test 2020-02-11T16:08:30.283 INFO:tasks.workunit.client.0.smithi088.stdout:./234/.snap/snap-subdir-test 2020-02-11T16:08:30.296 INFO:tasks.workunit.client.0.smithi088.stdout:./225/.snap/snap-subdir-test 2020-02-11T16:08:30.304 INFO:tasks.workunit.client.0.smithi088.stdout:./182/.snap/snap-subdir-test 2020-02-11T16:08:30.309 INFO:tasks.workunit.client.0.smithi088.stdout:./107/.snap/snap-subdir-test 2020-02-11T16:08:30.318 INFO:tasks.workunit.client.0.smithi088.stdout:./178/.snap/snap-subdir-test 2020-02-11T16:08:30.327 INFO:tasks.workunit.client.0.smithi088.stdout:./266/.snap/snap-subdir-test 2020-02-11T16:08:30.335 INFO:tasks.workunit.client.0.smithi088.stdout:./240/.snap/snap-subdir-test 2020-02-11T16:08:30.345 INFO:tasks.workunit.client.0.smithi088.stdout:./156/.snap/snap-subdir-test 2020-02-11T16:08:30.355 INFO:tasks.workunit.client.0.smithi088.stdout:./131/.snap/snap-subdir-test 2020-02-11T16:08:30.364 INFO:tasks.workunit.client.0.smithi088.stdout:./123/.snap/snap-subdir-test 2020-02-11T16:08:30.372 INFO:tasks.workunit.client.0.smithi088.stdout:./160/.snap/snap-subdir-test 2020-02-11T16:08:30.381 INFO:tasks.workunit.client.0.smithi088.stdout:./165/.snap/snap-subdir-test 2020-02-11T16:08:30.390 INFO:tasks.workunit.client.0.smithi088.stdout:./101/.snap/snap-subdir-test 2020-02-11T16:08:30.399 INFO:tasks.workunit.client.0.smithi088.stdout:./148/.snap/snap-subdir-test 2020-02-11T16:08:30.408 INFO:tasks.workunit.client.0.smithi088.stdout:./168/.snap/snap-subdir-test 2020-02-11T16:08:30.417 INFO:tasks.workunit.client.0.smithi088.stdout:./179/.snap/snap-subdir-test 2020-02-11T16:08:30.425 INFO:tasks.workunit.client.0.smithi088.stdout:./257/.snap/snap-subdir-test 2020-02-11T16:08:30.433 INFO:tasks.workunit.client.0.smithi088.stdout:./252/.snap/snap-subdir-test 2020-02-11T16:08:30.442 INFO:tasks.workunit.client.0.smithi088.stdout:./132/.snap/snap-subdir-test 2020-02-11T16:08:30.451 INFO:tasks.workunit.client.0.smithi088.stdout:./236/.snap/snap-subdir-test 2020-02-11T16:08:30.460 INFO:tasks.workunit.client.0.smithi088.stdout:./211/.snap/snap-subdir-test 2020-02-11T16:08:30.526 INFO:tasks.workunit.client.0.smithi088.stdout:./199/.snap/snap-subdir-test 2020-02-11T16:08:30.535 INFO:tasks.workunit.client.0.smithi088.stdout:./205/.snap/snap-subdir-test 2020-02-11T16:08:30.544 INFO:tasks.workunit.client.0.smithi088.stdout:./163/.snap/snap-subdir-test 2020-02-11T16:08:30.552 INFO:tasks.workunit.client.0.smithi088.stdout:./261/.snap/snap-subdir-test 2020-02-11T16:08:30.560 INFO:tasks.workunit.client.0.smithi088.stdout:./201/.snap/snap-subdir-test 2020-02-11T16:08:30.569 INFO:tasks.workunit.client.0.smithi088.stdout:./282/.snap/snap-subdir-test 2020-02-11T16:08:30.577 INFO:tasks.workunit.client.0.smithi088.stdout:./296/.snap/snap-subdir-test 2020-02-11T16:08:30.667 INFO:tasks.workunit.client.0.smithi088.stdout:./217/.snap/snap-subdir-test 2020-02-11T16:08:30.676 INFO:tasks.workunit.client.0.smithi088.stdout:./153/.snap/snap-subdir-test 2020-02-11T16:08:30.685 INFO:tasks.workunit.client.0.smithi088.stdout:./206/.snap/snap-subdir-test 2020-02-11T16:08:30.694 INFO:tasks.workunit.client.0.smithi088.stdout:./122/.snap/snap-subdir-test 2020-02-11T16:08:30.703 INFO:tasks.workunit.client.0.smithi088.stdout:./162/.snap/snap-subdir-test 2020-02-11T16:08:30.712 INFO:tasks.workunit.client.0.smithi088.stdout:./197/.snap/snap-subdir-test 2020-02-11T16:08:30.721 INFO:tasks.workunit.client.0.smithi088.stdout:./216/.snap/snap-subdir-test 2020-02-11T16:08:31.350 INFO:tasks.workunit.client.0.smithi088.stdout:./254/.snap/snap-subdir-test 2020-02-11T16:08:31.359 INFO:tasks.workunit.client.0.smithi088.stdout:./113/.snap/snap-subdir-test 2020-02-11T16:08:31.368 INFO:tasks.workunit.client.0.smithi088.stdout:./152/.snap/snap-subdir-test 2020-02-11T16:08:31.377 INFO:tasks.workunit.client.0.smithi088.stdout:./121/.snap/snap-subdir-test 2020-02-11T16:08:31.386 INFO:tasks.workunit.client.0.smithi088.stdout:./118/.snap/snap-subdir-test 2020-02-11T16:08:31.395 INFO:tasks.workunit.client.0.smithi088.stdout:./196/.snap/snap-subdir-test 2020-02-11T16:08:31.404 INFO:tasks.workunit.client.0.smithi088.stdout:./124/.snap/snap-subdir-test 2020-02-11T16:08:31.412 INFO:tasks.workunit.client.0.smithi088.stdout:./239/.snap/snap-subdir-test 2020-02-11T16:08:31.420 INFO:tasks.workunit.client.0.smithi088.stdout:./188/.snap/snap-subdir-test 2020-02-11T16:08:31.429 INFO:tasks.workunit.client.0.smithi088.stdout:./287/.snap/snap-subdir-test 2020-02-11T16:08:31.437 INFO:tasks.workunit.client.0.smithi088.stdout:./275/.snap/snap-subdir-test 2020-02-11T16:08:31.445 INFO:tasks.workunit.client.0.smithi088.stdout:./259/.snap/snap-subdir-test 2020-02-11T16:08:31.454 INFO:tasks.workunit.client.0.smithi088.stdout:./224/.snap/snap-subdir-test 2020-02-11T16:08:31.463 INFO:tasks.workunit.client.0.smithi088.stdout:./264/.snap/snap-subdir-test 2020-02-11T16:08:31.526 INFO:tasks.workunit.client.0.smithi088.stdout:./145/.snap/snap-subdir-test 2020-02-11T16:08:31.535 INFO:tasks.workunit.client.0.smithi088.stdout:./279/.snap/snap-subdir-test 2020-02-11T16:08:31.543 INFO:tasks.workunit.client.0.smithi088.stdout:./263/.snap/snap-subdir-test 2020-02-11T16:08:31.552 INFO:tasks.workunit.client.0.smithi088.stdout:./130/.snap/snap-subdir-test 2020-02-11T16:08:31.562 INFO:tasks.workunit.client.0.smithi088.stdout:./193/.snap/snap-subdir-test 2020-02-11T16:08:31.570 INFO:tasks.workunit.client.0.smithi088.stdout:./223/.snap/snap-subdir-test 2020-02-11T16:08:31.578 INFO:tasks.workunit.client.0.smithi088.stdout:./207/.snap/snap-subdir-test 2020-02-11T16:08:31.587 INFO:tasks.workunit.client.0.smithi088.stdout:./276/.snap/snap-subdir-test 2020-02-11T16:08:31.595 INFO:tasks.workunit.client.0.smithi088.stdout:./271/.snap/snap-subdir-test 2020-02-11T16:08:31.603 INFO:tasks.workunit.client.0.smithi088.stdout:./251/.snap/snap-subdir-test 2020-02-11T16:08:31.612 INFO:tasks.workunit.client.0.smithi088.stdout:./175/.snap/snap-subdir-test 2020-02-11T16:08:31.620 INFO:tasks.workunit.client.0.smithi088.stdout:./222/.snap/snap-subdir-test 2020-02-11T16:08:31.629 INFO:tasks.workunit.client.0.smithi088.stdout:./220/.snap/snap-subdir-test 2020-02-11T16:08:31.637 INFO:tasks.workunit.client.0.smithi088.stdout:./203/.snap/snap-subdir-test 2020-02-11T16:08:31.646 INFO:tasks.workunit.client.0.smithi088.stdout:./181/.snap/snap-subdir-test 2020-02-11T16:08:31.655 INFO:tasks.workunit.client.0.smithi088.stdout:./286/.snap/snap-subdir-test 2020-02-11T16:08:31.663 INFO:tasks.workunit.client.0.smithi088.stdout:./127/.snap/snap-subdir-test 2020-02-11T16:08:31.673 INFO:tasks.workunit.client.0.smithi088.stdout:./108/.snap/snap-subdir-test 2020-02-11T16:08:31.681 INFO:tasks.workunit.client.0.smithi088.stdout:./183/.snap/snap-subdir-test 2020-02-11T16:08:31.691 INFO:tasks.workunit.client.0.smithi088.stdout:./294/.snap/snap-subdir-test 2020-02-11T16:08:31.708 INFO:tasks.workunit.client.0.smithi088.stdout:./235/.snap/snap-subdir-test 2020-02-11T16:08:31.733 INFO:tasks.workunit.client.0.smithi088.stdout:./177/.snap/snap-subdir-test 2020-02-11T16:08:31.756 INFO:tasks.workunit.client.0.smithi088.stdout:./169/.snap/snap-subdir-test 2020-02-11T16:08:31.783 INFO:tasks.workunit.client.0.smithi088.stdout:./212/.snap/snap-subdir-test 2020-02-11T16:08:31.796 INFO:tasks.workunit.client.0.smithi088.stdout:./154/.snap/snap-subdir-test 2020-02-11T16:08:31.805 INFO:tasks.workunit.client.0.smithi088.stdout:./171/.snap/snap-subdir-test 2020-02-11T16:08:31.814 INFO:tasks.workunit.client.0.smithi088.stdout:./139/.snap/snap-subdir-test 2020-02-11T16:08:31.823 INFO:tasks.workunit.client.0.smithi088.stdout:./102/.snap/snap-subdir-test 2020-02-11T16:08:31.832 INFO:tasks.workunit.client.0.smithi088.stdout:./129/.snap/snap-subdir-test 2020-02-11T16:08:33.907 INFO:tasks.workunit.client.0.smithi088.stdout:Delete all the files and directories ... 2020-02-11T16:08:34.457 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/19' 2020-02-11T16:08:34.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/15' 2020-02-11T16:08:34.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/31' 2020-02-11T16:08:34.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/36' 2020-02-11T16:08:34.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/20' 2020-02-11T16:08:34.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/12' 2020-02-11T16:08:34.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/39' 2020-02-11T16:08:34.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/10' 2020-02-11T16:08:34.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/34' 2020-02-11T16:08:34.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/38' 2020-02-11T16:08:34.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/11' 2020-02-11T16:08:34.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/16' 2020-02-11T16:08:34.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/32' 2020-02-11T16:08:34.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/30' 2020-02-11T16:08:34.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/14' 2020-02-11T16:08:34.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/18' 2020-02-11T16:08:34.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/13' 2020-02-11T16:08:34.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/33' 2020-02-11T16:08:34.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/17' 2020-02-11T16:08:34.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/35' 2020-02-11T16:08:34.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './100/37' 2020-02-11T16:08:34.461 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './100' 2020-02-11T16:08:34.461 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/19' 2020-02-11T16:08:34.461 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/15' 2020-02-11T16:08:34.461 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/31' 2020-02-11T16:08:34.461 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/36' 2020-02-11T16:08:34.461 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/20' 2020-02-11T16:08:34.462 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/12' 2020-02-11T16:08:34.462 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/39' 2020-02-11T16:08:34.462 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/10' 2020-02-11T16:08:34.462 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/34' 2020-02-11T16:08:34.463 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/38' 2020-02-11T16:08:34.463 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/11' 2020-02-11T16:08:34.463 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/16' 2020-02-11T16:08:34.463 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/32' 2020-02-11T16:08:34.463 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/30' 2020-02-11T16:08:34.464 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/14' 2020-02-11T16:08:34.464 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/18' 2020-02-11T16:08:34.464 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/13' 2020-02-11T16:08:34.464 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/33' 2020-02-11T16:08:34.465 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/17' 2020-02-11T16:08:34.465 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/35' 2020-02-11T16:08:34.465 INFO:tasks.workunit.client.0.smithi088.stdout:removed './101/37' 2020-02-11T16:08:34.465 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './101' 2020-02-11T16:08:34.466 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/19' 2020-02-11T16:08:34.466 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/15' 2020-02-11T16:08:34.466 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/31' 2020-02-11T16:08:34.466 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/36' 2020-02-11T16:08:34.466 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/20' 2020-02-11T16:08:34.467 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/12' 2020-02-11T16:08:34.467 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/39' 2020-02-11T16:08:34.467 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/10' 2020-02-11T16:08:34.467 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/34' 2020-02-11T16:08:34.468 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/38' 2020-02-11T16:08:34.468 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/11' 2020-02-11T16:08:34.468 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/16' 2020-02-11T16:08:34.468 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/32' 2020-02-11T16:08:34.469 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/30' 2020-02-11T16:08:34.469 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/14' 2020-02-11T16:08:34.469 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/18' 2020-02-11T16:08:34.469 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/13' 2020-02-11T16:08:34.470 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/33' 2020-02-11T16:08:34.470 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/17' 2020-02-11T16:08:34.470 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/35' 2020-02-11T16:08:34.470 INFO:tasks.workunit.client.0.smithi088.stdout:removed './102/37' 2020-02-11T16:08:34.471 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './102' 2020-02-11T16:08:34.471 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/19' 2020-02-11T16:08:34.471 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/15' 2020-02-11T16:08:34.471 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/31' 2020-02-11T16:08:34.472 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/36' 2020-02-11T16:08:34.472 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/20' 2020-02-11T16:08:34.472 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/12' 2020-02-11T16:08:34.472 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/39' 2020-02-11T16:08:34.473 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/10' 2020-02-11T16:08:34.473 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/34' 2020-02-11T16:08:34.473 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/38' 2020-02-11T16:08:34.473 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/11' 2020-02-11T16:08:34.473 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/16' 2020-02-11T16:08:34.474 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/32' 2020-02-11T16:08:34.474 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/30' 2020-02-11T16:08:34.474 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/14' 2020-02-11T16:08:34.474 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/18' 2020-02-11T16:08:34.475 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/13' 2020-02-11T16:08:34.475 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/33' 2020-02-11T16:08:34.475 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/17' 2020-02-11T16:08:34.476 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/35' 2020-02-11T16:08:34.476 INFO:tasks.workunit.client.0.smithi088.stdout:removed './103/37' 2020-02-11T16:08:34.476 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './103' 2020-02-11T16:08:34.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/19' 2020-02-11T16:08:34.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/15' 2020-02-11T16:08:34.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/31' 2020-02-11T16:08:34.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/36' 2020-02-11T16:08:34.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/20' 2020-02-11T16:08:34.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/12' 2020-02-11T16:08:34.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/39' 2020-02-11T16:08:34.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/10' 2020-02-11T16:08:34.479 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/34' 2020-02-11T16:08:34.479 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/38' 2020-02-11T16:08:34.479 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/11' 2020-02-11T16:08:34.479 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/16' 2020-02-11T16:08:34.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/32' 2020-02-11T16:08:34.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/30' 2020-02-11T16:08:34.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/14' 2020-02-11T16:08:34.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/18' 2020-02-11T16:08:34.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/13' 2020-02-11T16:08:34.481 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/33' 2020-02-11T16:08:34.481 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/17' 2020-02-11T16:08:34.481 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/35' 2020-02-11T16:08:34.481 INFO:tasks.workunit.client.0.smithi088.stdout:removed './104/37' 2020-02-11T16:08:34.482 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './104' 2020-02-11T16:08:34.482 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/19' 2020-02-11T16:08:34.482 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/15' 2020-02-11T16:08:34.482 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/31' 2020-02-11T16:08:34.482 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/36' 2020-02-11T16:08:34.483 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/20' 2020-02-11T16:08:34.483 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/12' 2020-02-11T16:08:34.483 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/39' 2020-02-11T16:08:34.483 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/10' 2020-02-11T16:08:34.484 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/34' 2020-02-11T16:08:34.484 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/38' 2020-02-11T16:08:34.484 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/11' 2020-02-11T16:08:34.484 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/16' 2020-02-11T16:08:34.484 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/32' 2020-02-11T16:08:34.485 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/30' 2020-02-11T16:08:34.485 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/14' 2020-02-11T16:08:34.485 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/18' 2020-02-11T16:08:34.485 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/13' 2020-02-11T16:08:34.486 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/33' 2020-02-11T16:08:34.486 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/17' 2020-02-11T16:08:34.486 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/35' 2020-02-11T16:08:34.486 INFO:tasks.workunit.client.0.smithi088.stdout:removed './105/37' 2020-02-11T16:08:34.487 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './105' 2020-02-11T16:08:34.487 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/19' 2020-02-11T16:08:34.487 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/15' 2020-02-11T16:08:34.487 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/31' 2020-02-11T16:08:34.487 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/36' 2020-02-11T16:08:34.488 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/20' 2020-02-11T16:08:34.488 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/12' 2020-02-11T16:08:34.488 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/39' 2020-02-11T16:08:34.488 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/10' 2020-02-11T16:08:34.489 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/34' 2020-02-11T16:08:34.489 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/38' 2020-02-11T16:08:34.489 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/11' 2020-02-11T16:08:34.489 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/16' 2020-02-11T16:08:34.489 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/32' 2020-02-11T16:08:34.490 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/30' 2020-02-11T16:08:34.490 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/14' 2020-02-11T16:08:34.490 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/18' 2020-02-11T16:08:34.490 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/13' 2020-02-11T16:08:34.491 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/33' 2020-02-11T16:08:34.491 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/17' 2020-02-11T16:08:34.491 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/35' 2020-02-11T16:08:34.491 INFO:tasks.workunit.client.0.smithi088.stdout:removed './106/37' 2020-02-11T16:08:34.491 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './106' 2020-02-11T16:08:34.492 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/19' 2020-02-11T16:08:34.492 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/15' 2020-02-11T16:08:34.492 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/31' 2020-02-11T16:08:34.492 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/36' 2020-02-11T16:08:34.493 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/20' 2020-02-11T16:08:34.493 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/12' 2020-02-11T16:08:34.493 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/39' 2020-02-11T16:08:34.493 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/10' 2020-02-11T16:08:34.494 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/34' 2020-02-11T16:08:34.494 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/38' 2020-02-11T16:08:34.494 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/11' 2020-02-11T16:08:34.494 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/16' 2020-02-11T16:08:34.494 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/32' 2020-02-11T16:08:34.495 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/30' 2020-02-11T16:08:34.495 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/14' 2020-02-11T16:08:34.495 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/18' 2020-02-11T16:08:34.495 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/13' 2020-02-11T16:08:34.496 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/33' 2020-02-11T16:08:34.496 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/17' 2020-02-11T16:08:34.496 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/35' 2020-02-11T16:08:34.496 INFO:tasks.workunit.client.0.smithi088.stdout:removed './107/37' 2020-02-11T16:08:34.496 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './107' 2020-02-11T16:08:34.497 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/19' 2020-02-11T16:08:34.497 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/15' 2020-02-11T16:08:34.497 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/31' 2020-02-11T16:08:34.497 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/36' 2020-02-11T16:08:34.498 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/20' 2020-02-11T16:08:34.498 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/12' 2020-02-11T16:08:34.498 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/39' 2020-02-11T16:08:34.499 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/10' 2020-02-11T16:08:34.499 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/34' 2020-02-11T16:08:34.499 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/38' 2020-02-11T16:08:34.499 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/11' 2020-02-11T16:08:34.499 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/16' 2020-02-11T16:08:34.500 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/32' 2020-02-11T16:08:34.500 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/30' 2020-02-11T16:08:34.500 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/14' 2020-02-11T16:08:34.500 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/18' 2020-02-11T16:08:34.501 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/13' 2020-02-11T16:08:34.501 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/33' 2020-02-11T16:08:34.501 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/17' 2020-02-11T16:08:34.501 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/35' 2020-02-11T16:08:34.501 INFO:tasks.workunit.client.0.smithi088.stdout:removed './108/37' 2020-02-11T16:08:34.502 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './108' 2020-02-11T16:08:34.502 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/19' 2020-02-11T16:08:34.502 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/15' 2020-02-11T16:08:34.502 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/31' 2020-02-11T16:08:34.503 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/36' 2020-02-11T16:08:34.503 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/20' 2020-02-11T16:08:34.503 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/12' 2020-02-11T16:08:34.503 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/39' 2020-02-11T16:08:34.503 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/10' 2020-02-11T16:08:34.504 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/34' 2020-02-11T16:08:34.504 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/38' 2020-02-11T16:08:34.504 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/11' 2020-02-11T16:08:34.504 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/16' 2020-02-11T16:08:34.505 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/32' 2020-02-11T16:08:34.505 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/30' 2020-02-11T16:08:35.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/14' 2020-02-11T16:08:35.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/18' 2020-02-11T16:08:35.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/13' 2020-02-11T16:08:35.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/33' 2020-02-11T16:08:35.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/17' 2020-02-11T16:08:35.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/35' 2020-02-11T16:08:35.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './109/37' 2020-02-11T16:08:35.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './109' 2020-02-11T16:08:35.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/19' 2020-02-11T16:08:35.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/15' 2020-02-11T16:08:35.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/31' 2020-02-11T16:08:35.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/36' 2020-02-11T16:08:35.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/20' 2020-02-11T16:08:35.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/12' 2020-02-11T16:08:35.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/39' 2020-02-11T16:08:35.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/10' 2020-02-11T16:08:35.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/34' 2020-02-11T16:08:35.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/38' 2020-02-11T16:08:35.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/11' 2020-02-11T16:08:35.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/16' 2020-02-11T16:08:35.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/32' 2020-02-11T16:08:35.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/30' 2020-02-11T16:08:35.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/14' 2020-02-11T16:08:35.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/18' 2020-02-11T16:08:35.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/13' 2020-02-11T16:08:35.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/33' 2020-02-11T16:08:35.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/17' 2020-02-11T16:08:35.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/35' 2020-02-11T16:08:35.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './110/37' 2020-02-11T16:08:35.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './110' 2020-02-11T16:08:35.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/19' 2020-02-11T16:08:35.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/15' 2020-02-11T16:08:35.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/31' 2020-02-11T16:08:35.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/36' 2020-02-11T16:08:35.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/20' 2020-02-11T16:08:35.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/12' 2020-02-11T16:08:35.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/39' 2020-02-11T16:08:35.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/10' 2020-02-11T16:08:35.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/34' 2020-02-11T16:08:35.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/38' 2020-02-11T16:08:35.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/11' 2020-02-11T16:08:35.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/16' 2020-02-11T16:08:35.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/32' 2020-02-11T16:08:35.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/30' 2020-02-11T16:08:35.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/14' 2020-02-11T16:08:35.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/18' 2020-02-11T16:08:35.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/13' 2020-02-11T16:08:35.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/33' 2020-02-11T16:08:35.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/17' 2020-02-11T16:08:35.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/35' 2020-02-11T16:08:35.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './111/37' 2020-02-11T16:08:35.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './111' 2020-02-11T16:08:35.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/19' 2020-02-11T16:08:35.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/15' 2020-02-11T16:08:35.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/31' 2020-02-11T16:08:35.055 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/36' 2020-02-11T16:08:35.055 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/20' 2020-02-11T16:08:35.056 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/12' 2020-02-11T16:08:35.056 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/39' 2020-02-11T16:08:35.056 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/10' 2020-02-11T16:08:35.056 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/34' 2020-02-11T16:08:35.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/38' 2020-02-11T16:08:35.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/11' 2020-02-11T16:08:35.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/16' 2020-02-11T16:08:35.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/32' 2020-02-11T16:08:35.058 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/30' 2020-02-11T16:08:35.058 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/14' 2020-02-11T16:08:35.058 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/18' 2020-02-11T16:08:35.058 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/13' 2020-02-11T16:08:35.059 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/33' 2020-02-11T16:08:35.059 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/17' 2020-02-11T16:08:35.059 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/35' 2020-02-11T16:08:35.059 INFO:tasks.workunit.client.0.smithi088.stdout:removed './112/37' 2020-02-11T16:08:35.059 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './112' 2020-02-11T16:08:35.059 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/19' 2020-02-11T16:08:35.060 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/15' 2020-02-11T16:08:35.060 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/31' 2020-02-11T16:08:35.060 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/36' 2020-02-11T16:08:35.060 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/20' 2020-02-11T16:08:35.060 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/12' 2020-02-11T16:08:35.060 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/39' 2020-02-11T16:08:35.060 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/10' 2020-02-11T16:08:35.061 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/34' 2020-02-11T16:08:35.061 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/38' 2020-02-11T16:08:35.061 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/11' 2020-02-11T16:08:35.061 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/16' 2020-02-11T16:08:35.061 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/32' 2020-02-11T16:08:35.061 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/30' 2020-02-11T16:08:35.062 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/14' 2020-02-11T16:08:35.062 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/18' 2020-02-11T16:08:35.062 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/13' 2020-02-11T16:08:35.062 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/33' 2020-02-11T16:08:35.062 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/17' 2020-02-11T16:08:35.063 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/35' 2020-02-11T16:08:35.063 INFO:tasks.workunit.client.0.smithi088.stdout:removed './113/37' 2020-02-11T16:08:35.063 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './113' 2020-02-11T16:08:35.063 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/19' 2020-02-11T16:08:35.063 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/15' 2020-02-11T16:08:35.063 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/31' 2020-02-11T16:08:35.063 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/36' 2020-02-11T16:08:35.063 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/20' 2020-02-11T16:08:35.064 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/12' 2020-02-11T16:08:35.064 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/39' 2020-02-11T16:08:35.064 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/10' 2020-02-11T16:08:35.064 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/34' 2020-02-11T16:08:35.064 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/38' 2020-02-11T16:08:35.064 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/11' 2020-02-11T16:08:35.064 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/16' 2020-02-11T16:08:35.065 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/32' 2020-02-11T16:08:35.065 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/30' 2020-02-11T16:08:35.065 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/14' 2020-02-11T16:08:35.065 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/18' 2020-02-11T16:08:35.065 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/13' 2020-02-11T16:08:35.065 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/33' 2020-02-11T16:08:35.065 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/17' 2020-02-11T16:08:35.066 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/35' 2020-02-11T16:08:35.066 INFO:tasks.workunit.client.0.smithi088.stdout:removed './114/37' 2020-02-11T16:08:35.066 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './114' 2020-02-11T16:08:35.066 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/19' 2020-02-11T16:08:35.066 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/15' 2020-02-11T16:08:35.066 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/31' 2020-02-11T16:08:35.066 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/36' 2020-02-11T16:08:35.067 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/20' 2020-02-11T16:08:35.067 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/12' 2020-02-11T16:08:35.067 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/39' 2020-02-11T16:08:35.067 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/10' 2020-02-11T16:08:35.067 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/34' 2020-02-11T16:08:35.067 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/38' 2020-02-11T16:08:35.067 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/11' 2020-02-11T16:08:35.068 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/16' 2020-02-11T16:08:35.068 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/32' 2020-02-11T16:08:35.068 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/30' 2020-02-11T16:08:35.068 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/14' 2020-02-11T16:08:35.068 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/18' 2020-02-11T16:08:35.068 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/13' 2020-02-11T16:08:35.068 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/33' 2020-02-11T16:08:35.068 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/17' 2020-02-11T16:08:35.069 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/35' 2020-02-11T16:08:35.069 INFO:tasks.workunit.client.0.smithi088.stdout:removed './115/37' 2020-02-11T16:08:35.069 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './115' 2020-02-11T16:08:35.069 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/19' 2020-02-11T16:08:35.069 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/15' 2020-02-11T16:08:35.069 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/31' 2020-02-11T16:08:35.069 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/36' 2020-02-11T16:08:35.070 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/20' 2020-02-11T16:08:35.070 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/12' 2020-02-11T16:08:35.070 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/39' 2020-02-11T16:08:35.070 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/10' 2020-02-11T16:08:35.070 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/34' 2020-02-11T16:08:35.070 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/38' 2020-02-11T16:08:35.070 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/11' 2020-02-11T16:08:35.071 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/16' 2020-02-11T16:08:35.071 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/32' 2020-02-11T16:08:35.071 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/30' 2020-02-11T16:08:35.071 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/14' 2020-02-11T16:08:35.071 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/18' 2020-02-11T16:08:35.071 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/13' 2020-02-11T16:08:35.071 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/33' 2020-02-11T16:08:35.071 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/17' 2020-02-11T16:08:35.072 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/35' 2020-02-11T16:08:35.072 INFO:tasks.workunit.client.0.smithi088.stdout:removed './116/37' 2020-02-11T16:08:35.072 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './116' 2020-02-11T16:08:35.072 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/19' 2020-02-11T16:08:35.072 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/15' 2020-02-11T16:08:35.072 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/31' 2020-02-11T16:08:35.073 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/36' 2020-02-11T16:08:35.073 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/20' 2020-02-11T16:08:35.073 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/12' 2020-02-11T16:08:35.073 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/39' 2020-02-11T16:08:35.073 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/10' 2020-02-11T16:08:35.073 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/34' 2020-02-11T16:08:35.073 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/38' 2020-02-11T16:08:35.074 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/11' 2020-02-11T16:08:35.074 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/16' 2020-02-11T16:08:35.074 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/32' 2020-02-11T16:08:35.074 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/30' 2020-02-11T16:08:35.074 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/14' 2020-02-11T16:08:35.074 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/18' 2020-02-11T16:08:35.075 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/13' 2020-02-11T16:08:35.075 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/33' 2020-02-11T16:08:35.075 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/17' 2020-02-11T16:08:35.075 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/35' 2020-02-11T16:08:35.075 INFO:tasks.workunit.client.0.smithi088.stdout:removed './117/37' 2020-02-11T16:08:35.075 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './117' 2020-02-11T16:08:35.075 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/19' 2020-02-11T16:08:35.076 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/15' 2020-02-11T16:08:35.076 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/31' 2020-02-11T16:08:35.076 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/36' 2020-02-11T16:08:35.076 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/20' 2020-02-11T16:08:35.076 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/12' 2020-02-11T16:08:35.076 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/39' 2020-02-11T16:08:35.077 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/10' 2020-02-11T16:08:35.077 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/34' 2020-02-11T16:08:35.077 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/38' 2020-02-11T16:08:35.077 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/11' 2020-02-11T16:08:35.077 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/16' 2020-02-11T16:08:35.078 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/32' 2020-02-11T16:08:35.078 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/30' 2020-02-11T16:08:35.078 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/14' 2020-02-11T16:08:35.078 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/18' 2020-02-11T16:08:35.078 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/13' 2020-02-11T16:08:35.078 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/33' 2020-02-11T16:08:35.078 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/17' 2020-02-11T16:08:35.079 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/35' 2020-02-11T16:08:35.079 INFO:tasks.workunit.client.0.smithi088.stdout:removed './118/37' 2020-02-11T16:08:35.079 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './118' 2020-02-11T16:08:35.079 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/19' 2020-02-11T16:08:35.079 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/15' 2020-02-11T16:08:35.079 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/31' 2020-02-11T16:08:35.079 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/36' 2020-02-11T16:08:35.080 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/20' 2020-02-11T16:08:35.080 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/12' 2020-02-11T16:08:35.675 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/39' 2020-02-11T16:08:35.675 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/10' 2020-02-11T16:08:35.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/34' 2020-02-11T16:08:35.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/38' 2020-02-11T16:08:35.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/11' 2020-02-11T16:08:35.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/16' 2020-02-11T16:08:35.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/32' 2020-02-11T16:08:35.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/30' 2020-02-11T16:08:35.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/14' 2020-02-11T16:08:35.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/18' 2020-02-11T16:08:35.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/13' 2020-02-11T16:08:35.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/33' 2020-02-11T16:08:35.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/17' 2020-02-11T16:08:35.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/35' 2020-02-11T16:08:35.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './119/37' 2020-02-11T16:08:35.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './119' 2020-02-11T16:08:35.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/19' 2020-02-11T16:08:35.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/15' 2020-02-11T16:08:35.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/31' 2020-02-11T16:08:35.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/36' 2020-02-11T16:08:35.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/20' 2020-02-11T16:08:35.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/12' 2020-02-11T16:08:35.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/39' 2020-02-11T16:08:35.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/10' 2020-02-11T16:08:35.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/34' 2020-02-11T16:08:35.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/38' 2020-02-11T16:08:35.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/11' 2020-02-11T16:08:35.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/16' 2020-02-11T16:08:35.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/32' 2020-02-11T16:08:35.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/30' 2020-02-11T16:08:35.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/14' 2020-02-11T16:08:35.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/18' 2020-02-11T16:08:35.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/13' 2020-02-11T16:08:35.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/33' 2020-02-11T16:08:35.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/17' 2020-02-11T16:08:35.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/35' 2020-02-11T16:08:35.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './120/37' 2020-02-11T16:08:35.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './120' 2020-02-11T16:08:35.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/19' 2020-02-11T16:08:35.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/15' 2020-02-11T16:08:35.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/31' 2020-02-11T16:08:35.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/36' 2020-02-11T16:08:35.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/20' 2020-02-11T16:08:35.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/12' 2020-02-11T16:08:35.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/39' 2020-02-11T16:08:35.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/10' 2020-02-11T16:08:35.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/34' 2020-02-11T16:08:35.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/38' 2020-02-11T16:08:35.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/11' 2020-02-11T16:08:35.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/16' 2020-02-11T16:08:35.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/32' 2020-02-11T16:08:35.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/30' 2020-02-11T16:08:35.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/14' 2020-02-11T16:08:35.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/18' 2020-02-11T16:08:35.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/13' 2020-02-11T16:08:35.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/33' 2020-02-11T16:08:35.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/17' 2020-02-11T16:08:35.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/35' 2020-02-11T16:08:35.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './121/37' 2020-02-11T16:08:35.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './121' 2020-02-11T16:08:35.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/19' 2020-02-11T16:08:35.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/15' 2020-02-11T16:08:35.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/31' 2020-02-11T16:08:35.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/36' 2020-02-11T16:08:35.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/20' 2020-02-11T16:08:35.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/12' 2020-02-11T16:08:35.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/39' 2020-02-11T16:08:35.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/10' 2020-02-11T16:08:35.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/34' 2020-02-11T16:08:35.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/38' 2020-02-11T16:08:35.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/11' 2020-02-11T16:08:35.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/16' 2020-02-11T16:08:35.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/32' 2020-02-11T16:08:35.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/30' 2020-02-11T16:08:35.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/14' 2020-02-11T16:08:35.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/18' 2020-02-11T16:08:35.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/13' 2020-02-11T16:08:35.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/33' 2020-02-11T16:08:35.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/17' 2020-02-11T16:08:35.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/35' 2020-02-11T16:08:35.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed './122/37' 2020-02-11T16:08:35.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './122' 2020-02-11T16:08:35.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/19' 2020-02-11T16:08:35.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/15' 2020-02-11T16:08:35.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/31' 2020-02-11T16:08:35.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/36' 2020-02-11T16:08:35.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/20' 2020-02-11T16:08:35.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/12' 2020-02-11T16:08:35.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/39' 2020-02-11T16:08:35.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/10' 2020-02-11T16:08:35.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/34' 2020-02-11T16:08:35.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/38' 2020-02-11T16:08:35.689 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/11' 2020-02-11T16:08:35.689 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/16' 2020-02-11T16:08:35.689 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/32' 2020-02-11T16:08:35.689 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/30' 2020-02-11T16:08:35.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/14' 2020-02-11T16:08:35.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/18' 2020-02-11T16:08:35.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/13' 2020-02-11T16:08:35.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/33' 2020-02-11T16:08:35.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/17' 2020-02-11T16:08:35.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/35' 2020-02-11T16:08:35.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './123/37' 2020-02-11T16:08:35.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './123' 2020-02-11T16:08:35.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/19' 2020-02-11T16:08:35.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/15' 2020-02-11T16:08:35.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/31' 2020-02-11T16:08:35.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/36' 2020-02-11T16:08:35.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/20' 2020-02-11T16:08:35.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/12' 2020-02-11T16:08:35.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/39' 2020-02-11T16:08:35.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/10' 2020-02-11T16:08:35.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/34' 2020-02-11T16:08:35.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/38' 2020-02-11T16:08:35.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/11' 2020-02-11T16:08:35.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/16' 2020-02-11T16:08:35.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/32' 2020-02-11T16:08:35.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/30' 2020-02-11T16:08:35.693 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/14' 2020-02-11T16:08:35.693 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/18' 2020-02-11T16:08:35.693 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/13' 2020-02-11T16:08:35.693 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/33' 2020-02-11T16:08:35.693 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/17' 2020-02-11T16:08:35.693 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/35' 2020-02-11T16:08:35.693 INFO:tasks.workunit.client.0.smithi088.stdout:removed './124/37' 2020-02-11T16:08:35.693 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './124' 2020-02-11T16:08:35.694 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/19' 2020-02-11T16:08:35.694 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/15' 2020-02-11T16:08:35.694 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/31' 2020-02-11T16:08:35.694 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/36' 2020-02-11T16:08:35.694 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/20' 2020-02-11T16:08:35.694 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/12' 2020-02-11T16:08:35.694 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/39' 2020-02-11T16:08:35.695 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/10' 2020-02-11T16:08:35.695 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/34' 2020-02-11T16:08:35.695 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/38' 2020-02-11T16:08:35.695 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/11' 2020-02-11T16:08:35.695 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/16' 2020-02-11T16:08:35.695 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/32' 2020-02-11T16:08:35.695 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/30' 2020-02-11T16:08:35.695 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/14' 2020-02-11T16:08:35.696 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/18' 2020-02-11T16:08:35.696 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/13' 2020-02-11T16:08:35.696 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/33' 2020-02-11T16:08:35.696 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/17' 2020-02-11T16:08:35.696 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/35' 2020-02-11T16:08:35.696 INFO:tasks.workunit.client.0.smithi088.stdout:removed './125/37' 2020-02-11T16:08:35.696 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './125' 2020-02-11T16:08:35.697 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/19' 2020-02-11T16:08:35.697 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/15' 2020-02-11T16:08:35.697 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/31' 2020-02-11T16:08:35.697 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/36' 2020-02-11T16:08:35.697 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/20' 2020-02-11T16:08:35.697 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/12' 2020-02-11T16:08:35.697 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/39' 2020-02-11T16:08:35.697 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/10' 2020-02-11T16:08:35.698 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/34' 2020-02-11T16:08:35.698 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/38' 2020-02-11T16:08:35.698 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/11' 2020-02-11T16:08:35.698 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/16' 2020-02-11T16:08:35.698 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/32' 2020-02-11T16:08:35.698 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/30' 2020-02-11T16:08:35.699 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/14' 2020-02-11T16:08:35.699 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/18' 2020-02-11T16:08:35.699 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/13' 2020-02-11T16:08:35.699 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/33' 2020-02-11T16:08:35.699 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/17' 2020-02-11T16:08:35.700 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/35' 2020-02-11T16:08:35.700 INFO:tasks.workunit.client.0.smithi088.stdout:removed './126/37' 2020-02-11T16:08:35.700 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './126' 2020-02-11T16:08:35.700 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/19' 2020-02-11T16:08:35.700 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/15' 2020-02-11T16:08:35.700 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/31' 2020-02-11T16:08:35.701 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/36' 2020-02-11T16:08:35.701 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/20' 2020-02-11T16:08:35.701 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/12' 2020-02-11T16:08:35.701 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/39' 2020-02-11T16:08:35.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/10' 2020-02-11T16:08:35.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/34' 2020-02-11T16:08:35.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/38' 2020-02-11T16:08:35.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/11' 2020-02-11T16:08:35.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/16' 2020-02-11T16:08:35.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/32' 2020-02-11T16:08:35.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/30' 2020-02-11T16:08:35.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/14' 2020-02-11T16:08:35.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/18' 2020-02-11T16:08:35.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/13' 2020-02-11T16:08:35.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/33' 2020-02-11T16:08:35.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/17' 2020-02-11T16:08:35.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/35' 2020-02-11T16:08:35.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './127/37' 2020-02-11T16:08:35.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './127' 2020-02-11T16:08:35.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/19' 2020-02-11T16:08:35.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/15' 2020-02-11T16:08:35.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/31' 2020-02-11T16:08:35.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/36' 2020-02-11T16:08:35.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/20' 2020-02-11T16:08:35.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/12' 2020-02-11T16:08:35.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/39' 2020-02-11T16:08:35.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/10' 2020-02-11T16:08:35.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/34' 2020-02-11T16:08:35.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/38' 2020-02-11T16:08:35.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/11' 2020-02-11T16:08:35.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/16' 2020-02-11T16:08:35.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/32' 2020-02-11T16:08:35.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/30' 2020-02-11T16:08:35.706 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/14' 2020-02-11T16:08:35.706 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/18' 2020-02-11T16:08:35.706 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/13' 2020-02-11T16:08:35.706 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/33' 2020-02-11T16:08:35.706 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/17' 2020-02-11T16:08:35.706 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/35' 2020-02-11T16:08:36.269 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:08:36.269 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:08:36.370 INFO:tasks.workunit.client.0.smithi088.stdout:removed './128/37' 2020-02-11T16:08:36.370 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './128' 2020-02-11T16:08:36.370 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/19' 2020-02-11T16:08:36.370 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/15' 2020-02-11T16:08:36.370 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/31' 2020-02-11T16:08:36.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/36' 2020-02-11T16:08:36.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/20' 2020-02-11T16:08:36.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/12' 2020-02-11T16:08:36.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/39' 2020-02-11T16:08:36.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/10' 2020-02-11T16:08:36.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/34' 2020-02-11T16:08:36.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/38' 2020-02-11T16:08:36.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/11' 2020-02-11T16:08:36.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/16' 2020-02-11T16:08:36.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/32' 2020-02-11T16:08:36.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/30' 2020-02-11T16:08:36.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/14' 2020-02-11T16:08:36.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/18' 2020-02-11T16:08:36.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/13' 2020-02-11T16:08:36.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/33' 2020-02-11T16:08:36.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/17' 2020-02-11T16:08:36.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/35' 2020-02-11T16:08:36.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './129/37' 2020-02-11T16:08:36.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './129' 2020-02-11T16:08:36.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/19' 2020-02-11T16:08:36.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/15' 2020-02-11T16:08:36.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/31' 2020-02-11T16:08:36.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/36' 2020-02-11T16:08:36.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/20' 2020-02-11T16:08:36.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/12' 2020-02-11T16:08:36.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/39' 2020-02-11T16:08:36.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/10' 2020-02-11T16:08:36.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/34' 2020-02-11T16:08:36.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/38' 2020-02-11T16:08:36.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/11' 2020-02-11T16:08:36.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/16' 2020-02-11T16:08:36.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/32' 2020-02-11T16:08:36.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/30' 2020-02-11T16:08:36.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/14' 2020-02-11T16:08:36.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/18' 2020-02-11T16:08:36.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/13' 2020-02-11T16:08:36.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/33' 2020-02-11T16:08:36.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/17' 2020-02-11T16:08:36.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/35' 2020-02-11T16:08:36.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './130/37' 2020-02-11T16:08:36.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './130' 2020-02-11T16:08:36.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/19' 2020-02-11T16:08:36.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/15' 2020-02-11T16:08:36.377 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/31' 2020-02-11T16:08:36.377 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/36' 2020-02-11T16:08:36.377 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/20' 2020-02-11T16:08:36.377 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/12' 2020-02-11T16:08:36.377 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/39' 2020-02-11T16:08:36.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/10' 2020-02-11T16:08:36.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/34' 2020-02-11T16:08:36.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/38' 2020-02-11T16:08:36.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/11' 2020-02-11T16:08:36.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/16' 2020-02-11T16:08:36.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/32' 2020-02-11T16:08:36.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/30' 2020-02-11T16:08:36.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/14' 2020-02-11T16:08:36.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/18' 2020-02-11T16:08:36.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/13' 2020-02-11T16:08:36.380 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/33' 2020-02-11T16:08:36.380 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/17' 2020-02-11T16:08:36.380 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/35' 2020-02-11T16:08:36.380 INFO:tasks.workunit.client.0.smithi088.stdout:removed './131/37' 2020-02-11T16:08:36.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './131' 2020-02-11T16:08:36.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/19' 2020-02-11T16:08:36.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/15' 2020-02-11T16:08:36.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/31' 2020-02-11T16:08:36.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/36' 2020-02-11T16:08:36.382 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/20' 2020-02-11T16:08:36.382 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/12' 2020-02-11T16:08:36.382 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/39' 2020-02-11T16:08:36.382 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/10' 2020-02-11T16:08:36.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/34' 2020-02-11T16:08:36.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/38' 2020-02-11T16:08:36.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/11' 2020-02-11T16:08:36.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/16' 2020-02-11T16:08:36.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/32' 2020-02-11T16:08:36.384 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/30' 2020-02-11T16:08:36.384 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/14' 2020-02-11T16:08:36.384 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/18' 2020-02-11T16:08:36.384 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/13' 2020-02-11T16:08:36.385 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/33' 2020-02-11T16:08:36.385 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/17' 2020-02-11T16:08:36.385 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/35' 2020-02-11T16:08:36.385 INFO:tasks.workunit.client.0.smithi088.stdout:removed './132/37' 2020-02-11T16:08:36.385 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './132' 2020-02-11T16:08:36.386 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/19' 2020-02-11T16:08:36.386 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/15' 2020-02-11T16:08:36.386 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/31' 2020-02-11T16:08:36.386 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/36' 2020-02-11T16:08:36.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/20' 2020-02-11T16:08:36.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/12' 2020-02-11T16:08:36.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/39' 2020-02-11T16:08:36.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/10' 2020-02-11T16:08:36.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/34' 2020-02-11T16:08:36.388 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/38' 2020-02-11T16:08:36.388 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/11' 2020-02-11T16:08:36.388 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/16' 2020-02-11T16:08:36.388 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/32' 2020-02-11T16:08:36.389 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/30' 2020-02-11T16:08:36.389 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/14' 2020-02-11T16:08:36.389 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/18' 2020-02-11T16:08:36.389 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/13' 2020-02-11T16:08:36.389 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/33' 2020-02-11T16:08:36.390 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/17' 2020-02-11T16:08:36.390 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/35' 2020-02-11T16:08:36.390 INFO:tasks.workunit.client.0.smithi088.stdout:removed './133/37' 2020-02-11T16:08:36.390 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './133' 2020-02-11T16:08:36.390 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/19' 2020-02-11T16:08:36.391 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/15' 2020-02-11T16:08:36.391 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/31' 2020-02-11T16:08:36.391 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/36' 2020-02-11T16:08:36.391 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/20' 2020-02-11T16:08:36.392 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/12' 2020-02-11T16:08:36.392 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/39' 2020-02-11T16:08:36.392 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/10' 2020-02-11T16:08:36.392 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/34' 2020-02-11T16:08:36.392 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/38' 2020-02-11T16:08:36.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/11' 2020-02-11T16:08:36.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/16' 2020-02-11T16:08:36.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/32' 2020-02-11T16:08:36.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/30' 2020-02-11T16:08:36.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/14' 2020-02-11T16:08:36.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/18' 2020-02-11T16:08:36.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/13' 2020-02-11T16:08:36.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/33' 2020-02-11T16:08:36.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/17' 2020-02-11T16:08:36.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/35' 2020-02-11T16:08:36.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './134/37' 2020-02-11T16:08:36.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './134' 2020-02-11T16:08:36.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/19' 2020-02-11T16:08:36.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/15' 2020-02-11T16:08:36.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/31' 2020-02-11T16:08:36.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/36' 2020-02-11T16:08:36.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/20' 2020-02-11T16:08:36.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/12' 2020-02-11T16:08:36.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/39' 2020-02-11T16:08:36.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/10' 2020-02-11T16:08:36.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/34' 2020-02-11T16:08:36.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/38' 2020-02-11T16:08:36.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/11' 2020-02-11T16:08:36.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/16' 2020-02-11T16:08:36.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/32' 2020-02-11T16:08:36.398 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/30' 2020-02-11T16:08:36.398 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/14' 2020-02-11T16:08:36.398 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/18' 2020-02-11T16:08:36.398 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/13' 2020-02-11T16:08:36.398 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/33' 2020-02-11T16:08:36.398 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/17' 2020-02-11T16:08:36.399 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/35' 2020-02-11T16:08:36.399 INFO:tasks.workunit.client.0.smithi088.stdout:removed './135/37' 2020-02-11T16:08:36.399 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './135' 2020-02-11T16:08:36.399 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/19' 2020-02-11T16:08:36.399 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/15' 2020-02-11T16:08:36.400 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/31' 2020-02-11T16:08:36.400 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/36' 2020-02-11T16:08:36.400 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/20' 2020-02-11T16:08:36.400 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/12' 2020-02-11T16:08:36.400 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/39' 2020-02-11T16:08:36.400 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/10' 2020-02-11T16:08:36.400 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/34' 2020-02-11T16:08:36.401 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/38' 2020-02-11T16:08:36.401 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/11' 2020-02-11T16:08:36.401 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/16' 2020-02-11T16:08:36.401 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/32' 2020-02-11T16:08:36.401 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/30' 2020-02-11T16:08:36.401 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/14' 2020-02-11T16:08:36.401 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/18' 2020-02-11T16:08:36.401 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/13' 2020-02-11T16:08:36.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/33' 2020-02-11T16:08:36.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/17' 2020-02-11T16:08:36.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/35' 2020-02-11T16:08:36.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './136/37' 2020-02-11T16:08:36.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './136' 2020-02-11T16:08:36.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/19' 2020-02-11T16:08:36.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/15' 2020-02-11T16:08:36.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/31' 2020-02-11T16:08:36.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/36' 2020-02-11T16:08:36.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/20' 2020-02-11T16:08:36.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/12' 2020-02-11T16:08:36.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/39' 2020-02-11T16:08:36.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/10' 2020-02-11T16:08:36.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/34' 2020-02-11T16:08:36.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/38' 2020-02-11T16:08:36.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/11' 2020-02-11T16:08:36.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/16' 2020-02-11T16:08:36.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/32' 2020-02-11T16:08:36.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/30' 2020-02-11T16:08:36.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/14' 2020-02-11T16:08:36.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/18' 2020-02-11T16:08:36.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/13' 2020-02-11T16:08:36.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/33' 2020-02-11T16:08:36.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/17' 2020-02-11T16:08:36.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/35' 2020-02-11T16:08:36.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './137/37' 2020-02-11T16:08:36.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './137' 2020-02-11T16:08:36.406 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/19' 2020-02-11T16:08:36.406 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/15' 2020-02-11T16:08:36.406 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/31' 2020-02-11T16:08:36.406 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/36' 2020-02-11T16:08:36.406 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/20' 2020-02-11T16:08:36.406 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/12' 2020-02-11T16:08:36.406 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/39' 2020-02-11T16:08:36.406 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/10' 2020-02-11T16:08:36.407 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/34' 2020-02-11T16:08:36.407 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/38' 2020-02-11T16:08:36.407 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/11' 2020-02-11T16:08:36.407 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/16' 2020-02-11T16:08:36.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.421+0000 7f0581713700 1 Processor -- start 2020-02-11T16:08:36.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.421+0000 7f0581713700 1 -- start start 2020-02-11T16:08:36.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.422+0000 7f0581713700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f057c0a9130 0x7f057c1314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:36.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.422+0000 7f0581713700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c0adb40 con 0x7f057c0ad380 2020-02-11T16:08:36.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.422+0000 7f0581713700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c137de0 con 0x7f057c131920 2020-02-11T16:08:36.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.422+0000 7f0581713700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057c137bf0 con 0x7f057c0a9130 2020-02-11T16:08:36.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.422+0000 7f057a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f057c0a9130 0x7f057c1314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.422+0000 7f057a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f057c0a9130 0x7f057c1314c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53324/0 (socket says 172.21.15.88:53324) 2020-02-11T16:08:36.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.422+0000 7f057a7fc700 1 -- 172.21.15.88:0/292569657 learned_addr learned my addr 172.21.15.88:0/292569657 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:36.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.422+0000 7f057affd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f057c0ad380 0x7f057c138280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:60962/0 (socket says 172.21.15.88:60962) 2020-02-11T16:08:36.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f0579ffb700 1 -- 172.21.15.88:0/292569657 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241447596 0 0) 0x7f057c0adb40 con 0x7f057c0ad380 2020-02-11T16:08:36.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f057a7fc700 1 -- 172.21.15.88:0/292569657 >> v1:172.21.15.88:6789/0 conn(0x7f057c131920 legacy=0x7f057c131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f057a7fc700 1 -- 172.21.15.88:0/292569657 >> v1:172.21.15.52:6789/0 conn(0x7f057c0ad380 legacy=0x7f057c138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f057a7fc700 1 -- 172.21.15.88:0/292569657 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c0a95c0 con 0x7f057c0a9130 2020-02-11T16:08:36.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f057a7fc700 1 --2- 172.21.15.88:0/292569657 >> v2:172.21.15.88:3300/0 conn(0x7f057c0a9130 0x7f057c1314c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f056c002f30 tx=0x7f056c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f057a7fc700 1 --2- 172.21.15.88:0/292569657 >> v2:172.21.15.88:3300/0 conn(0x7f057c0a9130 0x7f057c1314c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f056c002f30 tx=0x7f056c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f057a7fc700 1 --2- 172.21.15.88:0/292569657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c1314c0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f056c002f30 tx=0x7f056c0088e0).ready entity=mon.1 client_cookie=794d42da998ce754 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:36.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f057a7fc700 1 --2- 172.21.15.88:0/292569657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c1314c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f056c002f30 tx=0x7f056c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f0579ffb700 1 -- 172.21.15.88:0/292569657 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056c011760 con 0x7f057c0a9130 2020-02-11T16:08:36.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f057a7fc700 1 --2- 172.21.15.88:0/292569657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c1314c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f056c002f30 tx=0x7f056c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f057a7fc700 1 --2- 172.21.15.88:0/292569657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c1314c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f056c002f30 tx=0x7f056c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f0579ffb700 1 -- 172.21.15.88:0/292569657 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c0118c0 con 0x7f057c0a9130 2020-02-11T16:08:36.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f0579ffb700 1 -- 172.21.15.88:0/292569657 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056c011ce0 con 0x7f057c0a9130 2020-02-11T16:08:36.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f0581713700 1 -- 172.21.15.88:0/292569657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 msgr2=0x7f057c1314c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.423+0000 7f0581713700 1 --2- 172.21.15.88:0/292569657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c1314c0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f056c002f30 tx=0x7f056c0088e0).stop 2020-02-11T16:08:36.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.424+0000 7f0581713700 1 -- 172.21.15.88:0/292569657 shutdown_connections 2020-02-11T16:08:36.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.424+0000 7f0581713700 1 --2- 172.21.15.88:0/292569657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c1314c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:36.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.424+0000 7f0581713700 1 -- 172.21.15.88:0/292569657 >> 172.21.15.88:0/292569657 conn(0x7f057c05ac70 msgr2=0x7f057c0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:36.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.424+0000 7f0581713700 1 -- 172.21.15.88:0/292569657 shutdown_connections 2020-02-11T16:08:36.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.424+0000 7f0581713700 1 -- 172.21.15.88:0/292569657 wait complete. 2020-02-11T16:08:36.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.425+0000 7f0581713700 1 Processor -- start 2020-02-11T16:08:36.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.425+0000 7f0581713700 1 -- start start 2020-02-11T16:08:36.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.426+0000 7f0581713700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f057c0a9130 0x7f057c127440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:36.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.426+0000 7f0581713700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f057c0ad380 0x7f057c129930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:36.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.426+0000 7f0581713700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c128ef0 con 0x7f057c131920 2020-02-11T16:08:36.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.426+0000 7f0581713700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057c127a50 con 0x7f057c0a9130 2020-02-11T16:08:36.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.426+0000 7f0581713700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c129190 con 0x7f057c0ad380 2020-02-11T16:08:36.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.426+0000 7f057b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f057c131920 0x7f057c126720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40952/0 (socket says 172.21.15.88:40952) 2020-02-11T16:08:36.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.426+0000 7f057b7fe700 1 -- 172.21.15.88:0/255778565 learned_addr learned my addr 172.21.15.88:0/255778565 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:36.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.426+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> v2:172.21.15.88:3300/0 conn(0x7f057c0a9130 0x7f057c127440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.426+0000 7f057a7fc700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f057c0ad380 0x7f057c129930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f057affd700 1 -- 172.21.15.88:0/255778565 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f057c0ad380 msgr2=0x7f057c129930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f057c0ad380 0x7f057c129930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:36.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f057affd700 1 -- 172.21.15.88:0/255778565 >> v1:172.21.15.88:6789/0 conn(0x7f057c131920 legacy=0x7f057c126720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f057affd700 1 -- 172.21.15.88:0/255778565 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c129630 con 0x7f057c0a9130 2020-02-11T16:08:36.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> v2:172.21.15.88:3300/0 conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> v2:172.21.15.88:3300/0 conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:36.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f056bfff700 1 -- 172.21.15.88:0/255778565 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0570011520 con 0x7f057c0a9130 2020-02-11T16:08:36.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f056bfff700 1 -- 172.21.15.88:0/255778565 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570011680 con 0x7f057c0a9130 2020-02-11T16:08:36.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f0581713700 1 -- 172.21.15.88:0/255778565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c12c700 con 0x7f057c0a9130 2020-02-11T16:08:36.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f056bfff700 1 -- 172.21.15.88:0/255778565 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0570011a60 con 0x7f057c0a9130 2020-02-11T16:08:36.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.427+0000 7f0581713700 1 -- 172.21.15.88:0/255778565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c12e510 con 0x7f057c0a9130 2020-02-11T16:08:36.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.428+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.428+0000 7f056bfff700 1 -- 172.21.15.88:0/255778565 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f057000b0a0 con 0x7f057c0a9130 2020-02-11T16:08:36.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.428+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.428+0000 7f056bfff700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0558039c70 0x7f055803c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:36.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.428+0000 7f056bfff700 1 -- 172.21.15.88:0/255778565 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f05700497c0 con 0x7f057c0a9130 2020-02-11T16:08:36.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.428+0000 7f0581713700 1 -- 172.21.15.88:0/255778565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c0565b0 con 0x7f057c0a9130 2020-02-11T16:08:36.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.429+0000 7f057a7fc700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0558039c70 0x7f055803c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.429+0000 7f057a7fc700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0558039c70 0x7f055803c130 crc :-1 s=READY pgs=154 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.433+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.433+0000 7f056bfff700 1 -- 172.21.15.88:0/255778565 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f057002ee80 con 0x7f057c0a9130 2020-02-11T16:08:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.632+0000 7f0581713700 1 -- 172.21.15.88:0/255778565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f057c1292d0 con 0x7f057c0a9130 2020-02-11T16:08:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.632+0000 7f057affd700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.632+0000 7f056bfff700 1 -- 172.21.15.88:0/255778565 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f05700090c0 con 0x7f057c0a9130 2020-02-11T16:08:36.636 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 -- 172.21.15.88:0/255778565 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0558039c70 msgr2=0x7f055803c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0558039c70 0x7f055803c130 crc :-1 s=READY pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 -- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 msgr2=0x7f057c127440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c127440 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f05740014e0 tx=0x7f0570010950).stop 2020-02-11T16:08:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 -- 172.21.15.88:0/255778565 shutdown_connections 2020-02-11T16:08:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0558039c70 0x7f055803c130 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f057c0a9130 0x7f057c127440 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 --2- 172.21.15.88:0/255778565 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f057c0ad380 0x7f057c129930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 -- 172.21.15.88:0/255778565 >> 172.21.15.88:0/255778565 conn(0x7f057c05ac70 msgr2=0x7f057c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 -- 172.21.15.88:0/255778565 shutdown_connections 2020-02-11T16:08:36.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.634+0000 7f0581713700 1 -- 172.21.15.88:0/255778565 wait complete. 2020-02-11T16:08:36.647 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":38,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:36.647 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:08:36.647 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:08:36.647 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:08:36.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.758+0000 7f42f46a0700 1 Processor -- start 2020-02-11T16:08:36.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.758+0000 7f42f46a0700 1 -- start start 2020-02-11T16:08:36.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f46a0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42ec131f50 0x7f42ec05f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:36.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f46a0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42ec13b290 0x7f42ec09d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:36.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f46a0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec138360 con 0x7f42ec13b6f0 2020-02-11T16:08:36.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f46a0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec138150 con 0x7f42ec131f50 2020-02-11T16:08:36.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f46a0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec138600 con 0x7f42ec13b290 2020-02-11T16:08:36.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42ec131f50 0x7f42ec05f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42ec131f50 0x7f42ec05f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53334/0 (socket says 172.21.15.88:53334) 2020-02-11T16:08:36.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 -- 172.21.15.88:0/2667799836 learned_addr learned my addr 172.21.15.88:0/2667799836 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:36.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f2c3d700 1 --1- 172.21.15.88:0/2667799836 >> v1:172.21.15.88:6789/0 conn(0x7f42ec13b6f0 0x7f42ec05ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40962/0 (socket says 172.21.15.88:40962) 2020-02-11T16:08:36.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f1c3b700 1 --2- 172.21.15.88:0/2667799836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42ec13b290 0x7f42ec09d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 -- 172.21.15.88:0/2667799836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42ec13b290 msgr2=0x7f42ec09d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:08:36.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 --2- 172.21.15.88:0/2667799836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42ec13b290 0x7f42ec09d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 -- 172.21.15.88:0/2667799836 >> v1:172.21.15.88:6789/0 conn(0x7f42ec13b6f0 legacy=0x7f42ec05ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 -- 172.21.15.88:0/2667799836 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec137d40 con 0x7f42ec131f50 2020-02-11T16:08:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 --2- 172.21.15.88:0/2667799836 >> v2:172.21.15.88:3300/0 conn(0x7f42ec131f50 0x7f42ec05f900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f42e8002f30 tx=0x7f42e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 --2- 172.21.15.88:0/2667799836 >> v2:172.21.15.88:3300/0 conn(0x7f42ec131f50 0x7f42ec05f900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f42e8002f30 tx=0x7f42e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 --2- 172.21.15.88:0/2667799836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec131f50 0x7f42ec05f900 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f42e8002f30 tx=0x7f42e80088e0).ready entity=mon.1 client_cookie=6df612b5b4b60200 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 --2- 172.21.15.88:0/2667799836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec131f50 0x7f42ec05f900 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f42e8002f30 tx=0x7f42e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f143a700 1 -- 172.21.15.88:0/2667799836 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e80116b0 con 0x7f42ec131f50 2020-02-11T16:08:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 --2- 172.21.15.88:0/2667799836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec131f50 0x7f42ec05f900 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f42e8002f30 tx=0x7f42e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f243c700 1 --2- 172.21.15.88:0/2667799836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec131f50 0x7f42ec05f900 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f42e8002f30 tx=0x7f42e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f143a700 1 -- 172.21.15.88:0/2667799836 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e8011810 con 0x7f42ec131f50 2020-02-11T16:08:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f143a700 1 -- 172.21.15.88:0/2667799836 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e8011bf0 con 0x7f42ec131f50 2020-02-11T16:08:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f46a0700 1 -- 172.21.15.88:0/2667799836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec131f50 msgr2=0x7f42ec05f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.759+0000 7f42f46a0700 1 --2- 172.21.15.88:0/2667799836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec131f50 0x7f42ec05f900 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f42e8002f30 tx=0x7f42e80088e0).stop 2020-02-11T16:08:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.760+0000 7f42f46a0700 1 -- 172.21.15.88:0/2667799836 shutdown_connections 2020-02-11T16:08:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.760+0000 7f42f46a0700 1 --2- 172.21.15.88:0/2667799836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec131f50 0x7f42ec05f900 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.760+0000 7f42f46a0700 1 --2- 172.21.15.88:0/2667799836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42ec13b290 0x7f42ec09d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.760+0000 7f42f46a0700 1 -- 172.21.15.88:0/2667799836 >> 172.21.15.88:0/2667799836 conn(0x7f42ec0a7bb0 msgr2=0x7f42ec0a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.760+0000 7f42f46a0700 1 -- 172.21.15.88:0/2667799836 shutdown_connections 2020-02-11T16:08:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.760+0000 7f42f46a0700 1 -- 172.21.15.88:0/2667799836 wait complete. 2020-02-11T16:08:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.761+0000 7f42f46a0700 1 Processor -- start 2020-02-11T16:08:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.761+0000 7f42f46a0700 1 -- start start 2020-02-11T16:08:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.761+0000 7f42f46a0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42ec131f50 0x7f42ec135be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.761+0000 7f42f46a0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42ec13b290 0x7f42ec130300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.761+0000 7f42f46a0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec0aae50 con 0x7f42ec12df80 2020-02-11T16:08:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.761+0000 7f42f46a0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec0a1e90 con 0x7f42ec13b290 2020-02-11T16:08:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.761+0000 7f42f46a0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0a5790 con 0x7f42ec131f50 2020-02-11T16:08:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42ec13b290 0x7f42ec130300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42ec13b290 0x7f42ec130300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53340/0 (socket says 172.21.15.88:53340) 2020-02-11T16:08:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 -- 172.21.15.88:0/2788629863 learned_addr learned my addr 172.21.15.88:0/2788629863 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f243c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42ec131f50 0x7f42ec135be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 -- 172.21.15.88:0/2788629863 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42ec131f50 msgr2=0x7f42ec135be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42ec131f50 0x7f42ec135be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 -- 172.21.15.88:0/2788629863 >> v1:172.21.15.88:6789/0 conn(0x7f42ec12df80 legacy=0x7f42ec12b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 -- 172.21.15.88:0/2788629863 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec0aa910 con 0x7f42ec13b290 2020-02-11T16:08:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f243c700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42ec131f50 0x7f42ec135be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:08:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 --2- 172.21.15.88:0/2788629863 >> v2:172.21.15.88:3300/0 conn(0x7f42ec13b290 0x7f42ec130300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42dc003070 tx=0x7f42dc010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 --2- 172.21.15.88:0/2788629863 >> v2:172.21.15.88:3300/0 conn(0x7f42ec13b290 0x7f42ec130300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42dc003070 tx=0x7f42dc010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b290 0x7f42ec130300 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f42dc003070 tx=0x7f42dc010cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:36.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b290 0x7f42ec130300 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f42dc003070 tx=0x7f42dc010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b290 0x7f42ec130300 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f42dc003070 tx=0x7f42dc010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42dc005aa0 con 0x7f42ec13b290 2020-02-11T16:08:36.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f1c3b700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b290 0x7f42ec130300 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f42dc003070 tx=0x7f42dc010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc005c00 con 0x7f42ec13b290 2020-02-11T16:08:36.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f46a0700 1 -- 172.21.15.88:0/2788629863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec0aabb0 con 0x7f42ec13b290 2020-02-11T16:08:36.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42dc005e30 con 0x7f42ec13b290 2020-02-11T16:08:36.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.762+0000 7f42f46a0700 1 -- 172.21.15.88:0/2788629863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec12bc10 con 0x7f42ec13b290 2020-02-11T16:08:36.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.763+0000 7f42f1c3b700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b290 0x7f42ec130300 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f42dc003070 tx=0x7f42dc010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.763+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f42dc007180 con 0x7f42ec13b290 2020-02-11T16:08:36.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.763+0000 7f42f1c3b700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b290 0x7f42ec130300 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f42dc003070 tx=0x7f42dc010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.763+0000 7f42db7fe700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f42cc039c40 0x7f42cc03c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:36.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.763+0000 7f42f46a0700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 0x7f42ec12d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:36.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.763+0000 7f42f46a0700 1 -- 172.21.15.88:0/2788629863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec05e2f0 con 0x7f42ec13b6f0 2020-02-11T16:08:36.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.763+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f42dc04a2b0 con 0x7f42ec13b290 2020-02-11T16:08:36.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.763+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 0x7f42ec12d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.763+0000 7f42f243c700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f42cc039c40 0x7f42cc03c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42f2c3d700 1 -- 172.21.15.88:0/2788629863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42ec0a5b60 con 0x7f42ec13b6f0 2020-02-11T16:08:36.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 0x7f42ec12d430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42f243c700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f42cc039c40 0x7f42cc03c100 crc :-1 s=READY pgs=155 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:36.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 0x7f42ec12d430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 0x7f42ec12d430 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:36.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 0x7f42ec12d430 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e4005d70 con 0x7f42ec13b6f0 2020-02-11T16:08:36.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 0x7f42ec12d430 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f42e40121e0 con 0x7f42ec13b6f0 2020-02-11T16:08:36.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 msgr2=0x7f42ec12d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42db7fe700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 0x7f42ec12d430 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).stop 2020-02-11T16:08:36.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 msgr2=0x7f42ec12d430 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:36.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.764+0000 7f42db7fe700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b6f0 0x7f42ec12d430 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).stop 2020-02-11T16:08:36.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42f46a0700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 0x7f42ec05ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:36.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42f46a0700 1 -- 172.21.15.88:0/2788629863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0565b0 con 0x7f42ec05e8f0 2020-02-11T16:08:36.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 0x7f42ec05ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:36.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42f2c3d700 1 -- 172.21.15.88:0/2788629863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f42ec12f8a0 con 0x7f42ec05e8f0 2020-02-11T16:08:36.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 0x7f42ec05ed00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 0x7f42ec05ed00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 0x7f42ec05ed00 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:36.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 0x7f42ec05ed00 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e400bc80 con 0x7f42ec05e8f0 2020-02-11T16:08:36.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42f2c3d700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 0x7f42ec05ed00 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:36.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f42e40123e0 con 0x7f42ec05e8f0 2020-02-11T16:08:36.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 msgr2=0x7f42ec05ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.773+0000 7f42db7fe700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 0x7f42ec05ed00 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).stop 2020-02-11T16:08:36.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42db7fe700 1 -- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 msgr2=0x7f42ec05ed00 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:36.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42db7fe700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec05e8f0 0x7f42ec05ed00 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0x7f42ec137aa0 tx=0x7f42e4010b40).stop 2020-02-11T16:08:36.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f46a0700 1 -- 172.21.15.88:0/2788629863 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f42cc039c40 msgr2=0x7f42cc03c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f46a0700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f42cc039c40 0x7f42cc03c100 crc :-1 s=READY pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:36.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f46a0700 1 -- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b290 msgr2=0x7f42ec130300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:36.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f46a0700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b290 0x7f42ec130300 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f42dc003070 tx=0x7f42dc010cc0).stop 2020-02-11T16:08:36.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f2c3d700 1 -- 172.21.15.88:0/2788629863 reap_dead start 2020-02-11T16:08:36.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f2c3d700 1 -- 172.21.15.88:0/2788629863 reap_dead start 2020-02-11T16:08:36.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f46a0700 1 -- 172.21.15.88:0/2788629863 shutdown_connections 2020-02-11T16:08:36.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f46a0700 1 --2- 172.21.15.88:0/2788629863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42ec13b290 0x7f42ec130300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:36.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f46a0700 1 -- 172.21.15.88:0/2788629863 >> 172.21.15.88:0/2788629863 conn(0x7f42ec0a7bb0 msgr2=0x7f42ec131660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:36.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f46a0700 1 -- 172.21.15.88:0/2788629863 shutdown_connections 2020-02-11T16:08:36.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:36.774+0000 7f42f46a0700 1 -- 172.21.15.88:0/2788629863 wait complete. 2020-02-11T16:08:36.918 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:08:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:08:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 38, 2020-02-11T16:08:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:08:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:08:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:08:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:08:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2020-02-11T16:08:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:08:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:08:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:08:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:08:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:08:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:08:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:08:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:08:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:08:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:08:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:08:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:08:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:08:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:08:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:08:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:08:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:08:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:36.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:08:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:08:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:36.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.929 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:08:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:08:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:36.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:08:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:08:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:36.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:08:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:08:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:36.932 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:08:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:36.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:08:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:08:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:08:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:36.935 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:08:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:08:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:36.936 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:08:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:08:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:36.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:36.938 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:08:36.938 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:08:36.972 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/32' 2020-02-11T16:08:36.972 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/30' 2020-02-11T16:08:36.972 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/14' 2020-02-11T16:08:36.972 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/18' 2020-02-11T16:08:36.972 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/13' 2020-02-11T16:08:36.972 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/33' 2020-02-11T16:08:36.973 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/17' 2020-02-11T16:08:36.973 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/35' 2020-02-11T16:08:36.973 INFO:tasks.workunit.client.0.smithi088.stdout:removed './138/37' 2020-02-11T16:08:36.973 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './138' 2020-02-11T16:08:36.973 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/19' 2020-02-11T16:08:36.973 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/15' 2020-02-11T16:08:36.973 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/31' 2020-02-11T16:08:36.974 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/36' 2020-02-11T16:08:36.974 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/20' 2020-02-11T16:08:36.974 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/12' 2020-02-11T16:08:36.974 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/39' 2020-02-11T16:08:36.974 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/10' 2020-02-11T16:08:36.974 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/34' 2020-02-11T16:08:36.974 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/38' 2020-02-11T16:08:36.974 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/11' 2020-02-11T16:08:36.975 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/16' 2020-02-11T16:08:36.975 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/32' 2020-02-11T16:08:36.975 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/30' 2020-02-11T16:08:36.975 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/14' 2020-02-11T16:08:36.975 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/18' 2020-02-11T16:08:36.975 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/13' 2020-02-11T16:08:36.975 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/33' 2020-02-11T16:08:36.976 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/17' 2020-02-11T16:08:36.976 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/35' 2020-02-11T16:08:36.976 INFO:tasks.workunit.client.0.smithi088.stdout:removed './139/37' 2020-02-11T16:08:36.976 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './139' 2020-02-11T16:08:36.976 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/19' 2020-02-11T16:08:36.976 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/15' 2020-02-11T16:08:36.976 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/31' 2020-02-11T16:08:36.977 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/36' 2020-02-11T16:08:36.977 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/20' 2020-02-11T16:08:36.977 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/12' 2020-02-11T16:08:36.977 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/39' 2020-02-11T16:08:36.977 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/10' 2020-02-11T16:08:36.977 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/34' 2020-02-11T16:08:36.977 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/38' 2020-02-11T16:08:36.978 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/11' 2020-02-11T16:08:36.978 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/16' 2020-02-11T16:08:36.978 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/32' 2020-02-11T16:08:36.978 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/30' 2020-02-11T16:08:36.978 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/14' 2020-02-11T16:08:36.978 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/18' 2020-02-11T16:08:36.978 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/13' 2020-02-11T16:08:36.978 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/33' 2020-02-11T16:08:36.979 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/17' 2020-02-11T16:08:36.979 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/35' 2020-02-11T16:08:36.979 INFO:tasks.workunit.client.0.smithi088.stdout:removed './140/37' 2020-02-11T16:08:36.979 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './140' 2020-02-11T16:08:36.979 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/19' 2020-02-11T16:08:36.979 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/15' 2020-02-11T16:08:36.979 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/31' 2020-02-11T16:08:36.980 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/36' 2020-02-11T16:08:36.980 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/20' 2020-02-11T16:08:36.980 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/12' 2020-02-11T16:08:36.980 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/39' 2020-02-11T16:08:36.980 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/10' 2020-02-11T16:08:36.980 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/34' 2020-02-11T16:08:36.980 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/38' 2020-02-11T16:08:36.981 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/11' 2020-02-11T16:08:36.981 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/16' 2020-02-11T16:08:36.981 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/32' 2020-02-11T16:08:36.981 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/30' 2020-02-11T16:08:36.981 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/14' 2020-02-11T16:08:36.982 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/18' 2020-02-11T16:08:36.982 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/13' 2020-02-11T16:08:36.982 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/33' 2020-02-11T16:08:36.982 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/17' 2020-02-11T16:08:36.982 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/35' 2020-02-11T16:08:36.982 INFO:tasks.workunit.client.0.smithi088.stdout:removed './141/37' 2020-02-11T16:08:36.982 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './141' 2020-02-11T16:08:36.982 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/19' 2020-02-11T16:08:36.983 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/15' 2020-02-11T16:08:36.983 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/31' 2020-02-11T16:08:36.983 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/36' 2020-02-11T16:08:36.983 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/20' 2020-02-11T16:08:36.983 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/12' 2020-02-11T16:08:36.983 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/39' 2020-02-11T16:08:36.983 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/10' 2020-02-11T16:08:36.984 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/34' 2020-02-11T16:08:36.984 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/38' 2020-02-11T16:08:36.984 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/11' 2020-02-11T16:08:36.984 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/16' 2020-02-11T16:08:36.984 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/32' 2020-02-11T16:08:36.984 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/30' 2020-02-11T16:08:36.984 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/14' 2020-02-11T16:08:36.984 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/18' 2020-02-11T16:08:36.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/13' 2020-02-11T16:08:36.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/33' 2020-02-11T16:08:36.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/17' 2020-02-11T16:08:36.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/35' 2020-02-11T16:08:36.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './142/37' 2020-02-11T16:08:36.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './142' 2020-02-11T16:08:36.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/19' 2020-02-11T16:08:36.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/15' 2020-02-11T16:08:36.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/31' 2020-02-11T16:08:36.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/36' 2020-02-11T16:08:36.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/20' 2020-02-11T16:08:36.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/12' 2020-02-11T16:08:36.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/39' 2020-02-11T16:08:36.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/10' 2020-02-11T16:08:36.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/34' 2020-02-11T16:08:36.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/38' 2020-02-11T16:08:36.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/11' 2020-02-11T16:08:36.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/16' 2020-02-11T16:08:36.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/32' 2020-02-11T16:08:36.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/30' 2020-02-11T16:08:36.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/14' 2020-02-11T16:08:36.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/18' 2020-02-11T16:08:36.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/13' 2020-02-11T16:08:36.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/33' 2020-02-11T16:08:36.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/17' 2020-02-11T16:08:36.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/35' 2020-02-11T16:08:36.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed './143/37' 2020-02-11T16:08:36.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './143' 2020-02-11T16:08:36.990 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/19' 2020-02-11T16:08:36.990 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/15' 2020-02-11T16:08:36.990 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/31' 2020-02-11T16:08:36.990 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/36' 2020-02-11T16:08:36.990 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/20' 2020-02-11T16:08:36.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/12' 2020-02-11T16:08:36.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/39' 2020-02-11T16:08:36.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/10' 2020-02-11T16:08:36.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/34' 2020-02-11T16:08:36.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/38' 2020-02-11T16:08:36.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/11' 2020-02-11T16:08:36.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/16' 2020-02-11T16:08:36.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/32' 2020-02-11T16:08:36.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/30' 2020-02-11T16:08:36.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/14' 2020-02-11T16:08:36.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/18' 2020-02-11T16:08:36.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/13' 2020-02-11T16:08:36.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/33' 2020-02-11T16:08:36.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/17' 2020-02-11T16:08:36.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/35' 2020-02-11T16:08:36.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './144/37' 2020-02-11T16:08:36.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './144' 2020-02-11T16:08:36.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/19' 2020-02-11T16:08:36.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/15' 2020-02-11T16:08:36.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/31' 2020-02-11T16:08:36.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/36' 2020-02-11T16:08:36.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/20' 2020-02-11T16:08:36.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/12' 2020-02-11T16:08:36.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/39' 2020-02-11T16:08:36.996 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/10' 2020-02-11T16:08:36.996 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/34' 2020-02-11T16:08:36.996 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/38' 2020-02-11T16:08:36.996 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/11' 2020-02-11T16:08:36.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/16' 2020-02-11T16:08:36.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/32' 2020-02-11T16:08:36.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/30' 2020-02-11T16:08:36.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/14' 2020-02-11T16:08:36.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/18' 2020-02-11T16:08:36.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/13' 2020-02-11T16:08:36.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/33' 2020-02-11T16:08:36.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/17' 2020-02-11T16:08:36.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/35' 2020-02-11T16:08:36.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './145/37' 2020-02-11T16:08:36.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './145' 2020-02-11T16:08:36.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/19' 2020-02-11T16:08:36.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/15' 2020-02-11T16:08:36.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/31' 2020-02-11T16:08:36.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/36' 2020-02-11T16:08:36.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/20' 2020-02-11T16:08:36.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/12' 2020-02-11T16:08:36.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/39' 2020-02-11T16:08:36.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/10' 2020-02-11T16:08:36.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/34' 2020-02-11T16:08:36.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/38' 2020-02-11T16:08:37.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/11' 2020-02-11T16:08:37.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/16' 2020-02-11T16:08:37.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/32' 2020-02-11T16:08:37.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/30' 2020-02-11T16:08:37.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/14' 2020-02-11T16:08:37.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/18' 2020-02-11T16:08:37.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/13' 2020-02-11T16:08:37.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/33' 2020-02-11T16:08:37.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/17' 2020-02-11T16:08:37.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/35' 2020-02-11T16:08:37.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './146/37' 2020-02-11T16:08:37.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './146' 2020-02-11T16:08:37.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/19' 2020-02-11T16:08:37.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/15' 2020-02-11T16:08:37.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/31' 2020-02-11T16:08:37.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/36' 2020-02-11T16:08:37.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/20' 2020-02-11T16:08:37.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/12' 2020-02-11T16:08:37.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/39' 2020-02-11T16:08:37.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/10' 2020-02-11T16:08:37.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/34' 2020-02-11T16:08:37.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/38' 2020-02-11T16:08:37.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/11' 2020-02-11T16:08:37.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/16' 2020-02-11T16:08:37.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/32' 2020-02-11T16:08:37.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/30' 2020-02-11T16:08:37.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/14' 2020-02-11T16:08:37.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/18' 2020-02-11T16:08:37.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/13' 2020-02-11T16:08:37.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/33' 2020-02-11T16:08:37.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/17' 2020-02-11T16:08:37.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/35' 2020-02-11T16:08:37.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './147/37' 2020-02-11T16:08:37.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './147' 2020-02-11T16:08:37.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/19' 2020-02-11T16:08:37.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/15' 2020-02-11T16:08:37.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/31' 2020-02-11T16:08:37.005 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/36' 2020-02-11T16:08:37.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.050+0000 7fb4ac610700 1 Processor -- start 2020-02-11T16:08:37.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.050+0000 7fb4ac610700 1 -- start start 2020-02-11T16:08:37.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4ac610700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:37.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4ac610700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a40a31b0 con 0x7fb4a40a5de0 2020-02-11T16:08:37.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4ac610700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a40a3570 con 0x7fb4a40a18a0 2020-02-11T16:08:37.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4ac610700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40a3810 con 0x7fb4a40a6260 2020-02-11T16:08:37.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4aa3ac700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb4a40a18a0 0x7fb4a40a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40976/0 (socket says 172.21.15.88:40976) 2020-02-11T16:08:37.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4aa3ac700 1 -- 172.21.15.88:0/3596101540 learned_addr learned my addr 172.21.15.88:0/3596101540 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:37.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4aabad700 1 --2- 172.21.15.88:0/3596101540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4a93aa700 1 -- 172.21.15.88:0/3596101540 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601204494 0 0) 0x7fb4a40a31b0 con 0x7fb4a40a5de0 2020-02-11T16:08:37.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4a93aa700 1 -- 172.21.15.88:0/3596101540 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb48c003230 con 0x7fb4a40a5de0 2020-02-11T16:08:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4a93aa700 1 -- 172.21.15.88:0/3596101540 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839214383 0 0) 0x7fb4a40a3570 con 0x7fb4a40a18a0 2020-02-11T16:08:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4a93aa700 1 -- 172.21.15.88:0/3596101540 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a40a31b0 con 0x7fb4a40a18a0 2020-02-11T16:08:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4aabad700 1 -- 172.21.15.88:0/3596101540 >> v1:172.21.15.88:6789/0 conn(0x7fb4a40a18a0 legacy=0x7fb4a40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4aabad700 1 -- 172.21.15.88:0/3596101540 >> v1:172.21.15.52:6789/0 conn(0x7fb4a40a5de0 legacy=0x7fb4a4134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4aabad700 1 -- 172.21.15.88:0/3596101540 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a40a3ab0 con 0x7fb4a40a6260 2020-02-11T16:08:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.051+0000 7fb4aabad700 1 --2- 172.21.15.88:0/3596101540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4135160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb49c0032b0 tx=0x7fb49c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4aabad700 1 --2- 172.21.15.88:0/3596101540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4135160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb49c0032b0 tx=0x7fb49c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4aabad700 1 --2- 172.21.15.88:0/3596101540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4135160 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c008c60).ready entity=mon.2 client_cookie=d1366965d1ad1093 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4aabad700 1 --2- 172.21.15.88:0/3596101540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4135160 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4a93aa700 1 -- 172.21.15.88:0/3596101540 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49c011db0 con 0x7fb4a40a6260 2020-02-11T16:08:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4aabad700 1 --2- 172.21.15.88:0/3596101540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4135160 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4a93aa700 1 -- 172.21.15.88:0/3596101540 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00a160 con 0x7fb4a40a6260 2020-02-11T16:08:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4aabad700 1 --2- 172.21.15.88:0/3596101540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4135160 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4a93aa700 1 -- 172.21.15.88:0/3596101540 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49c00a500 con 0x7fb4a40a6260 2020-02-11T16:08:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4ac610700 1 -- 172.21.15.88:0/3596101540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 msgr2=0x7fb4a4135160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4ac610700 1 --2- 172.21.15.88:0/3596101540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4135160 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c008c60).stop 2020-02-11T16:08:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4ac610700 1 -- 172.21.15.88:0/3596101540 shutdown_connections 2020-02-11T16:08:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4ac610700 1 --2- 172.21.15.88:0/3596101540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4135160 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.052+0000 7fb4ac610700 1 -- 172.21.15.88:0/3596101540 >> 172.21.15.88:0/3596101540 conn(0x7fb4a409d110 msgr2=0x7fb4a409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.053+0000 7fb4ac610700 1 -- 172.21.15.88:0/3596101540 shutdown_connections 2020-02-11T16:08:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.053+0000 7fb4ac610700 1 -- 172.21.15.88:0/3596101540 wait complete. 2020-02-11T16:08:37.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4ac610700 1 Processor -- start 2020-02-11T16:08:37.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4ac610700 1 -- start start 2020-02-11T16:08:37.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4ac610700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb4a40a5de0 0x7fb4a4136690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4ac610700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4136ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4ac610700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a40a9090 con 0x7fb4a40a18a0 2020-02-11T16:08:37.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4ac610700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a4134e20 con 0x7fb4a40a5de0 2020-02-11T16:08:37.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4ac610700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a4136af0 con 0x7fb4a40a6260 2020-02-11T16:08:37.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4aa3ac700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb4a40a18a0 0x7fb4a4138090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40982/0 (socket says 172.21.15.88:40982) 2020-02-11T16:08:37.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4aa3ac700 1 -- 172.21.15.88:0/952785531 learned_addr learned my addr 172.21.15.88:0/952785531 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4a9bab700 1 --2- 172.21.15.88:0/952785531 >> v2:172.21.15.88:3300/0 conn(0x7fb4a40a5de0 0x7fb4a4136690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.054+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4136ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 -- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 msgr2=0x7fb4a4136ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4136ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 -- 172.21.15.88:0/952785531 >> v1:172.21.15.88:6789/0 conn(0x7fb4a40a18a0 legacy=0x7fb4a4138090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331317447 0 0) 0x7fb4a40a9090 con 0x7fb4a40a18a0 2020-02-11T16:08:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 -- 172.21.15.88:0/952785531 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4131d00 con 0x7fb4a40a5de0 2020-02-11T16:08:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4a40a6260 0x7fb4a4136ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:08:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 --2- 172.21.15.88:0/952785531 >> v2:172.21.15.88:3300/0 conn(0x7fb4a40a5de0 0x7fb4a4136690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb494002430 tx=0x7fb494010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 --2- 172.21.15.88:0/952785531 >> v2:172.21.15.88:3300/0 conn(0x7fb4a40a5de0 0x7fb4a4136690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb494002430 tx=0x7fb494010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4a40a5de0 0x7fb4a4136690 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fb494002430 tx=0x7fb494010910).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4a40a5de0 0x7fb4a4136690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fb494002430 tx=0x7fb494010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49400cc00 con 0x7fb4a40a5de0 2020-02-11T16:08:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4a40a5de0 0x7fb4a4136690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fb494002430 tx=0x7fb494010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4a40a5de0 0x7fb4a4136690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fb494002430 tx=0x7fb494010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49400cd60 con 0x7fb4a40a5de0 2020-02-11T16:08:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4ac610700 1 -- 172.21.15.88:0/952785531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a4131fa0 con 0x7fb4a40a5de0 2020-02-11T16:08:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49400e350 con 0x7fb4a40a5de0 2020-02-11T16:08:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4ac610700 1 -- 172.21.15.88:0/952785531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a4135b50 con 0x7fb4a40a5de0 2020-02-11T16:08:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.055+0000 7fb4a9bab700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4a40a5de0 0x7fb4a4136690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fb494002430 tx=0x7fb494010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb49400e5c0 con 0x7fb4a40a5de0 2020-02-11T16:08:37.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4a9bab700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4a40a5de0 0x7fb4a4136690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fb494002430 tx=0x7fb494010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4937fe700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb484039bc0 0x7fb48403c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4ac610700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 0x7fb4a4137140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4ac610700 1 -- 172.21.15.88:0/952785531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a4131bb0 con 0x7fb4a40a7fe0 2020-02-11T16:08:37.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb494049680 con 0x7fb4a40a5de0 2020-02-11T16:08:37.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4aa3ac700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb484039bc0 0x7fb48403c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 0x7fb4a4137140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4aa3ac700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb484039bc0 0x7fb48403c080 crc :-1 s=READY pgs=156 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4aabad700 1 -- 172.21.15.88:0/952785531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4a40565b0 con 0x7fb4a40a7fe0 2020-02-11T16:08:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.056+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 0x7fb4a4137140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb4a412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.057+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 0x7fb4a4137140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb4a412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.057+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 0x7fb4a4137140 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb4a412f3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.057+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 0x7fb4a4137140 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb4a412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.057+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49c007c00 con 0x7fb4a40a7fe0 2020-02-11T16:08:37.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.057+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 0x7fb4a4137140 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb4a412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.057+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fb49c00ae30 con 0x7fb4a40a7fe0 2020-02-11T16:08:37.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.057+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 msgr2=0x7fb4a4137140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.057+0000 7fb4937fe700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 0x7fb4a4137140 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb4a412f3b0).stop 2020-02-11T16:08:37.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.057+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 msgr2=0x7fb4a4137140 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:37.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.057+0000 7fb4937fe700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a40a7fe0 0x7fb4a4137140 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb4a412f3b0).stop 2020-02-11T16:08:37.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.066+0000 7fb4ac610700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 0x7fb4a4137980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.066+0000 7fb4ac610700 1 -- 172.21.15.88:0/952785531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a405e2f0 con 0x7fb4a41375a0 2020-02-11T16:08:37.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.067+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 0x7fb4a4137980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.067+0000 7fb4aabad700 1 -- 172.21.15.88:0/952785531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb4a4137de0 con 0x7fb4a41375a0 2020-02-11T16:08:37.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.067+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 0x7fb4a4137980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c00a5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.067+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 0x7fb4a4137980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c00a5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.067+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 0x7fb4a4137980 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c00a5c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.067+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 0x7fb4a4137980 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c00a5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.068+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49c007910 con 0x7fb4a41375a0 2020-02-11T16:08:37.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.068+0000 7fb4aabad700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 0x7fb4a4137980 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c00a5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.068+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4022 (secure 0 0 0) 0x7fb49c00d610 con 0x7fb4a41375a0 2020-02-11T16:08:37.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.068+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 msgr2=0x7fb4a4137980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.068+0000 7fb4937fe700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 0x7fb4a4137980 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c00a5c0).stop 2020-02-11T16:08:37.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.068+0000 7fb4937fe700 1 -- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 msgr2=0x7fb4a4137980 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:37.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.068+0000 7fb4937fe700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4a41375a0 0x7fb4a4137980 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0x7fb49c0032b0 tx=0x7fb49c00a5c0).stop 2020-02-11T16:08:37.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.069+0000 7fb4ac610700 1 -- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb484039bc0 msgr2=0x7fb48403c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.069+0000 7fb4ac610700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb484039bc0 0x7fb48403c080 crc :-1 s=READY pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.069+0000 7fb4ac610700 1 -- 172.21.15.88:0/952785531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4a40a5de0 msgr2=0x7fb4a4136690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.069+0000 7fb4ac610700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4a40a5de0 0x7fb4a4136690 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fb494002430 tx=0x7fb494010910).stop 2020-02-11T16:08:37.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.069+0000 7fb4aabad700 1 -- 172.21.15.88:0/952785531 reap_dead start 2020-02-11T16:08:37.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.069+0000 7fb4ac610700 1 -- 172.21.15.88:0/952785531 shutdown_connections 2020-02-11T16:08:37.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.069+0000 7fb4ac610700 1 --2- 172.21.15.88:0/952785531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4a40a5de0 0x7fb4a4136690 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0x7fb494002430 tx=0x7fb494010910).stop 2020-02-11T16:08:37.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.069+0000 7fb4ac610700 1 -- 172.21.15.88:0/952785531 >> 172.21.15.88:0/952785531 conn(0x7fb4a409d110 msgr2=0x7fb4a4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:37.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.069+0000 7fb4ac610700 1 -- 172.21.15.88:0/952785531 shutdown_connections 2020-02-11T16:08:37.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.069+0000 7fb4ac610700 1 -- 172.21.15.88:0/952785531 wait complete. 2020-02-11T16:08:37.081 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:08:37.081 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:37.082 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:37.082 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:08:37.082 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 38, 2020-02-11T16:08:37.082 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:08:37.082 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:08:37.082 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:08:37.082 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:08:37.082 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.083 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2020-02-11T16:08:37.083 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:37.083 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:08:37.083 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:08:37.083 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:37.083 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:37.083 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:37.084 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:37.084 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:37.084 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:37.084 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.084 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:08:37.084 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:08:37.084 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:37.085 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:37.085 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:37.085 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:37.085 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:37.085 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:37.085 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.085 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.085 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:08:37.086 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:08:37.086 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:08:37.086 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:08:37.086 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:08:37.086 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:08:37.086 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:37.086 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:37.087 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:08:37.087 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:08:37.087 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:37.087 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:08:37.087 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:37.087 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:37.087 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:37.088 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:37.088 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:37.088 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:37.088 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.088 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:08:37.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.088 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:08:37.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.089 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:37.089 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:37.089 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:37.089 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:37.089 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.089 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:37.089 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:08:37.090 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.090 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.090 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:37.090 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:08:37.090 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.090 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.091 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.091 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.091 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:08:37.091 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:08:37.091 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:37.091 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:37.091 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.092 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:37.092 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:37.092 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:37.092 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:37.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.092 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:37.093 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:08:37.093 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.093 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:37.093 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:08:37.093 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.093 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.094 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.094 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:08:37.094 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:08:37.094 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:37.094 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:37.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.095 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:08:37.095 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:08:37.095 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:37.095 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:37.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.095 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:37.096 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:08:37.096 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.096 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.096 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.096 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:37.096 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:08:37.096 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.096 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.097 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.097 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.097 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:08:37.097 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:08:37.097 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:37.097 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:37.097 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.098 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.098 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:08:37.098 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:08:37.098 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.098 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:37.098 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:37.099 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:37.099 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.099 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.099 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:08:37.099 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.099 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:37.099 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:37.099 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:37.100 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.100 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.100 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:08:37.100 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.100 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:37.100 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:37.100 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:37.101 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.101 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.101 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.101 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:08:37.102 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:08:37.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.258+0000 7f74441cc700 1 Processor -- start 2020-02-11T16:08:37.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.259+0000 7f74441cc700 1 -- start start 2020-02-11T16:08:37.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f74441cc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f743c0ad9d0 0x7f743c0a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:37.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f74441cc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f743c139040 0x7f743c1394f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:37.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f74441cc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c13f710 con 0x7f743c0ad3f0 2020-02-11T16:08:37.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f74441cc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0a9c60 con 0x7f743c139040 2020-02-11T16:08:37.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f74441cc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0a93f0 con 0x7f743c0ad9d0 2020-02-11T16:08:37.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f743c0ad9d0 0x7f743c0a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f743c0ad9d0 0x7f743c0a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53368/0 (socket says 172.21.15.88:53368) 2020-02-11T16:08:37.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 -- 172.21.15.88:0/2809165445 learned_addr learned my addr 172.21.15.88:0/2809165445 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:37.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7442769700 1 --2- 172.21.15.88:0/2809165445 >> v2:172.21.15.52:3300/0 conn(0x7f743c139040 0x7f743c1394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 -- 172.21.15.88:0/2809165445 >> v2:172.21.15.52:3300/0 conn(0x7f743c139040 msgr2=0x7f743c1394f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:08:37.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 --2- 172.21.15.88:0/2809165445 >> v2:172.21.15.52:3300/0 conn(0x7f743c139040 0x7f743c1394f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:37.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 -- 172.21.15.88:0/2809165445 >> v1:172.21.15.88:6789/0 conn(0x7f743c0ad3f0 legacy=0x7f743c13fb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:08:37.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 -- 172.21.15.88:0/2809165445 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0a9690 con 0x7f743c0ad9d0 2020-02-11T16:08:37.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 --2- 172.21.15.88:0/2809165445 >> v2:172.21.15.88:3300/0 conn(0x7f743c0ad9d0 0x7f743c0a8e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f743c0af220 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 --2- 172.21.15.88:0/2809165445 >> v2:172.21.15.88:3300/0 conn(0x7f743c0ad9d0 0x7f743c0a8e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f743c0af220 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 --2- 172.21.15.88:0/2809165445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c0ad9d0 0x7f743c0a8e70 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f743c0af220 tx=0x7f7438007a40).ready entity=mon.1 client_cookie=f63ec020ca783b43 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.260+0000 7f7441767700 1 --2- 172.21.15.88:0/2809165445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c0ad9d0 0x7f743c0a8e70 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f743c0af220 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.261+0000 7f7441767700 1 --2- 172.21.15.88:0/2809165445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c0ad9d0 0x7f743c0a8e70 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f743c0af220 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.261+0000 7f7441767700 1 --2- 172.21.15.88:0/2809165445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c0ad9d0 0x7f743c0a8e70 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f743c0af220 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.261+0000 7f7440f66700 1 -- 172.21.15.88:0/2809165445 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7438011630 con 0x7f743c0ad9d0 2020-02-11T16:08:37.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.261+0000 7f7440f66700 1 -- 172.21.15.88:0/2809165445 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438011790 con 0x7f743c0ad9d0 2020-02-11T16:08:37.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.261+0000 7f7440f66700 1 -- 172.21.15.88:0/2809165445 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7438011b70 con 0x7f743c0ad9d0 2020-02-11T16:08:37.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.261+0000 7f74441cc700 1 -- 172.21.15.88:0/2809165445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c0ad9d0 msgr2=0x7f743c0a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.261+0000 7f74441cc700 1 --2- 172.21.15.88:0/2809165445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c0ad9d0 0x7f743c0a8e70 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f743c0af220 tx=0x7f7438007a40).stop 2020-02-11T16:08:37.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.262+0000 7f74441cc700 1 -- 172.21.15.88:0/2809165445 shutdown_connections 2020-02-11T16:08:37.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.262+0000 7f74441cc700 1 --2- 172.21.15.88:0/2809165445 >> v2:172.21.15.52:3300/0 conn(0x7f743c139040 0x7f743c1394f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:37.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.262+0000 7f74441cc700 1 --2- 172.21.15.88:0/2809165445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c0ad9d0 0x7f743c0a8e70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.262+0000 7f74441cc700 1 -- 172.21.15.88:0/2809165445 >> 172.21.15.88:0/2809165445 conn(0x7f743c05ac70 msgr2=0x7f743c0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:37.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.262+0000 7f74441cc700 1 -- 172.21.15.88:0/2809165445 shutdown_connections 2020-02-11T16:08:37.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.263+0000 7f74441cc700 1 -- 172.21.15.88:0/2809165445 wait complete. 2020-02-11T16:08:37.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.264+0000 7f74441cc700 1 Processor -- start 2020-02-11T16:08:37.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.264+0000 7f74441cc700 1 -- start start 2020-02-11T16:08:37.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.265+0000 7f74441cc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f743c0ad3f0 0x7f743c134a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.265+0000 7f74441cc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c13d190 con 0x7f743c0ad9d0 2020-02-11T16:08:37.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.265+0000 7f74441cc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c134390 con 0x7f743c139040 2020-02-11T16:08:37.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.265+0000 7f74441cc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c134180 con 0x7f743c0ad3f0 2020-02-11T16:08:37.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.265+0000 7f7442769700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f743c139040 0x7f743c153e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41000/0 (socket says 172.21.15.88:41000) 2020-02-11T16:08:37.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.265+0000 7f7442769700 1 -- 172.21.15.88:0/2078925857 learned_addr learned my addr 172.21.15.88:0/2078925857 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:37.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248960881 0 0) 0x7f743c134390 con 0x7f743c139040 2020-02-11T16:08:37.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7424002fe0 con 0x7f743c139040 2020-02-11T16:08:37.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713767732 0 0) 0x7f743c13d190 con 0x7f743c0ad9d0 2020-02-11T16:08:37.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f743c134390 con 0x7f743c0ad9d0 2020-02-11T16:08:37.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> v2:172.21.15.52:3300/0 conn(0x7f743c0ad3f0 0x7f743c134a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3148472816 0 0) 0x7f743c134390 con 0x7f743c0ad9d0 2020-02-11T16:08:37.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f743c13d190 con 0x7f743c0ad9d0 2020-02-11T16:08:37.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f74380085c0 con 0x7f743c0ad9d0 2020-02-11T16:08:37.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 >> v2:172.21.15.52:3300/0 conn(0x7f743c0ad3f0 msgr2=0x7f743c134a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 --2- 172.21.15.88:0/2078925857 >> v2:172.21.15.52:3300/0 conn(0x7f743c0ad3f0 0x7f743c134a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 >> v1:172.21.15.88:6789/0 conn(0x7f743c139040 legacy=0x7f743c153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 >> v1:172.21.15.52:6789/0 conn(0x7f743c0ad9d0 legacy=0x7f743c1331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7424004b20 0x7f7424004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7424003f30 0x7f742400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c134180 con 0x7f7424003670 2020-02-11T16:08:37.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74240044f0 con 0x7f7424004b20 2020-02-11T16:08:37.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742400bbe0 con 0x7f7424003f30 2020-02-11T16:08:37.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.266+0000 7f7442769700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7424003f30 0x7f742400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7424004b20 0x7f7424004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 -- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7424003f30 msgr2=0x7f742400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7424003f30 0x7f742400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 -- 172.21.15.88:0/2078925857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7424004b20 msgr2=0x7f7424004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7424004b20 0x7f7424004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 -- 172.21.15.88:0/2078925857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c136760 con 0x7f7424003670 2020-02-11T16:08:37.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7442769700 1 -- 172.21.15.88:0/2078925857 reap_dead start 2020-02-11T16:08:37.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7438007c90 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f74441cc700 1 -- 172.21.15.88:0/2078925857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c1376b0 con 0x7f7424003670 2020-02-11T16:08:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7438007c90 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f74441cc700 1 -- 172.21.15.88:0/2078925857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c0a7450 con 0x7f7424003670 2020-02-11T16:08:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f7438007c90 tx=0x7f7438007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f7438007c90 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7438007530 con 0x7f7424003670 2020-02-11T16:08:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f7438007c90 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f7438007c90 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74380056c0 con 0x7f7424003670 2020-02-11T16:08:37.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.267+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7438005a20 con 0x7f7424003670 2020-02-11T16:08:37.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.268+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f7438007c90 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.268+0000 7f7441767700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f7438007c90 tx=0x7f7438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.268+0000 7f74441cc700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 0x7f743c065a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.268+0000 7f74441cc700 1 -- 172.21.15.88:0/2078925857 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0664c0 con 0x7f743c0a7ae0 2020-02-11T16:08:37.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.268+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 0x7f743c065a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.269+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7438005b80 con 0x7f7424003670 2020-02-11T16:08:37.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.269+0000 7f7441f68700 1 -- 172.21.15.88:0/2078925857 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f743c1353c0 con 0x7f743c0a7ae0 2020-02-11T16:08:37.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.269+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 0x7f743c065a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c00c1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.269+0000 7f7432ffd700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f742403de30 0x7f74240402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.269+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 0x7f743c065a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c00c1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.269+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f743804a5b0 con 0x7f7424003670 2020-02-11T16:08:37.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.269+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 0x7f743c065a00 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c00c1a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.269+0000 7f7442769700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f742403de30 0x7f74240402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.269+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 0x7f743c065a00 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c00c1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.269+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f742c013060 con 0x7f743c0a7ae0 2020-02-11T16:08:37.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.270+0000 7f7442769700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f742403de30 0x7f74240402f0 crc :-1 s=READY pgs=157 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.270+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 0x7f743c065a00 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c00c1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.270+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f742c0129a0 con 0x7f743c0a7ae0 2020-02-11T16:08:37.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.270+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 msgr2=0x7f743c065a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.270+0000 7f7432ffd700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 0x7f743c065a00 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c00c1a0).stop 2020-02-11T16:08:37.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.270+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 msgr2=0x7f743c065a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:37.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.270+0000 7f7432ffd700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 0x7f743c065a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.283+0000 7f74441cc700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 0x7f743c134bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.283+0000 7f74441cc700 1 -- 172.21.15.88:0/2078925857 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c05e2f0 con 0x7f743c1347f0 2020-02-11T16:08:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.283+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 0x7f743c134bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.283+0000 7f7441f68700 1 -- 172.21.15.88:0/2078925857 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f743c135030 con 0x7f743c1347f0 2020-02-11T16:08:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.283+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 0x7f743c134bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c008120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.283+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 0x7f743c134bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c008120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.283+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 0x7f743c134bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c008120).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.284+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 0x7f743c134bd0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c008120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.284+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f742c00e9e0 con 0x7f743c1347f0 2020-02-11T16:08:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.284+0000 7f7441f68700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 0x7f743c134bd0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c008120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.284+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f742c00eb40 con 0x7f743c1347f0 2020-02-11T16:08:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.284+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 msgr2=0x7f743c134bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.284+0000 7f7432ffd700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 0x7f743c134bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c008120).stop 2020-02-11T16:08:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.284+0000 7f7432ffd700 1 -- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 msgr2=0x7f743c134bd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.284+0000 7f7432ffd700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 0x7f743c134bd0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0x7f742c002f60 tx=0x7f742c008120).stop 2020-02-11T16:08:37.289 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:08:37.289 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:08:37.289 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:08:37.289 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:08:37.289 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 38, 2020-02-11T16:08:37.290 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:08:37.290 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:08:37.290 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:08:37.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:08:37.290 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.290 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2020-02-11T16:08:37.290 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:37.290 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:08:37.291 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:08:37.291 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:37.291 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:37.291 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:37.291 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:37.291 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:37.291 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:37.292 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.292 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:08:37.292 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:08:37.292 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:37.292 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:37.292 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:37.292 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:37.293 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:37.293 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:37.293 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.293 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:08:37.293 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:08:37.293 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:08:37.294 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:08:37.294 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:08:37.294 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:08:37.294 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:37.294 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:37.294 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:08:37.294 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:08:37.295 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:37.295 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:08:37.295 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:37.295 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:37.295 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:37.295 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:37.295 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:37.295 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:37.296 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.296 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:08:37.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.296 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:08:37.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.296 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:37.296 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:37.297 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:37.297 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:37.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.300 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:37.301 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:08:37.301 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.301 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:37.301 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:08:37.301 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.302 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.302 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.302 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:08:37.302 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:08:37.302 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:37.302 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:37.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.303 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:37.303 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:37.303 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:37.303 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:37.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.303 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:37.304 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:08:37.304 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.304 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:37.304 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:08:37.304 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.305 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.305 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.305 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:08:37.305 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:08:37.306 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:37.306 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:37.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.307 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:08:37.307 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:08:37.307 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:37.307 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:37.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.307 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:37.308 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:08:37.308 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.308 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:37.308 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:08:37.308 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:37.309 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.309 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.309 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:08:37.309 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:08:37.309 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:37.309 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:37.309 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.310 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:37.310 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:08:37.310 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:08:37.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.310 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:37.310 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:37.311 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:37.311 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.311 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.311 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:08:37.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.311 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:37.311 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:37.312 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:37.312 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.312 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.312 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:08:37.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.312 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:37.312 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:37.312 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:08:37.313 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.313 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.313 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:08:37.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.313 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:37.313 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:37.313 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:08:37.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.314 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:37.314 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:08:37.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:37.314 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:37.314 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:37.314 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:08:37.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.315 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:37.315 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:37.315 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:08:37.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.285+0000 7f74441cc700 1 -- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f742403de30 msgr2=0x7f74240402f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.285+0000 7f74441cc700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f742403de30 0x7f74240402f0 crc :-1 s=READY pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.285+0000 7f74441cc700 1 -- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 msgr2=0x7f7424003ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.285+0000 7f74441cc700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f7438007c90 tx=0x7f7438007a40).stop 2020-02-11T16:08:37.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.285+0000 7f74441cc700 1 -- 172.21.15.88:0/2078925857 shutdown_connections 2020-02-11T16:08:37.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.285+0000 7f74441cc700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f742403de30 0x7f74240402f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.285+0000 7f74441cc700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7424003670 0x7f7424003ad0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.285+0000 7f74441cc700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c0a7ae0 0x7f743c065a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.285+0000 7f74441cc700 1 --2- 172.21.15.88:0/2078925857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f743c1347f0 0x7f743c134bd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.285+0000 7f74441cc700 1 -- 172.21.15.88:0/2078925857 >> 172.21.15.88:0/2078925857 conn(0x7f743c05ac70 msgr2=0x7f743c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:37.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.286+0000 7f74441cc700 1 -- 172.21.15.88:0/2078925857 shutdown_connections 2020-02-11T16:08:37.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.286+0000 7f74441cc700 1 -- 172.21.15.88:0/2078925857 wait complete. 2020-02-11T16:08:37.320 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2020-02-11T16:08:37.321 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:08:37.321 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2020-02-11T16:08:37.321 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:08:37.321 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-02-11T16:08:37.321 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:08:37.335 INFO:tasks.ceph.mon.c:Stopped 2020-02-11T16:08:37.335 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:08:37.335 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:08:37.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.471+0000 7fbc21076700 1 Processor -- start 2020-02-11T16:08:37.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.471+0000 7fbc21076700 1 -- start start 2020-02-11T16:08:37.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.471+0000 7fbc21076700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:37.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.471+0000 7fbc21076700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbc1c0a2870 0x7fbc1c13b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:37.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.471+0000 7fbc21076700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1c0a2cf0 con 0x7fbc1c13b640 2020-02-11T16:08:37.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.471+0000 7fbc21076700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1c0a8630 con 0x7fbc1c0a2870 2020-02-11T16:08:37.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.471+0000 7fbc21076700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1c0a30c0 con 0x7fbc1c0a6ff0 2020-02-11T16:08:37.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1b59e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbc1c13b640 0x7fbc1c137c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41058/0 (socket says 172.21.15.88:41058) 2020-02-11T16:08:37.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53428/0 (socket says 172.21.15.88:53428) 2020-02-11T16:08:37.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1b59e700 1 -- 172.21.15.88:0/3512920393 learned_addr learned my addr 172.21.15.88:0/3512920393 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:37.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1a59c700 1 --2- 172.21.15.88:0/3512920393 >> v2:172.21.15.52:3300/0 conn(0x7fbc1c0a2870 0x7fbc1c13b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 -- 172.21.15.88:0/3512920393 >> v2:172.21.15.52:3300/0 conn(0x7fbc1c0a2870 msgr2=0x7fbc1c13b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:08:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 --2- 172.21.15.88:0/3512920393 >> v2:172.21.15.52:3300/0 conn(0x7fbc1c0a2870 0x7fbc1c13b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 -- 172.21.15.88:0/3512920393 >> v1:172.21.15.88:6789/0 conn(0x7fbc1c13b640 legacy=0x7fbc1c137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc19d9b700 1 -- 172.21.15.88:0/3512920393 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466898316 0 0) 0x7fbc14001450 con 0x7fbc1c13b640 2020-02-11T16:08:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 -- 172.21.15.88:0/3512920393 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c0a2130 con 0x7fbc1c0a6ff0 2020-02-11T16:08:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 --2- 172.21.15.88:0/3512920393 >> v2:172.21.15.88:3300/0 conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc0c002f30 tx=0x7fbc0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 --2- 172.21.15.88:0/3512920393 >> v2:172.21.15.88:3300/0 conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc0c002f30 tx=0x7fbc0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 --2- 172.21.15.88:0/3512920393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fbc0c002f30 tx=0x7fbc0c007a40).ready entity=mon.1 client_cookie=a116f21bce88c0e0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 --2- 172.21.15.88:0/3512920393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fbc0c002f30 tx=0x7fbc0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc19d9b700 1 -- 172.21.15.88:0/3512920393 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc0c0113c0 con 0x7fbc1c0a6ff0 2020-02-11T16:08:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 --2- 172.21.15.88:0/3512920393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fbc0c002f30 tx=0x7fbc0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc19d9b700 1 -- 172.21.15.88:0/3512920393 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0c011520 con 0x7fbc1c0a6ff0 2020-02-11T16:08:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc1ad9d700 1 --2- 172.21.15.88:0/3512920393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fbc0c002f30 tx=0x7fbc0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc19d9b700 1 -- 172.21.15.88:0/3512920393 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc0c0118c0 con 0x7fbc1c0a6ff0 2020-02-11T16:08:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc21076700 1 -- 172.21.15.88:0/3512920393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c0a6ff0 msgr2=0x7fbc1c0a73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.472+0000 7fbc21076700 1 --2- 172.21.15.88:0/3512920393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fbc0c002f30 tx=0x7fbc0c007a40).stop 2020-02-11T16:08:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.473+0000 7fbc21076700 1 -- 172.21.15.88:0/3512920393 shutdown_connections 2020-02-11T16:08:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.473+0000 7fbc21076700 1 --2- 172.21.15.88:0/3512920393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c0a6ff0 0x7fbc1c0a73d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.473+0000 7fbc21076700 1 --2- 172.21.15.88:0/3512920393 >> v2:172.21.15.52:3300/0 conn(0x7fbc1c0a2870 0x7fbc1c13b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.473+0000 7fbc21076700 1 -- 172.21.15.88:0/3512920393 >> 172.21.15.88:0/3512920393 conn(0x7fbc1c0ac2d0 msgr2=0x7fbc1c0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.473+0000 7fbc21076700 1 -- 172.21.15.88:0/3512920393 shutdown_connections 2020-02-11T16:08:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.473+0000 7fbc21076700 1 -- 172.21.15.88:0/3512920393 wait complete. 2020-02-11T16:08:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc21076700 1 Processor -- start 2020-02-11T16:08:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc21076700 1 -- start start 2020-02-11T16:08:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc21076700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc1c0a6ff0 0x7fbc1c0a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc21076700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc1c13b640 0x7fbc1c134780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc21076700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1c134fa0 con 0x7fbc1c0a2870 2020-02-11T16:08:37.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc21076700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1c0a5420 con 0x7fbc1c13b640 2020-02-11T16:08:37.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc21076700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c0a56c0 con 0x7fbc1c0a6ff0 2020-02-11T16:08:37.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc1a59c700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc1c0a6ff0 msgr2=0x7fbc1c0a5a70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:08:37.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc1a59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc1c0a6ff0 0x7fbc1c0a5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:37.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc1b59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc1c13b640 0x7fbc1c134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc1ad9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbc1c0a2870 0x7fbc1c131620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:32842/0 (socket says 172.21.15.88:32842) 2020-02-11T16:08:37.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc1b59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc1c13b640 0x7fbc1c134780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53438/0 (socket says 172.21.15.88:53438) 2020-02-11T16:08:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.474+0000 7fbc1ad9d700 1 -- 172.21.15.88:0/2954607777 learned_addr learned my addr 172.21.15.88:0/2954607777 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 -- 172.21.15.88:0/2954607777 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc1c0a6ff0 msgr2=0x7fbc1c0a5a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:08:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc1c0a6ff0 0x7fbc1c0a5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 -- 172.21.15.88:0/2954607777 >> v1:172.21.15.52:6789/0 conn(0x7fbc1c0a2870 legacy=0x7fbc1c131620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 -- 172.21.15.88:0/2954607777 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c134be0 con 0x7fbc1c13b640 2020-02-11T16:08:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> v2:172.21.15.88:3300/0 conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> v2:172.21.15.88:3300/0 conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc0bfff700 1 -- 172.21.15.88:0/2954607777 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc14005d20 con 0x7fbc1c13b640 2020-02-11T16:08:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc0bfff700 1 -- 172.21.15.88:0/2954607777 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc14012700 con 0x7fbc1c13b640 2020-02-11T16:08:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc21076700 1 -- 172.21.15.88:0/2954607777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1c1338b0 con 0x7fbc1c13b640 2020-02-11T16:08:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc0bfff700 1 -- 172.21.15.88:0/2954607777 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc14012b20 con 0x7fbc1c13b640 2020-02-11T16:08:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc21076700 1 -- 172.21.15.88:0/2954607777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1c135250 con 0x7fbc1c13b640 2020-02-11T16:08:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.475+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.476+0000 7fbc0bfff700 1 -- 172.21.15.88:0/2954607777 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fbc14011310 con 0x7fbc1c13b640 2020-02-11T16:08:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.476+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.476+0000 7fbc0bfff700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbf8039ca0 0x7fbbf803c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:37.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.476+0000 7fbc0bfff700 1 -- 172.21.15.88:0/2954607777 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fbc14049e10 con 0x7fbc1c13b640 2020-02-11T16:08:37.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.476+0000 7fbc21076700 1 -- 172.21.15.88:0/2954607777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1c0a2cf0 con 0x7fbc1c13b640 2020-02-11T16:08:37.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.476+0000 7fbc1ad9d700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbf8039ca0 0x7fbbf803c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:37.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.476+0000 7fbc1ad9d700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbf8039ca0 0x7fbbf803c160 crc :-1 s=READY pgs=158 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.480+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.480+0000 7fbc0bfff700 1 -- 172.21.15.88:0/2954607777 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbc1c0a2cf0 con 0x7fbc1c13b640 2020-02-11T16:08:37.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/20' 2020-02-11T16:08:37.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/12' 2020-02-11T16:08:37.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/39' 2020-02-11T16:08:37.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/10' 2020-02-11T16:08:37.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/34' 2020-02-11T16:08:37.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/38' 2020-02-11T16:08:37.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/11' 2020-02-11T16:08:37.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/16' 2020-02-11T16:08:37.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/32' 2020-02-11T16:08:37.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/30' 2020-02-11T16:08:37.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/14' 2020-02-11T16:08:37.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/18' 2020-02-11T16:08:37.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/13' 2020-02-11T16:08:37.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/33' 2020-02-11T16:08:37.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/17' 2020-02-11T16:08:37.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/35' 2020-02-11T16:08:37.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './148/37' 2020-02-11T16:08:37.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './148' 2020-02-11T16:08:37.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/19' 2020-02-11T16:08:37.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/15' 2020-02-11T16:08:37.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/31' 2020-02-11T16:08:37.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/36' 2020-02-11T16:08:37.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/20' 2020-02-11T16:08:37.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/12' 2020-02-11T16:08:37.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/39' 2020-02-11T16:08:37.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/10' 2020-02-11T16:08:37.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/34' 2020-02-11T16:08:37.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/38' 2020-02-11T16:08:37.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/11' 2020-02-11T16:08:37.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/16' 2020-02-11T16:08:37.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/32' 2020-02-11T16:08:37.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/30' 2020-02-11T16:08:37.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/14' 2020-02-11T16:08:37.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/18' 2020-02-11T16:08:37.664 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/13' 2020-02-11T16:08:37.664 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/33' 2020-02-11T16:08:37.664 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/17' 2020-02-11T16:08:37.664 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/35' 2020-02-11T16:08:37.664 INFO:tasks.workunit.client.0.smithi088.stdout:removed './149/37' 2020-02-11T16:08:37.664 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './149' 2020-02-11T16:08:37.664 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/19' 2020-02-11T16:08:37.664 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/15' 2020-02-11T16:08:37.665 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/31' 2020-02-11T16:08:37.665 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/36' 2020-02-11T16:08:37.665 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/20' 2020-02-11T16:08:37.665 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/12' 2020-02-11T16:08:37.665 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/39' 2020-02-11T16:08:37.665 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/10' 2020-02-11T16:08:37.665 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/34' 2020-02-11T16:08:37.666 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/38' 2020-02-11T16:08:37.666 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/11' 2020-02-11T16:08:37.666 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/16' 2020-02-11T16:08:37.666 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/32' 2020-02-11T16:08:37.666 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/30' 2020-02-11T16:08:37.666 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/14' 2020-02-11T16:08:37.669 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/18' 2020-02-11T16:08:37.669 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/13' 2020-02-11T16:08:37.669 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/33' 2020-02-11T16:08:37.670 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/17' 2020-02-11T16:08:37.670 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/35' 2020-02-11T16:08:37.670 INFO:tasks.workunit.client.0.smithi088.stdout:removed './150/37' 2020-02-11T16:08:37.670 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './150' 2020-02-11T16:08:37.671 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/19' 2020-02-11T16:08:37.671 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/15' 2020-02-11T16:08:37.672 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/31' 2020-02-11T16:08:37.672 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/36' 2020-02-11T16:08:37.672 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/20' 2020-02-11T16:08:37.672 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/12' 2020-02-11T16:08:37.672 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/39' 2020-02-11T16:08:37.672 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/10' 2020-02-11T16:08:37.673 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/34' 2020-02-11T16:08:37.673 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/38' 2020-02-11T16:08:37.673 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/11' 2020-02-11T16:08:37.673 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/16' 2020-02-11T16:08:37.673 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/32' 2020-02-11T16:08:37.673 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/30' 2020-02-11T16:08:37.674 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/14' 2020-02-11T16:08:37.674 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/18' 2020-02-11T16:08:37.674 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/13' 2020-02-11T16:08:37.674 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/33' 2020-02-11T16:08:37.674 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/17' 2020-02-11T16:08:37.674 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/35' 2020-02-11T16:08:37.674 INFO:tasks.workunit.client.0.smithi088.stdout:removed './151/37' 2020-02-11T16:08:37.675 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './151' 2020-02-11T16:08:37.675 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/19' 2020-02-11T16:08:37.675 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/15' 2020-02-11T16:08:37.675 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/31' 2020-02-11T16:08:37.675 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/36' 2020-02-11T16:08:37.675 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/20' 2020-02-11T16:08:37.675 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/12' 2020-02-11T16:08:37.675 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/39' 2020-02-11T16:08:37.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/10' 2020-02-11T16:08:37.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/34' 2020-02-11T16:08:37.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/38' 2020-02-11T16:08:37.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/11' 2020-02-11T16:08:37.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/16' 2020-02-11T16:08:37.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/32' 2020-02-11T16:08:37.676 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/30' 2020-02-11T16:08:37.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/14' 2020-02-11T16:08:37.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/18' 2020-02-11T16:08:37.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/13' 2020-02-11T16:08:37.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/33' 2020-02-11T16:08:37.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/17' 2020-02-11T16:08:37.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/35' 2020-02-11T16:08:37.677 INFO:tasks.workunit.client.0.smithi088.stdout:removed './152/37' 2020-02-11T16:08:37.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './152' 2020-02-11T16:08:37.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/19' 2020-02-11T16:08:37.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/15' 2020-02-11T16:08:37.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/31' 2020-02-11T16:08:37.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/36' 2020-02-11T16:08:37.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/20' 2020-02-11T16:08:37.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/12' 2020-02-11T16:08:37.678 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/39' 2020-02-11T16:08:37.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/10' 2020-02-11T16:08:37.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/34' 2020-02-11T16:08:37.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/38' 2020-02-11T16:08:37.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/11' 2020-02-11T16:08:37.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/16' 2020-02-11T16:08:37.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/32' 2020-02-11T16:08:37.679 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/30' 2020-02-11T16:08:37.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/14' 2020-02-11T16:08:37.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/18' 2020-02-11T16:08:37.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/13' 2020-02-11T16:08:37.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/33' 2020-02-11T16:08:37.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/17' 2020-02-11T16:08:37.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/35' 2020-02-11T16:08:37.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed './153/37' 2020-02-11T16:08:37.680 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './153' 2020-02-11T16:08:37.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/19' 2020-02-11T16:08:37.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/15' 2020-02-11T16:08:37.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/31' 2020-02-11T16:08:37.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/36' 2020-02-11T16:08:37.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/20' 2020-02-11T16:08:37.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/12' 2020-02-11T16:08:37.681 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/39' 2020-02-11T16:08:37.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/10' 2020-02-11T16:08:37.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/34' 2020-02-11T16:08:37.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/38' 2020-02-11T16:08:37.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/11' 2020-02-11T16:08:37.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/16' 2020-02-11T16:08:37.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/32' 2020-02-11T16:08:37.682 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/30' 2020-02-11T16:08:37.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/14' 2020-02-11T16:08:37.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/18' 2020-02-11T16:08:37.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/13' 2020-02-11T16:08:37.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/33' 2020-02-11T16:08:37.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/17' 2020-02-11T16:08:37.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/35' 2020-02-11T16:08:37.683 INFO:tasks.workunit.client.0.smithi088.stdout:removed './154/37' 2020-02-11T16:08:37.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './154' 2020-02-11T16:08:37.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/19' 2020-02-11T16:08:37.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/15' 2020-02-11T16:08:37.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/31' 2020-02-11T16:08:37.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/36' 2020-02-11T16:08:37.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/20' 2020-02-11T16:08:37.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/12' 2020-02-11T16:08:37.684 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/39' 2020-02-11T16:08:37.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/10' 2020-02-11T16:08:37.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/34' 2020-02-11T16:08:37.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/38' 2020-02-11T16:08:37.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/11' 2020-02-11T16:08:37.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/16' 2020-02-11T16:08:37.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/32' 2020-02-11T16:08:37.685 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/30' 2020-02-11T16:08:37.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/14' 2020-02-11T16:08:37.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/18' 2020-02-11T16:08:37.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/13' 2020-02-11T16:08:37.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/33' 2020-02-11T16:08:37.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/17' 2020-02-11T16:08:37.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/35' 2020-02-11T16:08:37.686 INFO:tasks.workunit.client.0.smithi088.stdout:removed './155/37' 2020-02-11T16:08:37.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './155' 2020-02-11T16:08:37.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/19' 2020-02-11T16:08:37.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/15' 2020-02-11T16:08:37.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/31' 2020-02-11T16:08:37.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/36' 2020-02-11T16:08:37.687 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/20' 2020-02-11T16:08:37.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/12' 2020-02-11T16:08:37.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/39' 2020-02-11T16:08:37.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/10' 2020-02-11T16:08:37.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/34' 2020-02-11T16:08:37.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/38' 2020-02-11T16:08:37.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/11' 2020-02-11T16:08:37.688 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/16' 2020-02-11T16:08:37.689 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/32' 2020-02-11T16:08:37.689 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/30' 2020-02-11T16:08:37.689 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/14' 2020-02-11T16:08:37.689 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/18' 2020-02-11T16:08:37.689 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/13' 2020-02-11T16:08:37.689 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/33' 2020-02-11T16:08:37.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/17' 2020-02-11T16:08:37.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/35' 2020-02-11T16:08:37.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './156/37' 2020-02-11T16:08:37.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './156' 2020-02-11T16:08:37.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/19' 2020-02-11T16:08:37.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/15' 2020-02-11T16:08:37.690 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/31' 2020-02-11T16:08:37.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/36' 2020-02-11T16:08:37.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/20' 2020-02-11T16:08:37.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/12' 2020-02-11T16:08:37.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/39' 2020-02-11T16:08:37.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/10' 2020-02-11T16:08:37.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/34' 2020-02-11T16:08:37.691 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/38' 2020-02-11T16:08:37.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/11' 2020-02-11T16:08:37.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/16' 2020-02-11T16:08:37.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/32' 2020-02-11T16:08:37.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/30' 2020-02-11T16:08:37.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/14' 2020-02-11T16:08:37.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/18' 2020-02-11T16:08:37.692 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/13' 2020-02-11T16:08:37.693 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/33' 2020-02-11T16:08:37.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.681+0000 7fbc21076700 1 -- 172.21.15.88:0/2954607777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbc1c0a2cf0 con 0x7fbc1c13b640 2020-02-11T16:08:37.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.681+0000 7fbc1b59e700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.681+0000 7fbc0bfff700 1 -- 172.21.15.88:0/2954607777 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fbc1c0a2cf0 con 0x7fbc1c13b640 2020-02-11T16:08:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 -- 172.21.15.88:0/2954607777 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbf8039ca0 msgr2=0x7fbbf803c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbf8039ca0 0x7fbbf803c160 crc :-1 s=READY pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 -- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 msgr2=0x7fbc1c134780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 0x7fbc1c134780 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fbc14001210 tx=0x7fbc14010ce0).stop 2020-02-11T16:08:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 -- 172.21.15.88:0/2954607777 shutdown_connections 2020-02-11T16:08:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbf8039ca0 0x7fbbf803c160 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc1c13b640 0x7fbc1c134780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 --2- 172.21.15.88:0/2954607777 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc1c0a6ff0 0x7fbc1c0a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 -- 172.21.15.88:0/2954607777 >> 172.21.15.88:0/2954607777 conn(0x7fbc1c0ac2d0 msgr2=0x7fbc1c05f000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 -- 172.21.15.88:0/2954607777 shutdown_connections 2020-02-11T16:08:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:37.683+0000 7fbc21076700 1 -- 172.21.15.88:0/2954607777 wait complete. 2020-02-11T16:08:37.697 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:37.698 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":38,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:38.348 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/17' 2020-02-11T16:08:38.349 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/35' 2020-02-11T16:08:38.349 INFO:tasks.workunit.client.0.smithi088.stdout:removed './157/37' 2020-02-11T16:08:38.349 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './157' 2020-02-11T16:08:38.349 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/19' 2020-02-11T16:08:38.349 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/15' 2020-02-11T16:08:38.349 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/31' 2020-02-11T16:08:38.349 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/36' 2020-02-11T16:08:38.350 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/20' 2020-02-11T16:08:38.350 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/12' 2020-02-11T16:08:38.350 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/39' 2020-02-11T16:08:38.350 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/10' 2020-02-11T16:08:38.350 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/34' 2020-02-11T16:08:38.350 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/38' 2020-02-11T16:08:38.350 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/11' 2020-02-11T16:08:38.351 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/16' 2020-02-11T16:08:38.351 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/32' 2020-02-11T16:08:38.351 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/30' 2020-02-11T16:08:38.351 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/14' 2020-02-11T16:08:38.351 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/18' 2020-02-11T16:08:38.351 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/13' 2020-02-11T16:08:38.352 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/33' 2020-02-11T16:08:38.352 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/17' 2020-02-11T16:08:38.352 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/35' 2020-02-11T16:08:38.352 INFO:tasks.workunit.client.0.smithi088.stdout:removed './158/37' 2020-02-11T16:08:38.352 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './158' 2020-02-11T16:08:38.352 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/19' 2020-02-11T16:08:38.352 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/15' 2020-02-11T16:08:38.353 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/31' 2020-02-11T16:08:38.353 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/36' 2020-02-11T16:08:38.353 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/20' 2020-02-11T16:08:38.353 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/12' 2020-02-11T16:08:38.353 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/39' 2020-02-11T16:08:38.354 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/10' 2020-02-11T16:08:38.354 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/34' 2020-02-11T16:08:38.354 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/38' 2020-02-11T16:08:38.354 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/11' 2020-02-11T16:08:38.354 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/16' 2020-02-11T16:08:38.355 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/32' 2020-02-11T16:08:38.355 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/30' 2020-02-11T16:08:38.355 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/14' 2020-02-11T16:08:38.355 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/18' 2020-02-11T16:08:38.355 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/13' 2020-02-11T16:08:38.355 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/33' 2020-02-11T16:08:38.356 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/17' 2020-02-11T16:08:38.356 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/35' 2020-02-11T16:08:38.356 INFO:tasks.workunit.client.0.smithi088.stdout:removed './159/37' 2020-02-11T16:08:38.356 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './159' 2020-02-11T16:08:38.356 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/19' 2020-02-11T16:08:38.356 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/15' 2020-02-11T16:08:38.357 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/31' 2020-02-11T16:08:38.357 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/36' 2020-02-11T16:08:38.357 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/20' 2020-02-11T16:08:38.357 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/12' 2020-02-11T16:08:38.357 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/39' 2020-02-11T16:08:38.357 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/10' 2020-02-11T16:08:38.358 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/34' 2020-02-11T16:08:38.358 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/38' 2020-02-11T16:08:38.358 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/11' 2020-02-11T16:08:38.358 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/16' 2020-02-11T16:08:38.359 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/32' 2020-02-11T16:08:38.359 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/30' 2020-02-11T16:08:38.359 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/14' 2020-02-11T16:08:38.359 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/18' 2020-02-11T16:08:38.359 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/13' 2020-02-11T16:08:38.359 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/33' 2020-02-11T16:08:38.359 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/17' 2020-02-11T16:08:38.360 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/35' 2020-02-11T16:08:38.360 INFO:tasks.workunit.client.0.smithi088.stdout:removed './160/37' 2020-02-11T16:08:38.360 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './160' 2020-02-11T16:08:38.360 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/19' 2020-02-11T16:08:38.360 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/15' 2020-02-11T16:08:38.360 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/31' 2020-02-11T16:08:38.360 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/36' 2020-02-11T16:08:38.361 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/20' 2020-02-11T16:08:38.361 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/12' 2020-02-11T16:08:38.361 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/39' 2020-02-11T16:08:38.361 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/10' 2020-02-11T16:08:38.361 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/34' 2020-02-11T16:08:38.361 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/38' 2020-02-11T16:08:38.363 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/11' 2020-02-11T16:08:38.363 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/16' 2020-02-11T16:08:38.363 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/32' 2020-02-11T16:08:38.364 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/30' 2020-02-11T16:08:38.364 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/14' 2020-02-11T16:08:38.365 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/18' 2020-02-11T16:08:38.365 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/13' 2020-02-11T16:08:38.365 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/33' 2020-02-11T16:08:38.365 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/17' 2020-02-11T16:08:38.365 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/35' 2020-02-11T16:08:38.365 INFO:tasks.workunit.client.0.smithi088.stdout:removed './161/37' 2020-02-11T16:08:38.366 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './161' 2020-02-11T16:08:38.366 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/19' 2020-02-11T16:08:38.366 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/15' 2020-02-11T16:08:38.366 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/31' 2020-02-11T16:08:38.366 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/36' 2020-02-11T16:08:38.366 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/20' 2020-02-11T16:08:38.366 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/12' 2020-02-11T16:08:38.367 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/39' 2020-02-11T16:08:38.367 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/10' 2020-02-11T16:08:38.367 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/34' 2020-02-11T16:08:38.368 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/38' 2020-02-11T16:08:38.368 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/11' 2020-02-11T16:08:38.368 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/16' 2020-02-11T16:08:38.368 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/32' 2020-02-11T16:08:38.368 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/30' 2020-02-11T16:08:38.368 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/14' 2020-02-11T16:08:38.369 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/18' 2020-02-11T16:08:38.369 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/13' 2020-02-11T16:08:38.369 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/33' 2020-02-11T16:08:38.370 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/17' 2020-02-11T16:08:38.370 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/35' 2020-02-11T16:08:38.370 INFO:tasks.workunit.client.0.smithi088.stdout:removed './162/37' 2020-02-11T16:08:38.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './162' 2020-02-11T16:08:38.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/19' 2020-02-11T16:08:38.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/15' 2020-02-11T16:08:38.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/31' 2020-02-11T16:08:38.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/36' 2020-02-11T16:08:38.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/20' 2020-02-11T16:08:38.371 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/12' 2020-02-11T16:08:38.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/39' 2020-02-11T16:08:38.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/10' 2020-02-11T16:08:38.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/34' 2020-02-11T16:08:38.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/38' 2020-02-11T16:08:38.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/11' 2020-02-11T16:08:38.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/16' 2020-02-11T16:08:38.372 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/32' 2020-02-11T16:08:38.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/30' 2020-02-11T16:08:38.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/14' 2020-02-11T16:08:38.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/18' 2020-02-11T16:08:38.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/13' 2020-02-11T16:08:38.373 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/33' 2020-02-11T16:08:38.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/17' 2020-02-11T16:08:38.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/35' 2020-02-11T16:08:38.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './163/37' 2020-02-11T16:08:38.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './163' 2020-02-11T16:08:38.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/19' 2020-02-11T16:08:38.374 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/15' 2020-02-11T16:08:38.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/31' 2020-02-11T16:08:38.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/36' 2020-02-11T16:08:38.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/20' 2020-02-11T16:08:38.375 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/12' 2020-02-11T16:08:38.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/39' 2020-02-11T16:08:38.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/10' 2020-02-11T16:08:38.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/34' 2020-02-11T16:08:38.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/38' 2020-02-11T16:08:38.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/11' 2020-02-11T16:08:38.376 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/16' 2020-02-11T16:08:38.377 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/32' 2020-02-11T16:08:38.377 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/30' 2020-02-11T16:08:38.377 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/14' 2020-02-11T16:08:38.377 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/18' 2020-02-11T16:08:38.377 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/13' 2020-02-11T16:08:38.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/33' 2020-02-11T16:08:38.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/17' 2020-02-11T16:08:38.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/35' 2020-02-11T16:08:38.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './164/37' 2020-02-11T16:08:38.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './164' 2020-02-11T16:08:38.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/19' 2020-02-11T16:08:38.378 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/15' 2020-02-11T16:08:38.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/31' 2020-02-11T16:08:38.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/36' 2020-02-11T16:08:38.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/20' 2020-02-11T16:08:38.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/12' 2020-02-11T16:08:38.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/39' 2020-02-11T16:08:38.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/10' 2020-02-11T16:08:38.379 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/34' 2020-02-11T16:08:38.380 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/38' 2020-02-11T16:08:38.380 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/11' 2020-02-11T16:08:38.380 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/16' 2020-02-11T16:08:38.380 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/32' 2020-02-11T16:08:38.380 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/30' 2020-02-11T16:08:38.380 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/14' 2020-02-11T16:08:38.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/18' 2020-02-11T16:08:38.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/13' 2020-02-11T16:08:38.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/33' 2020-02-11T16:08:38.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/17' 2020-02-11T16:08:38.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/35' 2020-02-11T16:08:38.381 INFO:tasks.workunit.client.0.smithi088.stdout:removed './165/37' 2020-02-11T16:08:38.382 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './165' 2020-02-11T16:08:38.382 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/19' 2020-02-11T16:08:38.382 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/15' 2020-02-11T16:08:38.382 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/31' 2020-02-11T16:08:38.382 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/36' 2020-02-11T16:08:38.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/20' 2020-02-11T16:08:38.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/12' 2020-02-11T16:08:38.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/39' 2020-02-11T16:08:38.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/10' 2020-02-11T16:08:38.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/34' 2020-02-11T16:08:38.383 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/38' 2020-02-11T16:08:38.384 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/11' 2020-02-11T16:08:38.384 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/16' 2020-02-11T16:08:38.384 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/32' 2020-02-11T16:08:38.384 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/30' 2020-02-11T16:08:38.384 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/14' 2020-02-11T16:08:38.384 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/18' 2020-02-11T16:08:38.385 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/13' 2020-02-11T16:08:38.385 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/33' 2020-02-11T16:08:38.385 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/17' 2020-02-11T16:08:38.386 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/35' 2020-02-11T16:08:38.386 INFO:tasks.workunit.client.0.smithi088.stdout:removed './166/37' 2020-02-11T16:08:38.386 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './166' 2020-02-11T16:08:38.386 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/19' 2020-02-11T16:08:38.386 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/15' 2020-02-11T16:08:38.386 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/31' 2020-02-11T16:08:38.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/36' 2020-02-11T16:08:38.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/20' 2020-02-11T16:08:38.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/12' 2020-02-11T16:08:38.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/39' 2020-02-11T16:08:38.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/10' 2020-02-11T16:08:38.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/34' 2020-02-11T16:08:38.387 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/38' 2020-02-11T16:08:38.937 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/11' 2020-02-11T16:08:38.937 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/16' 2020-02-11T16:08:38.937 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/32' 2020-02-11T16:08:38.937 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/30' 2020-02-11T16:08:38.937 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/14' 2020-02-11T16:08:38.937 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/18' 2020-02-11T16:08:38.937 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/13' 2020-02-11T16:08:38.938 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/33' 2020-02-11T16:08:38.938 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/17' 2020-02-11T16:08:38.938 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/35' 2020-02-11T16:08:38.938 INFO:tasks.workunit.client.0.smithi088.stdout:removed './167/37' 2020-02-11T16:08:38.938 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './167' 2020-02-11T16:08:38.938 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/19' 2020-02-11T16:08:38.938 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/15' 2020-02-11T16:08:38.939 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/31' 2020-02-11T16:08:38.939 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/36' 2020-02-11T16:08:38.939 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/20' 2020-02-11T16:08:38.939 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/12' 2020-02-11T16:08:38.939 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/39' 2020-02-11T16:08:38.939 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/10' 2020-02-11T16:08:38.939 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/34' 2020-02-11T16:08:38.940 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/38' 2020-02-11T16:08:38.940 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/11' 2020-02-11T16:08:38.940 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/16' 2020-02-11T16:08:38.940 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/32' 2020-02-11T16:08:38.940 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/30' 2020-02-11T16:08:38.941 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/14' 2020-02-11T16:08:38.941 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/18' 2020-02-11T16:08:38.941 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/13' 2020-02-11T16:08:38.941 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/33' 2020-02-11T16:08:38.941 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/17' 2020-02-11T16:08:38.941 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/35' 2020-02-11T16:08:38.941 INFO:tasks.workunit.client.0.smithi088.stdout:removed './168/37' 2020-02-11T16:08:38.942 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './168' 2020-02-11T16:08:38.942 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/19' 2020-02-11T16:08:38.942 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/15' 2020-02-11T16:08:38.942 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/31' 2020-02-11T16:08:38.942 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/36' 2020-02-11T16:08:38.942 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/20' 2020-02-11T16:08:38.942 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/12' 2020-02-11T16:08:38.943 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/39' 2020-02-11T16:08:38.943 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/10' 2020-02-11T16:08:38.943 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/34' 2020-02-11T16:08:38.943 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/38' 2020-02-11T16:08:38.943 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/11' 2020-02-11T16:08:38.943 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/16' 2020-02-11T16:08:38.943 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/32' 2020-02-11T16:08:38.943 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/30' 2020-02-11T16:08:38.944 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/14' 2020-02-11T16:08:38.944 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/18' 2020-02-11T16:08:38.944 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/13' 2020-02-11T16:08:38.944 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/33' 2020-02-11T16:08:38.944 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/17' 2020-02-11T16:08:38.944 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/35' 2020-02-11T16:08:38.944 INFO:tasks.workunit.client.0.smithi088.stdout:removed './169/37' 2020-02-11T16:08:38.945 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './169' 2020-02-11T16:08:38.945 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/19' 2020-02-11T16:08:38.945 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/15' 2020-02-11T16:08:38.945 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/31' 2020-02-11T16:08:38.945 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/36' 2020-02-11T16:08:38.945 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/20' 2020-02-11T16:08:38.945 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/12' 2020-02-11T16:08:38.945 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/39' 2020-02-11T16:08:38.946 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/10' 2020-02-11T16:08:38.946 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/34' 2020-02-11T16:08:38.946 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/38' 2020-02-11T16:08:38.946 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/11' 2020-02-11T16:08:38.946 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/16' 2020-02-11T16:08:38.946 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/32' 2020-02-11T16:08:38.946 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/30' 2020-02-11T16:08:38.947 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/14' 2020-02-11T16:08:38.947 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/18' 2020-02-11T16:08:38.947 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/13' 2020-02-11T16:08:38.947 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/33' 2020-02-11T16:08:38.947 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/17' 2020-02-11T16:08:38.947 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/35' 2020-02-11T16:08:38.947 INFO:tasks.workunit.client.0.smithi088.stdout:removed './170/37' 2020-02-11T16:08:38.947 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './170' 2020-02-11T16:08:38.948 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/19' 2020-02-11T16:08:38.948 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/15' 2020-02-11T16:08:38.948 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/31' 2020-02-11T16:08:38.948 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/36' 2020-02-11T16:08:38.948 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/20' 2020-02-11T16:08:38.948 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/12' 2020-02-11T16:08:38.948 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/39' 2020-02-11T16:08:38.949 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/10' 2020-02-11T16:08:38.949 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/34' 2020-02-11T16:08:38.949 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/38' 2020-02-11T16:08:38.949 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/11' 2020-02-11T16:08:38.949 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/16' 2020-02-11T16:08:38.949 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/32' 2020-02-11T16:08:38.949 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/30' 2020-02-11T16:08:38.950 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/14' 2020-02-11T16:08:38.950 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/18' 2020-02-11T16:08:38.950 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/13' 2020-02-11T16:08:38.950 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/33' 2020-02-11T16:08:38.950 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/17' 2020-02-11T16:08:38.951 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/35' 2020-02-11T16:08:38.951 INFO:tasks.workunit.client.0.smithi088.stdout:removed './171/37' 2020-02-11T16:08:38.952 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './171' 2020-02-11T16:08:38.953 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/19' 2020-02-11T16:08:38.953 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/15' 2020-02-11T16:08:38.953 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/31' 2020-02-11T16:08:38.953 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/36' 2020-02-11T16:08:38.953 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/20' 2020-02-11T16:08:38.953 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/12' 2020-02-11T16:08:38.953 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/39' 2020-02-11T16:08:38.954 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/10' 2020-02-11T16:08:38.954 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/34' 2020-02-11T16:08:38.954 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/38' 2020-02-11T16:08:38.954 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/11' 2020-02-11T16:08:38.954 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/16' 2020-02-11T16:08:38.954 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/32' 2020-02-11T16:08:38.954 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/30' 2020-02-11T16:08:38.954 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/14' 2020-02-11T16:08:38.955 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/18' 2020-02-11T16:08:38.955 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/13' 2020-02-11T16:08:38.955 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/33' 2020-02-11T16:08:38.955 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/17' 2020-02-11T16:08:38.955 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/35' 2020-02-11T16:08:38.955 INFO:tasks.workunit.client.0.smithi088.stdout:removed './172/37' 2020-02-11T16:08:38.955 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './172' 2020-02-11T16:08:38.956 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/19' 2020-02-11T16:08:38.956 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/15' 2020-02-11T16:08:38.956 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/31' 2020-02-11T16:08:38.956 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/36' 2020-02-11T16:08:38.956 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/20' 2020-02-11T16:08:38.956 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/12' 2020-02-11T16:08:38.956 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/39' 2020-02-11T16:08:38.956 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/10' 2020-02-11T16:08:38.957 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/34' 2020-02-11T16:08:38.957 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/38' 2020-02-11T16:08:38.957 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/11' 2020-02-11T16:08:38.957 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/16' 2020-02-11T16:08:38.957 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/32' 2020-02-11T16:08:38.957 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/30' 2020-02-11T16:08:38.957 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/14' 2020-02-11T16:08:38.958 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/18' 2020-02-11T16:08:38.958 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/13' 2020-02-11T16:08:38.958 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/33' 2020-02-11T16:08:38.958 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/17' 2020-02-11T16:08:38.958 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/35' 2020-02-11T16:08:38.958 INFO:tasks.workunit.client.0.smithi088.stdout:removed './173/37' 2020-02-11T16:08:38.958 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './173' 2020-02-11T16:08:38.959 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/19' 2020-02-11T16:08:38.959 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/15' 2020-02-11T16:08:38.959 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/31' 2020-02-11T16:08:38.959 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/36' 2020-02-11T16:08:38.959 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/20' 2020-02-11T16:08:38.959 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/12' 2020-02-11T16:08:38.959 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/39' 2020-02-11T16:08:38.959 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/10' 2020-02-11T16:08:38.960 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/34' 2020-02-11T16:08:38.960 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/38' 2020-02-11T16:08:38.960 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/11' 2020-02-11T16:08:38.960 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/16' 2020-02-11T16:08:38.960 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/32' 2020-02-11T16:08:38.960 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/30' 2020-02-11T16:08:38.960 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/14' 2020-02-11T16:08:38.961 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/18' 2020-02-11T16:08:38.961 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/13' 2020-02-11T16:08:38.961 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/33' 2020-02-11T16:08:38.961 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/17' 2020-02-11T16:08:38.962 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/35' 2020-02-11T16:08:38.962 INFO:tasks.workunit.client.0.smithi088.stdout:removed './174/37' 2020-02-11T16:08:38.962 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './174' 2020-02-11T16:08:38.962 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/19' 2020-02-11T16:08:38.962 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/15' 2020-02-11T16:08:38.962 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/31' 2020-02-11T16:08:38.963 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/36' 2020-02-11T16:08:38.963 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/20' 2020-02-11T16:08:38.963 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/12' 2020-02-11T16:08:38.963 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/39' 2020-02-11T16:08:38.963 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/10' 2020-02-11T16:08:38.963 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/34' 2020-02-11T16:08:38.963 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/38' 2020-02-11T16:08:38.963 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/11' 2020-02-11T16:08:38.964 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/16' 2020-02-11T16:08:38.964 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/32' 2020-02-11T16:08:38.964 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/30' 2020-02-11T16:08:38.964 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/14' 2020-02-11T16:08:38.964 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/18' 2020-02-11T16:08:38.964 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/13' 2020-02-11T16:08:38.964 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/33' 2020-02-11T16:08:38.965 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/17' 2020-02-11T16:08:38.965 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/35' 2020-02-11T16:08:38.965 INFO:tasks.workunit.client.0.smithi088.stdout:removed './175/37' 2020-02-11T16:08:38.965 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './175' 2020-02-11T16:08:38.965 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/19' 2020-02-11T16:08:38.965 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/15' 2020-02-11T16:08:38.965 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/31' 2020-02-11T16:08:38.965 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/36' 2020-02-11T16:08:38.966 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/20' 2020-02-11T16:08:38.966 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/12' 2020-02-11T16:08:38.966 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/39' 2020-02-11T16:08:38.966 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/10' 2020-02-11T16:08:38.966 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/34' 2020-02-11T16:08:38.966 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/38' 2020-02-11T16:08:38.966 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/11' 2020-02-11T16:08:38.967 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/16' 2020-02-11T16:08:38.967 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/32' 2020-02-11T16:08:38.967 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/30' 2020-02-11T16:08:38.967 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/14' 2020-02-11T16:08:38.967 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/18' 2020-02-11T16:08:38.967 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/13' 2020-02-11T16:08:38.968 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/33' 2020-02-11T16:08:38.968 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/17' 2020-02-11T16:08:38.968 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/35' 2020-02-11T16:08:38.968 INFO:tasks.workunit.client.0.smithi088.stdout:removed './176/37' 2020-02-11T16:08:38.968 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './176' 2020-02-11T16:08:38.968 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/19' 2020-02-11T16:08:38.969 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/15' 2020-02-11T16:08:39.626 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/31' 2020-02-11T16:08:39.626 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/36' 2020-02-11T16:08:39.626 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/20' 2020-02-11T16:08:39.626 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/12' 2020-02-11T16:08:39.626 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/39' 2020-02-11T16:08:39.627 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/10' 2020-02-11T16:08:39.627 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/34' 2020-02-11T16:08:39.627 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/38' 2020-02-11T16:08:39.627 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/11' 2020-02-11T16:08:39.627 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/16' 2020-02-11T16:08:39.627 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/32' 2020-02-11T16:08:39.627 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/30' 2020-02-11T16:08:39.628 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/14' 2020-02-11T16:08:39.628 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/18' 2020-02-11T16:08:39.628 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/13' 2020-02-11T16:08:39.628 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/33' 2020-02-11T16:08:39.628 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/17' 2020-02-11T16:08:39.628 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/35' 2020-02-11T16:08:39.628 INFO:tasks.workunit.client.0.smithi088.stdout:removed './177/37' 2020-02-11T16:08:39.628 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './177' 2020-02-11T16:08:39.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/19' 2020-02-11T16:08:39.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/15' 2020-02-11T16:08:39.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/31' 2020-02-11T16:08:39.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/36' 2020-02-11T16:08:39.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/20' 2020-02-11T16:08:39.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/12' 2020-02-11T16:08:39.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/39' 2020-02-11T16:08:39.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/10' 2020-02-11T16:08:39.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/34' 2020-02-11T16:08:39.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/38' 2020-02-11T16:08:39.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/11' 2020-02-11T16:08:39.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/16' 2020-02-11T16:08:39.631 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/32' 2020-02-11T16:08:39.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/30' 2020-02-11T16:08:39.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/14' 2020-02-11T16:08:39.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/18' 2020-02-11T16:08:39.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/13' 2020-02-11T16:08:39.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/33' 2020-02-11T16:08:39.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/17' 2020-02-11T16:08:39.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/35' 2020-02-11T16:08:39.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed './178/37' 2020-02-11T16:08:39.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './178' 2020-02-11T16:08:39.635 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/19' 2020-02-11T16:08:39.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/15' 2020-02-11T16:08:39.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/31' 2020-02-11T16:08:39.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/36' 2020-02-11T16:08:39.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/20' 2020-02-11T16:08:39.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/12' 2020-02-11T16:08:39.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/39' 2020-02-11T16:08:39.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/10' 2020-02-11T16:08:39.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/34' 2020-02-11T16:08:39.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/38' 2020-02-11T16:08:39.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/11' 2020-02-11T16:08:39.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/16' 2020-02-11T16:08:39.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/32' 2020-02-11T16:08:39.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/30' 2020-02-11T16:08:39.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/14' 2020-02-11T16:08:39.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/18' 2020-02-11T16:08:39.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/13' 2020-02-11T16:08:39.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/33' 2020-02-11T16:08:39.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/17' 2020-02-11T16:08:39.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/35' 2020-02-11T16:08:39.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './179/37' 2020-02-11T16:08:39.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './179' 2020-02-11T16:08:39.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/19' 2020-02-11T16:08:39.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/15' 2020-02-11T16:08:39.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/31' 2020-02-11T16:08:39.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/36' 2020-02-11T16:08:39.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/20' 2020-02-11T16:08:39.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/12' 2020-02-11T16:08:39.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/39' 2020-02-11T16:08:39.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/10' 2020-02-11T16:08:39.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/34' 2020-02-11T16:08:39.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/38' 2020-02-11T16:08:39.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/11' 2020-02-11T16:08:39.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/16' 2020-02-11T16:08:39.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/32' 2020-02-11T16:08:39.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/30' 2020-02-11T16:08:39.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/14' 2020-02-11T16:08:39.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/18' 2020-02-11T16:08:39.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/13' 2020-02-11T16:08:39.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/33' 2020-02-11T16:08:39.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/17' 2020-02-11T16:08:39.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/35' 2020-02-11T16:08:39.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './180/37' 2020-02-11T16:08:39.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './180' 2020-02-11T16:08:39.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/19' 2020-02-11T16:08:39.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/15' 2020-02-11T16:08:39.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/31' 2020-02-11T16:08:39.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/36' 2020-02-11T16:08:39.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/20' 2020-02-11T16:08:39.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/12' 2020-02-11T16:08:39.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/39' 2020-02-11T16:08:39.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/10' 2020-02-11T16:08:39.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/34' 2020-02-11T16:08:39.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/38' 2020-02-11T16:08:39.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/11' 2020-02-11T16:08:39.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/16' 2020-02-11T16:08:39.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/32' 2020-02-11T16:08:39.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/30' 2020-02-11T16:08:39.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/14' 2020-02-11T16:08:39.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/18' 2020-02-11T16:08:39.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/13' 2020-02-11T16:08:39.646 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/33' 2020-02-11T16:08:39.646 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/17' 2020-02-11T16:08:39.646 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/35' 2020-02-11T16:08:39.646 INFO:tasks.workunit.client.0.smithi088.stdout:removed './181/37' 2020-02-11T16:08:39.646 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './181' 2020-02-11T16:08:39.646 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/19' 2020-02-11T16:08:39.646 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/15' 2020-02-11T16:08:39.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/31' 2020-02-11T16:08:39.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/36' 2020-02-11T16:08:39.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/20' 2020-02-11T16:08:39.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/12' 2020-02-11T16:08:39.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/39' 2020-02-11T16:08:39.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/10' 2020-02-11T16:08:39.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/34' 2020-02-11T16:08:39.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/38' 2020-02-11T16:08:39.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/11' 2020-02-11T16:08:39.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/16' 2020-02-11T16:08:39.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/32' 2020-02-11T16:08:39.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/30' 2020-02-11T16:08:39.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/14' 2020-02-11T16:08:39.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/18' 2020-02-11T16:08:39.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/13' 2020-02-11T16:08:39.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/33' 2020-02-11T16:08:39.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/17' 2020-02-11T16:08:39.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/35' 2020-02-11T16:08:39.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './182/37' 2020-02-11T16:08:39.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './182' 2020-02-11T16:08:39.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/19' 2020-02-11T16:08:39.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/15' 2020-02-11T16:08:39.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/31' 2020-02-11T16:08:39.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/36' 2020-02-11T16:08:39.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/20' 2020-02-11T16:08:39.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/12' 2020-02-11T16:08:39.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/39' 2020-02-11T16:08:39.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/10' 2020-02-11T16:08:39.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/34' 2020-02-11T16:08:39.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/38' 2020-02-11T16:08:39.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/11' 2020-02-11T16:08:39.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/16' 2020-02-11T16:08:39.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/32' 2020-02-11T16:08:39.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/30' 2020-02-11T16:08:39.652 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/14' 2020-02-11T16:08:39.652 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/18' 2020-02-11T16:08:39.652 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/13' 2020-02-11T16:08:39.652 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/33' 2020-02-11T16:08:39.652 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/17' 2020-02-11T16:08:39.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/35' 2020-02-11T16:08:39.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed './183/37' 2020-02-11T16:08:39.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './183' 2020-02-11T16:08:39.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/19' 2020-02-11T16:08:39.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/15' 2020-02-11T16:08:39.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/31' 2020-02-11T16:08:39.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/36' 2020-02-11T16:08:39.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/20' 2020-02-11T16:08:39.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/12' 2020-02-11T16:08:39.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/39' 2020-02-11T16:08:39.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/10' 2020-02-11T16:08:39.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/34' 2020-02-11T16:08:39.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/38' 2020-02-11T16:08:39.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/11' 2020-02-11T16:08:39.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/16' 2020-02-11T16:08:39.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/32' 2020-02-11T16:08:39.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/30' 2020-02-11T16:08:39.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/14' 2020-02-11T16:08:39.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/18' 2020-02-11T16:08:39.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/13' 2020-02-11T16:08:39.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/33' 2020-02-11T16:08:39.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/17' 2020-02-11T16:08:39.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/35' 2020-02-11T16:08:39.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './184/37' 2020-02-11T16:08:39.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './184' 2020-02-11T16:08:39.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/19' 2020-02-11T16:08:39.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/15' 2020-02-11T16:08:39.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/31' 2020-02-11T16:08:39.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/36' 2020-02-11T16:08:39.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/20' 2020-02-11T16:08:39.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/12' 2020-02-11T16:08:39.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/39' 2020-02-11T16:08:39.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/10' 2020-02-11T16:08:39.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/34' 2020-02-11T16:08:39.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/38' 2020-02-11T16:08:39.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/11' 2020-02-11T16:08:39.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/16' 2020-02-11T16:08:39.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/32' 2020-02-11T16:08:39.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/30' 2020-02-11T16:08:39.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/14' 2020-02-11T16:08:39.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/18' 2020-02-11T16:08:39.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/13' 2020-02-11T16:08:39.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/33' 2020-02-11T16:08:39.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/17' 2020-02-11T16:08:39.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/35' 2020-02-11T16:08:39.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './185/37' 2020-02-11T16:08:39.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './185' 2020-02-11T16:08:39.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/19' 2020-02-11T16:08:39.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/15' 2020-02-11T16:08:39.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/31' 2020-02-11T16:08:39.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/36' 2020-02-11T16:08:39.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/20' 2020-02-11T16:08:39.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/12' 2020-02-11T16:08:39.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/39' 2020-02-11T16:08:39.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/10' 2020-02-11T16:08:39.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/34' 2020-02-11T16:08:39.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/38' 2020-02-11T16:08:39.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/11' 2020-02-11T16:08:39.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/16' 2020-02-11T16:08:39.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/32' 2020-02-11T16:08:39.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/30' 2020-02-11T16:08:39.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/14' 2020-02-11T16:08:39.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/18' 2020-02-11T16:08:40.236 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/13' 2020-02-11T16:08:40.236 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/33' 2020-02-11T16:08:40.236 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/17' 2020-02-11T16:08:40.236 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/35' 2020-02-11T16:08:40.236 INFO:tasks.workunit.client.0.smithi088.stdout:removed './186/37' 2020-02-11T16:08:40.237 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './186' 2020-02-11T16:08:40.237 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/19' 2020-02-11T16:08:40.237 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/15' 2020-02-11T16:08:40.237 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/31' 2020-02-11T16:08:40.237 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/36' 2020-02-11T16:08:40.237 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/20' 2020-02-11T16:08:40.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/12' 2020-02-11T16:08:40.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/39' 2020-02-11T16:08:40.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/10' 2020-02-11T16:08:40.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/34' 2020-02-11T16:08:40.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/38' 2020-02-11T16:08:40.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/11' 2020-02-11T16:08:40.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/16' 2020-02-11T16:08:40.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/32' 2020-02-11T16:08:40.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/30' 2020-02-11T16:08:40.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/14' 2020-02-11T16:08:40.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/18' 2020-02-11T16:08:40.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/13' 2020-02-11T16:08:40.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/33' 2020-02-11T16:08:40.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/17' 2020-02-11T16:08:40.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/35' 2020-02-11T16:08:40.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './187/37' 2020-02-11T16:08:40.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './187' 2020-02-11T16:08:40.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/19' 2020-02-11T16:08:40.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/15' 2020-02-11T16:08:40.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/31' 2020-02-11T16:08:40.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/36' 2020-02-11T16:08:40.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/20' 2020-02-11T16:08:40.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/12' 2020-02-11T16:08:40.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/39' 2020-02-11T16:08:40.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/10' 2020-02-11T16:08:40.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/34' 2020-02-11T16:08:40.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/38' 2020-02-11T16:08:40.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/11' 2020-02-11T16:08:40.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/16' 2020-02-11T16:08:40.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/32' 2020-02-11T16:08:40.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/30' 2020-02-11T16:08:40.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/14' 2020-02-11T16:08:40.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/18' 2020-02-11T16:08:40.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/13' 2020-02-11T16:08:40.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/33' 2020-02-11T16:08:40.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/17' 2020-02-11T16:08:40.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/35' 2020-02-11T16:08:40.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './188/37' 2020-02-11T16:08:40.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './188' 2020-02-11T16:08:40.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/19' 2020-02-11T16:08:40.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/15' 2020-02-11T16:08:40.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/31' 2020-02-11T16:08:40.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/36' 2020-02-11T16:08:40.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/20' 2020-02-11T16:08:40.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/12' 2020-02-11T16:08:40.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/39' 2020-02-11T16:08:40.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/10' 2020-02-11T16:08:40.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/34' 2020-02-11T16:08:40.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/38' 2020-02-11T16:08:40.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/11' 2020-02-11T16:08:40.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/16' 2020-02-11T16:08:40.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/32' 2020-02-11T16:08:40.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/30' 2020-02-11T16:08:40.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/14' 2020-02-11T16:08:40.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/18' 2020-02-11T16:08:40.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/13' 2020-02-11T16:08:40.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/33' 2020-02-11T16:08:40.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/17' 2020-02-11T16:08:40.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/35' 2020-02-11T16:08:40.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './189/37' 2020-02-11T16:08:40.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './189' 2020-02-11T16:08:40.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/19' 2020-02-11T16:08:40.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/15' 2020-02-11T16:08:40.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/31' 2020-02-11T16:08:40.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/36' 2020-02-11T16:08:40.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/20' 2020-02-11T16:08:40.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/12' 2020-02-11T16:08:40.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/39' 2020-02-11T16:08:40.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/10' 2020-02-11T16:08:40.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/34' 2020-02-11T16:08:40.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/38' 2020-02-11T16:08:40.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/11' 2020-02-11T16:08:40.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/16' 2020-02-11T16:08:40.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/32' 2020-02-11T16:08:40.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/30' 2020-02-11T16:08:40.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/14' 2020-02-11T16:08:40.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/18' 2020-02-11T16:08:40.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/13' 2020-02-11T16:08:40.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/33' 2020-02-11T16:08:40.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/17' 2020-02-11T16:08:40.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/35' 2020-02-11T16:08:40.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './190/37' 2020-02-11T16:08:40.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './190' 2020-02-11T16:08:40.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/19' 2020-02-11T16:08:40.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/15' 2020-02-11T16:08:40.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/31' 2020-02-11T16:08:40.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/36' 2020-02-11T16:08:40.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/20' 2020-02-11T16:08:40.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/12' 2020-02-11T16:08:40.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/39' 2020-02-11T16:08:40.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/10' 2020-02-11T16:08:40.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/34' 2020-02-11T16:08:40.251 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/38' 2020-02-11T16:08:40.251 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/11' 2020-02-11T16:08:40.251 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/16' 2020-02-11T16:08:40.251 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/32' 2020-02-11T16:08:40.251 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/30' 2020-02-11T16:08:40.251 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/14' 2020-02-11T16:08:40.251 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/18' 2020-02-11T16:08:40.251 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/13' 2020-02-11T16:08:40.252 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/33' 2020-02-11T16:08:40.252 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/17' 2020-02-11T16:08:40.252 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/35' 2020-02-11T16:08:40.252 INFO:tasks.workunit.client.0.smithi088.stdout:removed './191/37' 2020-02-11T16:08:40.252 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './191' 2020-02-11T16:08:40.252 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/19' 2020-02-11T16:08:40.252 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/15' 2020-02-11T16:08:40.253 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/31' 2020-02-11T16:08:40.253 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/36' 2020-02-11T16:08:40.253 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/20' 2020-02-11T16:08:40.253 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/12' 2020-02-11T16:08:40.253 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/39' 2020-02-11T16:08:40.253 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/10' 2020-02-11T16:08:40.253 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/34' 2020-02-11T16:08:40.253 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/38' 2020-02-11T16:08:40.254 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/11' 2020-02-11T16:08:40.254 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/16' 2020-02-11T16:08:40.254 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/32' 2020-02-11T16:08:40.254 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/30' 2020-02-11T16:08:40.254 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/14' 2020-02-11T16:08:40.254 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/18' 2020-02-11T16:08:40.254 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/13' 2020-02-11T16:08:40.255 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/33' 2020-02-11T16:08:40.255 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/17' 2020-02-11T16:08:40.255 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/35' 2020-02-11T16:08:40.255 INFO:tasks.workunit.client.0.smithi088.stdout:removed './192/37' 2020-02-11T16:08:40.255 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './192' 2020-02-11T16:08:40.255 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/19' 2020-02-11T16:08:40.255 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/15' 2020-02-11T16:08:40.256 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/31' 2020-02-11T16:08:40.256 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/36' 2020-02-11T16:08:40.256 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/20' 2020-02-11T16:08:40.256 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/12' 2020-02-11T16:08:40.256 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/39' 2020-02-11T16:08:40.256 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/10' 2020-02-11T16:08:40.256 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/34' 2020-02-11T16:08:40.256 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/38' 2020-02-11T16:08:40.257 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/11' 2020-02-11T16:08:40.257 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/16' 2020-02-11T16:08:40.257 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/32' 2020-02-11T16:08:40.257 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/30' 2020-02-11T16:08:40.257 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/14' 2020-02-11T16:08:40.257 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/18' 2020-02-11T16:08:40.257 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/13' 2020-02-11T16:08:40.258 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/33' 2020-02-11T16:08:40.258 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/17' 2020-02-11T16:08:40.258 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/35' 2020-02-11T16:08:40.258 INFO:tasks.workunit.client.0.smithi088.stdout:removed './193/37' 2020-02-11T16:08:40.258 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './193' 2020-02-11T16:08:40.258 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/19' 2020-02-11T16:08:40.258 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/15' 2020-02-11T16:08:40.258 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/31' 2020-02-11T16:08:40.259 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/36' 2020-02-11T16:08:40.259 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/20' 2020-02-11T16:08:40.259 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/12' 2020-02-11T16:08:40.259 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/39' 2020-02-11T16:08:40.259 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/10' 2020-02-11T16:08:40.259 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/34' 2020-02-11T16:08:40.259 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/38' 2020-02-11T16:08:40.260 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/11' 2020-02-11T16:08:40.260 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/16' 2020-02-11T16:08:40.260 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/32' 2020-02-11T16:08:40.260 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/30' 2020-02-11T16:08:40.260 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/14' 2020-02-11T16:08:40.261 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/18' 2020-02-11T16:08:40.261 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/13' 2020-02-11T16:08:40.261 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/33' 2020-02-11T16:08:40.261 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/17' 2020-02-11T16:08:40.261 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/35' 2020-02-11T16:08:40.261 INFO:tasks.workunit.client.0.smithi088.stdout:removed './194/37' 2020-02-11T16:08:40.261 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './194' 2020-02-11T16:08:40.262 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/19' 2020-02-11T16:08:40.262 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/15' 2020-02-11T16:08:40.262 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/31' 2020-02-11T16:08:40.262 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/36' 2020-02-11T16:08:40.262 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/20' 2020-02-11T16:08:40.262 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/12' 2020-02-11T16:08:40.262 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/39' 2020-02-11T16:08:40.262 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/10' 2020-02-11T16:08:40.263 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/34' 2020-02-11T16:08:40.263 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/38' 2020-02-11T16:08:40.263 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/11' 2020-02-11T16:08:40.263 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/16' 2020-02-11T16:08:40.263 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/32' 2020-02-11T16:08:40.263 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/30' 2020-02-11T16:08:40.263 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/14' 2020-02-11T16:08:40.264 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/18' 2020-02-11T16:08:40.264 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/13' 2020-02-11T16:08:40.264 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/33' 2020-02-11T16:08:40.264 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/17' 2020-02-11T16:08:40.264 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/35' 2020-02-11T16:08:40.264 INFO:tasks.workunit.client.0.smithi088.stdout:removed './195/37' 2020-02-11T16:08:40.264 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './195' 2020-02-11T16:08:40.264 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/19' 2020-02-11T16:08:40.265 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/15' 2020-02-11T16:08:40.265 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/31' 2020-02-11T16:08:40.265 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/36' 2020-02-11T16:08:40.265 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/20' 2020-02-11T16:08:40.265 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/12' 2020-02-11T16:08:40.265 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/39' 2020-02-11T16:08:40.265 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/10' 2020-02-11T16:08:40.698 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:08:40.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.823+0000 7f1627093700 1 Processor -- start 2020-02-11T16:08:40.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.823+0000 7f1627093700 1 -- start start 2020-02-11T16:08:40.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1627093700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f16200a1bb0 0x7f1620138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:40.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1627093700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16200a4960 con 0x7f16201384d0 2020-02-11T16:08:40.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1627093700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16200a3ca0 con 0x7f162005a950 2020-02-11T16:08:40.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1627093700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16200a2d10 con 0x7f16200a1bb0 2020-02-11T16:08:40.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1626091700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f162005a950 0x7f16200a6710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41068/0 (socket says 172.21.15.88:41068) 2020-02-11T16:08:40.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1626091700 1 -- 172.21.15.88:0/1832628860 learned_addr learned my addr 172.21.15.88:0/1832628860 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:40.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1625890700 1 --2- 172.21.15.88:0/1832628860 >> v2:172.21.15.52:3300/0 conn(0x7f16200a1bb0 0x7f1620138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:40.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1625890700 1 -- 172.21.15.88:0/1832628860 >> v1:172.21.15.88:6789/0 conn(0x7f162005a950 legacy=0x7f16200a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:40.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1625890700 1 -- 172.21.15.88:0/1832628860 >> v1:172.21.15.52:6789/0 conn(0x7f16201384d0 legacy=0x7f1620138950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:40.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f162508f700 1 -- 172.21.15.88:0/1832628860 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899576954 0 0) 0x7f16200a4960 con 0x7f16201384d0 2020-02-11T16:08:40.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1625890700 1 -- 172.21.15.88:0/1832628860 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200a25d0 con 0x7f16200a1bb0 2020-02-11T16:08:40.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1625890700 1 --2- 172.21.15.88:0/1832628860 >> v2:172.21.15.52:3300/0 conn(0x7f16200a1bb0 0x7f1620138070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1610002f30 tx=0x7f16100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1625890700 1 --2- 172.21.15.88:0/1832628860 >> v2:172.21.15.52:3300/0 conn(0x7f16200a1bb0 0x7f1620138070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1610002f30 tx=0x7f16100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.825+0000 7f1625890700 1 --2- 172.21.15.88:0/1832628860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16200a1bb0 0x7f1620138070 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f16100088e0).ready entity=mon.0 client_cookie=c0c61a4218b6b34e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:40.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f1625890700 1 --2- 172.21.15.88:0/1832628860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16200a1bb0 0x7f1620138070 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f16100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f162508f700 1 -- 172.21.15.88:0/1832628860 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1610008e40 con 0x7f16200a1bb0 2020-02-11T16:08:40.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f1625890700 1 --2- 172.21.15.88:0/1832628860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16200a1bb0 0x7f1620138070 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f16100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f1625890700 1 --2- 172.21.15.88:0/1832628860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16200a1bb0 0x7f1620138070 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f16100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f162508f700 1 -- 172.21.15.88:0/1832628860 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100116a0 con 0x7f16200a1bb0 2020-02-11T16:08:40.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f162508f700 1 -- 172.21.15.88:0/1832628860 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1610011a80 con 0x7f16200a1bb0 2020-02-11T16:08:40.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f1627093700 1 -- 172.21.15.88:0/1832628860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16200a1bb0 msgr2=0x7f1620138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:40.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f1627093700 1 --2- 172.21.15.88:0/1832628860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16200a1bb0 0x7f1620138070 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f16100088e0).stop 2020-02-11T16:08:40.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f1627093700 1 -- 172.21.15.88:0/1832628860 shutdown_connections 2020-02-11T16:08:40.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f1627093700 1 --2- 172.21.15.88:0/1832628860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16200a1bb0 0x7f1620138070 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:40.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f1627093700 1 -- 172.21.15.88:0/1832628860 >> 172.21.15.88:0/1832628860 conn(0x7f16200aa840 msgr2=0x7f16200aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:40.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f1627093700 1 -- 172.21.15.88:0/1832628860 shutdown_connections 2020-02-11T16:08:40.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.826+0000 7f1627093700 1 -- 172.21.15.88:0/1832628860 wait complete. 2020-02-11T16:08:40.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.828+0000 7f1627093700 1 Processor -- start 2020-02-11T16:08:40.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.828+0000 7f1627093700 1 -- start start 2020-02-11T16:08:40.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1627093700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f162005a950 0x7f16200a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:40.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1627093700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f16200a1bb0 0x7f162009ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:40.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1627093700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1620061de0 con 0x7f16201384d0 2020-02-11T16:08:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1627093700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1620062040 con 0x7f162005a950 2020-02-11T16:08:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1627093700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16200622e0 con 0x7f16200a1bb0 2020-02-11T16:08:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f16200a1bb0 0x7f162009ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1626892700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f16201384d0 0x7f1620132400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41078/0 (socket says 172.21.15.88:41078) 2020-02-11T16:08:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1626091700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f162005a950 0x7f16200a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1626892700 1 -- 172.21.15.88:0/1531168303 learned_addr learned my addr 172.21.15.88:0/1531168303 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:40.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 -- 172.21.15.88:0/1531168303 >> v2:172.21.15.52:3300/0 conn(0x7f162005a950 msgr2=0x7f16200a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:40.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> v2:172.21.15.52:3300/0 conn(0x7f162005a950 0x7f16200a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:40.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 -- 172.21.15.88:0/1531168303 >> v1:172.21.15.88:6789/0 conn(0x7f16201384d0 legacy=0x7f1620132400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:40.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 -- 172.21.15.88:0/1531168303 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162009e430 con 0x7f16200a1bb0 2020-02-11T16:08:40.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> v2:172.21.15.88:3300/0 conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> v2:172.21.15.88:3300/0 conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f160f7fe700 1 -- 172.21.15.88:0/1531168303 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1610007150 con 0x7f16200a1bb0 2020-02-11T16:08:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f160f7fe700 1 -- 172.21.15.88:0/1531168303 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100072b0 con 0x7f16200a1bb0 2020-02-11T16:08:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f1627093700 1 -- 172.21.15.88:0/1531168303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16200a06c0 con 0x7f16200a1bb0 2020-02-11T16:08:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.829+0000 7f160f7fe700 1 -- 172.21.15.88:0/1531168303 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16100056c0 con 0x7f16200a1bb0 2020-02-11T16:08:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.830+0000 7f1627093700 1 -- 172.21.15.88:0/1531168303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162009db50 con 0x7f16200a1bb0 2020-02-11T16:08:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.830+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.830+0000 7f160f7fe700 1 -- 172.21.15.88:0/1531168303 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f1610005930 con 0x7f16200a1bb0 2020-02-11T16:08:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.830+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.830+0000 7f160f7fe700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1600039c10 0x7f160003c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:40.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.831+0000 7f160f7fe700 1 -- 172.21.15.88:0/1531168303 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f161004a100 con 0x7f16200a1bb0 2020-02-11T16:08:40.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.831+0000 7f1626091700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1600039c10 0x7f160003c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:40.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.831+0000 7f1626091700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1600039c10 0x7f160003c0d0 crc :-1 s=READY pgs=159 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:40.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.832+0000 7f1627093700 1 -- 172.21.15.88:0/1531168303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1620132e90 con 0x7f16200a1bb0 2020-02-11T16:08:40.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.835+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:40.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:40.835+0000 7f160f7fe700 1 -- 172.21.15.88:0/1531168303 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f161002f800 con 0x7f16200a1bb0 2020-02-11T16:08:40.870 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/34' 2020-02-11T16:08:40.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/38' 2020-02-11T16:08:40.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/11' 2020-02-11T16:08:40.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/16' 2020-02-11T16:08:40.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/32' 2020-02-11T16:08:40.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/30' 2020-02-11T16:08:40.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/14' 2020-02-11T16:08:40.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/18' 2020-02-11T16:08:40.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/13' 2020-02-11T16:08:40.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/33' 2020-02-11T16:08:40.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/17' 2020-02-11T16:08:40.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/35' 2020-02-11T16:08:40.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed './196/37' 2020-02-11T16:08:40.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './196' 2020-02-11T16:08:40.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/19' 2020-02-11T16:08:40.873 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/15' 2020-02-11T16:08:40.873 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/31' 2020-02-11T16:08:40.873 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/36' 2020-02-11T16:08:40.873 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/20' 2020-02-11T16:08:40.873 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/12' 2020-02-11T16:08:40.874 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/39' 2020-02-11T16:08:40.874 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/10' 2020-02-11T16:08:40.874 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/34' 2020-02-11T16:08:40.874 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/38' 2020-02-11T16:08:40.874 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/11' 2020-02-11T16:08:40.874 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/16' 2020-02-11T16:08:40.874 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/32' 2020-02-11T16:08:40.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/30' 2020-02-11T16:08:40.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/14' 2020-02-11T16:08:40.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/18' 2020-02-11T16:08:40.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/13' 2020-02-11T16:08:40.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/33' 2020-02-11T16:08:40.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/17' 2020-02-11T16:08:40.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/35' 2020-02-11T16:08:40.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './197/37' 2020-02-11T16:08:40.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './197' 2020-02-11T16:08:40.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/19' 2020-02-11T16:08:40.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/15' 2020-02-11T16:08:40.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/31' 2020-02-11T16:08:40.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/36' 2020-02-11T16:08:40.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/20' 2020-02-11T16:08:40.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/12' 2020-02-11T16:08:40.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/39' 2020-02-11T16:08:40.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/10' 2020-02-11T16:08:40.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/34' 2020-02-11T16:08:40.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/38' 2020-02-11T16:08:40.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/11' 2020-02-11T16:08:40.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/16' 2020-02-11T16:08:40.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/32' 2020-02-11T16:08:40.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/30' 2020-02-11T16:08:40.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/14' 2020-02-11T16:08:40.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/18' 2020-02-11T16:08:40.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/13' 2020-02-11T16:08:40.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/33' 2020-02-11T16:08:40.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/17' 2020-02-11T16:08:40.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/35' 2020-02-11T16:08:40.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './198/37' 2020-02-11T16:08:40.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './198' 2020-02-11T16:08:40.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/19' 2020-02-11T16:08:40.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/15' 2020-02-11T16:08:40.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/31' 2020-02-11T16:08:40.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/36' 2020-02-11T16:08:40.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/20' 2020-02-11T16:08:40.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/12' 2020-02-11T16:08:40.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/39' 2020-02-11T16:08:40.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/10' 2020-02-11T16:08:40.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/34' 2020-02-11T16:08:40.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/38' 2020-02-11T16:08:40.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/11' 2020-02-11T16:08:40.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/16' 2020-02-11T16:08:40.882 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/32' 2020-02-11T16:08:40.882 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/30' 2020-02-11T16:08:40.882 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/14' 2020-02-11T16:08:40.882 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/18' 2020-02-11T16:08:40.882 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/13' 2020-02-11T16:08:40.882 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/33' 2020-02-11T16:08:40.882 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/17' 2020-02-11T16:08:40.882 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/35' 2020-02-11T16:08:40.883 INFO:tasks.workunit.client.0.smithi088.stdout:removed './199/37' 2020-02-11T16:08:40.883 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './199' 2020-02-11T16:08:40.883 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/21' 2020-02-11T16:08:40.883 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/27' 2020-02-11T16:08:40.883 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/31' 2020-02-11T16:08:40.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/36' 2020-02-11T16:08:40.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/20' 2020-02-11T16:08:40.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/39' 2020-02-11T16:08:40.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/34' 2020-02-11T16:08:40.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/38' 2020-02-11T16:08:40.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/28' 2020-02-11T16:08:40.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/24' 2020-02-11T16:08:40.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/29' 2020-02-11T16:08:40.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/32' 2020-02-11T16:08:40.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/22' 2020-02-11T16:08:40.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/25' 2020-02-11T16:08:40.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/30' 2020-02-11T16:08:40.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/33' 2020-02-11T16:08:40.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/23' 2020-02-11T16:08:40.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/35' 2020-02-11T16:08:40.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/26' 2020-02-11T16:08:40.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed './200/37' 2020-02-11T16:08:40.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './200' 2020-02-11T16:08:40.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/21' 2020-02-11T16:08:40.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/27' 2020-02-11T16:08:40.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/31' 2020-02-11T16:08:40.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/36' 2020-02-11T16:08:40.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/20' 2020-02-11T16:08:40.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/39' 2020-02-11T16:08:40.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/34' 2020-02-11T16:08:40.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/38' 2020-02-11T16:08:40.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/28' 2020-02-11T16:08:40.888 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/24' 2020-02-11T16:08:40.888 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/29' 2020-02-11T16:08:40.888 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/32' 2020-02-11T16:08:40.888 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/22' 2020-02-11T16:08:40.888 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/25' 2020-02-11T16:08:40.888 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/30' 2020-02-11T16:08:40.888 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/33' 2020-02-11T16:08:40.889 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/23' 2020-02-11T16:08:40.889 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/35' 2020-02-11T16:08:40.889 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/26' 2020-02-11T16:08:40.889 INFO:tasks.workunit.client.0.smithi088.stdout:removed './201/37' 2020-02-11T16:08:40.889 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './201' 2020-02-11T16:08:40.889 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/21' 2020-02-11T16:08:40.889 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/27' 2020-02-11T16:08:40.890 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/31' 2020-02-11T16:08:40.890 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/36' 2020-02-11T16:08:40.890 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/20' 2020-02-11T16:08:40.890 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/39' 2020-02-11T16:08:40.890 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/34' 2020-02-11T16:08:40.890 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/38' 2020-02-11T16:08:40.890 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/28' 2020-02-11T16:08:40.890 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/24' 2020-02-11T16:08:40.891 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/29' 2020-02-11T16:08:40.891 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/32' 2020-02-11T16:08:40.891 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/22' 2020-02-11T16:08:40.891 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/25' 2020-02-11T16:08:40.891 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/30' 2020-02-11T16:08:40.891 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/33' 2020-02-11T16:08:40.891 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/23' 2020-02-11T16:08:40.892 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/35' 2020-02-11T16:08:40.892 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/26' 2020-02-11T16:08:40.892 INFO:tasks.workunit.client.0.smithi088.stdout:removed './202/37' 2020-02-11T16:08:40.892 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './202' 2020-02-11T16:08:40.892 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/21' 2020-02-11T16:08:40.892 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/27' 2020-02-11T16:08:40.892 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/31' 2020-02-11T16:08:40.893 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/36' 2020-02-11T16:08:40.893 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/20' 2020-02-11T16:08:40.893 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/39' 2020-02-11T16:08:40.893 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/34' 2020-02-11T16:08:40.893 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/38' 2020-02-11T16:08:40.893 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/28' 2020-02-11T16:08:40.894 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/24' 2020-02-11T16:08:40.894 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/29' 2020-02-11T16:08:40.894 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/32' 2020-02-11T16:08:40.894 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/22' 2020-02-11T16:08:40.894 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/25' 2020-02-11T16:08:40.894 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/30' 2020-02-11T16:08:40.895 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/33' 2020-02-11T16:08:40.895 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/23' 2020-02-11T16:08:40.895 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/35' 2020-02-11T16:08:40.895 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/26' 2020-02-11T16:08:40.895 INFO:tasks.workunit.client.0.smithi088.stdout:removed './203/37' 2020-02-11T16:08:40.895 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './203' 2020-02-11T16:08:40.896 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/21' 2020-02-11T16:08:40.896 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/27' 2020-02-11T16:08:40.896 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/31' 2020-02-11T16:08:40.896 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/36' 2020-02-11T16:08:40.896 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/20' 2020-02-11T16:08:40.896 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/39' 2020-02-11T16:08:40.896 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/34' 2020-02-11T16:08:40.897 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/38' 2020-02-11T16:08:40.897 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/28' 2020-02-11T16:08:40.897 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/24' 2020-02-11T16:08:40.897 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/29' 2020-02-11T16:08:40.897 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/32' 2020-02-11T16:08:40.897 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/22' 2020-02-11T16:08:40.897 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/25' 2020-02-11T16:08:40.898 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/30' 2020-02-11T16:08:40.898 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/33' 2020-02-11T16:08:40.898 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/23' 2020-02-11T16:08:40.898 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/35' 2020-02-11T16:08:40.898 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/26' 2020-02-11T16:08:40.898 INFO:tasks.workunit.client.0.smithi088.stdout:removed './204/37' 2020-02-11T16:08:40.898 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './204' 2020-02-11T16:08:40.898 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/21' 2020-02-11T16:08:40.899 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/27' 2020-02-11T16:08:40.899 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/31' 2020-02-11T16:08:40.899 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/36' 2020-02-11T16:08:40.899 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/20' 2020-02-11T16:08:40.899 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/39' 2020-02-11T16:08:40.899 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/34' 2020-02-11T16:08:40.899 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/38' 2020-02-11T16:08:40.900 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/28' 2020-02-11T16:08:40.900 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/24' 2020-02-11T16:08:40.900 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/29' 2020-02-11T16:08:40.900 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/32' 2020-02-11T16:08:40.900 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/22' 2020-02-11T16:08:40.900 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/25' 2020-02-11T16:08:40.900 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/30' 2020-02-11T16:08:40.901 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/33' 2020-02-11T16:08:40.901 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/23' 2020-02-11T16:08:40.901 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/35' 2020-02-11T16:08:40.901 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/26' 2020-02-11T16:08:40.901 INFO:tasks.workunit.client.0.smithi088.stdout:removed './205/37' 2020-02-11T16:08:40.901 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './205' 2020-02-11T16:08:40.901 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/21' 2020-02-11T16:08:40.901 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/27' 2020-02-11T16:08:40.902 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/31' 2020-02-11T16:08:40.902 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/36' 2020-02-11T16:08:40.902 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/20' 2020-02-11T16:08:40.902 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/39' 2020-02-11T16:08:41.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.052+0000 7f1627093700 1 -- 172.21.15.88:0/1531168303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f16200a0970 con 0x7f16200a1bb0 2020-02-11T16:08:41.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.053+0000 7f1625890700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:41.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.053+0000 7f160f7fe700 1 -- 172.21.15.88:0/1531168303 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f16100322b0 con 0x7f16200a1bb0 2020-02-11T16:08:41.056 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:41.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 -- 172.21.15.88:0/1531168303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1600039c10 msgr2=0x7f160003c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:41.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1600039c10 0x7f160003c0d0 crc :-1 s=READY pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:41.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 -- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 msgr2=0x7f162009ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:41.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 0x7f162009ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f1610002f30 tx=0x7f1610011450).stop 2020-02-11T16:08:41.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 -- 172.21.15.88:0/1531168303 shutdown_connections 2020-02-11T16:08:41.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1600039c10 0x7f160003c0d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:41.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 --2- 172.21.15.88:0/1531168303 >> v2:172.21.15.52:3300/0 conn(0x7f162005a950 0x7f16200a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:41.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 --2- 172.21.15.88:0/1531168303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16200a1bb0 0x7f162009ede0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:41.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 -- 172.21.15.88:0/1531168303 >> 172.21.15.88:0/1531168303 conn(0x7f16200aa840 msgr2=0x7f1620069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:41.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 -- 172.21.15.88:0/1531168303 shutdown_connections 2020-02-11T16:08:41.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:41.054+0000 7f1627093700 1 -- 172.21.15.88:0/1531168303 wait complete. 2020-02-11T16:08:41.068 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":38,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:41.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/34' 2020-02-11T16:08:41.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/38' 2020-02-11T16:08:41.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/28' 2020-02-11T16:08:41.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/24' 2020-02-11T16:08:41.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/29' 2020-02-11T16:08:41.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/32' 2020-02-11T16:08:41.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/22' 2020-02-11T16:08:41.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/25' 2020-02-11T16:08:41.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/30' 2020-02-11T16:08:41.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/33' 2020-02-11T16:08:41.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/23' 2020-02-11T16:08:41.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/35' 2020-02-11T16:08:41.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/26' 2020-02-11T16:08:41.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './206/37' 2020-02-11T16:08:41.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './206' 2020-02-11T16:08:41.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/21' 2020-02-11T16:08:41.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/27' 2020-02-11T16:08:41.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/31' 2020-02-11T16:08:41.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/36' 2020-02-11T16:08:41.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/20' 2020-02-11T16:08:41.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/39' 2020-02-11T16:08:41.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/34' 2020-02-11T16:08:41.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/38' 2020-02-11T16:08:41.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/28' 2020-02-11T16:08:41.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/24' 2020-02-11T16:08:41.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/29' 2020-02-11T16:08:41.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/32' 2020-02-11T16:08:41.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/22' 2020-02-11T16:08:41.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/25' 2020-02-11T16:08:41.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/30' 2020-02-11T16:08:41.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/33' 2020-02-11T16:08:41.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/23' 2020-02-11T16:08:41.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/35' 2020-02-11T16:08:41.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/26' 2020-02-11T16:08:41.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './207/37' 2020-02-11T16:08:41.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './207' 2020-02-11T16:08:41.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/21' 2020-02-11T16:08:41.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/27' 2020-02-11T16:08:41.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/31' 2020-02-11T16:08:41.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/36' 2020-02-11T16:08:41.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/20' 2020-02-11T16:08:41.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/39' 2020-02-11T16:08:41.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/34' 2020-02-11T16:08:41.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/38' 2020-02-11T16:08:41.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/28' 2020-02-11T16:08:41.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/24' 2020-02-11T16:08:41.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/29' 2020-02-11T16:08:41.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/32' 2020-02-11T16:08:41.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/22' 2020-02-11T16:08:41.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/25' 2020-02-11T16:08:41.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/30' 2020-02-11T16:08:41.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/33' 2020-02-11T16:08:41.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/23' 2020-02-11T16:08:41.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/35' 2020-02-11T16:08:41.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/26' 2020-02-11T16:08:41.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './208/37' 2020-02-11T16:08:41.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './208' 2020-02-11T16:08:41.594 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/21' 2020-02-11T16:08:41.594 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/27' 2020-02-11T16:08:41.594 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/31' 2020-02-11T16:08:41.594 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/36' 2020-02-11T16:08:41.594 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/20' 2020-02-11T16:08:41.594 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/39' 2020-02-11T16:08:41.594 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/34' 2020-02-11T16:08:41.595 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/38' 2020-02-11T16:08:41.595 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/28' 2020-02-11T16:08:41.595 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/24' 2020-02-11T16:08:41.595 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/29' 2020-02-11T16:08:41.595 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/32' 2020-02-11T16:08:41.595 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/22' 2020-02-11T16:08:41.595 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/25' 2020-02-11T16:08:41.595 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/30' 2020-02-11T16:08:41.596 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/33' 2020-02-11T16:08:41.596 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/23' 2020-02-11T16:08:41.596 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/35' 2020-02-11T16:08:41.596 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/26' 2020-02-11T16:08:41.596 INFO:tasks.workunit.client.0.smithi088.stdout:removed './209/37' 2020-02-11T16:08:41.596 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './209' 2020-02-11T16:08:41.596 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/21' 2020-02-11T16:08:41.597 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/27' 2020-02-11T16:08:41.597 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/31' 2020-02-11T16:08:41.597 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/36' 2020-02-11T16:08:41.597 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/20' 2020-02-11T16:08:41.597 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/39' 2020-02-11T16:08:41.597 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/34' 2020-02-11T16:08:41.597 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/38' 2020-02-11T16:08:41.597 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/28' 2020-02-11T16:08:41.598 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/24' 2020-02-11T16:08:41.598 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/29' 2020-02-11T16:08:41.598 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/32' 2020-02-11T16:08:41.598 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/22' 2020-02-11T16:08:41.598 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/25' 2020-02-11T16:08:41.598 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/30' 2020-02-11T16:08:41.598 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/33' 2020-02-11T16:08:41.598 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/23' 2020-02-11T16:08:41.599 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/35' 2020-02-11T16:08:41.599 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/26' 2020-02-11T16:08:41.599 INFO:tasks.workunit.client.0.smithi088.stdout:removed './210/37' 2020-02-11T16:08:41.599 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './210' 2020-02-11T16:08:41.599 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/21' 2020-02-11T16:08:41.599 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/27' 2020-02-11T16:08:41.599 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/31' 2020-02-11T16:08:41.600 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/36' 2020-02-11T16:08:41.600 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/20' 2020-02-11T16:08:41.600 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/39' 2020-02-11T16:08:41.600 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/34' 2020-02-11T16:08:41.600 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/38' 2020-02-11T16:08:41.600 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/28' 2020-02-11T16:08:41.600 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/24' 2020-02-11T16:08:41.600 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/29' 2020-02-11T16:08:41.601 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/32' 2020-02-11T16:08:41.601 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/22' 2020-02-11T16:08:41.601 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/25' 2020-02-11T16:08:41.601 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/30' 2020-02-11T16:08:41.602 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/33' 2020-02-11T16:08:41.602 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/23' 2020-02-11T16:08:41.602 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/35' 2020-02-11T16:08:41.602 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/26' 2020-02-11T16:08:41.602 INFO:tasks.workunit.client.0.smithi088.stdout:removed './211/37' 2020-02-11T16:08:41.602 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './211' 2020-02-11T16:08:41.602 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/21' 2020-02-11T16:08:41.603 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/27' 2020-02-11T16:08:41.603 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/31' 2020-02-11T16:08:41.603 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/36' 2020-02-11T16:08:41.603 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/20' 2020-02-11T16:08:41.603 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/39' 2020-02-11T16:08:41.603 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/34' 2020-02-11T16:08:41.603 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/38' 2020-02-11T16:08:41.603 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/28' 2020-02-11T16:08:41.604 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/24' 2020-02-11T16:08:41.604 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/29' 2020-02-11T16:08:41.604 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/32' 2020-02-11T16:08:41.604 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/22' 2020-02-11T16:08:41.604 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/25' 2020-02-11T16:08:41.604 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/30' 2020-02-11T16:08:41.604 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/33' 2020-02-11T16:08:41.604 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/23' 2020-02-11T16:08:41.605 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/35' 2020-02-11T16:08:41.605 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/26' 2020-02-11T16:08:41.605 INFO:tasks.workunit.client.0.smithi088.stdout:removed './212/37' 2020-02-11T16:08:41.605 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './212' 2020-02-11T16:08:41.605 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/21' 2020-02-11T16:08:41.605 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/27' 2020-02-11T16:08:41.605 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/31' 2020-02-11T16:08:41.606 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/36' 2020-02-11T16:08:41.606 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/20' 2020-02-11T16:08:41.606 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/39' 2020-02-11T16:08:41.606 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/34' 2020-02-11T16:08:41.606 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/38' 2020-02-11T16:08:41.606 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/28' 2020-02-11T16:08:41.606 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/24' 2020-02-11T16:08:41.606 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/29' 2020-02-11T16:08:41.607 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/32' 2020-02-11T16:08:41.607 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/22' 2020-02-11T16:08:41.607 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/25' 2020-02-11T16:08:41.607 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/30' 2020-02-11T16:08:41.607 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/33' 2020-02-11T16:08:41.607 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/23' 2020-02-11T16:08:41.607 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/35' 2020-02-11T16:08:41.608 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/26' 2020-02-11T16:08:41.608 INFO:tasks.workunit.client.0.smithi088.stdout:removed './213/37' 2020-02-11T16:08:41.608 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './213' 2020-02-11T16:08:41.608 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/21' 2020-02-11T16:08:41.608 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/27' 2020-02-11T16:08:41.608 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/31' 2020-02-11T16:08:41.608 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/36' 2020-02-11T16:08:41.608 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/20' 2020-02-11T16:08:41.609 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/39' 2020-02-11T16:08:41.609 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/34' 2020-02-11T16:08:41.609 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/38' 2020-02-11T16:08:41.609 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/28' 2020-02-11T16:08:41.609 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/24' 2020-02-11T16:08:41.609 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/29' 2020-02-11T16:08:41.609 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/32' 2020-02-11T16:08:41.610 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/22' 2020-02-11T16:08:41.610 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/25' 2020-02-11T16:08:41.610 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/30' 2020-02-11T16:08:41.610 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/33' 2020-02-11T16:08:41.610 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/23' 2020-02-11T16:08:41.610 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/35' 2020-02-11T16:08:41.610 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/26' 2020-02-11T16:08:41.610 INFO:tasks.workunit.client.0.smithi088.stdout:removed './214/37' 2020-02-11T16:08:41.611 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './214' 2020-02-11T16:08:41.611 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/21' 2020-02-11T16:08:41.611 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/27' 2020-02-11T16:08:41.611 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/31' 2020-02-11T16:08:41.611 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/36' 2020-02-11T16:08:41.612 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/20' 2020-02-11T16:08:41.612 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/39' 2020-02-11T16:08:41.612 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/34' 2020-02-11T16:08:41.612 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/38' 2020-02-11T16:08:41.612 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/28' 2020-02-11T16:08:41.612 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/24' 2020-02-11T16:08:41.612 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/29' 2020-02-11T16:08:41.613 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/32' 2020-02-11T16:08:41.613 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/22' 2020-02-11T16:08:41.613 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/25' 2020-02-11T16:08:41.613 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/30' 2020-02-11T16:08:41.613 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/33' 2020-02-11T16:08:41.613 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/23' 2020-02-11T16:08:41.613 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/35' 2020-02-11T16:08:41.613 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/26' 2020-02-11T16:08:41.614 INFO:tasks.workunit.client.0.smithi088.stdout:removed './215/37' 2020-02-11T16:08:41.614 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './215' 2020-02-11T16:08:41.614 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/21' 2020-02-11T16:08:41.614 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/27' 2020-02-11T16:08:41.614 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/31' 2020-02-11T16:08:41.614 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/36' 2020-02-11T16:08:41.614 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/20' 2020-02-11T16:08:41.615 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/39' 2020-02-11T16:08:41.615 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/34' 2020-02-11T16:08:41.615 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/38' 2020-02-11T16:08:41.984 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:08:41.995 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:08:42.220 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/28' 2020-02-11T16:08:42.220 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/24' 2020-02-11T16:08:42.220 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/29' 2020-02-11T16:08:42.220 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/32' 2020-02-11T16:08:42.220 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/22' 2020-02-11T16:08:42.221 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/25' 2020-02-11T16:08:42.221 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/30' 2020-02-11T16:08:42.221 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/33' 2020-02-11T16:08:42.221 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/23' 2020-02-11T16:08:42.221 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/35' 2020-02-11T16:08:42.221 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/26' 2020-02-11T16:08:42.221 INFO:tasks.workunit.client.0.smithi088.stdout:removed './216/37' 2020-02-11T16:08:42.222 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './216' 2020-02-11T16:08:42.222 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/21' 2020-02-11T16:08:42.222 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/27' 2020-02-11T16:08:42.222 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/31' 2020-02-11T16:08:42.222 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/36' 2020-02-11T16:08:42.222 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/20' 2020-02-11T16:08:42.222 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/39' 2020-02-11T16:08:42.223 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/34' 2020-02-11T16:08:42.223 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/38' 2020-02-11T16:08:42.223 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/28' 2020-02-11T16:08:42.223 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/24' 2020-02-11T16:08:42.223 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/29' 2020-02-11T16:08:42.223 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/32' 2020-02-11T16:08:42.223 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/22' 2020-02-11T16:08:42.224 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/25' 2020-02-11T16:08:42.224 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/30' 2020-02-11T16:08:42.224 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/33' 2020-02-11T16:08:42.224 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/23' 2020-02-11T16:08:42.224 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/35' 2020-02-11T16:08:42.224 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/26' 2020-02-11T16:08:42.224 INFO:tasks.workunit.client.0.smithi088.stdout:removed './217/37' 2020-02-11T16:08:42.224 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './217' 2020-02-11T16:08:42.225 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/21' 2020-02-11T16:08:42.225 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/27' 2020-02-11T16:08:42.225 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/31' 2020-02-11T16:08:42.225 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/36' 2020-02-11T16:08:42.225 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/20' 2020-02-11T16:08:42.225 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/39' 2020-02-11T16:08:42.225 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/34' 2020-02-11T16:08:42.226 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/38' 2020-02-11T16:08:42.226 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/28' 2020-02-11T16:08:42.226 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/24' 2020-02-11T16:08:42.226 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/29' 2020-02-11T16:08:42.226 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/32' 2020-02-11T16:08:42.226 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/22' 2020-02-11T16:08:42.226 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/25' 2020-02-11T16:08:42.227 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/30' 2020-02-11T16:08:42.227 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/33' 2020-02-11T16:08:42.227 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/23' 2020-02-11T16:08:42.227 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/35' 2020-02-11T16:08:42.227 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/26' 2020-02-11T16:08:42.227 INFO:tasks.workunit.client.0.smithi088.stdout:removed './218/37' 2020-02-11T16:08:42.227 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './218' 2020-02-11T16:08:42.227 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/21' 2020-02-11T16:08:42.228 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/27' 2020-02-11T16:08:42.228 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/31' 2020-02-11T16:08:42.228 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/36' 2020-02-11T16:08:42.228 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/20' 2020-02-11T16:08:42.228 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/39' 2020-02-11T16:08:42.228 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/34' 2020-02-11T16:08:42.228 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/38' 2020-02-11T16:08:42.229 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/28' 2020-02-11T16:08:42.229 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/24' 2020-02-11T16:08:42.229 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/29' 2020-02-11T16:08:42.229 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/32' 2020-02-11T16:08:42.229 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/22' 2020-02-11T16:08:42.229 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/25' 2020-02-11T16:08:42.229 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/30' 2020-02-11T16:08:42.229 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/33' 2020-02-11T16:08:42.230 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/23' 2020-02-11T16:08:42.230 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/35' 2020-02-11T16:08:42.230 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/26' 2020-02-11T16:08:42.230 INFO:tasks.workunit.client.0.smithi088.stdout:removed './219/37' 2020-02-11T16:08:42.230 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './219' 2020-02-11T16:08:42.230 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/21' 2020-02-11T16:08:42.230 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/27' 2020-02-11T16:08:42.231 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/31' 2020-02-11T16:08:42.231 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/36' 2020-02-11T16:08:42.231 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/20' 2020-02-11T16:08:42.231 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/39' 2020-02-11T16:08:42.231 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/34' 2020-02-11T16:08:42.231 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/38' 2020-02-11T16:08:42.231 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/28' 2020-02-11T16:08:42.232 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/24' 2020-02-11T16:08:42.232 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/29' 2020-02-11T16:08:42.232 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/32' 2020-02-11T16:08:42.232 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/22' 2020-02-11T16:08:42.232 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/25' 2020-02-11T16:08:42.232 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/30' 2020-02-11T16:08:42.232 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/33' 2020-02-11T16:08:42.232 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/23' 2020-02-11T16:08:42.233 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/35' 2020-02-11T16:08:42.233 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/26' 2020-02-11T16:08:42.233 INFO:tasks.workunit.client.0.smithi088.stdout:removed './220/37' 2020-02-11T16:08:42.233 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './220' 2020-02-11T16:08:42.233 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/21' 2020-02-11T16:08:42.233 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/27' 2020-02-11T16:08:42.233 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/31' 2020-02-11T16:08:42.234 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/36' 2020-02-11T16:08:42.234 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/20' 2020-02-11T16:08:42.234 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/39' 2020-02-11T16:08:42.234 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/34' 2020-02-11T16:08:42.234 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/38' 2020-02-11T16:08:42.234 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/28' 2020-02-11T16:08:42.234 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/24' 2020-02-11T16:08:42.235 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/29' 2020-02-11T16:08:42.235 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/32' 2020-02-11T16:08:42.235 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/22' 2020-02-11T16:08:42.235 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/25' 2020-02-11T16:08:42.235 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/30' 2020-02-11T16:08:42.235 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/33' 2020-02-11T16:08:42.235 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/23' 2020-02-11T16:08:42.236 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/35' 2020-02-11T16:08:42.236 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/26' 2020-02-11T16:08:42.236 INFO:tasks.workunit.client.0.smithi088.stdout:removed './221/37' 2020-02-11T16:08:42.236 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './221' 2020-02-11T16:08:42.236 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/21' 2020-02-11T16:08:42.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/27' 2020-02-11T16:08:42.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/31' 2020-02-11T16:08:42.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/36' 2020-02-11T16:08:42.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/20' 2020-02-11T16:08:42.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/39' 2020-02-11T16:08:42.238 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/34' 2020-02-11T16:08:42.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/38' 2020-02-11T16:08:42.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/28' 2020-02-11T16:08:42.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/24' 2020-02-11T16:08:42.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/29' 2020-02-11T16:08:42.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/32' 2020-02-11T16:08:42.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/22' 2020-02-11T16:08:42.239 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/25' 2020-02-11T16:08:42.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/30' 2020-02-11T16:08:42.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/33' 2020-02-11T16:08:42.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/23' 2020-02-11T16:08:42.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/35' 2020-02-11T16:08:42.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/26' 2020-02-11T16:08:42.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './222/37' 2020-02-11T16:08:42.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './222' 2020-02-11T16:08:42.240 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/21' 2020-02-11T16:08:42.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/27' 2020-02-11T16:08:42.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/31' 2020-02-11T16:08:42.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/36' 2020-02-11T16:08:42.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/20' 2020-02-11T16:08:42.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/39' 2020-02-11T16:08:42.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/34' 2020-02-11T16:08:42.241 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/38' 2020-02-11T16:08:42.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/28' 2020-02-11T16:08:42.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/24' 2020-02-11T16:08:42.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/29' 2020-02-11T16:08:42.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/32' 2020-02-11T16:08:42.242 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/22' 2020-02-11T16:08:42.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/25' 2020-02-11T16:08:42.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/30' 2020-02-11T16:08:42.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/33' 2020-02-11T16:08:42.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/23' 2020-02-11T16:08:42.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/35' 2020-02-11T16:08:42.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/26' 2020-02-11T16:08:42.243 INFO:tasks.workunit.client.0.smithi088.stdout:removed './223/37' 2020-02-11T16:08:42.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './223' 2020-02-11T16:08:42.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/21' 2020-02-11T16:08:42.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/27' 2020-02-11T16:08:42.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/31' 2020-02-11T16:08:42.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/36' 2020-02-11T16:08:42.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/20' 2020-02-11T16:08:42.244 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/39' 2020-02-11T16:08:42.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/34' 2020-02-11T16:08:42.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/38' 2020-02-11T16:08:42.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/28' 2020-02-11T16:08:42.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/24' 2020-02-11T16:08:42.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/29' 2020-02-11T16:08:42.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/32' 2020-02-11T16:08:42.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/22' 2020-02-11T16:08:42.245 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/25' 2020-02-11T16:08:42.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/30' 2020-02-11T16:08:42.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/33' 2020-02-11T16:08:42.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/23' 2020-02-11T16:08:42.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/35' 2020-02-11T16:08:42.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/26' 2020-02-11T16:08:42.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed './224/37' 2020-02-11T16:08:42.246 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './224' 2020-02-11T16:08:42.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/21' 2020-02-11T16:08:42.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/27' 2020-02-11T16:08:42.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/31' 2020-02-11T16:08:42.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/36' 2020-02-11T16:08:42.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/20' 2020-02-11T16:08:42.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/39' 2020-02-11T16:08:42.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/34' 2020-02-11T16:08:42.247 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/38' 2020-02-11T16:08:42.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/28' 2020-02-11T16:08:42.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/24' 2020-02-11T16:08:42.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/29' 2020-02-11T16:08:42.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/32' 2020-02-11T16:08:42.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/22' 2020-02-11T16:08:42.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/25' 2020-02-11T16:08:42.248 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/30' 2020-02-11T16:08:42.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/33' 2020-02-11T16:08:42.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/23' 2020-02-11T16:08:42.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/35' 2020-02-11T16:08:42.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/26' 2020-02-11T16:08:42.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './225/37' 2020-02-11T16:08:42.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './225' 2020-02-11T16:08:42.249 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/21' 2020-02-11T16:08:42.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/27' 2020-02-11T16:08:42.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/31' 2020-02-11T16:08:42.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/36' 2020-02-11T16:08:42.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/20' 2020-02-11T16:08:42.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/39' 2020-02-11T16:08:42.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/34' 2020-02-11T16:08:42.250 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/38' 2020-02-11T16:08:42.251 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/28' 2020-02-11T16:08:42.251 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/24' 2020-02-11T16:08:42.847 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/29' 2020-02-11T16:08:42.848 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/32' 2020-02-11T16:08:42.848 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/22' 2020-02-11T16:08:42.848 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/25' 2020-02-11T16:08:42.848 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/30' 2020-02-11T16:08:42.848 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/33' 2020-02-11T16:08:42.848 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/23' 2020-02-11T16:08:42.849 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/35' 2020-02-11T16:08:42.849 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/26' 2020-02-11T16:08:42.849 INFO:tasks.workunit.client.0.smithi088.stdout:removed './226/37' 2020-02-11T16:08:42.849 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './226' 2020-02-11T16:08:42.849 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/21' 2020-02-11T16:08:42.849 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/27' 2020-02-11T16:08:42.849 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/31' 2020-02-11T16:08:42.850 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/36' 2020-02-11T16:08:42.850 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/20' 2020-02-11T16:08:42.850 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/39' 2020-02-11T16:08:42.850 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/34' 2020-02-11T16:08:42.850 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/38' 2020-02-11T16:08:42.850 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/28' 2020-02-11T16:08:42.850 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/24' 2020-02-11T16:08:42.850 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/29' 2020-02-11T16:08:42.851 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/32' 2020-02-11T16:08:42.851 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/22' 2020-02-11T16:08:42.851 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/25' 2020-02-11T16:08:42.851 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/30' 2020-02-11T16:08:42.851 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/33' 2020-02-11T16:08:42.851 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/23' 2020-02-11T16:08:42.851 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/35' 2020-02-11T16:08:42.852 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/26' 2020-02-11T16:08:42.852 INFO:tasks.workunit.client.0.smithi088.stdout:removed './227/37' 2020-02-11T16:08:42.852 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './227' 2020-02-11T16:08:42.852 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/21' 2020-02-11T16:08:42.852 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/27' 2020-02-11T16:08:42.852 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/31' 2020-02-11T16:08:42.852 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/36' 2020-02-11T16:08:42.853 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/20' 2020-02-11T16:08:42.853 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/39' 2020-02-11T16:08:42.853 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/34' 2020-02-11T16:08:42.853 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/38' 2020-02-11T16:08:42.853 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/28' 2020-02-11T16:08:42.853 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/24' 2020-02-11T16:08:42.853 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/29' 2020-02-11T16:08:42.853 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/32' 2020-02-11T16:08:42.854 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/22' 2020-02-11T16:08:42.854 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/25' 2020-02-11T16:08:42.854 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/30' 2020-02-11T16:08:42.854 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/33' 2020-02-11T16:08:42.854 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/23' 2020-02-11T16:08:42.854 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/35' 2020-02-11T16:08:42.854 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/26' 2020-02-11T16:08:42.855 INFO:tasks.workunit.client.0.smithi088.stdout:removed './228/37' 2020-02-11T16:08:42.855 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './228' 2020-02-11T16:08:42.855 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/21' 2020-02-11T16:08:42.855 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/27' 2020-02-11T16:08:42.855 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/31' 2020-02-11T16:08:42.855 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/36' 2020-02-11T16:08:42.855 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/20' 2020-02-11T16:08:42.856 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/39' 2020-02-11T16:08:42.856 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/34' 2020-02-11T16:08:42.856 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/38' 2020-02-11T16:08:42.856 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/28' 2020-02-11T16:08:42.856 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/24' 2020-02-11T16:08:42.857 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/29' 2020-02-11T16:08:42.857 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/32' 2020-02-11T16:08:42.857 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/22' 2020-02-11T16:08:42.858 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/25' 2020-02-11T16:08:42.858 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/30' 2020-02-11T16:08:42.858 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/33' 2020-02-11T16:08:42.858 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/23' 2020-02-11T16:08:42.858 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/35' 2020-02-11T16:08:42.858 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/26' 2020-02-11T16:08:42.858 INFO:tasks.workunit.client.0.smithi088.stdout:removed './229/37' 2020-02-11T16:08:42.859 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './229' 2020-02-11T16:08:42.859 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/21' 2020-02-11T16:08:42.859 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/27' 2020-02-11T16:08:42.859 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/31' 2020-02-11T16:08:42.859 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/36' 2020-02-11T16:08:42.860 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/20' 2020-02-11T16:08:42.860 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/39' 2020-02-11T16:08:42.860 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/34' 2020-02-11T16:08:42.860 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/38' 2020-02-11T16:08:42.860 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/28' 2020-02-11T16:08:42.860 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/24' 2020-02-11T16:08:42.860 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/29' 2020-02-11T16:08:42.860 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/32' 2020-02-11T16:08:42.861 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/22' 2020-02-11T16:08:42.861 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/25' 2020-02-11T16:08:42.861 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/30' 2020-02-11T16:08:42.861 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/33' 2020-02-11T16:08:42.861 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/23' 2020-02-11T16:08:42.861 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/35' 2020-02-11T16:08:42.861 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/26' 2020-02-11T16:08:42.862 INFO:tasks.workunit.client.0.smithi088.stdout:removed './230/37' 2020-02-11T16:08:42.862 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './230' 2020-02-11T16:08:42.862 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/21' 2020-02-11T16:08:42.863 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/27' 2020-02-11T16:08:42.863 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/31' 2020-02-11T16:08:42.864 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/36' 2020-02-11T16:08:42.864 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/20' 2020-02-11T16:08:42.865 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/39' 2020-02-11T16:08:42.865 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/34' 2020-02-11T16:08:42.865 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/38' 2020-02-11T16:08:42.866 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/28' 2020-02-11T16:08:42.866 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/24' 2020-02-11T16:08:42.866 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/29' 2020-02-11T16:08:42.866 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/32' 2020-02-11T16:08:42.866 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/22' 2020-02-11T16:08:42.866 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/25' 2020-02-11T16:08:42.866 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/30' 2020-02-11T16:08:42.867 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/33' 2020-02-11T16:08:42.867 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/23' 2020-02-11T16:08:42.867 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/35' 2020-02-11T16:08:42.867 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/26' 2020-02-11T16:08:42.867 INFO:tasks.workunit.client.0.smithi088.stdout:removed './231/37' 2020-02-11T16:08:42.867 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './231' 2020-02-11T16:08:42.867 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/21' 2020-02-11T16:08:42.868 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/27' 2020-02-11T16:08:42.868 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/31' 2020-02-11T16:08:42.868 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/36' 2020-02-11T16:08:42.868 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/20' 2020-02-11T16:08:42.868 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/39' 2020-02-11T16:08:42.868 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/34' 2020-02-11T16:08:42.868 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/38' 2020-02-11T16:08:42.869 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/28' 2020-02-11T16:08:42.869 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/24' 2020-02-11T16:08:42.869 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/29' 2020-02-11T16:08:42.870 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/32' 2020-02-11T16:08:42.870 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/22' 2020-02-11T16:08:42.870 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/25' 2020-02-11T16:08:42.870 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/30' 2020-02-11T16:08:42.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/33' 2020-02-11T16:08:42.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/23' 2020-02-11T16:08:42.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/35' 2020-02-11T16:08:42.871 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/26' 2020-02-11T16:08:42.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed './232/37' 2020-02-11T16:08:42.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './232' 2020-02-11T16:08:42.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/21' 2020-02-11T16:08:42.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/27' 2020-02-11T16:08:42.872 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/31' 2020-02-11T16:08:42.873 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/36' 2020-02-11T16:08:42.873 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/20' 2020-02-11T16:08:42.873 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/39' 2020-02-11T16:08:42.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/34' 2020-02-11T16:08:42.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/38' 2020-02-11T16:08:42.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/28' 2020-02-11T16:08:42.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/24' 2020-02-11T16:08:42.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/29' 2020-02-11T16:08:42.875 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/32' 2020-02-11T16:08:42.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/22' 2020-02-11T16:08:42.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/25' 2020-02-11T16:08:42.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/30' 2020-02-11T16:08:42.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/33' 2020-02-11T16:08:42.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/23' 2020-02-11T16:08:42.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/35' 2020-02-11T16:08:42.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/26' 2020-02-11T16:08:42.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './233/37' 2020-02-11T16:08:42.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './233' 2020-02-11T16:08:42.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/21' 2020-02-11T16:08:42.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/27' 2020-02-11T16:08:42.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/31' 2020-02-11T16:08:42.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/36' 2020-02-11T16:08:42.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/20' 2020-02-11T16:08:42.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/39' 2020-02-11T16:08:42.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/34' 2020-02-11T16:08:42.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/38' 2020-02-11T16:08:42.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/28' 2020-02-11T16:08:42.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/24' 2020-02-11T16:08:42.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/29' 2020-02-11T16:08:42.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/32' 2020-02-11T16:08:42.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/22' 2020-02-11T16:08:42.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/25' 2020-02-11T16:08:42.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/30' 2020-02-11T16:08:42.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/33' 2020-02-11T16:08:42.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/23' 2020-02-11T16:08:42.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/35' 2020-02-11T16:08:42.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/26' 2020-02-11T16:08:42.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './234/37' 2020-02-11T16:08:42.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './234' 2020-02-11T16:08:42.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/21' 2020-02-11T16:08:42.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/27' 2020-02-11T16:08:42.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/31' 2020-02-11T16:08:42.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/36' 2020-02-11T16:08:42.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/20' 2020-02-11T16:08:42.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/39' 2020-02-11T16:08:42.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/34' 2020-02-11T16:08:42.883 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/38' 2020-02-11T16:08:42.883 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/28' 2020-02-11T16:08:42.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/24' 2020-02-11T16:08:42.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/29' 2020-02-11T16:08:42.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/32' 2020-02-11T16:08:42.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/22' 2020-02-11T16:08:42.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/25' 2020-02-11T16:08:42.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/30' 2020-02-11T16:08:42.884 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/33' 2020-02-11T16:08:42.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/23' 2020-02-11T16:08:42.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/35' 2020-02-11T16:08:42.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/26' 2020-02-11T16:08:42.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './235/37' 2020-02-11T16:08:42.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './235' 2020-02-11T16:08:42.885 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/21' 2020-02-11T16:08:42.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/27' 2020-02-11T16:08:42.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/31' 2020-02-11T16:08:42.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/36' 2020-02-11T16:08:42.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/20' 2020-02-11T16:08:42.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/39' 2020-02-11T16:08:42.886 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/34' 2020-02-11T16:08:42.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/38' 2020-02-11T16:08:42.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/28' 2020-02-11T16:08:42.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/24' 2020-02-11T16:08:42.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/29' 2020-02-11T16:08:42.887 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/32' 2020-02-11T16:08:43.559 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/22' 2020-02-11T16:08:43.559 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/25' 2020-02-11T16:08:43.560 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/30' 2020-02-11T16:08:43.560 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/33' 2020-02-11T16:08:43.560 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/23' 2020-02-11T16:08:43.560 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/35' 2020-02-11T16:08:43.560 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/26' 2020-02-11T16:08:43.561 INFO:tasks.workunit.client.0.smithi088.stdout:removed './236/37' 2020-02-11T16:08:43.561 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './236' 2020-02-11T16:08:43.561 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/21' 2020-02-11T16:08:43.561 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/27' 2020-02-11T16:08:43.561 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/31' 2020-02-11T16:08:43.562 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/36' 2020-02-11T16:08:43.562 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/20' 2020-02-11T16:08:43.562 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/39' 2020-02-11T16:08:43.562 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/34' 2020-02-11T16:08:43.562 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/38' 2020-02-11T16:08:43.563 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/28' 2020-02-11T16:08:43.563 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/24' 2020-02-11T16:08:43.563 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/29' 2020-02-11T16:08:43.563 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/32' 2020-02-11T16:08:43.563 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/22' 2020-02-11T16:08:43.563 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/25' 2020-02-11T16:08:43.564 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/30' 2020-02-11T16:08:43.564 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/33' 2020-02-11T16:08:43.564 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/23' 2020-02-11T16:08:43.564 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/35' 2020-02-11T16:08:43.564 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/26' 2020-02-11T16:08:43.564 INFO:tasks.workunit.client.0.smithi088.stdout:removed './237/37' 2020-02-11T16:08:43.565 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './237' 2020-02-11T16:08:43.565 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/21' 2020-02-11T16:08:43.565 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/27' 2020-02-11T16:08:43.565 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/31' 2020-02-11T16:08:43.565 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/36' 2020-02-11T16:08:43.565 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/20' 2020-02-11T16:08:43.566 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/39' 2020-02-11T16:08:43.566 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/34' 2020-02-11T16:08:43.566 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/38' 2020-02-11T16:08:43.566 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/28' 2020-02-11T16:08:43.566 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/24' 2020-02-11T16:08:43.566 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/29' 2020-02-11T16:08:43.566 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/32' 2020-02-11T16:08:43.567 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/22' 2020-02-11T16:08:43.567 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/25' 2020-02-11T16:08:43.567 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/30' 2020-02-11T16:08:43.567 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/33' 2020-02-11T16:08:43.567 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/23' 2020-02-11T16:08:43.567 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/35' 2020-02-11T16:08:43.568 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/26' 2020-02-11T16:08:43.568 INFO:tasks.workunit.client.0.smithi088.stdout:removed './238/37' 2020-02-11T16:08:43.568 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './238' 2020-02-11T16:08:43.568 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/21' 2020-02-11T16:08:43.568 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/27' 2020-02-11T16:08:43.568 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/31' 2020-02-11T16:08:43.568 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/36' 2020-02-11T16:08:43.569 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/20' 2020-02-11T16:08:43.569 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/39' 2020-02-11T16:08:43.569 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/34' 2020-02-11T16:08:43.569 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/38' 2020-02-11T16:08:43.569 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/28' 2020-02-11T16:08:43.570 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/24' 2020-02-11T16:08:43.570 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/29' 2020-02-11T16:08:43.570 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/32' 2020-02-11T16:08:43.570 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/22' 2020-02-11T16:08:43.570 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/25' 2020-02-11T16:08:43.570 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/30' 2020-02-11T16:08:43.570 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/33' 2020-02-11T16:08:43.571 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/23' 2020-02-11T16:08:43.571 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/35' 2020-02-11T16:08:43.571 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/26' 2020-02-11T16:08:43.571 INFO:tasks.workunit.client.0.smithi088.stdout:removed './239/37' 2020-02-11T16:08:43.571 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './239' 2020-02-11T16:08:43.571 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/21' 2020-02-11T16:08:43.572 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/27' 2020-02-11T16:08:43.572 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/31' 2020-02-11T16:08:43.572 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/36' 2020-02-11T16:08:43.572 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/20' 2020-02-11T16:08:43.572 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/39' 2020-02-11T16:08:43.572 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/34' 2020-02-11T16:08:43.572 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/38' 2020-02-11T16:08:43.573 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/28' 2020-02-11T16:08:43.573 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/24' 2020-02-11T16:08:43.573 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/29' 2020-02-11T16:08:43.574 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/32' 2020-02-11T16:08:43.574 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/22' 2020-02-11T16:08:43.574 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/25' 2020-02-11T16:08:43.575 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/30' 2020-02-11T16:08:43.575 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/33' 2020-02-11T16:08:43.575 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/23' 2020-02-11T16:08:43.575 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/35' 2020-02-11T16:08:43.575 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/26' 2020-02-11T16:08:43.576 INFO:tasks.workunit.client.0.smithi088.stdout:removed './240/37' 2020-02-11T16:08:43.576 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './240' 2020-02-11T16:08:43.576 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/21' 2020-02-11T16:08:43.576 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/27' 2020-02-11T16:08:43.576 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/31' 2020-02-11T16:08:43.577 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/36' 2020-02-11T16:08:43.577 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/20' 2020-02-11T16:08:43.577 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/39' 2020-02-11T16:08:43.577 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/34' 2020-02-11T16:08:43.578 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/38' 2020-02-11T16:08:43.578 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/28' 2020-02-11T16:08:43.578 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/24' 2020-02-11T16:08:43.578 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/29' 2020-02-11T16:08:43.578 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/32' 2020-02-11T16:08:43.579 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/22' 2020-02-11T16:08:43.579 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/25' 2020-02-11T16:08:43.579 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/30' 2020-02-11T16:08:43.579 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/33' 2020-02-11T16:08:43.579 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/23' 2020-02-11T16:08:43.579 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/35' 2020-02-11T16:08:43.579 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/26' 2020-02-11T16:08:43.580 INFO:tasks.workunit.client.0.smithi088.stdout:removed './241/37' 2020-02-11T16:08:43.580 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './241' 2020-02-11T16:08:43.580 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/21' 2020-02-11T16:08:43.580 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/27' 2020-02-11T16:08:43.580 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/31' 2020-02-11T16:08:43.580 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/36' 2020-02-11T16:08:43.580 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/20' 2020-02-11T16:08:43.581 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/39' 2020-02-11T16:08:43.581 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/34' 2020-02-11T16:08:43.581 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/38' 2020-02-11T16:08:43.581 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/28' 2020-02-11T16:08:43.581 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/24' 2020-02-11T16:08:43.581 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/29' 2020-02-11T16:08:43.582 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/32' 2020-02-11T16:08:43.582 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/22' 2020-02-11T16:08:43.582 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/25' 2020-02-11T16:08:43.582 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/30' 2020-02-11T16:08:43.582 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/33' 2020-02-11T16:08:43.582 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/23' 2020-02-11T16:08:43.582 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/35' 2020-02-11T16:08:43.583 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/26' 2020-02-11T16:08:43.583 INFO:tasks.workunit.client.0.smithi088.stdout:removed './242/37' 2020-02-11T16:08:43.583 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './242' 2020-02-11T16:08:43.583 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/21' 2020-02-11T16:08:43.583 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/27' 2020-02-11T16:08:43.583 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/31' 2020-02-11T16:08:43.583 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/36' 2020-02-11T16:08:43.583 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/20' 2020-02-11T16:08:43.584 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/39' 2020-02-11T16:08:43.584 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/34' 2020-02-11T16:08:43.584 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/38' 2020-02-11T16:08:43.584 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/28' 2020-02-11T16:08:43.584 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/24' 2020-02-11T16:08:43.584 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/29' 2020-02-11T16:08:43.584 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/32' 2020-02-11T16:08:43.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/22' 2020-02-11T16:08:43.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/25' 2020-02-11T16:08:43.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/30' 2020-02-11T16:08:43.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/33' 2020-02-11T16:08:43.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/23' 2020-02-11T16:08:43.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/35' 2020-02-11T16:08:43.585 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/26' 2020-02-11T16:08:43.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './243/37' 2020-02-11T16:08:43.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './243' 2020-02-11T16:08:43.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/21' 2020-02-11T16:08:43.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/27' 2020-02-11T16:08:43.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/31' 2020-02-11T16:08:43.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/36' 2020-02-11T16:08:43.586 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/20' 2020-02-11T16:08:43.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/39' 2020-02-11T16:08:43.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/34' 2020-02-11T16:08:43.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/38' 2020-02-11T16:08:43.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/28' 2020-02-11T16:08:43.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/24' 2020-02-11T16:08:43.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/29' 2020-02-11T16:08:43.587 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/32' 2020-02-11T16:08:43.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/22' 2020-02-11T16:08:43.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/25' 2020-02-11T16:08:43.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/30' 2020-02-11T16:08:43.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/33' 2020-02-11T16:08:43.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/23' 2020-02-11T16:08:43.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/35' 2020-02-11T16:08:43.588 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/26' 2020-02-11T16:08:43.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './244/37' 2020-02-11T16:08:43.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './244' 2020-02-11T16:08:43.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/21' 2020-02-11T16:08:43.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/27' 2020-02-11T16:08:43.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/31' 2020-02-11T16:08:43.589 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/36' 2020-02-11T16:08:43.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/20' 2020-02-11T16:08:43.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/39' 2020-02-11T16:08:43.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/34' 2020-02-11T16:08:43.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/38' 2020-02-11T16:08:43.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/28' 2020-02-11T16:08:43.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/24' 2020-02-11T16:08:43.590 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/29' 2020-02-11T16:08:43.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/32' 2020-02-11T16:08:43.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/22' 2020-02-11T16:08:43.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/25' 2020-02-11T16:08:43.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/30' 2020-02-11T16:08:43.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/33' 2020-02-11T16:08:43.591 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/23' 2020-02-11T16:08:43.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/35' 2020-02-11T16:08:43.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/26' 2020-02-11T16:08:43.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './245/37' 2020-02-11T16:08:43.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './245' 2020-02-11T16:08:43.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/21' 2020-02-11T16:08:43.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/27' 2020-02-11T16:08:43.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/31' 2020-02-11T16:08:43.592 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/36' 2020-02-11T16:08:43.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/20' 2020-02-11T16:08:43.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/39' 2020-02-11T16:08:43.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/34' 2020-02-11T16:08:43.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/38' 2020-02-11T16:08:43.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/28' 2020-02-11T16:08:43.593 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/24' 2020-02-11T16:08:43.594 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/29' 2020-02-11T16:08:43.594 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/32' 2020-02-11T16:08:43.594 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/22' 2020-02-11T16:08:44.068 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:08:44.145 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/25' 2020-02-11T16:08:44.145 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/30' 2020-02-11T16:08:44.145 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/33' 2020-02-11T16:08:44.145 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/23' 2020-02-11T16:08:44.146 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/35' 2020-02-11T16:08:44.146 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/26' 2020-02-11T16:08:44.146 INFO:tasks.workunit.client.0.smithi088.stdout:removed './246/37' 2020-02-11T16:08:44.146 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './246' 2020-02-11T16:08:44.147 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/21' 2020-02-11T16:08:44.147 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/27' 2020-02-11T16:08:44.147 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/31' 2020-02-11T16:08:44.147 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/36' 2020-02-11T16:08:44.147 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/20' 2020-02-11T16:08:44.148 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/39' 2020-02-11T16:08:44.148 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/34' 2020-02-11T16:08:44.148 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/38' 2020-02-11T16:08:44.148 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/28' 2020-02-11T16:08:44.149 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/24' 2020-02-11T16:08:44.149 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/29' 2020-02-11T16:08:44.149 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/32' 2020-02-11T16:08:44.149 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/22' 2020-02-11T16:08:44.150 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/25' 2020-02-11T16:08:44.150 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/30' 2020-02-11T16:08:44.150 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/33' 2020-02-11T16:08:44.150 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/23' 2020-02-11T16:08:44.150 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/35' 2020-02-11T16:08:44.151 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/26' 2020-02-11T16:08:44.151 INFO:tasks.workunit.client.0.smithi088.stdout:removed './247/37' 2020-02-11T16:08:44.151 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './247' 2020-02-11T16:08:44.151 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/21' 2020-02-11T16:08:44.152 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/27' 2020-02-11T16:08:44.152 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/31' 2020-02-11T16:08:44.152 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/36' 2020-02-11T16:08:44.152 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/20' 2020-02-11T16:08:44.153 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/39' 2020-02-11T16:08:44.153 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/34' 2020-02-11T16:08:44.153 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/38' 2020-02-11T16:08:44.153 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/28' 2020-02-11T16:08:44.153 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/24' 2020-02-11T16:08:44.154 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/29' 2020-02-11T16:08:44.154 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/32' 2020-02-11T16:08:44.154 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/22' 2020-02-11T16:08:44.154 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/25' 2020-02-11T16:08:44.155 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/30' 2020-02-11T16:08:44.155 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/33' 2020-02-11T16:08:44.155 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/23' 2020-02-11T16:08:44.155 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/35' 2020-02-11T16:08:44.156 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/26' 2020-02-11T16:08:44.156 INFO:tasks.workunit.client.0.smithi088.stdout:removed './248/37' 2020-02-11T16:08:44.156 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './248' 2020-02-11T16:08:44.156 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/21' 2020-02-11T16:08:44.156 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/27' 2020-02-11T16:08:44.157 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/31' 2020-02-11T16:08:44.157 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/36' 2020-02-11T16:08:44.157 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/20' 2020-02-11T16:08:44.157 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/39' 2020-02-11T16:08:44.158 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/34' 2020-02-11T16:08:44.158 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/38' 2020-02-11T16:08:44.158 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/28' 2020-02-11T16:08:44.158 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/24' 2020-02-11T16:08:44.159 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/29' 2020-02-11T16:08:44.159 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/32' 2020-02-11T16:08:44.159 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/22' 2020-02-11T16:08:44.159 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/25' 2020-02-11T16:08:44.160 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/30' 2020-02-11T16:08:44.160 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/33' 2020-02-11T16:08:44.160 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/23' 2020-02-11T16:08:44.160 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/35' 2020-02-11T16:08:44.160 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/26' 2020-02-11T16:08:44.161 INFO:tasks.workunit.client.0.smithi088.stdout:removed './249/37' 2020-02-11T16:08:44.161 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './249' 2020-02-11T16:08:44.161 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/21' 2020-02-11T16:08:44.161 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/27' 2020-02-11T16:08:44.162 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/31' 2020-02-11T16:08:44.162 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/36' 2020-02-11T16:08:44.162 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/20' 2020-02-11T16:08:44.162 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/39' 2020-02-11T16:08:44.163 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/34' 2020-02-11T16:08:44.163 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/38' 2020-02-11T16:08:44.163 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/28' 2020-02-11T16:08:44.163 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/24' 2020-02-11T16:08:44.164 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/29' 2020-02-11T16:08:44.164 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/32' 2020-02-11T16:08:44.164 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/22' 2020-02-11T16:08:44.164 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/25' 2020-02-11T16:08:44.164 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/30' 2020-02-11T16:08:44.165 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/33' 2020-02-11T16:08:44.165 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/23' 2020-02-11T16:08:44.165 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/35' 2020-02-11T16:08:44.165 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/26' 2020-02-11T16:08:44.165 INFO:tasks.workunit.client.0.smithi088.stdout:removed './250/37' 2020-02-11T16:08:44.165 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './250' 2020-02-11T16:08:44.166 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/21' 2020-02-11T16:08:44.166 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/27' 2020-02-11T16:08:44.166 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/31' 2020-02-11T16:08:44.166 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/36' 2020-02-11T16:08:44.166 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/20' 2020-02-11T16:08:44.166 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/39' 2020-02-11T16:08:44.166 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/34' 2020-02-11T16:08:44.167 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/38' 2020-02-11T16:08:44.167 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/28' 2020-02-11T16:08:44.167 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/24' 2020-02-11T16:08:44.167 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/29' 2020-02-11T16:08:44.167 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/32' 2020-02-11T16:08:44.167 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/22' 2020-02-11T16:08:44.167 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/25' 2020-02-11T16:08:44.168 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/30' 2020-02-11T16:08:44.168 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/33' 2020-02-11T16:08:44.168 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/23' 2020-02-11T16:08:44.168 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/35' 2020-02-11T16:08:44.168 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/26' 2020-02-11T16:08:44.168 INFO:tasks.workunit.client.0.smithi088.stdout:removed './251/37' 2020-02-11T16:08:44.168 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './251' 2020-02-11T16:08:44.169 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/21' 2020-02-11T16:08:44.169 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/27' 2020-02-11T16:08:44.169 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/31' 2020-02-11T16:08:44.169 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/36' 2020-02-11T16:08:44.169 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/20' 2020-02-11T16:08:44.169 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/39' 2020-02-11T16:08:44.169 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/34' 2020-02-11T16:08:44.170 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/38' 2020-02-11T16:08:44.170 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/28' 2020-02-11T16:08:44.170 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/24' 2020-02-11T16:08:44.170 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/29' 2020-02-11T16:08:44.170 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/32' 2020-02-11T16:08:44.170 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/22' 2020-02-11T16:08:44.170 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/25' 2020-02-11T16:08:44.171 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/30' 2020-02-11T16:08:44.171 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/33' 2020-02-11T16:08:44.171 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/23' 2020-02-11T16:08:44.171 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/35' 2020-02-11T16:08:44.171 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/26' 2020-02-11T16:08:44.171 INFO:tasks.workunit.client.0.smithi088.stdout:removed './252/37' 2020-02-11T16:08:44.171 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './252' 2020-02-11T16:08:44.171 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/21' 2020-02-11T16:08:44.172 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/27' 2020-02-11T16:08:44.172 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/31' 2020-02-11T16:08:44.172 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/36' 2020-02-11T16:08:44.172 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/20' 2020-02-11T16:08:44.172 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/39' 2020-02-11T16:08:44.172 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/34' 2020-02-11T16:08:44.172 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/38' 2020-02-11T16:08:44.173 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/28' 2020-02-11T16:08:44.173 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/24' 2020-02-11T16:08:44.173 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/29' 2020-02-11T16:08:44.173 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/32' 2020-02-11T16:08:44.173 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/22' 2020-02-11T16:08:44.173 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/25' 2020-02-11T16:08:44.173 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/30' 2020-02-11T16:08:44.174 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/33' 2020-02-11T16:08:44.174 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/23' 2020-02-11T16:08:44.174 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/35' 2020-02-11T16:08:44.174 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/26' 2020-02-11T16:08:44.174 INFO:tasks.workunit.client.0.smithi088.stdout:removed './253/37' 2020-02-11T16:08:44.174 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './253' 2020-02-11T16:08:44.174 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/21' 2020-02-11T16:08:44.174 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/27' 2020-02-11T16:08:44.175 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/31' 2020-02-11T16:08:44.175 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/36' 2020-02-11T16:08:44.175 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/20' 2020-02-11T16:08:44.175 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/39' 2020-02-11T16:08:44.175 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/34' 2020-02-11T16:08:44.175 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/38' 2020-02-11T16:08:44.175 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/28' 2020-02-11T16:08:44.176 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/24' 2020-02-11T16:08:44.176 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/29' 2020-02-11T16:08:44.176 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/32' 2020-02-11T16:08:44.176 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/22' 2020-02-11T16:08:44.176 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/25' 2020-02-11T16:08:44.176 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/30' 2020-02-11T16:08:44.176 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/33' 2020-02-11T16:08:44.176 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/23' 2020-02-11T16:08:44.177 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/35' 2020-02-11T16:08:44.177 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/26' 2020-02-11T16:08:44.177 INFO:tasks.workunit.client.0.smithi088.stdout:removed './254/37' 2020-02-11T16:08:44.177 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './254' 2020-02-11T16:08:44.177 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/21' 2020-02-11T16:08:44.177 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/27' 2020-02-11T16:08:44.177 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/31' 2020-02-11T16:08:44.178 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/36' 2020-02-11T16:08:44.178 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/20' 2020-02-11T16:08:44.178 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/39' 2020-02-11T16:08:44.178 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/34' 2020-02-11T16:08:44.178 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/38' 2020-02-11T16:08:44.178 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/28' 2020-02-11T16:08:44.178 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/24' 2020-02-11T16:08:44.179 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/29' 2020-02-11T16:08:44.179 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/32' 2020-02-11T16:08:44.179 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/22' 2020-02-11T16:08:44.179 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/25' 2020-02-11T16:08:44.179 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/30' 2020-02-11T16:08:44.179 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/33' 2020-02-11T16:08:44.180 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/23' 2020-02-11T16:08:44.180 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/35' 2020-02-11T16:08:44.180 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/26' 2020-02-11T16:08:44.180 INFO:tasks.workunit.client.0.smithi088.stdout:removed './255/37' 2020-02-11T16:08:44.180 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './255' 2020-02-11T16:08:44.180 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/21' 2020-02-11T16:08:44.180 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/27' 2020-02-11T16:08:44.180 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/31' 2020-02-11T16:08:44.181 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/36' 2020-02-11T16:08:44.181 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/20' 2020-02-11T16:08:44.181 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/39' 2020-02-11T16:08:44.181 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/34' 2020-02-11T16:08:44.181 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/38' 2020-02-11T16:08:44.181 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/28' 2020-02-11T16:08:44.181 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/24' 2020-02-11T16:08:44.182 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/29' 2020-02-11T16:08:44.182 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/32' 2020-02-11T16:08:44.182 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/22' 2020-02-11T16:08:44.182 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/25' 2020-02-11T16:08:44.182 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/30' 2020-02-11T16:08:44.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.219+0000 7f24467a1700 1 Processor -- start 2020-02-11T16:08:44.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.219+0000 7f24467a1700 1 -- start start 2020-02-11T16:08:44.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.220+0000 7f24467a1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24400a18a0 0x7f24400a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:44.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.220+0000 7f24467a1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f24400a5de0 0x7f24400a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:44.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.220+0000 7f24467a1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24400a31b0 con 0x7f244012e3a0 2020-02-11T16:08:44.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.220+0000 7f24467a1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24400a3570 con 0x7f24400a5de0 2020-02-11T16:08:44.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.220+0000 7f24467a1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24400a3810 con 0x7f24400a18a0 2020-02-11T16:08:44.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f24400a5de0 0x7f24400a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:44.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f24400a5de0 0x7f24400a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:39466/0 (socket says 172.21.15.88:39466) 2020-02-11T16:08:44.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 -- 172.21.15.88:0/1314753605 learned_addr learned my addr 172.21.15.88:0/1314753605 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:44.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 -- 172.21.15.88:0/1314753605 >> v2:172.21.15.88:3300/0 conn(0x7f24400a18a0 msgr2=0x7f24400a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:08:44.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1314753605 >> v2:172.21.15.88:3300/0 conn(0x7f24400a18a0 0x7f24400a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 -- 172.21.15.88:0/1314753605 >> v1:172.21.15.52:6789/0 conn(0x7f244012e3a0 legacy=0x7f244012e830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2020-02-11T16:08:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 -- 172.21.15.88:0/1314753605 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24400a3ab0 con 0x7f24400a5de0 2020-02-11T16:08:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1314753605 >> v2:172.21.15.52:3300/0 conn(0x7f24400a5de0 0x7f24400a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1314753605 >> v2:172.21.15.52:3300/0 conn(0x7f24400a5de0 0x7f24400a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1314753605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24400a5de0 0x7f24400a6260 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).ready entity=mon.0 client_cookie=e14563361fd708d1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1314753605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24400a5de0 0x7f24400a6260 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1314753605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24400a5de0 0x7f24400a6260 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1314753605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24400a5de0 0x7f24400a6260 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.221+0000 7f243effd700 1 -- 172.21.15.88:0/1314753605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2434008e20 con 0x7f24400a5de0 2020-02-11T16:08:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.222+0000 7f243effd700 1 -- 172.21.15.88:0/1314753605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24340118d0 con 0x7f24400a5de0 2020-02-11T16:08:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.222+0000 7f243effd700 1 -- 172.21.15.88:0/1314753605 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2434011cb0 con 0x7f24400a5de0 2020-02-11T16:08:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.222+0000 7f24467a1700 1 -- 172.21.15.88:0/1314753605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24400a5de0 msgr2=0x7f24400a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.222+0000 7f24467a1700 1 --2- 172.21.15.88:0/1314753605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24400a5de0 0x7f24400a6260 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).stop 2020-02-11T16:08:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.222+0000 7f24467a1700 1 -- 172.21.15.88:0/1314753605 shutdown_connections 2020-02-11T16:08:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.222+0000 7f24467a1700 1 --2- 172.21.15.88:0/1314753605 >> v2:172.21.15.88:3300/0 conn(0x7f24400a18a0 0x7f24400a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.222+0000 7f24467a1700 1 --2- 172.21.15.88:0/1314753605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24400a5de0 0x7f24400a6260 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.222+0000 7f24467a1700 1 -- 172.21.15.88:0/1314753605 >> 172.21.15.88:0/1314753605 conn(0x7f244009d110 msgr2=0x7f244009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.223+0000 7f24467a1700 1 -- 172.21.15.88:0/1314753605 shutdown_connections 2020-02-11T16:08:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.223+0000 7f24467a1700 1 -- 172.21.15.88:0/1314753605 wait complete. 2020-02-11T16:08:44.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.224+0000 7f24467a1700 1 Processor -- start 2020-02-11T16:08:44.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.224+0000 7f24467a1700 1 -- start start 2020-02-11T16:08:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.225+0000 7f24467a1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24400a18a0 0x7f244009e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.225+0000 7f24467a1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24400a5de0 0x7f24400a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.225+0000 7f24467a1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24401321b0 con 0x7f244012e3a0 2020-02-11T16:08:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.225+0000 7f24467a1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244009e6a0 con 0x7f24400a5de0 2020-02-11T16:08:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.225+0000 7f24467a1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24400a7990 con 0x7f24400a18a0 2020-02-11T16:08:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.225+0000 7f243ffff700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24400a18a0 msgr2=0x7f244009e240 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:08:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.225+0000 7f243ffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24400a18a0 0x7f244009e240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.225+0000 7f2444d3e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f244012e3a0 0x7f244009e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41114/0 (socket says 172.21.15.88:41114) 2020-02-11T16:08:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.225+0000 7f2444d3e700 1 -- 172.21.15.88:0/1722058132 learned_addr learned my addr 172.21.15.88:0/1722058132 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> v2:172.21.15.88:3300/0 conn(0x7f24400a5de0 0x7f24400a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 -- 172.21.15.88:0/1722058132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24400a18a0 msgr2=0x7f244009e240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:08:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24400a18a0 0x7f244009e240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 -- 172.21.15.88:0/1722058132 >> v1:172.21.15.88:6789/0 conn(0x7f244012e3a0 legacy=0x7f244009e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:44.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 -- 172.21.15.88:0/1722058132 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440130830 con 0x7f24400a5de0 2020-02-11T16:08:44.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> v2:172.21.15.88:3300/0 conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> v2:172.21.15.88:3300/0 conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:44.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.226+0000 7f243d7fa700 1 -- 172.21.15.88:0/1722058132 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243400f910 con 0x7f24400a5de0 2020-02-11T16:08:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.227+0000 7f243d7fa700 1 -- 172.21.15.88:0/1722058132 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434008e20 con 0x7f24400a5de0 2020-02-11T16:08:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.227+0000 7f243d7fa700 1 -- 172.21.15.88:0/1722058132 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2434007530 con 0x7f24400a5de0 2020-02-11T16:08:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.227+0000 7f24467a1700 1 -- 172.21.15.88:0/1722058132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2440130ad0 con 0x7f24400a5de0 2020-02-11T16:08:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.227+0000 7f24467a1700 1 -- 172.21.15.88:0/1722058132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2440131210 con 0x7f24400a5de0 2020-02-11T16:08:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.228+0000 7f24467a1700 1 -- 172.21.15.88:0/1722058132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244009f160 con 0x7f24400a5de0 2020-02-11T16:08:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.229+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.230+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.230+0000 7f243d7fa700 1 -- 172.21.15.88:0/1722058132 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f24340056c0 con 0x7f24400a5de0 2020-02-11T16:08:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.230+0000 7f243d7fa700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2420039c70 0x7f242003c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.230+0000 7f243d7fa700 1 -- 172.21.15.88:0/1722058132 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f243404a1a0 con 0x7f24400a5de0 2020-02-11T16:08:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.231+0000 7f243ffff700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2420039c70 0x7f242003c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.231+0000 7f243ffff700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2420039c70 0x7f242003c130 crc :-1 s=READY pgs=160 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.234+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.234+0000 7f243d7fa700 1 -- 172.21.15.88:0/1722058132 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f24340326f0 con 0x7f24400a5de0 2020-02-11T16:08:44.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.513+0000 7f24467a1700 1 -- 172.21.15.88:0/1722058132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f244009f160 con 0x7f24400a5de0 2020-02-11T16:08:44.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.513+0000 7f243f7fe700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:44.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.513+0000 7f243d7fa700 1 -- 172.21.15.88:0/1722058132 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f244009f160 con 0x7f24400a5de0 2020-02-11T16:08:44.517 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:44.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 -- 172.21.15.88:0/1722058132 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2420039c70 msgr2=0x7f242003c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:44.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2420039c70 0x7f242003c130 crc :-1 s=READY pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:44.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 -- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 msgr2=0x7f24400a0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:44.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 0x7f24400a0540 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f244005bbc0 tx=0x7f2434007a40).stop 2020-02-11T16:08:44.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 -- 172.21.15.88:0/1722058132 shutdown_connections 2020-02-11T16:08:44.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2420039c70 0x7f242003c130 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:44.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24400a18a0 0x7f244009e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:44.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 --2- 172.21.15.88:0/1722058132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24400a5de0 0x7f24400a0540 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:44.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 -- 172.21.15.88:0/1722058132 >> 172.21.15.88:0/1722058132 conn(0x7f244009d110 msgr2=0x7f24400a4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:44.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 -- 172.21.15.88:0/1722058132 shutdown_connections 2020-02-11T16:08:44.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:44.515+0000 7f24467a1700 1 -- 172.21.15.88:0/1722058132 wait complete. 2020-02-11T16:08:44.528 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":38,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:44.782 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/33' 2020-02-11T16:08:44.783 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/23' 2020-02-11T16:08:44.783 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/35' 2020-02-11T16:08:44.783 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/26' 2020-02-11T16:08:44.784 INFO:tasks.workunit.client.0.smithi088.stdout:removed './256/37' 2020-02-11T16:08:44.784 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './256' 2020-02-11T16:08:44.784 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/21' 2020-02-11T16:08:44.784 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/27' 2020-02-11T16:08:44.784 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/31' 2020-02-11T16:08:44.785 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/36' 2020-02-11T16:08:44.785 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/20' 2020-02-11T16:08:44.785 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/39' 2020-02-11T16:08:44.785 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/34' 2020-02-11T16:08:44.786 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/38' 2020-02-11T16:08:44.786 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/28' 2020-02-11T16:08:44.786 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/24' 2020-02-11T16:08:44.786 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/29' 2020-02-11T16:08:44.787 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/32' 2020-02-11T16:08:44.787 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/22' 2020-02-11T16:08:44.787 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/25' 2020-02-11T16:08:44.787 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/30' 2020-02-11T16:08:44.787 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/33' 2020-02-11T16:08:44.788 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/23' 2020-02-11T16:08:44.788 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/35' 2020-02-11T16:08:44.788 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/26' 2020-02-11T16:08:44.788 INFO:tasks.workunit.client.0.smithi088.stdout:removed './257/37' 2020-02-11T16:08:44.788 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './257' 2020-02-11T16:08:44.789 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/21' 2020-02-11T16:08:44.789 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/27' 2020-02-11T16:08:44.789 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/31' 2020-02-11T16:08:44.789 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/36' 2020-02-11T16:08:44.790 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/20' 2020-02-11T16:08:44.790 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/39' 2020-02-11T16:08:44.790 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/34' 2020-02-11T16:08:44.790 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/38' 2020-02-11T16:08:44.790 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/28' 2020-02-11T16:08:44.791 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/24' 2020-02-11T16:08:44.791 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/29' 2020-02-11T16:08:44.791 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/32' 2020-02-11T16:08:44.791 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/22' 2020-02-11T16:08:44.791 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/25' 2020-02-11T16:08:44.791 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/30' 2020-02-11T16:08:44.792 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/33' 2020-02-11T16:08:44.792 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/23' 2020-02-11T16:08:44.792 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/35' 2020-02-11T16:08:44.792 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/26' 2020-02-11T16:08:44.792 INFO:tasks.workunit.client.0.smithi088.stdout:removed './258/37' 2020-02-11T16:08:44.792 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './258' 2020-02-11T16:08:44.792 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/21' 2020-02-11T16:08:44.793 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/27' 2020-02-11T16:08:44.793 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/31' 2020-02-11T16:08:44.793 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/36' 2020-02-11T16:08:44.793 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/20' 2020-02-11T16:08:44.793 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/39' 2020-02-11T16:08:44.793 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/34' 2020-02-11T16:08:44.793 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/38' 2020-02-11T16:08:44.794 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/28' 2020-02-11T16:08:44.794 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/24' 2020-02-11T16:08:44.794 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/29' 2020-02-11T16:08:44.794 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/32' 2020-02-11T16:08:44.794 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/22' 2020-02-11T16:08:44.794 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/25' 2020-02-11T16:08:44.794 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/30' 2020-02-11T16:08:44.794 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/33' 2020-02-11T16:08:44.795 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/23' 2020-02-11T16:08:44.795 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/35' 2020-02-11T16:08:44.795 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/26' 2020-02-11T16:08:44.795 INFO:tasks.workunit.client.0.smithi088.stdout:removed './259/37' 2020-02-11T16:08:44.795 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './259' 2020-02-11T16:08:44.795 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/21' 2020-02-11T16:08:44.795 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/27' 2020-02-11T16:08:44.796 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/31' 2020-02-11T16:08:44.796 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/36' 2020-02-11T16:08:44.796 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/20' 2020-02-11T16:08:44.796 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/39' 2020-02-11T16:08:44.796 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/34' 2020-02-11T16:08:44.796 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/38' 2020-02-11T16:08:44.796 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/28' 2020-02-11T16:08:44.796 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/24' 2020-02-11T16:08:44.797 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/29' 2020-02-11T16:08:44.797 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/32' 2020-02-11T16:08:44.797 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/22' 2020-02-11T16:08:44.797 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/25' 2020-02-11T16:08:44.797 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/30' 2020-02-11T16:08:44.797 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/33' 2020-02-11T16:08:44.797 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/23' 2020-02-11T16:08:44.798 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/35' 2020-02-11T16:08:44.798 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/26' 2020-02-11T16:08:44.798 INFO:tasks.workunit.client.0.smithi088.stdout:removed './260/37' 2020-02-11T16:08:44.798 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './260' 2020-02-11T16:08:44.798 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/21' 2020-02-11T16:08:44.798 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/27' 2020-02-11T16:08:44.798 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/31' 2020-02-11T16:08:44.799 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/36' 2020-02-11T16:08:44.799 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/20' 2020-02-11T16:08:44.799 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/39' 2020-02-11T16:08:44.799 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/34' 2020-02-11T16:08:44.799 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/38' 2020-02-11T16:08:44.800 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/28' 2020-02-11T16:08:44.800 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/24' 2020-02-11T16:08:44.800 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/29' 2020-02-11T16:08:44.800 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/32' 2020-02-11T16:08:44.800 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/22' 2020-02-11T16:08:44.800 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/25' 2020-02-11T16:08:44.800 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/30' 2020-02-11T16:08:44.800 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/33' 2020-02-11T16:08:44.801 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/23' 2020-02-11T16:08:44.801 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/35' 2020-02-11T16:08:44.801 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/26' 2020-02-11T16:08:44.801 INFO:tasks.workunit.client.0.smithi088.stdout:removed './261/37' 2020-02-11T16:08:44.802 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './261' 2020-02-11T16:08:44.802 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/21' 2020-02-11T16:08:44.802 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/27' 2020-02-11T16:08:44.802 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/31' 2020-02-11T16:08:44.802 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/36' 2020-02-11T16:08:44.803 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/20' 2020-02-11T16:08:44.803 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/39' 2020-02-11T16:08:44.803 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/34' 2020-02-11T16:08:44.803 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/38' 2020-02-11T16:08:44.803 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/28' 2020-02-11T16:08:44.804 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/24' 2020-02-11T16:08:44.804 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/29' 2020-02-11T16:08:44.804 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/32' 2020-02-11T16:08:44.804 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/22' 2020-02-11T16:08:44.805 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/25' 2020-02-11T16:08:44.805 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/30' 2020-02-11T16:08:44.805 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/33' 2020-02-11T16:08:44.805 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/23' 2020-02-11T16:08:44.806 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/35' 2020-02-11T16:08:44.806 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/26' 2020-02-11T16:08:44.806 INFO:tasks.workunit.client.0.smithi088.stdout:removed './262/37' 2020-02-11T16:08:44.806 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './262' 2020-02-11T16:08:44.806 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/21' 2020-02-11T16:08:44.807 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/27' 2020-02-11T16:08:44.807 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/31' 2020-02-11T16:08:44.807 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/36' 2020-02-11T16:08:44.807 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/20' 2020-02-11T16:08:44.808 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/39' 2020-02-11T16:08:44.808 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/34' 2020-02-11T16:08:44.808 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/38' 2020-02-11T16:08:44.808 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/28' 2020-02-11T16:08:44.808 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/24' 2020-02-11T16:08:44.809 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/29' 2020-02-11T16:08:44.809 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/32' 2020-02-11T16:08:44.809 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/22' 2020-02-11T16:08:44.809 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/25' 2020-02-11T16:08:44.810 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/30' 2020-02-11T16:08:44.810 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/33' 2020-02-11T16:08:44.810 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/23' 2020-02-11T16:08:44.810 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/35' 2020-02-11T16:08:44.811 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/26' 2020-02-11T16:08:44.811 INFO:tasks.workunit.client.0.smithi088.stdout:removed './263/37' 2020-02-11T16:08:44.812 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './263' 2020-02-11T16:08:44.812 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/21' 2020-02-11T16:08:44.812 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/27' 2020-02-11T16:08:44.812 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/31' 2020-02-11T16:08:44.813 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/36' 2020-02-11T16:08:44.813 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/20' 2020-02-11T16:08:44.813 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/39' 2020-02-11T16:08:44.813 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/34' 2020-02-11T16:08:44.814 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/38' 2020-02-11T16:08:44.814 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/28' 2020-02-11T16:08:44.814 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/24' 2020-02-11T16:08:44.815 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/29' 2020-02-11T16:08:44.815 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/32' 2020-02-11T16:08:44.815 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/22' 2020-02-11T16:08:44.815 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/25' 2020-02-11T16:08:44.815 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/30' 2020-02-11T16:08:44.816 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/33' 2020-02-11T16:08:44.816 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/23' 2020-02-11T16:08:44.816 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/35' 2020-02-11T16:08:44.816 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/26' 2020-02-11T16:08:44.817 INFO:tasks.workunit.client.0.smithi088.stdout:removed './264/37' 2020-02-11T16:08:44.817 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './264' 2020-02-11T16:08:44.817 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/21' 2020-02-11T16:08:44.817 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/27' 2020-02-11T16:08:44.818 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/31' 2020-02-11T16:08:44.818 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/36' 2020-02-11T16:08:44.818 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/20' 2020-02-11T16:08:44.818 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/39' 2020-02-11T16:08:44.818 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/34' 2020-02-11T16:08:44.819 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/38' 2020-02-11T16:08:44.819 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/28' 2020-02-11T16:08:44.819 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/24' 2020-02-11T16:08:44.819 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/29' 2020-02-11T16:08:44.819 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/32' 2020-02-11T16:08:44.820 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/22' 2020-02-11T16:08:44.820 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/25' 2020-02-11T16:08:44.820 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/30' 2020-02-11T16:08:44.820 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/33' 2020-02-11T16:08:44.820 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/23' 2020-02-11T16:08:44.821 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/35' 2020-02-11T16:08:44.821 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/26' 2020-02-11T16:08:44.821 INFO:tasks.workunit.client.0.smithi088.stdout:removed './265/37' 2020-02-11T16:08:44.821 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './265' 2020-02-11T16:08:44.821 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/21' 2020-02-11T16:08:44.822 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/27' 2020-02-11T16:08:44.822 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/31' 2020-02-11T16:08:44.822 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/36' 2020-02-11T16:08:44.822 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/20' 2020-02-11T16:08:44.823 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/39' 2020-02-11T16:08:44.823 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/34' 2020-02-11T16:08:44.823 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/38' 2020-02-11T16:08:44.823 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/28' 2020-02-11T16:08:44.823 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/24' 2020-02-11T16:08:44.824 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/29' 2020-02-11T16:08:44.824 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/32' 2020-02-11T16:08:44.824 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/22' 2020-02-11T16:08:44.824 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/25' 2020-02-11T16:08:44.824 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/30' 2020-02-11T16:08:44.825 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/33' 2020-02-11T16:08:44.825 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/23' 2020-02-11T16:08:45.483 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/35' 2020-02-11T16:08:45.484 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/26' 2020-02-11T16:08:45.484 INFO:tasks.workunit.client.0.smithi088.stdout:removed './266/37' 2020-02-11T16:08:45.484 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './266' 2020-02-11T16:08:45.484 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/21' 2020-02-11T16:08:45.485 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/27' 2020-02-11T16:08:45.485 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/31' 2020-02-11T16:08:45.485 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/36' 2020-02-11T16:08:45.485 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/20' 2020-02-11T16:08:45.485 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/39' 2020-02-11T16:08:45.486 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/34' 2020-02-11T16:08:45.486 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/38' 2020-02-11T16:08:45.486 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/28' 2020-02-11T16:08:45.486 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/24' 2020-02-11T16:08:45.487 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/29' 2020-02-11T16:08:45.487 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/32' 2020-02-11T16:08:45.487 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/22' 2020-02-11T16:08:45.487 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/25' 2020-02-11T16:08:45.487 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/30' 2020-02-11T16:08:45.488 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/33' 2020-02-11T16:08:45.488 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/23' 2020-02-11T16:08:45.488 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/35' 2020-02-11T16:08:45.488 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/26' 2020-02-11T16:08:45.489 INFO:tasks.workunit.client.0.smithi088.stdout:removed './267/37' 2020-02-11T16:08:45.489 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './267' 2020-02-11T16:08:45.489 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/21' 2020-02-11T16:08:45.489 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/27' 2020-02-11T16:08:45.490 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/31' 2020-02-11T16:08:45.490 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/36' 2020-02-11T16:08:45.490 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/20' 2020-02-11T16:08:45.490 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/39' 2020-02-11T16:08:45.490 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/34' 2020-02-11T16:08:45.491 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/38' 2020-02-11T16:08:45.491 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/28' 2020-02-11T16:08:45.491 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/24' 2020-02-11T16:08:45.491 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/29' 2020-02-11T16:08:45.492 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/32' 2020-02-11T16:08:45.493 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/22' 2020-02-11T16:08:45.493 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/25' 2020-02-11T16:08:45.493 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/30' 2020-02-11T16:08:45.493 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/33' 2020-02-11T16:08:45.494 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/23' 2020-02-11T16:08:45.495 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/35' 2020-02-11T16:08:45.495 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/26' 2020-02-11T16:08:45.495 INFO:tasks.workunit.client.0.smithi088.stdout:removed './268/37' 2020-02-11T16:08:45.495 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './268' 2020-02-11T16:08:45.496 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/21' 2020-02-11T16:08:45.496 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/27' 2020-02-11T16:08:45.496 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/31' 2020-02-11T16:08:45.496 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/36' 2020-02-11T16:08:45.497 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/20' 2020-02-11T16:08:45.497 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/39' 2020-02-11T16:08:45.497 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/34' 2020-02-11T16:08:45.497 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/38' 2020-02-11T16:08:45.497 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/28' 2020-02-11T16:08:45.498 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/24' 2020-02-11T16:08:45.498 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/29' 2020-02-11T16:08:45.498 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/32' 2020-02-11T16:08:45.498 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/22' 2020-02-11T16:08:45.499 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/25' 2020-02-11T16:08:45.499 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/30' 2020-02-11T16:08:45.499 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/33' 2020-02-11T16:08:45.499 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/23' 2020-02-11T16:08:45.500 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/35' 2020-02-11T16:08:45.500 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/26' 2020-02-11T16:08:45.500 INFO:tasks.workunit.client.0.smithi088.stdout:removed './269/37' 2020-02-11T16:08:45.500 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './269' 2020-02-11T16:08:45.501 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/21' 2020-02-11T16:08:45.501 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/27' 2020-02-11T16:08:45.501 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/31' 2020-02-11T16:08:45.501 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/36' 2020-02-11T16:08:45.502 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/20' 2020-02-11T16:08:45.502 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/39' 2020-02-11T16:08:45.503 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/34' 2020-02-11T16:08:45.503 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/38' 2020-02-11T16:08:45.503 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/28' 2020-02-11T16:08:45.504 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/24' 2020-02-11T16:08:45.504 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/29' 2020-02-11T16:08:45.504 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/32' 2020-02-11T16:08:45.504 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/22' 2020-02-11T16:08:45.505 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/25' 2020-02-11T16:08:45.505 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/30' 2020-02-11T16:08:45.505 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/33' 2020-02-11T16:08:45.505 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/23' 2020-02-11T16:08:45.505 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/35' 2020-02-11T16:08:45.506 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/26' 2020-02-11T16:08:45.506 INFO:tasks.workunit.client.0.smithi088.stdout:removed './270/37' 2020-02-11T16:08:45.506 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './270' 2020-02-11T16:08:45.506 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/21' 2020-02-11T16:08:45.507 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/27' 2020-02-11T16:08:45.507 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/31' 2020-02-11T16:08:45.507 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/36' 2020-02-11T16:08:45.507 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/20' 2020-02-11T16:08:45.507 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/39' 2020-02-11T16:08:45.508 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/34' 2020-02-11T16:08:45.508 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/38' 2020-02-11T16:08:45.508 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/28' 2020-02-11T16:08:45.508 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/24' 2020-02-11T16:08:45.509 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/29' 2020-02-11T16:08:45.509 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/32' 2020-02-11T16:08:45.509 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/22' 2020-02-11T16:08:45.509 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/25' 2020-02-11T16:08:45.510 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/30' 2020-02-11T16:08:45.510 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/33' 2020-02-11T16:08:45.510 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/23' 2020-02-11T16:08:45.510 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/35' 2020-02-11T16:08:45.510 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/26' 2020-02-11T16:08:45.511 INFO:tasks.workunit.client.0.smithi088.stdout:removed './271/37' 2020-02-11T16:08:45.511 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './271' 2020-02-11T16:08:45.511 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/21' 2020-02-11T16:08:45.511 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/27' 2020-02-11T16:08:45.512 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/31' 2020-02-11T16:08:45.512 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/36' 2020-02-11T16:08:45.512 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/20' 2020-02-11T16:08:45.512 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/39' 2020-02-11T16:08:45.512 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/34' 2020-02-11T16:08:45.513 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/38' 2020-02-11T16:08:45.514 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/28' 2020-02-11T16:08:45.514 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/24' 2020-02-11T16:08:45.514 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/29' 2020-02-11T16:08:45.514 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/32' 2020-02-11T16:08:45.514 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/22' 2020-02-11T16:08:45.515 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/25' 2020-02-11T16:08:45.515 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/30' 2020-02-11T16:08:45.515 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/33' 2020-02-11T16:08:45.515 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/23' 2020-02-11T16:08:45.516 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/35' 2020-02-11T16:08:45.517 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/26' 2020-02-11T16:08:45.517 INFO:tasks.workunit.client.0.smithi088.stdout:removed './272/37' 2020-02-11T16:08:45.517 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './272' 2020-02-11T16:08:45.517 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/21' 2020-02-11T16:08:45.518 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/27' 2020-02-11T16:08:45.518 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/31' 2020-02-11T16:08:45.518 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/36' 2020-02-11T16:08:45.519 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/20' 2020-02-11T16:08:45.519 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/39' 2020-02-11T16:08:45.519 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/34' 2020-02-11T16:08:45.519 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/38' 2020-02-11T16:08:45.519 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/28' 2020-02-11T16:08:45.520 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/24' 2020-02-11T16:08:45.520 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/29' 2020-02-11T16:08:45.520 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/32' 2020-02-11T16:08:45.520 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/22' 2020-02-11T16:08:45.521 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/25' 2020-02-11T16:08:45.521 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/30' 2020-02-11T16:08:45.521 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/33' 2020-02-11T16:08:45.521 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/23' 2020-02-11T16:08:45.521 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/35' 2020-02-11T16:08:45.521 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/26' 2020-02-11T16:08:45.522 INFO:tasks.workunit.client.0.smithi088.stdout:removed './273/37' 2020-02-11T16:08:45.522 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './273' 2020-02-11T16:08:45.522 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/21' 2020-02-11T16:08:45.522 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/27' 2020-02-11T16:08:45.522 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/31' 2020-02-11T16:08:45.523 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/36' 2020-02-11T16:08:45.523 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/20' 2020-02-11T16:08:45.523 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/39' 2020-02-11T16:08:45.523 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/34' 2020-02-11T16:08:45.523 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/38' 2020-02-11T16:08:45.523 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/28' 2020-02-11T16:08:45.524 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/24' 2020-02-11T16:08:45.524 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/29' 2020-02-11T16:08:45.524 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/32' 2020-02-11T16:08:45.524 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/22' 2020-02-11T16:08:45.525 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/25' 2020-02-11T16:08:45.525 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/30' 2020-02-11T16:08:45.525 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/33' 2020-02-11T16:08:45.525 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/23' 2020-02-11T16:08:45.525 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/35' 2020-02-11T16:08:45.525 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/26' 2020-02-11T16:08:45.525 INFO:tasks.workunit.client.0.smithi088.stdout:removed './274/37' 2020-02-11T16:08:45.525 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './274' 2020-02-11T16:08:45.526 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/21' 2020-02-11T16:08:45.526 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/27' 2020-02-11T16:08:45.526 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/31' 2020-02-11T16:08:45.526 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/36' 2020-02-11T16:08:45.526 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/20' 2020-02-11T16:08:45.526 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/39' 2020-02-11T16:08:45.526 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/34' 2020-02-11T16:08:45.527 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/38' 2020-02-11T16:08:45.527 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/28' 2020-02-11T16:08:45.527 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/24' 2020-02-11T16:08:45.527 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/29' 2020-02-11T16:08:45.527 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/32' 2020-02-11T16:08:45.527 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/22' 2020-02-11T16:08:45.527 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/25' 2020-02-11T16:08:45.527 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/30' 2020-02-11T16:08:45.528 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/33' 2020-02-11T16:08:45.528 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/23' 2020-02-11T16:08:45.528 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/35' 2020-02-11T16:08:45.528 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/26' 2020-02-11T16:08:45.528 INFO:tasks.workunit.client.0.smithi088.stdout:removed './275/37' 2020-02-11T16:08:45.528 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './275' 2020-02-11T16:08:45.528 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/21' 2020-02-11T16:08:45.529 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/27' 2020-02-11T16:08:45.529 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/31' 2020-02-11T16:08:45.529 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/36' 2020-02-11T16:08:45.529 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/20' 2020-02-11T16:08:45.529 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/39' 2020-02-11T16:08:45.529 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/34' 2020-02-11T16:08:45.529 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/38' 2020-02-11T16:08:45.530 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/28' 2020-02-11T16:08:45.530 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/24' 2020-02-11T16:08:45.530 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/29' 2020-02-11T16:08:45.530 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/32' 2020-02-11T16:08:45.530 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/22' 2020-02-11T16:08:45.530 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/25' 2020-02-11T16:08:45.531 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/30' 2020-02-11T16:08:45.531 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/33' 2020-02-11T16:08:45.531 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/23' 2020-02-11T16:08:45.531 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/35' 2020-02-11T16:08:45.531 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/26' 2020-02-11T16:08:46.022 INFO:tasks.workunit.client.0.smithi088.stdout:removed './276/37' 2020-02-11T16:08:46.022 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './276' 2020-02-11T16:08:46.022 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/21' 2020-02-11T16:08:46.023 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/27' 2020-02-11T16:08:46.023 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/31' 2020-02-11T16:08:46.023 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/36' 2020-02-11T16:08:46.023 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/20' 2020-02-11T16:08:46.023 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/39' 2020-02-11T16:08:46.023 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/34' 2020-02-11T16:08:46.023 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/38' 2020-02-11T16:08:46.024 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/28' 2020-02-11T16:08:46.024 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/24' 2020-02-11T16:08:46.024 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/29' 2020-02-11T16:08:46.024 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/32' 2020-02-11T16:08:46.024 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/22' 2020-02-11T16:08:46.024 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/25' 2020-02-11T16:08:46.024 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/30' 2020-02-11T16:08:46.025 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/33' 2020-02-11T16:08:46.025 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/23' 2020-02-11T16:08:46.025 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/35' 2020-02-11T16:08:46.025 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/26' 2020-02-11T16:08:46.025 INFO:tasks.workunit.client.0.smithi088.stdout:removed './277/37' 2020-02-11T16:08:46.025 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './277' 2020-02-11T16:08:46.026 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/21' 2020-02-11T16:08:46.026 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/27' 2020-02-11T16:08:46.026 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/31' 2020-02-11T16:08:46.026 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/36' 2020-02-11T16:08:46.026 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/20' 2020-02-11T16:08:46.027 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/39' 2020-02-11T16:08:46.027 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/34' 2020-02-11T16:08:46.027 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/38' 2020-02-11T16:08:46.027 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/28' 2020-02-11T16:08:46.027 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/24' 2020-02-11T16:08:46.027 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/29' 2020-02-11T16:08:46.027 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/32' 2020-02-11T16:08:46.028 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/22' 2020-02-11T16:08:46.028 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/25' 2020-02-11T16:08:46.028 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/30' 2020-02-11T16:08:46.028 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/33' 2020-02-11T16:08:46.028 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/23' 2020-02-11T16:08:46.028 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/35' 2020-02-11T16:08:46.029 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/26' 2020-02-11T16:08:46.029 INFO:tasks.workunit.client.0.smithi088.stdout:removed './278/37' 2020-02-11T16:08:46.029 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './278' 2020-02-11T16:08:46.029 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/21' 2020-02-11T16:08:46.029 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/27' 2020-02-11T16:08:46.030 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/31' 2020-02-11T16:08:46.030 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/36' 2020-02-11T16:08:46.030 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/20' 2020-02-11T16:08:46.030 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/39' 2020-02-11T16:08:46.030 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/34' 2020-02-11T16:08:46.031 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/38' 2020-02-11T16:08:46.031 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/28' 2020-02-11T16:08:46.031 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/24' 2020-02-11T16:08:46.031 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/29' 2020-02-11T16:08:46.031 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/32' 2020-02-11T16:08:46.031 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/22' 2020-02-11T16:08:46.031 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/25' 2020-02-11T16:08:46.032 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/30' 2020-02-11T16:08:46.032 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/33' 2020-02-11T16:08:46.032 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/23' 2020-02-11T16:08:46.032 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/35' 2020-02-11T16:08:46.032 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/26' 2020-02-11T16:08:46.032 INFO:tasks.workunit.client.0.smithi088.stdout:removed './279/37' 2020-02-11T16:08:46.032 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './279' 2020-02-11T16:08:46.033 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/21' 2020-02-11T16:08:46.033 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/27' 2020-02-11T16:08:46.033 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/31' 2020-02-11T16:08:46.033 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/36' 2020-02-11T16:08:46.033 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/20' 2020-02-11T16:08:46.033 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/39' 2020-02-11T16:08:46.034 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/34' 2020-02-11T16:08:46.034 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/38' 2020-02-11T16:08:46.034 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/28' 2020-02-11T16:08:46.034 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/24' 2020-02-11T16:08:46.034 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/29' 2020-02-11T16:08:46.035 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/32' 2020-02-11T16:08:46.035 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/22' 2020-02-11T16:08:46.035 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/25' 2020-02-11T16:08:46.035 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/30' 2020-02-11T16:08:46.035 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/33' 2020-02-11T16:08:46.035 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/23' 2020-02-11T16:08:46.036 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/35' 2020-02-11T16:08:46.036 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/26' 2020-02-11T16:08:46.036 INFO:tasks.workunit.client.0.smithi088.stdout:removed './280/37' 2020-02-11T16:08:46.036 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './280' 2020-02-11T16:08:46.036 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/21' 2020-02-11T16:08:46.037 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/27' 2020-02-11T16:08:46.037 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/31' 2020-02-11T16:08:46.037 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/36' 2020-02-11T16:08:46.037 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/20' 2020-02-11T16:08:46.038 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/39' 2020-02-11T16:08:46.038 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/34' 2020-02-11T16:08:46.038 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/38' 2020-02-11T16:08:46.038 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/28' 2020-02-11T16:08:46.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/24' 2020-02-11T16:08:46.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/29' 2020-02-11T16:08:46.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/32' 2020-02-11T16:08:46.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/22' 2020-02-11T16:08:46.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/25' 2020-02-11T16:08:46.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/30' 2020-02-11T16:08:46.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/33' 2020-02-11T16:08:46.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/23' 2020-02-11T16:08:46.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/35' 2020-02-11T16:08:46.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/26' 2020-02-11T16:08:46.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed './281/37' 2020-02-11T16:08:46.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './281' 2020-02-11T16:08:46.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/21' 2020-02-11T16:08:46.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/27' 2020-02-11T16:08:46.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/31' 2020-02-11T16:08:46.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/36' 2020-02-11T16:08:46.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/20' 2020-02-11T16:08:46.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/39' 2020-02-11T16:08:46.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/34' 2020-02-11T16:08:46.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/38' 2020-02-11T16:08:46.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/28' 2020-02-11T16:08:46.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/24' 2020-02-11T16:08:46.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/29' 2020-02-11T16:08:46.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/32' 2020-02-11T16:08:46.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/22' 2020-02-11T16:08:46.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/25' 2020-02-11T16:08:46.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/30' 2020-02-11T16:08:46.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/33' 2020-02-11T16:08:46.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/23' 2020-02-11T16:08:46.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/35' 2020-02-11T16:08:46.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/26' 2020-02-11T16:08:46.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './282/37' 2020-02-11T16:08:46.044 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './282' 2020-02-11T16:08:46.044 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/21' 2020-02-11T16:08:46.044 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/27' 2020-02-11T16:08:46.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/31' 2020-02-11T16:08:46.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/36' 2020-02-11T16:08:46.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/20' 2020-02-11T16:08:46.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/39' 2020-02-11T16:08:46.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/34' 2020-02-11T16:08:46.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/38' 2020-02-11T16:08:46.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/28' 2020-02-11T16:08:46.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/24' 2020-02-11T16:08:46.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/29' 2020-02-11T16:08:46.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/32' 2020-02-11T16:08:46.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/22' 2020-02-11T16:08:46.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/25' 2020-02-11T16:08:46.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/30' 2020-02-11T16:08:46.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/33' 2020-02-11T16:08:46.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/23' 2020-02-11T16:08:46.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/35' 2020-02-11T16:08:46.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/26' 2020-02-11T16:08:46.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './283/37' 2020-02-11T16:08:46.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './283' 2020-02-11T16:08:46.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/21' 2020-02-11T16:08:46.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/27' 2020-02-11T16:08:46.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/31' 2020-02-11T16:08:46.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/36' 2020-02-11T16:08:46.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/20' 2020-02-11T16:08:46.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/39' 2020-02-11T16:08:46.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/34' 2020-02-11T16:08:46.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/38' 2020-02-11T16:08:46.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/28' 2020-02-11T16:08:46.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/24' 2020-02-11T16:08:46.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/29' 2020-02-11T16:08:46.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/32' 2020-02-11T16:08:46.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/22' 2020-02-11T16:08:46.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/25' 2020-02-11T16:08:46.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/30' 2020-02-11T16:08:46.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/33' 2020-02-11T16:08:46.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/23' 2020-02-11T16:08:46.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/35' 2020-02-11T16:08:46.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/26' 2020-02-11T16:08:46.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './284/37' 2020-02-11T16:08:46.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './284' 2020-02-11T16:08:46.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/21' 2020-02-11T16:08:46.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/27' 2020-02-11T16:08:46.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/31' 2020-02-11T16:08:46.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/36' 2020-02-11T16:08:46.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/20' 2020-02-11T16:08:46.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/39' 2020-02-11T16:08:46.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/34' 2020-02-11T16:08:46.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/38' 2020-02-11T16:08:46.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/28' 2020-02-11T16:08:46.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/24' 2020-02-11T16:08:46.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/29' 2020-02-11T16:08:46.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/32' 2020-02-11T16:08:46.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/22' 2020-02-11T16:08:46.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/25' 2020-02-11T16:08:46.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/30' 2020-02-11T16:08:46.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/33' 2020-02-11T16:08:46.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/23' 2020-02-11T16:08:46.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/35' 2020-02-11T16:08:46.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/26' 2020-02-11T16:08:46.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './285/37' 2020-02-11T16:08:46.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './285' 2020-02-11T16:08:46.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/21' 2020-02-11T16:08:46.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/27' 2020-02-11T16:08:46.055 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/31' 2020-02-11T16:08:46.055 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/36' 2020-02-11T16:08:46.055 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/20' 2020-02-11T16:08:46.056 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/39' 2020-02-11T16:08:46.056 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/34' 2020-02-11T16:08:46.056 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/38' 2020-02-11T16:08:46.056 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/28' 2020-02-11T16:08:46.056 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/24' 2020-02-11T16:08:46.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/29' 2020-02-11T16:08:46.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/32' 2020-02-11T16:08:46.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/22' 2020-02-11T16:08:46.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/25' 2020-02-11T16:08:46.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/30' 2020-02-11T16:08:46.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/33' 2020-02-11T16:08:46.057 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/23' 2020-02-11T16:08:46.058 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/35' 2020-02-11T16:08:46.058 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/26' 2020-02-11T16:08:46.058 INFO:tasks.workunit.client.0.smithi088.stdout:removed './286/37' 2020-02-11T16:08:46.058 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './286' 2020-02-11T16:08:46.734 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/21' 2020-02-11T16:08:46.734 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/27' 2020-02-11T16:08:46.734 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/31' 2020-02-11T16:08:46.734 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/36' 2020-02-11T16:08:46.734 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/20' 2020-02-11T16:08:46.735 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/39' 2020-02-11T16:08:46.735 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/34' 2020-02-11T16:08:46.735 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/38' 2020-02-11T16:08:46.735 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/28' 2020-02-11T16:08:46.735 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/24' 2020-02-11T16:08:46.735 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/29' 2020-02-11T16:08:46.735 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/32' 2020-02-11T16:08:46.736 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/22' 2020-02-11T16:08:46.736 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/25' 2020-02-11T16:08:46.736 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/30' 2020-02-11T16:08:46.736 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/33' 2020-02-11T16:08:46.736 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/23' 2020-02-11T16:08:46.736 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/35' 2020-02-11T16:08:46.736 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/26' 2020-02-11T16:08:46.737 INFO:tasks.workunit.client.0.smithi088.stdout:removed './287/37' 2020-02-11T16:08:46.737 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './287' 2020-02-11T16:08:46.737 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/21' 2020-02-11T16:08:46.737 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/27' 2020-02-11T16:08:46.737 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/31' 2020-02-11T16:08:46.737 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/36' 2020-02-11T16:08:46.737 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/20' 2020-02-11T16:08:46.738 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/39' 2020-02-11T16:08:46.738 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/34' 2020-02-11T16:08:46.738 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/38' 2020-02-11T16:08:46.738 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/28' 2020-02-11T16:08:46.738 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/24' 2020-02-11T16:08:46.738 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/29' 2020-02-11T16:08:46.738 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/32' 2020-02-11T16:08:46.739 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/22' 2020-02-11T16:08:46.739 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/25' 2020-02-11T16:08:46.739 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/30' 2020-02-11T16:08:46.739 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/33' 2020-02-11T16:08:46.739 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/23' 2020-02-11T16:08:46.739 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/35' 2020-02-11T16:08:46.739 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/26' 2020-02-11T16:08:46.739 INFO:tasks.workunit.client.0.smithi088.stdout:removed './288/37' 2020-02-11T16:08:46.740 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './288' 2020-02-11T16:08:46.740 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/21' 2020-02-11T16:08:46.740 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/27' 2020-02-11T16:08:46.740 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/31' 2020-02-11T16:08:46.740 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/36' 2020-02-11T16:08:46.740 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/20' 2020-02-11T16:08:46.740 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/39' 2020-02-11T16:08:46.741 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/34' 2020-02-11T16:08:46.741 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/38' 2020-02-11T16:08:46.741 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/28' 2020-02-11T16:08:46.741 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/24' 2020-02-11T16:08:46.741 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/29' 2020-02-11T16:08:46.741 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/32' 2020-02-11T16:08:46.741 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/22' 2020-02-11T16:08:46.742 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/25' 2020-02-11T16:08:46.742 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/30' 2020-02-11T16:08:46.742 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/33' 2020-02-11T16:08:46.742 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/23' 2020-02-11T16:08:46.742 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/35' 2020-02-11T16:08:46.742 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/26' 2020-02-11T16:08:46.742 INFO:tasks.workunit.client.0.smithi088.stdout:removed './289/37' 2020-02-11T16:08:46.743 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './289' 2020-02-11T16:08:46.743 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/21' 2020-02-11T16:08:46.743 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/27' 2020-02-11T16:08:46.743 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/31' 2020-02-11T16:08:46.743 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/36' 2020-02-11T16:08:46.743 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/20' 2020-02-11T16:08:46.743 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/39' 2020-02-11T16:08:46.744 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/34' 2020-02-11T16:08:46.744 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/38' 2020-02-11T16:08:46.744 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/28' 2020-02-11T16:08:46.744 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/24' 2020-02-11T16:08:46.744 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/29' 2020-02-11T16:08:46.744 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/32' 2020-02-11T16:08:46.744 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/22' 2020-02-11T16:08:46.744 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/25' 2020-02-11T16:08:46.745 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/30' 2020-02-11T16:08:46.745 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/33' 2020-02-11T16:08:46.745 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/23' 2020-02-11T16:08:46.745 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/35' 2020-02-11T16:08:46.745 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/26' 2020-02-11T16:08:46.745 INFO:tasks.workunit.client.0.smithi088.stdout:removed './290/37' 2020-02-11T16:08:46.745 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './290' 2020-02-11T16:08:46.746 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/21' 2020-02-11T16:08:46.746 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/27' 2020-02-11T16:08:46.746 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/31' 2020-02-11T16:08:46.746 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/36' 2020-02-11T16:08:46.746 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/20' 2020-02-11T16:08:46.746 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/39' 2020-02-11T16:08:46.747 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/34' 2020-02-11T16:08:46.747 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/38' 2020-02-11T16:08:46.747 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/28' 2020-02-11T16:08:46.748 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/24' 2020-02-11T16:08:46.749 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/29' 2020-02-11T16:08:46.749 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/32' 2020-02-11T16:08:46.749 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/22' 2020-02-11T16:08:46.749 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/25' 2020-02-11T16:08:46.749 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/30' 2020-02-11T16:08:46.749 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/33' 2020-02-11T16:08:46.750 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/23' 2020-02-11T16:08:46.750 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/35' 2020-02-11T16:08:46.750 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/26' 2020-02-11T16:08:46.750 INFO:tasks.workunit.client.0.smithi088.stdout:removed './291/37' 2020-02-11T16:08:46.750 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './291' 2020-02-11T16:08:46.750 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/21' 2020-02-11T16:08:46.750 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/27' 2020-02-11T16:08:46.751 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/31' 2020-02-11T16:08:46.751 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/36' 2020-02-11T16:08:46.751 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/20' 2020-02-11T16:08:46.751 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/39' 2020-02-11T16:08:46.751 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/34' 2020-02-11T16:08:46.751 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/38' 2020-02-11T16:08:46.751 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/28' 2020-02-11T16:08:46.751 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/24' 2020-02-11T16:08:46.752 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/29' 2020-02-11T16:08:46.752 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/32' 2020-02-11T16:08:46.752 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/22' 2020-02-11T16:08:46.752 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/25' 2020-02-11T16:08:46.752 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/30' 2020-02-11T16:08:46.752 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/33' 2020-02-11T16:08:46.752 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/23' 2020-02-11T16:08:46.752 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/35' 2020-02-11T16:08:46.753 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/26' 2020-02-11T16:08:46.753 INFO:tasks.workunit.client.0.smithi088.stdout:removed './292/37' 2020-02-11T16:08:46.753 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './292' 2020-02-11T16:08:46.753 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/21' 2020-02-11T16:08:46.753 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/27' 2020-02-11T16:08:46.753 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/31' 2020-02-11T16:08:46.753 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/36' 2020-02-11T16:08:46.754 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/20' 2020-02-11T16:08:46.754 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/39' 2020-02-11T16:08:46.754 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/34' 2020-02-11T16:08:46.754 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/38' 2020-02-11T16:08:46.754 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/28' 2020-02-11T16:08:46.754 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/24' 2020-02-11T16:08:46.754 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/29' 2020-02-11T16:08:46.755 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/32' 2020-02-11T16:08:46.755 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/22' 2020-02-11T16:08:46.755 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/25' 2020-02-11T16:08:46.755 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/30' 2020-02-11T16:08:46.755 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/33' 2020-02-11T16:08:46.755 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/23' 2020-02-11T16:08:46.756 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/35' 2020-02-11T16:08:46.756 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/26' 2020-02-11T16:08:46.756 INFO:tasks.workunit.client.0.smithi088.stdout:removed './293/37' 2020-02-11T16:08:46.756 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './293' 2020-02-11T16:08:46.756 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/21' 2020-02-11T16:08:46.757 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/27' 2020-02-11T16:08:46.757 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/31' 2020-02-11T16:08:46.757 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/36' 2020-02-11T16:08:46.757 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/20' 2020-02-11T16:08:46.757 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/39' 2020-02-11T16:08:46.757 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/34' 2020-02-11T16:08:46.757 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/38' 2020-02-11T16:08:46.757 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/28' 2020-02-11T16:08:46.758 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/24' 2020-02-11T16:08:46.758 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/29' 2020-02-11T16:08:46.758 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/32' 2020-02-11T16:08:46.758 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/22' 2020-02-11T16:08:46.758 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/25' 2020-02-11T16:08:46.758 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/30' 2020-02-11T16:08:46.758 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/33' 2020-02-11T16:08:46.759 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/23' 2020-02-11T16:08:46.759 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/35' 2020-02-11T16:08:46.759 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/26' 2020-02-11T16:08:46.759 INFO:tasks.workunit.client.0.smithi088.stdout:removed './294/37' 2020-02-11T16:08:46.759 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './294' 2020-02-11T16:08:46.759 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/21' 2020-02-11T16:08:46.759 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/27' 2020-02-11T16:08:46.759 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/31' 2020-02-11T16:08:46.760 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/36' 2020-02-11T16:08:46.760 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/20' 2020-02-11T16:08:46.760 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/39' 2020-02-11T16:08:46.760 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/34' 2020-02-11T16:08:46.760 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/38' 2020-02-11T16:08:46.760 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/28' 2020-02-11T16:08:46.760 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/24' 2020-02-11T16:08:46.761 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/29' 2020-02-11T16:08:46.761 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/32' 2020-02-11T16:08:46.761 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/22' 2020-02-11T16:08:46.761 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/25' 2020-02-11T16:08:46.761 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/30' 2020-02-11T16:08:46.761 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/33' 2020-02-11T16:08:46.761 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/23' 2020-02-11T16:08:46.761 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/35' 2020-02-11T16:08:46.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/26' 2020-02-11T16:08:46.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed './295/37' 2020-02-11T16:08:46.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './295' 2020-02-11T16:08:46.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/21' 2020-02-11T16:08:46.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/27' 2020-02-11T16:08:46.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/31' 2020-02-11T16:08:46.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/36' 2020-02-11T16:08:46.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/20' 2020-02-11T16:08:46.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/39' 2020-02-11T16:08:46.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/34' 2020-02-11T16:08:46.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/38' 2020-02-11T16:08:46.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/28' 2020-02-11T16:08:46.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/24' 2020-02-11T16:08:46.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/29' 2020-02-11T16:08:46.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/32' 2020-02-11T16:08:46.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/22' 2020-02-11T16:08:46.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/25' 2020-02-11T16:08:46.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/30' 2020-02-11T16:08:46.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/33' 2020-02-11T16:08:46.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/23' 2020-02-11T16:08:46.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/35' 2020-02-11T16:08:46.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/26' 2020-02-11T16:08:46.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './296/37' 2020-02-11T16:08:46.765 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './296' 2020-02-11T16:08:46.765 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/21' 2020-02-11T16:08:46.765 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/27' 2020-02-11T16:08:47.190 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/31' 2020-02-11T16:08:47.190 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/36' 2020-02-11T16:08:47.190 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/20' 2020-02-11T16:08:47.190 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/39' 2020-02-11T16:08:47.190 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/34' 2020-02-11T16:08:47.191 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/38' 2020-02-11T16:08:47.191 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/28' 2020-02-11T16:08:47.191 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/24' 2020-02-11T16:08:47.191 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/29' 2020-02-11T16:08:47.191 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/32' 2020-02-11T16:08:47.191 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/22' 2020-02-11T16:08:47.191 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/25' 2020-02-11T16:08:47.191 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/30' 2020-02-11T16:08:47.192 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/33' 2020-02-11T16:08:47.192 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/23' 2020-02-11T16:08:47.192 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/35' 2020-02-11T16:08:47.192 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/26' 2020-02-11T16:08:47.192 INFO:tasks.workunit.client.0.smithi088.stdout:removed './297/37' 2020-02-11T16:08:47.192 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './297' 2020-02-11T16:08:47.192 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/21' 2020-02-11T16:08:47.193 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/27' 2020-02-11T16:08:47.193 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/31' 2020-02-11T16:08:47.193 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/36' 2020-02-11T16:08:47.193 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/20' 2020-02-11T16:08:47.193 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/39' 2020-02-11T16:08:47.193 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/34' 2020-02-11T16:08:47.193 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/38' 2020-02-11T16:08:47.193 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/28' 2020-02-11T16:08:47.194 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/24' 2020-02-11T16:08:47.194 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/29' 2020-02-11T16:08:47.194 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/32' 2020-02-11T16:08:47.194 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/22' 2020-02-11T16:08:47.194 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/25' 2020-02-11T16:08:47.194 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/30' 2020-02-11T16:08:47.194 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/33' 2020-02-11T16:08:47.195 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/23' 2020-02-11T16:08:47.195 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/35' 2020-02-11T16:08:47.195 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/26' 2020-02-11T16:08:47.195 INFO:tasks.workunit.client.0.smithi088.stdout:removed './298/37' 2020-02-11T16:08:47.195 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './298' 2020-02-11T16:08:47.195 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/21' 2020-02-11T16:08:47.195 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/27' 2020-02-11T16:08:47.195 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/31' 2020-02-11T16:08:47.196 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/36' 2020-02-11T16:08:47.196 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/20' 2020-02-11T16:08:47.196 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/39' 2020-02-11T16:08:47.196 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/34' 2020-02-11T16:08:47.196 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/38' 2020-02-11T16:08:47.196 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/28' 2020-02-11T16:08:47.196 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/24' 2020-02-11T16:08:47.196 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/29' 2020-02-11T16:08:47.197 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/32' 2020-02-11T16:08:47.197 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/22' 2020-02-11T16:08:47.197 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/25' 2020-02-11T16:08:47.197 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/30' 2020-02-11T16:08:47.197 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/33' 2020-02-11T16:08:47.197 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/23' 2020-02-11T16:08:47.197 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/35' 2020-02-11T16:08:47.198 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/26' 2020-02-11T16:08:47.198 INFO:tasks.workunit.client.0.smithi088.stdout:removed './299/37' 2020-02-11T16:08:47.198 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './299' 2020-02-11T16:08:47.198 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/19' 2020-02-11T16:08:47.198 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/15' 2020-02-11T16:08:47.198 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/20' 2020-02-11T16:08:47.198 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/12' 2020-02-11T16:08:47.199 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/10' 2020-02-11T16:08:47.199 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/11' 2020-02-11T16:08:47.199 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/16' 2020-02-11T16:08:47.199 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/14' 2020-02-11T16:08:47.199 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/18' 2020-02-11T16:08:47.200 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/13' 2020-02-11T16:08:47.200 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/166/17' 2020-02-11T16:08:47.200 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/166' 2020-02-11T16:08:47.200 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/19' 2020-02-11T16:08:47.200 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/15' 2020-02-11T16:08:47.201 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/20' 2020-02-11T16:08:47.201 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/12' 2020-02-11T16:08:47.201 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/10' 2020-02-11T16:08:47.201 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/11' 2020-02-11T16:08:47.201 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/16' 2020-02-11T16:08:47.202 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/14' 2020-02-11T16:08:47.202 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/18' 2020-02-11T16:08:47.202 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/13' 2020-02-11T16:08:47.202 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/147/17' 2020-02-11T16:08:47.202 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/147' 2020-02-11T16:08:47.202 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/19' 2020-02-11T16:08:47.202 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/15' 2020-02-11T16:08:47.202 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/20' 2020-02-11T16:08:47.203 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/12' 2020-02-11T16:08:47.203 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/10' 2020-02-11T16:08:47.203 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/11' 2020-02-11T16:08:47.203 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/16' 2020-02-11T16:08:47.203 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/14' 2020-02-11T16:08:47.203 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/18' 2020-02-11T16:08:47.203 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/13' 2020-02-11T16:08:47.204 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/151/17' 2020-02-11T16:08:47.204 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/151' 2020-02-11T16:08:47.204 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/19' 2020-02-11T16:08:47.204 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/15' 2020-02-11T16:08:47.204 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/20' 2020-02-11T16:08:47.204 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/12' 2020-02-11T16:08:47.204 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/10' 2020-02-11T16:08:47.205 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/11' 2020-02-11T16:08:47.205 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/16' 2020-02-11T16:08:47.205 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/14' 2020-02-11T16:08:47.205 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/18' 2020-02-11T16:08:47.205 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/13' 2020-02-11T16:08:47.205 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/170/17' 2020-02-11T16:08:47.205 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/170' 2020-02-11T16:08:47.205 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/19' 2020-02-11T16:08:47.206 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/15' 2020-02-11T16:08:47.206 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/20' 2020-02-11T16:08:47.206 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/12' 2020-02-11T16:08:47.206 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/10' 2020-02-11T16:08:47.206 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/11' 2020-02-11T16:08:47.206 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/16' 2020-02-11T16:08:47.206 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/14' 2020-02-11T16:08:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/18' 2020-02-11T16:08:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/13' 2020-02-11T16:08:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/167/17' 2020-02-11T16:08:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/167' 2020-02-11T16:08:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/19' 2020-02-11T16:08:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/15' 2020-02-11T16:08:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/20' 2020-02-11T16:08:47.207 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/12' 2020-02-11T16:08:47.208 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/10' 2020-02-11T16:08:47.208 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/11' 2020-02-11T16:08:47.208 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/16' 2020-02-11T16:08:47.208 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/14' 2020-02-11T16:08:47.208 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/18' 2020-02-11T16:08:47.208 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/13' 2020-02-11T16:08:47.208 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/140/17' 2020-02-11T16:08:47.208 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/140' 2020-02-11T16:08:47.209 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/19' 2020-02-11T16:08:47.209 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/15' 2020-02-11T16:08:47.209 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/20' 2020-02-11T16:08:47.209 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/12' 2020-02-11T16:08:47.209 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/10' 2020-02-11T16:08:47.529 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:08:47.628 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/11' 2020-02-11T16:08:47.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/16' 2020-02-11T16:08:47.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/14' 2020-02-11T16:08:47.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/18' 2020-02-11T16:08:47.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/13' 2020-02-11T16:08:47.629 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/142/17' 2020-02-11T16:08:47.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/142' 2020-02-11T16:08:47.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/19' 2020-02-11T16:08:47.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/15' 2020-02-11T16:08:47.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/20' 2020-02-11T16:08:47.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/12' 2020-02-11T16:08:47.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/10' 2020-02-11T16:08:47.630 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/11' 2020-02-11T16:08:47.631 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/16' 2020-02-11T16:08:47.631 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/14' 2020-02-11T16:08:47.631 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/18' 2020-02-11T16:08:47.631 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/13' 2020-02-11T16:08:47.631 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/150/17' 2020-02-11T16:08:47.632 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/150' 2020-02-11T16:08:47.632 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/19' 2020-02-11T16:08:47.632 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/15' 2020-02-11T16:08:47.632 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/20' 2020-02-11T16:08:47.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/12' 2020-02-11T16:08:47.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/10' 2020-02-11T16:08:47.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/11' 2020-02-11T16:08:47.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/16' 2020-02-11T16:08:47.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/14' 2020-02-11T16:08:47.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/18' 2020-02-11T16:08:47.633 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/13' 2020-02-11T16:08:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/105/17' 2020-02-11T16:08:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/105' 2020-02-11T16:08:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/19' 2020-02-11T16:08:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/15' 2020-02-11T16:08:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/20' 2020-02-11T16:08:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/12' 2020-02-11T16:08:47.634 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/10' 2020-02-11T16:08:47.635 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/11' 2020-02-11T16:08:47.635 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/16' 2020-02-11T16:08:47.635 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/14' 2020-02-11T16:08:47.635 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/18' 2020-02-11T16:08:47.635 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/13' 2020-02-11T16:08:47.635 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/149/17' 2020-02-11T16:08:47.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/149' 2020-02-11T16:08:47.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/19' 2020-02-11T16:08:47.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/15' 2020-02-11T16:08:47.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/20' 2020-02-11T16:08:47.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/12' 2020-02-11T16:08:47.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/10' 2020-02-11T16:08:47.636 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/11' 2020-02-11T16:08:47.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/16' 2020-02-11T16:08:47.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/14' 2020-02-11T16:08:47.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/18' 2020-02-11T16:08:47.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/13' 2020-02-11T16:08:47.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/109/17' 2020-02-11T16:08:47.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/109' 2020-02-11T16:08:47.637 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/19' 2020-02-11T16:08:47.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/15' 2020-02-11T16:08:47.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/20' 2020-02-11T16:08:47.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/12' 2020-02-11T16:08:47.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/10' 2020-02-11T16:08:47.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/11' 2020-02-11T16:08:47.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/16' 2020-02-11T16:08:47.638 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/14' 2020-02-11T16:08:47.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/18' 2020-02-11T16:08:47.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/13' 2020-02-11T16:08:47.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/158/17' 2020-02-11T16:08:47.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/158' 2020-02-11T16:08:47.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/19' 2020-02-11T16:08:47.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/15' 2020-02-11T16:08:47.639 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/20' 2020-02-11T16:08:47.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/12' 2020-02-11T16:08:47.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/10' 2020-02-11T16:08:47.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/11' 2020-02-11T16:08:47.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/16' 2020-02-11T16:08:47.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/14' 2020-02-11T16:08:47.640 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/18' 2020-02-11T16:08:47.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/13' 2020-02-11T16:08:47.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/106/17' 2020-02-11T16:08:47.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/106' 2020-02-11T16:08:47.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/19' 2020-02-11T16:08:47.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/15' 2020-02-11T16:08:47.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/20' 2020-02-11T16:08:47.641 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/12' 2020-02-11T16:08:47.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/10' 2020-02-11T16:08:47.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/11' 2020-02-11T16:08:47.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/16' 2020-02-11T16:08:47.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/14' 2020-02-11T16:08:47.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/18' 2020-02-11T16:08:47.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/13' 2020-02-11T16:08:47.642 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/189/17' 2020-02-11T16:08:47.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/189' 2020-02-11T16:08:47.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/19' 2020-02-11T16:08:47.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/15' 2020-02-11T16:08:47.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/20' 2020-02-11T16:08:47.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/12' 2020-02-11T16:08:47.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/10' 2020-02-11T16:08:47.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/11' 2020-02-11T16:08:47.643 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/16' 2020-02-11T16:08:47.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/14' 2020-02-11T16:08:47.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/18' 2020-02-11T16:08:47.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/13' 2020-02-11T16:08:47.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/133/17' 2020-02-11T16:08:47.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/133' 2020-02-11T16:08:47.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/19' 2020-02-11T16:08:47.644 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/15' 2020-02-11T16:08:47.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/20' 2020-02-11T16:08:47.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/12' 2020-02-11T16:08:47.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/10' 2020-02-11T16:08:47.645 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/11' 2020-02-11T16:08:47.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.640+0000 7fa65b2a4700 1 Processor -- start 2020-02-11T16:08:47.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.640+0000 7fa65b2a4700 1 -- start start 2020-02-11T16:08:47.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.640+0000 7fa65b2a4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 0x7fa6541314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:47.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.640+0000 7fa65b2a4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:47.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.640+0000 7fa65b2a4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540adb40 con 0x7fa6540ad380 2020-02-11T16:08:47.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.640+0000 7fa65b2a4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa654137bf0 con 0x7fa654131920 2020-02-11T16:08:47.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.640+0000 7fa65b2a4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa654137de0 con 0x7fa6540a9130 2020-02-11T16:08:47.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.641+0000 7fa65883f700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 msgr2=0x7fa6541314c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:08:47.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.641+0000 7fa65883f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 0x7fa6541314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:47.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.641+0000 7fa659841700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:47.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.641+0000 7fa659841700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53500/0 (socket says 172.21.15.88:53500) 2020-02-11T16:08:47.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.641+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 learned_addr learned my addr 172.21.15.88:0/3885288093 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:47.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.641+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:08:47.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.641+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:08:47.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.641+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:08:47.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.641+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:47.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.842+0000 7fa65883f700 1 -- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 msgr2=0x7fa6541314c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:08:47.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.842+0000 7fa65883f700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 0x7fa6541314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:08:47.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.842+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:47.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.842+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:08:47.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.842+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:08:47.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.842+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:08:47.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:47.842+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:08:47.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/16' 2020-02-11T16:08:47.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/14' 2020-02-11T16:08:47.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/18' 2020-02-11T16:08:47.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/13' 2020-02-11T16:08:47.985 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/173/17' 2020-02-11T16:08:47.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/173' 2020-02-11T16:08:47.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/19' 2020-02-11T16:08:47.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/15' 2020-02-11T16:08:47.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/20' 2020-02-11T16:08:47.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/12' 2020-02-11T16:08:47.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/10' 2020-02-11T16:08:47.986 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/11' 2020-02-11T16:08:47.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/16' 2020-02-11T16:08:47.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/14' 2020-02-11T16:08:47.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/18' 2020-02-11T16:08:47.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/13' 2020-02-11T16:08:47.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/174/17' 2020-02-11T16:08:47.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/174' 2020-02-11T16:08:47.987 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/19' 2020-02-11T16:08:47.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/15' 2020-02-11T16:08:47.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/20' 2020-02-11T16:08:47.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/12' 2020-02-11T16:08:47.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/10' 2020-02-11T16:08:47.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/11' 2020-02-11T16:08:47.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/16' 2020-02-11T16:08:47.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/14' 2020-02-11T16:08:47.988 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/18' 2020-02-11T16:08:47.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/13' 2020-02-11T16:08:47.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/155/17' 2020-02-11T16:08:47.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/155' 2020-02-11T16:08:47.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/19' 2020-02-11T16:08:47.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/15' 2020-02-11T16:08:47.989 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/20' 2020-02-11T16:08:47.990 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/12' 2020-02-11T16:08:47.990 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/10' 2020-02-11T16:08:47.990 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/11' 2020-02-11T16:08:47.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/16' 2020-02-11T16:08:47.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/14' 2020-02-11T16:08:47.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/18' 2020-02-11T16:08:47.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/13' 2020-02-11T16:08:47.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/114/17' 2020-02-11T16:08:47.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/114' 2020-02-11T16:08:47.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/19' 2020-02-11T16:08:47.991 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/15' 2020-02-11T16:08:47.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/20' 2020-02-11T16:08:47.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/12' 2020-02-11T16:08:47.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/10' 2020-02-11T16:08:47.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/11' 2020-02-11T16:08:47.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/16' 2020-02-11T16:08:47.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/14' 2020-02-11T16:08:47.992 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/18' 2020-02-11T16:08:47.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/13' 2020-02-11T16:08:47.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/159/17' 2020-02-11T16:08:47.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/159' 2020-02-11T16:08:47.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/19' 2020-02-11T16:08:47.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/15' 2020-02-11T16:08:47.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/20' 2020-02-11T16:08:47.993 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/12' 2020-02-11T16:08:47.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/10' 2020-02-11T16:08:47.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/11' 2020-02-11T16:08:47.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/16' 2020-02-11T16:08:47.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/14' 2020-02-11T16:08:47.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/18' 2020-02-11T16:08:47.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/13' 2020-02-11T16:08:47.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/187/17' 2020-02-11T16:08:47.994 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/187' 2020-02-11T16:08:47.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/19' 2020-02-11T16:08:47.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/15' 2020-02-11T16:08:47.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/20' 2020-02-11T16:08:47.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/12' 2020-02-11T16:08:47.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/10' 2020-02-11T16:08:47.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/11' 2020-02-11T16:08:47.995 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/16' 2020-02-11T16:08:47.996 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/14' 2020-02-11T16:08:47.996 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/18' 2020-02-11T16:08:47.996 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/13' 2020-02-11T16:08:47.996 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/185/17' 2020-02-11T16:08:47.996 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/185' 2020-02-11T16:08:47.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/19' 2020-02-11T16:08:47.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/15' 2020-02-11T16:08:47.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/20' 2020-02-11T16:08:47.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/12' 2020-02-11T16:08:47.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/10' 2020-02-11T16:08:47.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/11' 2020-02-11T16:08:47.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/16' 2020-02-11T16:08:47.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/14' 2020-02-11T16:08:47.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/18' 2020-02-11T16:08:47.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/13' 2020-02-11T16:08:47.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/120/17' 2020-02-11T16:08:47.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/120' 2020-02-11T16:08:47.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/19' 2020-02-11T16:08:47.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/15' 2020-02-11T16:08:47.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/20' 2020-02-11T16:08:47.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/12' 2020-02-11T16:08:47.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/10' 2020-02-11T16:08:48.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/11' 2020-02-11T16:08:48.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/16' 2020-02-11T16:08:48.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/14' 2020-02-11T16:08:48.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/18' 2020-02-11T16:08:48.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/13' 2020-02-11T16:08:48.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/110/17' 2020-02-11T16:08:48.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/110' 2020-02-11T16:08:48.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/19' 2020-02-11T16:08:48.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/15' 2020-02-11T16:08:48.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/20' 2020-02-11T16:08:48.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/12' 2020-02-11T16:08:48.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/10' 2020-02-11T16:08:48.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/11' 2020-02-11T16:08:48.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/16' 2020-02-11T16:08:48.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:48.243+0000 7fa65883f700 1 -- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 msgr2=0x7fa6541314c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:08:48.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:48.243+0000 7fa65883f700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 0x7fa6541314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:08:48.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:48.243+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:48.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:48.243+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:08:48.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:48.243+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:08:48.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:48.243+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:08:48.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:48.243+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:08:48.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/14' 2020-02-11T16:08:48.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/18' 2020-02-11T16:08:48.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/13' 2020-02-11T16:08:48.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/137/17' 2020-02-11T16:08:48.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/137' 2020-02-11T16:08:48.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/19' 2020-02-11T16:08:48.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/15' 2020-02-11T16:08:48.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/20' 2020-02-11T16:08:48.460 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/12' 2020-02-11T16:08:48.461 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/10' 2020-02-11T16:08:48.461 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/11' 2020-02-11T16:08:48.461 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/16' 2020-02-11T16:08:48.461 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/14' 2020-02-11T16:08:48.462 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/18' 2020-02-11T16:08:48.462 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/13' 2020-02-11T16:08:48.462 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/198/17' 2020-02-11T16:08:48.462 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/198' 2020-02-11T16:08:48.462 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/19' 2020-02-11T16:08:48.463 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/15' 2020-02-11T16:08:48.463 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/20' 2020-02-11T16:08:48.463 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/12' 2020-02-11T16:08:48.463 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/10' 2020-02-11T16:08:48.463 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/11' 2020-02-11T16:08:48.464 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/16' 2020-02-11T16:08:48.464 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/14' 2020-02-11T16:08:48.464 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/18' 2020-02-11T16:08:48.464 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/13' 2020-02-11T16:08:48.465 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/136/17' 2020-02-11T16:08:48.465 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/136' 2020-02-11T16:08:48.465 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/19' 2020-02-11T16:08:48.465 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/15' 2020-02-11T16:08:48.466 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/20' 2020-02-11T16:08:48.466 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/12' 2020-02-11T16:08:48.466 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/10' 2020-02-11T16:08:48.467 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/11' 2020-02-11T16:08:48.467 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/16' 2020-02-11T16:08:48.467 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/14' 2020-02-11T16:08:48.467 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/18' 2020-02-11T16:08:48.468 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/13' 2020-02-11T16:08:48.468 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/125/17' 2020-02-11T16:08:48.468 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/125' 2020-02-11T16:08:48.468 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/19' 2020-02-11T16:08:48.468 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/15' 2020-02-11T16:08:48.469 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/20' 2020-02-11T16:08:48.469 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/12' 2020-02-11T16:08:48.469 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/10' 2020-02-11T16:08:48.469 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/11' 2020-02-11T16:08:48.470 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/16' 2020-02-11T16:08:48.471 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/14' 2020-02-11T16:08:48.471 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/18' 2020-02-11T16:08:48.471 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/13' 2020-02-11T16:08:48.471 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/194/17' 2020-02-11T16:08:48.472 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/194' 2020-02-11T16:08:48.472 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/19' 2020-02-11T16:08:48.472 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/15' 2020-02-11T16:08:48.472 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/20' 2020-02-11T16:08:48.472 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/12' 2020-02-11T16:08:48.473 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/10' 2020-02-11T16:08:48.473 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/11' 2020-02-11T16:08:48.473 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/16' 2020-02-11T16:08:48.473 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/14' 2020-02-11T16:08:48.473 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/18' 2020-02-11T16:08:48.474 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/13' 2020-02-11T16:08:48.474 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/119/17' 2020-02-11T16:08:48.474 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/119' 2020-02-11T16:08:48.475 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/19' 2020-02-11T16:08:48.475 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/15' 2020-02-11T16:08:48.475 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/20' 2020-02-11T16:08:48.475 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/12' 2020-02-11T16:08:48.475 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/10' 2020-02-11T16:08:48.475 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/11' 2020-02-11T16:08:48.475 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/16' 2020-02-11T16:08:48.476 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/14' 2020-02-11T16:08:48.476 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/18' 2020-02-11T16:08:48.476 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/13' 2020-02-11T16:08:48.476 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/157/17' 2020-02-11T16:08:48.476 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/157' 2020-02-11T16:08:48.476 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/19' 2020-02-11T16:08:48.476 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/15' 2020-02-11T16:08:48.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/20' 2020-02-11T16:08:48.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/12' 2020-02-11T16:08:48.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/10' 2020-02-11T16:08:48.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/11' 2020-02-11T16:08:48.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/16' 2020-02-11T16:08:48.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/14' 2020-02-11T16:08:48.477 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/18' 2020-02-11T16:08:48.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/13' 2020-02-11T16:08:48.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/172/17' 2020-02-11T16:08:48.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/172' 2020-02-11T16:08:48.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/19' 2020-02-11T16:08:48.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/15' 2020-02-11T16:08:48.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/20' 2020-02-11T16:08:48.478 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/12' 2020-02-11T16:08:48.479 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/10' 2020-02-11T16:08:48.479 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/11' 2020-02-11T16:08:48.479 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/16' 2020-02-11T16:08:48.479 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/14' 2020-02-11T16:08:48.479 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/18' 2020-02-11T16:08:48.479 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/13' 2020-02-11T16:08:48.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/186/17' 2020-02-11T16:08:48.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/186' 2020-02-11T16:08:48.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/19' 2020-02-11T16:08:48.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/15' 2020-02-11T16:08:48.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/20' 2020-02-11T16:08:48.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/12' 2020-02-11T16:08:48.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/10' 2020-02-11T16:08:48.480 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/11' 2020-02-11T16:08:48.481 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/16' 2020-02-11T16:08:48.481 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/14' 2020-02-11T16:08:49.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:49.044+0000 7fa65883f700 1 -- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 msgr2=0x7fa6541314c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:08:49.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:49.044+0000 7fa65883f700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 0x7fa6541314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:08:49.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:49.044+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:49.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:49.044+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:08:49.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:49.044+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:08:49.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:49.044+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:08:49.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:49.044+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:08:50.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:50.646+0000 7fa65883f700 1 -- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 msgr2=0x7fa6541314c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:08:50.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:50.646+0000 7fa65883f700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 0x7fa6541314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:08:50.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:50.646+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:50.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:50.646+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:08:50.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:50.646+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:08:50.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:50.646+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:08:50.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:50.646+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:08:51.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.693+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212148968 0 0) 0x7fa6540adb40 con 0x7fa6540ad380 2020-02-11T16:08:51.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.693+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa63c003230 con 0x7fa6540ad380 2020-02-11T16:08:51.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 196537037 0 0) 0x7fa63c003230 con 0x7fa6540ad380 2020-02-11T16:08:51.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 msgr2=0x7fa6541314c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:08:51.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 0x7fa6541314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:51.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 msgr2=0x7fa654131d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:08:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 --2- 172.21.15.88:0/3885288093 >> v2:172.21.15.88:3300/0 conn(0x7fa654131920 0x7fa654131d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540a8e70 con 0x7fa6540ad380 2020-02-11T16:08:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa6500016b0 con 0x7fa6540ad380 2020-02-11T16:08:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 >> v1:172.21.15.52:6789/0 conn(0x7fa6540ad380 legacy=0x7fa654138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa63c003720 0x7fa63c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 0x7fa63c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa63c004930 0x7fa63c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654137de0 con 0x7fa63c003720 2020-02-11T16:08:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c005390 con 0x7fa63c004930 2020-02-11T16:08:51.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c004130 con 0x7fa6540a9130 2020-02-11T16:08:51.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa65883f700 1 -- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 msgr2=0x7fa63c0044d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:08:51.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa65883f700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 0x7fa63c0044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:51.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.694+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa63c004930 0x7fa63c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 msgr2=0x7fa63c0044d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:08:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6540a9130 0x7fa63c0044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa63c003720 msgr2=0x7fa63c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:08:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa63c003720 0x7fa63c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c003230 con 0x7fa63c004930 2020-02-11T16:08:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa63c004930 0x7fa63c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa64c008cb0 tx=0x7fa64c0104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa63c004930 0x7fa63c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa64c008cb0 tx=0x7fa64c0104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa63c004930 0x7fa63c004db0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fa64c008cb0 tx=0x7fa64c0104f0).ready entity=mon.1 client_cookie=147763f382a8d588 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa63c004930 0x7fa63c004db0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa64c008cb0 tx=0x7fa64c0104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64c0112b0 con 0x7fa63c004930 2020-02-11T16:08:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa63c004930 0x7fa63c004db0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa64c008cb0 tx=0x7fa64c0104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa63c004930 0x7fa63c004db0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa64c008cb0 tx=0x7fa64c0104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c011410 con 0x7fa63c004930 2020-02-11T16:08:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa643fff700 1 -- 172.21.15.88:0/3885288093 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64c011770 con 0x7fa63c004930 2020-02-11T16:08:51.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa65b2a4700 1 -- 172.21.15.88:0/3885288093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa63c004930 msgr2=0x7fa63c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:51.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa65b2a4700 1 --2- 172.21.15.88:0/3885288093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa63c004930 0x7fa63c004db0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fa64c008cb0 tx=0x7fa64c0104f0).stop 2020-02-11T16:08:51.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.695+0000 7fa659841700 1 -- 172.21.15.88:0/3885288093 reap_dead start 2020-02-11T16:08:51.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.696+0000 7fa65b2a4700 1 -- 172.21.15.88:0/3885288093 shutdown_connections 2020-02-11T16:08:51.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.696+0000 7fa65b2a4700 1 -- 172.21.15.88:0/3885288093 >> 172.21.15.88:0/3885288093 conn(0x7fa65405ac70 msgr2=0x7fa6540ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:51.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.696+0000 7fa65b2a4700 1 -- 172.21.15.88:0/3885288093 shutdown_connections 2020-02-11T16:08:51.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.696+0000 7fa65b2a4700 1 -- 172.21.15.88:0/3885288093 wait complete. 2020-02-11T16:08:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.697+0000 7fa65b2a4700 1 Processor -- start 2020-02-11T16:08:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.697+0000 7fa65b2a4700 1 -- start start 2020-02-11T16:08:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65b2a4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa654148e90 0x7fa65412b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65b2a4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa654128240 0x7fa654128660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65b2a4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540a81a0 con 0x7fa654136fd0 2020-02-11T16:08:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65b2a4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6540a6070 con 0x7fa654128240 2020-02-11T16:08:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65b2a4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6540a6310 con 0x7fa654148e90 2020-02-11T16:08:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65883f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa654148e90 0x7fa65412b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65883f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa654148e90 0x7fa65412b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53532/0 (socket says 172.21.15.88:53532) 2020-02-11T16:08:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65883f700 1 -- 172.21.15.88:0/664366873 learned_addr learned my addr 172.21.15.88:0/664366873 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa659841700 1 --2- 172.21.15.88:0/664366873 >> v2:172.21.15.52:3300/0 conn(0x7fa654128240 0x7fa654128660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65883f700 1 -- 172.21.15.88:0/664366873 >> v2:172.21.15.52:3300/0 conn(0x7fa654128240 msgr2=0x7fa654128660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> v2:172.21.15.52:3300/0 conn(0x7fa654128240 0x7fa654128660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65883f700 1 -- 172.21.15.88:0/664366873 >> v1:172.21.15.52:6789/0 conn(0x7fa654136fd0 legacy=0x7fa654148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa65883f700 1 -- 172.21.15.88:0/664366873 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540a65b0 con 0x7fa654148e90 2020-02-11T16:08:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.698+0000 7fa659841700 1 --2- 172.21.15.88:0/664366873 >> v2:172.21.15.52:3300/0 conn(0x7fa654128240 0x7fa654128660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:08:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.699+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> v2:172.21.15.88:3300/0 conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.699+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> v2:172.21.15.88:3300/0 conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.699+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.699+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.699+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.699+0000 7fa6427fc700 1 -- 172.21.15.88:0/664366873 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64400e8e0 con 0x7fa654148e90 2020-02-11T16:08:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.699+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.699+0000 7fa6427fc700 1 -- 172.21.15.88:0/664366873 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64400ea80 con 0x7fa654148e90 2020-02-11T16:08:51.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.699+0000 7fa65b2a4700 1 -- 172.21.15.88:0/664366873 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65412bb90 con 0x7fa654148e90 2020-02-11T16:08:51.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.699+0000 7fa6427fc700 1 -- 172.21.15.88:0/664366873 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64400eea0 con 0x7fa654148e90 2020-02-11T16:08:51.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.700+0000 7fa65b2a4700 1 -- 172.21.15.88:0/664366873 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa654128ac0 con 0x7fa654148e90 2020-02-11T16:08:51.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.700+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.700+0000 7fa6427fc700 1 -- 172.21.15.88:0/664366873 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa64400a0c0 con 0x7fa654148e90 2020-02-11T16:08:51.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.700+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.700+0000 7fa6427fc700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa634039be0 0x7fa63403c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:51.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.700+0000 7fa6427fc700 1 -- 172.21.15.88:0/664366873 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa64404d0a0 con 0x7fa654148e90 2020-02-11T16:08:51.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.701+0000 7fa659040700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa634039be0 0x7fa63403c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:51.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.701+0000 7fa65b2a4700 1 -- 172.21.15.88:0/664366873 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6540a6740 con 0x7fa654148e90 2020-02-11T16:08:51.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.701+0000 7fa659040700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa634039be0 0x7fa63403c0a0 crc :-1 s=READY pgs=161 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:51.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.704+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.705+0000 7fa6427fc700 1 -- 172.21.15.88:0/664366873 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fa64402f320 con 0x7fa654148e90 2020-02-11T16:08:51.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.891+0000 7fa65b2a4700 1 -- 172.21.15.88:0/664366873 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa6540565b0 con 0x7fa654148e90 2020-02-11T16:08:51.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.892+0000 7fa65883f700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:51.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.892+0000 7fa6427fc700 1 -- 172.21.15.88:0/664366873 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7fa644031df0 con 0x7fa654148e90 2020-02-11T16:08:51.895 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":42,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 -- 172.21.15.88:0/664366873 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa634039be0 msgr2=0x7fa63403c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa634039be0 0x7fa63403c0a0 crc :-1 s=READY pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:51.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 -- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 msgr2=0x7fa65412b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:51.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 0x7fa65412b730 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fa644000b20 tx=0x7fa644010aa0).stop 2020-02-11T16:08:51.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 -- 172.21.15.88:0/664366873 shutdown_connections 2020-02-11T16:08:51.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa634039be0 0x7fa63403c0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:51.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 --2- 172.21.15.88:0/664366873 >> v2:172.21.15.52:3300/0 conn(0x7fa654128240 0x7fa654128660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:51.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 --2- 172.21.15.88:0/664366873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654148e90 0x7fa65412b730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:51.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 -- 172.21.15.88:0/664366873 >> 172.21.15.88:0/664366873 conn(0x7fa65405ac70 msgr2=0x7fa654069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:51.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 -- 172.21.15.88:0/664366873 shutdown_connections 2020-02-11T16:08:51.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:51.893+0000 7fa65b2a4700 1 -- 172.21.15.88:0/664366873 wait complete. 2020-02-11T16:08:51.905 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":42,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:08:51.905 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:08:51.906 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:08:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.010+0000 7fa1f7a6f700 1 Processor -- start 2020-02-11T16:08:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.010+0000 7fa1f7a6f700 1 -- start start 2020-02-11T16:08:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f7a6f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f7a6f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1f00a6260 0x7fa1f012eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f7a6f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00a3570 con 0x7fa1f00a5de0 2020-02-11T16:08:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f7a6f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f00a3810 con 0x7fa1f00a6260 2020-02-11T16:08:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f7a6f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f00a3ab0 con 0x7fa1f00a18a0 2020-02-11T16:08:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f580b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f580b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53540/0 (socket says 172.21.15.88:53540) 2020-02-11T16:08:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f580b700 1 -- 172.21.15.88:0/978045038 learned_addr learned my addr 172.21.15.88:0/978045038 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f600c700 1 --2- 172.21.15.88:0/978045038 >> v2:172.21.15.52:3300/0 conn(0x7fa1f00a6260 0x7fa1f012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f580b700 1 -- 172.21.15.88:0/978045038 >> v2:172.21.15.52:3300/0 conn(0x7fa1f00a6260 msgr2=0x7fa1f012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:08:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f580b700 1 --2- 172.21.15.88:0/978045038 >> v2:172.21.15.52:3300/0 conn(0x7fa1f00a6260 0x7fa1f012eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f580b700 1 -- 172.21.15.88:0/978045038 >> v1:172.21.15.52:6789/0 conn(0x7fa1f00a5de0 legacy=0x7fa1f012e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f580b700 1 -- 172.21.15.88:0/978045038 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00a3d50 con 0x7fa1f00a18a0 2020-02-11T16:08:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f580b700 1 --2- 172.21.15.88:0/978045038 >> v2:172.21.15.88:3300/0 conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa1e0002f30 tx=0x7fa1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f580b700 1 --2- 172.21.15.88:0/978045038 >> v2:172.21.15.88:3300/0 conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa1e0002f30 tx=0x7fa1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.011+0000 7fa1f580b700 1 --2- 172.21.15.88:0/978045038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fa1e0002f30 tx=0x7fa1e0007a40).ready entity=mon.1 client_cookie=2ddf978ead30aec server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f580b700 1 --2- 172.21.15.88:0/978045038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fa1e0002f30 tx=0x7fa1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f4809700 1 -- 172.21.15.88:0/978045038 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e0011670 con 0x7fa1f00a18a0 2020-02-11T16:08:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f580b700 1 --2- 172.21.15.88:0/978045038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fa1e0002f30 tx=0x7fa1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f580b700 1 --2- 172.21.15.88:0/978045038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fa1e0002f30 tx=0x7fa1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f4809700 1 -- 172.21.15.88:0/978045038 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e00117d0 con 0x7fa1f00a18a0 2020-02-11T16:08:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f4809700 1 -- 172.21.15.88:0/978045038 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e0011bb0 con 0x7fa1f00a18a0 2020-02-11T16:08:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/978045038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f00a18a0 msgr2=0x7fa1f00a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f7a6f700 1 --2- 172.21.15.88:0/978045038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fa1e0002f30 tx=0x7fa1e0007a40).stop 2020-02-11T16:08:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/978045038 shutdown_connections 2020-02-11T16:08:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f7a6f700 1 --2- 172.21.15.88:0/978045038 >> v2:172.21.15.52:3300/0 conn(0x7fa1f00a6260 0x7fa1f012eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:08:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f7a6f700 1 --2- 172.21.15.88:0/978045038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f00a18a0 0x7fa1f00a6dd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/978045038 >> 172.21.15.88:0/978045038 conn(0x7fa1f009d110 msgr2=0x7fa1f009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:52.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/978045038 shutdown_connections 2020-02-11T16:08:52.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.012+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/978045038 wait complete. 2020-02-11T16:08:52.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.013+0000 7fa1f7a6f700 1 Processor -- start 2020-02-11T16:08:52.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.013+0000 7fa1f7a6f700 1 -- start start 2020-02-11T16:08:52.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f7a6f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1f00a5de0 0x7fa1f01494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:52.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f7a6f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1f00a6260 0x7fa1f0124e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:52.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f7a6f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f0149930 con 0x7fa1f00a18a0 2020-02-11T16:08:52.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f7a6f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f00a2940 con 0x7fa1f00a6260 2020-02-11T16:08:52.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f7a6f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0134e50 con 0x7fa1f00a5de0 2020-02-11T16:08:52.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f580b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa1f00a18a0 0x7fa1f0148dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41170/0 (socket says 172.21.15.88:41170) 2020-02-11T16:08:52.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f580b700 1 -- 172.21.15.88:0/776612462 learned_addr learned my addr 172.21.15.88:0/776612462 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:52.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f500a700 1 -- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1f00a5de0 msgr2=0x7fa1f01494d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:08:52.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f500a700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1f00a5de0 0x7fa1f01494d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:52.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f600c700 1 --2- 172.21.15.88:0/776612462 >> v2:172.21.15.52:3300/0 conn(0x7fa1f00a6260 0x7fa1f0124e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476414493 0 0) 0x7fa1f0149930 con 0x7fa1f00a18a0 2020-02-11T16:08:52.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1d0002fe0 con 0x7fa1f00a18a0 2020-02-11T16:08:52.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4160655252 0 0) 0x7fa1d0002fe0 con 0x7fa1f00a18a0 2020-02-11T16:08:52.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa1f0149930 con 0x7fa1f00a18a0 2020-02-11T16:08:52.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa1e0011e30 con 0x7fa1f00a18a0 2020-02-11T16:08:52.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f600c700 1 -- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1f00a5de0 msgr2=0x7fa1f01494d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:08:52.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f600c700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1f00a5de0 0x7fa1f01494d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f600c700 1 -- 172.21.15.88:0/776612462 >> v1:172.21.15.88:6789/0 conn(0x7fa1f00a18a0 legacy=0x7fa1f0148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f600c700 1 -- 172.21.15.88:0/776612462 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f012d960 con 0x7fa1f00a6260 2020-02-11T16:08:52.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f600c700 1 --2- 172.21.15.88:0/776612462 >> v2:172.21.15.52:3300/0 conn(0x7fa1f00a6260 0x7fa1f0124e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1e80032b0 tx=0x7fa1e8010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f600c700 1 --2- 172.21.15.88:0/776612462 >> v2:172.21.15.52:3300/0 conn(0x7fa1f00a6260 0x7fa1f0124e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1e80032b0 tx=0x7fa1e8010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f600c700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1f00a6260 0x7fa1f0124e60 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fa1e80032b0 tx=0x7fa1e8010f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:52.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f600c700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1f00a6260 0x7fa1f0124e60 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa1e80032b0 tx=0x7fa1e8010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e8012af0 con 0x7fa1f00a6260 2020-02-11T16:08:52.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f600c700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1f00a6260 0x7fa1f0124e60 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa1e80032b0 tx=0x7fa1e8010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.014+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/776612462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f00a0690 con 0x7fa1f00a6260 2020-02-11T16:08:52.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.015+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e8012c50 con 0x7fa1f00a6260 2020-02-11T16:08:52.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.015+0000 7fa1f600c700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1f00a6260 0x7fa1f0124e60 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa1e80032b0 tx=0x7fa1e8010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.015+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e800a160 con 0x7fa1f00a6260 2020-02-11T16:08:52.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.015+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/776612462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f01320d0 con 0x7fa1f00a6260 2020-02-11T16:08:52.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.015+0000 7fa1f600c700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1f00a6260 0x7fa1f0124e60 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa1e80032b0 tx=0x7fa1e8010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.015+0000 7fa1f7a6f700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 0x7fa1f01252c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:52.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.015+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/776612462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f005e2f0 con 0x7fa1f005aa60 2020-02-11T16:08:52.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.015+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa1e800a350 con 0x7fa1f00a6260 2020-02-11T16:08:52.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.015+0000 7fa1f600c700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1f00a6260 0x7fa1f0124e60 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa1e80032b0 tx=0x7fa1e8010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.015+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 0x7fa1f01252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1deffd700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa1d003a210 0x7fa1d003c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:52.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa1e804a030 con 0x7fa1f00a6260 2020-02-11T16:08:52.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1f580b700 1 -- 172.21.15.88:0/776612462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1f01356e0 con 0x7fa1f005aa60 2020-02-11T16:08:52.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 0x7fa1f01252c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 0x7fa1f01252c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 0x7fa1f01252c0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1f500a700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa1d003a210 0x7fa1d003c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 0x7fa1f01252c0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e0007530 con 0x7fa1f005aa60 2020-02-11T16:08:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1f500a700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa1d003a210 0x7fa1d003c6d0 crc :-1 s=READY pgs=162 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 0x7fa1f01252c0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa1e00056c0 con 0x7fa1f005aa60 2020-02-11T16:08:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 msgr2=0x7fa1f01252c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1deffd700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 0x7fa1f01252c0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007ae0).stop 2020-02-11T16:08:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 msgr2=0x7fa1f01252c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.016+0000 7fa1deffd700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f005aa60 0x7fa1f01252c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.024+0000 7fa1f7a6f700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 0x7fa1f012f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.024+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/776612462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0135310 con 0x7fa1f0125720 2020-02-11T16:08:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.024+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 0x7fa1f012f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.024+0000 7fa1f580b700 1 -- 172.21.15.88:0/776612462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa1f00565b0 con 0x7fa1f0125720 2020-02-11T16:08:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.024+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 0x7fa1f012f410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 0x7fa1f012f410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 0x7fa1f012f410 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:52.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 0x7fa1f012f410 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e000ec60 con 0x7fa1f0125720 2020-02-11T16:08:52.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f580b700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 0x7fa1f012f410 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4348 (secure 0 0 0) 0x7fa1e000b450 con 0x7fa1f0125720 2020-02-11T16:08:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 msgr2=0x7fa1f012f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1deffd700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 0x7fa1f012f410 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fa1e0002ef0 tx=0x7fa1e0007d20).stop 2020-02-11T16:08:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1deffd700 1 -- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 msgr2=0x7fa1f012f410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1deffd700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f0125720 0x7fa1f012f410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa1d003a210 msgr2=0x7fa1d003c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f7a6f700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa1d003a210 0x7fa1d003c6d0 crc :-1 s=READY pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1f00a6260 msgr2=0x7fa1f0124e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f7a6f700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1f00a6260 0x7fa1f0124e60 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fa1e80032b0 tx=0x7fa1e8010f10).stop 2020-02-11T16:08:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f600c700 1 -- 172.21.15.88:0/776612462 reap_dead start 2020-02-11T16:08:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f600c700 1 -- 172.21.15.88:0/776612462 reap_dead start 2020-02-11T16:08:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/776612462 shutdown_connections 2020-02-11T16:08:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f7a6f700 1 --2- 172.21.15.88:0/776612462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1f00a6260 0x7fa1f0124e60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/776612462 >> 172.21.15.88:0/776612462 conn(0x7fa1f009d110 msgr2=0x7fa1f00a92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:52.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/776612462 shutdown_connections 2020-02-11T16:08:52.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.025+0000 7fa1f7a6f700 1 -- 172.21.15.88:0/776612462 wait complete. 2020-02-11T16:08:52.044 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:08:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:08:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 42, 2020-02-11T16:08:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:08:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:08:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:08:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:08:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:08:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:08:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:08:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:08:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:08:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:08:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:08:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:08:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:08:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:08:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:08:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:08:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:08:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:08:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:08:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:08:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:08:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:08:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:08:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:52.055 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.055 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:52.055 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:52.055 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:52.055 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:52.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.056 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:52.056 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:08:52.056 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.056 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.056 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:52.056 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:08:52.056 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.057 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.057 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.057 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.057 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:08:52.057 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:08:52.057 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:52.058 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:52.058 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.058 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.058 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:08:52.058 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:08:52.058 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:52.058 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:52.059 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.059 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:52.059 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:08:52.059 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.059 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.059 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.060 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:52.060 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:08:52.060 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.060 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.060 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.060 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.060 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:08:52.061 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:08:52.061 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:52.061 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:52.061 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.061 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.061 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.061 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:08:52.062 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:08:52.062 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.062 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:52.062 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:52.062 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:52.062 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.062 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.062 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:08:52.063 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.063 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:52.063 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:52.063 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:52.063 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.063 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.063 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:08:52.064 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.064 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:52.064 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:52.064 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:08:52.064 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.064 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.064 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:08:52.064 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.065 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:52.065 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:52.065 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:08:52.065 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.065 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.065 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:08:52.065 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.066 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:52.066 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:52.066 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:08:52.066 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.066 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.066 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.066 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:08:52.068 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:08:52.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.172+0000 7f8b17da6700 1 Processor -- start 2020-02-11T16:08:52.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.172+0000 7f8b17da6700 1 -- start start 2020-02-11T16:08:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.173+0000 7f8b17da6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b100a1520 0x7f8b10131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.173+0000 7f8b17da6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b100a4350 con 0x7f8b100a2fa0 2020-02-11T16:08:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.173+0000 7f8b17da6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b100a3a40 con 0x7f8b100a5b20 2020-02-11T16:08:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.173+0000 7f8b17da6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100a1e60 con 0x7f8b100a1520 2020-02-11T16:08:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.173+0000 7f8b15341700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8b100a5b20 0x7f8b10131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41184/0 (socket says 172.21.15.88:41184) 2020-02-11T16:08:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.173+0000 7f8b15341700 1 -- 172.21.15.88:0/3397369124 learned_addr learned my addr 172.21.15.88:0/3397369124 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.173+0000 7f8b16343700 1 --2- 172.21.15.88:0/3397369124 >> v2:172.21.15.52:3300/0 conn(0x7f8b100a1520 0x7f8b10131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.173+0000 7f8b14b40700 1 -- 172.21.15.88:0/3397369124 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682064289 0 0) 0x7f8b100a3a40 con 0x7f8b100a5b20 2020-02-11T16:08:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.173+0000 7f8b14b40700 1 -- 172.21.15.88:0/3397369124 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8af8003230 con 0x7f8b100a5b20 2020-02-11T16:08:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b14b40700 1 -- 172.21.15.88:0/3397369124 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3439251091 0 0) 0x7f8af8003230 con 0x7f8b100a5b20 2020-02-11T16:08:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b16343700 1 -- 172.21.15.88:0/3397369124 >> v1:172.21.15.88:6789/0 conn(0x7f8b100a5b20 legacy=0x7f8b10131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b16343700 1 -- 172.21.15.88:0/3397369124 >> v1:172.21.15.52:6789/0 conn(0x7f8b100a2fa0 legacy=0x7f8b100a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b16343700 1 -- 172.21.15.88:0/3397369124 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100a3ce0 con 0x7f8b100a1520 2020-02-11T16:08:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b16343700 1 --2- 172.21.15.88:0/3397369124 >> v2:172.21.15.52:3300/0 conn(0x7f8b100a1520 0x7f8b10131990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b000010d0 tx=0x7f8b08008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b16343700 1 --2- 172.21.15.88:0/3397369124 >> v2:172.21.15.52:3300/0 conn(0x7f8b100a1520 0x7f8b10131990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b000010d0 tx=0x7f8b08008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b16343700 1 --2- 172.21.15.88:0/3397369124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b100a1520 0x7f8b10131990 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f8b000010d0 tx=0x7f8b08008c60).ready entity=mon.0 client_cookie=47b89c683367be3a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b16343700 1 --2- 172.21.15.88:0/3397369124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b100a1520 0x7f8b10131990 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f8b000010d0 tx=0x7f8b08008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b14b40700 1 -- 172.21.15.88:0/3397369124 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0c0016d0 con 0x7f8b100a1520 2020-02-11T16:08:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b16343700 1 --2- 172.21.15.88:0/3397369124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b100a1520 0x7f8b10131990 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f8b000010d0 tx=0x7f8b08008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b14b40700 1 -- 172.21.15.88:0/3397369124 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b08010b30 con 0x7f8b100a1520 2020-02-11T16:08:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b16343700 1 --2- 172.21.15.88:0/3397369124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b100a1520 0x7f8b10131990 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f8b000010d0 tx=0x7f8b08008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b17da6700 1 -- 172.21.15.88:0/3397369124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b100a1520 msgr2=0x7f8b10131990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b14b40700 1 -- 172.21.15.88:0/3397369124 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b08010e90 con 0x7f8b100a1520 2020-02-11T16:08:52.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b17da6700 1 --2- 172.21.15.88:0/3397369124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b100a1520 0x7f8b10131990 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f8b000010d0 tx=0x7f8b08008c60).stop 2020-02-11T16:08:52.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b17da6700 1 -- 172.21.15.88:0/3397369124 shutdown_connections 2020-02-11T16:08:52.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.174+0000 7f8b17da6700 1 --2- 172.21.15.88:0/3397369124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b100a1520 0x7f8b10131990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.175+0000 7f8b17da6700 1 -- 172.21.15.88:0/3397369124 >> 172.21.15.88:0/3397369124 conn(0x7f8b1009d110 msgr2=0x7f8b1009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.175+0000 7f8b17da6700 1 -- 172.21.15.88:0/3397369124 shutdown_connections 2020-02-11T16:08:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.175+0000 7f8b17da6700 1 -- 172.21.15.88:0/3397369124 wait complete. 2020-02-11T16:08:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.175+0000 7f8b17da6700 1 Processor -- start 2020-02-11T16:08:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.175+0000 7f8b17da6700 1 -- start start 2020-02-11T16:08:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b17da6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b100a1520 0x7f8b1009f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:52.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b17da6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b100a1040 con 0x7f8b100a5b20 2020-02-11T16:08:52.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b17da6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1009ed10 con 0x7f8b100a2fa0 2020-02-11T16:08:52.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b17da6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b10131df0 con 0x7f8b100a1520 2020-02-11T16:08:52.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b15b42700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b100a1520 0x7f8b1009f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b15b42700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b100a1520 0x7f8b1009f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53562/0 (socket says 172.21.15.88:53562) 2020-02-11T16:08:52.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b15341700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8b100a2fa0 0x7f8b1009e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41190/0 (socket says 172.21.15.88:41190) 2020-02-11T16:08:52.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b15b42700 1 -- 172.21.15.88:0/3244064427 learned_addr learned my addr 172.21.15.88:0/3244064427 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:52.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b15b42700 1 -- 172.21.15.88:0/3244064427 >> v1:172.21.15.88:6789/0 conn(0x7f8b100a2fa0 legacy=0x7f8b1009e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b15b42700 1 -- 172.21.15.88:0/3244064427 >> v1:172.21.15.52:6789/0 conn(0x7f8b100a5b20 legacy=0x7f8b100667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b15b42700 1 -- 172.21.15.88:0/3244064427 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100a0da0 con 0x7f8b100a1520 2020-02-11T16:08:52.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267062022 0 0) 0x7f8b1009ed10 con 0x7f8b100a2fa0 2020-02-11T16:08:52.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.176+0000 7f8b15b42700 1 --2- 172.21.15.88:0/3244064427 >> v2:172.21.15.88:3300/0 conn(0x7f8b100a1520 0x7f8b1009f4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b00001190 tx=0x7f8b00010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8b15b42700 1 --2- 172.21.15.88:0/3244064427 >> v2:172.21.15.88:3300/0 conn(0x7f8b100a1520 0x7f8b1009f4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b00001190 tx=0x7f8b00010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8b15b42700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b100a1520 0x7f8b1009f4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f8b00001190 tx=0x7f8b00010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:52.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8b15b42700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b100a1520 0x7f8b1009f4d0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8b00001190 tx=0x7f8b00010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0000cc20 con 0x7f8b100a1520 2020-02-11T16:08:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8b15b42700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b100a1520 0x7f8b1009f4d0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8b00001190 tx=0x7f8b00010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8b15b42700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b100a1520 0x7f8b1009f4d0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8b00001190 tx=0x7f8b00010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0000cd80 con 0x7f8b100a1520 2020-02-11T16:08:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b00012430 con 0x7f8b100a1520 2020-02-11T16:08:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8b17da6700 1 -- 172.21.15.88:0/3244064427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1009f090 con 0x7f8b100a1520 2020-02-11T16:08:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8b17da6700 1 -- 172.21.15.88:0/3244064427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b10066ec0 con 0x7f8b100a1520 2020-02-11T16:08:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8b15b42700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b100a1520 0x7f8b1009f4d0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8b00001190 tx=0x7f8b00010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8b00012590 con 0x7f8b100a1520 2020-02-11T16:08:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.177+0000 7f8b15b42700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b100a1520 0x7f8b1009f4d0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8b00001190 tx=0x7f8b00010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8afeffd700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8af0039a70 0x7f8af003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8b17da6700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 0x7f8b101387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8b17da6700 1 -- 172.21.15.88:0/3244064427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1005e2f0 con 0x7f8b10140ed0 2020-02-11T16:08:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8b000498d0 con 0x7f8b100a1520 2020-02-11T16:08:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 0x7f8b101387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8b15341700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8af0039a70 0x7f8af003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8b16343700 1 -- 172.21.15.88:0/3244064427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b100a2570 con 0x7f8b10140ed0 2020-02-11T16:08:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8b15341700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8af0039a70 0x7f8af003bf30 crc :-1 s=READY pgs=163 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 0x7f8b101387d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 0x7f8b101387d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 0x7f8b101387d0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 0x7f8b101387d0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.178+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b08007c80 con 0x7f8b10140ed0 2020-02-11T16:08:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.179+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 0x7f8b101387d0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.179+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8b08005e40 con 0x7f8b10140ed0 2020-02-11T16:08:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.179+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 msgr2=0x7f8b101387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.179+0000 7f8afeffd700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 0x7f8b101387d0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).stop 2020-02-11T16:08:52.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.179+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 msgr2=0x7f8b101387d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:52.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.179+0000 7f8afeffd700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b10140ed0 0x7f8b101387d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.187+0000 7f8b17da6700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 0x7f8b100a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.187+0000 7f8b17da6700 1 -- 172.21.15.88:0/3244064427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100565b0 con 0x7f8b1009ef90 2020-02-11T16:08:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.187+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 0x7f8b100a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.187+0000 7f8b16343700 1 -- 172.21.15.88:0/3244064427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8b101412e0 con 0x7f8b1009ef90 2020-02-11T16:08:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.187+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 0x7f8b100a7fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.187+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 0x7f8b100a7fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.187+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 0x7f8b100a7fe0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 0x7f8b100a7fe0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b08015640 con 0x7f8b1009ef90 2020-02-11T16:08:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b16343700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 0x7f8b100a7fe0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4180 (secure 0 0 0) 0x7f8b080157a0 con 0x7f8b1009ef90 2020-02-11T16:08:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 msgr2=0x7f8b100a7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8afeffd700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 0x7f8b100a7fe0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f8b100a0b70 tx=0x7f8b08008290).stop 2020-02-11T16:08:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8afeffd700 1 -- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 msgr2=0x7f8b100a7fe0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:08:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8afeffd700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1009ef90 0x7f8b100a7fe0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b17da6700 1 -- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8af0039a70 msgr2=0x7f8af003bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b17da6700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8af0039a70 0x7f8af003bf30 crc :-1 s=READY pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b17da6700 1 -- 172.21.15.88:0/3244064427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b100a1520 msgr2=0x7f8b1009f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b17da6700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b100a1520 0x7f8b1009f4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f8b00001190 tx=0x7f8b00010ba0).stop 2020-02-11T16:08:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b16343700 1 -- 172.21.15.88:0/3244064427 reap_dead start 2020-02-11T16:08:52.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b17da6700 1 -- 172.21.15.88:0/3244064427 shutdown_connections 2020-02-11T16:08:52.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b17da6700 1 --2- 172.21.15.88:0/3244064427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b100a1520 0x7f8b1009f4d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:52.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b17da6700 1 -- 172.21.15.88:0/3244064427 >> 172.21.15.88:0/3244064427 conn(0x7f8b1009d110 msgr2=0x7f8b1005a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:52.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b17da6700 1 -- 172.21.15.88:0/3244064427 shutdown_connections 2020-02-11T16:08:52.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:08:52.188+0000 7f8b17da6700 1 -- 172.21.15.88:0/3244064427 wait complete. 2020-02-11T16:08:52.208 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:08:52.208 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:52.209 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:52.209 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:08:52.209 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 42, 2020-02-11T16:08:52.209 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:08:52.209 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:08:52.209 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:08:52.209 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:08:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:08:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:08:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:52.211 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:52.211 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:52.211 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.211 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:08:52.211 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:08:52.211 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:52.211 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:52.212 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:52.212 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:52.212 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:52.212 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:52.212 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.212 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:08:52.212 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:08:52.213 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:08:52.213 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:08:52.213 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:08:52.213 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:08:52.213 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:52.213 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:08:52.213 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:08:52.214 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:08:52.214 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:08:52.214 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:08:52.214 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:08:52.214 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:08:52.214 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:08:52.214 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:08:52.215 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:08:52.215 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:08:52.215 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.215 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:08:52.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.215 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:08:52.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.215 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:08:52.216 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:08:52.216 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:52.216 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:52.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.216 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:52.216 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:08:52.216 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.217 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:52.217 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:08:52.217 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.217 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.217 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.218 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:08:52.218 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:08:52.218 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:52.218 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:52.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.219 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:08:52.219 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:08:52.219 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:52.219 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:52.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.220 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:52.220 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:08:52.220 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.220 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:52.221 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:08:52.221 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.221 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.221 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.221 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:08:52.221 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:08:52.222 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:52.222 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:52.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.222 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:08:52.222 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:08:52.222 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:08:52.223 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:08:52.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.223 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:08:52.223 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:08:52.223 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.223 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:08:52.224 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:08:52.224 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:08:52.224 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.224 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.224 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:08:52.225 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:08:52.225 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:08:52.225 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:08:52.225 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.225 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:08:52.225 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:08:52.226 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:08:52.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.226 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:52.226 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:52.226 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:52.226 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.227 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.227 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:08:52.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.227 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:52.227 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:52.228 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:08:52.228 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.228 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.228 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:08:52.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.229 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:52.229 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:52.229 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:08:52.229 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.229 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:08:52.229 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:08:52.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:08:52.230 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:08:52.230 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:08:52.230 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:08:52.230 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.230 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:08:52.230 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:08:52.230 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:08:52.231 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:08:56.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/18' 2020-02-11T16:08:56.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/13' 2020-02-11T16:08:56.647 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/190/17' 2020-02-11T16:08:56.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/190' 2020-02-11T16:08:56.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/19' 2020-02-11T16:08:56.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/15' 2020-02-11T16:08:56.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/20' 2020-02-11T16:08:56.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/12' 2020-02-11T16:08:56.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/10' 2020-02-11T16:08:56.648 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/11' 2020-02-11T16:08:56.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/16' 2020-02-11T16:08:56.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/14' 2020-02-11T16:08:56.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/18' 2020-02-11T16:08:56.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/13' 2020-02-11T16:08:56.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/104/17' 2020-02-11T16:08:56.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/104' 2020-02-11T16:08:56.649 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/19' 2020-02-11T16:08:56.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/15' 2020-02-11T16:08:56.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/20' 2020-02-11T16:08:56.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/12' 2020-02-11T16:08:56.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/10' 2020-02-11T16:08:56.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/11' 2020-02-11T16:08:56.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/16' 2020-02-11T16:08:56.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/14' 2020-02-11T16:08:56.650 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/18' 2020-02-11T16:08:56.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/13' 2020-02-11T16:08:56.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/164/17' 2020-02-11T16:08:56.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/164' 2020-02-11T16:08:56.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/19' 2020-02-11T16:08:56.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/15' 2020-02-11T16:08:56.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/20' 2020-02-11T16:08:56.651 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/12' 2020-02-11T16:08:56.652 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/10' 2020-02-11T16:08:56.652 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/11' 2020-02-11T16:08:56.652 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/16' 2020-02-11T16:08:56.652 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/14' 2020-02-11T16:08:56.652 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/18' 2020-02-11T16:08:56.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/13' 2020-02-11T16:08:56.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/112/17' 2020-02-11T16:08:56.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/112' 2020-02-11T16:08:56.653 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/19' 2020-02-11T16:08:56.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/15' 2020-02-11T16:08:56.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/20' 2020-02-11T16:08:56.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/12' 2020-02-11T16:08:56.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/10' 2020-02-11T16:08:56.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/11' 2020-02-11T16:08:56.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/16' 2020-02-11T16:08:56.654 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/14' 2020-02-11T16:08:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/18' 2020-02-11T16:08:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/13' 2020-02-11T16:08:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/100/17' 2020-02-11T16:08:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/100' 2020-02-11T16:08:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/19' 2020-02-11T16:08:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/15' 2020-02-11T16:08:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/20' 2020-02-11T16:08:56.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/12' 2020-02-11T16:08:56.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/10' 2020-02-11T16:08:56.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/11' 2020-02-11T16:08:56.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/16' 2020-02-11T16:08:56.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/14' 2020-02-11T16:08:56.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/18' 2020-02-11T16:08:56.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/13' 2020-02-11T16:08:56.656 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/134/17' 2020-02-11T16:08:56.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/134' 2020-02-11T16:08:56.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/19' 2020-02-11T16:08:56.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/15' 2020-02-11T16:08:56.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/20' 2020-02-11T16:08:56.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/12' 2020-02-11T16:08:56.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/10' 2020-02-11T16:08:56.657 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/11' 2020-02-11T16:08:56.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/16' 2020-02-11T16:08:56.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/14' 2020-02-11T16:08:56.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/18' 2020-02-11T16:08:56.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/13' 2020-02-11T16:08:56.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/115/17' 2020-02-11T16:08:56.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/115' 2020-02-11T16:08:56.658 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/19' 2020-02-11T16:08:56.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/15' 2020-02-11T16:08:56.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/20' 2020-02-11T16:08:56.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/12' 2020-02-11T16:08:56.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/10' 2020-02-11T16:08:56.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/11' 2020-02-11T16:08:56.659 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/16' 2020-02-11T16:08:56.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/14' 2020-02-11T16:08:56.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/18' 2020-02-11T16:08:56.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/13' 2020-02-11T16:08:56.660 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/116/17' 2020-02-11T16:08:56.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/116' 2020-02-11T16:08:56.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/19' 2020-02-11T16:08:56.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/15' 2020-02-11T16:08:56.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/20' 2020-02-11T16:08:56.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/12' 2020-02-11T16:08:56.661 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/10' 2020-02-11T16:08:56.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/11' 2020-02-11T16:08:56.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/16' 2020-02-11T16:08:56.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/14' 2020-02-11T16:08:56.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/18' 2020-02-11T16:08:56.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/13' 2020-02-11T16:08:56.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/195/17' 2020-02-11T16:08:56.662 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/195' 2020-02-11T16:08:56.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/19' 2020-02-11T16:08:56.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/15' 2020-02-11T16:08:56.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/20' 2020-02-11T16:08:56.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/12' 2020-02-11T16:08:56.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/10' 2020-02-11T16:08:56.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/11' 2020-02-11T16:08:56.663 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/16' 2020-02-11T16:08:56.664 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/14' 2020-02-11T16:08:56.664 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/18' 2020-02-11T16:08:57.032 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/13' 2020-02-11T16:08:57.033 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/138/17' 2020-02-11T16:08:57.033 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/138' 2020-02-11T16:08:57.033 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/19' 2020-02-11T16:08:57.034 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/15' 2020-02-11T16:08:57.034 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/20' 2020-02-11T16:08:57.034 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/12' 2020-02-11T16:08:57.034 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/10' 2020-02-11T16:08:57.034 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/11' 2020-02-11T16:08:57.035 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/16' 2020-02-11T16:08:57.035 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/14' 2020-02-11T16:08:57.035 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/18' 2020-02-11T16:08:57.035 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/13' 2020-02-11T16:08:57.036 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/135/17' 2020-02-11T16:08:57.036 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/135' 2020-02-11T16:08:57.036 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/19' 2020-02-11T16:08:57.036 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/15' 2020-02-11T16:08:57.036 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/20' 2020-02-11T16:08:57.037 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/12' 2020-02-11T16:08:57.037 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/10' 2020-02-11T16:08:57.037 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/11' 2020-02-11T16:08:57.037 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/16' 2020-02-11T16:08:57.037 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/14' 2020-02-11T16:08:57.037 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/18' 2020-02-11T16:08:57.038 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/13' 2020-02-11T16:08:57.038 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/117/17' 2020-02-11T16:08:57.038 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/117' 2020-02-11T16:08:57.038 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/19' 2020-02-11T16:08:57.038 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/15' 2020-02-11T16:08:57.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/20' 2020-02-11T16:08:57.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/12' 2020-02-11T16:08:57.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/10' 2020-02-11T16:08:57.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/11' 2020-02-11T16:08:57.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/16' 2020-02-11T16:08:57.039 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/14' 2020-02-11T16:08:57.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/18' 2020-02-11T16:08:57.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/13' 2020-02-11T16:08:57.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/143/17' 2020-02-11T16:08:57.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/143' 2020-02-11T16:08:57.040 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/19' 2020-02-11T16:08:57.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/15' 2020-02-11T16:08:57.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/20' 2020-02-11T16:08:57.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/12' 2020-02-11T16:08:57.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/10' 2020-02-11T16:08:57.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/11' 2020-02-11T16:08:57.041 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/16' 2020-02-11T16:08:57.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/14' 2020-02-11T16:08:57.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/18' 2020-02-11T16:08:57.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/13' 2020-02-11T16:08:57.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/180/17' 2020-02-11T16:08:57.042 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/180' 2020-02-11T16:08:57.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/19' 2020-02-11T16:08:57.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/15' 2020-02-11T16:08:57.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/20' 2020-02-11T16:08:57.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/12' 2020-02-11T16:08:57.043 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/10' 2020-02-11T16:08:57.044 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/11' 2020-02-11T16:08:57.044 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/16' 2020-02-11T16:08:57.044 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/14' 2020-02-11T16:08:57.044 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/18' 2020-02-11T16:08:57.044 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/13' 2020-02-11T16:08:57.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/126/17' 2020-02-11T16:08:57.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/126' 2020-02-11T16:08:57.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/19' 2020-02-11T16:08:57.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/15' 2020-02-11T16:08:57.045 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/20' 2020-02-11T16:08:57.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/12' 2020-02-11T16:08:57.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/10' 2020-02-11T16:08:57.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/11' 2020-02-11T16:08:57.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/16' 2020-02-11T16:08:57.046 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/14' 2020-02-11T16:08:57.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/18' 2020-02-11T16:08:57.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/13' 2020-02-11T16:08:57.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/161/17' 2020-02-11T16:08:57.047 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/161' 2020-02-11T16:08:57.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/19' 2020-02-11T16:08:57.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/15' 2020-02-11T16:08:57.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/20' 2020-02-11T16:08:57.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/12' 2020-02-11T16:08:57.048 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/10' 2020-02-11T16:08:57.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/11' 2020-02-11T16:08:57.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/16' 2020-02-11T16:08:57.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/14' 2020-02-11T16:08:57.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/18' 2020-02-11T16:08:57.049 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/13' 2020-02-11T16:08:57.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/176/17' 2020-02-11T16:08:57.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/176' 2020-02-11T16:08:57.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/19' 2020-02-11T16:08:57.050 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/15' 2020-02-11T16:08:57.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/20' 2020-02-11T16:08:57.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/12' 2020-02-11T16:08:57.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/10' 2020-02-11T16:08:57.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/11' 2020-02-11T16:08:57.051 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/16' 2020-02-11T16:08:57.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/14' 2020-02-11T16:08:57.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/18' 2020-02-11T16:08:57.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/13' 2020-02-11T16:08:57.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/111/17' 2020-02-11T16:08:57.052 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/111' 2020-02-11T16:08:57.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/19' 2020-02-11T16:08:57.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/15' 2020-02-11T16:08:57.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/20' 2020-02-11T16:08:57.053 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/12' 2020-02-11T16:08:57.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/10' 2020-02-11T16:08:57.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/11' 2020-02-11T16:08:57.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/16' 2020-02-11T16:08:57.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/14' 2020-02-11T16:08:57.054 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/18' 2020-02-11T16:08:57.055 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/13' 2020-02-11T16:08:57.392 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/191/17' 2020-02-11T16:08:57.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/191' 2020-02-11T16:08:57.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/19' 2020-02-11T16:08:57.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/15' 2020-02-11T16:08:57.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/20' 2020-02-11T16:08:57.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/12' 2020-02-11T16:08:57.393 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/10' 2020-02-11T16:08:57.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/11' 2020-02-11T16:08:57.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/16' 2020-02-11T16:08:57.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/14' 2020-02-11T16:08:57.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/18' 2020-02-11T16:08:57.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/13' 2020-02-11T16:08:57.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/184/17' 2020-02-11T16:08:57.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/184' 2020-02-11T16:08:57.394 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/19' 2020-02-11T16:08:57.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/15' 2020-02-11T16:08:57.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/20' 2020-02-11T16:08:57.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/12' 2020-02-11T16:08:57.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/10' 2020-02-11T16:08:57.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/11' 2020-02-11T16:08:57.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/16' 2020-02-11T16:08:57.395 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/14' 2020-02-11T16:08:57.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/18' 2020-02-11T16:08:57.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/13' 2020-02-11T16:08:57.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/192/17' 2020-02-11T16:08:57.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/192' 2020-02-11T16:08:57.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/19' 2020-02-11T16:08:57.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/15' 2020-02-11T16:08:57.396 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/20' 2020-02-11T16:08:57.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/12' 2020-02-11T16:08:57.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/10' 2020-02-11T16:08:57.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/11' 2020-02-11T16:08:57.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/16' 2020-02-11T16:08:57.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/14' 2020-02-11T16:08:57.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/18' 2020-02-11T16:08:57.397 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/13' 2020-02-11T16:08:57.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/103/17' 2020-02-11T16:08:57.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/103' 2020-02-11T16:08:57.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/19' 2020-02-11T16:08:57.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/15' 2020-02-11T16:08:57.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/20' 2020-02-11T16:08:57.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/12' 2020-02-11T16:08:57.402 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/10' 2020-02-11T16:08:57.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/11' 2020-02-11T16:08:57.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/16' 2020-02-11T16:08:57.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/14' 2020-02-11T16:08:57.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/18' 2020-02-11T16:08:57.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/13' 2020-02-11T16:08:57.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/128/17' 2020-02-11T16:08:57.403 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/128' 2020-02-11T16:08:57.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/19' 2020-02-11T16:08:57.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/15' 2020-02-11T16:08:57.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/20' 2020-02-11T16:08:57.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/12' 2020-02-11T16:08:57.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/10' 2020-02-11T16:08:57.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/11' 2020-02-11T16:08:57.404 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/16' 2020-02-11T16:08:57.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/14' 2020-02-11T16:08:57.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/18' 2020-02-11T16:08:57.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/13' 2020-02-11T16:08:57.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/144/17' 2020-02-11T16:08:57.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/144' 2020-02-11T16:08:57.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/19' 2020-02-11T16:08:57.405 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/15' 2020-02-11T16:08:57.416 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/20' 2020-02-11T16:08:57.417 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/12' 2020-02-11T16:08:57.417 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/10' 2020-02-11T16:08:57.417 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/11' 2020-02-11T16:08:57.417 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/16' 2020-02-11T16:08:57.417 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/14' 2020-02-11T16:08:57.417 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/18' 2020-02-11T16:08:57.417 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/13' 2020-02-11T16:08:57.418 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/146/17' 2020-02-11T16:08:57.418 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/146' 2020-02-11T16:08:57.418 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/19' 2020-02-11T16:08:57.418 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/15' 2020-02-11T16:08:57.418 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/20' 2020-02-11T16:08:57.418 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/12' 2020-02-11T16:08:57.418 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/10' 2020-02-11T16:08:57.419 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/11' 2020-02-11T16:08:57.419 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/16' 2020-02-11T16:08:57.419 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/14' 2020-02-11T16:08:57.419 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/18' 2020-02-11T16:08:57.419 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/13' 2020-02-11T16:08:57.419 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/141/17' 2020-02-11T16:08:57.419 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/141' 2020-02-11T16:08:57.420 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/19' 2020-02-11T16:08:57.420 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/15' 2020-02-11T16:08:57.420 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/20' 2020-02-11T16:08:57.420 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/12' 2020-02-11T16:08:57.420 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/10' 2020-02-11T16:08:57.420 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/11' 2020-02-11T16:08:57.420 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/16' 2020-02-11T16:08:57.421 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/14' 2020-02-11T16:08:57.421 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/18' 2020-02-11T16:08:57.421 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/13' 2020-02-11T16:08:57.421 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/182/17' 2020-02-11T16:08:57.421 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/182' 2020-02-11T16:08:57.421 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/19' 2020-02-11T16:08:57.421 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/15' 2020-02-11T16:08:57.421 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/20' 2020-02-11T16:08:57.422 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/12' 2020-02-11T16:08:57.422 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/10' 2020-02-11T16:08:57.422 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/11' 2020-02-11T16:08:57.422 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/16' 2020-02-11T16:08:57.422 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/14' 2020-02-11T16:08:57.422 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/18' 2020-02-11T16:08:57.422 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/13' 2020-02-11T16:08:57.423 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/107/17' 2020-02-11T16:08:57.698 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/107' 2020-02-11T16:08:57.698 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/19' 2020-02-11T16:08:57.699 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/15' 2020-02-11T16:08:57.699 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/20' 2020-02-11T16:08:57.699 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/12' 2020-02-11T16:08:57.699 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/10' 2020-02-11T16:08:57.700 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/11' 2020-02-11T16:08:57.700 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/16' 2020-02-11T16:08:57.700 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/14' 2020-02-11T16:08:57.700 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/18' 2020-02-11T16:08:57.701 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/13' 2020-02-11T16:08:57.701 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/178/17' 2020-02-11T16:08:57.701 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/178' 2020-02-11T16:08:57.701 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/19' 2020-02-11T16:08:57.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/15' 2020-02-11T16:08:57.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/20' 2020-02-11T16:08:57.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/12' 2020-02-11T16:08:57.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/10' 2020-02-11T16:08:57.702 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/11' 2020-02-11T16:08:57.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/16' 2020-02-11T16:08:57.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/14' 2020-02-11T16:08:57.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/18' 2020-02-11T16:08:57.703 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/13' 2020-02-11T16:08:57.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/156/17' 2020-02-11T16:08:57.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/156' 2020-02-11T16:08:57.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/19' 2020-02-11T16:08:57.704 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/15' 2020-02-11T16:08:57.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/20' 2020-02-11T16:08:57.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/12' 2020-02-11T16:08:57.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/10' 2020-02-11T16:08:57.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/11' 2020-02-11T16:08:57.705 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/16' 2020-02-11T16:08:57.706 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/14' 2020-02-11T16:08:57.706 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/18' 2020-02-11T16:08:57.706 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/13' 2020-02-11T16:08:57.706 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/131/17' 2020-02-11T16:08:57.707 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/131' 2020-02-11T16:08:57.707 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/19' 2020-02-11T16:08:57.707 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/15' 2020-02-11T16:08:57.707 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/20' 2020-02-11T16:08:57.708 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/12' 2020-02-11T16:08:57.708 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/10' 2020-02-11T16:08:57.708 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/11' 2020-02-11T16:08:57.708 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/16' 2020-02-11T16:08:57.708 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/14' 2020-02-11T16:08:57.709 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/18' 2020-02-11T16:08:57.709 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/13' 2020-02-11T16:08:57.709 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/123/17' 2020-02-11T16:08:57.709 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/123' 2020-02-11T16:08:57.710 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/19' 2020-02-11T16:08:57.710 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/15' 2020-02-11T16:08:57.710 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/20' 2020-02-11T16:08:57.711 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/12' 2020-02-11T16:08:57.711 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/10' 2020-02-11T16:08:57.711 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/11' 2020-02-11T16:08:57.711 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/16' 2020-02-11T16:08:57.712 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/14' 2020-02-11T16:08:57.712 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/18' 2020-02-11T16:08:57.712 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/13' 2020-02-11T16:08:57.712 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/160/17' 2020-02-11T16:08:57.712 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/160' 2020-02-11T16:08:57.713 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/19' 2020-02-11T16:08:57.722 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/15' 2020-02-11T16:08:57.722 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/20' 2020-02-11T16:08:57.722 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/12' 2020-02-11T16:08:57.723 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/10' 2020-02-11T16:08:57.723 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/11' 2020-02-11T16:08:57.723 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/16' 2020-02-11T16:08:57.723 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/14' 2020-02-11T16:08:57.723 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/18' 2020-02-11T16:08:57.723 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/13' 2020-02-11T16:08:57.723 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/165/17' 2020-02-11T16:08:57.723 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/165' 2020-02-11T16:08:57.724 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/19' 2020-02-11T16:08:57.724 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/15' 2020-02-11T16:08:57.724 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/20' 2020-02-11T16:08:57.724 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/12' 2020-02-11T16:08:57.724 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/10' 2020-02-11T16:08:57.724 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/11' 2020-02-11T16:08:57.724 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/16' 2020-02-11T16:08:57.725 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/14' 2020-02-11T16:08:57.725 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/18' 2020-02-11T16:08:57.725 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/13' 2020-02-11T16:08:57.725 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/101/17' 2020-02-11T16:08:57.725 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/101' 2020-02-11T16:08:57.725 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/19' 2020-02-11T16:08:57.725 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/15' 2020-02-11T16:08:57.726 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/20' 2020-02-11T16:08:57.726 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/12' 2020-02-11T16:08:57.726 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/10' 2020-02-11T16:08:57.726 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/11' 2020-02-11T16:08:57.726 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/16' 2020-02-11T16:08:57.726 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/14' 2020-02-11T16:08:57.726 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/18' 2020-02-11T16:08:57.727 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/13' 2020-02-11T16:08:57.727 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/148/17' 2020-02-11T16:08:57.727 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/148' 2020-02-11T16:08:57.727 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/19' 2020-02-11T16:08:57.727 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/15' 2020-02-11T16:08:57.727 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/20' 2020-02-11T16:08:57.727 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/12' 2020-02-11T16:08:57.727 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/10' 2020-02-11T16:08:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/11' 2020-02-11T16:08:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/16' 2020-02-11T16:08:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/14' 2020-02-11T16:08:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/18' 2020-02-11T16:08:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/13' 2020-02-11T16:08:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/168/17' 2020-02-11T16:08:57.728 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/168' 2020-02-11T16:08:57.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/19' 2020-02-11T16:08:57.997 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/15' 2020-02-11T16:08:57.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/20' 2020-02-11T16:08:57.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/12' 2020-02-11T16:08:57.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/10' 2020-02-11T16:08:57.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/11' 2020-02-11T16:08:57.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/16' 2020-02-11T16:08:57.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/14' 2020-02-11T16:08:57.998 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/18' 2020-02-11T16:08:57.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/13' 2020-02-11T16:08:57.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/179/17' 2020-02-11T16:08:57.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/179' 2020-02-11T16:08:57.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/19' 2020-02-11T16:08:57.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/15' 2020-02-11T16:08:57.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/20' 2020-02-11T16:08:57.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/12' 2020-02-11T16:08:57.999 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/10' 2020-02-11T16:08:58.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/11' 2020-02-11T16:08:58.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/16' 2020-02-11T16:08:58.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/14' 2020-02-11T16:08:58.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/18' 2020-02-11T16:08:58.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/13' 2020-02-11T16:08:58.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/132/17' 2020-02-11T16:08:58.000 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/132' 2020-02-11T16:08:58.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/19' 2020-02-11T16:08:58.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/15' 2020-02-11T16:08:58.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/20' 2020-02-11T16:08:58.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/12' 2020-02-11T16:08:58.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/10' 2020-02-11T16:08:58.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/11' 2020-02-11T16:08:58.001 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/16' 2020-02-11T16:08:58.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/14' 2020-02-11T16:08:58.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/18' 2020-02-11T16:08:58.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/13' 2020-02-11T16:08:58.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/199/17' 2020-02-11T16:08:58.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/199' 2020-02-11T16:08:58.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/19' 2020-02-11T16:08:58.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/15' 2020-02-11T16:08:58.002 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/20' 2020-02-11T16:08:58.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/12' 2020-02-11T16:08:58.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/10' 2020-02-11T16:08:58.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/11' 2020-02-11T16:08:58.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/16' 2020-02-11T16:08:58.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/14' 2020-02-11T16:08:58.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/18' 2020-02-11T16:08:58.003 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/13' 2020-02-11T16:08:58.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/163/17' 2020-02-11T16:08:58.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/163' 2020-02-11T16:08:58.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/19' 2020-02-11T16:08:58.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/15' 2020-02-11T16:08:58.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/20' 2020-02-11T16:08:58.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/12' 2020-02-11T16:08:58.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/10' 2020-02-11T16:08:58.004 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/11' 2020-02-11T16:08:58.005 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/16' 2020-02-11T16:08:58.005 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/14' 2020-02-11T16:08:58.005 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/18' 2020-02-11T16:08:58.005 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/13' 2020-02-11T16:08:58.005 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/153/17' 2020-02-11T16:08:58.005 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/153' 2020-02-11T16:08:58.005 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/19' 2020-02-11T16:08:58.006 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/15' 2020-02-11T16:08:58.006 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/20' 2020-02-11T16:08:58.006 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/12' 2020-02-11T16:08:58.006 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/10' 2020-02-11T16:08:58.006 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/11' 2020-02-11T16:08:58.006 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/16' 2020-02-11T16:08:58.006 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/14' 2020-02-11T16:08:58.007 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/18' 2020-02-11T16:08:58.007 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/13' 2020-02-11T16:08:58.007 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/122/17' 2020-02-11T16:08:58.007 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/122' 2020-02-11T16:08:58.007 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/19' 2020-02-11T16:08:58.007 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/15' 2020-02-11T16:08:58.007 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/20' 2020-02-11T16:08:58.008 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/12' 2020-02-11T16:08:58.008 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/10' 2020-02-11T16:08:58.008 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/11' 2020-02-11T16:08:58.008 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/16' 2020-02-11T16:08:58.008 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/14' 2020-02-11T16:08:58.008 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/18' 2020-02-11T16:08:58.008 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/13' 2020-02-11T16:08:58.008 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/162/17' 2020-02-11T16:08:58.009 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/162' 2020-02-11T16:08:58.009 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/19' 2020-02-11T16:08:58.009 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/15' 2020-02-11T16:08:58.009 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/20' 2020-02-11T16:08:58.009 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/12' 2020-02-11T16:08:58.009 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/10' 2020-02-11T16:08:58.009 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/11' 2020-02-11T16:08:58.010 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/16' 2020-02-11T16:08:58.010 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/14' 2020-02-11T16:08:58.010 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/18' 2020-02-11T16:08:58.010 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/13' 2020-02-11T16:08:58.010 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/197/17' 2020-02-11T16:08:58.010 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/197' 2020-02-11T16:08:58.010 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/19' 2020-02-11T16:08:58.011 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/15' 2020-02-11T16:08:58.011 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/20' 2020-02-11T16:08:58.011 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/12' 2020-02-11T16:08:58.011 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/10' 2020-02-11T16:08:58.011 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/11' 2020-02-11T16:08:58.011 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/16' 2020-02-11T16:08:58.011 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/14' 2020-02-11T16:08:58.011 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/18' 2020-02-11T16:08:58.012 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/13' 2020-02-11T16:08:58.012 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/113/17' 2020-02-11T16:08:58.012 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/113' 2020-02-11T16:08:58.012 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/19' 2020-02-11T16:08:58.441 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/15' 2020-02-11T16:08:58.442 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/20' 2020-02-11T16:08:58.442 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/12' 2020-02-11T16:08:58.442 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/10' 2020-02-11T16:08:58.442 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/11' 2020-02-11T16:08:58.442 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/16' 2020-02-11T16:08:58.443 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/14' 2020-02-11T16:08:58.443 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/18' 2020-02-11T16:08:58.443 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/13' 2020-02-11T16:08:58.443 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/152/17' 2020-02-11T16:08:58.443 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/152' 2020-02-11T16:08:58.443 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/19' 2020-02-11T16:08:58.444 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/15' 2020-02-11T16:08:58.444 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/20' 2020-02-11T16:08:58.444 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/12' 2020-02-11T16:08:58.444 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/10' 2020-02-11T16:08:58.444 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/11' 2020-02-11T16:08:58.445 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/16' 2020-02-11T16:08:58.445 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/14' 2020-02-11T16:08:58.445 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/18' 2020-02-11T16:08:58.445 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/13' 2020-02-11T16:08:58.445 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/121/17' 2020-02-11T16:08:58.445 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/121' 2020-02-11T16:08:58.446 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/19' 2020-02-11T16:08:58.446 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/15' 2020-02-11T16:08:58.446 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/20' 2020-02-11T16:08:58.446 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/12' 2020-02-11T16:08:58.446 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/10' 2020-02-11T16:08:58.446 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/11' 2020-02-11T16:08:58.446 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/16' 2020-02-11T16:08:58.447 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/14' 2020-02-11T16:08:58.447 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/18' 2020-02-11T16:08:58.447 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/13' 2020-02-11T16:08:58.447 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/118/17' 2020-02-11T16:08:58.447 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/118' 2020-02-11T16:08:58.447 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/19' 2020-02-11T16:08:58.447 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/15' 2020-02-11T16:08:58.448 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/20' 2020-02-11T16:08:58.448 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/12' 2020-02-11T16:08:58.448 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/10' 2020-02-11T16:08:58.448 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/11' 2020-02-11T16:08:58.448 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/16' 2020-02-11T16:08:58.449 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/14' 2020-02-11T16:08:58.449 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/18' 2020-02-11T16:08:58.449 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/13' 2020-02-11T16:08:58.449 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/196/17' 2020-02-11T16:08:58.449 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/196' 2020-02-11T16:08:58.449 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/19' 2020-02-11T16:08:58.450 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/15' 2020-02-11T16:08:58.450 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/20' 2020-02-11T16:08:58.450 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/12' 2020-02-11T16:08:58.450 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/10' 2020-02-11T16:08:58.450 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/11' 2020-02-11T16:08:58.450 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/16' 2020-02-11T16:08:58.450 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/14' 2020-02-11T16:08:58.451 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/18' 2020-02-11T16:08:58.451 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/13' 2020-02-11T16:08:58.451 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/124/17' 2020-02-11T16:08:58.451 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/124' 2020-02-11T16:08:58.451 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/19' 2020-02-11T16:08:58.451 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/15' 2020-02-11T16:08:58.451 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/20' 2020-02-11T16:08:58.452 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/12' 2020-02-11T16:08:58.452 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/10' 2020-02-11T16:08:58.452 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/11' 2020-02-11T16:08:58.452 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/16' 2020-02-11T16:08:58.452 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/14' 2020-02-11T16:08:58.452 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/18' 2020-02-11T16:08:58.452 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/13' 2020-02-11T16:08:58.453 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/188/17' 2020-02-11T16:08:58.453 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/188' 2020-02-11T16:08:58.453 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/19' 2020-02-11T16:08:58.453 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/15' 2020-02-11T16:08:58.453 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/20' 2020-02-11T16:08:58.453 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/12' 2020-02-11T16:08:58.454 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/10' 2020-02-11T16:08:58.454 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/11' 2020-02-11T16:08:58.454 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/16' 2020-02-11T16:08:58.455 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/14' 2020-02-11T16:08:58.455 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/18' 2020-02-11T16:08:58.455 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/13' 2020-02-11T16:08:58.455 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/145/17' 2020-02-11T16:08:58.455 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/145' 2020-02-11T16:08:58.455 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/19' 2020-02-11T16:08:58.455 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/15' 2020-02-11T16:08:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/20' 2020-02-11T16:08:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/12' 2020-02-11T16:08:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/10' 2020-02-11T16:08:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/11' 2020-02-11T16:08:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/16' 2020-02-11T16:08:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/14' 2020-02-11T16:08:58.456 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/18' 2020-02-11T16:08:58.457 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/13' 2020-02-11T16:08:58.457 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/130/17' 2020-02-11T16:08:58.457 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/130' 2020-02-11T16:08:58.457 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/19' 2020-02-11T16:08:58.457 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/15' 2020-02-11T16:08:58.457 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/20' 2020-02-11T16:08:58.457 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/12' 2020-02-11T16:08:58.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/10' 2020-02-11T16:08:58.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/11' 2020-02-11T16:08:58.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/16' 2020-02-11T16:08:58.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/14' 2020-02-11T16:08:58.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/18' 2020-02-11T16:08:58.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/13' 2020-02-11T16:08:58.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/193/17' 2020-02-11T16:08:58.458 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/193' 2020-02-11T16:08:58.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/19' 2020-02-11T16:08:58.459 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/15' 2020-02-11T16:08:58.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/20' 2020-02-11T16:08:58.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/12' 2020-02-11T16:08:58.762 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/10' 2020-02-11T16:08:58.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/11' 2020-02-11T16:08:58.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/16' 2020-02-11T16:08:58.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/14' 2020-02-11T16:08:58.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/18' 2020-02-11T16:08:58.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/13' 2020-02-11T16:08:58.763 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/175/17' 2020-02-11T16:08:58.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/175' 2020-02-11T16:08:58.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/19' 2020-02-11T16:08:58.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/15' 2020-02-11T16:08:58.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/20' 2020-02-11T16:08:58.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/12' 2020-02-11T16:08:58.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/10' 2020-02-11T16:08:58.764 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/11' 2020-02-11T16:08:58.765 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/16' 2020-02-11T16:08:58.765 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/14' 2020-02-11T16:08:58.765 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/18' 2020-02-11T16:08:58.765 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/13' 2020-02-11T16:08:58.765 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/181/17' 2020-02-11T16:08:58.765 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/181' 2020-02-11T16:08:58.766 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/19' 2020-02-11T16:08:58.766 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/15' 2020-02-11T16:08:58.766 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/20' 2020-02-11T16:08:58.766 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/12' 2020-02-11T16:08:58.766 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/10' 2020-02-11T16:08:58.766 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/11' 2020-02-11T16:08:58.766 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/16' 2020-02-11T16:08:58.767 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/14' 2020-02-11T16:08:58.767 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/18' 2020-02-11T16:08:58.767 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/13' 2020-02-11T16:08:58.767 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/127/17' 2020-02-11T16:08:58.767 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/127' 2020-02-11T16:08:58.768 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/19' 2020-02-11T16:08:58.768 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/15' 2020-02-11T16:08:58.768 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/20' 2020-02-11T16:08:58.768 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/12' 2020-02-11T16:08:58.768 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/10' 2020-02-11T16:08:58.768 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/11' 2020-02-11T16:08:58.769 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/16' 2020-02-11T16:08:58.769 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/14' 2020-02-11T16:08:58.769 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/18' 2020-02-11T16:08:58.769 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/13' 2020-02-11T16:08:58.769 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/108/17' 2020-02-11T16:08:58.769 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/108' 2020-02-11T16:08:58.770 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/19' 2020-02-11T16:08:58.770 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/15' 2020-02-11T16:08:58.770 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/20' 2020-02-11T16:08:58.770 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/12' 2020-02-11T16:08:58.770 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/10' 2020-02-11T16:08:58.771 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/11' 2020-02-11T16:08:58.771 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/16' 2020-02-11T16:08:58.771 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/14' 2020-02-11T16:08:58.771 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/18' 2020-02-11T16:08:58.771 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/13' 2020-02-11T16:08:58.772 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/183/17' 2020-02-11T16:08:58.772 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/183' 2020-02-11T16:08:58.772 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/19' 2020-02-11T16:08:58.772 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/15' 2020-02-11T16:08:58.772 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/20' 2020-02-11T16:08:58.772 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/12' 2020-02-11T16:08:58.773 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/10' 2020-02-11T16:08:58.773 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/11' 2020-02-11T16:08:58.773 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/16' 2020-02-11T16:08:58.773 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/14' 2020-02-11T16:08:58.773 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/18' 2020-02-11T16:08:58.773 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/13' 2020-02-11T16:08:58.773 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/177/17' 2020-02-11T16:08:58.774 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/177' 2020-02-11T16:08:58.774 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/19' 2020-02-11T16:08:58.775 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/15' 2020-02-11T16:08:58.775 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/20' 2020-02-11T16:08:58.775 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/12' 2020-02-11T16:08:58.775 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/10' 2020-02-11T16:08:58.775 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/11' 2020-02-11T16:08:58.775 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/16' 2020-02-11T16:08:58.776 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/14' 2020-02-11T16:08:58.776 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/18' 2020-02-11T16:08:58.776 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/13' 2020-02-11T16:08:58.776 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/169/17' 2020-02-11T16:08:58.776 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/169' 2020-02-11T16:08:58.776 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/19' 2020-02-11T16:08:58.777 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/15' 2020-02-11T16:08:58.777 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/20' 2020-02-11T16:08:58.777 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/12' 2020-02-11T16:08:58.777 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/10' 2020-02-11T16:08:58.777 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/11' 2020-02-11T16:08:58.777 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/16' 2020-02-11T16:08:58.778 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/14' 2020-02-11T16:08:58.778 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/18' 2020-02-11T16:08:58.778 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/13' 2020-02-11T16:08:58.778 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/154/17' 2020-02-11T16:08:58.778 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/154' 2020-02-11T16:08:58.778 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/19' 2020-02-11T16:08:58.779 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/15' 2020-02-11T16:08:58.779 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/20' 2020-02-11T16:08:58.779 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/12' 2020-02-11T16:08:58.779 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/10' 2020-02-11T16:08:58.779 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/11' 2020-02-11T16:08:58.779 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/16' 2020-02-11T16:08:58.779 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/14' 2020-02-11T16:08:58.780 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/18' 2020-02-11T16:08:58.780 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/13' 2020-02-11T16:08:58.780 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/171/17' 2020-02-11T16:08:58.780 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/171' 2020-02-11T16:08:58.780 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/19' 2020-02-11T16:08:58.780 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/15' 2020-02-11T16:08:58.780 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/20' 2020-02-11T16:08:58.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/12' 2020-02-11T16:08:58.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/10' 2020-02-11T16:08:58.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/11' 2020-02-11T16:08:58.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/16' 2020-02-11T16:08:58.876 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/14' 2020-02-11T16:08:58.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/18' 2020-02-11T16:08:58.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/13' 2020-02-11T16:08:58.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/139/17' 2020-02-11T16:08:58.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/139' 2020-02-11T16:08:58.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/19' 2020-02-11T16:08:58.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/15' 2020-02-11T16:08:58.877 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/20' 2020-02-11T16:08:58.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/12' 2020-02-11T16:08:58.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/10' 2020-02-11T16:08:58.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/11' 2020-02-11T16:08:58.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/16' 2020-02-11T16:08:58.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/14' 2020-02-11T16:08:58.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/18' 2020-02-11T16:08:58.878 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/13' 2020-02-11T16:08:58.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/102/17' 2020-02-11T16:08:58.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/102' 2020-02-11T16:08:58.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/19' 2020-02-11T16:08:58.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/15' 2020-02-11T16:08:58.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/20' 2020-02-11T16:08:58.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/12' 2020-02-11T16:08:58.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/10' 2020-02-11T16:08:58.879 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/11' 2020-02-11T16:08:58.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/16' 2020-02-11T16:08:58.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/14' 2020-02-11T16:08:58.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/18' 2020-02-11T16:08:58.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/13' 2020-02-11T16:08:58.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed './copyofsnap1/test1/129/17' 2020-02-11T16:08:58.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1/129' 2020-02-11T16:08:58.880 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1/test1' 2020-02-11T16:08:58.881 INFO:tasks.workunit.client.0.smithi088.stdout:removed directory './copyofsnap1' 2020-02-11T16:08:58.881 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:08:58.881 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:08:58.881 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:08:58.916 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2020-02-11T16:08:58.917 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2020-02-11T16:08:58.977 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:08:58.977 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:08:59.070 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.063+0000 7fdac1e26700 1 Processor -- start 2020-02-11T16:08:59.070 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.063+0000 7fdac1e26700 1 -- start start 2020-02-11T16:08:59.070 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.063+0000 7fdac1e26700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdabc0a14c0 0x7fdabc150670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:08:59.070 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.063+0000 7fdac1e26700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc0a37e0 con 0x7fdabc0a2da0 2020-02-11T16:08:59.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.063+0000 7fdac1e26700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc0a26d0 con 0x7fdabc05ac40 2020-02-11T16:08:59.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.063+0000 7fdac1e26700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc0a24e0 con 0x7fdabc0a14c0 2020-02-11T16:08:59.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.064+0000 7fdabbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdabc05ac40 0x7fdabc099890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41202/0 (socket says 172.21.15.88:41202) 2020-02-11T16:08:59.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.064+0000 7fdac0bc4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdabc0a14c0 0x7fdabc150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:59.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.064+0000 7fdabbfff700 1 -- 172.21.15.88:0/3353724202 learned_addr learned my addr 172.21.15.88:0/3353724202 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:08:59.072 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.064+0000 7fdac0bc4700 1 -- 172.21.15.88:0/3353724202 >> v1:172.21.15.88:6789/0 conn(0x7fdabc05ac40 legacy=0x7fdabc099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:59.072 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.064+0000 7fdac0bc4700 1 -- 172.21.15.88:0/3353724202 >> v1:172.21.15.52:6789/0 conn(0x7fdabc0a2da0 legacy=0x7fdabc099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:59.072 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.064+0000 7fdac0bc4700 1 -- 172.21.15.88:0/3353724202 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0a2970 con 0x7fdabc0a14c0 2020-02-11T16:08:59.072 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.064+0000 7fdac0bc4700 1 --2- 172.21.15.88:0/3353724202 >> v2:172.21.15.88:3300/0 conn(0x7fdabc0a14c0 0x7fdabc150670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdab0001000 tx=0x7fdab4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.072 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.065+0000 7fdac0bc4700 1 --2- 172.21.15.88:0/3353724202 >> v2:172.21.15.88:3300/0 conn(0x7fdabc0a14c0 0x7fdabc150670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdab0001000 tx=0x7fdab4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.072 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.065+0000 7fdac0bc4700 1 --2- 172.21.15.88:0/3353724202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc0a14c0 0x7fdabc150670 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fdab0001000 tx=0x7fdab4008c60).ready entity=mon.1 client_cookie=2aa52838d7537a85 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:59.072 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.065+0000 7fdac0bc4700 1 --2- 172.21.15.88:0/3353724202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc0a14c0 0x7fdabc150670 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fdab0001000 tx=0x7fdab4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.073 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.065+0000 7fdac0bc4700 1 --2- 172.21.15.88:0/3353724202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc0a14c0 0x7fdabc150670 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fdab0001000 tx=0x7fdab4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.073 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.065+0000 7fdabaffd700 1 -- 172.21.15.88:0/3353724202 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdab4010e50 con 0x7fdabc0a14c0 2020-02-11T16:08:59.073 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.065+0000 7fdac0bc4700 1 --2- 172.21.15.88:0/3353724202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc0a14c0 0x7fdabc150670 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fdab0001000 tx=0x7fdab4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.073 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.065+0000 7fdabaffd700 1 -- 172.21.15.88:0/3353724202 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab40110c0 con 0x7fdabc0a14c0 2020-02-11T16:08:59.073 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.065+0000 7fdabaffd700 1 -- 172.21.15.88:0/3353724202 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdab4011420 con 0x7fdabc0a14c0 2020-02-11T16:08:59.073 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.065+0000 7fdac1e26700 1 -- 172.21.15.88:0/3353724202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc0a14c0 msgr2=0x7fdabc150670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:59.073 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.065+0000 7fdac1e26700 1 --2- 172.21.15.88:0/3353724202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc0a14c0 0x7fdabc150670 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fdab0001000 tx=0x7fdab4008c60).stop 2020-02-11T16:08:59.074 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.066+0000 7fdac1e26700 1 -- 172.21.15.88:0/3353724202 shutdown_connections 2020-02-11T16:08:59.074 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.066+0000 7fdac1e26700 1 --2- 172.21.15.88:0/3353724202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc0a14c0 0x7fdabc150670 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:59.074 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.066+0000 7fdac1e26700 1 -- 172.21.15.88:0/3353724202 >> 172.21.15.88:0/3353724202 conn(0x7fdabc05c170 msgr2=0x7fdabc05a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:08:59.074 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.068+0000 7fdac1e26700 1 -- 172.21.15.88:0/3353724202 shutdown_connections 2020-02-11T16:08:59.074 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.068+0000 7fdac1e26700 1 -- 172.21.15.88:0/3353724202 wait complete. 2020-02-11T16:08:59.077 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.069+0000 7fdac1e26700 1 Processor -- start 2020-02-11T16:08:59.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.069+0000 7fdac1e26700 1 -- start start 2020-02-11T16:08:59.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.070+0000 7fdac1e26700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdabc05ac40 0x7fdabc1229e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:59.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.070+0000 7fdac1e26700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdabc0a2da0 0x7fdabc131840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:59.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.070+0000 7fdac1e26700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc121150 con 0x7fdabc0a14c0 2020-02-11T16:08:59.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.070+0000 7fdac1e26700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc07ef90 con 0x7fdabc05ac40 2020-02-11T16:08:59.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.070+0000 7fdac1e26700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc1311e0 con 0x7fdabc0a2da0 2020-02-11T16:08:59.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.070+0000 7fdabbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdabc05ac40 0x7fdabc1229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:59.079 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.070+0000 7fdabbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdabc05ac40 0x7fdabc1229e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53582/0 (socket says 172.21.15.88:53582) 2020-02-11T16:08:59.079 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.070+0000 7fdabbfff700 1 -- 172.21.15.88:0/3324242613 learned_addr learned my addr 172.21.15.88:0/3324242613 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:08:59.079 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.070+0000 7fdabb7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdabc0a14c0 0x7fdabc09ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41210/0 (socket says 172.21.15.88:41210) 2020-02-11T16:08:59.079 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.070+0000 7fdac0bc4700 1 -- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdabc0a2da0 msgr2=0x7fdabc131840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:08:59.079 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdac0bc4700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdabc0a2da0 0x7fdabc131840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:08:59.079 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdabbfff700 1 -- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdabc0a2da0 msgr2=0x7fdabc131840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:08:59.079 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdabc0a2da0 0x7fdabc131840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:08:59.080 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdabbfff700 1 -- 172.21.15.88:0/3324242613 >> v1:172.21.15.88:6789/0 conn(0x7fdabc0a14c0 legacy=0x7fdabc09ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:08:59.080 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdabbfff700 1 -- 172.21.15.88:0/3324242613 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc120c10 con 0x7fdabc05ac40 2020-02-11T16:08:59.080 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> v2:172.21.15.88:3300/0 conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.080 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> v2:172.21.15.88:3300/0 conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.080 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:59.080 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.080 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.081 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdab8ff9700 1 -- 172.21.15.88:0/3324242613 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaac0055a0 con 0x7fdabc05ac40 2020-02-11T16:08:59.081 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.081 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdab8ff9700 1 -- 172.21.15.88:0/3324242613 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac005740 con 0x7fdabc05ac40 2020-02-11T16:08:59.081 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.071+0000 7fdab8ff9700 1 -- 172.21.15.88:0/3324242613 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaac005b60 con 0x7fdabc05ac40 2020-02-11T16:08:59.081 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.072+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc120eb0 con 0x7fdabc05ac40 2020-02-11T16:08:59.081 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.072+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc120890 con 0x7fdabc05ac40 2020-02-11T16:08:59.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.073+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.073+0000 7fdab8ff9700 1 -- 172.21.15.88:0/3324242613 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdaac00d230 con 0x7fdabc05ac40 2020-02-11T16:08:59.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.073+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.073+0000 7fdab8ff9700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fda9c039c40 0x7fda9c03c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:08:59.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.073+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc09cb60 con 0x7fdabc05ac40 2020-02-11T16:08:59.082 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.073+0000 7fdab8ff9700 1 -- 172.21.15.88:0/3324242613 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdaac04baf0 con 0x7fdabc05ac40 2020-02-11T16:08:59.083 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.073+0000 7fdabb7fe700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fda9c039c40 0x7fda9c03c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:08:59.083 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.074+0000 7fdabb7fe700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fda9c039c40 0x7fda9c03c100 crc :-1 s=READY pgs=164 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:08:59.083 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.077+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.083 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.077+0000 7fdab8ff9700 1 -- 172.21.15.88:0/3324242613 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fdabc09cb60 con 0x7fdabc05ac40 2020-02-11T16:08:59.377 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.375+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdabc09cb60 con 0x7fdabc05ac40 2020-02-11T16:08:59.636 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.634+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:08:59.636 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.635+0000 7fdab8ff9700 1 -- 172.21.15.88:0/3324242613 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v20) v1 ==== 167+0+0 (secure 0 0 0) 0x7fdabc09cb60 con 0x7fdabc05ac40 2020-02-11T16:08:59.773 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:08:59.772+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdabc09cb60 con 0x7fdabc05ac40 2020-02-11T16:09:00.636 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.635+0000 7fdabbfff700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.637 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.635+0000 7fdab8ff9700 1 -- 172.21.15.88:0/3324242613 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v21) v1 ==== 167+0+0 (secure 0 0 0) 0x7fdabc09cb60 con 0x7fdabc05ac40 2020-02-11T16:09:00.639 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fda9c039c40 msgr2=0x7fda9c03c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:00.639 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fda9c039c40 0x7fda9c03c100 crc :-1 s=READY pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:00.639 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 msgr2=0x7fdabc1229e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:00.639 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fdaac0010d0 tx=0x7fdaac00e800).stop 2020-02-11T16:09:00.640 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 shutdown_connections 2020-02-11T16:09:00.640 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fda9c039c40 0x7fda9c03c100 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:00.640 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdabc0a2da0 0x7fdabc131840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:00.640 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 --2- 172.21.15.88:0/3324242613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdabc05ac40 0x7fdabc1229e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:00.640 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 >> 172.21.15.88:0/3324242613 conn(0x7fdabc05c170 msgr2=0x7fdabc0a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:00.640 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 shutdown_connections 2020-02-11T16:09:00.640 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.637+0000 7fdac1e26700 1 -- 172.21.15.88:0/3324242613 wait complete. 2020-02-11T16:09:00.641 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:09:00.649 INFO:tasks.workunit.client.0.smithi088.stderr:+ touch foo 2020-02-11T16:09:00.653 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod +x foo 2020-02-11T16:09:00.654 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:09:00.690 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep foo 2020-02-11T16:09:00.690 INFO:tasks.workunit.client.0.smithi088.stderr:+ find .snap/s/foo -executable 2020-02-11T16:09:00.696 INFO:tasks.workunit.client.0.smithi088.stdout:.snap/s/foo 2020-02-11T16:09:00.696 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:09:00.703 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm foo 2020-02-11T16:09:00.706 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:09:00.707 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:09:00.707 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:09:00.707 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:09:00.814 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2020-02-11T16:09:00.814 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2020-02-11T16:09:00.846 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:09:00.846 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir foo 2020-02-11T16:09:00.848 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:09:00.942 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.932+0000 7f1488f28700 1 Processor -- start 2020-02-11T16:09:00.942 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.932+0000 7f1488f28700 1 -- start start 2020-02-11T16:09:00.942 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1488f28700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f148405ac40 0x7f14840a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:00.943 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1488f28700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1484099fa0 0x7f148414f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:00.943 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1488f28700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14840a37e0 con 0x7f14840a14c0 2020-02-11T16:09:00.943 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1488f28700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14840a24e0 con 0x7f148405ac40 2020-02-11T16:09:00.944 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1488f28700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14840a4350 con 0x7f1484099fa0 2020-02-11T16:09:00.944 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f148405ac40 0x7f14840a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:00.944 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f148359e700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1484099fa0 msgr2=0x7f148414f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:00.944 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f148405ac40 0x7f14840a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53592/0 (socket says 172.21.15.88:53592) 2020-02-11T16:09:00.945 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 -- 172.21.15.88:0/4272440717 learned_addr learned my addr 172.21.15.88:0/4272440717 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:00.945 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f148359e700 1 --2- 172.21.15.88:0/4272440717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1484099fa0 0x7f148414f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:00.945 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 -- 172.21.15.88:0/4272440717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1484099fa0 msgr2=0x7f148414f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:00.945 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 --2- 172.21.15.88:0/4272440717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1484099fa0 0x7f148414f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:00.946 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 -- 172.21.15.88:0/4272440717 >> v1:172.21.15.52:6789/0 conn(0x7f14840a14c0 legacy=0x7f1484099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:00.946 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 -- 172.21.15.88:0/4272440717 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14840a26d0 con 0x7f148405ac40 2020-02-11T16:09:00.946 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 --2- 172.21.15.88:0/4272440717 >> v2:172.21.15.88:3300/0 conn(0x7f148405ac40 0x7f14840a2da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f148405faa0 tx=0x7f14740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.946 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 --2- 172.21.15.88:0/4272440717 >> v2:172.21.15.88:3300/0 conn(0x7f148405ac40 0x7f14840a2da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f148405faa0 tx=0x7f14740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.946 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 --2- 172.21.15.88:0/4272440717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f148405ac40 0x7f14840a2da0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f148405faa0 tx=0x7f14740088e0).ready entity=mon.1 client_cookie=72e5c7cc4bab24b7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:00.947 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 --2- 172.21.15.88:0/4272440717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f148405ac40 0x7f14840a2da0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f148405faa0 tx=0x7f14740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.947 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1481d9b700 1 -- 172.21.15.88:0/4272440717 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1474008e20 con 0x7f148405ac40 2020-02-11T16:09:00.947 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 --2- 172.21.15.88:0/4272440717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f148405ac40 0x7f14840a2da0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f148405faa0 tx=0x7f14740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.947 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1482d9d700 1 --2- 172.21.15.88:0/4272440717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f148405ac40 0x7f14840a2da0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f148405faa0 tx=0x7f14740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.948 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.933+0000 7f1481d9b700 1 -- 172.21.15.88:0/4272440717 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14740118d0 con 0x7f148405ac40 2020-02-11T16:09:00.948 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.934+0000 7f1481d9b700 1 -- 172.21.15.88:0/4272440717 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1474011c70 con 0x7f148405ac40 2020-02-11T16:09:00.948 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.934+0000 7f1488f28700 1 -- 172.21.15.88:0/4272440717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f148405ac40 msgr2=0x7f14840a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:00.948 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.934+0000 7f1488f28700 1 --2- 172.21.15.88:0/4272440717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f148405ac40 0x7f14840a2da0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f148405faa0 tx=0x7f14740088e0).stop 2020-02-11T16:09:00.948 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.934+0000 7f1488f28700 1 -- 172.21.15.88:0/4272440717 shutdown_connections 2020-02-11T16:09:00.949 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.934+0000 7f1488f28700 1 --2- 172.21.15.88:0/4272440717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1484099fa0 0x7f148414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:00.949 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.934+0000 7f1488f28700 1 --2- 172.21.15.88:0/4272440717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f148405ac40 0x7f14840a2da0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:00.949 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.934+0000 7f1488f28700 1 -- 172.21.15.88:0/4272440717 >> 172.21.15.88:0/4272440717 conn(0x7f148405c170 msgr2=0x7f148405a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:00.949 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.934+0000 7f1488f28700 1 -- 172.21.15.88:0/4272440717 shutdown_connections 2020-02-11T16:09:00.950 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.934+0000 7f1488f28700 1 -- 172.21.15.88:0/4272440717 wait complete. 2020-02-11T16:09:00.950 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.935+0000 7f1488f28700 1 Processor -- start 2020-02-11T16:09:00.950 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.935+0000 7f1488f28700 1 -- start start 2020-02-11T16:09:00.950 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f1488f28700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f148405ac40 0x7f148409c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:00.950 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f1488f28700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1484099fa0 0x7f148409cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:00.951 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f1488f28700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14840a14c0 0x7f148409a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:00.951 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f1488f28700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148409b650 con 0x7f148405ac40 2020-02-11T16:09:00.951 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f1488f28700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148409c840 con 0x7f1484099fa0 2020-02-11T16:09:00.951 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f1488f28700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148409d1d0 con 0x7f14840a14c0 2020-02-11T16:09:00.952 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1484099fa0 0x7f148409cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:00.952 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148359e700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14840a14c0 msgr2=0x7f148409a930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:00.952 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1484099fa0 0x7f148409cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53600/0 (socket says 172.21.15.88:53600) 2020-02-11T16:09:00.952 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 -- 172.21.15.88:0/880791807 learned_addr learned my addr 172.21.15.88:0/880791807 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:00.953 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148359e700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14840a14c0 0x7f148409a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:00.953 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f1482d9d700 1 --2- 172.21.15.88:0/880791807 >> v2:172.21.15.52:3300/0 conn(0x7f148405ac40 0x7f148409c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:00.953 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 -- 172.21.15.88:0/880791807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14840a14c0 msgr2=0x7f148409a930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:00.953 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14840a14c0 0x7f148409a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:00.953 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 -- 172.21.15.88:0/880791807 >> v2:172.21.15.52:3300/0 conn(0x7f148405ac40 msgr2=0x7f148409c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:00.954 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> v2:172.21.15.52:3300/0 conn(0x7f148405ac40 0x7f148409c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:00.954 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 -- 172.21.15.88:0/880791807 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148409cae0 con 0x7f1484099fa0 2020-02-11T16:09:00.954 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f1482d9d700 1 --2- 172.21.15.88:0/880791807 >> v2:172.21.15.52:3300/0 conn(0x7f148405ac40 0x7f148409c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:09:00.954 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> v2:172.21.15.88:3300/0 conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.955 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> v2:172.21.15.88:3300/0 conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.955 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:00.955 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.956 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f14737fe700 1 -- 172.21.15.88:0/880791807 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147800cbf0 con 0x7f1484099fa0 2020-02-11T16:09:00.956 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.956 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.956 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f14737fe700 1 -- 172.21.15.88:0/880791807 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147800cd50 con 0x7f1484099fa0 2020-02-11T16:09:00.956 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14841378f0 con 0x7f1484099fa0 2020-02-11T16:09:00.957 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f14737fe700 1 -- 172.21.15.88:0/880791807 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147800e350 con 0x7f1484099fa0 2020-02-11T16:09:00.957 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.936+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148409af50 con 0x7f1484099fa0 2020-02-11T16:09:00.957 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.937+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.957 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.937+0000 7f14737fe700 1 -- 172.21.15.88:0/880791807 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f14780064e0 con 0x7f1484099fa0 2020-02-11T16:09:00.958 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.937+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.958 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.937+0000 7f14737fe700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1468039be0 0x7f146803c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:00.958 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.937+0000 7f14737fe700 1 -- 172.21.15.88:0/880791807 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f1478049900 con 0x7f1484099fa0 2020-02-11T16:09:00.958 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.937+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14840565b0 con 0x7f1484099fa0 2020-02-11T16:09:00.958 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.938+0000 7f1482d9d700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1468039be0 0x7f146803c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:00.959 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.938+0000 7f1482d9d700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1468039be0 0x7f146803c0a0 crc :-1 s=READY pgs=165 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:00.959 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.941+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:00.960 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:00.941+0000 7f14737fe700 1 -- 172.21.15.88:0/880791807 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f147802eee0 con 0x7f1484099fa0 2020-02-11T16:09:01.121 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:01.119+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f148409a500 con 0x7f1484099fa0 2020-02-11T16:09:01.643 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:01.641+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:01.643 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:01.641+0000 7f14737fe700 1 -- 172.21.15.88:0/880791807 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v22) v1 ==== 167+0+0 (secure 0 0 0) 0x7f14780319f0 con 0x7f1484099fa0 2020-02-11T16:09:01.780 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:01.779+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f148405e8e0 con 0x7f1484099fa0 2020-02-11T16:09:02.648 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.646+0000 7f148259c700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:02.648 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.646+0000 7f14737fe700 1 -- 172.21.15.88:0/880791807 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v23) v1 ==== 167+0+0 (secure 0 0 0) 0x7f1478031e30 con 0x7f1484099fa0 2020-02-11T16:09:02.651 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.650+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1468039be0 msgr2=0x7f146803c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:02.652 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.650+0000 7f1488f28700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1468039be0 0x7f146803c0a0 crc :-1 s=READY pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:02.652 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.650+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 msgr2=0x7f148409cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:02.652 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.650+0000 7f1488f28700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f1478001f50 tx=0x7f1478010a70).stop 2020-02-11T16:09:02.653 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.650+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 shutdown_connections 2020-02-11T16:09:02.653 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.650+0000 7f1488f28700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14840a14c0 0x7f148409a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:02.653 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.650+0000 7f1488f28700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1468039be0 0x7f146803c0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:02.653 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.650+0000 7f1488f28700 1 --2- 172.21.15.88:0/880791807 >> v2:172.21.15.52:3300/0 conn(0x7f148405ac40 0x7f148409c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:02.653 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.650+0000 7f1488f28700 1 --2- 172.21.15.88:0/880791807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1484099fa0 0x7f148409cd70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:02.654 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.650+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 >> 172.21.15.88:0/880791807 conn(0x7f148405c170 msgr2=0x7f1484069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:02.654 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.651+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 shutdown_connections 2020-02-11T16:09:02.654 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:02.651+0000 7f1488f28700 1 -- 172.21.15.88:0/880791807 wait complete. 2020-02-11T16:09:02.654 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:09:02.669 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo x 2020-02-11T16:09:02.672 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:07.638 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir foo/.snap/ss 2020-02-11T16:09:07.647 INFO:tasks.workunit.client.0.smithi088.stderr:+ ln foo/x foo/xx 2020-02-11T16:09:07.652 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat foo/.snap/ss/x 2020-02-11T16:09:07.659 INFO:tasks.workunit.client.0.smithi088.stdout:x 2020-02-11T16:09:07.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir foo/.snap/ss 2020-02-11T16:09:07.666 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo a 2020-02-11T16:09:07.668 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo b 2020-02-11T16:09:07.670 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir foo/.snap/s 2020-02-11T16:09:07.681 INFO:tasks.workunit.client.0.smithi088.stderr:++ cat foo/.snap/s/a 2020-02-11T16:09:07.689 INFO:tasks.workunit.client.0.smithi088.stderr:+ r=a 2020-02-11T16:09:07.689 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -z a ']' 2020-02-11T16:09:07.690 INFO:tasks.workunit.client.0.smithi088.stderr:+ ln foo/b foo/b2 2020-02-11T16:09:07.693 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat foo/.snap/s/b 2020-02-11T16:09:07.700 INFO:tasks.workunit.client.0.smithi088.stdout:b 2020-02-11T16:09:07.700 INFO:tasks.workunit.client.0.smithi088.stdout:this used to hang: 2020-02-11T16:09:07.700 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 'this used to hang:' 2020-02-11T16:09:07.700 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo more 2020-02-11T16:09:07.701 INFO:tasks.workunit.client.0.smithi088.stdout:oh, it didn't hang! good job. 2020-02-11T16:09:07.702 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 'oh, it didn'\''t hang! good job.' 2020-02-11T16:09:07.702 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat foo/b 2020-02-11T16:09:07.703 INFO:tasks.workunit.client.0.smithi088.stdout:b 2020-02-11T16:09:07.703 INFO:tasks.workunit.client.0.smithi088.stdout:more 2020-02-11T16:09:07.703 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir foo/.snap/s 2020-02-11T16:09:07.711 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -r foo 2020-02-11T16:09:07.733 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:09:07.734 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:09:07.734 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:09:07.734 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:09:07.841 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2020-02-11T16:09:07.842 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2020-02-11T16:09:07.872 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:09:07.873 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:09:07.960 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.955+0000 7ffa9c51c700 1 Processor -- start 2020-02-11T16:09:07.961 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.955+0000 7ffa9c51c700 1 -- start start 2020-02-11T16:09:07.961 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.955+0000 7ffa9c51c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 0x7ffa940a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:07.961 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.955+0000 7ffa9c51c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa940a14c0 0x7ffa94099890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:07.962 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.955+0000 7ffa9c51c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa940a37e0 con 0x7ffa94099cf0 2020-02-11T16:09:07.962 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.955+0000 7ffa9c51c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa940a24e0 con 0x7ffa9405ac40 2020-02-11T16:09:07.962 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.955+0000 7ffa9c51c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa940a4350 con 0x7ffa940a14c0 2020-02-11T16:09:07.962 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.955+0000 7ffa9a2b8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa940a14c0 0x7ffa94099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:07.962 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa940a14c0 0x7ffa94099890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53606/0 (socket says 172.21.15.88:53606) 2020-02-11T16:09:07.962 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9b2ba700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffa94099cf0 0x7ffa940a6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41234/0 (socket says 172.21.15.88:41234) 2020-02-11T16:09:07.962 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 -- 172.21.15.88:0/605624152 learned_addr learned my addr 172.21.15.88:0/605624152 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:07.963 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9aab9700 1 --2- 172.21.15.88:0/605624152 >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 0x7ffa940a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:07.963 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 -- 172.21.15.88:0/605624152 >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 msgr2=0x7ffa940a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:07.963 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 --2- 172.21.15.88:0/605624152 >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 0x7ffa940a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:07.963 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 -- 172.21.15.88:0/605624152 >> v1:172.21.15.88:6789/0 conn(0x7ffa94099cf0 legacy=0x7ffa940a6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:07.963 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 -- 172.21.15.88:0/605624152 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa940a26d0 con 0x7ffa940a14c0 2020-02-11T16:09:07.964 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa99ab7700 1 -- 172.21.15.88:0/605624152 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048006267 0 0) 0x7ffa940a37e0 con 0x7ffa94099cf0 2020-02-11T16:09:07.964 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 --2- 172.21.15.88:0/605624152 >> v2:172.21.15.88:3300/0 conn(0x7ffa940a14c0 0x7ffa94099890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffa88002f30 tx=0x7ffa88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.964 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 --2- 172.21.15.88:0/605624152 >> v2:172.21.15.88:3300/0 conn(0x7ffa940a14c0 0x7ffa94099890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffa88002f30 tx=0x7ffa88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.964 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 --2- 172.21.15.88:0/605624152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa94099890 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7ffa88002f30 tx=0x7ffa88007a40).ready entity=mon.1 client_cookie=597047b9cf2a4c1b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:07.964 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 --2- 172.21.15.88:0/605624152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa94099890 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7ffa88002f30 tx=0x7ffa88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.964 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa99ab7700 1 -- 172.21.15.88:0/605624152 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa88011720 con 0x7ffa940a14c0 2020-02-11T16:09:07.964 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 --2- 172.21.15.88:0/605624152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa94099890 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7ffa88002f30 tx=0x7ffa88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.965 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9a2b8700 1 --2- 172.21.15.88:0/605624152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa94099890 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7ffa88002f30 tx=0x7ffa88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.965 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa99ab7700 1 -- 172.21.15.88:0/605624152 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa88011880 con 0x7ffa940a14c0 2020-02-11T16:09:07.965 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa99ab7700 1 -- 172.21.15.88:0/605624152 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa88011be0 con 0x7ffa940a14c0 2020-02-11T16:09:07.965 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9c51c700 1 -- 172.21.15.88:0/605624152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 msgr2=0x7ffa94099890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:07.966 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.956+0000 7ffa9c51c700 1 --2- 172.21.15.88:0/605624152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa94099890 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7ffa88002f30 tx=0x7ffa88007a40).stop 2020-02-11T16:09:07.966 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.957+0000 7ffa9c51c700 1 -- 172.21.15.88:0/605624152 shutdown_connections 2020-02-11T16:09:07.966 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.957+0000 7ffa9c51c700 1 --2- 172.21.15.88:0/605624152 >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 0x7ffa940a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:07.966 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.957+0000 7ffa9c51c700 1 --2- 172.21.15.88:0/605624152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa94099890 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:07.966 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.957+0000 7ffa9c51c700 1 -- 172.21.15.88:0/605624152 >> 172.21.15.88:0/605624152 conn(0x7ffa9405c170 msgr2=0x7ffa9405a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:07.966 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.957+0000 7ffa9c51c700 1 -- 172.21.15.88:0/605624152 shutdown_connections 2020-02-11T16:09:07.967 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.957+0000 7ffa9c51c700 1 -- 172.21.15.88:0/605624152 wait complete. 2020-02-11T16:09:07.967 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9c51c700 1 Processor -- start 2020-02-11T16:09:07.967 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9c51c700 1 -- start start 2020-02-11T16:09:07.971 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9c51c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 0x7ffa94063ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:07.971 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9c51c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa940a14c0 0x7ffa9407e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:07.971 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9c51c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa94062a90 con 0x7ffa94099cf0 2020-02-11T16:09:07.972 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9c51c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa94065b70 con 0x7ffa9405ac40 2020-02-11T16:09:07.972 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9c51c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa94065e10 con 0x7ffa940a14c0 2020-02-11T16:09:07.972 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9b2ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa940a14c0 0x7ffa9407e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:07.972 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9a2b8700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffa94099cf0 0x7ffa940665a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41238/0 (socket says 172.21.15.88:41238) 2020-02-11T16:09:07.972 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9a2b8700 1 -- 172.21.15.88:0/1504539674 learned_addr learned my addr 172.21.15.88:0/1504539674 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:07.972 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.958+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> v2:172.21.15.88:3300/0 conn(0x7ffa940a14c0 0x7ffa9407e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53614/0 (socket says 172.21.15.88:53614) 2020-02-11T16:09:07.972 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9aab9700 1 --2- 172.21.15.88:0/1504539674 >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 0x7ffa94063ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:07.973 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 -- 172.21.15.88:0/1504539674 >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 msgr2=0x7ffa94063ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:07.973 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa937fe700 1 -- 172.21.15.88:0/1504539674 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548155767 0 0) 0x7ffa94062a90 con 0x7ffa94099cf0 2020-02-11T16:09:07.973 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 0x7ffa94063ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:07.973 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 -- 172.21.15.88:0/1504539674 >> v1:172.21.15.88:6789/0 conn(0x7ffa94099cf0 legacy=0x7ffa940665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:07.973 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 -- 172.21.15.88:0/1504539674 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa940660b0 con 0x7ffa940a14c0 2020-02-11T16:09:07.973 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9aab9700 1 --2- 172.21.15.88:0/1504539674 >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 0x7ffa94063ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:09:07.974 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> v2:172.21.15.88:3300/0 conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.974 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> v2:172.21.15.88:3300/0 conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.974 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:07.975 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.975 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa937fe700 1 -- 172.21.15.88:0/1504539674 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa8c004c50 con 0x7ffa940a14c0 2020-02-11T16:09:07.975 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.975 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.975 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa937fe700 1 -- 172.21.15.88:0/1504539674 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c004db0 con 0x7ffa940a14c0 2020-02-11T16:09:07.975 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa94066cb0 con 0x7ffa940a14c0 2020-02-11T16:09:07.975 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa937fe700 1 -- 172.21.15.88:0/1504539674 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa8c0127a0 con 0x7ffa940a14c0 2020-02-11T16:09:07.976 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa94064450 con 0x7ffa940a14c0 2020-02-11T16:09:07.976 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.959+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.976 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.960+0000 7ffa937fe700 1 -- 172.21.15.88:0/1504539674 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ffa8c012a10 con 0x7ffa940a14c0 2020-02-11T16:09:07.976 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.960+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.976 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.960+0000 7ffa937fe700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa74039b80 0x7ffa7403c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:07.976 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.960+0000 7ffa937fe700 1 -- 172.21.15.88:0/1504539674 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ffa8c049db0 con 0x7ffa940a14c0 2020-02-11T16:09:07.977 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.960+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa940565b0 con 0x7ffa940a14c0 2020-02-11T16:09:07.977 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.960+0000 7ffa9aab9700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa74039b80 0x7ffa7403c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:07.977 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.960+0000 7ffa9aab9700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa74039b80 0x7ffa7403c040 crc :-1 s=READY pgs=166 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:07.977 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.963+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:07.977 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:07.963+0000 7ffa937fe700 1 -- 172.21.15.88:0/1504539674 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ffa8c02f390 con 0x7ffa940a14c0 2020-02-11T16:09:08.147 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:08.144+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffa94066240 con 0x7ffa940a14c0 2020-02-11T16:09:09.055 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:09.052+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:09.055 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:09.052+0000 7ffa937fe700 1 -- 172.21.15.88:0/1504539674 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v24) v1 ==== 167+0+0 (secure 0 0 0) 0x7ffa8c031ea0 con 0x7ffa940a14c0 2020-02-11T16:09:09.195 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:09.192+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffa9405e8e0 con 0x7ffa940a14c0 2020-02-11T16:09:10.058 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.055+0000 7ffa9b2ba700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.058 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.055+0000 7ffa937fe700 1 -- 172.21.15.88:0/1504539674 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v25) v1 ==== 167+0+0 (secure 0 0 0) 0x7ffa8c0322e0 con 0x7ffa940a14c0 2020-02-11T16:09:10.061 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa74039b80 msgr2=0x7ffa7403c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:10.061 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa74039b80 0x7ffa7403c040 crc :-1 s=READY pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:10.061 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 msgr2=0x7ffa9407e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:10.061 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7ffa94065970 tx=0x7ffa8c010c50).stop 2020-02-11T16:09:10.061 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 shutdown_connections 2020-02-11T16:09:10.062 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940a14c0 0x7ffa9407e4e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:10.062 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 --2- 172.21.15.88:0/1504539674 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa74039b80 0x7ffa7403c040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:10.062 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 --2- 172.21.15.88:0/1504539674 >> v2:172.21.15.52:3300/0 conn(0x7ffa9405ac40 0x7ffa94063ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:10.062 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 >> 172.21.15.88:0/1504539674 conn(0x7ffa9405c170 msgr2=0x7ffa94069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:10.062 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 shutdown_connections 2020-02-11T16:09:10.062 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.058+0000 7ffa9c51c700 1 -- 172.21.15.88:0/1504539674 wait complete. 2020-02-11T16:09:10.063 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:09:10.071 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:10.075 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/bar 2020-02-11T16:09:10.087 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/foo 2020-02-11T16:09:10.093 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/foo 2020-02-11T16:09:10.100 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:10.106 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/bar/a 2020-02-11T16:09:10.111 INFO:tasks.workunit.client.0.smithi088.stdout: File: .snap/bar/a 2020-02-11T16:09:10.111 INFO:tasks.workunit.client.0.smithi088.stdout: Size: 0 Blocks: 1 IO Block: 4096 directory 2020-02-11T16:09:10.112 INFO:tasks.workunit.client.0.smithi088.stdout:Device: 2dh/45d Inode: 59955269551003528 Links: 2 2020-02-11T16:09:10.112 INFO:tasks.workunit.client.0.smithi088.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1209/ ubuntu) 2020-02-11T16:09:10.112 INFO:tasks.workunit.client.0.smithi088.stdout:Context: system_u:object_r:fusefs_t:s0 2020-02-11T16:09:10.112 INFO:tasks.workunit.client.0.smithi088.stdout:Access: 2020-02-11 16:09:10.072326274 +0000 2020-02-11T16:09:10.112 INFO:tasks.workunit.client.0.smithi088.stdout:Modify: 2020-02-11 16:09:10.072326274 +0000 2020-02-11T16:09:10.112 INFO:tasks.workunit.client.0.smithi088.stdout:Change: 2020-02-11 16:09:10.072326274 +0000 2020-02-11T16:09:10.112 INFO:tasks.workunit.client.0.smithi088.stdout: Birth: - 2020-02-11T16:09:10.113 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/bar 2020-02-11T16:09:10.118 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:09:10.119 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:09:10.119 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:09:10.119 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:09:10.195 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2020-02-11T16:09:10.195 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2020-02-11T16:09:10.255 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:09:10.256 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:09:10.349 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.338+0000 7fc5b48b2700 1 Processor -- start 2020-02-11T16:09:10.349 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.338+0000 7fc5b48b2700 1 -- start start 2020-02-11T16:09:10.349 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5b48b2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5b00a2da0 0x7fc5b00a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:10.349 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5b48b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b00a37e0 con 0x7fc5b005ac40 2020-02-11T16:09:10.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5b48b2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b00a26d0 con 0x7fc5b0099fa0 2020-02-11T16:09:10.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5b48b2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b00a24e0 con 0x7fc5b00a2da0 2020-02-11T16:09:10.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5af59e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc5b0099fa0 0x7fc5b014f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41246/0 (socket says 172.21.15.88:41246) 2020-02-11T16:09:10.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5af59e700 1 -- 172.21.15.88:0/44871892 learned_addr learned my addr 172.21.15.88:0/44871892 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:10.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254415426 0 0) 0x7fc5b00a26d0 con 0x7fc5b0099fa0 2020-02-11T16:09:10.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc598003230 con 0x7fc5b0099fa0 2020-02-11T16:09:10.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> v2:172.21.15.52:3300/0 conn(0x7fc5b00a2da0 0x7fc5b00a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:10.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3806946883 0 0) 0x7fc598003230 con 0x7fc5b0099fa0 2020-02-11T16:09:10.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 >> v2:172.21.15.52:3300/0 conn(0x7fc5b00a2da0 msgr2=0x7fc5b00a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:10.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 --2- 172.21.15.88:0/44871892 >> v2:172.21.15.52:3300/0 conn(0x7fc5b00a2da0 0x7fc5b00a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:10.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 >> v1:172.21.15.52:6789/0 conn(0x7fc5b005ac40 legacy=0x7fc5b0099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:10.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00a2970 con 0x7fc5b0099fa0 2020-02-11T16:09:10.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fc5a8001a50 con 0x7fc5b0099fa0 2020-02-11T16:09:10.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 >> v1:172.21.15.88:6789/0 conn(0x7fc5b0099fa0 legacy=0x7fc5b014f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:10.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc598003720 0x7fc598003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:10.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 0x7fc598004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:10.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc598004ae0 0x7fc598004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:10.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59800b880 con 0x7fc598004ae0 2020-02-11T16:09:10.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59800b9f0 con 0x7fc598004090 2020-02-11T16:09:10.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5aed9d700 1 -- 172.21.15.88:0/44871892 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc598003720 msgr2=0x7fc598003b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:10.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.339+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59804fbc0 con 0x7fc598003720 2020-02-11T16:09:10.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc598003720 0x7fc598003b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:10.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> v2:172.21.15.52:3300/0 conn(0x7fc5b00a2da0 0x7fc5b00a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:09:10.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 0x7fc598004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:10.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5af59e700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc598004ae0 0x7fc598004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:10.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 -- 172.21.15.88:0/44871892 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc598003720 msgr2=0x7fc598003b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:10.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc598003720 0x7fc598003b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:10.354 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 -- 172.21.15.88:0/44871892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc598004ae0 msgr2=0x7fc598004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:10.354 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc598004ae0 0x7fc598004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:10.354 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5af59e700 1 -- 172.21.15.88:0/44871892 reap_dead start 2020-02-11T16:09:10.354 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 -- 172.21.15.88:0/44871892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc598003230 con 0x7fc598004090 2020-02-11T16:09:10.354 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 0x7fc598004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5a4002f30 tx=0x7fc5a400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.354 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 0x7fc598004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5a4002f30 tx=0x7fc5a400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.355 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 0x7fc598004570 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a400ff00).ready entity=mon.1 client_cookie=9435b70a5434b2c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:10.355 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 0x7fc598004570 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.355 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 0x7fc598004570 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.355 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a4008d30 con 0x7fc598004090 2020-02-11T16:09:10.355 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 0x7fc598004570 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.355 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4008e90 con 0x7fc598004090 2020-02-11T16:09:10.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5add9b700 1 -- 172.21.15.88:0/44871892 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a4010a20 con 0x7fc598004090 2020-02-11T16:09:10.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5b48b2700 1 -- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 msgr2=0x7fc598004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:10.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.340+0000 7fc5b48b2700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 0x7fc598004570 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a400ff00).stop 2020-02-11T16:09:10.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.341+0000 7fc5b48b2700 1 -- 172.21.15.88:0/44871892 shutdown_connections 2020-02-11T16:09:10.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.341+0000 7fc5b48b2700 1 --2- 172.21.15.88:0/44871892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc598004090 0x7fc598004570 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:10.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.341+0000 7fc5b48b2700 1 -- 172.21.15.88:0/44871892 >> 172.21.15.88:0/44871892 conn(0x7fc5b005c170 msgr2=0x7fc5b005a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:10.357 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.341+0000 7fc5b48b2700 1 -- 172.21.15.88:0/44871892 shutdown_connections 2020-02-11T16:09:10.357 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.341+0000 7fc5b48b2700 1 -- 172.21.15.88:0/44871892 wait complete. 2020-02-11T16:09:10.357 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.342+0000 7fc5b48b2700 1 Processor -- start 2020-02-11T16:09:10.357 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.342+0000 7fc5b48b2700 1 -- start start 2020-02-11T16:09:10.357 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.342+0000 7fc5b48b2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5b0120930 0x7fc5b00a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:10.357 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.342+0000 7fc5b48b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b00a4aa0 con 0x7fc5b0135910 2020-02-11T16:09:10.358 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.342+0000 7fc5b48b2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b0065130 con 0x7fc5b01354b0 2020-02-11T16:09:10.358 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.342+0000 7fc5b48b2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b00a4600 con 0x7fc5b0120930 2020-02-11T16:09:10.358 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.342+0000 7fc5aed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5b0120930 0x7fc5b00a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:10.358 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.342+0000 7fc5ae59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc5b01354b0 0x7fc5b0063ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41256/0 (socket says 172.21.15.88:41256) 2020-02-11T16:09:10.358 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.342+0000 7fc5aed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5b0120930 0x7fc5b00a7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53628/0 (socket says 172.21.15.88:53628) 2020-02-11T16:09:10.358 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.342+0000 7fc5ae59c700 1 -- 172.21.15.88:0/1886626248 learned_addr learned my addr 172.21.15.88:0/1886626248 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:10.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5aed9d700 1 -- 172.21.15.88:0/1886626248 >> v1:172.21.15.88:6789/0 conn(0x7fc5b01354b0 legacy=0x7fc5b0063ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:10.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5aed9d700 1 -- 172.21.15.88:0/1886626248 >> v1:172.21.15.52:6789/0 conn(0x7fc5b0135910 legacy=0x7fc5b013c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:10.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc59f7fe700 1 -- 172.21.15.88:0/1886626248 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148001561 0 0) 0x7fc5b0065130 con 0x7fc5b01354b0 2020-02-11T16:09:10.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5aed9d700 1 -- 172.21.15.88:0/1886626248 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0065360 con 0x7fc5b0120930 2020-02-11T16:09:10.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> v2:172.21.15.88:3300/0 conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> v2:172.21.15.88:3300/0 conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:10.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc59f7fe700 1 -- 172.21.15.88:0/1886626248 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a0005bb0 con 0x7fc5b0120930 2020-02-11T16:09:10.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc59f7fe700 1 -- 172.21.15.88:0/1886626248 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0005d50 con 0x7fc5b0120930 2020-02-11T16:09:10.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc59f7fe700 1 -- 172.21.15.88:0/1886626248 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a00062b0 con 0x7fc5b0120930 2020-02-11T16:09:10.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b007f790 con 0x7fc5b0120930 2020-02-11T16:09:10.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b0065800 con 0x7fc5b0120930 2020-02-11T16:09:10.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.343+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.344+0000 7fc59f7fe700 1 -- 172.21.15.88:0/1886626248 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc5a0006520 con 0x7fc5b0120930 2020-02-11T16:09:10.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.344+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.344+0000 7fc59f7fe700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc594039be0 0x7fc59403c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:10.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.344+0000 7fc59f7fe700 1 -- 172.21.15.88:0/1886626248 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fc5a00499e0 con 0x7fc5b0120930 2020-02-11T16:09:10.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.344+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b00a81b0 con 0x7fc5b0120930 2020-02-11T16:09:10.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.344+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc594039be0 0x7fc59403c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:10.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.344+0000 7fc5ae59c700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc594039be0 0x7fc59403c0a0 crc :-1 s=READY pgs=167 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:10.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.348+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:10.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.348+0000 7fc59f7fe700 1 -- 172.21.15.88:0/1886626248 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc5b00a81b0 con 0x7fc5b0120930 2020-02-11T16:09:10.528 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:10.525+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc5b00a81b0 con 0x7fc5b0120930 2020-02-11T16:09:11.066 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:11.063+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:11.066 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:11.063+0000 7fc59f7fe700 1 -- 172.21.15.88:0/1886626248 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v26) v1 ==== 167+0+0 (secure 0 0 0) 0x7fc5b00a81b0 con 0x7fc5b0120930 2020-02-11T16:09:11.204 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:11.200+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc5b00a81b0 con 0x7fc5b0120930 2020-02-11T16:09:12.065 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:09:12.068 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:09:12.075 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.072+0000 7fc5aed9d700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.075 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.072+0000 7fc59f7fe700 1 -- 172.21.15.88:0/1886626248 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v27) v1 ==== 167+0+0 (secure 0 0 0) 0x7fc5b00a81b0 con 0x7fc5b0120930 2020-02-11T16:09:12.076 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:09:12.075+0000 7f25f7552700 -1 osd.4 pg_epoch: 29 pg[3.3s0( v 28'1379 (0'0,28'1379] local-lis/les=21/22 n=2 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=28'1379 lcod 28'1378 mlcod 28'1378 active+clean+snaptrim trimq=[1a6~2,1a9~2] ps=[c~19a]] removing snap head 2020-02-11T16:09:12.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.075+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc594039be0 msgr2=0x7fc59403c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:12.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.075+0000 7fc5b48b2700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc594039be0 0x7fc59403c0a0 crc :-1 s=READY pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:12.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.075+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 msgr2=0x7fc5b00a7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:12.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.075+0000 7fc5b48b2700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fc5b005fea0 tx=0x7fc5a0010920).stop 2020-02-11T16:09:12.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.075+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 shutdown_connections 2020-02-11T16:09:12.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.075+0000 7fc5b48b2700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc594039be0 0x7fc59403c0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:12.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.075+0000 7fc5b48b2700 1 --2- 172.21.15.88:0/1886626248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5b0120930 0x7fc5b00a7d20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:12.079 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.075+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 >> 172.21.15.88:0/1886626248 conn(0x7fc5b005c170 msgr2=0x7fc5b00a14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:12.079 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.075+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 shutdown_connections 2020-02-11T16:09:12.079 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:12.075+0000 7fc5b48b2700 1 -- 172.21.15.88:0/1886626248 wait complete. 2020-02-11T16:09:12.080 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:09:12.091 INFO:tasks.workunit.client.0.smithi088.stderr:++ seq 1 20 2020-02-11T16:09:12.092 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:12.092 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:12.095 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:12.095 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:12.109 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:12.116 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:12.117 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:12.230 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:12.232 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:09:12.232 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2020-02-11T16:09:12.232 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-11T16:09:12.233 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-11T16:09:12.235 INFO:tasks.ceph.mon.c:Started 2020-02-11T16:09:12.235 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:09:12.236 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:09:12.243 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:12.244 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:12.244 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:12.244 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:12.244 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:12.244 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:12.244 INFO:tasks.workunit.client.0.smithi088.stdout: 39407 ? 00:00:00 ps 2020-02-11T16:09:12.246 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:12.260 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:12.263 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:12.270 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:12.270 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:12.272 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:12.272 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:12.285 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:12.291 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:12.292 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:12.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.346+0000 7f481abcb700 1 Processor -- start 2020-02-11T16:09:12.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.346+0000 7f481abcb700 1 -- start start 2020-02-11T16:09:12.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f481abcb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 0x7f48140a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:12.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f481abcb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48140a31b0 con 0x7f48140a5de0 2020-02-11T16:09:12.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f481abcb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48140a3570 con 0x7f48140a6260 2020-02-11T16:09:12.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f481abcb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48140a3810 con 0x7f48140a18a0 2020-02-11T16:09:12.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f4819168700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f48140a6260 0x7f481412eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41268/0 (socket says 172.21.15.88:41268) 2020-02-11T16:09:12.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f4819168700 1 -- 172.21.15.88:0/3870977539 learned_addr learned my addr 172.21.15.88:0/3870977539 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:12.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f4818967700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 0x7f48140a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:12.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261054241 0 0) 0x7f48140a3570 con 0x7f48140a6260 2020-02-11T16:09:12.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f4818967700 1 -- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 msgr2=0x7f48140a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:09:12.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f4818967700 1 -- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 msgr2=0x7f48140a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:09:12.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f4818967700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 0x7f48140a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:12.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4800003230 con 0x7f48140a6260 2020-02-11T16:09:12.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f4818967700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 0x7f48140a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:12.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1999692909 0 0) 0x7f4800003230 con 0x7f48140a6260 2020-02-11T16:09:12.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 msgr2=0x7f48140a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:12.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 0x7f48140a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:12.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 >> v1:172.21.15.52:6789/0 conn(0x7f48140a5de0 legacy=0x7f481412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:12.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48140a3ab0 con 0x7f48140a6260 2020-02-11T16:09:12.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f480c001a50 con 0x7f48140a6260 2020-02-11T16:09:12.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 >> v1:172.21.15.88:6789/0 conn(0x7f48140a6260 legacy=0x7f481412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:12.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 0x7f4800003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:12.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4800003bb0 0x7f4800004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:12.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4800004590 0x7f4800004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:12.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140a3810 con 0x7f4800003bb0 2020-02-11T16:09:12.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4800004fc0 con 0x7f4800004590 2020-02-11T16:09:12.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.347+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4800005180 con 0x7f48140a18a0 2020-02-11T16:09:12.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4800004590 0x7f4800004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:12.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4818967700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 0x7f4800003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:12.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4813fff700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4800003bb0 0x7f4800004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:12.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 -- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 msgr2=0x7f4800003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:12.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48140a18a0 0x7f4800003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:12.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 -- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4800003bb0 msgr2=0x7f4800004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:12.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4800003bb0 0x7f4800004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:12.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 -- 172.21.15.88:0/3870977539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4800003230 con 0x7f4800004590 2020-02-11T16:09:12.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4800004590 0x7f4800004a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f480c001760 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4800004590 0x7f4800004a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f480c001760 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4800004590 0x7f4800004a10 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f480c001760 tx=0x7f48140a1c80).ready entity=mon.1 client_cookie=cb0322b0c9abb93f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:12.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4800004590 0x7f4800004a10 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f480c001760 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480c00e540 con 0x7f4800004590 2020-02-11T16:09:12.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4800004590 0x7f4800004a10 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f480c001760 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c00e6a0 con 0x7f4800004590 2020-02-11T16:09:12.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4800004590 0x7f4800004a10 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f480c001760 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f48137fe700 1 -- 172.21.15.88:0/3870977539 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480c00ea40 con 0x7f4800004590 2020-02-11T16:09:12.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f481abcb700 1 -- 172.21.15.88:0/3870977539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4800004590 msgr2=0x7f4800004a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:12.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f481abcb700 1 --2- 172.21.15.88:0/3870977539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4800004590 0x7f4800004a10 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f480c001760 tx=0x7f48140a1c80).stop 2020-02-11T16:09:12.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.348+0000 7f4819168700 1 -- 172.21.15.88:0/3870977539 reap_dead start 2020-02-11T16:09:12.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.349+0000 7f481abcb700 1 -- 172.21.15.88:0/3870977539 shutdown_connections 2020-02-11T16:09:12.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.349+0000 7f481abcb700 1 -- 172.21.15.88:0/3870977539 >> 172.21.15.88:0/3870977539 conn(0x7f481409d110 msgr2=0x7f481409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:12.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.349+0000 7f481abcb700 1 -- 172.21.15.88:0/3870977539 shutdown_connections 2020-02-11T16:09:12.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.349+0000 7f481abcb700 1 -- 172.21.15.88:0/3870977539 wait complete. 2020-02-11T16:09:12.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.349+0000 7f481abcb700 1 Processor -- start 2020-02-11T16:09:12.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.349+0000 7f481abcb700 1 -- start start 2020-02-11T16:09:12.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f481abcb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4814065810 0x7f4814135000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:12.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f481abcb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4814138c10 0x7f4814135460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:12.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f481abcb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4814129290 0x7f4814129740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:12.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f481abcb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48140a7660 con 0x7f4814065810 2020-02-11T16:09:12.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f481abcb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481405a750 con 0x7f4814129290 2020-02-11T16:09:12.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f481abcb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481405a9f0 con 0x7f4814138c10 2020-02-11T16:09:12.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4819168700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4814129290 0x7f4814129740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:12.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4819168700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4814129290 0x7f4814129740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53654/0 (socket says 172.21.15.88:53654) 2020-02-11T16:09:12.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4819168700 1 -- 172.21.15.88:0/1454164102 learned_addr learned my addr 172.21.15.88:0/1454164102 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:12.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4818967700 1 --2- 172.21.15.88:0/1454164102 >> v2:172.21.15.52:3300/0 conn(0x7f4814065810 0x7f4814135000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:12.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4813fff700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4814138c10 0x7f4814135460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:12.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4813fff700 1 -- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4814138c10 msgr2=0x7f4814135460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:09:12.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4813fff700 1 -- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4814138c10 msgr2=0x7f4814135460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:09:12.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4813fff700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4814138c10 0x7f4814135460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:12.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4813fff700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4814138c10 0x7f4814135460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:12.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4819168700 1 -- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4814138c10 msgr2=0x7f4814135460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:12.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4814138c10 0x7f4814135460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:12.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4819168700 1 -- 172.21.15.88:0/1454164102 >> v2:172.21.15.52:3300/0 conn(0x7f4814065810 msgr2=0x7f4814135000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:12.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.350+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> v2:172.21.15.52:3300/0 conn(0x7f4814065810 0x7f4814135000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:12.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4819168700 1 -- 172.21.15.88:0/1454164102 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48140a4780 con 0x7f4814129290 2020-02-11T16:09:12.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4818967700 1 --2- 172.21.15.88:0/1454164102 >> v2:172.21.15.52:3300/0 conn(0x7f4814065810 0x7f4814135000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:09:12.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> v2:172.21.15.88:3300/0 conn(0x7f4814129290 0x7f4814129740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> v2:172.21.15.88:3300/0 conn(0x7f4814129290 0x7f4814129740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 0x7f4814129740 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:12.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 0x7f4814129740 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4811ffb700 1 -- 172.21.15.88:0/1454164102 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480c004930 con 0x7f4814129290 2020-02-11T16:09:12.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 0x7f4814129740 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 0x7f4814129740 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4811ffb700 1 -- 172.21.15.88:0/1454164102 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c004a90 con 0x7f4814129290 2020-02-11T16:09:12.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4811ffb700 1 -- 172.21.15.88:0/1454164102 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480c004e30 con 0x7f4814129290 2020-02-11T16:09:12.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f481abcb700 1 -- 172.21.15.88:0/1454164102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481409ed00 con 0x7f4814129290 2020-02-11T16:09:12.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f481abcb700 1 -- 172.21.15.88:0/1454164102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4814129d60 con 0x7f4814129290 2020-02-11T16:09:12.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.351+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 0x7f4814129740 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.352+0000 7f4811ffb700 1 -- 172.21.15.88:0/1454164102 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f480c0100b0 con 0x7f4814129290 2020-02-11T16:09:12.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.352+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 0x7f4814129740 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.352+0000 7f4811ffb700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47f4039c30 0x7f47f403c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:12.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.352+0000 7f481abcb700 1 -- 172.21.15.88:0/1454164102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481409e490 con 0x7f4814129290 2020-02-11T16:09:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.352+0000 7f4811ffb700 1 -- 172.21.15.88:0/1454164102 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f480c049d00 con 0x7f4814129290 2020-02-11T16:09:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.352+0000 7f4818967700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47f4039c30 0x7f47f403c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.352+0000 7f4818967700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47f4039c30 0x7f47f403c0f0 crc :-1 s=READY pgs=169 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.355+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 0x7f4814129740 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.355+0000 7f4811ffb700 1 -- 172.21.15.88:0/1454164102 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f481409e490 con 0x7f4814129290 2020-02-11T16:09:12.403 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:12.409 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:12.410 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:12.410 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:12.410 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:12.410 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:12.410 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:12.410 INFO:tasks.workunit.client.0.smithi088.stdout: 39459 ? 00:00:00 ps 2020-02-11T16:09:12.411 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:12.424 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:12.426 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:12.432 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:12.432 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:12.434 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:12.435 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:12.447 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:12.454 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:12.454 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:12.521 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:12.527 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:12.527 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:12.527 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:12.527 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:12.527 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:12.527 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:12.528 INFO:tasks.workunit.client.0.smithi088.stdout: 39469 ? 00:00:00 ps 2020-02-11T16:09:12.529 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:12.541 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:12.543 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:12.549 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:12.549 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:12.551 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:12.552 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:12.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.550+0000 7f481abcb700 1 -- 172.21.15.88:0/1454164102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f481409e490 con 0x7f4814129290 2020-02-11T16:09:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.550+0000 7f4819168700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 0x7f4814129740 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.550+0000 7f4811ffb700 1 -- 172.21.15.88:0/1454164102 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f481409e490 con 0x7f4814129290 2020-02-11T16:09:12.553 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":42,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:12.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 -- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47f4039c30 msgr2=0x7f47f403c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:12.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47f4039c30 0x7f47f403c0f0 crc :-1 s=READY pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:12.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 -- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 msgr2=0x7f4814129740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:12.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 0x7f4814129740 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f48140a34c0 tx=0x7f48140a1c80).stop 2020-02-11T16:09:12.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 -- 172.21.15.88:0/1454164102 shutdown_connections 2020-02-11T16:09:12.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4814129290 0x7f4814129740 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:12.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f47f4039c30 0x7f47f403c0f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:12.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 --2- 172.21.15.88:0/1454164102 >> v2:172.21.15.52:3300/0 conn(0x7f4814065810 0x7f4814135000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:12.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 --2- 172.21.15.88:0/1454164102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4814138c10 0x7f4814135460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:12.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 -- 172.21.15.88:0/1454164102 >> 172.21.15.88:0/1454164102 conn(0x7f481409d110 msgr2=0x7f48140a4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:12.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 -- 172.21.15.88:0/1454164102 shutdown_connections 2020-02-11T16:09:12.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:12.552+0000 7f481abcb700 1 -- 172.21.15.88:0/1454164102 wait complete. 2020-02-11T16:09:12.561 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:12.566 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":42,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:12.568 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:12.569 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:12.683 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:12.698 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:12.698 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:12.699 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:12.699 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:12.699 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:12.699 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:12.699 INFO:tasks.workunit.client.0.smithi088.stdout: 39481 ? 00:00:00 ps 2020-02-11T16:09:12.699 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:12.702 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:12.705 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:12.710 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:12.710 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:12.712 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:12.712 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:12.724 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:12.730 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:12.731 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:12.778 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:12.783 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:12.784 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:12.784 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:12.784 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:12.784 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:12.784 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:12.784 INFO:tasks.workunit.client.0.smithi088.stdout: 39491 ? 00:00:00 ps 2020-02-11T16:09:12.786 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:12.798 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:12.802 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:12.805 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:12.805 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:12.807 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:12.807 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:12.818 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:12.823 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:12.823 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:12.869 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:12.875 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:12.876 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:12.876 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:12.876 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:12.876 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:12.876 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:12.877 INFO:tasks.workunit.client.0.smithi088.stdout: 39502 ? 00:00:00 ps 2020-02-11T16:09:12.877 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:12.889 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:12.892 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:12.897 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:12.898 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:12.900 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:12.900 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:12.909 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:12.915 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:12.916 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:12.978 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:12.984 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:12.985 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:12.985 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:12.985 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:12.985 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:12.985 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:12.986 INFO:tasks.workunit.client.0.smithi088.stdout: 39512 ? 00:00:00 ps 2020-02-11T16:09:12.987 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:12.998 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:13.001 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:13.007 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:13.007 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:13.009 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:13.009 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:13.019 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:13.025 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:13.026 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:13.098 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:13.102 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:13.102 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:13.102 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:13.102 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:13.103 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:13.103 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:13.103 INFO:tasks.workunit.client.0.smithi088.stdout: 39522 ? 00:00:00 ps 2020-02-11T16:09:13.103 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:13.115 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:13.118 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:13.123 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:13.123 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:13.126 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:13.126 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:13.135 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:13.143 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:13.144 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:13.212 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:13.218 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:13.218 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:13.218 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:13.218 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:13.218 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:13.219 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:13.219 INFO:tasks.workunit.client.0.smithi088.stdout: 39532 ? 00:00:00 ps 2020-02-11T16:09:13.220 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:13.231 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:13.234 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:13.239 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:13.239 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:13.241 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:13.242 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:13.250 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:13.256 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:13.257 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:13.327 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:13.327 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:13.327 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:13.327 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:13.327 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:13.328 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:13.328 INFO:tasks.workunit.client.0.smithi088.stdout: 39542 ? 00:00:00 ps 2020-02-11T16:09:13.329 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:13.340 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:13.343 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:13.348 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:13.349 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:13.351 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:13.351 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:13.360 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:13.366 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:13.367 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:13.438 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:13.443 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:13.443 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:13.444 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:13.444 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:13.444 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:13.444 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:13.444 INFO:tasks.workunit.client.0.smithi088.stdout: 39552 ? 00:00:00 ps 2020-02-11T16:09:13.445 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:13.457 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:13.460 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:13.465 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:13.466 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:13.467 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:13.468 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:13.476 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:13.482 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:13.483 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:13.530 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:13.535 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:13.535 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:13.535 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:13.535 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:13.535 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:13.535 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:13.536 INFO:tasks.workunit.client.0.smithi088.stdout: 39562 ? 00:00:00 ps 2020-02-11T16:09:13.538 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:13.549 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:13.551 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:13.557 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:13.557 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:13.559 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:13.559 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:13.569 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:13.575 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:13.576 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:13.621 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:13.627 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:13.627 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:13.627 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:13.627 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:13.628 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:13.628 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:13.628 INFO:tasks.workunit.client.0.smithi088.stdout: 39572 ? 00:00:00 ps 2020-02-11T16:09:13.629 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:13.655 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:13.657 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:13.663 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:13.663 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:13.665 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:13.666 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:13.675 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:13.681 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:13.682 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:13.797 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:13.803 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:13.803 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:13.803 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:13.803 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:13.803 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:13.803 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:13.804 INFO:tasks.workunit.client.0.smithi088.stdout: 39582 ? 00:00:00 ps 2020-02-11T16:09:13.805 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:13.818 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:13.821 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:13.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:13.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:13.829 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:13.829 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:13.838 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:13.844 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:13.845 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:13.906 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:13.912 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:13.913 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:13.913 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:13.913 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:13.913 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:13.913 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:13.913 INFO:tasks.workunit.client.0.smithi088.stdout: 39592 ? 00:00:00 ps 2020-02-11T16:09:13.915 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:13.930 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:13.930 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:13.935 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:13.935 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:13.937 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:13.938 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:13.947 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:13.953 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:13.954 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:13.998 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:14.004 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:14.004 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:14.004 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:14.004 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:14.004 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:14.004 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:14.005 INFO:tasks.workunit.client.0.smithi088.stdout: 39602 ? 00:00:00 ps 2020-02-11T16:09:14.006 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:14.018 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:14.021 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:14.026 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:14.026 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:14.028 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:14.028 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:14.044 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:14.051 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:14.052 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:14.164 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:14.170 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:14.170 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:14.170 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:14.170 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:14.170 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:14.171 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:14.171 INFO:tasks.workunit.client.0.smithi088.stdout: 39612 ? 00:00:00 ps 2020-02-11T16:09:14.172 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:14.190 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:14.192 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:14.198 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:14.198 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:14.200 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:14.200 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:14.210 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:14.216 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:14.217 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:14.282 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:14.288 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:14.288 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:14.288 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:14.288 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:14.288 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:14.288 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:14.289 INFO:tasks.workunit.client.0.smithi088.stdout: 39622 ? 00:00:00 ps 2020-02-11T16:09:14.290 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:14.303 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:14.306 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:14.314 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:14.314 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:14.317 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:14.317 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:14.328 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:14.335 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:14.336 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:14.390 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:14.396 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:14.396 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:14.396 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:14.396 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:14.396 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:14.396 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:14.397 INFO:tasks.workunit.client.0.smithi088.stdout: 39632 ? 00:00:00 ps 2020-02-11T16:09:14.403 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:14.413 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:14.416 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:14.424 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:09:14.424 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:09:14.426 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/one 2020-02-11T16:09:14.427 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat 2020-02-11T16:09:14.436 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/two 2020-02-11T16:09:14.443 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a/foo 2020-02-11T16:09:14.444 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:09:14.523 INFO:tasks.workunit.client.0.smithi088.stderr:+ ps 2020-02-11T16:09:14.529 INFO:tasks.workunit.client.0.smithi088.stdout: PID TTY TIME CMD 2020-02-11T16:09:14.529 INFO:tasks.workunit.client.0.smithi088.stdout: 4630 ? 00:00:00 systemd 2020-02-11T16:09:14.529 INFO:tasks.workunit.client.0.smithi088.stdout: 4649 ? 00:00:00 (sd-pam) 2020-02-11T16:09:14.529 INFO:tasks.workunit.client.0.smithi088.stdout: 22145 ? 00:00:00 sshd 2020-02-11T16:09:14.529 INFO:tasks.workunit.client.0.smithi088.stdout: 39338 ? 00:00:00 timeout 2020-02-11T16:09:14.530 INFO:tasks.workunit.client.0.smithi088.stdout: 39355 ? 00:00:00 snaptest-double 2020-02-11T16:09:14.530 INFO:tasks.workunit.client.0.smithi088.stdout: 39642 ? 00:00:00 ps 2020-02-11T16:09:14.531 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/one a/.snap/two 2020-02-11T16:09:14.543 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a/foo 2020-02-11T16:09:14.545 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a 2020-02-11T16:09:14.551 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:09:14.551 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:09:14.552 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:09:14.552 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:09:14.627 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2020-02-11T16:09:14.627 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2020-02-11T16:09:14.687 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:09:14.774 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff984d78700 1 Processor -- start 2020-02-11T16:09:14.774 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff984d78700 1 -- start start 2020-02-11T16:09:14.775 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff984d78700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff98005ac40 0x7ff9800a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:14.775 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff984d78700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff9800a14c0 0x7ff980099890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:14.775 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff984d78700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff980099cf0 0x7ff98009a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:14.775 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff984d78700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9800a24e0 con 0x7ff9800a14c0 2020-02-11T16:09:14.775 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff984d78700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9800a4350 con 0x7ff98005ac40 2020-02-11T16:09:14.775 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff984d78700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800a37e0 con 0x7ff980099cf0 2020-02-11T16:09:14.775 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff97ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff98005ac40 0x7ff9800a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:14.776 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff97ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff98005ac40 0x7ff9800a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53658/0 (socket says 172.21.15.88:53658) 2020-02-11T16:09:14.776 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.769+0000 7ff97ed9d700 1 -- 172.21.15.88:0/2967290815 learned_addr learned my addr 172.21.15.88:0/2967290815 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:14.776 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97659c700 1 --2- 172.21.15.88:0/2967290815 >> v2:172.21.15.52:3300/0 conn(0x7ff9800a14c0 0x7ff980099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:14.776 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97f59e700 1 --2- 172.21.15.88:0/2967290815 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff980099cf0 0x7ff98009a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:14.776 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 -- 172.21.15.88:0/2967290815 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff980099cf0 msgr2=0x7ff98009a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:14.776 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/2967290815 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff980099cf0 0x7ff98009a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:14.776 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 -- 172.21.15.88:0/2967290815 >> v2:172.21.15.52:3300/0 conn(0x7ff9800a14c0 msgr2=0x7ff980099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:14.777 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/2967290815 >> v2:172.21.15.52:3300/0 conn(0x7ff9800a14c0 0x7ff980099890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:14.777 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 -- 172.21.15.88:0/2967290815 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98009a5c0 con 0x7ff98005ac40 2020-02-11T16:09:14.777 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97659c700 1 --2- 172.21.15.88:0/2967290815 >> v2:172.21.15.52:3300/0 conn(0x7ff9800a14c0 0x7ff980099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:09:14.777 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/2967290815 >> v2:172.21.15.88:3300/0 conn(0x7ff98005ac40 0x7ff9800a2da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff970002f30 tx=0x7ff970007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.777 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/2967290815 >> v2:172.21.15.88:3300/0 conn(0x7ff98005ac40 0x7ff9800a2da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff970002f30 tx=0x7ff970007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.777 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/2967290815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff98005ac40 0x7ff9800a2da0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7ff970002f30 tx=0x7ff970007a40).ready entity=mon.1 client_cookie=158b4de703221186 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:14.778 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/2967290815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff98005ac40 0x7ff9800a2da0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7ff970002f30 tx=0x7ff970007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.778 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97e59c700 1 -- 172.21.15.88:0/2967290815 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff970011720 con 0x7ff98005ac40 2020-02-11T16:09:14.778 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/2967290815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff98005ac40 0x7ff9800a2da0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7ff970002f30 tx=0x7ff970007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.778 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/2967290815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff98005ac40 0x7ff9800a2da0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7ff970002f30 tx=0x7ff970007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.778 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97e59c700 1 -- 172.21.15.88:0/2967290815 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970011880 con 0x7ff98005ac40 2020-02-11T16:09:14.778 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff97e59c700 1 -- 172.21.15.88:0/2967290815 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff970011be0 con 0x7ff98005ac40 2020-02-11T16:09:14.779 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff984d78700 1 -- 172.21.15.88:0/2967290815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff98005ac40 msgr2=0x7ff9800a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:14.779 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff984d78700 1 --2- 172.21.15.88:0/2967290815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff98005ac40 0x7ff9800a2da0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7ff970002f30 tx=0x7ff970007a40).stop 2020-02-11T16:09:14.779 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff984d78700 1 -- 172.21.15.88:0/2967290815 shutdown_connections 2020-02-11T16:09:14.779 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff984d78700 1 --2- 172.21.15.88:0/2967290815 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff980099cf0 0x7ff98009a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:14.779 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff984d78700 1 --2- 172.21.15.88:0/2967290815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff98005ac40 0x7ff9800a2da0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:14.779 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff984d78700 1 --2- 172.21.15.88:0/2967290815 >> v2:172.21.15.52:3300/0 conn(0x7ff9800a14c0 0x7ff980099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:14.779 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.770+0000 7ff984d78700 1 -- 172.21.15.88:0/2967290815 >> 172.21.15.88:0/2967290815 conn(0x7ff98005c170 msgr2=0x7ff98005a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:14.780 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.771+0000 7ff984d78700 1 -- 172.21.15.88:0/2967290815 shutdown_connections 2020-02-11T16:09:14.780 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.771+0000 7ff984d78700 1 -- 172.21.15.88:0/2967290815 wait complete. 2020-02-11T16:09:14.780 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.772+0000 7ff984d78700 1 Processor -- start 2020-02-11T16:09:14.780 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.772+0000 7ff984d78700 1 -- start start 2020-02-11T16:09:14.783 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.772+0000 7ff984d78700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff98005ac40 0x7ff980121580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:14.783 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.772+0000 7ff984d78700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9800a14c0 0x7ff98007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:14.784 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.772+0000 7ff984d78700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98007f330 con 0x7ff980099cf0 2020-02-11T16:09:14.784 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.772+0000 7ff984d78700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9801238b0 con 0x7ff98005ac40 2020-02-11T16:09:14.784 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.772+0000 7ff984d78700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff980123b50 con 0x7ff9800a14c0 2020-02-11T16:09:14.784 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.772+0000 7ff97f59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9800a14c0 0x7ff98007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:14.784 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.772+0000 7ff97f59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9800a14c0 0x7ff98007e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53666/0 (socket says 172.21.15.88:53666) 2020-02-11T16:09:14.784 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.772+0000 7ff97f59e700 1 -- 172.21.15.88:0/627100554 learned_addr learned my addr 172.21.15.88:0/627100554 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:14.785 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/627100554 >> v2:172.21.15.52:3300/0 conn(0x7ff98005ac40 0x7ff980121580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:14.785 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 -- 172.21.15.88:0/627100554 >> v2:172.21.15.52:3300/0 conn(0x7ff98005ac40 msgr2=0x7ff980121580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:14.785 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> v2:172.21.15.52:3300/0 conn(0x7ff98005ac40 0x7ff980121580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:14.785 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 -- 172.21.15.88:0/627100554 >> v1:172.21.15.52:6789/0 conn(0x7ff980099cf0 legacy=0x7ff9801207b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:14.785 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 -- 172.21.15.88:0/627100554 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff980121d00 con 0x7ff9800a14c0 2020-02-11T16:09:14.785 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> v2:172.21.15.88:3300/0 conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.786 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> v2:172.21.15.88:3300/0 conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.786 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:14.786 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.786 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff977fff700 1 -- 172.21.15.88:0/627100554 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff978007350 con 0x7ff9800a14c0 2020-02-11T16:09:14.786 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.786 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.786 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff977fff700 1 -- 172.21.15.88:0/627100554 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9780074b0 con 0x7ff9800a14c0 2020-02-11T16:09:14.787 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9801219e0 con 0x7ff9800a14c0 2020-02-11T16:09:14.787 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff977fff700 1 -- 172.21.15.88:0/627100554 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9780078d0 con 0x7ff9800a14c0 2020-02-11T16:09:14.787 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff980120ec0 con 0x7ff9800a14c0 2020-02-11T16:09:14.787 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.773+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.787 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.774+0000 7ff977fff700 1 -- 172.21.15.88:0/627100554 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff9780123f0 con 0x7ff9800a14c0 2020-02-11T16:09:14.787 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.774+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.787 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.774+0000 7ff977fff700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff964039c90 0x7ff96403c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:14.788 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.774+0000 7ff977fff700 1 -- 172.21.15.88:0/627100554 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff978049cc0 con 0x7ff9800a14c0 2020-02-11T16:09:14.788 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.774+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9800565b0 con 0x7ff9800a14c0 2020-02-11T16:09:14.788 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.774+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff964039c90 0x7ff96403c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:14.788 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.774+0000 7ff97ed9d700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff964039c90 0x7ff96403c150 crc :-1 s=READY pgs=170 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:14.788 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.778+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:14.788 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.778+0000 7ff977fff700 1 -- 172.21.15.88:0/627100554 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff97802f300 con 0x7ff9800a14c0 2020-02-11T16:09:14.971 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:14.968+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff98005e8e0 con 0x7ff9800a14c0 2020-02-11T16:09:15.567 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:09:15.641 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:15.638+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.641 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:15.638+0000 7ff977fff700 1 -- 172.21.15.88:0/627100554 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v28) v1 ==== 167+0+0 (secure 0 0 0) 0x7ff978031e10 con 0x7ff9800a14c0 2020-02-11T16:09:15.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.676+0000 7f87d8e10700 1 Processor -- start 2020-02-11T16:09:15.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.676+0000 7f87d8e10700 1 -- start start 2020-02-11T16:09:15.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.676+0000 7f87d8e10700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d40a18a0 0x7f87d40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.676+0000 7f87d8e10700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87d40a5de0 0x7f87d40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.676+0000 7f87d8e10700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87d412e3a0 0x7f87d412e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.676+0000 7f87d8e10700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d40a3570 con 0x7f87d40a5de0 2020-02-11T16:09:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d8e10700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d40a3810 con 0x7f87d412e3a0 2020-02-11T16:09:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d8e10700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40a3ab0 con 0x7f87d40a18a0 2020-02-11T16:09:15.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87d412e3a0 0x7f87d412e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:15.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87d412e3a0 0x7f87d412e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53676/0 (socket says 172.21.15.88:53676) 2020-02-11T16:09:15.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 -- 172.21.15.88:0/2207880856 learned_addr learned my addr 172.21.15.88:0/2207880856 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:15.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87cbfff700 1 --2- 172.21.15.88:0/2207880856 >> v2:172.21.15.52:3300/0 conn(0x7f87d40a5de0 0x7f87d40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:15.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d259c700 1 --2- 172.21.15.88:0/2207880856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d40a18a0 0x7f87d40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:15.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 -- 172.21.15.88:0/2207880856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d40a18a0 msgr2=0x7f87d40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:15.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2207880856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d40a18a0 0x7f87d40a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:15.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 -- 172.21.15.88:0/2207880856 >> v2:172.21.15.52:3300/0 conn(0x7f87d40a5de0 msgr2=0x7f87d40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:15.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2207880856 >> v2:172.21.15.52:3300/0 conn(0x7f87d40a5de0 0x7f87d40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:15.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 -- 172.21.15.88:0/2207880856 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d40a3d50 con 0x7f87d412e3a0 2020-02-11T16:09:15.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2207880856 >> v2:172.21.15.88:3300/0 conn(0x7f87d412e3a0 0x7f87d412e830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f87d405bbc0 tx=0x7f87cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2207880856 >> v2:172.21.15.88:3300/0 conn(0x7f87d412e3a0 0x7f87d412e830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f87d405bbc0 tx=0x7f87cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2207880856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412e830 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87cc008c60).ready entity=mon.1 client_cookie=3d753f74435db784 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:15.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2207880856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412e830 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2207880856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412e830 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d1d9b700 1 -- 172.21.15.88:0/2207880856 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87cc00a350 con 0x7f87d412e3a0 2020-02-11T16:09:15.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2207880856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412e830 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d1d9b700 1 -- 172.21.15.88:0/2207880856 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc00a4b0 con 0x7f87d412e3a0 2020-02-11T16:09:15.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d1d9b700 1 -- 172.21.15.88:0/2207880856 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87cc00a890 con 0x7f87d412e3a0 2020-02-11T16:09:15.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d8e10700 1 -- 172.21.15.88:0/2207880856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 msgr2=0x7f87d412e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:15.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.677+0000 7f87d8e10700 1 --2- 172.21.15.88:0/2207880856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412e830 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87cc008c60).stop 2020-02-11T16:09:15.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.678+0000 7f87d8e10700 1 -- 172.21.15.88:0/2207880856 shutdown_connections 2020-02-11T16:09:15.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.678+0000 7f87d8e10700 1 --2- 172.21.15.88:0/2207880856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412e830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:15.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.678+0000 7f87d8e10700 1 --2- 172.21.15.88:0/2207880856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d40a18a0 0x7f87d40a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:15.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.678+0000 7f87d8e10700 1 --2- 172.21.15.88:0/2207880856 >> v2:172.21.15.52:3300/0 conn(0x7f87d40a5de0 0x7f87d40a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:15.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.678+0000 7f87d8e10700 1 -- 172.21.15.88:0/2207880856 >> 172.21.15.88:0/2207880856 conn(0x7f87d409d110 msgr2=0x7f87d409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:15.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.678+0000 7f87d8e10700 1 -- 172.21.15.88:0/2207880856 shutdown_connections 2020-02-11T16:09:15.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.678+0000 7f87d8e10700 1 -- 172.21.15.88:0/2207880856 wait complete. 2020-02-11T16:09:15.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d8e10700 1 Processor -- start 2020-02-11T16:09:15.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d8e10700 1 -- start start 2020-02-11T16:09:15.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d8e10700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87d40a18a0 0x7f87d4141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:15.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d8e10700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87d412e3a0 0x7f87d412a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:15.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d8e10700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d4135600 con 0x7f87d40a5de0 2020-02-11T16:09:15.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d8e10700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d4140b10 con 0x7f87d40a18a0 2020-02-11T16:09:15.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d8e10700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d4140db0 con 0x7f87d412e3a0 2020-02-11T16:09:15.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d2d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87d412e3a0 0x7f87d412a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:15.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d2d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87d412e3a0 0x7f87d412a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53682/0 (socket says 172.21.15.88:53682) 2020-02-11T16:09:15.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d2d9d700 1 -- 172.21.15.88:0/2693947845 learned_addr learned my addr 172.21.15.88:0/2693947845 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:15.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87cbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f87d40a5de0 0x7f87d412f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41304/0 (socket says 172.21.15.88:41304) 2020-02-11T16:09:15.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.679+0000 7f87d259c700 1 --2- 172.21.15.88:0/2693947845 >> v2:172.21.15.52:3300/0 conn(0x7f87d40a18a0 0x7f87d4141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:15.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 -- 172.21.15.88:0/2693947845 >> v2:172.21.15.52:3300/0 conn(0x7f87d40a18a0 msgr2=0x7f87d4141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:15.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> v2:172.21.15.52:3300/0 conn(0x7f87d40a18a0 0x7f87d4141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:15.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 -- 172.21.15.88:0/2693947845 >> v1:172.21.15.88:6789/0 conn(0x7f87d40a5de0 legacy=0x7f87d412f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:15.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 -- 172.21.15.88:0/2693947845 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4130000 con 0x7f87d412e3a0 2020-02-11T16:09:15.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87cb7fe700 1 -- 172.21.15.88:0/2693947845 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798386703 0 0) 0x7f87d4135600 con 0x7f87d40a5de0 2020-02-11T16:09:15.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> v2:172.21.15.88:3300/0 conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> v2:172.21.15.88:3300/0 conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:15.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87cb7fe700 1 -- 172.21.15.88:0/2693947845 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87cc005c30 con 0x7f87d412e3a0 2020-02-11T16:09:15.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87cb7fe700 1 -- 172.21.15.88:0/2693947845 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc005d90 con 0x7f87d412e3a0 2020-02-11T16:09:15.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d8e10700 1 -- 172.21.15.88:0/2693947845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d41416b0 con 0x7f87d412e3a0 2020-02-11T16:09:15.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87cb7fe700 1 -- 172.21.15.88:0/2693947845 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87cc007340 con 0x7f87d412e3a0 2020-02-11T16:09:15.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d8e10700 1 -- 172.21.15.88:0/2693947845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d41311d0 con 0x7f87d412e3a0 2020-02-11T16:09:15.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.680+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.681+0000 7f87cb7fe700 1 -- 172.21.15.88:0/2693947845 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f87cc0075b0 con 0x7f87d412e3a0 2020-02-11T16:09:15.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.681+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.681+0000 7f87cb7fe700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87ac039bd0 0x7f87ac03c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:15.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.681+0000 7f87cb7fe700 1 -- 172.21.15.88:0/2693947845 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f87cc04c780 con 0x7f87d412e3a0 2020-02-11T16:09:15.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.681+0000 7f87d8e10700 1 -- 172.21.15.88:0/2693947845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d4131480 con 0x7f87d412e3a0 2020-02-11T16:09:15.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.681+0000 7f87d259c700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87ac039bd0 0x7f87ac03c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.681+0000 7f87d259c700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87ac039bd0 0x7f87ac03c090 crc :-1 s=READY pgs=171 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.685+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.685+0000 7f87cb7fe700 1 -- 172.21.15.88:0/2693947845 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f87cc031e60 con 0x7f87d412e3a0 2020-02-11T16:09:15.788 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:15.785+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff980121b70 con 0x7ff9800a14c0 2020-02-11T16:09:15.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.870+0000 7f87d8e10700 1 -- 172.21.15.88:0/2693947845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f87d4130190 con 0x7f87d412e3a0 2020-02-11T16:09:15.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.871+0000 7f87d2d9d700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:15.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.871+0000 7f87cb7fe700 1 -- 172.21.15.88:0/2693947845 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f87cc034930 con 0x7f87d412e3a0 2020-02-11T16:09:15.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 -- 172.21.15.88:0/2693947845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87ac039bd0 msgr2=0x7f87ac03c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:15.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87ac039bd0 0x7f87ac03c090 crc :-1 s=READY pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:15.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 -- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 msgr2=0x7f87d412a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:15.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412a440 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f87d405bbc0 tx=0x7f87d40a1c80).stop 2020-02-11T16:09:15.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 -- 172.21.15.88:0/2693947845 shutdown_connections 2020-02-11T16:09:15.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d412e3a0 0x7f87d412a440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:15.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 --2- 172.21.15.88:0/2693947845 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87ac039bd0 0x7f87ac03c090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:15.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 --2- 172.21.15.88:0/2693947845 >> v2:172.21.15.52:3300/0 conn(0x7f87d40a18a0 0x7f87d4141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:15.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 -- 172.21.15.88:0/2693947845 >> 172.21.15.88:0/2693947845 conn(0x7f87d409d110 msgr2=0x7f87d40a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:15.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 -- 172.21.15.88:0/2693947845 shutdown_connections 2020-02-11T16:09:15.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:15.872+0000 7f87d8e10700 1 -- 172.21.15.88:0/2693947845 wait complete. 2020-02-11T16:09:15.892 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":42,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:15.892 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":42,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:16.640 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.637+0000 7ff97f59e700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:16.640 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.637+0000 7ff977fff700 1 -- 172.21.15.88:0/627100554 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v29) v1 ==== 167+0+0 (secure 0 0 0) 0x7ff978032250 con 0x7ff9800a14c0 2020-02-11T16:09:16.642 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff964039c90 msgr2=0x7ff96403c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:16.642 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff964039c90 0x7ff96403c150 crc :-1 s=READY pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:16.642 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 msgr2=0x7ff98007e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:16.642 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7ff980123640 tx=0x7ff978010dd0).stop 2020-02-11T16:09:16.642 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 shutdown_connections 2020-02-11T16:09:16.643 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9800a14c0 0x7ff98007e5b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:16.643 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 --2- 172.21.15.88:0/627100554 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff964039c90 0x7ff96403c150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:16.643 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 --2- 172.21.15.88:0/627100554 >> v2:172.21.15.52:3300/0 conn(0x7ff98005ac40 0x7ff980121580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:16.643 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 >> 172.21.15.88:0/627100554 conn(0x7ff98005c170 msgr2=0x7ff9800a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:16.643 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 shutdown_connections 2020-02-11T16:09:16.643 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:16.639+0000 7ff984d78700 1 -- 172.21.15.88:0/627100554 wait complete. 2020-02-11T16:09:16.644 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:09:16.651 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/foo 2020-02-11T16:09:16.660 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 'We want ENOENT, not ESTALE, here.' 2020-02-11T16:09:16.661 INFO:tasks.workunit.client.0.smithi088.stderr:++ seq 1 100 2020-02-11T16:09:16.661 INFO:tasks.workunit.client.0.smithi088.stdout:We want ENOENT, not ESTALE, here. 2020-02-11T16:09:16.661 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.662 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/1 2020-02-11T16:09:16.662 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.664 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/1': No such file or directory 2020-02-11T16:09:16.664 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.664 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/2 2020-02-11T16:09:16.665 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.667 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/2': No such file or directory 2020-02-11T16:09:16.667 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.667 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/3 2020-02-11T16:09:16.667 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.670 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/3': No such file or directory 2020-02-11T16:09:16.670 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.670 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/4 2020-02-11T16:09:16.670 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.672 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/4': No such file or directory 2020-02-11T16:09:16.673 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.673 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/5 2020-02-11T16:09:16.673 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.675 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/5': No such file or directory 2020-02-11T16:09:16.675 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.676 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/6 2020-02-11T16:09:16.676 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.678 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/6': No such file or directory 2020-02-11T16:09:16.678 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.678 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/7 2020-02-11T16:09:16.678 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.680 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/7': No such file or directory 2020-02-11T16:09:16.680 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.681 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/8 2020-02-11T16:09:16.681 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.683 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/8': No such file or directory 2020-02-11T16:09:16.683 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.683 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/9 2020-02-11T16:09:16.683 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.685 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/9': No such file or directory 2020-02-11T16:09:16.686 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.686 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/10 2020-02-11T16:09:16.686 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.688 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/10': No such file or directory 2020-02-11T16:09:16.688 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.688 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/11 2020-02-11T16:09:16.689 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.691 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/11': No such file or directory 2020-02-11T16:09:16.691 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.691 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/12 2020-02-11T16:09:16.691 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.695 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/12': No such file or directory 2020-02-11T16:09:16.695 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.695 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/13 2020-02-11T16:09:16.695 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.698 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/13': No such file or directory 2020-02-11T16:09:16.698 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.698 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/14 2020-02-11T16:09:16.699 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.700 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/14': No such file or directory 2020-02-11T16:09:16.701 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.701 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/15 2020-02-11T16:09:16.701 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.703 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/15': No such file or directory 2020-02-11T16:09:16.703 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.703 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/16 2020-02-11T16:09:16.703 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.705 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/16': No such file or directory 2020-02-11T16:09:16.706 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.706 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/17 2020-02-11T16:09:16.706 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.708 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/17': No such file or directory 2020-02-11T16:09:16.708 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.708 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/18 2020-02-11T16:09:16.708 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.710 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/18': No such file or directory 2020-02-11T16:09:16.710 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.711 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/19 2020-02-11T16:09:16.711 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.713 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/19': No such file or directory 2020-02-11T16:09:16.713 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.713 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/20 2020-02-11T16:09:16.713 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.715 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/20': No such file or directory 2020-02-11T16:09:16.715 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.716 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/21 2020-02-11T16:09:16.716 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.718 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/21': No such file or directory 2020-02-11T16:09:16.718 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.718 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/22 2020-02-11T16:09:16.718 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.720 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/22': No such file or directory 2020-02-11T16:09:16.720 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.720 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/23 2020-02-11T16:09:16.721 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.723 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/23': No such file or directory 2020-02-11T16:09:16.723 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.723 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/24 2020-02-11T16:09:16.723 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.725 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/24': No such file or directory 2020-02-11T16:09:16.725 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.726 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/25 2020-02-11T16:09:16.726 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.728 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/25': No such file or directory 2020-02-11T16:09:16.728 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.728 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/26 2020-02-11T16:09:16.728 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.730 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/26': No such file or directory 2020-02-11T16:09:16.730 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.730 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/27 2020-02-11T16:09:16.731 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.732 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/27': No such file or directory 2020-02-11T16:09:16.733 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.733 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/28 2020-02-11T16:09:16.733 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.735 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/28': No such file or directory 2020-02-11T16:09:16.735 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.735 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/29 2020-02-11T16:09:16.736 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.737 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/29': No such file or directory 2020-02-11T16:09:16.738 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.738 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/30 2020-02-11T16:09:16.738 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.740 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/30': No such file or directory 2020-02-11T16:09:16.740 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.740 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/31 2020-02-11T16:09:16.740 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.742 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/31': No such file or directory 2020-02-11T16:09:16.743 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.743 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/32 2020-02-11T16:09:16.743 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.745 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/32': No such file or directory 2020-02-11T16:09:16.745 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.745 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/33 2020-02-11T16:09:16.745 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.747 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/33': No such file or directory 2020-02-11T16:09:16.748 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.748 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/34 2020-02-11T16:09:16.748 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.750 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/34': No such file or directory 2020-02-11T16:09:16.750 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.750 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/35 2020-02-11T16:09:16.750 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.752 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/35': No such file or directory 2020-02-11T16:09:16.752 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.753 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/36 2020-02-11T16:09:16.753 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.755 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/36': No such file or directory 2020-02-11T16:09:16.755 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.755 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/37 2020-02-11T16:09:16.755 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.757 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/37': No such file or directory 2020-02-11T16:09:16.758 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.758 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/38 2020-02-11T16:09:16.758 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.760 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/38': No such file or directory 2020-02-11T16:09:16.760 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.760 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/39 2020-02-11T16:09:16.760 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.762 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/39': No such file or directory 2020-02-11T16:09:16.762 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.763 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/40 2020-02-11T16:09:16.763 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.765 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/40': No such file or directory 2020-02-11T16:09:16.765 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.765 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/41 2020-02-11T16:09:16.765 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.767 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/41': No such file or directory 2020-02-11T16:09:16.767 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.767 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/42 2020-02-11T16:09:16.768 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.770 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/42': No such file or directory 2020-02-11T16:09:16.770 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.770 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/43 2020-02-11T16:09:16.770 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.772 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/43': No such file or directory 2020-02-11T16:09:16.773 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.773 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/44 2020-02-11T16:09:16.773 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.775 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/44': No such file or directory 2020-02-11T16:09:16.775 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.775 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/45 2020-02-11T16:09:16.775 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.777 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/45': No such file or directory 2020-02-11T16:09:16.778 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.778 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/46 2020-02-11T16:09:16.778 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.780 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/46': No such file or directory 2020-02-11T16:09:16.780 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.780 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/47 2020-02-11T16:09:16.781 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.782 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/47': No such file or directory 2020-02-11T16:09:16.783 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.783 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/48 2020-02-11T16:09:16.783 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.785 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/48': No such file or directory 2020-02-11T16:09:16.785 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.785 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/49 2020-02-11T16:09:16.785 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.787 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/49': No such file or directory 2020-02-11T16:09:16.788 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.788 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/50 2020-02-11T16:09:16.788 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.790 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/50': No such file or directory 2020-02-11T16:09:16.790 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.790 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/51 2020-02-11T16:09:16.791 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.793 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/51': No such file or directory 2020-02-11T16:09:16.793 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.793 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/52 2020-02-11T16:09:16.793 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.795 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/52': No such file or directory 2020-02-11T16:09:16.795 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.796 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/53 2020-02-11T16:09:16.796 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.798 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/53': No such file or directory 2020-02-11T16:09:16.798 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.798 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/54 2020-02-11T16:09:16.798 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.800 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/54': No such file or directory 2020-02-11T16:09:16.800 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.800 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/55 2020-02-11T16:09:16.801 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.802 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/55': No such file or directory 2020-02-11T16:09:16.803 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.803 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/56 2020-02-11T16:09:16.803 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.805 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/56': No such file or directory 2020-02-11T16:09:16.805 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.805 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/57 2020-02-11T16:09:16.805 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.807 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/57': No such file or directory 2020-02-11T16:09:16.808 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.808 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/58 2020-02-11T16:09:16.808 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.810 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/58': No such file or directory 2020-02-11T16:09:16.810 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.810 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/59 2020-02-11T16:09:16.810 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.812 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/59': No such file or directory 2020-02-11T16:09:16.812 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.813 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/60 2020-02-11T16:09:16.813 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.815 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/60': No such file or directory 2020-02-11T16:09:16.815 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.815 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/61 2020-02-11T16:09:16.815 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.817 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/61': No such file or directory 2020-02-11T16:09:16.817 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.818 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/62 2020-02-11T16:09:16.818 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.820 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/62': No such file or directory 2020-02-11T16:09:16.820 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.820 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/63 2020-02-11T16:09:16.820 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.823 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/63': No such file or directory 2020-02-11T16:09:16.823 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.823 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/64 2020-02-11T16:09:16.823 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.826 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/64': No such file or directory 2020-02-11T16:09:16.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/65 2020-02-11T16:09:16.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.829 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/65': No such file or directory 2020-02-11T16:09:16.829 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.829 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/66 2020-02-11T16:09:16.829 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.832 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/66': No such file or directory 2020-02-11T16:09:16.832 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.832 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/67 2020-02-11T16:09:16.832 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.835 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/67': No such file or directory 2020-02-11T16:09:16.835 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.835 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/68 2020-02-11T16:09:16.835 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.838 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/68': No such file or directory 2020-02-11T16:09:16.838 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.838 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/69 2020-02-11T16:09:16.838 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.841 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/69': No such file or directory 2020-02-11T16:09:16.841 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.841 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/70 2020-02-11T16:09:16.841 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.844 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/70': No such file or directory 2020-02-11T16:09:16.844 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.844 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/71 2020-02-11T16:09:16.844 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.847 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/71': No such file or directory 2020-02-11T16:09:16.847 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.847 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/72 2020-02-11T16:09:16.847 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.850 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/72': No such file or directory 2020-02-11T16:09:16.850 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.850 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/73 2020-02-11T16:09:16.850 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.857 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/73': No such file or directory 2020-02-11T16:09:16.857 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.857 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/74 2020-02-11T16:09:16.858 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.859 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/74': No such file or directory 2020-02-11T16:09:16.859 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/75': No such file or directory 2020-02-11T16:09:16.859 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.859 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/75 2020-02-11T16:09:16.859 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.859 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.860 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/76 2020-02-11T16:09:16.860 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.862 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/76': No such file or directory 2020-02-11T16:09:16.862 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.862 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/77 2020-02-11T16:09:16.862 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.865 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/77': No such file or directory 2020-02-11T16:09:16.865 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.865 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/78 2020-02-11T16:09:16.865 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.868 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/78': No such file or directory 2020-02-11T16:09:16.868 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.868 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/79 2020-02-11T16:09:16.868 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.871 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/79': No such file or directory 2020-02-11T16:09:16.871 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.871 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/80 2020-02-11T16:09:16.871 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.874 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/80': No such file or directory 2020-02-11T16:09:16.874 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.875 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/81 2020-02-11T16:09:16.875 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.877 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/81': No such file or directory 2020-02-11T16:09:16.878 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.878 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/82 2020-02-11T16:09:16.878 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.880 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/82': No such file or directory 2020-02-11T16:09:16.881 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.881 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/83 2020-02-11T16:09:16.881 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.883 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/83': No such file or directory 2020-02-11T16:09:16.883 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.884 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/84 2020-02-11T16:09:16.884 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.886 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/84': No such file or directory 2020-02-11T16:09:16.886 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.887 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/85 2020-02-11T16:09:16.887 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.889 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/85': No such file or directory 2020-02-11T16:09:16.889 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.889 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/86 2020-02-11T16:09:16.890 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.892 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/86': No such file or directory 2020-02-11T16:09:16.893 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.893 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/87 2020-02-11T16:09:16.893 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.895 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/87': No such file or directory 2020-02-11T16:09:16.895 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.896 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/88 2020-02-11T16:09:16.896 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.898 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/88': No such file or directory 2020-02-11T16:09:16.898 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.899 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/89 2020-02-11T16:09:16.899 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.901 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/89': No such file or directory 2020-02-11T16:09:16.901 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.901 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/90 2020-02-11T16:09:16.902 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.904 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/90': No such file or directory 2020-02-11T16:09:16.904 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.905 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/91 2020-02-11T16:09:16.905 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.907 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/91': No such file or directory 2020-02-11T16:09:16.907 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.907 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/92 2020-02-11T16:09:16.908 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.910 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/92': No such file or directory 2020-02-11T16:09:16.911 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.911 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/93 2020-02-11T16:09:16.911 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.913 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/93': No such file or directory 2020-02-11T16:09:16.913 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.913 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/94 2020-02-11T16:09:16.914 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.916 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/94': No such file or directory 2020-02-11T16:09:16.916 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.916 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/95 2020-02-11T16:09:16.916 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.919 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/95': No such file or directory 2020-02-11T16:09:16.919 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.919 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/96 2020-02-11T16:09:16.920 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.922 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/96': No such file or directory 2020-02-11T16:09:16.922 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.922 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/97 2020-02-11T16:09:16.923 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.925 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/97': No such file or directory 2020-02-11T16:09:16.925 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.925 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/98 2020-02-11T16:09:16.926 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.928 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/98': No such file or directory 2020-02-11T16:09:16.928 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.928 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/99 2020-02-11T16:09:16.928 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.931 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/99': No such file or directory 2020-02-11T16:09:16.931 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 100` 2020-02-11T16:09:16.931 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/foo/100 2020-02-11T16:09:16.931 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'No such file' 2020-02-11T16:09:16.934 INFO:tasks.workunit.client.0.smithi088.stdout:stat: cannot stat '.snap/foo/100': No such file or directory 2020-02-11T16:09:16.934 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/foo 2020-02-11T16:09:16.942 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:09:16.942 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:09:16.942 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:09:16.942 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:09:16.978 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2020-02-11T16:09:16.978 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2020-02-11T16:09:17.038 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:09:17.039 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:09:17.134 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.119+0000 7ff1d1418700 1 Processor -- start 2020-02-11T16:09:17.134 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.119+0000 7ff1d1418700 1 -- start start 2020-02-11T16:09:17.134 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.119+0000 7ff1d1418700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:17.134 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.119+0000 7ff1d1418700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1cc09d250 0x7ff1cc09d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.119+0000 7ff1d1418700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff1cc024760 0x7ff1cc024b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.119+0000 7ff1d1418700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc0a5dc0 con 0x7ff1cc09d250 2020-02-11T16:09:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d1418700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc09ed50 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d1418700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc067310 con 0x7ff1cc024760 2020-02-11T16:09:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53686/0 (socket says 172.21.15.88:53686) 2020-02-11T16:09:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 -- 172.21.15.88:0/383525654 learned_addr learned my addr 172.21.15.88:0/383525654 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1cbfff700 1 --2- 172.21.15.88:0/383525654 >> v2:172.21.15.52:3300/0 conn(0x7ff1cc09d250 0x7ff1cc09d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:17.137 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d267a700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff1cc024760 0x7ff1cc024b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:17.144 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d267a700 1 -- 172.21.15.88:0/383525654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff1cc024760 msgr2=0x7ff1cc024b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:09:17.144 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d267a700 1 -- 172.21.15.88:0/383525654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff1cc024760 msgr2=0x7ff1cc024b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:09:17.144 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d267a700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff1cc024760 0x7ff1cc024b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 -- 172.21.15.88:0/383525654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff1cc024760 msgr2=0x7ff1cc024b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d267a700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff1cc024760 0x7ff1cc024b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff1cc024760 0x7ff1cc024b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 -- 172.21.15.88:0/383525654 >> v2:172.21.15.52:3300/0 conn(0x7ff1cc09d250 msgr2=0x7ff1cc09d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:17.146 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 --2- 172.21.15.88:0/383525654 >> v2:172.21.15.52:3300/0 conn(0x7ff1cc09d250 0x7ff1cc09d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:17.146 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 -- 172.21.15.88:0/383525654 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0a6bc0 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.146 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 --2- 172.21.15.88:0/383525654 >> v2:172.21.15.88:3300/0 conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff1c0002f30 tx=0x7ff1c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.146 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 --2- 172.21.15.88:0/383525654 >> v2:172.21.15.88:3300/0 conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff1c0002f30 tx=0x7ff1c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.147 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7ff1c0002f30 tx=0x7ff1c0007a40).ready entity=mon.1 client_cookie=24c01d03ee621827 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:17.147 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7ff1c0002f30 tx=0x7ff1c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.147 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1cb7fe700 1 -- 172.21.15.88:0/383525654 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c000f620 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.147 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7ff1c0002f30 tx=0x7ff1c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.147 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d0c17700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7ff1c0002f30 tx=0x7ff1c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.148 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1cb7fe700 1 -- 172.21.15.88:0/383525654 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000f780 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.148 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1cb7fe700 1 -- 172.21.15.88:0/383525654 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c0011970 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.148 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d1418700 1 -- 172.21.15.88:0/383525654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 msgr2=0x7ff1cc09e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:17.148 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.120+0000 7ff1d1418700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7ff1c0002f30 tx=0x7ff1c0007a40).stop 2020-02-11T16:09:17.149 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.121+0000 7ff1d1418700 1 -- 172.21.15.88:0/383525654 shutdown_connections 2020-02-11T16:09:17.149 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.121+0000 7ff1d1418700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff1cc024760 0x7ff1cc024b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:17.149 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.121+0000 7ff1d1418700 1 --2- 172.21.15.88:0/383525654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc09e8f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:17.149 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.121+0000 7ff1d1418700 1 --2- 172.21.15.88:0/383525654 >> v2:172.21.15.52:3300/0 conn(0x7ff1cc09d250 0x7ff1cc09d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:17.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.121+0000 7ff1d1418700 1 -- 172.21.15.88:0/383525654 >> 172.21.15.88:0/383525654 conn(0x7ff1cc05b610 msgr2=0x7ff1cc05ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:17.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.121+0000 7ff1d1418700 1 -- 172.21.15.88:0/383525654 shutdown_connections 2020-02-11T16:09:17.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.121+0000 7ff1d1418700 1 -- 172.21.15.88:0/383525654 wait complete. 2020-02-11T16:09:17.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.122+0000 7ff1d1418700 1 Processor -- start 2020-02-11T16:09:17.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.122+0000 7ff1d1418700 1 -- start start 2020-02-11T16:09:17.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d1418700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1cc09d250 0x7ff1cc120a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:17.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d1418700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:17.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d1418700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0a3d10 con 0x7ff1cc024760 2020-02-11T16:09:17.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d1418700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc121350 con 0x7ff1cc09d250 2020-02-11T16:09:17.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d1418700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc07f4c0 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:17.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53696/0 (socket says 172.21.15.88:53696) 2020-02-11T16:09:17.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 -- 172.21.15.88:0/3875515670 learned_addr learned my addr 172.21.15.88:0/3875515670 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1cbfff700 1 --2- 172.21.15.88:0/3875515670 >> v2:172.21.15.52:3300/0 conn(0x7ff1cc09d250 0x7ff1cc120a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 -- 172.21.15.88:0/3875515670 >> v2:172.21.15.52:3300/0 conn(0x7ff1cc09d250 msgr2=0x7ff1cc120a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> v2:172.21.15.52:3300/0 conn(0x7ff1cc09d250 0x7ff1cc120a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 -- 172.21.15.88:0/3875515670 >> v1:172.21.15.88:6789/0 conn(0x7ff1cc024760 legacy=0x7ff1cc0a26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1c97fa700 1 -- 172.21.15.88:0/3875515670 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583237430 0 0) 0x7ff1cc0a3d10 con 0x7ff1cc024760 2020-02-11T16:09:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 -- 172.21.15.88:0/3875515670 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0a4f10 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> v2:172.21.15.88:3300/0 conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> v2:172.21.15.88:3300/0 conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1c97fa700 1 -- 172.21.15.88:0/3875515670 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c4005e30 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1c97fa700 1 -- 172.21.15.88:0/3875515670 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c4007540 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc127530 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1c97fa700 1 -- 172.21.15.88:0/3875515670 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c40078a0 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.123+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0a4ac0 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.124+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.124+0000 7ff1c97fa700 1 -- 172.21.15.88:0/3875515670 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff1c4010180 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.124+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.124+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc0a5500 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.124+0000 7ff1c97fa700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff1ac039b80 0x7ff1ac03c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.124+0000 7ff1c97fa700 1 -- 172.21.15.88:0/3875515670 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff1c4049920 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.125+0000 7ff1d0c17700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff1ac039b80 0x7ff1ac03c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.125+0000 7ff1d0c17700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff1ac039b80 0x7ff1ac03c040 crc :-1 s=READY pgs=172 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.128+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.128+0000 7ff1c97fa700 1 -- 172.21.15.88:0/3875515670 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff1c402f040 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.311 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.308+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff1cc0a5340 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.648 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.646+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:17.648 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.646+0000 7ff1c97fa700 1 -- 172.21.15.88:0/3875515670 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v30) v1 ==== 167+0+0 (secure 0 0 0) 0x7ff1cc0a5340 con 0x7ff1cc0a73e0 2020-02-11T16:09:17.786 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:17.783+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff1cc0a5340 con 0x7ff1cc0a73e0 2020-02-11T16:09:18.652 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.649+0000 7ff1d267a700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:18.652 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.649+0000 7ff1c97fa700 1 -- 172.21.15.88:0/3875515670 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v31) v1 ==== 167+0+0 (secure 0 0 0) 0x7ff1cc0a5340 con 0x7ff1cc0a73e0 2020-02-11T16:09:18.654 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff1ac039b80 msgr2=0x7ff1ac03c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:18.654 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff1ac039b80 0x7ff1ac03c040 crc :-1 s=READY pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:18.654 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 msgr2=0x7ff1cc120ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:18.655 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7ff1c40032b0 tx=0x7ff1c4010f40).stop 2020-02-11T16:09:18.655 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 shutdown_connections 2020-02-11T16:09:18.655 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1cc0a73e0 0x7ff1cc120ef0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:18.655 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 --2- 172.21.15.88:0/3875515670 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff1ac039b80 0x7ff1ac03c040 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:18.655 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 --2- 172.21.15.88:0/3875515670 >> v2:172.21.15.52:3300/0 conn(0x7ff1cc09d250 0x7ff1cc120a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:18.655 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 >> 172.21.15.88:0/3875515670 conn(0x7ff1cc05b610 msgr2=0x7ff1cc069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:18.655 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 shutdown_connections 2020-02-11T16:09:18.656 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:09:18.651+0000 7ff1d1418700 1 -- 172.21.15.88:0/3875515670 wait complete. 2020-02-11T16:09:18.656 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:09:18.665 INFO:tasks.workunit.client.0.smithi088.stderr:+ git clone git://git.ceph.com/ceph.git 2020-02-11T16:09:18.669 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into 'ceph'... 2020-02-11T16:09:18.893 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:09:19.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.997+0000 7fcca20df700 1 Processor -- start 2020-02-11T16:09:19.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.998+0000 7fcca20df700 1 -- start start 2020-02-11T16:09:19.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.998+0000 7fcca20df700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a1680 0x7fcc9c0a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.998+0000 7fcca20df700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.998+0000 7fcca20df700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9c0a37d0 con 0x7fcc9c140000 2020-02-11T16:09:19.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.998+0000 7fcca20df700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c0a3630 con 0x7fcc9c0a31d0 2020-02-11T16:09:19.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.998+0000 7fcca20df700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0a2940 con 0x7fcc9c0a1680 2020-02-11T16:09:19.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca10dd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a1680 0x7fcc9c0a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:39688/0 (socket says 172.21.15.88:39688) 2020-02-11T16:09:19.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca10dd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a1680 0x7fcc9c0a2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:48026/0 (socket says 172.21.15.88:48026) 2020-02-11T16:09:19.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 -- 172.21.15.88:0/3523580168 learned_addr learned my addr 172.21.15.88:0/3523580168 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:19.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca10dd700 1 -- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a1680 msgr2=0x7fcc9c0a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:09:19.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca10dd700 1 -- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a1680 msgr2=0x7fcc9c0a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:09:19.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca10dd700 1 --2- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a1680 0x7fcc9c0a2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:19.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca10dd700 1 --2- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a1680 0x7fcc9c0a2d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:19.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 -- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a1680 msgr2=0x7fcc9c0a2d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:19.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 --2- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a1680 0x7fcc9c0a2d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:19.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 -- 172.21.15.88:0/3523580168 >> v1:172.21.15.52:6789/0 conn(0x7fcc9c140000 legacy=0x7fcc9c05a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 -- 172.21.15.88:0/3523580168 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c09a100 con 0x7fcc9c0a31d0 2020-02-11T16:09:19.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 --2- 172.21.15.88:0/3523580168 >> v2:172.21.15.52:3300/0 conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcc98002f30 tx=0x7fcc980088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 --2- 172.21.15.88:0/3523580168 >> v2:172.21.15.52:3300/0 conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcc98002f30 tx=0x7fcc980088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 --2- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fcc98002f30 tx=0x7fcc980088e0).ready entity=mon.0 client_cookie=13a79f2d74e8a177 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 --2- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fcc98002f30 tx=0x7fcc980088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcc87fff700 1 -- 172.21.15.88:0/3523580168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc98011760 con 0x7fcc9c0a31d0 2020-02-11T16:09:19.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 --2- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fcc98002f30 tx=0x7fcc980088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca08dc700 1 --2- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fcc98002f30 tx=0x7fcc980088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcc87fff700 1 -- 172.21.15.88:0/3523580168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc980118c0 con 0x7fcc9c0a31d0 2020-02-11T16:09:19.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcc87fff700 1 -- 172.21.15.88:0/3523580168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc98011ca0 con 0x7fcc9c0a31d0 2020-02-11T16:09:19.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca20df700 1 -- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc9c0a31d0 msgr2=0x7fcc9c13fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:18.999+0000 7fcca20df700 1 --2- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fcc98002f30 tx=0x7fcc980088e0).stop 2020-02-11T16:09:19.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.000+0000 7fcca20df700 1 -- 172.21.15.88:0/3523580168 shutdown_connections 2020-02-11T16:09:19.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.000+0000 7fcca20df700 1 --2- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a1680 0x7fcc9c0a2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:19.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.000+0000 7fcca20df700 1 --2- 172.21.15.88:0/3523580168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc9c0a31d0 0x7fcc9c13fba0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.000+0000 7fcca20df700 1 -- 172.21.15.88:0/3523580168 >> 172.21.15.88:0/3523580168 conn(0x7fcc9c0a9f90 msgr2=0x7fcc9c0aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:19.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.000+0000 7fcca20df700 1 -- 172.21.15.88:0/3523580168 shutdown_connections 2020-02-11T16:09:19.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.000+0000 7fcca20df700 1 -- 172.21.15.88:0/3523580168 wait complete. 2020-02-11T16:09:19.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.001+0000 7fcca20df700 1 Processor -- start 2020-02-11T16:09:19.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.001+0000 7fcca20df700 1 -- start start 2020-02-11T16:09:19.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.001+0000 7fcca20df700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc9c0a1680 0x7fcc9c13cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.001+0000 7fcca20df700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a31d0 0x7fcc9c14c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.001+0000 7fcca20df700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9c13cfd0 con 0x7fcc9c140000 2020-02-11T16:09:19.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.001+0000 7fcca20df700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c0a5e40 con 0x7fcc9c0a1680 2020-02-11T16:09:19.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.001+0000 7fcca20df700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c13d210 con 0x7fcc9c0a31d0 2020-02-11T16:09:19.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc9c0a1680 0x7fcc9c13cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc9c0a1680 0x7fcc9c13cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53708/0 (socket says 172.21.15.88:53708) 2020-02-11T16:09:19.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 -- 172.21.15.88:0/1787634222 learned_addr learned my addr 172.21.15.88:0/1787634222 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:19.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca08dc700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a31d0 0x7fcc9c14c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca08dc700 1 -- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a31d0 msgr2=0x7fcc9c14c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:09:19.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca08dc700 1 -- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a31d0 msgr2=0x7fcc9c14c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:09:19.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca08dc700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a31d0 0x7fcc9c14c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:19.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca08dc700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a31d0 0x7fcc9c14c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:19.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 -- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a31d0 msgr2=0x7fcc9c14c460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:19.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a31d0 0x7fcc9c14c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 -- 172.21.15.88:0/1787634222 >> v1:172.21.15.52:6789/0 conn(0x7fcc9c140000 legacy=0x7fcc9c14d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 -- 172.21.15.88:0/1787634222 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c14bfc0 con 0x7fcc9c0a1680 2020-02-11T16:09:19.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> v2:172.21.15.88:3300/0 conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> v2:172.21.15.88:3300/0 conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcc8effd700 1 -- 172.21.15.88:0/1787634222 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc94005a40 con 0x7fcc9c0a1680 2020-02-11T16:09:19.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcc8effd700 1 -- 172.21.15.88:0/1787634222 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc94005ba0 con 0x7fcc9c0a1680 2020-02-11T16:09:19.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca20df700 1 -- 172.21.15.88:0/1787634222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9c14dc20 con 0x7fcc9c0a1680 2020-02-11T16:09:19.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcc8effd700 1 -- 172.21.15.88:0/1787634222 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc9400a1b0 con 0x7fcc9c0a1680 2020-02-11T16:09:19.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.002+0000 7fcca20df700 1 -- 172.21.15.88:0/1787634222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9c14ce10 con 0x7fcc9c0a1680 2020-02-11T16:09:19.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.003+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.003+0000 7fcc8effd700 1 -- 172.21.15.88:0/1787634222 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fcc94007180 con 0x7fcc9c0a1680 2020-02-11T16:09:19.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.003+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.003+0000 7fcc8effd700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc78039c20 0x7fcc7803c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.003+0000 7fcc8effd700 1 -- 172.21.15.88:0/1787634222 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fcc94049d10 con 0x7fcc9c0a1680 2020-02-11T16:09:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.003+0000 7fcca20df700 1 -- 172.21.15.88:0/1787634222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9c14c150 con 0x7fcc9c0a1680 2020-02-11T16:09:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.003+0000 7fcca08dc700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc78039c20 0x7fcc7803c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.003+0000 7fcca08dc700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc78039c20 0x7fcc7803c0e0 crc :-1 s=READY pgs=173 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.007+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.007+0000 7fcc8effd700 1 -- 172.21.15.88:0/1787634222 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fcc9402f330 con 0x7fcc9c0a1680 2020-02-11T16:09:19.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.189+0000 7fcca20df700 1 -- 172.21.15.88:0/1787634222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcc9c0565b0 con 0x7fcc9c0a1680 2020-02-11T16:09:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.190+0000 7fcca10dd700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.190+0000 7fcc8effd700 1 -- 172.21.15.88:0/1787634222 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7fcc94031e40 con 0x7fcc9c0a1680 2020-02-11T16:09:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 -- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc78039c20 msgr2=0x7fcc7803c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc78039c20 0x7fcc7803c0e0 crc :-1 s=READY pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 -- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 msgr2=0x7fcc9c13cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 0x7fcc9c13cb70 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fcc940032b0 tx=0x7fcc9c0684d0).stop 2020-02-11T16:09:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 -- 172.21.15.88:0/1787634222 shutdown_connections 2020-02-11T16:09:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc78039c20 0x7fcc7803c0e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc9c0a1680 0x7fcc9c13cb70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 --2- 172.21.15.88:0/1787634222 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc9c0a31d0 0x7fcc9c14c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 -- 172.21.15.88:0/1787634222 >> 172.21.15.88:0/1787634222 conn(0x7fcc9c0a9f90 msgr2=0x7fcc9c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:19.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 -- 172.21.15.88:0/1787634222 shutdown_connections 2020-02-11T16:09:19.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.191+0000 7fcca20df700 1 -- 172.21.15.88:0/1787634222 wait complete. 2020-02-11T16:09:19.199 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:19.204 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":44,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:19.204 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:09:19.204 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:09:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.308+0000 7fb25f4cb700 1 Processor -- start 2020-02-11T16:09:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.308+0000 7fb25f4cb700 1 -- start start 2020-02-11T16:09:19.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25f4cb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 0x7fb2580a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25f4cb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2580a4350 con 0x7fb2580a2fa0 2020-02-11T16:09:19.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25f4cb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2580a3a40 con 0x7fb258131280 2020-02-11T16:09:19.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25f4cb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2580a1e60 con 0x7fb2580a5b20 2020-02-11T16:09:19.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25da68700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb258131280 0x7fb258131710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41346/0 (socket says 172.21.15.88:41346) 2020-02-11T16:09:19.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25da68700 1 -- 172.21.15.88:0/3804912077 learned_addr learned my addr 172.21.15.88:0/3804912077 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:19.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 0x7fb2580a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25ca66700 1 -- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 msgr2=0x7fb2580a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:09:19.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222468442 0 0) 0x7fb2580a3a40 con 0x7fb258131280 2020-02-11T16:09:19.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25ca66700 1 -- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 msgr2=0x7fb2580a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:09:19.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 0x7fb2580a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:19.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb240003230 con 0x7fb258131280 2020-02-11T16:09:19.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 0x7fb2580a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:19.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792632709 0 0) 0x7fb2580a4350 con 0x7fb2580a2fa0 2020-02-11T16:09:19.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2580a3a40 con 0x7fb2580a2fa0 2020-02-11T16:09:19.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2480027961 0 0) 0x7fb240003230 con 0x7fb258131280 2020-02-11T16:09:19.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 msgr2=0x7fb2580a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:19.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 0x7fb2580a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:19.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 >> v1:172.21.15.52:6789/0 conn(0x7fb2580a2fa0 legacy=0x7fb2580a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580a3ce0 con 0x7fb258131280 2020-02-11T16:09:19.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fb250001a50 con 0x7fb258131280 2020-02-11T16:09:19.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 >> v1:172.21.15.88:6789/0 conn(0x7fb258131280 legacy=0x7fb258131710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 0x7fb2400038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb240003d40 0x7fb2400044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb240004930 0x7fb240004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2580a1e60 con 0x7fb240003d40 2020-02-11T16:09:19.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240005210 con 0x7fb240004930 2020-02-11T16:09:19.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.309+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24000b720 con 0x7fb2580a5b20 2020-02-11T16:09:19.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb240004930 0x7fb240004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb240003d40 0x7fb2400044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25d267700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 0x7fb2400038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 -- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 msgr2=0x7fb2400038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:19.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2580a5b20 0x7fb2400038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:19.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 -- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb240003d40 msgr2=0x7fb2400044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:19.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb240003d40 0x7fb2400044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:19.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 -- 172.21.15.88:0/3804912077 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb240003230 con 0x7fb240004930 2020-02-11T16:09:19.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb240004930 0x7fb240004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb250001820 tx=0x7fb258067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb240004930 0x7fb240004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb250001820 tx=0x7fb258067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb240004930 0x7fb240004db0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fb250001820 tx=0x7fb258067410).ready entity=mon.1 client_cookie=b6f4a2ce12094267 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb240004930 0x7fb240004db0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fb250001820 tx=0x7fb258067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb250005d40 con 0x7fb240004930 2020-02-11T16:09:19.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb240004930 0x7fb240004db0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fb250001820 tx=0x7fb258067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb240004930 0x7fb240004db0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fb250001820 tx=0x7fb258067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb250014070 con 0x7fb240004930 2020-02-11T16:09:19.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb247fff700 1 -- 172.21.15.88:0/3804912077 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb250005ea0 con 0x7fb240004930 2020-02-11T16:09:19.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3804912077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb240004930 msgr2=0x7fb240004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25f4cb700 1 --2- 172.21.15.88:0/3804912077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb240004930 0x7fb240004db0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fb250001820 tx=0x7fb258067410).stop 2020-02-11T16:09:19.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25da68700 1 -- 172.21.15.88:0/3804912077 reap_dead start 2020-02-11T16:09:19.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3804912077 shutdown_connections 2020-02-11T16:09:19.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.310+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3804912077 >> 172.21.15.88:0/3804912077 conn(0x7fb25809d110 msgr2=0x7fb25809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:19.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.311+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3804912077 shutdown_connections 2020-02-11T16:09:19.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.311+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3804912077 wait complete. 2020-02-11T16:09:19.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.311+0000 7fb25f4cb700 1 Processor -- start 2020-02-11T16:09:19.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.311+0000 7fb25f4cb700 1 -- start start 2020-02-11T16:09:19.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25f4cb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb258135ac0 0x7fb258066f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25f4cb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb258130980 0x7fb258134930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25f4cb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb258135f60 con 0x7fb2580a0a50 2020-02-11T16:09:19.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25f4cb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb258130de0 con 0x7fb258135ac0 2020-02-11T16:09:19.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25f4cb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb258136230 con 0x7fb258130980 2020-02-11T16:09:19.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25d267700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb2580a0a50 0x7fb258130270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41354/0 (socket says 172.21.15.88:41354) 2020-02-11T16:09:19.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25d267700 1 -- 172.21.15.88:0/3813228575 learned_addr learned my addr 172.21.15.88:0/3813228575 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:19.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25da68700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb258130980 0x7fb258134930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3813228575 >> v2:172.21.15.52:3300/0 conn(0x7fb258135ac0 0x7fb258066f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25da68700 1 -- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb258130980 msgr2=0x7fb258134930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:09:19.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25da68700 1 -- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb258130980 msgr2=0x7fb258134930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:09:19.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25da68700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb258130980 0x7fb258134930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:19.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25da68700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb258130980 0x7fb258134930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:19.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226708123 0 0) 0x7fb258135f60 con 0x7fb2580a0a50 2020-02-11T16:09:19.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb238002fe0 con 0x7fb2580a0a50 2020-02-11T16:09:19.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25ca66700 1 -- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb258130980 msgr2=0x7fb258134930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:19.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb258130980 0x7fb258134930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25ca66700 1 -- 172.21.15.88:0/3813228575 >> v1:172.21.15.88:6789/0 conn(0x7fb2580a0a50 legacy=0x7fb258130270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25ca66700 1 -- 172.21.15.88:0/3813228575 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2581364d0 con 0x7fb258135ac0 2020-02-11T16:09:19.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.312+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3813228575 >> v2:172.21.15.52:3300/0 conn(0x7fb258135ac0 0x7fb258066f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb254002f30 tx=0x7fb254010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3813228575 >> v2:172.21.15.52:3300/0 conn(0x7fb258135ac0 0x7fb258066f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb254002f30 tx=0x7fb254010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb258135ac0 0x7fb258066f80 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fb254002f30 tx=0x7fb254010ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb258135ac0 0x7fb258066f80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fb254002f30 tx=0x7fb254010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb254005e90 con 0x7fb258135ac0 2020-02-11T16:09:19.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb258135ac0 0x7fb258066f80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fb254002f30 tx=0x7fb254010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb254007160 con 0x7fb258135ac0 2020-02-11T16:09:19.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb258135ac0 0x7fb258066f80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fb254002f30 tx=0x7fb254010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3813228575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2580a4780 con 0x7fb258135ac0 2020-02-11T16:09:19.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb254007540 con 0x7fb258135ac0 2020-02-11T16:09:19.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3813228575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb258134d90 con 0x7fb258135ac0 2020-02-11T16:09:19.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.313+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb258135ac0 0x7fb258066f80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fb254002f30 tx=0x7fb254010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb254009460 con 0x7fb258135ac0 2020-02-11T16:09:19.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25ca66700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb258135ac0 0x7fb258066f80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fb254002f30 tx=0x7fb254010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25f4cb700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 0x7fb2580a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3813228575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25805e2f0 con 0x7fb25809ff00 2020-02-11T16:09:19.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 0x7fb2580a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb2467fc700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb238039f10 0x7fb23803c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fb254049bb0 con 0x7fb258135ac0 2020-02-11T16:09:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25d267700 1 -- 172.21.15.88:0/3813228575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb258066ce0 con 0x7fb25809ff00 2020-02-11T16:09:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25da68700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb238039f10 0x7fb23803c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 0x7fb2580a7ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 0x7fb2580a7ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 0x7fb2580a7ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 0x7fb2580a7ef0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb248001e90 con 0x7fb25809ff00 2020-02-11T16:09:19.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25da68700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb238039f10 0x7fb23803c3d0 crc :-1 s=READY pgs=174 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 0x7fb2580a7ef0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fb24800c930 con 0x7fb25809ff00 2020-02-11T16:09:19.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 msgr2=0x7fb2580a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb2467fc700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 0x7fb2580a7ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).stop 2020-02-11T16:09:19.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 msgr2=0x7fb2580a7ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:19.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.314+0000 7fb2467fc700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25809ff00 0x7fb2580a7ef0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).stop 2020-02-11T16:09:19.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.322+0000 7fb25f4cb700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 0x7fb2580a8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.322+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3813228575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581360f0 con 0x7fb2580a8350 2020-02-11T16:09:19.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.322+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 0x7fb2580a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25d267700 1 -- 172.21.15.88:0/3813228575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb2580565b0 con 0x7fb2580a8350 2020-02-11T16:09:19.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 0x7fb2580a8760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 0x7fb2580a8760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 0x7fb2580a8760 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 0x7fb2580a8760 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb24800b800 con 0x7fb2580a8350 2020-02-11T16:09:19.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25d267700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 0x7fb2580a8760 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7fb248012810 con 0x7fb2580a8350 2020-02-11T16:09:19.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 msgr2=0x7fb2580a8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb2467fc700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 0x7fb2580a8760 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).stop 2020-02-11T16:09:19.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb2467fc700 1 -- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 msgr2=0x7fb2580a8760 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:19.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb2467fc700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2580a8350 0x7fb2580a8760 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0x7fb248001910 tx=0x7fb248010d70).stop 2020-02-11T16:09:19.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb238039f10 msgr2=0x7fb23803c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25f4cb700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb238039f10 0x7fb23803c3d0 crc :-1 s=READY pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb258135ac0 msgr2=0x7fb258066f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25f4cb700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb258135ac0 0x7fb258066f80 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fb254002f30 tx=0x7fb254010ae0).stop 2020-02-11T16:09:19.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.323+0000 7fb25da68700 1 -- 172.21.15.88:0/3813228575 reap_dead start 2020-02-11T16:09:19.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.324+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3813228575 shutdown_connections 2020-02-11T16:09:19.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.324+0000 7fb25f4cb700 1 --2- 172.21.15.88:0/3813228575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb258135ac0 0x7fb258066f80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.324+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3813228575 >> 172.21.15.88:0/3813228575 conn(0x7fb25809d110 msgr2=0x7fb2581316d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:19.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.324+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3813228575 shutdown_connections 2020-02-11T16:09:19.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.324+0000 7fb25f4cb700 1 -- 172.21.15.88:0/3813228575 wait complete. 2020-02-11T16:09:19.347 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:09:19.347 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:19.348 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:19.348 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:09:19.348 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 44, 2020-02-11T16:09:19.348 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:09:19.348 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:09:19.348 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:09:19.348 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:09:19.349 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.349 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:09:19.349 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:19.349 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:09:19.349 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:09:19.349 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:19.349 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:19.350 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:19.350 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:19.350 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:19.350 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:19.350 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.350 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:09:19.350 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:09:19.351 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:19.351 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:19.351 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:19.351 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:19.351 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:19.351 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:19.351 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.352 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:09:19.352 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:09:19.352 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:09:19.352 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:09:19.352 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:09:19.352 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:09:19.352 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:19.353 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:19.353 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:09:19.353 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:09:19.353 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:19.353 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:09:19.353 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:19.353 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:19.354 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:19.354 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:19.354 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:19.354 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:19.354 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.354 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:09:19.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.355 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:09:19.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.355 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:19.355 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:19.355 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:19.355 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:19.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.356 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:19.356 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:09:19.356 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.356 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:19.356 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:09:19.357 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.357 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.357 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.357 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:09:19.357 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:09:19.357 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:19.358 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:19.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.358 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:19.358 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:19.358 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:19.358 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:19.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.359 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:19.359 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:09:19.359 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.359 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:19.360 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:09:19.360 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.360 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.360 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.360 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:09:19.360 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:09:19.360 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:19.361 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:19.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.361 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:09:19.361 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:09:19.362 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:19.362 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:19.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.362 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:19.362 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:09:19.362 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.363 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:19.363 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:09:19.363 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.363 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.363 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.364 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:09:19.364 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:09:19.364 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:19.364 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:19.364 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.364 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.364 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:09:19.365 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:09:19.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.365 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:19.365 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:19.365 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:19.365 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.365 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.366 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:09:19.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.366 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:19.366 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:19.366 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:19.366 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.366 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.367 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:09:19.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.367 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:19.367 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:19.367 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:09:19.367 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.367 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.367 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:09:19.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.368 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:19.368 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:19.368 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:09:19.368 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.368 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.368 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:09:19.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.369 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:19.369 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:19.369 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:09:19.369 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.369 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.369 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.370 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:09:19.371 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:09:19.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.475+0000 7f2633357700 1 Processor -- start 2020-02-11T16:09:19.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.475+0000 7f2633357700 1 -- start start 2020-02-11T16:09:19.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.475+0000 7f2633357700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f262c0a6260 0x7f262c135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.475+0000 7f2633357700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c0a31b0 con 0x7f262c0a5de0 2020-02-11T16:09:19.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.475+0000 7f2633357700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c0a3570 con 0x7f262c0a18a0 2020-02-11T16:09:19.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.475+0000 7f2633357700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c0a3810 con 0x7f262c0a6260 2020-02-11T16:09:19.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26310f3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f262c0a18a0 0x7f262c0a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41366/0 (socket says 172.21.15.88:41366) 2020-02-11T16:09:19.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26310f3700 1 -- 172.21.15.88:0/3098740566 learned_addr learned my addr 172.21.15.88:0/3098740566 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:19.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26318f4700 1 --2- 172.21.15.88:0/3098740566 >> v2:172.21.15.52:3300/0 conn(0x7f262c0a6260 0x7f262c135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f261ffff700 1 -- 172.21.15.88:0/3098740566 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834430567 0 0) 0x7f262c0a3570 con 0x7f262c0a18a0 2020-02-11T16:09:19.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f261ffff700 1 -- 172.21.15.88:0/3098740566 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2614003230 con 0x7f262c0a18a0 2020-02-11T16:09:19.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26318f4700 1 -- 172.21.15.88:0/3098740566 >> v1:172.21.15.88:6789/0 conn(0x7f262c0a18a0 legacy=0x7f262c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26318f4700 1 -- 172.21.15.88:0/3098740566 >> v1:172.21.15.52:6789/0 conn(0x7f262c0a5de0 legacy=0x7f262c134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26318f4700 1 -- 172.21.15.88:0/3098740566 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0a3ab0 con 0x7f262c0a6260 2020-02-11T16:09:19.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26318f4700 1 --2- 172.21.15.88:0/3098740566 >> v2:172.21.15.52:3300/0 conn(0x7f262c0a6260 0x7f262c135160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26240032b0 tx=0x7f2624008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26318f4700 1 --2- 172.21.15.88:0/3098740566 >> v2:172.21.15.52:3300/0 conn(0x7f262c0a6260 0x7f262c135160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26240032b0 tx=0x7f2624008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26318f4700 1 --2- 172.21.15.88:0/3098740566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c0a6260 0x7f262c135160 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f26240032b0 tx=0x7f2624008c60).ready entity=mon.0 client_cookie=c2f1f8492c02788e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26318f4700 1 --2- 172.21.15.88:0/3098740566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c0a6260 0x7f262c135160 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f26240032b0 tx=0x7f2624008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f261ffff700 1 -- 172.21.15.88:0/3098740566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2624011e60 con 0x7f262c0a6260 2020-02-11T16:09:19.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26318f4700 1 --2- 172.21.15.88:0/3098740566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c0a6260 0x7f262c135160 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f26240032b0 tx=0x7f2624008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f26318f4700 1 --2- 172.21.15.88:0/3098740566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c0a6260 0x7f262c135160 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f26240032b0 tx=0x7f2624008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f261ffff700 1 -- 172.21.15.88:0/3098740566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262400a160 con 0x7f262c0a6260 2020-02-11T16:09:19.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f261ffff700 1 -- 172.21.15.88:0/3098740566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262400a4c0 con 0x7f262c0a6260 2020-02-11T16:09:19.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f2633357700 1 -- 172.21.15.88:0/3098740566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c0a6260 msgr2=0x7f262c135160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.476+0000 7f2633357700 1 --2- 172.21.15.88:0/3098740566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c0a6260 0x7f262c135160 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f26240032b0 tx=0x7f2624008c60).stop 2020-02-11T16:09:19.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.477+0000 7f2633357700 1 -- 172.21.15.88:0/3098740566 shutdown_connections 2020-02-11T16:09:19.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.477+0000 7f2633357700 1 --2- 172.21.15.88:0/3098740566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c0a6260 0x7f262c135160 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.477+0000 7f2633357700 1 -- 172.21.15.88:0/3098740566 >> 172.21.15.88:0/3098740566 conn(0x7f262c09d110 msgr2=0x7f262c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:19.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.477+0000 7f2633357700 1 -- 172.21.15.88:0/3098740566 shutdown_connections 2020-02-11T16:09:19.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.477+0000 7f2633357700 1 -- 172.21.15.88:0/3098740566 wait complete. 2020-02-11T16:09:19.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.478+0000 7f2633357700 1 Processor -- start 2020-02-11T16:09:19.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.478+0000 7f2633357700 1 -- start start 2020-02-11T16:09:19.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.478+0000 7f2633357700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 0x7f262c150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.478+0000 7f2633357700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c135bc0 con 0x7f262c0a18a0 2020-02-11T16:09:19.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.478+0000 7f2633357700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c066eb0 con 0x7f262c0a5de0 2020-02-11T16:09:19.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.478+0000 7f2633357700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c133250 con 0x7f262c0a6260 2020-02-11T16:09:19.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.478+0000 7f26308f2700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f262c0a5de0 0x7f262c147950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41374/0 (socket says 172.21.15.88:41374) 2020-02-11T16:09:19.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.478+0000 7f26308f2700 1 -- 172.21.15.88:0/1249063001 learned_addr learned my addr 172.21.15.88:0/1249063001 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:19.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.478+0000 7f26318f4700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 0x7f262c150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.478+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451439676 0 0) 0x7f262c066eb0 con 0x7f262c0a5de0 2020-02-11T16:09:19.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f260c002fe0 con 0x7f262c0a5de0 2020-02-11T16:09:19.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26318f4700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 msgr2=0x7f262c150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:09:19.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26318f4700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 msgr2=0x7f262c150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:09:19.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26318f4700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 0x7f262c150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:19.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26318f4700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 0x7f262c150860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:19.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283180160 0 0) 0x7f262c135bc0 con 0x7f262c0a18a0 2020-02-11T16:09:19.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f262c066eb0 con 0x7f262c0a18a0 2020-02-11T16:09:19.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3126907010 0 0) 0x7f260c002fe0 con 0x7f262c0a5de0 2020-02-11T16:09:19.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f262c135bc0 con 0x7f262c0a5de0 2020-02-11T16:09:19.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f26280019c0 con 0x7f262c0a5de0 2020-02-11T16:09:19.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 msgr2=0x7f262c150860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:19.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 0x7f262c150860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 >> v1:172.21.15.88:6789/0 conn(0x7f262c0a5de0 legacy=0x7f262c147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 >> v1:172.21.15.52:6789/0 conn(0x7f262c0a18a0 legacy=0x7f262c131690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c003800 0x7f260c003c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 0x7f260c0040e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c004540 con 0x7f260c003800 2020-02-11T16:09:19.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0046b0 con 0x7f260c004b20 2020-02-11T16:09:19.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c00b750 con 0x7f262c0a6260 2020-02-11T16:09:19.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c003800 0x7f260c003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26318f4700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 0x7f260c0040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26318f4700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 msgr2=0x7f260c0040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:09:19.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26318f4700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 msgr2=0x7f260c0040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:09:19.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26318f4700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 0x7f260c0040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:19.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26318f4700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 0x7f260c0040e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:19.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 msgr2=0x7f260c0040e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:19.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f262c0a6260 0x7f260c0040e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c003800 msgr2=0x7f260c003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c003800 0x7f260c003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 -- 172.21.15.88:0/1249063001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c133440 con 0x7f260c004b20 2020-02-11T16:09:19.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f2633357700 1 -- 172.21.15.88:0/1249063001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c139080 con 0x7f260c004b20 2020-02-11T16:09:19.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f262c05a110 tx=0x7f2620010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f262c05a110 tx=0x7f2620010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f262c05a110 tx=0x7f2620010a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f262c05a110 tx=0x7f2620010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262000c650 con 0x7f260c004b20 2020-02-11T16:09:19.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f262c05a110 tx=0x7f2620010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f262c05a110 tx=0x7f2620010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000c7f0 con 0x7f260c004b20 2020-02-11T16:09:19.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.479+0000 7f2633357700 1 -- 172.21.15.88:0/1249063001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c133c90 con 0x7f260c004b20 2020-02-11T16:09:19.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.480+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262000cc10 con 0x7f260c004b20 2020-02-11T16:09:19.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.480+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f262c05a110 tx=0x7f2620010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.480+0000 7f2633357700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 0x7f262c137de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.480+0000 7f2633357700 1 -- 172.21.15.88:0/1249063001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c05e2f0 con 0x7f262c148060 2020-02-11T16:09:19.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.480+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f262000cd70 con 0x7f260c004b20 2020-02-11T16:09:19.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.480+0000 7f26310f3700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f262c05a110 tx=0x7f2620010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 0x7f262c137de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f261e7fc700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f260c042180 0x7f260c044640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f2620049510 con 0x7f260c004b20 2020-02-11T16:09:19.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f26318f4700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f260c042180 0x7f260c044640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f26308f2700 1 -- 172.21.15.88:0/1249063001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f262c134050 con 0x7f262c148060 2020-02-11T16:09:19.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 0x7f262c137de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 0x7f262c137de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 0x7f262c137de0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f26318f4700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f260c042180 0x7f260c044640 crc :-1 s=READY pgs=175 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 0x7f262c137de0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262800b430 con 0x7f262c148060 2020-02-11T16:09:19.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 0x7f262c137de0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f2628008bc0 con 0x7f262c148060 2020-02-11T16:09:19.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 msgr2=0x7f262c137de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f261e7fc700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 0x7f262c137de0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).stop 2020-02-11T16:09:19.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 msgr2=0x7f262c137de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:19.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f26318f4700 1 -- 172.21.15.88:0/1249063001 reap_dead start 2020-02-11T16:09:19.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.481+0000 7f261e7fc700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c148060 0x7f262c137de0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.489+0000 7f2633357700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 0x7f262c147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.489+0000 7f2633357700 1 -- 172.21.15.88:0/1249063001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c133e20 con 0x7f262c131120 2020-02-11T16:09:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.490+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 0x7f262c147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.490+0000 7f26308f2700 1 -- 172.21.15.88:0/1249063001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f262c0565b0 con 0x7f262c131120 2020-02-11T16:09:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.490+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 0x7f262c147950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.490+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 0x7f262c147950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.490+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 0x7f262c147950 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.490+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 0x7f262c147950 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.490+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262800ad20 con 0x7f262c131120 2020-02-11T16:09:19.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f26308f2700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 0x7f262c147950 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4191 (secure 0 0 0) 0x7f262800ae80 con 0x7f262c131120 2020-02-11T16:09:19.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 msgr2=0x7f262c147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f261e7fc700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 0x7f262c147950 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f2628001160 tx=0x7f26280116c0).stop 2020-02-11T16:09:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f261e7fc700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 msgr2=0x7f262c147950 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f261e7fc700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 0x7f262c147950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f260c042180 msgr2=0x7f260c044640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f260c042180 0x7f260c044640 crc :-1 s=READY pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 -- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 msgr2=0x7f260c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f262c05a110 tx=0x7f2620010a70).stop 2020-02-11T16:09:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 -- 172.21.15.88:0/1249063001 shutdown_connections 2020-02-11T16:09:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f260c042180 0x7f260c044640 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f260c004b20 0x7f260c004f00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 --2- 172.21.15.88:0/1249063001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262c131120 0x7f262c147950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 -- 172.21.15.88:0/1249063001 >> 172.21.15.88:0/1249063001 conn(0x7f262c09d110 msgr2=0x7f262c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 -- 172.21.15.88:0/1249063001 shutdown_connections 2020-02-11T16:09:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.491+0000 7f2633357700 1 -- 172.21.15.88:0/1249063001 wait complete. 2020-02-11T16:09:19.511 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:09:19.511 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:19.511 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:19.511 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:09:19.511 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 44, 2020-02-11T16:09:19.511 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:09:19.511 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:09:19.512 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:09:19.512 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:09:19.512 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.512 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:09:19.512 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:19.512 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:09:19.512 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:09:19.513 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:19.513 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:19.513 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:19.513 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:19.513 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:19.514 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:19.514 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.514 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:09:19.514 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:09:19.514 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:19.515 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:19.515 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:19.515 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:19.515 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:19.515 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:19.516 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.516 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:09:19.516 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:09:19.516 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:09:19.516 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:09:19.517 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:09:19.517 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:09:19.517 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:19.517 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:19.517 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:09:19.517 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:09:19.518 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:19.518 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:09:19.518 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:19.518 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:19.518 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:19.518 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:19.518 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:19.519 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:19.519 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.519 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:09:19.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.519 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:09:19.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.519 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:19.520 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:19.520 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:19.520 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:19.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.520 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:19.520 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:09:19.520 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.521 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:19.521 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:09:19.521 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.521 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.521 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.522 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:09:19.522 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:09:19.522 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:19.522 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:19.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.522 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:19.523 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:19.523 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:19.523 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:19.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.523 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:19.523 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:09:19.524 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.524 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:19.524 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:09:19.524 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.524 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.525 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.525 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:09:19.525 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:09:19.525 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:19.525 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:19.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.526 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:09:19.526 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:09:19.526 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:19.526 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:19.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:19.527 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:09:19.527 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:19.527 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:09:19.528 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:19.528 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.528 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.528 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:09:19.528 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:09:19.528 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:19.529 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:19.529 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.529 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:19.529 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:09:19.529 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:09:19.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.529 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:19.530 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:19.530 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:19.530 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.530 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.530 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:09:19.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.530 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:19.531 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:19.531 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:19.531 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.531 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.531 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:09:19.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.531 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:19.532 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:19.532 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:09:19.532 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.532 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:19.532 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:09:19.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:19.533 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:19.534 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:19.534 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:09:19.534 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.534 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:19.534 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:19.535 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:09:19.535 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:09:19.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.642+0000 7fab4a3c2700 1 Processor -- start 2020-02-11T16:09:19.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.642+0000 7fab4a3c2700 1 -- start start 2020-02-11T16:09:19.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab4a3c2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 0x7fab44141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab4a3c2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab440a4af0 con 0x7fab440a8690 2020-02-11T16:09:19.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab4a3c2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab440a4d90 con 0x7fab440a3a90 2020-02-11T16:09:19.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab4a3c2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab441302a0 con 0x7fab44136750 2020-02-11T16:09:19.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab43fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fab440a3a90 0x7fab440a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41390/0 (socket says 172.21.15.88:41390) 2020-02-11T16:09:19.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab43fff700 1 -- 172.21.15.88:0/599482389 learned_addr learned my addr 172.21.15.88:0/599482389 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:19.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab4895f700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 0x7fab44141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704030053 0 0) 0x7fab440a4d90 con 0x7fab440a3a90 2020-02-11T16:09:19.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab30003230 con 0x7fab440a3a90 2020-02-11T16:09:19.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab4895f700 1 -- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 msgr2=0x7fab44141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:09:19.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab4895f700 1 -- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 msgr2=0x7fab44141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:09:19.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab4895f700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 0x7fab44141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:19.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab4895f700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 0x7fab44141380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 331041774 0 0) 0x7fab30003230 con 0x7fab440a3a90 2020-02-11T16:09:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 msgr2=0x7fab44141380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab42ffd700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 0x7fab44141380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 >> v1:172.21.15.52:6789/0 conn(0x7fab440a8690 legacy=0x7fab44136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab440a5540 con 0x7fab440a3a90 2020-02-11T16:09:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.643+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fab380016d0 con 0x7fab440a3a90 2020-02-11T16:09:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 >> v1:172.21.15.88:6789/0 conn(0x7fab440a3a90 legacy=0x7fab440a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab42ffd700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab30003750 0x7fab30003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab42ffd700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab30004050 0x7fab30004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab42ffd700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 0x7fab30004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab441302a0 con 0x7fab30003750 2020-02-11T16:09:19.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab30004f70 con 0x7fab30004050 2020-02-11T16:09:19.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab30005130 con 0x7fab44136750 2020-02-11T16:09:19.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab30004050 0x7fab30004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab43fff700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab30003750 0x7fab30003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab4895f700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 0x7fab30004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 -- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 msgr2=0x7fab30004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:19.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab44136750 0x7fab30004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:19.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 -- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab30003750 msgr2=0x7fab30003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:19.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab30003750 0x7fab30003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:19.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 -- 172.21.15.88:0/599482389 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab30003230 con 0x7fab30004050 2020-02-11T16:09:19.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab30004050 0x7fab30004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab34000fe0 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab30004050 0x7fab30004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab34000fe0 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab30004050 0x7fab30004530 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fab34000fe0 tx=0x7fab3400fe00).ready entity=mon.1 client_cookie=ed5a48794f32e539 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab30004050 0x7fab30004530 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fab34000fe0 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab30004050 0x7fab30004530 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fab34000fe0 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab34003540 con 0x7fab30004050 2020-02-11T16:09:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab437fe700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab30004050 0x7fab30004530 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fab34000fe0 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340036a0 con 0x7fab30004050 2020-02-11T16:09:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab42ffd700 1 -- 172.21.15.88:0/599482389 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab34003a40 con 0x7fab30004050 2020-02-11T16:09:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab4a3c2700 1 -- 172.21.15.88:0/599482389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab30004050 msgr2=0x7fab30004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab4a3c2700 1 --2- 172.21.15.88:0/599482389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab30004050 0x7fab30004530 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fab34000fe0 tx=0x7fab3400fe00).stop 2020-02-11T16:09:19.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.644+0000 7fab4895f700 1 -- 172.21.15.88:0/599482389 reap_dead start 2020-02-11T16:09:19.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.645+0000 7fab4a3c2700 1 -- 172.21.15.88:0/599482389 shutdown_connections 2020-02-11T16:09:19.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.645+0000 7fab4a3c2700 1 -- 172.21.15.88:0/599482389 >> 172.21.15.88:0/599482389 conn(0x7fab440ac2d0 msgr2=0x7fab440ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:19.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.645+0000 7fab4a3c2700 1 -- 172.21.15.88:0/599482389 shutdown_connections 2020-02-11T16:09:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.645+0000 7fab4a3c2700 1 -- 172.21.15.88:0/599482389 wait complete. 2020-02-11T16:09:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.646+0000 7fab4a3c2700 1 Processor -- start 2020-02-11T16:09:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.646+0000 7fab4a3c2700 1 -- start start 2020-02-11T16:09:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.646+0000 7fab4a3c2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fab44064740 0x7fab44064d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.646+0000 7fab4a3c2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440651f0 0x7fab44146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.646+0000 7fab4a3c2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab440a6c70 con 0x7fab44066ad0 2020-02-11T16:09:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.646+0000 7fab4a3c2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab44065b20 con 0x7fab44064740 2020-02-11T16:09:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.646+0000 7fab4a3c2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab44132b10 con 0x7fab440651f0 2020-02-11T16:09:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab4895f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440651f0 0x7fab44146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fab44064740 0x7fab44064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab4895f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440651f0 0x7fab44146b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:48104/0 (socket says 172.21.15.88:48104) 2020-02-11T16:09:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab4895f700 1 -- 172.21.15.88:0/1959721933 learned_addr learned my addr 172.21.15.88:0/1959721933 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab4895f700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440651f0 msgr2=0x7fab44146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:09:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab4895f700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440651f0 msgr2=0x7fab44146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:09:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab4895f700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440651f0 0x7fab44146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab4895f700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440651f0 0x7fab44146b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440651f0 msgr2=0x7fab44146b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:19.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440651f0 0x7fab44146b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:19.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 -- 172.21.15.88:0/1959721933 >> v1:172.21.15.52:6789/0 conn(0x7fab44066ad0 legacy=0x7fab44146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:19.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 -- 172.21.15.88:0/1959721933 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44066f70 con 0x7fab44064740 2020-02-11T16:09:19.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 --2- 172.21.15.88:0/1959721933 >> v2:172.21.15.52:3300/0 conn(0x7fab44064740 0x7fab44064d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab380013e0 tx=0x7fab4405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 --2- 172.21.15.88:0/1959721933 >> v2:172.21.15.52:3300/0 conn(0x7fab44064740 0x7fab44064d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab380013e0 tx=0x7fab4405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab44064740 0x7fab44064d90 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fab380013e0 tx=0x7fab4405bd40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab44064740 0x7fab44064d90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fab380013e0 tx=0x7fab4405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab38011b20 con 0x7fab44064740 2020-02-11T16:09:19.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab44064740 0x7fab44064d90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fab380013e0 tx=0x7fab4405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab43fff700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab44064740 0x7fab44064d90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fab380013e0 tx=0x7fab4405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab38011cc0 con 0x7fab44064740 2020-02-11T16:09:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab4a3c2700 1 -- 172.21.15.88:0/1959721933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab44132670 con 0x7fab44064740 2020-02-11T16:09:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab380097f0 con 0x7fab44064740 2020-02-11T16:09:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.647+0000 7fab4a3c2700 1 -- 172.21.15.88:0/1959721933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab44133270 con 0x7fab44064740 2020-02-11T16:09:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.648+0000 7fab4a3c2700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.648+0000 7fab4a3c2700 1 -- 172.21.15.88:0/1959721933 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4405e2f0 con 0x7fab440a5db0 2020-02-11T16:09:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.648+0000 7fab43fff700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab44064740 0x7fab44064d90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fab380013e0 tx=0x7fab4405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.648+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.648+0000 7fab437fe700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 msgr2=0x7fab441303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:09:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.648+0000 7fab437fe700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 msgr2=0x7fab441303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:09:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.648+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.648+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.649+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fab3800c220 con 0x7fab44064740 2020-02-11T16:09:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.649+0000 7fab43fff700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab44064740 0x7fab44064d90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fab380013e0 tx=0x7fab4405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.649+0000 7fab417fa700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fab24039cf0 0x7fab2403c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.649+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fab38049810 con 0x7fab44064740 2020-02-11T16:09:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.649+0000 7fab4895f700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fab24039cf0 0x7fab2403c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.649+0000 7fab4895f700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fab24039cf0 0x7fab2403c1b0 crc :-1 s=READY pgs=176 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:19.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.849+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:19.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.849+0000 7fab437fe700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 msgr2=0x7fab441303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:09:19.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.849+0000 7fab437fe700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 msgr2=0x7fab441303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:09:19.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.849+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:19.849+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:09:20.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:20.250+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:20.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:20.250+0000 7fab437fe700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 msgr2=0x7fab441303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:09:20.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:20.250+0000 7fab437fe700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 msgr2=0x7fab441303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:09:20.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:20.250+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:20.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:20.250+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:09:21.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:21.051+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:21.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:21.051+0000 7fab437fe700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 msgr2=0x7fab441303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:09:21.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:21.051+0000 7fab437fe700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 msgr2=0x7fab441303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:09:21.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:21.051+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:09:21.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:21.051+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:09:22.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.653+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:22.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab437fe700 1 -- 172.21.15.88:0/1959721933 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab440565b0 con 0x7fab440a5db0 2020-02-11T16:09:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab3400f890 con 0x7fab440a5db0 2020-02-11T16:09:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fab340068e0 con 0x7fab440a5db0 2020-02-11T16:09:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 msgr2=0x7fab441303e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab417fa700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).stop 2020-02-11T16:09:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 msgr2=0x7fab441303e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.654+0000 7fab417fa700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a5db0 0x7fab441303e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.663+0000 7fab4a3c2700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 0x7fab44130840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:22.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.663+0000 7fab4a3c2700 1 -- 172.21.15.88:0/1959721933 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab44067100 con 0x7fab440a6190 2020-02-11T16:09:22.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.663+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 0x7fab44130840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:22.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab437fe700 1 -- 172.21.15.88:0/1959721933 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fab4405ccb0 con 0x7fab440a6190 2020-02-11T16:09:22.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 0x7fab44130840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 0x7fab44130840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 0x7fab44130840 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:22.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 0x7fab44130840 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab34003d20 con 0x7fab440a6190 2020-02-11T16:09:22.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab437fe700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 0x7fab44130840 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3849 (secure 0 0 0) 0x7fab34011e70 con 0x7fab440a6190 2020-02-11T16:09:22.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 msgr2=0x7fab44130840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:22.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab417fa700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 0x7fab44130840 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fab440aa210 tx=0x7fab3400fe00).stop 2020-02-11T16:09:22.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab417fa700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 msgr2=0x7fab44130840 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:22.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.664+0000 7fab417fa700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab440a6190 0x7fab44130840 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:22.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4a3c2700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fab24039cf0 msgr2=0x7fab2403c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:22.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4a3c2700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fab24039cf0 0x7fab2403c1b0 crc :-1 s=READY pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:22.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4a3c2700 1 -- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab44064740 msgr2=0x7fab44064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:22.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4a3c2700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab44064740 0x7fab44064d90 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fab380013e0 tx=0x7fab4405bd40).stop 2020-02-11T16:09:22.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4895f700 1 -- 172.21.15.88:0/1959721933 reap_dead start 2020-02-11T16:09:22.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4895f700 1 -- 172.21.15.88:0/1959721933 reap_dead start 2020-02-11T16:09:22.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4a3c2700 1 -- 172.21.15.88:0/1959721933 shutdown_connections 2020-02-11T16:09:22.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4a3c2700 1 --2- 172.21.15.88:0/1959721933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab44064740 0x7fab44064d90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:22.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4a3c2700 1 -- 172.21.15.88:0/1959721933 >> 172.21.15.88:0/1959721933 conn(0x7fab440ac2d0 msgr2=0x7fab4405b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:22.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4a3c2700 1 -- 172.21.15.88:0/1959721933 shutdown_connections 2020-02-11T16:09:22.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.665+0000 7fab4a3c2700 1 -- 172.21.15.88:0/1959721933 wait complete. 2020-02-11T16:09:22.684 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:09:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:09:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:09:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:09:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 44, 2020-02-11T16:09:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:09:22.686 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:09:22.704 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:09:22.704 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:09:22.704 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:22.705 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 4, 2020-02-11T16:09:22.705 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:22.705 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:09:22.705 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:09:22.705 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:22.705 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:22.706 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:22.706 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:22.706 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:22.706 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:22.706 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:22.706 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:09:22.706 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:09:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:09:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:09:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:09:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:09:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:09:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:09:22.709 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:22.709 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:22.709 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:09:22.709 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:09:22.709 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:22.709 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:09:22.709 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:22.710 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:22.710 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:22.710 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:22.710 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:22.710 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:22.710 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:22.710 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:09:22.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.711 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:09:22.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.711 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:22.711 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:22.711 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:22.711 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:22.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.712 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:22.712 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:09:22.712 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:22.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.712 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:22.712 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:09:22.713 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:22.713 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:22.713 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:22.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.713 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:09:22.713 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:09:22.714 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:22.714 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:22.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.714 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:22.714 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:22.714 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:22.714 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:22.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.715 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:22.715 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:09:22.715 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:22.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.715 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:22.716 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:09:22.716 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:22.716 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:22.716 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:22.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.716 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:09:22.716 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:09:22.717 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:22.717 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:22.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.717 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:09:22.717 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:09:22.717 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:22.717 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:22.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.718 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:22.718 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:09:22.718 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:22.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.718 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:22.719 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:09:22.719 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:22.719 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:22.719 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:22.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.719 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:09:22.719 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:09:22.720 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:22.720 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:22.720 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:22.720 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:22.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:22.720 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:09:22.720 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:09:22.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.721 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:22.721 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:22.721 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:22.721 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:22.721 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:22.721 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:09:22.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:22.722 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:22.722 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:22.722 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:22.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:22.722 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:22.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:22.722 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:09:22.723 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:09:22.723 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:09:22.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.829+0000 7fb8b6039700 1 Processor -- start 2020-02-11T16:09:22.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.829+0000 7fb8b6039700 1 -- start start 2020-02-11T16:09:22.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.830+0000 7fb8b6039700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8b00a5de0 0x7fb8b00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:22.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.830+0000 7fb8b6039700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b00a31b0 con 0x7fb8b00a18a0 2020-02-11T16:09:22.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.830+0000 7fb8b6039700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b00a3570 con 0x7fb8b0134a50 2020-02-11T16:09:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.830+0000 7fb8b6039700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b00a3810 con 0x7fb8b00a5de0 2020-02-11T16:09:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.830+0000 7fb8affff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb8b0134a50 0x7fb8b0134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41424/0 (socket says 172.21.15.88:41424) 2020-02-11T16:09:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.830+0000 7fb8affff700 1 -- 172.21.15.88:0/1739977927 learned_addr learned my addr 172.21.15.88:0/1739977927 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.830+0000 7fb8aeffd700 1 --2- 172.21.15.88:0/1739977927 >> v2:172.21.15.52:3300/0 conn(0x7fb8b00a5de0 0x7fb8b00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.830+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050067633 0 0) 0x7fb8b00a3570 con 0x7fb8b0134a50 2020-02-11T16:09:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.830+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb89c003230 con 0x7fb8b0134a50 2020-02-11T16:09:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3090054576 0 0) 0x7fb89c003230 con 0x7fb8b0134a50 2020-02-11T16:09:22.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 >> v2:172.21.15.52:3300/0 conn(0x7fb8b00a5de0 msgr2=0x7fb8b00a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:22.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 --2- 172.21.15.88:0/1739977927 >> v2:172.21.15.52:3300/0 conn(0x7fb8b00a5de0 0x7fb8b00a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:22.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 >> v1:172.21.15.52:6789/0 conn(0x7fb8b00a18a0 legacy=0x7fb8b00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:22.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00a3ab0 con 0x7fb8b0134a50 2020-02-11T16:09:22.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fb8a8001a50 con 0x7fb8b0134a50 2020-02-11T16:09:22.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 >> v1:172.21.15.88:6789/0 conn(0x7fb8b0134a50 legacy=0x7fb8b0134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:22.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c003720 0x7fb89c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb89c0044d0 0x7fb89c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 0x7fb89c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00a3810 con 0x7fb89c003720 2020-02-11T16:09:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c0041c0 con 0x7fb89c004db0 2020-02-11T16:09:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c00bb80 con 0x7fb89c0044d0 2020-02-11T16:09:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 0x7fb89c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8af7fe700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c003720 0x7fb89c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8aeffd700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb89c0044d0 0x7fb89c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 -- 172.21.15.88:0/1739977927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb89c0044d0 msgr2=0x7fb89c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb89c0044d0 0x7fb89c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 -- 172.21.15.88:0/1739977927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c003720 msgr2=0x7fb89c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c003720 0x7fb89c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 -- 172.21.15.88:0/1739977927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c003230 con 0x7fb89c004db0 2020-02-11T16:09:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 0x7fb89c00b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 -- 172.21.15.88:0/1739977927 reap_dead start 2020-02-11T16:09:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 0x7fb89c00b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 0x7fb89c00b720 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).ready entity=mon.1 client_cookie=a6a5d69808c28811 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 0x7fb89c00b720 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a8005d40 con 0x7fb89c004db0 2020-02-11T16:09:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 0x7fb89c00b720 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8004d20 con 0x7fb89c004db0 2020-02-11T16:09:22.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8affff700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 0x7fb89c00b720 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8ae7fc700 1 -- 172.21.15.88:0/1739977927 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a8005ea0 con 0x7fb89c004db0 2020-02-11T16:09:22.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8b6039700 1 -- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 msgr2=0x7fb89c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:22.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.831+0000 7fb8b6039700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 0x7fb89c00b720 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).stop 2020-02-11T16:09:22.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.832+0000 7fb8b6039700 1 -- 172.21.15.88:0/1739977927 shutdown_connections 2020-02-11T16:09:22.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.832+0000 7fb8b6039700 1 --2- 172.21.15.88:0/1739977927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb89c004db0 0x7fb89c00b720 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:22.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.832+0000 7fb8b6039700 1 -- 172.21.15.88:0/1739977927 >> 172.21.15.88:0/1739977927 conn(0x7fb8b009d110 msgr2=0x7fb8b009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:22.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.832+0000 7fb8b6039700 1 -- 172.21.15.88:0/1739977927 shutdown_connections 2020-02-11T16:09:22.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.832+0000 7fb8b6039700 1 -- 172.21.15.88:0/1739977927 wait complete. 2020-02-11T16:09:22.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.833+0000 7fb8b6039700 1 Processor -- start 2020-02-11T16:09:22.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.833+0000 7fb8b6039700 1 -- start start 2020-02-11T16:09:22.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.833+0000 7fb8b6039700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb89c004db0 0x7fb8b012c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8b6039700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8b012d830 0x7fb8b009ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8b6039700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8b01343d0 0x7fb8b009f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8b6039700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b00a0d00 con 0x7fb89c004db0 2020-02-11T16:09:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8b6039700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b012f410 con 0x7fb8b01343d0 2020-02-11T16:09:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8b6039700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b012f6b0 con 0x7fb8b012d830 2020-02-11T16:09:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8b01343d0 0x7fb8b009f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8b01343d0 0x7fb8b009f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53810/0 (socket says 172.21.15.88:53810) 2020-02-11T16:09:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 -- 172.21.15.88:0/4291253604 learned_addr learned my addr 172.21.15.88:0/4291253604 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8af7fe700 1 --2- 172.21.15.88:0/4291253604 >> v2:172.21.15.52:3300/0 conn(0x7fb89c004db0 0x7fb8b012c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8aeffd700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8b012d830 0x7fb8b009ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 -- 172.21.15.88:0/4291253604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8b012d830 msgr2=0x7fb8b009ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8b012d830 0x7fb8b009ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 -- 172.21.15.88:0/4291253604 >> v2:172.21.15.52:3300/0 conn(0x7fb89c004db0 msgr2=0x7fb8b012c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> v2:172.21.15.52:3300/0 conn(0x7fb89c004db0 0x7fb8b012c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 -- 172.21.15.88:0/4291253604 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b012d390 con 0x7fb8b01343d0 2020-02-11T16:09:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> v2:172.21.15.88:3300/0 conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> v2:172.21.15.88:3300/0 conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8acff9700 1 -- 172.21.15.88:0/4291253604 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a800b840 con 0x7fb8b01343d0 2020-02-11T16:09:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8acff9700 1 -- 172.21.15.88:0/4291253604 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a800cb80 con 0x7fb8b01343d0 2020-02-11T16:09:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8acff9700 1 -- 172.21.15.88:0/4291253604 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a8004d20 con 0x7fb8b01343d0 2020-02-11T16:09:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8b6039700 1 -- 172.21.15.88:0/4291253604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b00a01b0 con 0x7fb8b01343d0 2020-02-11T16:09:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.834+0000 7fb8b6039700 1 -- 172.21.15.88:0/4291253604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b012ee60 con 0x7fb8b01343d0 2020-02-11T16:09:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.835+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.835+0000 7fb8acff9700 1 -- 172.21.15.88:0/4291253604 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb8a8001510 con 0x7fb8b01343d0 2020-02-11T16:09:22.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.835+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.835+0000 7fb8b6039700 1 -- 172.21.15.88:0/4291253604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b012f8b0 con 0x7fb8b01343d0 2020-02-11T16:09:22.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.835+0000 7fb8acff9700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb890039d50 0x7fb89003c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:22.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.835+0000 7fb8acff9700 1 -- 172.21.15.88:0/4291253604 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fb8a8049dd0 con 0x7fb8b01343d0 2020-02-11T16:09:22.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.835+0000 7fb8af7fe700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb890039d50 0x7fb89003c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:22.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.836+0000 7fb8af7fe700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb890039d50 0x7fb89003c210 crc :-1 s=READY pgs=177 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.839+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:22.839+0000 7fb8acff9700 1 -- 172.21.15.88:0/4291253604 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb8a804de60 con 0x7fb8b01343d0 2020-02-11T16:09:23.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.021+0000 7fb8b6039700 1 -- 172.21.15.88:0/4291253604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fb8b00565b0 con 0x7fb8b01343d0 2020-02-11T16:09:23.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.023+0000 7fb8affff700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:23.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.023+0000 7fb8acff9700 1 -- 172.21.15.88:0/4291253604 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fb8a802f4d0 con 0x7fb8b01343d0 2020-02-11T16:09:23.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.024+0000 7fb8b6039700 1 -- 172.21.15.88:0/4291253604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb890039d50 msgr2=0x7fb89003c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:23.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.024+0000 7fb8b6039700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb890039d50 0x7fb89003c210 crc :-1 s=READY pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.024+0000 7fb8b6039700 1 -- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 msgr2=0x7fb8b009f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.024+0000 7fb8b6039700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 0x7fb8b009f2e0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fb89c0054a0 tx=0x7fb8a8002040).stop 2020-02-11T16:09:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.025+0000 7fb8b6039700 1 -- 172.21.15.88:0/4291253604 shutdown_connections 2020-02-11T16:09:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.025+0000 7fb8b6039700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8b01343d0 0x7fb8b009f2e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.025+0000 7fb8b6039700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb890039d50 0x7fb89003c210 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.025+0000 7fb8b6039700 1 --2- 172.21.15.88:0/4291253604 >> v2:172.21.15.52:3300/0 conn(0x7fb89c004db0 0x7fb8b012c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.025+0000 7fb8b6039700 1 --2- 172.21.15.88:0/4291253604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8b012d830 0x7fb8b009ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:23.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.025+0000 7fb8b6039700 1 -- 172.21.15.88:0/4291253604 >> 172.21.15.88:0/4291253604 conn(0x7fb8b009d110 msgr2=0x7fb8b0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:23.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.025+0000 7fb8b6039700 1 -- 172.21.15.88:0/4291253604 shutdown_connections 2020-02-11T16:09:23.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:23.025+0000 7fb8b6039700 1 -- 172.21.15.88:0/4291253604 wait complete. 2020-02-11T16:09:23.040 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:09:33.041 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:09:33.041 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:09:33.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.156+0000 7fcf0c9f6700 1 Processor -- start 2020-02-11T16:09:33.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.156+0000 7fcf0c9f6700 1 -- start start 2020-02-11T16:09:33.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.157+0000 7fcf0c9f6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf0812ffa0 0x7fcf08141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.157+0000 7fcf0c9f6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf080a5560 con 0x7fcf080a4ec0 2020-02-11T16:09:33.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.157+0000 7fcf0c9f6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0809e060 con 0x7fcf080a7120 2020-02-11T16:09:33.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.157+0000 7fcf0c9f6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf080a5350 con 0x7fcf0812ffa0 2020-02-11T16:09:33.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.157+0000 7fcf06d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf0812ffa0 0x7fcf08141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.157+0000 7fcf0659c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcf080a7120 0x7fcf080a39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41442/0 (socket says 172.21.15.88:41442) 2020-02-11T16:09:33.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.157+0000 7fcf0659c700 1 -- 172.21.15.88:0/2145618382 learned_addr learned my addr 172.21.15.88:0/2145618382 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:33.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.157+0000 7fcf06d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf0812ffa0 0x7fcf08141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53820/0 (socket says 172.21.15.88:53820) 2020-02-11T16:09:33.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf06d9d700 1 -- 172.21.15.88:0/2145618382 >> v1:172.21.15.88:6789/0 conn(0x7fcf080a7120 legacy=0x7fcf080a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf06d9d700 1 -- 172.21.15.88:0/2145618382 >> v1:172.21.15.52:6789/0 conn(0x7fcf080a4ec0 legacy=0x7fcf0812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:33.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf05d9b700 1 -- 172.21.15.88:0/2145618382 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922531897 0 0) 0x7fcf0809e060 con 0x7fcf080a7120 2020-02-11T16:09:33.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf06d9d700 1 -- 172.21.15.88:0/2145618382 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0809e300 con 0x7fcf0812ffa0 2020-02-11T16:09:33.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf06d9d700 1 --2- 172.21.15.88:0/2145618382 >> v2:172.21.15.88:3300/0 conn(0x7fcf0812ffa0 0x7fcf08141480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcf0805ee60 tx=0x7fcf00008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf06d9d700 1 --2- 172.21.15.88:0/2145618382 >> v2:172.21.15.88:3300/0 conn(0x7fcf0812ffa0 0x7fcf08141480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcf0805ee60 tx=0x7fcf00008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf06d9d700 1 --2- 172.21.15.88:0/2145618382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf0812ffa0 0x7fcf08141480 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fcf0805ee60 tx=0x7fcf00008c60).ready entity=mon.1 client_cookie=e80b68a069da200d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf06d9d700 1 --2- 172.21.15.88:0/2145618382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf0812ffa0 0x7fcf08141480 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fcf0805ee60 tx=0x7fcf00008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf05d9b700 1 -- 172.21.15.88:0/2145618382 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0000a160 con 0x7fcf0812ffa0 2020-02-11T16:09:33.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf06d9d700 1 --2- 172.21.15.88:0/2145618382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf0812ffa0 0x7fcf08141480 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fcf0805ee60 tx=0x7fcf00008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf06d9d700 1 --2- 172.21.15.88:0/2145618382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf0812ffa0 0x7fcf08141480 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fcf0805ee60 tx=0x7fcf00008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf05d9b700 1 -- 172.21.15.88:0/2145618382 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0000a2c0 con 0x7fcf0812ffa0 2020-02-11T16:09:33.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf05d9b700 1 -- 172.21.15.88:0/2145618382 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0000a660 con 0x7fcf0812ffa0 2020-02-11T16:09:33.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/2145618382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf0812ffa0 msgr2=0x7fcf08141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf0c9f6700 1 --2- 172.21.15.88:0/2145618382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf0812ffa0 0x7fcf08141480 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fcf0805ee60 tx=0x7fcf00008c60).stop 2020-02-11T16:09:33.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/2145618382 shutdown_connections 2020-02-11T16:09:33.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf0c9f6700 1 --2- 172.21.15.88:0/2145618382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf0812ffa0 0x7fcf08141480 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/2145618382 >> 172.21.15.88:0/2145618382 conn(0x7fcf0809d110 msgr2=0x7fcf0809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/2145618382 shutdown_connections 2020-02-11T16:09:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.158+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/2145618382 wait complete. 2020-02-11T16:09:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.159+0000 7fcf0c9f6700 1 Processor -- start 2020-02-11T16:09:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.159+0000 7fcf0c9f6700 1 -- start start 2020-02-11T16:09:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fcf0c9f6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf0812ffa0 0x7fcf0805ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fcf0c9f6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf081389d0 con 0x7fcf080a7120 2020-02-11T16:09:33.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fcf0c9f6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf081364d0 con 0x7fcf080a4ec0 2020-02-11T16:09:33.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fcf0c9f6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0812cb80 con 0x7fcf0812ffa0 2020-02-11T16:09:33.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fcf0659c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcf080a4ec0 0x7fcf08139770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41448/0 (socket says 172.21.15.88:41448) 2020-02-11T16:09:33.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fcf0659c700 1 -- 172.21.15.88:0/3327437076 learned_addr learned my addr 172.21.15.88:0/3327437076 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:33.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537379312 0 0) 0x7fcf081364d0 con 0x7fcf080a4ec0 2020-02-11T16:09:33.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fcf06d9d700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf0812ffa0 0x7fcf0805ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceec002fe0 con 0x7fcf080a4ec0 2020-02-11T16:09:33.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3018325784 0 0) 0x7fceec002fe0 con 0x7fcf080a4ec0 2020-02-11T16:09:33.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcf081364d0 con 0x7fcf080a4ec0 2020-02-11T16:09:33.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556678843 0 0) 0x7fcf081389d0 con 0x7fcf080a7120 2020-02-11T16:09:33.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceec002fe0 con 0x7fcf080a7120 2020-02-11T16:09:33.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fcef8001860 con 0x7fcf080a4ec0 2020-02-11T16:09:33.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf0812ffa0 msgr2=0x7fcf0805ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf0812ffa0 0x7fcf0805ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 >> v1:172.21.15.88:6789/0 conn(0x7fcf080a4ec0 legacy=0x7fcf08139770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 >> v1:172.21.15.52:6789/0 conn(0x7fcf080a7120 legacy=0x7fcf08127610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.160+0000 7fceff7fe700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec004b60 0x7fceec004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fceff7fe700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fceff7fe700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf0812ffa0 0x7fceec0041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0812cb80 con 0x7fceec004b60 2020-02-11T16:09:33.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec004640 con 0x7fceec003920 2020-02-11T16:09:33.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec00b750 con 0x7fcf0812ffa0 2020-02-11T16:09:33.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcf0659c700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec004b60 0x7fceec004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcf06d9d700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf0812ffa0 0x7fceec0041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 -- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf0812ffa0 msgr2=0x7fceec0041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf0812ffa0 0x7fceec0041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 -- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec004b60 msgr2=0x7fceec004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec004b60 0x7fceec004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 -- 172.21.15.88:0/3327437076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08138650 con 0x7fceec003920 2020-02-11T16:09:33.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/3327437076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf08135210 con 0x7fceec003920 2020-02-11T16:09:33.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/3327437076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0805ae60 con 0x7fceec003920 2020-02-11T16:09:33.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef00069c0 con 0x7fceec003920 2020-02-11T16:09:33.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef0006b20 con 0x7fceec003920 2020-02-11T16:09:33.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.161+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef00120f0 con 0x7fceec003920 2020-02-11T16:09:33.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.162+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.162+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fcef0012250 con 0x7fceec003920 2020-02-11T16:09:33.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.162+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.162+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/3327437076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0805b110 con 0x7fceec003920 2020-02-11T16:09:33.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.162+0000 7fceff7fe700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceec041ff0 0x7fceec0444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.162+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fcef00491d0 con 0x7fceec003920 2020-02-11T16:09:33.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.163+0000 7fcf0659c700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceec041ff0 0x7fceec0444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.163+0000 7fcf0659c700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceec041ff0 0x7fceec0444b0 crc :-1 s=READY pgs=178 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.166+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.166+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fcef002e6a0 con 0x7fceec003920 2020-02-11T16:09:33.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.348+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/3327437076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcf08138b60 con 0x7fceec003920 2020-02-11T16:09:33.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.348+0000 7fcefffff700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.348+0000 7fceff7fe700 1 -- 172.21.15.88:0/3327437076 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fcef0031320 con 0x7fceec003920 2020-02-11T16:09:33.350 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:33.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.349+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceec041ff0 msgr2=0x7fceec0444b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.349+0000 7fcf0c9f6700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fceec041ff0 0x7fceec0444b0 crc :-1 s=READY pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.349+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 msgr2=0x7fceec003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.349+0000 7fcf0c9f6700 1 --2- 172.21.15.88:0/3327437076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fceec003920 0x7fceec003d80 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fcef0000fe0 tx=0x7fcef000c5c0).stop 2020-02-11T16:09:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.349+0000 7fcf06d9d700 1 -- 172.21.15.88:0/3327437076 reap_dead start 2020-02-11T16:09:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.349+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/3327437076 shutdown_connections 2020-02-11T16:09:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.349+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/3327437076 >> 172.21.15.88:0/3327437076 conn(0x7fcf0809d110 msgr2=0x7fcf0812ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.350+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/3327437076 shutdown_connections 2020-02-11T16:09:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.350+0000 7fcf0c9f6700 1 -- 172.21.15.88:0/3327437076 wait complete. 2020-02-11T16:09:33.361 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":44,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:33.361 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:09:33.362 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:09:33.362 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:09:33.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.466+0000 7f222ccb8700 1 Processor -- start 2020-02-11T16:09:33.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.466+0000 7f222ccb8700 1 -- start start 2020-02-11T16:09:33.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222ccb8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22280a18a0 0x7f22280a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222ccb8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 0x7f22280a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222ccb8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f222812e3a0 0x7f222812e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222ccb8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22280a3570 con 0x7f22280a5de0 2020-02-11T16:09:33.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222ccb8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22280a3810 con 0x7f22280a18a0 2020-02-11T16:09:33.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222ccb8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22280a3ab0 con 0x7f222812e3a0 2020-02-11T16:09:33.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22280a18a0 0x7f22280a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22280a18a0 0x7f22280a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53836/0 (socket says 172.21.15.88:53836) 2020-02-11T16:09:33.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 -- 172.21.15.88:0/3349725647 learned_addr learned my addr 172.21.15.88:0/3349725647 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:33.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f2226d9d700 1 --2- 172.21.15.88:0/3349725647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f222812e3a0 0x7f222812e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f2225d9b700 1 --2- 172.21.15.88:0/3349725647 >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 0x7f22280a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 -- 172.21.15.88:0/3349725647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f222812e3a0 msgr2=0x7f222812e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:33.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 --2- 172.21.15.88:0/3349725647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f222812e3a0 0x7f222812e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 -- 172.21.15.88:0/3349725647 >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 msgr2=0x7f22280a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:33.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 --2- 172.21.15.88:0/3349725647 >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 0x7f22280a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 -- 172.21.15.88:0/3349725647 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280a3d50 con 0x7f22280a18a0 2020-02-11T16:09:33.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f2226d9d700 1 --2- 172.21.15.88:0/3349725647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f222812e3a0 0x7f222812e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:09:33.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f2225d9b700 1 --2- 172.21.15.88:0/3349725647 >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 0x7f22280a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:09:33.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 --2- 172.21.15.88:0/3349725647 >> v2:172.21.15.88:3300/0 conn(0x7f22280a18a0 0x7f22280a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f221c002f30 tx=0x7f221c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 --2- 172.21.15.88:0/3349725647 >> v2:172.21.15.88:3300/0 conn(0x7f22280a18a0 0x7f22280a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f221c002f30 tx=0x7f221c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 --2- 172.21.15.88:0/3349725647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22280a18a0 0x7f22280a6dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f221c002f30 tx=0x7f221c007a40).ready entity=mon.1 client_cookie=4a4e0e746bf71dfe server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.467+0000 7f222659c700 1 --2- 172.21.15.88:0/3349725647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22280a18a0 0x7f22280a6dd0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f221c002f30 tx=0x7f221c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222559a700 1 -- 172.21.15.88:0/3349725647 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221c011720 con 0x7f22280a18a0 2020-02-11T16:09:33.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222659c700 1 --2- 172.21.15.88:0/3349725647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22280a18a0 0x7f22280a6dd0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f221c002f30 tx=0x7f221c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222659c700 1 --2- 172.21.15.88:0/3349725647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22280a18a0 0x7f22280a6dd0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f221c002f30 tx=0x7f221c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222559a700 1 -- 172.21.15.88:0/3349725647 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c011880 con 0x7f22280a18a0 2020-02-11T16:09:33.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222559a700 1 -- 172.21.15.88:0/3349725647 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221c011c20 con 0x7f22280a18a0 2020-02-11T16:09:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222ccb8700 1 -- 172.21.15.88:0/3349725647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22280a18a0 msgr2=0x7f22280a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222ccb8700 1 --2- 172.21.15.88:0/3349725647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22280a18a0 0x7f22280a6dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f221c002f30 tx=0x7f221c007a40).stop 2020-02-11T16:09:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222ccb8700 1 -- 172.21.15.88:0/3349725647 shutdown_connections 2020-02-11T16:09:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222ccb8700 1 --2- 172.21.15.88:0/3349725647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f222812e3a0 0x7f222812e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222ccb8700 1 --2- 172.21.15.88:0/3349725647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22280a18a0 0x7f22280a6dd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222ccb8700 1 --2- 172.21.15.88:0/3349725647 >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 0x7f22280a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222ccb8700 1 -- 172.21.15.88:0/3349725647 >> 172.21.15.88:0/3349725647 conn(0x7f222809d110 msgr2=0x7f222809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:33.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222ccb8700 1 -- 172.21.15.88:0/3349725647 shutdown_connections 2020-02-11T16:09:33.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.468+0000 7f222ccb8700 1 -- 172.21.15.88:0/3349725647 wait complete. 2020-02-11T16:09:33.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.469+0000 7f222ccb8700 1 Processor -- start 2020-02-11T16:09:33.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.469+0000 7f222ccb8700 1 -- start start 2020-02-11T16:09:33.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f222ccb8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 0x7f222809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f222ccb8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f222812e3a0 0x7f222809f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f222ccb8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2228136e00 con 0x7f22280a18a0 2020-02-11T16:09:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f222ccb8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22281370a0 con 0x7f22280a5de0 2020-02-11T16:09:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f222ccb8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222809ef00 con 0x7f222812e3a0 2020-02-11T16:09:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f222812e3a0 0x7f222809f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f222812e3a0 0x7f222809f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53844/0 (socket says 172.21.15.88:53844) 2020-02-11T16:09:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 -- 172.21.15.88:0/2551053010 learned_addr learned my addr 172.21.15.88:0/2551053010 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 0x7f222809f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 -- 172.21.15.88:0/2551053010 >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 msgr2=0x7f222809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 --2- 172.21.15.88:0/2551053010 >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 0x7f222809f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 -- 172.21.15.88:0/2551053010 >> v1:172.21.15.52:6789/0 conn(0x7f22280a18a0 legacy=0x7f2228128520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 -- 172.21.15.88:0/2551053010 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222809fd80 con 0x7f222812e3a0 2020-02-11T16:09:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> v2:172.21.15.52:3300/0 conn(0x7f22280a5de0 0x7f222809f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:09:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 --2- 172.21.15.88:0/2551053010 >> v2:172.21.15.88:3300/0 conn(0x7f222812e3a0 0x7f222809f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22200032b0 tx=0x7f2220010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 --2- 172.21.15.88:0/2551053010 >> v2:172.21.15.88:3300/0 conn(0x7f222812e3a0 0x7f222809f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22200032b0 tx=0x7f2220010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f222812e3a0 0x7f222809f920 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f22200032b0 tx=0x7f2220010dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f222812e3a0 0x7f222809f920 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f22200032b0 tx=0x7f2220010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f222812e3a0 0x7f222809f920 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f22200032b0 tx=0x7f2220010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2220007350 con 0x7f222812e3a0 2020-02-11T16:09:33.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f2226d9d700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f222812e3a0 0x7f222809f920 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f22200032b0 tx=0x7f2220010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22200074b0 con 0x7f222812e3a0 2020-02-11T16:09:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f222ccb8700 1 -- 172.21.15.88:0/2551053010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22280a0af0 con 0x7f222812e3a0 2020-02-11T16:09:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2220007890 con 0x7f222812e3a0 2020-02-11T16:09:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.470+0000 7f222ccb8700 1 -- 172.21.15.88:0/2551053010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2228128df0 con 0x7f222812e3a0 2020-02-11T16:09:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.471+0000 7f2226d9d700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f222812e3a0 0x7f222809f920 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f22200032b0 tx=0x7f2220010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.471+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2220012470 con 0x7f222812e3a0 2020-02-11T16:09:33.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.471+0000 7f2226d9d700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f222812e3a0 0x7f222809f920 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f22200032b0 tx=0x7f2220010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.471+0000 7f22177fe700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2204039d50 0x7f220403c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.471+0000 7f222ccb8700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 0x7f22280a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.471+0000 7f222ccb8700 1 -- 172.21.15.88:0/2551053010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222805e2f0 con 0x7f2228134f50 2020-02-11T16:09:33.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.471+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f2220049ce0 con 0x7f222812e3a0 2020-02-11T16:09:33.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.471+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 0x7f22280a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.471+0000 7f222659c700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2204039d50 0x7f220403c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f2225d9b700 1 -- 172.21.15.88:0/2551053010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f222809f220 con 0x7f2228134f50 2020-02-11T16:09:33.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f222659c700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2204039d50 0x7f220403c210 crc :-1 s=READY pgs=179 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 0x7f22280a49b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 0x7f22280a49b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 0x7f22280a49b0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 0x7f22280a49b0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22180073f0 con 0x7f2228134f50 2020-02-11T16:09:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 0x7f22280a49b0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f2218007550 con 0x7f2228134f50 2020-02-11T16:09:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 msgr2=0x7f22280a49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f22177fe700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 0x7f22280a49b0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).stop 2020-02-11T16:09:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 msgr2=0x7f22280a49b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.472+0000 7f22177fe700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2228134f50 0x7f22280a49b0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).stop 2020-02-11T16:09:33.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.480+0000 7f222ccb8700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 0x7f22281296f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.480+0000 7f222ccb8700 1 -- 172.21.15.88:0/2551053010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222805b7a0 con 0x7f22281292e0 2020-02-11T16:09:33.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.480+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 0x7f22281296f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.480+0000 7f2225d9b700 1 -- 172.21.15.88:0/2551053010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f22280565b0 con 0x7f22281292e0 2020-02-11T16:09:33.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.480+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 0x7f22281296f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.480+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 0x7f22281296f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.480+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 0x7f22281296f0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.480+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 0x7f22281296f0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221800dc90 con 0x7f22281292e0 2020-02-11T16:09:33.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f2225d9b700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 0x7f22281296f0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f221800f350 con 0x7f22281292e0 2020-02-11T16:09:33.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 msgr2=0x7f22281296f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f22177fe700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 0x7f22281296f0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).stop 2020-02-11T16:09:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f22177fe700 1 -- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 msgr2=0x7f22281296f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f22177fe700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22281292e0 0x7f22281296f0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218010b20).stop 2020-02-11T16:09:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f222ccb8700 1 -- 172.21.15.88:0/2551053010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2204039d50 msgr2=0x7f220403c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f222ccb8700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2204039d50 0x7f220403c210 crc :-1 s=READY pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f222ccb8700 1 -- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f222812e3a0 msgr2=0x7f222809f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f222ccb8700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f222812e3a0 0x7f222809f920 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f22200032b0 tx=0x7f2220010dd0).stop 2020-02-11T16:09:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f2226d9d700 1 -- 172.21.15.88:0/2551053010 reap_dead start 2020-02-11T16:09:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f2226d9d700 1 -- 172.21.15.88:0/2551053010 reap_dead start 2020-02-11T16:09:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f222ccb8700 1 -- 172.21.15.88:0/2551053010 shutdown_connections 2020-02-11T16:09:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f222ccb8700 1 --2- 172.21.15.88:0/2551053010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f222812e3a0 0x7f222809f920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f222ccb8700 1 -- 172.21.15.88:0/2551053010 >> 172.21.15.88:0/2551053010 conn(0x7f222809d110 msgr2=0x7f222812dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f222ccb8700 1 -- 172.21.15.88:0/2551053010 shutdown_connections 2020-02-11T16:09:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.481+0000 7f222ccb8700 1 -- 172.21.15.88:0/2551053010 wait complete. 2020-02-11T16:09:33.496 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:09:33.496 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:33.496 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:33.496 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:09:33.496 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 44, 2020-02-11T16:09:33.496 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:09:33.497 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:09:33.497 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:09:33.497 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:09:33.497 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.497 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:09:33.497 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:33.498 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:09:33.498 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:09:33.498 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:33.498 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:33.498 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:33.498 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:33.499 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:33.499 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:33.499 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.499 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:09:33.499 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:09:33.499 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:33.500 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:33.500 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:33.500 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:33.500 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:33.500 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:33.500 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.501 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:09:33.501 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:09:33.501 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:09:33.501 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:09:33.501 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:09:33.502 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:09:33.502 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:33.502 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:33.502 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:09:33.502 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:09:33.502 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:33.502 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:09:33.503 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:33.503 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:33.503 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:33.503 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:33.503 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:33.503 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:33.503 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.503 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:09:33.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.504 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:09:33.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.504 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:33.504 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:33.504 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:33.505 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:33.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.505 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:33.505 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:09:33.505 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.506 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:33.506 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:09:33.506 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.507 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:09:33.507 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:09:33.507 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:33.507 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:33.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.508 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:33.508 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:33.508 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:33.508 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:33.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.508 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:33.508 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:09:33.509 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.509 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:33.509 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:09:33.509 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.510 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.510 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.510 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:09:33.510 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:09:33.510 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:33.510 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:33.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.511 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:09:33.511 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:09:33.511 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:33.511 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:33.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.511 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:33.512 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:09:33.512 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.512 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:33.512 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:09:33.512 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.513 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.513 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.513 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:09:33.513 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:09:33.513 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:33.513 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:33.514 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.514 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.514 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:09:33.514 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:09:33.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.515 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.515 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.515 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:33.515 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.515 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.515 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:09:33.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.516 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.516 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.516 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:33.516 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.516 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.516 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:09:33.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.516 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.517 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.517 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:09:33.517 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.517 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.517 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:09:33.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.517 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.518 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.518 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:09:33.518 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.518 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.518 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:09:33.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.518 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.518 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.519 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:09:33.519 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.519 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.519 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.519 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:09:33.521 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:09:33.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.624+0000 7f22e1573700 1 Processor -- start 2020-02-11T16:09:33.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.624+0000 7f22e1573700 1 -- start start 2020-02-11T16:09:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.625+0000 7f22e1573700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22dc0ad380 0x7f22dc0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.625+0000 7f22e1573700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22dc138280 0x7f22dc138710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.625+0000 7f22e1573700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22dc0adb40 con 0x7f22dc13b1c0 2020-02-11T16:09:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.625+0000 7f22e1573700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc137bf0 con 0x7f22dc0ad380 2020-02-11T16:09:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.625+0000 7f22e1573700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc138b70 con 0x7f22dc138280 2020-02-11T16:09:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.625+0000 7f22da7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22dc138280 0x7f22dc138710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.625+0000 7f22da7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22dc138280 0x7f22dc138710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53852/0 (socket says 172.21.15.88:53852) 2020-02-11T16:09:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.625+0000 7f22db7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f22dc13b1c0 0x7f22dc13b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41482/0 (socket says 172.21.15.88:41482) 2020-02-11T16:09:33.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.625+0000 7f22da7fc700 1 -- 172.21.15.88:0/1610974885 learned_addr learned my addr 172.21.15.88:0/1610974885 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:33.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.625+0000 7f22daffd700 1 --2- 172.21.15.88:0/1610974885 >> v2:172.21.15.52:3300/0 conn(0x7f22dc0ad380 0x7f22dc0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22da7fc700 1 -- 172.21.15.88:0/1610974885 >> v2:172.21.15.52:3300/0 conn(0x7f22dc0ad380 msgr2=0x7f22dc0a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:33.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1610974885 >> v2:172.21.15.52:3300/0 conn(0x7f22dc0ad380 0x7f22dc0a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22da7fc700 1 -- 172.21.15.88:0/1610974885 >> v1:172.21.15.88:6789/0 conn(0x7f22dc13b1c0 legacy=0x7f22dc13b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22da7fc700 1 -- 172.21.15.88:0/1610974885 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc137de0 con 0x7f22dc138280 2020-02-11T16:09:33.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22d9ffb700 1 -- 172.21.15.88:0/1610974885 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574341788 0 0) 0x7f22dc0adb40 con 0x7f22dc13b1c0 2020-02-11T16:09:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1610974885 >> v2:172.21.15.88:3300/0 conn(0x7f22dc138280 0x7f22dc138710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1610974885 >> v2:172.21.15.88:3300/0 conn(0x7f22dc138280 0x7f22dc138710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1610974885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc138710 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).ready entity=mon.1 client_cookie=e0ad5dee2931a965 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1610974885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc138710 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22d9ffb700 1 -- 172.21.15.88:0/1610974885 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c4011670 con 0x7f22dc138280 2020-02-11T16:09:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1610974885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc138710 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1610974885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc138710 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22d9ffb700 1 -- 172.21.15.88:0/1610974885 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c40117d0 con 0x7f22dc138280 2020-02-11T16:09:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22d9ffb700 1 -- 172.21.15.88:0/1610974885 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c4011b30 con 0x7f22dc138280 2020-02-11T16:09:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22e1573700 1 -- 172.21.15.88:0/1610974885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 msgr2=0x7f22dc138710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22e1573700 1 --2- 172.21.15.88:0/1610974885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc138710 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).stop 2020-02-11T16:09:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22e1573700 1 -- 172.21.15.88:0/1610974885 shutdown_connections 2020-02-11T16:09:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22e1573700 1 --2- 172.21.15.88:0/1610974885 >> v2:172.21.15.52:3300/0 conn(0x7f22dc0ad380 0x7f22dc0a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22e1573700 1 --2- 172.21.15.88:0/1610974885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc138710 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22e1573700 1 -- 172.21.15.88:0/1610974885 >> 172.21.15.88:0/1610974885 conn(0x7f22dc05ac70 msgr2=0x7f22dc0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22e1573700 1 -- 172.21.15.88:0/1610974885 shutdown_connections 2020-02-11T16:09:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.626+0000 7f22e1573700 1 -- 172.21.15.88:0/1610974885 wait complete. 2020-02-11T16:09:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.627+0000 7f22e1573700 1 Processor -- start 2020-02-11T16:09:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.627+0000 7f22e1573700 1 -- start start 2020-02-11T16:09:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22e1573700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22dc0ad380 0x7f22dc066fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22e1573700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22dc138280 0x7f22dc132cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22e1573700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22dc134fd0 con 0x7f22dc13b1c0 2020-02-11T16:09:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22e1573700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc135270 con 0x7f22dc0ad380 2020-02-11T16:09:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22e1573700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc066b10 con 0x7f22dc138280 2020-02-11T16:09:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22dc138280 0x7f22dc132cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22dc138280 0x7f22dc132cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53860/0 (socket says 172.21.15.88:53860) 2020-02-11T16:09:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 -- 172.21.15.88:0/1635771882 learned_addr learned my addr 172.21.15.88:0/1635771882 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> v2:172.21.15.52:3300/0 conn(0x7f22dc0ad380 0x7f22dc066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 -- 172.21.15.88:0/1635771882 >> v2:172.21.15.52:3300/0 conn(0x7f22dc0ad380 msgr2=0x7f22dc066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1635771882 >> v2:172.21.15.52:3300/0 conn(0x7f22dc0ad380 0x7f22dc066fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 -- 172.21.15.88:0/1635771882 >> v1:172.21.15.52:6789/0 conn(0x7f22dc13b1c0 legacy=0x7f22dc12d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 -- 172.21.15.88:0/1635771882 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc138dc0 con 0x7f22dc138280 2020-02-11T16:09:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> v2:172.21.15.52:3300/0 conn(0x7f22dc0ad380 0x7f22dc066fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:09:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1635771882 >> v2:172.21.15.88:3300/0 conn(0x7f22dc138280 0x7f22dc132cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1635771882 >> v2:172.21.15.88:3300/0 conn(0x7f22dc138280 0x7f22dc132cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc132cb0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc132cb0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c4011b30 con 0x7f22dc138280 2020-02-11T16:09:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc132cb0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc132cb0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c4007150 con 0x7f22dc138280 2020-02-11T16:09:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22e1573700 1 -- 172.21.15.88:0/1635771882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc137640 con 0x7f22dc138280 2020-02-11T16:09:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.628+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c4007530 con 0x7f22dc138280 2020-02-11T16:09:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.629+0000 7f22e1573700 1 -- 172.21.15.88:0/1635771882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc132570 con 0x7f22dc138280 2020-02-11T16:09:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.629+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc132cb0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.629+0000 7f22e1573700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 0x7f22dc1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.629+0000 7f22e1573700 1 -- 172.21.15.88:0/1635771882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc05e2f0 con 0x7f22dc138fd0 2020-02-11T16:09:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.629+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f22c40056c0 con 0x7f22dc138280 2020-02-11T16:09:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.629+0000 7f22da7fc700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc132cb0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.629+0000 7f22d3fff700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f22c0039bf0 0x7f22c003c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.629+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 0x7f22dc1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.629+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f22c404a100 con 0x7f22dc138280 2020-02-11T16:09:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22db7fe700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f22c0039bf0 0x7f22c003c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22daffd700 1 -- 172.21.15.88:0/1635771882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22dc12e250 con 0x7f22dc138fd0 2020-02-11T16:09:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 0x7f22dc1393e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22db7fe700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f22c0039bf0 0x7f22c003c0b0 crc :-1 s=READY pgs=180 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 0x7f22dc1393e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 0x7f22dc1393e0 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 0x7f22dc1393e0 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22d400e160 con 0x7f22dc138fd0 2020-02-11T16:09:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 0x7f22dc1393e0 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f22d40105a0 con 0x7f22dc138fd0 2020-02-11T16:09:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 msgr2=0x7f22dc1393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22d3fff700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 0x7f22dc1393e0 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).stop 2020-02-11T16:09:33.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 msgr2=0x7f22dc1393e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:33.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.630+0000 7f22d3fff700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc138fd0 0x7f22dc1393e0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).stop 2020-02-11T16:09:33.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.638+0000 7f22e1573700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 0x7f22dc139c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.638+0000 7f22e1573700 1 -- 172.21.15.88:0/1635771882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc1377d0 con 0x7f22dc139840 2020-02-11T16:09:33.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.639+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 0x7f22dc139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.639+0000 7f22daffd700 1 -- 172.21.15.88:0/1635771882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f22dc132ac0 con 0x7f22dc139840 2020-02-11T16:09:33.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.639+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 0x7f22dc139c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.639+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 0x7f22dc139c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.639+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 0x7f22dc139c50 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.639+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 0x7f22dc139c50 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.639+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22d400ce50 con 0x7f22dc139840 2020-02-11T16:09:33.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22daffd700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 0x7f22dc139c50 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4192 (secure 0 0 0) 0x7f22d4010330 con 0x7f22dc139840 2020-02-11T16:09:33.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 msgr2=0x7f22dc139c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22d3fff700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 0x7f22dc139c50 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f22d40032b0 tx=0x7f22d4011040).stop 2020-02-11T16:09:33.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22d3fff700 1 -- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 msgr2=0x7f22dc139c50 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:33.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22d3fff700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22dc139840 0x7f22dc139c50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22e1573700 1 -- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f22c0039bf0 msgr2=0x7f22c003c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22e1573700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f22c0039bf0 0x7f22c003c0b0 crc :-1 s=READY pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22e1573700 1 -- 172.21.15.88:0/1635771882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 msgr2=0x7f22dc132cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22e1573700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc132cb0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f22c4002f30 tx=0x7f22c4007a40).stop 2020-02-11T16:09:33.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22db7fe700 1 -- 172.21.15.88:0/1635771882 reap_dead start 2020-02-11T16:09:33.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22db7fe700 1 -- 172.21.15.88:0/1635771882 reap_dead start 2020-02-11T16:09:33.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22e1573700 1 -- 172.21.15.88:0/1635771882 shutdown_connections 2020-02-11T16:09:33.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22e1573700 1 --2- 172.21.15.88:0/1635771882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22dc138280 0x7f22dc132cb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22e1573700 1 -- 172.21.15.88:0/1635771882 >> 172.21.15.88:0/1635771882 conn(0x7f22dc05ac70 msgr2=0x7f22dc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:33.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22e1573700 1 -- 172.21.15.88:0/1635771882 shutdown_connections 2020-02-11T16:09:33.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.640+0000 7f22e1573700 1 -- 172.21.15.88:0/1635771882 wait complete. 2020-02-11T16:09:33.654 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:09:33.654 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:33.654 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:33.654 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:09:33.654 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 44, 2020-02-11T16:09:33.654 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:09:33.654 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:09:33.655 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:09:33.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:09:33.655 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.655 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:09:33.655 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:33.655 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:09:33.655 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:09:33.655 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:33.656 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:33.656 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:33.656 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:33.656 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:33.656 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:33.656 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.656 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:09:33.657 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:09:33.657 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:33.657 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:33.657 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:33.657 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:33.657 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:33.657 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:33.658 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.658 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:09:33.658 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:09:33.658 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:09:33.658 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:09:33.658 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:09:33.659 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:09:33.659 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:33.659 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:33.659 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:09:33.659 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:09:33.659 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:33.660 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:09:33.660 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:33.660 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:33.660 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:33.660 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:33.660 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:33.660 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:33.661 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.661 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:09:33.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.661 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:09:33.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.661 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:33.661 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:33.662 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:33.662 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:33.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.662 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:33.662 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:09:33.662 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.663 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:33.663 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:09:33.663 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.663 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.663 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.664 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:09:33.664 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:09:33.664 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:33.664 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:33.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.664 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:33.665 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:33.665 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:33.665 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:33.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.665 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:33.665 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:09:33.665 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.666 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:33.666 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:09:33.666 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.666 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.667 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:09:33.667 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:09:33.667 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:33.667 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:33.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.668 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:09:33.668 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:09:33.668 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:33.668 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:33.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.669 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:33.669 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:09:33.669 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.669 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:33.670 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:09:33.670 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.670 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.670 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:09:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:09:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:09:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:09:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:09:33.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.673 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.673 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.673 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:33.673 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.673 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.673 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:09:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:09:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:09:33.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.675 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.675 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.675 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:09:33.675 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.675 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.675 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.676 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:09:33.677 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:09:33.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.781+0000 7f59848c3700 1 Processor -- start 2020-02-11T16:09:33.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.781+0000 7f59848c3700 1 -- start start 2020-02-11T16:09:33.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.782+0000 7f59848c3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59800a18a0 0x7f59800a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.782+0000 7f59848c3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5de0 0x7f59800a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.782+0000 7f59848c3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59800a31b0 con 0x7f598012e3a0 2020-02-11T16:09:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.782+0000 7f59848c3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59800a3570 con 0x7f59800a18a0 2020-02-11T16:09:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.782+0000 7f59848c3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59800a3810 con 0x7f59800a5de0 2020-02-11T16:09:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.782+0000 7f597ed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f598012e3a0 0x7f598012e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41496/0 (socket says 172.21.15.88:41496) 2020-02-11T16:09:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.782+0000 7f597ed9d700 1 -- 172.21.15.88:0/2409065061 learned_addr learned my addr 172.21.15.88:0/2409065061 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.782+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571074981 0 0) 0x7f59800a31b0 con 0x7f598012e3a0 2020-02-11T16:09:33.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597dd9b700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5de0 0x7f59800a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597e59c700 1 --2- 172.21.15.88:0/2409065061 >> v2:172.21.15.52:3300/0 conn(0x7f59800a18a0 0x7f59800a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5960003230 con 0x7f598012e3a0 2020-02-11T16:09:33.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2516307508 0 0) 0x7f5960003230 con 0x7f598012e3a0 2020-02-11T16:09:33.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5de0 msgr2=0x7f59800a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:33.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5de0 0x7f59800a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 >> v2:172.21.15.52:3300/0 conn(0x7f59800a18a0 msgr2=0x7f59800a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:33.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 --2- 172.21.15.88:0/2409065061 >> v2:172.21.15.52:3300/0 conn(0x7f59800a18a0 0x7f59800a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800a3ab0 con 0x7f598012e3a0 2020-02-11T16:09:33.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f5978001a50 con 0x7f598012e3a0 2020-02-11T16:09:33.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 >> v1:172.21.15.88:6789/0 conn(0x7f598012e3a0 legacy=0x7f598012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5960003720 0x7f5960003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5de0 0x7f59600044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5960004930 0x7f5960004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59800a3570 con 0x7f5960003720 2020-02-11T16:09:33.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59800a3810 con 0x7f5960004930 2020-02-11T16:09:33.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5960005380 con 0x7f59800a5de0 2020-02-11T16:09:33.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5960004930 0x7f5960004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597e59c700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5960003720 0x7f5960003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597dd9b700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5de0 0x7f59600044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 -- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5de0 msgr2=0x7f59600044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:33.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5de0 0x7f59600044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 -- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5960003720 msgr2=0x7f5960003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:33.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5960003720 0x7f5960003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 -- 172.21.15.88:0/2409065061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960003230 con 0x7f5960004930 2020-02-11T16:09:33.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5960004930 0x7f5960004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5978001760 tx=0x7f59800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5960004930 0x7f5960004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5978001760 tx=0x7f59800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5960004930 0x7f5960004db0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f5978001760 tx=0x7f59800a1c80).ready entity=mon.1 client_cookie=301200b99b93d6ba server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5960004930 0x7f5960004db0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f5978001760 tx=0x7f59800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5960004930 0x7f5960004db0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f5978001760 tx=0x7f59800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597800e540 con 0x7f5960004930 2020-02-11T16:09:33.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597ed9d700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5960004930 0x7f5960004db0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f5978001760 tx=0x7f59800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597800e6a0 con 0x7f5960004930 2020-02-11T16:09:33.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.783+0000 7f597d59a700 1 -- 172.21.15.88:0/2409065061 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597800ea40 con 0x7f5960004930 2020-02-11T16:09:33.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.784+0000 7f59848c3700 1 -- 172.21.15.88:0/2409065061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5960004930 msgr2=0x7f5960004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.784+0000 7f59848c3700 1 --2- 172.21.15.88:0/2409065061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5960004930 0x7f5960004db0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f5978001760 tx=0x7f59800a1c80).stop 2020-02-11T16:09:33.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.784+0000 7f597ed9d700 1 -- 172.21.15.88:0/2409065061 reap_dead start 2020-02-11T16:09:33.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.784+0000 7f59848c3700 1 -- 172.21.15.88:0/2409065061 shutdown_connections 2020-02-11T16:09:33.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.784+0000 7f59848c3700 1 -- 172.21.15.88:0/2409065061 >> 172.21.15.88:0/2409065061 conn(0x7f598009d110 msgr2=0x7f598009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:33.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.784+0000 7f59848c3700 1 -- 172.21.15.88:0/2409065061 shutdown_connections 2020-02-11T16:09:33.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.784+0000 7f59848c3700 1 -- 172.21.15.88:0/2409065061 wait complete. 2020-02-11T16:09:33.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.785+0000 7f59848c3700 1 Processor -- start 2020-02-11T16:09:33.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.785+0000 7f59848c3700 1 -- start start 2020-02-11T16:09:33.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.785+0000 7f59848c3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5980145860 0x7f5980145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.785+0000 7f59848c3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f598009eb40 0x7f598009eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.785+0000 7f59848c3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5980137d20 0x7f5980138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.785+0000 7f59848c3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598009e470 con 0x7f5980145860 2020-02-11T16:09:33.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.785+0000 7f59848c3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59800a7660 con 0x7f598009eb40 2020-02-11T16:09:33.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.785+0000 7f59848c3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598013c620 con 0x7f5980137d20 2020-02-11T16:09:33.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f598009eb40 0x7f598009eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f598009eb40 0x7f598009eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53882/0 (socket says 172.21.15.88:53882) 2020-02-11T16:09:33.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 -- 172.21.15.88:0/1531116831 learned_addr learned my addr 172.21.15.88:0/1531116831 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:33.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> v2:172.21.15.52:3300/0 conn(0x7f5980145860 0x7f5980145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597ed9d700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5980137d20 0x7f5980138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 -- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5980137d20 msgr2=0x7f5980138170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5980137d20 0x7f5980138170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 -- 172.21.15.88:0/1531116831 >> v2:172.21.15.52:3300/0 conn(0x7f5980145860 msgr2=0x7f5980145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 --2- 172.21.15.88:0/1531116831 >> v2:172.21.15.52:3300/0 conn(0x7f5980145860 0x7f5980145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 -- 172.21.15.88:0/1531116831 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980146220 con 0x7f598009eb40 2020-02-11T16:09:33.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 --2- 172.21.15.88:0/1531116831 >> v2:172.21.15.88:3300/0 conn(0x7f598009eb40 0x7f598009eff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5970003070 tx=0x7f5970010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 --2- 172.21.15.88:0/1531116831 >> v2:172.21.15.88:3300/0 conn(0x7f598009eb40 0x7f598009eff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5970003070 tx=0x7f5970010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f598009eb40 0x7f598009eff0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f5970003070 tx=0x7f5970010d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f598009eb40 0x7f598009eff0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f5970003070 tx=0x7f5970010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f598009eb40 0x7f598009eff0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f5970003070 tx=0x7f5970010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f597dd9b700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f598009eb40 0x7f598009eff0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f5970003070 tx=0x7f5970010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5970005e90 con 0x7f598009eb40 2020-02-11T16:09:33.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5970007160 con 0x7f598009eb40 2020-02-11T16:09:33.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f59848c3700 1 -- 172.21.15.88:0/1531116831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598009e6a0 con 0x7f598009eb40 2020-02-11T16:09:33.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5970007580 con 0x7f598009eb40 2020-02-11T16:09:33.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.786+0000 7f59848c3700 1 -- 172.21.15.88:0/1531116831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5980131ef0 con 0x7f598009eb40 2020-02-11T16:09:33.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.787+0000 7f597dd9b700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f598009eb40 0x7f598009eff0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f5970003070 tx=0x7f5970010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.787+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5970008350 con 0x7f598009eb40 2020-02-11T16:09:33.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.787+0000 7f597dd9b700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f598009eb40 0x7f598009eff0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f5970003070 tx=0x7f5970010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.787+0000 7f59848c3700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 0x7f5980141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.787+0000 7f59848c3700 1 -- 172.21.15.88:0/1531116831 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598005e2f0 con 0x7f59800a4d30 2020-02-11T16:09:33.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.787+0000 7f59777fe700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5964039da0 0x7f596403c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.787+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5970049ab0 con 0x7f598009eb40 2020-02-11T16:09:33.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.787+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 0x7f5980141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.787+0000 7f597ed9d700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5964039da0 0x7f596403c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f597e59c700 1 -- 172.21.15.88:0/1531116831 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5980138950 con 0x7f59800a4d30 2020-02-11T16:09:33.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 0x7f5980141f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f596800c450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f597ed9d700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5964039da0 0x7f596403c260 crc :-1 s=READY pgs=181 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 0x7f5980141f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f596800c450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 0x7f5980141f10 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f596800c450).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 0x7f5980141f10 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f596800c450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596800caf0 con 0x7f59800a4d30 2020-02-11T16:09:33.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 0x7f5980141f10 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f596800c450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5968007520 con 0x7f59800a4d30 2020-02-11T16:09:33.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 msgr2=0x7f5980141f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f59777fe700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 0x7f5980141f10 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f596800c450).stop 2020-02-11T16:09:33.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 msgr2=0x7f5980141f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:33.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.788+0000 7f59777fe700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a4d30 0x7f5980141f10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.796+0000 7f59848c3700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 0x7f5980142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.796+0000 7f59848c3700 1 -- 172.21.15.88:0/1531116831 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598009e830 con 0x7f59800a5110 2020-02-11T16:09:33.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.797+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 0x7f5980142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.797+0000 7f597e59c700 1 -- 172.21.15.88:0/1531116831 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f59800565b0 con 0x7f59800a5110 2020-02-11T16:09:33.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.797+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 0x7f5980142370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f5968008040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.797+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 0x7f5980142370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f5968008040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.797+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 0x7f5980142370 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f5968008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.797+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 0x7f5980142370 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f5968008040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.797+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5968010440 con 0x7f59800a5110 2020-02-11T16:09:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f597e59c700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 0x7f5980142370 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f5968008040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f5968007350 con 0x7f59800a5110 2020-02-11T16:09:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 msgr2=0x7f5980142370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59777fe700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 0x7f5980142370 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f5968002f30 tx=0x7f5968008040).stop 2020-02-11T16:09:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59777fe700 1 -- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 msgr2=0x7f5980142370 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59777fe700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59800a5110 0x7f5980142370 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59848c3700 1 -- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5964039da0 msgr2=0x7f596403c260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59848c3700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5964039da0 0x7f596403c260 crc :-1 s=READY pgs=181 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59848c3700 1 -- 172.21.15.88:0/1531116831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f598009eb40 msgr2=0x7f598009eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59848c3700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f598009eb40 0x7f598009eff0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f5970003070 tx=0x7f5970010d10).stop 2020-02-11T16:09:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f597ed9d700 1 -- 172.21.15.88:0/1531116831 reap_dead start 2020-02-11T16:09:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f597ed9d700 1 -- 172.21.15.88:0/1531116831 reap_dead start 2020-02-11T16:09:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59848c3700 1 -- 172.21.15.88:0/1531116831 shutdown_connections 2020-02-11T16:09:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59848c3700 1 --2- 172.21.15.88:0/1531116831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f598009eb40 0x7f598009eff0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59848c3700 1 -- 172.21.15.88:0/1531116831 >> 172.21.15.88:0/1531116831 conn(0x7f598009d110 msgr2=0x7f59800a6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59848c3700 1 -- 172.21.15.88:0/1531116831 shutdown_connections 2020-02-11T16:09:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.798+0000 7f59848c3700 1 -- 172.21.15.88:0/1531116831 wait complete. 2020-02-11T16:09:33.825 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:09:33.826 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:09:33.826 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:09:33.826 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:09:33.826 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 44, 2020-02-11T16:09:33.826 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:09:33.827 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:09:33.827 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:09:33.827 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:09:33.827 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.827 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:09:33.827 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:33.827 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:09:33.828 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:09:33.828 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:33.828 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:33.828 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:33.828 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:33.828 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:33.828 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:33.829 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.829 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:09:33.829 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:09:33.829 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:33.829 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:33.829 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:33.830 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:33.830 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:33.830 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:33.830 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.831 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:09:33.831 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:09:33.831 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:09:33.831 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:09:33.831 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:09:33.831 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:09:33.831 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:33.832 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:33.832 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:09:33.832 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:09:33.832 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:33.832 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:09:33.832 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:33.833 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:33.833 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:33.833 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:33.833 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:33.833 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:33.834 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.834 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:09:33.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.834 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:09:33.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.835 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:33.835 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:33.836 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:33.836 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:33.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.836 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:33.836 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:09:33.837 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.837 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:33.838 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:09:33.838 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.838 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.838 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.839 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:09:33.839 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:09:33.839 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:33.840 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:33.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.840 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:33.840 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:33.841 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:33.841 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:33.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.841 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:33.841 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:09:33.841 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.842 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:33.842 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:09:33.842 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.842 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.842 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.842 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:09:33.843 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:09:33.843 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:33.843 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:33.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.843 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:09:33.843 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:09:33.844 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:33.844 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:33.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.844 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:33.844 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:09:33.844 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.845 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:33.845 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:09:33.845 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:33.845 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.845 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.845 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:09:33.846 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:09:33.846 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:33.846 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:33.846 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.846 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:33.846 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:09:33.847 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:09:33.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.847 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.847 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.847 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:33.847 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.847 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:33.848 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:09:33.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:33.848 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:33.848 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:33.848 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:33.848 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.848 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:33.848 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:33.849 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:09:33.849 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2020-02-11T16:09:33.849 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:09:33.849 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2020-02-11T16:09:33.849 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:09:33.850 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-02-11T16:09:33.850 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:09:33.861 INFO:tasks.ceph.mon.c:Stopped 2020-02-11T16:09:33.861 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:09:33.862 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:09:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.964+0000 7f321753c700 1 Processor -- start 2020-02-11T16:09:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.965+0000 7f321753c700 1 -- start start 2020-02-11T16:09:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.965+0000 7f321753c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f32100a18a0 0x7f32100a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.965+0000 7f321753c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32100a6260 0x7f321012eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.965+0000 7f321753c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32100a3570 con 0x7f32100a5de0 2020-02-11T16:09:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.965+0000 7f321753c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32100a3810 con 0x7f32100a18a0 2020-02-11T16:09:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.965+0000 7f321753c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32100a3ab0 con 0x7f32100a6260 2020-02-11T16:09:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.965+0000 7f3215ad9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32100a6260 0x7f321012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.965+0000 7f3215ad9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32100a6260 0x7f321012eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53894/0 (socket says 172.21.15.88:53894) 2020-02-11T16:09:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.965+0000 7f3214ad7700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f32100a5de0 0x7f321012e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41522/0 (socket says 172.21.15.88:41522) 2020-02-11T16:09:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.965+0000 7f3215ad9700 1 -- 172.21.15.88:0/1235951792 learned_addr learned my addr 172.21.15.88:0/1235951792 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f32152d8700 1 --2- 172.21.15.88:0/1235951792 >> v2:172.21.15.52:3300/0 conn(0x7f32100a18a0 0x7f32100a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f3215ad9700 1 -- 172.21.15.88:0/1235951792 >> v2:172.21.15.52:3300/0 conn(0x7f32100a18a0 msgr2=0x7f32100a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f3215ad9700 1 --2- 172.21.15.88:0/1235951792 >> v2:172.21.15.52:3300/0 conn(0x7f32100a18a0 0x7f32100a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f3215ad9700 1 -- 172.21.15.88:0/1235951792 >> v1:172.21.15.88:6789/0 conn(0x7f32100a5de0 legacy=0x7f321012e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f3215ad9700 1 -- 172.21.15.88:0/1235951792 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100a3d50 con 0x7f32100a6260 2020-02-11T16:09:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f3215ad9700 1 --2- 172.21.15.88:0/1235951792 >> v2:172.21.15.88:3300/0 conn(0x7f32100a6260 0x7f321012eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f320c0010d0 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f3215ad9700 1 --2- 172.21.15.88:0/1235951792 >> v2:172.21.15.88:3300/0 conn(0x7f32100a6260 0x7f321012eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f320c0010d0 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f3215ad9700 1 --2- 172.21.15.88:0/1235951792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f321012eab0 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f320c0010d0 tx=0x7f3208007dc0).ready entity=mon.1 client_cookie=b9be604f9c5392d8 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f3215ad9700 1 --2- 172.21.15.88:0/1235951792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f321012eab0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f320c0010d0 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f31fffff700 1 -- 172.21.15.88:0/1235951792 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3208010d70 con 0x7f32100a6260 2020-02-11T16:09:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f3215ad9700 1 --2- 172.21.15.88:0/1235951792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f321012eab0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f320c0010d0 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f3215ad9700 1 --2- 172.21.15.88:0/1235951792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f321012eab0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f320c0010d0 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f31fffff700 1 -- 172.21.15.88:0/1235951792 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32080110c0 con 0x7f32100a6260 2020-02-11T16:09:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f31fffff700 1 -- 172.21.15.88:0/1235951792 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3208011460 con 0x7f32100a6260 2020-02-11T16:09:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f321753c700 1 -- 172.21.15.88:0/1235951792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 msgr2=0x7f321012eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.966+0000 7f321753c700 1 --2- 172.21.15.88:0/1235951792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f321012eab0 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f320c0010d0 tx=0x7f3208007dc0).stop 2020-02-11T16:09:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.967+0000 7f321753c700 1 -- 172.21.15.88:0/1235951792 shutdown_connections 2020-02-11T16:09:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.967+0000 7f321753c700 1 --2- 172.21.15.88:0/1235951792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f321012eab0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.967+0000 7f321753c700 1 --2- 172.21.15.88:0/1235951792 >> v2:172.21.15.52:3300/0 conn(0x7f32100a18a0 0x7f32100a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.967+0000 7f321753c700 1 -- 172.21.15.88:0/1235951792 >> 172.21.15.88:0/1235951792 conn(0x7f321009d110 msgr2=0x7f321009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.967+0000 7f321753c700 1 -- 172.21.15.88:0/1235951792 shutdown_connections 2020-02-11T16:09:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.967+0000 7f321753c700 1 -- 172.21.15.88:0/1235951792 wait complete. 2020-02-11T16:09:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.967+0000 7f321753c700 1 Processor -- start 2020-02-11T16:09:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.967+0000 7f321753c700 1 -- start start 2020-02-11T16:09:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f321753c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f32100a18a0 0x7f32101353e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f321753c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32100a6260 0x7f3210131960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f321753c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3210133c80 con 0x7f32100a5de0 2020-02-11T16:09:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f321753c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3210133f20 con 0x7f32100a18a0 2020-02-11T16:09:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f321753c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3210065450 con 0x7f32100a6260 2020-02-11T16:09:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f3215ad9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32100a6260 0x7f3210131960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f3215ad9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32100a6260 0x7f3210131960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53902/0 (socket says 172.21.15.88:53902) 2020-02-11T16:09:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f3215ad9700 1 -- 172.21.15.88:0/2697418499 learned_addr learned my addr 172.21.15.88:0/2697418499 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f32152d8700 1 --2- 172.21.15.88:0/2697418499 >> v2:172.21.15.52:3300/0 conn(0x7f32100a18a0 0x7f32101353e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f3215ad9700 1 -- 172.21.15.88:0/2697418499 >> v2:172.21.15.52:3300/0 conn(0x7f32100a18a0 msgr2=0x7f32101353e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> v2:172.21.15.52:3300/0 conn(0x7f32100a18a0 0x7f32101353e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f3215ad9700 1 -- 172.21.15.88:0/2697418499 >> v1:172.21.15.52:6789/0 conn(0x7f32100a5de0 legacy=0x7f3210066130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f3215ad9700 1 -- 172.21.15.88:0/2697418499 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3210067050 con 0x7f32100a6260 2020-02-11T16:09:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> v2:172.21.15.88:3300/0 conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> v2:172.21.15.88:3300/0 conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.968+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f31fe7fc700 1 -- 172.21.15.88:0/2697418499 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3208005a40 con 0x7f32100a6260 2020-02-11T16:09:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f31fe7fc700 1 -- 172.21.15.88:0/2697418499 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3208005ba0 con 0x7f32100a6260 2020-02-11T16:09:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f31fe7fc700 1 -- 172.21.15.88:0/2697418499 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f320800f280 con 0x7f32100a6260 2020-02-11T16:09:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f321753c700 1 -- 172.21.15.88:0/2697418499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32101450d0 con 0x7f32100a6260 2020-02-11T16:09:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f321753c700 1 -- 172.21.15.88:0/2697418499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321012d950 con 0x7f32100a6260 2020-02-11T16:09:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f31fe7fc700 1 -- 172.21.15.88:0/2697418499 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f320800f540 con 0x7f32100a6260 2020-02-11T16:09:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.969+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.970+0000 7f31fe7fc700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31f0039c40 0x7f31f003c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.970+0000 7f31fe7fc700 1 -- 172.21.15.88:0/2697418499 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f320800f0c0 con 0x7f32100a6260 2020-02-11T16:09:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.970+0000 7f321753c700 1 -- 172.21.15.88:0/2697418499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3210135930 con 0x7f32100a6260 2020-02-11T16:09:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.970+0000 7f32152d8700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31f0039c40 0x7f31f003c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.970+0000 7f32152d8700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31f0039c40 0x7f31f003c100 crc :-1 s=READY pgs=182 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.973+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:33.973+0000 7f31fe7fc700 1 -- 172.21.15.88:0/2697418499 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f320802f8e0 con 0x7f32100a6260 2020-02-11T16:09:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.152+0000 7f321753c700 1 -- 172.21.15.88:0/2697418499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3210133ab0 con 0x7f32100a6260 2020-02-11T16:09:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.152+0000 7f3215ad9700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.152+0000 7f31fe7fc700 1 -- 172.21.15.88:0/2697418499 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f3208007c20 con 0x7f32100a6260 2020-02-11T16:09:34.155 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 -- 172.21.15.88:0/2697418499 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31f0039c40 msgr2=0x7f31f003c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31f0039c40 0x7f31f003c100 crc :-1 s=READY pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 -- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 msgr2=0x7f3210131960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f3210131960 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f3210134610 tx=0x7f3208007dc0).stop 2020-02-11T16:09:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 -- 172.21.15.88:0/2697418499 shutdown_connections 2020-02-11T16:09:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32100a6260 0x7f3210131960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 --2- 172.21.15.88:0/2697418499 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31f0039c40 0x7f31f003c100 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 --2- 172.21.15.88:0/2697418499 >> v2:172.21.15.52:3300/0 conn(0x7f32100a18a0 0x7f32101353e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 -- 172.21.15.88:0/2697418499 >> 172.21.15.88:0/2697418499 conn(0x7f321009d110 msgr2=0x7f32100a4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 -- 172.21.15.88:0/2697418499 shutdown_connections 2020-02-11T16:09:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:34.154+0000 7f321753c700 1 -- 172.21.15.88:0/2697418499 wait complete. 2020-02-11T16:09:34.165 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":44,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:37.166 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:09:37.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.280+0000 7f1dbf4ee700 1 Processor -- start 2020-02-11T16:09:37.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.280+0000 7f1dbf4ee700 1 -- start start 2020-02-11T16:09:37.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbf4ee700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1db80a18a0 0x7f1db80a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:37.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbf4ee700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1db80a5de0 0x7f1db80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:37.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbf4ee700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db80a31b0 con 0x7f1db812e3a0 2020-02-11T16:09:37.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbf4ee700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db80a3570 con 0x7f1db80a18a0 2020-02-11T16:09:37.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbf4ee700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80a3810 con 0x7f1db80a5de0 2020-02-11T16:09:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1db80a18a0 0x7f1db80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbca89700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1db80a5de0 msgr2=0x7f1db80a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbca89700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1db80a5de0 0x7f1db80a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1db80a18a0 0x7f1db80a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53906/0 (socket says 172.21.15.88:53906) 2020-02-11T16:09:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 -- 172.21.15.88:0/1626334952 learned_addr learned my addr 172.21.15.88:0/1626334952 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 -- 172.21.15.88:0/1626334952 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1db80a5de0 msgr2=0x7f1db80a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 --2- 172.21.15.88:0/1626334952 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1db80a5de0 0x7f1db80a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 -- 172.21.15.88:0/1626334952 >> v1:172.21.15.52:6789/0 conn(0x7f1db812e3a0 legacy=0x7f1db812e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 -- 172.21.15.88:0/1626334952 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db80a3ab0 con 0x7f1db80a18a0 2020-02-11T16:09:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 --2- 172.21.15.88:0/1626334952 >> v2:172.21.15.88:3300/0 conn(0x7f1db80a18a0 0x7f1db80a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1db805b910 tx=0x7f1da80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 --2- 172.21.15.88:0/1626334952 >> v2:172.21.15.88:3300/0 conn(0x7f1db80a18a0 0x7f1db80a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1db805b910 tx=0x7f1da80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 --2- 172.21.15.88:0/1626334952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a18a0 0x7f1db80a6dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f1db805b910 tx=0x7f1da80088e0).ready entity=mon.1 client_cookie=18fffbec37e93329 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 --2- 172.21.15.88:0/1626334952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a18a0 0x7f1db80a6dd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f1db805b910 tx=0x7f1da80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1da7fff700 1 -- 172.21.15.88:0/1626334952 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1da8008e20 con 0x7f1db80a18a0 2020-02-11T16:09:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 --2- 172.21.15.88:0/1626334952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a18a0 0x7f1db80a6dd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f1db805b910 tx=0x7f1da80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbd28a700 1 --2- 172.21.15.88:0/1626334952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a18a0 0x7f1db80a6dd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f1db805b910 tx=0x7f1da80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1da7fff700 1 -- 172.21.15.88:0/1626334952 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da8011910 con 0x7f1db80a18a0 2020-02-11T16:09:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1da7fff700 1 -- 172.21.15.88:0/1626334952 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1da8011cb0 con 0x7f1db80a18a0 2020-02-11T16:09:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1626334952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a18a0 msgr2=0x7f1db80a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:37.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.281+0000 7f1dbf4ee700 1 --2- 172.21.15.88:0/1626334952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a18a0 0x7f1db80a6dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f1db805b910 tx=0x7f1da80088e0).stop 2020-02-11T16:09:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.282+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1626334952 shutdown_connections 2020-02-11T16:09:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.282+0000 7f1dbf4ee700 1 --2- 172.21.15.88:0/1626334952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a18a0 0x7f1db80a6dd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.282+0000 7f1dbf4ee700 1 --2- 172.21.15.88:0/1626334952 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1db80a5de0 0x7f1db80a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.282+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1626334952 >> 172.21.15.88:0/1626334952 conn(0x7f1db809d110 msgr2=0x7f1db809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.282+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1626334952 shutdown_connections 2020-02-11T16:09:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.282+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1626334952 wait complete. 2020-02-11T16:09:37.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.283+0000 7f1dbf4ee700 1 Processor -- start 2020-02-11T16:09:37.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.283+0000 7f1dbf4ee700 1 -- start start 2020-02-11T16:09:37.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.283+0000 7f1dbf4ee700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1db80a5de0 0x7f1db809ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:37.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbf4ee700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db806a280 con 0x7f1db80a18a0 2020-02-11T16:09:37.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbf4ee700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db809f3b0 con 0x7f1db812e3a0 2020-02-11T16:09:37.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbf4ee700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db809f650 con 0x7f1db80a5de0 2020-02-11T16:09:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1db80a5de0 0x7f1db809ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1db80a5de0 0x7f1db809ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53914/0 (socket says 172.21.15.88:53914) 2020-02-11T16:09:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 -- 172.21.15.88:0/1818812741 learned_addr learned my addr 172.21.15.88:0/1818812741 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbda8b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1db812e3a0 0x7f1db81465d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41542/0 (socket says 172.21.15.88:41542) 2020-02-11T16:09:37.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 -- 172.21.15.88:0/1818812741 >> v1:172.21.15.88:6789/0 conn(0x7f1db812e3a0 legacy=0x7f1db81465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:37.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 -- 172.21.15.88:0/1818812741 >> v1:172.21.15.52:6789/0 conn(0x7f1db80a18a0 legacy=0x7f1db81283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:37.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 -- 172.21.15.88:0/1818812741 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db809f8f0 con 0x7f1db80a5de0 2020-02-11T16:09:37.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 --2- 172.21.15.88:0/1818812741 >> v2:172.21.15.88:3300/0 conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 --2- 172.21.15.88:0/1818812741 >> v2:172.21.15.88:3300/0 conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:37.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1da67fc700 1 -- 172.21.15.88:0/1818812741 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1db400d0c0 con 0x7f1db80a5de0 2020-02-11T16:09:37.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbca89700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1da67fc700 1 -- 172.21.15.88:0/1818812741 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db400d260 con 0x7f1db80a5de0 2020-02-11T16:09:37.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1818812741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db80a0b40 con 0x7f1db80a5de0 2020-02-11T16:09:37.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1da67fc700 1 -- 172.21.15.88:0/1818812741 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1db400d680 con 0x7f1db80a5de0 2020-02-11T16:09:37.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.284+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1818812741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db8128c90 con 0x7f1db80a5de0 2020-02-11T16:09:37.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.285+0000 7f1dbca89700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.285+0000 7f1da67fc700 1 -- 172.21.15.88:0/1818812741 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f1db400d8f0 con 0x7f1db80a5de0 2020-02-11T16:09:37.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.285+0000 7f1dbca89700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.285+0000 7f1da67fc700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d98039bf0 0x7f1d9803c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:37.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.285+0000 7f1da67fc700 1 -- 172.21.15.88:0/1818812741 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f1db40498e0 con 0x7f1db80a5de0 2020-02-11T16:09:37.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.285+0000 7f1dbd28a700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d98039bf0 0x7f1d9803c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:37.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.286+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1818812741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db809f1e0 con 0x7f1db80a5de0 2020-02-11T16:09:37.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.286+0000 7f1dbd28a700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d98039bf0 0x7f1d9803c0b0 crc :-1 s=READY pgs=183 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:37.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.289+0000 7f1dbca89700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.289+0000 7f1da67fc700 1 -- 172.21.15.88:0/1818812741 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f1db402eee0 con 0x7f1db80a5de0 2020-02-11T16:09:37.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.471+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1818812741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1db809fa80 con 0x7f1db80a5de0 2020-02-11T16:09:37.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.471+0000 7f1dbca89700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:37.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.471+0000 7f1da67fc700 1 -- 172.21.15.88:0/1818812741 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f1db40319d0 con 0x7f1db80a5de0 2020-02-11T16:09:37.473 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:37.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.472+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1818812741 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d98039bf0 msgr2=0x7f1d9803c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:37.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.472+0000 7f1dbf4ee700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d98039bf0 0x7f1d9803c0b0 crc :-1 s=READY pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:37.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.472+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 msgr2=0x7f1db809ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:37.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.472+0000 7f1dbf4ee700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 0x7f1db809ed80 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f1db4000b20 tx=0x7f1db4010a40).stop 2020-02-11T16:09:37.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.472+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1818812741 shutdown_connections 2020-02-11T16:09:37.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.472+0000 7f1dbf4ee700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d98039bf0 0x7f1d9803c0b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:37.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.472+0000 7f1dbf4ee700 1 --2- 172.21.15.88:0/1818812741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1db80a5de0 0x7f1db809ed80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:37.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.472+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1818812741 >> 172.21.15.88:0/1818812741 conn(0x7f1db809d110 msgr2=0x7f1db80a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:37.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.472+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1818812741 shutdown_connections 2020-02-11T16:09:37.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:37.473+0000 7f1dbf4ee700 1 -- 172.21.15.88:0/1818812741 wait complete. 2020-02-11T16:09:37.484 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":44,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:40.484 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:09:40.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.606+0000 7f795a1c3700 1 Processor -- start 2020-02-11T16:09:40.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.606+0000 7f795a1c3700 1 -- start start 2020-02-11T16:09:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f795a1c3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79540a18a0 0x7f79540a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f795a1c3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79540a5de0 0x7f79540a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f795a1c3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795412e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f795a1c3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79540a3570 con 0x7f79540a18a0 2020-02-11T16:09:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f795a1c3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79540a3810 con 0x7f79540a5de0 2020-02-11T16:09:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f795a1c3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540a3ab0 con 0x7f795412e3a0 2020-02-11T16:09:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79540a5de0 0x7f79540a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:40.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7953fff700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f795412e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:40.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7953fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:40.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79540a5de0 0x7f79540a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53922/0 (socket says 172.21.15.88:53922) 2020-02-11T16:09:40.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 -- 172.21.15.88:0/3116573365 learned_addr learned my addr 172.21.15.88:0/3116573365 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:40.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f79537fe700 1 --2- 172.21.15.88:0/3116573365 >> v2:172.21.15.52:3300/0 conn(0x7f79540a18a0 0x7f79540a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 -- 172.21.15.88:0/3116573365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f795412e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 --2- 172.21.15.88:0/3116573365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 -- 172.21.15.88:0/3116573365 >> v2:172.21.15.52:3300/0 conn(0x7f79540a18a0 msgr2=0x7f79540a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 --2- 172.21.15.88:0/3116573365 >> v2:172.21.15.52:3300/0 conn(0x7f79540a18a0 0x7f79540a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 -- 172.21.15.88:0/3116573365 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79540a3d50 con 0x7f79540a5de0 2020-02-11T16:09:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 --2- 172.21.15.88:0/3116573365 >> v2:172.21.15.88:3300/0 conn(0x7f79540a5de0 0x7f79540a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7948002f30 tx=0x7f7948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 --2- 172.21.15.88:0/3116573365 >> v2:172.21.15.88:3300/0 conn(0x7f79540a5de0 0x7f79540a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7948002f30 tx=0x7f7948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 --2- 172.21.15.88:0/3116573365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540a5de0 0x7f79540a6260 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f7948002f30 tx=0x7f7948007a40).ready entity=mon.1 client_cookie=511fa23523275c21 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 --2- 172.21.15.88:0/3116573365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540a5de0 0x7f79540a6260 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f7948002f30 tx=0x7f7948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 --2- 172.21.15.88:0/3116573365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540a5de0 0x7f79540a6260 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f7948002f30 tx=0x7f7948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f7952ffd700 1 --2- 172.21.15.88:0/3116573365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540a5de0 0x7f79540a6260 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f7948002f30 tx=0x7f7948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f79527fc700 1 -- 172.21.15.88:0/3116573365 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7948008e20 con 0x7f79540a5de0 2020-02-11T16:09:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f79527fc700 1 -- 172.21.15.88:0/3116573365 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948011910 con 0x7f79540a5de0 2020-02-11T16:09:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f79527fc700 1 -- 172.21.15.88:0/3116573365 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7948011cf0 con 0x7f79540a5de0 2020-02-11T16:09:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f795a1c3700 1 -- 172.21.15.88:0/3116573365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540a5de0 msgr2=0x7f79540a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.607+0000 7f795a1c3700 1 --2- 172.21.15.88:0/3116573365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540a5de0 0x7f79540a6260 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f7948002f30 tx=0x7f7948007a40).stop 2020-02-11T16:09:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.608+0000 7f795a1c3700 1 -- 172.21.15.88:0/3116573365 shutdown_connections 2020-02-11T16:09:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.608+0000 7f795a1c3700 1 --2- 172.21.15.88:0/3116573365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795412e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.608+0000 7f795a1c3700 1 --2- 172.21.15.88:0/3116573365 >> v2:172.21.15.52:3300/0 conn(0x7f79540a18a0 0x7f79540a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.608+0000 7f795a1c3700 1 --2- 172.21.15.88:0/3116573365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540a5de0 0x7f79540a6260 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.608+0000 7f795a1c3700 1 -- 172.21.15.88:0/3116573365 >> 172.21.15.88:0/3116573365 conn(0x7f795409d110 msgr2=0x7f795409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.608+0000 7f795a1c3700 1 -- 172.21.15.88:0/3116573365 shutdown_connections 2020-02-11T16:09:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.608+0000 7f795a1c3700 1 -- 172.21.15.88:0/3116573365 wait complete. 2020-02-11T16:09:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.609+0000 7f795a1c3700 1 Processor -- start 2020-02-11T16:09:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.609+0000 7f795a1c3700 1 -- start start 2020-02-11T16:09:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.610+0000 7f795a1c3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795414c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.610+0000 7f795a1c3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795412d400 con 0x7f79540a5de0 2020-02-11T16:09:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.610+0000 7f795a1c3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795412ccc0 con 0x7f79540a18a0 2020-02-11T16:09:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.610+0000 7f795a1c3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795412cf60 con 0x7f795412e3a0 2020-02-11T16:09:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.610+0000 7f79537fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f79540a18a0 0x7f7954131810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41552/0 (socket says 172.21.15.88:41552) 2020-02-11T16:09:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.610+0000 7f79537fe700 1 -- 172.21.15.88:0/2301355065 learned_addr learned my addr 172.21.15.88:0/2301355065 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.610+0000 7f7953fff700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f795414c750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.610+0000 7f7953fff700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795414c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:40.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.811+0000 7f7953fff700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f795414c750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:40.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:40.811+0000 7f7953fff700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795414c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:09:41.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:41.212+0000 7f7953fff700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f795414c750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:41.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:41.212+0000 7f7953fff700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795414c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:09:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:42.013+0000 7f7953fff700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f795414c750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:42.013+0000 7f7953fff700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795414c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:09:42.140 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:09:42.142 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:09:43.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:43.615+0000 7f7953fff700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f795414c750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:43.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:43.615+0000 7f7953fff700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795414c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:09:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:46.818+0000 7f7953fff700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f795414c750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:46.818+0000 7f7953fff700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795414c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:09:48.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.654+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185820175 0 0) 0x7f795412d400 con 0x7f79540a5de0 2020-02-11T16:09:48.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.654+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7934002fe0 con 0x7f79540a5de0 2020-02-11T16:09:48.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.654+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715701435 0 0) 0x7f795412ccc0 con 0x7f79540a18a0 2020-02-11T16:09:48.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.654+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f795412d400 con 0x7f79540a18a0 2020-02-11T16:09:48.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2046589384 0 0) 0x7f7934002fe0 con 0x7f79540a5de0 2020-02-11T16:09:48.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f795412ccc0 con 0x7f79540a5de0 2020-02-11T16:09:48.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f7948008e20 con 0x7f79540a5de0 2020-02-11T16:09:48.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f795414c750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:48.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f795414c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 >> v1:172.21.15.88:6789/0 conn(0x7f79540a18a0 legacy=0x7f7954131810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 >> v1:172.21.15.52:6789/0 conn(0x7f79540a5de0 legacy=0x7f7954134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7934003ab0 0x7f7934003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f7934004350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795412cf60 con 0x7f7934003ab0 2020-02-11T16:09:48.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79340047b0 con 0x7f7934004b20 2020-02-11T16:09:48.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7934004970 con 0x7f795412e3a0 2020-02-11T16:09:48.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:48.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7953fff700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f7934004350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:48.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f7953fff700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f7934004350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:48.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f79537fe700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 msgr2=0x7f7934004350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:48.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f795412e3a0 0x7f7934004350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f79537fe700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7934003ab0 msgr2=0x7f7934003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7934003ab0 0x7f7934003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.655+0000 7f79537fe700 1 -- 172.21.15.88:0/2301355065 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954135520 con 0x7f7934004b20 2020-02-11T16:09:48.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f795a1c3700 1 -- 172.21.15.88:0/2301355065 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7954132000 con 0x7f7934004b20 2020-02-11T16:09:48.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f795a1c3700 1 -- 172.21.15.88:0/2301355065 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795412f770 con 0x7f7934004b20 2020-02-11T16:09:48.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:48.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7944005aa0 con 0x7f7934004b20 2020-02-11T16:09:48.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7944005c00 con 0x7f7934004b20 2020-02-11T16:09:48.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7944012600 con 0x7f7934004b20 2020-02-11T16:09:48.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.656+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.657+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7944012760 con 0x7f7934004b20 2020-02-11T16:09:48.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.657+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.657+0000 7f795a1c3700 1 -- 172.21.15.88:0/2301355065 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7930003340 con 0x7f7934004b20 2020-02-11T16:09:48.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.657+0000 7f7950ff9700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7934044300 0x7f79340467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.657+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7944049850 con 0x7f7934004b20 2020-02-11T16:09:48.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.657+0000 7f7952ffd700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7934044300 0x7f79340467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:48.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.657+0000 7f7952ffd700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7934044300 0x7f79340467c0 crc :-1 s=READY pgs=184 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:48.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.661+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.661+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f794402ed40 con 0x7f7934004b20 2020-02-11T16:09:48.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.846+0000 7f795a1c3700 1 -- 172.21.15.88:0/2301355065 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f79300036e0 con 0x7f7934004b20 2020-02-11T16:09:48.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.846+0000 7f79537fe700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.846+0000 7f7950ff9700 1 -- 172.21.15.88:0/2301355065 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7f7944031a00 con 0x7f7934004b20 2020-02-11T16:09:48.848 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":48,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.847+0000 7f795a1c3700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7934044300 msgr2=0x7f79340467c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.847+0000 7f795a1c3700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7934044300 0x7f79340467c0 crc :-1 s=READY pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.847+0000 7f795a1c3700 1 -- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 msgr2=0x7f7934004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.847+0000 7f795a1c3700 1 --2- 172.21.15.88:0/2301355065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7934004b20 0x7f7934004f40 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f7944001fc0 tx=0x7f7944010be0).stop 2020-02-11T16:09:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.847+0000 7f7953fff700 1 -- 172.21.15.88:0/2301355065 reap_dead start 2020-02-11T16:09:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.847+0000 7f7953fff700 1 -- 172.21.15.88:0/2301355065 reap_dead start 2020-02-11T16:09:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.847+0000 7f795a1c3700 1 -- 172.21.15.88:0/2301355065 shutdown_connections 2020-02-11T16:09:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.847+0000 7f795a1c3700 1 -- 172.21.15.88:0/2301355065 >> 172.21.15.88:0/2301355065 conn(0x7f795409d110 msgr2=0x7f79540a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.848+0000 7f795a1c3700 1 -- 172.21.15.88:0/2301355065 shutdown_connections 2020-02-11T16:09:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.848+0000 7f795a1c3700 1 -- 172.21.15.88:0/2301355065 wait complete. 2020-02-11T16:09:48.859 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":48,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:09:48.860 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:09:48.860 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:09:48.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.964+0000 7f6bfca14700 1 Processor -- start 2020-02-11T16:09:48.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.964+0000 7f6bfca14700 1 -- start start 2020-02-11T16:09:48.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bfca14700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6bf80a7120 0x7f6bf80a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:48.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bfca14700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 0x7f6bf812ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bfca14700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf80a5320 con 0x7f6bf80a39e0 2020-02-11T16:09:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bfca14700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf8130400 con 0x7f6bf80a7120 2020-02-11T16:09:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bfca14700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf809e7a0 con 0x7f6bf80a3e70 2020-02-11T16:09:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6bf80a7120 0x7f6bf80a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6bf80a7120 0x7f6bf80a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53958/0 (socket says 172.21.15.88:53958) 2020-02-11T16:09:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf659c700 1 -- 172.21.15.88:0/1147084429 learned_addr learned my addr 172.21.15.88:0/1147084429 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf6d9d700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 msgr2=0x7f6bf812ffa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:48.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf6d9d700 1 --2- 172.21.15.88:0/1147084429 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 0x7f6bf812ffa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:48.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf659c700 1 -- 172.21.15.88:0/1147084429 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 msgr2=0x7f6bf812ffa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:48.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf659c700 1 --2- 172.21.15.88:0/1147084429 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 0x7f6bf812ffa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:48.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf659c700 1 -- 172.21.15.88:0/1147084429 >> v1:172.21.15.52:6789/0 conn(0x7f6bf80a39e0 legacy=0x7f6bf812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf659c700 1 -- 172.21.15.88:0/1147084429 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf80a5560 con 0x7f6bf80a7120 2020-02-11T16:09:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf659c700 1 --2- 172.21.15.88:0/1147084429 >> v2:172.21.15.88:3300/0 conn(0x7f6bf80a7120 0x7f6bf80a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6bf805ee60 tx=0x7f6bec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf659c700 1 --2- 172.21.15.88:0/1147084429 >> v2:172.21.15.88:3300/0 conn(0x7f6bf80a7120 0x7f6bf80a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6bf805ee60 tx=0x7f6bec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.965+0000 7f6bf659c700 1 --2- 172.21.15.88:0/1147084429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf80a7120 0x7f6bf80a4ec0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f6bf805ee60 tx=0x7f6bec0088e0).ready entity=mon.1 client_cookie=615610af2d6c0bac server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:48.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bf659c700 1 --2- 172.21.15.88:0/1147084429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf80a7120 0x7f6bf80a4ec0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f6bf805ee60 tx=0x7f6bec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bf659c700 1 --2- 172.21.15.88:0/1147084429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf80a7120 0x7f6bf80a4ec0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f6bf805ee60 tx=0x7f6bec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bf559a700 1 -- 172.21.15.88:0/1147084429 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bec008e20 con 0x7f6bf80a7120 2020-02-11T16:09:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bf659c700 1 --2- 172.21.15.88:0/1147084429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf80a7120 0x7f6bf80a4ec0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f6bf805ee60 tx=0x7f6bec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bf559a700 1 -- 172.21.15.88:0/1147084429 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec011910 con 0x7f6bf80a7120 2020-02-11T16:09:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bf559a700 1 -- 172.21.15.88:0/1147084429 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bec011cb0 con 0x7f6bf80a7120 2020-02-11T16:09:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bfca14700 1 -- 172.21.15.88:0/1147084429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf80a7120 msgr2=0x7f6bf80a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bfca14700 1 --2- 172.21.15.88:0/1147084429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf80a7120 0x7f6bf80a4ec0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f6bf805ee60 tx=0x7f6bec0088e0).stop 2020-02-11T16:09:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bfca14700 1 -- 172.21.15.88:0/1147084429 shutdown_connections 2020-02-11T16:09:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bfca14700 1 --2- 172.21.15.88:0/1147084429 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 0x7f6bf812ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bfca14700 1 --2- 172.21.15.88:0/1147084429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf80a7120 0x7f6bf80a4ec0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bfca14700 1 -- 172.21.15.88:0/1147084429 >> 172.21.15.88:0/1147084429 conn(0x7f6bf809d110 msgr2=0x7f6bf809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bfca14700 1 -- 172.21.15.88:0/1147084429 shutdown_connections 2020-02-11T16:09:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.966+0000 7f6bfca14700 1 -- 172.21.15.88:0/1147084429 wait complete. 2020-02-11T16:09:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.967+0000 7f6bfca14700 1 Processor -- start 2020-02-11T16:09:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.967+0000 7f6bfca14700 1 -- start start 2020-02-11T16:09:48.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bfca14700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 0x7f6bf8135980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bfca14700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf8133cf0 con 0x7f6bf80a7120 2020-02-11T16:09:48.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bfca14700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf81354e0 con 0x7f6bf80a39e0 2020-02-11T16:09:48.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bfca14700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8134f70 con 0x7f6bf80a3e70 2020-02-11T16:09:48.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bf659c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6bf80a39e0 0x7f6bf8144440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41590/0 (socket says 172.21.15.88:41590) 2020-02-11T16:09:48.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bf659c700 1 -- 172.21.15.88:0/2106630365 learned_addr learned my addr 172.21.15.88:0/2106630365 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bf5d9b700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 msgr2=0x7f6bf8135980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 0x7f6bf8135980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089790927 0 0) 0x7f6bf81354e0 con 0x7f6bf80a39e0 2020-02-11T16:09:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd4002fe0 con 0x7f6bf80a39e0 2020-02-11T16:09:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 836625876 0 0) 0x7f6bd4002fe0 con 0x7f6bf80a39e0 2020-02-11T16:09:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6bf81354e0 con 0x7f6bf80a39e0 2020-02-11T16:09:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f6bec008e20 con 0x7f6bf80a39e0 2020-02-11T16:09:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 msgr2=0x7f6bf8135980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 0x7f6bf8135980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 >> v1:172.21.15.88:6789/0 conn(0x7f6bf80a39e0 legacy=0x7f6bf8144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 >> v1:172.21.15.52:6789/0 conn(0x7f6bf80a7120 legacy=0x7f6bf81274a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 0x7f6bd4003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bd4003d80 0x7f6bd4004230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40047b0 con 0x7f6bd4003d80 2020-02-11T16:09:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4005350 con 0x7f6bd40049b0 2020-02-11T16:09:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4005510 con 0x7f6bf80a3e70 2020-02-11T16:09:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bf5d9b700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 msgr2=0x7f6bd4003920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 0x7f6bd4003920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.968+0000 7f6bf6d9d700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bd4003d80 0x7f6bd4004230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 msgr2=0x7f6bd4003920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6bf80a3e70 0x7f6bd4003920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bd4003d80 msgr2=0x7f6bd4004230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bd4003d80 0x7f6bd4004230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 -- 172.21.15.88:0/2106630365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf81337b0 con 0x7f6bd40049b0 2020-02-11T16:09:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bfca14700 1 -- 172.21.15.88:0/2106630365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf8133a20 con 0x7f6bd40049b0 2020-02-11T16:09:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6bd40048f0 tx=0x7f6bf80a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bfca14700 1 -- 172.21.15.88:0/2106630365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf812a460 con 0x7f6bd40049b0 2020-02-11T16:09:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6bd40048f0 tx=0x7f6bf80a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f6bd40048f0 tx=0x7f6bf80a11a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:48.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f6bd40048f0 tx=0x7f6bf80a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bec007530 con 0x7f6bd40049b0 2020-02-11T16:09:48.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f6bd40048f0 tx=0x7f6bf80a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec00a930 con 0x7f6bd40049b0 2020-02-11T16:09:48.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f6bd40048f0 tx=0x7f6bf80a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bec00ac90 con 0x7f6bd40049b0 2020-02-11T16:09:48.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.969+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f6bd40048f0 tx=0x7f6bf80a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bfca14700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 0x7f6bf805ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bfca14700 1 -- 172.21.15.88:0/2106630365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf805e2f0 con 0x7f6bf8135d00 2020-02-11T16:09:48.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6bec0056c0 con 0x7f6bd40049b0 2020-02-11T16:09:48.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 0x7f6bf805ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:48.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf659c700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f6bd40048f0 tx=0x7f6bf80a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6be77fe700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6bd40420c0 0x7f6bd4044580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6bec04a7a0 con 0x7f6bd40049b0 2020-02-11T16:09:48.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf5d9b700 1 -- 172.21.15.88:0/2106630365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6bf81352f0 con 0x7f6bf8135d00 2020-02-11T16:09:48.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 0x7f6bf805ae60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 0x7f6bf805ae60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 0x7f6bf805ae60 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:48.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf6d9d700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6bd40420c0 0x7f6bd4044580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:48.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 0x7f6bf805ae60 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be800ca30 con 0x7f6bf8135d00 2020-02-11T16:09:48.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf6d9d700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6bd40420c0 0x7f6bd4044580 crc :-1 s=READY pgs=185 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:48.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 0x7f6bf805ae60 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6be800cb90 con 0x7f6bf8135d00 2020-02-11T16:09:48.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 msgr2=0x7f6bf805ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6be77fe700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 0x7f6bf805ae60 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).stop 2020-02-11T16:09:48.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 msgr2=0x7f6bf805ae60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:48.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6bf6d9d700 1 -- 172.21.15.88:0/2106630365 reap_dead start 2020-02-11T16:09:48.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.970+0000 7f6be77fe700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8135d00 0x7f6bf805ae60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.978+0000 7f6bfca14700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 0x7f6bf81274a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.978+0000 7f6bfca14700 1 -- 172.21.15.88:0/2106630365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf80a5320 con 0x7f6bf8144440 2020-02-11T16:09:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 0x7f6bf81274a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6bf5d9b700 1 -- 172.21.15.88:0/2106630365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6bf80565b0 con 0x7f6bf8144440 2020-02-11T16:09:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 0x7f6bf81274a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 0x7f6bf81274a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 0x7f6bf81274a0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 0x7f6bf81274a0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be8015440 con 0x7f6bf8144440 2020-02-11T16:09:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6bf5d9b700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 0x7f6bf81274a0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4348 (secure 0 0 0) 0x7f6be80155a0 con 0x7f6bf8144440 2020-02-11T16:09:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 msgr2=0x7f6bf81274a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6be77fe700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 0x7f6bf81274a0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).stop 2020-02-11T16:09:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6be77fe700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 msgr2=0x7f6bf81274a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.979+0000 7f6be77fe700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 0x7f6bf81274a0 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0x7f6be8002270 tx=0x7f6be800c490).stop 2020-02-11T16:09:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6bd40420c0 msgr2=0x7f6bd4044580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6bd40420c0 0x7f6bd4044580 crc :-1 s=READY pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 -- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 msgr2=0x7f6bd4004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f6bd40048f0 tx=0x7f6bf80a11a0).stop 2020-02-11T16:09:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 -- 172.21.15.88:0/2106630365 shutdown_connections 2020-02-11T16:09:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6bd40420c0 0x7f6bd4044580 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd40049b0 0x7f6bd4004db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 --2- 172.21.15.88:0/2106630365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bf8144440 0x7f6bf81274a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 -- 172.21.15.88:0/2106630365 >> 172.21.15.88:0/2106630365 conn(0x7f6bf809d110 msgr2=0x7f6bf8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 -- 172.21.15.88:0/2106630365 shutdown_connections 2020-02-11T16:09:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:48.980+0000 7f6bfca14700 1 -- 172.21.15.88:0/2106630365 wait complete. 2020-02-11T16:09:48.998 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:09:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:09:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 48, 2020-02-11T16:09:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:09:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:09:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:09:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:09:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:09:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:09:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:09:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:09:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:09:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:09:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:09:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:09:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:09:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:09:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:09:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:09:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:09:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:09:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:09:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:09:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:09:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:09:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:09:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:09:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:09:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:09:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:09:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:09:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:09:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:09:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:09:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:09:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:09:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:09:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:09:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:09:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:09:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:09:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:09:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:09:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:09:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:09:49.024 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.024 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.024 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.024 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:09:49.024 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:09:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.130+0000 7f0781806700 1 Processor -- start 2020-02-11T16:09:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.130+0000 7f0781806700 1 -- start start 2020-02-11T16:09:49.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f0781806700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c0a73d0 0x7f077c0a2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:49.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f0781806700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0a2cd0 con 0x7f077c0a6ff0 2020-02-11T16:09:49.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f0781806700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0a30c0 con 0x7f077c13b8f0 2020-02-11T16:09:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f0781806700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c132460 con 0x7f077c0a73d0 2020-02-11T16:09:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f0773fff700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c0a73d0 msgr2=0x7f077c0a2870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f0773fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c0a73d0 0x7f077c0a2870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f077c13b8f0 0x7f077c142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41612/0 (socket says 172.21.15.88:41612) 2020-02-11T16:09:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077b7fe700 1 -- 172.21.15.88:0/160633938 learned_addr learned my addr 172.21.15.88:0/160633938 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:09:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913618136 0 0) 0x7f077c0a30c0 con 0x7f077c13b8f0 2020-02-11T16:09:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f075c003230 con 0x7f077c13b8f0 2020-02-11T16:09:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2438066050 0 0) 0x7f075c003230 con 0x7f077c13b8f0 2020-02-11T16:09:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c0a73d0 msgr2=0x7f077c0a2870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c0a73d0 0x7f077c0a2870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 >> v1:172.21.15.52:6789/0 conn(0x7f077c0a6ff0 legacy=0x7f077c13b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0a2130 con 0x7f077c13b8f0 2020-02-11T16:09:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f0774001a90 con 0x7f077c13b8f0 2020-02-11T16:09:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 >> v1:172.21.15.88:6789/0 conn(0x7f077c13b8f0 legacy=0x7f077c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c0a73d0 0x7f075c003770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f075c003bf0 0x7f075c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f075c004930 0x7f075c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:09:49.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c004130 con 0x7f075c004930 2020-02-11T16:09:49.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0042a0 con 0x7f075c003bf0 2020-02-11T16:09:49.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c00b720 con 0x7f077c0a73d0 2020-02-11T16:09:49.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077affd700 1 -- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c0a73d0 msgr2=0x7f075c003770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:49.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f077affd700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c0a73d0 0x7f075c003770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:49.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.131+0000 7f0773fff700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f075c003bf0 0x7f075c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:49.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f077b7fe700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f075c004930 0x7f075c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:49.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 -- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c0a73d0 msgr2=0x7f075c003770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:09:49.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c0a73d0 0x7f075c003770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:49.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 -- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f075c004930 msgr2=0x7f075c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:09:49.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f075c004930 0x7f075c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:09:49.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 -- 172.21.15.88:0/160633938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c003230 con 0x7f075c003bf0 2020-02-11T16:09:49.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f075c003bf0 0x7f075c0044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f075c003bf0 0x7f075c0044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f075c003bf0 0x7f075c0044d0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).ready entity=mon.1 client_cookie=ed4a60cfa70df004 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:49.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f075c003bf0 0x7f075c0044d0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f075c003bf0 0x7f075c0044d0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0764003e10 con 0x7f075c003bf0 2020-02-11T16:09:49.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0773fff700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f075c003bf0 0x7f075c0044d0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0764008940 con 0x7f075c003bf0 2020-02-11T16:09:49.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f077a7fc700 1 -- 172.21.15.88:0/160633938 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0764008d20 con 0x7f075c003bf0 2020-02-11T16:09:49.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0781806700 1 -- 172.21.15.88:0/160633938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f075c003bf0 msgr2=0x7f075c0044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:49.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0781806700 1 --2- 172.21.15.88:0/160633938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f075c003bf0 0x7f075c0044d0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).stop 2020-02-11T16:09:49.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f077b7fe700 1 -- 172.21.15.88:0/160633938 reap_dead start 2020-02-11T16:09:49.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0781806700 1 -- 172.21.15.88:0/160633938 shutdown_connections 2020-02-11T16:09:49.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0781806700 1 -- 172.21.15.88:0/160633938 >> 172.21.15.88:0/160633938 conn(0x7f077c0ac2d0 msgr2=0x7f077c0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:49.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0781806700 1 -- 172.21.15.88:0/160633938 shutdown_connections 2020-02-11T16:09:49.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.132+0000 7f0781806700 1 -- 172.21.15.88:0/160633938 wait complete. 2020-02-11T16:09:49.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.133+0000 7f0781806700 1 Processor -- start 2020-02-11T16:09:49.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.133+0000 7f0781806700 1 -- start start 2020-02-11T16:09:49.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0781806700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c1365d0 0x7f077c132920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:49.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0781806700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f077c145390 0x7f077c1488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:49.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0781806700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c133570 con 0x7f077c145810 2020-02-11T16:09:49.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0781806700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c1337a0 con 0x7f077c145390 2020-02-11T16:09:49.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0781806700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c133a40 con 0x7f077c1365d0 2020-02-11T16:09:49.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f077affd700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c1365d0 msgr2=0x7f077c132920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:09:49.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f077affd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c1365d0 0x7f077c132920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:09:49.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f077c145390 0x7f077c1488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:49.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f077c145390 0x7f077c1488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53996/0 (socket says 172.21.15.88:53996) 2020-02-11T16:09:49.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 -- 172.21.15.88:0/4175384807 learned_addr learned my addr 172.21.15.88:0/4175384807 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:09:49.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 -- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c1365d0 msgr2=0x7f077c132920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:09:49.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f077c1365d0 0x7f077c132920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:49.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 -- 172.21.15.88:0/4175384807 >> v1:172.21.15.52:6789/0 conn(0x7f077c145810 legacy=0x7f077c148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:49.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 -- 172.21.15.88:0/4175384807 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0a6970 con 0x7f077c145390 2020-02-11T16:09:49.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 --2- 172.21.15.88:0/4175384807 >> v2:172.21.15.88:3300/0 conn(0x7f077c145390 0x7f077c1488e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 --2- 172.21.15.88:0/4175384807 >> v2:172.21.15.88:3300/0 conn(0x7f077c145390 0x7f077c1488e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f077c145390 0x7f077c1488e0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:49.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f077c145390 0x7f077c1488e0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0764007160 con 0x7f077c145390 2020-02-11T16:09:49.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.134+0000 7f0773fff700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f077c145390 0x7f077c1488e0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0773fff700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f077c145390 0x7f077c1488e0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07640072c0 con 0x7f077c145390 2020-02-11T16:09:49.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0781806700 1 -- 172.21.15.88:0/4175384807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c0a1520 con 0x7f077c145390 2020-02-11T16:09:49.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07640059a0 con 0x7f077c145390 2020-02-11T16:09:49.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0781806700 1 -- 172.21.15.88:0/4175384807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c133ee0 con 0x7f077c145390 2020-02-11T16:09:49.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0773fff700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f077c145390 0x7f077c1488e0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0764005c10 con 0x7f077c145390 2020-02-11T16:09:49.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0781806700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 0x7f077c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:49.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0781806700 1 -- 172.21.15.88:0/4175384807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c05e2f0 con 0x7f077c0aa0e0 2020-02-11T16:09:49.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0773fff700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f077c145390 0x7f077c1488e0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 0x7f077c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:49.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.135+0000 7f0778ff9700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0760039c20 0x7f076003c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:49.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f0764049f90 con 0x7f077c145390 2020-02-11T16:09:49.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f077b7fe700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0760039c20 0x7f076003c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:49.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f077affd700 1 -- 172.21.15.88:0/4175384807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f077c0565b0 con 0x7f077c0aa0e0 2020-02-11T16:09:49.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 0x7f077c138d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f077b7fe700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0760039c20 0x7f076003c0e0 crc :-1 s=READY pgs=186 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:49.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 0x7f077c138d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 0x7f077c138d40 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c001e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:49.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 0x7f077c138d40 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f076c00ca30 con 0x7f077c0aa0e0 2020-02-11T16:09:49.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 0x7f077c138d40 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f076c00cb90 con 0x7f077c0aa0e0 2020-02-11T16:09:49.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 msgr2=0x7f077c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:49.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f0778ff9700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 0x7f077c138d40 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c001e30).stop 2020-02-11T16:09:49.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 msgr2=0x7f077c138d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:49.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.136+0000 7f0778ff9700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c0aa0e0 0x7f077c138d40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:49.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.145+0000 7f0781806700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 0x7f077c1395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:09:49.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.145+0000 7f0781806700 1 -- 172.21.15.88:0/4175384807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c05ccb0 con 0x7f077c1391a0 2020-02-11T16:09:49.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.145+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 0x7f077c1395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:09:49.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.145+0000 7f077affd700 1 -- 172.21.15.88:0/4175384807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f077c133bb0 con 0x7f077c1391a0 2020-02-11T16:09:49.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.145+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 0x7f077c1395b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c0012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.145+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 0x7f077c1395b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c0012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.145+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 0x7f077c1395b0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c0012e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:09:49.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 0x7f077c1395b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c0012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f076c00d4c0 con 0x7f077c1391a0 2020-02-11T16:09:49.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f077affd700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 0x7f077c1395b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c0012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:09:49.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4180 (secure 0 0 0) 0x7f076c00d620 con 0x7f077c1391a0 2020-02-11T16:09:49.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 msgr2=0x7f077c1395b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:49.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0778ff9700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 0x7f077c1395b0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c0012e0).stop 2020-02-11T16:09:49.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0778ff9700 1 -- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 msgr2=0x7f077c1395b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:09:49.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0778ff9700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f077c1391a0 0x7f077c1395b0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0x7f076c000e90 tx=0x7f076c0012e0).stop 2020-02-11T16:09:49.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0781806700 1 -- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0760039c20 msgr2=0x7f076003c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:49.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0781806700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0760039c20 0x7f076003c0e0 crc :-1 s=READY pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:49.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0781806700 1 -- 172.21.15.88:0/4175384807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f077c145390 msgr2=0x7f077c1488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:09:49.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0781806700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f077c145390 0x7f077c1488e0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f0764005750 tx=0x7f0764007a60).stop 2020-02-11T16:09:49.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f077b7fe700 1 -- 172.21.15.88:0/4175384807 reap_dead start 2020-02-11T16:09:49.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0781806700 1 -- 172.21.15.88:0/4175384807 shutdown_connections 2020-02-11T16:09:49.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0781806700 1 --2- 172.21.15.88:0/4175384807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f077c145390 0x7f077c1488e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:09:49.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0781806700 1 -- 172.21.15.88:0/4175384807 >> 172.21.15.88:0/4175384807 conn(0x7f077c0ac2d0 msgr2=0x7f077c05f000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:09:49.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0781806700 1 -- 172.21.15.88:0/4175384807 shutdown_connections 2020-02-11T16:09:49.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:09:49.146+0000 7f0781806700 1 -- 172.21.15.88:0/4175384807 wait complete. 2020-02-11T16:09:49.163 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:09:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:09:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 48, 2020-02-11T16:09:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:09:49.163 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:09:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:09:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:09:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:09:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:09:49.164 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:49.165 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:09:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:09:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.167 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:09:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:09:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:09:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:09:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:09:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:09:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:49.168 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:09:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:09:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:09:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:09:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:09:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:09:49.169 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:09:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:09:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:09:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:09:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:09:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:09:49.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:09:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:09:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:09:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:49.171 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:09:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.172 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:09:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:09:49.173 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:09:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:09:49.174 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:09:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:09:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:09:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:09:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:09:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.177 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:09:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:09:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:09:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:09:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:09:49.178 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:09:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:09:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:09:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:09:49.179 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:09:49.180 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:09:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:09:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:09:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:09:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:09:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:09:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.182 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:09:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.183 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:09:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:09:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.184 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:09:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:09:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:09:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:09:49.185 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:09:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:09:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:09:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:09:49.186 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:09:49.186 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:09:49.187 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:10:09.187 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:10:09.187 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2020-02-11T16:10:09.188 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-11T16:10:09.188 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-11T16:10:09.191 INFO:tasks.ceph.mon.c:Started 2020-02-11T16:10:09.191 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:10:09.191 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:10:09.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.307+0000 7f51f9512700 1 Processor -- start 2020-02-11T16:10:09.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.307+0000 7f51f9512700 1 -- start start 2020-02-11T16:10:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f9512700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51f40a18a0 0x7f51f40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f9512700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f9512700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f40a3570 con 0x7f51f40a5de0 2020-02-11T16:10:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f9512700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f40a3810 con 0x7f51f40a18a0 2020-02-11T16:10:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f9512700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40a3ab0 con 0x7f51f40a6260 2020-02-11T16:10:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f27fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f51f40a5de0 0x7f51f412e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41642/0 (socket says 172.21.15.88:41642) 2020-02-11T16:10:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f27fc700 1 -- 172.21.15.88:0/878303395 learned_addr learned my addr 172.21.15.88:0/878303395 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/878303395 >> v2:172.21.15.52:3300/0 conn(0x7f51f40a18a0 0x7f51f40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f37fe700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f1ffb700 1 -- 172.21.15.88:0/878303395 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022614869 0 0) 0x7f51f40a3570 con 0x7f51f40a5de0 2020-02-11T16:10:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f1ffb700 1 -- 172.21.15.88:0/878303395 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d4003230 con 0x7f51f40a5de0 2020-02-11T16:10:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f37fe700 1 -- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 msgr2=0x7f51f412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:10:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f37fe700 1 -- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 msgr2=0x7f51f412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:10:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f37fe700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f412eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f37fe700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f412eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f1ffb700 1 -- 172.21.15.88:0/878303395 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3646204449 0 0) 0x7f51d4003230 con 0x7f51f40a5de0 2020-02-11T16:10:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f2ffd700 1 -- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 msgr2=0x7f51f412eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:10:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f412eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f2ffd700 1 -- 172.21.15.88:0/878303395 >> v1:172.21.15.88:6789/0 conn(0x7f51f40a5de0 legacy=0x7f51f412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f2ffd700 1 -- 172.21.15.88:0/878303395 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40a3d50 con 0x7f51f40a18a0 2020-02-11T16:10:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/878303395 >> v2:172.21.15.52:3300/0 conn(0x7f51f40a18a0 0x7f51f40a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51dc001870 tx=0x7f51ec008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/878303395 >> v2:172.21.15.52:3300/0 conn(0x7f51f40a18a0 0x7f51f40a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51dc001870 tx=0x7f51ec008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.308+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40a18a0 0x7f51f40a6dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f51dc001870 tx=0x7f51ec008c60).ready entity=mon.0 client_cookie=70bfa23ba76b1398 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:09.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40a18a0 0x7f51f40a6dd0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f51dc001870 tx=0x7f51ec008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f1ffb700 1 -- 172.21.15.88:0/878303395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51dc0016d0 con 0x7f51f40a18a0 2020-02-11T16:10:09.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40a18a0 0x7f51f40a6dd0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f51dc001870 tx=0x7f51ec008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f1ffb700 1 -- 172.21.15.88:0/878303395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec011b30 con 0x7f51f40a18a0 2020-02-11T16:10:09.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40a18a0 0x7f51f40a6dd0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f51dc001870 tx=0x7f51ec008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f1ffb700 1 -- 172.21.15.88:0/878303395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ec011e90 con 0x7f51f40a18a0 2020-02-11T16:10:09.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f9512700 1 -- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40a18a0 msgr2=0x7f51f40a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:09.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f9512700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40a18a0 0x7f51f40a6dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f51dc001870 tx=0x7f51ec008c60).stop 2020-02-11T16:10:09.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f9512700 1 -- 172.21.15.88:0/878303395 shutdown_connections 2020-02-11T16:10:09.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f9512700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f412eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:09.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f9512700 1 --2- 172.21.15.88:0/878303395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40a18a0 0x7f51f40a6dd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:09.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f9512700 1 -- 172.21.15.88:0/878303395 >> 172.21.15.88:0/878303395 conn(0x7f51f409d110 msgr2=0x7f51f409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:09.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f9512700 1 -- 172.21.15.88:0/878303395 shutdown_connections 2020-02-11T16:10:09.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.309+0000 7f51f9512700 1 -- 172.21.15.88:0/878303395 wait complete. 2020-02-11T16:10:09.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.310+0000 7f51f9512700 1 Processor -- start 2020-02-11T16:10:09.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.310+0000 7f51f9512700 1 -- start start 2020-02-11T16:10:09.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f9512700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f41367d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:09.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f9512700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f4065880 con 0x7f51f40a5de0 2020-02-11T16:10:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f9512700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f4065b20 con 0x7f51f40a18a0 2020-02-11T16:10:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f9512700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4065dc0 con 0x7f51f40a6260 2020-02-11T16:10:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f2ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f51f40a18a0 0x7f51f41483a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41644/0 (socket says 172.21.15.88:41644) 2020-02-11T16:10:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f2ffd700 1 -- 172.21.15.88:0/4091252538 learned_addr learned my addr 172.21.15.88:0/4091252538 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f41367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461857755 0 0) 0x7f51f4065b20 con 0x7f51f40a18a0 2020-02-11T16:10:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d8002fe0 con 0x7f51f40a18a0 2020-02-11T16:10:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f37fe700 1 -- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 msgr2=0x7f51f41367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:10:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f37fe700 1 -- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 msgr2=0x7f51f41367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:10:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f41367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f41367d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685833264 0 0) 0x7f51f4065880 con 0x7f51f40a5de0 2020-02-11T16:10:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f4065b20 con 0x7f51f40a5de0 2020-02-11T16:10:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3646924204 0 0) 0x7f51d8002fe0 con 0x7f51f40a18a0 2020-02-11T16:10:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f51f4065880 con 0x7f51f40a18a0 2020-02-11T16:10:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f51ec003290 con 0x7f51f40a18a0 2020-02-11T16:10:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 msgr2=0x7f51f41367d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:10:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51f41367d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 >> v1:172.21.15.88:6789/0 conn(0x7f51f40a18a0 legacy=0x7f51f41483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 >> v1:172.21.15.52:6789/0 conn(0x7f51f40a5de0 legacy=0x7f51f412e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8004b20 0x7f51d8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51d8003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4065dc0 con 0x7f51d8004b20 2020-02-11T16:10:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80047f0 con 0x7f51d8003f10 2020-02-11T16:10:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d800b750 con 0x7f51f40a6260 2020-02-11T16:10:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8004b20 0x7f51d8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.311+0000 7f51f27fc700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51d8003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:09.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f27fc700 1 -- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 msgr2=0x7f51d8003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:10:09.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f27fc700 1 -- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 msgr2=0x7f51d8003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:10:09.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f27fc700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51d8003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:09.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f27fc700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51d8003ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:09.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 -- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 msgr2=0x7f51d8003ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:10:09.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f40a6260 0x7f51d8003ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:09.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 -- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8004b20 msgr2=0x7f51d8004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:09.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8004b20 0x7f51d8004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:09.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 -- 172.21.15.88:0/4091252538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4066060 con 0x7f51d8003f10 2020-02-11T16:10:09.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f9512700 1 -- 172.21.15.88:0/4091252538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f4148ab0 con 0x7f51d8003f10 2020-02-11T16:10:09.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f9512700 1 -- 172.21.15.88:0/4091252538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f4065610 con 0x7f51d8003f10 2020-02-11T16:10:09.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:09.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e4012b60 con 0x7f51d8003f10 2020-02-11T16:10:09.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e4012cc0 con 0x7f51d8003f10 2020-02-11T16:10:09.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e4012e30 con 0x7f51d8003f10 2020-02-11T16:10:09.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.312+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.313+0000 7f51f9512700 1 -- 172.21.15.88:0/4091252538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc003340 con 0x7f51d8003f10 2020-02-11T16:10:09.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.313+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f51e40058b0 con 0x7f51d8003f10 2020-02-11T16:10:09.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.313+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.313+0000 7f51ebfff700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f51d8042110 0x7f51d80445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:09.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.313+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f51e4049e30 con 0x7f51d8003f10 2020-02-11T16:10:09.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.313+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f51d8042110 0x7f51d80445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:09.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.313+0000 7f51f2ffd700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f51d8042110 0x7f51d80445d0 crc :-1 s=READY pgs=188 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:09.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.316+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.316+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f51e404de60 con 0x7f51d8003f10 2020-02-11T16:10:09.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.499+0000 7f51f9512700 1 -- 172.21.15.88:0/4091252538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f51cc0036e0 con 0x7f51d8003f10 2020-02-11T16:10:09.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.499+0000 7f51f37fe700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:09.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.499+0000 7f51ebfff700 1 -- 172.21.15.88:0/4091252538 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f51e402f4b0 con 0x7f51d8003f10 2020-02-11T16:10:09.502 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":48,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:09.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.500+0000 7f51f9512700 1 -- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f51d8042110 msgr2=0x7f51d80445d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.500+0000 7f51f9512700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f51d8042110 0x7f51d80445d0 crc :-1 s=READY pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.500+0000 7f51f9512700 1 -- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 msgr2=0x7f51d8004390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.500+0000 7f51f9512700 1 --2- 172.21.15.88:0/4091252538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d8003f10 0x7f51d8004390 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f51d8005650 tx=0x7f51e4010da0).stop 2020-02-11T16:10:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.500+0000 7f51f37fe700 1 -- 172.21.15.88:0/4091252538 reap_dead start 2020-02-11T16:10:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.500+0000 7f51f37fe700 1 -- 172.21.15.88:0/4091252538 reap_dead start 2020-02-11T16:10:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.500+0000 7f51f9512700 1 -- 172.21.15.88:0/4091252538 shutdown_connections 2020-02-11T16:10:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.500+0000 7f51f9512700 1 -- 172.21.15.88:0/4091252538 >> 172.21.15.88:0/4091252538 conn(0x7f51f409d110 msgr2=0x7f51f40a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:09.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.500+0000 7f51f9512700 1 -- 172.21.15.88:0/4091252538 shutdown_connections 2020-02-11T16:10:09.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:09.500+0000 7f51f9512700 1 -- 172.21.15.88:0/4091252538 wait complete. 2020-02-11T16:10:09.513 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":48,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:12.212 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:10:12.215 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:10:12.514 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:10:12.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.627+0000 7fc893331700 1 Processor -- start 2020-02-11T16:10:12.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.627+0000 7fc893331700 1 -- start start 2020-02-11T16:10:12.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.628+0000 7fc893331700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 0x7fc88c0a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:12.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.628+0000 7fc893331700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88c0a2cf0 con 0x7fc88c0a2870 2020-02-11T16:10:12.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.628+0000 7fc893331700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88c0a30c0 con 0x7fc88c13b8f0 2020-02-11T16:10:12.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.628+0000 7fc893331700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c132460 con 0x7fc88c0a6ff0 2020-02-11T16:10:12.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.628+0000 7fc8918ce700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc88c13b8f0 0x7fc88c142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41662/0 (socket says 172.21.15.88:41662) 2020-02-11T16:10:12.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.628+0000 7fc8918ce700 1 -- 172.21.15.88:0/3016663813 learned_addr learned my addr 172.21.15.88:0/3016663813 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:12.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.628+0000 7fc8910cd700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 0x7fc88c0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:12.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448609843 0 0) 0x7fc88c0a30c0 con 0x7fc88c13b8f0 2020-02-11T16:10:12.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc874003230 con 0x7fc88c13b8f0 2020-02-11T16:10:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8910cd700 1 -- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 msgr2=0x7fc88c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:10:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8910cd700 1 -- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 msgr2=0x7fc88c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:10:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8910cd700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 0x7fc88c0a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8910cd700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 0x7fc88c0a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226985576 0 0) 0x7fc8880010d0 con 0x7fc88c0a2870 2020-02-11T16:10:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc88c0a30c0 con 0x7fc88c0a2870 2020-02-11T16:10:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3457277085 0 0) 0x7fc874003230 con 0x7fc88c13b8f0 2020-02-11T16:10:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 msgr2=0x7fc88c0a73d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:10:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 0x7fc88c0a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 >> v1:172.21.15.52:6789/0 conn(0x7fc88c0a2870 legacy=0x7fc88c13b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c0a2130 con 0x7fc88c13b8f0 2020-02-11T16:10:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fc884001a50 con 0x7fc88c13b8f0 2020-02-11T16:10:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 >> v1:172.21.15.88:6789/0 conn(0x7fc88c13b8f0 legacy=0x7fc88c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 0x7fc8740038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc874003d40 0x7fc8740044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc874004930 0x7fc874004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874005210 con 0x7fc874004930 2020-02-11T16:10:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874005380 con 0x7fc874003d40 2020-02-11T16:10:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87400b720 con 0x7fc88c0a6ff0 2020-02-11T16:10:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8908cc700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc874003d40 0x7fc8740044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:12.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8910cd700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 0x7fc8740038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:12.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8918ce700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc874004930 0x7fc874004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:12.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8908cc700 1 -- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 msgr2=0x7fc8740038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:12.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8908cc700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc88c0a6ff0 0x7fc8740038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:12.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8908cc700 1 -- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc874004930 msgr2=0x7fc874004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:12.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8908cc700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc874004930 0x7fc874004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:12.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8908cc700 1 -- 172.21.15.88:0/3016663813 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc874003230 con 0x7fc874003d40 2020-02-11T16:10:12.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8908cc700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc874003d40 0x7fc8740044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8908cc700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc874003d40 0x7fc8740044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.629+0000 7fc8908cc700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc874003d40 0x7fc8740044d0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).ready entity=mon.1 client_cookie=3f27bac69610969b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:12.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc8908cc700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc874003d40 0x7fc8740044d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc888010ce0 con 0x7fc874003d40 2020-02-11T16:10:12.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc8908cc700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc874003d40 0x7fc8740044d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc8908cc700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc874003d40 0x7fc8740044d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888010e80 con 0x7fc874003d40 2020-02-11T16:10:12.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc87ffff700 1 -- 172.21.15.88:0/3016663813 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc88800c730 con 0x7fc874003d40 2020-02-11T16:10:12.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc893331700 1 -- 172.21.15.88:0/3016663813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc874003d40 msgr2=0x7fc8740044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:12.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc893331700 1 --2- 172.21.15.88:0/3016663813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc874003d40 0x7fc8740044d0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).stop 2020-02-11T16:10:12.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc8918ce700 1 -- 172.21.15.88:0/3016663813 reap_dead start 2020-02-11T16:10:12.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc893331700 1 -- 172.21.15.88:0/3016663813 shutdown_connections 2020-02-11T16:10:12.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc893331700 1 -- 172.21.15.88:0/3016663813 >> 172.21.15.88:0/3016663813 conn(0x7fc88c0ac2d0 msgr2=0x7fc88c0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:12.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc893331700 1 -- 172.21.15.88:0/3016663813 shutdown_connections 2020-02-11T16:10:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.630+0000 7fc893331700 1 -- 172.21.15.88:0/3016663813 wait complete. 2020-02-11T16:10:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.631+0000 7fc893331700 1 Processor -- start 2020-02-11T16:10:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.631+0000 7fc893331700 1 -- start start 2020-02-11T16:10:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc893331700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc88c145000 0x7fc88c1454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc893331700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88c0a5520 con 0x7fc88c145910 2020-02-11T16:10:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc893331700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88c0a57c0 con 0x7fc88c0a38f0 2020-02-11T16:10:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc893331700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88c134350 con 0x7fc88c145000 2020-02-11T16:10:12.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc88c145000 0x7fc88c1454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:12.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc88c145000 0x7fc88c1454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54046/0 (socket says 172.21.15.88:54046) 2020-02-11T16:10:12.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 -- 172.21.15.88:0/186240971 learned_addr learned my addr 172.21.15.88:0/186240971 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:12.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 -- 172.21.15.88:0/186240971 >> v1:172.21.15.88:6789/0 conn(0x7fc88c0a38f0 legacy=0x7fc88c0a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:12.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 -- 172.21.15.88:0/186240971 >> v1:172.21.15.52:6789/0 conn(0x7fc88c145910 legacy=0x7fc88c14fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:12.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc87e7fc700 1 -- 172.21.15.88:0/186240971 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392647947 0 0) 0x7fc88c0a57c0 con 0x7fc88c0a38f0 2020-02-11T16:10:12.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 -- 172.21.15.88:0/186240971 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c1345f0 con 0x7fc88c145000 2020-02-11T16:10:12.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 --2- 172.21.15.88:0/186240971 >> v2:172.21.15.88:3300/0 conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 --2- 172.21.15.88:0/186240971 >> v2:172.21.15.88:3300/0 conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:12.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc87e7fc700 1 -- 172.21.15.88:0/186240971 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc88800cca0 con 0x7fc88c145000 2020-02-11T16:10:12.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc8908cc700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc87e7fc700 1 -- 172.21.15.88:0/186240971 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88800ce00 con 0x7fc88c145000 2020-02-11T16:10:12.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc893331700 1 -- 172.21.15.88:0/186240971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88c134a90 con 0x7fc88c145000 2020-02-11T16:10:12.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.632+0000 7fc87e7fc700 1 -- 172.21.15.88:0/186240971 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc88800e350 con 0x7fc88c145000 2020-02-11T16:10:12.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.633+0000 7fc893331700 1 -- 172.21.15.88:0/186240971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88c0a6130 con 0x7fc88c145000 2020-02-11T16:10:12.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.633+0000 7fc8908cc700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.633+0000 7fc87e7fc700 1 -- 172.21.15.88:0/186240971 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc88800e5c0 con 0x7fc88c145000 2020-02-11T16:10:12.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.633+0000 7fc8908cc700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.633+0000 7fc87e7fc700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc86c039b40 0x7fc86c03c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:12.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.633+0000 7fc87e7fc700 1 -- 172.21.15.88:0/186240971 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc888049950 con 0x7fc88c145000 2020-02-11T16:10:12.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.634+0000 7fc893331700 1 -- 172.21.15.88:0/186240971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88c0a2cf0 con 0x7fc88c145000 2020-02-11T16:10:12.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.634+0000 7fc8910cd700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc86c039b40 0x7fc86c03c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:12.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.634+0000 7fc8910cd700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc86c039b40 0x7fc86c03c000 crc :-1 s=READY pgs=189 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:12.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.637+0000 7fc8908cc700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.637+0000 7fc87e7fc700 1 -- 172.21.15.88:0/186240971 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc88c0a2cf0 con 0x7fc88c145000 2020-02-11T16:10:12.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.820+0000 7fc893331700 1 -- 172.21.15.88:0/186240971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc88c0a2cf0 con 0x7fc88c145000 2020-02-11T16:10:12.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.820+0000 7fc8908cc700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:12.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.820+0000 7fc87e7fc700 1 -- 172.21.15.88:0/186240971 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fc88c0a2cf0 con 0x7fc88c145000 2020-02-11T16:10:12.823 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":48,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:12.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.821+0000 7fc893331700 1 -- 172.21.15.88:0/186240971 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc86c039b40 msgr2=0x7fc86c03c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:12.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.821+0000 7fc893331700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc86c039b40 0x7fc86c03c000 crc :-1 s=READY pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:12.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.821+0000 7fc893331700 1 -- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 msgr2=0x7fc88c1454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:12.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.821+0000 7fc893331700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 0x7fc88c1454b0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7fc888001260 tx=0x7fc888001710).stop 2020-02-11T16:10:12.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.821+0000 7fc893331700 1 -- 172.21.15.88:0/186240971 shutdown_connections 2020-02-11T16:10:12.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.821+0000 7fc893331700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc86c039b40 0x7fc86c03c000 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:12.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.821+0000 7fc893331700 1 --2- 172.21.15.88:0/186240971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c145000 0x7fc88c1454b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:12.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.821+0000 7fc893331700 1 -- 172.21.15.88:0/186240971 >> 172.21.15.88:0/186240971 conn(0x7fc88c0ac2d0 msgr2=0x7fc88c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:12.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.821+0000 7fc893331700 1 -- 172.21.15.88:0/186240971 shutdown_connections 2020-02-11T16:10:12.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:12.821+0000 7fc893331700 1 -- 172.21.15.88:0/186240971 wait complete. 2020-02-11T16:10:12.834 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":48,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:15.835 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:10:15.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.950+0000 7fc6224ee700 1 Processor -- start 2020-02-11T16:10:15.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.950+0000 7fc6224ee700 1 -- start start 2020-02-11T16:10:15.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.950+0000 7fc6224ee700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc61c0a18a0 0x7fc61c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:15.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.950+0000 7fc6224ee700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c0a31b0 con 0x7fc61c0a6260 2020-02-11T16:10:15.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.950+0000 7fc6224ee700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c0a3570 con 0x7fc61c0a5de0 2020-02-11T16:10:15.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.950+0000 7fc6224ee700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c0a3810 con 0x7fc61c0a18a0 2020-02-11T16:10:15.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.950+0000 7fc613fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc61c0a5de0 0x7fc61c12e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41678/0 (socket says 172.21.15.88:41678) 2020-02-11T16:10:15.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.950+0000 7fc613fff700 1 -- 172.21.15.88:0/200323947 learned_addr learned my addr 172.21.15.88:0/200323947 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:15.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61bfff700 1 --2- 172.21.15.88:0/200323947 >> v2:172.21.15.52:3300/0 conn(0x7fc61c0a18a0 0x7fc61c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:15.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602170914 0 0) 0x7fc61c0a3570 con 0x7fc61c0a5de0 2020-02-11T16:10:15.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5fc003230 con 0x7fc61c0a5de0 2020-02-11T16:10:15.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1531238889 0 0) 0x7fc5fc003230 con 0x7fc61c0a5de0 2020-02-11T16:10:15.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 >> v2:172.21.15.52:3300/0 conn(0x7fc61c0a18a0 msgr2=0x7fc61c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:15.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 --2- 172.21.15.88:0/200323947 >> v2:172.21.15.52:3300/0 conn(0x7fc61c0a18a0 0x7fc61c0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:15.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 >> v1:172.21.15.52:6789/0 conn(0x7fc61c0a6260 legacy=0x7fc61c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:15.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0a3ab0 con 0x7fc61c0a5de0 2020-02-11T16:10:15.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fc6040016d0 con 0x7fc61c0a5de0 2020-02-11T16:10:15.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 >> v1:172.21.15.88:6789/0 conn(0x7fc61c0a5de0 legacy=0x7fc61c12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:15.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc003720 0x7fc5fc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:15.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5fc0044d0 0x7fc5fc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:15.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 0x7fc5fc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:15.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0a3810 con 0x7fc5fc0044d0 2020-02-11T16:10:15.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0041c0 con 0x7fc5fc004db0 2020-02-11T16:10:15.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc00bb80 con 0x7fc5fc003720 2020-02-11T16:10:15.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc613fff700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5fc0044d0 0x7fc5fc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:15.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc620a8b700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 0x7fc5fc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:15.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc61bfff700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc003720 0x7fc5fc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:15.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc620a8b700 1 -- 172.21.15.88:0/200323947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc003720 msgr2=0x7fc5fc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:15.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc620a8b700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5fc003720 0x7fc5fc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:15.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.951+0000 7fc620a8b700 1 -- 172.21.15.88:0/200323947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5fc0044d0 msgr2=0x7fc5fc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:15.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc620a8b700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5fc0044d0 0x7fc5fc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:15.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc620a8b700 1 -- 172.21.15.88:0/200323947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc003230 con 0x7fc5fc004db0 2020-02-11T16:10:15.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc620a8b700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 0x7fc5fc00b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc620a8b700 1 -- 172.21.15.88:0/200323947 reap_dead start 2020-02-11T16:10:15.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc620a8b700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 0x7fc5fc00b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc620a8b700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 0x7fc5fc00b720 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).ready entity=mon.1 client_cookie=f5c8bd5cc4f3f45 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:15.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc620a8b700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 0x7fc5fc00b720 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc614006c40 con 0x7fc5fc004db0 2020-02-11T16:10:15.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc620a8b700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 0x7fc5fc00b720 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc620a8b700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 0x7fc5fc00b720 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc614006da0 con 0x7fc5fc004db0 2020-02-11T16:10:15.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc61b7fe700 1 -- 172.21.15.88:0/200323947 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc614002640 con 0x7fc5fc004db0 2020-02-11T16:10:15.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc6224ee700 1 -- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 msgr2=0x7fc5fc00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:15.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc6224ee700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 0x7fc5fc00b720 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).stop 2020-02-11T16:10:15.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc6224ee700 1 -- 172.21.15.88:0/200323947 shutdown_connections 2020-02-11T16:10:15.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc6224ee700 1 --2- 172.21.15.88:0/200323947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5fc004db0 0x7fc5fc00b720 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:15.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc6224ee700 1 -- 172.21.15.88:0/200323947 >> 172.21.15.88:0/200323947 conn(0x7fc61c09d110 msgr2=0x7fc61c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:15.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc6224ee700 1 -- 172.21.15.88:0/200323947 shutdown_connections 2020-02-11T16:10:15.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.952+0000 7fc6224ee700 1 -- 172.21.15.88:0/200323947 wait complete. 2020-02-11T16:10:15.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.953+0000 7fc6224ee700 1 Processor -- start 2020-02-11T16:10:15.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.953+0000 7fc6224ee700 1 -- start start 2020-02-11T16:10:15.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc6224ee700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5fc004db0 0x7fc61c137240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:15.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc6224ee700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc61c1300a0 0x7fc61c12e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:15.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc6224ee700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc61c12e610 0x7fc61c12aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:15.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc6224ee700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c1376a0 con 0x7fc5fc004db0 2020-02-11T16:10:15.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc6224ee700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c0a4780 con 0x7fc61c12e610 2020-02-11T16:10:15.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc6224ee700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c12fc70 con 0x7fc61c1300a0 2020-02-11T16:10:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc61c12e610 0x7fc61c12aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc61c12e610 0x7fc61c12aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54066/0 (socket says 172.21.15.88:54066) 2020-02-11T16:10:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 -- 172.21.15.88:0/4209631748 learned_addr learned my addr 172.21.15.88:0/4209631748 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc61bfff700 1 --2- 172.21.15.88:0/4209631748 >> v2:172.21.15.52:3300/0 conn(0x7fc5fc004db0 0x7fc61c137240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc613fff700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc61c1300a0 0x7fc61c12e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 -- 172.21.15.88:0/4209631748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc61c1300a0 msgr2=0x7fc61c12e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc61c1300a0 0x7fc61c12e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 -- 172.21.15.88:0/4209631748 >> v2:172.21.15.52:3300/0 conn(0x7fc5fc004db0 msgr2=0x7fc61c137240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> v2:172.21.15.52:3300/0 conn(0x7fc5fc004db0 0x7fc61c137240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 -- 172.21.15.88:0/4209631748 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c130570 con 0x7fc61c12e610 2020-02-11T16:10:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> v2:172.21.15.88:3300/0 conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> v2:172.21.15.88:3300/0 conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.954+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc619ffb700 1 -- 172.21.15.88:0/4209631748 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc614011cd0 con 0x7fc61c12e610 2020-02-11T16:10:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc619ffb700 1 -- 172.21.15.88:0/4209631748 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc614011e30 con 0x7fc61c12e610 2020-02-11T16:10:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc619ffb700 1 -- 172.21.15.88:0/4209631748 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc614002640 con 0x7fc61c12e610 2020-02-11T16:10:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc6224ee700 1 -- 172.21.15.88:0/4209631748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c130810 con 0x7fc61c12e610 2020-02-11T16:10:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc6224ee700 1 -- 172.21.15.88:0/4209631748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c0a7660 con 0x7fc61c12e610 2020-02-11T16:10:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc619ffb700 1 -- 172.21.15.88:0/4209631748 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc6140027a0 con 0x7fc61c12e610 2020-02-11T16:10:15.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.955+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.956+0000 7fc6224ee700 1 -- 172.21.15.88:0/4209631748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c12dee0 con 0x7fc61c12e610 2020-02-11T16:10:15.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.956+0000 7fc619ffb700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc600039cd0 0x7fc60003c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:15.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.956+0000 7fc619ffb700 1 -- 172.21.15.88:0/4209631748 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc614049e20 con 0x7fc61c12e610 2020-02-11T16:10:15.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.956+0000 7fc61bfff700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc600039cd0 0x7fc60003c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:15.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.956+0000 7fc61bfff700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc600039cd0 0x7fc60003c190 crc :-1 s=READY pgs=190 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:15.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.959+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:15.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:15.959+0000 7fc619ffb700 1 -- 172.21.15.88:0/4209631748 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc61402f4e0 con 0x7fc61c12e610 2020-02-11T16:10:16.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.141+0000 7fc6224ee700 1 -- 172.21.15.88:0/4209631748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc61c12dee0 con 0x7fc61c12e610 2020-02-11T16:10:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.142+0000 7fc620a8b700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.142+0000 7fc619ffb700 1 -- 172.21.15.88:0/4209631748 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7fc614031fd0 con 0x7fc61c12e610 2020-02-11T16:10:16.144 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 -- 172.21.15.88:0/4209631748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc600039cd0 msgr2=0x7fc60003c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc600039cd0 0x7fc60003c190 crc :-1 s=READY pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 -- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 msgr2=0x7fc61c12aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 0x7fc61c12aec0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fc5fc0054a0 tx=0x7fc6140100d0).stop 2020-02-11T16:10:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 -- 172.21.15.88:0/4209631748 shutdown_connections 2020-02-11T16:10:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc61c12e610 0x7fc61c12aec0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc600039cd0 0x7fc60003c190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 --2- 172.21.15.88:0/4209631748 >> v2:172.21.15.52:3300/0 conn(0x7fc5fc004db0 0x7fc61c137240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 --2- 172.21.15.88:0/4209631748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc61c1300a0 0x7fc61c12e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 -- 172.21.15.88:0/4209631748 >> 172.21.15.88:0/4209631748 conn(0x7fc61c09d110 msgr2=0x7fc61c0a6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 -- 172.21.15.88:0/4209631748 shutdown_connections 2020-02-11T16:10:16.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.143+0000 7fc6224ee700 1 -- 172.21.15.88:0/4209631748 wait complete. 2020-02-11T16:10:16.155 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":50,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:16.155 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:10:16.155 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:10:16.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.260+0000 7fdb939ad700 1 Processor -- start 2020-02-11T16:10:16.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.260+0000 7fdb939ad700 1 -- start start 2020-02-11T16:10:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb939ad700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb8c0a18a0 0x7fdb8c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb939ad700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8c0a31b0 con 0x7fdb8c0a5de0 2020-02-11T16:10:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb939ad700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8c0a3570 con 0x7fdb8c0a6260 2020-02-11T16:10:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb939ad700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8c0a3810 con 0x7fdb8c0a18a0 2020-02-11T16:10:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91749700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb8c0a18a0 0x7fdb8c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91f4a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdb8c0a6260 0x7fdb8c12eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41698/0 (socket says 172.21.15.88:41698) 2020-02-11T16:10:16.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91f4a700 1 -- 172.21.15.88:0/1201498505 learned_addr learned my addr 172.21.15.88:0/1201498505 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:16.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91749700 1 -- 172.21.15.88:0/1201498505 >> v1:172.21.15.88:6789/0 conn(0x7fdb8c0a6260 legacy=0x7fdb8c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91749700 1 -- 172.21.15.88:0/1201498505 >> v1:172.21.15.52:6789/0 conn(0x7fdb8c0a5de0 legacy=0x7fdb8c12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:16.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb7ffff700 1 -- 172.21.15.88:0/1201498505 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531667460 0 0) 0x7fdb8c0a3570 con 0x7fdb8c0a6260 2020-02-11T16:10:16.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91749700 1 -- 172.21.15.88:0/1201498505 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c0a3ab0 con 0x7fdb8c0a18a0 2020-02-11T16:10:16.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91749700 1 --2- 172.21.15.88:0/1201498505 >> v2:172.21.15.88:3300/0 conn(0x7fdb8c0a18a0 0x7fdb8c0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdb8c05bbc0 tx=0x7fdb84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91749700 1 --2- 172.21.15.88:0/1201498505 >> v2:172.21.15.88:3300/0 conn(0x7fdb8c0a18a0 0x7fdb8c0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdb8c05bbc0 tx=0x7fdb84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91749700 1 --2- 172.21.15.88:0/1201498505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c0a18a0 0x7fdb8c0a6dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84008c60).ready entity=mon.1 client_cookie=283085be7277d117 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91749700 1 --2- 172.21.15.88:0/1201498505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c0a18a0 0x7fdb8c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb7ffff700 1 -- 172.21.15.88:0/1201498505 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8400a160 con 0x7fdb8c0a18a0 2020-02-11T16:10:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91749700 1 --2- 172.21.15.88:0/1201498505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c0a18a0 0x7fdb8c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb7ffff700 1 -- 172.21.15.88:0/1201498505 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8400a2c0 con 0x7fdb8c0a18a0 2020-02-11T16:10:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb91749700 1 --2- 172.21.15.88:0/1201498505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c0a18a0 0x7fdb8c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb7ffff700 1 -- 172.21.15.88:0/1201498505 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8400a660 con 0x7fdb8c0a18a0 2020-02-11T16:10:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb939ad700 1 -- 172.21.15.88:0/1201498505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c0a18a0 msgr2=0x7fdb8c0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.261+0000 7fdb939ad700 1 --2- 172.21.15.88:0/1201498505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c0a18a0 0x7fdb8c0a6dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84008c60).stop 2020-02-11T16:10:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.262+0000 7fdb939ad700 1 -- 172.21.15.88:0/1201498505 shutdown_connections 2020-02-11T16:10:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.262+0000 7fdb939ad700 1 --2- 172.21.15.88:0/1201498505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c0a18a0 0x7fdb8c0a6dd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.262+0000 7fdb939ad700 1 -- 172.21.15.88:0/1201498505 >> 172.21.15.88:0/1201498505 conn(0x7fdb8c09d110 msgr2=0x7fdb8c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.262+0000 7fdb939ad700 1 -- 172.21.15.88:0/1201498505 shutdown_connections 2020-02-11T16:10:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.262+0000 7fdb939ad700 1 -- 172.21.15.88:0/1201498505 wait complete. 2020-02-11T16:10:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.263+0000 7fdb939ad700 1 Processor -- start 2020-02-11T16:10:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.263+0000 7fdb939ad700 1 -- start start 2020-02-11T16:10:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.263+0000 7fdb939ad700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 0x7fdb8c1375d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.263+0000 7fdb939ad700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb8c0a6260 0x7fdb8c1282f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.263+0000 7fdb939ad700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8c12fa60 con 0x7fdb8c0a5de0 2020-02-11T16:10:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.263+0000 7fdb939ad700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8c137d70 con 0x7fdb8c0a6260 2020-02-11T16:10:16.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.263+0000 7fdb939ad700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c137a30 con 0x7fdb8c0a18a0 2020-02-11T16:10:16.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.263+0000 7fdb90f48700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdb8c0a5de0 0x7fdb8c134ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41706/0 (socket says 172.21.15.88:41706) 2020-02-11T16:10:16.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.263+0000 7fdb90f48700 1 -- 172.21.15.88:0/3598575288 learned_addr learned my addr 172.21.15.88:0/3598575288 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:16.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029867924 0 0) 0x7fdb8c12fa60 con 0x7fdb8c0a5de0 2020-02-11T16:10:16.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb6c002fe0 con 0x7fdb8c0a5de0 2020-02-11T16:10:16.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 0x7fdb8c1375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> v2:172.21.15.52:3300/0 conn(0x7fdb8c0a6260 0x7fdb8c1282f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91749700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 msgr2=0x7fdb8c1375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:10:16.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1160828748 0 0) 0x7fdb6c002fe0 con 0x7fdb8c0a5de0 2020-02-11T16:10:16.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91749700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 msgr2=0x7fdb8c1375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:10:16.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 0x7fdb8c1375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:16.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdb8c12fa60 con 0x7fdb8c0a5de0 2020-02-11T16:10:16.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 0x7fdb8c1375d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:16.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fdb800029a0 con 0x7fdb8c0a5de0 2020-02-11T16:10:16.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 msgr2=0x7fdb8c1375d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:10:16.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 0x7fdb8c1375d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 >> v2:172.21.15.52:3300/0 conn(0x7fdb8c0a6260 msgr2=0x7fdb8c1282f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 --2- 172.21.15.88:0/3598575288 >> v2:172.21.15.52:3300/0 conn(0x7fdb8c0a6260 0x7fdb8c1282f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 >> v1:172.21.15.88:6789/0 conn(0x7fdb8c0a5de0 legacy=0x7fdb8c134ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 0x7fdb6c0049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c004e10 0x7fdb6c005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c137d70 con 0x7fdb6c004e10 2020-02-11T16:10:16.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c137a30 con 0x7fdb6c003a30 2020-02-11T16:10:16.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0044e0 con 0x7fdb8c0a18a0 2020-02-11T16:10:16.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 0x7fdb6c0049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb90f48700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c004e10 0x7fdb6c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91749700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 msgr2=0x7fdb6c0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:10:16.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91749700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 msgr2=0x7fdb6c0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:10:16.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 0x7fdb6c0049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:16.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 0x7fdb6c0049b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:16.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 msgr2=0x7fdb6c0049b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:10:16.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb8c0a18a0 0x7fdb6c0049b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c004e10 msgr2=0x7fdb6c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c004e10 0x7fdb6c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 -- 172.21.15.88:0/3598575288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c135600 con 0x7fdb6c003a30 2020-02-11T16:10:16.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb939ad700 1 -- 172.21.15.88:0/3598575288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8c12ff00 con 0x7fdb6c003a30 2020-02-11T16:10:16.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb88000e90 tx=0x7fdb8800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb88000e90 tx=0x7fdb8800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fdb88000e90 tx=0x7fdb8800c5d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.264+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fdb88000e90 tx=0x7fdb8800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8800c630 con 0x7fdb6c003a30 2020-02-11T16:10:16.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fdb88000e90 tx=0x7fdb8800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb939ad700 1 -- 172.21.15.88:0/3598575288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c0a3cb0 con 0x7fdb6c003a30 2020-02-11T16:10:16.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8800c790 con 0x7fdb6c003a30 2020-02-11T16:10:16.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fdb88000e90 tx=0x7fdb8800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8800caf0 con 0x7fdb6c003a30 2020-02-11T16:10:16.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fdb88000e90 tx=0x7fdb8800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb91f4a700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fdb88000e90 tx=0x7fdb8800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdb8800cc50 con 0x7fdb6c003a30 2020-02-11T16:10:16.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb939ad700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 0x7fdb8c128750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb939ad700 1 -- 172.21.15.88:0/3598575288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c137b70 con 0x7fdb8c1375b0 2020-02-11T16:10:16.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 0x7fdb8c128750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb7e7fc700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb6c041f10 0x7fdb6c0443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.265+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdb88049980 con 0x7fdb6c003a30 2020-02-11T16:10:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb91749700 1 -- 172.21.15.88:0/3598575288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb8c05e2f0 con 0x7fdb8c1375b0 2020-02-11T16:10:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb90f48700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb6c041f10 0x7fdb6c0443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 0x7fdb8c128750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 0x7fdb8c128750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 0x7fdb8c128750 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 0x7fdb8c128750 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb84005c30 con 0x7fdb8c1375b0 2020-02-11T16:10:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb90f48700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb6c041f10 0x7fdb6c0443d0 crc :-1 s=READY pgs=191 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 0x7fdb8c128750 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fdb84005d90 con 0x7fdb8c1375b0 2020-02-11T16:10:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 msgr2=0x7fdb8c128750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb7e7fc700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 0x7fdb8c128750 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).stop 2020-02-11T16:10:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 msgr2=0x7fdb8c128750 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb91f4a700 1 -- 172.21.15.88:0/3598575288 reap_dead start 2020-02-11T16:10:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.266+0000 7fdb7e7fc700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1375b0 0x7fdb8c128750 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.274+0000 7fdb939ad700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 0x7fdb8c134ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.274+0000 7fdb939ad700 1 -- 172.21.15.88:0/3598575288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c0565b0 con 0x7fdb8c1282f0 2020-02-11T16:10:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.274+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 0x7fdb8c134ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.274+0000 7fdb91749700 1 -- 172.21.15.88:0/3598575288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdb8c0a9480 con 0x7fdb8c1282f0 2020-02-11T16:10:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.274+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 0x7fdb8c134ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.274+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 0x7fdb8c134ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.274+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 0x7fdb8c134ef0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 0x7fdb8c134ef0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8400d3d0 con 0x7fdb8c1282f0 2020-02-11T16:10:16.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb91749700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 0x7fdb8c134ef0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7fdb8400d530 con 0x7fdb8c1282f0 2020-02-11T16:10:16.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 msgr2=0x7fdb8c134ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb7e7fc700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 0x7fdb8c134ef0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).stop 2020-02-11T16:10:16.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb7e7fc700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 msgr2=0x7fdb8c134ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:16.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb7e7fc700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 0x7fdb8c134ef0 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0x7fdb8c05bbc0 tx=0x7fdb84011790).stop 2020-02-11T16:10:16.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb6c041f10 msgr2=0x7fdb6c0443d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb6c041f10 0x7fdb6c0443d0 crc :-1 s=READY pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 -- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 msgr2=0x7fdb6c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fdb88000e90 tx=0x7fdb8800c5d0).stop 2020-02-11T16:10:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 -- 172.21.15.88:0/3598575288 shutdown_connections 2020-02-11T16:10:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6c003a30 0x7fdb6c003eb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb6c041f10 0x7fdb6c0443d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 --2- 172.21.15.88:0/3598575288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb8c1282f0 0x7fdb8c134ef0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 -- 172.21.15.88:0/3598575288 >> 172.21.15.88:0/3598575288 conn(0x7fdb8c09d110 msgr2=0x7fdb8c12ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:16.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 -- 172.21.15.88:0/3598575288 shutdown_connections 2020-02-11T16:10:16.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.275+0000 7fdb939ad700 1 -- 172.21.15.88:0/3598575288 wait complete. 2020-02-11T16:10:16.293 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:10:16.293 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:16.293 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:16.294 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:10:16.294 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 50, 2020-02-11T16:10:16.294 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:10:16.294 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:10:16.294 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:10:16.294 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:10:16.295 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.295 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:10:16.295 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:16.295 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:10:16.295 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:10:16.295 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:16.295 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:16.296 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:16.296 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:16.296 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:16.296 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:16.296 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.296 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:10:16.296 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:10:16.296 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:16.297 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:16.297 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:16.297 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:16.297 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:16.297 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:16.297 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.298 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:10:16.298 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:10:16.298 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:10:16.298 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:10:16.298 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:10:16.298 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:10:16.298 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:16.299 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:16.299 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:10:16.299 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:10:16.299 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:16.299 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:10:16.299 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:16.299 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:16.300 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:16.300 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:16.301 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:16.301 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:16.301 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.301 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:10:16.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.301 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:10:16.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.309 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:16.309 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:16.310 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:16.310 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:16.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.310 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:16.310 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:10:16.310 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.311 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:16.311 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:10:16.311 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.311 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.311 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:10:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:10:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:10:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:10:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:10:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:10:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:10:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:10:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:10:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:10:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:10:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:10:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:10:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:10:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:10:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:10:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:10:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:10:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:10:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:10:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:10:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.324 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:10:16.324 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:10:16.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.430+0000 7f9dae35c700 1 Processor -- start 2020-02-11T16:10:16.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.430+0000 7f9dae35c700 1 -- start start 2020-02-11T16:10:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.430+0000 7f9dae35c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9da80a6e90 0x7f9da8145470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.430+0000 7f9dae35c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da80a1c90 con 0x7f9da80a51a0 2020-02-11T16:10:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.430+0000 7f9dae35c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da80a1f30 con 0x7f9da81458d0 2020-02-11T16:10:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.430+0000 7f9dae35c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da80a5f00 con 0x7f9da80a6e90 2020-02-11T16:10:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.430+0000 7f9da77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9da81458d0 0x7f9da80a4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41722/0 (socket says 172.21.15.88:41722) 2020-02-11T16:10:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.430+0000 7f9da77fe700 1 -- 172.21.15.88:0/4278458002 learned_addr learned my addr 172.21.15.88:0/4278458002 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da7fff700 1 --2- 172.21.15.88:0/4278458002 >> v2:172.21.15.52:3300/0 conn(0x7f9da80a6e90 0x7f9da8145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527020631 0 0) 0x7f9da80a1f30 con 0x7f9da81458d0 2020-02-11T16:10:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d94003230 con 0x7f9da81458d0 2020-02-11T16:10:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2995610189 0 0) 0x7f9d94003230 con 0x7f9da81458d0 2020-02-11T16:10:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 >> v2:172.21.15.52:3300/0 conn(0x7f9da80a6e90 msgr2=0x7f9da8145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 --2- 172.21.15.88:0/4278458002 >> v2:172.21.15.52:3300/0 conn(0x7f9da80a6e90 0x7f9da8145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 >> v1:172.21.15.52:6789/0 conn(0x7f9da80a51a0 legacy=0x7f9da814f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da80a2470 con 0x7f9da81458d0 2020-02-11T16:10:16.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f9d9c0016d0 con 0x7f9da81458d0 2020-02-11T16:10:16.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 >> v1:172.21.15.88:6789/0 conn(0x7f9da81458d0 legacy=0x7f9da80a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94003720 0x7f9d94003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:16.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d940044d0 0x7f9d94004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:16.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 0x7f9d9400c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:16.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80a5f00 con 0x7f9d94003720 2020-02-11T16:10:16.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940041c0 con 0x7f9d94004db0 2020-02-11T16:10:16.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940056f0 con 0x7f9d940044d0 2020-02-11T16:10:16.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 0x7f9d9400c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da7fff700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94003720 0x7f9d94003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da77fe700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d940044d0 0x7f9d94004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9dac8f9700 1 -- 172.21.15.88:0/4278458002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d940044d0 msgr2=0x7f9d94004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:16.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d940044d0 0x7f9d94004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:16.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9dac8f9700 1 -- 172.21.15.88:0/4278458002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94003720 msgr2=0x7f9d94003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:16.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94003720 0x7f9d94003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:16.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9dac8f9700 1 -- 172.21.15.88:0/4278458002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94003230 con 0x7f9d94004db0 2020-02-11T16:10:16.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9da77fe700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d940044d0 0x7f9d94004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:10:16.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 0x7f9d9400c830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9dac8f9700 1 -- 172.21.15.88:0/4278458002 reap_dead start 2020-02-11T16:10:16.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 0x7f9d9400c830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.431+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 0x7f9d9400c830 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).ready entity=mon.1 client_cookie=2c310fd0e147360b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 0x7f9d9400c830 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 0x7f9d9400c830 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9da0006c40 con 0x7f9d94004db0 2020-02-11T16:10:16.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 0x7f9d9400c830 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da0006da0 con 0x7f9d94004db0 2020-02-11T16:10:16.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9da6ffd700 1 -- 172.21.15.88:0/4278458002 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9da0002640 con 0x7f9d94004db0 2020-02-11T16:10:16.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9dae35c700 1 -- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 msgr2=0x7f9d9400c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9dae35c700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 0x7f9d9400c830 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).stop 2020-02-11T16:10:16.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9dae35c700 1 -- 172.21.15.88:0/4278458002 shutdown_connections 2020-02-11T16:10:16.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9dae35c700 1 --2- 172.21.15.88:0/4278458002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d94004db0 0x7f9d9400c830 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9dae35c700 1 -- 172.21.15.88:0/4278458002 >> 172.21.15.88:0/4278458002 conn(0x7f9da809d110 msgr2=0x7f9da809d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:16.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9dae35c700 1 -- 172.21.15.88:0/4278458002 shutdown_connections 2020-02-11T16:10:16.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.432+0000 7f9dae35c700 1 -- 172.21.15.88:0/4278458002 wait complete. 2020-02-11T16:10:16.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.433+0000 7f9dae35c700 1 Processor -- start 2020-02-11T16:10:16.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.433+0000 7f9dae35c700 1 -- start start 2020-02-11T16:10:16.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dae35c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d94004db0 0x7f9da8143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dae35c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9da80aa010 0x7f9da80aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dae35c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9da80aab50 0x7f9da807c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dae35c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da8142320 con 0x7f9da80aa010 2020-02-11T16:10:16.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dae35c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da805b8c0 con 0x7f9da80aab50 2020-02-11T16:10:16.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dae35c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da807e220 con 0x7f9d94004db0 2020-02-11T16:10:16.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9da80aab50 0x7f9da807c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9da80aab50 0x7f9da807c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54110/0 (socket says 172.21.15.88:54110) 2020-02-11T16:10:16.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 -- 172.21.15.88:0/68427956 learned_addr learned my addr 172.21.15.88:0/68427956 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:16.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d94004db0 0x7f9da8143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9da77fe700 1 --2- 172.21.15.88:0/68427956 >> v2:172.21.15.52:3300/0 conn(0x7f9da80aa010 0x7f9da80aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9da7fff700 1 -- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d94004db0 msgr2=0x7f9da8143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:10:16.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9da7fff700 1 -- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d94004db0 msgr2=0x7f9da8143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:10:16.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d94004db0 0x7f9da8143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:16.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d94004db0 0x7f9da8143120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:16.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 -- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d94004db0 msgr2=0x7f9da8143120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:10:16.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9d94004db0 0x7f9da8143120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 -- 172.21.15.88:0/68427956 >> v2:172.21.15.52:3300/0 conn(0x7f9da80aa010 msgr2=0x7f9da80aa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/68427956 >> v2:172.21.15.52:3300/0 conn(0x7f9da80aa010 0x7f9da80aa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 -- 172.21.15.88:0/68427956 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da807e4c0 con 0x7f9da80aab50 2020-02-11T16:10:16.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9da77fe700 1 --2- 172.21.15.88:0/68427956 >> v2:172.21.15.52:3300/0 conn(0x7f9da80aa010 0x7f9da80aa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:10:16.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/68427956 >> v2:172.21.15.88:3300/0 conn(0x7f9da80aab50 0x7f9da807c050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/68427956 >> v2:172.21.15.88:3300/0 conn(0x7f9da80aab50 0x7f9da807c050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da80aab50 0x7f9da807c050 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da80aab50 0x7f9da807c050 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da80aab50 0x7f9da807c050 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9da0011d40 con 0x7f9da80aab50 2020-02-11T16:10:16.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da80aab50 0x7f9da807c050 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da0002450 con 0x7f9da80aab50 2020-02-11T16:10:16.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dae35c700 1 -- 172.21.15.88:0/68427956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da807e760 con 0x7f9da80aab50 2020-02-11T16:10:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9da0002870 con 0x7f9da80aab50 2020-02-11T16:10:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.434+0000 7f9dae35c700 1 -- 172.21.15.88:0/68427956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da80a8180 con 0x7f9da80aab50 2020-02-11T16:10:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.435+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da80aab50 0x7f9da807c050 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.435+0000 7f9dae35c700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 0x7f9da8149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.435+0000 7f9dae35c700 1 -- 172.21.15.88:0/68427956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da805e2f0 con 0x7f9da807c830 2020-02-11T16:10:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.435+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f9da00029d0 con 0x7f9da80aab50 2020-02-11T16:10:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.435+0000 7f9dac8f9700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da80aab50 0x7f9da807c050 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.435+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 0x7f9da8149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.435+0000 7f9da57fa700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d88039cd0 0x7f9d8803c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.435+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f9da0049f50 con 0x7f9da80aab50 2020-02-11T16:10:16.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.435+0000 7f9da77fe700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d88039cd0 0x7f9d8803c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da7fff700 1 -- 172.21.15.88:0/68427956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9da80565b0 con 0x7f9da807c830 2020-02-11T16:10:16.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 0x7f9da8149270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 0x7f9da8149270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 0x7f9da8149270 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da77fe700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d88039cd0 0x7f9d8803c190 crc :-1 s=READY pgs=192 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 0x7f9da8149270 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d98005e90 con 0x7f9da807c830 2020-02-11T16:10:16.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 0x7f9da8149270 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f9d98007160 con 0x7f9da807c830 2020-02-11T16:10:16.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 msgr2=0x7f9da8149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da57fa700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 0x7f9da8149270 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).stop 2020-02-11T16:10:16.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 msgr2=0x7f9da8149270 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:16.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.436+0000 7f9da57fa700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da807c830 0x7f9da8149270 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.444+0000 7f9dae35c700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 0x7f9da8151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.444+0000 7f9dae35c700 1 -- 172.21.15.88:0/68427956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da807e8f0 con 0x7f9da8151aa0 2020-02-11T16:10:16.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.444+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 0x7f9da8151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da7fff700 1 -- 172.21.15.88:0/68427956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9da805ccb0 con 0x7f9da8151aa0 2020-02-11T16:10:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 0x7f9da8151eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 0x7f9da8151eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 0x7f9da8151eb0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 0x7f9da8151eb0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d98007560 con 0x7f9da8151aa0 2020-02-11T16:10:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da7fff700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 0x7f9da8151eb0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4191 (secure 0 0 0) 0x7f9d98010070 con 0x7f9da8151aa0 2020-02-11T16:10:16.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 msgr2=0x7f9da8151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da57fa700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 0x7f9da8151eb0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f9d98007960 tx=0x7f9d98010c50).stop 2020-02-11T16:10:16.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da57fa700 1 -- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 msgr2=0x7f9da8151eb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:16.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.445+0000 7f9da57fa700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9da8151aa0 0x7f9da8151eb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dae35c700 1 -- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d88039cd0 msgr2=0x7f9d8803c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dae35c700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9d88039cd0 0x7f9d8803c190 crc :-1 s=READY pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dae35c700 1 -- 172.21.15.88:0/68427956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da80aab50 msgr2=0x7f9da807c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dae35c700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da80aab50 0x7f9da807c050 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f9d940054a0 tx=0x7f9da00100d0).stop 2020-02-11T16:10:16.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dac8f9700 1 -- 172.21.15.88:0/68427956 reap_dead start 2020-02-11T16:10:16.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dac8f9700 1 -- 172.21.15.88:0/68427956 reap_dead start 2020-02-11T16:10:16.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dae35c700 1 -- 172.21.15.88:0/68427956 shutdown_connections 2020-02-11T16:10:16.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dae35c700 1 --2- 172.21.15.88:0/68427956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da80aab50 0x7f9da807c050 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dae35c700 1 -- 172.21.15.88:0/68427956 >> 172.21.15.88:0/68427956 conn(0x7f9da809d110 msgr2=0x7f9da8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:16.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dae35c700 1 -- 172.21.15.88:0/68427956 shutdown_connections 2020-02-11T16:10:16.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.446+0000 7f9dae35c700 1 -- 172.21.15.88:0/68427956 wait complete. 2020-02-11T16:10:16.463 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:10:16.464 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:10:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 50, 2020-02-11T16:10:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:10:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:10:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:10:16.465 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:10:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:10:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:10:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:10:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:10:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:10:16.467 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.468 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:10:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:10:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:10:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:10:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:10:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:10:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:16.469 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:10:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:10:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:10:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:10:16.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:10:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:16.472 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:10:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.473 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:10:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.474 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:10:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:10:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:16.475 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:10:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:10:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.477 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.478 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:10:16.478 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:10:16.478 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:16.478 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:16.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.479 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:10:16.479 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:10:16.479 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:16.479 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:16.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.480 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:16.480 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:10:16.480 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.480 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:16.480 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:10:16.481 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:16.482 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.482 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.483 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:10:16.483 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:10:16.483 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:16.483 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:16.483 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.483 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:16.484 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:10:16.484 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:10:16.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.484 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:16.484 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:16.484 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:16.485 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.485 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.485 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:10:16.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.485 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:16.485 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:16.485 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:16.485 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.486 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.486 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:10:16.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.486 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:16.486 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:16.486 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:10:16.486 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.487 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:16.487 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:10:16.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:16.487 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:16.487 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:16.487 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:10:16.487 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.487 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:16.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:16.488 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:10:16.488 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:10:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.593+0000 7f01e26ff700 1 Processor -- start 2020-02-11T16:10:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.593+0000 7f01e26ff700 1 -- start start 2020-02-11T16:10:16.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01e26ff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01dc0a5b20 0x7f01dc0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:16.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01e26ff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc131280 0x7f01dc1316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:16.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01e26ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc0a4350 con 0x7f01dc0a2fa0 2020-02-11T16:10:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01e26ff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc0a1e60 con 0x7f01dc0a5b20 2020-02-11T16:10:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01e26ff700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0a3450 con 0x7f01dc131280 2020-02-11T16:10:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01dbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f01dc0a2fa0 0x7f01dc0a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41744/0 (socket says 172.21.15.88:41744) 2020-02-11T16:10:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01dbfff700 1 -- 172.21.15.88:0/1574936135 learned_addr learned my addr 172.21.15.88:0/1574936135 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc131280 0x7f01dc1316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 --2- 172.21.15.88:0/1574936135 >> v2:172.21.15.52:3300/0 conn(0x7f01dc0a5b20 0x7f01dc0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01daffd700 1 -- 172.21.15.88:0/1574936135 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429878471 0 0) 0x7f01dc0a4350 con 0x7f01dc0a2fa0 2020-02-11T16:10:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01e0c9c700 1 -- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc131280 msgr2=0x7f01dc1316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:10:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01e0c9c700 1 -- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc131280 msgr2=0x7f01dc1316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:10:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01daffd700 1 -- 172.21.15.88:0/1574936135 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c8003230 con 0x7f01dc0a2fa0 2020-02-11T16:10:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc131280 0x7f01dc1316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc131280 0x7f01dc1316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 -- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc131280 msgr2=0x7f01dc1316f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:10:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc131280 0x7f01dc1316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01daffd700 1 -- 172.21.15.88:0/1574936135 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3472688542 0 0) 0x7f01c8003230 con 0x7f01dc0a2fa0 2020-02-11T16:10:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 -- 172.21.15.88:0/1574936135 >> v1:172.21.15.88:6789/0 conn(0x7f01dc0a2fa0 legacy=0x7f01dc0a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 -- 172.21.15.88:0/1574936135 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc0a3a40 con 0x7f01dc0a5b20 2020-02-11T16:10:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 --2- 172.21.15.88:0/1574936135 >> v2:172.21.15.52:3300/0 conn(0x7f01dc0a5b20 0x7f01dc0a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01cc001870 tx=0x7f01d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 --2- 172.21.15.88:0/1574936135 >> v2:172.21.15.52:3300/0 conn(0x7f01dc0a5b20 0x7f01dc0a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01cc001870 tx=0x7f01d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01dc0a5b20 0x7f01dc0a1520 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f01cc001870 tx=0x7f01d00088e0).ready entity=mon.0 client_cookie=d2941148a3a880f2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01dc0a5b20 0x7f01dc0a1520 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f01cc001870 tx=0x7f01d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01daffd700 1 -- 172.21.15.88:0/1574936135 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01cc0016d0 con 0x7f01dc0a5b20 2020-02-11T16:10:16.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01dc0a5b20 0x7f01dc0a1520 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f01cc001870 tx=0x7f01d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01daffd700 1 -- 172.21.15.88:0/1574936135 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d0008e40 con 0x7f01dc0a5b20 2020-02-11T16:10:16.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.594+0000 7f01db7fe700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01dc0a5b20 0x7f01dc0a1520 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f01cc001870 tx=0x7f01d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.595+0000 7f01daffd700 1 -- 172.21.15.88:0/1574936135 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d00114b0 con 0x7f01dc0a5b20 2020-02-11T16:10:16.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.595+0000 7f01e26ff700 1 -- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01dc0a5b20 msgr2=0x7f01dc0a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.595+0000 7f01e26ff700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01dc0a5b20 0x7f01dc0a1520 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f01cc001870 tx=0x7f01d00088e0).stop 2020-02-11T16:10:16.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.595+0000 7f01e26ff700 1 -- 172.21.15.88:0/1574936135 shutdown_connections 2020-02-11T16:10:16.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.595+0000 7f01e26ff700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc131280 0x7f01dc1316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:16.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.595+0000 7f01e26ff700 1 --2- 172.21.15.88:0/1574936135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01dc0a5b20 0x7f01dc0a1520 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.595+0000 7f01e26ff700 1 -- 172.21.15.88:0/1574936135 >> 172.21.15.88:0/1574936135 conn(0x7f01dc09d110 msgr2=0x7f01dc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:16.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.595+0000 7f01e26ff700 1 -- 172.21.15.88:0/1574936135 shutdown_connections 2020-02-11T16:10:16.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.595+0000 7f01e26ff700 1 -- 172.21.15.88:0/1574936135 wait complete. 2020-02-11T16:10:16.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.596+0000 7f01e26ff700 1 Processor -- start 2020-02-11T16:10:16.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.596+0000 7f01e26ff700 1 -- start start 2020-02-11T16:10:16.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e26ff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0a2fa0 0x7f01dc13e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e26ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01dc131280 0x7f01dc142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e26ff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc043730 con 0x7f01dc0a5b20 2020-02-11T16:10:16.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e26ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc1432c0 con 0x7f01dc131280 2020-02-11T16:10:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e26ff700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc1353c0 con 0x7f01dc0a2fa0 2020-02-11T16:10:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01dc131280 0x7f01dc142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01dc131280 0x7f01dc142e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54128/0 (socket says 172.21.15.88:54128) 2020-02-11T16:10:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 -- 172.21.15.88:0/359106793 learned_addr learned my addr 172.21.15.88:0/359106793 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0a2fa0 0x7f01dc13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0a2fa0 msgr2=0x7f01dc13e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0a2fa0 0x7f01dc13e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:16.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 -- 172.21.15.88:0/359106793 >> v1:172.21.15.52:6789/0 conn(0x7f01dc0a5b20 legacy=0x7f01dc13d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:16.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 -- 172.21.15.88:0/359106793 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc137930 con 0x7f01dc131280 2020-02-11T16:10:16.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0a2fa0 0x7f01dc13e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:10:16.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/359106793 >> v2:172.21.15.88:3300/0 conn(0x7f01dc131280 0x7f01dc142e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01dc0a6050 tx=0x7f01d4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/359106793 >> v2:172.21.15.88:3300/0 conn(0x7f01dc131280 0x7f01dc142e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01dc0a6050 tx=0x7f01d4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01dc131280 0x7f01dc142e60 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f01dc0a6050 tx=0x7f01d4010fd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01dc131280 0x7f01dc142e60 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f01dc0a6050 tx=0x7f01d4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d4005e30 con 0x7f01dc131280 2020-02-11T16:10:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01dc131280 0x7f01dc142e60 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f01dc0a6050 tx=0x7f01d4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01dc131280 0x7f01dc142e60 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f01dc0a6050 tx=0x7f01d4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d4007540 con 0x7f01dc131280 2020-02-11T16:10:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d4012630 con 0x7f01dc131280 2020-02-11T16:10:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e26ff700 1 -- 172.21.15.88:0/359106793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01dc137b60 con 0x7f01dc131280 2020-02-11T16:10:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.597+0000 7f01e26ff700 1 -- 172.21.15.88:0/359106793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc13a120 con 0x7f01dc131280 2020-02-11T16:10:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.598+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01dc131280 0x7f01dc142e60 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f01dc0a6050 tx=0x7f01d4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.598+0000 7f01e26ff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.598+0000 7f01e26ff700 1 -- 172.21.15.88:0/359106793 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc05e2f0 con 0x7f01dc0aa8d0 2020-02-11T16:10:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.598+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f01d4010180 con 0x7f01dc131280 2020-02-11T16:10:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.598+0000 7f01e0c9c700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01dc131280 0x7f01dc142e60 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f01dc0a6050 tx=0x7f01d4010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.598+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.598+0000 7f01d97fa700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f01bc039d50 0x7f01bc03c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.599+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f01d4049a60 con 0x7f01dc131280 2020-02-11T16:10:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.599+0000 7f01dbfff700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 msgr2=0x7f01dc1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:10:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.599+0000 7f01dbfff700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 msgr2=0x7f01dc1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:10:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.599+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.599+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.599+0000 7f01db7fe700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f01bc039d50 0x7f01bc03c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.599+0000 7f01db7fe700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f01bc039d50 0x7f01bc03c210 crc :-1 s=READY pgs=193 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:16.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.800+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:16.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.800+0000 7f01dbfff700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 msgr2=0x7f01dc1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:10:16.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.800+0000 7f01dbfff700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 msgr2=0x7f01dc1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:10:16.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.800+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:16.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:16.800+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:10:17.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:17.201+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:17.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:17.201+0000 7f01dbfff700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 msgr2=0x7f01dc1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:10:17.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:17.201+0000 7f01dbfff700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 msgr2=0x7f01dc1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:10:17.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:17.201+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:17.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:17.201+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:10:18.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:18.002+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:18.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:18.002+0000 7f01dbfff700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 msgr2=0x7f01dc1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:10:18.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:18.002+0000 7f01dbfff700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 msgr2=0x7f01dc1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:10:18.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:18.002+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:18.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:18.002+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:10:19.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.605+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:19.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.605+0000 7f01dbfff700 1 -- 172.21.15.88:0/359106793 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01dc0565b0 con 0x7f01dc0aa8d0 2020-02-11T16:10:19.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.605+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.605+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.605+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:19.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.606+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.606+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01cc012ad0 con 0x7f01dc0aa8d0 2020-02-11T16:10:19.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.606+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.606+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f01cc012c30 con 0x7f01dc0aa8d0 2020-02-11T16:10:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.606+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 msgr2=0x7f01dc1388b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.606+0000 7f01d97fa700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).stop 2020-02-11T16:10:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.606+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 msgr2=0x7f01dc1388b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.606+0000 7f01d97fa700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aa8d0 0x7f01dc1388b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:19.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.615+0000 7f01e26ff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 0x7f01dc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:19.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.615+0000 7f01e26ff700 1 -- 172.21.15.88:0/359106793 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc13e290 con 0x7f01dc0aacb0 2020-02-11T16:10:19.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.616+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 0x7f01dc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:19.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.616+0000 7f01dbfff700 1 -- 172.21.15.88:0/359106793 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f01dc1397a0 con 0x7f01dc0aacb0 2020-02-11T16:10:19.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.616+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 0x7f01dc138d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.616+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 0x7f01dc138d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.616+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 0x7f01dc138d10 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:19.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.616+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 0x7f01dc138d10 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.616+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01cc00b670 con 0x7f01dc0aacb0 2020-02-11T16:10:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01dbfff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 0x7f01dc138d10 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3849 (secure 0 0 0) 0x7f01cc00b7d0 con 0x7f01dc0aacb0 2020-02-11T16:10:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 msgr2=0x7f01dc138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01d97fa700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 0x7f01dc138d10 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f01cc001930 tx=0x7f01cc010cb0).stop 2020-02-11T16:10:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01d97fa700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 msgr2=0x7f01dc138d10 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01d97fa700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01dc0aacb0 0x7f01dc138d10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e26ff700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f01bc039d50 msgr2=0x7f01bc03c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e26ff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f01bc039d50 0x7f01bc03c210 crc :-1 s=READY pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e26ff700 1 -- 172.21.15.88:0/359106793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01dc131280 msgr2=0x7f01dc142e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e26ff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01dc131280 0x7f01dc142e60 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f01dc0a6050 tx=0x7f01d4010fd0).stop 2020-02-11T16:10:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e0c9c700 1 -- 172.21.15.88:0/359106793 reap_dead start 2020-02-11T16:10:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e0c9c700 1 -- 172.21.15.88:0/359106793 reap_dead start 2020-02-11T16:10:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e26ff700 1 -- 172.21.15.88:0/359106793 shutdown_connections 2020-02-11T16:10:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e26ff700 1 --2- 172.21.15.88:0/359106793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01dc131280 0x7f01dc142e60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e26ff700 1 -- 172.21.15.88:0/359106793 >> 172.21.15.88:0/359106793 conn(0x7f01dc09d110 msgr2=0x7f01dc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e26ff700 1 -- 172.21.15.88:0/359106793 shutdown_connections 2020-02-11T16:10:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.617+0000 7f01e26ff700 1 -- 172.21.15.88:0/359106793 wait complete. 2020-02-11T16:10:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:10:19.624 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:10:19.624 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:10:19.624 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:10:19.624 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 50, 2020-02-11T16:10:19.624 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:10:19.625 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:10:19.625 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:10:19.625 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:10:19.625 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:19.625 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 5, 2020-02-11T16:10:19.625 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:19.626 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:10:19.626 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:10:19.626 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:19.626 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:19.626 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:19.626 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:19.627 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:19.627 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:19.627 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:19.627 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:10:19.627 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:10:19.627 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:19.627 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:19.627 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:19.628 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:19.628 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:19.628 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:19.628 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:19.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.628 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:10:19.628 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:10:19.629 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:10:19.629 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:10:19.629 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:10:19.629 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:10:19.629 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:19.630 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:19.630 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:10:19.630 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:10:19.630 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:19.630 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:10:19.630 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:19.630 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:19.631 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:19.631 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:19.631 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:19.631 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:19.631 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:19.631 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:10:19.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.632 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:10:19.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.632 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:19.632 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:19.632 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:19.632 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:19.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.633 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:19.633 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:10:19.633 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:19.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.633 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:19.633 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:10:19.634 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:19.634 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:19.634 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:19.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.634 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:10:19.634 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:10:19.634 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:19.635 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:19.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.635 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:19.635 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:19.635 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:19.635 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:19.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.636 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:19.636 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:10:19.636 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:19.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.637 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:19.637 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:10:19.637 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:19.637 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:19.637 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:19.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.637 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:10:19.637 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:10:19.638 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:19.638 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:19.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.639 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:10:19.639 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:10:19.639 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:19.639 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:19.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.639 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:19.640 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:10:19.640 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:19.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.640 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:19.640 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:10:19.640 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:19.640 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:19.641 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:19.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.641 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:10:19.641 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:10:19.641 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:19.641 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:19.642 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:19.642 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:19.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:19.642 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:10:19.642 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:10:19.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.642 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:19.643 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:19.643 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:19.643 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:19.643 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:19.643 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:10:19.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:19.644 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:19.644 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:19.644 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:19.644 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:19.644 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:19.645 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:19.645 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:10:19.646 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:10:19.646 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:10:19.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.758+0000 7fc277773700 1 Processor -- start 2020-02-11T16:10:19.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.759+0000 7fc277773700 1 -- start start 2020-02-11T16:10:19.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.759+0000 7fc277773700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc2700a2fa0 0x7fc2700a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:19.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.759+0000 7fc277773700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc270131990 0x7fc2700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:19.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.759+0000 7fc277773700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2700a4350 con 0x7fc2700a5410 2020-02-11T16:10:19.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.759+0000 7fc277773700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2700a1e60 con 0x7fc2700a2fa0 2020-02-11T16:10:19.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.759+0000 7fc277773700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700a3450 con 0x7fc270131990 2020-02-11T16:10:19.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.759+0000 7fc27550f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc2700a2fa0 0x7fc2700a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:19.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.759+0000 7fc274d0e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc2700a5410 0x7fc270131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41770/0 (socket says 172.21.15.88:41770) 2020-02-11T16:10:19.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.759+0000 7fc27550f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc2700a2fa0 0x7fc2700a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54144/0 (socket says 172.21.15.88:54144) 2020-02-11T16:10:19.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.759+0000 7fc274d0e700 1 -- 172.21.15.88:0/3665290742 learned_addr learned my addr 172.21.15.88:0/3665290742 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:19.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc275d10700 1 --2- 172.21.15.88:0/3665290742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc270131990 0x7fc2700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:19.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc27550f700 1 -- 172.21.15.88:0/3665290742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc270131990 msgr2=0x7fc2700a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:19.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc27550f700 1 --2- 172.21.15.88:0/3665290742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc270131990 0x7fc2700a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:19.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc27550f700 1 -- 172.21.15.88:0/3665290742 >> v1:172.21.15.88:6789/0 conn(0x7fc2700a5410 legacy=0x7fc270131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:19.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc27550f700 1 -- 172.21.15.88:0/3665290742 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2700a3a40 con 0x7fc2700a2fa0 2020-02-11T16:10:19.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc25ffff700 1 -- 172.21.15.88:0/3665290742 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444984070 0 0) 0x7fc2700a4350 con 0x7fc2700a5410 2020-02-11T16:10:19.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc27550f700 1 --2- 172.21.15.88:0/3665290742 >> v2:172.21.15.88:3300/0 conn(0x7fc2700a2fa0 0x7fc2700a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc27005efb0 tx=0x7fc2600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc27550f700 1 --2- 172.21.15.88:0/3665290742 >> v2:172.21.15.88:3300/0 conn(0x7fc2700a2fa0 0x7fc2700a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc27005efb0 tx=0x7fc2600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc27550f700 1 --2- 172.21.15.88:0/3665290742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a2fa0 0x7fc2700a1520 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fc27005efb0 tx=0x7fc2600088e0).ready entity=mon.1 client_cookie=3a12f6127d6757b7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc27550f700 1 --2- 172.21.15.88:0/3665290742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a2fa0 0x7fc2700a1520 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fc27005efb0 tx=0x7fc2600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc27550f700 1 --2- 172.21.15.88:0/3665290742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a2fa0 0x7fc2700a1520 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fc27005efb0 tx=0x7fc2600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc25ffff700 1 -- 172.21.15.88:0/3665290742 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc260008e40 con 0x7fc2700a2fa0 2020-02-11T16:10:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc27550f700 1 --2- 172.21.15.88:0/3665290742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a2fa0 0x7fc2700a1520 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fc27005efb0 tx=0x7fc2600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc25ffff700 1 -- 172.21.15.88:0/3665290742 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2600115b0 con 0x7fc2700a2fa0 2020-02-11T16:10:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc25ffff700 1 -- 172.21.15.88:0/3665290742 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc260011950 con 0x7fc2700a2fa0 2020-02-11T16:10:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc277773700 1 -- 172.21.15.88:0/3665290742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a2fa0 msgr2=0x7fc2700a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc277773700 1 --2- 172.21.15.88:0/3665290742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a2fa0 0x7fc2700a1520 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fc27005efb0 tx=0x7fc2600088e0).stop 2020-02-11T16:10:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc277773700 1 -- 172.21.15.88:0/3665290742 shutdown_connections 2020-02-11T16:10:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc277773700 1 --2- 172.21.15.88:0/3665290742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc270131990 0x7fc2700a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc277773700 1 --2- 172.21.15.88:0/3665290742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a2fa0 0x7fc2700a1520 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.760+0000 7fc277773700 1 -- 172.21.15.88:0/3665290742 >> 172.21.15.88:0/3665290742 conn(0x7fc27009d110 msgr2=0x7fc27009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.761+0000 7fc277773700 1 -- 172.21.15.88:0/3665290742 shutdown_connections 2020-02-11T16:10:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.761+0000 7fc277773700 1 -- 172.21.15.88:0/3665290742 wait complete. 2020-02-11T16:10:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.761+0000 7fc277773700 1 Processor -- start 2020-02-11T16:10:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.761+0000 7fc277773700 1 -- start start 2020-02-11T16:10:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc277773700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc2700a5410 0x7fc270064410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc277773700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc270131990 0x7fc270062130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc277773700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc270135340 con 0x7fc2700a2fa0 2020-02-11T16:10:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc277773700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc270061390 con 0x7fc2700a5410 2020-02-11T16:10:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc277773700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc270061630 con 0x7fc270131990 2020-02-11T16:10:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc274d0e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc2700a5410 0x7fc270064410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc27550f700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc2700a2fa0 0x7fc270130670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41774/0 (socket says 172.21.15.88:41774) 2020-02-11T16:10:19.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc274d0e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc2700a5410 0x7fc270064410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54150/0 (socket says 172.21.15.88:54150) 2020-02-11T16:10:19.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc27550f700 1 -- 172.21.15.88:0/1628104320 learned_addr learned my addr 172.21.15.88:0/1628104320 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:19.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc275d10700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc270131990 0x7fc270062130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:19.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc274d0e700 1 -- 172.21.15.88:0/1628104320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc270131990 msgr2=0x7fc270062130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:19.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc270131990 0x7fc270062130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:19.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc25e7fc700 1 -- 172.21.15.88:0/1628104320 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375925705 0 0) 0x7fc2700a3a40 con 0x7fc2700a2fa0 2020-02-11T16:10:19.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc274d0e700 1 -- 172.21.15.88:0/1628104320 >> v1:172.21.15.88:6789/0 conn(0x7fc2700a2fa0 legacy=0x7fc270130670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:19.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc274d0e700 1 -- 172.21.15.88:0/1628104320 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2700618d0 con 0x7fc2700a5410 2020-02-11T16:10:19.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.762+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> v2:172.21.15.88:3300/0 conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> v2:172.21.15.88:3300/0 conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:19.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc25e7fc700 1 -- 172.21.15.88:0/1628104320 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc26c005ca0 con 0x7fc2700a5410 2020-02-11T16:10:19.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc25e7fc700 1 -- 172.21.15.88:0/1628104320 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c005e00 con 0x7fc2700a5410 2020-02-11T16:10:19.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc277773700 1 -- 172.21.15.88:0/1628104320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc270061080 con 0x7fc2700a5410 2020-02-11T16:10:19.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc25e7fc700 1 -- 172.21.15.88:0/1628104320 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc26c0062b0 con 0x7fc2700a5410 2020-02-11T16:10:19.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc277773700 1 -- 172.21.15.88:0/1628104320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc270130d80 con 0x7fc2700a5410 2020-02-11T16:10:19.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc25e7fc700 1 -- 172.21.15.88:0/1628104320 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc26c0064e0 con 0x7fc2700a5410 2020-02-11T16:10:19.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.763+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.764+0000 7fc25e7fc700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc250039a10 0x7fc25003bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:19.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.764+0000 7fc25e7fc700 1 -- 172.21.15.88:0/1628104320 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc26c049930 con 0x7fc2700a5410 2020-02-11T16:10:19.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.764+0000 7fc27550f700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc250039a10 0x7fc25003bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:19.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.764+0000 7fc277773700 1 -- 172.21.15.88:0/1628104320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc270061a60 con 0x7fc2700a5410 2020-02-11T16:10:19.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.764+0000 7fc27550f700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc250039a10 0x7fc25003bed0 crc :-1 s=READY pgs=194 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:19.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.767+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.767+0000 7fc25e7fc700 1 -- 172.21.15.88:0/1628104320 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc26c02ef70 con 0x7fc2700a5410 2020-02-11T16:10:19.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.951+0000 7fc277773700 1 -- 172.21.15.88:0/1628104320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fc2700565b0 con 0x7fc2700a5410 2020-02-11T16:10:19.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.952+0000 7fc274d0e700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:19.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.953+0000 7fc25e7fc700 1 -- 172.21.15.88:0/1628104320 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fc26c031a80 con 0x7fc2700a5410 2020-02-11T16:10:19.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 -- 172.21.15.88:0/1628104320 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc250039a10 msgr2=0x7fc25003bed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:19.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc250039a10 0x7fc25003bed0 crc :-1 s=READY pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:19.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 -- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 msgr2=0x7fc270064410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:19.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 0x7fc270064410 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fc26c000b80 tx=0x7fc26c0108c0).stop 2020-02-11T16:10:19.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 -- 172.21.15.88:0/1628104320 shutdown_connections 2020-02-11T16:10:19.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc250039a10 0x7fc25003bed0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:19.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc270131990 0x7fc270062130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:19.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 --2- 172.21.15.88:0/1628104320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2700a5410 0x7fc270064410 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:19.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 -- 172.21.15.88:0/1628104320 >> 172.21.15.88:0/1628104320 conn(0x7fc27009d110 msgr2=0x7fc270069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:19.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 -- 172.21.15.88:0/1628104320 shutdown_connections 2020-02-11T16:10:19.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:19.954+0000 7fc277773700 1 -- 172.21.15.88:0/1628104320 wait complete. 2020-02-11T16:10:19.968 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:10:29.968 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:10:29.969 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:10:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.083+0000 7f6efbfb5700 1 Processor -- start 2020-02-11T16:10:30.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.083+0000 7f6efbfb5700 1 -- start start 2020-02-11T16:10:30.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6efbfb5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:30.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6efbfb5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef40a31b0 con 0x7f6ef40a5de0 2020-02-11T16:10:30.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6efbfb5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef40a3570 con 0x7f6ef40a6260 2020-02-11T16:10:30.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6efbfb5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef40a3810 con 0x7f6ef40a18a0 2020-02-11T16:10:30.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54158/0 (socket says 172.21.15.88:54158) 2020-02-11T16:10:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6efa552700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6ef40a6260 0x7f6ef412eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41788/0 (socket says 172.21.15.88:41788) 2020-02-11T16:10:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 -- 172.21.15.88:0/3338237241 learned_addr learned my addr 172.21.15.88:0/3338237241 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 -- 172.21.15.88:0/3338237241 >> v1:172.21.15.88:6789/0 conn(0x7f6ef40a6260 legacy=0x7f6ef412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 -- 172.21.15.88:0/3338237241 >> v1:172.21.15.52:6789/0 conn(0x7f6ef40a5de0 legacy=0x7f6ef412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef8d4f700 1 -- 172.21.15.88:0/3338237241 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93343967 0 0) 0x7f6ef40a3570 con 0x7f6ef40a6260 2020-02-11T16:10:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 -- 172.21.15.88:0/3338237241 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef40a3ab0 con 0x7f6ef40a18a0 2020-02-11T16:10:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 --2- 172.21.15.88:0/3338237241 >> v2:172.21.15.88:3300/0 conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ef0002f30 tx=0x7f6ef00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 --2- 172.21.15.88:0/3338237241 >> v2:172.21.15.88:3300/0 conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ef0002f30 tx=0x7f6ef00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 --2- 172.21.15.88:0/3338237241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f6ef0002f30 tx=0x7f6ef00088e0).ready entity=mon.1 client_cookie=588d8cf8880f4ac3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 --2- 172.21.15.88:0/3338237241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f6ef0002f30 tx=0x7f6ef00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef8d4f700 1 -- 172.21.15.88:0/3338237241 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef0011760 con 0x7f6ef40a18a0 2020-02-11T16:10:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.084+0000 7f6ef9d51700 1 --2- 172.21.15.88:0/3338237241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f6ef0002f30 tx=0x7f6ef00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.085+0000 7f6ef9d51700 1 --2- 172.21.15.88:0/3338237241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f6ef0002f30 tx=0x7f6ef00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.085+0000 7f6ef8d4f700 1 -- 172.21.15.88:0/3338237241 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef00118c0 con 0x7f6ef40a18a0 2020-02-11T16:10:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.085+0000 7f6ef8d4f700 1 -- 172.21.15.88:0/3338237241 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef0011ca0 con 0x7f6ef40a18a0 2020-02-11T16:10:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.085+0000 7f6efbfb5700 1 -- 172.21.15.88:0/3338237241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a18a0 msgr2=0x7f6ef40a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.085+0000 7f6efbfb5700 1 --2- 172.21.15.88:0/3338237241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f6ef0002f30 tx=0x7f6ef00088e0).stop 2020-02-11T16:10:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.085+0000 7f6efbfb5700 1 -- 172.21.15.88:0/3338237241 shutdown_connections 2020-02-11T16:10:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.085+0000 7f6efbfb5700 1 --2- 172.21.15.88:0/3338237241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a18a0 0x7f6ef40a6dd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.085+0000 7f6efbfb5700 1 -- 172.21.15.88:0/3338237241 >> 172.21.15.88:0/3338237241 conn(0x7f6ef409d110 msgr2=0x7f6ef409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.085+0000 7f6efbfb5700 1 -- 172.21.15.88:0/3338237241 shutdown_connections 2020-02-11T16:10:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.085+0000 7f6efbfb5700 1 -- 172.21.15.88:0/3338237241 wait complete. 2020-02-11T16:10:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.086+0000 7f6efbfb5700 1 Processor -- start 2020-02-11T16:10:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.086+0000 7f6efbfb5700 1 -- start start 2020-02-11T16:10:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6efbfb5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ef40a5de0 0x7f6ef41365d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6efbfb5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef4138710 con 0x7f6ef40a6260 2020-02-11T16:10:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6efbfb5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef41389b0 con 0x7f6ef40a18a0 2020-02-11T16:10:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6efbfb5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef4138c50 con 0x7f6ef40a5de0 2020-02-11T16:10:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9d51700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6ef40a18a0 0x7f6ef4135bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41790/0 (socket says 172.21.15.88:41790) 2020-02-11T16:10:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9d51700 1 -- 172.21.15.88:0/1583995201 learned_addr learned my addr 172.21.15.88:0/1583995201 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> v2:172.21.15.88:3300/0 conn(0x7f6ef40a5de0 0x7f6ef41365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9550700 1 -- 172.21.15.88:0/1583995201 >> v1:172.21.15.88:6789/0 conn(0x7f6ef40a18a0 legacy=0x7f6ef4135bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9550700 1 -- 172.21.15.88:0/1583995201 >> v1:172.21.15.52:6789/0 conn(0x7f6ef40a6260 legacy=0x7f6ef4128260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ee6ffd700 1 -- 172.21.15.88:0/1583995201 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603323621 0 0) 0x7f6ef41389b0 con 0x7f6ef40a18a0 2020-02-11T16:10:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9550700 1 -- 172.21.15.88:0/1583995201 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4135750 con 0x7f6ef40a5de0 2020-02-11T16:10:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> v2:172.21.15.88:3300/0 conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> v2:172.21.15.88:3300/0 conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ee6ffd700 1 -- 172.21.15.88:0/1583995201 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee80101c0 con 0x7f6ef40a5de0 2020-02-11T16:10:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ee6ffd700 1 -- 172.21.15.88:0/1583995201 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee8010320 con 0x7f6ef40a5de0 2020-02-11T16:10:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6efbfb5700 1 -- 172.21.15.88:0/1583995201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef40a95f0 con 0x7f6ef40a5de0 2020-02-11T16:10:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6ee6ffd700 1 -- 172.21.15.88:0/1583995201 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee80106c0 con 0x7f6ef40a5de0 2020-02-11T16:10:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.087+0000 7f6efbfb5700 1 -- 172.21.15.88:0/1583995201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef4128bb0 con 0x7f6ef40a5de0 2020-02-11T16:10:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.088+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.088+0000 7f6ee6ffd700 1 -- 172.21.15.88:0/1583995201 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6ee8006860 con 0x7f6ef40a5de0 2020-02-11T16:10:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.088+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.088+0000 7f6ee6ffd700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ed4039a20 0x7f6ed403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.088+0000 7f6ee6ffd700 1 -- 172.21.15.88:0/1583995201 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6ee8049d80 con 0x7f6ef40a5de0 2020-02-11T16:10:30.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.088+0000 7f6efbfb5700 1 -- 172.21.15.88:0/1583995201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef40565b0 con 0x7f6ef40a5de0 2020-02-11T16:10:30.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.088+0000 7f6ef9d51700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ed4039a20 0x7f6ed403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.089+0000 7f6ef9d51700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ed4039a20 0x7f6ed403bee0 crc :-1 s=READY pgs=195 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.092+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.092+0000 7f6ee6ffd700 1 -- 172.21.15.88:0/1583995201 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f6ee802f440 con 0x7f6ef40a5de0 2020-02-11T16:10:30.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.273+0000 7f6efbfb5700 1 -- 172.21.15.88:0/1583995201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6ef4138d90 con 0x7f6ef40a5de0 2020-02-11T16:10:30.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.273+0000 7f6ef9550700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.273+0000 7f6ee6ffd700 1 -- 172.21.15.88:0/1583995201 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f6ee80090c0 con 0x7f6ef40a5de0 2020-02-11T16:10:30.276 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:30.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.274+0000 7f6efbfb5700 1 -- 172.21.15.88:0/1583995201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ed4039a20 msgr2=0x7f6ed403bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.275+0000 7f6efbfb5700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ed4039a20 0x7f6ed403bee0 crc :-1 s=READY pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.275+0000 7f6efbfb5700 1 -- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 msgr2=0x7f6ef41365d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.275+0000 7f6efbfb5700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 0x7f6ef41365d0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f6ef405bbc0 tx=0x7f6ee8010d10).stop 2020-02-11T16:10:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.275+0000 7f6efbfb5700 1 -- 172.21.15.88:0/1583995201 shutdown_connections 2020-02-11T16:10:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.275+0000 7f6efbfb5700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ed4039a20 0x7f6ed403bee0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.275+0000 7f6efbfb5700 1 --2- 172.21.15.88:0/1583995201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef40a5de0 0x7f6ef41365d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.275+0000 7f6efbfb5700 1 -- 172.21.15.88:0/1583995201 >> 172.21.15.88:0/1583995201 conn(0x7f6ef409d110 msgr2=0x7f6ef40a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.275+0000 7f6efbfb5700 1 -- 172.21.15.88:0/1583995201 shutdown_connections 2020-02-11T16:10:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.275+0000 7f6efbfb5700 1 -- 172.21.15.88:0/1583995201 wait complete. 2020-02-11T16:10:30.287 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":50,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:30.287 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:10:30.287 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:10:30.287 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:10:30.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.398+0000 7f5ed7396700 1 Processor -- start 2020-02-11T16:10:30.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.398+0000 7f5ed7396700 1 -- start start 2020-02-11T16:10:30.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.399+0000 7f5ed7396700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ed00a73d0 0x7f5ed00a2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:30.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.399+0000 7f5ed7396700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed013b8f0 0x7f5ed0142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:30.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.399+0000 7f5ed7396700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00a2cd0 con 0x7f5ed00a6ff0 2020-02-11T16:10:30.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.399+0000 7f5ed7396700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed0132460 con 0x7f5ed00a73d0 2020-02-11T16:10:30.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.399+0000 7f5ed7396700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00a8630 con 0x7f5ed013b8f0 2020-02-11T16:10:30.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.399+0000 7f5ed4931700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ed00a73d0 0x7f5ed00a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.399+0000 7f5ed5933700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed013b8f0 0x7f5ed0142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.399+0000 7f5ed4931700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ed00a73d0 0x7f5ed00a2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:40158/0 (socket says 172.21.15.88:40158) 2020-02-11T16:10:30.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.399+0000 7f5ed4931700 1 -- 172.21.15.88:0/1401696468 learned_addr learned my addr 172.21.15.88:0/1401696468 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:30.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed4931700 1 -- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed013b8f0 msgr2=0x7f5ed0142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:30.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed013b8f0 0x7f5ed0142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed4931700 1 -- 172.21.15.88:0/1401696468 >> v1:172.21.15.52:6789/0 conn(0x7f5ed00a6ff0 legacy=0x7f5ed013b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ebffff700 1 -- 172.21.15.88:0/1401696468 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038515281 0 0) 0x7f5ed00a2cd0 con 0x7f5ed00a6ff0 2020-02-11T16:10:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed4931700 1 -- 172.21.15.88:0/1401696468 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00a30c0 con 0x7f5ed00a73d0 2020-02-11T16:10:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed5933700 1 --2- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed013b8f0 0x7f5ed0142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:10:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1401696468 >> v2:172.21.15.52:3300/0 conn(0x7f5ed00a73d0 0x7f5ed00a2870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ecc002f30 tx=0x7f5ecc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1401696468 >> v2:172.21.15.52:3300/0 conn(0x7f5ed00a73d0 0x7f5ed00a2870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ecc002f30 tx=0x7f5ecc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed00a73d0 0x7f5ed00a2870 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f5ecc002f30 tx=0x7f5ecc0088e0).ready entity=mon.0 client_cookie=12444ca13af51f93 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed00a73d0 0x7f5ed00a2870 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f5ecc002f30 tx=0x7f5ecc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ebffff700 1 -- 172.21.15.88:0/1401696468 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc0116b0 con 0x7f5ed00a73d0 2020-02-11T16:10:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed00a73d0 0x7f5ed00a2870 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f5ecc002f30 tx=0x7f5ecc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ebffff700 1 -- 172.21.15.88:0/1401696468 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc011810 con 0x7f5ed00a73d0 2020-02-11T16:10:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed00a73d0 0x7f5ed00a2870 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f5ecc002f30 tx=0x7f5ecc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed7396700 1 -- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed00a73d0 msgr2=0x7f5ed00a2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ebffff700 1 -- 172.21.15.88:0/1401696468 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc011bb0 con 0x7f5ed00a73d0 2020-02-11T16:10:30.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.400+0000 7f5ed7396700 1 --2- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed00a73d0 0x7f5ed00a2870 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f5ecc002f30 tx=0x7f5ecc0088e0).stop 2020-02-11T16:10:30.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.401+0000 7f5ed7396700 1 -- 172.21.15.88:0/1401696468 shutdown_connections 2020-02-11T16:10:30.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.401+0000 7f5ed7396700 1 --2- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed013b8f0 0x7f5ed0142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.401+0000 7f5ed7396700 1 --2- 172.21.15.88:0/1401696468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed00a73d0 0x7f5ed00a2870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.401+0000 7f5ed7396700 1 -- 172.21.15.88:0/1401696468 >> 172.21.15.88:0/1401696468 conn(0x7f5ed00ac2d0 msgr2=0x7f5ed00ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.401+0000 7f5ed7396700 1 -- 172.21.15.88:0/1401696468 shutdown_connections 2020-02-11T16:10:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.401+0000 7f5ed7396700 1 -- 172.21.15.88:0/1401696468 wait complete. 2020-02-11T16:10:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.401+0000 7f5ed7396700 1 Processor -- start 2020-02-11T16:10:30.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.401+0000 7f5ed7396700 1 -- start start 2020-02-11T16:10:30.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ed7396700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed00a6ff0 0x7f5ed0130270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ed7396700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ed013b8f0 0x7f5ed01454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ed7396700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00a6650 con 0x7f5ed00a73d0 2020-02-11T16:10:30.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ed7396700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed0132f40 con 0x7f5ed013b8f0 2020-02-11T16:10:30.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ed7396700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed012d7c0 con 0x7f5ed00a6ff0 2020-02-11T16:10:30.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ed4931700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5ed00a73d0 0x7f5ed0133ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41804/0 (socket says 172.21.15.88:41804) 2020-02-11T16:10:30.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ed4931700 1 -- 172.21.15.88:0/1169849180 learned_addr learned my addr 172.21.15.88:0/1169849180 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:30.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462309590 0 0) 0x7f5ed00a6650 con 0x7f5ed00a73d0 2020-02-11T16:10:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ed5933700 1 --2- 172.21.15.88:0/1169849180 >> v2:172.21.15.52:3300/0 conn(0x7f5ed013b8f0 0x7f5ed01454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb0002fe0 con 0x7f5ed00a73d0 2020-02-11T16:10:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.402+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed00a6ff0 0x7f5ed0130270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1987470347 0 0) 0x7f5eb0002fe0 con 0x7f5ed00a73d0 2020-02-11T16:10:30.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5ed00a6650 con 0x7f5ed00a73d0 2020-02-11T16:10:30.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f5ecc011db0 con 0x7f5ed00a73d0 2020-02-11T16:10:30.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed00a6ff0 msgr2=0x7f5ed0130270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed00a6ff0 0x7f5ed0130270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 >> v2:172.21.15.52:3300/0 conn(0x7f5ed013b8f0 msgr2=0x7f5ed01454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 --2- 172.21.15.88:0/1169849180 >> v2:172.21.15.52:3300/0 conn(0x7f5ed013b8f0 0x7f5ed01454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 >> v1:172.21.15.88:6789/0 conn(0x7f5ed00a73d0 legacy=0x7f5ed0133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0005260 0x7f5eb0003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed00a6ff0 0x7f5eb0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0132f40 con 0x7f5eb0005260 2020-02-11T16:10:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed012d7c0 con 0x7f5eb00049b0 2020-02-11T16:10:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00044a0 con 0x7f5ed00a6ff0 2020-02-11T16:10:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0005260 0x7f5eb0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5933700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed00a6ff0 0x7f5eb0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 -- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed00a6ff0 msgr2=0x7f5eb0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ed00a6ff0 0x7f5eb0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 -- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0005260 msgr2=0x7f5eb0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0005260 0x7f5eb0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 -- 172.21.15.88:0/1169849180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed012da60 con 0x7f5eb00049b0 2020-02-11T16:10:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed7396700 1 -- 172.21.15.88:0/1169849180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed012dd00 con 0x7f5eb00049b0 2020-02-11T16:10:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ec0000b80 tx=0x7f5ec0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ec0000b80 tx=0x7f5ec0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f5ec0000b80 tx=0x7f5ec0010c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f5ec0000b80 tx=0x7f5ec0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ec0001e10 con 0x7f5eb00049b0 2020-02-11T16:10:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f5ec0000b80 tx=0x7f5ec0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0012270 con 0x7f5eb00049b0 2020-02-11T16:10:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f5ec0000b80 tx=0x7f5ec0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ed7396700 1 -- 172.21.15.88:0/1169849180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed0144f70 con 0x7f5eb00049b0 2020-02-11T16:10:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.403+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ec0012650 con 0x7f5eb00049b0 2020-02-11T16:10:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.404+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f5ec0000b80 tx=0x7f5ec0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.404+0000 7f5ed7396700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 0x7f5eac0058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.404+0000 7f5ed7396700 1 -- 172.21.15.88:0/1169849180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac005ea0 con 0x7f5eac003420 2020-02-11T16:10:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.404+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 0x7f5eac0058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.404+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5ec00127b0 con 0x7f5eb00049b0 2020-02-11T16:10:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.404+0000 7f5ed5132700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f5ec0000b80 tx=0x7f5ec0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.404+0000 7f5ed4931700 1 -- 172.21.15.88:0/1169849180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5eac006060 con 0x7f5eac003420 2020-02-11T16:10:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.404+0000 7f5ebe7fc700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5eb0041f20 0x7f5eb00443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.404+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 0x7f5eac0058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5ec0049410 con 0x7f5eb00049b0 2020-02-11T16:10:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 0x7f5eac0058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 0x7f5eac0058e0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ed5933700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5eb0041f20 0x7f5eb00443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 0x7f5eac0058e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc007530 con 0x7f5eac003420 2020-02-11T16:10:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ed5933700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5eb0041f20 0x7f5eb00443e0 crc :-1 s=READY pgs=196 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 0x7f5eac0058e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5ecc0056c0 con 0x7f5eac003420 2020-02-11T16:10:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 msgr2=0x7f5eac0058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ebe7fc700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 0x7f5eac0058e0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).stop 2020-02-11T16:10:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 msgr2=0x7f5eac0058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ed5933700 1 -- 172.21.15.88:0/1169849180 reap_dead start 2020-02-11T16:10:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.405+0000 7f5ebe7fc700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac003420 0x7f5eac0058e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.413+0000 7f5ed7396700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 0x7f5eac0068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.413+0000 7f5ed7396700 1 -- 172.21.15.88:0/1169849180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac006dd0 con 0x7f5eac006440 2020-02-11T16:10:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.413+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 0x7f5eac0068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.413+0000 7f5ed4931700 1 -- 172.21.15.88:0/1169849180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5eac006f90 con 0x7f5eac006440 2020-02-11T16:10:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.413+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 0x7f5eac0068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.413+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 0x7f5eac0068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.413+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 0x7f5eac0068f0 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 0x7f5eac0068f0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc00eca0 con 0x7f5eac006440 2020-02-11T16:10:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed4931700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 0x7f5eac0068f0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f5ecc005e60 con 0x7f5eac006440 2020-02-11T16:10:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 msgr2=0x7f5eac0068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ebe7fc700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 0x7f5eac0068f0 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).stop 2020-02-11T16:10:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ebe7fc700 1 -- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 msgr2=0x7f5eac0068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ebe7fc700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 0x7f5eac0068f0 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0x7f5ecc002ef0 tx=0x7f5ed0138ce0).stop 2020-02-11T16:10:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 -- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5eb0041f20 msgr2=0x7f5eb00443e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5eb0041f20 0x7f5eb00443e0 crc :-1 s=READY pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 -- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 msgr2=0x7f5eb0004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f5ec0000b80 tx=0x7f5ec0010c50).stop 2020-02-11T16:10:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 -- 172.21.15.88:0/1169849180 shutdown_connections 2020-02-11T16:10:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb00049b0 0x7f5eb0004d90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5eb0041f20 0x7f5eb00443e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 --2- 172.21.15.88:0/1169849180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eac006440 0x7f5eac0068f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 -- 172.21.15.88:0/1169849180 >> 172.21.15.88:0/1169849180 conn(0x7f5ed00ac2d0 msgr2=0x7f5ed00ac6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 -- 172.21.15.88:0/1169849180 shutdown_connections 2020-02-11T16:10:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.414+0000 7f5ed7396700 1 -- 172.21.15.88:0/1169849180 wait complete. 2020-02-11T16:10:30.752 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:10:30.752 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:30.753 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:30.753 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:10:30.753 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 50, 2020-02-11T16:10:30.753 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:10:30.753 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:10:30.753 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:10:30.753 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:10:30.754 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.754 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:10:30.754 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:30.754 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:10:30.754 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:10:30.754 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:30.754 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:30.755 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:30.755 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:30.755 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:30.755 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:30.755 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.755 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:10:30.756 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:10:30.756 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:30.756 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:30.756 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:30.756 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:30.756 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:30.756 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:30.757 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.757 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:10:30.757 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:10:30.757 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:10:30.757 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:10:30.757 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:10:30.758 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:10:30.758 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:30.758 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:30.758 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:10:30.758 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:10:30.758 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:30.758 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:10:30.759 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:30.759 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:30.759 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:30.759 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:30.759 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:30.759 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:30.759 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.760 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:10:30.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.760 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:10:30.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.760 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:30.760 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:30.760 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:30.760 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:30.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.761 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:30.761 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:10:30.761 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.761 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:30.762 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:10:30.762 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.762 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.762 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.762 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:10:30.762 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:10:30.763 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:30.763 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:30.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.763 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:30.763 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:30.763 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:30.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:30.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.764 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:30.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:10:30.764 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.765 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:30.765 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:10:30.765 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.765 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.765 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.765 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:10:30.766 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:10:30.766 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:30.766 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:30.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.766 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:10:30.766 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:10:30.767 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:30.767 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:30.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.767 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:30.767 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:10:30.767 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.768 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:30.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:10:30.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.768 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.769 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.769 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:10:30.769 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:10:30.769 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:30.769 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:30.770 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.770 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.770 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:10:30.770 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:10:30.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.770 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:10:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:10:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:10:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:10:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:10:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:10:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:10:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.775 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:10:30.775 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:10:30.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.882+0000 7f22c15d2700 1 Processor -- start 2020-02-11T16:10:30.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.882+0000 7f22c15d2700 1 -- start start 2020-02-11T16:10:30.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.883+0000 7f22c15d2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22bc0a4ec0 0x7f22bc12f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:30.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.883+0000 7f22c15d2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc0a5560 con 0x7f22bc12fcf0 2020-02-11T16:10:30.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.883+0000 7f22c15d2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc09e060 con 0x7f22bc0a7120 2020-02-11T16:10:30.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.883+0000 7f22c15d2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc0a5350 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.883+0000 7f22ba7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22bc0a4ec0 0x7f22bc12f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.883+0000 7f22baffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f22bc0a7120 0x7f22bc0a39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41820/0 (socket says 172.21.15.88:41820) 2020-02-11T16:10:30.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.883+0000 7f22baffd700 1 -- 172.21.15.88:0/3223456723 learned_addr learned my addr 172.21.15.88:0/3223456723 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:30.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.883+0000 7f22ba7fc700 1 -- 172.21.15.88:0/3223456723 >> v1:172.21.15.88:6789/0 conn(0x7f22bc0a7120 legacy=0x7f22bc0a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22ba7fc700 1 -- 172.21.15.88:0/3223456723 >> v1:172.21.15.52:6789/0 conn(0x7f22bc12fcf0 legacy=0x7f22bc140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22ba7fc700 1 -- 172.21.15.88:0/3223456723 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc09e300 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3223456723 >> v2:172.21.15.88:3300/0 conn(0x7f22bc0a4ec0 0x7f22bc12f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f22ac002f30 tx=0x7f22ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3223456723 >> v2:172.21.15.88:3300/0 conn(0x7f22bc0a4ec0 0x7f22bc12f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f22ac002f30 tx=0x7f22ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3223456723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc12f890 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f22ac002f30 tx=0x7f22ac0088e0).ready entity=mon.1 client_cookie=c07bbddcf5f00d2a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3223456723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc12f890 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f22ac002f30 tx=0x7f22ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3223456723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc12f890 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f22ac002f30 tx=0x7f22ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3223456723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc12f890 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f22ac002f30 tx=0x7f22ac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22b9ffb700 1 -- 172.21.15.88:0/3223456723 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22ac008e40 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22b9ffb700 1 -- 172.21.15.88:0/3223456723 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac0116a0 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22b9ffb700 1 -- 172.21.15.88:0/3223456723 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22ac011a80 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22c15d2700 1 -- 172.21.15.88:0/3223456723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22bc0a4ec0 msgr2=0x7f22bc12f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22c15d2700 1 --2- 172.21.15.88:0/3223456723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc12f890 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f22ac002f30 tx=0x7f22ac0088e0).stop 2020-02-11T16:10:30.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22c15d2700 1 -- 172.21.15.88:0/3223456723 shutdown_connections 2020-02-11T16:10:30.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22c15d2700 1 --2- 172.21.15.88:0/3223456723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc12f890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22c15d2700 1 -- 172.21.15.88:0/3223456723 >> 172.21.15.88:0/3223456723 conn(0x7f22bc09d110 msgr2=0x7f22bc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:30.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22c15d2700 1 -- 172.21.15.88:0/3223456723 shutdown_connections 2020-02-11T16:10:30.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.884+0000 7f22c15d2700 1 -- 172.21.15.88:0/3223456723 wait complete. 2020-02-11T16:10:30.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.885+0000 7f22c15d2700 1 Processor -- start 2020-02-11T16:10:30.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.885+0000 7f22c15d2700 1 -- start start 2020-02-11T16:10:30.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22c15d2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22bc0a4ec0 0x7f22bc0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22c15d2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc148950 con 0x7f22bc0a7120 2020-02-11T16:10:30.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22c15d2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc148bf0 con 0x7f22bc12fcf0 2020-02-11T16:10:30.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22c15d2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc133a40 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22bb7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f22bc12fcf0 0x7f22bc127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41828/0 (socket says 172.21.15.88:41828) 2020-02-11T16:10:30.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22bb7fe700 1 -- 172.21.15.88:0/3692208145 learned_addr learned my addr 172.21.15.88:0/3692208145 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:30.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22baffd700 1 --2- 172.21.15.88:0/3692208145 >> v2:172.21.15.52:3300/0 conn(0x7f22bc0a4ec0 0x7f22bc0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190533835 0 0) 0x7f22bc148bf0 con 0x7f22bc12fcf0 2020-02-11T16:10:30.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2298002fe0 con 0x7f22bc12fcf0 2020-02-11T16:10:30.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1866281119 0 0) 0x7f2298002fe0 con 0x7f22bc12fcf0 2020-02-11T16:10:30.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f22bc148bf0 con 0x7f22bc12fcf0 2020-02-11T16:10:30.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f22b4001c30 con 0x7f22bc12fcf0 2020-02-11T16:10:30.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22baffd700 1 -- 172.21.15.88:0/3692208145 >> v1:172.21.15.88:6789/0 conn(0x7f22bc12fcf0 legacy=0x7f22bc127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.886+0000 7f22baffd700 1 -- 172.21.15.88:0/3692208145 >> v1:172.21.15.52:6789/0 conn(0x7f22bc0a7120 legacy=0x7f22bc149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22baffd700 1 -- 172.21.15.88:0/3692208145 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc09fa30 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22baffd700 1 --2- 172.21.15.88:0/3692208145 >> v2:172.21.15.52:3300/0 conn(0x7f22bc0a4ec0 0x7f22bc0a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22bc05ef00 tx=0x7f22b00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22baffd700 1 --2- 172.21.15.88:0/3692208145 >> v2:172.21.15.52:3300/0 conn(0x7f22bc0a4ec0 0x7f22bc0a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22bc05ef00 tx=0x7f22b00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22baffd700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc0a1520 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f22bc05ef00 tx=0x7f22b00107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22baffd700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc0a1520 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f22bc05ef00 tx=0x7f22b00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b0005a90 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22baffd700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc0a1520 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f22bc05ef00 tx=0x7f22b00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22c15d2700 1 -- 172.21.15.88:0/3692208145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc127d10 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b0011e90 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22baffd700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc0a1520 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f22bc05ef00 tx=0x7f22b00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b0005de0 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22c15d2700 1 -- 172.21.15.88:0/3692208145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc065650 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.887+0000 7f22baffd700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc0a1520 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f22bc05ef00 tx=0x7f22b00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22c15d2700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 0x7f22bc05a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22c15d2700 1 -- 172.21.15.88:0/3692208145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc05e2f0 con 0x7f22bc12b530 2020-02-11T16:10:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f22b000a320 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 0x7f22bc05a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22baffd700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc0a1520 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f22bc05ef00 tx=0x7f22b00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22abfff700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f229803a1a0 0x7f229803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f22b00494c0 con 0x7f22bc0a4ec0 2020-02-11T16:10:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22ba7fc700 1 -- 172.21.15.88:0/3692208145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22bc133b80 con 0x7f22bc12b530 2020-02-11T16:10:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 0x7f22bc05a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22bb7fe700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f229803a1a0 0x7f229803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 0x7f22bc05a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 0x7f22bc05a5d0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 0x7f22bc05a5d0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.888+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22ac011b20 con 0x7f22bc12b530 2020-02-11T16:10:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.889+0000 7f22bb7fe700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f229803a1a0 0x7f229803c660 crc :-1 s=READY pgs=197 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.889+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 0x7f22bc05a5d0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.889+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f22ac007150 con 0x7f22bc12b530 2020-02-11T16:10:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.889+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 msgr2=0x7f22bc05a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.889+0000 7f22abfff700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 0x7f22bc05a5d0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).stop 2020-02-11T16:10:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.889+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 msgr2=0x7f22bc05a5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.889+0000 7f22abfff700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b530 0x7f22bc05a5d0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).stop 2020-02-11T16:10:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.897+0000 7f22c15d2700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 0x7f22bc05aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.897+0000 7f22c15d2700 1 -- 172.21.15.88:0/3692208145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc127f00 con 0x7f22bc12b910 2020-02-11T16:10:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.897+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 0x7f22bc05aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.897+0000 7f22ba7fc700 1 -- 172.21.15.88:0/3692208145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f22bc0a1a00 con 0x7f22bc12b910 2020-02-11T16:10:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.897+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 0x7f22bc05aa30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.897+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 0x7f22bc05aa30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.897+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 0x7f22bc05aa30 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 0x7f22bc05aa30 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22ac00c730 con 0x7f22bc12b910 2020-02-11T16:10:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22ba7fc700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 0x7f22bc05aa30 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4192 (secure 0 0 0) 0x7f22ac00c890 con 0x7f22bc12b910 2020-02-11T16:10:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 msgr2=0x7f22bc05aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22abfff700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 0x7f22bc05aa30 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f22bc09f960 tx=0x7f22bc0a11a0).stop 2020-02-11T16:10:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22abfff700 1 -- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 msgr2=0x7f22bc05aa30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22abfff700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc12b910 0x7f22bc05aa30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22c15d2700 1 -- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f229803a1a0 msgr2=0x7f229803c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22c15d2700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f229803a1a0 0x7f229803c660 crc :-1 s=READY pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22c15d2700 1 -- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc0a4ec0 msgr2=0x7f22bc0a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22c15d2700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc0a1520 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f22bc05ef00 tx=0x7f22b00107f0).stop 2020-02-11T16:10:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22bb7fe700 1 -- 172.21.15.88:0/3692208145 reap_dead start 2020-02-11T16:10:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22c15d2700 1 -- 172.21.15.88:0/3692208145 shutdown_connections 2020-02-11T16:10:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22c15d2700 1 --2- 172.21.15.88:0/3692208145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22bc0a4ec0 0x7f22bc0a1520 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22c15d2700 1 -- 172.21.15.88:0/3692208145 >> 172.21.15.88:0/3692208145 conn(0x7f22bc09d110 msgr2=0x7f22bc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22c15d2700 1 -- 172.21.15.88:0/3692208145 shutdown_connections 2020-02-11T16:10:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:30.898+0000 7f22c15d2700 1 -- 172.21.15.88:0/3692208145 wait complete. 2020-02-11T16:10:30.915 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:10:30.915 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:30.916 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:30.916 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:10:30.916 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 50, 2020-02-11T16:10:30.916 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:10:30.916 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:10:30.916 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:10:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:10:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 16, 2020-02-11T16:10:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:10:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:10:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:10:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:10:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:10:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:10:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:10:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:10:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:10:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:10:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:10:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:10:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:10:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:10:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:10:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:10:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:10:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:10:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:10:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:10:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:10:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:10:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:10:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:10:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:10:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:10:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:10:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:10:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:10:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:10:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:10:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:10:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:10:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.941 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:30.941 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:30.941 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:10:30.941 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.941 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:30.941 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:10:30.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:30.942 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:30.942 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:30.942 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:10:30.942 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.942 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:30.943 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:30.943 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:10:30.943 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:10:31.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.048+0000 7f7b658af700 1 Processor -- start 2020-02-11T16:10:31.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.048+0000 7f7b658af700 1 -- start start 2020-02-11T16:10:31.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.048+0000 7f7b658af700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a3f40 0x7f7b60137790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:31.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.048+0000 7f7b658af700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b60137bf0 0x7f7b60138080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:31.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.048+0000 7f7b658af700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b600a22b0 con 0x7f7b6005b1e0 2020-02-11T16:10:31.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.048+0000 7f7b658af700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b600a2550 con 0x7f7b60137bf0 2020-02-11T16:10:31.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.048+0000 7f7b658af700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600a3a30 con 0x7f7b600a3f40 2020-02-11T16:10:31.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.048+0000 7f7b650ae700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b60137bf0 0x7f7b60138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b60137bf0 0x7f7b60138080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54214/0 (socket says 172.21.15.88:54214) 2020-02-11T16:10:31.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 -- 172.21.15.88:0/3317625077 learned_addr learned my addr 172.21.15.88:0/3317625077 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:31.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b5ffff700 1 --2- 172.21.15.88:0/3317625077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a3f40 0x7f7b60137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 -- 172.21.15.88:0/3317625077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a3f40 msgr2=0x7f7b60137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:31.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 --2- 172.21.15.88:0/3317625077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a3f40 0x7f7b60137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:31.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 -- 172.21.15.88:0/3317625077 >> v1:172.21.15.52:6789/0 conn(0x7f7b6005b1e0 legacy=0x7f7b600a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:31.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 -- 172.21.15.88:0/3317625077 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b601384e0 con 0x7f7b60137bf0 2020-02-11T16:10:31.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b5ffff700 1 --2- 172.21.15.88:0/3317625077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a3f40 0x7f7b60137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:10:31.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 --2- 172.21.15.88:0/3317625077 >> v2:172.21.15.88:3300/0 conn(0x7f7b60137bf0 0x7f7b60138080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b600a5dd0 tx=0x7f7b58008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 --2- 172.21.15.88:0/3317625077 >> v2:172.21.15.88:3300/0 conn(0x7f7b60137bf0 0x7f7b60138080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b600a5dd0 tx=0x7f7b58008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 --2- 172.21.15.88:0/3317625077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b60138080 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b58008c60).ready entity=mon.1 client_cookie=6ca01f78d665bba5 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:31.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 --2- 172.21.15.88:0/3317625077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b60138080 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b58008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b5f7fe700 1 -- 172.21.15.88:0/3317625077 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b5800b350 con 0x7f7b60137bf0 2020-02-11T16:10:31.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 --2- 172.21.15.88:0/3317625077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b60138080 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b58008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b650ae700 1 --2- 172.21.15.88:0/3317625077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b60138080 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b58008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b5f7fe700 1 -- 172.21.15.88:0/3317625077 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5800b4b0 con 0x7f7b60137bf0 2020-02-11T16:10:31.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b5f7fe700 1 -- 172.21.15.88:0/3317625077 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b5800b850 con 0x7f7b60137bf0 2020-02-11T16:10:31.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b658af700 1 -- 172.21.15.88:0/3317625077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 msgr2=0x7f7b60138080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.049+0000 7f7b658af700 1 --2- 172.21.15.88:0/3317625077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b60138080 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b58008c60).stop 2020-02-11T16:10:31.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.050+0000 7f7b658af700 1 -- 172.21.15.88:0/3317625077 shutdown_connections 2020-02-11T16:10:31.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.050+0000 7f7b658af700 1 --2- 172.21.15.88:0/3317625077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b60138080 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:31.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.050+0000 7f7b658af700 1 --2- 172.21.15.88:0/3317625077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a3f40 0x7f7b60137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.050+0000 7f7b658af700 1 -- 172.21.15.88:0/3317625077 >> 172.21.15.88:0/3317625077 conn(0x7f7b600a9fb0 msgr2=0x7f7b600aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.050+0000 7f7b658af700 1 -- 172.21.15.88:0/3317625077 shutdown_connections 2020-02-11T16:10:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.050+0000 7f7b658af700 1 -- 172.21.15.88:0/3317625077 wait complete. 2020-02-11T16:10:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.050+0000 7f7b658af700 1 Processor -- start 2020-02-11T16:10:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.050+0000 7f7b658af700 1 -- start start 2020-02-11T16:10:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.051+0000 7f7b658af700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6005b1e0 0x7f7b60099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.051+0000 7f7b658af700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b60137bf0 0x7f7b6009a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.051+0000 7f7b658af700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6009a610 con 0x7f7b600a3f40 2020-02-11T16:10:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.051+0000 7f7b658af700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6009cd50 con 0x7f7b60137bf0 2020-02-11T16:10:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.051+0000 7f7b658af700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6009cff0 con 0x7f7b6005b1e0 2020-02-11T16:10:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.051+0000 7f7b650ae700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b60137bf0 0x7f7b6009a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.051+0000 7f7b650ae700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b60137bf0 0x7f7b6009a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54220/0 (socket says 172.21.15.88:54220) 2020-02-11T16:10:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.051+0000 7f7b650ae700 1 -- 172.21.15.88:0/2446460112 learned_addr learned my addr 172.21.15.88:0/2446460112 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.051+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6005b1e0 0x7f7b60099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 -- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6005b1e0 msgr2=0x7f7b60099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6005b1e0 0x7f7b60099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 -- 172.21.15.88:0/2446460112 >> v1:172.21.15.52:6789/0 conn(0x7f7b600a3f40 legacy=0x7f7b6009abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 -- 172.21.15.88:0/2446460112 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600a67a0 con 0x7f7b60137bf0 2020-02-11T16:10:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 --2- 172.21.15.88:0/2446460112 >> v2:172.21.15.88:3300/0 conn(0x7f7b60137bf0 0x7f7b6009a1b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b6009a800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 --2- 172.21.15.88:0/2446460112 >> v2:172.21.15.88:3300/0 conn(0x7f7b60137bf0 0x7f7b6009a1b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b6009a800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b6009a1b0 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b6009a800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b6009a1b0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b6009a800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b6009a1b0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b6009a800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b58005e40 con 0x7f7b60137bf0 2020-02-11T16:10:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b6009a1b0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b6009a800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b58007160 con 0x7f7b60137bf0 2020-02-11T16:10:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b58007540 con 0x7f7b60137bf0 2020-02-11T16:10:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b658af700 1 -- 172.21.15.88:0/2446460112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6009d890 con 0x7f7b60137bf0 2020-02-11T16:10:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b658af700 1 -- 172.21.15.88:0/2446460112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6009c960 con 0x7f7b60137bf0 2020-02-11T16:10:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.052+0000 7f7b650ae700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b6009a1b0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b6009a800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b658af700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 0x7f7b6012db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b658af700 1 -- 172.21.15.88:0/2446460112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6009ce90 con 0x7f7b6009b2f0 2020-02-11T16:10:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7b580077b0 con 0x7f7b60137bf0 2020-02-11T16:10:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b650ae700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b6009a1b0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b6009a800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 0x7f7b6012db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b5dffb700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7b44039d60 0x7f7b4403c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7b5804a470 con 0x7f7b60137bf0 2020-02-11T16:10:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b5ffff700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7b44039d60 0x7f7b4403c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b648ad700 1 -- 172.21.15.88:0/2446460112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b600565b0 con 0x7f7b6009b2f0 2020-02-11T16:10:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 0x7f7b6012db80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 0x7f7b6012db80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 0x7f7b6012db80 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b5ffff700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7b44039d60 0x7f7b4403c220 crc :-1 s=READY pgs=198 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 0x7f7b6012db80 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.053+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b480032b0 con 0x7f7b6009b2f0 2020-02-11T16:10:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.054+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 0x7f7b6012db80 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.054+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f7b48003410 con 0x7f7b6009b2f0 2020-02-11T16:10:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.054+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 msgr2=0x7f7b6012db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.054+0000 7f7b5dffb700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 0x7f7b6012db80 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).stop 2020-02-11T16:10:31.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.054+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 msgr2=0x7f7b6012db80 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:31.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.054+0000 7f7b5dffb700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b6009b2f0 0x7f7b6012db80 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).stop 2020-02-11T16:10:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.062+0000 7f7b658af700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 0x7f7b600a8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.062+0000 7f7b658af700 1 -- 172.21.15.88:0/2446460112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6005e2f0 con 0x7f7b600a83f0 2020-02-11T16:10:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.062+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 0x7f7b600a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b648ad700 1 -- 172.21.15.88:0/2446460112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7b6009d130 con 0x7f7b600a83f0 2020-02-11T16:10:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 0x7f7b600a8800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 0x7f7b600a8800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 0x7f7b600a8800 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 0x7f7b600a8800 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4800b830 con 0x7f7b600a83f0 2020-02-11T16:10:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b648ad700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 0x7f7b600a8800 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f7b48014550 con 0x7f7b600a83f0 2020-02-11T16:10:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 msgr2=0x7f7b600a8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b5dffb700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 0x7f7b600a8800 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).stop 2020-02-11T16:10:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b5dffb700 1 -- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 msgr2=0x7f7b600a8800 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b5dffb700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7b600a83f0 0x7f7b600a8800 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0x7f7b48001fa0 tx=0x7f7b600684d0).stop 2020-02-11T16:10:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.063+0000 7f7b658af700 1 -- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7b44039d60 msgr2=0x7f7b4403c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.064+0000 7f7b658af700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7b44039d60 0x7f7b4403c220 crc :-1 s=READY pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.064+0000 7f7b658af700 1 -- 172.21.15.88:0/2446460112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 msgr2=0x7f7b6009a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.064+0000 7f7b658af700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b6009a1b0 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f7b600a5dd0 tx=0x7f7b6009a800).stop 2020-02-11T16:10:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.064+0000 7f7b650ae700 1 -- 172.21.15.88:0/2446460112 reap_dead start 2020-02-11T16:10:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.064+0000 7f7b650ae700 1 -- 172.21.15.88:0/2446460112 reap_dead start 2020-02-11T16:10:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.064+0000 7f7b658af700 1 -- 172.21.15.88:0/2446460112 shutdown_connections 2020-02-11T16:10:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.064+0000 7f7b658af700 1 --2- 172.21.15.88:0/2446460112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b60137bf0 0x7f7b6009a1b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.064+0000 7f7b658af700 1 -- 172.21.15.88:0/2446460112 >> 172.21.15.88:0/2446460112 conn(0x7f7b600a9fb0 msgr2=0x7f7b600a52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.064+0000 7f7b658af700 1 -- 172.21.15.88:0/2446460112 shutdown_connections 2020-02-11T16:10:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.064+0000 7f7b658af700 1 -- 172.21.15.88:0/2446460112 wait complete. 2020-02-11T16:10:31.076 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:10:31.077 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:10:31.077 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:10:31.077 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:10:31.077 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 50, 2020-02-11T16:10:31.077 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:10:31.077 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:10:31.077 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:10:31.078 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:10:31.078 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:31.078 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 16, 2020-02-11T16:10:31.078 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:31.078 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:10:31.078 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:10:31.078 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:31.079 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:31.079 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:31.079 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:31.079 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:31.079 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:31.079 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:31.079 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:10:31.079 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:10:31.080 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:31.080 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:31.080 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:31.080 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:31.081 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:31.081 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:31.081 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:31.081 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.081 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:10:31.081 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:10:31.081 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:10:31.082 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:10:31.082 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:10:31.082 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:10:31.082 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:31.082 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:31.082 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:10:31.082 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:10:31.083 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:31.083 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:10:31.083 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:31.083 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:31.083 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:31.083 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:31.083 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:31.084 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:31.084 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:31.084 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:10:31.084 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.084 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:10:31.084 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.084 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:31.085 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:31.085 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:31.085 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:31.085 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.085 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:31.085 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:10:31.085 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:31.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.086 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.086 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:31.086 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:10:31.086 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:31.086 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:31.086 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:31.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.087 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:10:31.087 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:10:31.087 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:31.087 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:31.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.087 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:31.088 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:31.088 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:31.088 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:31.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.088 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:31.088 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:10:31.088 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:31.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.089 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.089 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:31.089 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:10:31.089 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:31.089 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:31.089 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:31.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.090 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:10:31.090 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:10:31.090 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:31.090 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:31.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.090 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.090 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:10:31.091 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:10:31.091 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:31.091 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:31.091 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.091 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:31.091 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:10:31.092 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:31.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.092 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:31.092 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:10:31.092 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:31.092 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:31.092 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:31.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.093 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:10:31.093 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:10:31.093 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:31.093 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:31.093 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:31.093 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:31.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:31.094 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:10:31.094 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:10:31.094 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.094 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:31.094 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:31.094 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:31.095 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:31.095 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:31.095 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:10:31.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:31.095 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:31.095 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:31.095 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:31.095 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:31.096 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:31.096 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:31.096 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:10:31.097 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2020-02-11T16:10:31.097 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:10:31.097 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2020-02-11T16:10:31.097 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:10:31.098 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-02-11T16:10:31.098 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:10:31.108 INFO:tasks.ceph.mon.c:Stopped 2020-02-11T16:10:31.108 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:10:31.109 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:10:31.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.211+0000 7fe6a1d61700 1 Processor -- start 2020-02-11T16:10:31.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.211+0000 7fe6a1d61700 1 -- start start 2020-02-11T16:10:31.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe6a1d61700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe69c0a2fa0 0x7fe69c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:31.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe6a1d61700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 0x7fe69c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:31.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe6a1d61700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c0a4350 con 0x7fe69c0a5410 2020-02-11T16:10:31.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe6a1d61700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c0a1e60 con 0x7fe69c0a2fa0 2020-02-11T16:10:31.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe6a1d61700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0a3450 con 0x7fe69c131990 2020-02-11T16:10:31.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe69c0a2fa0 0x7fe69c0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe69c0a2fa0 0x7fe69c0a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54228/0 (socket says 172.21.15.88:54228) 2020-02-11T16:10:31.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 -- 172.21.15.88:0/1105625878 learned_addr learned my addr 172.21.15.88:0/1105625878 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:31.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69bfff700 1 -- 172.21.15.88:0/1105625878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 msgr2=0x7fe69c0a5870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:10:31.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69bfff700 1 --2- 172.21.15.88:0/1105625878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 0x7fe69c0a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:31.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 -- 172.21.15.88:0/1105625878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 msgr2=0x7fe69c0a5870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:10:31.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 --2- 172.21.15.88:0/1105625878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 0x7fe69c0a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:31.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 -- 172.21.15.88:0/1105625878 >> v1:172.21.15.52:6789/0 conn(0x7fe69c0a5410 legacy=0x7fe69c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 -- 172.21.15.88:0/1105625878 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0a3a40 con 0x7fe69c0a2fa0 2020-02-11T16:10:31.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 --2- 172.21.15.88:0/1105625878 >> v2:172.21.15.88:3300/0 conn(0x7fe69c0a2fa0 0x7fe69c0a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe69c05efb0 tx=0x7fe68c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 --2- 172.21.15.88:0/1105625878 >> v2:172.21.15.88:3300/0 conn(0x7fe69c0a2fa0 0x7fe69c0a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe69c05efb0 tx=0x7fe68c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 --2- 172.21.15.88:0/1105625878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0a2fa0 0x7fe69c0a1520 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7fe69c05efb0 tx=0x7fe68c0088e0).ready entity=mon.1 client_cookie=77e9e889db9d9923 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:31.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 --2- 172.21.15.88:0/1105625878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0a2fa0 0x7fe69c0a1520 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fe69c05efb0 tx=0x7fe68c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69a7fc700 1 -- 172.21.15.88:0/1105625878 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe68c012a20 con 0x7fe69c0a2fa0 2020-02-11T16:10:31.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 --2- 172.21.15.88:0/1105625878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0a2fa0 0x7fe69c0a1520 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fe69c05efb0 tx=0x7fe68c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69b7fe700 1 --2- 172.21.15.88:0/1105625878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0a2fa0 0x7fe69c0a1520 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fe69c05efb0 tx=0x7fe68c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69a7fc700 1 -- 172.21.15.88:0/1105625878 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c012b80 con 0x7fe69c0a2fa0 2020-02-11T16:10:31.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe69a7fc700 1 -- 172.21.15.88:0/1105625878 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe68c00b160 con 0x7fe69c0a2fa0 2020-02-11T16:10:31.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe6a1d61700 1 -- 172.21.15.88:0/1105625878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0a2fa0 msgr2=0x7fe69c0a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.212+0000 7fe6a1d61700 1 --2- 172.21.15.88:0/1105625878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0a2fa0 0x7fe69c0a1520 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7fe69c05efb0 tx=0x7fe68c0088e0).stop 2020-02-11T16:10:31.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.213+0000 7fe6a1d61700 1 -- 172.21.15.88:0/1105625878 shutdown_connections 2020-02-11T16:10:31.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.213+0000 7fe6a1d61700 1 --2- 172.21.15.88:0/1105625878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 0x7fe69c0a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:31.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.213+0000 7fe6a1d61700 1 --2- 172.21.15.88:0/1105625878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0a2fa0 0x7fe69c0a1520 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:31.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.213+0000 7fe6a1d61700 1 -- 172.21.15.88:0/1105625878 >> 172.21.15.88:0/1105625878 conn(0x7fe69c09d110 msgr2=0x7fe69c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:31.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.213+0000 7fe6a1d61700 1 -- 172.21.15.88:0/1105625878 shutdown_connections 2020-02-11T16:10:31.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.213+0000 7fe6a1d61700 1 -- 172.21.15.88:0/1105625878 wait complete. 2020-02-11T16:10:31.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.214+0000 7fe6a1d61700 1 Processor -- start 2020-02-11T16:10:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.214+0000 7fe6a1d61700 1 -- start start 2020-02-11T16:10:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe6a1d61700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 0x7fe69c150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe6a1d61700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c1366c0 con 0x7fe69c0a2fa0 2020-02-11T16:10:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe6a1d61700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c1368f0 con 0x7fe69c0a5410 2020-02-11T16:10:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe6a1d61700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c137030 con 0x7fe69c131990 2020-02-11T16:10:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe69bfff700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 msgr2=0x7fe69c150ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:10:31.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe69bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 0x7fe69c150ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:31.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe69affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe69c0a5410 0x7fe69c0a0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41862/0 (socket says 172.21.15.88:41862) 2020-02-11T16:10:31.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe69affd700 1 -- 172.21.15.88:0/514804595 learned_addr learned my addr 172.21.15.88:0/514804595 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:31.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236653858 0 0) 0x7fe69c1368f0 con 0x7fe69c0a5410 2020-02-11T16:10:31.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe67c002fe0 con 0x7fe69c0a5410 2020-02-11T16:10:31.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660687030 0 0) 0x7fe69c1366c0 con 0x7fe69c0a2fa0 2020-02-11T16:10:31.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe69c1368f0 con 0x7fe69c0a2fa0 2020-02-11T16:10:31.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 195690841 0 0) 0x7fe67c002fe0 con 0x7fe69c0a5410 2020-02-11T16:10:31.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe69c1366c0 con 0x7fe69c0a5410 2020-02-11T16:10:31.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe6900019c0 con 0x7fe69c0a5410 2020-02-11T16:10:31.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 msgr2=0x7fe69c150ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:10:31.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 0x7fe69c150ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:31.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 >> v1:172.21.15.88:6789/0 conn(0x7fe69c0a5410 legacy=0x7fe69c0a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 >> v1:172.21.15.52:6789/0 conn(0x7fe69c0a2fa0 legacy=0x7fe69c145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67c004b20 0x7fe67c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 0x7fe67c003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0047f0 con 0x7fe67c004b20 2020-02-11T16:10:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c004960 con 0x7fe67c003f10 2020-02-11T16:10:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c00b750 con 0x7fe69c131990 2020-02-11T16:10:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe69affd700 1 -- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 msgr2=0x7fe67c003ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:10:31.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe69affd700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 0x7fe67c003ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:31.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.215+0000 7fe69b7fe700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67c004b20 0x7fe67c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 -- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 msgr2=0x7fe67c003ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:10:31.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe69c131990 0x7fe67c003ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:31.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 -- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67c004b20 msgr2=0x7fe67c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67c004b20 0x7fe67c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 -- 172.21.15.88:0/514804595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c136b90 con 0x7fe67c003f10 2020-02-11T16:10:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe6a1d61700 1 -- 172.21.15.88:0/514804595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c067110 con 0x7fe67c003f10 2020-02-11T16:10:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe6a1d61700 1 -- 172.21.15.88:0/514804595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c0a0e40 con 0x7fe67c003f10 2020-02-11T16:10:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe69400f610 con 0x7fe67c003f10 2020-02-11T16:10:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69400f770 con 0x7fe67c003f10 2020-02-11T16:10:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe69400e160 con 0x7fe67c003f10 2020-02-11T16:10:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.216+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.217+0000 7fe6a1d61700 1 -- 172.21.15.88:0/514804595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678003340 con 0x7fe67c003f10 2020-02-11T16:10:31.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.217+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe69400e2c0 con 0x7fe67c003f10 2020-02-11T16:10:31.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.217+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.217+0000 7fe698ff9700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe67c0422b0 0x7fe67c044770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:31.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.217+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe694049c10 con 0x7fe67c003f10 2020-02-11T16:10:31.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.217+0000 7fe69b7fe700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe67c0422b0 0x7fe67c044770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:31.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.217+0000 7fe69b7fe700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe67c0422b0 0x7fe67c044770 crc :-1 s=READY pgs=199 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:31.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.220+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.220+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe69402f290 con 0x7fe67c003f10 2020-02-11T16:10:31.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.402+0000 7fe6a1d61700 1 -- 172.21.15.88:0/514804595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe6780036e0 con 0x7fe67c003f10 2020-02-11T16:10:31.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.402+0000 7fe69bfff700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:31.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.402+0000 7fe698ff9700 1 -- 172.21.15.88:0/514804595 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fe694031d60 con 0x7fe67c003f10 2020-02-11T16:10:31.405 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:31.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.404+0000 7fe6a1d61700 1 -- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe67c0422b0 msgr2=0x7fe67c044770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.404+0000 7fe6a1d61700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe67c0422b0 0x7fe67c044770 crc :-1 s=READY pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:31.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.404+0000 7fe6a1d61700 1 -- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 msgr2=0x7fe67c004390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:31.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.404+0000 7fe6a1d61700 1 --2- 172.21.15.88:0/514804595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67c003f10 0x7fe67c004390 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7fe694003800 tx=0x7fe694010c10).stop 2020-02-11T16:10:31.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.404+0000 7fe69bfff700 1 -- 172.21.15.88:0/514804595 reap_dead start 2020-02-11T16:10:31.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.404+0000 7fe69bfff700 1 -- 172.21.15.88:0/514804595 reap_dead start 2020-02-11T16:10:31.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.404+0000 7fe6a1d61700 1 -- 172.21.15.88:0/514804595 shutdown_connections 2020-02-11T16:10:31.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.404+0000 7fe6a1d61700 1 -- 172.21.15.88:0/514804595 >> 172.21.15.88:0/514804595 conn(0x7fe69c09d110 msgr2=0x7fe69c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:31.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.404+0000 7fe6a1d61700 1 -- 172.21.15.88:0/514804595 shutdown_connections 2020-02-11T16:10:31.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:31.404+0000 7fe6a1d61700 1 -- 172.21.15.88:0/514804595 wait complete. 2020-02-11T16:10:31.415 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":50,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:34.416 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:10:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.530+0000 7febec28b700 1 Processor -- start 2020-02-11T16:10:34.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.530+0000 7febec28b700 1 -- start start 2020-02-11T16:10:34.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.530+0000 7febec28b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febe40a18a0 0x7febe40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:34.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.530+0000 7febec28b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febe40a6260 0x7febe412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:34.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.530+0000 7febec28b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40a3570 con 0x7febe40a5de0 2020-02-11T16:10:34.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.530+0000 7febec28b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe40a3810 con 0x7febe40a18a0 2020-02-11T16:10:34.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.530+0000 7febec28b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40a3ab0 con 0x7febe40a6260 2020-02-11T16:10:34.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea828700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febe40a6260 msgr2=0x7febe412eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:10:34.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febe9826700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7febe40a5de0 0x7febe412e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41874/0 (socket says 172.21.15.88:41874) 2020-02-11T16:10:34.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febe9826700 1 -- 172.21.15.88:0/3240060224 learned_addr learned my addr 172.21.15.88:0/3240060224 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:34.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea828700 1 --2- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febe40a6260 0x7febe412eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:34.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 --2- 172.21.15.88:0/3240060224 >> v2:172.21.15.52:3300/0 conn(0x7febe40a18a0 0x7febe40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:34.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 -- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febe40a6260 msgr2=0x7febe412eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:10:34.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 --2- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febe40a6260 0x7febe412eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:34.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 -- 172.21.15.88:0/3240060224 >> v1:172.21.15.88:6789/0 conn(0x7febe40a5de0 legacy=0x7febe412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:34.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 -- 172.21.15.88:0/3240060224 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40a3d50 con 0x7febe40a18a0 2020-02-11T16:10:34.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 --2- 172.21.15.88:0/3240060224 >> v2:172.21.15.52:3300/0 conn(0x7febe40a18a0 0x7febe40a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7febd8002f30 tx=0x7febd80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 --2- 172.21.15.88:0/3240060224 >> v2:172.21.15.52:3300/0 conn(0x7febe40a18a0 0x7febe40a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7febd8002f30 tx=0x7febd80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 --2- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe40a18a0 0x7febe40a6dd0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7febd8002f30 tx=0x7febd80088e0).ready entity=mon.0 client_cookie=c20959f2dfbe6f1e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:34.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 --2- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe40a18a0 0x7febe40a6dd0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7febd8002f30 tx=0x7febd80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febe9025700 1 -- 172.21.15.88:0/3240060224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febd80116a0 con 0x7febe40a18a0 2020-02-11T16:10:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 --2- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe40a18a0 0x7febe40a6dd0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7febd8002f30 tx=0x7febd80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febea027700 1 --2- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe40a18a0 0x7febe40a6dd0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7febd8002f30 tx=0x7febd80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febe9025700 1 -- 172.21.15.88:0/3240060224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd8011800 con 0x7febe40a18a0 2020-02-11T16:10:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febe9025700 1 -- 172.21.15.88:0/3240060224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febd8011be0 con 0x7febe40a18a0 2020-02-11T16:10:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febec28b700 1 -- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe40a18a0 msgr2=0x7febe40a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:34.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.531+0000 7febec28b700 1 --2- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe40a18a0 0x7febe40a6dd0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7febd8002f30 tx=0x7febd80088e0).stop 2020-02-11T16:10:34.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.532+0000 7febec28b700 1 -- 172.21.15.88:0/3240060224 shutdown_connections 2020-02-11T16:10:34.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.532+0000 7febec28b700 1 --2- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febe40a6260 0x7febe412eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:34.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.532+0000 7febec28b700 1 --2- 172.21.15.88:0/3240060224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe40a18a0 0x7febe40a6dd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:34.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.532+0000 7febec28b700 1 -- 172.21.15.88:0/3240060224 >> 172.21.15.88:0/3240060224 conn(0x7febe409d110 msgr2=0x7febe409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:34.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.532+0000 7febec28b700 1 -- 172.21.15.88:0/3240060224 shutdown_connections 2020-02-11T16:10:34.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.532+0000 7febec28b700 1 -- 172.21.15.88:0/3240060224 wait complete. 2020-02-11T16:10:34.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.533+0000 7febec28b700 1 Processor -- start 2020-02-11T16:10:34.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.533+0000 7febec28b700 1 -- start start 2020-02-11T16:10:34.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.533+0000 7febec28b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febe40a5de0 0x7febe4128310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:34.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febec28b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe41368a0 con 0x7febe40a6260 2020-02-11T16:10:34.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febec28b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe4135760 con 0x7febe40a18a0 2020-02-11T16:10:34.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febec28b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe4136ad0 con 0x7febe40a5de0 2020-02-11T16:10:34.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febe40a5de0 0x7febe4128310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:34.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febe40a5de0 0x7febe4128310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54254/0 (socket says 172.21.15.88:54254) 2020-02-11T16:10:34.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febea027700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7febe40a18a0 0x7febe4136e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41880/0 (socket says 172.21.15.88:41880) 2020-02-11T16:10:34.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 -- 172.21.15.88:0/2571814136 learned_addr learned my addr 172.21.15.88:0/2571814136 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:34.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 -- 172.21.15.88:0/2571814136 >> v1:172.21.15.88:6789/0 conn(0x7febe40a18a0 legacy=0x7febe4136e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:34.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 -- 172.21.15.88:0/2571814136 >> v1:172.21.15.52:6789/0 conn(0x7febe40a6260 legacy=0x7febe4128770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:34.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 -- 172.21.15.88:0/2571814136 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4138460 con 0x7febe40a5de0 2020-02-11T16:10:34.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 --2- 172.21.15.88:0/2571814136 >> v2:172.21.15.88:3300/0 conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 --2- 172.21.15.88:0/2571814136 >> v2:172.21.15.88:3300/0 conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:34.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febd77fe700 1 -- 172.21.15.88:0/2571814136 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe000c950 con 0x7febe40a5de0 2020-02-11T16:10:34.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febec28b700 1 -- 172.21.15.88:0/2571814136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe4138e10 con 0x7febe40a5de0 2020-02-11T16:10:34.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febd77fe700 1 -- 172.21.15.88:0/2571814136 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000cab0 con 0x7febe40a5de0 2020-02-11T16:10:34.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febe9826700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febd77fe700 1 -- 172.21.15.88:0/2571814136 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe000ce90 con 0x7febe40a5de0 2020-02-11T16:10:34.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.534+0000 7febec28b700 1 -- 172.21.15.88:0/2571814136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe4135bc0 con 0x7febe40a5de0 2020-02-11T16:10:34.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.535+0000 7febe9826700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.535+0000 7febd77fe700 1 -- 172.21.15.88:0/2571814136 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7febe00055c0 con 0x7febe40a5de0 2020-02-11T16:10:34.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.535+0000 7febe9826700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.535+0000 7febd77fe700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febc4039bf0 0x7febc403c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:34.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.535+0000 7febd77fe700 1 -- 172.21.15.88:0/2571814136 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7febe00495e0 con 0x7febe40a5de0 2020-02-11T16:10:34.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.535+0000 7febec28b700 1 -- 172.21.15.88:0/2571814136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe40565b0 con 0x7febe40a5de0 2020-02-11T16:10:34.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.536+0000 7febea027700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febc4039bf0 0x7febc403c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:34.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.536+0000 7febea027700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febc4039bf0 0x7febc403c0b0 crc :-1 s=READY pgs=200 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:34.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.539+0000 7febe9826700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.539+0000 7febd77fe700 1 -- 172.21.15.88:0/2571814136 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7febe002eb40 con 0x7febe40a5de0 2020-02-11T16:10:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.720+0000 7febec28b700 1 -- 172.21.15.88:0/2571814136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7febe405ccb0 con 0x7febe40a5de0 2020-02-11T16:10:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.720+0000 7febe9826700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.720+0000 7febd77fe700 1 -- 172.21.15.88:0/2571814136 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7febe0008510 con 0x7febe40a5de0 2020-02-11T16:10:34.724 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.722+0000 7febec28b700 1 -- 172.21.15.88:0/2571814136 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febc4039bf0 msgr2=0x7febc403c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.722+0000 7febec28b700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febc4039bf0 0x7febc403c0b0 crc :-1 s=READY pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.722+0000 7febec28b700 1 -- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 msgr2=0x7febe4128310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.722+0000 7febec28b700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 0x7febe4128310 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7febe41379a0 tx=0x7febe00013a0).stop 2020-02-11T16:10:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.722+0000 7febec28b700 1 -- 172.21.15.88:0/2571814136 shutdown_connections 2020-02-11T16:10:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.722+0000 7febec28b700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febc4039bf0 0x7febc403c0b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.722+0000 7febec28b700 1 --2- 172.21.15.88:0/2571814136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe40a5de0 0x7febe4128310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.722+0000 7febec28b700 1 -- 172.21.15.88:0/2571814136 >> 172.21.15.88:0/2571814136 conn(0x7febe409d110 msgr2=0x7febe40a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.722+0000 7febec28b700 1 -- 172.21.15.88:0/2571814136 shutdown_connections 2020-02-11T16:10:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:34.722+0000 7febec28b700 1 -- 172.21.15.88:0/2571814136 wait complete. 2020-02-11T16:10:34.735 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":50,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:37.736 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:10:37.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.849+0000 7fb8ff6fe700 1 Processor -- start 2020-02-11T16:10:37.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.849+0000 7fb8ff6fe700 1 -- start start 2020-02-11T16:10:37.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8ff6fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8f80a18a0 0x7fb8f80a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:37.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8ff6fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8f80a5de0 0x7fb8f80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:37.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8ff6fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8f812e3a0 0x7fb8f812e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:37.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8ff6fe700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80a3570 con 0x7fb8f812e3a0 2020-02-11T16:10:37.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8ff6fe700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80a3810 con 0x7fb8f80a5de0 2020-02-11T16:10:37.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8ff6fe700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80a3ab0 con 0x7fb8f80a18a0 2020-02-11T16:10:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fd49a700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8f80a18a0 msgr2=0x7fb8f80a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:10:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fd49a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8f80a18a0 0x7fb8f80a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8f80a5de0 0x7fb8f80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8f80a5de0 0x7fb8f80a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54262/0 (socket says 172.21.15.88:54262) 2020-02-11T16:10:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 -- 172.21.15.88:0/2704214778 learned_addr learned my addr 172.21.15.88:0/2704214778 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fdc9b700 1 --2- 172.21.15.88:0/2704214778 >> v2:172.21.15.52:3300/0 conn(0x7fb8f812e3a0 0x7fb8f812e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 -- 172.21.15.88:0/2704214778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8f80a18a0 msgr2=0x7fb8f80a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:10:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2704214778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8f80a18a0 0x7fb8f80a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 -- 172.21.15.88:0/2704214778 >> v2:172.21.15.52:3300/0 conn(0x7fb8f812e3a0 msgr2=0x7fb8f812e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2704214778 >> v2:172.21.15.52:3300/0 conn(0x7fb8f812e3a0 0x7fb8f812e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 -- 172.21.15.88:0/2704214778 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80a3d50 con 0x7fb8f80a5de0 2020-02-11T16:10:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2704214778 >> v2:172.21.15.88:3300/0 conn(0x7fb8f80a5de0 0x7fb8f80a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8f805bbc0 tx=0x7fb8f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2704214778 >> v2:172.21.15.88:3300/0 conn(0x7fb8f80a5de0 0x7fb8f80a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8f805bbc0 tx=0x7fb8f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.850+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2704214778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f80a6260 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fb8f805bbc0 tx=0x7fb8f40088e0).ready entity=mon.1 client_cookie=673aeddd7ec2cca9 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:37.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2704214778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f80a6260 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fb8f805bbc0 tx=0x7fb8f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2704214778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f80a6260 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fb8f805bbc0 tx=0x7fb8f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8e7fff700 1 -- 172.21.15.88:0/2704214778 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f4008e20 con 0x7fb8f80a5de0 2020-02-11T16:10:37.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2704214778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f80a6260 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fb8f805bbc0 tx=0x7fb8f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8e7fff700 1 -- 172.21.15.88:0/2704214778 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4011860 con 0x7fb8f80a5de0 2020-02-11T16:10:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8e7fff700 1 -- 172.21.15.88:0/2704214778 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f4011c40 con 0x7fb8f80a5de0 2020-02-11T16:10:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2704214778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 msgr2=0x7fb8f80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8ff6fe700 1 --2- 172.21.15.88:0/2704214778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f80a6260 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fb8f805bbc0 tx=0x7fb8f40088e0).stop 2020-02-11T16:10:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2704214778 shutdown_connections 2020-02-11T16:10:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8ff6fe700 1 --2- 172.21.15.88:0/2704214778 >> v2:172.21.15.52:3300/0 conn(0x7fb8f812e3a0 0x7fb8f812e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8ff6fe700 1 --2- 172.21.15.88:0/2704214778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8f80a18a0 0x7fb8f80a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:37.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8ff6fe700 1 --2- 172.21.15.88:0/2704214778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f80a6260 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:37.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2704214778 >> 172.21.15.88:0/2704214778 conn(0x7fb8f809d110 msgr2=0x7fb8f809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:37.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2704214778 shutdown_connections 2020-02-11T16:10:37.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.851+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2704214778 wait complete. 2020-02-11T16:10:37.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.852+0000 7fb8ff6fe700 1 Processor -- start 2020-02-11T16:10:37.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.852+0000 7fb8ff6fe700 1 -- start start 2020-02-11T16:10:37.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8ff6fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8f80a5de0 0x7fb8f8136d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:37.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8ff6fe700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f8138c40 con 0x7fb8f812e3a0 2020-02-11T16:10:37.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8ff6fe700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f8138700 con 0x7fb8f80a18a0 2020-02-11T16:10:37.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8ff6fe700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f81389a0 con 0x7fb8f80a5de0 2020-02-11T16:10:37.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8f80a5de0 0x7fb8f8136d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:37.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8f80a5de0 0x7fb8f8136d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54268/0 (socket says 172.21.15.88:54268) 2020-02-11T16:10:37.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 -- 172.21.15.88:0/2322779131 learned_addr learned my addr 172.21.15.88:0/2322779131 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:37.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 -- 172.21.15.88:0/2322779131 >> v1:172.21.15.88:6789/0 conn(0x7fb8f80a18a0 legacy=0x7fb8f812d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:37.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 -- 172.21.15.88:0/2322779131 >> v1:172.21.15.52:6789/0 conn(0x7fb8f812e3a0 legacy=0x7fb8f8134e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:37.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 -- 172.21.15.88:0/2322779131 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f8135bc0 con 0x7fb8f80a5de0 2020-02-11T16:10:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2322779131 >> v2:172.21.15.88:3300/0 conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2322779131 >> v2:172.21.15.88:3300/0 conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8e67fc700 1 -- 172.21.15.88:0/2322779131 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f4008e20 con 0x7fb8f80a5de0 2020-02-11T16:10:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8e67fc700 1 -- 172.21.15.88:0/2322779131 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f400f8c0 con 0x7fb8f80a5de0 2020-02-11T16:10:37.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8e67fc700 1 -- 172.21.15.88:0/2322779131 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f4005aa0 con 0x7fb8f80a5de0 2020-02-11T16:10:37.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.853+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2322779131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f81371c0 con 0x7fb8f80a5de0 2020-02-11T16:10:37.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.854+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2322779131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f8066b20 con 0x7fb8f80a5de0 2020-02-11T16:10:37.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.854+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.854+0000 7fb8e67fc700 1 -- 172.21.15.88:0/2322779131 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb8f4005d10 con 0x7fb8f80a5de0 2020-02-11T16:10:37.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.854+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.855+0000 7fb8e67fc700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb8d8039ce0 0x7fb8d803c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:37.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.855+0000 7fb8e67fc700 1 -- 172.21.15.88:0/2322779131 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb8f4049e00 con 0x7fb8f80a5de0 2020-02-11T16:10:37.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.855+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2322779131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f8135890 con 0x7fb8f80a5de0 2020-02-11T16:10:37.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.855+0000 7fb8fd49a700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb8d8039ce0 0x7fb8d803c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:37.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.855+0000 7fb8fd49a700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb8d8039ce0 0x7fb8d803c1a0 crc :-1 s=READY pgs=201 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:37.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.858+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:37.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:37.858+0000 7fb8e67fc700 1 -- 172.21.15.88:0/2322779131 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb8f40323f0 con 0x7fb8f80a5de0 2020-02-11T16:10:38.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.040+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2322779131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb8f80565b0 con 0x7fb8f80a5de0 2020-02-11T16:10:38.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.041+0000 7fb8fcc99700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:38.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.041+0000 7fb8e67fc700 1 -- 172.21.15.88:0/2322779131 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fb8f4031fb0 con 0x7fb8f80a5de0 2020-02-11T16:10:38.044 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:38.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.042+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2322779131 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb8d8039ce0 msgr2=0x7fb8d803c1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:38.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.042+0000 7fb8ff6fe700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb8d8039ce0 0x7fb8d803c1a0 crc :-1 s=READY pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:38.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.042+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 msgr2=0x7fb8f8136d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:38.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.042+0000 7fb8ff6fe700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f8136d60 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7fb8f8066630 tx=0x7fb8f80a1c80).stop 2020-02-11T16:10:38.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.042+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2322779131 shutdown_connections 2020-02-11T16:10:38.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.042+0000 7fb8ff6fe700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb8d8039ce0 0x7fb8d803c1a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:38.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.042+0000 7fb8ff6fe700 1 --2- 172.21.15.88:0/2322779131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8f80a5de0 0x7fb8f8136d60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:38.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.042+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2322779131 >> 172.21.15.88:0/2322779131 conn(0x7fb8f809d110 msgr2=0x7fb8f80a98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:38.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.042+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2322779131 shutdown_connections 2020-02-11T16:10:38.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:38.042+0000 7fb8ff6fe700 1 -- 172.21.15.88:0/2322779131 wait complete. 2020-02-11T16:10:38.055 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":50,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:41.055 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:10:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.169+0000 7f825a652700 1 Processor -- start 2020-02-11T16:10:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.169+0000 7f825a652700 1 -- start start 2020-02-11T16:10:41.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f825a652700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:41.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f825a652700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82541382e0 con 0x7f8254137cf0 2020-02-11T16:10:41.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f825a652700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8254138580 con 0x7f825405c1f0 2020-02-11T16:10:41.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f825a652700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8254138820 con 0x7f8254135540 2020-02-11T16:10:41.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f8258bef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:41.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f8258bef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54282/0 (socket says 172.21.15.88:54282) 2020-02-11T16:10:41.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f8253fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f825405c1f0 0x7f82540a3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41904/0 (socket says 172.21.15.88:41904) 2020-02-11T16:10:41.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 learned_addr learned my addr 172.21.15.88:0/2991104084 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:41.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:10:41.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:10:41.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:41.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.170+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.371+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.371+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:10:41.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.371+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:10:41.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.371+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:41.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.371+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:10:41.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.772+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.772+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:10:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.772+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:10:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.772+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:41.772+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:10:42.286 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:10:42.289 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:10:42.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:42.573+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:42.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:42.573+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:10:42.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:42.573+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:10:42.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:42.573+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:42.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:42.573+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:10:44.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:44.175+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:44.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:44.175+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:10:44.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:44.175+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:10:44.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:44.175+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:10:44.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:44.175+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:10:45.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.663+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743220925 0 0) 0x7f82541382e0 con 0x7f8254137cf0 2020-02-11T16:10:45.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8240003230 con 0x7f8254137cf0 2020-02-11T16:10:45.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1518196737 0 0) 0x7f8240003230 con 0x7f8254137cf0 2020-02-11T16:10:45.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 msgr2=0x7f82540a1e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:10:45.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 --2- 172.21.15.88:0/2991104084 >> v2:172.21.15.88:3300/0 conn(0x7f8254135540 0x7f82540a1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:45.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 >> v1:172.21.15.88:6789/0 conn(0x7f825405c1f0 legacy=0x7f82540a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:45.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82540a22b0 con 0x7f8254137cf0 2020-02-11T16:10:45.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f82480016d0 con 0x7f8254137cf0 2020-02-11T16:10:45.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 >> v1:172.21.15.52:6789/0 conn(0x7f8254137cf0 legacy=0x7f8254134e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:45.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8240003770 0x7f8240003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:45.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82400044d0 0x7f8240004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 0x7f824000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8254138820 con 0x7f8240003770 2020-02-11T16:10:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8240005260 con 0x7f8240004db0 2020-02-11T16:10:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824000bb80 con 0x7f82400044d0 2020-02-11T16:10:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f82537fe700 1 -- 172.21.15.88:0/2991104084 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82400044d0 msgr2=0x7f8240004950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:10:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f82537fe700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82400044d0 0x7f8240004950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.664+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 0x7f824000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82400044d0 msgr2=0x7f8240004950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:10:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f82400044d0 0x7f8240004950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8240003770 msgr2=0x7f8240003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8240003770 0x7f8240003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8240003230 con 0x7f8240004db0 2020-02-11T16:10:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 0x7f824000b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f824c0032b0 tx=0x7f824c0104c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 -- 172.21.15.88:0/2991104084 reap_dead start 2020-02-11T16:10:45.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 0x7f824000b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f824c0032b0 tx=0x7f824c0104c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 0x7f824000b720 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f824c0032b0 tx=0x7f824c0104c0).ready entity=mon.1 client_cookie=3499efd67a3ad0c2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:45.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 0x7f824000b720 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f824c0032b0 tx=0x7f824c0104c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824c001370 con 0x7f8240004db0 2020-02-11T16:10:45.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 0x7f824000b720 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f824c0032b0 tx=0x7f824c0104c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c001570 con 0x7f8240004db0 2020-02-11T16:10:45.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8258bef700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 0x7f824000b720 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f824c0032b0 tx=0x7f824c0104c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f8252ffd700 1 -- 172.21.15.88:0/2991104084 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824c0018d0 con 0x7f8240004db0 2020-02-11T16:10:45.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f825a652700 1 -- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 msgr2=0x7f824000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:45.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.665+0000 7f825a652700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 0x7f824000b720 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f824c0032b0 tx=0x7f824c0104c0).stop 2020-02-11T16:10:45.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.666+0000 7f825a652700 1 -- 172.21.15.88:0/2991104084 shutdown_connections 2020-02-11T16:10:45.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.666+0000 7f825a652700 1 --2- 172.21.15.88:0/2991104084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8240004db0 0x7f824000b720 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:45.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.666+0000 7f825a652700 1 -- 172.21.15.88:0/2991104084 >> 172.21.15.88:0/2991104084 conn(0x7f82540ab400 msgr2=0x7f82540a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:45.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.666+0000 7f825a652700 1 -- 172.21.15.88:0/2991104084 shutdown_connections 2020-02-11T16:10:45.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.666+0000 7f825a652700 1 -- 172.21.15.88:0/2991104084 wait complete. 2020-02-11T16:10:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.667+0000 7f825a652700 1 Processor -- start 2020-02-11T16:10:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.667+0000 7f825a652700 1 -- start start 2020-02-11T16:10:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f825a652700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8240004db0 0x7f825413aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f825a652700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82540aa170 0x7f825413aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f825a652700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8254138de0 0x7f8254139260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f825a652700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825405a5d0 con 0x7f8240004db0 2020-02-11T16:10:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f825a652700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825413bb90 con 0x7f82540aa170 2020-02-11T16:10:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f825a652700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8254060e70 con 0x7f8254138de0 2020-02-11T16:10:45.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f8258bef700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8254138de0 msgr2=0x7f8254139260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:10:45.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f82537fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82540aa170 0x7f825413aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:45.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f8258bef700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8254138de0 0x7f8254139260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:45.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f82537fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82540aa170 0x7f825413aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54306/0 (socket says 172.21.15.88:54306) 2020-02-11T16:10:45.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f8253fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8240004db0 0x7f825413aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:45.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.668+0000 7f82537fe700 1 -- 172.21.15.88:0/2112464269 learned_addr learned my addr 172.21.15.88:0/2112464269 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.669+0000 7f82537fe700 1 -- 172.21.15.88:0/2112464269 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8254138de0 msgr2=0x7f8254139260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:10:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.669+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8254138de0 0x7f8254139260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.669+0000 7f82537fe700 1 -- 172.21.15.88:0/2112464269 >> v2:172.21.15.52:3300/0 conn(0x7f8240004db0 msgr2=0x7f825413aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.669+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> v2:172.21.15.52:3300/0 conn(0x7f8240004db0 0x7f825413aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.669+0000 7f82537fe700 1 -- 172.21.15.88:0/2112464269 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8254062d20 con 0x7f82540aa170 2020-02-11T16:10:45.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.669+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> v2:172.21.15.88:3300/0 conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.669+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> v2:172.21.15.88:3300/0 conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.669+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:45.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.670+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.670+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.670+0000 7f82517fa700 1 -- 172.21.15.88:0/2112464269 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8248012ac0 con 0x7f82540aa170 2020-02-11T16:10:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.670+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.670+0000 7f82517fa700 1 -- 172.21.15.88:0/2112464269 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248012c20 con 0x7f82540aa170 2020-02-11T16:10:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.670+0000 7f825a652700 1 -- 172.21.15.88:0/2112464269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82540631c0 con 0x7f82540aa170 2020-02-11T16:10:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.670+0000 7f82517fa700 1 -- 172.21.15.88:0/2112464269 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824800e3b0 con 0x7f82540aa170 2020-02-11T16:10:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.670+0000 7f825a652700 1 -- 172.21.15.88:0/2112464269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8254139f20 con 0x7f82540aa170 2020-02-11T16:10:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.671+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.671+0000 7f82517fa700 1 -- 172.21.15.88:0/2112464269 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f824800e510 con 0x7f82540aa170 2020-02-11T16:10:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.671+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.671+0000 7f82517fa700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8234039da0 0x7f823403c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.671+0000 7f82517fa700 1 -- 172.21.15.88:0/2112464269 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8248049f00 con 0x7f82540aa170 2020-02-11T16:10:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.671+0000 7f825a652700 1 -- 172.21.15.88:0/2112464269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8254062eb0 con 0x7f82540aa170 2020-02-11T16:10:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.671+0000 7f8253fff700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8234039da0 0x7f823403c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.672+0000 7f8253fff700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8234039da0 0x7f823403c260 crc :-1 s=READY pgs=202 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:45.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.675+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.675+0000 7f82517fa700 1 -- 172.21.15.88:0/2112464269 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f824802f4a0 con 0x7f82540aa170 2020-02-11T16:10:45.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.862+0000 7f825a652700 1 -- 172.21.15.88:0/2112464269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f82540565b0 con 0x7f82540aa170 2020-02-11T16:10:45.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.862+0000 7f82537fe700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.862+0000 7f82517fa700 1 -- 172.21.15.88:0/2112464269 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7f8248031f90 con 0x7f82540aa170 2020-02-11T16:10:45.866 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":54,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 -- 172.21.15.88:0/2112464269 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8234039da0 msgr2=0x7f823403c260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8234039da0 0x7f823403c260 crc :-1 s=READY pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 -- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 msgr2=0x7f825413aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 0x7f825413aed0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f8248000b20 tx=0x7f825405c5d0).stop 2020-02-11T16:10:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 -- 172.21.15.88:0/2112464269 shutdown_connections 2020-02-11T16:10:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8254138de0 0x7f8254139260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8234039da0 0x7f823403c260 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 --2- 172.21.15.88:0/2112464269 >> v2:172.21.15.52:3300/0 conn(0x7f8240004db0 0x7f825413aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 --2- 172.21.15.88:0/2112464269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82540aa170 0x7f825413aed0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:45.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 -- 172.21.15.88:0/2112464269 >> 172.21.15.88:0/2112464269 conn(0x7f82540ab400 msgr2=0x7f82540a7420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:45.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 -- 172.21.15.88:0/2112464269 shutdown_connections 2020-02-11T16:10:45.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.864+0000 7f825a652700 1 -- 172.21.15.88:0/2112464269 wait complete. 2020-02-11T16:10:45.877 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":54,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:10:45.877 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:10:45.877 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:10:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.980+0000 7fa7b2483700 1 Processor -- start 2020-02-11T16:10:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.980+0000 7fa7b2483700 1 -- start start 2020-02-11T16:10:45.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7b2483700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:45.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7b2483700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7b2483700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac0a5320 con 0x7fa7ac12f890 2020-02-11T16:10:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7b2483700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac09e7a0 con 0x7fa7ac0a7120 2020-02-11T16:10:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7b2483700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac1303c0 con 0x7fa7ac0a39e0 2020-02-11T16:10:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7ab7fe700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7ac0a39e0 msgr2=0x7fa7ac0a3e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:10:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7ab7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a3e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:10:45.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54312/0 (socket says 172.21.15.88:54312) 2020-02-11T16:10:45.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 -- 172.21.15.88:0/556905667 learned_addr learned my addr 172.21.15.88:0/556905667 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:45.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7b0a20700 1 --1- 172.21.15.88:0/556905667 >> v1:172.21.15.88:6789/0 conn(0x7fa7ac12f890 0x7fa7ac12fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41942/0 (socket says 172.21.15.88:41942) 2020-02-11T16:10:45.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 -- 172.21.15.88:0/556905667 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7ac0a39e0 msgr2=0x7fa7ac0a3e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:10:45.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 --2- 172.21.15.88:0/556905667 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a3e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:45.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 -- 172.21.15.88:0/556905667 >> v1:172.21.15.88:6789/0 conn(0x7fa7ac12f890 legacy=0x7fa7ac12fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:45.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 -- 172.21.15.88:0/556905667 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac0a5560 con 0x7fa7ac0a7120 2020-02-11T16:10:45.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7aaffd700 1 -- 172.21.15.88:0/556905667 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909429603 0 0) 0x7fa7a4001450 con 0x7fa7ac12f890 2020-02-11T16:10:45.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 --2- 172.21.15.88:0/556905667 >> v2:172.21.15.88:3300/0 conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa79c002f30 tx=0x7fa79c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 --2- 172.21.15.88:0/556905667 >> v2:172.21.15.88:3300/0 conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa79c002f30 tx=0x7fa79c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 --2- 172.21.15.88:0/556905667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fa79c002f30 tx=0x7fa79c0088e0).ready entity=mon.1 client_cookie=836036bab5d393b6 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:45.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 --2- 172.21.15.88:0/556905667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fa79c002f30 tx=0x7fa79c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7aaffd700 1 -- 172.21.15.88:0/556905667 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c008e20 con 0x7fa7ac0a7120 2020-02-11T16:10:45.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 --2- 172.21.15.88:0/556905667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fa79c002f30 tx=0x7fa79c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7abfff700 1 --2- 172.21.15.88:0/556905667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fa79c002f30 tx=0x7fa79c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:45.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7aaffd700 1 -- 172.21.15.88:0/556905667 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c011950 con 0x7fa7ac0a7120 2020-02-11T16:10:45.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7aaffd700 1 -- 172.21.15.88:0/556905667 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c011d30 con 0x7fa7ac0a7120 2020-02-11T16:10:45.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.981+0000 7fa7b2483700 1 -- 172.21.15.88:0/556905667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a7120 msgr2=0x7fa7ac0a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:45.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.982+0000 7fa7b2483700 1 --2- 172.21.15.88:0/556905667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fa79c002f30 tx=0x7fa79c0088e0).stop 2020-02-11T16:10:45.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.982+0000 7fa7b2483700 1 -- 172.21.15.88:0/556905667 shutdown_connections 2020-02-11T16:10:45.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.982+0000 7fa7b2483700 1 --2- 172.21.15.88:0/556905667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a7120 0x7fa7ac0a4ec0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:45.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.982+0000 7fa7b2483700 1 --2- 172.21.15.88:0/556905667 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:45.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.982+0000 7fa7b2483700 1 -- 172.21.15.88:0/556905667 >> 172.21.15.88:0/556905667 conn(0x7fa7ac09d110 msgr2=0x7fa7ac09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:45.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.982+0000 7fa7b2483700 1 -- 172.21.15.88:0/556905667 shutdown_connections 2020-02-11T16:10:45.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.982+0000 7fa7b2483700 1 -- 172.21.15.88:0/556905667 wait complete. 2020-02-11T16:10:45.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.983+0000 7fa7b2483700 1 Processor -- start 2020-02-11T16:10:45.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.983+0000 7fa7b2483700 1 -- start start 2020-02-11T16:10:45.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7b2483700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:45.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7b2483700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac0a1e40 con 0x7fa7ac0a7120 2020-02-11T16:10:45.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7b2483700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac0a2360 con 0x7fa7ac12f890 2020-02-11T16:10:45.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7b2483700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac0a2600 con 0x7fa7ac0a39e0 2020-02-11T16:10:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54318/0 (socket says 172.21.15.88:54318) 2020-02-11T16:10:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 -- 172.21.15.88:0/2507720329 learned_addr learned my addr 172.21.15.88:0/2507720329 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:10:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7b0a20700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa7ac12f890 0x7fa7ac12a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41948/0 (socket says 172.21.15.88:41948) 2020-02-11T16:10:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 -- 172.21.15.88:0/2507720329 >> v1:172.21.15.88:6789/0 conn(0x7fa7ac12f890 legacy=0x7fa7ac12a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 -- 172.21.15.88:0/2507720329 >> v1:172.21.15.52:6789/0 conn(0x7fa7ac0a7120 legacy=0x7fa7ac065490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900096655 0 0) 0x7fa7ac0a2360 con 0x7fa7ac12f890 2020-02-11T16:10:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 -- 172.21.15.88:0/2507720329 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac0a28a0 con 0x7fa7ac0a39e0 2020-02-11T16:10:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 --2- 172.21.15.88:0/2507720329 >> v2:172.21.15.88:3300/0 conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7ac128d10 tx=0x7fa7ac130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 --2- 172.21.15.88:0/2507720329 >> v2:172.21.15.88:3300/0 conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7ac128d10 tx=0x7fa7ac130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fa7ac128d10 tx=0x7fa7ac130500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa7ac128d10 tx=0x7fa7ac130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c007340 con 0x7fa7ac0a39e0 2020-02-11T16:10:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa7ac128d10 tx=0x7fa7ac130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7abfff700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa7ac128d10 tx=0x7fa7ac130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c0074a0 con 0x7fa7ac0a39e0 2020-02-11T16:10:46.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7b2483700 1 -- 172.21.15.88:0/2507720329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac067190 con 0x7fa7ac0a39e0 2020-02-11T16:10:46.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c0058b0 con 0x7fa7ac0a39e0 2020-02-11T16:10:46.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.984+0000 7fa7b2483700 1 -- 172.21.15.88:0/2507720329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac065ba0 con 0x7fa7ac0a39e0 2020-02-11T16:10:46.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.985+0000 7fa7abfff700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa7ac128d10 tx=0x7fa7ac130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.985+0000 7fa7b2483700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 0x7fa7ac12b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:46.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.985+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa79c005b30 con 0x7fa7ac0a39e0 2020-02-11T16:10:46.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.985+0000 7fa7b2483700 1 -- 172.21.15.88:0/2507720329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac05e2f0 con 0x7fa7ac12a890 2020-02-11T16:10:46.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.985+0000 7fa7abfff700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fa7ac128d10 tx=0x7fa7ac130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.985+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 0x7fa7ac12b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:46.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.985+0000 7fa7a97fa700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa78c039ad0 0x7fa78c03bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.985+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa79c04a330 con 0x7fa7ac0a39e0 2020-02-11T16:10:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.985+0000 7fa7ab7fe700 1 -- 172.21.15.88:0/2507720329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7ac0565b0 con 0x7fa7ac12a890 2020-02-11T16:10:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 0x7fa7ac12b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 0x7fa7ac12b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 0x7fa7ac12b760 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7b0a20700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa78c039ad0 0x7fa78c03bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:46.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 0x7fa7ac12b760 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a0007550 con 0x7fa7ac12a890 2020-02-11T16:10:46.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7b0a20700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa78c039ad0 0x7fa78c03bf90 crc :-1 s=READY pgs=203 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:46.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 0x7fa7ac12b760 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa7a000ed40 con 0x7fa7ac12a890 2020-02-11T16:10:46.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 msgr2=0x7fa7ac12b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7a97fa700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 0x7fa7ac12b760 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).stop 2020-02-11T16:10:46.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 msgr2=0x7fa7ac12b760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:46.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.986+0000 7fa7a97fa700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12a890 0x7fa7ac12b760 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:46.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.994+0000 7fa7b2483700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 0x7fa7ac12d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:46.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.994+0000 7fa7b2483700 1 -- 172.21.15.88:0/2507720329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0a2740 con 0x7fa7ac12d2b0 2020-02-11T16:10:46.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.994+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 0x7fa7ac12d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:46.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.994+0000 7fa7ab7fe700 1 -- 172.21.15.88:0/2507720329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa7ac05ccb0 con 0x7fa7ac12d2b0 2020-02-11T16:10:46.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.994+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 0x7fa7ac12d690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.994+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 0x7fa7ac12d690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.994+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 0x7fa7ac12d690 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:46.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.994+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 0x7fa7ac12d690 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.994+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a000f380 con 0x7fa7ac12d2b0 2020-02-11T16:10:46.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7ab7fe700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 0x7fa7ac12d690 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4348 (secure 0 0 0) 0x7fa7a000f4e0 con 0x7fa7ac12d2b0 2020-02-11T16:10:46.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 msgr2=0x7fa7ac12d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7a97fa700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 0x7fa7ac12d690 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).stop 2020-02-11T16:10:46.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7a97fa700 1 -- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 msgr2=0x7fa7ac12d690 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:46.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7a97fa700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac12d2b0 0x7fa7ac12d690 secure :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0x7fa7a0000b20 tx=0x7fa7a0010840).stop 2020-02-11T16:10:46.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b2483700 1 -- 172.21.15.88:0/2507720329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa78c039ad0 msgr2=0x7fa78c03bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b2483700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa78c039ad0 0x7fa78c03bf90 crc :-1 s=READY pgs=203 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:46.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b2483700 1 -- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a39e0 msgr2=0x7fa7ac0a19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b2483700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fa7ac128d10 tx=0x7fa7ac130500).stop 2020-02-11T16:10:46.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b0a20700 1 -- 172.21.15.88:0/2507720329 reap_dead start 2020-02-11T16:10:46.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b0a20700 1 -- 172.21.15.88:0/2507720329 reap_dead start 2020-02-11T16:10:46.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b2483700 1 -- 172.21.15.88:0/2507720329 shutdown_connections 2020-02-11T16:10:46.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b2483700 1 --2- 172.21.15.88:0/2507720329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7ac0a39e0 0x7fa7ac0a19e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:46.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b2483700 1 -- 172.21.15.88:0/2507720329 >> 172.21.15.88:0/2507720329 conn(0x7fa7ac09d110 msgr2=0x7fa7ac0a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:46.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b2483700 1 -- 172.21.15.88:0/2507720329 shutdown_connections 2020-02-11T16:10:46.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:45.995+0000 7fa7b2483700 1 -- 172.21.15.88:0/2507720329 wait complete. 2020-02-11T16:10:46.013 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:10:46.013 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:46.014 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:46.014 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:10:46.014 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 54, 2020-02-11T16:10:46.014 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:10:46.014 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:10:46.014 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:10:46.014 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.015 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:10:46.015 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:46.015 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:10:46.015 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:10:46.015 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:46.015 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:46.015 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:46.016 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:46.016 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:46.016 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:46.016 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.016 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:10:46.016 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:10:46.016 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:46.017 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:46.017 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:46.017 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:46.017 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:46.017 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:46.017 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.018 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:10:46.018 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:10:46.018 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:10:46.018 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:10:46.018 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:10:46.018 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:10:46.019 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:46.019 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:46.019 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:10:46.019 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:10:46.019 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:46.019 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:10:46.019 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:46.020 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:46.020 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:46.020 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:46.020 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:46.020 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:46.020 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.021 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:10:46.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.021 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:10:46.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.021 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:46.021 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:46.022 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:46.022 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:46.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.022 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:46.022 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:10:46.022 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.023 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:46.023 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:10:46.023 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.023 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.023 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.024 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:10:46.024 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:10:46.024 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:46.024 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:46.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.025 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:46.025 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:46.025 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:46.025 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:46.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.025 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:46.025 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:10:46.026 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.026 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:46.026 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:10:46.026 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.026 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.027 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.027 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:10:46.027 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:10:46.027 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:46.027 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:46.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.028 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:10:46.028 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:10:46.028 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:46.028 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:46.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.029 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:46.029 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:10:46.029 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.029 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:46.030 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:10:46.030 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.030 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.030 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.030 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:10:46.031 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:10:46.031 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:46.031 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:46.031 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.031 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.032 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:10:46.032 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:10:46.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.032 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:46.032 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:46.033 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:46.033 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.033 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.033 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:10:46.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.033 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:46.033 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:46.034 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:46.034 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.034 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.034 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:10:46.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.034 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:46.035 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:46.035 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:10:46.035 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.035 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.035 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:10:46.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.035 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:46.036 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:46.036 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:10:46.036 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.036 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.036 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:10:46.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.037 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:46.037 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:46.037 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:10:46.037 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.037 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.037 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.037 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:10:46.038 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:10:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.141+0000 7f89d3d58700 1 Processor -- start 2020-02-11T16:10:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.141+0000 7f89d3d58700 1 -- start start 2020-02-11T16:10:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d3d58700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89cc0ad380 0x7f89cc0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:46.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d3d58700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f89cc138280 0x7f89cc138710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:10:46.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d3d58700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc0adb40 con 0x7f89cc13b1c0 2020-02-11T16:10:46.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d3d58700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc137bf0 con 0x7f89cc0ad380 2020-02-11T16:10:46.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d3d58700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc138b70 con 0x7f89cc138280 2020-02-11T16:10:46.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d12f3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f89cc138280 0x7f89cc138710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:46.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d22f5700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f89cc13b1c0 0x7f89cc13b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41960/0 (socket says 172.21.15.88:41960) 2020-02-11T16:10:46.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d22f5700 1 -- 172.21.15.88:0/2456246662 learned_addr learned my addr 172.21.15.88:0/2456246662 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:46.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2456246662 >> v2:172.21.15.52:3300/0 conn(0x7f89cc0ad380 0x7f89cc0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:46.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d12f3700 1 -- 172.21.15.88:0/2456246662 >> v2:172.21.15.52:3300/0 conn(0x7f89cc0ad380 msgr2=0x7f89cc0a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:10:46.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d12f3700 1 --2- 172.21.15.88:0/2456246662 >> v2:172.21.15.52:3300/0 conn(0x7f89cc0ad380 0x7f89cc0a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:46.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d12f3700 1 -- 172.21.15.88:0/2456246662 >> v1:172.21.15.88:6789/0 conn(0x7f89cc13b1c0 legacy=0x7f89cc13b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d0af2700 1 -- 172.21.15.88:0/2456246662 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862164736 0 0) 0x7f89cc0adb40 con 0x7f89cc13b1c0 2020-02-11T16:10:46.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.142+0000 7f89d12f3700 1 -- 172.21.15.88:0/2456246662 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc137de0 con 0x7f89cc138280 2020-02-11T16:10:46.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d12f3700 1 --2- 172.21.15.88:0/2456246662 >> v2:172.21.15.88:3300/0 conn(0x7f89cc138280 0x7f89cc138710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f89c8002f30 tx=0x7f89c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d12f3700 1 --2- 172.21.15.88:0/2456246662 >> v2:172.21.15.88:3300/0 conn(0x7f89cc138280 0x7f89cc138710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f89c8002f30 tx=0x7f89c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d12f3700 1 --2- 172.21.15.88:0/2456246662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc138280 0x7f89cc138710 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f89c8002f30 tx=0x7f89c8007a40).ready entity=mon.1 client_cookie=b882a968327a07c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:46.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d12f3700 1 --2- 172.21.15.88:0/2456246662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc138280 0x7f89cc138710 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f89c8002f30 tx=0x7f89c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d0af2700 1 -- 172.21.15.88:0/2456246662 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89c8011470 con 0x7f89cc138280 2020-02-11T16:10:46.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d12f3700 1 --2- 172.21.15.88:0/2456246662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc138280 0x7f89cc138710 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f89c8002f30 tx=0x7f89c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d12f3700 1 --2- 172.21.15.88:0/2456246662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc138280 0x7f89cc138710 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f89c8002f30 tx=0x7f89c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d0af2700 1 -- 172.21.15.88:0/2456246662 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c80115d0 con 0x7f89cc138280 2020-02-11T16:10:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d0af2700 1 -- 172.21.15.88:0/2456246662 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89c8011970 con 0x7f89cc138280 2020-02-11T16:10:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d3d58700 1 -- 172.21.15.88:0/2456246662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc138280 msgr2=0x7f89cc138710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d3d58700 1 --2- 172.21.15.88:0/2456246662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc138280 0x7f89cc138710 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f89c8002f30 tx=0x7f89c8007a40).stop 2020-02-11T16:10:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d3d58700 1 -- 172.21.15.88:0/2456246662 shutdown_connections 2020-02-11T16:10:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d3d58700 1 --2- 172.21.15.88:0/2456246662 >> v2:172.21.15.52:3300/0 conn(0x7f89cc0ad380 0x7f89cc0a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:10:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d3d58700 1 --2- 172.21.15.88:0/2456246662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc138280 0x7f89cc138710 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d3d58700 1 -- 172.21.15.88:0/2456246662 >> 172.21.15.88:0/2456246662 conn(0x7f89cc05ac70 msgr2=0x7f89cc0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d3d58700 1 -- 172.21.15.88:0/2456246662 shutdown_connections 2020-02-11T16:10:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.143+0000 7f89d3d58700 1 -- 172.21.15.88:0/2456246662 wait complete. 2020-02-11T16:10:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.144+0000 7f89d3d58700 1 Processor -- start 2020-02-11T16:10:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.144+0000 7f89d3d58700 1 -- start start 2020-02-11T16:10:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d3d58700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89cc0ad380 0x7f89cc134e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d3d58700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f89cc13b1c0 0x7f89cc13a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d3d58700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc13b030 con 0x7f89cc138280 2020-02-11T16:10:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d3d58700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc1354b0 con 0x7f89cc0ad380 2020-02-11T16:10:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d3d58700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc13aaf0 con 0x7f89cc13b1c0 2020-02-11T16:10:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d12f3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f89cc138280 0x7f89cc12d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41964/0 (socket says 172.21.15.88:41964) 2020-02-11T16:10:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d12f3700 1 -- 172.21.15.88:0/2451884354 learned_addr learned my addr 172.21.15.88:0/2451884354 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:10:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 --2- 172.21.15.88:0/2451884354 >> v2:172.21.15.88:3300/0 conn(0x7f89cc13b1c0 0x7f89cc13a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> v2:172.21.15.52:3300/0 conn(0x7f89cc0ad380 0x7f89cc134e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584064672 0 0) 0x7f89cc13b030 con 0x7f89cc138280 2020-02-11T16:10:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89ac002fe0 con 0x7f89cc138280 2020-02-11T16:10:46.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 -- 172.21.15.88:0/2451884354 >> v2:172.21.15.52:3300/0 conn(0x7f89cc0ad380 msgr2=0x7f89cc134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 --2- 172.21.15.88:0/2451884354 >> v2:172.21.15.52:3300/0 conn(0x7f89cc0ad380 0x7f89cc134e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:46.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 -- 172.21.15.88:0/2451884354 >> v1:172.21.15.88:6789/0 conn(0x7f89cc138280 legacy=0x7f89cc12d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 -- 172.21.15.88:0/2451884354 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc13ad90 con 0x7f89cc13b1c0 2020-02-11T16:10:46.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 --2- 172.21.15.88:0/2451884354 >> v2:172.21.15.88:3300/0 conn(0x7f89cc13b1c0 0x7f89cc13a4c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f89c4001210 tx=0x7f89c4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 --2- 172.21.15.88:0/2451884354 >> v2:172.21.15.88:3300/0 conn(0x7f89cc13b1c0 0x7f89cc13a4c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f89c4001210 tx=0x7f89c4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc13b1c0 0x7f89cc13a4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f89c4001210 tx=0x7f89c4010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:46.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc13b1c0 0x7f89cc13a4c0 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f89c4001210 tx=0x7f89c4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89c4005e30 con 0x7f89cc13b1c0 2020-02-11T16:10:46.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc13b1c0 0x7f89cc13a4c0 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f89c4001210 tx=0x7f89c4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d22f5700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc13b1c0 0x7f89cc13a4c0 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f89c4001210 tx=0x7f89c4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c40123e0 con 0x7f89cc13b1c0 2020-02-11T16:10:46.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89c4012800 con 0x7f89cc13b1c0 2020-02-11T16:10:46.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d3d58700 1 -- 172.21.15.88:0/2451884354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc12ded0 con 0x7f89cc13b1c0 2020-02-11T16:10:46.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.145+0000 7f89d3d58700 1 -- 172.21.15.88:0/2451884354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc12e180 con 0x7f89cc13b1c0 2020-02-11T16:10:46.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.146+0000 7f89d22f5700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc13b1c0 0x7f89cc13a4c0 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f89c4001210 tx=0x7f89c4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.146+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f89c4012ac0 con 0x7f89cc13b1c0 2020-02-11T16:10:46.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.146+0000 7f89d22f5700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc13b1c0 0x7f89cc13a4c0 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f89c4001210 tx=0x7f89c4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.146+0000 7f89d3d58700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 0x7f89cc135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:46.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.146+0000 7f89d3d58700 1 -- 172.21.15.88:0/2451884354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc05e2f0 con 0x7f89cc145260 2020-02-11T16:10:46.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.146+0000 7f89baffd700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f89ac039ef0 0x7f89ac03c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:46.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.146+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f89c4049e90 con 0x7f89cc13b1c0 2020-02-11T16:10:46.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 0x7f89cc135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:46.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89d12f3700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f89ac039ef0 0x7f89ac03c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:46.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89d12f3700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f89ac039ef0 0x7f89ac03c3b0 crc :-1 s=READY pgs=204 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:46.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89d1af4700 1 -- 172.21.15.88:0/2451884354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89cc144c40 con 0x7f89cc145260 2020-02-11T16:10:46.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 0x7f89cc135b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 0x7f89cc135b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 0x7f89cc135b60 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:46.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 0x7f89cc135b60 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89bc006650 con 0x7f89cc145260 2020-02-11T16:10:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 0x7f89cc135b60 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f89bc0058b0 con 0x7f89cc145260 2020-02-11T16:10:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 msgr2=0x7f89cc135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89baffd700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 0x7f89cc135b60 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).stop 2020-02-11T16:10:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.147+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 msgr2=0x7f89cc135b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:46.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.148+0000 7f89baffd700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145260 0x7f89cc135b60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:46.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.156+0000 7f89d3d58700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 0x7f89cc135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:10:46.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.156+0000 7f89d3d58700 1 -- 172.21.15.88:0/2451884354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc13ac30 con 0x7f89cc145640 2020-02-11T16:10:46.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.156+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 0x7f89cc135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:10:46.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.156+0000 7f89d1af4700 1 -- 172.21.15.88:0/2451884354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f89cc13a920 con 0x7f89cc145640 2020-02-11T16:10:46.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.156+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 0x7f89cc135fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 0x7f89cc135fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 0x7f89cc135fc0 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:10:46.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 0x7f89cc135fc0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89bc00a640 con 0x7f89cc145640 2020-02-11T16:10:46.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d1af4700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 0x7f89cc135fc0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:10:46.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4180 (secure 0 0 0) 0x7f89bc015e90 con 0x7f89cc145640 2020-02-11T16:10:46.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 msgr2=0x7f89cc135fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89baffd700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 0x7f89cc135fc0 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).stop 2020-02-11T16:10:46.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89baffd700 1 -- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 msgr2=0x7f89cc135fc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:10:46.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89baffd700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc145640 0x7f89cc135fc0 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0x7f89bc002f30 tx=0x7f89bc010e10).stop 2020-02-11T16:10:46.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d3d58700 1 -- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f89ac039ef0 msgr2=0x7f89ac03c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d3d58700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f89ac039ef0 0x7f89ac03c3b0 crc :-1 s=READY pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:46.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d3d58700 1 -- 172.21.15.88:0/2451884354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc13b1c0 msgr2=0x7f89cc13a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:10:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d3d58700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc13b1c0 0x7f89cc13a4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f89c4001210 tx=0x7f89c4010c00).stop 2020-02-11T16:10:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d22f5700 1 -- 172.21.15.88:0/2451884354 reap_dead start 2020-02-11T16:10:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d22f5700 1 -- 172.21.15.88:0/2451884354 reap_dead start 2020-02-11T16:10:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.157+0000 7f89d3d58700 1 -- 172.21.15.88:0/2451884354 shutdown_connections 2020-02-11T16:10:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.158+0000 7f89d3d58700 1 --2- 172.21.15.88:0/2451884354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89cc13b1c0 0x7f89cc13a4c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:10:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.158+0000 7f89d3d58700 1 -- 172.21.15.88:0/2451884354 >> 172.21.15.88:0/2451884354 conn(0x7f89cc05ac70 msgr2=0x7f89cc130c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:10:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.158+0000 7f89d3d58700 1 -- 172.21.15.88:0/2451884354 shutdown_connections 2020-02-11T16:10:46.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:10:46.158+0000 7f89d3d58700 1 -- 172.21.15.88:0/2451884354 wait complete. 2020-02-11T16:10:46.188 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:10:46.188 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:46.188 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:46.188 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:10:46.188 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 54, 2020-02-11T16:10:46.189 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:10:46.189 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:10:46.189 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:10:46.189 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.189 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:10:46.189 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:46.189 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:10:46.189 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:10:46.190 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:46.190 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:46.190 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:46.190 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:46.190 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:46.190 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:46.190 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.191 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:10:46.191 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:10:46.191 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:46.191 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:46.191 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:46.191 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:46.191 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:46.192 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:46.192 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.192 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:10:46.192 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:10:46.192 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:10:46.192 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:10:46.193 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:10:46.193 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:10:46.193 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:46.193 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:10:46.193 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:10:46.193 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:10:46.194 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:10:46.194 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:10:46.194 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:10:46.194 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:10:46.194 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:10:46.195 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:10:46.195 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:10:46.195 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:10:46.195 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.195 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:10:46.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.195 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:10:46.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.196 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:10:46.196 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:10:46.196 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:46.196 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:46.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.196 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:46.196 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:10:46.197 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.197 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:46.197 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:10:46.197 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.198 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.198 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.198 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:10:46.198 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:10:46.198 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:46.198 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:46.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.199 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:10:46.199 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:10:46.199 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:46.199 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:46.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.200 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:46.200 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:10:46.200 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.200 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:46.200 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:10:46.200 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.201 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.201 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.201 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:10:46.201 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:10:46.201 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:46.201 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:46.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.202 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:10:46.202 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:10:46.202 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:10:46.202 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:10:46.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.203 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:10:46.203 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:10:46.203 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.203 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:10:46.203 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:10:46.204 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:10:46.204 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.204 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.204 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:10:46.204 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:10:46.204 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:10:46.205 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:10:46.205 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.205 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:10:46.205 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:10:46.205 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:10:46.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.206 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:46.206 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:46.206 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:46.206 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.206 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.206 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:10:46.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.207 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:46.207 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:46.207 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:10:46.207 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.207 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.207 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:10:46.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.208 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:46.208 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:46.208 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:10:46.208 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.208 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:10:46.208 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:10:46.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:10:46.209 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:10:46.209 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:10:46.209 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:10:46.209 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.209 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:10:46.209 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:10:46.209 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:10:46.210 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:11:06.211 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:11:06.211 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2020-02-11T16:11:06.211 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-11T16:11:06.211 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-11T16:11:06.214 INFO:tasks.ceph.mon.c:Started 2020-02-11T16:11:06.214 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:11:06.215 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:11:06.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.329+0000 7f79a36e9700 1 Processor -- start 2020-02-11T16:11:06.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.330+0000 7f79a36e9700 1 -- start start 2020-02-11T16:11:06.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.330+0000 7f79a36e9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f799c0a1520 0x7f799c131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:06.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.330+0000 7f79a36e9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c0a4350 con 0x7f799c0a5b20 2020-02-11T16:11:06.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.330+0000 7f79a36e9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c0a3a40 con 0x7f799c0a2fa0 2020-02-11T16:11:06.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.330+0000 7f79a36e9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c0a1e60 con 0x7f799c0a1520 2020-02-11T16:11:06.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.330+0000 7f79a1c86700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f799c0a1520 0x7f799c131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:06.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.330+0000 7f79a1485700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f799c0a2fa0 0x7f799c0a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41980/0 (socket says 172.21.15.88:41980) 2020-02-11T16:11:06.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a1485700 1 -- 172.21.15.88:0/3898743293 learned_addr learned my addr 172.21.15.88:0/3898743293 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:06.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a1c86700 1 -- 172.21.15.88:0/3898743293 >> v1:172.21.15.88:6789/0 conn(0x7f799c0a2fa0 legacy=0x7f799c0a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:06.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a1c86700 1 -- 172.21.15.88:0/3898743293 >> v1:172.21.15.52:6789/0 conn(0x7f799c0a5b20 legacy=0x7f799c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:06.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f798bfff700 1 -- 172.21.15.88:0/3898743293 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594597824 0 0) 0x7f799c0a3a40 con 0x7f799c0a2fa0 2020-02-11T16:11:06.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a1c86700 1 -- 172.21.15.88:0/3898743293 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c0a3ce0 con 0x7f799c0a1520 2020-02-11T16:11:06.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a1c86700 1 --2- 172.21.15.88:0/3898743293 >> v2:172.21.15.88:3300/0 conn(0x7f799c0a1520 0x7f799c131990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79940032b0 tx=0x7f7994008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a1c86700 1 --2- 172.21.15.88:0/3898743293 >> v2:172.21.15.88:3300/0 conn(0x7f799c0a1520 0x7f799c131990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79940032b0 tx=0x7f7994008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a1c86700 1 --2- 172.21.15.88:0/3898743293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c131990 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7f79940032b0 tx=0x7f7994008c60).ready entity=mon.1 client_cookie=9f65f80241656745 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:06.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a1c86700 1 --2- 172.21.15.88:0/3898743293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c131990 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f79940032b0 tx=0x7f7994008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f798bfff700 1 -- 172.21.15.88:0/3898743293 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799400a160 con 0x7f799c0a1520 2020-02-11T16:11:06.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a1c86700 1 --2- 172.21.15.88:0/3898743293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c131990 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f79940032b0 tx=0x7f7994008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a1c86700 1 --2- 172.21.15.88:0/3898743293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c131990 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f79940032b0 tx=0x7f7994008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f798bfff700 1 -- 172.21.15.88:0/3898743293 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799400a2c0 con 0x7f799c0a1520 2020-02-11T16:11:06.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f798bfff700 1 -- 172.21.15.88:0/3898743293 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799400a6a0 con 0x7f799c0a1520 2020-02-11T16:11:06.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a36e9700 1 -- 172.21.15.88:0/3898743293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 msgr2=0x7f799c131990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:06.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.331+0000 7f79a36e9700 1 --2- 172.21.15.88:0/3898743293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c131990 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7f79940032b0 tx=0x7f7994008c60).stop 2020-02-11T16:11:06.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.332+0000 7f79a36e9700 1 -- 172.21.15.88:0/3898743293 shutdown_connections 2020-02-11T16:11:06.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.332+0000 7f79a36e9700 1 --2- 172.21.15.88:0/3898743293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c131990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.332+0000 7f79a36e9700 1 -- 172.21.15.88:0/3898743293 >> 172.21.15.88:0/3898743293 conn(0x7f799c09d110 msgr2=0x7f799c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.332+0000 7f79a36e9700 1 -- 172.21.15.88:0/3898743293 shutdown_connections 2020-02-11T16:11:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.332+0000 7f79a36e9700 1 -- 172.21.15.88:0/3898743293 wait complete. 2020-02-11T16:11:06.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a36e9700 1 Processor -- start 2020-02-11T16:11:06.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a36e9700 1 -- start start 2020-02-11T16:11:06.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a36e9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f799c0a1520 0x7f799c137a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:06.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a36e9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f799c0a2fa0 0x7f799c148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:06.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a36e9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c136650 con 0x7f799c0a5b20 2020-02-11T16:11:06.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a36e9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c131df0 con 0x7f799c0a2fa0 2020-02-11T16:11:06.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a36e9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c1368f0 con 0x7f799c0a1520 2020-02-11T16:11:06.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a1485700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f799c0a1520 0x7f799c137a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:06.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a1485700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f799c0a1520 0x7f799c137a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54360/0 (socket says 172.21.15.88:54360) 2020-02-11T16:11:06.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a1485700 1 -- 172.21.15.88:0/4237639540 learned_addr learned my addr 172.21.15.88:0/4237639540 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:06.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.333+0000 7f79a0c84700 1 --2- 172.21.15.88:0/4237639540 >> v2:172.21.15.52:3300/0 conn(0x7f799c0a2fa0 0x7f799c148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:06.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 -- 172.21.15.88:0/4237639540 >> v2:172.21.15.52:3300/0 conn(0x7f799c0a2fa0 msgr2=0x7f799c148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:06.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> v2:172.21.15.52:3300/0 conn(0x7f799c0a2fa0 0x7f799c148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:06.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 -- 172.21.15.88:0/4237639540 >> v1:172.21.15.52:6789/0 conn(0x7f799c0a5b20 legacy=0x7f799c09e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:06.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 -- 172.21.15.88:0/4237639540 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c139340 con 0x7f799c0a1520 2020-02-11T16:11:06.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> v2:172.21.15.88:3300/0 conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> v2:172.21.15.88:3300/0 conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:06.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f798a7fc700 1 -- 172.21.15.88:0/4237639540 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f798c005ca0 con 0x7f799c0a1520 2020-02-11T16:11:06.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f798a7fc700 1 -- 172.21.15.88:0/4237639540 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c005e00 con 0x7f799c0a1520 2020-02-11T16:11:06.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f798a7fc700 1 -- 172.21.15.88:0/4237639540 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f798c0062b0 con 0x7f799c0a1520 2020-02-11T16:11:06.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a36e9700 1 -- 172.21.15.88:0/4237639540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c139590 con 0x7f799c0a1520 2020-02-11T16:11:06.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a36e9700 1 -- 172.21.15.88:0/4237639540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c136fd0 con 0x7f799c0a1520 2020-02-11T16:11:06.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.334+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.335+0000 7f798a7fc700 1 -- 172.21.15.88:0/4237639540 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f798c006520 con 0x7f799c0a1520 2020-02-11T16:11:06.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.335+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.335+0000 7f798a7fc700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f797c039b60 0x7f797c03c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:06.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.335+0000 7f798a7fc700 1 -- 172.21.15.88:0/4237639540 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f798c0499f0 con 0x7f799c0a1520 2020-02-11T16:11:06.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.335+0000 7f79a36e9700 1 -- 172.21.15.88:0/4237639540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c0565b0 con 0x7f799c0a1520 2020-02-11T16:11:06.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.335+0000 7f79a0c84700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f797c039b60 0x7f797c03c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:06.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.335+0000 7f79a0c84700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f797c039b60 0x7f797c03c020 crc :-1 s=READY pgs=206 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:06.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.339+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.339+0000 7f798a7fc700 1 -- 172.21.15.88:0/4237639540 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f798c02f030 con 0x7f799c0a1520 2020-02-11T16:11:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.518+0000 7f79a36e9700 1 -- 172.21.15.88:0/4237639540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f799c05ccb0 con 0x7f799c0a1520 2020-02-11T16:11:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.519+0000 7f79a1485700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.519+0000 7f798a7fc700 1 -- 172.21.15.88:0/4237639540 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f798c031b40 con 0x7f799c0a1520 2020-02-11T16:11:06.521 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":54,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:06.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 -- 172.21.15.88:0/4237639540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f797c039b60 msgr2=0x7f797c03c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:06.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f797c039b60 0x7f797c03c020 crc :-1 s=READY pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:06.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 -- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 msgr2=0x7f799c137a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:06.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c137a90 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f798c000b80 tx=0x7f798c010960).stop 2020-02-11T16:11:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 -- 172.21.15.88:0/4237639540 shutdown_connections 2020-02-11T16:11:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f799c0a1520 0x7f799c137a90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 --2- 172.21.15.88:0/4237639540 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f797c039b60 0x7f797c03c020 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 --2- 172.21.15.88:0/4237639540 >> v2:172.21.15.52:3300/0 conn(0x7f799c0a2fa0 0x7f799c148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 -- 172.21.15.88:0/4237639540 >> 172.21.15.88:0/4237639540 conn(0x7f799c09d110 msgr2=0x7f799c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 -- 172.21.15.88:0/4237639540 shutdown_connections 2020-02-11T16:11:06.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:06.520+0000 7f79a36e9700 1 -- 172.21.15.88:0/4237639540 wait complete. 2020-02-11T16:11:06.532 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":54,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:09.533 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:11:09.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.647+0000 7fdece2ab700 1 Processor -- start 2020-02-11T16:11:09.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.647+0000 7fdece2ab700 1 -- start start 2020-02-11T16:11:09.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdece2ab700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 0x7fdec80a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:09.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdece2ab700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec80a5320 con 0x7fdec80a39e0 2020-02-11T16:11:09.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdece2ab700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec80a5560 con 0x7fdec80a3e60 2020-02-11T16:11:09.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdece2ab700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80a4280 con 0x7fdec80a7120 2020-02-11T16:11:09.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdecc848700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdec80a3e60 0x7fdec8140470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41996/0 (socket says 172.21.15.88:41996) 2020-02-11T16:11:09.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdecc848700 1 -- 172.21.15.88:0/1700396257 learned_addr learned my addr 172.21.15.88:0/1700396257 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:09.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 0x7fdec80a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:09.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdec7fff700 1 -- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 msgr2=0x7fdec80a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:11:09.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdec7fff700 1 -- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 msgr2=0x7fdec80a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:11:09.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 0x7fdec80a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:09.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.648+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 0x7fdec80a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:09.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685512052 0 0) 0x7fdebc0010d0 con 0x7fdec80a39e0 2020-02-11T16:11:09.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeb4003230 con 0x7fdec80a39e0 2020-02-11T16:11:09.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745090969 0 0) 0x7fdec80a5560 con 0x7fdec80a3e60 2020-02-11T16:11:09.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdebc0010d0 con 0x7fdec80a3e60 2020-02-11T16:11:09.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1028693086 0 0) 0x7fdeb4003230 con 0x7fdec80a39e0 2020-02-11T16:11:09.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 msgr2=0x7fdec80a4ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:11:09.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 0x7fdec80a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:09.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 >> v1:172.21.15.88:6789/0 conn(0x7fdec80a3e60 legacy=0x7fdec8140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:09.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec809e060 con 0x7fdec80a39e0 2020-02-11T16:11:09.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fdebc001860 con 0x7fdec80a39e0 2020-02-11T16:11:09.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 >> v1:172.21.15.52:6789/0 conn(0x7fdec80a39e0 legacy=0x7fdec812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:09.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb40038e0 0x7fdeb4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:09.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 0x7fdeb40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:09.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4004930 0x7fdeb4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:09.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80a4280 con 0x7fdeb4004930 2020-02-11T16:11:09.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb4005210 con 0x7fdeb40038e0 2020-02-11T16:11:09.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb400b720 con 0x7fdec80a7120 2020-02-11T16:11:09.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb40038e0 0x7fdeb4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:09.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdecc848700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4004930 0x7fdeb4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:09.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.649+0000 7fdec77fe700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 0x7fdeb40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:09.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 -- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 msgr2=0x7fdeb40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:09.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec80a7120 0x7fdeb40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:09.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 -- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4004930 msgr2=0x7fdeb4004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:09.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4004930 0x7fdeb4004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:09.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 -- 172.21.15.88:0/1700396257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4003230 con 0x7fdeb40038e0 2020-02-11T16:11:09.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdecc848700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4004930 0x7fdeb4004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:11:09.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb40038e0 0x7fdeb4003ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb40038e0 0x7fdeb4003ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb40038e0 0x7fdeb4003ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).ready entity=mon.1 client_cookie=955f76720736f7b7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:09.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb40038e0 0x7fdeb4003ce0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb8010e30 con 0x7fdeb40038e0 2020-02-11T16:11:09.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb40038e0 0x7fdeb4003ce0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec7fff700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb40038e0 0x7fdeb4003ce0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8008930 con 0x7fdeb40038e0 2020-02-11T16:11:09.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdec6ffd700 1 -- 172.21.15.88:0/1700396257 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb8008c90 con 0x7fdeb40038e0 2020-02-11T16:11:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdece2ab700 1 -- 172.21.15.88:0/1700396257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb40038e0 msgr2=0x7fdeb4003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdece2ab700 1 --2- 172.21.15.88:0/1700396257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb40038e0 0x7fdeb4003ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).stop 2020-02-11T16:11:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdecc848700 1 -- 172.21.15.88:0/1700396257 reap_dead start 2020-02-11T16:11:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdece2ab700 1 -- 172.21.15.88:0/1700396257 shutdown_connections 2020-02-11T16:11:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.650+0000 7fdece2ab700 1 -- 172.21.15.88:0/1700396257 >> 172.21.15.88:0/1700396257 conn(0x7fdec809d110 msgr2=0x7fdec809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.651+0000 7fdece2ab700 1 -- 172.21.15.88:0/1700396257 shutdown_connections 2020-02-11T16:11:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.651+0000 7fdece2ab700 1 -- 172.21.15.88:0/1700396257 wait complete. 2020-02-11T16:11:09.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.651+0000 7fdece2ab700 1 Processor -- start 2020-02-11T16:11:09.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.651+0000 7fdece2ab700 1 -- start start 2020-02-11T16:11:09.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdece2ab700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdec809f380 0x7fdec8135920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:09.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdece2ab700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec81329f0 0x7fdec8132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:09.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdece2ab700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec8137760 con 0x7fdec8135d80 2020-02-11T16:11:09.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdece2ab700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec8137570 con 0x7fdec809f380 2020-02-11T16:11:09.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdece2ab700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec81357a0 con 0x7fdec81329f0 2020-02-11T16:11:09.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdec7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdec809f380 0x7fdec8135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:09.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdecc848700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec81329f0 0x7fdec8132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:09.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdecc848700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec81329f0 0x7fdec8132e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:48706/0 (socket says 172.21.15.88:48706) 2020-02-11T16:11:09.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdec7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdec809f380 0x7fdec8135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:40364/0 (socket says 172.21.15.88:40364) 2020-02-11T16:11:09.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdecc848700 1 -- 172.21.15.88:0/3616462799 learned_addr learned my addr 172.21.15.88:0/3616462799 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:09.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdecc848700 1 -- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec81329f0 msgr2=0x7fdec8132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:11:09.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.652+0000 7fdecc848700 1 -- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec81329f0 msgr2=0x7fdec8132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:09.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdecc848700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec81329f0 0x7fdec8132e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:09.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdecc848700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec81329f0 0x7fdec8132e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:09.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec7fff700 1 -- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec81329f0 msgr2=0x7fdec8132e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:11:09.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec81329f0 0x7fdec8132e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:09.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec7fff700 1 -- 172.21.15.88:0/3616462799 >> v1:172.21.15.52:6789/0 conn(0x7fdec8135d80 legacy=0x7fdec81322e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:09.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec7fff700 1 -- 172.21.15.88:0/3616462799 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec8134ee0 con 0x7fdec809f380 2020-02-11T16:11:09.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> v2:172.21.15.52:3300/0 conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> v2:172.21.15.52:3300/0 conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec57fa700 1 -- 172.21.15.88:0/3616462799 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb8008e60 con 0x7fdec809f380 2020-02-11T16:11:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec57fa700 1 -- 172.21.15.88:0/3616462799 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8005ac0 con 0x7fdec809f380 2020-02-11T16:11:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdece2ab700 1 -- 172.21.15.88:0/3616462799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec81379c0 con 0x7fdec809f380 2020-02-11T16:11:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdec57fa700 1 -- 172.21.15.88:0/3616462799 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb8005e60 con 0x7fdec809f380 2020-02-11T16:11:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.653+0000 7fdece2ab700 1 -- 172.21.15.88:0/3616462799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec8133a40 con 0x7fdec809f380 2020-02-11T16:11:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.654+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.654+0000 7fdec57fa700 1 -- 172.21.15.88:0/3616462799 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdeb8007c00 con 0x7fdec809f380 2020-02-11T16:11:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.654+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.654+0000 7fdece2ab700 1 -- 172.21.15.88:0/3616462799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec8134c10 con 0x7fdec809f380 2020-02-11T16:11:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.654+0000 7fdec57fa700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdea8039d00 0x7fdea803c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.654+0000 7fdec57fa700 1 -- 172.21.15.88:0/3616462799 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdeb8049be0 con 0x7fdec809f380 2020-02-11T16:11:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.654+0000 7fdec77fe700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdea8039d00 0x7fdea803c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.655+0000 7fdec77fe700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdea8039d00 0x7fdea803c1c0 crc :-1 s=READY pgs=207 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:09.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.658+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.658+0000 7fdec57fa700 1 -- 172.21.15.88:0/3616462799 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fdec8134c10 con 0x7fdec809f380 2020-02-11T16:11:09.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.840+0000 7fdece2ab700 1 -- 172.21.15.88:0/3616462799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdec8136190 con 0x7fdec809f380 2020-02-11T16:11:09.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.841+0000 7fdec7fff700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:09.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.841+0000 7fdec57fa700 1 -- 172.21.15.88:0/3616462799 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fdec8136190 con 0x7fdec809f380 2020-02-11T16:11:09.843 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":54,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:09.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 -- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdea8039d00 msgr2=0x7fdea803c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:09.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdea8039d00 0x7fdea803c1c0 crc :-1 s=READY pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:09.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 -- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 msgr2=0x7fdec8135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:09.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 0x7fdec8135920 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7fdeb8002f30 tx=0x7fdeb8010080).stop 2020-02-11T16:11:09.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 -- 172.21.15.88:0/3616462799 shutdown_connections 2020-02-11T16:11:09.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdec81329f0 0x7fdec8132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:09.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdea8039d00 0x7fdea803c1c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:09.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 --2- 172.21.15.88:0/3616462799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdec809f380 0x7fdec8135920 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:09.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 -- 172.21.15.88:0/3616462799 >> 172.21.15.88:0/3616462799 conn(0x7fdec809d110 msgr2=0x7fdec805a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:09.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 -- 172.21.15.88:0/3616462799 shutdown_connections 2020-02-11T16:11:09.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:09.842+0000 7fdece2ab700 1 -- 172.21.15.88:0/3616462799 wait complete. 2020-02-11T16:11:09.855 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":54,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:12.350 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:11:12.352 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:11:12.856 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:11:12.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.971+0000 7f76e9636700 1 Processor -- start 2020-02-11T16:11:12.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.971+0000 7f76e9636700 1 -- start start 2020-02-11T16:11:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e9636700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76e40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e9636700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76e40a5cf0 0x7f76e413c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e9636700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e4136930 con 0x7f76e40a7120 2020-02-11T16:11:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e9636700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e40a6470 con 0x7f76e40a5cf0 2020-02-11T16:11:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e9636700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40a49b0 con 0x7f76e40a2900 2020-02-11T16:11:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76e40a5cf0 0x7f76e413c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76e40a5cf0 0x7f76e413c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54390/0 (socket says 172.21.15.88:54390) 2020-02-11T16:11:12.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e2ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f76e40a7120 0x7f76e413c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42012/0 (socket says 172.21.15.88:42012) 2020-02-11T16:11:12.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 -- 172.21.15.88:0/3785184686 learned_addr learned my addr 172.21.15.88:0/3785184686 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:12.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e27fc700 1 --2- 172.21.15.88:0/3785184686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76e40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:12.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 -- 172.21.15.88:0/3785184686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 msgr2=0x7f76e40a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:12.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 --2- 172.21.15.88:0/3785184686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76e40a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:12.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 -- 172.21.15.88:0/3785184686 >> v1:172.21.15.88:6789/0 conn(0x7f76e40a7120 legacy=0x7f76e413c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:12.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e1ffb700 1 -- 172.21.15.88:0/3785184686 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215631081 0 0) 0x7f76e4136930 con 0x7f76e40a7120 2020-02-11T16:11:12.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 -- 172.21.15.88:0/3785184686 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40a4c50 con 0x7f76e40a5cf0 2020-02-11T16:11:12.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e27fc700 1 --2- 172.21.15.88:0/3785184686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76e40a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:11:12.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 --2- 172.21.15.88:0/3785184686 >> v2:172.21.15.88:3300/0 conn(0x7f76e40a5cf0 0x7f76e413c830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76dc0032b0 tx=0x7f76dc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 --2- 172.21.15.88:0/3785184686 >> v2:172.21.15.88:3300/0 conn(0x7f76e40a5cf0 0x7f76e413c830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76dc0032b0 tx=0x7f76dc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 --2- 172.21.15.88:0/3785184686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e40a5cf0 0x7f76e413c830 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f76dc0032b0 tx=0x7f76dc008c60).ready entity=mon.1 client_cookie=f9a9fa6ca64bfcbd server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:12.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 --2- 172.21.15.88:0/3785184686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e40a5cf0 0x7f76e413c830 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f76dc0032b0 tx=0x7f76dc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e1ffb700 1 -- 172.21.15.88:0/3785184686 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76dc00a160 con 0x7f76e40a5cf0 2020-02-11T16:11:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 --2- 172.21.15.88:0/3785184686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e40a5cf0 0x7f76e413c830 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f76dc0032b0 tx=0x7f76dc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e1ffb700 1 -- 172.21.15.88:0/3785184686 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc00a2c0 con 0x7f76e40a5cf0 2020-02-11T16:11:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e37fe700 1 --2- 172.21.15.88:0/3785184686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e40a5cf0 0x7f76e413c830 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f76dc0032b0 tx=0x7f76dc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e1ffb700 1 -- 172.21.15.88:0/3785184686 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76dc00a660 con 0x7f76e40a5cf0 2020-02-11T16:11:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e9636700 1 -- 172.21.15.88:0/3785184686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e40a5cf0 msgr2=0x7f76e413c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.972+0000 7f76e9636700 1 --2- 172.21.15.88:0/3785184686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e40a5cf0 0x7f76e413c830 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f76dc0032b0 tx=0x7f76dc008c60).stop 2020-02-11T16:11:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.973+0000 7f76e9636700 1 -- 172.21.15.88:0/3785184686 shutdown_connections 2020-02-11T16:11:12.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.973+0000 7f76e9636700 1 --2- 172.21.15.88:0/3785184686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e40a5cf0 0x7f76e413c830 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:12.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.973+0000 7f76e9636700 1 --2- 172.21.15.88:0/3785184686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76e40a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:12.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.973+0000 7f76e9636700 1 -- 172.21.15.88:0/3785184686 >> 172.21.15.88:0/3785184686 conn(0x7f76e409d110 msgr2=0x7f76e409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:12.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.973+0000 7f76e9636700 1 -- 172.21.15.88:0/3785184686 shutdown_connections 2020-02-11T16:11:12.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.973+0000 7f76e9636700 1 -- 172.21.15.88:0/3785184686 wait complete. 2020-02-11T16:11:12.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.974+0000 7f76e9636700 1 Processor -- start 2020-02-11T16:11:12.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.974+0000 7f76e9636700 1 -- start start 2020-02-11T16:11:12.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e9636700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76e409fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:12.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e9636700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e41400a0 con 0x7f76e40a5cf0 2020-02-11T16:11:12.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e9636700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e4140340 con 0x7f76e40a7120 2020-02-11T16:11:12.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e9636700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e413f8a0 con 0x7f76e40a2900 2020-02-11T16:11:12.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f76e40a7120 0x7f76e414cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42022/0 (socket says 172.21.15.88:42022) 2020-02-11T16:11:12.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e37fe700 1 -- 172.21.15.88:0/2713475821 learned_addr learned my addr 172.21.15.88:0/2713475821 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:12.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352021059 0 0) 0x7f76e4140340 con 0x7f76e40a7120 2020-02-11T16:11:12.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76e409fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:12.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c0002fe0 con 0x7f76e40a7120 2020-02-11T16:11:12.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 633224302 0 0) 0x7f76c0002fe0 con 0x7f76e40a7120 2020-02-11T16:11:12.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e2ffd700 1 -- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 msgr2=0x7f76e409fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:11:12.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e2ffd700 1 -- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 msgr2=0x7f76e409fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:12.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f76e4140340 con 0x7f76e40a7120 2020-02-11T16:11:12.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76e409fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f76dc011de0 con 0x7f76e40a7120 2020-02-11T16:11:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76e409fac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 msgr2=0x7f76e409fac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:11:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76e409fac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 >> v1:172.21.15.88:6789/0 conn(0x7f76e40a7120 legacy=0x7f76e414cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 >> v1:172.21.15.52:6789/0 conn(0x7f76e40a5cf0 legacy=0x7f76e413f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:12.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:12.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76c0003920 0x7f76c0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:12.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76c00041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:12.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e413f8a0 con 0x7f76c0003920 2020-02-11T16:11:12.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0005500 con 0x7f76c00049b0 2020-02-11T16:11:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0004670 con 0x7f76e40a2900 2020-02-11T16:11:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:12.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e37fe700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76c00041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:12.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.975+0000 7f76e27fc700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76c0003920 0x7f76c0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e37fe700 1 -- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 msgr2=0x7f76c00041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:11:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e37fe700 1 -- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 msgr2=0x7f76c00041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 -- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 msgr2=0x7f76c00041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e37fe700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76c00041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e37fe700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76c00041e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76e40a2900 0x7f76c00041e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 -- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76c0003920 msgr2=0x7f76c0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76c0003920 0x7f76c0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 -- 172.21.15.88:0/2713475821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e409e040 con 0x7f76c00049b0 2020-02-11T16:11:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e9636700 1 -- 172.21.15.88:0/2713475821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e414d380 con 0x7f76c00049b0 2020-02-11T16:11:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e27fc700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76c0003920 0x7f76c0003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:11:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e9636700 1 -- 172.21.15.88:0/2713475821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e413fdc0 con 0x7f76c00049b0 2020-02-11T16:11:12.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:12.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76d400cc20 con 0x7f76c00049b0 2020-02-11T16:11:12.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d400cd80 con 0x7f76c00049b0 2020-02-11T16:11:12.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76d4004700 con 0x7f76c00049b0 2020-02-11T16:11:12.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.976+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.977+0000 7f76e9636700 1 -- 172.21.15.88:0/2713475821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c4003340 con 0x7f76c00049b0 2020-02-11T16:11:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.977+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f76d4004860 con 0x7f76c00049b0 2020-02-11T16:11:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.977+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.977+0000 7f76d3fff700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0041f70 0x7f76c0044430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:12.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.977+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f76d4049910 con 0x7f76c00049b0 2020-02-11T16:11:12.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.977+0000 7f76e27fc700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0041f70 0x7f76c0044430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:12.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.977+0000 7f76e27fc700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0041f70 0x7f76c0044430 crc :-1 s=READY pgs=208 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.980+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:12.980+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f76d402efb0 con 0x7f76c00049b0 2020-02-11T16:11:13.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.161+0000 7f76e9636700 1 -- 172.21.15.88:0/2713475821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f76c40036e0 con 0x7f76c00049b0 2020-02-11T16:11:13.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.162+0000 7f76e2ffd700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.162+0000 7f76d3fff700 1 -- 172.21.15.88:0/2713475821 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7f76d4031ac0 con 0x7f76c00049b0 2020-02-11T16:11:13.164 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:13.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.163+0000 7f76e9636700 1 -- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0041f70 msgr2=0x7f76c0044430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.163+0000 7f76e9636700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f76c0041f70 0x7f76c0044430 crc :-1 s=READY pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.163+0000 7f76e9636700 1 -- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 msgr2=0x7f76c0004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.163+0000 7f76e9636700 1 --2- 172.21.15.88:0/2713475821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76c00049b0 0x7f76c0004dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f76d4000b80 tx=0x7f76d4010c50).stop 2020-02-11T16:11:13.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.163+0000 7f76e37fe700 1 -- 172.21.15.88:0/2713475821 reap_dead start 2020-02-11T16:11:13.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.163+0000 7f76e9636700 1 -- 172.21.15.88:0/2713475821 shutdown_connections 2020-02-11T16:11:13.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.163+0000 7f76e9636700 1 -- 172.21.15.88:0/2713475821 >> 172.21.15.88:0/2713475821 conn(0x7f76e409d110 msgr2=0x7f76e405b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:13.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.163+0000 7f76e9636700 1 -- 172.21.15.88:0/2713475821 shutdown_connections 2020-02-11T16:11:13.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.163+0000 7f76e9636700 1 -- 172.21.15.88:0/2713475821 wait complete. 2020-02-11T16:11:13.175 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":56,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:13.175 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:11:13.176 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:11:13.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.281+0000 7f6a1df0f700 1 Processor -- start 2020-02-11T16:11:13.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.281+0000 7f6a1df0f700 1 -- start start 2020-02-11T16:11:13.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a1df0f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a180a5de0 0x7f6a180a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:13.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a1df0f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a180a31b0 con 0x7f6a18134a50 2020-02-11T16:11:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a1df0f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a180a3570 con 0x7f6a180a18a0 2020-02-11T16:11:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a1df0f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a180a3810 con 0x7f6a180a5de0 2020-02-11T16:11:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a180a5de0 0x7f6a180a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a180a5de0 0x7f6a180a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54408/0 (socket says 172.21.15.88:54408) 2020-02-11T16:11:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a177fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6a180a18a0 0x7f6a180a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42032/0 (socket says 172.21.15.88:42032) 2020-02-11T16:11:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 -- 172.21.15.88:0/1986737435 learned_addr learned my addr 172.21.15.88:0/1986737435 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 -- 172.21.15.88:0/1986737435 >> v1:172.21.15.88:6789/0 conn(0x7f6a180a18a0 legacy=0x7f6a180a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 -- 172.21.15.88:0/1986737435 >> v1:172.21.15.52:6789/0 conn(0x7f6a18134a50 legacy=0x7f6a18134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:13.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 -- 172.21.15.88:0/1986737435 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180a3ab0 con 0x7f6a180a5de0 2020-02-11T16:11:13.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/1986737435 >> v2:172.21.15.88:3300/0 conn(0x7f6a180a5de0 0x7f6a180a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6a1805bbc0 tx=0x7f6a0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/1986737435 >> v2:172.21.15.88:3300/0 conn(0x7f6a180a5de0 0x7f6a180a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6a1805bbc0 tx=0x7f6a0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/1986737435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5de0 0x7f6a180a6260 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0088e0).ready entity=mon.1 client_cookie=2bd5aec384333f46 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/1986737435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5de0 0x7f6a180a6260 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a167fc700 1 -- 172.21.15.88:0/1986737435 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a0c011720 con 0x7f6a180a5de0 2020-02-11T16:11:13.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/1986737435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5de0 0x7f6a180a6260 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/1986737435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5de0 0x7f6a180a6260 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a167fc700 1 -- 172.21.15.88:0/1986737435 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c011880 con 0x7f6a180a5de0 2020-02-11T16:11:13.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a167fc700 1 -- 172.21.15.88:0/1986737435 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a0c011c20 con 0x7f6a180a5de0 2020-02-11T16:11:13.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a1df0f700 1 -- 172.21.15.88:0/1986737435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5de0 msgr2=0x7f6a180a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.282+0000 7f6a1df0f700 1 --2- 172.21.15.88:0/1986737435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5de0 0x7f6a180a6260 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0088e0).stop 2020-02-11T16:11:13.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.283+0000 7f6a1df0f700 1 -- 172.21.15.88:0/1986737435 shutdown_connections 2020-02-11T16:11:13.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.283+0000 7f6a1df0f700 1 --2- 172.21.15.88:0/1986737435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5de0 0x7f6a180a6260 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.283+0000 7f6a1df0f700 1 -- 172.21.15.88:0/1986737435 >> 172.21.15.88:0/1986737435 conn(0x7f6a1809d110 msgr2=0x7f6a1809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:13.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.283+0000 7f6a1df0f700 1 -- 172.21.15.88:0/1986737435 shutdown_connections 2020-02-11T16:11:13.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.283+0000 7f6a1df0f700 1 -- 172.21.15.88:0/1986737435 wait complete. 2020-02-11T16:11:13.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a1df0f700 1 Processor -- start 2020-02-11T16:11:13.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a1df0f700 1 -- start start 2020-02-11T16:11:13.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a1df0f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a180a18a0 0x7f6a1812cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a1df0f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a180a5de0 0x7f6a1812c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a1df0f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6a18134a50 0x7f6a181261d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a1df0f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1809f0b0 con 0x7f6a18134a50 2020-02-11T16:11:13.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a1df0f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1809eb70 con 0x7f6a180a18a0 2020-02-11T16:11:13.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a1df0f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1809ee10 con 0x7f6a180a5de0 2020-02-11T16:11:13.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a177fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a180a18a0 0x7f6a1812cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a177fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a180a18a0 0x7f6a1812cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54412/0 (socket says 172.21.15.88:54412) 2020-02-11T16:11:13.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.284+0000 7f6a177fe700 1 -- 172.21.15.88:0/817368236 learned_addr learned my addr 172.21.15.88:0/817368236 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:13.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a180a5de0 0x7f6a1812c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a17fff700 1 --2- 172.21.15.88:0/817368236 >> v2:172.21.15.52:3300/0 conn(0x7f6a18134a50 0x7f6a181261d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a16ffd700 1 -- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a180a5de0 msgr2=0x7f6a1812c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:11:13.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a16ffd700 1 -- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a180a5de0 msgr2=0x7f6a1812c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:13.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a180a5de0 0x7f6a1812c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:13.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a180a5de0 0x7f6a1812c3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:13.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 -- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a180a5de0 msgr2=0x7f6a1812c3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:11:13.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a180a5de0 0x7f6a1812c3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 -- 172.21.15.88:0/817368236 >> v2:172.21.15.52:3300/0 conn(0x7f6a18134a50 msgr2=0x7f6a181261d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 --2- 172.21.15.88:0/817368236 >> v2:172.21.15.52:3300/0 conn(0x7f6a18134a50 0x7f6a181261d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 -- 172.21.15.88:0/817368236 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1809e830 con 0x7f6a180a18a0 2020-02-11T16:11:13.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a17fff700 1 --2- 172.21.15.88:0/817368236 >> v2:172.21.15.52:3300/0 conn(0x7f6a18134a50 0x7f6a181261d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:11:13.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 --2- 172.21.15.88:0/817368236 >> v2:172.21.15.88:3300/0 conn(0x7f6a180a18a0 0x7f6a1812cc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a08001000 tx=0x7f6a08010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 --2- 172.21.15.88:0/817368236 >> v2:172.21.15.88:3300/0 conn(0x7f6a180a18a0 0x7f6a1812cc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a08001000 tx=0x7f6a08010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a18a0 0x7f6a1812cc60 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f6a08001000 tx=0x7f6a08010a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a18a0 0x7f6a1812cc60 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f6a08001000 tx=0x7f6a08010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a0800c970 con 0x7f6a180a18a0 2020-02-11T16:11:13.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a18a0 0x7f6a1812cc60 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f6a08001000 tx=0x7f6a08010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a18a0 0x7f6a1812cc60 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f6a08001000 tx=0x7f6a08010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0800cad0 con 0x7f6a180a18a0 2020-02-11T16:11:13.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a1df0f700 1 -- 172.21.15.88:0/817368236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a181328f0 con 0x7f6a180a18a0 2020-02-11T16:11:13.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a080044f0 con 0x7f6a180a18a0 2020-02-11T16:11:13.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a1df0f700 1 -- 172.21.15.88:0/817368236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1812ca40 con 0x7f6a180a18a0 2020-02-11T16:11:13.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.285+0000 7f6a177fe700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a18a0 0x7f6a1812cc60 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f6a08001000 tx=0x7f6a08010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a1df0f700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 0x7f6a18126630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a1df0f700 1 -- 172.21.15.88:0/817368236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1805e2f0 con 0x7f6a180a5170 2020-02-11T16:11:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6a08004760 con 0x7f6a180a18a0 2020-02-11T16:11:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a177fe700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a18a0 0x7f6a1812cc60 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f6a08001000 tx=0x7f6a08010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 0x7f6a18126630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a14ff9700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69f8039ca0 0x7f69f803c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6a08049600 con 0x7f6a180a18a0 2020-02-11T16:11:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a16ffd700 1 -- 172.21.15.88:0/817368236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a180565b0 con 0x7f6a180a5170 2020-02-11T16:11:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 0x7f6a18126630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 0x7f6a18126630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a17fff700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69f8039ca0 0x7f69f803c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 0x7f6a18126630 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 0x7f6a18126630 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a0c011cb0 con 0x7f6a180a5170 2020-02-11T16:11:13.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.286+0000 7f6a17fff700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69f8039ca0 0x7f69f803c160 crc :-1 s=READY pgs=209 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.287+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 0x7f6a18126630 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.287+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6a0c007340 con 0x7f6a180a5170 2020-02-11T16:11:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.287+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 msgr2=0x7f6a18126630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.287+0000 7f6a14ff9700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 0x7f6a18126630 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).stop 2020-02-11T16:11:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.287+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 msgr2=0x7f6a18126630 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.287+0000 7f6a14ff9700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a5170 0x7f6a18126630 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a1df0f700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 0x7f6a1805a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a1df0f700 1 -- 172.21.15.88:0/817368236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18132a80 con 0x7f6a18126a90 2020-02-11T16:11:13.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 0x7f6a1805a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a16ffd700 1 -- 172.21.15.88:0/817368236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6a1805ccb0 con 0x7f6a18126a90 2020-02-11T16:11:13.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 0x7f6a1805a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 0x7f6a1805a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 0x7f6a1805a5d0 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 0x7f6a1805a5d0 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a0c00ea40 con 0x7f6a18126a90 2020-02-11T16:11:13.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a16ffd700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 0x7f6a1805a5d0 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7f6a0c00eba0 con 0x7f6a18126a90 2020-02-11T16:11:13.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 msgr2=0x7f6a1805a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a14ff9700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 0x7f6a1805a5d0 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f6a1805bbc0 tx=0x7f6a0c0114d0).stop 2020-02-11T16:11:13.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a14ff9700 1 -- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 msgr2=0x7f6a1805a5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.295+0000 7f6a14ff9700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18126a90 0x7f6a1805a5d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a1df0f700 1 -- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69f8039ca0 msgr2=0x7f69f803c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a1df0f700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69f8039ca0 0x7f69f803c160 crc :-1 s=READY pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a1df0f700 1 -- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a18a0 msgr2=0x7f6a1812cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a1df0f700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a18a0 0x7f6a1812cc60 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f6a08001000 tx=0x7f6a08010a60).stop 2020-02-11T16:11:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a17fff700 1 -- 172.21.15.88:0/817368236 reap_dead start 2020-02-11T16:11:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a17fff700 1 -- 172.21.15.88:0/817368236 reap_dead start 2020-02-11T16:11:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a1df0f700 1 -- 172.21.15.88:0/817368236 shutdown_connections 2020-02-11T16:11:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a1df0f700 1 --2- 172.21.15.88:0/817368236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a180a18a0 0x7f6a1812cc60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a1df0f700 1 -- 172.21.15.88:0/817368236 >> 172.21.15.88:0/817368236 conn(0x7f6a1809d110 msgr2=0x7f6a18069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a1df0f700 1 -- 172.21.15.88:0/817368236 shutdown_connections 2020-02-11T16:11:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.296+0000 7f6a1df0f700 1 -- 172.21.15.88:0/817368236 wait complete. 2020-02-11T16:11:13.321 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:11:13.321 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:13.321 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:13.322 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:11:13.322 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 56, 2020-02-11T16:11:13.322 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:11:13.322 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:11:13.322 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:11:13.322 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:11:13.322 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.323 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:11:13.323 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:13.323 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:11:13.323 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:11:13.323 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:13.323 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:13.323 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:13.323 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:13.324 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:13.324 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:13.324 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.324 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:11:13.324 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:11:13.324 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:13.324 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:13.325 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:13.325 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:13.325 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:13.325 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:13.325 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.325 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:11:13.326 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:11:13.326 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:11:13.326 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:11:13.326 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:11:13.326 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:11:13.326 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:13.327 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:13.327 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:11:13.327 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:11:13.327 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:13.327 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:11:13.327 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:13.328 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:13.328 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:13.328 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:13.328 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:13.328 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:13.328 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.329 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:11:13.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.329 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:11:13.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.329 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:13.329 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:13.329 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:13.330 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:13.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.330 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:13.330 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:11:13.330 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.331 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:13.331 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:11:13.331 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.331 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.331 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.331 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:11:13.331 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:11:13.332 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:13.332 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:13.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.332 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:13.332 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:13.332 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:13.333 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:13.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.333 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:13.333 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:11:13.333 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.333 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:13.334 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:11:13.334 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.334 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.334 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.334 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:11:13.334 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:11:13.335 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:13.335 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:13.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.335 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:11:13.335 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:11:13.335 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:13.335 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:11:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:11:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:11:13.338 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:11:13.338 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:13.338 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:13.338 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.338 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.338 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:11:13.339 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:11:13.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.339 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:13.339 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:13.339 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:13.339 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.339 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.340 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:11:13.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.340 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:13.340 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:13.340 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:13.340 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.340 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.340 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:11:13.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.341 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:13.341 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:13.341 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:11:13.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.341 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.341 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:11:13.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.342 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:13.342 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:13.342 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:11:13.342 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.342 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.342 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:11:13.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.343 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:13.343 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:13.343 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:11:13.343 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.343 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.343 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.343 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:11:13.344 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:11:13.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.448+0000 7fb229565700 1 Processor -- start 2020-02-11T16:11:13.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.448+0000 7fb229565700 1 -- start start 2020-02-11T16:11:13.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb229565700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a18a0 0x7fb2240a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:13.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb229565700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2240a6260 0x7fb22412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:13.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb229565700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240a3570 con 0x7fb2240a5de0 2020-02-11T16:11:13.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb229565700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240a3810 con 0x7fb2240a6260 2020-02-11T16:11:13.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb229565700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240a3ab0 con 0x7fb2240a18a0 2020-02-11T16:11:13.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2240a6260 0x7fb22412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2240a6260 0x7fb22412eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54424/0 (socket says 172.21.15.88:54424) 2020-02-11T16:11:13.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 -- 172.21.15.88:0/331738284 learned_addr learned my addr 172.21.15.88:0/331738284 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:13.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb222ffd700 1 --2- 172.21.15.88:0/331738284 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a18a0 0x7fb2240a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 -- 172.21.15.88:0/331738284 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a18a0 msgr2=0x7fb2240a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:13.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 --2- 172.21.15.88:0/331738284 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a18a0 0x7fb2240a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:13.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 -- 172.21.15.88:0/331738284 >> v1:172.21.15.52:6789/0 conn(0x7fb2240a5de0 legacy=0x7fb22412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:13.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 -- 172.21.15.88:0/331738284 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240a3d50 con 0x7fb2240a6260 2020-02-11T16:11:13.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb222ffd700 1 --2- 172.21.15.88:0/331738284 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a18a0 0x7fb2240a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:11:13.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 --2- 172.21.15.88:0/331738284 >> v2:172.21.15.88:3300/0 conn(0x7fb2240a6260 0x7fb22412eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb22405b910 tx=0x7fb2140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 --2- 172.21.15.88:0/331738284 >> v2:172.21.15.88:3300/0 conn(0x7fb2240a6260 0x7fb22412eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb22405b910 tx=0x7fb2140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 --2- 172.21.15.88:0/331738284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb22412eab0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2140088e0).ready entity=mon.1 client_cookie=8586ecc2a42b52e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 --2- 172.21.15.88:0/331738284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb22412eab0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb221ffb700 1 -- 172.21.15.88:0/331738284 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2140116e0 con 0x7fb2240a6260 2020-02-11T16:11:13.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 --2- 172.21.15.88:0/331738284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb22412eab0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb221ffb700 1 -- 172.21.15.88:0/331738284 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb214011840 con 0x7fb2240a6260 2020-02-11T16:11:13.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb2237fe700 1 --2- 172.21.15.88:0/331738284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb22412eab0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb229565700 1 -- 172.21.15.88:0/331738284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 msgr2=0x7fb22412eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb221ffb700 1 -- 172.21.15.88:0/331738284 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb214011be0 con 0x7fb2240a6260 2020-02-11T16:11:13.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.449+0000 7fb229565700 1 --2- 172.21.15.88:0/331738284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb22412eab0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2140088e0).stop 2020-02-11T16:11:13.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.450+0000 7fb229565700 1 -- 172.21.15.88:0/331738284 shutdown_connections 2020-02-11T16:11:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.450+0000 7fb229565700 1 --2- 172.21.15.88:0/331738284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb22412eab0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.450+0000 7fb229565700 1 --2- 172.21.15.88:0/331738284 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a18a0 0x7fb2240a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.450+0000 7fb229565700 1 -- 172.21.15.88:0/331738284 >> 172.21.15.88:0/331738284 conn(0x7fb22409d110 msgr2=0x7fb22409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.450+0000 7fb229565700 1 -- 172.21.15.88:0/331738284 shutdown_connections 2020-02-11T16:11:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.450+0000 7fb229565700 1 -- 172.21.15.88:0/331738284 wait complete. 2020-02-11T16:11:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.451+0000 7fb229565700 1 Processor -- start 2020-02-11T16:11:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.451+0000 7fb229565700 1 -- start start 2020-02-11T16:11:13.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.451+0000 7fb229565700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2240a18a0 0x7fb224131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.451+0000 7fb229565700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a5de0 0x7fb224146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.451+0000 7fb229565700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2240a6260 0x7fb2241470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.451+0000 7fb229565700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb224131fd0 con 0x7fb2240a18a0 2020-02-11T16:11:13.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.451+0000 7fb229565700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb224132240 con 0x7fb2240a6260 2020-02-11T16:11:13.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.451+0000 7fb229565700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb224146500 con 0x7fb2240a5de0 2020-02-11T16:11:13.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.451+0000 7fb2237fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2240a6260 0x7fb2241470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2240a6260 0x7fb2241470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54434/0 (socket says 172.21.15.88:54434) 2020-02-11T16:11:13.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 -- 172.21.15.88:0/2980219678 learned_addr learned my addr 172.21.15.88:0/2980219678 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:13.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a18a0 0x7fb224131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2227fc700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a5de0 0x7fb224146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2227fc700 1 -- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a5de0 msgr2=0x7fb224146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:11:13.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2227fc700 1 -- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a5de0 msgr2=0x7fb224146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:13.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2227fc700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a5de0 0x7fb224146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:13.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 -- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a5de0 msgr2=0x7fb224146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2227fc700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a5de0 0x7fb224146c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:13.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2240a5de0 0x7fb224146c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 -- 172.21.15.88:0/2980219678 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a18a0 msgr2=0x7fb224131b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 --2- 172.21.15.88:0/2980219678 >> v2:172.21.15.52:3300/0 conn(0x7fb2240a18a0 0x7fb224131b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 -- 172.21.15.88:0/2980219678 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2241467a0 con 0x7fb2240a6260 2020-02-11T16:11:13.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 --2- 172.21.15.88:0/2980219678 >> v2:172.21.15.88:3300/0 conn(0x7fb2240a6260 0x7fb2241470a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2240a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 --2- 172.21.15.88:0/2980219678 >> v2:172.21.15.88:3300/0 conn(0x7fb2240a6260 0x7fb2241470a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2240a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb2241470a0 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2240a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb2241470a0 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2240a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb214007340 con 0x7fb2240a6260 2020-02-11T16:11:13.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb2241470a0 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2240a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb2237fe700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb2241470a0 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2240a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2140074a0 con 0x7fb2240a6260 2020-02-11T16:11:13.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb229565700 1 -- 172.21.15.88:0/2980219678 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb224135610 con 0x7fb2240a6260 2020-02-11T16:11:13.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2140058b0 con 0x7fb2240a6260 2020-02-11T16:11:13.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.452+0000 7fb229565700 1 -- 172.21.15.88:0/2980219678 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb224138a60 con 0x7fb2240a6260 2020-02-11T16:11:13.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.453+0000 7fb2237fe700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb2241470a0 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2240a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.453+0000 7fb2237fe700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb2241470a0 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2240a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.453+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb214005b20 con 0x7fb2240a6260 2020-02-11T16:11:13.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.453+0000 7fb229565700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 0x7fb2241434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.453+0000 7fb229565700 1 -- 172.21.15.88:0/2980219678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22405e2f0 con 0x7fb2240a8a10 2020-02-11T16:11:13.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.453+0000 7fb21bfff700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb208039cd0 0x7fb20803c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.453+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 0x7fb2241434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.453+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb21404a270 con 0x7fb2240a6260 2020-02-11T16:11:13.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.453+0000 7fb2227fc700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb208039cd0 0x7fb20803c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.453+0000 7fb222ffd700 1 -- 172.21.15.88:0/2980219678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2241469a0 con 0x7fb2240a8a10 2020-02-11T16:11:13.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 0x7fb2241434e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb2227fc700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb208039cd0 0x7fb20803c190 crc :-1 s=READY pgs=210 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 0x7fb2241434e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 0x7fb2241434e0 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 0x7fb2241434e0 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21c005e30 con 0x7fb2240a8a10 2020-02-11T16:11:13.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 0x7fb2241434e0 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fb21c012a90 con 0x7fb2240a8a10 2020-02-11T16:11:13.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 msgr2=0x7fb2241434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb21bfff700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 0x7fb2241434e0 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).stop 2020-02-11T16:11:13.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 msgr2=0x7fb2241434e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:13.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.454+0000 7fb21bfff700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2240a8a10 0x7fb2241434e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.462+0000 7fb229565700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 0x7fb22405a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.462+0000 7fb229565700 1 -- 172.21.15.88:0/2980219678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240565b0 con 0x7fb224143940 2020-02-11T16:11:13.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.462+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 0x7fb22405a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb222ffd700 1 -- 172.21.15.88:0/2980219678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb2240a9dd0 con 0x7fb224143940 2020-02-11T16:11:13.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 0x7fb22405a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 0x7fb22405a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 0x7fb22405a5d0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 0x7fb22405a5d0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21c012d80 con 0x7fb224143940 2020-02-11T16:11:13.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb222ffd700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 0x7fb22405a5d0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4191 (secure 0 0 0) 0x7fb21c0078f0 con 0x7fb224143940 2020-02-11T16:11:13.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 msgr2=0x7fb22405a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb21bfff700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 0x7fb22405a5d0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7fb21c0032b0 tx=0x7fb21c011010).stop 2020-02-11T16:11:13.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb21bfff700 1 -- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 msgr2=0x7fb22405a5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:13.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.463+0000 7fb21bfff700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb224143940 0x7fb22405a5d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb229565700 1 -- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb208039cd0 msgr2=0x7fb20803c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb229565700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb208039cd0 0x7fb20803c190 crc :-1 s=READY pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb229565700 1 -- 172.21.15.88:0/2980219678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 msgr2=0x7fb2241470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb229565700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb2241470a0 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7fb22405b910 tx=0x7fb2240a1c80).stop 2020-02-11T16:11:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb2237fe700 1 -- 172.21.15.88:0/2980219678 reap_dead start 2020-02-11T16:11:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb2237fe700 1 -- 172.21.15.88:0/2980219678 reap_dead start 2020-02-11T16:11:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb229565700 1 -- 172.21.15.88:0/2980219678 shutdown_connections 2020-02-11T16:11:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb229565700 1 --2- 172.21.15.88:0/2980219678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2240a6260 0x7fb2241470a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb229565700 1 -- 172.21.15.88:0/2980219678 >> 172.21.15.88:0/2980219678 conn(0x7fb22409d110 msgr2=0x7fb2240a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb229565700 1 -- 172.21.15.88:0/2980219678 shutdown_connections 2020-02-11T16:11:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.464+0000 7fb229565700 1 -- 172.21.15.88:0/2980219678 wait complete. 2020-02-11T16:11:13.477 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:11:13.477 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:13.477 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:13.477 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:11:13.477 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 56, 2020-02-11T16:11:13.477 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:11:13.478 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:11:13.478 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:11:13.478 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:11:13.478 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.478 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:11:13.478 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:13.478 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:11:13.479 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:11:13.479 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:13.479 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:13.479 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:13.479 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:13.479 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:13.479 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:13.480 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.480 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:11:13.480 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:11:13.480 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:13.480 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:13.480 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:13.481 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:13.481 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:13.481 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:13.481 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.481 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:11:13.481 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:11:13.482 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:11:13.482 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:11:13.482 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:11:13.482 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:11:13.482 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:13.482 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:13.482 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:11:13.483 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:11:13.483 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:13.483 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:11:13.483 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:13.483 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:13.483 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:13.484 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:13.484 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:13.484 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:13.484 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.484 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:11:13.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.485 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:11:13.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.485 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:13.486 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:13.486 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:13.486 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:13.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.486 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:13.487 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:11:13.487 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.487 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:13.488 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:11:13.488 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.488 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.489 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:11:13.489 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:11:13.489 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:13.489 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:13.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.490 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:13.490 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:13.490 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:13.490 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:13.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.491 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:13.491 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:11:13.491 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.492 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:13.492 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:11:13.492 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.492 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.493 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.493 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:11:13.493 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:11:13.493 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:13.494 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:13.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.494 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:11:13.494 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:11:13.495 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:13.495 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:13.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.495 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:13.495 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:11:13.496 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.496 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:13.496 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:11:13.497 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:13.497 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.497 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.497 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:11:13.498 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:11:13.498 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:13.498 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:13.498 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.498 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:13.499 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:11:13.499 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:11:13.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.499 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:13.499 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:13.500 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:13.500 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.500 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.500 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:11:13.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.501 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:13.501 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:13.501 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:13.501 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.501 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.502 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:11:13.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.502 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:13.502 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:13.502 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:11:13.503 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.503 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:13.503 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:11:13.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:13.503 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:13.504 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:13.504 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:11:13.504 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.504 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:13.504 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:13.505 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:11:13.506 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:11:13.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.610+0000 7fa541ccb700 1 Processor -- start 2020-02-11T16:11:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.610+0000 7fa541ccb700 1 -- start start 2020-02-11T16:11:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa541ccb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa53c0a8690 0x7fa53c136040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa541ccb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c1364a0 0x7fa53c140370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa541ccb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c0a4af0 con 0x7fa53c0a3a90 2020-02-11T16:11:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa541ccb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53c1302a0 con 0x7fa53c0a8690 2020-02-11T16:11:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa541ccb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c135a20 con 0x7fa53c1364a0 2020-02-11T16:11:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa53affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa53c0a8690 0x7fa53c136040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa53b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa53c0a3a90 0x7fa53c0a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42068/0 (socket says 172.21.15.88:42068) 2020-02-11T16:11:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa53b7fe700 1 -- 172.21.15.88:0/1839530686 learned_addr learned my addr 172.21.15.88:0/1839530686 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa53bfff700 1 --2- 172.21.15.88:0/1839530686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c1364a0 0x7fa53c140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa53affd700 1 -- 172.21.15.88:0/1839530686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c1364a0 msgr2=0x7fa53c140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa53affd700 1 --2- 172.21.15.88:0/1839530686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c1364a0 0x7fa53c140370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa53affd700 1 -- 172.21.15.88:0/1839530686 >> v1:172.21.15.88:6789/0 conn(0x7fa53c0a3a90 legacy=0x7fa53c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa53a7fc700 1 -- 172.21.15.88:0/1839530686 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214748153 0 0) 0x7fa53c0a4af0 con 0x7fa53c0a3a90 2020-02-11T16:11:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa53affd700 1 -- 172.21.15.88:0/1839530686 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0a4d90 con 0x7fa53c0a8690 2020-02-11T16:11:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.611+0000 7fa53affd700 1 --2- 172.21.15.88:0/1839530686 >> v2:172.21.15.88:3300/0 conn(0x7fa53c0a8690 0x7fa53c136040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa530002f30 tx=0x7fa5300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa53affd700 1 --2- 172.21.15.88:0/1839530686 >> v2:172.21.15.88:3300/0 conn(0x7fa53c0a8690 0x7fa53c136040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa530002f30 tx=0x7fa5300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa53affd700 1 --2- 172.21.15.88:0/1839530686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c0a8690 0x7fa53c136040 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa5300088e0).ready entity=mon.1 client_cookie=9989a7005241f0ae server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa53affd700 1 --2- 172.21.15.88:0/1839530686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c0a8690 0x7fa53c136040 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa5300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa53a7fc700 1 -- 172.21.15.88:0/1839530686 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa530008e40 con 0x7fa53c0a8690 2020-02-11T16:11:13.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa53affd700 1 --2- 172.21.15.88:0/1839530686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c0a8690 0x7fa53c136040 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa5300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa53affd700 1 --2- 172.21.15.88:0/1839530686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c0a8690 0x7fa53c136040 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa5300088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa53a7fc700 1 -- 172.21.15.88:0/1839530686 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5300116a0 con 0x7fa53c0a8690 2020-02-11T16:11:13.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa53a7fc700 1 -- 172.21.15.88:0/1839530686 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa530011a40 con 0x7fa53c0a8690 2020-02-11T16:11:13.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa541ccb700 1 -- 172.21.15.88:0/1839530686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c0a8690 msgr2=0x7fa53c136040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa541ccb700 1 --2- 172.21.15.88:0/1839530686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c0a8690 0x7fa53c136040 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa5300088e0).stop 2020-02-11T16:11:13.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa541ccb700 1 -- 172.21.15.88:0/1839530686 shutdown_connections 2020-02-11T16:11:13.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa541ccb700 1 --2- 172.21.15.88:0/1839530686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c1364a0 0x7fa53c140370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:13.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa541ccb700 1 --2- 172.21.15.88:0/1839530686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c0a8690 0x7fa53c136040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa541ccb700 1 -- 172.21.15.88:0/1839530686 >> 172.21.15.88:0/1839530686 conn(0x7fa53c0ac2d0 msgr2=0x7fa53c0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:13.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa541ccb700 1 -- 172.21.15.88:0/1839530686 shutdown_connections 2020-02-11T16:11:13.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.612+0000 7fa541ccb700 1 -- 172.21.15.88:0/1839530686 wait complete. 2020-02-11T16:11:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.613+0000 7fa541ccb700 1 Processor -- start 2020-02-11T16:11:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.613+0000 7fa541ccb700 1 -- start start 2020-02-11T16:11:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa541ccb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 0x7fa53c142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa541ccb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa53c0a8690 0x7fa53c143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa541ccb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c130b50 con 0x7fa53c1364a0 2020-02-11T16:11:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa541ccb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53c130df0 con 0x7fa53c0a8690 2020-02-11T16:11:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa541ccb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c131090 con 0x7fa53c0a3a90 2020-02-11T16:11:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa53bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa53c1364a0 0x7fa53c1461d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42076/0 (socket says 172.21.15.88:42076) 2020-02-11T16:11:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa53bfff700 1 -- 172.21.15.88:0/2467563010 learned_addr learned my addr 172.21.15.88:0/2467563010 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 0x7fa53c142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342309242 0 0) 0x7fa53c130b50 con 0x7fa53c1364a0 2020-02-11T16:11:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa51c002fe0 con 0x7fa53c1364a0 2020-02-11T16:11:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> v2:172.21.15.52:3300/0 conn(0x7fa53c0a8690 0x7fa53c143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 msgr2=0x7fa53c142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:11:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 msgr2=0x7fa53c142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 0x7fa53c142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 0x7fa53c142dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 200930274 0 0) 0x7fa51c002fe0 con 0x7fa53c1364a0 2020-02-11T16:11:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa53c130b50 con 0x7fa53c1364a0 2020-02-11T16:11:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa5340018e0 con 0x7fa53c1364a0 2020-02-11T16:11:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 msgr2=0x7fa53c142dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:11:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 0x7fa53c142dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 >> v2:172.21.15.52:3300/0 conn(0x7fa53c0a8690 msgr2=0x7fa53c143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 --2- 172.21.15.88:0/2467563010 >> v2:172.21.15.52:3300/0 conn(0x7fa53c0a8690 0x7fa53c143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 >> v1:172.21.15.88:6789/0 conn(0x7fa53c1364a0 legacy=0x7fa53c1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 0x7fa51c0049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c003d80 0x7fa51c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c130df0 con 0x7fa51c003d80 2020-02-11T16:11:13.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c131090 con 0x7fa51c004e10 2020-02-11T16:11:13.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.614+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c005360 con 0x7fa53c0a3a90 2020-02-11T16:11:13.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53bfff700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c003d80 0x7fa51c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 0x7fa51c0049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 msgr2=0x7fa51c0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 msgr2=0x7fa51c0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:11:13.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 msgr2=0x7fa51c0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:13.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 0x7fa51c0049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:13.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 0x7fa51c0049b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:13.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa53c0a3a90 0x7fa51c0049b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c003d80 msgr2=0x7fa51c004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:13.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c003d80 0x7fa51c004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:13.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 -- 172.21.15.88:0/2467563010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c12e920 con 0x7fa51c004e10 2020-02-11T16:11:13.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa541ccb700 1 -- 172.21.15.88:0/2467563010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c143690 con 0x7fa51c004e10 2020-02-11T16:11:13.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa53c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa541ccb700 1 -- 172.21.15.88:0/2467563010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c139250 con 0x7fa51c004e10 2020-02-11T16:11:13.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa53c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa53c0ac270).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa53c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa530011ab0 con 0x7fa51c004e10 2020-02-11T16:11:13.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa53c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa53c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530008e40 con 0x7fa51c004e10 2020-02-11T16:11:13.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa530007530 con 0x7fa51c004e10 2020-02-11T16:11:13.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.615+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa53c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa5300056c0 con 0x7fa51c004e10 2020-02-11T16:11:13.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa53affd700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa53c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:13.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa541ccb700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa541ccb700 1 -- 172.21.15.88:0/2467563010 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa518005ea0 con 0x7fa518003420 2020-02-11T16:11:13.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa538ff9700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa51c041d50 0x7fa51c044210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:13.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa53004a190 con 0x7fa51c004e10 2020-02-11T16:11:13.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 msgr2=0x7fa5180058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:11:13.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 msgr2=0x7fa5180058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:13.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:13.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:13.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa53bfff700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa51c041d50 0x7fa51c044210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.616+0000 7fa53bfff700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa51c041d50 0x7fa51c044210 crc :-1 s=READY pgs=211 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:13.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.817+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:13.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.817+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 msgr2=0x7fa5180058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:11:13.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.817+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 msgr2=0x7fa5180058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:13.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.817+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:13.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:13.817+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:11:14.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:14.218+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:14.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:14.218+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 msgr2=0x7fa5180058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:11:14.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:14.218+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 msgr2=0x7fa5180058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:14.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:14.218+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:14.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:14.218+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:11:15.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:15.019+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:15.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:15.019+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 msgr2=0x7fa5180058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:11:15.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:15.019+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 msgr2=0x7fa5180058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:11:15.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:15.019+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:15.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:15.019+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:11:16.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.622+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:16.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.622+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa518006060 con 0x7fa518003420 2020-02-11T16:11:16.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.622+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.622+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.622+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:16.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.622+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.622+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa52c0104e0 con 0x7fa518003420 2020-02-11T16:11:16.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.623+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.623+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa52c00caf0 con 0x7fa518003420 2020-02-11T16:11:16.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.623+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 msgr2=0x7fa5180058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:16.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.623+0000 7fa538ff9700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).stop 2020-02-11T16:11:16.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.623+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 msgr2=0x7fa5180058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:16.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.623+0000 7fa538ff9700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518003420 0x7fa5180058e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.623+0000 7fa53bfff700 1 -- 172.21.15.88:0/2467563010 reap_dead start 2020-02-11T16:11:16.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.632+0000 7fa541ccb700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 0x7fa5180068d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:16.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.632+0000 7fa541ccb700 1 -- 172.21.15.88:0/2467563010 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa518006d80 con 0x7fa518006440 2020-02-11T16:11:16.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.632+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 0x7fa5180068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:16.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.632+0000 7fa53b7fe700 1 -- 172.21.15.88:0/2467563010 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa518006f40 con 0x7fa518006440 2020-02-11T16:11:16.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.632+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 0x7fa5180068d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.632+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 0x7fa5180068d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.632+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 0x7fa5180068d0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.633+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 0x7fa5180068d0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.633+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa52c00f650 con 0x7fa518006440 2020-02-11T16:11:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.633+0000 7fa53b7fe700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 0x7fa5180068d0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.633+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3849 (secure 0 0 0) 0x7fa52c00f7b0 con 0x7fa518006440 2020-02-11T16:11:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.633+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 msgr2=0x7fa5180068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.633+0000 7fa538ff9700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 0x7fa5180068d0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fa52c000b80 tx=0x7fa52c00c560).stop 2020-02-11T16:11:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.633+0000 7fa538ff9700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 msgr2=0x7fa5180068d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.633+0000 7fa538ff9700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 0x7fa5180068d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.633+0000 7fa541ccb700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa51c041d50 msgr2=0x7fa51c044210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.633+0000 7fa541ccb700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa51c041d50 0x7fa51c044210 crc :-1 s=READY pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.634+0000 7fa541ccb700 1 -- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 msgr2=0x7fa51c003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.634+0000 7fa541ccb700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7fa530002f30 tx=0x7fa53c0ac270).stop 2020-02-11T16:11:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.634+0000 7fa541ccb700 1 -- 172.21.15.88:0/2467563010 shutdown_connections 2020-02-11T16:11:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.634+0000 7fa541ccb700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c004e10 0x7fa51c003920 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.634+0000 7fa541ccb700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa51c041d50 0x7fa51c044210 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.634+0000 7fa541ccb700 1 --2- 172.21.15.88:0/2467563010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa518006440 0x7fa5180068d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.634+0000 7fa541ccb700 1 -- 172.21.15.88:0/2467563010 >> 172.21.15.88:0/2467563010 conn(0x7fa53c0ac2d0 msgr2=0x7fa53c12c910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:16.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.634+0000 7fa541ccb700 1 -- 172.21.15.88:0/2467563010 shutdown_connections 2020-02-11T16:11:16.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.634+0000 7fa541ccb700 1 -- 172.21.15.88:0/2467563010 wait complete. 2020-02-11T16:11:16.645 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:11:16.645 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:11:16.645 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:11:16.645 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:11:16.646 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 56, 2020-02-11T16:11:16.646 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:11:16.646 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:11:16.646 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:11:16.646 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:11:16.647 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:16.647 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 4, 2020-02-11T16:11:16.647 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:16.648 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:11:16.648 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:11:16.648 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:16.649 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:16.649 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:16.649 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:16.650 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:16.650 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:16.650 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:16.650 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:11:16.650 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:11:16.651 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:16.651 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:16.651 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:16.651 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:16.652 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:16.652 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:16.652 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:16.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.653 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:11:16.653 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:11:16.653 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:11:16.653 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:11:16.653 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:11:16.654 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:11:16.654 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:16.654 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:16.654 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:11:16.655 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:11:16.655 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:16.655 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:11:16.656 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:16.656 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:16.656 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:16.656 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:16.657 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:16.657 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:16.657 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:16.657 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:11:16.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.658 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:11:16.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.658 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:16.658 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:16.659 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:16.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:16.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.659 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:16.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:11:16.660 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:16.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.660 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:16.661 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:11:16.661 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:16.661 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:16.661 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:16.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.662 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:11:16.662 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:11:16.662 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:16.663 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:16.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.663 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:16.664 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:16.664 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:16.664 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:16.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.664 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:16.665 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:11:16.665 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:16.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.665 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:16.666 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:11:16.666 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:16.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:16.666 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:16.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.666 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:11:16.666 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:11:16.667 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:16.667 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:16.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.667 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:11:16.668 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:11:16.668 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:16.668 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:16.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.669 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:16.669 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:11:16.669 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:16.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.670 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:16.670 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:11:16.670 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:16.671 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:16.671 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:16.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.671 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:11:16.672 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:11:16.672 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:16.672 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:16.672 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:16.677 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:16.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:16.677 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:11:16.677 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:11:16.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.678 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:16.678 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:16.678 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:16.678 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:16.678 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:16.678 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:11:16.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:16.679 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:16.679 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:16.679 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:16.679 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:16.680 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:16.680 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:16.680 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:11:16.681 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:11:16.681 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:11:16.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.805+0000 7f13c9d90700 1 Processor -- start 2020-02-11T16:11:16.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.805+0000 7f13c9d90700 1 -- start start 2020-02-11T16:11:16.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c9d90700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13c40a5de0 0x7f13c40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:16.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c9d90700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13c4134a50 0x7f13c4134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:16.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c9d90700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c40a31b0 con 0x7f13c40a18a0 2020-02-11T16:11:16.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c9d90700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c40a3570 con 0x7f13c4134a50 2020-02-11T16:11:16.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c9d90700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40a3810 con 0x7f13c40a5de0 2020-02-11T16:11:16.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13c4134a50 0x7f13c4134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:16.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13c4134a50 0x7f13c4134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54476/0 (socket says 172.21.15.88:54476) 2020-02-11T16:11:16.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 -- 172.21.15.88:0/231440372 learned_addr learned my addr 172.21.15.88:0/231440372 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:16.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c2ffd700 1 --2- 172.21.15.88:0/231440372 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13c40a5de0 0x7f13c40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:16.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 -- 172.21.15.88:0/231440372 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13c40a5de0 msgr2=0x7f13c40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:16.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 --2- 172.21.15.88:0/231440372 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13c40a5de0 0x7f13c40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:16.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 -- 172.21.15.88:0/231440372 >> v1:172.21.15.52:6789/0 conn(0x7f13c40a18a0 legacy=0x7f13c40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:16.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 -- 172.21.15.88:0/231440372 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c40a3ab0 con 0x7f13c4134a50 2020-02-11T16:11:16.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 --2- 172.21.15.88:0/231440372 >> v2:172.21.15.88:3300/0 conn(0x7f13c4134a50 0x7f13c4134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f13c40a5cc0 tx=0x7f13bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 --2- 172.21.15.88:0/231440372 >> v2:172.21.15.88:3300/0 conn(0x7f13c4134a50 0x7f13c4134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f13c40a5cc0 tx=0x7f13bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 --2- 172.21.15.88:0/231440372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c4134a50 0x7f13c4134ee0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f13c40a5cc0 tx=0x7f13bc008c60).ready entity=mon.1 client_cookie=823f7c2ca2e6fb82 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:16.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 --2- 172.21.15.88:0/231440372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c4134a50 0x7f13c4134ee0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f13c40a5cc0 tx=0x7f13bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c27fc700 1 -- 172.21.15.88:0/231440372 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13bc00a160 con 0x7f13c4134a50 2020-02-11T16:11:16.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 --2- 172.21.15.88:0/231440372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c4134a50 0x7f13c4134ee0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f13c40a5cc0 tx=0x7f13bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c3fff700 1 --2- 172.21.15.88:0/231440372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c4134a50 0x7f13c4134ee0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f13c40a5cc0 tx=0x7f13bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c27fc700 1 -- 172.21.15.88:0/231440372 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc00a2c0 con 0x7f13c4134a50 2020-02-11T16:11:16.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c27fc700 1 -- 172.21.15.88:0/231440372 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13bc00a6a0 con 0x7f13c4134a50 2020-02-11T16:11:16.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c9d90700 1 -- 172.21.15.88:0/231440372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c4134a50 msgr2=0x7f13c4134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:16.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.806+0000 7f13c9d90700 1 --2- 172.21.15.88:0/231440372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c4134a50 0x7f13c4134ee0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f13c40a5cc0 tx=0x7f13bc008c60).stop 2020-02-11T16:11:16.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.807+0000 7f13c9d90700 1 -- 172.21.15.88:0/231440372 shutdown_connections 2020-02-11T16:11:16.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.807+0000 7f13c9d90700 1 --2- 172.21.15.88:0/231440372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c4134a50 0x7f13c4134ee0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.807+0000 7f13c9d90700 1 --2- 172.21.15.88:0/231440372 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13c40a5de0 0x7f13c40a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:16.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.807+0000 7f13c9d90700 1 -- 172.21.15.88:0/231440372 >> 172.21.15.88:0/231440372 conn(0x7f13c409d110 msgr2=0x7f13c409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:16.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.807+0000 7f13c9d90700 1 -- 172.21.15.88:0/231440372 shutdown_connections 2020-02-11T16:11:16.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.807+0000 7f13c9d90700 1 -- 172.21.15.88:0/231440372 wait complete. 2020-02-11T16:11:16.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.808+0000 7f13c9d90700 1 Processor -- start 2020-02-11T16:11:16.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.808+0000 7f13c9d90700 1 -- start start 2020-02-11T16:11:16.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.808+0000 7f13c9d90700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13c40a18a0 0x7f13c412fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:16.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c9d90700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13c40a5de0 0x7f13c412ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:16.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c9d90700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c412a440 con 0x7f13c4134a50 2020-02-11T16:11:16.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c9d90700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c4130180 con 0x7f13c40a18a0 2020-02-11T16:11:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c9d90700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c412a670 con 0x7f13c40a5de0 2020-02-11T16:11:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13c40a18a0 0x7f13c412fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c3fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f13c4134a50 0x7f13c41262f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42108/0 (socket says 172.21.15.88:42108) 2020-02-11T16:11:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c3fff700 1 -- 172.21.15.88:0/66849371 learned_addr learned my addr 172.21.15.88:0/66849371 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c2ffd700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13c40a5de0 0x7f13c412ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 -- 172.21.15.88:0/66849371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13c40a5de0 msgr2=0x7f13c412ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:16.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13c40a5de0 0x7f13c412ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 -- 172.21.15.88:0/66849371 >> v1:172.21.15.88:6789/0 conn(0x7f13c4134a50 legacy=0x7f13c41262f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:16.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c0ff9700 1 -- 172.21.15.88:0/66849371 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57398058 0 0) 0x7f13c412a440 con 0x7f13c4134a50 2020-02-11T16:11:16.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 -- 172.21.15.88:0/66849371 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c412fed0 con 0x7f13c40a18a0 2020-02-11T16:11:16.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> v2:172.21.15.88:3300/0 conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> v2:172.21.15.88:3300/0 conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:16.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c0ff9700 1 -- 172.21.15.88:0/66849371 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13b4006bc0 con 0x7f13c40a18a0 2020-02-11T16:11:16.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c0ff9700 1 -- 172.21.15.88:0/66849371 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b4006d60 con 0x7f13c40a18a0 2020-02-11T16:11:16.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c9d90700 1 -- 172.21.15.88:0/66849371 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c40a8b50 con 0x7f13c40a18a0 2020-02-11T16:11:16.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c0ff9700 1 -- 172.21.15.88:0/66849371 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13b40110c0 con 0x7f13c40a18a0 2020-02-11T16:11:16.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.809+0000 7f13c9d90700 1 -- 172.21.15.88:0/66849371 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c40a8360 con 0x7f13c40a18a0 2020-02-11T16:11:16.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.810+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.810+0000 7f13c0ff9700 1 -- 172.21.15.88:0/66849371 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f13b4011330 con 0x7f13c40a18a0 2020-02-11T16:11:16.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.810+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.810+0000 7f13c9d90700 1 -- 172.21.15.88:0/66849371 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c40565b0 con 0x7f13c40a18a0 2020-02-11T16:11:16.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.810+0000 7f13c0ff9700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13a8039b70 0x7f13a803c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:16.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.810+0000 7f13c0ff9700 1 -- 172.21.15.88:0/66849371 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f13b4049930 con 0x7f13c40a18a0 2020-02-11T16:11:16.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.810+0000 7f13c2ffd700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13a8039b70 0x7f13a803c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:16.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.811+0000 7f13c2ffd700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13a8039b70 0x7f13a803c030 crc :-1 s=READY pgs=212 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:16.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.814+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.814+0000 7f13c0ff9700 1 -- 172.21.15.88:0/66849371 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f13b402ef10 con 0x7f13c40a18a0 2020-02-11T16:11:16.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.994+0000 7f13c9d90700 1 -- 172.21.15.88:0/66849371 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f13c405ccb0 con 0x7f13c40a18a0 2020-02-11T16:11:16.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.995+0000 7f13c37fe700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:16.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.995+0000 7f13c0ff9700 1 -- 172.21.15.88:0/66849371 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f13b4031a20 con 0x7f13c40a18a0 2020-02-11T16:11:16.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 -- 172.21.15.88:0/66849371 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13a8039b70 msgr2=0x7f13a803c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:16.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13a8039b70 0x7f13a803c030 crc :-1 s=READY pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 -- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 msgr2=0x7f13c412fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:16.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 0x7f13c412fa70 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f13c412f980 tx=0x7f13b40108e0).stop 2020-02-11T16:11:16.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 -- 172.21.15.88:0/66849371 shutdown_connections 2020-02-11T16:11:16.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13a8039b70 0x7f13a803c030 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40a18a0 0x7f13c412fa70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 --2- 172.21.15.88:0/66849371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13c40a5de0 0x7f13c412ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:16.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 -- 172.21.15.88:0/66849371 >> 172.21.15.88:0/66849371 conn(0x7f13c409d110 msgr2=0x7f13c4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:17.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 -- 172.21.15.88:0/66849371 shutdown_connections 2020-02-11T16:11:17.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:16.996+0000 7f13c9d90700 1 -- 172.21.15.88:0/66849371 wait complete. 2020-02-11T16:11:17.009 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:11:27.011 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:11:27.011 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:11:27.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.125+0000 7f1d3a854700 1 Processor -- start 2020-02-11T16:11:27.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.125+0000 7f1d3a854700 1 -- start start 2020-02-11T16:11:27.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.125+0000 7f1d3a854700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d340a7120 0x7f1d340a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.125+0000 7f1d3a854700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a50f0 0x7f1d340a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.125+0000 7f1d3a854700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d34136930 con 0x7f1d3413c120 2020-02-11T16:11:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.125+0000 7f1d3a854700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d340a6470 con 0x7f1d340a7120 2020-02-11T16:11:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.125+0000 7f1d3a854700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340a49b0 con 0x7f1d340a50f0 2020-02-11T16:11:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d340a7120 0x7f1d340a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d340a7120 0x7f1d340a2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54488/0 (socket says 172.21.15.88:54488) 2020-02-11T16:11:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 -- 172.21.15.88:0/1633074155 learned_addr learned my addr 172.21.15.88:0/1633074155 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d337fe700 1 --2- 172.21.15.88:0/1633074155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a50f0 0x7f1d340a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 -- 172.21.15.88:0/1633074155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a50f0 msgr2=0x7f1d340a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 --2- 172.21.15.88:0/1633074155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a50f0 0x7f1d340a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 -- 172.21.15.88:0/1633074155 >> v1:172.21.15.52:6789/0 conn(0x7f1d3413c120 legacy=0x7f1d3413c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 -- 172.21.15.88:0/1633074155 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340a4c50 con 0x7f1d340a7120 2020-02-11T16:11:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 --2- 172.21.15.88:0/1633074155 >> v2:172.21.15.88:3300/0 conn(0x7f1d340a7120 0x7f1d340a2900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d24002f30 tx=0x7f1d240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 --2- 172.21.15.88:0/1633074155 >> v2:172.21.15.88:3300/0 conn(0x7f1d340a7120 0x7f1d340a2900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d24002f30 tx=0x7f1d240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 --2- 172.21.15.88:0/1633074155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d340a7120 0x7f1d340a2900 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f1d24002f30 tx=0x7f1d240088e0).ready entity=mon.1 client_cookie=ea3d8ec235dc4c7c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 --2- 172.21.15.88:0/1633074155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d340a7120 0x7f1d340a2900 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f1d24002f30 tx=0x7f1d240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 --2- 172.21.15.88:0/1633074155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d340a7120 0x7f1d340a2900 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f1d24002f30 tx=0x7f1d240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d32ffd700 1 -- 172.21.15.88:0/1633074155 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d240116b0 con 0x7f1d340a7120 2020-02-11T16:11:27.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d33fff700 1 --2- 172.21.15.88:0/1633074155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d340a7120 0x7f1d340a2900 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f1d24002f30 tx=0x7f1d240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d32ffd700 1 -- 172.21.15.88:0/1633074155 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d24011810 con 0x7f1d340a7120 2020-02-11T16:11:27.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d32ffd700 1 -- 172.21.15.88:0/1633074155 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d24011bf0 con 0x7f1d340a7120 2020-02-11T16:11:27.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d3a854700 1 -- 172.21.15.88:0/1633074155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d340a7120 msgr2=0x7f1d340a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.126+0000 7f1d3a854700 1 --2- 172.21.15.88:0/1633074155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d340a7120 0x7f1d340a2900 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f1d24002f30 tx=0x7f1d240088e0).stop 2020-02-11T16:11:27.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.127+0000 7f1d3a854700 1 -- 172.21.15.88:0/1633074155 shutdown_connections 2020-02-11T16:11:27.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.127+0000 7f1d3a854700 1 --2- 172.21.15.88:0/1633074155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d340a7120 0x7f1d340a2900 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.127+0000 7f1d3a854700 1 --2- 172.21.15.88:0/1633074155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a50f0 0x7f1d340a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.127+0000 7f1d3a854700 1 -- 172.21.15.88:0/1633074155 >> 172.21.15.88:0/1633074155 conn(0x7f1d3409d110 msgr2=0x7f1d3409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:27.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.127+0000 7f1d3a854700 1 -- 172.21.15.88:0/1633074155 shutdown_connections 2020-02-11T16:11:27.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.127+0000 7f1d3a854700 1 -- 172.21.15.88:0/1633074155 wait complete. 2020-02-11T16:11:27.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.128+0000 7f1d3a854700 1 Processor -- start 2020-02-11T16:11:27.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.128+0000 7f1d3a854700 1 -- start start 2020-02-11T16:11:27.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.128+0000 7f1d3a854700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.128+0000 7f1d3a854700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d34134950 con 0x7f1d340a50f0 2020-02-11T16:11:27.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d3a854700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d341353c0 con 0x7f1d3413c120 2020-02-11T16:11:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d3a854700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34135660 con 0x7f1d340a7120 2020-02-11T16:11:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d38df1700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1d3413c120 0x7f1d34153c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42124/0 (socket says 172.21.15.88:42124) 2020-02-11T16:11:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d38df1700 1 -- 172.21.15.88:0/2650612116 learned_addr learned my addr 172.21.15.88:0/2650612116 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961654491 0 0) 0x7f1d341353c0 con 0x7f1d3413c120 2020-02-11T16:11:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d14002fe0 con 0x7f1d3413c120 2020-02-11T16:11:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13476593 0 0) 0x7f1d34134950 con 0x7f1d340a50f0 2020-02-11T16:11:27.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d341353c0 con 0x7f1d340a50f0 2020-02-11T16:11:27.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d337fe700 1 -- 172.21.15.88:0/2650612116 >> v1:172.21.15.88:6789/0 conn(0x7f1d3413c120 legacy=0x7f1d34153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d337fe700 1 -- 172.21.15.88:0/2650612116 >> v1:172.21.15.52:6789/0 conn(0x7f1d340a50f0 legacy=0x7f1d3412dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d337fe700 1 -- 172.21.15.88:0/2650612116 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340a2530 con 0x7f1d340a7120 2020-02-11T16:11:27.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d28007530 con 0x7f1d340a7120 2020-02-11T16:11:27.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d280056c0 con 0x7f1d340a7120 2020-02-11T16:11:27.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d3a854700 1 -- 172.21.15.88:0/2650612116 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d341344b0 con 0x7f1d340a7120 2020-02-11T16:11:27.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d28005a60 con 0x7f1d340a7120 2020-02-11T16:11:27.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.129+0000 7f1d3a854700 1 -- 172.21.15.88:0/2650612116 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d34133570 con 0x7f1d340a7120 2020-02-11T16:11:27.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.130+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.130+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f1d28005c60 con 0x7f1d340a7120 2020-02-11T16:11:27.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.130+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.130+0000 7f1d3a854700 1 -- 172.21.15.88:0/2650612116 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d340565b0 con 0x7f1d340a7120 2020-02-11T16:11:27.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.130+0000 7f1d317fa700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d1403a0e0 0x7f1d1403c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.130+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f1d2800d0c0 con 0x7f1d340a7120 2020-02-11T16:11:27.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.131+0000 7f1d33fff700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d1403a0e0 0x7f1d1403c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.131+0000 7f1d33fff700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d1403a0e0 0x7f1d1403c5a0 crc :-1 s=READY pgs=213 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.135+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.135+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f1d2802eed0 con 0x7f1d340a7120 2020-02-11T16:11:27.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.317+0000 7f1d3a854700 1 -- 172.21.15.88:0/2650612116 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1d3405ccb0 con 0x7f1d340a7120 2020-02-11T16:11:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.317+0000 7f1d337fe700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.318+0000 7f1d317fa700 1 -- 172.21.15.88:0/2650612116 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f1d28031b70 con 0x7f1d340a7120 2020-02-11T16:11:27.320 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:27.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.319+0000 7f1d3a854700 1 -- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d1403a0e0 msgr2=0x7f1d1403c5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.319+0000 7f1d3a854700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d1403a0e0 0x7f1d1403c5a0 crc :-1 s=READY pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.319+0000 7f1d3a854700 1 -- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 msgr2=0x7f1d341320a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.319+0000 7f1d3a854700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010c00).stop 2020-02-11T16:11:27.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.319+0000 7f1d3a854700 1 -- 172.21.15.88:0/2650612116 shutdown_connections 2020-02-11T16:11:27.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.319+0000 7f1d3a854700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d1403a0e0 0x7f1d1403c5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.319+0000 7f1d3a854700 1 --2- 172.21.15.88:0/2650612116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d340a7120 0x7f1d341320a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.319+0000 7f1d3a854700 1 -- 172.21.15.88:0/2650612116 >> 172.21.15.88:0/2650612116 conn(0x7f1d3409d110 msgr2=0x7f1d3412ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:27.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.319+0000 7f1d3a854700 1 -- 172.21.15.88:0/2650612116 shutdown_connections 2020-02-11T16:11:27.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.319+0000 7f1d3a854700 1 -- 172.21.15.88:0/2650612116 wait complete. 2020-02-11T16:11:27.331 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":56,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:27.332 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:11:27.332 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:11:27.332 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:11:27.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.435+0000 7ff5f4649700 1 Processor -- start 2020-02-11T16:11:27.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.435+0000 7ff5f4649700 1 -- start start 2020-02-11T16:11:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.435+0000 7ff5f4649700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5ec0a18a0 0x7ff5ec0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.435+0000 7ff5f4649700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ec0a31b0 con 0x7ff5ec0a6260 2020-02-11T16:11:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.435+0000 7ff5f4649700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ec0a3570 con 0x7ff5ec0a5de0 2020-02-11T16:11:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.435+0000 7ff5f4649700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec0a3810 con 0x7ff5ec0a18a0 2020-02-11T16:11:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f23e5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5ec0a18a0 0x7ff5ec0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f1be4700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff5ec0a5de0 0x7ff5ec12e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42128/0 (socket says 172.21.15.88:42128) 2020-02-11T16:11:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f1be4700 1 -- 172.21.15.88:0/2540563496 learned_addr learned my addr 172.21.15.88:0/2540563496 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f23e5700 1 -- 172.21.15.88:0/2540563496 >> v1:172.21.15.88:6789/0 conn(0x7ff5ec0a5de0 legacy=0x7ff5ec12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f23e5700 1 -- 172.21.15.88:0/2540563496 >> v1:172.21.15.52:6789/0 conn(0x7ff5ec0a6260 legacy=0x7ff5ec12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f23e5700 1 -- 172.21.15.88:0/2540563496 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec0a3ab0 con 0x7ff5ec0a18a0 2020-02-11T16:11:27.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2540563496 >> v2:172.21.15.88:3300/0 conn(0x7ff5ec0a18a0 0x7ff5ec0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5e40032b0 tx=0x7ff5e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2540563496 >> v2:172.21.15.88:3300/0 conn(0x7ff5ec0a18a0 0x7ff5ec0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5e40032b0 tx=0x7ff5e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2540563496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a18a0 0x7ff5ec0a6dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7ff5e40032b0 tx=0x7ff5e4008c60).ready entity=mon.1 client_cookie=f90ea010fa26c985 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2540563496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a18a0 0x7ff5ec0a6dd0 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7ff5e40032b0 tx=0x7ff5e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f13e3700 1 -- 172.21.15.88:0/2540563496 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e400c350 con 0x7ff5ec0a18a0 2020-02-11T16:11:27.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2540563496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a18a0 0x7ff5ec0a6dd0 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7ff5e40032b0 tx=0x7ff5e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2540563496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a18a0 0x7ff5ec0a6dd0 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7ff5e40032b0 tx=0x7ff5e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f13e3700 1 -- 172.21.15.88:0/2540563496 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e400c4b0 con 0x7ff5ec0a18a0 2020-02-11T16:11:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f13e3700 1 -- 172.21.15.88:0/2540563496 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e400c890 con 0x7ff5ec0a18a0 2020-02-11T16:11:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f4649700 1 -- 172.21.15.88:0/2540563496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a18a0 msgr2=0x7ff5ec0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.436+0000 7ff5f4649700 1 --2- 172.21.15.88:0/2540563496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a18a0 0x7ff5ec0a6dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7ff5e40032b0 tx=0x7ff5e4008c60).stop 2020-02-11T16:11:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.437+0000 7ff5f4649700 1 -- 172.21.15.88:0/2540563496 shutdown_connections 2020-02-11T16:11:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.437+0000 7ff5f4649700 1 --2- 172.21.15.88:0/2540563496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a18a0 0x7ff5ec0a6dd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.437+0000 7ff5f4649700 1 -- 172.21.15.88:0/2540563496 >> 172.21.15.88:0/2540563496 conn(0x7ff5ec09d110 msgr2=0x7ff5ec09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.437+0000 7ff5f4649700 1 -- 172.21.15.88:0/2540563496 shutdown_connections 2020-02-11T16:11:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.437+0000 7ff5f4649700 1 -- 172.21.15.88:0/2540563496 wait complete. 2020-02-11T16:11:27.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f4649700 1 Processor -- start 2020-02-11T16:11:27.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f4649700 1 -- start start 2020-02-11T16:11:27.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f4649700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff5ec0a5de0 0x7ff5ec137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f4649700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5ec0a6260 0x7ff5ec138110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f4649700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ec130b60 con 0x7ff5ec0a18a0 2020-02-11T16:11:27.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f4649700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec137660 con 0x7ff5ec0a5de0 2020-02-11T16:11:27.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f4649700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec131d60 con 0x7ff5ec0a6260 2020-02-11T16:11:27.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f2be6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5ec0a6260 0x7ff5ec138110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f23e5700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff5ec0a18a0 0x7ff5ec128350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42132/0 (socket says 172.21.15.88:42132) 2020-02-11T16:11:27.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f2be6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5ec0a6260 0x7ff5ec138110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54510/0 (socket says 172.21.15.88:54510) 2020-02-11T16:11:27.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.438+0000 7ff5f23e5700 1 -- 172.21.15.88:0/2997815851 learned_addr learned my addr 172.21.15.88:0/2997815851 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:27.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f1be4700 1 --2- 172.21.15.88:0/2997815851 >> v2:172.21.15.52:3300/0 conn(0x7ff5ec0a5de0 0x7ff5ec137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 -- 172.21.15.88:0/2997815851 >> v2:172.21.15.52:3300/0 conn(0x7ff5ec0a5de0 msgr2=0x7ff5ec137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 --2- 172.21.15.88:0/2997815851 >> v2:172.21.15.52:3300/0 conn(0x7ff5ec0a5de0 0x7ff5ec137cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970260874 0 0) 0x7ff5ec0a3ab0 con 0x7ff5ec0a18a0 2020-02-11T16:11:27.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 -- 172.21.15.88:0/2997815851 >> v1:172.21.15.88:6789/0 conn(0x7ff5ec0a18a0 legacy=0x7ff5ec128350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 -- 172.21.15.88:0/2997815851 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec137850 con 0x7ff5ec0a6260 2020-02-11T16:11:27.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 --2- 172.21.15.88:0/2997815851 >> v2:172.21.15.88:3300/0 conn(0x7ff5ec0a6260 0x7ff5ec138110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5ec05bbc0 tx=0x7ff5e8010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 --2- 172.21.15.88:0/2997815851 >> v2:172.21.15.88:3300/0 conn(0x7ff5ec0a6260 0x7ff5ec138110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5ec05bbc0 tx=0x7ff5e8010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a6260 0x7ff5ec138110 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7ff5ec05bbc0 tx=0x7ff5e8010820).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a6260 0x7ff5ec138110 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7ff5ec05bbc0 tx=0x7ff5e8010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a6260 0x7ff5ec138110 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7ff5ec05bbc0 tx=0x7ff5e8010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e8006bc0 con 0x7ff5ec0a6260 2020-02-11T16:11:27.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a6260 0x7ff5ec138110 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7ff5ec05bbc0 tx=0x7ff5e8010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e8006d20 con 0x7ff5ec0a6260 2020-02-11T16:11:27.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f4649700 1 -- 172.21.15.88:0/2997815851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec130f60 con 0x7ff5ec0a6260 2020-02-11T16:11:27.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e8011040 con 0x7ff5ec0a6260 2020-02-11T16:11:27.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f4649700 1 -- 172.21.15.88:0/2997815851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec138570 con 0x7ff5ec0a6260 2020-02-11T16:11:27.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.439+0000 7ff5f2be6700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a6260 0x7ff5ec138110 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7ff5ec05bbc0 tx=0x7ff5e8010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.440+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff5e80112b0 con 0x7ff5ec0a6260 2020-02-11T16:11:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.440+0000 7ff5f2be6700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a6260 0x7ff5ec138110 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7ff5ec05bbc0 tx=0x7ff5e8010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.440+0000 7ff5f4649700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 0x7ff5ec05b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.440+0000 7ff5f4649700 1 -- 172.21.15.88:0/2997815851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec137a10 con 0x7ff5ec128a60 2020-02-11T16:11:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.440+0000 7ff5df7fe700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5cc039b30 0x7ff5cc03bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.440+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff5e8049790 con 0x7ff5ec0a6260 2020-02-11T16:11:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.440+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 0x7ff5ec05b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.440+0000 7ff5f1be4700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5cc039b30 0x7ff5cc03bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5f23e5700 1 -- 172.21.15.88:0/2997815851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5ec05e2f0 con 0x7ff5ec128a60 2020-02-11T16:11:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 0x7ff5ec05b140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5f1be4700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5cc039b30 0x7ff5cc03bff0 crc :-1 s=READY pgs=214 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 0x7ff5ec05b140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 0x7ff5ec05b140 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 0x7ff5ec05b140 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e4005c30 con 0x7ff5ec128a60 2020-02-11T16:11:27.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 0x7ff5ec05b140 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff5e4005d90 con 0x7ff5ec128a60 2020-02-11T16:11:27.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 msgr2=0x7ff5ec05b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5df7fe700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 0x7ff5ec05b140 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).stop 2020-02-11T16:11:27.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 msgr2=0x7ff5ec05b140 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:27.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.441+0000 7ff5df7fe700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec128a60 0x7ff5ec05b140 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).stop 2020-02-11T16:11:27.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.449+0000 7ff5f4649700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 0x7ff5ec1329c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.449+0000 7ff5f4649700 1 -- 172.21.15.88:0/2997815851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec130f00 con 0x7ff5ec135f40 2020-02-11T16:11:27.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.449+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 0x7ff5ec1329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.449+0000 7ff5f23e5700 1 -- 172.21.15.88:0/2997815851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff5ec0565b0 con 0x7ff5ec135f40 2020-02-11T16:11:27.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.449+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 0x7ff5ec1329c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.449+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 0x7ff5ec1329c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.449+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 0x7ff5ec1329c0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.449+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 0x7ff5ec1329c0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e400f3d0 con 0x7ff5ec135f40 2020-02-11T16:11:27.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f23e5700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 0x7ff5ec1329c0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7ff5e400f530 con 0x7ff5ec135f40 2020-02-11T16:11:27.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 msgr2=0x7ff5ec1329c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5df7fe700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 0x7ff5ec1329c0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7ff5e40086a0 tx=0x7ff5e40139e0).stop 2020-02-11T16:11:27.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5df7fe700 1 -- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 msgr2=0x7ff5ec1329c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:27.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5df7fe700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec135f40 0x7ff5ec1329c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f4649700 1 -- 172.21.15.88:0/2997815851 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5cc039b30 msgr2=0x7ff5cc03bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f4649700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5cc039b30 0x7ff5cc03bff0 crc :-1 s=READY pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f4649700 1 -- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a6260 msgr2=0x7ff5ec138110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f4649700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a6260 0x7ff5ec138110 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7ff5ec05bbc0 tx=0x7ff5e8010820).stop 2020-02-11T16:11:27.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f2be6700 1 -- 172.21.15.88:0/2997815851 reap_dead start 2020-02-11T16:11:27.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f2be6700 1 -- 172.21.15.88:0/2997815851 reap_dead start 2020-02-11T16:11:27.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f4649700 1 -- 172.21.15.88:0/2997815851 shutdown_connections 2020-02-11T16:11:27.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f4649700 1 --2- 172.21.15.88:0/2997815851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ec0a6260 0x7ff5ec138110 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f4649700 1 -- 172.21.15.88:0/2997815851 >> 172.21.15.88:0/2997815851 conn(0x7ff5ec09d110 msgr2=0x7ff5ec0a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:27.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f4649700 1 -- 172.21.15.88:0/2997815851 shutdown_connections 2020-02-11T16:11:27.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.450+0000 7ff5f4649700 1 -- 172.21.15.88:0/2997815851 wait complete. 2020-02-11T16:11:27.471 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:11:27.472 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:27.472 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:27.472 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:11:27.472 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 56, 2020-02-11T16:11:27.472 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:11:27.473 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:11:27.473 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:11:27.473 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:11:27.473 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.474 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:11:27.474 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:27.474 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:11:27.474 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:11:27.474 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:27.475 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:27.475 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:27.475 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:27.475 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:27.476 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:27.476 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.476 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:11:27.476 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:11:27.477 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:27.477 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:27.477 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:27.477 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:27.478 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:27.478 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:27.478 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.478 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:11:27.479 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:11:27.479 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:11:27.479 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:11:27.479 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:11:27.479 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:11:27.479 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:27.480 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:27.480 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:11:27.480 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:11:27.480 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:27.480 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:11:27.480 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:27.480 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:27.481 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:27.481 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:27.481 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:27.481 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:27.481 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.481 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:11:27.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.481 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:11:27.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.482 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:27.482 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:27.482 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:27.482 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:27.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.482 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:27.483 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:11:27.483 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.483 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:27.483 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:11:27.483 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.484 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.484 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.484 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:11:27.484 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:11:27.484 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:27.484 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:27.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.485 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:27.485 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:27.485 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:27.485 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:27.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.486 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:27.486 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:11:27.486 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.486 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:27.486 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:11:27.487 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.487 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.487 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.487 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:11:27.487 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:11:27.487 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:27.487 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:27.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.488 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:11:27.488 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:11:27.488 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:27.488 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:27.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.489 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:27.489 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:11:27.489 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.489 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:27.489 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:11:27.490 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.490 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.490 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.490 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:11:27.490 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:11:27.491 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:27.491 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:27.491 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.491 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.491 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:11:27.491 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:11:27.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.492 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.492 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.492 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:27.492 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.492 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.492 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:11:27.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.493 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.493 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.493 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:27.493 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.493 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.493 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:11:27.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.495 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.495 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.495 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:11:27.496 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.496 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.496 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:11:27.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.496 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.496 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.497 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:11:27.497 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.497 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.497 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:11:27.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.497 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.497 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.498 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:11:27.498 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.498 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.498 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.498 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:11:27.499 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:11:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.601+0000 7f253ecb3700 1 Processor -- start 2020-02-11T16:11:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.601+0000 7f253ecb3700 1 -- start start 2020-02-11T16:11:27.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.602+0000 7f253ecb3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25380a6260 0x7f2538135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.602+0000 7f253ecb3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25380a31b0 con 0x7f25380a18a0 2020-02-11T16:11:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.602+0000 7f253ecb3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25380a3570 con 0x7f25380a5de0 2020-02-11T16:11:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.602+0000 7f253ecb3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25380a3810 con 0x7f25380a6260 2020-02-11T16:11:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.602+0000 7f2537fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f25380a5de0 0x7f2538134a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42146/0 (socket says 172.21.15.88:42146) 2020-02-11T16:11:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.602+0000 7f2537fff700 1 -- 172.21.15.88:0/3840378373 learned_addr learned my addr 172.21.15.88:0/3840378373 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.602+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559089479 0 0) 0x7f25380a3570 con 0x7f25380a5de0 2020-02-11T16:11:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.602+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2524003230 con 0x7f25380a5de0 2020-02-11T16:11:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.602+0000 7f253d250700 1 --2- 172.21.15.88:0/3840378373 >> v2:172.21.15.52:3300/0 conn(0x7f25380a6260 0x7f2538135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 284566784 0 0) 0x7f2524003230 con 0x7f25380a5de0 2020-02-11T16:11:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 >> v2:172.21.15.52:3300/0 conn(0x7f25380a6260 msgr2=0x7f2538135160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 --2- 172.21.15.88:0/3840378373 >> v2:172.21.15.52:3300/0 conn(0x7f25380a6260 0x7f2538135160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 >> v1:172.21.15.52:6789/0 conn(0x7f25380a18a0 legacy=0x7f25380a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25380a3ab0 con 0x7f25380a5de0 2020-02-11T16:11:27.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f252c0016d0 con 0x7f25380a5de0 2020-02-11T16:11:27.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 >> v1:172.21.15.88:6789/0 conn(0x7f25380a5de0 legacy=0x7f2538134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2524003720 0x7f2524003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25240044d0 0x7f2524004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 0x7f252400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25380a3810 con 0x7f25240044d0 2020-02-11T16:11:27.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25240041c0 con 0x7f2524004db0 2020-02-11T16:11:27.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252400bb80 con 0x7f2524003720 2020-02-11T16:11:27.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 0x7f252400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f2537fff700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25240044d0 0x7f2524004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253ca4f700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2524003720 0x7f2524003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 -- 172.21.15.88:0/3840378373 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2524003720 msgr2=0x7f2524003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:27.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2524003720 0x7f2524003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 -- 172.21.15.88:0/3840378373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25240044d0 msgr2=0x7f2524004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:27.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25240044d0 0x7f2524004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 -- 172.21.15.88:0/3840378373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524003230 con 0x7f2524004db0 2020-02-11T16:11:27.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253ca4f700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2524003720 0x7f2524003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:11:27.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 0x7f252400b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f25240054a0 tx=0x7f2530010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 -- 172.21.15.88:0/3840378373 reap_dead start 2020-02-11T16:11:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 0x7f252400b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f25240054a0 tx=0x7f2530010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 0x7f252400b720 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f25240054a0 tx=0x7f2530010400).ready entity=mon.1 client_cookie=fc246d6a0688b369 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 0x7f252400b720 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f25240054a0 tx=0x7f2530010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2530005c30 con 0x7f2524004db0 2020-02-11T16:11:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 0x7f252400b720 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f25240054a0 tx=0x7f2530010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253d250700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 0x7f252400b720 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f25240054a0 tx=0x7f2530010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2530005d90 con 0x7f2524004db0 2020-02-11T16:11:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f25377fe700 1 -- 172.21.15.88:0/3840378373 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25300112b0 con 0x7f2524004db0 2020-02-11T16:11:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253ecb3700 1 -- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 msgr2=0x7f252400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.603+0000 7f253ecb3700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 0x7f252400b720 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f25240054a0 tx=0x7f2530010400).stop 2020-02-11T16:11:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.604+0000 7f253ecb3700 1 -- 172.21.15.88:0/3840378373 shutdown_connections 2020-02-11T16:11:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.604+0000 7f253ecb3700 1 --2- 172.21.15.88:0/3840378373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2524004db0 0x7f252400b720 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.604+0000 7f253ecb3700 1 -- 172.21.15.88:0/3840378373 >> 172.21.15.88:0/3840378373 conn(0x7f253809d110 msgr2=0x7f253809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.604+0000 7f253ecb3700 1 -- 172.21.15.88:0/3840378373 shutdown_connections 2020-02-11T16:11:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.604+0000 7f253ecb3700 1 -- 172.21.15.88:0/3840378373 wait complete. 2020-02-11T16:11:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.605+0000 7f253ecb3700 1 Processor -- start 2020-02-11T16:11:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.605+0000 7f253ecb3700 1 -- start start 2020-02-11T16:11:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.605+0000 7f253ecb3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2524004db0 0x7f25380a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.605+0000 7f253ecb3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f253809e270 0x7f2538134bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f253ecb3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f253812b2b0 0x7f253812b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f253ecb3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2538135030 con 0x7f2524004db0 2020-02-11T16:11:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f253ecb3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25380a8c50 con 0x7f253809e270 2020-02-11T16:11:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f253ecb3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25380a0170 con 0x7f253812b2b0 2020-02-11T16:11:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f253809e270 0x7f2538134bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f253809e270 0x7f2538134bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54532/0 (socket says 172.21.15.88:54532) 2020-02-11T16:11:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 -- 172.21.15.88:0/1271879920 learned_addr learned my addr 172.21.15.88:0/1271879920 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 -- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f253812b2b0 msgr2=0x7f253812b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f253812b2b0 0x7f253812b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 -- 172.21.15.88:0/1271879920 >> v2:172.21.15.52:3300/0 conn(0x7f2524004db0 msgr2=0x7f25380a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 --2- 172.21.15.88:0/1271879920 >> v2:172.21.15.52:3300/0 conn(0x7f2524004db0 0x7f25380a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 -- 172.21.15.88:0/1271879920 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25380a0e60 con 0x7f253809e270 2020-02-11T16:11:27.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 --2- 172.21.15.88:0/1271879920 >> v2:172.21.15.88:3300/0 conn(0x7f253809e270 0x7f2538134bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f252c0013e0 tx=0x7f253812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 --2- 172.21.15.88:0/1271879920 >> v2:172.21.15.88:3300/0 conn(0x7f253809e270 0x7f2538134bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f252c0013e0 tx=0x7f253812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f253809e270 0x7f2538134bd0 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f252c0013e0 tx=0x7f253812f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f253809e270 0x7f2538134bd0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f252c0013e0 tx=0x7f253812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f253809e270 0x7f2538134bd0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f252c0013e0 tx=0x7f253812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2537fff700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f253809e270 0x7f2538134bd0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f252c0013e0 tx=0x7f253812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f252c00ce70 con 0x7f253809e270 2020-02-11T16:11:27.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c00e350 con 0x7f253809e270 2020-02-11T16:11:27.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f253ecb3700 1 -- 172.21.15.88:0/1271879920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2538132180 con 0x7f253809e270 2020-02-11T16:11:27.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f252c00e6b0 con 0x7f253809e270 2020-02-11T16:11:27.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.606+0000 7f253ecb3700 1 -- 172.21.15.88:0/1271879920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2538138c90 con 0x7f253809e270 2020-02-11T16:11:27.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f2537fff700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f253809e270 0x7f2538134bd0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f252c0013e0 tx=0x7f253812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f253ecb3700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 0x7f253805a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f253ecb3700 1 -- 172.21.15.88:0/1271879920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253805e2f0 con 0x7f25380a7fe0 2020-02-11T16:11:27.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f252c007250 con 0x7f253809e270 2020-02-11T16:11:27.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f2537fff700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f253809e270 0x7f2538134bd0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f252c0013e0 tx=0x7f253812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f2535ffb700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2518039d50 0x7f251803c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 0x7f253805a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f252c049930 con 0x7f253809e270 2020-02-11T16:11:27.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f253d250700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2518039d50 0x7f251803c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f253ca4f700 1 -- 172.21.15.88:0/1271879920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25380a8a90 con 0x7f25380a7fe0 2020-02-11T16:11:27.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 0x7f253805a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f253d250700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2518039d50 0x7f251803c210 crc :-1 s=READY pgs=215 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.607+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 0x7f253805a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.608+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 0x7f253805a5d0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.608+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 0x7f253805a5d0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.608+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2528006b70 con 0x7f25380a7fe0 2020-02-11T16:11:27.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.608+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 0x7f253805a5d0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.608+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f2528006cd0 con 0x7f25380a7fe0 2020-02-11T16:11:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.608+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 msgr2=0x7f253805a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.608+0000 7f2535ffb700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 0x7f253805a5d0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).stop 2020-02-11T16:11:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.608+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 msgr2=0x7f253805a5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.608+0000 7f2535ffb700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25380a7fe0 0x7f253805a5d0 secure :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).stop 2020-02-11T16:11:27.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.616+0000 7f253ecb3700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 0x7f253805ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.616+0000 7f253ecb3700 1 -- 172.21.15.88:0/1271879920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25380a8d90 con 0x7f253805aa30 2020-02-11T16:11:27.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.616+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 0x7f253805ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f253ca4f700 1 -- 172.21.15.88:0/1271879920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f25380565b0 con 0x7f253805aa30 2020-02-11T16:11:27.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 0x7f253805ae40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 0x7f253805ae40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 0x7f253805ae40 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 0x7f253805ae40 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25280085b0 con 0x7f253805aa30 2020-02-11T16:11:27.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f253ca4f700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 0x7f253805ae40 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4192 (secure 0 0 0) 0x7f2528008710 con 0x7f253805aa30 2020-02-11T16:11:27.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 msgr2=0x7f253805ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f2535ffb700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 0x7f253805ae40 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).stop 2020-02-11T16:11:27.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f2535ffb700 1 -- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 msgr2=0x7f253805ae40 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:27.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.617+0000 7f2535ffb700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f253805aa30 0x7f253805ae40 secure :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0x7f253805bbc0 tx=0x7f25280107c0).stop 2020-02-11T16:11:27.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253ecb3700 1 -- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2518039d50 msgr2=0x7f251803c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253ecb3700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2518039d50 0x7f251803c210 crc :-1 s=READY pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253ecb3700 1 -- 172.21.15.88:0/1271879920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f253809e270 msgr2=0x7f2538134bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253ecb3700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f253809e270 0x7f2538134bd0 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f252c0013e0 tx=0x7f253812f3b0).stop 2020-02-11T16:11:27.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253d250700 1 -- 172.21.15.88:0/1271879920 reap_dead start 2020-02-11T16:11:27.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253d250700 1 -- 172.21.15.88:0/1271879920 reap_dead start 2020-02-11T16:11:27.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253ecb3700 1 -- 172.21.15.88:0/1271879920 shutdown_connections 2020-02-11T16:11:27.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253ecb3700 1 --2- 172.21.15.88:0/1271879920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f253809e270 0x7f2538134bd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253ecb3700 1 -- 172.21.15.88:0/1271879920 >> 172.21.15.88:0/1271879920 conn(0x7f253809d110 msgr2=0x7f25380aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:27.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253ecb3700 1 -- 172.21.15.88:0/1271879920 shutdown_connections 2020-02-11T16:11:27.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.618+0000 7f253ecb3700 1 -- 172.21.15.88:0/1271879920 wait complete. 2020-02-11T16:11:27.634 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:11:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:11:27.634 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 56, 2020-02-11T16:11:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:11:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:11:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:11:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:11:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:11:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:11:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:11:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:27.636 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:11:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:11:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:27.637 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:11:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:11:27.638 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:11:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:11:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:11:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:11:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:11:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:11:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:11:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:27.640 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:11:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:11:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:27.641 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:11:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:11:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.643 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:11:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:11:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:27.644 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:11:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:11:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:11:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:11:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:11:27.647 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:11:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:11:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:11:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:11:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:11:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:11:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:11:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.651 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:11:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:11:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:11:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.653 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:11:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:11:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.654 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.655 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:11:27.655 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:11:27.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.758+0000 7f8349ce9700 1 Processor -- start 2020-02-11T16:11:27.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.758+0000 7f8349ce9700 1 -- start start 2020-02-11T16:11:27.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.759+0000 7f8349ce9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.759+0000 7f8349ce9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f83440a5de0 0x7f83440a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.759+0000 7f8349ce9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83440a31b0 con 0x7f834412e3a0 2020-02-11T16:11:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.759+0000 7f8349ce9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83440a3570 con 0x7f83440a5de0 2020-02-11T16:11:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.759+0000 7f8349ce9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83440a3810 con 0x7f83440a18a0 2020-02-11T16:11:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.759+0000 7f83437fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.759+0000 7f8342ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f83440a5de0 0x7f83440a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.759+0000 7f83437fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:48866/0 (socket says 172.21.15.88:48866) 2020-02-11T16:11:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.759+0000 7f83437fe700 1 -- 172.21.15.88:0/725776030 learned_addr learned my addr 172.21.15.88:0/725776030 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83437fe700 1 -- 172.21.15.88:0/725776030 >> v2:172.21.15.52:3300/0 conn(0x7f83440a5de0 msgr2=0x7f83440a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83437fe700 1 --2- 172.21.15.88:0/725776030 >> v2:172.21.15.52:3300/0 conn(0x7f83440a5de0 0x7f83440a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83437fe700 1 -- 172.21.15.88:0/725776030 >> v1:172.21.15.52:6789/0 conn(0x7f834412e3a0 legacy=0x7f834412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83437fe700 1 -- 172.21.15.88:0/725776030 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83440a3ab0 con 0x7f83440a18a0 2020-02-11T16:11:27.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83437fe700 1 --2- 172.21.15.88:0/725776030 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8334002f30 tx=0x7f83340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83437fe700 1 --2- 172.21.15.88:0/725776030 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8334002f30 tx=0x7f83340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83437fe700 1 --2- 172.21.15.88:0/725776030 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83340088e0).ready entity=mon.2 client_cookie=68198644a7179053 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83437fe700 1 --2- 172.21.15.88:0/725776030 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83427fc700 1 -- 172.21.15.88:0/725776030 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83340116b0 con 0x7f83440a18a0 2020-02-11T16:11:27.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83437fe700 1 --2- 172.21.15.88:0/725776030 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83437fe700 1 --2- 172.21.15.88:0/725776030 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83427fc700 1 -- 172.21.15.88:0/725776030 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8334011810 con 0x7f83440a18a0 2020-02-11T16:11:27.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f83427fc700 1 -- 172.21.15.88:0/725776030 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8334011bf0 con 0x7f83440a18a0 2020-02-11T16:11:27.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f8349ce9700 1 -- 172.21.15.88:0/725776030 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 msgr2=0x7f83440a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f8349ce9700 1 --2- 172.21.15.88:0/725776030 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83340088e0).stop 2020-02-11T16:11:27.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f8349ce9700 1 -- 172.21.15.88:0/725776030 shutdown_connections 2020-02-11T16:11:27.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f8349ce9700 1 --2- 172.21.15.88:0/725776030 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a18a0 0x7f83440a6dd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f8349ce9700 1 --2- 172.21.15.88:0/725776030 >> v2:172.21.15.52:3300/0 conn(0x7f83440a5de0 0x7f83440a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f8349ce9700 1 -- 172.21.15.88:0/725776030 >> 172.21.15.88:0/725776030 conn(0x7f834409d110 msgr2=0x7f834409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:27.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f8349ce9700 1 -- 172.21.15.88:0/725776030 shutdown_connections 2020-02-11T16:11:27.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.760+0000 7f8349ce9700 1 -- 172.21.15.88:0/725776030 wait complete. 2020-02-11T16:11:27.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.761+0000 7f8349ce9700 1 Processor -- start 2020-02-11T16:11:27.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.761+0000 7f8349ce9700 1 -- start start 2020-02-11T16:11:27.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f8349ce9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f83440a18a0 0x7f8344142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f8349ce9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f8349ce9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8344135c30 con 0x7f83440a5de0 2020-02-11T16:11:27.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f8349ce9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8344130e40 con 0x7f83440a18a0 2020-02-11T16:11:27.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f8349ce9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834412f590 con 0x7f834412e3a0 2020-02-11T16:11:27.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f8342ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f83440a5de0 0x7f8344128490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42172/0 (socket says 172.21.15.88:42172) 2020-02-11T16:11:27.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f8342ffd700 1 -- 172.21.15.88:0/1455829760 learned_addr learned my addr 172.21.15.88:0/1455829760 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:27.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> v2:172.21.15.52:3300/0 conn(0x7f83440a18a0 0x7f8344142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f8343fff700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569155697 0 0) 0x7f8344135c30 con 0x7f83440a5de0 2020-02-11T16:11:27.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.762+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8324002fe0 con 0x7f83440a5de0 2020-02-11T16:11:27.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 -- 172.21.15.88:0/1455829760 >> v2:172.21.15.52:3300/0 conn(0x7f83440a18a0 msgr2=0x7f8344142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 --2- 172.21.15.88:0/1455829760 >> v2:172.21.15.52:3300/0 conn(0x7f83440a18a0 0x7f8344142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 -- 172.21.15.88:0/1455829760 >> v1:172.21.15.88:6789/0 conn(0x7f83440a5de0 legacy=0x7f8344128490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 -- 172.21.15.88:0/1455829760 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834412f830 con 0x7f834412e3a0 2020-02-11T16:11:27.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f834405b910 tx=0x7f833c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f834405b910 tx=0x7f833c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f834405b910 tx=0x7f833c010bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f834405b910 tx=0x7f833c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833c006d50 con 0x7f834412e3a0 2020-02-11T16:11:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f834405b910 tx=0x7f833c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f834405b910 tx=0x7f833c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c002240 con 0x7f834412e3a0 2020-02-11T16:11:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833c002660 con 0x7f834412e3a0 2020-02-11T16:11:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8349ce9700 1 -- 172.21.15.88:0/1455829760 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8344128ba0 con 0x7f834412e3a0 2020-02-11T16:11:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8349ce9700 1 -- 172.21.15.88:0/1455829760 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83441321c0 con 0x7f834412e3a0 2020-02-11T16:11:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.763+0000 7f8343fff700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f834405b910 tx=0x7f833c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f8349ce9700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 0x7f8344130050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f8349ce9700 1 -- 172.21.15.88:0/1455829760 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834405e2f0 con 0x7f83440a4e50 2020-02-11T16:11:27.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f833c0028d0 con 0x7f834412e3a0 2020-02-11T16:11:27.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f8343fff700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f834405b910 tx=0x7f833c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 0x7f8344130050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f8340ff9700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8324039f50 0x7f832403c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f833c049ce0 con 0x7f834412e3a0 2020-02-11T16:11:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f83437fe700 1 -- 172.21.15.88:0/1455829760 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83440565b0 con 0x7f83440a4e50 2020-02-11T16:11:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f8342ffd700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8324039f50 0x7f832403c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 0x7f8344130050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 0x7f8344130050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 0x7f8344130050 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 0x7f8344130050 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8334011ca0 con 0x7f83440a4e50 2020-02-11T16:11:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.764+0000 7f8342ffd700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8324039f50 0x7f832403c410 crc :-1 s=READY pgs=216 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.765+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 0x7f8344130050 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.765+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8334007340 con 0x7f83440a4e50 2020-02-11T16:11:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.765+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 msgr2=0x7f8344130050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.765+0000 7f8340ff9700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 0x7f8344130050 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).stop 2020-02-11T16:11:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.765+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 msgr2=0x7f8344130050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.765+0000 7f8340ff9700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83440a4e50 0x7f8344130050 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.773+0000 7f8349ce9700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 0x7f834414c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.773+0000 7f8349ce9700 1 -- 172.21.15.88:0/1455829760 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8344142980 con 0x7f834414c430 2020-02-11T16:11:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.773+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 0x7f834414c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.773+0000 7f83437fe700 1 -- 172.21.15.88:0/1455829760 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f834405ccb0 con 0x7f834414c430 2020-02-11T16:11:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.773+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 0x7f834414c840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.773+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 0x7f834414c840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.773+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 0x7f834414c840 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 0x7f834414c840 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833400c730 con 0x7f834414c430 2020-02-11T16:11:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f83437fe700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 0x7f834414c840 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f833400c890 con 0x7f834414c430 2020-02-11T16:11:27.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 msgr2=0x7f834414c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8340ff9700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 0x7f834414c840 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f8334002f30 tx=0x7f83440a1c80).stop 2020-02-11T16:11:27.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8340ff9700 1 -- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 msgr2=0x7f834414c840 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:27.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8340ff9700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834414c430 0x7f834414c840 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8349ce9700 1 -- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8324039f50 msgr2=0x7f832403c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8349ce9700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8324039f50 0x7f832403c410 crc :-1 s=READY pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8349ce9700 1 -- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 msgr2=0x7f8344142460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8349ce9700 1 --2- 172.21.15.88:0/1455829760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f834412e3a0 0x7f8344142460 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f834405b910 tx=0x7f833c010bd0).stop 2020-02-11T16:11:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8343fff700 1 -- 172.21.15.88:0/1455829760 reap_dead start 2020-02-11T16:11:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8343fff700 1 -- 172.21.15.88:0/1455829760 reap_dead start 2020-02-11T16:11:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8349ce9700 1 -- 172.21.15.88:0/1455829760 shutdown_connections 2020-02-11T16:11:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8349ce9700 1 -- 172.21.15.88:0/1455829760 >> 172.21.15.88:0/1455829760 conn(0x7f834409d110 msgr2=0x7f83440aa920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8349ce9700 1 -- 172.21.15.88:0/1455829760 shutdown_connections 2020-02-11T16:11:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.774+0000 7f8349ce9700 1 -- 172.21.15.88:0/1455829760 wait complete. 2020-02-11T16:11:27.791 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:11:27.791 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:11:27.791 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:11:27.791 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:11:27.791 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 56, 2020-02-11T16:11:27.791 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:11:27.792 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:11:27.792 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:11:27.792 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:11:27.792 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.792 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:11:27.792 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:27.792 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:11:27.792 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:11:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:11:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:11:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:11:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:11:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:11:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:11:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:11:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:11:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:11:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:11:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:11:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:11:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:11:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:11:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:11:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:11:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:11:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:11:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:11:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:11:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:11:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:11:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:11:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:11:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:11:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:11:27.807 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:11:27.807 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:27.807 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:27.807 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.807 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:27.807 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:11:27.808 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:11:27.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.808 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.808 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.808 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:27.808 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.808 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:27.809 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:11:27.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:27.809 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:27.809 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:27.809 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:11:27.809 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.809 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:27.809 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:11:27.810 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2020-02-11T16:11:27.810 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:11:27.810 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2020-02-11T16:11:27.810 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:11:27.811 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-02-11T16:11:27.811 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:11:27.821 INFO:tasks.ceph.mon.c:Stopped 2020-02-11T16:11:27.821 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:11:27.822 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:11:27.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.923+0000 7f43ee541700 1 Processor -- start 2020-02-11T16:11:27.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.923+0000 7f43ee541700 1 -- start start 2020-02-11T16:11:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43ee541700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43e80a5b20 0x7f43e80a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43ee541700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e8131280 0x7f43e81316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43ee541700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e80a4350 con 0x7f43e80a2fa0 2020-02-11T16:11:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43ee541700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e80a1e60 con 0x7f43e80a5b20 2020-02-11T16:11:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43ee541700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e80a3450 con 0x7f43e8131280 2020-02-11T16:11:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43ecade700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e8131280 msgr2=0x7f43e81316f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43e7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f43e80a2fa0 0x7f43e80a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42182/0 (socket says 172.21.15.88:42182) 2020-02-11T16:11:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43e7fff700 1 -- 172.21.15.88:0/1010344242 learned_addr learned my addr 172.21.15.88:0/1010344242 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43ecade700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e8131280 0x7f43e81316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992099722 0 0) 0x7f43e80a4350 con 0x7f43e80a2fa0 2020-02-11T16:11:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d4003230 con 0x7f43e80a2fa0 2020-02-11T16:11:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.924+0000 7f43e77fe700 1 --2- 172.21.15.88:0/1010344242 >> v2:172.21.15.52:3300/0 conn(0x7f43e80a5b20 0x7f43e80a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3285214210 0 0) 0x7f43d4003230 con 0x7f43e80a2fa0 2020-02-11T16:11:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e8131280 msgr2=0x7f43e81316f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:11:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e8131280 0x7f43e81316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 >> v2:172.21.15.52:3300/0 conn(0x7f43e80a5b20 msgr2=0x7f43e80a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 --2- 172.21.15.88:0/1010344242 >> v2:172.21.15.52:3300/0 conn(0x7f43e80a5b20 0x7f43e80a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e80a3a40 con 0x7f43e80a2fa0 2020-02-11T16:11:27.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f43d80016d0 con 0x7f43e80a2fa0 2020-02-11T16:11:27.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 >> v1:172.21.15.88:6789/0 conn(0x7f43e80a2fa0 legacy=0x7f43e80a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d4003750 0x7f43d4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e8131280 0x7f43d40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d4004930 0x7f43d4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:27.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e80a1e60 con 0x7f43d4003750 2020-02-11T16:11:27.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4005390 con 0x7f43d4004930 2020-02-11T16:11:27.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40041b0 con 0x7f43e8131280 2020-02-11T16:11:27.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d4004930 0x7f43d4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e77fe700 1 -- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e8131280 msgr2=0x7f43d40044d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:27.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e7fff700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d4003750 0x7f43d4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e77fe700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e8131280 0x7f43d40044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:27.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 -- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e8131280 msgr2=0x7f43d40044d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:11:27.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e8131280 0x7f43d40044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 -- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d4003750 msgr2=0x7f43d4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:27.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d4003750 0x7f43d4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:27.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 -- 172.21.15.88:0/1010344242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4003230 con 0x7f43d4004930 2020-02-11T16:11:27.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d4004930 0x7f43d4004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f43e0005ad0 tx=0x7f43e0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d4004930 0x7f43d4004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f43e0005ad0 tx=0x7f43e0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d4004930 0x7f43d4004db0 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f43e0005ad0 tx=0x7f43e0008c60).ready entity=mon.1 client_cookie=709adc5dcb8988ec server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d4004930 0x7f43d4004db0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f43e0005ad0 tx=0x7f43e0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43e0005350 con 0x7f43d4004930 2020-02-11T16:11:27.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d4004930 0x7f43d4004db0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f43e0005ad0 tx=0x7f43e0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e00054b0 con 0x7f43d4004930 2020-02-11T16:11:27.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ecade700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d4004930 0x7f43d4004db0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f43e0005ad0 tx=0x7f43e0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43e6ffd700 1 -- 172.21.15.88:0/1010344242 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43e0005890 con 0x7f43d4004930 2020-02-11T16:11:27.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ee541700 1 -- 172.21.15.88:0/1010344242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d4004930 msgr2=0x7f43d4004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.925+0000 7f43ee541700 1 --2- 172.21.15.88:0/1010344242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d4004930 0x7f43d4004db0 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f43e0005ad0 tx=0x7f43e0008c60).stop 2020-02-11T16:11:27.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.926+0000 7f43ecade700 1 -- 172.21.15.88:0/1010344242 reap_dead start 2020-02-11T16:11:27.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.926+0000 7f43ee541700 1 -- 172.21.15.88:0/1010344242 shutdown_connections 2020-02-11T16:11:27.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.926+0000 7f43ee541700 1 -- 172.21.15.88:0/1010344242 >> 172.21.15.88:0/1010344242 conn(0x7f43e809d110 msgr2=0x7f43e809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:27.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.926+0000 7f43ee541700 1 -- 172.21.15.88:0/1010344242 shutdown_connections 2020-02-11T16:11:27.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.926+0000 7f43ee541700 1 -- 172.21.15.88:0/1010344242 wait complete. 2020-02-11T16:11:27.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.927+0000 7f43ee541700 1 Processor -- start 2020-02-11T16:11:27.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.927+0000 7f43ee541700 1 -- start start 2020-02-11T16:11:27.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ee541700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e809fd30 0x7f43e8139c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ee541700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43e8146770 0x7f43e8137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ee541700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e8146be0 con 0x7f43e8130ae0 2020-02-11T16:11:27.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ee541700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e813c840 con 0x7f43e8146770 2020-02-11T16:11:27.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ee541700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8130100 con 0x7f43e809fd30 2020-02-11T16:11:27.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43e7fff700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e809fd30 msgr2=0x7f43e8139c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:27.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43e7fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e809fd30 0x7f43e8139c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:27.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43e8146770 0x7f43e8137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43e8146770 0x7f43e8137bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54570/0 (socket says 172.21.15.88:54570) 2020-02-11T16:11:27.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 -- 172.21.15.88:0/4183842329 learned_addr learned my addr 172.21.15.88:0/4183842329 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:27.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 -- 172.21.15.88:0/4183842329 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e809fd30 msgr2=0x7f43e8139c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:11:27.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e809fd30 0x7f43e8139c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:27.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 -- 172.21.15.88:0/4183842329 >> v1:172.21.15.52:6789/0 conn(0x7f43e8130ae0 legacy=0x7f43e81374e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:27.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 -- 172.21.15.88:0/4183842329 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e81303a0 con 0x7f43e8146770 2020-02-11T16:11:27.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> v2:172.21.15.88:3300/0 conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> v2:172.21.15.88:3300/0 conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43e57fa700 1 -- 172.21.15.88:0/4183842329 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43e0005d00 con 0x7f43e8146770 2020-02-11T16:11:27.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43e57fa700 1 -- 172.21.15.88:0/4183842329 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e0005e60 con 0x7f43e8146770 2020-02-11T16:11:27.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43e57fa700 1 -- 172.21.15.88:0/4183842329 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43e0005710 con 0x7f43e8146770 2020-02-11T16:11:27.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ee541700 1 -- 172.21.15.88:0/4183842329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e8130640 con 0x7f43e8146770 2020-02-11T16:11:27.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.928+0000 7f43ee541700 1 -- 172.21.15.88:0/4183842329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e80a0610 con 0x7f43e8146770 2020-02-11T16:11:27.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.929+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.929+0000 7f43e57fa700 1 -- 172.21.15.88:0/4183842329 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f43e000f1f0 con 0x7f43e8146770 2020-02-11T16:11:27.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.929+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.929+0000 7f43e57fa700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43c8039db0 0x7f43c803c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:27.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.929+0000 7f43ee541700 1 -- 172.21.15.88:0/4183842329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e80565b0 con 0x7f43e8146770 2020-02-11T16:11:27.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.929+0000 7f43e57fa700 1 -- 172.21.15.88:0/4183842329 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f43e0049ad0 con 0x7f43e8146770 2020-02-11T16:11:27.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.929+0000 7f43e7fff700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43c8039db0 0x7f43c803c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:27.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.930+0000 7f43e7fff700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43c8039db0 0x7f43c803c270 crc :-1 s=READY pgs=217 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.933+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:27.933+0000 7f43e57fa700 1 -- 172.21.15.88:0/4183842329 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f43e00320c0 con 0x7f43e8146770 2020-02-11T16:11:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.117+0000 7f43ee541700 1 -- 172.21.15.88:0/4183842329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f43e80a4280 con 0x7f43e8146770 2020-02-11T16:11:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.118+0000 7f43ecade700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.118+0000 7f43e57fa700 1 -- 172.21.15.88:0/4183842329 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f43e0031c80 con 0x7f43e8146770 2020-02-11T16:11:28.121 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 -- 172.21.15.88:0/4183842329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43c8039db0 msgr2=0x7f43c803c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43c8039db0 0x7f43c803c270 crc :-1 s=READY pgs=217 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 -- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 msgr2=0x7f43e8137bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:28.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 0x7f43e8137bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f43e80a1410 tx=0x7f43d400c830).stop 2020-02-11T16:11:28.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 -- 172.21.15.88:0/4183842329 shutdown_connections 2020-02-11T16:11:28.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43c8039db0 0x7f43c803c270 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:28.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8146770 0x7f43e8137bf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:28.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 --2- 172.21.15.88:0/4183842329 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43e809fd30 0x7f43e8139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:28.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 -- 172.21.15.88:0/4183842329 >> 172.21.15.88:0/4183842329 conn(0x7f43e809d110 msgr2=0x7f43e80a5330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:28.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 -- 172.21.15.88:0/4183842329 shutdown_connections 2020-02-11T16:11:28.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:28.119+0000 7f43ee541700 1 -- 172.21.15.88:0/4183842329 wait complete. 2020-02-11T16:11:28.132 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":56,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:31.133 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:11:31.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.246+0000 7fd278437700 1 Processor -- start 2020-02-11T16:11:31.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.246+0000 7fd278437700 1 -- start start 2020-02-11T16:11:31.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.247+0000 7fd278437700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2700a5de0 0x7fd2700a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:31.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.247+0000 7fd278437700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd270134a50 0x7fd270134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:31.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.247+0000 7fd278437700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700a31b0 con 0x7fd2700a18a0 2020-02-11T16:11:31.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.247+0000 7fd278437700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700a3570 con 0x7fd270134a50 2020-02-11T16:11:31.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.247+0000 7fd278437700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700a3810 con 0x7fd2700a5de0 2020-02-11T16:11:31.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.247+0000 7fd2759d2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2700a5de0 0x7fd2700a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:31.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.247+0000 7fd2761d3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd2700a18a0 0x7fd2700a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42200/0 (socket says 172.21.15.88:42200) 2020-02-11T16:11:31.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.247+0000 7fd2761d3700 1 -- 172.21.15.88:0/4201545932 learned_addr learned my addr 172.21.15.88:0/4201545932 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:31.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.247+0000 7fd2759d2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2700a5de0 0x7fd2700a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54574/0 (socket says 172.21.15.88:54574) 2020-02-11T16:11:31.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2769d4700 1 --2- 172.21.15.88:0/4201545932 >> v2:172.21.15.52:3300/0 conn(0x7fd270134a50 0x7fd270134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:31.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2759d2700 1 -- 172.21.15.88:0/4201545932 >> v2:172.21.15.52:3300/0 conn(0x7fd270134a50 msgr2=0x7fd270134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:31.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2759d2700 1 --2- 172.21.15.88:0/4201545932 >> v2:172.21.15.52:3300/0 conn(0x7fd270134a50 0x7fd270134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:31.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2759d2700 1 -- 172.21.15.88:0/4201545932 >> v1:172.21.15.88:6789/0 conn(0x7fd2700a18a0 legacy=0x7fd2700a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:31.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2759d2700 1 -- 172.21.15.88:0/4201545932 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700a3ab0 con 0x7fd2700a5de0 2020-02-11T16:11:31.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2759d2700 1 --2- 172.21.15.88:0/4201545932 >> v2:172.21.15.88:3300/0 conn(0x7fd2700a5de0 0x7fd2700a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd264002f30 tx=0x7fd264007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2759d2700 1 --2- 172.21.15.88:0/4201545932 >> v2:172.21.15.88:3300/0 conn(0x7fd2700a5de0 0x7fd2700a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd264002f30 tx=0x7fd264007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2759d2700 1 --2- 172.21.15.88:0/4201545932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2700a5de0 0x7fd2700a6260 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7fd264002f30 tx=0x7fd264007a40).ready entity=mon.1 client_cookie=632087b54cda873e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:31.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2759d2700 1 --2- 172.21.15.88:0/4201545932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2700a5de0 0x7fd2700a6260 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fd264002f30 tx=0x7fd264007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2751d1700 1 -- 172.21.15.88:0/4201545932 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd26400ae80 con 0x7fd2700a5de0 2020-02-11T16:11:31.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2759d2700 1 --2- 172.21.15.88:0/4201545932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2700a5de0 0x7fd2700a6260 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fd264002f30 tx=0x7fd264007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2759d2700 1 --2- 172.21.15.88:0/4201545932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2700a5de0 0x7fd2700a6260 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fd264002f30 tx=0x7fd264007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2751d1700 1 -- 172.21.15.88:0/4201545932 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd264013a60 con 0x7fd2700a5de0 2020-02-11T16:11:31.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd2751d1700 1 -- 172.21.15.88:0/4201545932 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd264013e00 con 0x7fd2700a5de0 2020-02-11T16:11:31.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd278437700 1 -- 172.21.15.88:0/4201545932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2700a5de0 msgr2=0x7fd2700a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:31.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.248+0000 7fd278437700 1 --2- 172.21.15.88:0/4201545932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2700a5de0 0x7fd2700a6260 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7fd264002f30 tx=0x7fd264007a40).stop 2020-02-11T16:11:31.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.249+0000 7fd278437700 1 -- 172.21.15.88:0/4201545932 shutdown_connections 2020-02-11T16:11:31.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.249+0000 7fd278437700 1 --2- 172.21.15.88:0/4201545932 >> v2:172.21.15.52:3300/0 conn(0x7fd270134a50 0x7fd270134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:31.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.249+0000 7fd278437700 1 --2- 172.21.15.88:0/4201545932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2700a5de0 0x7fd2700a6260 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:31.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.249+0000 7fd278437700 1 -- 172.21.15.88:0/4201545932 >> 172.21.15.88:0/4201545932 conn(0x7fd27009d110 msgr2=0x7fd27009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:31.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.249+0000 7fd278437700 1 -- 172.21.15.88:0/4201545932 shutdown_connections 2020-02-11T16:11:31.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.249+0000 7fd278437700 1 -- 172.21.15.88:0/4201545932 wait complete. 2020-02-11T16:11:31.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.249+0000 7fd278437700 1 Processor -- start 2020-02-11T16:11:31.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.249+0000 7fd278437700 1 -- start start 2020-02-11T16:11:31.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.250+0000 7fd278437700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2700a18a0 0x7fd270129bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:31.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.250+0000 7fd278437700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd270134a50 0x7fd2701279f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:31.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.250+0000 7fd278437700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700a84e0 con 0x7fd2700a5de0 2020-02-11T16:11:31.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.250+0000 7fd278437700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd270131bd0 con 0x7fd270134a50 2020-02-11T16:11:31.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.250+0000 7fd278437700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700a89e0 con 0x7fd2700a18a0 2020-02-11T16:11:31.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.250+0000 7fd2761d3700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2700a18a0 msgr2=0x7fd270129bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:31.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.250+0000 7fd2761d3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2700a18a0 0x7fd270129bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:31.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.250+0000 7fd2759d2700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd2700a5de0 0x7fd2701272e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42206/0 (socket says 172.21.15.88:42206) 2020-02-11T16:11:31.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.250+0000 7fd2759d2700 1 -- 172.21.15.88:0/3481604848 learned_addr learned my addr 172.21.15.88:0/3481604848 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:31.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.250+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> v2:172.21.15.52:3300/0 conn(0x7fd270134a50 0x7fd2701279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:31.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2769d4700 1 -- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2700a18a0 msgr2=0x7fd270129bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:11:31.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2700a18a0 0x7fd270129bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:31.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2769d4700 1 -- 172.21.15.88:0/3481604848 >> v1:172.21.15.88:6789/0 conn(0x7fd2700a5de0 legacy=0x7fd2701272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:31.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2769d4700 1 -- 172.21.15.88:0/3481604848 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700a8740 con 0x7fd270134a50 2020-02-11T16:11:31.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> v2:172.21.15.52:3300/0 conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> v2:172.21.15.52:3300/0 conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:31.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2637fe700 1 -- 172.21.15.88:0/3481604848 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd268005e20 con 0x7fd270134a50 2020-02-11T16:11:31.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2637fe700 1 -- 172.21.15.88:0/3481604848 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2680129b0 con 0x7fd270134a50 2020-02-11T16:11:31.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd278437700 1 -- 172.21.15.88:0/3481604848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2700a8bd0 con 0x7fd270134a50 2020-02-11T16:11:31.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd2637fe700 1 -- 172.21.15.88:0/3481604848 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd268012d50 con 0x7fd270134a50 2020-02-11T16:11:31.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.251+0000 7fd278437700 1 -- 172.21.15.88:0/3481604848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27012d4a0 con 0x7fd270134a50 2020-02-11T16:11:31.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.252+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.252+0000 7fd2637fe700 1 -- 172.21.15.88:0/3481604848 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd268010170 con 0x7fd270134a50 2020-02-11T16:11:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.252+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.252+0000 7fd278437700 1 -- 172.21.15.88:0/3481604848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2700565b0 con 0x7fd270134a50 2020-02-11T16:11:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.252+0000 7fd2637fe700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd250039bc0 0x7fd25003c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.252+0000 7fd2637fe700 1 -- 172.21.15.88:0/3481604848 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fd268049d50 con 0x7fd270134a50 2020-02-11T16:11:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.253+0000 7fd2761d3700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd250039bc0 0x7fd25003c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.253+0000 7fd2761d3700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd250039bc0 0x7fd25003c080 crc :-1 s=READY pgs=218 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:31.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.257+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.257+0000 7fd2637fe700 1 -- 172.21.15.88:0/3481604848 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd26802f390 con 0x7fd270134a50 2020-02-11T16:11:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.436+0000 7fd278437700 1 -- 172.21.15.88:0/3481604848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd2700a72c0 con 0x7fd270134a50 2020-02-11T16:11:31.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.437+0000 7fd2769d4700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:31.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.437+0000 7fd2637fe700 1 -- 172.21.15.88:0/3481604848 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fd268031e80 con 0x7fd270134a50 2020-02-11T16:11:31.441 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.438+0000 7fd278437700 1 -- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd250039bc0 msgr2=0x7fd25003c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.438+0000 7fd278437700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd250039bc0 0x7fd25003c080 crc :-1 s=READY pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:31.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.439+0000 7fd278437700 1 -- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 msgr2=0x7fd2701279f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:31.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.439+0000 7fd278437700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 0x7fd2701279f0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fd2680032b0 tx=0x7fd268010f20).stop 2020-02-11T16:11:31.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.439+0000 7fd278437700 1 -- 172.21.15.88:0/3481604848 shutdown_connections 2020-02-11T16:11:31.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.439+0000 7fd278437700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd250039bc0 0x7fd25003c080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:31.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.439+0000 7fd278437700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd270134a50 0x7fd2701279f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.439+0000 7fd278437700 1 --2- 172.21.15.88:0/3481604848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2700a18a0 0x7fd270129bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.439+0000 7fd278437700 1 -- 172.21.15.88:0/3481604848 >> 172.21.15.88:0/3481604848 conn(0x7fd27009d110 msgr2=0x7fd270069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.439+0000 7fd278437700 1 -- 172.21.15.88:0/3481604848 shutdown_connections 2020-02-11T16:11:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:31.439+0000 7fd278437700 1 -- 172.21.15.88:0/3481604848 wait complete. 2020-02-11T16:11:31.451 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":56,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:34.452 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:11:34.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.564+0000 7fe7e4766700 1 Processor -- start 2020-02-11T16:11:34.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.564+0000 7fe7e4766700 1 -- start start 2020-02-11T16:11:34.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e4766700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7dc0a18a0 0x7fe7dc0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e4766700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7dc0a6260 0x7fe7dc12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e4766700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7dc0a3570 con 0x7fe7dc0a5de0 2020-02-11T16:11:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e4766700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc0a3810 con 0x7fe7dc0a6260 2020-02-11T16:11:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e4766700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0a3ab0 con 0x7fe7dc0a18a0 2020-02-11T16:11:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7dc0a6260 0x7fe7dc12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2502700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7dc0a18a0 msgr2=0x7fe7dc0a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:34.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e1d01700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe7dc0a5de0 0x7fe7dc12e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42212/0 (socket says 172.21.15.88:42212) 2020-02-11T16:11:34.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e1d01700 1 -- 172.21.15.88:0/1247605684 learned_addr learned my addr 172.21.15.88:0/1247605684 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:34.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2502700 1 --2- 172.21.15.88:0/1247605684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7dc0a18a0 0x7fe7dc0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:34.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 -- 172.21.15.88:0/1247605684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7dc0a18a0 msgr2=0x7fe7dc0a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:11:34.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/1247605684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7dc0a18a0 0x7fe7dc0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:34.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 -- 172.21.15.88:0/1247605684 >> v1:172.21.15.88:6789/0 conn(0x7fe7dc0a5de0 legacy=0x7fe7dc12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:34.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 -- 172.21.15.88:0/1247605684 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc0a3d50 con 0x7fe7dc0a6260 2020-02-11T16:11:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/1247605684 >> v2:172.21.15.88:3300/0 conn(0x7fe7dc0a6260 0x7fe7dc12eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7dc05bbc0 tx=0x7fe7d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/1247605684 >> v2:172.21.15.88:3300/0 conn(0x7fe7dc0a6260 0x7fe7dc12eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7dc05bbc0 tx=0x7fe7d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/1247605684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc12eab0 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7d80088e0).ready entity=mon.1 client_cookie=d16a82d909c24506 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/1247605684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc12eab0 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e1500700 1 -- 172.21.15.88:0/1247605684 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7d8011660 con 0x7fe7dc0a6260 2020-02-11T16:11:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/1247605684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc12eab0 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/1247605684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc12eab0 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e1500700 1 -- 172.21.15.88:0/1247605684 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d80117c0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e1500700 1 -- 172.21.15.88:0/1247605684 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7d8011ba0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e4766700 1 -- 172.21.15.88:0/1247605684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 msgr2=0x7fe7dc12eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.565+0000 7fe7e4766700 1 --2- 172.21.15.88:0/1247605684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc12eab0 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7d80088e0).stop 2020-02-11T16:11:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.566+0000 7fe7e4766700 1 -- 172.21.15.88:0/1247605684 shutdown_connections 2020-02-11T16:11:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.566+0000 7fe7e4766700 1 --2- 172.21.15.88:0/1247605684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc12eab0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.566+0000 7fe7e4766700 1 --2- 172.21.15.88:0/1247605684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7dc0a18a0 0x7fe7dc0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.566+0000 7fe7e4766700 1 -- 172.21.15.88:0/1247605684 >> 172.21.15.88:0/1247605684 conn(0x7fe7dc09d110 msgr2=0x7fe7dc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.566+0000 7fe7e4766700 1 -- 172.21.15.88:0/1247605684 shutdown_connections 2020-02-11T16:11:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.566+0000 7fe7e4766700 1 -- 172.21.15.88:0/1247605684 wait complete. 2020-02-11T16:11:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.567+0000 7fe7e4766700 1 Processor -- start 2020-02-11T16:11:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.567+0000 7fe7e4766700 1 -- start start 2020-02-11T16:11:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.567+0000 7fe7e4766700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe7dc0a18a0 0x7fe7dc142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.567+0000 7fe7e4766700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7dc0a6260 0x7fe7dc143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.567+0000 7fe7e4766700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7dc1436b0 con 0x7fe7dc0a5de0 2020-02-11T16:11:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.567+0000 7fe7e4766700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc143950 con 0x7fe7dc0a18a0 2020-02-11T16:11:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.567+0000 7fe7e4766700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc143bf0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e1d01700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe7dc0a5de0 0x7fe7dc131ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42220/0 (socket says 172.21.15.88:42220) 2020-02-11T16:11:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e1d01700 1 -- 172.21.15.88:0/687117828 learned_addr learned my addr 172.21.15.88:0/687117828 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> v2:172.21.15.88:3300/0 conn(0x7fe7dc0a6260 0x7fe7dc143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2502700 1 --2- 172.21.15.88:0/687117828 >> v2:172.21.15.52:3300/0 conn(0x7fe7dc0a18a0 0x7fe7dc142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 -- 172.21.15.88:0/687117828 >> v2:172.21.15.52:3300/0 conn(0x7fe7dc0a18a0 msgr2=0x7fe7dc142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> v2:172.21.15.52:3300/0 conn(0x7fe7dc0a18a0 0x7fe7dc142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 -- 172.21.15.88:0/687117828 >> v1:172.21.15.88:6789/0 conn(0x7fe7dc0a5de0 legacy=0x7fe7dc131ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 -- 172.21.15.88:0/687117828 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc1322b0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> v2:172.21.15.88:3300/0 conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> v2:172.21.15.88:3300/0 conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7cf7fe700 1 -- 172.21.15.88:0/687117828 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7d8007340 con 0x7fe7dc0a6260 2020-02-11T16:11:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7cf7fe700 1 -- 172.21.15.88:0/687117828 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d80074a0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e4766700 1 -- 172.21.15.88:0/687117828 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc1357a0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7cf7fe700 1 -- 172.21.15.88:0/687117828 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7d80058b0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.568+0000 7fe7e4766700 1 -- 172.21.15.88:0/687117828 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc135110 con 0x7fe7dc0a6260 2020-02-11T16:11:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.569+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.569+0000 7fe7cf7fe700 1 -- 172.21.15.88:0/687117828 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe7d8005a10 con 0x7fe7dc0a6260 2020-02-11T16:11:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.569+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.569+0000 7fe7cf7fe700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe7bc039c40 0x7fe7bc03c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.569+0000 7fe7cf7fe700 1 -- 172.21.15.88:0/687117828 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe7d804a200 con 0x7fe7dc0a6260 2020-02-11T16:11:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.569+0000 7fe7e4766700 1 -- 172.21.15.88:0/687117828 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc0565b0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.569+0000 7fe7e2502700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe7bc039c40 0x7fe7bc03c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.570+0000 7fe7e2502700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe7bc039c40 0x7fe7bc03c100 crc :-1 s=READY pgs=219 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.573+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.573+0000 7fe7cf7fe700 1 -- 172.21.15.88:0/687117828 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe7d80327f0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.757+0000 7fe7e4766700 1 -- 172.21.15.88:0/687117828 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe7dc05ccb0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.757+0000 7fe7e2d03700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:34.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.757+0000 7fe7cf7fe700 1 -- 172.21.15.88:0/687117828 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fe7d80323b0 con 0x7fe7dc0a6260 2020-02-11T16:11:34.760 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.758+0000 7fe7e4766700 1 -- 172.21.15.88:0/687117828 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe7bc039c40 msgr2=0x7fe7bc03c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.758+0000 7fe7e4766700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe7bc039c40 0x7fe7bc03c100 crc :-1 s=READY pgs=219 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.758+0000 7fe7e4766700 1 -- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 msgr2=0x7fe7dc143190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.758+0000 7fe7e4766700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc143190 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7fe7dc05bbc0 tx=0x7fe7dc0a1c80).stop 2020-02-11T16:11:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.758+0000 7fe7e4766700 1 -- 172.21.15.88:0/687117828 shutdown_connections 2020-02-11T16:11:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.759+0000 7fe7e4766700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7dc0a6260 0x7fe7dc143190 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.759+0000 7fe7e4766700 1 --2- 172.21.15.88:0/687117828 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe7bc039c40 0x7fe7bc03c100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.759+0000 7fe7e4766700 1 --2- 172.21.15.88:0/687117828 >> v2:172.21.15.52:3300/0 conn(0x7fe7dc0a18a0 0x7fe7dc142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.759+0000 7fe7e4766700 1 -- 172.21.15.88:0/687117828 >> 172.21.15.88:0/687117828 conn(0x7fe7dc09d110 msgr2=0x7fe7dc0a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.759+0000 7fe7e4766700 1 -- 172.21.15.88:0/687117828 shutdown_connections 2020-02-11T16:11:34.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:34.759+0000 7fe7e4766700 1 -- 172.21.15.88:0/687117828 wait complete. 2020-02-11T16:11:34.771 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":56,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:37.772 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:11:37.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.885+0000 7f27a67d8700 1 Processor -- start 2020-02-11T16:11:37.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.885+0000 7f27a67d8700 1 -- start start 2020-02-11T16:11:37.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f27a67d8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f27a67d8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 0x7f27a012e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f27a67d8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a009d6b0 con 0x7f27a005c250 2020-02-11T16:11:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f27a67d8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00a3f20 con 0x7f27a005be70 2020-02-11T16:11:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f27a67d8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a012f050 con 0x7f27a0137f10 2020-02-11T16:11:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f279f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f27a005c250 0x7f27a00a6ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42234/0 (socket says 172.21.15.88:42234) 2020-02-11T16:11:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f279f7fe700 1 -- 172.21.15.88:0/419212264 learned_addr learned my addr 172.21.15.88:0/419212264 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f27a4d75700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 msgr2=0x7f27a012e740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f27a4d75700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 0x7f27a012e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:11:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:11:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:37.886+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:38.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.087+0000 7f27a4d75700 1 -- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 msgr2=0x7f27a012e740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:38.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.087+0000 7f27a4d75700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 0x7f27a012e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:11:38.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.087+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:38.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.087+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:11:38.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.087+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:11:38.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.087+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:38.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.087+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:11:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.488+0000 7f27a4d75700 1 -- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 msgr2=0x7f27a012e740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.488+0000 7f27a4d75700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 0x7f27a012e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:11:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.488+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.488+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:11:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.488+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:11:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.488+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:38.488+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:11:39.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:39.289+0000 7f27a4d75700 1 -- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 msgr2=0x7f27a012e740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:39.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:39.289+0000 7f27a4d75700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 0x7f27a012e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:11:39.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:39.289+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:39.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:39.289+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:11:39.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:39.289+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:11:39.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:39.289+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:39.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:39.289+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:11:40.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:40.891+0000 7f27a4d75700 1 -- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 msgr2=0x7f27a012e740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:40.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:40.891+0000 7f27a4d75700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 0x7f27a012e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:11:40.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:40.891+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:40.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:40.891+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:11:40.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:40.891+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:11:40.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:40.891+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:11:40.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:40.891+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:11:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313068624 0 0) 0x7f27a009d6b0 con 0x7f27a005c250 2020-02-11T16:11:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278c003230 con 0x7f27a005c250 2020-02-11T16:11:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1369632266 0 0) 0x7f278c003230 con 0x7f27a005c250 2020-02-11T16:11:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 msgr2=0x7f27a012e740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:11:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 0x7f27a012e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 msgr2=0x7f27a00a31c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:11:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 --2- 172.21.15.88:0/419212264 >> v2:172.21.15.52:3300/0 conn(0x7f27a005be70 0x7f27a00a31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a00a6560 con 0x7f27a005c250 2020-02-11T16:11:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f27940016b0 con 0x7f27a005c250 2020-02-11T16:11:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 >> v1:172.21.15.88:6789/0 conn(0x7f27a005c250 legacy=0x7f27a00a6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.087+0000 7f279effd700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c003720 0x7f278c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279effd700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c003fc0 0x7f278c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279effd700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 0x7f278c004a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a012f050 con 0x7f278c003fc0 2020-02-11T16:11:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c004ff0 con 0x7f278c003720 2020-02-11T16:11:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0051b0 con 0x7f27a0137f10 2020-02-11T16:11:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f27a4d75700 1 -- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 msgr2=0x7f278c004a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f27a4d75700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 0x7f278c004a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c003720 0x7f278c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 msgr2=0x7f278c004a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:11:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27a0137f10 0x7f278c004a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c003fc0 msgr2=0x7f278c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c003fc0 0x7f278c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 -- 172.21.15.88:0/419212264 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c003230 con 0x7f278c003720 2020-02-11T16:11:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c003720 0x7f278c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2790002f30 tx=0x7f279000bc90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c003720 0x7f278c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2790002f30 tx=0x7f279000bc90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c003720 0x7f278c003b40 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f2790002f30 tx=0x7f279000bc90).ready entity=mon.1 client_cookie=82d544d173df2928 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c003720 0x7f278c003b40 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f2790002f30 tx=0x7f279000bc90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2790010a90 con 0x7f278c003720 2020-02-11T16:11:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c003720 0x7f278c003b40 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f2790002f30 tx=0x7f279000bc90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279ffff700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c003720 0x7f278c003b40 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f2790002f30 tx=0x7f279000bc90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790010bf0 con 0x7f278c003720 2020-02-11T16:11:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f279effd700 1 -- 172.21.15.88:0/419212264 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f279000e650 con 0x7f278c003720 2020-02-11T16:11:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f27a67d8700 1 -- 172.21.15.88:0/419212264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c003720 msgr2=0x7f278c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f27a67d8700 1 --2- 172.21.15.88:0/419212264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c003720 0x7f278c003b40 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f2790002f30 tx=0x7f279000bc90).stop 2020-02-11T16:11:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.088+0000 7f27a4d75700 1 -- 172.21.15.88:0/419212264 reap_dead start 2020-02-11T16:11:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.089+0000 7f27a67d8700 1 -- 172.21.15.88:0/419212264 shutdown_connections 2020-02-11T16:11:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.089+0000 7f27a67d8700 1 -- 172.21.15.88:0/419212264 >> 172.21.15.88:0/419212264 conn(0x7f27a00ab400 msgr2=0x7f27a00a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.089+0000 7f27a67d8700 1 -- 172.21.15.88:0/419212264 shutdown_connections 2020-02-11T16:11:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.089+0000 7f27a67d8700 1 -- 172.21.15.88:0/419212264 wait complete. 2020-02-11T16:11:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.091+0000 7f27a67d8700 1 Processor -- start 2020-02-11T16:11:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.091+0000 7f27a67d8700 1 -- start start 2020-02-11T16:11:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a67d8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27a0132140 0x7f27a0151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a67d8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a005aa00 con 0x7f27a012d330 2020-02-11T16:11:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a67d8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a01361c0 con 0x7f27a0131cc0 2020-02-11T16:11:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a67d8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00665d0 con 0x7f27a0132140 2020-02-11T16:11:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27a0132140 0x7f27a0151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f279f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f27a0131cc0 0x7f27a014da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42264/0 (socket says 172.21.15.88:42264) 2020-02-11T16:11:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27a0132140 0x7f27a0151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54640/0 (socket says 172.21.15.88:54640) 2020-02-11T16:11:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f279ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f27a012d330 0x7f27a0065ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:34044/0 (socket says 172.21.15.88:34044) 2020-02-11T16:11:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f279f7fe700 1 -- 172.21.15.88:0/250707497 learned_addr learned my addr 172.21.15.88:0/250707497 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:42.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 -- 172.21.15.88:0/250707497 >> v1:172.21.15.88:6789/0 conn(0x7f27a0131cc0 legacy=0x7f27a014da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 -- 172.21.15.88:0/250707497 >> v1:172.21.15.52:6789/0 conn(0x7f27a012d330 legacy=0x7f27a0065ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 -- 172.21.15.88:0/250707497 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a0137c00 con 0x7f27a0132140 2020-02-11T16:11:42.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 --2- 172.21.15.88:0/250707497 >> v2:172.21.15.88:3300/0 conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 --2- 172.21.15.88:0/250707497 >> v2:172.21.15.88:3300/0 conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f27a4d75700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.092+0000 7f279d7fa700 1 -- 172.21.15.88:0/250707497 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27980116a0 con 0x7f27a0132140 2020-02-11T16:11:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.093+0000 7f279d7fa700 1 -- 172.21.15.88:0/250707497 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2798011800 con 0x7f27a0132140 2020-02-11T16:11:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.093+0000 7f27a67d8700 1 -- 172.21.15.88:0/250707497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a01363f0 con 0x7f27a0132140 2020-02-11T16:11:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.093+0000 7f279d7fa700 1 -- 172.21.15.88:0/250707497 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2798011b60 con 0x7f27a0132140 2020-02-11T16:11:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.093+0000 7f27a67d8700 1 -- 172.21.15.88:0/250707497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a0135d00 con 0x7f27a0132140 2020-02-11T16:11:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.093+0000 7f27a4d75700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.094+0000 7f279d7fa700 1 -- 172.21.15.88:0/250707497 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2798006180 con 0x7f27a0132140 2020-02-11T16:11:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.094+0000 7f27a4d75700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.094+0000 7f279d7fa700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2780039ad0 0x7f278003bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.094+0000 7f279d7fa700 1 -- 172.21.15.88:0/250707497 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f27980495f0 con 0x7f27a0132140 2020-02-11T16:11:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.094+0000 7f279ffff700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2780039ad0 0x7f278003bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.094+0000 7f27a67d8700 1 -- 172.21.15.88:0/250707497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a0137a10 con 0x7f27a0132140 2020-02-11T16:11:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.094+0000 7f279ffff700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2780039ad0 0x7f278003bf90 crc :-1 s=READY pgs=220 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.098+0000 7f27a4d75700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.098+0000 7f279d7fa700 1 -- 172.21.15.88:0/250707497 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f279802ec50 con 0x7f27a0132140 2020-02-11T16:11:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.282+0000 7f27a67d8700 1 -- 172.21.15.88:0/250707497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f27a00565b0 con 0x7f27a0132140 2020-02-11T16:11:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.282+0000 7f27a4d75700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.282+0000 7f279d7fa700 1 -- 172.21.15.88:0/250707497 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7f27980316e0 con 0x7f27a0132140 2020-02-11T16:11:42.286 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":60,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.284+0000 7f27a67d8700 1 -- 172.21.15.88:0/250707497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2780039ad0 msgr2=0x7f278003bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.284+0000 7f27a67d8700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2780039ad0 0x7f278003bf90 crc :-1 s=READY pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.284+0000 7f27a67d8700 1 -- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 msgr2=0x7f27a0151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.284+0000 7f27a67d8700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 0x7f27a0151130 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f27a00aa8b0 tx=0x7f2798010960).stop 2020-02-11T16:11:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.284+0000 7f27a67d8700 1 -- 172.21.15.88:0/250707497 shutdown_connections 2020-02-11T16:11:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.284+0000 7f27a67d8700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2780039ad0 0x7f278003bf90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.284+0000 7f27a67d8700 1 --2- 172.21.15.88:0/250707497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a0132140 0x7f27a0151130 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.284+0000 7f27a67d8700 1 -- 172.21.15.88:0/250707497 >> 172.21.15.88:0/250707497 conn(0x7f27a00ab400 msgr2=0x7f27a0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.284+0000 7f27a67d8700 1 -- 172.21.15.88:0/250707497 shutdown_connections 2020-02-11T16:11:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.284+0000 7f27a67d8700 1 -- 172.21.15.88:0/250707497 wait complete. 2020-02-11T16:11:42.296 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":60,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:11:42.296 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:11:42.297 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:11:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.400+0000 7f581da9f700 1 Processor -- start 2020-02-11T16:11:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.400+0000 7f581da9f700 1 -- start start 2020-02-11T16:11:42.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f581da9f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f58180a5de0 0x7f58180a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:42.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f581da9f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5818134a50 0x7f5818134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:42.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f581da9f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58180a31b0 con 0x7f58180a18a0 2020-02-11T16:11:42.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f581da9f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58180a3570 con 0x7f5818134a50 2020-02-11T16:11:42.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f581da9f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58180a3810 con 0x7f58180a5de0 2020-02-11T16:11:42.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f58180a5de0 0x7f58180a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f58180a5de0 0x7f58180a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54646/0 (socket says 172.21.15.88:54646) 2020-02-11T16:11:42.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 -- 172.21.15.88:0/2403366895 learned_addr learned my addr 172.21.15.88:0/2403366895 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:42.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 -- 172.21.15.88:0/2403366895 >> v2:172.21.15.52:3300/0 conn(0x7f5818134a50 msgr2=0x7f5818134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:42.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 --2- 172.21.15.88:0/2403366895 >> v2:172.21.15.52:3300/0 conn(0x7f5818134a50 0x7f5818134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:42.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 -- 172.21.15.88:0/2403366895 >> v1:172.21.15.52:6789/0 conn(0x7f58180a18a0 legacy=0x7f58180a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:11:42.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 -- 172.21.15.88:0/2403366895 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58180a3ab0 con 0x7f58180a5de0 2020-02-11T16:11:42.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 --2- 172.21.15.88:0/2403366895 >> v2:172.21.15.88:3300/0 conn(0x7f58180a5de0 0x7f58180a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f581805bbc0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 --2- 172.21.15.88:0/2403366895 >> v2:172.21.15.88:3300/0 conn(0x7f58180a5de0 0x7f58180a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f581805bbc0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 --2- 172.21.15.88:0/2403366895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58180a5de0 0x7f58180a6260 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f581805bbc0 tx=0x7f580c007a40).ready entity=mon.1 client_cookie=6c8daf5461aea385 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 --2- 172.21.15.88:0/2403366895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58180a5de0 0x7f58180a6260 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f581805bbc0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f58167fc700 1 -- 172.21.15.88:0/2403366895 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580c0116e0 con 0x7f58180a5de0 2020-02-11T16:11:42.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 --2- 172.21.15.88:0/2403366895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58180a5de0 0x7f58180a6260 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f581805bbc0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f5816ffd700 1 --2- 172.21.15.88:0/2403366895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58180a5de0 0x7f58180a6260 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f581805bbc0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f58167fc700 1 -- 172.21.15.88:0/2403366895 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c011840 con 0x7f58180a5de0 2020-02-11T16:11:42.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f58167fc700 1 -- 172.21.15.88:0/2403366895 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580c011c20 con 0x7f58180a5de0 2020-02-11T16:11:42.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.401+0000 7f581da9f700 1 -- 172.21.15.88:0/2403366895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58180a5de0 msgr2=0x7f58180a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.402+0000 7f581da9f700 1 --2- 172.21.15.88:0/2403366895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58180a5de0 0x7f58180a6260 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f581805bbc0 tx=0x7f580c007a40).stop 2020-02-11T16:11:42.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.402+0000 7f581da9f700 1 -- 172.21.15.88:0/2403366895 shutdown_connections 2020-02-11T16:11:42.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.402+0000 7f581da9f700 1 --2- 172.21.15.88:0/2403366895 >> v2:172.21.15.52:3300/0 conn(0x7f5818134a50 0x7f5818134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.402+0000 7f581da9f700 1 --2- 172.21.15.88:0/2403366895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58180a5de0 0x7f58180a6260 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.402+0000 7f581da9f700 1 -- 172.21.15.88:0/2403366895 >> 172.21.15.88:0/2403366895 conn(0x7f581809d110 msgr2=0x7f581809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.402+0000 7f581da9f700 1 -- 172.21.15.88:0/2403366895 shutdown_connections 2020-02-11T16:11:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.402+0000 7f581da9f700 1 -- 172.21.15.88:0/2403366895 wait complete. 2020-02-11T16:11:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.403+0000 7f581da9f700 1 Processor -- start 2020-02-11T16:11:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.403+0000 7f581da9f700 1 -- start start 2020-02-11T16:11:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f581da9f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f58180a5de0 0x7f581811d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f581da9f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58180a9d80 con 0x7f58180a18a0 2020-02-11T16:11:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f581da9f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5818130d00 con 0x7f5818134a50 2020-02-11T16:11:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f581da9f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5818130570 con 0x7f58180a5de0 2020-02-11T16:11:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5817fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5818134a50 0x7f581811d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42280/0 (socket says 172.21.15.88:42280) 2020-02-11T16:11:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5817fff700 1 -- 172.21.15.88:0/1584183762 learned_addr learned my addr 172.21.15.88:0/1584183762 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5816ffd700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f58180a5de0 msgr2=0x7f581811d3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f58180a5de0 0x7f581811d3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733268440 0 0) 0x7f5818130d00 con 0x7f5818134a50 2020-02-11T16:11:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f8002fe0 con 0x7f5818134a50 2020-02-11T16:11:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866488865 0 0) 0x7f58180a9d80 con 0x7f58180a18a0 2020-02-11T16:11:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5818130d00 con 0x7f58180a18a0 2020-02-11T16:11:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 286292396 0 0) 0x7f57f8002fe0 con 0x7f5818134a50 2020-02-11T16:11:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58180a9d80 con 0x7f5818134a50 2020-02-11T16:11:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f5810002b60 con 0x7f5818134a50 2020-02-11T16:11:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f58180a5de0 msgr2=0x7f581811d3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:11:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f58180a5de0 0x7f581811d3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 >> v1:172.21.15.88:6789/0 conn(0x7f5818134a50 legacy=0x7f581811d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 >> v1:172.21.15.52:6789/0 conn(0x7f58180a18a0 legacy=0x7f58181219d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f8004b20 0x7f57f8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f58180a5de0 0x7f57f8004420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818130570 con 0x7f57f8004b20 2020-02-11T16:11:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8004960 con 0x7f57f8003ab0 2020-02-11T16:11:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f800b7d0 con 0x7f58180a5de0 2020-02-11T16:11:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5817fff700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f58180a5de0 msgr2=0x7f57f8004420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f5817fff700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f58180a5de0 0x7f57f8004420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.404+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f8004b20 0x7f57f8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f58180a5de0 msgr2=0x7f57f8004420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:11:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f58180a5de0 0x7f57f8004420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f8004b20 msgr2=0x7f57f8004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f8004b20 0x7f57f8004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 -- 172.21.15.88:0/1584183762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818130fa0 con 0x7f57f8003ab0 2020-02-11T16:11:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f581da9f700 1 -- 172.21.15.88:0/1584183762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58180a0be0 con 0x7f57f8003ab0 2020-02-11T16:11:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f580c0102c0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f581da9f700 1 -- 172.21.15.88:0/1584183762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5818130910 con 0x7f57f8003ab0 2020-02-11T16:11:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f580c0102c0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f580c0102c0 tx=0x7f580c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f580c0102c0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580c007c10 con 0x7f57f8003ab0 2020-02-11T16:11:42.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f580c0102c0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f580c0102c0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c007340 con 0x7f57f8003ab0 2020-02-11T16:11:42.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580c0056c0 con 0x7f57f8003ab0 2020-02-11T16:11:42.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f580c0102c0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f581da9f700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 0x7f57f40058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f581da9f700 1 -- 172.21.15.88:0/1584183762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4005ea0 con 0x7f57f4003420 2020-02-11T16:11:42.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.405+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 0x7f57f40058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f580c005820 con 0x7f57f8003ab0 2020-02-11T16:11:42.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5816ffd700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f580c0102c0 tx=0x7f580c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f58177fe700 1 -- 172.21.15.88:0/1584183762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57f4006060 con 0x7f57f4003420 2020-02-11T16:11:42.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 0x7f57f40058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5814ff9700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57f8042310 0x7f57f80447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f580c049f70 con 0x7f57f8003ab0 2020-02-11T16:11:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 0x7f57f40058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 0x7f57f40058e0 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 0x7f57f40058e0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58080089d0 con 0x7f57f4003420 2020-02-11T16:11:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5817fff700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57f8042310 0x7f57f80447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 0x7f57f40058e0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5808002fa0 con 0x7f57f4003420 2020-02-11T16:11:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 msgr2=0x7f57f40058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5814ff9700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 0x7f57f40058e0 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).stop 2020-02-11T16:11:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 msgr2=0x7f57f40058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5817fff700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57f8042310 0x7f57f80447d0 crc :-1 s=READY pgs=221 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5814ff9700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f4003420 0x7f57f40058e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.406+0000 7f5817fff700 1 -- 172.21.15.88:0/1584183762 reap_dead start 2020-02-11T16:11:42.432 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:11:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.414+0000 7f581da9f700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 0x7f57f40068a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.414+0000 7f581da9f700 1 -- 172.21.15.88:0/1584183762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4006dd0 con 0x7f57f40063f0 2020-02-11T16:11:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.414+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 0x7f57f40068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f58177fe700 1 -- 172.21.15.88:0/1584183762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f57f4006f90 con 0x7f57f40063f0 2020-02-11T16:11:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 0x7f57f40068a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 0x7f57f40068a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 0x7f57f40068a0 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 0x7f57f40068a0 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580800f4d0 con 0x7f57f40063f0 2020-02-11T16:11:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f58177fe700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 0x7f57f40068a0 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4348 (secure 0 0 0) 0x7f58080020c0 con 0x7f57f40063f0 2020-02-11T16:11:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 msgr2=0x7f57f40068a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f5814ff9700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 0x7f57f40068a0 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).stop 2020-02-11T16:11:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f5814ff9700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 msgr2=0x7f57f40068a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f5814ff9700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 0x7f57f40068a0 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0x7f581805b650 tx=0x7f5808010d00).stop 2020-02-11T16:11:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57f8042310 msgr2=0x7f57f80447d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57f8042310 0x7f57f80447d0 crc :-1 s=READY pgs=221 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 -- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 msgr2=0x7f57f8003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f580c0102c0 tx=0x7f580c007a40).stop 2020-02-11T16:11:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 -- 172.21.15.88:0/1584183762 shutdown_connections 2020-02-11T16:11:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57f8042310 0x7f57f80447d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f8003ab0 0x7f57f8003ef0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 --2- 172.21.15.88:0/1584183762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f40063f0 0x7f57f40068a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 -- 172.21.15.88:0/1584183762 >> 172.21.15.88:0/1584183762 conn(0x7f581809d110 msgr2=0x7f5818069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 -- 172.21.15.88:0/1584183762 shutdown_connections 2020-02-11T16:11:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.415+0000 7f581da9f700 1 -- 172.21.15.88:0/1584183762 wait complete. 2020-02-11T16:11:42.436 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:11:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:11:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 60, 2020-02-11T16:11:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:11:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:11:42.439 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:11:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:11:42.440 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:11:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:11:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:42.441 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:11:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:11:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:42.442 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:42.443 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:11:42.444 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:11:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:11:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:11:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:11:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:11:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:42.447 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:11:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:11:42.448 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:11:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:42.449 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:11:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:11:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:42.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:11:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:42.452 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:11:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:11:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:11:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:42.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.455 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:11:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:11:42.456 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:11:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:11:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:42.457 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:11:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:11:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:42.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:11:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.459 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:11:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:11:42.460 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:11:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:11:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:11:42.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.462 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.464 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:11:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.465 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:11:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:11:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.466 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:11:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:11:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.467 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:11:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:11:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.468 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.468 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:11:42.469 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:11:42.472 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:11:42.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.577+0000 7f13f0648700 1 Processor -- start 2020-02-11T16:11:42.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.577+0000 7f13f0648700 1 -- start start 2020-02-11T16:11:42.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13f0648700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e80ad380 0x7f13e80a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:42.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13f0648700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13e8138280 0x7f13e81386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:11:42.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13f0648700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e80adb40 con 0x7f13e813b1c0 2020-02-11T16:11:42.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13f0648700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e8137bf0 con 0x7f13e8138280 2020-02-11T16:11:42.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13f0648700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e8138b40 con 0x7f13e80ad380 2020-02-11T16:11:42.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13e8138280 0x7f13e81386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13e8138280 0x7f13e81386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54670/0 (socket says 172.21.15.88:54670) 2020-02-11T16:11:42.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 -- 172.21.15.88:0/397040385 learned_addr learned my addr 172.21.15.88:0/397040385 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:11:42.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13ee3e4700 1 -- 172.21.15.88:0/397040385 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e80ad380 msgr2=0x7f13e80a9130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:42.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/397040385 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e80ad380 0x7f13e80a9130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:42.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 -- 172.21.15.88:0/397040385 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e80ad380 msgr2=0x7f13e80a9130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:11:42.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 --2- 172.21.15.88:0/397040385 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e80ad380 0x7f13e80a9130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:42.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 -- 172.21.15.88:0/397040385 >> v1:172.21.15.52:6789/0 conn(0x7f13e813b1c0 legacy=0x7f13e813b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 -- 172.21.15.88:0/397040385 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8137de0 con 0x7f13e8138280 2020-02-11T16:11:42.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 --2- 172.21.15.88:0/397040385 >> v2:172.21.15.88:3300/0 conn(0x7f13e8138280 0x7f13e81386e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f13dc002f30 tx=0x7f13dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 --2- 172.21.15.88:0/397040385 >> v2:172.21.15.88:3300/0 conn(0x7f13e8138280 0x7f13e81386e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f13dc002f30 tx=0x7f13dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 --2- 172.21.15.88:0/397040385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13e8138280 0x7f13e81386e0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc0088e0).ready entity=mon.1 client_cookie=7de81d29ac06b589 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 --2- 172.21.15.88:0/397040385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13e8138280 0x7f13e81386e0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13ed3e2700 1 -- 172.21.15.88:0/397040385 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13dc008e20 con 0x7f13e8138280 2020-02-11T16:11:42.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.578+0000 7f13edbe3700 1 --2- 172.21.15.88:0/397040385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13e8138280 0x7f13e81386e0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13edbe3700 1 --2- 172.21.15.88:0/397040385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13e8138280 0x7f13e81386e0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13ed3e2700 1 -- 172.21.15.88:0/397040385 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc011950 con 0x7f13e8138280 2020-02-11T16:11:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13ed3e2700 1 -- 172.21.15.88:0/397040385 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13dc011d30 con 0x7f13e8138280 2020-02-11T16:11:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13f0648700 1 -- 172.21.15.88:0/397040385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13e8138280 msgr2=0x7f13e81386e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13f0648700 1 --2- 172.21.15.88:0/397040385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13e8138280 0x7f13e81386e0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc0088e0).stop 2020-02-11T16:11:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13f0648700 1 -- 172.21.15.88:0/397040385 shutdown_connections 2020-02-11T16:11:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13f0648700 1 --2- 172.21.15.88:0/397040385 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e80ad380 0x7f13e80a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:11:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13f0648700 1 --2- 172.21.15.88:0/397040385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13e8138280 0x7f13e81386e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13f0648700 1 -- 172.21.15.88:0/397040385 >> 172.21.15.88:0/397040385 conn(0x7f13e805ac70 msgr2=0x7f13e80ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13f0648700 1 -- 172.21.15.88:0/397040385 shutdown_connections 2020-02-11T16:11:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.579+0000 7f13f0648700 1 -- 172.21.15.88:0/397040385 wait complete. 2020-02-11T16:11:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.580+0000 7f13f0648700 1 Processor -- start 2020-02-11T16:11:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.580+0000 7f13f0648700 1 -- start start 2020-02-11T16:11:42.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13f0648700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e813b1c0 0x7f13e8137780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13f0648700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e80a8200 con 0x7f13e80ad380 2020-02-11T16:11:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13f0648700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e80a65c0 con 0x7f13e8138280 2020-02-11T16:11:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13f0648700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e8138e30 con 0x7f13e813b1c0 2020-02-11T16:11:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13eebe5700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e813b1c0 msgr2=0x7f13e8137780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13edbe3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f13e8138280 0x7f13e812b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42302/0 (socket says 172.21.15.88:42302) 2020-02-11T16:11:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13edbe3700 1 -- 172.21.15.88:0/2693671275 learned_addr learned my addr 172.21.15.88:0/2693671275 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:11:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e813b1c0 0x7f13e8137780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:42.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761065838 0 0) 0x7f13e80a65c0 con 0x7f13e8138280 2020-02-11T16:11:42.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c8002fe0 con 0x7f13e8138280 2020-02-11T16:11:42.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751186425 0 0) 0x7f13e80a8200 con 0x7f13e80ad380 2020-02-11T16:11:42.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e80a65c0 con 0x7f13e80ad380 2020-02-11T16:11:42.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1795381499 0 0) 0x7f13c8002fe0 con 0x7f13e8138280 2020-02-11T16:11:42.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f13e80a8200 con 0x7f13e8138280 2020-02-11T16:11:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f13dc008e20 con 0x7f13e8138280 2020-02-11T16:11:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e813b1c0 msgr2=0x7f13e8137780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:11:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e813b1c0 0x7f13e8137780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 >> v1:172.21.15.88:6789/0 conn(0x7f13e8138280 legacy=0x7f13e812b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 >> v1:172.21.15.52:6789/0 conn(0x7f13e80ad380 legacy=0x7f13e812cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e813b1c0 0x7f13c8004b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13c8004fa0 0x7f13c8003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c80047f0 con 0x7f13c8004fa0 2020-02-11T16:11:42.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c8004960 con 0x7f13c8003f10 2020-02-11T16:11:42.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c800b750 con 0x7f13e813b1c0 2020-02-11T16:11:42.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13ee3e4700 1 -- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e813b1c0 msgr2=0x7f13c8004b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:11:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e813b1c0 0x7f13c8004b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:11:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.581+0000 7f13edbe3700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13c8004fa0 0x7f13c8003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 -- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e813b1c0 msgr2=0x7f13c8004b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:11:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13e813b1c0 0x7f13c8004b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 -- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13c8004fa0 msgr2=0x7f13c8003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13c8004fa0 0x7f13c8003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 -- 172.21.15.88:0/2693671275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e80a6860 con 0x7f13c8003f10 2020-02-11T16:11:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13f0648700 1 -- 172.21.15.88:0/2693671275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e812cb20 con 0x7f13c8003f10 2020-02-11T16:11:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13e0001210 tx=0x7f13e0001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13f0648700 1 -- 172.21.15.88:0/2693671275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e80a6360 con 0x7f13c8003f10 2020-02-11T16:11:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13e0001210 tx=0x7f13e0001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f13e0001210 tx=0x7f13e0001710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f13e0001210 tx=0x7f13e0001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f13e0001210 tx=0x7f13e0001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e000cca0 con 0x7f13c8003f10 2020-02-11T16:11:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f13e0001210 tx=0x7f13e0001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e000ce00 con 0x7f13c8003f10 2020-02-11T16:11:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e0010360 con 0x7f13c8003f10 2020-02-11T16:11:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.582+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f13e0001210 tx=0x7f13e0001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13f0648700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 0x7f13e812bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f13e00104c0 con 0x7f13c8003f10 2020-02-11T16:11:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13f0648700 1 -- 172.21.15.88:0/2693671275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e805e2f0 con 0x7f13e8137780 2020-02-11T16:11:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13eebe5700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f13e0001210 tx=0x7f13e0001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13db7fe700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13c80421c0 0x7f13c8044680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 0x7f13e812bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f13e0049a70 con 0x7f13c8003f10 2020-02-11T16:11:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13edbe3700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13c80421c0 0x7f13c8044680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13ee3e4700 1 -- 172.21.15.88:0/2693671275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13e8066cd0 con 0x7f13e8137780 2020-02-11T16:11:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 0x7f13e812bde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 0x7f13e812bde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 0x7f13e812bde0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13edbe3700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13c80421c0 0x7f13c8044680 crc :-1 s=READY pgs=222 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 0x7f13e812bde0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.583+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e4013060 con 0x7f13e8137780 2020-02-11T16:11:42.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.584+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 0x7f13e812bde0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.584+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f13e4012130 con 0x7f13e8137780 2020-02-11T16:11:42.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.584+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 msgr2=0x7f13e812bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.584+0000 7f13db7fe700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 0x7f13e812bde0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).stop 2020-02-11T16:11:42.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.584+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 msgr2=0x7f13e812bde0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:42.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.584+0000 7f13eebe5700 1 -- 172.21.15.88:0/2693671275 reap_dead start 2020-02-11T16:11:42.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.584+0000 7f13db7fe700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e8137780 0x7f13e812bde0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.592+0000 7f13f0648700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 0x7f13e8138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:11:42.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.592+0000 7f13f0648700 1 -- 172.21.15.88:0/2693671275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80565b0 con 0x7f13e812b6d0 2020-02-11T16:11:42.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.592+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 0x7f13e8138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:11:42.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.592+0000 7f13ee3e4700 1 -- 172.21.15.88:0/2693671275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f13e812d890 con 0x7f13e812b6d0 2020-02-11T16:11:42.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.592+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 0x7f13e8138fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.592+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 0x7f13e8138fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.592+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 0x7f13e8138fd0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:11:42.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.592+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 0x7f13e8138fd0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.592+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e4012490 con 0x7f13e812b6d0 2020-02-11T16:11:42.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13ee3e4700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 0x7f13e8138fd0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:11:42.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4180 (secure 0 0 0) 0x7f13e40125f0 con 0x7f13e812b6d0 2020-02-11T16:11:42.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 msgr2=0x7f13e8138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13db7fe700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 0x7f13e8138fd0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f13e40048d0 tx=0x7f13e4010a90).stop 2020-02-11T16:11:42.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13db7fe700 1 -- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 msgr2=0x7f13e8138fd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:11:42.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13db7fe700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 0x7f13e8138fd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 -- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13c80421c0 msgr2=0x7f13c8044680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13c80421c0 0x7f13c8044680 crc :-1 s=READY pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 -- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 msgr2=0x7f13c8004390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:11:42.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f13e0001210 tx=0x7f13e0001710).stop 2020-02-11T16:11:42.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 -- 172.21.15.88:0/2693671275 shutdown_connections 2020-02-11T16:11:42.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f13c80421c0 0x7f13c8044680 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c8003f10 0x7f13c8004390 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 --2- 172.21.15.88:0/2693671275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e812b6d0 0x7f13e8138fd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:11:42.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 -- 172.21.15.88:0/2693671275 >> 172.21.15.88:0/2693671275 conn(0x7f13e805ac70 msgr2=0x7f13e8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:11:42.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 -- 172.21.15.88:0/2693671275 shutdown_connections 2020-02-11T16:11:42.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:11:42.593+0000 7f13f0648700 1 -- 172.21.15.88:0/2693671275 wait complete. 2020-02-11T16:11:42.612 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:11:42.612 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:42.612 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:42.612 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:11:42.612 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 60, 2020-02-11T16:11:42.612 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:11:42.612 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:11:42.613 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:11:42.613 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.613 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:11:42.613 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:42.613 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:11:42.613 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:11:42.613 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:42.614 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:42.614 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:42.614 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:42.614 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:42.614 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:42.614 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.614 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:11:42.615 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:11:42.615 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:42.615 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:42.615 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:42.615 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:42.615 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:42.615 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:42.615 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.616 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:11:42.616 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:11:42.616 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:11:42.616 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:11:42.616 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:11:42.617 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:11:42.617 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:42.617 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:11:42.617 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:11:42.617 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:11:42.617 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:11:42.618 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:11:42.618 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:11:42.618 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:11:42.618 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:11:42.618 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:11:42.618 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:11:42.618 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:11:42.619 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.619 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:11:42.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.619 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:11:42.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.619 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:11:42.619 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:11:42.619 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:42.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:42.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.620 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:42.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:11:42.621 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.621 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:42.621 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:11:42.621 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.621 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.622 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.622 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:11:42.622 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:11:42.622 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:42.622 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:42.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.623 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:11:42.623 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:11:42.623 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:42.623 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:42.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.623 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:42.623 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:11:42.624 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.624 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:42.624 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:11:42.624 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.624 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.625 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.625 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:11:42.625 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:11:42.625 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:42.625 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:42.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.626 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:11:42.626 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:11:42.626 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:11:42.626 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:11:42.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.626 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:11:42.627 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:11:42.627 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.627 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:11:42.628 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:11:42.628 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:11:42.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.628 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.628 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:11:42.628 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:11:42.628 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:11:42.629 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:11:42.629 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.629 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:11:42.629 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:11:42.629 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:11:42.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.630 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:42.630 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:42.630 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:42.630 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.630 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.631 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:11:42.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.631 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:42.631 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:42.631 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:11:42.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.632 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.632 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:11:42.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.632 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:42.632 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:42.632 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:11:42.632 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.632 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:11:42.633 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:11:42.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:11:42.633 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:11:42.633 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:11:42.633 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:11:42.633 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.633 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:11:42.634 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:11:42.634 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:11:42.634 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:12:02.635 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:12:02.636 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2020-02-11T16:12:02.636 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-11T16:12:02.636 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-11T16:12:02.639 INFO:tasks.ceph.mon.c:Started 2020-02-11T16:12:02.639 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:12:02.639 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:12:02.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.759+0000 7faf08312700 1 Processor -- start 2020-02-11T16:12:02.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.759+0000 7faf08312700 1 -- start start 2020-02-11T16:12:02.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf08312700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf000a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:02.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf08312700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf000a5de0 0x7faf000a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:02.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf08312700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf000a31b0 con 0x7faf0012e3a0 2020-02-11T16:12:02.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf08312700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf000a3570 con 0x7faf000a5de0 2020-02-11T16:12:02.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf08312700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf000a3810 con 0x7faf000a18a0 2020-02-11T16:12:02.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf058ad700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf000a5de0 0x7faf000a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:02.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf058ad700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf000a5de0 0x7faf000a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54700/0 (socket says 172.21.15.88:54700) 2020-02-11T16:12:02.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf058ad700 1 -- 172.21.15.88:0/1655322877 learned_addr learned my addr 172.21.15.88:0/1655322877 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:02.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf060ae700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf000a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:02.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf060ae700 1 -- 172.21.15.88:0/1655322877 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 msgr2=0x7faf000a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:12:02.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf060ae700 1 -- 172.21.15.88:0/1655322877 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 msgr2=0x7faf000a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:12:02.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf060ae700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf000a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:02.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf060ae700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf000a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:02.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf058ad700 1 -- 172.21.15.88:0/1655322877 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 msgr2=0x7faf000a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:12:02.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf058ad700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf000a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:02.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf058ad700 1 -- 172.21.15.88:0/1655322877 >> v1:172.21.15.52:6789/0 conn(0x7faf0012e3a0 legacy=0x7faf0012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:02.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf058ad700 1 -- 172.21.15.88:0/1655322877 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf000a3ab0 con 0x7faf000a5de0 2020-02-11T16:12:02.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.760+0000 7faf058ad700 1 --2- 172.21.15.88:0/1655322877 >> v2:172.21.15.88:3300/0 conn(0x7faf000a5de0 0x7faf000a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faefc002f30 tx=0x7faefc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf058ad700 1 --2- 172.21.15.88:0/1655322877 >> v2:172.21.15.88:3300/0 conn(0x7faf000a5de0 0x7faf000a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faefc002f30 tx=0x7faefc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf058ad700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf000a5de0 0x7faf000a6260 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7faefc002f30 tx=0x7faefc0088e0).ready entity=mon.1 client_cookie=4a8908cfab200d88 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:02.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf058ad700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf000a5de0 0x7faf000a6260 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7faefc002f30 tx=0x7faefc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf050ac700 1 -- 172.21.15.88:0/1655322877 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faefc011760 con 0x7faf000a5de0 2020-02-11T16:12:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf058ad700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf000a5de0 0x7faf000a6260 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7faefc002f30 tx=0x7faefc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf058ad700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf000a5de0 0x7faf000a6260 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7faefc002f30 tx=0x7faefc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf050ac700 1 -- 172.21.15.88:0/1655322877 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc0118c0 con 0x7faf000a5de0 2020-02-11T16:12:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf050ac700 1 -- 172.21.15.88:0/1655322877 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faefc011ca0 con 0x7faf000a5de0 2020-02-11T16:12:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf08312700 1 -- 172.21.15.88:0/1655322877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf000a5de0 msgr2=0x7faf000a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf08312700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf000a5de0 0x7faf000a6260 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7faefc002f30 tx=0x7faefc0088e0).stop 2020-02-11T16:12:02.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf08312700 1 -- 172.21.15.88:0/1655322877 shutdown_connections 2020-02-11T16:12:02.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf08312700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf000a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:02.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf08312700 1 --2- 172.21.15.88:0/1655322877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf000a5de0 0x7faf000a6260 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:02.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf08312700 1 -- 172.21.15.88:0/1655322877 >> 172.21.15.88:0/1655322877 conn(0x7faf0009d110 msgr2=0x7faf0009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:02.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf08312700 1 -- 172.21.15.88:0/1655322877 shutdown_connections 2020-02-11T16:12:02.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.761+0000 7faf08312700 1 -- 172.21.15.88:0/1655322877 wait complete. 2020-02-11T16:12:02.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.762+0000 7faf08312700 1 Processor -- start 2020-02-11T16:12:02.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.762+0000 7faf08312700 1 -- start start 2020-02-11T16:12:02.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf08312700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf00133560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:02.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf08312700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf000a5de0 0x7faf000664b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:02.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf08312700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf0012e3a0 0x7faf00066910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:02.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf08312700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf001339c0 con 0x7faf000a5de0 2020-02-11T16:12:02.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf08312700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf001328f0 con 0x7faf0012e3a0 2020-02-11T16:12:02.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf08312700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf00133c00 con 0x7faf000a18a0 2020-02-11T16:12:02.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf0012e3a0 0x7faf00066910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:02.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf0012e3a0 0x7faf00066910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54708/0 (socket says 172.21.15.88:54708) 2020-02-11T16:12:02.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 -- 172.21.15.88:0/3174656280 learned_addr learned my addr 172.21.15.88:0/3174656280 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:02.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf060ae700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf00133560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:02.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf058ad700 1 --2- 172.21.15.88:0/3174656280 >> v2:172.21.15.52:3300/0 conn(0x7faf000a5de0 0x7faf000664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:02.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf060ae700 1 -- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 msgr2=0x7faf00133560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:12:02.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf060ae700 1 -- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 msgr2=0x7faf00133560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:12:02.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf060ae700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf00133560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:02.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf060ae700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf00133560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:02.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 -- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 msgr2=0x7faf00133560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:12:02.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf00133560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:02.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 -- 172.21.15.88:0/3174656280 >> v2:172.21.15.52:3300/0 conn(0x7faf000a5de0 msgr2=0x7faf000664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:02.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> v2:172.21.15.52:3300/0 conn(0x7faf000a5de0 0x7faf000664b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:02.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 -- 172.21.15.88:0/3174656280 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf00066010 con 0x7faf0012e3a0 2020-02-11T16:12:02.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> v2:172.21.15.88:3300/0 conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> v2:172.21.15.88:3300/0 conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:02.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faef37fe700 1 -- 172.21.15.88:0/3174656280 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef80101c0 con 0x7faf0012e3a0 2020-02-11T16:12:02.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faef37fe700 1 -- 172.21.15.88:0/3174656280 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8010360 con 0x7faf0012e3a0 2020-02-11T16:12:02.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf08312700 1 -- 172.21.15.88:0/3174656280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf00148a10 con 0x7faf0012e3a0 2020-02-11T16:12:02.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faef37fe700 1 -- 172.21.15.88:0/3174656280 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef8010780 con 0x7faf0012e3a0 2020-02-11T16:12:02.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.763+0000 7faf08312700 1 -- 172.21.15.88:0/3174656280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0005a950 con 0x7faf0012e3a0 2020-02-11T16:12:02.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.764+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.764+0000 7faef37fe700 1 -- 172.21.15.88:0/3174656280 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7faef8006860 con 0x7faf0012e3a0 2020-02-11T16:12:02.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.764+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.764+0000 7faef37fe700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faee0039ca0 0x7faee003c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:02.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.764+0000 7faef37fe700 1 -- 172.21.15.88:0/3174656280 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7faef8049c80 con 0x7faf0012e3a0 2020-02-11T16:12:02.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.764+0000 7faf08312700 1 -- 172.21.15.88:0/3174656280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf000565b0 con 0x7faf0012e3a0 2020-02-11T16:12:02.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.765+0000 7faf060ae700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faee0039ca0 0x7faee003c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:02.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.765+0000 7faf060ae700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faee0039ca0 0x7faee003c160 crc :-1 s=READY pgs=224 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:02.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.768+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.768+0000 7faef37fe700 1 -- 172.21.15.88:0/3174656280 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7faef802f2e0 con 0x7faf0012e3a0 2020-02-11T16:12:02.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.948+0000 7faf08312700 1 -- 172.21.15.88:0/3174656280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7faf000a7410 con 0x7faf0012e3a0 2020-02-11T16:12:02.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.948+0000 7faf068af700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:02.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.948+0000 7faef37fe700 1 -- 172.21.15.88:0/3174656280 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7faef8031dd0 con 0x7faf0012e3a0 2020-02-11T16:12:02.951 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":60,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:12:02.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.949+0000 7faf08312700 1 -- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faee0039ca0 msgr2=0x7faee003c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:02.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.949+0000 7faf08312700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faee0039ca0 0x7faee003c160 crc :-1 s=READY pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:02.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.949+0000 7faf08312700 1 -- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 msgr2=0x7faf00066910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:02.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.949+0000 7faf08312700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 0x7faf00066910 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7faef8001290 tx=0x7faef8010ce0).stop 2020-02-11T16:12:02.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.950+0000 7faf08312700 1 -- 172.21.15.88:0/3174656280 shutdown_connections 2020-02-11T16:12:02.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.950+0000 7faf08312700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf0012e3a0 0x7faf00066910 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:02.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.950+0000 7faf08312700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf000a18a0 0x7faf00133560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:02.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.950+0000 7faf08312700 1 --2- 172.21.15.88:0/3174656280 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faee0039ca0 0x7faee003c160 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:02.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.950+0000 7faf08312700 1 --2- 172.21.15.88:0/3174656280 >> v2:172.21.15.52:3300/0 conn(0x7faf000a5de0 0x7faf000664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:02.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.950+0000 7faf08312700 1 -- 172.21.15.88:0/3174656280 >> 172.21.15.88:0/3174656280 conn(0x7faf0009d110 msgr2=0x7faf000a61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:02.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.950+0000 7faf08312700 1 -- 172.21.15.88:0/3174656280 shutdown_connections 2020-02-11T16:12:02.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:02.950+0000 7faf08312700 1 -- 172.21.15.88:0/3174656280 wait complete. 2020-02-11T16:12:02.963 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":60,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:12:05.963 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:12:06.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.077+0000 7f5bcfde8700 1 Processor -- start 2020-02-11T16:12:06.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.077+0000 7f5bcfde8700 1 -- start start 2020-02-11T16:12:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bcfde8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 0x7f5bc80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bcfde8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc80a31b0 con 0x7f5bc80a18a0 2020-02-11T16:12:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bcfde8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc80a3570 con 0x7f5bc8134a50 2020-02-11T16:12:06.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bcfde8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80a3810 con 0x7f5bc80a5de0 2020-02-11T16:12:06.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bce385700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5bc8134a50 0x7f5bc8134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42342/0 (socket says 172.21.15.88:42342) 2020-02-11T16:12:06.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bce385700 1 -- 172.21.15.88:0/3429815427 learned_addr learned my addr 172.21.15.88:0/3429815427 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:06.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 0x7f5bc80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547976608 0 0) 0x7f5bc80a3570 con 0x7f5bc8134a50 2020-02-11T16:12:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bcd383700 1 -- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 msgr2=0x7f5bc80a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:12:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bcd383700 1 -- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 msgr2=0x7f5bc80a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:12:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 0x7f5bc80a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:06.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb0003230 con 0x7f5bc8134a50 2020-02-11T16:12:06.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 0x7f5bc80a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:06.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380532738 0 0) 0x7f5bc80a31b0 con 0x7f5bc80a18a0 2020-02-11T16:12:06.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc80a3570 con 0x7f5bc80a18a0 2020-02-11T16:12:06.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2446847357 0 0) 0x7f5bb0003230 con 0x7f5bc8134a50 2020-02-11T16:12:06.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 msgr2=0x7f5bc80a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:12:06.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.078+0000 7f5bccb82700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 0x7f5bc80a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:06.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 >> v1:172.21.15.52:6789/0 conn(0x7f5bc80a18a0 legacy=0x7f5bc80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:06.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc80a3ab0 con 0x7f5bc8134a50 2020-02-11T16:12:06.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f5bc0001a50 con 0x7f5bc8134a50 2020-02-11T16:12:06.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 >> v1:172.21.15.88:6789/0 conn(0x7f5bc8134a50 legacy=0x7f5bc8134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:06.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 0x7f5bb00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:06.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0003d40 0x7f5bb00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:06.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bb0004930 0x7f5bb0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:06.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80a3810 con 0x7f5bb0004930 2020-02-11T16:12:06.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb0005210 con 0x7f5bb0003d40 2020-02-11T16:12:06.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb000b720 con 0x7f5bc80a5de0 2020-02-11T16:12:06.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0003d40 0x7f5bb00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:06.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bce385700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bb0004930 0x7f5bb0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:06.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 0x7f5bb00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:06.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 -- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 msgr2=0x7f5bb00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:06.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc80a5de0 0x7f5bb00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:06.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 -- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bb0004930 msgr2=0x7f5bb0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:06.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bb0004930 0x7f5bb0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:06.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 -- 172.21.15.88:0/3429815427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0003230 con 0x7f5bb0003d40 2020-02-11T16:12:06.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0003d40 0x7f5bb00044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5bc4002f30 tx=0x7f5bc400ff80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0003d40 0x7f5bb00044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5bc4002f30 tx=0x7f5bc400ff80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0003d40 0x7f5bb00044d0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7f5bc4002f30 tx=0x7f5bc400ff80).ready entity=mon.1 client_cookie=f44fffab0ef8352b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0003d40 0x7f5bb00044d0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f5bc4002f30 tx=0x7f5bc400ff80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bc4008dd0 con 0x7f5bb0003d40 2020-02-11T16:12:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0003d40 0x7f5bb00044d0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f5bc4002f30 tx=0x7f5bc400ff80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcd383700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0003d40 0x7f5bb00044d0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f5bc4002f30 tx=0x7f5bc400ff80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc4010800 con 0x7f5bb0003d40 2020-02-11T16:12:06.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bccb82700 1 -- 172.21.15.88:0/3429815427 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bc4010b60 con 0x7f5bb0003d40 2020-02-11T16:12:06.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcfde8700 1 -- 172.21.15.88:0/3429815427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0003d40 msgr2=0x7f5bb00044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:06.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bcfde8700 1 --2- 172.21.15.88:0/3429815427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0003d40 0x7f5bb00044d0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7f5bc4002f30 tx=0x7f5bc400ff80).stop 2020-02-11T16:12:06.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.079+0000 7f5bce385700 1 -- 172.21.15.88:0/3429815427 reap_dead start 2020-02-11T16:12:06.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.080+0000 7f5bcfde8700 1 -- 172.21.15.88:0/3429815427 shutdown_connections 2020-02-11T16:12:06.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.080+0000 7f5bcfde8700 1 -- 172.21.15.88:0/3429815427 >> 172.21.15.88:0/3429815427 conn(0x7f5bc809d110 msgr2=0x7f5bc809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:06.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.080+0000 7f5bcfde8700 1 -- 172.21.15.88:0/3429815427 shutdown_connections 2020-02-11T16:12:06.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.080+0000 7f5bcfde8700 1 -- 172.21.15.88:0/3429815427 wait complete. 2020-02-11T16:12:06.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.081+0000 7f5bcfde8700 1 Processor -- start 2020-02-11T16:12:06.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.081+0000 7f5bcfde8700 1 -- start start 2020-02-11T16:12:06.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.081+0000 7f5bcfde8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bc812f790 0x7f5bc8131920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:06.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.081+0000 7f5bcfde8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc81279f0 0x7f5bc814cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:06.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.081+0000 7f5bcfde8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc812a050 con 0x7f5bc8131d80 2020-02-11T16:12:06.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.081+0000 7f5bcfde8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc812a2f0 con 0x7f5bc812f790 2020-02-11T16:12:06.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.081+0000 7f5bcfde8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc812c030 con 0x7f5bc81279f0 2020-02-11T16:12:06.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bc812f790 0x7f5bc8131920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:06.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bce385700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc81279f0 0x7f5bc814cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:06.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bc812f790 0x7f5bc8131920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:40710/0 (socket says 172.21.15.88:40710) 2020-02-11T16:12:06.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 -- 172.21.15.88:0/2744758638 learned_addr learned my addr 172.21.15.88:0/2744758638 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:06.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bce385700 1 -- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc81279f0 msgr2=0x7f5bc814cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:12:06.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bce385700 1 -- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc81279f0 msgr2=0x7f5bc814cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:12:06.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bce385700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc81279f0 0x7f5bc814cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:06.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bce385700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc81279f0 0x7f5bc814cc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:06.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 -- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc81279f0 msgr2=0x7f5bc814cc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:12:06.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc81279f0 0x7f5bc814cc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:06.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 -- 172.21.15.88:0/2744758638 >> v1:172.21.15.52:6789/0 conn(0x7f5bc8131d80 legacy=0x7f5bc81272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:06.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 -- 172.21.15.88:0/2744758638 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc812de90 con 0x7f5bc812f790 2020-02-11T16:12:06.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> v2:172.21.15.52:3300/0 conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> v2:172.21.15.52:3300/0 conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:06.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bb6ffd700 1 -- 172.21.15.88:0/2744758638 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb800c840 con 0x7f5bc812f790 2020-02-11T16:12:06.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bb6ffd700 1 -- 172.21.15.88:0/2744758638 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb800c9a0 con 0x7f5bc812f790 2020-02-11T16:12:06.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcfde8700 1 -- 172.21.15.88:0/2744758638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc81321e0 con 0x7f5bc812f790 2020-02-11T16:12:06.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.082+0000 7f5bb6ffd700 1 -- 172.21.15.88:0/2744758638 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb800cdc0 con 0x7f5bc812f790 2020-02-11T16:12:06.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.083+0000 7f5bcfde8700 1 -- 172.21.15.88:0/2744758638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc8130e50 con 0x7f5bc812f790 2020-02-11T16:12:06.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.083+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.084+0000 7f5bb6ffd700 1 -- 172.21.15.88:0/2744758638 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5bb80064e0 con 0x7f5bc812f790 2020-02-11T16:12:06.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.084+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.084+0000 7f5bb6ffd700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ba8039c40 0x7f5ba803c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:06.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.084+0000 7f5bb6ffd700 1 -- 172.21.15.88:0/2744758638 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5bb80498b0 con 0x7f5bc812f790 2020-02-11T16:12:06.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.084+0000 7f5bcfde8700 1 -- 172.21.15.88:0/2744758638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc80565b0 con 0x7f5bc812f790 2020-02-11T16:12:06.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.084+0000 7f5bcd383700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ba8039c40 0x7f5ba803c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:06.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.084+0000 7f5bcd383700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ba8039c40 0x7f5ba803c100 crc :-1 s=READY pgs=225 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:06.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.088+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.088+0000 7f5bb6ffd700 1 -- 172.21.15.88:0/2744758638 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f5bb802eef0 con 0x7f5bc812f790 2020-02-11T16:12:06.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.268+0000 7f5bcfde8700 1 -- 172.21.15.88:0/2744758638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5bc812cce0 con 0x7f5bc812f790 2020-02-11T16:12:06.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.269+0000 7f5bcdb84700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:06.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.269+0000 7f5bb6ffd700 1 -- 172.21.15.88:0/2744758638 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f5bb80319e0 con 0x7f5bc812f790 2020-02-11T16:12:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":60,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:12:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 -- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ba8039c40 msgr2=0x7f5ba803c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ba8039c40 0x7f5ba803c100 crc :-1 s=READY pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 -- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 msgr2=0x7f5bc8131920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 0x7f5bc8131920 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7f5bb80010d0 tx=0x7f5bb800c4e0).stop 2020-02-11T16:12:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 -- 172.21.15.88:0/2744758638 shutdown_connections 2020-02-11T16:12:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bc81279f0 0x7f5bc814cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ba8039c40 0x7f5ba803c100 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 --2- 172.21.15.88:0/2744758638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc812f790 0x7f5bc8131920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 -- 172.21.15.88:0/2744758638 >> 172.21.15.88:0/2744758638 conn(0x7f5bc809d110 msgr2=0x7f5bc8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 -- 172.21.15.88:0/2744758638 shutdown_connections 2020-02-11T16:12:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:06.270+0000 7f5bcfde8700 1 -- 172.21.15.88:0/2744758638 wait complete. 2020-02-11T16:12:06.289 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":60,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:12:09.290 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:12:09.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.415+0000 7f87dff21700 1 Processor -- start 2020-02-11T16:12:09.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.415+0000 7f87dff21700 1 -- start start 2020-02-11T16:12:09.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dff21700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87d80a5de0 0x7f87d80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:09.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dff21700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d80a31b0 con 0x7f87d80a18a0 2020-02-11T16:12:09.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dff21700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d80a3570 con 0x7f87d8134a50 2020-02-11T16:12:09.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dff21700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d80a3810 con 0x7f87d80a5de0 2020-02-11T16:12:09.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87de4be700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f87d8134a50 0x7f87d8134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42360/0 (socket says 172.21.15.88:42360) 2020-02-11T16:12:09.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87de4be700 1 -- 172.21.15.88:0/1302079733 learned_addr learned my addr 172.21.15.88:0/1302079733 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:09.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dd4bc700 1 --2- 172.21.15.88:0/1302079733 >> v2:172.21.15.52:3300/0 conn(0x7f87d80a5de0 0x7f87d80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dccbb700 1 -- 172.21.15.88:0/1302079733 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209878327 0 0) 0x7f87d80a3570 con 0x7f87d8134a50 2020-02-11T16:12:09.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dccbb700 1 -- 172.21.15.88:0/1302079733 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c0003230 con 0x7f87d8134a50 2020-02-11T16:12:09.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dccbb700 1 -- 172.21.15.88:0/1302079733 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1903963282 0 0) 0x7f87c0003230 con 0x7f87d8134a50 2020-02-11T16:12:09.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dd4bc700 1 -- 172.21.15.88:0/1302079733 >> v1:172.21.15.88:6789/0 conn(0x7f87d8134a50 legacy=0x7f87d8134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dd4bc700 1 -- 172.21.15.88:0/1302079733 >> v1:172.21.15.52:6789/0 conn(0x7f87d80a18a0 legacy=0x7f87d80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dd4bc700 1 -- 172.21.15.88:0/1302079733 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d80a3ab0 con 0x7f87d80a5de0 2020-02-11T16:12:09.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dd4bc700 1 --2- 172.21.15.88:0/1302079733 >> v2:172.21.15.52:3300/0 conn(0x7f87d80a5de0 0x7f87d80a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f87d4001870 tx=0x7f87cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.416+0000 7f87dd4bc700 1 --2- 172.21.15.88:0/1302079733 >> v2:172.21.15.52:3300/0 conn(0x7f87d80a5de0 0x7f87d80a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f87d4001870 tx=0x7f87cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dd4bc700 1 --2- 172.21.15.88:0/1302079733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d80a5de0 0x7f87d80a6260 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f87d4001870 tx=0x7f87cc0088e0).ready entity=mon.0 client_cookie=dcbf231b9e3aed04 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dd4bc700 1 --2- 172.21.15.88:0/1302079733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d80a5de0 0x7f87d80a6260 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f87d4001870 tx=0x7f87cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dccbb700 1 -- 172.21.15.88:0/1302079733 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d40016d0 con 0x7f87d80a5de0 2020-02-11T16:12:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dd4bc700 1 --2- 172.21.15.88:0/1302079733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d80a5de0 0x7f87d80a6260 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f87d4001870 tx=0x7f87cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dd4bc700 1 --2- 172.21.15.88:0/1302079733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d80a5de0 0x7f87d80a6260 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f87d4001870 tx=0x7f87cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dccbb700 1 -- 172.21.15.88:0/1302079733 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc0112c0 con 0x7f87d80a5de0 2020-02-11T16:12:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dccbb700 1 -- 172.21.15.88:0/1302079733 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87cc011620 con 0x7f87d80a5de0 2020-02-11T16:12:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dff21700 1 -- 172.21.15.88:0/1302079733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d80a5de0 msgr2=0x7f87d80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dff21700 1 --2- 172.21.15.88:0/1302079733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d80a5de0 0x7f87d80a6260 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f87d4001870 tx=0x7f87cc0088e0).stop 2020-02-11T16:12:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dff21700 1 -- 172.21.15.88:0/1302079733 shutdown_connections 2020-02-11T16:12:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dff21700 1 --2- 172.21.15.88:0/1302079733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d80a5de0 0x7f87d80a6260 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dff21700 1 -- 172.21.15.88:0/1302079733 >> 172.21.15.88:0/1302079733 conn(0x7f87d809d110 msgr2=0x7f87d809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:09.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dff21700 1 -- 172.21.15.88:0/1302079733 shutdown_connections 2020-02-11T16:12:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.417+0000 7f87dff21700 1 -- 172.21.15.88:0/1302079733 wait complete. 2020-02-11T16:12:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.418+0000 7f87dff21700 1 Processor -- start 2020-02-11T16:12:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.418+0000 7f87dff21700 1 -- start start 2020-02-11T16:12:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87dff21700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d80a5de0 0x7f87d8129340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87dff21700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87d8134a50 0x7f87d81297a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87dff21700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d8130c20 con 0x7f87d80a18a0 2020-02-11T16:12:09.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87dff21700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d8130ec0 con 0x7f87d8134a50 2020-02-11T16:12:09.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87dff21700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8131160 con 0x7f87d80a5de0 2020-02-11T16:12:09.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87ddcbd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f87d80a18a0 0x7f87d8138280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42364/0 (socket says 172.21.15.88:42364) 2020-02-11T16:12:09.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87ddcbd700 1 -- 172.21.15.88:0/1429960396 learned_addr learned my addr 172.21.15.88:0/1429960396 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:09.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87dd4bc700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d80a5de0 0x7f87d8129340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> v2:172.21.15.52:3300/0 conn(0x7f87d8134a50 0x7f87d81297a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342150536 0 0) 0x7f87d8130c20 con 0x7f87d80a18a0 2020-02-11T16:12:09.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87b8002fe0 con 0x7f87d80a18a0 2020-02-11T16:12:09.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87dd4bc700 1 -- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d80a5de0 msgr2=0x7f87d8129340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:12:09.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87dd4bc700 1 -- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d80a5de0 msgr2=0x7f87d8129340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:12:09.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87dd4bc700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d80a5de0 0x7f87d8129340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:09.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87dd4bc700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d80a5de0 0x7f87d8129340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:09.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 939671674 0 0) 0x7f87b8002fe0 con 0x7f87d80a18a0 2020-02-11T16:12:09.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f87d8130c20 con 0x7f87d80a18a0 2020-02-11T16:12:09.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f87d0001c50 con 0x7f87d80a18a0 2020-02-11T16:12:09.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87de4be700 1 -- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d80a5de0 msgr2=0x7f87d8129340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:12:09.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d80a5de0 0x7f87d8129340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87de4be700 1 -- 172.21.15.88:0/1429960396 >> v1:172.21.15.88:6789/0 conn(0x7f87d80a18a0 legacy=0x7f87d8138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87de4be700 1 -- 172.21.15.88:0/1429960396 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d8129c00 con 0x7f87d8134a50 2020-02-11T16:12:09.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.419+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> v2:172.21.15.52:3300/0 conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> v2:172.21.15.52:3300/0 conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d400c950 con 0x7f87d8134a50 2020-02-11T16:12:09.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87dff21700 1 -- 172.21.15.88:0/1429960396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d80a3cb0 con 0x7f87d8134a50 2020-02-11T16:12:09.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400cab0 con 0x7f87d8134a50 2020-02-11T16:12:09.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d400ce10 con 0x7f87d8134a50 2020-02-11T16:12:09.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87dff21700 1 -- 172.21.15.88:0/1429960396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d805b1c0 con 0x7f87d8134a50 2020-02-11T16:12:09.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.420+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.421+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f87d40044f0 con 0x7f87d8134a50 2020-02-11T16:12:09.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.421+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.421+0000 7f87caffd700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87b803a1b0 0x7f87b803c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.421+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f87d40494e0 con 0x7f87d8134a50 2020-02-11T16:12:09.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.421+0000 7f87dff21700 1 -- 172.21.15.88:0/1429960396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d8130a70 con 0x7f87d8134a50 2020-02-11T16:12:09.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.421+0000 7f87ddcbd700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87b803a1b0 0x7f87b803c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.421+0000 7f87ddcbd700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87b803a1b0 0x7f87b803c670 crc :-1 s=READY pgs=226 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.425+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.425+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f87d402ea90 con 0x7f87d8134a50 2020-02-11T16:12:09.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.606+0000 7f87dff21700 1 -- 172.21.15.88:0/1429960396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f87d80565b0 con 0x7f87d8134a50 2020-02-11T16:12:09.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.606+0000 7f87de4be700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.606+0000 7f87caffd700 1 -- 172.21.15.88:0/1429960396 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7f87d4033090 con 0x7f87d8134a50 2020-02-11T16:12:09.609 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:12:09.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 -- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87b803a1b0 msgr2=0x7f87b803c670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87b803a1b0 0x7f87b803c670 crc :-1 s=READY pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 -- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 msgr2=0x7f87d81297a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 0x7f87d81297a0 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f87d4001930 tx=0x7f87d400c510).stop 2020-02-11T16:12:09.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 -- 172.21.15.88:0/1429960396 shutdown_connections 2020-02-11T16:12:09.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f87b803a1b0 0x7f87b803c670 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87d8134a50 0x7f87d81297a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 --2- 172.21.15.88:0/1429960396 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f87d80a5de0 0x7f87d8129340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 -- 172.21.15.88:0/1429960396 >> 172.21.15.88:0/1429960396 conn(0x7f87d809d110 msgr2=0x7f87d80a98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:09.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 -- 172.21.15.88:0/1429960396 shutdown_connections 2020-02-11T16:12:09.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.608+0000 7f87dff21700 1 -- 172.21.15.88:0/1429960396 wait complete. 2020-02-11T16:12:09.621 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":62,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:12:09.621 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:12:09.621 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:12:09.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.725+0000 7f3aa7fcf700 1 Processor -- start 2020-02-11T16:12:09.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.725+0000 7f3aa7fcf700 1 -- start start 2020-02-11T16:12:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa7fcf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3aa00a4ec0 0x7f3aa012f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa7fcf700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3aa012fcf0 0x7f3aa0140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa7fcf700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa00a5560 con 0x7f3aa00a7120 2020-02-11T16:12:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa7fcf700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa00a5350 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa7fcf700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa009e060 con 0x7f3aa012fcf0 2020-02-11T16:12:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa556a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3aa00a4ec0 0x7f3aa012f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa556a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3aa00a4ec0 0x7f3aa012f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54748/0 (socket says 172.21.15.88:54748) 2020-02-11T16:12:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa556a700 1 -- 172.21.15.88:0/3215082193 learned_addr learned my addr 172.21.15.88:0/3215082193 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa656c700 1 --2- 172.21.15.88:0/3215082193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3aa012fcf0 0x7f3aa0140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa556a700 1 -- 172.21.15.88:0/3215082193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3aa012fcf0 msgr2=0x7f3aa0140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa556a700 1 --2- 172.21.15.88:0/3215082193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3aa012fcf0 0x7f3aa0140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa556a700 1 -- 172.21.15.88:0/3215082193 >> v1:172.21.15.52:6789/0 conn(0x7f3aa00a7120 legacy=0x7f3aa00a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa556a700 1 -- 172.21.15.88:0/3215082193 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa009e300 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa556a700 1 --2- 172.21.15.88:0/3215082193 >> v2:172.21.15.88:3300/0 conn(0x7f3aa00a4ec0 0x7f3aa012f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a9c002f30 tx=0x7f3a9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa556a700 1 --2- 172.21.15.88:0/3215082193 >> v2:172.21.15.88:3300/0 conn(0x7f3aa00a4ec0 0x7f3aa012f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a9c002f30 tx=0x7f3a9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.726+0000 7f3aa556a700 1 --2- 172.21.15.88:0/3215082193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa012f890 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f3a9c002f30 tx=0x7f3a9c0088e0).ready entity=mon.1 client_cookie=20353acf8c7bd2d1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa556a700 1 --2- 172.21.15.88:0/3215082193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa012f890 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f3a9c002f30 tx=0x7f3a9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa556a700 1 --2- 172.21.15.88:0/3215082193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa012f890 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f3a9c002f30 tx=0x7f3a9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa556a700 1 --2- 172.21.15.88:0/3215082193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa012f890 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f3a9c002f30 tx=0x7f3a9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa4d69700 1 -- 172.21.15.88:0/3215082193 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a9c011760 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa4d69700 1 -- 172.21.15.88:0/3215082193 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c0118c0 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa4d69700 1 -- 172.21.15.88:0/3215082193 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a9c011ca0 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/3215082193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 msgr2=0x7f3aa012f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa7fcf700 1 --2- 172.21.15.88:0/3215082193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa012f890 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f3a9c002f30 tx=0x7f3a9c0088e0).stop 2020-02-11T16:12:09.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/3215082193 shutdown_connections 2020-02-11T16:12:09.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa7fcf700 1 --2- 172.21.15.88:0/3215082193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3aa012fcf0 0x7f3aa0140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:09.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa7fcf700 1 --2- 172.21.15.88:0/3215082193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa012f890 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/3215082193 >> 172.21.15.88:0/3215082193 conn(0x7f3aa009d110 msgr2=0x7f3aa009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/3215082193 shutdown_connections 2020-02-11T16:12:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.727+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/3215082193 wait complete. 2020-02-11T16:12:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.728+0000 7f3aa7fcf700 1 Processor -- start 2020-02-11T16:12:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.728+0000 7f3aa7fcf700 1 -- start start 2020-02-11T16:12:09.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa7fcf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3aa00a4ec0 0x7f3aa00aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa7fcf700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3aa00a7120 0x7f3aa00a8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa7fcf700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa00a9850 con 0x7f3aa012fcf0 2020-02-11T16:12:09.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa7fcf700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa00aa460 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa7fcf700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0139420 con 0x7f3aa00a7120 2020-02-11T16:12:09.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3aa00a4ec0 0x7f3aa00aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3aa00a4ec0 0x7f3aa00aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54752/0 (socket says 172.21.15.88:54752) 2020-02-11T16:12:09.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 -- 172.21.15.88:0/77399075 learned_addr learned my addr 172.21.15.88:0/77399075 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:09.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa556a700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3aa00a7120 0x7f3aa00a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 -- 172.21.15.88:0/77399075 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3aa00a7120 msgr2=0x7f3aa00a8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3aa00a7120 0x7f3aa00a8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 -- 172.21.15.88:0/77399075 >> v1:172.21.15.52:6789/0 conn(0x7f3aa012fcf0 legacy=0x7f3aa012a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 -- 172.21.15.88:0/77399075 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0138d30 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 --2- 172.21.15.88:0/77399075 >> v2:172.21.15.88:3300/0 conn(0x7f3aa00a4ec0 0x7f3aa00aa000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3aa005ee60 tx=0x7f3a90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 --2- 172.21.15.88:0/77399075 >> v2:172.21.15.88:3300/0 conn(0x7f3aa00a4ec0 0x7f3aa00aa000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3aa005ee60 tx=0x7f3a90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa00aa000 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f3aa005ee60 tx=0x7f3a90010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa00aa000 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f3aa005ee60 tx=0x7f3a90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a9000cc20 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/77399075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa0138f60 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa00aa000 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f3aa005ee60 tx=0x7f3a90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3aa5d6b700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa00aa000 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f3aa005ee60 tx=0x7f3a90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.729+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9000cd80 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.730+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/77399075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa00a86d0 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.730+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a9000e380 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.730+0000 7f3aa5d6b700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa00aa000 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f3aa005ee60 tx=0x7f3a90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.730+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3a9000e570 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.730+0000 7f3aa5d6b700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa00aa000 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f3aa005ee60 tx=0x7f3a90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.730+0000 7f3a8effd700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a80039c20 0x7f3a8003c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.730+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3a90049760 con 0x7f3aa00a4ec0 2020-02-11T16:12:09.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.730+0000 7f3aa7fcf700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 0x7f3aa012aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.730+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/77399075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa005e2f0 con 0x7f3aa00aa670 2020-02-11T16:12:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 0x7f3aa012aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3aa556a700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a80039c20 0x7f3a8003c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3aa556a700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a80039c20 0x7f3a8003c0e0 crc :-1 s=READY pgs=227 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3aa656c700 1 -- 172.21.15.88:0/77399075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3aa00a7fb0 con 0x7f3aa00aa670 2020-02-11T16:12:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 0x7f3aa012aaf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 0x7f3aa012aaf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 0x7f3aa012aaf0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 0x7f3aa012aaf0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a98007540 con 0x7f3aa00aa670 2020-02-11T16:12:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 0x7f3aa012aaf0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f3a9800aef0 con 0x7f3aa00aa670 2020-02-11T16:12:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 msgr2=0x7f3aa012aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3a8effd700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 0x7f3aa012aaf0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).stop 2020-02-11T16:12:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 msgr2=0x7f3aa012aaf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.731+0000 7f3a8effd700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00aa670 0x7f3aa012aaf0 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).stop 2020-02-11T16:12:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.739+0000 7f3aa7fcf700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 0x7f3aa005a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.739+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/77399075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0139120 con 0x7f3aa012d440 2020-02-11T16:12:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.739+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 0x7f3aa005a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa656c700 1 -- 172.21.15.88:0/77399075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3aa00565b0 con 0x7f3aa012d440 2020-02-11T16:12:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 0x7f3aa005a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 0x7f3aa005a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 0x7f3aa005a5d0 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 0x7f3aa005a5d0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a98010440 con 0x7f3aa012d440 2020-02-11T16:12:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa656c700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 0x7f3aa005a5d0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7f3a98012690 con 0x7f3aa012d440 2020-02-11T16:12:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 msgr2=0x7f3aa005a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3a8effd700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 0x7f3aa005a5d0 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).stop 2020-02-11T16:12:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3a8effd700 1 -- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 msgr2=0x7f3aa005a5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3a8effd700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa012d440 0x7f3aa005a5d0 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rx=0x7f3aa00a8fc0 tx=0x7f3a98010e00).stop 2020-02-11T16:12:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/77399075 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a80039c20 msgr2=0x7f3a8003c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa7fcf700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a80039c20 0x7f3a8003c0e0 crc :-1 s=READY pgs=227 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 msgr2=0x7f3aa00aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa7fcf700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa00aa000 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f3aa005ee60 tx=0x7f3a90010a10).stop 2020-02-11T16:12:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa656c700 1 -- 172.21.15.88:0/77399075 reap_dead start 2020-02-11T16:12:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/77399075 shutdown_connections 2020-02-11T16:12:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa7fcf700 1 --2- 172.21.15.88:0/77399075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa00a4ec0 0x7f3aa00aa000 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.740+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/77399075 >> 172.21.15.88:0/77399075 conn(0x7f3aa009d110 msgr2=0x7f3aa012c740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.741+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/77399075 shutdown_connections 2020-02-11T16:12:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.741+0000 7f3aa7fcf700 1 -- 172.21.15.88:0/77399075 wait complete. 2020-02-11T16:12:09.771 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:12:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:12:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 62, 2020-02-11T16:12:09.771 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:12:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:12:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:12:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:12:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:12:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:09.772 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:12:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:12:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:09.773 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.774 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:12:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:12:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.776 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:12:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:12:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:12:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:12:09.777 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:12:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:12:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:09.778 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:12:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:12:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:12:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:09.779 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:12:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:12:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:12:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.782 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:12:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:12:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:12:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:09.784 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:09.785 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:12:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:12:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.786 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:12:09.787 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:12:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.788 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:12:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:12:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:12:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:12:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.790 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:12:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:12:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:09.791 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:12:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:12:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:09.792 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:12:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:09.793 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:12:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:12:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:12:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:12:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:12:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:12:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.797 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.798 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:12:09.798 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:12:09.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.902+0000 7fe8a93c7700 1 Processor -- start 2020-02-11T16:12:09.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.902+0000 7fe8a93c7700 1 -- start start 2020-02-11T16:12:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.903+0000 7fe8a93c7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8a40a5de0 0x7fe8a40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.903+0000 7fe8a93c7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a40a31b0 con 0x7fe8a40a18a0 2020-02-11T16:12:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.903+0000 7fe8a93c7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a40a3570 con 0x7fe8a4134a50 2020-02-11T16:12:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.903+0000 7fe8a93c7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a40a3810 con 0x7fe8a40a5de0 2020-02-11T16:12:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.903+0000 7fe8a37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe8a4134a50 0x7fe8a4134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42392/0 (socket says 172.21.15.88:42392) 2020-02-11T16:12:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.903+0000 7fe8a37fe700 1 -- 172.21.15.88:0/3200954577 learned_addr learned my addr 172.21.15.88:0/3200954577 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.903+0000 7fe8a27fc700 1 --2- 172.21.15.88:0/3200954577 >> v2:172.21.15.52:3300/0 conn(0x7fe8a40a5de0 0x7fe8a40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.903+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443621282 0 0) 0x7fe8a40a3570 con 0x7fe8a4134a50 2020-02-11T16:12:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.903+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe888003230 con 0x7fe8a4134a50 2020-02-11T16:12:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.903+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1406122901 0 0) 0x7fe888003230 con 0x7fe8a4134a50 2020-02-11T16:12:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 >> v2:172.21.15.52:3300/0 conn(0x7fe8a40a5de0 msgr2=0x7fe8a40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 --2- 172.21.15.88:0/3200954577 >> v2:172.21.15.52:3300/0 conn(0x7fe8a40a5de0 0x7fe8a40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 >> v1:172.21.15.52:6789/0 conn(0x7fe8a40a18a0 legacy=0x7fe8a40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40a3ab0 con 0x7fe8a4134a50 2020-02-11T16:12:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe89c001a50 con 0x7fe8a4134a50 2020-02-11T16:12:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 >> v1:172.21.15.88:6789/0 conn(0x7fe8a4134a50 legacy=0x7fe8a4134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe888003770 0x7fe888003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:09.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8880044d0 0x7fe888004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 0x7fe88800d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40a3810 con 0x7fe8880044d0 2020-02-11T16:12:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe888005260 con 0x7fe888004db0 2020-02-11T16:12:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe888009710 con 0x7fe888003770 2020-02-11T16:12:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 0x7fe88800d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe888003770 0x7fe888003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a27fc700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8880044d0 0x7fe888004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 -- 172.21.15.88:0/3200954577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe888003770 msgr2=0x7fe888003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe888003770 0x7fe888003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 -- 172.21.15.88:0/3200954577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8880044d0 msgr2=0x7fe888004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8880044d0 0x7fe888004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 -- 172.21.15.88:0/3200954577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe888003230 con 0x7fe888004db0 2020-02-11T16:12:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe888003770 0x7fe888003b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:12:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 0x7fe88800d930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe89c001760 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 -- 172.21.15.88:0/3200954577 reap_dead start 2020-02-11T16:12:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 0x7fe88800d930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe89c001760 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 0x7fe88800d930 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7fe89c001760 tx=0x7fe89c001f70).ready entity=mon.1 client_cookie=a7d043c294e2d70c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 0x7fe88800d930 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fe89c001760 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 0x7fe88800d930 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fe89c001760 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c00ce70 con 0x7fe888004db0 2020-02-11T16:12:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 0x7fe88800d930 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fe89c001760 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c00e540 con 0x7fe888004db0 2020-02-11T16:12:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a1ffb700 1 -- 172.21.15.88:0/3200954577 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c00e8a0 con 0x7fe888004db0 2020-02-11T16:12:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a93c7700 1 -- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 msgr2=0x7fe88800d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.904+0000 7fe8a93c7700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 0x7fe88800d930 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7fe89c001760 tx=0x7fe89c001f70).stop 2020-02-11T16:12:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.905+0000 7fe8a93c7700 1 -- 172.21.15.88:0/3200954577 shutdown_connections 2020-02-11T16:12:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.905+0000 7fe8a93c7700 1 --2- 172.21.15.88:0/3200954577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe888004db0 0x7fe88800d930 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.905+0000 7fe8a93c7700 1 -- 172.21.15.88:0/3200954577 >> 172.21.15.88:0/3200954577 conn(0x7fe8a409d110 msgr2=0x7fe8a409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.905+0000 7fe8a93c7700 1 -- 172.21.15.88:0/3200954577 shutdown_connections 2020-02-11T16:12:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.905+0000 7fe8a93c7700 1 -- 172.21.15.88:0/3200954577 wait complete. 2020-02-11T16:12:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.906+0000 7fe8a93c7700 1 Processor -- start 2020-02-11T16:12:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.906+0000 7fe8a93c7700 1 -- start start 2020-02-11T16:12:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.906+0000 7fe8a93c7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 0x7fe8a4136090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.906+0000 7fe8a93c7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a41322b0 con 0x7fe8a409f3b0 2020-02-11T16:12:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.906+0000 7fe8a93c7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a4144a20 con 0x7fe888004db0 2020-02-11T16:12:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.906+0000 7fe8a93c7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a41364f0 con 0x7fe8a4131150 2020-02-11T16:12:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.906+0000 7fe8a2ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe888004db0 0x7fe8a4130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42400/0 (socket says 172.21.15.88:42400) 2020-02-11T16:12:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.906+0000 7fe8a2ffd700 1 -- 172.21.15.88:0/2044660770 learned_addr learned my addr 172.21.15.88:0/2044660770 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.906+0000 7fe8a27fc700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 0x7fe8a4136090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a27fc700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 msgr2=0x7fe8a4136090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:12:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a27fc700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 msgr2=0x7fe8a4136090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:12:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872575563 0 0) 0x7fe8a4144a20 con 0x7fe888004db0 2020-02-11T16:12:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a27fc700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 0x7fe8a4136090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a27fc700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 0x7fe8a4136090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe880002fe0 con 0x7fe888004db0 2020-02-11T16:12:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565434145 0 0) 0x7fe8a41322b0 con 0x7fe8a409f3b0 2020-02-11T16:12:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a4144a20 con 0x7fe8a409f3b0 2020-02-11T16:12:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3270458190 0 0) 0x7fe880002fe0 con 0x7fe888004db0 2020-02-11T16:12:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe8a41322b0 con 0x7fe888004db0 2020-02-11T16:12:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe898001bb0 con 0x7fe888004db0 2020-02-11T16:12:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 msgr2=0x7fe8a4136090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:12:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 0x7fe8a4136090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 >> v1:172.21.15.88:6789/0 conn(0x7fe888004db0 legacy=0x7fe8a4130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 >> v1:172.21.15.52:6789/0 conn(0x7fe8a409f3b0 legacy=0x7fe8a409f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe880004b20 0x7fe880004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 0x7fe880003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a41364f0 con 0x7fe880004b20 2020-02-11T16:12:09.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800047f0 con 0x7fe880003f10 2020-02-11T16:12:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88000b750 con 0x7fe8a4131150 2020-02-11T16:12:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe880004b20 0x7fe880004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a27fc700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 0x7fe880003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a27fc700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 msgr2=0x7fe880003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:12:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a27fc700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 msgr2=0x7fe880003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:12:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a27fc700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 0x7fe880003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:09.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a27fc700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 0x7fe880003ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:09.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a37fe700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 msgr2=0x7fe880003ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:12:09.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8a4131150 0x7fe880003ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a37fe700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe880004b20 msgr2=0x7fe880004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe880004b20 0x7fe880004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a37fe700 1 -- 172.21.15.88:0/2044660770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a4144cc0 con 0x7fe880003f10 2020-02-11T16:12:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a93c7700 1 -- 172.21.15.88:0/2044660770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a4144f60 con 0x7fe880003f10 2020-02-11T16:12:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe89c00bde0 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a93c7700 1 -- 172.21.15.88:0/2044660770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a409ff50 con 0x7fe880003f10 2020-02-11T16:12:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe89c00bde0 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fe89c00bde0 tx=0x7fe89c001f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.907+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fe89c00bde0 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fe89c00bde0 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c00fe70 con 0x7fe880003f10 2020-02-11T16:12:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fe89c00bde0 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c004870 con 0x7fe880003f10 2020-02-11T16:12:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c004c10 con 0x7fe880003f10 2020-02-11T16:12:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fe89c00bde0 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe8a93c7700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 0x7fe8840058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe8a93c7700 1 -- 172.21.15.88:0/2044660770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe884005ea0 con 0x7fe884003420 2020-02-11T16:12:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe89c004d70 con 0x7fe880003f10 2020-02-11T16:12:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe8a37fe700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fe89c00bde0 tx=0x7fe89c001f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 0x7fe8840058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe893fff700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8800420a0 0x7fe880044560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.908+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe89c049ec0 con 0x7fe880003f10 2020-02-11T16:12:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe8a27fc700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8800420a0 0x7fe880044560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe8a2ffd700 1 -- 172.21.15.88:0/2044660770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe884006060 con 0x7fe884003420 2020-02-11T16:12:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 0x7fe8840058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 0x7fe8840058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 0x7fe8840058e0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe8a27fc700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8800420a0 0x7fe880044560 crc :-1 s=READY pgs=228 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 0x7fe8840058e0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe898001ea0 con 0x7fe884003420 2020-02-11T16:12:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 0x7fe8840058e0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fe89800e160 con 0x7fe884003420 2020-02-11T16:12:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 msgr2=0x7fe8840058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe893fff700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 0x7fe8840058e0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).stop 2020-02-11T16:12:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 msgr2=0x7fe8840058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe8a37fe700 1 -- 172.21.15.88:0/2044660770 reap_dead start 2020-02-11T16:12:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.909+0000 7fe893fff700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884003420 0x7fe8840058e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.917+0000 7fe8a93c7700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 0x7fe8840068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:09.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.917+0000 7fe8a93c7700 1 -- 172.21.15.88:0/2044660770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe884006dd0 con 0x7fe884006440 2020-02-11T16:12:09.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.918+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 0x7fe8840068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.918+0000 7fe8a2ffd700 1 -- 172.21.15.88:0/2044660770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe884006f90 con 0x7fe884006440 2020-02-11T16:12:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.918+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 0x7fe8840068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.918+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 0x7fe8840068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.918+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 0x7fe8840068f0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.918+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 0x7fe8840068f0 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.918+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89800b230 con 0x7fe884006440 2020-02-11T16:12:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a2ffd700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 0x7fe8840068f0 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4191 (secure 0 0 0) 0x7fe89800b390 con 0x7fe884006440 2020-02-11T16:12:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 msgr2=0x7fe8840068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe893fff700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 0x7fe8840068f0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).stop 2020-02-11T16:12:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe893fff700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 msgr2=0x7fe8840068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe893fff700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 0x7fe8840068f0 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0x7fe898001420 tx=0x7fe898011590).stop 2020-02-11T16:12:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8800420a0 msgr2=0x7fe880044560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8800420a0 0x7fe880044560 crc :-1 s=READY pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 -- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 msgr2=0x7fe880004390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fe89c00bde0 tx=0x7fe89c001f70).stop 2020-02-11T16:12:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 -- 172.21.15.88:0/2044660770 shutdown_connections 2020-02-11T16:12:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8800420a0 0x7fe880044560 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe880003f10 0x7fe880004390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 --2- 172.21.15.88:0/2044660770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe884006440 0x7fe8840068f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 -- 172.21.15.88:0/2044660770 >> 172.21.15.88:0/2044660770 conn(0x7fe8a409d110 msgr2=0x7fe8a4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 -- 172.21.15.88:0/2044660770 shutdown_connections 2020-02-11T16:12:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:09.919+0000 7fe8a93c7700 1 -- 172.21.15.88:0/2044660770 wait complete. 2020-02-11T16:12:09.954 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:12:09.955 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:09.955 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:09.956 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:12:09.956 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 62, 2020-02-11T16:12:09.956 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:12:09.956 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:12:09.956 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:12:09.956 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:12:09.956 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.957 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:12:09.957 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:09.957 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:12:09.957 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:12:09.957 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:09.957 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:09.957 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:09.957 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:09.958 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:09.958 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:09.958 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.958 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:12:09.958 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:12:09.958 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:09.958 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:09.959 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:09.959 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:09.959 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:09.959 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:09.959 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.959 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:12:09.960 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:12:09.960 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:12:09.960 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:12:09.960 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:12:09.960 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:12:09.960 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:09.960 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:09.961 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:12:09.961 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:12:09.961 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:09.961 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:12:09.961 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:09.962 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:09.962 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:09.962 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:09.962 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:09.962 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:09.962 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.963 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:12:09.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.963 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:12:09.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.964 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:09.964 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:09.964 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:09.964 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:09.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.965 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:09.965 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:12:09.966 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.966 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:09.966 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:12:09.966 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.967 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.967 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.967 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:12:09.967 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:12:09.967 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:09.967 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:09.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.968 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:09.968 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:09.968 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:09.968 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:09.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.969 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:09.969 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:12:09.969 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.970 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:09.970 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:12:09.970 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.971 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.971 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.971 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:12:09.971 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:12:09.971 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:09.972 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:09.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.972 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:12:09.972 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:12:09.972 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:09.972 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:09.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.973 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:09.973 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:12:09.973 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.973 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:09.974 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:12:09.974 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:09.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.974 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.974 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:12:09.974 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:12:09.975 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:09.975 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:09.975 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.975 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:09.975 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:12:09.975 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:12:09.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.976 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:09.976 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:09.976 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:09.976 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.976 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.976 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:12:09.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.977 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:09.977 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:09.977 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:09.977 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.977 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.977 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:12:09.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.978 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:09.978 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:09.978 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:12:09.978 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.978 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:12:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:12:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:09.980 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:12:09.981 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:12:10.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.084+0000 7f4a95b54700 1 Processor -- start 2020-02-11T16:12:10.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.084+0000 7f4a95b54700 1 -- start start 2020-02-11T16:12:10.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a95b54700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a900a7120 0x7f4a900a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:10.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a95b54700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4a900a3e70 0x7f4a9012ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:10.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a95b54700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a900a5320 con 0x7f4a900a39e0 2020-02-11T16:12:10.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a95b54700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a90130400 con 0x7f4a900a7120 2020-02-11T16:12:10.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a95b54700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9009e7a0 con 0x7f4a900a3e70 2020-02-11T16:12:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4a900a3e70 0x7f4a9012ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4a900a3e70 0x7f4a9012ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54796/0 (socket says 172.21.15.88:54796) 2020-02-11T16:12:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 -- 172.21.15.88:0/1841285099 learned_addr learned my addr 172.21.15.88:0/1841285099 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1841285099 >> v2:172.21.15.52:3300/0 conn(0x7f4a900a7120 0x7f4a900a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 -- 172.21.15.88:0/1841285099 >> v2:172.21.15.52:3300/0 conn(0x7f4a900a7120 msgr2=0x7f4a900a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 --2- 172.21.15.88:0/1841285099 >> v2:172.21.15.52:3300/0 conn(0x7f4a900a7120 0x7f4a900a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 -- 172.21.15.88:0/1841285099 >> v1:172.21.15.52:6789/0 conn(0x7f4a900a39e0 legacy=0x7f4a9012f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 -- 172.21.15.88:0/1841285099 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a900a5560 con 0x7f4a900a3e70 2020-02-11T16:12:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 --2- 172.21.15.88:0/1841285099 >> v2:172.21.15.88:3300/0 conn(0x7f4a900a3e70 0x7f4a9012ffa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a9005ee60 tx=0x7f4a88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 --2- 172.21.15.88:0/1841285099 >> v2:172.21.15.88:3300/0 conn(0x7f4a900a3e70 0x7f4a9012ffa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a9005ee60 tx=0x7f4a88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 --2- 172.21.15.88:0/1841285099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a9012ffa0 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7f4a9005ee60 tx=0x7f4a88007a40).ready entity=mon.1 client_cookie=4039e58fb1361275 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 --2- 172.21.15.88:0/1841285099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a9012ffa0 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f4a9005ee60 tx=0x7f4a88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8e7fc700 1 -- 172.21.15.88:0/1841285099 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a880116e0 con 0x7f4a900a3e70 2020-02-11T16:12:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 --2- 172.21.15.88:0/1841285099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a9012ffa0 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f4a9005ee60 tx=0x7f4a88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8ffff700 1 --2- 172.21.15.88:0/1841285099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a9012ffa0 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f4a9005ee60 tx=0x7f4a88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8e7fc700 1 -- 172.21.15.88:0/1841285099 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a88011840 con 0x7f4a900a3e70 2020-02-11T16:12:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a8e7fc700 1 -- 172.21.15.88:0/1841285099 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a88011c20 con 0x7f4a900a3e70 2020-02-11T16:12:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a95b54700 1 -- 172.21.15.88:0/1841285099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 msgr2=0x7f4a9012ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.085+0000 7f4a95b54700 1 --2- 172.21.15.88:0/1841285099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a9012ffa0 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7f4a9005ee60 tx=0x7f4a88007a40).stop 2020-02-11T16:12:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.086+0000 7f4a95b54700 1 -- 172.21.15.88:0/1841285099 shutdown_connections 2020-02-11T16:12:10.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.086+0000 7f4a95b54700 1 --2- 172.21.15.88:0/1841285099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a9012ffa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:10.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.086+0000 7f4a95b54700 1 --2- 172.21.15.88:0/1841285099 >> v2:172.21.15.52:3300/0 conn(0x7f4a900a7120 0x7f4a900a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:10.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.086+0000 7f4a95b54700 1 -- 172.21.15.88:0/1841285099 >> 172.21.15.88:0/1841285099 conn(0x7f4a9009d110 msgr2=0x7f4a9009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:10.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.086+0000 7f4a95b54700 1 -- 172.21.15.88:0/1841285099 shutdown_connections 2020-02-11T16:12:10.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.086+0000 7f4a95b54700 1 -- 172.21.15.88:0/1841285099 wait complete. 2020-02-11T16:12:10.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.087+0000 7f4a95b54700 1 Processor -- start 2020-02-11T16:12:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.087+0000 7f4a95b54700 1 -- start start 2020-02-11T16:12:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a95b54700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a900a39e0 0x7f4a90135520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a95b54700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4a900a3e70 0x7f4a90139540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a95b54700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a90138460 con 0x7f4a900a7120 2020-02-11T16:12:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a95b54700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a90137830 con 0x7f4a900a3e70 2020-02-11T16:12:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a95b54700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a90138820 con 0x7f4a900a39e0 2020-02-11T16:12:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4a900a3e70 0x7f4a90139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:10.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4a900a7120 0x7f4a9012a210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42428/0 (socket says 172.21.15.88:42428) 2020-02-11T16:12:10.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4a900a3e70 0x7f4a90139540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54800/0 (socket says 172.21.15.88:54800) 2020-02-11T16:12:10.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8ffff700 1 -- 172.21.15.88:0/1335698108 learned_addr learned my addr 172.21.15.88:0/1335698108 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:10.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a900a39e0 0x7f4a90135520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:10.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a900a39e0 msgr2=0x7f4a90135520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:10.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a900a39e0 0x7f4a90135520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:10.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991170621 0 0) 0x7f4a90138460 con 0x7f4a900a7120 2020-02-11T16:12:10.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 -- 172.21.15.88:0/1335698108 >> v1:172.21.15.88:6789/0 conn(0x7f4a900a7120 legacy=0x7f4a9012a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:10.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 -- 172.21.15.88:0/1335698108 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a90136e90 con 0x7f4a900a3e70 2020-02-11T16:12:10.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 --2- 172.21.15.88:0/1335698108 >> v2:172.21.15.88:3300/0 conn(0x7f4a900a3e70 0x7f4a90139540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a84002f40 tx=0x7f4a84010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 --2- 172.21.15.88:0/1335698108 >> v2:172.21.15.88:3300/0 conn(0x7f4a900a3e70 0x7f4a90139540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a84002f40 tx=0x7f4a84010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a90139540 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f4a84002f40 tx=0x7f4a84010910).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:10.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a90139540 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f4a84002f40 tx=0x7f4a84010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a84005910 con 0x7f4a900a3e70 2020-02-11T16:12:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a90139540 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f4a84002f40 tx=0x7f4a84010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8effd700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a90139540 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f4a84002f40 tx=0x7f4a84010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a84005a70 con 0x7f4a900a3e70 2020-02-11T16:12:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a95b54700 1 -- 172.21.15.88:0/1335698108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a90137130 con 0x7f4a900a3e70 2020-02-11T16:12:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a84005e90 con 0x7f4a900a3e70 2020-02-11T16:12:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.088+0000 7f4a95b54700 1 -- 172.21.15.88:0/1335698108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a901392e0 con 0x7f4a900a3e70 2020-02-11T16:12:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8effd700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a90139540 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f4a84002f40 tx=0x7f4a84010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a95b54700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a95b54700 1 -- 172.21.15.88:0/1335698108 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9005e2f0 con 0x7f4a9012a920 2020-02-11T16:12:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4a84008880 con 0x7f4a900a3e70 2020-02-11T16:12:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8effd700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a90139540 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f4a84002f40 tx=0x7f4a84010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:10.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:10.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8cff9700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4a70039a40 0x7f4a7003bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:10.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4a84049620 con 0x7f4a900a3e70 2020-02-11T16:12:10.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8f7fe700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 msgr2=0x7f4a9012c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:12:10.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8f7fe700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 msgr2=0x7f4a9012c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:12:10.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:10.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:10.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.089+0000 7f4a8ffff700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4a70039a40 0x7f4a7003bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:10.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.090+0000 7f4a8ffff700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4a70039a40 0x7f4a7003bf00 crc :-1 s=READY pgs=229 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:10.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.290+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:10.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.290+0000 7f4a8f7fe700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 msgr2=0x7f4a9012c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:12:10.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.290+0000 7f4a8f7fe700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 msgr2=0x7f4a9012c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:12:10.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.290+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:10.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.290+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:12:10.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.691+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:10.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.691+0000 7f4a8f7fe700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 msgr2=0x7f4a9012c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:12:10.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.691+0000 7f4a8f7fe700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 msgr2=0x7f4a9012c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:12:10.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.691+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:10.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:10.691+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:12:11.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:11.492+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:11.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:11.493+0000 7f4a8f7fe700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 msgr2=0x7f4a9012c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:12:11.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:11.493+0000 7f4a8f7fe700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 msgr2=0x7f4a9012c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:12:11.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:11.493+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:11.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:11.493+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:12:12.574 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:12:12.577 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:12:13.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.095+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.095+0000 7f4a8f7fe700 1 -- 172.21.15.88:0/1335698108 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a901372c0 con 0x7f4a9012a920 2020-02-11T16:12:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.095+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.095+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.096+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.096+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.096+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a80007540 con 0x7f4a9012a920 2020-02-11T16:12:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.096+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.096+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f4a8000af80 con 0x7f4a9012a920 2020-02-11T16:12:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.096+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 msgr2=0x7f4a9012c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.096+0000 7f4a8cff9700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).stop 2020-02-11T16:12:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.096+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 msgr2=0x7f4a9012c650 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:13.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.096+0000 7f4a8cff9700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012a920 0x7f4a9012c650 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.105+0000 7f4a95b54700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 0x7f4a9012d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:13.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.105+0000 7f4a95b54700 1 -- 172.21.15.88:0/1335698108 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9012efa0 con 0x7f4a9012d2b0 2020-02-11T16:12:13.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.105+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 0x7f4a9012d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:13.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8f7fe700 1 -- 172.21.15.88:0/1335698108 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4a900565b0 con 0x7f4a9012d2b0 2020-02-11T16:12:13.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 0x7f4a9012d6c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 0x7f4a9012d6c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 0x7f4a9012d6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:13.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 0x7f4a9012d6c0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a800125b0 con 0x7f4a9012d2b0 2020-02-11T16:12:13.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8f7fe700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 0x7f4a9012d6c0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3849 (secure 0 0 0) 0x7f4a80012710 con 0x7f4a9012d2b0 2020-02-11T16:12:13.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 msgr2=0x7f4a9012d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:13.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8cff9700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 0x7f4a9012d6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f4a800032b0 tx=0x7f4a80010f10).stop 2020-02-11T16:12:13.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8cff9700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 msgr2=0x7f4a9012d6c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:13.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.106+0000 7f4a8cff9700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a9012d2b0 0x7f4a9012d6c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.107+0000 7f4a95b54700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4a70039a40 msgr2=0x7f4a7003bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:13.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.107+0000 7f4a95b54700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4a70039a40 0x7f4a7003bf00 crc :-1 s=READY pgs=229 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.107+0000 7f4a95b54700 1 -- 172.21.15.88:0/1335698108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 msgr2=0x7f4a90139540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:13.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.107+0000 7f4a95b54700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a90139540 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f4a84002f40 tx=0x7f4a84010910).stop 2020-02-11T16:12:13.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.107+0000 7f4a8ffff700 1 -- 172.21.15.88:0/1335698108 reap_dead start 2020-02-11T16:12:13.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.107+0000 7f4a95b54700 1 -- 172.21.15.88:0/1335698108 shutdown_connections 2020-02-11T16:12:13.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.107+0000 7f4a95b54700 1 --2- 172.21.15.88:0/1335698108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a900a3e70 0x7f4a90139540 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.107+0000 7f4a95b54700 1 -- 172.21.15.88:0/1335698108 >> 172.21.15.88:0/1335698108 conn(0x7f4a9009d110 msgr2=0x7f4a90069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:13.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.107+0000 7f4a95b54700 1 -- 172.21.15.88:0/1335698108 shutdown_connections 2020-02-11T16:12:13.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.107+0000 7f4a95b54700 1 -- 172.21.15.88:0/1335698108 wait complete. 2020-02-11T16:12:13.117 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:12:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:12:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:12:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:12:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 62, 2020-02-11T16:12:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:12:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:12:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:12:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:12:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 4, 2020-02-11T16:12:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:12:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:12:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:12:13.123 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:12:13.123 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:13.123 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:13.123 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:13.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.125 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:12:13.125 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:12:13.125 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:12:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:12:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:12:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:12:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:12:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:12:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:12:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:12:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:12:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:12:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:13.133 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:12:13.133 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:13.133 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:13.133 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:13.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.134 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:12:13.134 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:12:13.135 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:13.135 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:13.135 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.136 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:13.136 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:13.136 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:13.136 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:13.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.137 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:13.137 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:12:13.137 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:13.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.138 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:13.138 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:12:13.138 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:13.139 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:13.139 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:13.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.139 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:12:13.139 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:12:13.140 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:13.140 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:13.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.141 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:12:13.141 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:12:13.141 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:13.141 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:13.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.142 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:13.142 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:12:13.142 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:13.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.143 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:13.143 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:12:13.143 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:13.144 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:13.144 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:13.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.144 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:12:13.145 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:12:13.145 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:13.145 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:13.145 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:13.146 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:13.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:13.146 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:12:13.146 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:12:13.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.147 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:13.147 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:13.147 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:13.147 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:13.148 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:13.148 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:12:13.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:13.148 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:13.148 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:13.149 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:13.149 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:13.149 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:13.149 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:13.149 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:12:13.150 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:12:13.151 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:12:13.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.261+0000 7f65e1019700 1 Processor -- start 2020-02-11T16:12:13.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.261+0000 7f65e1019700 1 -- start start 2020-02-11T16:12:13.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65e1019700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65dc0a7120 0x7f65dc0a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:13.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65e1019700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a39e0 0x7f65dc0a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:13.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65e1019700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 0x7f65dc12fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:13.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65e1019700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc09e7a0 con 0x7f65dc0a39e0 2020-02-11T16:12:13.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65e1019700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc0a5320 con 0x7f65dc0a7120 2020-02-11T16:12:13.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65e1019700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc0a5560 con 0x7f65dc12f890 2020-02-11T16:12:13.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65dad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65dc0a7120 0x7f65dc0a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:13.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65dad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65dc0a7120 0x7f65dc0a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54818/0 (socket says 172.21.15.88:54818) 2020-02-11T16:12:13.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65dad9d700 1 -- 172.21.15.88:0/3843594901 learned_addr learned my addr 172.21.15.88:0/3843594901 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:13.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65db59e700 1 --2- 172.21.15.88:0/3843594901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 0x7f65dc12fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:13.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65da59c700 1 --2- 172.21.15.88:0/3843594901 >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a39e0 0x7f65dc0a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:13.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65dad9d700 1 -- 172.21.15.88:0/3843594901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 msgr2=0x7f65dc12fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:13.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65dad9d700 1 --2- 172.21.15.88:0/3843594901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 0x7f65dc12fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:13.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65dad9d700 1 -- 172.21.15.88:0/3843594901 >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a39e0 msgr2=0x7f65dc0a3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:13.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65dad9d700 1 --2- 172.21.15.88:0/3843594901 >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a39e0 0x7f65dc0a3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:13.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65dad9d700 1 -- 172.21.15.88:0/3843594901 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc09e060 con 0x7f65dc0a7120 2020-02-11T16:12:13.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.262+0000 7f65da59c700 1 --2- 172.21.15.88:0/3843594901 >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a39e0 0x7f65dc0a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:12:13.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65dad9d700 1 --2- 172.21.15.88:0/3843594901 >> v2:172.21.15.88:3300/0 conn(0x7f65dc0a7120 0x7f65dc0a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65dad9d700 1 --2- 172.21.15.88:0/3843594901 >> v2:172.21.15.88:3300/0 conn(0x7f65dc0a7120 0x7f65dc0a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65dad9d700 1 --2- 172.21.15.88:0/3843594901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a7120 0x7f65dc0a4ec0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).ready entity=mon.1 client_cookie=227b1246f1ee028b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:13.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65dad9d700 1 --2- 172.21.15.88:0/3843594901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a7120 0x7f65dc0a4ec0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65d9d9b700 1 -- 172.21.15.88:0/3843594901 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65d4011670 con 0x7f65dc0a7120 2020-02-11T16:12:13.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65dad9d700 1 --2- 172.21.15.88:0/3843594901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a7120 0x7f65dc0a4ec0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65dad9d700 1 --2- 172.21.15.88:0/3843594901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a7120 0x7f65dc0a4ec0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65d9d9b700 1 -- 172.21.15.88:0/3843594901 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d40117d0 con 0x7f65dc0a7120 2020-02-11T16:12:13.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65d9d9b700 1 -- 172.21.15.88:0/3843594901 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65d4011b70 con 0x7f65dc0a7120 2020-02-11T16:12:13.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65e1019700 1 -- 172.21.15.88:0/3843594901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a7120 msgr2=0x7f65dc0a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:13.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65e1019700 1 --2- 172.21.15.88:0/3843594901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a7120 0x7f65dc0a4ec0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).stop 2020-02-11T16:12:13.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65e1019700 1 -- 172.21.15.88:0/3843594901 shutdown_connections 2020-02-11T16:12:13.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65e1019700 1 --2- 172.21.15.88:0/3843594901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 0x7f65dc12fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:13.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65e1019700 1 --2- 172.21.15.88:0/3843594901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a7120 0x7f65dc0a4ec0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65e1019700 1 --2- 172.21.15.88:0/3843594901 >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a39e0 0x7f65dc0a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:13.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65e1019700 1 -- 172.21.15.88:0/3843594901 >> 172.21.15.88:0/3843594901 conn(0x7f65dc09d110 msgr2=0x7f65dc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:13.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65e1019700 1 -- 172.21.15.88:0/3843594901 shutdown_connections 2020-02-11T16:12:13.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.263+0000 7f65e1019700 1 -- 172.21.15.88:0/3843594901 wait complete. 2020-02-11T16:12:13.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.264+0000 7f65e1019700 1 Processor -- start 2020-02-11T16:12:13.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.264+0000 7f65e1019700 1 -- start start 2020-02-11T16:12:13.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65e1019700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65dc0a39e0 0x7f65dc1293d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:13.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65e1019700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a7120 0x7f65dc129830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:13.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65e1019700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 0x7f65dc065450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:13.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65e1019700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc09f050 con 0x7f65dc0a7120 2020-02-11T16:12:13.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65e1019700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc0a1770 con 0x7f65dc0a39e0 2020-02-11T16:12:13.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65e1019700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc09edb0 con 0x7f65dc12f890 2020-02-11T16:12:13.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65dc0a39e0 0x7f65dc1293d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:13.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65dc0a39e0 0x7f65dc1293d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54822/0 (socket says 172.21.15.88:54822) 2020-02-11T16:12:13.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 -- 172.21.15.88:0/1879332001 learned_addr learned my addr 172.21.15.88:0/1879332001 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:13.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65da59c700 1 --2- 172.21.15.88:0/1879332001 >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a7120 0x7f65dc129830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:13.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65db59e700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 0x7f65dc065450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:13.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 -- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 msgr2=0x7f65dc065450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:13.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 0x7f65dc065450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 -- 172.21.15.88:0/1879332001 >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a7120 msgr2=0x7f65dc129830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:13.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a7120 0x7f65dc129830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 -- 172.21.15.88:0/1879332001 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc129c90 con 0x7f65dc0a39e0 2020-02-11T16:12:13.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65db59e700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 0x7f65dc065450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:12:13.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> v2:172.21.15.88:3300/0 conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> v2:172.21.15.88:3300/0 conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:13.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65cbfff700 1 -- 172.21.15.88:0/1879332001 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65d4011a40 con 0x7f65dc0a39e0 2020-02-11T16:12:13.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65cbfff700 1 -- 172.21.15.88:0/1879332001 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d4011ba0 con 0x7f65dc0a39e0 2020-02-11T16:12:13.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65e1019700 1 -- 172.21.15.88:0/1879332001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc12bf00 con 0x7f65dc0a39e0 2020-02-11T16:12:13.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65cbfff700 1 -- 172.21.15.88:0/1879332001 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65d4007340 con 0x7f65dc0a39e0 2020-02-11T16:12:13.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.265+0000 7f65e1019700 1 -- 172.21.15.88:0/1879332001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc09e910 con 0x7f65dc0a39e0 2020-02-11T16:12:13.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.266+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.266+0000 7f65cbfff700 1 -- 172.21.15.88:0/1879332001 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f65d40056c0 con 0x7f65dc0a39e0 2020-02-11T16:12:13.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.266+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.266+0000 7f65e1019700 1 -- 172.21.15.88:0/1879332001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65dc09ebc0 con 0x7f65dc0a39e0 2020-02-11T16:12:13.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.266+0000 7f65cbfff700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f65b8039cd0 0x7f65b803c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:13.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.266+0000 7f65cbfff700 1 -- 172.21.15.88:0/1879332001 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f65d4049ea0 con 0x7f65dc0a39e0 2020-02-11T16:12:13.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.267+0000 7f65da59c700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f65b8039cd0 0x7f65b803c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:13.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.267+0000 7f65da59c700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f65b8039cd0 0x7f65b803c190 crc :-1 s=READY pgs=230 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:13.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.270+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.270+0000 7f65cbfff700 1 -- 172.21.15.88:0/1879332001 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f65d402f390 con 0x7f65dc0a39e0 2020-02-11T16:12:13.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.452+0000 7f65e1019700 1 -- 172.21.15.88:0/1879332001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f65dc0565b0 con 0x7f65dc0a39e0 2020-02-11T16:12:13.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.453+0000 7f65dad9d700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:13.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.453+0000 7f65cbfff700 1 -- 172.21.15.88:0/1879332001 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f65d4032050 con 0x7f65dc0a39e0 2020-02-11T16:12:13.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 -- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f65b8039cd0 msgr2=0x7f65b803c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f65b8039cd0 0x7f65b803c190 crc :-1 s=READY pgs=230 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 -- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 msgr2=0x7f65dc1293d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 0x7f65dc1293d0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f65d4002f30 tx=0x7f65d4007a40).stop 2020-02-11T16:12:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 -- 172.21.15.88:0/1879332001 shutdown_connections 2020-02-11T16:12:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65dc12f890 0x7f65dc065450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc0a39e0 0x7f65dc1293d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 --2- 172.21.15.88:0/1879332001 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f65b8039cd0 0x7f65b803c190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 --2- 172.21.15.88:0/1879332001 >> v2:172.21.15.52:3300/0 conn(0x7f65dc0a7120 0x7f65dc129830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:13.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 -- 172.21.15.88:0/1879332001 >> 172.21.15.88:0/1879332001 conn(0x7f65dc09d110 msgr2=0x7f65dc12c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:13.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 -- 172.21.15.88:0/1879332001 shutdown_connections 2020-02-11T16:12:13.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:13.455+0000 7f65e1019700 1 -- 172.21.15.88:0/1879332001 wait complete. 2020-02-11T16:12:13.467 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:12:23.468 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:12:23.468 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:12:23.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.582+0000 7f4e93bd8700 1 Processor -- start 2020-02-11T16:12:23.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.582+0000 7f4e93bd8700 1 -- start start 2020-02-11T16:12:23.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.582+0000 7f4e93bd8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e8c0ad380 0x7f4e8c0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:23.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.582+0000 7f4e93bd8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e8c138280 0x7f4e8c1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:23.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.582+0000 7f4e93bd8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c0adb40 con 0x7f4e8c13b1c0 2020-02-11T16:12:23.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e93bd8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c137bf0 con 0x7f4e8c138280 2020-02-11T16:12:23.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e93bd8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c138b40 con 0x7f4e8c0ad380 2020-02-11T16:12:23.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e92175700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4e8c13b1c0 0x7f4e8c13b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42462/0 (socket says 172.21.15.88:42462) 2020-02-11T16:12:23.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e92175700 1 -- 172.21.15.88:0/1126879299 learned_addr learned my addr 172.21.15.88:0/1126879299 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:23.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e91173700 1 --2- 172.21.15.88:0/1126879299 >> v2:172.21.15.52:3300/0 conn(0x7f4e8c138280 0x7f4e8c1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e91974700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e8c0ad380 0x7f4e8c0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562768570 0 0) 0x7f4e8c0adb40 con 0x7f4e8c13b1c0 2020-02-11T16:12:23.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e74003230 con 0x7f4e8c13b1c0 2020-02-11T16:12:23.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4048630714 0 0) 0x7f4e74003230 con 0x7f4e8c13b1c0 2020-02-11T16:12:23.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e8c0ad380 msgr2=0x7f4e8c0a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:23.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e8c0ad380 0x7f4e8c0a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:23.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 >> v2:172.21.15.52:3300/0 conn(0x7f4e8c138280 msgr2=0x7f4e8c1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:23.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 --2- 172.21.15.88:0/1126879299 >> v2:172.21.15.52:3300/0 conn(0x7f4e8c138280 0x7f4e8c1386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:23.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c137de0 con 0x7f4e8c13b1c0 2020-02-11T16:12:23.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f4e880016d0 con 0x7f4e8c13b1c0 2020-02-11T16:12:23.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 >> v1:172.21.15.88:6789/0 conn(0x7f4e8c13b1c0 legacy=0x7f4e8c13b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e8c0ad380 0x7f4e74003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:23.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e74003b80 0x7f4e74003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:23.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e740045c0 0x7f4e74004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:23.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c138b40 con 0x7f4e74003b80 2020-02-11T16:12:23.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74004fd0 con 0x7f4e740045c0 2020-02-11T16:12:23.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74005190 con 0x7f4e8c0ad380 2020-02-11T16:12:23.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e92175700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e740045c0 0x7f4e74004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e91974700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e8c0ad380 0x7f4e74003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.583+0000 7f4e91173700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e74003b80 0x7f4e74003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 -- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e8c0ad380 msgr2=0x7f4e74003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:23.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e8c0ad380 0x7f4e74003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:23.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 -- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e74003b80 msgr2=0x7f4e74003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:23.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e74003b80 0x7f4e74003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:23.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 -- 172.21.15.88:0/1126879299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e74003230 con 0x7f4e740045c0 2020-02-11T16:12:23.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e740045c0 0x7f4e74004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e880013e0 tx=0x7f4e8800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e740045c0 0x7f4e74004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e880013e0 tx=0x7f4e8800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e740045c0 0x7f4e74004a20 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f4e880013e0 tx=0x7f4e8800c340).ready entity=mon.1 client_cookie=332b1741575bf538 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:23.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e740045c0 0x7f4e74004a20 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f4e880013e0 tx=0x7f4e8800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e8800ce70 con 0x7f4e740045c0 2020-02-11T16:12:23.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e740045c0 0x7f4e74004a20 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f4e880013e0 tx=0x7f4e8800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e740045c0 0x7f4e74004a20 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f4e880013e0 tx=0x7f4e8800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8800e350 con 0x7f4e740045c0 2020-02-11T16:12:23.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e90972700 1 -- 172.21.15.88:0/1126879299 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e8800e730 con 0x7f4e740045c0 2020-02-11T16:12:23.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e93bd8700 1 -- 172.21.15.88:0/1126879299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e740045c0 msgr2=0x7f4e74004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e93bd8700 1 --2- 172.21.15.88:0/1126879299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e740045c0 0x7f4e74004a20 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f4e880013e0 tx=0x7f4e8800c340).stop 2020-02-11T16:12:23.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e92175700 1 -- 172.21.15.88:0/1126879299 reap_dead start 2020-02-11T16:12:23.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e93bd8700 1 -- 172.21.15.88:0/1126879299 shutdown_connections 2020-02-11T16:12:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e93bd8700 1 -- 172.21.15.88:0/1126879299 >> 172.21.15.88:0/1126879299 conn(0x7f4e8c05ac70 msgr2=0x7f4e8c0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e93bd8700 1 -- 172.21.15.88:0/1126879299 shutdown_connections 2020-02-11T16:12:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.584+0000 7f4e93bd8700 1 -- 172.21.15.88:0/1126879299 wait complete. 2020-02-11T16:12:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.585+0000 7f4e93bd8700 1 Processor -- start 2020-02-11T16:12:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.585+0000 7f4e93bd8700 1 -- start start 2020-02-11T16:12:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e93bd8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e93bd8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c0ac3d0 con 0x7f4e8c133520 2020-02-11T16:12:23.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e93bd8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c130490 con 0x7f4e8c12fe20 2020-02-11T16:12:23.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e93bd8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c133ca0 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e92175700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4e8c12fe20 0x7f4e8c14fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42474/0 (socket says 172.21.15.88:42474) 2020-02-11T16:12:23.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e92175700 1 -- 172.21.15.88:0/3926863699 learned_addr learned my addr 172.21.15.88:0/3926863699 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:23.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> v2:172.21.15.52:3300/0 conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e7effd700 1 -- 172.21.15.88:0/3926863699 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308919809 0 0) 0x7f4e8c130490 con 0x7f4e8c12fe20 2020-02-11T16:12:23.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e7effd700 1 -- 172.21.15.88:0/3926863699 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e6c002fe0 con 0x7f4e8c12fe20 2020-02-11T16:12:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e91173700 1 -- 172.21.15.88:0/3926863699 >> v1:172.21.15.88:6789/0 conn(0x7f4e8c12fe20 legacy=0x7f4e8c14fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e91173700 1 -- 172.21.15.88:0/3926863699 >> v1:172.21.15.52:6789/0 conn(0x7f4e8c133520 legacy=0x7f4e8c12f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e91173700 1 -- 172.21.15.88:0/3926863699 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c1348a0 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.586+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> v2:172.21.15.52:3300/0 conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> v2:172.21.15.52:3300/0 conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e7effd700 1 -- 172.21.15.88:0/3926863699 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e80007530 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e93bd8700 1 -- 172.21.15.88:0/3926863699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c134b40 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e7effd700 1 -- 172.21.15.88:0/3926863699 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e800056c0 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e7effd700 1 -- 172.21.15.88:0/3926863699 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e80005aa0 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e93bd8700 1 -- 172.21.15.88:0/3926863699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c0a8b70 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.587+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.588+0000 7f4e7effd700 1 -- 172.21.15.88:0/3926863699 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4e80005d20 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.588+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.588+0000 7f4e93bd8700 1 -- 172.21.15.88:0/3926863699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c1346b0 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.588+0000 7f4e7effd700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e6c039f60 0x7f4e6c03c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:23.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.588+0000 7f4e7effd700 1 -- 172.21.15.88:0/3926863699 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4e8000f0a0 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.588+0000 7f4e91974700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e6c039f60 0x7f4e6c03c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.588+0000 7f4e91974700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e6c039f60 0x7f4e6c03c420 crc :-1 s=READY pgs=231 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:23.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.592+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.592+0000 7f4e7effd700 1 -- 172.21.15.88:0/3926863699 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4e8002ed80 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.773+0000 7f4e93bd8700 1 -- 172.21.15.88:0/3926863699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4e8c0565b0 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.775+0000 7f4e91173700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.775+0000 7f4e7effd700 1 -- 172.21.15.88:0/3926863699 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f4e8000a510 con 0x7f4e8c0a77c0 2020-02-11T16:12:23.777 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:12:23.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.775+0000 7f4e93bd8700 1 -- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e6c039f60 msgr2=0x7f4e6c03c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.775+0000 7f4e93bd8700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e6c039f60 0x7f4e6c03c420 crc :-1 s=READY pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.775+0000 7f4e93bd8700 1 -- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 msgr2=0x7f4e8c12f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.775+0000 7f4e93bd8700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f4e80002f30 tx=0x7f4e80010a50).stop 2020-02-11T16:12:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.775+0000 7f4e93bd8700 1 -- 172.21.15.88:0/3926863699 shutdown_connections 2020-02-11T16:12:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.775+0000 7f4e93bd8700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e6c039f60 0x7f4e6c03c420 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.775+0000 7f4e93bd8700 1 --2- 172.21.15.88:0/3926863699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e8c0a77c0 0x7f4e8c12f9c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.776+0000 7f4e93bd8700 1 -- 172.21.15.88:0/3926863699 >> 172.21.15.88:0/3926863699 conn(0x7f4e8c05ac70 msgr2=0x7f4e8c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.776+0000 7f4e93bd8700 1 -- 172.21.15.88:0/3926863699 shutdown_connections 2020-02-11T16:12:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.776+0000 7f4e93bd8700 1 -- 172.21.15.88:0/3926863699 wait complete. 2020-02-11T16:12:23.788 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":62,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:12:23.788 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:12:23.789 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:12:23.789 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:12:23.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.892+0000 7f5d909b1700 1 Processor -- start 2020-02-11T16:12:23.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.892+0000 7f5d909b1700 1 -- start start 2020-02-11T16:12:23.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.893+0000 7f5d909b1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:23.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.893+0000 7f5d909b1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:23.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.893+0000 7f5d909b1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c0a3570 con 0x7f5d8c0a5de0 2020-02-11T16:12:23.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.893+0000 7f5d909b1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8c0a3810 con 0x7f5d8c0a6260 2020-02-11T16:12:23.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.893+0000 7f5d909b1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0a3ab0 con 0x7f5d8c0a18a0 2020-02-11T16:12:23.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.893+0000 7f5d8ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.893+0000 7f5d8a59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.893+0000 7f5d8ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c12eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:40842/0 (socket says 172.21.15.88:40842) 2020-02-11T16:12:23.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.893+0000 7f5d8ad9d700 1 -- 172.21.15.88:0/3257021130 learned_addr learned my addr 172.21.15.88:0/3257021130 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8a59c700 1 -- 172.21.15.88:0/3257021130 >> v2:172.21.15.52:3300/0 conn(0x7f5d8c0a6260 msgr2=0x7f5d8c12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/3257021130 >> v2:172.21.15.52:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c12eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8a59c700 1 -- 172.21.15.88:0/3257021130 >> v1:172.21.15.52:6789/0 conn(0x7f5d8c0a5de0 legacy=0x7f5d8c12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8a59c700 1 -- 172.21.15.88:0/3257021130 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c0a3d50 con 0x7f5d8c0a18a0 2020-02-11T16:12:23.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8ad9d700 1 --2- 172.21.15.88:0/3257021130 >> v2:172.21.15.52:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c12eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:12:23.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/3257021130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5d8c05bbc0 tx=0x7f5d740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/3257021130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5d8c05bbc0 tx=0x7f5d740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/3257021130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c0a6dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d740088e0).ready entity=mon.2 client_cookie=fb19f3dedd513ac server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:23.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/3257021130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8959a700 1 -- 172.21.15.88:0/3257021130 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d74008e40 con 0x7f5d8c0a18a0 2020-02-11T16:12:23.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/3257021130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/3257021130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8959a700 1 -- 172.21.15.88:0/3257021130 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d740115b0 con 0x7f5d8c0a18a0 2020-02-11T16:12:23.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d8959a700 1 -- 172.21.15.88:0/3257021130 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d74011990 con 0x7f5d8c0a18a0 2020-02-11T16:12:23.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d909b1700 1 -- 172.21.15.88:0/3257021130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 msgr2=0x7f5d8c0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.894+0000 7f5d909b1700 1 --2- 172.21.15.88:0/3257021130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c0a6dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d740088e0).stop 2020-02-11T16:12:23.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.895+0000 7f5d909b1700 1 -- 172.21.15.88:0/3257021130 shutdown_connections 2020-02-11T16:12:23.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.895+0000 7f5d909b1700 1 --2- 172.21.15.88:0/3257021130 >> v2:172.21.15.52:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c12eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:23.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.895+0000 7f5d909b1700 1 --2- 172.21.15.88:0/3257021130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c0a6dd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:23.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.895+0000 7f5d909b1700 1 -- 172.21.15.88:0/3257021130 >> 172.21.15.88:0/3257021130 conn(0x7f5d8c09d110 msgr2=0x7f5d8c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:23.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.895+0000 7f5d909b1700 1 -- 172.21.15.88:0/3257021130 shutdown_connections 2020-02-11T16:12:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.895+0000 7f5d909b1700 1 -- 172.21.15.88:0/3257021130 wait complete. 2020-02-11T16:12:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d909b1700 1 Processor -- start 2020-02-11T16:12:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d909b1700 1 -- start start 2020-02-11T16:12:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d909b1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c135bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:23.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d909b1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c128a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:23.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d909b1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c135730 con 0x7f5d8c0a5de0 2020-02-11T16:12:23.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d909b1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8c0a0b10 con 0x7f5d8c0a6260 2020-02-11T16:12:23.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d909b1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c137df0 con 0x7f5d8c0a18a0 2020-02-11T16:12:23.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d8ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c128a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d8ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c128a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54862/0 (socket says 172.21.15.88:54862) 2020-02-11T16:12:23.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d8ad9d700 1 -- 172.21.15.88:0/2282485714 learned_addr learned my addr 172.21.15.88:0/2282485714 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:23.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.896+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c135bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d8ad9d700 1 -- 172.21.15.88:0/2282485714 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 msgr2=0x7f5d8c135bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d8ad9d700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d8c0a18a0 0x7f5d8c135bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:23.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d8ad9d700 1 -- 172.21.15.88:0/2282485714 >> v1:172.21.15.52:6789/0 conn(0x7f5d8c0a5de0 legacy=0x7f5d8c128350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179846919 0 0) 0x7f5d8c135730 con 0x7f5d8c0a5de0 2020-02-11T16:12:23.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d8ad9d700 1 -- 172.21.15.88:0/2282485714 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c09e070 con 0x7f5d8c0a6260 2020-02-11T16:12:23.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d8ad9d700 1 --2- 172.21.15.88:0/2282485714 >> v2:172.21.15.88:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c128a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d840033f0 tx=0x7f5d84011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d8ad9d700 1 --2- 172.21.15.88:0/2282485714 >> v2:172.21.15.88:3300/0 conn(0x7f5d8c0a6260 0x7f5d8c128a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d840033f0 tx=0x7f5d84011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d8ad9d700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a6260 0x7f5d8c128a60 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f5d840033f0 tx=0x7f5d84011130).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:23.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d8ad9d700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a6260 0x7f5d8c128a60 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f5d840033f0 tx=0x7f5d84011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d84005e30 con 0x7f5d8c0a6260 2020-02-11T16:12:23.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d8ad9d700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a6260 0x7f5d8c128a60 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f5d840033f0 tx=0x7f5d84011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8400cbf0 con 0x7f5d8c0a6260 2020-02-11T16:12:23.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d8ad9d700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a6260 0x7f5d8c128a60 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f5d840033f0 tx=0x7f5d84011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d909b1700 1 -- 172.21.15.88:0/2282485714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c138ae0 con 0x7f5d8c0a6260 2020-02-11T16:12:23.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d84012790 con 0x7f5d8c0a6260 2020-02-11T16:12:23.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.897+0000 7f5d909b1700 1 -- 172.21.15.88:0/2282485714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c136b60 con 0x7f5d8c0a6260 2020-02-11T16:12:23.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d8ad9d700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a6260 0x7f5d8c128a60 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f5d840033f0 tx=0x7f5d84011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d909b1700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 0x7f5d8c0a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:23.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d909b1700 1 -- 172.21.15.88:0/2282485714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c05e2f0 con 0x7f5d8c137160 2020-02-11T16:12:23.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5d84012a10 con 0x7f5d8c0a6260 2020-02-11T16:12:23.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d8ad9d700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a6260 0x7f5d8c128a60 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f5d840033f0 tx=0x7f5d84011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 0x7f5d8c0a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d837fe700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d70039b50 0x7f5d7003c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:23.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5d84049c90 con 0x7f5d8c0a6260 2020-02-11T16:12:23.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d8a59c700 1 -- 172.21.15.88:0/2282485714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d8c138e10 con 0x7f5d8c137160 2020-02-11T16:12:23.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 0x7f5d8c0a4b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d8c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d89d9b700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d70039b50 0x7f5d7003c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 0x7f5d8c0a4b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d8c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.898+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 0x7f5d8c0a4b30 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d8c0a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:23.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.899+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 0x7f5d8c0a4b30 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d8c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.899+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d74007bf0 con 0x7f5d8c137160 2020-02-11T16:12:23.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.899+0000 7f5d89d9b700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d70039b50 0x7f5d7003c010 crc :-1 s=READY pgs=232 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:23.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.899+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 0x7f5d8c0a4b30 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d8c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.899+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5d74007340 con 0x7f5d8c137160 2020-02-11T16:12:23.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.899+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 msgr2=0x7f5d8c0a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.899+0000 7f5d837fe700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 0x7f5d8c0a4b30 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d8c0a1c80).stop 2020-02-11T16:12:23.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.899+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 msgr2=0x7f5d8c0a4b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:23.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.899+0000 7f5d837fe700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c137160 0x7f5d8c0a4b30 secure :-1 s=CLOSED pgs=315 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d8c0a1c80).stop 2020-02-11T16:12:23.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d909b1700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 0x7f5d8c129200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:23.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d909b1700 1 -- 172.21.15.88:0/2282485714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c136fa0 con 0x7f5d8c0a4f90 2020-02-11T16:12:23.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 0x7f5d8c129200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:23.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d8a59c700 1 -- 172.21.15.88:0/2282485714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5d8c0565b0 con 0x7f5d8c0a4f90 2020-02-11T16:12:23.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 0x7f5d8c129200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d74007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 0x7f5d8c129200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d74007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 0x7f5d8c129200 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d74007ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:23.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 0x7f5d8c129200 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d74007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d74005ea0 con 0x7f5d8c0a4f90 2020-02-11T16:12:23.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d8a59c700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 0x7f5d8c129200 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d74007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:23.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f5d74012640 con 0x7f5d8c0a4f90 2020-02-11T16:12:23.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 msgr2=0x7f5d8c129200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d837fe700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 0x7f5d8c129200 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f5d8c05bbc0 tx=0x7f5d74007ae0).stop 2020-02-11T16:12:23.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.907+0000 7f5d837fe700 1 -- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 msgr2=0x7f5d8c129200 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:23.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d837fe700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a4f90 0x7f5d8c129200 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:23.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d909b1700 1 -- 172.21.15.88:0/2282485714 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d70039b50 msgr2=0x7f5d7003c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d909b1700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d70039b50 0x7f5d7003c010 crc :-1 s=READY pgs=232 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:23.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d909b1700 1 -- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a6260 msgr2=0x7f5d8c128a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:23.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d909b1700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a6260 0x7f5d8c128a60 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f5d840033f0 tx=0x7f5d84011130).stop 2020-02-11T16:12:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d8ad9d700 1 -- 172.21.15.88:0/2282485714 reap_dead start 2020-02-11T16:12:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d909b1700 1 -- 172.21.15.88:0/2282485714 shutdown_connections 2020-02-11T16:12:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d909b1700 1 --2- 172.21.15.88:0/2282485714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d8c0a6260 0x7f5d8c128a60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d909b1700 1 -- 172.21.15.88:0/2282485714 >> 172.21.15.88:0/2282485714 conn(0x7f5d8c09d110 msgr2=0x7f5d8c0a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d909b1700 1 -- 172.21.15.88:0/2282485714 shutdown_connections 2020-02-11T16:12:23.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:23.908+0000 7f5d909b1700 1 -- 172.21.15.88:0/2282485714 wait complete. 2020-02-11T16:12:23.937 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:12:23.937 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:23.937 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:23.937 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:12:23.938 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 62, 2020-02-11T16:12:23.938 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:12:23.938 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:12:23.938 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:12:23.938 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:12:23.938 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:23.938 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:12:23.939 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:23.939 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:12:23.939 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:12:23.939 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:23.939 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:23.939 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:23.940 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:23.940 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:23.940 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:23.940 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:23.941 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:12:23.941 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:12:23.941 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:23.941 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:23.941 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:23.941 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:23.942 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:23.942 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:23.942 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:23.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.942 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:12:23.942 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:12:23.942 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:12:23.943 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:12:23.943 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:12:23.944 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:12:23.944 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:23.944 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:23.944 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:12:23.944 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:12:23.944 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:23.945 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:12:23.945 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:23.945 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:23.945 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:23.946 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:23.946 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:23.946 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:23.946 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:23.946 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:12:23.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.946 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:12:23.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.947 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:23.947 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:23.947 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:23.947 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:23.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.947 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:23.948 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:12:23.948 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:23.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.948 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:23.948 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:12:23.948 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:23.949 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:23.949 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:23.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.949 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:12:23.949 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:12:23.949 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:23.950 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:23.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.950 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:23.950 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:23.950 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:23.950 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:23.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.951 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:23.951 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:12:23.951 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:23.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.951 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:23.952 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:12:23.952 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:23.952 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:23.952 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:23.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.952 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:12:23.952 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:12:23.953 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:23.953 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:23.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.953 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:12:23.954 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:12:23.954 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:23.954 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:23.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.954 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:23.954 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:12:23.954 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:23.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.955 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:23.955 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:12:23.955 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:23.955 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:23.956 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:23.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.956 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:12:23.956 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:12:23.956 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:23.956 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:23.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:23.957 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:23.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:23.957 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:12:23.957 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:12:23.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.957 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:23.957 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:23.958 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:23.958 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:23.958 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:23.958 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:12:23.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.958 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:23.958 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:23.959 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:23.959 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:23.959 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:23.959 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:12:23.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.959 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:23.959 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:23.959 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:12:23.960 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:23.960 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:23.960 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:12:23.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.961 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:23.961 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:23.961 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:12:23.961 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:23.961 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:23.961 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:12:23.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:23.962 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:23.962 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:23.962 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:12:23.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:23.962 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:23.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:23.962 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:12:23.964 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:12:24.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.066+0000 7f4da0cf7700 1 Processor -- start 2020-02-11T16:12:24.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.066+0000 7f4da0cf7700 1 -- start start 2020-02-11T16:12:24.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4da0cf7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d9c0a5de0 0x7f4d9c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4da0cf7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d9c134a50 0x7f4d9c134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4da0cf7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9c0a31b0 con 0x7f4d9c0a18a0 2020-02-11T16:12:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4da0cf7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9c0a3570 con 0x7f4d9c134a50 2020-02-11T16:12:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4da0cf7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c0a3810 con 0x7f4d9c0a5de0 2020-02-11T16:12:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4d9ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d9c134a50 0x7f4d9c134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4d9a59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4d9c0a18a0 0x7f4d9c0a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42496/0 (socket says 172.21.15.88:42496) 2020-02-11T16:12:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4d9ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d9c134a50 0x7f4d9c134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54870/0 (socket says 172.21.15.88:54870) 2020-02-11T16:12:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4d9a59c700 1 -- 172.21.15.88:0/2846733635 learned_addr learned my addr 172.21.15.88:0/2846733635 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4d99d9b700 1 --2- 172.21.15.88:0/2846733635 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d9c0a5de0 0x7f4d9c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4d9ad9d700 1 -- 172.21.15.88:0/2846733635 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d9c0a5de0 msgr2=0x7f4d9c0a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2846733635 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d9c0a5de0 0x7f4d9c0a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4d9ad9d700 1 -- 172.21.15.88:0/2846733635 >> v1:172.21.15.88:6789/0 conn(0x7f4d9c0a18a0 legacy=0x7f4d9c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.067+0000 7f4d9959a700 1 -- 172.21.15.88:0/2846733635 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719942528 0 0) 0x7f4d9c0a31b0 con 0x7f4d9c0a18a0 2020-02-11T16:12:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4d9ad9d700 1 -- 172.21.15.88:0/2846733635 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c0a3ab0 con 0x7f4d9c134a50 2020-02-11T16:12:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2846733635 >> v2:172.21.15.88:3300/0 conn(0x7f4d9c134a50 0x7f4d9c134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d9c0a5cc0 tx=0x7f4d94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2846733635 >> v2:172.21.15.88:3300/0 conn(0x7f4d9c134a50 0x7f4d9c134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d9c0a5cc0 tx=0x7f4d94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2846733635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c134ee0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d94008c60).ready entity=mon.1 client_cookie=9046f958861ebc9e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2846733635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c134ee0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4d9959a700 1 -- 172.21.15.88:0/2846733635 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d94013e40 con 0x7f4d9c134a50 2020-02-11T16:12:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2846733635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c134ee0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4d9959a700 1 -- 172.21.15.88:0/2846733635 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9400c350 con 0x7f4d9c134a50 2020-02-11T16:12:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2846733635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c134ee0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4d9959a700 1 -- 172.21.15.88:0/2846733635 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d9400c6f0 con 0x7f4d9c134a50 2020-02-11T16:12:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2846733635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 msgr2=0x7f4d9c134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4da0cf7700 1 --2- 172.21.15.88:0/2846733635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c134ee0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d94008c60).stop 2020-02-11T16:12:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2846733635 shutdown_connections 2020-02-11T16:12:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4da0cf7700 1 --2- 172.21.15.88:0/2846733635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c134ee0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4da0cf7700 1 --2- 172.21.15.88:0/2846733635 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d9c0a5de0 0x7f4d9c0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2846733635 >> 172.21.15.88:0/2846733635 conn(0x7f4d9c09d110 msgr2=0x7f4d9c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2846733635 shutdown_connections 2020-02-11T16:12:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.068+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2846733635 wait complete. 2020-02-11T16:12:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.069+0000 7f4da0cf7700 1 Processor -- start 2020-02-11T16:12:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.069+0000 7f4da0cf7700 1 -- start start 2020-02-11T16:12:24.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4da0cf7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d9c0a18a0 0x7f4d9c12f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4da0cf7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d9c134a50 0x7f4d9c12d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4da0cf7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9c130f40 con 0x7f4d9c0a5de0 2020-02-11T16:12:24.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4da0cf7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9c1311e0 con 0x7f4d9c134a50 2020-02-11T16:12:24.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4da0cf7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c12cb90 con 0x7f4d9c0a18a0 2020-02-11T16:12:24.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d9c134a50 0x7f4d9c12d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d9c134a50 0x7f4d9c12d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54880/0 (socket says 172.21.15.88:54880) 2020-02-11T16:12:24.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 -- 172.21.15.88:0/2600167089 learned_addr learned my addr 172.21.15.88:0/2600167089 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:24.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d9c0a18a0 0x7f4d9c12f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 -- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d9c0a18a0 msgr2=0x7f4d9c12f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d9c0a18a0 0x7f4d9c12f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 -- 172.21.15.88:0/2600167089 >> v1:172.21.15.52:6789/0 conn(0x7f4d9c0a5de0 legacy=0x7f4d9c128580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 -- 172.21.15.88:0/2600167089 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c128c90 con 0x7f4d9c134a50 2020-02-11T16:12:24.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d9c0a18a0 0x7f4d9c12f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:12:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2600167089 >> v2:172.21.15.88:3300/0 conn(0x7f4d9c134a50 0x7f4d9c12d050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d9c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2600167089 >> v2:172.21.15.88:3300/0 conn(0x7f4d9c134a50 0x7f4d9c12d050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d9c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c12d050 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d9c12f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c12d050 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d9c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c12d050 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d9c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d94005c30 con 0x7f4d9c134a50 2020-02-11T16:12:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c12d050 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d9c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d94005d90 con 0x7f4d9c134a50 2020-02-11T16:12:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2600167089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c12c850 con 0x7f4d9c134a50 2020-02-11T16:12:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d94007340 con 0x7f4d9c134a50 2020-02-11T16:12:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.070+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2600167089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9c130ce0 con 0x7f4d9c134a50 2020-02-11T16:12:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.071+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c12d050 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d9c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.071+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4d94007570 con 0x7f4d9c134a50 2020-02-11T16:12:24.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.071+0000 7f4d9ad9d700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c12d050 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d9c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.071+0000 7f4da0cf7700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 0x7f4d9c12b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.071+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2600167089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c05e2f0 con 0x7f4d9c12d680 2020-02-11T16:12:24.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.071+0000 7f4d8b7fe700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d78039c70 0x7f4d7803c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.071+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4d9404c8a0 con 0x7f4d9c134a50 2020-02-11T16:12:24.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.071+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 0x7f4d9c12b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.071+0000 7f4d99d9b700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d78039c70 0x7f4d7803c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d99d9b700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d78039c70 0x7f4d7803c130 crc :-1 s=READY pgs=233 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:24.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d9a59c700 1 -- 172.21.15.88:0/2600167089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d9c12cd60 con 0x7f4d9c12d680 2020-02-11T16:12:24.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 0x7f4d9c12b6a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 0x7f4d9c12b6a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 0x7f4d9c12b6a0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:24.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 0x7f4d9c12b6a0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d900104e0 con 0x7f4d9c12d680 2020-02-11T16:12:24.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 0x7f4d9c12b6a0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f4d9000ca30 con 0x7f4d9c12d680 2020-02-11T16:12:24.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 msgr2=0x7f4d9c12b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d8b7fe700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 0x7f4d9c12b6a0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).stop 2020-02-11T16:12:24.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 msgr2=0x7f4d9c12b6a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:24.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.072+0000 7f4d8b7fe700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c12d680 0x7f4d9c12b6a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.080+0000 7f4da0cf7700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 0x7f4d9c05a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.080+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2600167089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c131320 con 0x7f4d9c05a5d0 2020-02-11T16:12:24.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 0x7f4d9c05a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d9a59c700 1 -- 172.21.15.88:0/2600167089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4d9c0565b0 con 0x7f4d9c05a5d0 2020-02-11T16:12:24.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 0x7f4d9c05a9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 0x7f4d9c05a9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 0x7f4d9c05a9e0 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:24.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 0x7f4d9c05a9e0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d9000ce20 con 0x7f4d9c05a5d0 2020-02-11T16:12:24.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d9a59c700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 0x7f4d9c05a9e0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4192 (secure 0 0 0) 0x7f4d900135b0 con 0x7f4d9c05a5d0 2020-02-11T16:12:24.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 msgr2=0x7f4d9c05a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d8b7fe700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 0x7f4d9c05a9e0 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f4d90000b80 tx=0x7f4d9000c580).stop 2020-02-11T16:12:24.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d8b7fe700 1 -- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 msgr2=0x7f4d9c05a9e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:24.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.081+0000 7f4d8b7fe700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d9c05a5d0 0x7f4d9c05a9e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d78039c70 msgr2=0x7f4d7803c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4da0cf7700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d78039c70 0x7f4d7803c130 crc :-1 s=READY pgs=233 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2600167089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 msgr2=0x7f4d9c12d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4da0cf7700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c12d050 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f4d9c0a5cc0 tx=0x7f4d9c12f3b0).stop 2020-02-11T16:12:24.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4d9ad9d700 1 -- 172.21.15.88:0/2600167089 reap_dead start 2020-02-11T16:12:24.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4d9ad9d700 1 -- 172.21.15.88:0/2600167089 reap_dead start 2020-02-11T16:12:24.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2600167089 shutdown_connections 2020-02-11T16:12:24.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4da0cf7700 1 --2- 172.21.15.88:0/2600167089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d9c134a50 0x7f4d9c12d050 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2600167089 >> 172.21.15.88:0/2600167089 conn(0x7f4d9c09d110 msgr2=0x7f4d9c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:24.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2600167089 shutdown_connections 2020-02-11T16:12:24.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.082+0000 7f4da0cf7700 1 -- 172.21.15.88:0/2600167089 wait complete. 2020-02-11T16:12:24.094 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:12:24.094 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:24.094 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:24.094 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:12:24.094 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 62, 2020-02-11T16:12:24.094 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:12:24.095 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:12:24.095 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:12:24.095 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:12:24.095 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:24.095 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:12:24.095 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:24.095 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:12:24.096 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:12:24.096 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:24.096 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:24.096 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:24.096 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:24.096 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:24.096 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:24.097 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:24.097 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:12:24.097 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:12:24.097 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:24.097 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:24.097 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:24.097 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:24.098 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:24.098 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:24.098 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.098 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:12:24.098 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:12:24.098 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:12:24.098 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:12:24.099 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:12:24.099 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:12:24.099 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:24.099 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:24.099 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:12:24.099 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:12:24.099 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:24.100 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:12:24.100 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:24.100 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:24.100 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:24.100 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:24.100 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:24.100 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:24.101 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:24.101 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:12:24.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.101 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:12:24.101 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.101 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:24.101 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:24.101 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:24.102 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:24.102 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.102 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:24.102 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:12:24.102 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.102 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.102 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.103 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:24.103 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:12:24.103 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.103 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.103 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.103 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.103 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:12:24.104 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:12:24.104 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:24.104 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:24.104 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.104 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:24.104 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:24.104 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:24.105 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:24.105 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.105 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:24.105 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:12:24.105 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.105 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.106 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:24.106 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:12:24.106 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.106 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.106 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.106 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.106 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:12:24.107 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:12:24.107 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:24.107 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:24.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.107 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.107 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:12:24.107 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:12:24.108 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:24.108 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:24.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.108 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:24.108 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:12:24.108 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.109 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:24.109 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:12:24.109 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.109 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.109 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.109 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.109 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:12:24.110 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:12:24.110 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:24.110 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:24.110 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.110 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.110 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.110 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:12:24.111 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:12:24.111 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.111 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:24.111 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:24.111 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:24.111 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.111 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:24.112 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:12:24.112 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.112 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:24.112 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:24.112 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:24.112 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.112 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:24.112 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:12:24.113 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.113 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:24.113 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:24.113 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:12:24.113 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.113 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:24.113 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:12:24.114 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.114 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:24.114 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:24.114 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:12:24.114 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.114 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.114 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.115 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:12:24.116 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:12:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.219+0000 7fc84455a700 1 Processor -- start 2020-02-11T16:12:24.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.219+0000 7fc84455a700 1 -- start start 2020-02-11T16:12:24.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc84455a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc83c0a7120 0x7fc83c0a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:24.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc84455a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc83c0a3e70 0x7fc83c12ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:24.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc84455a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c0a5320 con 0x7fc83c0a39e0 2020-02-11T16:12:24.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc84455a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c130400 con 0x7fc83c0a7120 2020-02-11T16:12:24.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc84455a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c09e7a0 con 0x7fc83c0a3e70 2020-02-11T16:12:24.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc83c0a3e70 0x7fc83c12ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc83c0a3e70 0x7fc83c12ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54888/0 (socket says 172.21.15.88:54888) 2020-02-11T16:12:24.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 -- 172.21.15.88:0/289584384 learned_addr learned my addr 172.21.15.88:0/289584384 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:24.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc841af5700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc83c0a39e0 0x7fc83c12f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42514/0 (socket says 172.21.15.88:42514) 2020-02-11T16:12:24.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc8422f6700 1 --2- 172.21.15.88:0/289584384 >> v2:172.21.15.52:3300/0 conn(0x7fc83c0a7120 0x7fc83c0a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 -- 172.21.15.88:0/289584384 >> v2:172.21.15.52:3300/0 conn(0x7fc83c0a7120 msgr2=0x7fc83c0a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:24.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 --2- 172.21.15.88:0/289584384 >> v2:172.21.15.52:3300/0 conn(0x7fc83c0a7120 0x7fc83c0a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:24.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 -- 172.21.15.88:0/289584384 >> v1:172.21.15.88:6789/0 conn(0x7fc83c0a39e0 legacy=0x7fc83c12f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 -- 172.21.15.88:0/289584384 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0a5560 con 0x7fc83c0a3e70 2020-02-11T16:12:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc8412f4700 1 -- 172.21.15.88:0/289584384 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220006861 0 0) 0x7fc8300010d0 con 0x7fc83c0a39e0 2020-02-11T16:12:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 --2- 172.21.15.88:0/289584384 >> v2:172.21.15.88:3300/0 conn(0x7fc83c0a3e70 0x7fc83c12ffa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 --2- 172.21.15.88:0/289584384 >> v2:172.21.15.88:3300/0 conn(0x7fc83c0a3e70 0x7fc83c12ffa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 --2- 172.21.15.88:0/289584384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c0a3e70 0x7fc83c12ffa0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).ready entity=mon.1 client_cookie=d5049044e9286df0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 --2- 172.21.15.88:0/289584384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c0a3e70 0x7fc83c12ffa0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc8412f4700 1 -- 172.21.15.88:0/289584384 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc838011670 con 0x7fc83c0a3e70 2020-02-11T16:12:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 --2- 172.21.15.88:0/289584384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c0a3e70 0x7fc83c12ffa0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc842af7700 1 --2- 172.21.15.88:0/289584384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c0a3e70 0x7fc83c12ffa0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc8412f4700 1 -- 172.21.15.88:0/289584384 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8380117d0 con 0x7fc83c0a3e70 2020-02-11T16:12:24.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc8412f4700 1 -- 172.21.15.88:0/289584384 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc838011b70 con 0x7fc83c0a3e70 2020-02-11T16:12:24.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc84455a700 1 -- 172.21.15.88:0/289584384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c0a3e70 msgr2=0x7fc83c12ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.220+0000 7fc84455a700 1 --2- 172.21.15.88:0/289584384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c0a3e70 0x7fc83c12ffa0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).stop 2020-02-11T16:12:24.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.221+0000 7fc84455a700 1 -- 172.21.15.88:0/289584384 shutdown_connections 2020-02-11T16:12:24.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.221+0000 7fc84455a700 1 --2- 172.21.15.88:0/289584384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c0a3e70 0x7fc83c12ffa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.221+0000 7fc84455a700 1 --2- 172.21.15.88:0/289584384 >> v2:172.21.15.52:3300/0 conn(0x7fc83c0a7120 0x7fc83c0a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:24.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.221+0000 7fc84455a700 1 -- 172.21.15.88:0/289584384 >> 172.21.15.88:0/289584384 conn(0x7fc83c09d110 msgr2=0x7fc83c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:24.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.221+0000 7fc84455a700 1 -- 172.21.15.88:0/289584384 shutdown_connections 2020-02-11T16:12:24.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.221+0000 7fc84455a700 1 -- 172.21.15.88:0/289584384 wait complete. 2020-02-11T16:12:24.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc84455a700 1 Processor -- start 2020-02-11T16:12:24.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc84455a700 1 -- start start 2020-02-11T16:12:24.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc84455a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc83c0a3e70 0x7fc83c127700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc84455a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c0a7120 0x7fc83c127b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc84455a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c129640 con 0x7fc83c0a39e0 2020-02-11T16:12:24.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc84455a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c129a00 con 0x7fc83c0a3e70 2020-02-11T16:12:24.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc84455a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c129ca0 con 0x7fc83c0a7120 2020-02-11T16:12:24.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc8422f6700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc83c0a39e0 0x7fc83c135150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42518/0 (socket says 172.21.15.88:42518) 2020-02-11T16:12:24.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc8422f6700 1 -- 172.21.15.88:0/518270040 learned_addr learned my addr 172.21.15.88:0/518270040 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:24.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc841af5700 1 --2- 172.21.15.88:0/518270040 >> v2:172.21.15.52:3300/0 conn(0x7fc83c0a3e70 0x7fc83c127700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.222+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c0a7120 0x7fc83c127b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226790041 0 0) 0x7fc83c129640 con 0x7fc83c0a39e0 2020-02-11T16:12:24.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc81c002fe0 con 0x7fc83c0a39e0 2020-02-11T16:12:24.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3475115401 0 0) 0x7fc81c002fe0 con 0x7fc83c0a39e0 2020-02-11T16:12:24.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc83c129640 con 0x7fc83c0a39e0 2020-02-11T16:12:24.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fc834001810 con 0x7fc83c0a39e0 2020-02-11T16:12:24.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c0a7120 msgr2=0x7fc83c127b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c0a7120 0x7fc83c127b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 >> v2:172.21.15.52:3300/0 conn(0x7fc83c0a3e70 msgr2=0x7fc83c127700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 --2- 172.21.15.88:0/518270040 >> v2:172.21.15.52:3300/0 conn(0x7fc83c0a3e70 0x7fc83c127700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 >> v1:172.21.15.88:6789/0 conn(0x7fc83c0a39e0 legacy=0x7fc83c135150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc81c0049b0 0x7fc81c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c0a7120 0x7fc81c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c129a00 con 0x7fc81c0049b0 2020-02-11T16:12:24.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c129ca0 con 0x7fc81c003d80 2020-02-11T16:12:24.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0047a0 con 0x7fc83c0a7120 2020-02-11T16:12:24.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc841af5700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c0a7120 0x7fc81c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc81c0049b0 0x7fc81c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 -- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c0a7120 msgr2=0x7fc81c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c0a7120 0x7fc81c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 -- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc81c0049b0 msgr2=0x7fc81c004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc81c0049b0 0x7fc81c004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 -- 172.21.15.88:0/518270040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c129f40 con 0x7fc81c003d80 2020-02-11T16:12:24.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc81c0049b0 0x7fc81c004dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:12:24.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc84455a700 1 -- 172.21.15.88:0/518270040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c128500 con 0x7fc81c003d80 2020-02-11T16:12:24.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc84455a700 1 -- 172.21.15.88:0/518270040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c136730 con 0x7fc81c003d80 2020-02-11T16:12:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc838007340 con 0x7fc81c003d80 2020-02-11T16:12:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.223+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.224+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8380074a0 con 0x7fc81c003d80 2020-02-11T16:12:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.224+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8380058b0 con 0x7fc81c003d80 2020-02-11T16:12:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.224+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.224+0000 7fc84455a700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 0x7fc83c127b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.224+0000 7fc84455a700 1 -- 172.21.15.88:0/518270040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c136530 con 0x7fc83c135860 2020-02-11T16:12:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.224+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc838005a10 con 0x7fc81c003d80 2020-02-11T16:12:24.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.224+0000 7fc842af7700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.224+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 0x7fc83c127b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.224+0000 7fc82f7fe700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc81c041e40 0x7fc81c044300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.224+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc83804a070 con 0x7fc81c003d80 2020-02-11T16:12:24.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc841af5700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc81c041e40 0x7fc81c044300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc8422f6700 1 -- 172.21.15.88:0/518270040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc83c12a140 con 0x7fc83c135860 2020-02-11T16:12:24.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 0x7fc83c127b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 0x7fc83c127b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 0x7fc83c127b60 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:24.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc841af5700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc81c041e40 0x7fc81c044300 crc :-1 s=READY pgs=234 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:24.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 0x7fc83c127b60 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc834007350 con 0x7fc83c135860 2020-02-11T16:12:24.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 0x7fc83c127b60 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fc834010f10 con 0x7fc83c135860 2020-02-11T16:12:24.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 msgr2=0x7fc83c127b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc82f7fe700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 0x7fc83c127b60 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).stop 2020-02-11T16:12:24.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 msgr2=0x7fc83c127b60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:24.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc82f7fe700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c135860 0x7fc83c127b60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.225+0000 7fc842af7700 1 -- 172.21.15.88:0/518270040 reap_dead start 2020-02-11T16:12:24.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.233+0000 7fc84455a700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 0x7fc83c135130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:24.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.233+0000 7fc84455a700 1 -- 172.21.15.88:0/518270040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c05e2f0 con 0x7fc83c127700 2020-02-11T16:12:24.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.234+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 0x7fc83c135130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:24.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.234+0000 7fc8422f6700 1 -- 172.21.15.88:0/518270040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc83c0565b0 con 0x7fc83c127700 2020-02-11T16:12:24.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.234+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 0x7fc83c135130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.234+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 0x7fc83c135130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.234+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 0x7fc83c135130 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:24.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.234+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 0x7fc83c135130 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.234+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc83400ee30 con 0x7fc83c127700 2020-02-11T16:12:24.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc8422f6700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 0x7fc83c135130 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:24.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7fc83400bf20 con 0x7fc83c127700 2020-02-11T16:12:24.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 msgr2=0x7fc83c135130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc82f7fe700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 0x7fc83c135130 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fc834008320 tx=0x7fc834011c40).stop 2020-02-11T16:12:24.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc82f7fe700 1 -- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 msgr2=0x7fc83c135130 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:24.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc82f7fe700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 0x7fc83c135130 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 -- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc81c041e40 msgr2=0x7fc81c044300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc81c041e40 0x7fc81c044300 crc :-1 s=READY pgs=234 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 -- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 msgr2=0x7fc81c004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7fc838002f30 tx=0x7fc838007a40).stop 2020-02-11T16:12:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 -- 172.21.15.88:0/518270040 shutdown_connections 2020-02-11T16:12:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c003d80 0x7fc81c004200 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc81c041e40 0x7fc81c044300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 --2- 172.21.15.88:0/518270040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc83c127700 0x7fc83c135130 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 -- 172.21.15.88:0/518270040 >> 172.21.15.88:0/518270040 conn(0x7fc83c09d110 msgr2=0x7fc83c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 -- 172.21.15.88:0/518270040 shutdown_connections 2020-02-11T16:12:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:24.235+0000 7fc84455a700 1 -- 172.21.15.88:0/518270040 wait complete. 2020-02-11T16:12:24.250 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:12:24.250 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:12:24.250 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:12:24.251 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:12:24.251 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 62, 2020-02-11T16:12:24.251 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:12:24.251 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:12:24.251 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:12:24.251 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:12:24.252 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:24.252 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:12:24.252 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:24.252 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:12:24.252 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:12:24.252 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:24.252 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:24.252 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:24.253 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:24.253 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:24.253 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:24.253 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:24.253 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:12:24.253 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:12:24.253 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:24.254 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:24.254 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:24.254 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:24.254 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:24.254 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:24.254 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.255 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:12:24.255 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:12:24.256 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:12:24.256 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:12:24.257 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:12:24.257 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:12:24.257 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:24.257 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:24.257 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:12:24.257 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:12:24.257 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:24.258 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:12:24.258 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:24.258 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:24.258 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:24.258 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:24.258 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:24.258 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:24.259 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:24.259 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:12:24.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.259 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:12:24.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.259 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:24.259 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:24.260 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:24.260 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:24.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.260 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:24.260 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:12:24.260 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.261 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:24.261 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:12:24.261 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.261 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.261 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.261 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:12:24.262 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:12:24.262 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:24.262 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:24.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.262 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:24.262 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:24.263 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:24.263 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:24.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.263 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:24.263 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:12:24.263 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.264 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:24.264 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:12:24.264 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.264 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.264 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.265 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:12:24.265 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:12:24.265 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:24.265 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:24.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.265 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:12:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:12:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:12:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.267 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:24.267 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:12:24.267 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:24.267 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.267 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.268 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:12:24.268 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:12:24.268 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:24.268 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:24.268 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.268 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:24.268 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:12:24.269 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:12:24.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.269 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:24.269 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:24.269 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:24.269 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.269 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:24.270 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:12:24.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:24.270 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:24.270 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:24.270 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:24.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.270 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:24.271 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:24.271 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:12:24.272 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2020-02-11T16:12:24.272 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2020-02-11T16:12:24.272 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2020-02-11T16:12:24.272 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:12:24.273 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-02-11T16:12:24.273 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:12:24.283 INFO:tasks.ceph.mon.c:Stopped 2020-02-11T16:12:24.283 INFO:tasks.mon_thrash:Sending STOP to mon a 2020-02-11T16:12:24.284 INFO:tasks.ceph.mon.a:Sent signal 19 2020-02-11T16:12:24.284 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2020-02-11T16:12:39.285 INFO:tasks.mon_thrash:Sending CONT to mon a 2020-02-11T16:12:39.285 INFO:tasks.ceph.mon.a:Sent signal 18 2020-02-11T16:12:39.286 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:12:39.286 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:12:39.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.399+0000 7fa31bd7d700 1 Processor -- start 2020-02-11T16:12:39.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.399+0000 7fa31bd7d700 1 -- start start 2020-02-11T16:12:39.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa31bd7d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 0x7fa3140a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:39.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa31bd7d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:39.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa31bd7d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3140a4350 con 0x7fa3140a5410 2020-02-11T16:12:39.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa31bd7d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3140a1e60 con 0x7fa314131990 2020-02-11T16:12:39.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa31bd7d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140a3450 con 0x7fa3140a2fa0 2020-02-11T16:12:39.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa319318700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa3140a5410 0x7fa314131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42538/0 (socket says 172.21.15.88:42538) 2020-02-11T16:12:39.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa319318700 1 -- 172.21.15.88:0/1489448010 learned_addr learned my addr 172.21.15.88:0/1489448010 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:39.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa319b19700 1 -- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 msgr2=0x7fa3140a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:39.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 0x7fa3140a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:39.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:39.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:12:39.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:12:39.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:39.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.400+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.601+0000 7fa319b19700 1 -- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 msgr2=0x7fa3140a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.601+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 0x7fa3140a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:12:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.601+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.601+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:12:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.601+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:12:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.601+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:39.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:39.601+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:12:40.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.002+0000 7fa319b19700 1 -- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 msgr2=0x7fa3140a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:40.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.002+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 0x7fa3140a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:12:40.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.002+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:40.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.002+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:12:40.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.002+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:12:40.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.002+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:40.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.002+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:12:40.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.803+0000 7fa319b19700 1 -- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 msgr2=0x7fa3140a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:40.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.803+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 0x7fa3140a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:12:40.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.803+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:40.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.803+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:12:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.803+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:12:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.803+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:40.803+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:12:42.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:42.405+0000 7fa319b19700 1 -- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 msgr2=0x7fa3140a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:42.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:42.405+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 0x7fa3140a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:12:42.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:42.405+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:42.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:42.406+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:12:42.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:42.406+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:12:42.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:42.406+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:12:42.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:42.406+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:12:42.668 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:12:42.671 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:12:44.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.305+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203942207 0 0) 0x7fa3140a4350 con 0x7fa3140a5410 2020-02-11T16:12:44.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.305+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2fc003230 con 0x7fa3140a5410 2020-02-11T16:12:44.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1383684018 0 0) 0x7fa2fc003230 con 0x7fa3140a5410 2020-02-11T16:12:44.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 msgr2=0x7fa3140a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:12:44.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 0x7fa3140a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:44.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 msgr2=0x7fa3140a5890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:12:44.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 --2- 172.21.15.88:0/1489448010 >> v2:172.21.15.52:3300/0 conn(0x7fa314131990 0x7fa3140a5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3140a3a40 con 0x7fa3140a5410 2020-02-11T16:12:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa3100016b0 con 0x7fa3140a5410 2020-02-11T16:12:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 >> v1:172.21.15.88:6789/0 conn(0x7fa3140a5410 legacy=0x7fa314131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2fc003720 0x7fa2fc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 0x7fa2fc0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2fc004930 0x7fa2fc004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140a1e60 con 0x7fa2fc004930 2020-02-11T16:12:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc005390 con 0x7fa2fc003720 2020-02-11T16:12:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc004130 con 0x7fa3140a2fa0 2020-02-11T16:12:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa319318700 1 -- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 msgr2=0x7fa2fc0044d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa319318700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 0x7fa2fc0044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2fc003720 0x7fa2fc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.311+0000 7fa31a31a700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2fc004930 0x7fa2fc004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 -- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 msgr2=0x7fa2fc0044d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:12:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3140a2fa0 0x7fa2fc0044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 -- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2fc004930 msgr2=0x7fa2fc004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2fc004930 0x7fa2fc004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 -- 172.21.15.88:0/1489448010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc003230 con 0x7fa2fc003720 2020-02-11T16:12:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2fc003720 0x7fa2fc003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa304005b90 tx=0x7fa304008d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2fc003720 0x7fa2fc003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa304005b90 tx=0x7fa304008d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2fc003720 0x7fa2fc003b40 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa304008d20).ready entity=mon.1 client_cookie=b84f2615c7610e9b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2fc003720 0x7fa2fc003b40 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa304008d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa304003e70 con 0x7fa2fc003720 2020-02-11T16:12:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2fc003720 0x7fa2fc003b40 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa304008d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa304005540 con 0x7fa2fc003720 2020-02-11T16:12:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa319b19700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2fc003720 0x7fa2fc003b40 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa304008d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa31bd7d700 1 -- 172.21.15.88:0/1489448010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2fc003720 msgr2=0x7fa2fc003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa318b17700 1 -- 172.21.15.88:0/1489448010 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa304005920 con 0x7fa2fc003720 2020-02-11T16:12:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.312+0000 7fa31bd7d700 1 --2- 172.21.15.88:0/1489448010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2fc003720 0x7fa2fc003b40 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa304008d20).stop 2020-02-11T16:12:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.313+0000 7fa31a31a700 1 -- 172.21.15.88:0/1489448010 reap_dead start 2020-02-11T16:12:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.313+0000 7fa31bd7d700 1 -- 172.21.15.88:0/1489448010 shutdown_connections 2020-02-11T16:12:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.313+0000 7fa31bd7d700 1 -- 172.21.15.88:0/1489448010 >> 172.21.15.88:0/1489448010 conn(0x7fa31409d110 msgr2=0x7fa31409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.313+0000 7fa31bd7d700 1 -- 172.21.15.88:0/1489448010 shutdown_connections 2020-02-11T16:12:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.313+0000 7fa31bd7d700 1 -- 172.21.15.88:0/1489448010 wait complete. 2020-02-11T16:12:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.314+0000 7fa31bd7d700 1 Processor -- start 2020-02-11T16:12:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.314+0000 7fa31bd7d700 1 -- start start 2020-02-11T16:12:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa31bd7d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa3140a0950 0x7fa3141369f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa31bd7d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa314136e50 0x7fa314130440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa31bd7d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3141308a0 0x7fa3141485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa31bd7d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3140a7840 con 0x7fa314136e50 2020-02-11T16:12:44.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa31bd7d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3140a8260 con 0x7fa3140a0950 2020-02-11T16:12:44.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa31bd7d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa314137410 con 0x7fa3141308a0 2020-02-11T16:12:44.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa3140a0950 0x7fa3141369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa31a31a700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3141308a0 msgr2=0x7fa3141485b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:44.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa3140a0950 0x7fa3141369f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54948/0 (socket says 172.21.15.88:54948) 2020-02-11T16:12:44.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 -- 172.21.15.88:0/2576043691 learned_addr learned my addr 172.21.15.88:0/2576043691 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:44.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa31a31a700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3141308a0 0x7fa3141485b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:44.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319318700 1 --2- 172.21.15.88:0/2576043691 >> v2:172.21.15.52:3300/0 conn(0x7fa314136e50 0x7fa314130440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 -- 172.21.15.88:0/2576043691 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3141308a0 msgr2=0x7fa3141485b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:12:44.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3141308a0 0x7fa3141485b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 -- 172.21.15.88:0/2576043691 >> v2:172.21.15.52:3300/0 conn(0x7fa314136e50 msgr2=0x7fa314130440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> v2:172.21.15.52:3300/0 conn(0x7fa314136e50 0x7fa314130440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 -- 172.21.15.88:0/2576043691 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa314136470 con 0x7fa3140a0950 2020-02-11T16:12:44.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> v2:172.21.15.88:3300/0 conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> v2:172.21.15.88:3300/0 conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa302ffd700 1 -- 172.21.15.88:0/2576043691 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa304003e70 con 0x7fa3140a0950 2020-02-11T16:12:44.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.315+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.316+0000 7fa302ffd700 1 -- 172.21.15.88:0/2576043691 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa304005dc0 con 0x7fa3140a0950 2020-02-11T16:12:44.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.316+0000 7fa31bd7d700 1 -- 172.21.15.88:0/2576043691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa314137670 con 0x7fa3140a0950 2020-02-11T16:12:44.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.316+0000 7fa302ffd700 1 -- 172.21.15.88:0/2576043691 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30400f3e0 con 0x7fa3140a0950 2020-02-11T16:12:44.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.316+0000 7fa31bd7d700 1 -- 172.21.15.88:0/2576043691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3140a4780 con 0x7fa3140a0950 2020-02-11T16:12:44.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.316+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.316+0000 7fa302ffd700 1 -- 172.21.15.88:0/2576043691 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa30400f650 con 0x7fa3140a0950 2020-02-11T16:12:44.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.316+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.317+0000 7fa302ffd700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2f4039c80 0x7fa2f403c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.317+0000 7fa302ffd700 1 -- 172.21.15.88:0/2576043691 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa304049cf0 con 0x7fa3140a0950 2020-02-11T16:12:44.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.317+0000 7fa319318700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2f4039c80 0x7fa2f403c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.317+0000 7fa319318700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2f4039c80 0x7fa2f403c140 crc :-1 s=READY pgs=235 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.317+0000 7fa31bd7d700 1 -- 172.21.15.88:0/2576043691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3140565b0 con 0x7fa3140a0950 2020-02-11T16:12:44.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.321+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.321+0000 7fa302ffd700 1 -- 172.21.15.88:0/2576043691 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fa30402f390 con 0x7fa3140a0950 2020-02-11T16:12:44.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.505+0000 7fa31bd7d700 1 -- 172.21.15.88:0/2576043691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa3141345a0 con 0x7fa3140a0950 2020-02-11T16:12:44.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.505+0000 7fa319b19700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.505+0000 7fa302ffd700 1 -- 172.21.15.88:0/2576043691 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7fa304031ea0 con 0x7fa3140a0950 2020-02-11T16:12:44.508 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":64,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:12:44.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 -- 172.21.15.88:0/2576043691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2f4039c80 msgr2=0x7fa2f403c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2f4039c80 0x7fa2f403c140 crc :-1 s=READY pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 -- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 msgr2=0x7fa3141369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 0x7fa3141369f0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7fa304005b90 tx=0x7fa2fc0043b0).stop 2020-02-11T16:12:44.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 -- 172.21.15.88:0/2576043691 shutdown_connections 2020-02-11T16:12:44.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3141308a0 0x7fa3141485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3140a0950 0x7fa3141369f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 --2- 172.21.15.88:0/2576043691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2f4039c80 0x7fa2f403c140 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 --2- 172.21.15.88:0/2576043691 >> v2:172.21.15.52:3300/0 conn(0x7fa314136e50 0x7fa314130440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 -- 172.21.15.88:0/2576043691 >> 172.21.15.88:0/2576043691 conn(0x7fa31409d110 msgr2=0x7fa314069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:44.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 -- 172.21.15.88:0/2576043691 shutdown_connections 2020-02-11T16:12:44.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.507+0000 7fa31bd7d700 1 -- 172.21.15.88:0/2576043691 wait complete. 2020-02-11T16:12:44.518 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":64,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:12:44.519 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:12:44.519 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:12:44.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.623+0000 7fee07278700 1 Processor -- start 2020-02-11T16:12:44.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.623+0000 7fee07278700 1 -- start start 2020-02-11T16:12:44.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.623+0000 7fee07278700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee000a6260 0x7fee00135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:44.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.623+0000 7fee07278700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee000a31b0 con 0x7fee000a5de0 2020-02-11T16:12:44.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fee07278700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee000a3570 con 0x7fee000a18a0 2020-02-11T16:12:44.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fee07278700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee000a3810 con 0x7fee000a6260 2020-02-11T16:12:44.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fee05815700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee000a6260 msgr2=0x7fee00135160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:44.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fee05815700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee000a6260 0x7fee00135160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:44.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fee05014700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fee000a18a0 0x7fee000a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42586/0 (socket says 172.21.15.88:42586) 2020-02-11T16:12:44.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fee05014700 1 -- 172.21.15.88:0/2403646131 learned_addr learned my addr 172.21.15.88:0/2403646131 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:12:44.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208331862 0 0) 0x7fee000a3570 con 0x7fee000a18a0 2020-02-11T16:12:44.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fede8003230 con 0x7fee000a18a0 2020-02-11T16:12:44.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951199998 0 0) 0x7fee000a31b0 con 0x7fee000a5de0 2020-02-11T16:12:44.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee000a3570 con 0x7fee000a5de0 2020-02-11T16:12:44.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2464905855 0 0) 0x7fede8003230 con 0x7fee000a18a0 2020-02-11T16:12:44.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee000a6260 msgr2=0x7fee00135160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:12:44.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee000a6260 0x7fee00135160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 >> v1:172.21.15.52:6789/0 conn(0x7fee000a5de0 legacy=0x7fee00134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee000a3ab0 con 0x7fee000a18a0 2020-02-11T16:12:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fedf8001a50 con 0x7fee000a18a0 2020-02-11T16:12:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 >> v1:172.21.15.88:6789/0 conn(0x7fee000a18a0 legacy=0x7fee000a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede80038e0 0x7fede8003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fede80044d0 0x7fede8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee000a6260 0x7fede8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000a3810 con 0x7fede80044d0 2020-02-11T16:12:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede8005210 con 0x7fede80038e0 2020-02-11T16:12:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede800d930 con 0x7fee000a6260 2020-02-11T16:12:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fee05815700 1 -- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee000a6260 msgr2=0x7fede8004db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fee05815700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee000a6260 0x7fede8004db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fee05014700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede80038e0 0x7fede8003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.624+0000 7fee04813700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fede80044d0 0x7fede8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 -- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee000a6260 msgr2=0x7fede8004db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:12:44.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee000a6260 0x7fede8004db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:44.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 -- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fede80044d0 msgr2=0x7fede8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:12:44.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fede80044d0 0x7fede8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:44.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 -- 172.21.15.88:0/2403646131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede8003230 con 0x7fede80038e0 2020-02-11T16:12:44.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede80038e0 0x7fede8003ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fedf8001820 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede80038e0 0x7fede8003ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fedf8001820 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede80038e0 0x7fede8003ce0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7fedf8001820 tx=0x7fede8004420).ready entity=mon.1 client_cookie=17071eb1ccc44eba server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede80038e0 0x7fede8003ce0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7fedf8001820 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf800e540 con 0x7fede80038e0 2020-02-11T16:12:44.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede80038e0 0x7fede8003ce0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7fedf8001820 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05014700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede80038e0 0x7fede8003ce0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7fedf8001820 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf800e6a0 con 0x7fede80038e0 2020-02-11T16:12:44.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fedf3fff700 1 -- 172.21.15.88:0/2403646131 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf80100b0 con 0x7fede80038e0 2020-02-11T16:12:44.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee07278700 1 -- 172.21.15.88:0/2403646131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede80038e0 msgr2=0x7fede8003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee07278700 1 --2- 172.21.15.88:0/2403646131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede80038e0 0x7fede8003ce0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7fedf8001820 tx=0x7fede8004420).stop 2020-02-11T16:12:44.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee05815700 1 -- 172.21.15.88:0/2403646131 reap_dead start 2020-02-11T16:12:44.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee07278700 1 -- 172.21.15.88:0/2403646131 shutdown_connections 2020-02-11T16:12:44.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee07278700 1 -- 172.21.15.88:0/2403646131 >> 172.21.15.88:0/2403646131 conn(0x7fee0009d110 msgr2=0x7fee0009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:44.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee07278700 1 -- 172.21.15.88:0/2403646131 shutdown_connections 2020-02-11T16:12:44.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.625+0000 7fee07278700 1 -- 172.21.15.88:0/2403646131 wait complete. 2020-02-11T16:12:44.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.626+0000 7fee07278700 1 Processor -- start 2020-02-11T16:12:44.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.626+0000 7fee07278700 1 -- start start 2020-02-11T16:12:44.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee07278700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee00128830 0x7fee0012de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee07278700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fee00125e70 0x7fee00126320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee07278700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0012b330 con 0x7fee00132020 2020-02-11T16:12:44.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee07278700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee00145860 con 0x7fee00125e70 2020-02-11T16:12:44.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee07278700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0012c3a0 con 0x7fee00128830 2020-02-11T16:12:44.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee00128830 0x7fee0012de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee00128830 0x7fee0012de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54968/0 (socket says 172.21.15.88:54968) 2020-02-11T16:12:44.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 -- 172.21.15.88:0/1601785290 learned_addr learned my addr 172.21.15.88:0/1601785290 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:44.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05815700 1 --2- 172.21.15.88:0/1601785290 >> v2:172.21.15.52:3300/0 conn(0x7fee00125e70 0x7fee00126320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 -- 172.21.15.88:0/1601785290 >> v2:172.21.15.52:3300/0 conn(0x7fee00125e70 msgr2=0x7fee00126320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 --2- 172.21.15.88:0/1601785290 >> v2:172.21.15.52:3300/0 conn(0x7fee00125e70 0x7fee00126320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 -- 172.21.15.88:0/1601785290 >> v1:172.21.15.52:6789/0 conn(0x7fee00132020 legacy=0x7fee00144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 -- 172.21.15.88:0/1601785290 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee001314d0 con 0x7fee00128830 2020-02-11T16:12:44.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 --2- 172.21.15.88:0/1601785290 >> v2:172.21.15.88:3300/0 conn(0x7fee00128830 0x7fee0012de10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee0012dd20 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 --2- 172.21.15.88:0/1601785290 >> v2:172.21.15.88:3300/0 conn(0x7fee00128830 0x7fee0012de10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee0012dd20 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00128830 0x7fee0012de10 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7fee0012dd20 tx=0x7fede8004420).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00128830 0x7fee0012de10 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fee0012dd20 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00128830 0x7fee0012de10 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fee0012dd20 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf8004b20 con 0x7fee00128830 2020-02-11T16:12:44.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee05014700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00128830 0x7fee0012de10 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fee0012dd20 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf8004c80 con 0x7fee00128830 2020-02-11T16:12:44.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fee07278700 1 -- 172.21.15.88:0/1601785290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0012c840 con 0x7fee00128830 2020-02-11T16:12:44.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.627+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf8004e30 con 0x7fee00128830 2020-02-11T16:12:44.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.628+0000 7fee07278700 1 -- 172.21.15.88:0/1601785290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee001269c0 con 0x7fee00128830 2020-02-11T16:12:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.628+0000 7fee05014700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00128830 0x7fee0012de10 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fee0012dd20 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.628+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fedf8001510 con 0x7fee00128830 2020-02-11T16:12:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.628+0000 7fee05014700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00128830 0x7fee0012de10 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fee0012dd20 tx=0x7fede8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.628+0000 7fee07278700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 0x7fee00127090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.628+0000 7fee07278700 1 -- 172.21.15.88:0/1601785290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0005e2f0 con 0x7fee00129510 2020-02-11T16:12:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.628+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 0x7fee00127090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.628+0000 7fedf27fc700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039cd0 0x7fede003c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fedf804a380 con 0x7fee00128830 2020-02-11T16:12:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fee04813700 1 -- 172.21.15.88:0/1601785290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee0012c220 con 0x7fee00129510 2020-02-11T16:12:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 0x7fee00127090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 0x7fee00127090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 0x7fee00127090 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fee05815700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039cd0 0x7fede003c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 0x7fee00127090 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf400cc20 con 0x7fee00129510 2020-02-11T16:12:44.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 0x7fee00127090 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fedf400cd80 con 0x7fee00129510 2020-02-11T16:12:44.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 msgr2=0x7fee00127090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fedf27fc700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 0x7fee00127090 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).stop 2020-02-11T16:12:44.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 msgr2=0x7fee00127090 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:44.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fedf27fc700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00129510 0x7fee00127090 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.629+0000 7fee05815700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039cd0 0x7fede003c190 crc :-1 s=READY pgs=236 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.637+0000 7fee07278700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 0x7fee001278d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.637+0000 7fee07278700 1 -- 172.21.15.88:0/1601785290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000565b0 con 0x7fee001274f0 2020-02-11T16:12:44.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.637+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 0x7fee001278d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.637+0000 7fee04813700 1 -- 172.21.15.88:0/1601785290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fee00132440 con 0x7fee001274f0 2020-02-11T16:12:44.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 0x7fee001278d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 0x7fee001278d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 0x7fee001278d0 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 0x7fee001278d0 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf4010270 con 0x7fee001274f0 2020-02-11T16:12:44.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee04813700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 0x7fee001278d0 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4348 (secure 0 0 0) 0x7fedf40126f0 con 0x7fee001274f0 2020-02-11T16:12:44.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 msgr2=0x7fee001278d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fedf27fc700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 0x7fee001278d0 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).stop 2020-02-11T16:12:44.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fedf27fc700 1 -- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 msgr2=0x7fee001278d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:44.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fedf27fc700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee001274f0 0x7fee001278d0 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rx=0x7fee0012b9b0 tx=0x7fedf4010bd0).stop 2020-02-11T16:12:44.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee07278700 1 -- 172.21.15.88:0/1601785290 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039cd0 msgr2=0x7fede003c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee07278700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fede0039cd0 0x7fede003c190 crc :-1 s=READY pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee07278700 1 -- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00128830 msgr2=0x7fee0012de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee07278700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00128830 0x7fee0012de10 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7fee0012dd20 tx=0x7fede8004420).stop 2020-02-11T16:12:44.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee05815700 1 -- 172.21.15.88:0/1601785290 reap_dead start 2020-02-11T16:12:44.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee05815700 1 -- 172.21.15.88:0/1601785290 reap_dead start 2020-02-11T16:12:44.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee07278700 1 -- 172.21.15.88:0/1601785290 shutdown_connections 2020-02-11T16:12:44.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee07278700 1 --2- 172.21.15.88:0/1601785290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee00128830 0x7fee0012de10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee07278700 1 -- 172.21.15.88:0/1601785290 >> 172.21.15.88:0/1601785290 conn(0x7fee0009d110 msgr2=0x7fee00069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:44.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee07278700 1 -- 172.21.15.88:0/1601785290 shutdown_connections 2020-02-11T16:12:44.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.638+0000 7fee07278700 1 -- 172.21.15.88:0/1601785290 wait complete. 2020-02-11T16:12:44.654 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:12:44.654 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:44.654 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:44.654 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:12:44.654 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 64, 2020-02-11T16:12:44.654 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:12:44.654 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:12:44.655 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:12:44.655 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.655 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:12:44.655 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:44.655 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:12:44.655 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:12:44.655 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:44.655 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:44.656 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:44.656 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:44.656 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:44.656 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:44.656 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.656 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:12:44.656 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:12:44.657 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:44.657 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:44.657 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:44.657 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:44.657 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:44.657 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:44.658 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.658 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:12:44.658 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:12:44.658 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:12:44.658 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:12:44.658 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:12:44.659 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:12:44.659 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:44.659 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:44.659 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:12:44.659 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:12:44.660 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:44.660 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:12:44.660 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:44.660 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:44.660 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:44.660 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:44.661 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:44.661 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:44.661 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.661 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:12:44.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.661 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:12:44.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.661 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:44.662 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:44.662 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:44.662 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:44.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.662 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:44.662 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:12:44.662 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.663 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:44.663 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:12:44.663 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.663 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.663 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.664 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:12:44.664 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:12:44.664 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:44.664 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:44.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.664 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:44.665 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:44.665 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:44.665 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:44.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.665 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:44.665 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:12:44.665 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.666 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:44.666 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:12:44.666 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.666 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.667 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:12:44.667 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:12:44.667 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:44.667 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:44.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.667 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:12:44.668 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:12:44.668 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:44.668 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:44.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.668 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:44.668 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:12:44.668 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.669 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:44.669 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:12:44.669 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.669 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.669 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.670 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:12:44.670 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:12:44.670 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:44.670 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:44.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.670 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.671 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:12:44.671 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:12:44.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.671 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:44.671 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:44.671 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:44.671 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.672 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.672 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:12:44.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.672 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:44.672 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:44.672 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:44.672 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.673 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.673 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:12:44.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.673 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:44.673 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:44.673 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:12:44.673 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.674 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.674 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:12:44.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.674 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:44.674 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:44.674 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:12:44.674 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.675 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.675 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:12:44.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.675 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:44.675 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:44.675 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:12:44.675 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.675 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.676 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.676 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:12:44.676 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:12:44.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.781+0000 7fdd23a35700 1 Processor -- start 2020-02-11T16:12:44.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.781+0000 7fdd23a35700 1 -- start start 2020-02-11T16:12:44.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.782+0000 7fdd23a35700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:44.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.782+0000 7fdd23a35700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 0x7fdd1c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:12:44.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.782+0000 7fdd23a35700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c0a3f60 con 0x7fdd1c0a3ad0 2020-02-11T16:12:44.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.782+0000 7fdd23a35700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c1382e0 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.782+0000 7fdd23a35700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c138580 con 0x7fdd1c0a1e50 2020-02-11T16:12:44.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.782+0000 7fdd20fd0700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 msgr2=0x7fdd1c0a3670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:44.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.782+0000 7fdd20fd0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 0x7fdd1c0a3670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:44.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.782+0000 7fdd217d1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.782+0000 7fdd217d1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:40966/0 (socket says 172.21.15.88:40966) 2020-02-11T16:12:44.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.782+0000 7fdd217d1700 1 -- 172.21.15.88:0/2785661302 learned_addr learned my addr 172.21.15.88:0/2785661302 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:44.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd217d1700 1 -- 172.21.15.88:0/2785661302 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 msgr2=0x7fdd1c0a3670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:12:44.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2785661302 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 0x7fdd1c0a3670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:44.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd217d1700 1 -- 172.21.15.88:0/2785661302 >> v1:172.21.15.52:6789/0 conn(0x7fdd1c0a3ad0 legacy=0x7fdd1c134e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd217d1700 1 -- 172.21.15.88:0/2785661302 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c138820 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2785661302 >> v2:172.21.15.52:3300/0 conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd0c002f30 tx=0x7fdd0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2785661302 >> v2:172.21.15.52:3300/0 conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd0c002f30 tx=0x7fdd0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2785661302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd0c0088e0).ready entity=mon.0 client_cookie=b84b76afe38f291b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2785661302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd0bfff700 1 -- 172.21.15.88:0/2785661302 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c008e20 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2785661302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2785661302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd0bfff700 1 -- 172.21.15.88:0/2785661302 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c011950 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd0bfff700 1 -- 172.21.15.88:0/2785661302 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c011d30 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd23a35700 1 -- 172.21.15.88:0/2785661302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c05c1f0 msgr2=0x7fdd1c137cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd23a35700 1 --2- 172.21.15.88:0/2785661302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd0c0088e0).stop 2020-02-11T16:12:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd23a35700 1 -- 172.21.15.88:0/2785661302 shutdown_connections 2020-02-11T16:12:44.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd23a35700 1 --2- 172.21.15.88:0/2785661302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c137cf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd23a35700 1 --2- 172.21.15.88:0/2785661302 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 0x7fdd1c0a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:12:44.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.783+0000 7fdd23a35700 1 -- 172.21.15.88:0/2785661302 >> 172.21.15.88:0/2785661302 conn(0x7fdd1c0ab400 msgr2=0x7fdd1c0a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:44.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.784+0000 7fdd23a35700 1 -- 172.21.15.88:0/2785661302 shutdown_connections 2020-02-11T16:12:44.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.784+0000 7fdd23a35700 1 -- 172.21.15.88:0/2785661302 wait complete. 2020-02-11T16:12:44.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.784+0000 7fdd23a35700 1 Processor -- start 2020-02-11T16:12:44.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.784+0000 7fdd23a35700 1 -- start start 2020-02-11T16:12:44.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd23a35700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd1c05c1f0 0x7fdd1c131d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd23a35700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 0x7fdd1c13b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd23a35700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c138e60 con 0x7fdd1c0a3ad0 2020-02-11T16:12:44.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd23a35700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c13b590 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd23a35700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c13acb0 con 0x7fdd1c0a1e50 2020-02-11T16:12:44.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd20fd0700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 msgr2=0x7fdd1c13b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:12:44.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd20fd0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 0x7fdd1c13b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:12:44.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd217d1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd1c05c1f0 0x7fdd1c131d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd217d1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd1c05c1f0 0x7fdd1c131d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54986/0 (socket says 172.21.15.88:54986) 2020-02-11T16:12:44.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd217d1700 1 -- 172.21.15.88:0/2866264697 learned_addr learned my addr 172.21.15.88:0/2866264697 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:12:44.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd217d1700 1 -- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 msgr2=0x7fdd1c13b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:12:44.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1c0a1e50 0x7fdd1c13b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd217d1700 1 -- 172.21.15.88:0/2866264697 >> v1:172.21.15.52:6789/0 conn(0x7fdd1c0a3ad0 legacy=0x7fdd1c128dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd217d1700 1 -- 172.21.15.88:0/2866264697 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c13bde0 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2866264697 >> v2:172.21.15.88:3300/0 conn(0x7fdd1c05c1f0 0x7fdd1c131d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd1c05c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2866264697 >> v2:172.21.15.88:3300/0 conn(0x7fdd1c05c1f0 0x7fdd1c131d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd1c05c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.785+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c131d00 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd1c05c5d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.786+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c131d00 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd1c05c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.786+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c00f8d0 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.786+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c131d00 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd1c05c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.786+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c131d00 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd1c05c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.786+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c007340 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.786+0000 7fdd23a35700 1 -- 172.21.15.88:0/2866264697 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c13aec0 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.786+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c007570 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.786+0000 7fdd23a35700 1 -- 172.21.15.88:0/2866264697 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c133c90 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.786+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c131d00 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd1c05c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdd0c0058b0 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd23a35700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 0x7fdd1c0a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd217d1700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c131d00 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd1c05c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd23a35700 1 -- 172.21.15.88:0/2866264697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c05c630 con 0x7fdd1c1294e0 2020-02-11T16:12:44.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd0a7fc700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdcfc039c70 0x7fdcfc03c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdd0c04a300 con 0x7fdd1c05c1f0 2020-02-11T16:12:44.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 0x7fdd1c0a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd21fd2700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdcfc039c70 0x7fdcfc03c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd20fd0700 1 -- 172.21.15.88:0/2866264697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd1c13b6e0 con 0x7fdd1c1294e0 2020-02-11T16:12:44.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 0x7fdd1c0a6a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd21fd2700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdcfc039c70 0x7fdcfc03c130 crc :-1 s=READY pgs=237 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 0x7fdd1c0a6a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.787+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 0x7fdd1c0a6a40 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.788+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 0x7fdd1c0a6a40 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.788+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd18004c90 con 0x7fdd1c1294e0 2020-02-11T16:12:44.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.788+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 0x7fdd1c0a6a40 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.788+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fdd18004df0 con 0x7fdd1c1294e0 2020-02-11T16:12:44.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.788+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 msgr2=0x7fdd1c0a6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.788+0000 7fdd0a7fc700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 0x7fdd1c0a6a40 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).stop 2020-02-11T16:12:44.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.788+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 msgr2=0x7fdd1c0a6a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:44.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.788+0000 7fdd0a7fc700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c1294e0 0x7fdd1c0a6a40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.796+0000 7fdd23a35700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 0x7fdd1c0a8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:12:44.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.796+0000 7fdd23a35700 1 -- 172.21.15.88:0/2866264697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c133ad0 con 0x7fdd1c139ed0 2020-02-11T16:12:44.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.796+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 0x7fdd1c0a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:12:44.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.796+0000 7fdd20fd0700 1 -- 172.21.15.88:0/2866264697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdd1c139440 con 0x7fdd1c139ed0 2020-02-11T16:12:44.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.796+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 0x7fdd1c0a8760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 0x7fdd1c0a8760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 0x7fdd1c0a8760 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:12:44.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 0x7fdd1c0a8760 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1800f5f0 con 0x7fdd1c139ed0 2020-02-11T16:12:44.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd20fd0700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 0x7fdd1c0a8760 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:12:44.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4180 (secure 0 0 0) 0x7fdd1800f750 con 0x7fdd1c139ed0 2020-02-11T16:12:44.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 msgr2=0x7fdd1c0a8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd0a7fc700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 0x7fdd1c0a8760 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).stop 2020-02-11T16:12:44.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd0a7fc700 1 -- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 msgr2=0x7fdd1c0a8760 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:12:44.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd0a7fc700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd1c139ed0 0x7fdd1c0a8760 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0x7fdd18003480 tx=0x7fdd18010950).stop 2020-02-11T16:12:44.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd23a35700 1 -- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdcfc039c70 msgr2=0x7fdcfc03c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd23a35700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdcfc039c70 0x7fdcfc03c130 crc :-1 s=READY pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd23a35700 1 -- 172.21.15.88:0/2866264697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd1c05c1f0 msgr2=0x7fdd1c131d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:12:44.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd23a35700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c131d00 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7fdd0c002f30 tx=0x7fdd1c05c5d0).stop 2020-02-11T16:12:44.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd21fd2700 1 -- 172.21.15.88:0/2866264697 reap_dead start 2020-02-11T16:12:44.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd21fd2700 1 -- 172.21.15.88:0/2866264697 reap_dead start 2020-02-11T16:12:44.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd23a35700 1 -- 172.21.15.88:0/2866264697 shutdown_connections 2020-02-11T16:12:44.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd23a35700 1 --2- 172.21.15.88:0/2866264697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd1c05c1f0 0x7fdd1c131d00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:12:44.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd23a35700 1 -- 172.21.15.88:0/2866264697 >> 172.21.15.88:0/2866264697 conn(0x7fdd1c0ab400 msgr2=0x7fdd1c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:12:44.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd23a35700 1 -- 172.21.15.88:0/2866264697 shutdown_connections 2020-02-11T16:12:44.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:12:44.797+0000 7fdd23a35700 1 -- 172.21.15.88:0/2866264697 wait complete. 2020-02-11T16:12:44.808 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:12:44.808 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:44.808 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:44.808 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:12:44.808 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 64, 2020-02-11T16:12:44.808 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:12:44.808 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:12:44.809 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:12:44.809 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.809 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:12:44.809 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:44.809 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:12:44.809 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:12:44.809 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:44.810 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:44.810 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:44.810 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:44.810 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:44.810 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:44.810 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.810 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:12:44.810 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:12:44.811 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:44.811 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:44.811 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:44.811 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:44.811 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:44.811 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:44.811 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.812 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:12:44.812 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:12:44.812 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:12:44.812 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:12:44.812 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:12:44.812 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:12:44.812 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:44.813 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:12:44.813 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:12:44.813 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:12:44.813 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:12:44.813 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:12:44.813 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:12:44.813 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:12:44.814 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:12:44.814 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:12:44.814 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:12:44.814 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:12:44.814 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.814 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:12:44.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.815 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:12:44.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.815 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:12:44.815 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:12:44.815 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:44.815 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:44.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.816 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:44.816 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:12:44.816 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.816 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:44.816 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:12:44.816 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.817 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.817 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.817 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:12:44.817 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:12:44.817 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:44.818 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:44.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.818 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:12:44.818 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:12:44.818 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:44.818 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:44.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.819 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:44.819 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:12:44.819 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.819 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:44.819 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:12:44.820 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.820 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.820 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.820 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:12:44.820 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:12:44.820 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:44.820 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:44.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.821 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:12:44.821 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:12:44.821 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:12:44.821 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:12:44.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.822 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:12:44.822 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:12:44.822 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.822 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:12:44.822 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:12:44.823 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:12:44.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.823 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.823 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:12:44.823 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:12:44.823 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:12:44.823 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:12:44.824 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.824 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:12:44.824 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:12:44.824 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:12:44.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.824 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:44.825 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:44.825 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:44.825 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.825 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.825 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:12:44.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.825 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:44.826 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:44.826 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:12:44.826 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.826 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.826 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:12:44.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.826 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:44.826 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:44.827 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:12:44.827 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.827 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:12:44.827 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:12:44.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:12:44.827 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:12:44.827 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:12:44.828 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:12:44.828 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.828 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:12:44.828 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:12:44.828 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:12:44.829 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:13:04.830 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:13:04.831 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2020-02-11T16:13:04.831 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-11T16:13:04.831 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-11T16:13:04.834 INFO:tasks.ceph.mon.c:Started 2020-02-11T16:13:04.834 INFO:tasks.mon_thrash:Sending STOP to mon a 2020-02-11T16:13:04.834 INFO:tasks.ceph.mon.a:Sent signal 19 2020-02-11T16:13:04.835 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2020-02-11T16:13:12.817 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:13:12.820 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:13:19.835 INFO:tasks.mon_thrash:Sending CONT to mon a 2020-02-11T16:13:19.836 INFO:tasks.ceph.mon.a:Sent signal 18 2020-02-11T16:13:19.836 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:13:19.836 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:13:19.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.953+0000 7ffac478f700 1 Processor -- start 2020-02-11T16:13:19.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.953+0000 7ffac478f700 1 -- start start 2020-02-11T16:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.954+0000 7ffac478f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffabc0a18a0 0x7ffabc0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.954+0000 7ffac478f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.954+0000 7ffac478f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc0a31b0 con 0x7ffabc12e3a0 2020-02-11T16:13:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.954+0000 7ffac478f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc0a3570 con 0x7ffabc0a18a0 2020-02-11T16:13:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.954+0000 7ffac478f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc0a3810 con 0x7ffabc0a5de0 2020-02-11T16:13:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.954+0000 7ffac252b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffabc0a18a0 0x7ffabc0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:19.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.954+0000 7ffac1d2a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.954+0000 7ffac1d2a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:49330/0 (socket says 172.21.15.88:49330) 2020-02-11T16:13:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.954+0000 7ffac252b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffabc0a18a0 0x7ffabc0a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:40992/0 (socket says 172.21.15.88:40992) 2020-02-11T16:13:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.954+0000 7ffac1d2a700 1 -- 172.21.15.88:0/2633538767 learned_addr learned my addr 172.21.15.88:0/2633538767 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1d2a700 1 -- 172.21.15.88:0/2633538767 >> v2:172.21.15.52:3300/0 conn(0x7ffabc0a18a0 msgr2=0x7ffabc0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1d2a700 1 --2- 172.21.15.88:0/2633538767 >> v2:172.21.15.52:3300/0 conn(0x7ffabc0a18a0 0x7ffabc0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1d2a700 1 -- 172.21.15.88:0/2633538767 >> v1:172.21.15.52:6789/0 conn(0x7ffabc12e3a0 legacy=0x7ffabc12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1d2a700 1 -- 172.21.15.88:0/2633538767 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc0a3ab0 con 0x7ffabc0a5de0 2020-02-11T16:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1d2a700 1 --2- 172.21.15.88:0/2633538767 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffaac002f30 tx=0x7ffaac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1d2a700 1 --2- 172.21.15.88:0/2633538767 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffaac002f30 tx=0x7ffaac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1d2a700 1 --2- 172.21.15.88:0/2633538767 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7ffaac002f30 tx=0x7ffaac0088e0).ready entity=mon.2 client_cookie=db4865ecef192eed server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1d2a700 1 --2- 172.21.15.88:0/2633538767 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7ffaac002f30 tx=0x7ffaac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1529700 1 -- 172.21.15.88:0/2633538767 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaac0116b0 con 0x7ffabc0a5de0 2020-02-11T16:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1d2a700 1 --2- 172.21.15.88:0/2633538767 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7ffaac002f30 tx=0x7ffaac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1d2a700 1 --2- 172.21.15.88:0/2633538767 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7ffaac002f30 tx=0x7ffaac0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1529700 1 -- 172.21.15.88:0/2633538767 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac011810 con 0x7ffabc0a5de0 2020-02-11T16:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac1529700 1 -- 172.21.15.88:0/2633538767 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaac011bf0 con 0x7ffabc0a5de0 2020-02-11T16:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac478f700 1 -- 172.21.15.88:0/2633538767 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 msgr2=0x7ffabc0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac478f700 1 --2- 172.21.15.88:0/2633538767 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7ffaac002f30 tx=0x7ffaac0088e0).stop 2020-02-11T16:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac478f700 1 -- 172.21.15.88:0/2633538767 shutdown_connections 2020-02-11T16:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac478f700 1 --2- 172.21.15.88:0/2633538767 >> v2:172.21.15.52:3300/0 conn(0x7ffabc0a18a0 0x7ffabc0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac478f700 1 --2- 172.21.15.88:0/2633538767 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffabc0a5de0 0x7ffabc0a6260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:19.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac478f700 1 -- 172.21.15.88:0/2633538767 >> 172.21.15.88:0/2633538767 conn(0x7ffabc09d110 msgr2=0x7ffabc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:19.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.955+0000 7ffac478f700 1 -- 172.21.15.88:0/2633538767 shutdown_connections 2020-02-11T16:13:19.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.956+0000 7ffac478f700 1 -- 172.21.15.88:0/2633538767 wait complete. 2020-02-11T16:13:19.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.956+0000 7ffac478f700 1 Processor -- start 2020-02-11T16:13:19.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.956+0000 7ffac478f700 1 -- start start 2020-02-11T16:13:19.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac478f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffabc0a18a0 0x7ffabc130310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:19.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac478f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffabc12e3a0 0x7ffabc1328f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:19.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac478f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc0a0950 con 0x7ffabc0a5de0 2020-02-11T16:13:19.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac478f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc130ce0 con 0x7ffabc12e3a0 2020-02-11T16:13:19.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac478f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc132000 con 0x7ffabc0a18a0 2020-02-11T16:13:19.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac252b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffabc0a18a0 0x7ffabc130310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:19.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac1d2a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffabc0a5de0 0x7ffabc128690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42636/0 (socket says 172.21.15.88:42636) 2020-02-11T16:13:19.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac1d2a700 1 -- 172.21.15.88:0/3829113116 learned_addr learned my addr 172.21.15.88:0/3829113116 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:19.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac2d2c700 1 --2- 172.21.15.88:0/3829113116 >> v2:172.21.15.52:3300/0 conn(0x7ffabc12e3a0 0x7ffabc1328f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:19.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac252b700 1 -- 172.21.15.88:0/3829113116 >> v2:172.21.15.52:3300/0 conn(0x7ffabc12e3a0 msgr2=0x7ffabc1328f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:19.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> v2:172.21.15.52:3300/0 conn(0x7ffabc12e3a0 0x7ffabc1328f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:19.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac252b700 1 -- 172.21.15.88:0/3829113116 >> v1:172.21.15.88:6789/0 conn(0x7ffabc0a5de0 legacy=0x7ffabc128690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:19.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffaab7fe700 1 -- 172.21.15.88:0/3829113116 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283189169 0 0) 0x7ffabc0a3ab0 con 0x7ffabc0a5de0 2020-02-11T16:13:19.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac252b700 1 -- 172.21.15.88:0/3829113116 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc12fe70 con 0x7ffabc0a18a0 2020-02-11T16:13:19.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> v2:172.21.15.88:3300/0 conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> v2:172.21.15.88:3300/0 conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.957+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:19.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffaab7fe700 1 -- 172.21.15.88:0/3829113116 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffab8007530 con 0x7ffabc0a18a0 2020-02-11T16:13:19.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffaab7fe700 1 -- 172.21.15.88:0/3829113116 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab80056c0 con 0x7ffabc0a18a0 2020-02-11T16:13:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffac478f700 1 -- 172.21.15.88:0/3829113116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc132d50 con 0x7ffabc0a18a0 2020-02-11T16:13:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffaab7fe700 1 -- 172.21.15.88:0/3829113116 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffab8005aa0 con 0x7ffabc0a18a0 2020-02-11T16:13:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffac478f700 1 -- 172.21.15.88:0/3829113116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc12f8e0 con 0x7ffabc0a18a0 2020-02-11T16:13:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffaab7fe700 1 -- 172.21.15.88:0/3829113116 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ffab8005d10 con 0x7ffabc0a18a0 2020-02-11T16:13:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.958+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.959+0000 7ffaab7fe700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa9c039a70 0x7ffa9c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:19.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.959+0000 7ffaab7fe700 1 -- 172.21.15.88:0/3829113116 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ffab800d0c0 con 0x7ffabc0a18a0 2020-02-11T16:13:19.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.959+0000 7ffac478f700 1 -- 172.21.15.88:0/3829113116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc130000 con 0x7ffabc0a18a0 2020-02-11T16:13:19.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.959+0000 7ffac1d2a700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa9c039a70 0x7ffa9c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:19.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.959+0000 7ffac1d2a700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa9c039a70 0x7ffa9c03bf30 crc :-1 s=READY pgs=239 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:19.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.962+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:19.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:19.962+0000 7ffaab7fe700 1 -- 172.21.15.88:0/3829113116 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ffab802f220 con 0x7ffabc0a18a0 2020-02-11T16:13:20.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.148+0000 7ffac478f700 1 -- 172.21.15.88:0/3829113116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ffabc0565b0 con 0x7ffabc0a18a0 2020-02-11T16:13:20.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.149+0000 7ffac252b700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.149+0000 7ffaab7fe700 1 -- 172.21.15.88:0/3829113116 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7ffab8031d10 con 0x7ffabc0a18a0 2020-02-11T16:13:20.151 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:20.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 -- 172.21.15.88:0/3829113116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa9c039a70 msgr2=0x7ffa9c03bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa9c039a70 0x7ffa9c03bf30 crc :-1 s=READY pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 -- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 msgr2=0x7ffabc130310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 0x7ffabc130310 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7ffab8002f30 tx=0x7ffab8010b90).stop 2020-02-11T16:13:20.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 -- 172.21.15.88:0/3829113116 shutdown_connections 2020-02-11T16:13:20.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ffa9c039a70 0x7ffa9c03bf30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 --2- 172.21.15.88:0/3829113116 >> v2:172.21.15.52:3300/0 conn(0x7ffabc12e3a0 0x7ffabc1328f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 --2- 172.21.15.88:0/3829113116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffabc0a18a0 0x7ffabc130310 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 -- 172.21.15.88:0/3829113116 >> 172.21.15.88:0/3829113116 conn(0x7ffabc09d110 msgr2=0x7ffabc0aa050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:20.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 -- 172.21.15.88:0/3829113116 shutdown_connections 2020-02-11T16:13:20.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.150+0000 7ffac478f700 1 -- 172.21.15.88:0/3829113116 wait complete. 2020-02-11T16:13:20.166 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":68,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:20.166 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:13:20.166 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:13:20.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.270+0000 7f6f5743a700 1 Processor -- start 2020-02-11T16:13:20.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.270+0000 7f6f5743a700 1 -- start start 2020-02-11T16:13:20.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.271+0000 7f6f5743a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f500a18a0 0x7f6f500a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:20.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.271+0000 7f6f5743a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6f500a6260 0x7f6f5012eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:20.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.271+0000 7f6f5743a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500a3570 con 0x7f6f500a5de0 2020-02-11T16:13:20.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.271+0000 7f6f5743a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f500a3810 con 0x7f6f500a18a0 2020-02-11T16:13:20.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.271+0000 7f6f5743a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f500a3ab0 con 0x7f6f500a6260 2020-02-11T16:13:20.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.271+0000 7f6f559d7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6f500a6260 0x7f6f5012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.271+0000 7f6f559d7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6f500a6260 0x7f6f5012eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55022/0 (socket says 172.21.15.88:55022) 2020-02-11T16:13:20.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.271+0000 7f6f559d7700 1 -- 172.21.15.88:0/1912426772 learned_addr learned my addr 172.21.15.88:0/1912426772 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:20.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.271+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1912426772 >> v2:172.21.15.52:3300/0 conn(0x7f6f500a18a0 0x7f6f500a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f559d7700 1 -- 172.21.15.88:0/1912426772 >> v2:172.21.15.52:3300/0 conn(0x7f6f500a18a0 msgr2=0x7f6f500a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:20.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f559d7700 1 --2- 172.21.15.88:0/1912426772 >> v2:172.21.15.52:3300/0 conn(0x7f6f500a18a0 0x7f6f500a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:20.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f559d7700 1 -- 172.21.15.88:0/1912426772 >> v1:172.21.15.52:6789/0 conn(0x7f6f500a5de0 legacy=0x7f6f5012e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:20.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f559d7700 1 -- 172.21.15.88:0/1912426772 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500a3d50 con 0x7f6f500a6260 2020-02-11T16:13:20.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1912426772 >> v2:172.21.15.52:3300/0 conn(0x7f6f500a18a0 0x7f6f500a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:13:20.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f559d7700 1 --2- 172.21.15.88:0/1912426772 >> v2:172.21.15.88:3300/0 conn(0x7f6f500a6260 0x7f6f5012eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f480032b0 tx=0x7f6f48007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f559d7700 1 --2- 172.21.15.88:0/1912426772 >> v2:172.21.15.88:3300/0 conn(0x7f6f500a6260 0x7f6f5012eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f480032b0 tx=0x7f6f48007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f559d7700 1 --2- 172.21.15.88:0/1912426772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f500a6260 0x7f6f5012eab0 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f6f480032b0 tx=0x7f6f48007dc0).ready entity=mon.1 client_cookie=19eefb0ac98b8e6f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f559d7700 1 --2- 172.21.15.88:0/1912426772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f500a6260 0x7f6f5012eab0 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f6f480032b0 tx=0x7f6f48007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f3ffff700 1 -- 172.21.15.88:0/1912426772 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f4800a160 con 0x7f6f500a6260 2020-02-11T16:13:20.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f559d7700 1 --2- 172.21.15.88:0/1912426772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f500a6260 0x7f6f5012eab0 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f6f480032b0 tx=0x7f6f48007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f559d7700 1 --2- 172.21.15.88:0/1912426772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f500a6260 0x7f6f5012eab0 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f6f480032b0 tx=0x7f6f48007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f3ffff700 1 -- 172.21.15.88:0/1912426772 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800a2c0 con 0x7f6f500a6260 2020-02-11T16:13:20.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f3ffff700 1 -- 172.21.15.88:0/1912426772 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f4800a6a0 con 0x7f6f500a6260 2020-02-11T16:13:20.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f5743a700 1 -- 172.21.15.88:0/1912426772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f500a6260 msgr2=0x7f6f5012eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f5743a700 1 --2- 172.21.15.88:0/1912426772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f500a6260 0x7f6f5012eab0 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f6f480032b0 tx=0x7f6f48007dc0).stop 2020-02-11T16:13:20.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f5743a700 1 -- 172.21.15.88:0/1912426772 shutdown_connections 2020-02-11T16:13:20.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f5743a700 1 --2- 172.21.15.88:0/1912426772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f500a6260 0x7f6f5012eab0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f5743a700 1 --2- 172.21.15.88:0/1912426772 >> v2:172.21.15.52:3300/0 conn(0x7f6f500a18a0 0x7f6f500a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:20.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f5743a700 1 -- 172.21.15.88:0/1912426772 >> 172.21.15.88:0/1912426772 conn(0x7f6f5009d110 msgr2=0x7f6f5009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:20.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f5743a700 1 -- 172.21.15.88:0/1912426772 shutdown_connections 2020-02-11T16:13:20.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.272+0000 7f6f5743a700 1 -- 172.21.15.88:0/1912426772 wait complete. 2020-02-11T16:13:20.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.273+0000 7f6f5743a700 1 Processor -- start 2020-02-11T16:13:20.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.273+0000 7f6f5743a700 1 -- start start 2020-02-11T16:13:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f5743a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f500a18a0 0x7f6f5009dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f5743a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f500a5de0 0x7f6f50143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f5743a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5009e320 con 0x7f6f500a6260 2020-02-11T16:13:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f5743a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5009fce0 con 0x7f6f500a18a0 2020-02-11T16:13:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f5743a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50142f10 con 0x7f6f500a5de0 2020-02-11T16:13:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f559d7700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6f500a6260 0x7f6f50066890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42652/0 (socket says 172.21.15.88:42652) 2020-02-11T16:13:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f559d7700 1 -- 172.21.15.88:0/1546739505 learned_addr learned my addr 172.21.15.88:0/1546739505 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> v2:172.21.15.52:3300/0 conn(0x7f6f500a18a0 0x7f6f5009dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f500a5de0 0x7f6f50143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60550859 0 0) 0x7f6f500a3d50 con 0x7f6f500a6260 2020-02-11T16:13:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f30002fe0 con 0x7f6f500a6260 2020-02-11T16:13:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2030725600 0 0) 0x7f6f30002fe0 con 0x7f6f500a6260 2020-02-11T16:13:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6f500a3d50 con 0x7f6f500a6260 2020-02-11T16:13:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f6f48011da0 con 0x7f6f500a6260 2020-02-11T16:13:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f500a5de0 msgr2=0x7f6f50143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f500a5de0 0x7f6f50143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 >> v2:172.21.15.52:3300/0 conn(0x7f6f500a18a0 msgr2=0x7f6f5009dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 --2- 172.21.15.88:0/1546739505 >> v2:172.21.15.52:3300/0 conn(0x7f6f500a18a0 0x7f6f5009dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 >> v1:172.21.15.88:6789/0 conn(0x7f6f500a6260 legacy=0x7f6f50066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.274+0000 7f6f3e7fc700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f30003920 0x7f6f30003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f3e7fc700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f300041c0 0x7f6f3000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5009fce0 con 0x7f6f300041c0 2020-02-11T16:13:20.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300053b0 con 0x7f6f300049b0 2020-02-11T16:13:20.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30005520 con 0x7f6f30003920 2020-02-11T16:13:20.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f500a5de0 0x7f6f50143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:13:20.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f559d7700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f300041c0 0x7f6f3000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f30003920 0x7f6f30003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 -- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f30003920 msgr2=0x7f6f30003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f30003920 0x7f6f30003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 -- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f300041c0 msgr2=0x7f6f3000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f300041c0 0x7f6f3000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 -- 172.21.15.88:0/1546739505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5009f3c0 con 0x7f6f300049b0 2020-02-11T16:13:20.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f5743a700 1 -- 172.21.15.88:0/1546739505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5009f6c0 con 0x7f6f300049b0 2020-02-11T16:13:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f40002f30 tx=0x7f6f40010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f40002f30 tx=0x7f6f40010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f6f40002f30 tx=0x7f6f40010e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f6f40002f30 tx=0x7f6f40010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f5743a700 1 -- 172.21.15.88:0/1546739505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5009eee0 con 0x7f6f300049b0 2020-02-11T16:13:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f40007530 con 0x7f6f300049b0 2020-02-11T16:13:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f6f40002f30 tx=0x7f6f40010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40011790 con 0x7f6f300049b0 2020-02-11T16:13:20.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f6f40002f30 tx=0x7f6f40010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.275+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f40011b30 con 0x7f6f300049b0 2020-02-11T16:13:20.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f6f40002f30 tx=0x7f6f40010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6f40011c90 con 0x7f6f300049b0 2020-02-11T16:13:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f551d6700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f6f40002f30 tx=0x7f6f40010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f5743a700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 0x7f6f50143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f5743a700 1 -- 172.21.15.88:0/1546739505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5005e2f0 con 0x7f6f50134bd0 2020-02-11T16:13:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 0x7f6f50143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f3e7fc700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f300425b0 0x7f6f30044a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6f40007e40 con 0x7f6f300049b0 2020-02-11T16:13:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f549d5700 1 -- 172.21.15.88:0/1546739505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f5009f1f0 con 0x7f6f50134bd0 2020-02-11T16:13:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f559d7700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f300425b0 0x7f6f30044a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 0x7f6f50143060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 0x7f6f50143060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 0x7f6f50143060 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 0x7f6f50143060 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f4c00cc20 con 0x7f6f50134bd0 2020-02-11T16:13:20.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.276+0000 7f6f559d7700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f300425b0 0x7f6f30044a70 crc :-1 s=READY pgs=240 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.277+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 0x7f6f50143060 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.277+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6f4c00cd80 con 0x7f6f50134bd0 2020-02-11T16:13:20.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.277+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 msgr2=0x7f6f50143060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.277+0000 7f6f3e7fc700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 0x7f6f50143060 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).stop 2020-02-11T16:13:20.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.277+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 msgr2=0x7f6f50143060 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:20.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.277+0000 7f6f3e7fc700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f50134bd0 0x7f6f50143060 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.277+0000 7f6f559d7700 1 -- 172.21.15.88:0/1546739505 reap_dead start 2020-02-11T16:13:20.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f5743a700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 0x7f6f50066890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f5743a700 1 -- 172.21.15.88:0/1546739505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500a0c60 con 0x7f6f5009dec0 2020-02-11T16:13:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 0x7f6f50066890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f549d5700 1 -- 172.21.15.88:0/1546739505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6f500565b0 con 0x7f6f5009dec0 2020-02-11T16:13:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 0x7f6f50066890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 0x7f6f50066890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 0x7f6f50066890 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 0x7f6f50066890 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f4c012ea0 con 0x7f6f5009dec0 2020-02-11T16:13:20.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f549d5700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 0x7f6f50066890 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.285+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7f6f4c0144b0 con 0x7f6f5009dec0 2020-02-11T16:13:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 msgr2=0x7f6f50066890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f3e7fc700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 0x7f6f50066890 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).stop 2020-02-11T16:13:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f3e7fc700 1 -- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 msgr2=0x7f6f50066890 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f3e7fc700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 0x7f6f50066890 secure :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0x7f6f5005bbc0 tx=0x7f6f4c010c00).stop 2020-02-11T16:13:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 -- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f300425b0 msgr2=0x7f6f30044a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f300425b0 0x7f6f30044a70 crc :-1 s=READY pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 -- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 msgr2=0x7f6f30004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f6f40002f30 tx=0x7f6f40010e60).stop 2020-02-11T16:13:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 -- 172.21.15.88:0/1546739505 shutdown_connections 2020-02-11T16:13:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f300049b0 0x7f6f30004dd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f300425b0 0x7f6f30044a70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 --2- 172.21.15.88:0/1546739505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5009dec0 0x7f6f50066890 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 -- 172.21.15.88:0/1546739505 >> 172.21.15.88:0/1546739505 conn(0x7f6f5009d110 msgr2=0x7f6f500a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:20.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 -- 172.21.15.88:0/1546739505 shutdown_connections 2020-02-11T16:13:20.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.286+0000 7f6f5743a700 1 -- 172.21.15.88:0/1546739505 wait complete. 2020-02-11T16:13:20.317 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:13:20.317 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:20.317 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:20.317 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:13:20.318 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 68, 2020-02-11T16:13:20.318 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:13:20.318 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:13:20.318 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:13:20.318 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:13:20.318 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.319 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:13:20.319 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:20.319 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:13:20.319 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:13:20.319 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:20.320 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:20.320 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:20.320 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:20.320 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:20.320 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:20.320 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.321 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:13:20.321 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:13:20.321 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:20.321 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:20.321 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:20.322 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:20.322 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:20.322 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:20.322 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.323 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:13:20.323 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:13:20.323 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:13:20.323 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:13:20.324 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:13:20.324 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:13:20.324 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:20.324 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:20.324 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:13:20.325 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:13:20.325 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:20.325 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:13:20.325 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:20.325 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:20.326 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:20.326 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:20.326 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:20.326 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:20.327 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.327 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:13:20.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.327 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:13:20.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.328 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:13:20.328 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:13:20.328 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:20.328 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:20.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.329 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:20.329 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:13:20.329 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.330 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:20.330 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:13:20.330 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.331 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.331 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.331 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:13:20.331 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:13:20.332 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:20.332 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:20.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.332 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:20.333 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:20.333 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:20.333 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:20.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.334 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:20.334 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:13:20.334 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:13:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.336 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:13:20.336 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:13:20.336 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:20.336 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:20.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.337 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:20.337 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:20.337 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:20.337 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:20.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.337 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:20.337 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:13:20.338 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.338 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:20.338 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:13:20.338 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.338 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.339 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.339 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:13:20.339 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:13:20.339 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:20.339 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:20.339 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.340 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.340 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:13:20.340 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:13:20.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.340 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.340 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.341 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:20.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.341 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.341 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:13:20.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.342 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.342 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.342 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:20.342 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.342 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.342 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:13:20.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.343 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.343 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.343 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:13:20.343 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.343 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.343 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:13:20.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.344 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.344 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.344 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:13:20.344 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.344 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.344 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:13:20.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.345 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.345 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.345 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:13:20.345 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.345 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.345 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.345 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:13:20.346 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:13:20.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.451+0000 7f03fc2c9700 1 Processor -- start 2020-02-11T16:13:20.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.451+0000 7f03fc2c9700 1 -- start start 2020-02-11T16:13:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fc2c9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f03f40a3a90 0x7f03f40a8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fc2c9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03f4136750 0x7f03f40a8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fc2c9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f40a4af0 con 0x7f03f40a7c00 2020-02-11T16:13:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fc2c9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f41302a0 con 0x7f03f40a3a90 2020-02-11T16:13:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fc2c9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4135a20 con 0x7f03f4136750 2020-02-11T16:13:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fa065700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f03f40a3a90 0x7f03f40a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fa065700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f03f40a3a90 0x7f03f40a8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55042/0 (socket says 172.21.15.88:55042) 2020-02-11T16:13:20.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fa065700 1 -- 172.21.15.88:0/356597059 learned_addr learned my addr 172.21.15.88:0/356597059 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:20.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03f9864700 1 --1- 172.21.15.88:0/356597059 >> v1:172.21.15.88:6789/0 conn(0x7f03f40a7c00 0x7f03f4136040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42668/0 (socket says 172.21.15.88:42668) 2020-02-11T16:13:20.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fa866700 1 --2- 172.21.15.88:0/356597059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03f4136750 0x7f03f40a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fa065700 1 -- 172.21.15.88:0/356597059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03f4136750 msgr2=0x7f03f40a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:20.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fa065700 1 --2- 172.21.15.88:0/356597059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03f4136750 0x7f03f40a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:20.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fa065700 1 -- 172.21.15.88:0/356597059 >> v1:172.21.15.88:6789/0 conn(0x7f03f40a7c00 legacy=0x7f03f4136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03f9063700 1 -- 172.21.15.88:0/356597059 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733958729 0 0) 0x7f03f40a4af0 con 0x7f03f40a7c00 2020-02-11T16:13:20.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.452+0000 7f03fa065700 1 -- 172.21.15.88:0/356597059 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f40a4d90 con 0x7f03f40a3a90 2020-02-11T16:13:20.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fa065700 1 --2- 172.21.15.88:0/356597059 >> v2:172.21.15.88:3300/0 conn(0x7f03f40a3a90 0x7f03f40a8690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f03f4062760 tx=0x7f03e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fa065700 1 --2- 172.21.15.88:0/356597059 >> v2:172.21.15.88:3300/0 conn(0x7f03f40a3a90 0x7f03f40a8690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f03f4062760 tx=0x7f03e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fa065700 1 --2- 172.21.15.88:0/356597059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f40a8690 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f03f4062760 tx=0x7f03e80088e0).ready entity=mon.1 client_cookie=96b9826c7f5f9f1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fa065700 1 --2- 172.21.15.88:0/356597059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f40a8690 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f03f4062760 tx=0x7f03e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03f9063700 1 -- 172.21.15.88:0/356597059 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8011670 con 0x7f03f40a3a90 2020-02-11T16:13:20.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fa065700 1 --2- 172.21.15.88:0/356597059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f40a8690 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f03f4062760 tx=0x7f03e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fa065700 1 --2- 172.21.15.88:0/356597059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f40a8690 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f03f4062760 tx=0x7f03e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03f9063700 1 -- 172.21.15.88:0/356597059 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e80117d0 con 0x7f03f40a3a90 2020-02-11T16:13:20.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03f9063700 1 -- 172.21.15.88:0/356597059 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8011b70 con 0x7f03f40a3a90 2020-02-11T16:13:20.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fc2c9700 1 -- 172.21.15.88:0/356597059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 msgr2=0x7f03f40a8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fc2c9700 1 --2- 172.21.15.88:0/356597059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f40a8690 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f03f4062760 tx=0x7f03e80088e0).stop 2020-02-11T16:13:20.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fc2c9700 1 -- 172.21.15.88:0/356597059 shutdown_connections 2020-02-11T16:13:20.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fc2c9700 1 --2- 172.21.15.88:0/356597059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03f4136750 0x7f03f40a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:20.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fc2c9700 1 --2- 172.21.15.88:0/356597059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f40a8690 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fc2c9700 1 -- 172.21.15.88:0/356597059 >> 172.21.15.88:0/356597059 conn(0x7f03f40ac2d0 msgr2=0x7f03f40ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:20.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fc2c9700 1 -- 172.21.15.88:0/356597059 shutdown_connections 2020-02-11T16:13:20.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.453+0000 7f03fc2c9700 1 -- 172.21.15.88:0/356597059 wait complete. 2020-02-11T16:13:20.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.454+0000 7f03fc2c9700 1 Processor -- start 2020-02-11T16:13:20.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.454+0000 7f03fc2c9700 1 -- start start 2020-02-11T16:13:20.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fc2c9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f03f40a3a90 0x7f03f4067000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fc2c9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f03f40a7c00 0x7f03f41310b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fc2c9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03f4136750 0x7f03f4131510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fc2c9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f41303e0 con 0x7f03f40a7c00 2020-02-11T16:13:20.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fc2c9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f4130610 con 0x7f03f40a3a90 2020-02-11T16:13:20.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fc2c9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f41308b0 con 0x7f03f4136750 2020-02-11T16:13:20.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f03f40a3a90 0x7f03f4067000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f03f40a3a90 0x7f03f4067000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55044/0 (socket says 172.21.15.88:55044) 2020-02-11T16:13:20.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 -- 172.21.15.88:0/3992275997 learned_addr learned my addr 172.21.15.88:0/3992275997 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:20.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa866700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03f4136750 0x7f03f4131510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> v2:172.21.15.52:3300/0 conn(0x7f03f40a7c00 0x7f03f41310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 -- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03f4136750 msgr2=0x7f03f4131510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03f4136750 0x7f03f4131510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 -- 172.21.15.88:0/3992275997 >> v2:172.21.15.52:3300/0 conn(0x7f03f40a7c00 msgr2=0x7f03f41310b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 --2- 172.21.15.88:0/3992275997 >> v2:172.21.15.52:3300/0 conn(0x7f03f40a7c00 0x7f03f41310b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 -- 172.21.15.88:0/3992275997 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f4063760 con 0x7f03f40a3a90 2020-02-11T16:13:20.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> v2:172.21.15.52:3300/0 conn(0x7f03f40a7c00 0x7f03f41310b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:13:20.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 --2- 172.21.15.88:0/3992275997 >> v2:172.21.15.88:3300/0 conn(0x7f03f40a3a90 0x7f03f4067000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03f4133140 tx=0x7f03f405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 --2- 172.21.15.88:0/3992275997 >> v2:172.21.15.88:3300/0 conn(0x7f03f40a3a90 0x7f03f4067000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03f4133140 tx=0x7f03f405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f4067000 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f03f4133140 tx=0x7f03f405bd40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f4067000 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f03f4133140 tx=0x7f03f405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8011c30 con 0x7f03f40a3a90 2020-02-11T16:13:20.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f4067000 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f03f4133140 tx=0x7f03f405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e8007340 con 0x7f03f40a3a90 2020-02-11T16:13:20.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fa065700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f4067000 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f03f4133140 tx=0x7f03f405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fc2c9700 1 -- 172.21.15.88:0/3992275997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f4131970 con 0x7f03f40a3a90 2020-02-11T16:13:20.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8007570 con 0x7f03f40a3a90 2020-02-11T16:13:20.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.455+0000 7f03fc2c9700 1 -- 172.21.15.88:0/3992275997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f4138a00 con 0x7f03f40a3a90 2020-02-11T16:13:20.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.456+0000 7f03fa065700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f4067000 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f03f4133140 tx=0x7f03f405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.456+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f03e80058b0 con 0x7f03f40a3a90 2020-02-11T16:13:20.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.456+0000 7f03fa065700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f4067000 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f03f4133140 tx=0x7f03f405bd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.456+0000 7f03fc2c9700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 0x7f03f412d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.456+0000 7f03fc2c9700 1 -- 172.21.15.88:0/3992275997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f405e2f0 con 0x7f03f412f8b0 2020-02-11T16:13:20.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.456+0000 7f03e77fe700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f03d4039c40 0x7f03d403c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.456+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f03e804a1b0 con 0x7f03f40a3a90 2020-02-11T16:13:20.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.456+0000 7f03fa866700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f03d4039c40 0x7f03d403c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.456+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 0x7f03f412d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03fa866700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f03d4039c40 0x7f03d403c100 crc :-1 s=READY pgs=241 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03f9864700 1 -- 172.21.15.88:0/3992275997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03f40565b0 con 0x7f03f412f8b0 2020-02-11T16:13:20.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 0x7f03f412d430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 0x7f03f412d430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 0x7f03f412d430 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 0x7f03f412d430 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f000c930 con 0x7f03f412f8b0 2020-02-11T16:13:20.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 0x7f03f412d430 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f03f000ca90 con 0x7f03f412f8b0 2020-02-11T16:13:20.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 msgr2=0x7f03f412d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03e77fe700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 0x7f03f412d430 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).stop 2020-02-11T16:13:20.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 msgr2=0x7f03f412d430 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:20.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.457+0000 7f03e77fe700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412f8b0 0x7f03f412d430 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).stop 2020-02-11T16:13:20.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.465+0000 7f03fc2c9700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 0x7f03f4142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.465+0000 7f03fc2c9700 1 -- 172.21.15.88:0/3992275997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4130750 con 0x7f03f412d890 2020-02-11T16:13:20.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.466+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 0x7f03f4142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.466+0000 7f03f9864700 1 -- 172.21.15.88:0/3992275997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f03f4133410 con 0x7f03f412d890 2020-02-11T16:13:20.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.466+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 0x7f03f4142c70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.466+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 0x7f03f4142c70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.466+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 0x7f03f4142c70 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.466+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 0x7f03f4142c70 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.466+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f0004a70 con 0x7f03f412d890 2020-02-11T16:13:20.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03f9864700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 0x7f03f4142c70 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4191 (secure 0 0 0) 0x7f03f0004bd0 con 0x7f03f412d890 2020-02-11T16:13:20.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 msgr2=0x7f03f4142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03e77fe700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 0x7f03f4142c70 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).stop 2020-02-11T16:13:20.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03e77fe700 1 -- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 msgr2=0x7f03f4142c70 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:20.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03e77fe700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03f412d890 0x7f03f4142c70 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0x7f03f0000b80 tx=0x7f03f000c4f0).stop 2020-02-11T16:13:20.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fc2c9700 1 -- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f03d4039c40 msgr2=0x7f03d403c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fc2c9700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f03d4039c40 0x7f03d403c100 crc :-1 s=READY pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fc2c9700 1 -- 172.21.15.88:0/3992275997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 msgr2=0x7f03f4067000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fc2c9700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f4067000 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f03f4133140 tx=0x7f03f405bd40).stop 2020-02-11T16:13:20.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fa866700 1 -- 172.21.15.88:0/3992275997 reap_dead start 2020-02-11T16:13:20.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fa866700 1 -- 172.21.15.88:0/3992275997 reap_dead start 2020-02-11T16:13:20.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fc2c9700 1 -- 172.21.15.88:0/3992275997 shutdown_connections 2020-02-11T16:13:20.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fc2c9700 1 --2- 172.21.15.88:0/3992275997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03f40a3a90 0x7f03f4067000 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fc2c9700 1 -- 172.21.15.88:0/3992275997 >> 172.21.15.88:0/3992275997 conn(0x7f03f40ac2d0 msgr2=0x7f03f4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:20.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fc2c9700 1 -- 172.21.15.88:0/3992275997 shutdown_connections 2020-02-11T16:13:20.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.467+0000 7f03fc2c9700 1 -- 172.21.15.88:0/3992275997 wait complete. 2020-02-11T16:13:20.485 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:13:20.485 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:13:20.485 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:13:20.485 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:13:20.486 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 68, 2020-02-11T16:13:20.486 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:13:20.486 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:13:20.486 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:13:20.486 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:13:20.486 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.486 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:13:20.487 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:20.487 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:13:20.487 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:13:20.487 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:20.487 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:20.487 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:20.487 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:20.488 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:20.488 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:20.488 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.488 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:13:20.488 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:13:20.488 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:20.489 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:20.489 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:20.489 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:20.489 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:20.489 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:20.489 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.490 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:13:20.490 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:13:20.490 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:13:20.490 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:13:20.491 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:13:20.491 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:13:20.491 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:20.491 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:20.491 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:13:20.492 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:13:20.492 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:20.492 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:13:20.492 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:20.492 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:20.493 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:20.493 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:20.493 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:20.493 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:20.493 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.493 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:13:20.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.494 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:13:20.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.494 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:13:20.494 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:13:20.494 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:20.495 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:20.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.495 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:20.495 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:13:20.495 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.496 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:20.496 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:13:20.496 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.496 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.496 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.496 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:13:20.497 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:13:20.497 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:20.497 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:20.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.497 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:20.497 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:20.498 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:20.498 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:20.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.498 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:20.498 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:13:20.498 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.499 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:20.499 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:13:20.499 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.499 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.500 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.500 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:13:20.500 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:13:20.500 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:20.500 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:20.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.501 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:20.501 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:20.501 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:13:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:13:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:13:20.504 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:13:20.504 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:20.504 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:20.504 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.504 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.505 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:13:20.505 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:13:20.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.505 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.506 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.506 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:20.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.506 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.506 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:13:20.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.507 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.507 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.507 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:20.507 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.508 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.508 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:13:20.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.508 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.508 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.509 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:13:20.509 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.509 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.509 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:13:20.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.510 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.510 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.510 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:13:20.510 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.510 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.511 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.511 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:13:20.512 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:13:20.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.616+0000 7fa967e5f700 1 Processor -- start 2020-02-11T16:13:20.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.616+0000 7fa967e5f700 1 -- start start 2020-02-11T16:13:20.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.617+0000 7fa967e5f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa9600a2fa0 0x7fa9600a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:20.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.617+0000 7fa967e5f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9600a5410 0x7fa9600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:20.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.617+0000 7fa967e5f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600a4350 con 0x7fa960131280 2020-02-11T16:13:20.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.617+0000 7fa967e5f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9600a1e60 con 0x7fa9600a2fa0 2020-02-11T16:13:20.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.617+0000 7fa967e5f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600a3450 con 0x7fa9600a5410 2020-02-11T16:13:20.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.617+0000 7fa965bfb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa9600a2fa0 0x7fa9600a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.617+0000 7fa9663fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa960131280 0x7fa9601316f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42686/0 (socket says 172.21.15.88:42686) 2020-02-11T16:13:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.617+0000 7fa9663fc700 1 -- 172.21.15.88:0/2152402671 learned_addr learned my addr 172.21.15.88:0/2152402671 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.617+0000 7fa9653fa700 1 --2- 172.21.15.88:0/2152402671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9600a5410 0x7fa9600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa965bfb700 1 -- 172.21.15.88:0/2152402671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9600a5410 msgr2=0x7fa9600a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa965bfb700 1 --2- 172.21.15.88:0/2152402671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9600a5410 0x7fa9600a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa965bfb700 1 -- 172.21.15.88:0/2152402671 >> v1:172.21.15.88:6789/0 conn(0x7fa960131280 legacy=0x7fa9601316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa965bfb700 1 -- 172.21.15.88:0/2152402671 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600a3a40 con 0x7fa9600a2fa0 2020-02-11T16:13:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa964bf9700 1 -- 172.21.15.88:0/2152402671 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123318863 0 0) 0x7fa9600a4350 con 0x7fa960131280 2020-02-11T16:13:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa9653fa700 1 --2- 172.21.15.88:0/2152402671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9600a5410 0x7fa9600a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:13:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa965bfb700 1 --2- 172.21.15.88:0/2152402671 >> v2:172.21.15.88:3300/0 conn(0x7fa9600a2fa0 0x7fa9600a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa954002f30 tx=0x7fa9540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa965bfb700 1 --2- 172.21.15.88:0/2152402671 >> v2:172.21.15.88:3300/0 conn(0x7fa9600a2fa0 0x7fa9600a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa954002f30 tx=0x7fa9540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa965bfb700 1 --2- 172.21.15.88:0/2152402671 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a1520 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7fa954002f30 tx=0x7fa9540088e0).ready entity=mon.1 client_cookie=651753372854e2d6 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa965bfb700 1 --2- 172.21.15.88:0/2152402671 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a1520 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fa954002f30 tx=0x7fa9540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa964bf9700 1 -- 172.21.15.88:0/2152402671 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa954008e40 con 0x7fa9600a2fa0 2020-02-11T16:13:20.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa965bfb700 1 --2- 172.21.15.88:0/2152402671 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a1520 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fa954002f30 tx=0x7fa9540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa965bfb700 1 --2- 172.21.15.88:0/2152402671 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a1520 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fa954002f30 tx=0x7fa9540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa964bf9700 1 -- 172.21.15.88:0/2152402671 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9540116a0 con 0x7fa9600a2fa0 2020-02-11T16:13:20.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa964bf9700 1 -- 172.21.15.88:0/2152402671 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa954011a40 con 0x7fa9600a2fa0 2020-02-11T16:13:20.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa967e5f700 1 -- 172.21.15.88:0/2152402671 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 msgr2=0x7fa9600a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa967e5f700 1 --2- 172.21.15.88:0/2152402671 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a1520 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7fa954002f30 tx=0x7fa9540088e0).stop 2020-02-11T16:13:20.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa967e5f700 1 -- 172.21.15.88:0/2152402671 shutdown_connections 2020-02-11T16:13:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa967e5f700 1 --2- 172.21.15.88:0/2152402671 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a1520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa967e5f700 1 --2- 172.21.15.88:0/2152402671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9600a5410 0x7fa9600a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa967e5f700 1 -- 172.21.15.88:0/2152402671 >> 172.21.15.88:0/2152402671 conn(0x7fa96009d110 msgr2=0x7fa96009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa967e5f700 1 -- 172.21.15.88:0/2152402671 shutdown_connections 2020-02-11T16:13:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.618+0000 7fa967e5f700 1 -- 172.21.15.88:0/2152402671 wait complete. 2020-02-11T16:13:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.619+0000 7fa967e5f700 1 Processor -- start 2020-02-11T16:13:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.619+0000 7fa967e5f700 1 -- start start 2020-02-11T16:13:20.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa967e5f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa9600a2fa0 0x7fa9600a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa967e5f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960131280 0x7fa9600a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa967e5f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600a9bf0 con 0x7fa9600a5410 2020-02-11T16:13:20.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa967e5f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9600a0d40 con 0x7fa9600a2fa0 2020-02-11T16:13:20.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa967e5f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa960063d10 con 0x7fa960131280 2020-02-11T16:13:20.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa9600a2fa0 0x7fa9600a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa9600a2fa0 0x7fa9600a0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55062/0 (socket says 172.21.15.88:55062) 2020-02-11T16:13:20.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 -- 172.21.15.88:0/961190353 learned_addr learned my addr 172.21.15.88:0/961190353 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:20.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 -- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960131280 msgr2=0x7fa9600a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960131280 0x7fa9600a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 -- 172.21.15.88:0/961190353 >> v1:172.21.15.52:6789/0 conn(0x7fa9600a5410 legacy=0x7fa960137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 -- 172.21.15.88:0/961190353 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960063fb0 con 0x7fa9600a2fa0 2020-02-11T16:13:20.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 --2- 172.21.15.88:0/961190353 >> v2:172.21.15.88:3300/0 conn(0x7fa9600a2fa0 0x7fa9600a0480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9600a9db0 tx=0x7fa960067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 --2- 172.21.15.88:0/961190353 >> v2:172.21.15.88:3300/0 conn(0x7fa9600a2fa0 0x7fa9600a0480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9600a9db0 tx=0x7fa960067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a0480 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7fa9600a9db0 tx=0x7fa960067410).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a0480 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fa9600a9db0 tx=0x7fa960067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a0480 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fa9600a9db0 tx=0x7fa960067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa954007150 con 0x7fa9600a2fa0 2020-02-11T16:13:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa965bfb700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a0480 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fa9600a9db0 tx=0x7fa960067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9540072b0 con 0x7fa9600a2fa0 2020-02-11T16:13:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa967e5f700 1 -- 172.21.15.88:0/961190353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa960063920 con 0x7fa9600a2fa0 2020-02-11T16:13:20.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9540056c0 con 0x7fa9600a2fa0 2020-02-11T16:13:20.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.620+0000 7fa967e5f700 1 -- 172.21.15.88:0/961190353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9601382e0 con 0x7fa9600a2fa0 2020-02-11T16:13:20.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.621+0000 7fa965bfb700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a0480 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fa9600a9db0 tx=0x7fa960067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.621+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa954005930 con 0x7fa9600a2fa0 2020-02-11T16:13:20.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.621+0000 7fa965bfb700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a0480 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fa9600a9db0 tx=0x7fa960067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.621+0000 7fa967e5f700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 0x7fa9600a7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.621+0000 7fa967e5f700 1 -- 172.21.15.88:0/961190353 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96005e2f0 con 0x7fa960062280 2020-02-11T16:13:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.621+0000 7fa952ffd700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa940039c70 0x7fa94003c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.621+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa95404a100 con 0x7fa9600a2fa0 2020-02-11T16:13:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.622+0000 7fa9663fc700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa940039c70 0x7fa94003c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.622+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 0x7fa9600a7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.622+0000 7fa9663fc700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa940039c70 0x7fa94003c130 crc :-1 s=READY pgs=242 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.622+0000 7fa9653fa700 1 -- 172.21.15.88:0/961190353 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa960064140 con 0x7fa960062280 2020-02-11T16:13:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.622+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 0x7fa9600a7f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c00bdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.622+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 0x7fa9600a7f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c00bdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.622+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 0x7fa9600a7f80 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c00bdb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.622+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 0x7fa9600a7f80 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c00bdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.622+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa95c009580 con 0x7fa960062280 2020-02-11T16:13:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.623+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 0x7fa9600a7f80 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c00bdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.623+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa95c007520 con 0x7fa960062280 2020-02-11T16:13:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.623+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 msgr2=0x7fa9600a7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.623+0000 7fa952ffd700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 0x7fa9600a7f80 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c00bdb0).stop 2020-02-11T16:13:20.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.623+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 msgr2=0x7fa9600a7f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:20.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.623+0000 7fa952ffd700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960062280 0x7fa9600a7f80 secure :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c00bdb0).stop 2020-02-11T16:13:20.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.631+0000 7fa967e5f700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 0x7fa960135930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.631+0000 7fa967e5f700 1 -- 172.21.15.88:0/961190353 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa960063e50 con 0x7fa960135520 2020-02-11T16:13:20.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.631+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 0x7fa960135930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.631+0000 7fa9653fa700 1 -- 172.21.15.88:0/961190353 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa9600565b0 con 0x7fa960135520 2020-02-11T16:13:20.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.631+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 0x7fa960135930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c011fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.631+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 0x7fa960135930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c011fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.631+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 0x7fa960135930 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c011fc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.631+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 0x7fa960135930 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c011fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa95c00b0c0 con 0x7fa960135520 2020-02-11T16:13:20.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa9653fa700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 0x7fa960135930 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c011fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3849 (secure 0 0 0) 0x7fa95c007350 con 0x7fa960135520 2020-02-11T16:13:20.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 msgr2=0x7fa960135930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa952ffd700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 0x7fa960135930 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c011fc0).stop 2020-02-11T16:13:20.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa952ffd700 1 -- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 msgr2=0x7fa960135930 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:20.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa952ffd700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa960135520 0x7fa960135930 secure :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0x7fa95c002f30 tx=0x7fa95c011fc0).stop 2020-02-11T16:13:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa967e5f700 1 -- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa940039c70 msgr2=0x7fa94003c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa967e5f700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa940039c70 0x7fa94003c130 crc :-1 s=READY pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa967e5f700 1 -- 172.21.15.88:0/961190353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 msgr2=0x7fa9600a0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa967e5f700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a0480 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7fa9600a9db0 tx=0x7fa960067410).stop 2020-02-11T16:13:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa9663fc700 1 -- 172.21.15.88:0/961190353 reap_dead start 2020-02-11T16:13:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa9663fc700 1 -- 172.21.15.88:0/961190353 reap_dead start 2020-02-11T16:13:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa967e5f700 1 -- 172.21.15.88:0/961190353 shutdown_connections 2020-02-11T16:13:20.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa967e5f700 1 --2- 172.21.15.88:0/961190353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9600a2fa0 0x7fa9600a0480 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa967e5f700 1 -- 172.21.15.88:0/961190353 >> 172.21.15.88:0/961190353 conn(0x7fa96009d110 msgr2=0x7fa960069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:20.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa967e5f700 1 -- 172.21.15.88:0/961190353 shutdown_connections 2020-02-11T16:13:20.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.632+0000 7fa967e5f700 1 -- 172.21.15.88:0/961190353 wait complete. 2020-02-11T16:13:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:13:20.642 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:20.643 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:20.643 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:13:20.643 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 68, 2020-02-11T16:13:20.643 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:13:20.643 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:13:20.643 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:13:20.643 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:13:20.644 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.644 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:13:20.644 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:20.644 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:13:20.644 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:13:20.644 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:20.644 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:20.645 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:20.645 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:20.645 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:20.645 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:20.645 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.645 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:13:20.645 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:13:20.646 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:20.646 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:20.646 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:20.646 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:20.646 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:20.646 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:20.646 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.647 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:13:20.647 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:13:20.647 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:13:20.647 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:13:20.647 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:13:20.647 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:13:20.647 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:20.648 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:20.648 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:13:20.648 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:13:20.648 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:20.648 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:13:20.648 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:20.648 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:20.649 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:20.649 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:20.649 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:20.649 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:20.649 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.649 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:13:20.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.650 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:13:20.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.650 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:13:20.650 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:13:20.650 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:20.651 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:20.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.651 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:20.651 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:13:20.651 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.652 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:20.652 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:13:20.652 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.652 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.653 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:13:20.653 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:13:20.653 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:20.653 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:20.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.653 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:20.654 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:20.654 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:20.654 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:20.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.654 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:20.654 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:13:20.654 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.655 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:20.655 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:13:20.655 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.655 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.656 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:13:20.656 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:13:20.656 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:20.656 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:20.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.657 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:20.657 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:20.657 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:20.657 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:20.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.658 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:20.658 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:13:20.658 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.659 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:20.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:13:20.659 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:20.660 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.660 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.660 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:13:20.660 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:13:20.660 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:20.661 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:20.661 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.661 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:20.661 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:13:20.662 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:13:20.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.662 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.663 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.663 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:20.663 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.663 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:20.663 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:13:20.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:20.664 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:20.664 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:20.664 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:20.664 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.664 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:20.665 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:20.665 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:13:20.666 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:13:20.667 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:13:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.769+0000 7f7c288c6700 1 Processor -- start 2020-02-11T16:13:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.769+0000 7f7c288c6700 1 -- start start 2020-02-11T16:13:20.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.770+0000 7f7c288c6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c240a18a0 0x7f7c240a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:20.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.770+0000 7f7c288c6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c240a6260 0x7f7c2412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:20.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.770+0000 7f7c288c6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c240a3570 con 0x7f7c240a5de0 2020-02-11T16:13:20.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.770+0000 7f7c288c6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c240a3810 con 0x7f7c240a6260 2020-02-11T16:13:20.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.770+0000 7f7c288c6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c240a3ab0 con 0x7f7c240a18a0 2020-02-11T16:13:20.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.770+0000 7f7c2259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c240a18a0 0x7f7c240a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.770+0000 7f7c21d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7c240a5de0 0x7f7c2412e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42700/0 (socket says 172.21.15.88:42700) 2020-02-11T16:13:20.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.770+0000 7f7c2259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c240a18a0 0x7f7c240a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55074/0 (socket says 172.21.15.88:55074) 2020-02-11T16:13:20.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.770+0000 7f7c21d9b700 1 -- 172.21.15.88:0/3156650361 learned_addr learned my addr 172.21.15.88:0/3156650361 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:20.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c22d9d700 1 --2- 172.21.15.88:0/3156650361 >> v2:172.21.15.52:3300/0 conn(0x7f7c240a6260 0x7f7c2412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2259c700 1 -- 172.21.15.88:0/3156650361 >> v2:172.21.15.52:3300/0 conn(0x7f7c240a6260 msgr2=0x7f7c2412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:20.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2259c700 1 --2- 172.21.15.88:0/3156650361 >> v2:172.21.15.52:3300/0 conn(0x7f7c240a6260 0x7f7c2412eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:20.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2259c700 1 -- 172.21.15.88:0/3156650361 >> v1:172.21.15.88:6789/0 conn(0x7f7c240a5de0 legacy=0x7f7c2412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2259c700 1 -- 172.21.15.88:0/3156650361 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c240a3d50 con 0x7f7c240a18a0 2020-02-11T16:13:20.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2159a700 1 -- 172.21.15.88:0/3156650361 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855433945 0 0) 0x7f7c240a3570 con 0x7f7c240a5de0 2020-02-11T16:13:20.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2259c700 1 --2- 172.21.15.88:0/3156650361 >> v2:172.21.15.88:3300/0 conn(0x7f7c240a18a0 0x7f7c240a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2259c700 1 --2- 172.21.15.88:0/3156650361 >> v2:172.21.15.88:3300/0 conn(0x7f7c240a18a0 0x7f7c240a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2259c700 1 --2- 172.21.15.88:0/3156650361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c240a6dd0 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).ready entity=mon.1 client_cookie=9e8e2ee8971f042 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2259c700 1 --2- 172.21.15.88:0/3156650361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c240a6dd0 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2159a700 1 -- 172.21.15.88:0/3156650361 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1c00a160 con 0x7f7c240a18a0 2020-02-11T16:13:20.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2259c700 1 --2- 172.21.15.88:0/3156650361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c240a6dd0 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2159a700 1 -- 172.21.15.88:0/3156650361 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c00a2c0 con 0x7f7c240a18a0 2020-02-11T16:13:20.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2259c700 1 --2- 172.21.15.88:0/3156650361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c240a6dd0 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c2159a700 1 -- 172.21.15.88:0/3156650361 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1c00a660 con 0x7f7c240a18a0 2020-02-11T16:13:20.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c288c6700 1 -- 172.21.15.88:0/3156650361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 msgr2=0x7f7c240a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c288c6700 1 --2- 172.21.15.88:0/3156650361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c240a6dd0 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).stop 2020-02-11T16:13:20.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c288c6700 1 -- 172.21.15.88:0/3156650361 shutdown_connections 2020-02-11T16:13:20.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c288c6700 1 --2- 172.21.15.88:0/3156650361 >> v2:172.21.15.52:3300/0 conn(0x7f7c240a6260 0x7f7c2412eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:20.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c288c6700 1 --2- 172.21.15.88:0/3156650361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c240a6dd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c288c6700 1 -- 172.21.15.88:0/3156650361 >> 172.21.15.88:0/3156650361 conn(0x7f7c2409d110 msgr2=0x7f7c2409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:20.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c288c6700 1 -- 172.21.15.88:0/3156650361 shutdown_connections 2020-02-11T16:13:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.771+0000 7f7c288c6700 1 -- 172.21.15.88:0/3156650361 wait complete. 2020-02-11T16:13:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.772+0000 7f7c288c6700 1 Processor -- start 2020-02-11T16:13:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.772+0000 7f7c288c6700 1 -- start start 2020-02-11T16:13:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c288c6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c240a18a0 0x7f7c2409f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c288c6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c240a0c20 con 0x7f7c240a5de0 2020-02-11T16:13:20.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c288c6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c240a0ec0 con 0x7f7c240a6260 2020-02-11T16:13:20.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c288c6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2409eb50 con 0x7f7c240a18a0 2020-02-11T16:13:20.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c240a18a0 0x7f7c2409f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c240a18a0 0x7f7c2409f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55078/0 (socket says 172.21.15.88:55078) 2020-02-11T16:13:20.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c22d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7c240a6260 0x7f7c2414d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42708/0 (socket says 172.21.15.88:42708) 2020-02-11T16:13:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 -- 172.21.15.88:0/516603406 learned_addr learned my addr 172.21.15.88:0/516603406 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 -- 172.21.15.88:0/516603406 >> v1:172.21.15.88:6789/0 conn(0x7f7c240a6260 legacy=0x7f7c2414d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 -- 172.21.15.88:0/516603406 >> v1:172.21.15.52:6789/0 conn(0x7f7c240a5de0 legacy=0x7f7c240a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c1b7fe700 1 -- 172.21.15.88:0/516603406 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234391040 0 0) 0x7f7c240a0ec0 con 0x7f7c240a6260 2020-02-11T16:13:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 -- 172.21.15.88:0/516603406 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24134b40 con 0x7f7c240a18a0 2020-02-11T16:13:20.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 --2- 172.21.15.88:0/516603406 >> v2:172.21.15.88:3300/0 conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 --2- 172.21.15.88:0/516603406 >> v2:172.21.15.88:3300/0 conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c1b7fe700 1 -- 172.21.15.88:0/516603406 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1c005c30 con 0x7f7c240a18a0 2020-02-11T16:13:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c2259c700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c1b7fe700 1 -- 172.21.15.88:0/516603406 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c005d90 con 0x7f7c240a18a0 2020-02-11T16:13:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c288c6700 1 -- 172.21.15.88:0/516603406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c24134de0 con 0x7f7c240a18a0 2020-02-11T16:13:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.773+0000 7f7c1b7fe700 1 -- 172.21.15.88:0/516603406 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1c00f760 con 0x7f7c240a18a0 2020-02-11T16:13:20.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.774+0000 7f7c288c6700 1 -- 172.21.15.88:0/516603406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c240a0870 con 0x7f7c240a18a0 2020-02-11T16:13:20.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.774+0000 7f7c2259c700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.774+0000 7f7c1b7fe700 1 -- 172.21.15.88:0/516603406 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7c1c00f9d0 con 0x7f7c240a18a0 2020-02-11T16:13:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.774+0000 7f7c2259c700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.774+0000 7f7c1b7fe700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c08039a90 0x7f7c0803bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.774+0000 7f7c1b7fe700 1 -- 172.21.15.88:0/516603406 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7c1c04ab50 con 0x7f7c240a18a0 2020-02-11T16:13:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.775+0000 7f7c288c6700 1 -- 172.21.15.88:0/516603406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c240565b0 con 0x7f7c240a18a0 2020-02-11T16:13:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.775+0000 7f7c21d9b700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c08039a90 0x7f7c0803bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:20.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.775+0000 7f7c21d9b700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c08039a90 0x7f7c0803bf50 crc :-1 s=READY pgs=243 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:20.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.778+0000 7f7c2259c700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.778+0000 7f7c1b7fe700 1 -- 172.21.15.88:0/516603406 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f7c1c033140 con 0x7f7c240a18a0 2020-02-11T16:13:20.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.961+0000 7f7c288c6700 1 -- 172.21.15.88:0/516603406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f7c24134f70 con 0x7f7c240a18a0 2020-02-11T16:13:20.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.962+0000 7f7c2259c700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:20.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.962+0000 7f7c1b7fe700 1 -- 172.21.15.88:0/516603406 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f7c1c032d00 con 0x7f7c240a18a0 2020-02-11T16:13:20.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.963+0000 7f7c288c6700 1 -- 172.21.15.88:0/516603406 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c08039a90 msgr2=0x7f7c0803bf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.963+0000 7f7c288c6700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c08039a90 0x7f7c0803bf50 crc :-1 s=READY pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.963+0000 7f7c288c6700 1 -- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 msgr2=0x7f7c2409f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:20.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.963+0000 7f7c288c6700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c2409f470 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7f7c1c0032b0 tx=0x7f7c1c007dc0).stop 2020-02-11T16:13:20.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.963+0000 7f7c288c6700 1 -- 172.21.15.88:0/516603406 shutdown_connections 2020-02-11T16:13:20.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.963+0000 7f7c288c6700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7c08039a90 0x7f7c0803bf50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.963+0000 7f7c288c6700 1 --2- 172.21.15.88:0/516603406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c240a18a0 0x7f7c2409f470 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:20.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.963+0000 7f7c288c6700 1 -- 172.21.15.88:0/516603406 >> 172.21.15.88:0/516603406 conn(0x7f7c2409d110 msgr2=0x7f7c240a9200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:20.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.963+0000 7f7c288c6700 1 -- 172.21.15.88:0/516603406 shutdown_connections 2020-02-11T16:13:20.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:20.963+0000 7f7c288c6700 1 -- 172.21.15.88:0/516603406 wait complete. 2020-02-11T16:13:20.975 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:13:30.976 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:13:30.976 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:13:31.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.092+0000 7f1e3c17d700 1 Processor -- start 2020-02-11T16:13:31.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.092+0000 7f1e3c17d700 1 -- start start 2020-02-11T16:13:31.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.093+0000 7f1e3c17d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e340a2fa0 0x7f1e340a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.093+0000 7f1e3c17d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e340a4350 con 0x7f1e340a5410 2020-02-11T16:13:31.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.093+0000 7f1e3c17d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e340a3a40 con 0x7f1e34131990 2020-02-11T16:13:31.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.093+0000 7f1e3c17d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e340a1e60 con 0x7f1e340a2fa0 2020-02-11T16:13:31.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.093+0000 7f1e3a71a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1e34131990 0x7f1e3413ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42714/0 (socket says 172.21.15.88:42714) 2020-02-11T16:13:31.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.093+0000 7f1e3a71a700 1 -- 172.21.15.88:0/889919012 learned_addr learned my addr 172.21.15.88:0/889919012 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:31.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.093+0000 7f1e39f19700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e340a2fa0 0x7f1e340a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.093+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573415154 0 0) 0x7f1e340a3a40 con 0x7f1e34131990 2020-02-11T16:13:31.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e1c003230 con 0x7f1e34131990 2020-02-11T16:13:31.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2846216850 0 0) 0x7f1e1c003230 con 0x7f1e34131990 2020-02-11T16:13:31.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e340a2fa0 msgr2=0x7f1e340a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e340a2fa0 0x7f1e340a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 >> v1:172.21.15.52:6789/0 conn(0x7f1e340a5410 legacy=0x7f1e34131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e340a3ce0 con 0x7f1e34131990 2020-02-11T16:13:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f1e2c001a50 con 0x7f1e34131990 2020-02-11T16:13:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 >> v1:172.21.15.88:6789/0 conn(0x7f1e34131990 legacy=0x7f1e3413ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e1c003750 0x7f1e1c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e1c004090 0x7f1e1c004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e340a2fa0 0x7f1e1c004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e340a1e60 con 0x7f1e1c004090 2020-02-11T16:13:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c004fb0 con 0x7f1e1c003750 2020-02-11T16:13:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c005170 con 0x7f1e340a2fa0 2020-02-11T16:13:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e1c003750 0x7f1e1c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39718700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e1c004090 0x7f1e1c004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e3a71a700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e340a2fa0 0x7f1e1c004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 -- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e340a2fa0 msgr2=0x7f1e1c004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e340a2fa0 0x7f1e1c004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 -- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e1c004090 msgr2=0x7f1e1c004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e1c004090 0x7f1e1c004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 -- 172.21.15.88:0/889919012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c003230 con 0x7f1e1c003750 2020-02-11T16:13:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e1c003750 0x7f1e1c003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1e28002f30 tx=0x7f1e28010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e1c003750 0x7f1e1c003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1e28002f30 tx=0x7f1e28010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e1c003750 0x7f1e1c003b70 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f1e28002f30 tx=0x7f1e28010050).ready entity=mon.1 client_cookie=a3bee641050486f1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e1c003750 0x7f1e1c003b70 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f1e28002f30 tx=0x7f1e28010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e28008d30 con 0x7f1e1c003750 2020-02-11T16:13:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e1c003750 0x7f1e1c003b70 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f1e28002f30 tx=0x7f1e28010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28008e90 con 0x7f1e1c003750 2020-02-11T16:13:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e39f19700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e1c003750 0x7f1e1c003b70 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f1e28002f30 tx=0x7f1e28010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e38f17700 1 -- 172.21.15.88:0/889919012 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e28010ac0 con 0x7f1e1c003750 2020-02-11T16:13:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e3c17d700 1 -- 172.21.15.88:0/889919012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e1c003750 msgr2=0x7f1e1c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.094+0000 7f1e3c17d700 1 --2- 172.21.15.88:0/889919012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e1c003750 0x7f1e1c003b70 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f1e28002f30 tx=0x7f1e28010050).stop 2020-02-11T16:13:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.095+0000 7f1e3a71a700 1 -- 172.21.15.88:0/889919012 reap_dead start 2020-02-11T16:13:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.095+0000 7f1e3c17d700 1 -- 172.21.15.88:0/889919012 shutdown_connections 2020-02-11T16:13:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.095+0000 7f1e3c17d700 1 -- 172.21.15.88:0/889919012 >> 172.21.15.88:0/889919012 conn(0x7f1e3409d110 msgr2=0x7f1e3409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:31.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.095+0000 7f1e3c17d700 1 -- 172.21.15.88:0/889919012 shutdown_connections 2020-02-11T16:13:31.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.095+0000 7f1e3c17d700 1 -- 172.21.15.88:0/889919012 wait complete. 2020-02-11T16:13:31.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.096+0000 7f1e3c17d700 1 Processor -- start 2020-02-11T16:13:31.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.096+0000 7f1e3c17d700 1 -- start start 2020-02-11T16:13:31.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e3c17d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e3412ad40 0x7f1e3414c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e3c17d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3412e0a0 con 0x7f1e3409f980 2020-02-11T16:13:31.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e3c17d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3412e340 con 0x7f1e34144dd0 2020-02-11T16:13:31.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e3c17d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e340a0590 con 0x7f1e3412ad40 2020-02-11T16:13:31.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e39718700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1e34144dd0 0x7f1e3412a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42726/0 (socket says 172.21.15.88:42726) 2020-02-11T16:13:31.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e39718700 1 -- 172.21.15.88:0/73315790 learned_addr learned my addr 172.21.15.88:0/73315790 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:31.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324617588 0 0) 0x7f1e3412e340 con 0x7f1e34144dd0 2020-02-11T16:13:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e3a71a700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e3412ad40 0x7f1e3414c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e14002fe0 con 0x7f1e34144dd0 2020-02-11T16:13:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 354852908 0 0) 0x7f1e14002fe0 con 0x7f1e34144dd0 2020-02-11T16:13:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1e3412e340 con 0x7f1e34144dd0 2020-02-11T16:13:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f1e30002110 con 0x7f1e34144dd0 2020-02-11T16:13:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e3412ad40 msgr2=0x7f1e3414c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e3412ad40 0x7f1e3414c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 >> v1:172.21.15.88:6789/0 conn(0x7f1e34144dd0 legacy=0x7f1e3412a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 >> v1:172.21.15.52:6789/0 conn(0x7f1e3409f980 legacy=0x7f1e341446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e140049b0 0x7f1e14004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e3412ad40 0x7f1e14003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140043a0 con 0x7f1e140049b0 2020-02-11T16:13:31.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14004510 con 0x7f1e14005260 2020-02-11T16:13:31.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140046d0 con 0x7f1e3412ad40 2020-02-11T16:13:31.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e39f19700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e140049b0 0x7f1e14004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.097+0000 7f1e3a71a700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e3412ad40 0x7f1e14003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 -- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e3412ad40 msgr2=0x7f1e14003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1e3412ad40 0x7f1e14003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 -- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e140049b0 msgr2=0x7f1e14004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e140049b0 0x7f1e14004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 -- 172.21.15.88:0/73315790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3412e5e0 con 0x7f1e14005260 2020-02-11T16:13:31.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e3c17d700 1 -- 172.21.15.88:0/73315790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3412b310 con 0x7f1e14005260 2020-02-11T16:13:31.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e3c17d700 1 -- 172.21.15.88:0/73315790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e34066e00 con 0x7f1e14005260 2020-02-11T16:13:31.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e300068c0 con 0x7f1e14005260 2020-02-11T16:13:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e30006a20 con 0x7f1e14005260 2020-02-11T16:13:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e30006dc0 con 0x7f1e14005260 2020-02-11T16:13:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.098+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.099+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f1e3000b240 con 0x7f1e14005260 2020-02-11T16:13:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.099+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.099+0000 7f1e3c17d700 1 -- 172.21.15.88:0/73315790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e340565b0 con 0x7f1e14005260 2020-02-11T16:13:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.099+0000 7f1e26ffd700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1e14042070 0x7f1e14044530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.099+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f1e30049e90 con 0x7f1e14005260 2020-02-11T16:13:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.099+0000 7f1e39f19700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1e14042070 0x7f1e14044530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.099+0000 7f1e39f19700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1e14042070 0x7f1e14044530 crc :-1 s=READY pgs=244 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.102+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.102+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f1e3002f590 con 0x7f1e14005260 2020-02-11T16:13:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.280+0000 7f1e3c17d700 1 -- 172.21.15.88:0/73315790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1e3405ccb0 con 0x7f1e14005260 2020-02-11T16:13:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.280+0000 7f1e39718700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.280+0000 7f1e26ffd700 1 -- 172.21.15.88:0/73315790 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f1e3000b0a0 con 0x7f1e14005260 2020-02-11T16:13:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.282+0000 7f1e3c17d700 1 -- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1e14042070 msgr2=0x7f1e14044530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.282+0000 7f1e3c17d700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1e14042070 0x7f1e14044530 crc :-1 s=READY pgs=244 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.282+0000 7f1e3c17d700 1 -- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 msgr2=0x7f1e14003960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.282+0000 7f1e3c17d700 1 --2- 172.21.15.88:0/73315790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e14005260 0x7f1e14003960 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7f1e30000fa0 tx=0x7f1e30011540).stop 2020-02-11T16:13:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.282+0000 7f1e3a71a700 1 -- 172.21.15.88:0/73315790 reap_dead start 2020-02-11T16:13:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.282+0000 7f1e3a71a700 1 -- 172.21.15.88:0/73315790 reap_dead start 2020-02-11T16:13:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.282+0000 7f1e3c17d700 1 -- 172.21.15.88:0/73315790 shutdown_connections 2020-02-11T16:13:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.282+0000 7f1e3c17d700 1 -- 172.21.15.88:0/73315790 >> 172.21.15.88:0/73315790 conn(0x7f1e3409d110 msgr2=0x7f1e34069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.282+0000 7f1e3c17d700 1 -- 172.21.15.88:0/73315790 shutdown_connections 2020-02-11T16:13:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.282+0000 7f1e3c17d700 1 -- 172.21.15.88:0/73315790 wait complete. 2020-02-11T16:13:31.289 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:31.294 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":68,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:31.294 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:13:31.295 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:13:31.295 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:13:31.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.398+0000 7feb1c197700 1 Processor -- start 2020-02-11T16:13:31.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.398+0000 7feb1c197700 1 -- start start 2020-02-11T16:13:31.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1c197700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb140a5de0 0x7feb140a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1c197700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb14134a50 0x7feb14134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1c197700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb140a31b0 con 0x7feb140a18a0 2020-02-11T16:13:31.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1c197700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140a3570 con 0x7feb140a5de0 2020-02-11T16:13:31.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1c197700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140a3810 con 0x7feb14134a50 2020-02-11T16:13:31.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1a734700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb14134a50 0x7feb14134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1a734700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb14134a50 0x7feb14134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55116/0 (socket says 172.21.15.88:55116) 2020-02-11T16:13:31.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1a734700 1 -- 172.21.15.88:0/76172290 learned_addr learned my addr 172.21.15.88:0/76172290 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb19732700 1 --2- 172.21.15.88:0/76172290 >> v2:172.21.15.52:3300/0 conn(0x7feb140a5de0 0x7feb140a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1a734700 1 -- 172.21.15.88:0/76172290 >> v2:172.21.15.52:3300/0 conn(0x7feb140a5de0 msgr2=0x7feb140a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1a734700 1 --2- 172.21.15.88:0/76172290 >> v2:172.21.15.52:3300/0 conn(0x7feb140a5de0 0x7feb140a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1a734700 1 -- 172.21.15.88:0/76172290 >> v1:172.21.15.52:6789/0 conn(0x7feb140a18a0 legacy=0x7feb140a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1a734700 1 -- 172.21.15.88:0/76172290 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140a3ab0 con 0x7feb14134a50 2020-02-11T16:13:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1a734700 1 --2- 172.21.15.88:0/76172290 >> v2:172.21.15.88:3300/0 conn(0x7feb14134a50 0x7feb14134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb1405bbc0 tx=0x7feb0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1a734700 1 --2- 172.21.15.88:0/76172290 >> v2:172.21.15.88:3300/0 conn(0x7feb14134a50 0x7feb14134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb1405bbc0 tx=0x7feb0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.399+0000 7feb1a734700 1 --2- 172.21.15.88:0/76172290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14134a50 0x7feb14134ee0 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7feb1405bbc0 tx=0x7feb0c007dc0).ready entity=mon.1 client_cookie=5f171899ce4552a7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1a734700 1 --2- 172.21.15.88:0/76172290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14134a50 0x7feb14134ee0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7feb1405bbc0 tx=0x7feb0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1a734700 1 --2- 172.21.15.88:0/76172290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14134a50 0x7feb14134ee0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7feb1405bbc0 tx=0x7feb0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb18f31700 1 -- 172.21.15.88:0/76172290 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb0c00a160 con 0x7feb14134a50 2020-02-11T16:13:31.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1a734700 1 --2- 172.21.15.88:0/76172290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14134a50 0x7feb14134ee0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7feb1405bbc0 tx=0x7feb0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb18f31700 1 -- 172.21.15.88:0/76172290 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c00a2c0 con 0x7feb14134a50 2020-02-11T16:13:31.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb18f31700 1 -- 172.21.15.88:0/76172290 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb0c00a6a0 con 0x7feb14134a50 2020-02-11T16:13:31.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1c197700 1 -- 172.21.15.88:0/76172290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14134a50 msgr2=0x7feb14134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1c197700 1 --2- 172.21.15.88:0/76172290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14134a50 0x7feb14134ee0 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7feb1405bbc0 tx=0x7feb0c007dc0).stop 2020-02-11T16:13:31.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1c197700 1 -- 172.21.15.88:0/76172290 shutdown_connections 2020-02-11T16:13:31.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1c197700 1 --2- 172.21.15.88:0/76172290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14134a50 0x7feb14134ee0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1c197700 1 --2- 172.21.15.88:0/76172290 >> v2:172.21.15.52:3300/0 conn(0x7feb140a5de0 0x7feb140a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1c197700 1 -- 172.21.15.88:0/76172290 >> 172.21.15.88:0/76172290 conn(0x7feb1409d110 msgr2=0x7feb1409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:31.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1c197700 1 -- 172.21.15.88:0/76172290 shutdown_connections 2020-02-11T16:13:31.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.400+0000 7feb1c197700 1 -- 172.21.15.88:0/76172290 wait complete. 2020-02-11T16:13:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.401+0000 7feb1c197700 1 Processor -- start 2020-02-11T16:13:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.401+0000 7feb1c197700 1 -- start start 2020-02-11T16:13:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb1c197700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb140a5de0 0x7feb1409fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb1c197700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb141375e0 con 0x7feb140a18a0 2020-02-11T16:13:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb1c197700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb141369d0 con 0x7feb14134a50 2020-02-11T16:13:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb1c197700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb141367e0 con 0x7feb140a5de0 2020-02-11T16:13:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb140a5de0 0x7feb1409fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb1a734700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7feb14134a50 0x7feb1414daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42748/0 (socket says 172.21.15.88:42748) 2020-02-11T16:13:31.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb140a5de0 0x7feb1409fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55120/0 (socket says 172.21.15.88:55120) 2020-02-11T16:13:31.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb1a734700 1 -- 172.21.15.88:0/2468122283 learned_addr learned my addr 172.21.15.88:0/2468122283 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:31.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 -- 172.21.15.88:0/2468122283 >> v1:172.21.15.88:6789/0 conn(0x7feb14134a50 legacy=0x7feb1414daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 -- 172.21.15.88:0/2468122283 >> v1:172.21.15.52:6789/0 conn(0x7feb140a18a0 legacy=0x7feb14138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741079524 0 0) 0x7feb141369d0 con 0x7feb14134a50 2020-02-11T16:13:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 -- 172.21.15.88:0/2468122283 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14136c70 con 0x7feb140a5de0 2020-02-11T16:13:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 --2- 172.21.15.88:0/2468122283 >> v2:172.21.15.88:3300/0 conn(0x7feb140a5de0 0x7feb1409fc70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb04000fb0 tx=0x7feb10010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 --2- 172.21.15.88:0/2468122283 >> v2:172.21.15.88:3300/0 conn(0x7feb140a5de0 0x7feb1409fc70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb04000fb0 tx=0x7feb10010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a5de0 0x7feb1409fc70 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7feb04000fb0 tx=0x7feb10010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a5de0 0x7feb1409fc70 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7feb04000fb0 tx=0x7feb10010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb10008ea0 con 0x7feb140a5de0 2020-02-11T16:13:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a5de0 0x7feb1409fc70 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7feb04000fb0 tx=0x7feb10010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb10007340 con 0x7feb140a5de0 2020-02-11T16:13:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb1c197700 1 -- 172.21.15.88:0/2468122283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1409f7d0 con 0x7feb140a5de0 2020-02-11T16:13:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb19732700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a5de0 0x7feb1409fc70 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7feb04000fb0 tx=0x7feb10010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb100056c0 con 0x7feb140a5de0 2020-02-11T16:13:31.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.402+0000 7feb1c197700 1 -- 172.21.15.88:0/2468122283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb14135bc0 con 0x7feb140a5de0 2020-02-11T16:13:31.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.403+0000 7feb19732700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a5de0 0x7feb1409fc70 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7feb04000fb0 tx=0x7feb10010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.403+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7feb10005900 con 0x7feb140a5de0 2020-02-11T16:13:31.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.403+0000 7feb19732700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a5de0 0x7feb1409fc70 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7feb04000fb0 tx=0x7feb10010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.403+0000 7feb1c197700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 0x7feb14137ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.403+0000 7feb1c197700 1 -- 172.21.15.88:0/2468122283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1405e2f0 con 0x7feb14138c90 2020-02-11T16:13:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.403+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 0x7feb14137ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.403+0000 7feb02ffd700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feaf40399f0 0x7feaf403beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.403+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7feb1000b0a0 con 0x7feb140a5de0 2020-02-11T16:13:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb1a734700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feaf40399f0 0x7feaf403beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb19f33700 1 -- 172.21.15.88:0/2468122283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb14137f40 con 0x7feb14138c90 2020-02-11T16:13:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 0x7feb14137ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 0x7feb14137ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 0x7feb14137ae0 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb1a734700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feaf40399f0 0x7feaf403beb0 crc :-1 s=READY pgs=245 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 0x7feb14137ae0 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb04005c40 con 0x7feb14138c90 2020-02-11T16:13:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 0x7feb14137ae0 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7feb040020c0 con 0x7feb14138c90 2020-02-11T16:13:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 msgr2=0x7feb14137ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb02ffd700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 0x7feb14137ae0 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).stop 2020-02-11T16:13:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 msgr2=0x7feb14137ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.404+0000 7feb02ffd700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb14138c90 0x7feb14137ae0 secure :-1 s=CLOSED pgs=366 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).stop 2020-02-11T16:13:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.412+0000 7feb1c197700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 0x7feb1412d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.412+0000 7feb1c197700 1 -- 172.21.15.88:0/2468122283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1409f9d0 con 0x7feb140a0910 2020-02-11T16:13:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.412+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 0x7feb1412d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.412+0000 7feb19f33700 1 -- 172.21.15.88:0/2468122283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7feb140565b0 con 0x7feb140a0910 2020-02-11T16:13:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.412+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 0x7feb1412d7c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.412+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 0x7feb1412d7c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.412+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 0x7feb1412d7c0 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 0x7feb1412d7c0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb04005e70 con 0x7feb140a0910 2020-02-11T16:13:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb19f33700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 0x7feb1412d7c0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7feb0400f420 con 0x7feb140a0910 2020-02-11T16:13:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 msgr2=0x7feb1412d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb02ffd700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 0x7feb1412d7c0 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7feb04000ff0 tx=0x7feb04010970).stop 2020-02-11T16:13:31.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb02ffd700 1 -- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 msgr2=0x7feb1412d7c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:31.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb02ffd700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a0910 0x7feb1412d7c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1c197700 1 -- 172.21.15.88:0/2468122283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feaf40399f0 msgr2=0x7feaf403beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1c197700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feaf40399f0 0x7feaf403beb0 crc :-1 s=READY pgs=245 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1c197700 1 -- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a5de0 msgr2=0x7feb1409fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1c197700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a5de0 0x7feb1409fc70 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7feb04000fb0 tx=0x7feb10010a40).stop 2020-02-11T16:13:31.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1a734700 1 -- 172.21.15.88:0/2468122283 reap_dead start 2020-02-11T16:13:31.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1a734700 1 -- 172.21.15.88:0/2468122283 reap_dead start 2020-02-11T16:13:31.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1c197700 1 -- 172.21.15.88:0/2468122283 shutdown_connections 2020-02-11T16:13:31.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1c197700 1 --2- 172.21.15.88:0/2468122283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb140a5de0 0x7feb1409fc70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1c197700 1 -- 172.21.15.88:0/2468122283 >> 172.21.15.88:0/2468122283 conn(0x7feb1409d110 msgr2=0x7feb140aa050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:31.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1c197700 1 -- 172.21.15.88:0/2468122283 shutdown_connections 2020-02-11T16:13:31.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.413+0000 7feb1c197700 1 -- 172.21.15.88:0/2468122283 wait complete. 2020-02-11T16:13:31.448 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:13:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:13:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 68, 2020-02-11T16:13:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:13:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:13:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:13:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:13:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:13:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:13:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:13:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:13:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:13:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:13:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:13:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:13:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:13:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:13:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:13:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:13:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:13:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:13:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:13:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:13:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:13:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:13:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:13:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:13:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:13:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:13:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:13:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:13:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:13:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:13:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:13:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:13:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:13:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:13:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:13:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:13:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:13:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:13:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:13:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:13:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:13:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:13:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.472 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:13:31.473 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:13:31.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.576+0000 7fdd64b21700 1 Processor -- start 2020-02-11T16:13:31.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.576+0000 7fdd64b21700 1 -- start start 2020-02-11T16:13:31.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd64b21700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd6005fac0 0x7fdd600a5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd64b21700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 0x7fdd601399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd64b21700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6009dba0 con 0x7fdd6005ae60 2020-02-11T16:13:31.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd64b21700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd600a5ed0 con 0x7fdd6005fac0 2020-02-11T16:13:31.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd64b21700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6009ddd0 con 0x7fdd60139550 2020-02-11T16:13:31.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd5e59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd6005fac0 0x7fdd600a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd5dd9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 0x7fdd601399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd5e59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd6005fac0 0x7fdd600a5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:41116/0 (socket says 172.21.15.88:41116) 2020-02-11T16:13:31.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd5e59c700 1 -- 172.21.15.88:0/1144562701 learned_addr learned my addr 172.21.15.88:0/1144562701 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:31.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd5dd9b700 1 -- 172.21.15.88:0/1144562701 >> v2:172.21.15.52:3300/0 conn(0x7fdd6005fac0 msgr2=0x7fdd600a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:31.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1144562701 >> v2:172.21.15.52:3300/0 conn(0x7fdd6005fac0 0x7fdd600a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.577+0000 7fdd5dd9b700 1 -- 172.21.15.88:0/1144562701 >> v1:172.21.15.52:6789/0 conn(0x7fdd6005ae60 legacy=0x7fdd6005b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd5dd9b700 1 -- 172.21.15.88:0/1144562701 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6009e070 con 0x7fdd60139550 2020-02-11T16:13:31.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1144562701 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 0x7fdd601399b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd50002f30 tx=0x7fdd500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1144562701 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 0x7fdd601399b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd50002f30 tx=0x7fdd500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1144562701 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 0x7fdd601399b0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fdd50002f30 tx=0x7fdd500088e0).ready entity=mon.2 client_cookie=a8cc17db3b36b0a3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1144562701 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 0x7fdd601399b0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fdd50002f30 tx=0x7fdd500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd5d59a700 1 -- 172.21.15.88:0/1144562701 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd50008e40 con 0x7fdd60139550 2020-02-11T16:13:31.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1144562701 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 0x7fdd601399b0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fdd50002f30 tx=0x7fdd500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1144562701 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 0x7fdd601399b0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fdd50002f30 tx=0x7fdd500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd5d59a700 1 -- 172.21.15.88:0/1144562701 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd500115f0 con 0x7fdd60139550 2020-02-11T16:13:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd5d59a700 1 -- 172.21.15.88:0/1144562701 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd500119d0 con 0x7fdd60139550 2020-02-11T16:13:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd64b21700 1 -- 172.21.15.88:0/1144562701 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 msgr2=0x7fdd601399b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd64b21700 1 --2- 172.21.15.88:0/1144562701 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 0x7fdd601399b0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fdd50002f30 tx=0x7fdd500088e0).stop 2020-02-11T16:13:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd64b21700 1 -- 172.21.15.88:0/1144562701 shutdown_connections 2020-02-11T16:13:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd64b21700 1 --2- 172.21.15.88:0/1144562701 >> v2:172.21.15.52:3300/0 conn(0x7fdd6005fac0 0x7fdd600a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd64b21700 1 --2- 172.21.15.88:0/1144562701 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd60139550 0x7fdd601399b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd64b21700 1 -- 172.21.15.88:0/1144562701 >> 172.21.15.88:0/1144562701 conn(0x7fdd600a7bb0 msgr2=0x7fdd600a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:31.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd64b21700 1 -- 172.21.15.88:0/1144562701 shutdown_connections 2020-02-11T16:13:31.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.578+0000 7fdd64b21700 1 -- 172.21.15.88:0/1144562701 wait complete. 2020-02-11T16:13:31.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.579+0000 7fdd64b21700 1 Processor -- start 2020-02-11T16:13:31.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.579+0000 7fdd64b21700 1 -- start start 2020-02-11T16:13:31.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd64b21700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd64b21700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd60061850 con 0x7fdd6005fac0 2020-02-11T16:13:31.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd64b21700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd60061af0 con 0x7fdd60139550 2020-02-11T16:13:31.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd64b21700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60061d90 con 0x7fdd6005ae60 2020-02-11T16:13:31.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd5ed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdd60139550 0x7fdd60131330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42766/0 (socket says 172.21.15.88:42766) 2020-02-11T16:13:31.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd5ed9d700 1 -- 172.21.15.88:0/1515945553 learned_addr learned my addr 172.21.15.88:0/1515945553 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:31.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd5e59c700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317640909 0 0) 0x7fdd60061af0 con 0x7fdd60139550 2020-02-11T16:13:31.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd44002fe0 con 0x7fdd60139550 2020-02-11T16:13:31.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365605742 0 0) 0x7fdd60061850 con 0x7fdd6005fac0 2020-02-11T16:13:31.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd60061af0 con 0x7fdd6005fac0 2020-02-11T16:13:31.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd5e59c700 1 -- 172.21.15.88:0/1515945553 >> v1:172.21.15.88:6789/0 conn(0x7fdd60139550 legacy=0x7fdd60131330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd5e59c700 1 -- 172.21.15.88:0/1515945553 >> v1:172.21.15.52:6789/0 conn(0x7fdd6005fac0 legacy=0x7fdd601355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd5e59c700 1 -- 172.21.15.88:0/1515945553 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6009d1a0 con 0x7fdd6005ae60 2020-02-11T16:13:31.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.580+0000 7fdd5e59c700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd48002f30 tx=0x7fdd48010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd5e59c700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd48002f30 tx=0x7fdd48010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd5e59c700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fdd48002f30 tx=0x7fdd48010bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd5e59c700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fdd48002f30 tx=0x7fdd48010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd48007530 con 0x7fdd6005ae60 2020-02-11T16:13:31.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd5e59c700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fdd48002f30 tx=0x7fdd48010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd480056c0 con 0x7fdd6005ae60 2020-02-11T16:13:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd5e59c700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fdd48002f30 tx=0x7fdd48010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd64b21700 1 -- 172.21.15.88:0/1515945553 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd60134f30 con 0x7fdd6005ae60 2020-02-11T16:13:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd48005a60 con 0x7fdd6005ae60 2020-02-11T16:13:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd64b21700 1 -- 172.21.15.88:0/1515945553 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd60135e80 con 0x7fdd6005ae60 2020-02-11T16:13:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.581+0000 7fdd5e59c700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fdd48002f30 tx=0x7fdd48010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdd48005c60 con 0x7fdd6005ae60 2020-02-11T16:13:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd5e59c700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fdd48002f30 tx=0x7fdd48010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd64b21700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 0x7fdd6005e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd64b21700 1 -- 172.21.15.88:0/1515945553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6005e2f0 con 0x7fdd60131a40 2020-02-11T16:13:31.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd577fe700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd4403a0b0 0x7fdd4403c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 0x7fdd6005e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdd4800d0c0 con 0x7fdd6005ae60 2020-02-11T16:13:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd5ed9d700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd4403a0b0 0x7fdd4403c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd5ed9d700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd4403a0b0 0x7fdd4403c570 crc :-1 s=READY pgs=246 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd5dd9b700 1 -- 172.21.15.88:0/1515945553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd600565b0 con 0x7fdd60131a40 2020-02-11T16:13:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.582+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 0x7fdd6005e8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.583+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 0x7fdd6005e8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.583+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 0x7fdd6005e8f0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.583+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 0x7fdd6005e8f0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.583+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd50011980 con 0x7fdd60131a40 2020-02-11T16:13:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.583+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 0x7fdd6005e8f0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.583+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fdd50007150 con 0x7fdd60131a40 2020-02-11T16:13:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.583+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 msgr2=0x7fdd6005e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.583+0000 7fdd577fe700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 0x7fdd6005e8f0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).stop 2020-02-11T16:13:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.583+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 msgr2=0x7fdd6005e8f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.583+0000 7fdd577fe700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd60131a40 0x7fdd6005e8f0 secure :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).stop 2020-02-11T16:13:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.591+0000 7fdd64b21700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 0x7fdd600a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.591+0000 7fdd64b21700 1 -- 172.21.15.88:0/1515945553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60061ed0 con 0x7fdd600a8fd0 2020-02-11T16:13:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.591+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 0x7fdd600a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd5dd9b700 1 -- 172.21.15.88:0/1515945553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdd60062090 con 0x7fdd600a8fd0 2020-02-11T16:13:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 0x7fdd600a93b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 0x7fdd600a93b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 0x7fdd600a93b0 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 0x7fdd600a93b0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5000c730 con 0x7fdd600a8fd0 2020-02-11T16:13:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd5dd9b700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 0x7fdd600a93b0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4192 (secure 0 0 0) 0x7fdd5000c890 con 0x7fdd600a8fd0 2020-02-11T16:13:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 msgr2=0x7fdd600a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd577fe700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 0x7fdd600a93b0 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).stop 2020-02-11T16:13:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd577fe700 1 -- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 msgr2=0x7fdd600a93b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.592+0000 7fdd577fe700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd600a8fd0 0x7fdd600a93b0 secure :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0x7fdd50007ed0 tx=0x7fdd600600c0).stop 2020-02-11T16:13:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.593+0000 7fdd64b21700 1 -- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd4403a0b0 msgr2=0x7fdd4403c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.593+0000 7fdd64b21700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd4403a0b0 0x7fdd4403c570 crc :-1 s=READY pgs=246 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.593+0000 7fdd64b21700 1 -- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 msgr2=0x7fdd60134ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.593+0000 7fdd64b21700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fdd48002f30 tx=0x7fdd48010bf0).stop 2020-02-11T16:13:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.593+0000 7fdd5ed9d700 1 -- 172.21.15.88:0/1515945553 reap_dead start 2020-02-11T16:13:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.593+0000 7fdd64b21700 1 -- 172.21.15.88:0/1515945553 shutdown_connections 2020-02-11T16:13:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.593+0000 7fdd64b21700 1 --2- 172.21.15.88:0/1515945553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd6005ae60 0x7fdd60134ad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.593+0000 7fdd64b21700 1 -- 172.21.15.88:0/1515945553 >> 172.21.15.88:0/1515945553 conn(0x7fdd600a7bb0 msgr2=0x7fdd600a4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.593+0000 7fdd64b21700 1 -- 172.21.15.88:0/1515945553 shutdown_connections 2020-02-11T16:13:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.593+0000 7fdd64b21700 1 -- 172.21.15.88:0/1515945553 wait complete. 2020-02-11T16:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:13:31.610 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 68, 2020-02-11T16:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.611 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:13:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:13:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:13:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:31.626 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:13:31.627 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.628 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.629 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.630 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.632 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.633 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:13:31.634 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:13:31.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.738+0000 7fd9eeec2700 1 Processor -- start 2020-02-11T16:13:31.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.738+0000 7fd9eeec2700 1 -- start start 2020-02-11T16:13:31.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9eeec2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e80a4ec0 0x7fd9e812f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9eeec2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9e812fcf0 0x7fd9e8140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9eeec2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e80a5320 con 0x7fd9e80a7120 2020-02-11T16:13:31.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9eeec2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e80a5560 con 0x7fd9e812fcf0 2020-02-11T16:13:31.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9eeec2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e809e060 con 0x7fd9e80a4ec0 2020-02-11T16:13:31.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9ecc5e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd9e80a7120 0x7fd9e80a39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42774/0 (socket says 172.21.15.88:42774) 2020-02-11T16:13:31.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9ed45f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9e812fcf0 0x7fd9e8140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9ecc5e700 1 -- 172.21.15.88:0/4141066850 learned_addr learned my addr 172.21.15.88:0/4141066850 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:31.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9e7fff700 1 --2- 172.21.15.88:0/4141066850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e80a4ec0 0x7fd9e812f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9ed45f700 1 -- 172.21.15.88:0/4141066850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e80a4ec0 msgr2=0x7fd9e812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:31.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/4141066850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e80a4ec0 0x7fd9e812f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9e77fe700 1 -- 172.21.15.88:0/4141066850 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711897510 0 0) 0x7fd9d80010d0 con 0x7fd9e80a7120 2020-02-11T16:13:31.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9ed45f700 1 -- 172.21.15.88:0/4141066850 >> v1:172.21.15.88:6789/0 conn(0x7fd9e80a7120 legacy=0x7fd9e80a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.739+0000 7fd9ed45f700 1 -- 172.21.15.88:0/4141066850 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e809e300 con 0x7fd9e812fcf0 2020-02-11T16:13:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/4141066850 >> v2:172.21.15.88:3300/0 conn(0x7fd9e812fcf0 0x7fd9e8140470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd9e00032b0 tx=0x7fd9e0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/4141066850 >> v2:172.21.15.88:3300/0 conn(0x7fd9e812fcf0 0x7fd9e8140470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd9e00032b0 tx=0x7fd9e0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/4141066850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e812fcf0 0x7fd9e8140470 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7fd9e00032b0 tx=0x7fd9e0008c60).ready entity=mon.1 client_cookie=2af8400a748891e9 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/4141066850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e812fcf0 0x7fd9e8140470 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fd9e00032b0 tx=0x7fd9e0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9e77fe700 1 -- 172.21.15.88:0/4141066850 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9e0011e60 con 0x7fd9e812fcf0 2020-02-11T16:13:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/4141066850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e812fcf0 0x7fd9e8140470 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fd9e00032b0 tx=0x7fd9e0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/4141066850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e812fcf0 0x7fd9e8140470 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fd9e00032b0 tx=0x7fd9e0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9e77fe700 1 -- 172.21.15.88:0/4141066850 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e000a160 con 0x7fd9e812fcf0 2020-02-11T16:13:31.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9e77fe700 1 -- 172.21.15.88:0/4141066850 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9e000a4c0 con 0x7fd9e812fcf0 2020-02-11T16:13:31.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9eeec2700 1 -- 172.21.15.88:0/4141066850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e812fcf0 msgr2=0x7fd9e8140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9eeec2700 1 --2- 172.21.15.88:0/4141066850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e812fcf0 0x7fd9e8140470 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7fd9e00032b0 tx=0x7fd9e0008c60).stop 2020-02-11T16:13:31.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9eeec2700 1 -- 172.21.15.88:0/4141066850 shutdown_connections 2020-02-11T16:13:31.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9eeec2700 1 --2- 172.21.15.88:0/4141066850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e812fcf0 0x7fd9e8140470 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9eeec2700 1 --2- 172.21.15.88:0/4141066850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e80a4ec0 0x7fd9e812f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9eeec2700 1 -- 172.21.15.88:0/4141066850 >> 172.21.15.88:0/4141066850 conn(0x7fd9e809d110 msgr2=0x7fd9e809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:31.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9eeec2700 1 -- 172.21.15.88:0/4141066850 shutdown_connections 2020-02-11T16:13:31.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.740+0000 7fd9eeec2700 1 -- 172.21.15.88:0/4141066850 wait complete. 2020-02-11T16:13:31.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.741+0000 7fd9eeec2700 1 Processor -- start 2020-02-11T16:13:31.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.741+0000 7fd9eeec2700 1 -- start start 2020-02-11T16:13:31.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9eeec2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9e80a7120 0x7fd9e8138dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9eeec2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd9e812fcf0 0x7fd9e81394a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9eeec2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e8139220 con 0x7fd9e80a4ec0 2020-02-11T16:13:31.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9eeec2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e8136e20 con 0x7fd9e812fcf0 2020-02-11T16:13:31.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9eeec2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e81370c0 con 0x7fd9e80a7120 2020-02-11T16:13:31.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9e80a7120 0x7fd9e8138dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9e80a7120 0x7fd9e8138dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55154/0 (socket says 172.21.15.88:55154) 2020-02-11T16:13:31.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 -- 172.21.15.88:0/244303739 learned_addr learned my addr 172.21.15.88:0/244303739 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:31.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/244303739 >> v2:172.21.15.52:3300/0 conn(0x7fd9e812fcf0 0x7fd9e81394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 -- 172.21.15.88:0/244303739 >> v2:172.21.15.52:3300/0 conn(0x7fd9e812fcf0 msgr2=0x7fd9e81394a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 --2- 172.21.15.88:0/244303739 >> v2:172.21.15.52:3300/0 conn(0x7fd9e812fcf0 0x7fd9e81394a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 -- 172.21.15.88:0/244303739 >> v1:172.21.15.52:6789/0 conn(0x7fd9e80a4ec0 legacy=0x7fd9e81274a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 -- 172.21.15.88:0/244303739 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e8137360 con 0x7fd9e80a7120 2020-02-11T16:13:31.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/244303739 >> v2:172.21.15.52:3300/0 conn(0x7fd9e812fcf0 0x7fd9e81394a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:13:31.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 --2- 172.21.15.88:0/244303739 >> v2:172.21.15.88:3300/0 conn(0x7fd9e80a7120 0x7fd9e8138dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9e805e600 tx=0x7fd9dc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 --2- 172.21.15.88:0/244303739 >> v2:172.21.15.88:3300/0 conn(0x7fd9e80a7120 0x7fd9e8138dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9e805e600 tx=0x7fd9dc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e80a7120 0x7fd9e8138dc0 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7fd9e805e600 tx=0x7fd9dc010d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e80a7120 0x7fd9e8138dc0 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7fd9e805e600 tx=0x7fd9dc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e80a7120 0x7fd9e8138dc0 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7fd9e805e600 tx=0x7fd9dc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9dc005e90 con 0x7fd9e80a7120 2020-02-11T16:13:31.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e7fff700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e80a7120 0x7fd9e8138dc0 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7fd9e805e600 tx=0x7fd9dc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.742+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc007160 con 0x7fd9e80a7120 2020-02-11T16:13:31.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9eeec2700 1 -- 172.21.15.88:0/244303739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e80a6600 con 0x7fd9e80a7120 2020-02-11T16:13:31.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9dc007540 con 0x7fd9e80a7120 2020-02-11T16:13:31.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9eeec2700 1 -- 172.21.15.88:0/244303739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e8127bb0 con 0x7fd9e80a7120 2020-02-11T16:13:31.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9e7fff700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e80a7120 0x7fd9e8138dc0 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7fd9e805e600 tx=0x7fd9dc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9eeec2700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 0x7fd9e812eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9eeec2700 1 -- 172.21.15.88:0/244303739 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8136f60 con 0x7fd9e8139900 2020-02-11T16:13:31.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd9dc00e3b0 con 0x7fd9e80a7120 2020-02-11T16:13:31.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9e7fff700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e80a7120 0x7fd9e8138dc0 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7fd9e805e600 tx=0x7fd9dc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9e5ffb700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd9c8039d20 0x7fd9c803c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 0x7fd9e812eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.743+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fd9dc049f20 con 0x7fd9e80a7120 2020-02-11T16:13:31.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd9c8039d20 0x7fd9c803c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9ed45f700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd9c8039d20 0x7fd9c803c1e0 crc :-1 s=READY pgs=247 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9ecc5e700 1 -- 172.21.15.88:0/244303739 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9e81374f0 con 0x7fd9e8139900 2020-02-11T16:13:31.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 0x7fd9e812eb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 0x7fd9e812eb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 0x7fd9e812eb60 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 0x7fd9e812eb60 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d8005ca0 con 0x7fd9e8139900 2020-02-11T16:13:31.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 0x7fd9e812eb60 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fd9d8005e00 con 0x7fd9e8139900 2020-02-11T16:13:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 msgr2=0x7fd9e812eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9e5ffb700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 0x7fd9e812eb60 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).stop 2020-02-11T16:13:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 msgr2=0x7fd9e812eb60 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.744+0000 7fd9e5ffb700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e8139900 0x7fd9e812eb60 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).stop 2020-02-11T16:13:31.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.752+0000 7fd9eeec2700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 0x7fd9e809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.752+0000 7fd9eeec2700 1 -- 172.21.15.88:0/244303739 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8137200 con 0x7fd9e809e830 2020-02-11T16:13:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.753+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 0x7fd9e809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.753+0000 7fd9ecc5e700 1 -- 172.21.15.88:0/244303739 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd9e8139220 con 0x7fd9e809e830 2020-02-11T16:13:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.753+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 0x7fd9e809ec40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.753+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 0x7fd9e809ec40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.753+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 0x7fd9e809ec40 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.753+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 0x7fd9e809ec40 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d8009650 con 0x7fd9e809e830 2020-02-11T16:13:31.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9ecc5e700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 0x7fd9e809ec40 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7fd9d80097b0 con 0x7fd9e809e830 2020-02-11T16:13:31.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 msgr2=0x7fd9e809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9e5ffb700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 0x7fd9e809ec40 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).stop 2020-02-11T16:13:31.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9e5ffb700 1 -- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 msgr2=0x7fd9e809ec40 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:31.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9e5ffb700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd9e809e830 0x7fd9e809ec40 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0x7fd9d8000b80 tx=0x7fd9d80107e0).stop 2020-02-11T16:13:31.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9eeec2700 1 -- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd9c8039d20 msgr2=0x7fd9c803c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9eeec2700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd9c8039d20 0x7fd9c803c1e0 crc :-1 s=READY pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9eeec2700 1 -- 172.21.15.88:0/244303739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e80a7120 msgr2=0x7fd9e8138dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9eeec2700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e80a7120 0x7fd9e8138dc0 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7fd9e805e600 tx=0x7fd9dc010d80).stop 2020-02-11T16:13:31.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9ed45f700 1 -- 172.21.15.88:0/244303739 reap_dead start 2020-02-11T16:13:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9ed45f700 1 -- 172.21.15.88:0/244303739 reap_dead start 2020-02-11T16:13:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9eeec2700 1 -- 172.21.15.88:0/244303739 shutdown_connections 2020-02-11T16:13:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9eeec2700 1 --2- 172.21.15.88:0/244303739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e80a7120 0x7fd9e8138dc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9eeec2700 1 -- 172.21.15.88:0/244303739 >> 172.21.15.88:0/244303739 conn(0x7fd9e809d110 msgr2=0x7fd9e80a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:31.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9eeec2700 1 -- 172.21.15.88:0/244303739 shutdown_connections 2020-02-11T16:13:31.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.754+0000 7fd9eeec2700 1 -- 172.21.15.88:0/244303739 wait complete. 2020-02-11T16:13:31.784 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:13:31.784 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:31.785 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:31.785 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:13:31.785 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 68, 2020-02-11T16:13:31.785 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:13:31.785 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:13:31.785 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:13:31.786 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:13:31.786 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.786 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:13:31.786 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:31.786 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:13:31.786 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:13:31.786 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:31.787 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:31.787 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:31.787 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:31.787 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:31.787 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:31.787 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.787 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:13:31.788 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:13:31.788 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:31.788 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:31.788 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:31.788 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:31.788 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:31.788 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:31.789 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.789 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:13:31.789 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:13:31.789 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:13:31.789 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:13:31.789 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:13:31.790 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:13:31.790 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:31.790 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:31.790 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:13:31.790 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:13:31.790 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:31.790 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:13:31.790 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:31.791 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:31.791 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:31.791 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:31.791 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:31.791 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:31.797 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.797 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:13:31.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.797 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:13:31.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.798 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:13:31.798 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:13:31.798 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:31.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:31.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.799 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:31.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:13:31.800 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.800 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:31.801 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:13:31.801 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.801 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.801 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:13:31.802 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:13:31.802 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:31.802 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:31.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.803 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:31.803 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:31.804 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:31.804 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:31.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.804 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:31.805 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:13:31.805 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.805 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:31.806 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:13:31.806 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.806 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.806 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.807 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:13:31.807 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:13:31.807 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:31.808 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:31.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.808 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:31.808 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:31.809 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:31.809 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:31.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.809 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:31.814 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:13:31.814 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.814 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:31.815 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:13:31.815 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:31.815 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.815 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.815 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:13:31.815 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:13:31.815 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:31.816 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:31.816 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.816 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:31.816 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:13:31.816 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:13:31.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.817 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.817 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.817 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:31.817 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.817 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:31.817 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:13:31.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:31.818 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:31.818 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:31.818 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:31.818 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.818 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:31.819 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:31.819 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:13:31.819 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2020-02-11T16:13:31.819 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:13:31.819 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2020-02-11T16:13:31.820 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:13:31.820 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-02-11T16:13:31.820 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:13:31.833 INFO:tasks.ceph.mon.b:Stopped 2020-02-11T16:13:31.834 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:13:31.834 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:13:31.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.943+0000 7f88e3d04700 1 Processor -- start 2020-02-11T16:13:31.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.943+0000 7f88e3d04700 1 -- start start 2020-02-11T16:13:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e3d04700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f88dc0a18a0 0x7f88dc0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e3d04700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 0x7f88dc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e3d04700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88dc12e3a0 0x7f88dc12e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e3d04700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc0a3570 con 0x7f88dc0a18a0 2020-02-11T16:13:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e3d04700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc0a3810 con 0x7f88dc12e3a0 2020-02-11T16:13:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e3d04700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0a3ab0 con 0x7f88dc0a5de0 2020-02-11T16:13:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88dc12e3a0 0x7f88dc12e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e1aa0700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f88dc0a18a0 msgr2=0x7f88dc0a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88dc12e3a0 0x7f88dc12e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55184/0 (socket says 172.21.15.88:55184) 2020-02-11T16:13:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 -- 172.21.15.88:0/1964219935 learned_addr learned my addr 172.21.15.88:0/1964219935 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/1964219935 >> v2:172.21.15.52:3300/0 conn(0x7f88dc0a18a0 0x7f88dc0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:13:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e129f700 1 --2- 172.21.15.88:0/1964219935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 0x7f88dc0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 -- 172.21.15.88:0/1964219935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 msgr2=0x7f88dc0a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 --2- 172.21.15.88:0/1964219935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 0x7f88dc0a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 -- 172.21.15.88:0/1964219935 >> v2:172.21.15.52:3300/0 conn(0x7f88dc0a18a0 msgr2=0x7f88dc0a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:13:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 --2- 172.21.15.88:0/1964219935 >> v2:172.21.15.52:3300/0 conn(0x7f88dc0a18a0 0x7f88dc0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 -- 172.21.15.88:0/1964219935 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0a3d50 con 0x7f88dc12e3a0 2020-02-11T16:13:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e129f700 1 --2- 172.21.15.88:0/1964219935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 0x7f88dc0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:13:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 --2- 172.21.15.88:0/1964219935 >> v2:172.21.15.88:3300/0 conn(0x7f88dc12e3a0 0x7f88dc12e830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f88dc05bbc0 tx=0x7f88d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 --2- 172.21.15.88:0/1964219935 >> v2:172.21.15.88:3300/0 conn(0x7f88dc12e3a0 0x7f88dc12e830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f88dc05bbc0 tx=0x7f88d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 --2- 172.21.15.88:0/1964219935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc12e3a0 0x7f88dc12e830 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7f88dc05bbc0 tx=0x7f88d80088e0).ready entity=mon.1 client_cookie=83dbd2191a0fd906 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 --2- 172.21.15.88:0/1964219935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc12e3a0 0x7f88dc12e830 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f88dc05bbc0 tx=0x7f88d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 --2- 172.21.15.88:0/1964219935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc12e3a0 0x7f88dc12e830 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f88dc05bbc0 tx=0x7f88d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e0a9e700 1 -- 172.21.15.88:0/1964219935 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d80116e0 con 0x7f88dc12e3a0 2020-02-11T16:13:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e22a1700 1 --2- 172.21.15.88:0/1964219935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc12e3a0 0x7f88dc12e830 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f88dc05bbc0 tx=0x7f88d80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e0a9e700 1 -- 172.21.15.88:0/1964219935 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8011840 con 0x7f88dc12e3a0 2020-02-11T16:13:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e0a9e700 1 -- 172.21.15.88:0/1964219935 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d8011c20 con 0x7f88dc12e3a0 2020-02-11T16:13:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e3d04700 1 -- 172.21.15.88:0/1964219935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc12e3a0 msgr2=0x7f88dc12e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.944+0000 7f88e3d04700 1 --2- 172.21.15.88:0/1964219935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc12e3a0 0x7f88dc12e830 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7f88dc05bbc0 tx=0x7f88d80088e0).stop 2020-02-11T16:13:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.945+0000 7f88e3d04700 1 -- 172.21.15.88:0/1964219935 shutdown_connections 2020-02-11T16:13:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.945+0000 7f88e3d04700 1 --2- 172.21.15.88:0/1964219935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc12e3a0 0x7f88dc12e830 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.945+0000 7f88e3d04700 1 --2- 172.21.15.88:0/1964219935 >> v2:172.21.15.52:3300/0 conn(0x7f88dc0a18a0 0x7f88dc0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.945+0000 7f88e3d04700 1 --2- 172.21.15.88:0/1964219935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 0x7f88dc0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:31.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.945+0000 7f88e3d04700 1 -- 172.21.15.88:0/1964219935 >> 172.21.15.88:0/1964219935 conn(0x7f88dc09d110 msgr2=0x7f88dc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:31.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.945+0000 7f88e3d04700 1 -- 172.21.15.88:0/1964219935 shutdown_connections 2020-02-11T16:13:31.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.945+0000 7f88e3d04700 1 -- 172.21.15.88:0/1964219935 wait complete. 2020-02-11T16:13:31.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.946+0000 7f88e3d04700 1 Processor -- start 2020-02-11T16:13:31.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.946+0000 7f88e3d04700 1 -- start start 2020-02-11T16:13:31.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.946+0000 7f88e3d04700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88dc0a18a0 0x7f88dc1347c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.946+0000 7f88e3d04700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 0x7f88dc1369f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.946+0000 7f88e3d04700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc134080 con 0x7f88dc12e3a0 2020-02-11T16:13:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.946+0000 7f88e3d04700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc134320 con 0x7f88dc0a18a0 2020-02-11T16:13:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.946+0000 7f88e3d04700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc133c40 con 0x7f88dc0a5de0 2020-02-11T16:13:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.946+0000 7f88e1aa0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88dc0a18a0 0x7f88dc1347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88dc0a18a0 0x7f88dc1347c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55186/0 (socket says 172.21.15.88:55186) 2020-02-11T16:13:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 -- 172.21.15.88:0/722352466 learned_addr learned my addr 172.21.15.88:0/722352466 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e22a1700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f88dc12e3a0 0x7f88dc1383a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42816/0 (socket says 172.21.15.88:42816) 2020-02-11T16:13:31.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e129f700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 0x7f88dc1369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88caffd700 1 -- 172.21.15.88:0/722352466 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215482125 0 0) 0x7f88dc134080 con 0x7f88dc12e3a0 2020-02-11T16:13:31.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 -- 172.21.15.88:0/722352466 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 msgr2=0x7f88dc1369f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 0x7f88dc1369f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:31.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 -- 172.21.15.88:0/722352466 >> v1:172.21.15.88:6789/0 conn(0x7f88dc12e3a0 legacy=0x7f88dc1383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:31.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 -- 172.21.15.88:0/722352466 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc135aa0 con 0x7f88dc0a18a0 2020-02-11T16:13:31.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> v2:172.21.15.88:3300/0 conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> v2:172.21.15.88:3300/0 conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88caffd700 1 -- 172.21.15.88:0/722352466 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d4003e90 con 0x7f88dc0a18a0 2020-02-11T16:13:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88caffd700 1 -- 172.21.15.88:0/722352466 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d4012760 con 0x7f88dc0a18a0 2020-02-11T16:13:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e3d04700 1 -- 172.21.15.88:0/722352466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc131f20 con 0x7f88dc0a18a0 2020-02-11T16:13:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88caffd700 1 -- 172.21.15.88:0/722352466 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d4012b00 con 0x7f88dc0a18a0 2020-02-11T16:13:31.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.947+0000 7f88e3d04700 1 -- 172.21.15.88:0/722352466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc136e50 con 0x7f88dc0a18a0 2020-02-11T16:13:31.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.948+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.948+0000 7f88caffd700 1 -- 172.21.15.88:0/722352466 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f88d4012d70 con 0x7f88dc0a18a0 2020-02-11T16:13:31.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.948+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.948+0000 7f88caffd700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f88bc039be0 0x7f88bc03c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.948+0000 7f88caffd700 1 -- 172.21.15.88:0/722352466 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f88d4049c60 con 0x7f88dc0a18a0 2020-02-11T16:13:31.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.948+0000 7f88e3d04700 1 -- 172.21.15.88:0/722352466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc1344f0 con 0x7f88dc0a18a0 2020-02-11T16:13:31.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.948+0000 7f88e129f700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f88bc039be0 0x7f88bc03c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:31.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.949+0000 7f88e129f700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f88bc039be0 0x7f88bc03c0a0 crc :-1 s=READY pgs=248 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:31.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.952+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:31.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:31.952+0000 7f88caffd700 1 -- 172.21.15.88:0/722352466 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f88d402f2e0 con 0x7f88dc0a18a0 2020-02-11T16:13:32.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.135+0000 7f88e3d04700 1 -- 172.21.15.88:0/722352466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f88dc0565b0 con 0x7f88dc0a18a0 2020-02-11T16:13:32.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.135+0000 7f88e1aa0700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:32.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.135+0000 7f88caffd700 1 -- 172.21.15.88:0/722352466 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f88d4031db0 con 0x7f88dc0a18a0 2020-02-11T16:13:32.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.136+0000 7f88e3d04700 1 -- 172.21.15.88:0/722352466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f88bc039be0 msgr2=0x7f88bc03c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:32.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.136+0000 7f88e3d04700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f88bc039be0 0x7f88bc03c0a0 crc :-1 s=READY pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:32.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.136+0000 7f88e3d04700 1 -- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 msgr2=0x7f88dc1347c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:32.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.136+0000 7f88e3d04700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 0x7f88dc1347c0 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f88d4000b20 tx=0x7f88d4010dc0).stop 2020-02-11T16:13:32.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.137+0000 7f88e3d04700 1 -- 172.21.15.88:0/722352466 shutdown_connections 2020-02-11T16:13:32.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.137+0000 7f88e3d04700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f88bc039be0 0x7f88bc03c0a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:32.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.137+0000 7f88e3d04700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88dc0a18a0 0x7f88dc1347c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:32.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.137+0000 7f88e3d04700 1 --2- 172.21.15.88:0/722352466 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88dc0a5de0 0x7f88dc1369f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:32.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.137+0000 7f88e3d04700 1 -- 172.21.15.88:0/722352466 >> 172.21.15.88:0/722352466 conn(0x7f88dc09d110 msgr2=0x7f88dc0a6240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:32.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.137+0000 7f88e3d04700 1 -- 172.21.15.88:0/722352466 shutdown_connections 2020-02-11T16:13:32.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:32.137+0000 7f88e3d04700 1 -- 172.21.15.88:0/722352466 wait complete. 2020-02-11T16:13:32.216 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:32.216 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":68,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:35.217 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:13:35.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.330+0000 7fdd8bfff700 1 Processor -- start 2020-02-11T16:13:35.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.330+0000 7fdd8bfff700 1 -- start start 2020-02-11T16:13:35.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd8c132260 0x7fdd8c140400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:35.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8bfff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0a4080 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8bfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0a4320 con 0x7fdd8c09de70 2020-02-11T16:13:35.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8bfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c0a31f0 con 0x7fdd8c132260 2020-02-11T16:13:35.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd8c132260 0x7fdd8c140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:35.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8affd700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7fdd8c0a5dc0 legacy=0x7fdd8c0a1300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:13:35.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8a7fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdd8c09de70 0x7fdd8c131b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42820/0 (socket says 172.21.15.88:42820) 2020-02-11T16:13:35.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd8c132260 0x7fdd8c140400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55194/0 (socket says 172.21.15.88:55194) 2020-02-11T16:13:35.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8a7fc700 1 -- 172.21.15.88:0/2230512009 learned_addr learned my addr 172.21.15.88:0/2230512009 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:35.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8b7fe700 1 -- 172.21.15.88:0/2230512009 >> v1:172.21.15.88:6789/0 conn(0x7fdd8c09de70 legacy=0x7fdd8c131b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:35.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8b7fe700 1 -- 172.21.15.88:0/2230512009 >> v1:172.21.15.52:6789/0 conn(0x7fdd8c0a5dc0 legacy=0x7fdd8c0a1300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:13:35.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd89ffb700 1 -- 172.21.15.88:0/2230512009 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820361507 0 0) 0x7fdd8c0a4320 con 0x7fdd8c09de70 2020-02-11T16:13:35.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8b7fe700 1 -- 172.21.15.88:0/2230512009 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c0a2780 con 0x7fdd8c132260 2020-02-11T16:13:35.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8b7fe700 1 --2- 172.21.15.88:0/2230512009 >> v2:172.21.15.88:3300/0 conn(0x7fdd8c132260 0x7fdd8c140400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd8c05eb90 tx=0x7fdd84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8b7fe700 1 --2- 172.21.15.88:0/2230512009 >> v2:172.21.15.88:3300/0 conn(0x7fdd8c132260 0x7fdd8c140400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd8c05eb90 tx=0x7fdd84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.331+0000 7fdd8b7fe700 1 --2- 172.21.15.88:0/2230512009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c132260 0x7fdd8c140400 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7fdd8c05eb90 tx=0x7fdd84008c60).ready entity=mon.1 client_cookie=62955b4aece53066 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:35.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd8b7fe700 1 --2- 172.21.15.88:0/2230512009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c132260 0x7fdd8c140400 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7fdd8c05eb90 tx=0x7fdd84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd89ffb700 1 -- 172.21.15.88:0/2230512009 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd8400a160 con 0x7fdd8c132260 2020-02-11T16:13:35.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd8b7fe700 1 --2- 172.21.15.88:0/2230512009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c132260 0x7fdd8c140400 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7fdd8c05eb90 tx=0x7fdd84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd89ffb700 1 -- 172.21.15.88:0/2230512009 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400a2c0 con 0x7fdd8c132260 2020-02-11T16:13:35.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd8b7fe700 1 --2- 172.21.15.88:0/2230512009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c132260 0x7fdd8c140400 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7fdd8c05eb90 tx=0x7fdd84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd89ffb700 1 -- 172.21.15.88:0/2230512009 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd8400a6a0 con 0x7fdd8c132260 2020-02-11T16:13:35.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd8bfff700 1 -- 172.21.15.88:0/2230512009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c132260 msgr2=0x7fdd8c140400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:35.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd8bfff700 1 --2- 172.21.15.88:0/2230512009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c132260 0x7fdd8c140400 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7fdd8c05eb90 tx=0x7fdd84008c60).stop 2020-02-11T16:13:35.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd8bfff700 1 -- 172.21.15.88:0/2230512009 shutdown_connections 2020-02-11T16:13:35.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd8bfff700 1 --2- 172.21.15.88:0/2230512009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c132260 0x7fdd8c140400 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:35.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd8bfff700 1 -- 172.21.15.88:0/2230512009 >> 172.21.15.88:0/2230512009 conn(0x7fdd8c0a9f90 msgr2=0x7fdd8c0aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:35.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd8bfff700 1 -- 172.21.15.88:0/2230512009 shutdown_connections 2020-02-11T16:13:35.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.332+0000 7fdd8bfff700 1 -- 172.21.15.88:0/2230512009 wait complete. 2020-02-11T16:13:35.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.333+0000 7fdd8bfff700 1 Processor -- start 2020-02-11T16:13:35.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.333+0000 7fdd8bfff700 1 -- start start 2020-02-11T16:13:35.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd8c09de70 0x7fdd8c0665b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:35.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd8c0a5dc0 0x7fdd8c135530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:35.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd8c132260 0x7fdd8c148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:35.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8bfff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c066b30 con 0x7fdd8c09de70 2020-02-11T16:13:35.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8bfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c065400 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8bfff700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c135990 con 0x7fdd8c132260 2020-02-11T16:13:35.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd8c0a5dc0 0x7fdd8c135530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:35.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd8c0a5dc0 0x7fdd8c135530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55200/0 (socket says 172.21.15.88:55200) 2020-02-11T16:13:35.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 -- 172.21.15.88:0/1128119836 learned_addr learned my addr 172.21.15.88:0/1128119836 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:35.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8affd700 1 -- 172.21.15.88:0/1128119836 >> v2:172.21.15.52:3300/0 conn(0x7fdd8c09de70 msgr2=0x7fdd8c0665b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:35.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8affd700 1 --2- 172.21.15.88:0/1128119836 >> v2:172.21.15.52:3300/0 conn(0x7fdd8c09de70 0x7fdd8c0665b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:13:35.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 -- 172.21.15.88:0/1128119836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd8c132260 msgr2=0x7fdd8c148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:35.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd8c132260 0x7fdd8c148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:35.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 -- 172.21.15.88:0/1128119836 >> v2:172.21.15.52:3300/0 conn(0x7fdd8c09de70 msgr2=0x7fdd8c0665b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:13:35.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> v2:172.21.15.52:3300/0 conn(0x7fdd8c09de70 0x7fdd8c0665b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:35.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 -- 172.21.15.88:0/1128119836 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c148660 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> v2:172.21.15.88:3300/0 conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> v2:172.21.15.88:3300/0 conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:35.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd83fff700 1 -- 172.21.15.88:0/1128119836 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd7400ca40 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd83fff700 1 -- 172.21.15.88:0/1128119836 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7400cba0 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd8bfff700 1 -- 172.21.15.88:0/1128119836 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c0655f0 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.334+0000 7fdd83fff700 1 -- 172.21.15.88:0/1128119836 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd740120e0 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.335+0000 7fdd8bfff700 1 -- 172.21.15.88:0/1128119836 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c135120 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.335+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.335+0000 7fdd83fff700 1 -- 172.21.15.88:0/1128119836 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdd740055c0 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.335+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.335+0000 7fdd83fff700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd70039c10 0x7fdd7003c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:35.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.335+0000 7fdd83fff700 1 -- 172.21.15.88:0/1128119836 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdd7404c600 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.336+0000 7fdd8affd700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd70039c10 0x7fdd7003c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:35.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.336+0000 7fdd8bfff700 1 -- 172.21.15.88:0/1128119836 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c0657f0 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.336+0000 7fdd8affd700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd70039c10 0x7fdd7003c0d0 crc :-1 s=READY pgs=249 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:35.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.339+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.339+0000 7fdd83fff700 1 -- 172.21.15.88:0/1128119836 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fdd7402ea20 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.521+0000 7fdd8bfff700 1 -- 172.21.15.88:0/1128119836 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdd8c1494f0 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.522+0000 7fdd8a7fc700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:35.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.522+0000 7fdd83fff700 1 -- 172.21.15.88:0/1128119836 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fdd740100b0 con 0x7fdd8c0a5dc0 2020-02-11T16:13:35.525 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:35.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 -- 172.21.15.88:0/1128119836 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd70039c10 msgr2=0x7fdd7003c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:35.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd70039c10 0x7fdd7003c0d0 crc :-1 s=READY pgs=249 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:35.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 -- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 msgr2=0x7fdd8c135530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:35.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 0x7fdd8c135530 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7fdd74000b80 tx=0x7fdd74001e40).stop 2020-02-11T16:13:35.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 -- 172.21.15.88:0/1128119836 shutdown_connections 2020-02-11T16:13:35.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd8c132260 0x7fdd8c148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:35.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd70039c10 0x7fdd7003c0d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:35.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 --2- 172.21.15.88:0/1128119836 >> v2:172.21.15.52:3300/0 conn(0x7fdd8c09de70 0x7fdd8c0665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:35.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 --2- 172.21.15.88:0/1128119836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd8c0a5dc0 0x7fdd8c135530 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:35.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 -- 172.21.15.88:0/1128119836 >> 172.21.15.88:0/1128119836 conn(0x7fdd8c0a9f90 msgr2=0x7fdd8c0a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:35.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 -- 172.21.15.88:0/1128119836 shutdown_connections 2020-02-11T16:13:35.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:35.523+0000 7fdd8bfff700 1 -- 172.21.15.88:0/1128119836 wait complete. 2020-02-11T16:13:35.537 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":68,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:38.538 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:13:38.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.650+0000 7fea198c5700 1 Processor -- start 2020-02-11T16:13:38.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.650+0000 7fea198c5700 1 -- start start 2020-02-11T16:13:38.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea198c5700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea140a18a0 0x7fea140a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:38.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea198c5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea140a5de0 0x7fea140a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:38.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea198c5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fea1412e3a0 0x7fea1412e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:38.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea198c5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140a3570 con 0x7fea140a5de0 2020-02-11T16:13:38.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea198c5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140a3810 con 0x7fea1412e3a0 2020-02-11T16:13:38.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea198c5700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140a3ab0 con 0x7fea140a18a0 2020-02-11T16:13:38.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea127fc700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fea140a5de0 msgr2=0x7fea140a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:38.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea127fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea140a5de0 0x7fea140a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:13:38.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fea1412e3a0 0x7fea1412e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:38.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fea1412e3a0 0x7fea1412e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55208/0 (socket says 172.21.15.88:55208) 2020-02-11T16:13:38.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 -- 172.21.15.88:0/1287099221 learned_addr learned my addr 172.21.15.88:0/1287099221 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:38.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea12ffd700 1 --2- 172.21.15.88:0/1287099221 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea140a18a0 0x7fea140a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:38.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 -- 172.21.15.88:0/1287099221 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea140a18a0 msgr2=0x7fea140a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:38.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 --2- 172.21.15.88:0/1287099221 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea140a18a0 0x7fea140a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:38.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 -- 172.21.15.88:0/1287099221 >> v2:172.21.15.52:3300/0 conn(0x7fea140a5de0 msgr2=0x7fea140a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:13:38.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 --2- 172.21.15.88:0/1287099221 >> v2:172.21.15.52:3300/0 conn(0x7fea140a5de0 0x7fea140a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:38.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 -- 172.21.15.88:0/1287099221 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140a3d50 con 0x7fea1412e3a0 2020-02-11T16:13:38.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 --2- 172.21.15.88:0/1287099221 >> v2:172.21.15.88:3300/0 conn(0x7fea1412e3a0 0x7fea1412e830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fea1405bbc0 tx=0x7fea0c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 --2- 172.21.15.88:0/1287099221 >> v2:172.21.15.88:3300/0 conn(0x7fea1412e3a0 0x7fea1412e830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fea1405bbc0 tx=0x7fea0c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.651+0000 7fea137fe700 1 --2- 172.21.15.88:0/1287099221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea1412e3a0 0x7fea1412e830 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea0c008c60).ready entity=mon.1 client_cookie=e4d05f03c4ddfe5a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:38.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea137fe700 1 --2- 172.21.15.88:0/1287099221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea1412e3a0 0x7fea1412e830 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea0c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea137fe700 1 --2- 172.21.15.88:0/1287099221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea1412e3a0 0x7fea1412e830 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea0c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea11ffb700 1 -- 172.21.15.88:0/1287099221 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0c00a160 con 0x7fea1412e3a0 2020-02-11T16:13:38.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea137fe700 1 --2- 172.21.15.88:0/1287099221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea1412e3a0 0x7fea1412e830 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea0c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea11ffb700 1 -- 172.21.15.88:0/1287099221 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c00a2c0 con 0x7fea1412e3a0 2020-02-11T16:13:38.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea11ffb700 1 -- 172.21.15.88:0/1287099221 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0c00a6a0 con 0x7fea1412e3a0 2020-02-11T16:13:38.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea198c5700 1 -- 172.21.15.88:0/1287099221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea1412e3a0 msgr2=0x7fea1412e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:38.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea198c5700 1 --2- 172.21.15.88:0/1287099221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea1412e3a0 0x7fea1412e830 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea0c008c60).stop 2020-02-11T16:13:38.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea198c5700 1 -- 172.21.15.88:0/1287099221 shutdown_connections 2020-02-11T16:13:38.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea198c5700 1 --2- 172.21.15.88:0/1287099221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea1412e3a0 0x7fea1412e830 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:38.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea198c5700 1 --2- 172.21.15.88:0/1287099221 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea140a18a0 0x7fea140a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:38.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea198c5700 1 --2- 172.21.15.88:0/1287099221 >> v2:172.21.15.52:3300/0 conn(0x7fea140a5de0 0x7fea140a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:38.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea198c5700 1 -- 172.21.15.88:0/1287099221 >> 172.21.15.88:0/1287099221 conn(0x7fea1409d110 msgr2=0x7fea1409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:38.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea198c5700 1 -- 172.21.15.88:0/1287099221 shutdown_connections 2020-02-11T16:13:38.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.652+0000 7fea198c5700 1 -- 172.21.15.88:0/1287099221 wait complete. 2020-02-11T16:13:38.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.653+0000 7fea198c5700 1 Processor -- start 2020-02-11T16:13:38.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.653+0000 7fea198c5700 1 -- start start 2020-02-11T16:13:38.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea198c5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea140a18a0 0x7fea14131c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:38.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea198c5700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:38.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea198c5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea14135120 con 0x7fea140a5de0 2020-02-11T16:13:38.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea198c5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea141353c0 con 0x7fea140a18a0 2020-02-11T16:13:38.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea198c5700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea14135660 con 0x7fea1412e3a0 2020-02-11T16:13:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea12ffd700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fea140a18a0 msgr2=0x7fea14131c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea12ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea140a18a0 0x7fea14131c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:13:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea127fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fea140a5de0 0x7fea141333d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42842/0 (socket says 172.21.15.88:42842) 2020-02-11T16:13:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea127fc700 1 -- 172.21.15.88:0/577721926 learned_addr learned my addr 172.21.15.88:0/577721926 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea137fe700 1 -- 172.21.15.88:0/577721926 >> v2:172.21.15.52:3300/0 conn(0x7fea140a18a0 msgr2=0x7fea14131c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:13:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> v2:172.21.15.52:3300/0 conn(0x7fea140a18a0 0x7fea14131c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea137fe700 1 -- 172.21.15.88:0/577721926 >> v1:172.21.15.88:6789/0 conn(0x7fea140a5de0 legacy=0x7fea141333d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea137fe700 1 -- 172.21.15.88:0/577721926 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14135900 con 0x7fea1412e3a0 2020-02-11T16:13:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.654+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea0bfff700 1 -- 172.21.15.88:0/577721926 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0c005a40 con 0x7fea1412e3a0 2020-02-11T16:13:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea198c5700 1 -- 172.21.15.88:0/577721926 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea141320c0 con 0x7fea1412e3a0 2020-02-11T16:13:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea0bfff700 1 -- 172.21.15.88:0/577721926 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c005ba0 con 0x7fea1412e3a0 2020-02-11T16:13:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea0bfff700 1 -- 172.21.15.88:0/577721926 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0c00f570 con 0x7fea1412e3a0 2020-02-11T16:13:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea198c5700 1 -- 172.21.15.88:0/577721926 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1412aee0 con 0x7fea1412e3a0 2020-02-11T16:13:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.655+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.656+0000 7fea198c5700 1 -- 172.21.15.88:0/577721926 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea140565b0 con 0x7fea1412e3a0 2020-02-11T16:13:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.656+0000 7fea0bfff700 1 -- 172.21.15.88:0/577721926 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fea0c00f7f0 con 0x7fea1412e3a0 2020-02-11T16:13:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.656+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.656+0000 7fea0bfff700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe9f803bda0 0x7fe9f803e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.656+0000 7fea0bfff700 1 -- 172.21.15.88:0/577721926 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fea0c04a7c0 con 0x7fea1412e3a0 2020-02-11T16:13:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.656+0000 7fea12ffd700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe9f803bda0 0x7fe9f803e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.656+0000 7fea12ffd700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe9f803bda0 0x7fe9f803e260 crc :-1 s=READY pgs=250 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:38.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.660+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.660+0000 7fea0bfff700 1 -- 172.21.15.88:0/577721926 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fea0c032d90 con 0x7fea1412e3a0 2020-02-11T16:13:38.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.841+0000 7fea198c5700 1 -- 172.21.15.88:0/577721926 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fea1405ccb0 con 0x7fea1412e3a0 2020-02-11T16:13:38.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.843+0000 7fea137fe700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:38.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.843+0000 7fea0bfff700 1 -- 172.21.15.88:0/577721926 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fea0c032950 con 0x7fea1412e3a0 2020-02-11T16:13:38.845 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:38.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 -- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe9f803bda0 msgr2=0x7fe9f803e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe9f803bda0 0x7fe9f803e260 crc :-1 s=READY pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 -- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 msgr2=0x7fea14133ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fea1405bbc0 tx=0x7fea140a1c80).stop 2020-02-11T16:13:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 -- 172.21.15.88:0/577721926 shutdown_connections 2020-02-11T16:13:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea1412e3a0 0x7fea14133ae0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 --2- 172.21.15.88:0/577721926 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe9f803bda0 0x7fe9f803e260 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:38.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 --2- 172.21.15.88:0/577721926 >> v2:172.21.15.52:3300/0 conn(0x7fea140a18a0 0x7fea14131c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:38.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 -- 172.21.15.88:0/577721926 >> 172.21.15.88:0/577721926 conn(0x7fea1409d110 msgr2=0x7fea140a4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:38.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 -- 172.21.15.88:0/577721926 shutdown_connections 2020-02-11T16:13:38.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:38.844+0000 7fea198c5700 1 -- 172.21.15.88:0/577721926 wait complete. 2020-02-11T16:13:38.857 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":68,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:41.858 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:13:41.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.975+0000 7faf436fb700 1 Processor -- start 2020-02-11T16:13:41.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.975+0000 7faf436fb700 1 -- start start 2020-02-11T16:13:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.976+0000 7faf436fb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 0x7faf3c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.976+0000 7faf436fb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0a4350 con 0x7faf3c131990 2020-02-11T16:13:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.976+0000 7faf436fb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0a3a40 con 0x7faf3c0a5410 2020-02-11T16:13:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.976+0000 7faf436fb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c0a1e60 con 0x7faf3c0a2fa0 2020-02-11T16:13:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.976+0000 7faf41497700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 msgr2=0x7faf3c0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.976+0000 7faf41c98700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7faf3c131990 legacy=0x7faf3c13ead0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:13:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.976+0000 7faf40c96700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faf3c0a5410 0x7faf3c131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42850/0 (socket says 172.21.15.88:42850) 2020-02-11T16:13:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.976+0000 7faf41497700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 0x7faf3c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:13:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:41.976+0000 7faf40c96700 1 -- 172.21.15.88:0/1918878107 learned_addr learned my addr 172.21.15.88:0/1918878107 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:13:42.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:42.177+0000 7faf41c98700 1 -- 172.21.15.88:0/1918878107 >> v1:172.21.15.52:6789/0 conn(0x7faf3c131990 legacy=0x7faf3c13ead0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:13:42.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:42.177+0000 7faf41497700 1 -- 172.21.15.88:0/1918878107 >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 msgr2=0x7faf3c0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:42.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:42.177+0000 7faf41497700 1 --2- 172.21.15.88:0/1918878107 >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 0x7faf3c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:13:42.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:42.578+0000 7faf41c98700 1 -- 172.21.15.88:0/1918878107 >> v1:172.21.15.52:6789/0 conn(0x7faf3c131990 legacy=0x7faf3c13ead0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:13:42.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:42.578+0000 7faf41497700 1 -- 172.21.15.88:0/1918878107 >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 msgr2=0x7faf3c0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:42.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:42.578+0000 7faf41497700 1 --2- 172.21.15.88:0/1918878107 >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 0x7faf3c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:13:42.887 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:13:42.890 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:13:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:43.379+0000 7faf41c98700 1 -- 172.21.15.88:0/1918878107 >> v1:172.21.15.52:6789/0 conn(0x7faf3c131990 legacy=0x7faf3c13ead0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:13:43.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:43.379+0000 7faf41497700 1 -- 172.21.15.88:0/1918878107 >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 msgr2=0x7faf3c0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:43.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:43.379+0000 7faf41497700 1 --2- 172.21.15.88:0/1918878107 >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 0x7faf3c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:13:44.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:44.981+0000 7faf41c98700 1 -- 172.21.15.88:0/1918878107 >> v1:172.21.15.52:6789/0 conn(0x7faf3c131990 legacy=0x7faf3c13ead0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:13:44.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:44.981+0000 7faf41497700 1 -- 172.21.15.88:0/1918878107 >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 msgr2=0x7faf3c0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:44.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:44.981+0000 7faf41497700 1 --2- 172.21.15.88:0/1918878107 >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 0x7faf3c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:13:46.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.113+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236779381 0 0) 0x7faf3c0a3a40 con 0x7faf3c0a5410 2020-02-11T16:13:46.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.113+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf24004340 con 0x7faf3c0a5410 2020-02-11T16:13:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.115+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3023392959 0 0) 0x7faf24004340 con 0x7faf3c0a5410 2020-02-11T16:13:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.115+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 msgr2=0x7faf3c0a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:13:46.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.115+0000 7faf2bfff700 1 --2- 172.21.15.88:0/1918878107 >> v2:172.21.15.52:3300/0 conn(0x7faf3c0a2fa0 0x7faf3c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:46.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.115+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 >> v1:172.21.15.52:6789/0 conn(0x7faf3c131990 legacy=0x7faf3c13ead0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:13:46.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.115+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0a3ce0 con 0x7faf3c0a5410 2020-02-11T16:13:46.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.115+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7faf2c001670 con 0x7faf3c0a5410 2020-02-11T16:13:46.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.115+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 >> v1:172.21.15.88:6789/0 conn(0x7faf3c0a5410 legacy=0x7faf3c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.115+0000 7faf2bfff700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf24004830 0x7faf24004c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:46.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf2bfff700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf240055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:46.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf2bfff700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf24005b30 0x7faf24005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:46.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0a1e60 con 0x7faf24005b30 2020-02-11T16:13:46.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2400c8c0 con 0x7faf240050b0 2020-02-11T16:13:46.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2400ca80 con 0x7faf24004830 2020-02-11T16:13:46.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf41c98700 1 -- 172.21.15.88:0/1918878107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf24005b30 msgr2=0x7faf24005fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:46.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf41c98700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf24005b30 0x7faf24005fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:13:46.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf40c96700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf240055e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf41497700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf24004830 0x7faf24004c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf40c96700 1 -- 172.21.15.88:0/1918878107 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf24004830 msgr2=0x7faf24004c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:46.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf40c96700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf24004830 0x7faf24004c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:46.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf40c96700 1 -- 172.21.15.88:0/1918878107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf24005b30 msgr2=0x7faf24005fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:13:46.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf40c96700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf24005b30 0x7faf24005fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:46.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf41c98700 1 -- 172.21.15.88:0/1918878107 reap_dead start 2020-02-11T16:13:46.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf40c96700 1 -- 172.21.15.88:0/1918878107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24004340 con 0x7faf240050b0 2020-02-11T16:13:46.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf40c96700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf240055e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf24005550 tx=0x7faf2c00c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf40c96700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf240055e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf24005550 tx=0x7faf2c00c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.116+0000 7faf40c96700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf240055e0 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7faf24005550 tx=0x7faf2c00c1e0).ready entity=mon.1 client_cookie=37fe551c5512ec79 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.117+0000 7faf40c96700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf240055e0 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7faf24005550 tx=0x7faf2c00c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.117+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2c00ee30 con 0x7faf240050b0 2020-02-11T16:13:46.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.117+0000 7faf40c96700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf240055e0 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7faf24005550 tx=0x7faf2c00c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.117+0000 7faf40c96700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf240055e0 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7faf24005550 tx=0x7faf2c00c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.117+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c010d30 con 0x7faf240050b0 2020-02-11T16:13:46.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.117+0000 7faf2bfff700 1 -- 172.21.15.88:0/1918878107 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2c010ea0 con 0x7faf240050b0 2020-02-11T16:13:46.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.117+0000 7faf436fb700 1 -- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 msgr2=0x7faf240055e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.117+0000 7faf436fb700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf240055e0 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7faf24005550 tx=0x7faf2c00c1e0).stop 2020-02-11T16:13:46.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.118+0000 7faf436fb700 1 -- 172.21.15.88:0/1918878107 shutdown_connections 2020-02-11T16:13:46.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.118+0000 7faf436fb700 1 --2- 172.21.15.88:0/1918878107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf240055e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.118+0000 7faf436fb700 1 -- 172.21.15.88:0/1918878107 >> 172.21.15.88:0/1918878107 conn(0x7faf3c09d110 msgr2=0x7faf3c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:46.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.118+0000 7faf436fb700 1 -- 172.21.15.88:0/1918878107 shutdown_connections 2020-02-11T16:13:46.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.118+0000 7faf436fb700 1 -- 172.21.15.88:0/1918878107 wait complete. 2020-02-11T16:13:46.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.119+0000 7faf436fb700 1 Processor -- start 2020-02-11T16:13:46.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.119+0000 7faf436fb700 1 -- start start 2020-02-11T16:13:46.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.120+0000 7faf436fb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf240050b0 0x7faf3c137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.120+0000 7faf436fb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf3c0a0380 0x7faf3c135740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.120+0000 7faf436fb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c137f60 con 0x7faf3c135ba0 2020-02-11T16:13:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.120+0000 7faf436fb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c138200 con 0x7faf240050b0 2020-02-11T16:13:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.120+0000 7faf436fb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c1384a0 con 0x7faf3c0a0380 2020-02-11T16:13:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.120+0000 7faf41497700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf240050b0 0x7faf3c137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.120+0000 7faf41497700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf240050b0 0x7faf3c137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55250/0 (socket says 172.21.15.88:55250) 2020-02-11T16:13:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.120+0000 7faf41497700 1 -- 172.21.15.88:0/1533852950 learned_addr learned my addr 172.21.15.88:0/1533852950 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.120+0000 7faf40c96700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf3c0a0380 0x7faf3c135740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 -- 172.21.15.88:0/1533852950 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf3c0a0380 msgr2=0x7faf3c135740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf3c0a0380 0x7faf3c135740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 -- 172.21.15.88:0/1533852950 >> v1:172.21.15.88:6789/0 conn(0x7faf3c135ba0 legacy=0x7faf3c148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 -- 172.21.15.88:0/1533852950 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0665c0 con 0x7faf240050b0 2020-02-11T16:13:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf2a7fc700 1 -- 172.21.15.88:0/1533852950 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040672716 0 0) 0x7faf3c137f60 con 0x7faf3c135ba0 2020-02-11T16:13:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> v2:172.21.15.88:3300/0 conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> v2:172.21.15.88:3300/0 conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf2a7fc700 1 -- 172.21.15.88:0/1533852950 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf38012b80 con 0x7faf240050b0 2020-02-11T16:13:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf2a7fc700 1 -- 172.21.15.88:0/1533852950 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38012ce0 con 0x7faf240050b0 2020-02-11T16:13:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf436fb700 1 -- 172.21.15.88:0/1533852950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c0aa0e0 con 0x7faf240050b0 2020-02-11T16:13:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf2a7fc700 1 -- 172.21.15.88:0/1533852950 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3800e590 con 0x7faf240050b0 2020-02-11T16:13:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf436fb700 1 -- 172.21.15.88:0/1533852950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c148c90 con 0x7faf240050b0 2020-02-11T16:13:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.121+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.122+0000 7faf2a7fc700 1 -- 172.21.15.88:0/1533852950 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7faf3800e800 con 0x7faf240050b0 2020-02-11T16:13:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.122+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.122+0000 7faf2a7fc700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faf1c039be0 0x7faf1c03c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.122+0000 7faf2a7fc700 1 -- 172.21.15.88:0/1533852950 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7faf3804a060 con 0x7faf240050b0 2020-02-11T16:13:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.122+0000 7faf40c96700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faf1c039be0 0x7faf1c03c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.122+0000 7faf40c96700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faf1c039be0 0x7faf1c03c0a0 crc :-1 s=READY pgs=251 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.123+0000 7faf436fb700 1 -- 172.21.15.88:0/1533852950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c1354a0 con 0x7faf240050b0 2020-02-11T16:13:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.126+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.126+0000 7faf2a7fc700 1 -- 172.21.15.88:0/1533852950 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7faf3c1354a0 con 0x7faf240050b0 2020-02-11T16:13:46.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.313+0000 7faf436fb700 1 -- 172.21.15.88:0/1533852950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7faf3c1354a0 con 0x7faf240050b0 2020-02-11T16:13:46.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.313+0000 7faf41497700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.313+0000 7faf2a7fc700 1 -- 172.21.15.88:0/1533852950 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7faf38006510 con 0x7faf240050b0 2020-02-11T16:13:46.316 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":70,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 -- 172.21.15.88:0/1533852950 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faf1c039be0 msgr2=0x7faf1c03c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faf1c039be0 0x7faf1c03c0a0 crc :-1 s=READY pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 -- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 msgr2=0x7faf3c137770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf3c137770 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7faf380036e0 tx=0x7faf38010d10).stop 2020-02-11T16:13:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 -- 172.21.15.88:0/1533852950 shutdown_connections 2020-02-11T16:13:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faf1c039be0 0x7faf1c03c0a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf240050b0 0x7faf3c137770 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 --2- 172.21.15.88:0/1533852950 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faf3c0a0380 0x7faf3c135740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 -- 172.21.15.88:0/1533852950 >> 172.21.15.88:0/1533852950 conn(0x7faf3c09d110 msgr2=0x7faf3c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 -- 172.21.15.88:0/1533852950 shutdown_connections 2020-02-11T16:13:46.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.315+0000 7faf436fb700 1 -- 172.21.15.88:0/1533852950 wait complete. 2020-02-11T16:13:46.327 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":70,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:13:46.328 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:13:46.328 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:13:46.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.431+0000 7f6125213700 1 Processor -- start 2020-02-11T16:13:46.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.431+0000 7f6125213700 1 -- start start 2020-02-11T16:13:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f6125213700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61200a7120 0x7f61200a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f6125213700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61200a50f0 0x7f61200a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f6125213700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f612013c120 0x7f612013c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:46.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f6125213700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61200a6470 con 0x7f612013c120 2020-02-11T16:13:46.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f6125213700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61200a49b0 con 0x7f61200a7120 2020-02-11T16:13:46.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f6125213700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61200a4c50 con 0x7f61200a50f0 2020-02-11T16:13:46.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61200a7120 0x7f61200a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61200a7120 0x7f61200a2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55258/0 (socket says 172.21.15.88:55258) 2020-02-11T16:13:46.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 -- 172.21.15.88:0/190596717 learned_addr learned my addr 172.21.15.88:0/190596717 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:46.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611f59e700 1 -- 172.21.15.88:0/190596717 >> v2:172.21.15.52:3300/0 conn(0x7f612013c120 msgr2=0x7f612013c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:46.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611f59e700 1 --2- 172.21.15.88:0/190596717 >> v2:172.21.15.52:3300/0 conn(0x7f612013c120 0x7f612013c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:13:46.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f6117fff700 1 --2- 172.21.15.88:0/190596717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61200a50f0 0x7f61200a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 -- 172.21.15.88:0/190596717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61200a50f0 msgr2=0x7f61200a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:13:46.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 --2- 172.21.15.88:0/190596717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61200a50f0 0x7f61200a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:46.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 -- 172.21.15.88:0/190596717 >> v2:172.21.15.52:3300/0 conn(0x7f612013c120 msgr2=0x7f612013c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:13:46.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 --2- 172.21.15.88:0/190596717 >> v2:172.21.15.52:3300/0 conn(0x7f612013c120 0x7f612013c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:46.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 -- 172.21.15.88:0/190596717 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61200a5570 con 0x7f61200a7120 2020-02-11T16:13:46.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 --2- 172.21.15.88:0/190596717 >> v2:172.21.15.88:3300/0 conn(0x7f61200a7120 0x7f61200a2900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f61200a4fd0 tx=0x7f61100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 --2- 172.21.15.88:0/190596717 >> v2:172.21.15.88:3300/0 conn(0x7f61200a7120 0x7f61200a2900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f61200a4fd0 tx=0x7f61100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 --2- 172.21.15.88:0/190596717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f61200a2900 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7f61200a4fd0 tx=0x7f61100088e0).ready entity=mon.1 client_cookie=5277b9271a5bd576 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 --2- 172.21.15.88:0/190596717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f61200a2900 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f61200a4fd0 tx=0x7f61100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 --2- 172.21.15.88:0/190596717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f61200a2900 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f61200a4fd0 tx=0x7f61100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611e59c700 1 -- 172.21.15.88:0/190596717 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6110011720 con 0x7f61200a7120 2020-02-11T16:13:46.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611ed9d700 1 --2- 172.21.15.88:0/190596717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f61200a2900 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f61200a4fd0 tx=0x7f61100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611e59c700 1 -- 172.21.15.88:0/190596717 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110011880 con 0x7f61200a7120 2020-02-11T16:13:46.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f611e59c700 1 -- 172.21.15.88:0/190596717 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6110011c60 con 0x7f61200a7120 2020-02-11T16:13:46.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f6125213700 1 -- 172.21.15.88:0/190596717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 msgr2=0x7f61200a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.432+0000 7f6125213700 1 --2- 172.21.15.88:0/190596717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f61200a2900 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7f61200a4fd0 tx=0x7f61100088e0).stop 2020-02-11T16:13:46.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.433+0000 7f6125213700 1 -- 172.21.15.88:0/190596717 shutdown_connections 2020-02-11T16:13:46.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.433+0000 7f6125213700 1 --2- 172.21.15.88:0/190596717 >> v2:172.21.15.52:3300/0 conn(0x7f612013c120 0x7f612013c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:46.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.433+0000 7f6125213700 1 --2- 172.21.15.88:0/190596717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f61200a2900 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.433+0000 7f6125213700 1 --2- 172.21.15.88:0/190596717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61200a50f0 0x7f61200a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:46.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.433+0000 7f6125213700 1 -- 172.21.15.88:0/190596717 >> 172.21.15.88:0/190596717 conn(0x7f612009d110 msgr2=0x7f612009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:46.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.433+0000 7f6125213700 1 -- 172.21.15.88:0/190596717 shutdown_connections 2020-02-11T16:13:46.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.433+0000 7f6125213700 1 -- 172.21.15.88:0/190596717 wait complete. 2020-02-11T16:13:46.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f6125213700 1 Processor -- start 2020-02-11T16:13:46.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f6125213700 1 -- start start 2020-02-11T16:13:46.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f6125213700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61200a50f0 0x7f6120135750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f6125213700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61200a7120 0x7f612012dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f6125213700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f612013c120 0x7f612012e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f6125213700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6120139e80 con 0x7f61200a50f0 2020-02-11T16:13:46.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f6125213700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612013d370 con 0x7f61200a7120 2020-02-11T16:13:46.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f6125213700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612013d610 con 0x7f612013c120 2020-02-11T16:13:46.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f6117fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61200a7120 0x7f612012dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f611ed9d700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f61200a50f0 msgr2=0x7f6120135750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:46.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.434+0000 7f6117fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61200a7120 0x7f612012dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55266/0 (socket says 172.21.15.88:55266) 2020-02-11T16:13:46.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 -- 172.21.15.88:0/433893378 learned_addr learned my addr 172.21.15.88:0/433893378 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:46.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> v2:172.21.15.52:3300/0 conn(0x7f61200a50f0 0x7f6120135750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:13:46.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 -- 172.21.15.88:0/433893378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f612013c120 msgr2=0x7f612012e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f611f59e700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f612013c120 0x7f612012e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f612013c120 0x7f612012e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 -- 172.21.15.88:0/433893378 >> v2:172.21.15.52:3300/0 conn(0x7f61200a50f0 msgr2=0x7f6120135750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:13:46.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 --2- 172.21.15.88:0/433893378 >> v2:172.21.15.52:3300/0 conn(0x7f61200a50f0 0x7f6120135750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 -- 172.21.15.88:0/433893378 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6120135bb0 con 0x7f61200a7120 2020-02-11T16:13:46.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 --2- 172.21.15.88:0/433893378 >> v2:172.21.15.88:3300/0 conn(0x7f61200a7120 0x7f612012dba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6108002f30 tx=0x7f6108010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 --2- 172.21.15.88:0/433893378 >> v2:172.21.15.88:3300/0 conn(0x7f61200a7120 0x7f612012dba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6108002f30 tx=0x7f6108010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f612012dba0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7f6108002f30 tx=0x7f6108010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f612012dba0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f6108002f30 tx=0x7f6108010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f612012dba0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f6108002f30 tx=0x7f6108010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6108012380 con 0x7f61200a7120 2020-02-11T16:13:46.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f612012dba0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f6108002f30 tx=0x7f6108010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61080124e0 con 0x7f61200a7120 2020-02-11T16:13:46.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6125213700 1 -- 172.21.15.88:0/433893378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612012e460 con 0x7f61200a7120 2020-02-11T16:13:46.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6108012900 con 0x7f61200a7120 2020-02-11T16:13:46.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6125213700 1 -- 172.21.15.88:0/433893378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6120130a70 con 0x7f61200a7120 2020-02-11T16:13:46.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.435+0000 7f6117fff700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f612012dba0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f6108002f30 tx=0x7f6108010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f6125213700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 0x7f612013dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f6125213700 1 -- 172.21.15.88:0/433893378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612005e2f0 con 0x7f61200a58b0 2020-02-11T16:13:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6108012b70 con 0x7f61200a7120 2020-02-11T16:13:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f6117fff700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f612012dba0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f6108002f30 tx=0x7f6108010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 0x7f612013dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611cd99700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6104039c40 0x7f610403c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6108013060 con 0x7f61200a7120 2020-02-11T16:13:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611ed9d700 1 -- 172.21.15.88:0/433893378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61200565b0 con 0x7f61200a58b0 2020-02-11T16:13:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611f59e700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6104039c40 0x7f610403c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 0x7f612013dd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 0x7f612013dd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 0x7f612013dd50 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 0x7f612013dd50 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6110011cd0 con 0x7f61200a58b0 2020-02-11T16:13:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611f59e700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6104039c40 0x7f610403c100 crc :-1 s=READY pgs=252 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.436+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 0x7f612013dd50 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.437+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6110007150 con 0x7f61200a58b0 2020-02-11T16:13:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.437+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 msgr2=0x7f612013dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.437+0000 7f611cd99700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 0x7f612013dd50 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).stop 2020-02-11T16:13:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.437+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 msgr2=0x7f612013dd50 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.437+0000 7f611cd99700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a58b0 0x7f612013dd50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f6125213700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 0x7f612013e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f6125213700 1 -- 172.21.15.88:0/433893378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612013d4b0 con 0x7f61200a5c90 2020-02-11T16:13:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 0x7f612013e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611ed9d700 1 -- 172.21.15.88:0/433893378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f612005ccb0 con 0x7f61200a5c90 2020-02-11T16:13:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 0x7f612013e1b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 0x7f612013e1b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 0x7f612013e1b0 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 0x7f612013e1b0 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f611000c730 con 0x7f61200a5c90 2020-02-11T16:13:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611ed9d700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 0x7f612013e1b0 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4350 (secure 0 0 0) 0x7f611000c890 con 0x7f61200a5c90 2020-02-11T16:13:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 msgr2=0x7f612013e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611cd99700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 0x7f612013e1b0 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f6110007ed0 tx=0x7f61200a7500).stop 2020-02-11T16:13:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611cd99700 1 -- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 msgr2=0x7f612013e1b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.445+0000 7f611cd99700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a5c90 0x7f612013e1b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f6125213700 1 -- 172.21.15.88:0/433893378 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6104039c40 msgr2=0x7f610403c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f6125213700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6104039c40 0x7f610403c100 crc :-1 s=READY pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f6125213700 1 -- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 msgr2=0x7f612012dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f6125213700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f612012dba0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7f6108002f30 tx=0x7f6108010af0).stop 2020-02-11T16:13:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f611f59e700 1 -- 172.21.15.88:0/433893378 reap_dead start 2020-02-11T16:13:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f611f59e700 1 -- 172.21.15.88:0/433893378 reap_dead start 2020-02-11T16:13:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f6125213700 1 -- 172.21.15.88:0/433893378 shutdown_connections 2020-02-11T16:13:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f6125213700 1 --2- 172.21.15.88:0/433893378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61200a7120 0x7f612012dba0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f6125213700 1 -- 172.21.15.88:0/433893378 >> 172.21.15.88:0/433893378 conn(0x7f612009d110 msgr2=0x7f612012fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f6125213700 1 -- 172.21.15.88:0/433893378 shutdown_connections 2020-02-11T16:13:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.446+0000 7f6125213700 1 -- 172.21.15.88:0/433893378 wait complete. 2020-02-11T16:13:46.477 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:13:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:13:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 70, 2020-02-11T16:13:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:13:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:13:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:13:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:13:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:13:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:13:46.480 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:46.480 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:46.480 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:46.480 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:46.480 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:46.480 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:46.480 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.481 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:13:46.481 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:13:46.481 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:46.481 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:46.481 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:46.481 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:46.482 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:46.482 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:46.482 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.482 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:13:46.482 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:13:46.482 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:13:46.483 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:13:46.483 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:13:46.483 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:13:46.483 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:46.483 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:46.483 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:13:46.483 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:13:46.484 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:46.484 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:13:46.484 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:46.484 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:46.484 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:46.484 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:46.484 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:46.484 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:46.485 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.485 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:13:46.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.485 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:13:46.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.485 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:13:46.485 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:13:46.486 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:46.486 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:46.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.486 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:46.487 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:13:46.487 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.487 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:46.487 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:13:46.487 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.488 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.488 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:13:46.488 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:13:46.489 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:46.489 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:46.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.489 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:46.490 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:46.490 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:46.490 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:46.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.490 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:46.490 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:13:46.490 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.491 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:46.491 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:13:46.491 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.491 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.491 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.492 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:13:46.492 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:13:46.492 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:46.492 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:46.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.493 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:46.493 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:46.493 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:46.493 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:46.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.493 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:46.493 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:13:46.494 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.494 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:46.494 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:13:46.494 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.494 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.494 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.495 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:13:46.495 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:13:46.495 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:46.495 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:46.495 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.495 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.496 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:13:46.496 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:13:46.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.496 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:46.496 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:46.496 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:46.497 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.497 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.497 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:13:46.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.497 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:46.497 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:46.497 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:13:46.498 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.498 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.498 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:13:46.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.498 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:46.498 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:46.498 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2020-02-11T16:13:46.498 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.499 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.499 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:13:46.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.499 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:46.500 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:46.500 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:13:46.500 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.500 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.500 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:13:46.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.500 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:46.500 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:46.501 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:13:46.501 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.501 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.501 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.501 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:13:46.502 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:13:46.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.606+0000 7fec8db94700 1 Processor -- start 2020-02-11T16:13:46.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.606+0000 7fec8db94700 1 -- start start 2020-02-11T16:13:46.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec8db94700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fec880a5de0 0x7fec880a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec8db94700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec88134a50 0x7fec88134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:13:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec8db94700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec880a31b0 con 0x7fec880a18a0 2020-02-11T16:13:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec8db94700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec880a3570 con 0x7fec880a5de0 2020-02-11T16:13:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec8db94700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec880a3810 con 0x7fec88134a50 2020-02-11T16:13:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec88134a50 0x7fec88134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec86ffd700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fec880a5de0 msgr2=0x7fec880a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:13:46.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec88134a50 0x7fec88134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55278/0 (socket says 172.21.15.88:55278) 2020-02-11T16:13:46.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 -- 172.21.15.88:0/3312105058 learned_addr learned my addr 172.21.15.88:0/3312105058 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:46.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec877fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fec880a18a0 0x7fec880a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42902/0 (socket says 172.21.15.88:42902) 2020-02-11T16:13:46.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec86ffd700 1 --2- 172.21.15.88:0/3312105058 >> v2:172.21.15.52:3300/0 conn(0x7fec880a5de0 0x7fec880a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:13:46.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 -- 172.21.15.88:0/3312105058 >> v2:172.21.15.52:3300/0 conn(0x7fec880a5de0 msgr2=0x7fec880a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:13:46.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 --2- 172.21.15.88:0/3312105058 >> v2:172.21.15.52:3300/0 conn(0x7fec880a5de0 0x7fec880a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:46.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 -- 172.21.15.88:0/3312105058 >> v1:172.21.15.88:6789/0 conn(0x7fec880a18a0 legacy=0x7fec880a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 -- 172.21.15.88:0/3312105058 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880a3ab0 con 0x7fec88134a50 2020-02-11T16:13:46.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec867fc700 1 -- 172.21.15.88:0/3312105058 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420738202 0 0) 0x7fec880a31b0 con 0x7fec880a18a0 2020-02-11T16:13:46.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 --2- 172.21.15.88:0/3312105058 >> v2:172.21.15.88:3300/0 conn(0x7fec88134a50 0x7fec88134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec800032b0 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 --2- 172.21.15.88:0/3312105058 >> v2:172.21.15.88:3300/0 conn(0x7fec88134a50 0x7fec88134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec800032b0 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 --2- 172.21.15.88:0/3312105058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88134ee0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7fec800032b0 tx=0x7fec80007dc0).ready entity=mon.1 client_cookie=ce520f69219e9379 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 --2- 172.21.15.88:0/3312105058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88134ee0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fec800032b0 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 --2- 172.21.15.88:0/3312105058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88134ee0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fec800032b0 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec867fc700 1 -- 172.21.15.88:0/3312105058 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec8000c540 con 0x7fec88134a50 2020-02-11T16:13:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec87fff700 1 --2- 172.21.15.88:0/3312105058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88134ee0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fec800032b0 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec867fc700 1 -- 172.21.15.88:0/3312105058 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8000c6a0 con 0x7fec88134a50 2020-02-11T16:13:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.607+0000 7fec867fc700 1 -- 172.21.15.88:0/3312105058 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec8000ca00 con 0x7fec88134a50 2020-02-11T16:13:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.608+0000 7fec8db94700 1 -- 172.21.15.88:0/3312105058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 msgr2=0x7fec88134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.608+0000 7fec8db94700 1 --2- 172.21.15.88:0/3312105058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88134ee0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7fec800032b0 tx=0x7fec80007dc0).stop 2020-02-11T16:13:46.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.608+0000 7fec8db94700 1 -- 172.21.15.88:0/3312105058 shutdown_connections 2020-02-11T16:13:46.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.608+0000 7fec8db94700 1 --2- 172.21.15.88:0/3312105058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88134ee0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.608+0000 7fec8db94700 1 --2- 172.21.15.88:0/3312105058 >> v2:172.21.15.52:3300/0 conn(0x7fec880a5de0 0x7fec880a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:13:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.608+0000 7fec8db94700 1 -- 172.21.15.88:0/3312105058 >> 172.21.15.88:0/3312105058 conn(0x7fec8809d110 msgr2=0x7fec8809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.608+0000 7fec8db94700 1 -- 172.21.15.88:0/3312105058 shutdown_connections 2020-02-11T16:13:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.608+0000 7fec8db94700 1 -- 172.21.15.88:0/3312105058 wait complete. 2020-02-11T16:13:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.609+0000 7fec8db94700 1 Processor -- start 2020-02-11T16:13:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.609+0000 7fec8db94700 1 -- start start 2020-02-11T16:13:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec8db94700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec880a18a0 0x7fec88141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec8db94700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec88134a50 0x7fec88131ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec8db94700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec88131f20 con 0x7fec880a5de0 2020-02-11T16:13:46.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec8db94700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8805e440 con 0x7fec88134a50 2020-02-11T16:13:46.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec8db94700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec881416b0 con 0x7fec880a18a0 2020-02-11T16:13:46.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec88134a50 0x7fec88131ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec88134a50 0x7fec88131ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55286/0 (socket says 172.21.15.88:55286) 2020-02-11T16:13:46.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 -- 172.21.15.88:0/4161471119 learned_addr learned my addr 172.21.15.88:0/4161471119 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:13:46.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec86ffd700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7fec880a5de0 legacy=0x7fec8812f790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:13:46.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec880a18a0 0x7fec88141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 -- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec880a18a0 msgr2=0x7fec88141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec880a18a0 0x7fec88141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 -- 172.21.15.88:0/4161471119 >> v1:172.21.15.52:6789/0 conn(0x7fec880a5de0 legacy=0x7fec8812f790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:13:46.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 -- 172.21.15.88:0/4161471119 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88141950 con 0x7fec88134a50 2020-02-11T16:13:46.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec880a18a0 0x7fec88141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:13:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 --2- 172.21.15.88:0/4161471119 >> v2:172.21.15.88:3300/0 conn(0x7fec88134a50 0x7fec88131ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec8812f670 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 --2- 172.21.15.88:0/4161471119 >> v2:172.21.15.88:3300/0 conn(0x7fec88134a50 0x7fec88131ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec8812f670 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88131ac0 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7fec8812f670 tx=0x7fec80007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88131ac0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7fec8812f670 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec80005c30 con 0x7fec88134a50 2020-02-11T16:13:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88131ac0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7fec8812f670 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec87fff700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88131ac0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7fec8812f670 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec80005d90 con 0x7fec88134a50 2020-02-11T16:13:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec80007340 con 0x7fec88134a50 2020-02-11T16:13:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec8db94700 1 -- 172.21.15.88:0/4161471119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec880a9c60 con 0x7fec88134a50 2020-02-11T16:13:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.610+0000 7fec8db94700 1 -- 172.21.15.88:0/4161471119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec88130060 con 0x7fec88134a50 2020-02-11T16:13:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.611+0000 7fec87fff700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88131ac0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7fec8812f670 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.611+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fec800074a0 con 0x7fec88134a50 2020-02-11T16:13:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.611+0000 7fec8db94700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 0x7fec88129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.611+0000 7fec8db94700 1 -- 172.21.15.88:0/4161471119 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8805e2f0 con 0x7fec881296e0 2020-02-11T16:13:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.611+0000 7fec87fff700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88131ac0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7fec8812f670 tx=0x7fec80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.611+0000 7fec84ff9700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec68039bb0 0x7fec6803c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.611+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 0x7fec88129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.611+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fec8004c730 con 0x7fec88134a50 2020-02-11T16:13:46.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.611+0000 7fec86ffd700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec68039bb0 0x7fec6803c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec877fe700 1 -- 172.21.15.88:0/4161471119 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec8812f4f0 con 0x7fec881296e0 2020-02-11T16:13:46.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 0x7fec88129fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec86ffd700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec68039bb0 0x7fec6803c070 crc :-1 s=READY pgs=253 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 0x7fec88129fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 0x7fec88129fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 0x7fec88129fb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec78011230 con 0x7fec881296e0 2020-02-11T16:13:46.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 0x7fec88129fb0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fec7800ad40 con 0x7fec881296e0 2020-02-11T16:13:46.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 msgr2=0x7fec88129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec84ff9700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 0x7fec88129fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010940).stop 2020-02-11T16:13:46.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 msgr2=0x7fec88129fb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:46.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.612+0000 7fec84ff9700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec881296e0 0x7fec88129fb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.620+0000 7fec8db94700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 0x7fec8805a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:13:46.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.620+0000 7fec8db94700 1 -- 172.21.15.88:0/4161471119 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec88131f20 con 0x7fec8812a410 2020-02-11T16:13:46.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.621+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 0x7fec8805a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:13:46.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.621+0000 7fec877fe700 1 -- 172.21.15.88:0/4161471119 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fec880565b0 con 0x7fec8812a410 2020-02-11T16:13:46.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.621+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 0x7fec8805a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.621+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 0x7fec8805a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.621+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 0x7fec8805a5d0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010550).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:13:46.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.621+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 0x7fec8805a5d0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.621+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7800de60 con 0x7fec8812a410 2020-02-11T16:13:46.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec877fe700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 0x7fec8805a5d0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:13:46.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4008 (secure 0 0 0) 0x7fec780048f0 con 0x7fec8812a410 2020-02-11T16:13:46.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 msgr2=0x7fec8805a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec84ff9700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 0x7fec8805a5d0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fec78000b80 tx=0x7fec78010550).stop 2020-02-11T16:13:46.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec84ff9700 1 -- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 msgr2=0x7fec8805a5d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:13:46.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec84ff9700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fec8812a410 0x7fec8805a5d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec8db94700 1 -- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec68039bb0 msgr2=0x7fec6803c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec8db94700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec68039bb0 0x7fec6803c070 crc :-1 s=READY pgs=253 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec8db94700 1 -- 172.21.15.88:0/4161471119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 msgr2=0x7fec88131ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:13:46.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec8db94700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88131ac0 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7fec8812f670 tx=0x7fec80007dc0).stop 2020-02-11T16:13:46.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec87fff700 1 -- 172.21.15.88:0/4161471119 reap_dead start 2020-02-11T16:13:46.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec87fff700 1 -- 172.21.15.88:0/4161471119 reap_dead start 2020-02-11T16:13:46.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec8db94700 1 -- 172.21.15.88:0/4161471119 shutdown_connections 2020-02-11T16:13:46.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec8db94700 1 --2- 172.21.15.88:0/4161471119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec88134a50 0x7fec88131ac0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:13:46.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec8db94700 1 -- 172.21.15.88:0/4161471119 >> 172.21.15.88:0/4161471119 conn(0x7fec8809d110 msgr2=0x7fec88069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:13:46.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec8db94700 1 -- 172.21.15.88:0/4161471119 shutdown_connections 2020-02-11T16:13:46.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:13:46.622+0000 7fec8db94700 1 -- 172.21.15.88:0/4161471119 wait complete. 2020-02-11T16:13:46.639 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:13:46.639 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:46.639 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:46.639 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:13:46.640 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 70, 2020-02-11T16:13:46.640 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:13:46.640 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:13:46.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:13:46.640 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.640 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:13:46.640 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:46.640 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:13:46.641 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:13:46.641 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:46.641 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:46.641 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:46.641 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:46.641 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:46.641 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:46.642 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.642 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:13:46.642 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:13:46.642 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:46.642 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:46.642 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:46.643 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:46.643 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:46.643 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:46.643 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.643 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:13:46.643 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:13:46.644 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:13:46.644 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:13:46.644 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:13:46.644 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:13:46.644 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:46.644 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:13:46.645 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:13:46.645 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:13:46.645 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:13:46.645 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:13:46.645 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:13:46.646 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:13:46.646 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:13:46.646 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:13:46.646 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:13:46.646 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:13:46.646 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.647 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:13:46.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.647 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:13:46.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.647 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:13:46.647 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:13:46.648 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:46.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:46.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:13:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:13:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:13:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:13:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:13:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:13:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:46.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.653 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:46.653 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:13:46.653 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:13:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:13:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:13:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:13:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:13:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:13:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:13:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:13:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:13:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:13:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:13:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:13:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:13:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:13:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:13:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:13:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:13:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:13:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:13:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:13:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:13:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:13:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:13:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:13:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:13:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:13:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:13:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:13:46.662 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:13:46.663 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:14:06.664 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:14:06.664 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2020-02-11T16:14:06.664 INFO:tasks.ceph.mon.b:Restarting daemon 2020-02-11T16:14:06.664 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-02-11T16:14:06.667 INFO:tasks.ceph.mon.b:Started 2020-02-11T16:14:06.667 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:14:06.667 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:14:06.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.782+0000 7fe74c1da700 1 Processor -- start 2020-02-11T16:14:06.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.782+0000 7fe74c1da700 1 -- start start 2020-02-11T16:14:06.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe74c1da700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7440ad380 0x7fe7440a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:06.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe74c1da700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7441386e0 0x7fe74413b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:06.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe74c1da700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe744138b20 con 0x7fe744138280 2020-02-11T16:14:06.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe74c1da700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe744137bf0 con 0x7fe7441386e0 2020-02-11T16:14:06.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe74c1da700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440adb40 con 0x7fe7440ad380 2020-02-11T16:14:06.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe74a777700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7441386e0 0x7fe74413b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:06.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe749775700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe744138280 0x7fe74413b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42926/0 (socket says 172.21.15.88:42926) 2020-02-11T16:14:06.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe749775700 1 -- 172.21.15.88:0/2709047423 learned_addr learned my addr 172.21.15.88:0/2709047423 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:06.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe749f76700 1 --2- 172.21.15.88:0/2709047423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7440ad380 0x7fe7440a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:06.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe74a777700 1 -- 172.21.15.88:0/2709047423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7440ad380 msgr2=0x7fe7440a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:06.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe74a777700 1 --2- 172.21.15.88:0/2709047423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7440ad380 0x7fe7440a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:06.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe74a777700 1 -- 172.21.15.88:0/2709047423 >> v1:172.21.15.88:6789/0 conn(0x7fe744138280 legacy=0x7fe74413b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:06.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.783+0000 7fe748f74700 1 -- 172.21.15.88:0/2709047423 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483431500 0 0) 0x7fe7340010d0 con 0x7fe744138280 2020-02-11T16:14:06.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74a777700 1 -- 172.21.15.88:0/2709047423 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744137de0 con 0x7fe7441386e0 2020-02-11T16:14:06.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74a777700 1 --2- 172.21.15.88:0/2709047423 >> v2:172.21.15.88:3300/0 conn(0x7fe7441386e0 0x7fe74413b8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe73c0032b0 tx=0x7fe73c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74a777700 1 --2- 172.21.15.88:0/2709047423 >> v2:172.21.15.88:3300/0 conn(0x7fe7441386e0 0x7fe74413b8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe73c0032b0 tx=0x7fe73c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74a777700 1 --2- 172.21.15.88:0/2709047423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74413b8d0 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7fe73c0032b0 tx=0x7fe73c008c60).ready entity=mon.1 client_cookie=3806ac7c1c320c9c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74a777700 1 --2- 172.21.15.88:0/2709047423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74413b8d0 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7fe73c0032b0 tx=0x7fe73c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74a777700 1 --2- 172.21.15.88:0/2709047423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74413b8d0 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7fe73c0032b0 tx=0x7fe73c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe748f74700 1 -- 172.21.15.88:0/2709047423 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe73c011e60 con 0x7fe7441386e0 2020-02-11T16:14:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74a777700 1 --2- 172.21.15.88:0/2709047423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74413b8d0 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7fe73c0032b0 tx=0x7fe73c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe748f74700 1 -- 172.21.15.88:0/2709047423 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c00a160 con 0x7fe7441386e0 2020-02-11T16:14:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe748f74700 1 -- 172.21.15.88:0/2709047423 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe73c00a4c0 con 0x7fe7441386e0 2020-02-11T16:14:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74c1da700 1 -- 172.21.15.88:0/2709047423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 msgr2=0x7fe74413b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74c1da700 1 --2- 172.21.15.88:0/2709047423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74413b8d0 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7fe73c0032b0 tx=0x7fe73c008c60).stop 2020-02-11T16:14:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74c1da700 1 -- 172.21.15.88:0/2709047423 shutdown_connections 2020-02-11T16:14:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74c1da700 1 --2- 172.21.15.88:0/2709047423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74413b8d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74c1da700 1 --2- 172.21.15.88:0/2709047423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7440ad380 0x7fe7440a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74c1da700 1 -- 172.21.15.88:0/2709047423 >> 172.21.15.88:0/2709047423 conn(0x7fe74405ac70 msgr2=0x7fe7440ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74c1da700 1 -- 172.21.15.88:0/2709047423 shutdown_connections 2020-02-11T16:14:06.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.784+0000 7fe74c1da700 1 -- 172.21.15.88:0/2709047423 wait complete. 2020-02-11T16:14:06.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.785+0000 7fe74c1da700 1 Processor -- start 2020-02-11T16:14:06.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.785+0000 7fe74c1da700 1 -- start start 2020-02-11T16:14:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74c1da700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7441386e0 0x7fe74412d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74c1da700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe744128910 con 0x7fe7440ad380 2020-02-11T16:14:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74c1da700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe744128bb0 con 0x7fe744138280 2020-02-11T16:14:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74c1da700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74412caa0 con 0x7fe7441386e0 2020-02-11T16:14:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74a777700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7441386e0 0x7fe74412d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe749775700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe744138280 0x7fe74414d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42932/0 (socket says 172.21.15.88:42932) 2020-02-11T16:14:06.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe749775700 1 -- 172.21.15.88:0/3978636276 learned_addr learned my addr 172.21.15.88:0/3978636276 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:06.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74a777700 1 -- 172.21.15.88:0/3978636276 >> v1:172.21.15.88:6789/0 conn(0x7fe744138280 legacy=0x7fe74414d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:06.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74a777700 1 -- 172.21.15.88:0/3978636276 >> v1:172.21.15.52:6789/0 conn(0x7fe7440ad380 legacy=0x7fe7441266e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:06.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe732ffd700 1 -- 172.21.15.88:0/3978636276 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288909677 0 0) 0x7fe744128bb0 con 0x7fe744138280 2020-02-11T16:14:06.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74a777700 1 -- 172.21.15.88:0/3978636276 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7441378b0 con 0x7fe7441386e0 2020-02-11T16:14:06.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74a777700 1 --2- 172.21.15.88:0/3978636276 >> v2:172.21.15.88:3300/0 conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74a777700 1 --2- 172.21.15.88:0/3978636276 >> v2:172.21.15.88:3300/0 conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74a777700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:06.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74a777700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe732ffd700 1 -- 172.21.15.88:0/3978636276 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe73c0104f0 con 0x7fe7441386e0 2020-02-11T16:14:06.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74a777700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe74a777700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.786+0000 7fe732ffd700 1 -- 172.21.15.88:0/3978636276 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c005c30 con 0x7fe7441386e0 2020-02-11T16:14:06.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.787+0000 7fe74c1da700 1 -- 172.21.15.88:0/3978636276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe744136d60 con 0x7fe7441386e0 2020-02-11T16:14:06.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.787+0000 7fe732ffd700 1 -- 172.21.15.88:0/3978636276 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe73c007150 con 0x7fe7441386e0 2020-02-11T16:14:06.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.787+0000 7fe74c1da700 1 -- 172.21.15.88:0/3978636276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe744127030 con 0x7fe7441386e0 2020-02-11T16:14:06.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.787+0000 7fe74a777700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.787+0000 7fe732ffd700 1 -- 172.21.15.88:0/3978636276 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe73c0072b0 con 0x7fe7441386e0 2020-02-11T16:14:06.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.787+0000 7fe74a777700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.787+0000 7fe732ffd700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe724039b70 0x7fe72403c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.788+0000 7fe732ffd700 1 -- 172.21.15.88:0/3978636276 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe73c04a850 con 0x7fe7441386e0 2020-02-11T16:14:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.788+0000 7fe749f76700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe724039b70 0x7fe72403c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.788+0000 7fe74c1da700 1 -- 172.21.15.88:0/3978636276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7440565b0 con 0x7fe7441386e0 2020-02-11T16:14:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.788+0000 7fe749f76700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe724039b70 0x7fe72403c030 crc :-1 s=READY pgs=255 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.791+0000 7fe74a777700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.791+0000 7fe732ffd700 1 -- 172.21.15.88:0/3978636276 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe73c032e40 con 0x7fe7441386e0 2020-02-11T16:14:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.973+0000 7fe74c1da700 1 -- 172.21.15.88:0/3978636276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe7440ae9c0 con 0x7fe7441386e0 2020-02-11T16:14:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.974+0000 7fe74a777700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:06.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.974+0000 7fe732ffd700 1 -- 172.21.15.88:0/3978636276 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fe73c032a00 con 0x7fe7441386e0 2020-02-11T16:14:06.976 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":70,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.975+0000 7fe74c1da700 1 -- 172.21.15.88:0/3978636276 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe724039b70 msgr2=0x7fe72403c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.975+0000 7fe74c1da700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe724039b70 0x7fe72403c030 crc :-1 s=READY pgs=255 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.975+0000 7fe74c1da700 1 -- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 msgr2=0x7fe74412d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.975+0000 7fe74c1da700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74412d4e0 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7fe74412e070 tx=0x7fe73c011720).stop 2020-02-11T16:14:06.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.975+0000 7fe74c1da700 1 -- 172.21.15.88:0/3978636276 shutdown_connections 2020-02-11T16:14:06.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.975+0000 7fe74c1da700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe724039b70 0x7fe72403c030 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:06.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.975+0000 7fe74c1da700 1 --2- 172.21.15.88:0/3978636276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7441386e0 0x7fe74412d4e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:06.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.975+0000 7fe74c1da700 1 -- 172.21.15.88:0/3978636276 >> 172.21.15.88:0/3978636276 conn(0x7fe74405ac70 msgr2=0x7fe744069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:06.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.975+0000 7fe74c1da700 1 -- 172.21.15.88:0/3978636276 shutdown_connections 2020-02-11T16:14:06.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:06.975+0000 7fe74c1da700 1 -- 172.21.15.88:0/3978636276 wait complete. 2020-02-11T16:14:06.992 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":70,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:09.993 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:14:10.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.107+0000 7f70de5a5700 1 Processor -- start 2020-02-11T16:14:10.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.107+0000 7f70de5a5700 1 -- start start 2020-02-11T16:14:10.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.108+0000 7f70de5a5700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d80a7120 0x7f70d80a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:10.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.108+0000 7f70de5a5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f70d80a5cf0 0x7f70d813c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:10.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.108+0000 7f70de5a5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d8136930 con 0x7f70d80a50f0 2020-02-11T16:14:10.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.108+0000 7f70de5a5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d80a6470 con 0x7f70d80a5cf0 2020-02-11T16:14:10.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.108+0000 7f70de5a5700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80a49b0 con 0x7f70d80a7120 2020-02-11T16:14:10.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.108+0000 7f70cffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f70d80a50f0 0x7f70d813c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42942/0 (socket says 172.21.15.88:42942) 2020-02-11T16:14:10.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.108+0000 7f70cffff700 1 -- 172.21.15.88:0/1606580843 learned_addr learned my addr 172.21.15.88:0/1606580843 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:10.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.108+0000 7f70d7fff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d80a7120 0x7f70d80a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.108+0000 7f70dcb42700 1 --2- 172.21.15.88:0/1606580843 >> v2:172.21.15.52:3300/0 conn(0x7f70d80a5cf0 0x7f70d813c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.108+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362483718 0 0) 0x7f70d8136930 con 0x7f70d80a50f0 2020-02-11T16:14:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b8003230 con 0x7f70d80a50f0 2020-02-11T16:14:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70dcb42700 1 -- 172.21.15.88:0/1606580843 >> v2:172.21.15.52:3300/0 conn(0x7f70d80a5cf0 msgr2=0x7f70d813c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:14:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70dcb42700 1 -- 172.21.15.88:0/1606580843 >> v2:172.21.15.52:3300/0 conn(0x7f70d80a5cf0 msgr2=0x7f70d813c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70dcb42700 1 --2- 172.21.15.88:0/1606580843 >> v2:172.21.15.52:3300/0 conn(0x7f70d80a5cf0 0x7f70d813c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70dcb42700 1 --2- 172.21.15.88:0/1606580843 >> v2:172.21.15.52:3300/0 conn(0x7f70d80a5cf0 0x7f70d813c830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:14:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 564700424 0 0) 0x7f70b8003230 con 0x7f70d80a50f0 2020-02-11T16:14:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d80a7120 msgr2=0x7f70d80a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d80a7120 0x7f70d80a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 >> v2:172.21.15.52:3300/0 conn(0x7f70d80a5cf0 msgr2=0x7f70d813c830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:14:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 --2- 172.21.15.88:0/1606580843 >> v2:172.21.15.52:3300/0 conn(0x7f70d80a5cf0 0x7f70d813c830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80a4c50 con 0x7f70d80a50f0 2020-02-11T16:14:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f70c00016d0 con 0x7f70d80a50f0 2020-02-11T16:14:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 >> v1:172.21.15.88:6789/0 conn(0x7f70d80a50f0 legacy=0x7f70d813c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b8003720 0x7f70b8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b8004060 0x7f70b8004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d80a7120 0x7f70b8004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80a6470 con 0x7f70b8003720 2020-02-11T16:14:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80a49b0 con 0x7f70b8004060 2020-02-11T16:14:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8004ff0 con 0x7f70d80a7120 2020-02-11T16:14:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70cffff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b8004060 0x7f70b8004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70d7fff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b8003720 0x7f70b8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70dcb42700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d80a7120 0x7f70b8004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70cffff700 1 -- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d80a7120 msgr2=0x7f70b8004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70cffff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d80a7120 0x7f70b8004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70cffff700 1 -- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b8003720 msgr2=0x7f70b8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70cffff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b8003720 0x7f70b8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70cffff700 1 -- 172.21.15.88:0/1606580843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b8003230 con 0x7f70b8004060 2020-02-11T16:14:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70cffff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b8004060 0x7f70b8004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70c00013e0 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70cffff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b8004060 0x7f70b8004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70c00013e0 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70cffff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b8004060 0x7f70b8004530 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f70c00013e0 tx=0x7f70d80a7500).ready entity=mon.1 client_cookie=6e4a6d7cf78c5682 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.109+0000 7f70cffff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b8004060 0x7f70b8004530 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f70c00013e0 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c0010dc0 con 0x7f70b8004060 2020-02-11T16:14:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70cffff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b8004060 0x7f70b8004530 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f70c00013e0 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c00055e0 con 0x7f70b8004060 2020-02-11T16:14:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70cffff700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b8004060 0x7f70b8004530 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f70c00013e0 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70de5a5700 1 -- 172.21.15.88:0/1606580843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b8004060 msgr2=0x7f70b8004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70d77fe700 1 -- 172.21.15.88:0/1606580843 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c0005940 con 0x7f70b8004060 2020-02-11T16:14:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70de5a5700 1 --2- 172.21.15.88:0/1606580843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b8004060 0x7f70b8004530 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f70c00013e0 tx=0x7f70d80a7500).stop 2020-02-11T16:14:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70dcb42700 1 -- 172.21.15.88:0/1606580843 reap_dead start 2020-02-11T16:14:10.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70de5a5700 1 -- 172.21.15.88:0/1606580843 shutdown_connections 2020-02-11T16:14:10.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70de5a5700 1 -- 172.21.15.88:0/1606580843 >> 172.21.15.88:0/1606580843 conn(0x7f70d809d110 msgr2=0x7f70d809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:10.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70de5a5700 1 -- 172.21.15.88:0/1606580843 shutdown_connections 2020-02-11T16:14:10.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.110+0000 7f70de5a5700 1 -- 172.21.15.88:0/1606580843 wait complete. 2020-02-11T16:14:10.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.111+0000 7f70de5a5700 1 Processor -- start 2020-02-11T16:14:10.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.111+0000 7f70de5a5700 1 -- start start 2020-02-11T16:14:10.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.111+0000 7f70de5a5700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d8138120 0x7f70d809e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:10.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70de5a5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70d8132a40 0x7f70d814cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:10.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70de5a5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d81392d0 con 0x7f70d814cfe0 2020-02-11T16:14:10.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70de5a5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d8132ec0 con 0x7f70d8132a40 2020-02-11T16:14:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70de5a5700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d8139500 con 0x7f70d8138120 2020-02-11T16:14:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70d8132a40 0x7f70d814cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70d8132a40 0x7f70d814cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55326/0 (socket says 172.21.15.88:55326) 2020-02-11T16:14:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 -- 172.21.15.88:0/1994815991 learned_addr learned my addr 172.21.15.88:0/1994815991 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70d7fff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d8138120 0x7f70d809e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 -- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d8138120 msgr2=0x7f70d809e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:10.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d8138120 0x7f70d809e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:10.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 -- 172.21.15.88:0/1994815991 >> v1:172.21.15.52:6789/0 conn(0x7f70d814cfe0 legacy=0x7f70d814d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:10.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 -- 172.21.15.88:0/1994815991 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80a7770 con 0x7f70d8132a40 2020-02-11T16:14:10.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70d7fff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d8138120 0x7f70d809e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:14:10.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> v2:172.21.15.88:3300/0 conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> v2:172.21.15.88:3300/0 conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:10.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70d5ffb700 1 -- 172.21.15.88:0/1994815991 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c0005bf0 con 0x7f70d8132a40 2020-02-11T16:14:10.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70d5ffb700 1 -- 172.21.15.88:0/1994815991 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0005d50 con 0x7f70d8132a40 2020-02-11T16:14:10.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70de5a5700 1 -- 172.21.15.88:0/1994815991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d80a4780 con 0x7f70d8132a40 2020-02-11T16:14:10.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70d5ffb700 1 -- 172.21.15.88:0/1994815991 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c000ca80 con 0x7f70d8132a40 2020-02-11T16:14:10.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.112+0000 7f70de5a5700 1 -- 172.21.15.88:0/1994815991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d8139930 con 0x7f70d8132a40 2020-02-11T16:14:10.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.113+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.113+0000 7f70d5ffb700 1 -- 172.21.15.88:0/1994815991 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f70c000ccf0 con 0x7f70d8132a40 2020-02-11T16:14:10.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.113+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.113+0000 7f70d5ffb700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f70bc039cd0 0x7f70bc03c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:10.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.113+0000 7f70d5ffb700 1 -- 172.21.15.88:0/1994815991 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f70c0049770 con 0x7f70d8132a40 2020-02-11T16:14:10.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.113+0000 7f70de5a5700 1 -- 172.21.15.88:0/1994815991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d809def0 con 0x7f70d8132a40 2020-02-11T16:14:10.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.113+0000 7f70d7fff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f70bc039cd0 0x7f70bc03c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:10.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.114+0000 7f70d7fff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f70bc039cd0 0x7f70bc03c190 crc :-1 s=READY pgs=256 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:10.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.117+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.117+0000 7f70d5ffb700 1 -- 172.21.15.88:0/1994815991 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f70c002eed0 con 0x7f70d8132a40 2020-02-11T16:14:10.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.298+0000 7f70de5a5700 1 -- 172.21.15.88:0/1994815991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f70d80565b0 con 0x7f70d8132a40 2020-02-11T16:14:10.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.298+0000 7f70cffff700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:10.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.298+0000 7f70d5ffb700 1 -- 172.21.15.88:0/1994815991 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f70c0031940 con 0x7f70d8132a40 2020-02-11T16:14:10.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 -- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f70bc039cd0 msgr2=0x7f70bc03c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:10.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f70bc039cd0 0x7f70bc03c190 crc :-1 s=READY pgs=256 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:10.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 -- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 msgr2=0x7f70d814cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:10.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 0x7f70d814cb80 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7f70d8134610 tx=0x7f70d80a7500).stop 2020-02-11T16:14:10.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 -- 172.21.15.88:0/1994815991 shutdown_connections 2020-02-11T16:14:10.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f70bc039cd0 0x7f70bc03c190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:10.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70d8138120 0x7f70d809e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:10.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 --2- 172.21.15.88:0/1994815991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70d8132a40 0x7f70d814cb80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:10.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 -- 172.21.15.88:0/1994815991 >> 172.21.15.88:0/1994815991 conn(0x7f70d809d110 msgr2=0x7f70d80a3620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:10.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 -- 172.21.15.88:0/1994815991 shutdown_connections 2020-02-11T16:14:10.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:10.299+0000 7f70de5a5700 1 -- 172.21.15.88:0/1994815991 wait complete. 2020-02-11T16:14:10.307 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":70,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:10.314 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":70,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:12.957 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:14:12.961 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:14:13.315 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:14:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.429+0000 7f31c7153700 1 Processor -- start 2020-02-11T16:14:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.429+0000 7f31c7153700 1 -- start start 2020-02-11T16:14:13.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c7153700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:13.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c7153700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:13.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c7153700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c00a3570 con 0x7f31c00a5de0 2020-02-11T16:14:13.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c7153700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00a3810 con 0x7f31c00a6260 2020-02-11T16:14:13.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c7153700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00a3ab0 con 0x7f31c00a18a0 2020-02-11T16:14:13.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c4eef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:13.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c4eef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55332/0 (socket says 172.21.15.88:55332) 2020-02-11T16:14:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 learned_addr learned my addr 172.21.15.88:0/4255342593 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:14:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:14:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:14:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.430+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:14:13.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.631+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:13.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.631+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:14:13.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.631+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:13.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.631+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:13.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.631+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:14:13.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.631+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:13.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.631+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:14:13.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.631+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:13.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.631+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:13.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:13.631+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:14:14.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.032+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:14.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.032+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:14:14.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.032+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:14.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.032+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:14.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.032+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:14:14.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.032+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:14.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.032+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:14:14.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.032+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:14.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.032+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:14.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.032+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:14:14.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.833+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:14.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.833+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:14:14.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.833+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:14.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.833+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.833+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:14:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.833+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.833+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:14:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.833+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.833+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:14.833+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:14:16.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.434+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:16.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.434+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:14:16.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.434+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:16.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.434+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.434+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:14:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.434+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.434+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:14:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.434+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.434+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.434+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:14:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.779+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> v1:172.21.15.52:6789/0 conn(0x7f31c00a5de0 legacy=0x7f31c012e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2020-02-11T16:14:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.779+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> v1:172.21.15.52:6789/0 conn(0x7f31c00a5de0 legacy=0x7f31c012e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:14:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.779+0000 7f31bffff700 1 --1- 172.21.15.88:0/4255342593 >> v1:172.21.15.52:6789/0 conn(0x7f31c00a5de0 0x7f31c012e3a0 :-1 s=OPENED pgs=26 cs=1 l=1).handle_message read tag failed 2020-02-11T16:14:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:16.779+0000 7f31bffff700 1 --1- 172.21.15.88:0/4255342593 >> v1:172.21.15.52:6789/0 conn(0x7f31c00a5de0 0x7f31c012e3a0 :-1 s=OPENED pgs=26 cs=1 l=1).fault on lossy channel, failing 2020-02-11T16:14:19.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:19.637+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:19.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:19.637+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:14:19.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:19.637+0000 7f31c4eef700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:19.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:19.637+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:19.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:19.637+0000 7f31c4eef700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:14:19.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:19.638+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:19.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:19.638+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:14:19.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:19.638+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:19.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:19.638+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:19.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:19.638+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:14:23.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31be7fc700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:14:23.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31be7fc700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.88:3300/0 conn(0x7f31c00a18a0 0x7f31c00a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:23.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31be7fc700 1 -- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 msgr2=0x7f31c012eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:14:23.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31be7fc700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31c00a6260 0x7f31c012eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31be7fc700 1 -- 172.21.15.88:0/4255342593 >> v1:172.21.15.52:6789/0 conn(0x7f31c00a5de0 legacy=0x7f31c012e3a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31be7fc700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31be7fc700 1 -- 172.21.15.88:0/4255342593 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c00a3d50 con 0x7f31a00054e0 2020-02-11T16:14:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31be7fc700 1 -- 172.21.15.88:0/4255342593 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00a3810 con 0x7f31a0009100 2020-02-11T16:14:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 msgr2=0x7f31a000b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:14:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 msgr2=0x7f31a000b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:23.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:23.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.429+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:14:23.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.630+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:23.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.630+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 msgr2=0x7f31a000b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:14:23.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.630+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 msgr2=0x7f31a000b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:23.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.630+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:23.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:23.630+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:14:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:24.031+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:24.031+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 msgr2=0x7f31a000b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:14:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:24.031+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 msgr2=0x7f31a000b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:24.031+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:24.031+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:14:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:24.833+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:24.833+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 msgr2=0x7f31a000b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:14:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:24.833+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 msgr2=0x7f31a000b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:24.833+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:24.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:24.833+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:14:26.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31be7fc700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 msgr2=0x7f31a000b5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:14:26.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31be7fc700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0009100 0x7f31a000b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:26.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31be7fc700 1 -- 172.21.15.88:0/4255342593 >> v1:172.21.15.88:6789/0 conn(0x7f31a00054e0 legacy=0x7f31a0007930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:26.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 reap_dead start 2020-02-11T16:14:26.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31be7fc700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008060 0x7f31a000b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:26.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31be7fc700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31a0008440 0x7f31a0007930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:26.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31be7fc700 1 -- 172.21.15.88:0/4255342593 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a000cd10 con 0x7f31a000bdb0 2020-02-11T16:14:26.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31be7fc700 1 -- 172.21.15.88:0/4255342593 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00a3810 con 0x7f31a0008440 2020-02-11T16:14:26.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31be7fc700 1 -- 172.21.15.88:0/4255342593 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00a3ab0 con 0x7f31a0008060 2020-02-11T16:14:26.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008060 0x7f31a000b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:26.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31a0008440 0x7f31a0007930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:26.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008060 msgr2=0x7f31a000b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:14:26.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31bffff700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008060 msgr2=0x7f31a000b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:14:26.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008060 0x7f31a000b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:26.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31bffff700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008060 0x7f31a000b540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:14:26.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008060 msgr2=0x7f31a000b540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:14:26.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008060 0x7f31a000b540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:26.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 >> v1:172.21.15.88:6789/0 conn(0x7f31a000bdb0 legacy=0x7f31a000c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:26.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 -- 172.21.15.88:0/4255342593 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a00088f0 con 0x7f31a0008440 2020-02-11T16:14:26.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31a0008440 0x7f31a0007930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f31c00a1410 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> v2:172.21.15.52:3300/0 conn(0x7f31a0008440 0x7f31a0007930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f31c00a1410 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a0008440 0x7f31a0007930 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f31c00a1410 tx=0x7f31b0002ed0).ready entity=mon.0 client_cookie=db7ae2ca53969fa8 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:26.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a0008440 0x7f31a0007930 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f31c00a1410 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31bf7fe700 1 -- 172.21.15.88:0/4255342593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31b000c490 con 0x7f31a0008440 2020-02-11T16:14:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.430+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a0008440 0x7f31a0007930 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f31c00a1410 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31bf7fe700 1 -- 172.21.15.88:0/4255342593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b000c5f0 con 0x7f31a0008440 2020-02-11T16:14:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31c56f0700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a0008440 0x7f31a0007930 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f31c00a1410 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31bf7fe700 1 -- 172.21.15.88:0/4255342593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31b000c970 con 0x7f31a0008440 2020-02-11T16:14:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31c7153700 1 -- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a0008440 msgr2=0x7f31a0007930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31c7153700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a0008440 0x7f31a0007930 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f31c00a1410 tx=0x7f31b0002ed0).stop 2020-02-11T16:14:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31c7153700 1 -- 172.21.15.88:0/4255342593 shutdown_connections 2020-02-11T16:14:26.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31c7153700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a0008440 0x7f31a0007930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:26.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31c7153700 1 --2- 172.21.15.88:0/4255342593 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008060 0x7f31a000b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:26.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31c7153700 1 -- 172.21.15.88:0/4255342593 >> 172.21.15.88:0/4255342593 conn(0x7f31c009d110 msgr2=0x7f31c009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:26.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31c7153700 1 -- 172.21.15.88:0/4255342593 shutdown_connections 2020-02-11T16:14:26.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.431+0000 7f31c7153700 1 -- 172.21.15.88:0/4255342593 wait complete. 2020-02-11T16:14:26.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.433+0000 7f31c7153700 1 Processor -- start 2020-02-11T16:14:26.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.433+0000 7f31c7153700 1 -- start start 2020-02-11T16:14:26.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31c7153700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 0x7f31c0140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:26.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31c7153700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c0134800 con 0x7f31a000bdb0 2020-02-11T16:14:26.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31c7153700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c0134aa0 con 0x7f31a0008060 2020-02-11T16:14:26.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31c7153700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0134600 con 0x7f31a0008440 2020-02-11T16:14:26.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31c4eef700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f31a0008060 0x7f31c0133ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43002/0 (socket says 172.21.15.88:43002) 2020-02-11T16:14:26.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31c4eef700 1 -- 172.21.15.88:0/3806381073 learned_addr learned my addr 172.21.15.88:0/3806381073 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:26.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31bffff700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 0x7f31c0140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:26.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31bffff700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 msgr2=0x7f31c0140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:14:26.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31bffff700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 msgr2=0x7f31c0140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:14:26.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31bffff700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 0x7f31c0140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:26.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31bffff700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 0x7f31c0140f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:14:26.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485683595 0 0) 0x7f31c0134800 con 0x7f31a000bdb0 2020-02-11T16:14:26.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.434+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a0007e20 con 0x7f31a000bdb0 2020-02-11T16:14:26.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 787595171 0 0) 0x7f31a0007e20 con 0x7f31a000bdb0 2020-02-11T16:14:26.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31c0134800 con 0x7f31a000bdb0 2020-02-11T16:14:26.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f31b0007a60 con 0x7f31a000bdb0 2020-02-11T16:14:26.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 msgr2=0x7f31c0140f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:14:26.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 0x7f31c0140f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:26.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 >> v1:172.21.15.88:6789/0 conn(0x7f31a0008060 legacy=0x7f31c0133ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:26.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 >> v1:172.21.15.52:6789/0 conn(0x7f31a000bdb0 legacy=0x7f31c0127290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:26.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 0x7f31a000c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:26.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00028e0 0x7f31a0002cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:26.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:26.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0134600 con 0x7f31a000a990 2020-02-11T16:14:26.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a000b270 con 0x7f31a00028e0 2020-02-11T16:14:26.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a000b430 con 0x7f31a0008440 2020-02-11T16:14:26.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bffff700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00028e0 0x7f31a0002cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:26.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:26.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c4eef700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 0x7f31a000c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:26.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bffff700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00028e0 msgr2=0x7f31a0002cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:14:26.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bffff700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00028e0 msgr2=0x7f31a0002cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:14:26.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bffff700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00028e0 0x7f31a0002cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:26.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c4eef700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 msgr2=0x7f31a000c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:14:26.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c4eef700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 msgr2=0x7f31a000c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:14:26.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31bffff700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00028e0 0x7f31a0002cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:14:26.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c4eef700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 0x7f31a000c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:14:26.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c4eef700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 0x7f31a000c3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:14:26.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c56f0700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 msgr2=0x7f31a000c3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:14:26.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f31a0008440 0x7f31a000c3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:26.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c56f0700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00028e0 msgr2=0x7f31a0002cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:14:26.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00028e0 0x7f31a0002cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:26.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c56f0700 1 -- 172.21.15.88:0/3806381073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0140a10 con 0x7f31a000a990 2020-02-11T16:14:26.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c7153700 1 -- 172.21.15.88:0/3806381073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c009f890 con 0x7f31a000a990 2020-02-11T16:14:26.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.435+0000 7f31c7153700 1 -- 172.21.15.88:0/3806381073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c0131ae0 con 0x7f31a000a990 2020-02-11T16:14:26.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.436+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.436+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:26.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.436+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.436+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31b0007390 con 0x7f31a000a990 2020-02-11T16:14:26.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.436+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.436+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b00074f0 con 0x7f31a000a990 2020-02-11T16:14:26.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.436+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.436+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31b0005cb0 con 0x7f31a000a990 2020-02-11T16:14:26.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.436+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.437+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f31b00102b0 con 0x7f31a000a990 2020-02-11T16:14:26.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.437+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.437+0000 7f31c7153700 1 -- 172.21.15.88:0/3806381073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a4001d30 con 0x7f31a000a990 2020-02-11T16:14:26.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.437+0000 7f31bdffb700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31a00460c0 0x7f31a0048580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:26.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.437+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f31b004ad90 con 0x7f31a000a990 2020-02-11T16:14:26.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.437+0000 7f31c4eef700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31a00460c0 0x7f31a0048580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:26.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.437+0000 7f31c4eef700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31a00460c0 0x7f31a0048580 crc :-1 s=READY pgs=257 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:26.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.441+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.441+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f31b0033380 con 0x7f31a000a990 2020-02-11T16:14:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.626+0000 7f31c7153700 1 -- 172.21.15.88:0/3806381073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f31a40037b0 con 0x7f31a000a990 2020-02-11T16:14:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.627+0000 7f31c56f0700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.627+0000 7f31bdffb700 1 -- 172.21.15.88:0/3806381073 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7f31b000a510 con 0x7f31a000a990 2020-02-11T16:14:26.630 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":78,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":3,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.628+0000 7f31c7153700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31a00460c0 msgr2=0x7f31a0048580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.628+0000 7f31c7153700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f31a00460c0 0x7f31a0048580 crc :-1 s=READY pgs=257 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.628+0000 7f31c7153700 1 -- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 msgr2=0x7f31a000ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.628+0000 7f31c7153700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f31b0003070 tx=0x7f31b0002ed0).stop 2020-02-11T16:14:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.628+0000 7f31c56f0700 1 -- 172.21.15.88:0/3806381073 reap_dead start 2020-02-11T16:14:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.628+0000 7f31c7153700 1 -- 172.21.15.88:0/3806381073 shutdown_connections 2020-02-11T16:14:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.628+0000 7f31c7153700 1 --2- 172.21.15.88:0/3806381073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31a000a990 0x7f31a000ae10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:26.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.628+0000 7f31c7153700 1 -- 172.21.15.88:0/3806381073 >> 172.21.15.88:0/3806381073 conn(0x7f31c009d110 msgr2=0x7f31c00a6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:26.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.628+0000 7f31c7153700 1 -- 172.21.15.88:0/3806381073 shutdown_connections 2020-02-11T16:14:26.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:26.628+0000 7f31c7153700 1 -- 172.21.15.88:0/3806381073 wait complete. 2020-02-11T16:14:26.641 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":78,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":3,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:29.642 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:14:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.756+0000 7efeb3829700 1 Processor -- start 2020-02-11T16:14:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.756+0000 7efeb3829700 1 -- start start 2020-02-11T16:14:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.757+0000 7efeb3829700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 0x7efeac0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.757+0000 7efeb3829700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efeac0a5de0 0x7efeac0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.757+0000 7efeb3829700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac0a31b0 con 0x7efeac12e3a0 2020-02-11T16:14:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.757+0000 7efeb3829700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac0a3570 con 0x7efeac0a18a0 2020-02-11T16:14:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.757+0000 7efeb3829700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac0a3810 con 0x7efeac0a5de0 2020-02-11T16:14:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.757+0000 7efeb0dc4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efeac0a5de0 0x7efeac0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.757+0000 7efeb1dc6700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efeac12e3a0 0x7efeac12e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43016/0 (socket says 172.21.15.88:43016) 2020-02-11T16:14:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.757+0000 7efeb1dc6700 1 -- 172.21.15.88:0/4141259239 learned_addr learned my addr 172.21.15.88:0/4141259239 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb15c5700 1 --2- 172.21.15.88:0/4141259239 >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 0x7efeac0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb0dc4700 1 -- 172.21.15.88:0/4141259239 >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 msgr2=0x7efeac0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/4141259239 >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 0x7efeac0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb0dc4700 1 -- 172.21.15.88:0/4141259239 >> v1:172.21.15.88:6789/0 conn(0x7efeac12e3a0 legacy=0x7efeac12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efe9bfff700 1 -- 172.21.15.88:0/4141259239 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208526048 0 0) 0x7efeac0a31b0 con 0x7efeac12e3a0 2020-02-11T16:14:29.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb0dc4700 1 -- 172.21.15.88:0/4141259239 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0a3ab0 con 0x7efeac0a5de0 2020-02-11T16:14:29.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/4141259239 >> v2:172.21.15.88:3300/0 conn(0x7efeac0a5de0 0x7efeac0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/4141259239 >> v2:172.21.15.88:3300/0 conn(0x7efeac0a5de0 0x7efeac0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/4141259239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac0a6260 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).ready entity=mon.1 client_cookie=e8bbd6dd65433564 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:29.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/4141259239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac0a6260 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efe9bfff700 1 -- 172.21.15.88:0/4141259239 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea8011470 con 0x7efeac0a5de0 2020-02-11T16:14:29.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/4141259239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac0a6260 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efe9bfff700 1 -- 172.21.15.88:0/4141259239 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea80115d0 con 0x7efeac0a5de0 2020-02-11T16:14:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/4141259239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac0a6260 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb3829700 1 -- 172.21.15.88:0/4141259239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 msgr2=0x7efeac0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb3829700 1 --2- 172.21.15.88:0/4141259239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac0a6260 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).stop 2020-02-11T16:14:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efe9bfff700 1 -- 172.21.15.88:0/4141259239 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea8011970 con 0x7efeac0a5de0 2020-02-11T16:14:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb3829700 1 -- 172.21.15.88:0/4141259239 shutdown_connections 2020-02-11T16:14:29.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb3829700 1 --2- 172.21.15.88:0/4141259239 >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 0x7efeac0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:29.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb3829700 1 --2- 172.21.15.88:0/4141259239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac0a6260 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:29.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.758+0000 7efeb3829700 1 -- 172.21.15.88:0/4141259239 >> 172.21.15.88:0/4141259239 conn(0x7efeac09d110 msgr2=0x7efeac09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:29.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.759+0000 7efeb3829700 1 -- 172.21.15.88:0/4141259239 shutdown_connections 2020-02-11T16:14:29.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.759+0000 7efeb3829700 1 -- 172.21.15.88:0/4141259239 wait complete. 2020-02-11T16:14:29.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.759+0000 7efeb3829700 1 Processor -- start 2020-02-11T16:14:29.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.759+0000 7efeb3829700 1 -- start start 2020-02-11T16:14:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.760+0000 7efeb3829700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 0x7efeac1328f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.760+0000 7efeb3829700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efeac0a5de0 0x7efeac12b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:29.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.760+0000 7efeb3829700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac1332b0 con 0x7efeac12e3a0 2020-02-11T16:14:29.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.760+0000 7efeb3829700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac134750 con 0x7efeac0a18a0 2020-02-11T16:14:29.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.760+0000 7efeb3829700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac135450 con 0x7efeac0a5de0 2020-02-11T16:14:29.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.760+0000 7efeb0dc4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efeac0a5de0 0x7efeac12b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:29.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.760+0000 7efeb1dc6700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efeac12e3a0 0x7efeac131620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43024/0 (socket says 172.21.15.88:43024) 2020-02-11T16:14:29.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.760+0000 7efeb0dc4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efeac0a5de0 0x7efeac12b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55396/0 (socket says 172.21.15.88:55396) 2020-02-11T16:14:29.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.760+0000 7efeb1dc6700 1 -- 172.21.15.88:0/2815216094 learned_addr learned my addr 172.21.15.88:0/2815216094 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 -- 172.21.15.88:0/2815216094 >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 msgr2=0x7efeac1328f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb15c5700 1 --2- 172.21.15.88:0/2815216094 >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 0x7efeac1328f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efe9a7fc700 1 -- 172.21.15.88:0/2815216094 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151734092 0 0) 0x7efeac1332b0 con 0x7efeac12e3a0 2020-02-11T16:14:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 0x7efeac1328f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 -- 172.21.15.88:0/2815216094 >> v1:172.21.15.88:6789/0 conn(0x7efeac12e3a0 legacy=0x7efeac131620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 -- 172.21.15.88:0/2815216094 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac131d30 con 0x7efeac0a5de0 2020-02-11T16:14:29.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb15c5700 1 --2- 172.21.15.88:0/2815216094 >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 0x7efeac1328f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:14:29.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> v2:172.21.15.88:3300/0 conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> v2:172.21.15.88:3300/0 conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:29.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efe9a7fc700 1 -- 172.21.15.88:0/2815216094 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea8007150 con 0x7efeac0a5de0 2020-02-11T16:14:29.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efe9a7fc700 1 -- 172.21.15.88:0/2815216094 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea80072b0 con 0x7efeac0a5de0 2020-02-11T16:14:29.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb3829700 1 -- 172.21.15.88:0/2815216094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac135130 con 0x7efeac0a5de0 2020-02-11T16:14:29.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efe9a7fc700 1 -- 172.21.15.88:0/2815216094 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea80056c0 con 0x7efeac0a5de0 2020-02-11T16:14:29.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb3829700 1 -- 172.21.15.88:0/2815216094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac132130 con 0x7efeac0a5de0 2020-02-11T16:14:29.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.761+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.762+0000 7efe9a7fc700 1 -- 172.21.15.88:0/2815216094 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7efea80058c0 con 0x7efeac0a5de0 2020-02-11T16:14:29.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.762+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.762+0000 7efe9a7fc700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039ad0 0x7efe8c03bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:29.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.762+0000 7efe9a7fc700 1 -- 172.21.15.88:0/2815216094 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7efea804a100 con 0x7efeac0a5de0 2020-02-11T16:14:29.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.762+0000 7efeb3829700 1 -- 172.21.15.88:0/2815216094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac0565b0 con 0x7efeac0a5de0 2020-02-11T16:14:29.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.763+0000 7efeb15c5700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039ad0 0x7efe8c03bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:29.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.763+0000 7efeb15c5700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039ad0 0x7efe8c03bf90 crc :-1 s=READY pgs=258 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:29.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.766+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.766+0000 7efe9a7fc700 1 -- 172.21.15.88:0/2815216094 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7efea80326d0 con 0x7efeac0a5de0 2020-02-11T16:14:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.947+0000 7efeb3829700 1 -- 172.21.15.88:0/2815216094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7efeac1355c0 con 0x7efeac0a5de0 2020-02-11T16:14:29.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.947+0000 7efeb0dc4700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:29.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.947+0000 7efe9a7fc700 1 -- 172.21.15.88:0/2815216094 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7efea8032290 con 0x7efeac0a5de0 2020-02-11T16:14:29.950 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":80,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 -- 172.21.15.88:0/2815216094 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039ad0 msgr2=0x7efe8c03bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039ad0 0x7efe8c03bf90 crc :-1 s=READY pgs=258 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 -- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 msgr2=0x7efeac12b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac12b620 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea8007a40).stop 2020-02-11T16:14:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 -- 172.21.15.88:0/2815216094 shutdown_connections 2020-02-11T16:14:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039ad0 0x7efe8c03bf90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 --2- 172.21.15.88:0/2815216094 >> v2:172.21.15.52:3300/0 conn(0x7efeac0a18a0 0x7efeac1328f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 --2- 172.21.15.88:0/2815216094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac0a5de0 0x7efeac12b620 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 -- 172.21.15.88:0/2815216094 >> 172.21.15.88:0/2815216094 conn(0x7efeac09d110 msgr2=0x7efeac0a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 -- 172.21.15.88:0/2815216094 shutdown_connections 2020-02-11T16:14:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:29.948+0000 7efeb3829700 1 -- 172.21.15.88:0/2815216094 wait complete. 2020-02-11T16:14:29.961 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":80,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:32.962 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:14:33.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.074+0000 7fc0b3510700 1 Processor -- start 2020-02-11T16:14:33.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.075+0000 7fc0b3510700 1 -- start start 2020-02-11T16:14:33.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.075+0000 7fc0b3510700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0ac0a18a0 0x7fc0ac0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:33.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.075+0000 7fc0b3510700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:33.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.075+0000 7fc0b3510700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac0a31b0 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.075+0000 7fc0b3510700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac0a3570 con 0x7fc0ac0a18a0 2020-02-11T16:14:33.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.075+0000 7fc0b3510700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac0a3810 con 0x7fc0ac0a5de0 2020-02-11T16:14:33.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.075+0000 7fc0b0aab700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.075+0000 7fc0b0aab700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55402/0 (socket says 172.21.15.88:55402) 2020-02-11T16:14:33.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.075+0000 7fc0b0aab700 1 -- 172.21.15.88:0/2507296748 learned_addr learned my addr 172.21.15.88:0/2507296748 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:33.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b12ac700 1 --2- 172.21.15.88:0/2507296748 >> v2:172.21.15.52:3300/0 conn(0x7fc0ac0a18a0 0x7fc0ac0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b0aab700 1 -- 172.21.15.88:0/2507296748 >> v2:172.21.15.52:3300/0 conn(0x7fc0ac0a18a0 msgr2=0x7fc0ac0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:33.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b0aab700 1 --2- 172.21.15.88:0/2507296748 >> v2:172.21.15.52:3300/0 conn(0x7fc0ac0a18a0 0x7fc0ac0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:33.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b0aab700 1 -- 172.21.15.88:0/2507296748 >> v1:172.21.15.52:6789/0 conn(0x7fc0ac12e3a0 legacy=0x7fc0ac12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:33.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b0aab700 1 -- 172.21.15.88:0/2507296748 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac0a3ab0 con 0x7fc0ac0a5de0 2020-02-11T16:14:33.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b0aab700 1 --2- 172.21.15.88:0/2507296748 >> v2:172.21.15.88:3300/0 conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc0ac05bbc0 tx=0x7fc0a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b0aab700 1 --2- 172.21.15.88:0/2507296748 >> v2:172.21.15.88:3300/0 conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc0ac05bbc0 tx=0x7fc0a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b0aab700 1 --2- 172.21.15.88:0/2507296748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7fc0ac05bbc0 tx=0x7fc0a8007a40).ready entity=mon.1 client_cookie=61812d44c982cf8f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b0aab700 1 --2- 172.21.15.88:0/2507296748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7fc0ac05bbc0 tx=0x7fc0a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc09bfff700 1 -- 172.21.15.88:0/2507296748 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0a80116e0 con 0x7fc0ac0a5de0 2020-02-11T16:14:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b0aab700 1 --2- 172.21.15.88:0/2507296748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7fc0ac05bbc0 tx=0x7fc0a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc09bfff700 1 -- 172.21.15.88:0/2507296748 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a8011840 con 0x7fc0ac0a5de0 2020-02-11T16:14:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b0aab700 1 --2- 172.21.15.88:0/2507296748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7fc0ac05bbc0 tx=0x7fc0a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc09bfff700 1 -- 172.21.15.88:0/2507296748 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0a8011c20 con 0x7fc0ac0a5de0 2020-02-11T16:14:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b3510700 1 -- 172.21.15.88:0/2507296748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac0a5de0 msgr2=0x7fc0ac0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.076+0000 7fc0b3510700 1 --2- 172.21.15.88:0/2507296748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7fc0ac05bbc0 tx=0x7fc0a8007a40).stop 2020-02-11T16:14:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.077+0000 7fc0b3510700 1 -- 172.21.15.88:0/2507296748 shutdown_connections 2020-02-11T16:14:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.077+0000 7fc0b3510700 1 --2- 172.21.15.88:0/2507296748 >> v2:172.21.15.52:3300/0 conn(0x7fc0ac0a18a0 0x7fc0ac0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.077+0000 7fc0b3510700 1 --2- 172.21.15.88:0/2507296748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac0a5de0 0x7fc0ac0a6260 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.077+0000 7fc0b3510700 1 -- 172.21.15.88:0/2507296748 >> 172.21.15.88:0/2507296748 conn(0x7fc0ac09d110 msgr2=0x7fc0ac09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.077+0000 7fc0b3510700 1 -- 172.21.15.88:0/2507296748 shutdown_connections 2020-02-11T16:14:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.077+0000 7fc0b3510700 1 -- 172.21.15.88:0/2507296748 wait complete. 2020-02-11T16:14:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.077+0000 7fc0b3510700 1 Processor -- start 2020-02-11T16:14:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.078+0000 7fc0b3510700 1 -- start start 2020-02-11T16:14:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.078+0000 7fc0b3510700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0ac12e3a0 0x7fc0ac124950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.078+0000 7fc0b3510700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac12dc10 con 0x7fc0ac0a18a0 2020-02-11T16:14:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.078+0000 7fc0b3510700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac12deb0 con 0x7fc0ac0a5de0 2020-02-11T16:14:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.078+0000 7fc0b3510700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac0aae80 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.078+0000 7fc0b0aab700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc0ac0a5de0 0x7fc0ac124240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43034/0 (socket says 172.21.15.88:43034) 2020-02-11T16:14:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.078+0000 7fc0b0aab700 1 -- 172.21.15.88:0/1668636034 learned_addr learned my addr 172.21.15.88:0/1668636034 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.078+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> v2:172.21.15.88:3300/0 conn(0x7fc0ac12e3a0 0x7fc0ac124950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.078+0000 7fc0b1aad700 1 -- 172.21.15.88:0/1668636034 >> v1:172.21.15.88:6789/0 conn(0x7fc0ac0a5de0 legacy=0x7fc0ac124240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.078+0000 7fc0b1aad700 1 -- 172.21.15.88:0/1668636034 >> v1:172.21.15.52:6789/0 conn(0x7fc0ac0a18a0 legacy=0x7fc0ac135f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc0b1aad700 1 -- 172.21.15.88:0/1668636034 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac137be0 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> v2:172.21.15.88:3300/0 conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> v2:172.21.15.88:3300/0 conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=READY pgs=418 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=THROTTLE_DONE pgs=418 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=THROTTLE_DONE pgs=418 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc09a7fc700 1 -- 172.21.15.88:0/1668636034 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0a4006c40 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=THROTTLE_DONE pgs=418 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc09a7fc700 1 -- 172.21.15.88:0/1668636034 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a4006da0 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc0b3510700 1 -- 172.21.15.88:0/1668636034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ac137e30 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc09a7fc700 1 -- 172.21.15.88:0/1668636034 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0a4012840 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc0b3510700 1 -- 172.21.15.88:0/1668636034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ac138250 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.079+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=THROTTLE_DONE pgs=418 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.080+0000 7fc09a7fc700 1 -- 172.21.15.88:0/1668636034 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc0a4012ab0 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.080+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=THROTTLE_DONE pgs=418 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.080+0000 7fc09a7fc700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc08c039c70 0x7fc08c03c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.080+0000 7fc09a7fc700 1 -- 172.21.15.88:0/1668636034 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc0a4049a30 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.080+0000 7fc0b3510700 1 -- 172.21.15.88:0/1668636034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ac138560 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.080+0000 7fc0b12ac700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc08c039c70 0x7fc08c03c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.080+0000 7fc0b12ac700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc08c039c70 0x7fc08c03c130 crc :-1 s=READY pgs=259 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.084+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=THROTTLE_DONE pgs=418 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.084+0000 7fc09a7fc700 1 -- 172.21.15.88:0/1668636034 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc0a402f070 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.265+0000 7fc0b3510700 1 -- 172.21.15.88:0/1668636034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc0ac135c20 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.265+0000 7fc0b1aad700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=THROTTLE_DONE pgs=418 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.265+0000 7fc09a7fc700 1 -- 172.21.15.88:0/1668636034 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7fc0a40120c0 con 0x7fc0ac12e3a0 2020-02-11T16:14:33.268 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:33.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.266+0000 7fc0b3510700 1 -- 172.21.15.88:0/1668636034 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc08c039c70 msgr2=0x7fc08c03c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.266+0000 7fc0b3510700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc08c039c70 0x7fc08c03c130 crc :-1 s=READY pgs=259 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.266+0000 7fc0b3510700 1 -- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 msgr2=0x7fc0ac124950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.266+0000 7fc0b3510700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 0x7fc0ac124950 secure :-1 s=READY pgs=418 cs=0 l=1 rx=0x7fc0ac134220 tx=0x7fc0a4010c00).stop 2020-02-11T16:14:33.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.266+0000 7fc0b3510700 1 -- 172.21.15.88:0/1668636034 shutdown_connections 2020-02-11T16:14:33.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.266+0000 7fc0b3510700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc08c039c70 0x7fc08c03c130 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.266+0000 7fc0b3510700 1 --2- 172.21.15.88:0/1668636034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0ac12e3a0 0x7fc0ac124950 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.266+0000 7fc0b3510700 1 -- 172.21.15.88:0/1668636034 >> 172.21.15.88:0/1668636034 conn(0x7fc0ac09d110 msgr2=0x7fc0ac0a9200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:33.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.267+0000 7fc0b3510700 1 -- 172.21.15.88:0/1668636034 shutdown_connections 2020-02-11T16:14:33.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.267+0000 7fc0b3510700 1 -- 172.21.15.88:0/1668636034 wait complete. 2020-02-11T16:14:33.280 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":82,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:33.280 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:14:33.280 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:14:33.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.385+0000 7f5d7f723700 1 Processor -- start 2020-02-11T16:14:33.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.385+0000 7f5d7f723700 1 -- start start 2020-02-11T16:14:33.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7f723700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d780a7120 0x7f5d780a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:33.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7f723700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d780a50f0 0x7f5d780a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:33.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7f723700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d7813c120 0x7f5d7813c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:33.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7f723700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d780a6470 con 0x7f5d780a50f0 2020-02-11T16:14:33.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7f723700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d780a49b0 con 0x7f5d7813c120 2020-02-11T16:14:33.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7f723700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780a4c50 con 0x7f5d780a7120 2020-02-11T16:14:33.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d7813c120 0x7f5d7813c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d7813c120 0x7f5d7813c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55414/0 (socket says 172.21.15.88:55414) 2020-02-11T16:14:33.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 -- 172.21.15.88:0/698947605 learned_addr learned my addr 172.21.15.88:0/698947605 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:33.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/698947605 >> v2:172.21.15.52:3300/0 conn(0x7f5d780a50f0 0x7f5d780a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7d4bf700 1 --2- 172.21.15.88:0/698947605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d780a7120 0x7f5d780a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 -- 172.21.15.88:0/698947605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d780a7120 msgr2=0x7f5d780a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:33.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/698947605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d780a7120 0x7f5d780a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:33.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 -- 172.21.15.88:0/698947605 >> v2:172.21.15.52:3300/0 conn(0x7f5d780a50f0 msgr2=0x7f5d780a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:33.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/698947605 >> v2:172.21.15.52:3300/0 conn(0x7f5d780a50f0 0x7f5d780a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:33.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 -- 172.21.15.88:0/698947605 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780a5570 con 0x7f5d7813c120 2020-02-11T16:14:33.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/698947605 >> v2:172.21.15.52:3300/0 conn(0x7f5d780a50f0 0x7f5d780a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:14:33.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/698947605 >> v2:172.21.15.88:3300/0 conn(0x7f5d7813c120 0x7f5d7813c5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5d6c002f30 tx=0x7f5d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/698947605 >> v2:172.21.15.88:3300/0 conn(0x7f5d7813c120 0x7f5d7813c5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5d6c002f30 tx=0x7f5d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/698947605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813c120 0x7f5d7813c5b0 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f5d6c002f30 tx=0x7f5d6c007a40).ready entity=mon.1 client_cookie=980ad39d7d6d2b87 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/698947605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813c120 0x7f5d7813c5b0 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f5d6c002f30 tx=0x7f5d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.386+0000 7f5d63fff700 1 -- 172.21.15.88:0/698947605 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d6c011720 con 0x7f5d7813c120 2020-02-11T16:14:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/698947605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813c120 0x7f5d7813c5b0 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f5d6c002f30 tx=0x7f5d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/698947605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813c120 0x7f5d7813c5b0 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f5d6c002f30 tx=0x7f5d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d63fff700 1 -- 172.21.15.88:0/698947605 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c011880 con 0x7f5d7813c120 2020-02-11T16:14:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d63fff700 1 -- 172.21.15.88:0/698947605 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d6c011c60 con 0x7f5d7813c120 2020-02-11T16:14:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7f723700 1 -- 172.21.15.88:0/698947605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813c120 msgr2=0x7f5d7813c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7f723700 1 --2- 172.21.15.88:0/698947605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813c120 0x7f5d7813c5b0 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f5d6c002f30 tx=0x7f5d6c007a40).stop 2020-02-11T16:14:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7f723700 1 -- 172.21.15.88:0/698947605 shutdown_connections 2020-02-11T16:14:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7f723700 1 --2- 172.21.15.88:0/698947605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813c120 0x7f5d7813c5b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7f723700 1 --2- 172.21.15.88:0/698947605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d780a7120 0x7f5d780a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7f723700 1 --2- 172.21.15.88:0/698947605 >> v2:172.21.15.52:3300/0 conn(0x7f5d780a50f0 0x7f5d780a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7f723700 1 -- 172.21.15.88:0/698947605 >> 172.21.15.88:0/698947605 conn(0x7f5d7809d110 msgr2=0x7f5d7809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7f723700 1 -- 172.21.15.88:0/698947605 shutdown_connections 2020-02-11T16:14:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.387+0000 7f5d7f723700 1 -- 172.21.15.88:0/698947605 wait complete. 2020-02-11T16:14:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.388+0000 7f5d7f723700 1 Processor -- start 2020-02-11T16:14:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.388+0000 7f5d7f723700 1 -- start start 2020-02-11T16:14:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7f723700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d780a50f0 0x7f5d78136ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7f723700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d7813c120 0x7f5d781496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7f723700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7813d2d0 con 0x7f5d780a7120 2020-02-11T16:14:33.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7f723700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d78139240 con 0x7f5d780a50f0 2020-02-11T16:14:33.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7f723700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d781394e0 con 0x7f5d7813c120 2020-02-11T16:14:33.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d780a50f0 0x7f5d78136ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d780a50f0 0x7f5d78136ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55416/0 (socket says 172.21.15.88:55416) 2020-02-11T16:14:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 -- 172.21.15.88:0/3784427057 learned_addr learned my addr 172.21.15.88:0/3784427057 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d7813c120 0x7f5d781496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 -- 172.21.15.88:0/3784427057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d7813c120 msgr2=0x7f5d781496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d7813c120 0x7f5d781496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 -- 172.21.15.88:0/3784427057 >> v1:172.21.15.52:6789/0 conn(0x7f5d780a7120 legacy=0x7f5d78135e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 -- 172.21.15.88:0/3784427057 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d78136ff0 con 0x7f5d780a50f0 2020-02-11T16:14:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 --2- 172.21.15.88:0/3784427057 >> v2:172.21.15.88:3300/0 conn(0x7f5d780a50f0 0x7f5d78136ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d700032b0 tx=0x7f5d70010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 --2- 172.21.15.88:0/3784427057 >> v2:172.21.15.88:3300/0 conn(0x7f5d780a50f0 0x7f5d78136ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d700032b0 tx=0x7f5d70010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d780a50f0 0x7f5d78136ae0 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7f5d700032b0 tx=0x7f5d70010fe0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d780a50f0 0x7f5d78136ae0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f5d700032b0 tx=0x7f5d70010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d7000e9e0 con 0x7f5d780a50f0 2020-02-11T16:14:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d780a50f0 0x7f5d78136ae0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f5d700032b0 tx=0x7f5d70010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000eb40 con 0x7f5d780a50f0 2020-02-11T16:14:33.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7d4bf700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d780a50f0 0x7f5d78136ae0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f5d700032b0 tx=0x7f5d70010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7f723700 1 -- 172.21.15.88:0/3784427057 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d78137290 con 0x7f5d780a50f0 2020-02-11T16:14:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d7000a100 con 0x7f5d780a50f0 2020-02-11T16:14:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.389+0000 7f5d7f723700 1 -- 172.21.15.88:0/3784427057 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d781491b0 con 0x7f5d780a50f0 2020-02-11T16:14:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d7d4bf700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d780a50f0 0x7f5d78136ae0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f5d700032b0 tx=0x7f5d70010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5d70011610 con 0x7f5d780a50f0 2020-02-11T16:14:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d7f723700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 0x7f5d7805b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d7f723700 1 -- 172.21.15.88:0/3784427057 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7805e2f0 con 0x7f5d78149b20 2020-02-11T16:14:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d7d4bf700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d780a50f0 0x7f5d78136ae0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f5d700032b0 tx=0x7f5d70010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 0x7f5d7805b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d6affd700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d54039bf0 0x7f5d5403c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5d70049d70 con 0x7f5d780a50f0 2020-02-11T16:14:33.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d7ccbe700 1 -- 172.21.15.88:0/3784427057 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d78149420 con 0x7f5d78149b20 2020-02-11T16:14:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 0x7f5d7805b020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d7400bec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.390+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d54039bf0 0x7f5d5403c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 0x7f5d7805b020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d7400bec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 0x7f5d7805b020 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d7400bec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 0x7f5d7805b020 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d7400bec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d74013060 con 0x7f5d78149b20 2020-02-11T16:14:33.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d7dcc0700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d54039bf0 0x7f5d5403c0b0 crc :-1 s=READY pgs=260 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 0x7f5d7805b020 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d7400bec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5d74005e90 con 0x7f5d78149b20 2020-02-11T16:14:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 msgr2=0x7f5d7805b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d6affd700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 0x7f5d7805b020 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d7400bec0).stop 2020-02-11T16:14:33.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 msgr2=0x7f5d7805b020 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:33.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.391+0000 7f5d6affd700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d78149b20 0x7f5d7805b020 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.399+0000 7f5d7f723700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 0x7f5d7813a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.399+0000 7f5d7f723700 1 -- 172.21.15.88:0/3784427057 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d78139380 con 0x7f5d7813a330 2020-02-11T16:14:33.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.399+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 0x7f5d7813a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.399+0000 7f5d7ccbe700 1 -- 172.21.15.88:0/3784427057 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5d780565b0 con 0x7f5d7813a330 2020-02-11T16:14:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.399+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 0x7f5d7813a740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d740120d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.399+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 0x7f5d7813a740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d740120d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.399+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 0x7f5d7813a740 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d740120d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.399+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 0x7f5d7813a740 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d740120d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.399+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d7400ee40 con 0x7f5d7813a330 2020-02-11T16:14:33.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7ccbe700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 0x7f5d7813a740 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d740120d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7f5d7400a420 con 0x7f5d7813a330 2020-02-11T16:14:33.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 msgr2=0x7f5d7813a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d6affd700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 0x7f5d7813a740 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7f5d780a76f0 tx=0x7f5d740120d0).stop 2020-02-11T16:14:33.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d6affd700 1 -- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 msgr2=0x7f5d7813a740 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:33.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d6affd700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d7813a330 0x7f5d7813a740 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7f723700 1 -- 172.21.15.88:0/3784427057 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d54039bf0 msgr2=0x7f5d5403c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7f723700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d54039bf0 0x7f5d5403c0b0 crc :-1 s=READY pgs=260 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7f723700 1 -- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d780a50f0 msgr2=0x7f5d78136ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7f723700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d780a50f0 0x7f5d78136ae0 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7f5d700032b0 tx=0x7f5d70010fe0).stop 2020-02-11T16:14:33.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7dcc0700 1 -- 172.21.15.88:0/3784427057 reap_dead start 2020-02-11T16:14:33.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7dcc0700 1 -- 172.21.15.88:0/3784427057 reap_dead start 2020-02-11T16:14:33.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7f723700 1 -- 172.21.15.88:0/3784427057 shutdown_connections 2020-02-11T16:14:33.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7f723700 1 --2- 172.21.15.88:0/3784427057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d780a50f0 0x7f5d78136ae0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7f723700 1 -- 172.21.15.88:0/3784427057 >> 172.21.15.88:0/3784427057 conn(0x7f5d7809d110 msgr2=0x7f5d780a2890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:33.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7f723700 1 -- 172.21.15.88:0/3784427057 shutdown_connections 2020-02-11T16:14:33.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.400+0000 7f5d7f723700 1 -- 172.21.15.88:0/3784427057 wait complete. 2020-02-11T16:14:33.429 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:14:33.429 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:14:33.429 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:14:33.430 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:14:33.430 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 82, 2020-02-11T16:14:33.431 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:14:33.431 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:14:33.431 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:14:33.432 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:14:33.432 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.432 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:14:33.432 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:33.432 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:14:33.433 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:14:33.433 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:33.433 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:33.433 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:33.433 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:33.434 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:33.434 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:33.434 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.434 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:14:33.434 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:14:33.435 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:33.435 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:33.435 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:33.435 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:33.435 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:33.435 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:33.435 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.438 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:14:33.438 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:14:33.438 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:14:33.439 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:14:33.439 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:14:33.439 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:14:33.439 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:33.439 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:33.439 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:14:33.440 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:14:33.440 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:33.440 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:14:33.441 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:33.441 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:33.441 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:33.441 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:33.442 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:33.444 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:33.444 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.444 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:14:33.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.444 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:14:33.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.445 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:14:33.445 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:14:33.445 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:33.445 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:33.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.445 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:33.445 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:14:33.446 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.446 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:33.446 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:14:33.446 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.446 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.447 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.447 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:14:33.447 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:14:33.447 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:33.447 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:33.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.448 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:14:33.448 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:14:33.448 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:33.449 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:33.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.449 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:33.449 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:14:33.449 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.450 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:33.450 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:14:33.450 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.451 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.451 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.452 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:14:33.452 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:14:33.452 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:33.452 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:33.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.453 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:14:33.453 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:14:33.453 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:33.453 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:33.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.454 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:33.454 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:14:33.454 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.455 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:33.455 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:14:33.455 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.455 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.456 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.456 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:14:33.456 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:14:33.456 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:33.456 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:33.456 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.457 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.457 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:14:33.457 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:14:33.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.457 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:33.458 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:33.458 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:14:33.458 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.458 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.458 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:14:33.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.458 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:33.459 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:33.459 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:14:33.459 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.459 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.460 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:14:33.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.460 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:33.460 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:33.460 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2020-02-11T16:14:33.460 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.461 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.462 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:14:33.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.462 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:33.462 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:33.462 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:14:33.462 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.462 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.463 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:14:33.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.463 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:33.463 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:33.463 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:14:33.463 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.463 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.464 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.464 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:14:33.464 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:14:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.568+0000 7ff465914700 1 Processor -- start 2020-02-11T16:14:33.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.568+0000 7ff465914700 1 -- start start 2020-02-11T16:14:33.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff465914700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a5de0 0x7ff4600a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:33.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff465914700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff460134a50 0x7ff460134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:33.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff465914700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4600a31b0 con 0x7ff4600a18a0 2020-02-11T16:14:33.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff465914700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4600a3570 con 0x7ff460134a50 2020-02-11T16:14:33.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff465914700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600a3810 con 0x7ff4600a5de0 2020-02-11T16:14:33.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff460134a50 0x7ff460134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff460134a50 0x7ff460134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55430/0 (socket says 172.21.15.88:55430) 2020-02-11T16:14:33.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 -- 172.21.15.88:0/1935319133 learned_addr learned my addr 172.21.15.88:0/1935319133 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:33.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff457fff700 1 --2- 172.21.15.88:0/1935319133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a5de0 0x7ff4600a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 -- 172.21.15.88:0/1935319133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a5de0 msgr2=0x7ff4600a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:33.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/1935319133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a5de0 0x7ff4600a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:33.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 -- 172.21.15.88:0/1935319133 >> v1:172.21.15.52:6789/0 conn(0x7ff4600a18a0 legacy=0x7ff4600a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 -- 172.21.15.88:0/1935319133 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4600a3ab0 con 0x7ff460134a50 2020-02-11T16:14:33.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45e7fc700 1 -- 172.21.15.88:0/1935319133 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718596882 0 0) 0x7ff4600a31b0 con 0x7ff4600a18a0 2020-02-11T16:14:33.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/1935319133 >> v2:172.21.15.88:3300/0 conn(0x7ff460134a50 0x7ff460134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff4600a5cc0 tx=0x7ff458008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/1935319133 >> v2:172.21.15.88:3300/0 conn(0x7ff460134a50 0x7ff460134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff4600a5cc0 tx=0x7ff458008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/1935319133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff460134a50 0x7ff460134ee0 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff458008c60).ready entity=mon.1 client_cookie=63935554ad42964f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/1935319133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff460134a50 0x7ff460134ee0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff458008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45e7fc700 1 -- 172.21.15.88:0/1935319133 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45800a160 con 0x7ff460134a50 2020-02-11T16:14:33.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/1935319133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff460134a50 0x7ff460134ee0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff458008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45e7fc700 1 -- 172.21.15.88:0/1935319133 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45800a2c0 con 0x7ff460134a50 2020-02-11T16:14:33.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/1935319133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff460134a50 0x7ff460134ee0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff458008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff45e7fc700 1 -- 172.21.15.88:0/1935319133 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45800a660 con 0x7ff460134a50 2020-02-11T16:14:33.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff465914700 1 -- 172.21.15.88:0/1935319133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff460134a50 msgr2=0x7ff460134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.569+0000 7ff465914700 1 --2- 172.21.15.88:0/1935319133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff460134a50 0x7ff460134ee0 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff458008c60).stop 2020-02-11T16:14:33.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.570+0000 7ff465914700 1 -- 172.21.15.88:0/1935319133 shutdown_connections 2020-02-11T16:14:33.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.570+0000 7ff465914700 1 --2- 172.21.15.88:0/1935319133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff460134a50 0x7ff460134ee0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.570+0000 7ff465914700 1 --2- 172.21.15.88:0/1935319133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a5de0 0x7ff4600a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:33.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.570+0000 7ff465914700 1 -- 172.21.15.88:0/1935319133 >> 172.21.15.88:0/1935319133 conn(0x7ff46009d110 msgr2=0x7ff46009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:33.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.570+0000 7ff465914700 1 -- 172.21.15.88:0/1935319133 shutdown_connections 2020-02-11T16:14:33.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.570+0000 7ff465914700 1 -- 172.21.15.88:0/1935319133 wait complete. 2020-02-11T16:14:33.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.571+0000 7ff465914700 1 Processor -- start 2020-02-11T16:14:33.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.571+0000 7ff465914700 1 -- start start 2020-02-11T16:14:33.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.571+0000 7ff465914700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a18a0 0x7ff460128960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.571+0000 7ff465914700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff460134a50 0x7ff46012ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.571+0000 7ff465914700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46012f6b0 con 0x7ff4600a5de0 2020-02-11T16:14:33.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.571+0000 7ff465914700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46012d390 con 0x7ff460134a50 2020-02-11T16:14:33.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.571+0000 7ff465914700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600a3ee0 con 0x7ff4600a18a0 2020-02-11T16:14:33.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff460134a50 0x7ff46012ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45effd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a18a0 0x7ff460128960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff460134a50 0x7ff46012ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:41424/0 (socket says 172.21.15.88:41424) 2020-02-11T16:14:33.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff457fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff4600a5de0 0x7ff4601261d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:34842/0 (socket says 172.21.15.88:34842) 2020-02-11T16:14:33.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 -- 172.21.15.88:0/2445736687 learned_addr learned my addr 172.21.15.88:0/2445736687 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:33.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 -- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a18a0 msgr2=0x7ff460128960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a18a0 0x7ff460128960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 -- 172.21.15.88:0/2445736687 >> v1:172.21.15.52:6789/0 conn(0x7ff4600a5de0 legacy=0x7ff4601261d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 -- 172.21.15.88:0/2445736687 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff460129e80 con 0x7ff460134a50 2020-02-11T16:14:33.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411200526 0 0) 0x7ff46012f6b0 con 0x7ff4600a5de0 2020-02-11T16:14:33.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/2445736687 >> v2:172.21.15.52:3300/0 conn(0x7ff460134a50 0x7ff46012ce10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff46012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/2445736687 >> v2:172.21.15.52:3300/0 conn(0x7ff460134a50 0x7ff46012ce10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff46012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff460134a50 0x7ff46012ce10 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff46012f3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff460134a50 0x7ff46012ce10 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff46012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45800a640 con 0x7ff460134a50 2020-02-11T16:14:33.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff460134a50 0x7ff46012ce10 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff46012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff465914700 1 -- 172.21.15.88:0/2445736687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4601268e0 con 0x7ff460134a50 2020-02-11T16:14:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff458005c30 con 0x7ff460134a50 2020-02-11T16:14:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff460134a50 0x7ff46012ce10 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff46012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45800f570 con 0x7ff460134a50 2020-02-11T16:14:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.572+0000 7ff465914700 1 -- 172.21.15.88:0/2445736687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46012c6b0 con 0x7ff460134a50 2020-02-11T16:14:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.573+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff460134a50 0x7ff46012ce10 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff46012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.573+0000 7ff465914700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 0x7ff46012fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.573+0000 7ff465914700 1 -- 172.21.15.88:0/2445736687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46005e2f0 con 0x7ff46012c170 2020-02-11T16:14:33.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.573+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff45800f770 con 0x7ff460134a50 2020-02-11T16:14:33.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.573+0000 7ff45f7fe700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff460134a50 0x7ff46012ce10 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff46012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.573+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 0x7ff46012fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.573+0000 7ff45cff9700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff44403bd70 0x7ff44403e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.573+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff45804a7f0 con 0x7ff460134a50 2020-02-11T16:14:33.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.573+0000 7ff457fff700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff44403bd70 0x7ff44403e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.573+0000 7ff45effd700 1 -- 172.21.15.88:0/2445736687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4600565b0 con 0x7ff46012c170 2020-02-11T16:14:33.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 0x7ff46012fc30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 0x7ff46012fc30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 0x7ff46012fc30 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff457fff700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff44403bd70 0x7ff44403e230 crc :-1 s=READY pgs=261 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 0x7ff46012fc30 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff450001dc0 con 0x7ff46012c170 2020-02-11T16:14:33.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 0x7ff46012fc30 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff45000c820 con 0x7ff46012c170 2020-02-11T16:14:33.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 msgr2=0x7ff46012fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45cff9700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 0x7ff46012fc30 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).stop 2020-02-11T16:14:33.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 msgr2=0x7ff46012fc30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:33.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.574+0000 7ff45cff9700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff46012c170 0x7ff46012fc30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.582+0000 7ff465914700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 0x7ff46005a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.582+0000 7ff465914700 1 -- 172.21.15.88:0/2445736687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46012d4d0 con 0x7ff4600a4a90 2020-02-11T16:14:33.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 0x7ff46005a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45effd700 1 -- 172.21.15.88:0/2445736687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff46005ccb0 con 0x7ff4600a4a90 2020-02-11T16:14:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 0x7ff46005a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 0x7ff46005a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 0x7ff46005a5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 0x7ff46005a5d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4500103c0 con 0x7ff4600a4a90 2020-02-11T16:14:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45effd700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 0x7ff46005a5d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7ff450012640 con 0x7ff4600a4a90 2020-02-11T16:14:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 msgr2=0x7ff46005a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45cff9700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 0x7ff46005a5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7ff450000b80 tx=0x7ff450010ba0).stop 2020-02-11T16:14:33.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45cff9700 1 -- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 msgr2=0x7ff46005a5d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.583+0000 7ff45cff9700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600a4a90 0x7ff46005a5d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff465914700 1 -- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff44403bd70 msgr2=0x7ff44403e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff465914700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff44403bd70 0x7ff44403e230 crc :-1 s=READY pgs=261 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff465914700 1 -- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff460134a50 msgr2=0x7ff46012ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff465914700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff460134a50 0x7ff46012ce10 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7ff4600a5cc0 tx=0x7ff46012f3b0).stop 2020-02-11T16:14:33.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff45f7fe700 1 -- 172.21.15.88:0/2445736687 reap_dead start 2020-02-11T16:14:33.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff45f7fe700 1 -- 172.21.15.88:0/2445736687 reap_dead start 2020-02-11T16:14:33.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff465914700 1 -- 172.21.15.88:0/2445736687 shutdown_connections 2020-02-11T16:14:33.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff465914700 1 --2- 172.21.15.88:0/2445736687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff460134a50 0x7ff46012ce10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff465914700 1 -- 172.21.15.88:0/2445736687 >> 172.21.15.88:0/2445736687 conn(0x7ff46009d110 msgr2=0x7ff460069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:33.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff465914700 1 -- 172.21.15.88:0/2445736687 shutdown_connections 2020-02-11T16:14:33.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.584+0000 7ff465914700 1 -- 172.21.15.88:0/2445736687 wait complete. 2020-02-11T16:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 82, 2020-02-11T16:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:14:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:14:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:14:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:14:33.610 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:14:33.611 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:14:33.612 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:33.614 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:14:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.617 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.618 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:33.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.621 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:14:33.622 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.624 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:33.625 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:33.627 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:33.627 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:14:33.627 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.627 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.627 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:14:33.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.627 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:33.628 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:33.628 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:14:33.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.628 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.628 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:14:33.629 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:14:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.732+0000 7fc6b2e53700 1 Processor -- start 2020-02-11T16:14:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.732+0000 7fc6b2e53700 1 -- start start 2020-02-11T16:14:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b2e53700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6ac0a7120 0x7fc6ac0a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b2e53700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc6ac0a50f0 0x7fc6ac0a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b2e53700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac136930 con 0x7fc6ac13c120 2020-02-11T16:14:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b2e53700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac0a6470 con 0x7fc6ac0a50f0 2020-02-11T16:14:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b2e53700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac0a49b0 con 0x7fc6ac0a7120 2020-02-11T16:14:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6ac0a7120 0x7fc6ac0a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6ac0a7120 0x7fc6ac0a2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55446/0 (socket says 172.21.15.88:55446) 2020-02-11T16:14:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 -- 172.21.15.88:0/651489523 learned_addr learned my addr 172.21.15.88:0/651489523 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6abfff700 1 --2- 172.21.15.88:0/651489523 >> v2:172.21.15.52:3300/0 conn(0x7fc6ac0a50f0 0x7fc6ac0a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 -- 172.21.15.88:0/651489523 >> v2:172.21.15.52:3300/0 conn(0x7fc6ac0a50f0 msgr2=0x7fc6ac0a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/651489523 >> v2:172.21.15.52:3300/0 conn(0x7fc6ac0a50f0 0x7fc6ac0a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 -- 172.21.15.88:0/651489523 >> v1:172.21.15.88:6789/0 conn(0x7fc6ac13c120 legacy=0x7fc6ac13c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 -- 172.21.15.88:0/651489523 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac0a4c50 con 0x7fc6ac0a7120 2020-02-11T16:14:33.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/651489523 >> v2:172.21.15.88:3300/0 conn(0x7fc6ac0a7120 0x7fc6ac0a2900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6a0002f30 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/651489523 >> v2:172.21.15.88:3300/0 conn(0x7fc6ac0a7120 0x7fc6ac0a2900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6a0002f30 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/651489523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0a7120 0x7fc6ac0a2900 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7fc6a0002f30 tx=0x7fc6a0007a40).ready entity=mon.1 client_cookie=2a67a526cb791f6c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/651489523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0a7120 0x7fc6ac0a2900 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fc6a0002f30 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/651489523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0a7120 0x7fc6ac0a2900 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fc6a0002f30 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6ab7fe700 1 -- 172.21.15.88:0/651489523 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6a0011720 con 0x7fc6ac0a7120 2020-02-11T16:14:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.733+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/651489523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0a7120 0x7fc6ac0a2900 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fc6a0002f30 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.734+0000 7fc6ab7fe700 1 -- 172.21.15.88:0/651489523 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a0011880 con 0x7fc6ac0a7120 2020-02-11T16:14:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.734+0000 7fc6ab7fe700 1 -- 172.21.15.88:0/651489523 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6a0011c60 con 0x7fc6ac0a7120 2020-02-11T16:14:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.734+0000 7fc6b2e53700 1 -- 172.21.15.88:0/651489523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0a7120 msgr2=0x7fc6ac0a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.734+0000 7fc6b2e53700 1 --2- 172.21.15.88:0/651489523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0a7120 0x7fc6ac0a2900 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7fc6a0002f30 tx=0x7fc6a0007a40).stop 2020-02-11T16:14:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.734+0000 7fc6b2e53700 1 -- 172.21.15.88:0/651489523 shutdown_connections 2020-02-11T16:14:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.734+0000 7fc6b2e53700 1 --2- 172.21.15.88:0/651489523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0a7120 0x7fc6ac0a2900 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.734+0000 7fc6b2e53700 1 --2- 172.21.15.88:0/651489523 >> v2:172.21.15.52:3300/0 conn(0x7fc6ac0a50f0 0x7fc6ac0a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.734+0000 7fc6b2e53700 1 -- 172.21.15.88:0/651489523 >> 172.21.15.88:0/651489523 conn(0x7fc6ac09d110 msgr2=0x7fc6ac09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.734+0000 7fc6b2e53700 1 -- 172.21.15.88:0/651489523 shutdown_connections 2020-02-11T16:14:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.734+0000 7fc6b2e53700 1 -- 172.21.15.88:0/651489523 wait complete. 2020-02-11T16:14:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.735+0000 7fc6b2e53700 1 Processor -- start 2020-02-11T16:14:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.735+0000 7fc6b2e53700 1 -- start start 2020-02-11T16:14:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6b2e53700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6b2e53700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc6ac13c120 0x7fc6ac12abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6b2e53700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac12cc70 con 0x7fc6ac0a50f0 2020-02-11T16:14:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6b2e53700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac135990 con 0x7fc6ac13c120 2020-02-11T16:14:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6b2e53700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac12c0c0 con 0x7fc6ac0a7120 2020-02-11T16:14:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6b0bef700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc6ac0a50f0 0x7fc6ac12c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:34860/0 (socket says 172.21.15.88:34860) 2020-02-11T16:14:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6b0bef700 1 -- 172.21.15.88:0/2241993348 learned_addr learned my addr 172.21.15.88:0/2241993348 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:33.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6abfff700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6b13f0700 1 --2- 172.21.15.88:0/2241993348 >> v2:172.21.15.52:3300/0 conn(0x7fc6ac13c120 0x7fc6ac12abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832401240 0 0) 0x7fc6ac12cc70 con 0x7fc6ac0a50f0 2020-02-11T16:14:33.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc694002fe0 con 0x7fc6ac0a50f0 2020-02-11T16:14:33.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6abfff700 1 -- 172.21.15.88:0/2241993348 >> v2:172.21.15.52:3300/0 conn(0x7fc6ac13c120 msgr2=0x7fc6ac12abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6abfff700 1 --2- 172.21.15.88:0/2241993348 >> v2:172.21.15.52:3300/0 conn(0x7fc6ac13c120 0x7fc6ac12abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6abfff700 1 -- 172.21.15.88:0/2241993348 >> v1:172.21.15.52:6789/0 conn(0x7fc6ac0a50f0 legacy=0x7fc6ac12c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6abfff700 1 -- 172.21.15.88:0/2241993348 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac06a280 con 0x7fc6ac0a7120 2020-02-11T16:14:33.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6b13f0700 1 --2- 172.21.15.88:0/2241993348 >> v2:172.21.15.52:3300/0 conn(0x7fc6ac13c120 0x7fc6ac12abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:14:33.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6abfff700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc698002f30 tx=0x7fc698010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6abfff700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc698002f30 tx=0x7fc698010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6abfff700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fc698002f30 tx=0x7fc698010bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6abfff700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fc698002f30 tx=0x7fc698010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.736+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc698005e90 con 0x7fc6ac0a7120 2020-02-11T16:14:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6abfff700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fc698002f30 tx=0x7fc698010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6abfff700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fc698002f30 tx=0x7fc698010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698007160 con 0x7fc6ac0a7120 2020-02-11T16:14:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc698007540 con 0x7fc6ac0a7120 2020-02-11T16:14:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6b2e53700 1 -- 172.21.15.88:0/2241993348 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac133b90 con 0x7fc6ac0a7120 2020-02-11T16:14:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6b2e53700 1 -- 172.21.15.88:0/2241993348 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac13d490 con 0x7fc6ac0a7120 2020-02-11T16:14:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6abfff700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fc698002f30 tx=0x7fc698010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6b2e53700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 0x7fc6ac0a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6b2e53700 1 -- 172.21.15.88:0/2241993348 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac05e2f0 con 0x7fc6ac12b030 2020-02-11T16:14:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc69800e290 con 0x7fc6ac0a7120 2020-02-11T16:14:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6abfff700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fc698002f30 tx=0x7fc698010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.737+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 0x7fc6ac0a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6a9ffb700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc694039f30 0x7fc69403c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc698049c90 con 0x7fc6ac0a7120 2020-02-11T16:14:33.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6b13f0700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc694039f30 0x7fc69403c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6b0bef700 1 -- 172.21.15.88:0/2241993348 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6ac12c2c0 con 0x7fc6ac12b030 2020-02-11T16:14:33.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 0x7fc6ac0a31c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 0x7fc6ac0a31c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 0x7fc6ac0a31c0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6b13f0700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc694039f30 0x7fc69403c3f0 crc :-1 s=READY pgs=262 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 0x7fc6ac0a31c0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6a0011d10 con 0x7fc6ac12b030 2020-02-11T16:14:33.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 0x7fc6ac0a31c0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fc6a0007880 con 0x7fc6ac12b030 2020-02-11T16:14:33.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 msgr2=0x7fc6ac0a31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6a9ffb700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 0x7fc6ac0a31c0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).stop 2020-02-11T16:14:33.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 msgr2=0x7fc6ac0a31c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:33.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.738+0000 7fc6a9ffb700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac12b030 0x7fc6ac0a31c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.746+0000 7fc6b2e53700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 0x7fc6ac0a8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.746+0000 7fc6b2e53700 1 -- 172.21.15.88:0/2241993348 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac133d20 con 0x7fc6ac0a7ef0 2020-02-11T16:14:33.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.747+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 0x7fc6ac0a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.747+0000 7fc6b0bef700 1 -- 172.21.15.88:0/2241993348 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc6ac12bf20 con 0x7fc6ac0a7ef0 2020-02-11T16:14:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.747+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 0x7fc6ac0a8300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.747+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 0x7fc6ac0a8300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.747+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 0x7fc6ac0a8300 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 0x7fc6ac0a8300 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6a000e7d0 con 0x7fc6ac0a7ef0 2020-02-11T16:14:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b0bef700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 0x7fc6ac0a8300 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4019 (secure 0 0 0) 0x7fc6a000e930 con 0x7fc6ac0a7ef0 2020-02-11T16:14:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 msgr2=0x7fc6ac0a8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6a9ffb700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 0x7fc6ac0a8300 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fc6ac0a3fa0 tx=0x7fc6a0007a40).stop 2020-02-11T16:14:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6a9ffb700 1 -- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 msgr2=0x7fc6ac0a8300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6a9ffb700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7ef0 0x7fc6ac0a8300 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b2e53700 1 -- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc694039f30 msgr2=0x7fc69403c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b2e53700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc694039f30 0x7fc69403c3f0 crc :-1 s=READY pgs=262 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b2e53700 1 -- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 msgr2=0x7fc6ac135410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b2e53700 1 --2- 172.21.15.88:0/2241993348 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6ac0a7120 0x7fc6ac135410 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fc698002f30 tx=0x7fc698010bb0).stop 2020-02-11T16:14:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b13f0700 1 -- 172.21.15.88:0/2241993348 reap_dead start 2020-02-11T16:14:33.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b13f0700 1 -- 172.21.15.88:0/2241993348 reap_dead start 2020-02-11T16:14:33.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b2e53700 1 -- 172.21.15.88:0/2241993348 shutdown_connections 2020-02-11T16:14:33.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b2e53700 1 -- 172.21.15.88:0/2241993348 >> 172.21.15.88:0/2241993348 conn(0x7fc6ac09d110 msgr2=0x7fc6ac05ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:33.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b2e53700 1 -- 172.21.15.88:0/2241993348 shutdown_connections 2020-02-11T16:14:33.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.748+0000 7fc6b2e53700 1 -- 172.21.15.88:0/2241993348 wait complete. 2020-02-11T16:14:33.765 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:14:33.766 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:14:33.766 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:14:33.766 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:14:33.767 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 82, 2020-02-11T16:14:33.767 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:14:33.767 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:14:33.767 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:14:33.767 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:14:33.767 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.767 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:14:33.768 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:33.768 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:14:33.768 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:14:33.768 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:33.768 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:33.768 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:33.768 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:33.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:33.769 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:33.769 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.769 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:14:33.769 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:14:33.769 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:33.769 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:33.770 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:33.770 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:33.770 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:33.770 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:33.770 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.771 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:14:33.771 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:14:33.771 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:14:33.771 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:14:33.771 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:14:33.771 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:14:33.772 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:33.772 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:33.772 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:14:33.772 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:14:33.772 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:33.773 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:14:33.773 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:33.773 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:33.773 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:33.773 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:33.774 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:33.774 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:33.774 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.774 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:14:33.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.774 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:14:33.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.775 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:14:33.775 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:14:33.775 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:33.775 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:33.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.775 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:33.776 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:14:33.776 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.777 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:33.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:14:33.777 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.778 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.778 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.778 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:14:33.779 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:14:33.779 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:33.779 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:33.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.780 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:14:33.780 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:14:33.780 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:33.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:33.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.781 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:33.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:14:33.782 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.782 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:33.782 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:14:33.783 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.783 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.783 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:14:33.784 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:14:33.784 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:33.784 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:33.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.785 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:14:33.785 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:14:33.786 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:33.786 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:33.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.787 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:33.788 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:14:33.788 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.789 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:33.789 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:14:33.789 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:33.789 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.790 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.790 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:14:33.790 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:14:33.790 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:33.790 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:33.790 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.791 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:33.791 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:14:33.791 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:14:33.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.791 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:33.791 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:33.792 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:14:33.792 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.792 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.792 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:14:33.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.792 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:33.792 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:33.793 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:14:33.793 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.793 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:33.793 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:14:33.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:14:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:33.794 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:14:33.795 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:14:33.795 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:14:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.897+0000 7fc0b628b700 1 Processor -- start 2020-02-11T16:14:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.897+0000 7fc0b628b700 1 -- start start 2020-02-11T16:14:33.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0b628b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 0x7fc0b0132010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:33.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0b628b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b00adb40 con 0x7fc0b00ad380 2020-02-11T16:14:33.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0b628b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b0137de0 con 0x7fc0b00a9130 2020-02-11T16:14:33.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0b628b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0137bf0 con 0x7fc0b0131bd0 2020-02-11T16:14:33.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0af7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc0b00a9130 0x7fc0b01314c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43094/0 (socket says 172.21.15.88:43094) 2020-02-11T16:14:33.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0af7fe700 1 -- 172.21.15.88:0/2606585633 learned_addr learned my addr 172.21.15.88:0/2606585633 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:33.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2606585633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 0x7fc0b0132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0aeffd700 1 -- 172.21.15.88:0/2606585633 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211150040 0 0) 0x7fc0b0137de0 con 0x7fc0b00a9130 2020-02-11T16:14:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0aeffd700 1 -- 172.21.15.88:0/2606585633 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc09c003230 con 0x7fc0b00a9130 2020-02-11T16:14:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0aeffd700 1 -- 172.21.15.88:0/2606585633 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277651491 0 0) 0x7fc0b00adb40 con 0x7fc0b00ad380 2020-02-11T16:14:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0aeffd700 1 -- 172.21.15.88:0/2606585633 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b0137de0 con 0x7fc0b00ad380 2020-02-11T16:14:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.898+0000 7fc0aeffd700 1 -- 172.21.15.88:0/2606585633 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2589510497 0 0) 0x7fc09c003230 con 0x7fc0b00a9130 2020-02-11T16:14:33.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b4828700 1 -- 172.21.15.88:0/2606585633 >> v1:172.21.15.88:6789/0 conn(0x7fc0b00a9130 legacy=0x7fc0b01314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b4828700 1 -- 172.21.15.88:0/2606585633 >> v1:172.21.15.52:6789/0 conn(0x7fc0b00ad380 legacy=0x7fc0b0138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b4828700 1 -- 172.21.15.88:0/2606585633 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00a95c0 con 0x7fc0b0131bd0 2020-02-11T16:14:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2606585633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 0x7fc0b0132010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc0a40010d0 tx=0x7fc0a8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2606585633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 0x7fc0b0132010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc0a40010d0 tx=0x7fc0a8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2606585633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 0x7fc0b0132010 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0a8008c60).ready entity=mon.2 client_cookie=3cee3172002862c0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2606585633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 0x7fc0b0132010 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0a8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0aeffd700 1 -- 172.21.15.88:0/2606585633 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0a40016d0 con 0x7fc0b0131bd0 2020-02-11T16:14:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2606585633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 0x7fc0b0132010 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0a8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2606585633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 0x7fc0b0132010 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0a8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0aeffd700 1 -- 172.21.15.88:0/2606585633 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a8011b70 con 0x7fc0b0131bd0 2020-02-11T16:14:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0aeffd700 1 -- 172.21.15.88:0/2606585633 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0a800a160 con 0x7fc0b0131bd0 2020-02-11T16:14:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b628b700 1 -- 172.21.15.88:0/2606585633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 msgr2=0x7fc0b0132010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b628b700 1 --2- 172.21.15.88:0/2606585633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 0x7fc0b0132010 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0a8008c60).stop 2020-02-11T16:14:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b628b700 1 -- 172.21.15.88:0/2606585633 shutdown_connections 2020-02-11T16:14:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b628b700 1 --2- 172.21.15.88:0/2606585633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b0131bd0 0x7fc0b0132010 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b628b700 1 -- 172.21.15.88:0/2606585633 >> 172.21.15.88:0/2606585633 conn(0x7fc0b005ac70 msgr2=0x7fc0b00ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b628b700 1 -- 172.21.15.88:0/2606585633 shutdown_connections 2020-02-11T16:14:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.899+0000 7fc0b628b700 1 -- 172.21.15.88:0/2606585633 wait complete. 2020-02-11T16:14:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.900+0000 7fc0b628b700 1 Processor -- start 2020-02-11T16:14:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.900+0000 7fc0b628b700 1 -- start start 2020-02-11T16:14:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b628b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b00ad380 0x7fc0b0126610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b628b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0b0131bd0 0x7fc0b0126a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b628b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b0135c00 con 0x7fc0b00a9130 2020-02-11T16:14:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b628b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b00663e0 con 0x7fc0b0131bd0 2020-02-11T16:14:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b628b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b012dbf0 con 0x7fc0b00ad380 2020-02-11T16:14:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b4828700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0b0131bd0 0x7fc0b0126a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0af7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b00ad380 0x7fc0b0126610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0affff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc0b00a9130 0x7fc0b01485c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:34878/0 (socket says 172.21.15.88:34878) 2020-02-11T16:14:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0affff700 1 -- 172.21.15.88:0/2066361339 learned_addr learned my addr 172.21.15.88:0/2066361339 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b4828700 1 -- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b00ad380 msgr2=0x7fc0b0126610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b00ad380 0x7fc0b0126610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b4828700 1 -- 172.21.15.88:0/2066361339 >> v1:172.21.15.52:6789/0 conn(0x7fc0b00a9130 legacy=0x7fc0b01485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b4828700 1 -- 172.21.15.88:0/2066361339 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00654c0 con 0x7fc0b0131bd0 2020-02-11T16:14:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.901+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> v2:172.21.15.52:3300/0 conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> v2:172.21.15.52:3300/0 conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0ad7fa700 1 -- 172.21.15.88:0/2066361339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0a8005a40 con 0x7fc0b0131bd0 2020-02-11T16:14:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0ad7fa700 1 -- 172.21.15.88:0/2066361339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a8005ba0 con 0x7fc0b0131bd0 2020-02-11T16:14:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0b628b700 1 -- 172.21.15.88:0/2066361339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b012b3c0 con 0x7fc0b0131bd0 2020-02-11T16:14:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0ad7fa700 1 -- 172.21.15.88:0/2066361339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0a8007150 con 0x7fc0b0131bd0 2020-02-11T16:14:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0b628b700 1 -- 172.21.15.88:0/2066361339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b0065f50 con 0x7fc0b0131bd0 2020-02-11T16:14:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.902+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.903+0000 7fc0ad7fa700 1 -- 172.21.15.88:0/2066361339 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc0a8007390 con 0x7fc0b0131bd0 2020-02-11T16:14:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.903+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.903+0000 7fc0b628b700 1 -- 172.21.15.88:0/2066361339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b00565b0 con 0x7fc0b0131bd0 2020-02-11T16:14:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.903+0000 7fc0ad7fa700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc090039b90 0x7fc09003c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.903+0000 7fc0ad7fa700 1 -- 172.21.15.88:0/2066361339 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc0a804a2e0 con 0x7fc0b0131bd0 2020-02-11T16:14:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.903+0000 7fc0affff700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc090039b90 0x7fc09003c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.904+0000 7fc0affff700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc090039b90 0x7fc09003c050 crc :-1 s=READY pgs=263 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:33.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.907+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:33.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:33.907+0000 7fc0ad7fa700 1 -- 172.21.15.88:0/2066361339 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc0a802f960 con 0x7fc0b0131bd0 2020-02-11T16:14:34.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.088+0000 7fc0b628b700 1 -- 172.21.15.88:0/2066361339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fc0b00a5350 con 0x7fc0b0131bd0 2020-02-11T16:14:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.089+0000 7fc0b4828700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.089+0000 7fc0ad7fa700 1 -- 172.21.15.88:0/2066361339 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fc0a8032470 con 0x7fc0b0131bd0 2020-02-11T16:14:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 -- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc090039b90 msgr2=0x7fc09003c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc090039b90 0x7fc09003c050 crc :-1 s=READY pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:34.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 -- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 msgr2=0x7fc0b0126a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:34.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 0x7fc0b0126a70 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fc0a40010d0 tx=0x7fc0b00a9750).stop 2020-02-11T16:14:34.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 -- 172.21.15.88:0/2066361339 shutdown_connections 2020-02-11T16:14:34.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc090039b90 0x7fc09003c050 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:34.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b0131bd0 0x7fc0b0126a70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:34.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 --2- 172.21.15.88:0/2066361339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0b00ad380 0x7fc0b0126610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:34.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 -- 172.21.15.88:0/2066361339 >> 172.21.15.88:0/2066361339 conn(0x7fc0b005ac70 msgr2=0x7fc0b0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:34.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 -- 172.21.15.88:0/2066361339 shutdown_connections 2020-02-11T16:14:34.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:34.091+0000 7fc0b628b700 1 -- 172.21.15.88:0/2066361339 wait complete. 2020-02-11T16:14:34.104 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:14:43.044 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:14:43.055 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:14:44.105 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:14:44.106 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:14:44.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.219+0000 7fece7088700 1 Processor -- start 2020-02-11T16:14:44.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.219+0000 7fece7088700 1 -- start start 2020-02-11T16:14:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fece7088700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a18a0 0x7fece00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fece7088700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fece00a5de0 0x7fece00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fece7088700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece00a31b0 con 0x7fece012e3a0 2020-02-11T16:14:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fece7088700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece00a3570 con 0x7fece00a5de0 2020-02-11T16:14:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fece7088700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece00a3810 con 0x7fece00a18a0 2020-02-11T16:14:44.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fecdffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fece00a5de0 0x7fece00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fecdffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fece00a5de0 0x7fece00a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55482/0 (socket says 172.21.15.88:55482) 2020-02-11T16:14:44.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fecdffff700 1 -- 172.21.15.88:0/3216464239 learned_addr learned my addr 172.21.15.88:0/3216464239 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:44.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fece4e24700 1 --2- 172.21.15.88:0/3216464239 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a18a0 0x7fece00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fecdffff700 1 -- 172.21.15.88:0/3216464239 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a18a0 msgr2=0x7fece00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:44.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fecdffff700 1 --2- 172.21.15.88:0/3216464239 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a18a0 0x7fece00a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fecdffff700 1 -- 172.21.15.88:0/3216464239 >> v1:172.21.15.88:6789/0 conn(0x7fece012e3a0 legacy=0x7fece012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fecdffff700 1 -- 172.21.15.88:0/3216464239 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00a3ab0 con 0x7fece00a5de0 2020-02-11T16:14:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fecdf7fe700 1 -- 172.21.15.88:0/3216464239 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204899197 0 0) 0x7fece00a31b0 con 0x7fece012e3a0 2020-02-11T16:14:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.220+0000 7fece4e24700 1 --2- 172.21.15.88:0/3216464239 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a18a0 0x7fece00a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:14:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fecdffff700 1 --2- 172.21.15.88:0/3216464239 >> v2:172.21.15.88:3300/0 conn(0x7fece00a5de0 0x7fece00a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fecd4002f30 tx=0x7fecd40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fecdffff700 1 --2- 172.21.15.88:0/3216464239 >> v2:172.21.15.88:3300/0 conn(0x7fece00a5de0 0x7fece00a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fecd4002f30 tx=0x7fecd40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fecdffff700 1 --2- 172.21.15.88:0/3216464239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fece00a5de0 0x7fece00a6260 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fecd40088e0).ready entity=mon.1 client_cookie=dff4310831b0fc2b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fecdffff700 1 --2- 172.21.15.88:0/3216464239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fece00a5de0 0x7fece00a6260 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fecd40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fecdf7fe700 1 -- 172.21.15.88:0/3216464239 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecd4013e60 con 0x7fece00a5de0 2020-02-11T16:14:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fecdffff700 1 --2- 172.21.15.88:0/3216464239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fece00a5de0 0x7fece00a6260 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fecd40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fecdf7fe700 1 -- 172.21.15.88:0/3216464239 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd400c160 con 0x7fece00a5de0 2020-02-11T16:14:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fecdffff700 1 --2- 172.21.15.88:0/3216464239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fece00a5de0 0x7fece00a6260 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fecd40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fecdf7fe700 1 -- 172.21.15.88:0/3216464239 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecd400c4c0 con 0x7fece00a5de0 2020-02-11T16:14:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fece7088700 1 -- 172.21.15.88:0/3216464239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fece00a5de0 msgr2=0x7fece00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fece7088700 1 --2- 172.21.15.88:0/3216464239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fece00a5de0 0x7fece00a6260 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fecd40088e0).stop 2020-02-11T16:14:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fece7088700 1 -- 172.21.15.88:0/3216464239 shutdown_connections 2020-02-11T16:14:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fece7088700 1 --2- 172.21.15.88:0/3216464239 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a18a0 0x7fece00a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fece7088700 1 --2- 172.21.15.88:0/3216464239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fece00a5de0 0x7fece00a6260 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fece7088700 1 -- 172.21.15.88:0/3216464239 >> 172.21.15.88:0/3216464239 conn(0x7fece009d110 msgr2=0x7fece009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fece7088700 1 -- 172.21.15.88:0/3216464239 shutdown_connections 2020-02-11T16:14:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.221+0000 7fece7088700 1 -- 172.21.15.88:0/3216464239 wait complete. 2020-02-11T16:14:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.222+0000 7fece7088700 1 Processor -- start 2020-02-11T16:14:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.222+0000 7fece7088700 1 -- start start 2020-02-11T16:14:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.223+0000 7fece7088700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fece00a18a0 0x7fece01384c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.223+0000 7fece7088700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.223+0000 7fece7088700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece0135bc0 con 0x7fece012e3a0 2020-02-11T16:14:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.223+0000 7fece7088700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece0138d80 con 0x7fece00a18a0 2020-02-11T16:14:44.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.223+0000 7fece7088700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece0135010 con 0x7fece00a5de0 2020-02-11T16:14:44.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.223+0000 7fecdffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.223+0000 7fece4e24700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fece00a18a0 0x7fece01384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.223+0000 7fece5625700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fece012e3a0 0x7fece01271e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:34896/0 (socket says 172.21.15.88:34896) 2020-02-11T16:14:44.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.223+0000 7fece5625700 1 -- 172.21.15.88:0/1396856040 learned_addr learned my addr 172.21.15.88:0/1396856040 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:44.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecddffb700 1 -- 172.21.15.88:0/1396856040 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803849870 0 0) 0x7fece0135bc0 con 0x7fece012e3a0 2020-02-11T16:14:44.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecddffb700 1 -- 172.21.15.88:0/1396856040 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc0002fe0 con 0x7fece012e3a0 2020-02-11T16:14:44.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecdffff700 1 -- 172.21.15.88:0/1396856040 >> v2:172.21.15.52:3300/0 conn(0x7fece00a18a0 msgr2=0x7fece01384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> v2:172.21.15.52:3300/0 conn(0x7fece00a18a0 0x7fece01384c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecdffff700 1 -- 172.21.15.88:0/1396856040 >> v1:172.21.15.52:6789/0 conn(0x7fece012e3a0 legacy=0x7fece01271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecdffff700 1 -- 172.21.15.88:0/1396856040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece006a280 con 0x7fece00a5de0 2020-02-11T16:14:44.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecddffb700 1 -- 172.21.15.88:0/1396856040 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecd400aae0 con 0x7fece00a5de0 2020-02-11T16:14:44.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fece7088700 1 -- 172.21.15.88:0/1396856040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece0135310 con 0x7fece00a5de0 2020-02-11T16:14:44.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecddffb700 1 -- 172.21.15.88:0/1396856040 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4008970 con 0x7fece00a5de0 2020-02-11T16:14:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fecddffb700 1 -- 172.21.15.88:0/1396856040 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecd4008d90 con 0x7fece00a5de0 2020-02-11T16:14:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.224+0000 7fece7088700 1 -- 172.21.15.88:0/1396856040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece0134360 con 0x7fece00a5de0 2020-02-11T16:14:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.225+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.225+0000 7fecddffb700 1 -- 172.21.15.88:0/1396856040 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fecd400a150 con 0x7fece00a5de0 2020-02-11T16:14:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.225+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.225+0000 7fece7088700 1 -- 172.21.15.88:0/1396856040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece00565b0 con 0x7fece00a5de0 2020-02-11T16:14:44.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.225+0000 7fecddffb700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecc0039fa0 0x7fecc003c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.225+0000 7fecddffb700 1 -- 172.21.15.88:0/1396856040 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fecd4049db0 con 0x7fece00a5de0 2020-02-11T16:14:44.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.225+0000 7fece4e24700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecc0039fa0 0x7fecc003c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.226+0000 7fece4e24700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecc0039fa0 0x7fecc003c460 crc :-1 s=READY pgs=264 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.229+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.229+0000 7fecddffb700 1 -- 172.21.15.88:0/1396856040 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fecd402f450 con 0x7fece00a5de0 2020-02-11T16:14:44.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.411+0000 7fece7088700 1 -- 172.21.15.88:0/1396856040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fece00a7980 con 0x7fece00a5de0 2020-02-11T16:14:44.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.411+0000 7fecdffff700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.411+0000 7fecddffb700 1 -- 172.21.15.88:0/1396856040 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fecd4031f40 con 0x7fece00a5de0 2020-02-11T16:14:44.414 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.412+0000 7fece7088700 1 -- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecc0039fa0 msgr2=0x7fecc003c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.413+0000 7fece7088700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecc0039fa0 0x7fecc003c460 crc :-1 s=READY pgs=264 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.413+0000 7fece7088700 1 -- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 msgr2=0x7fece0138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.413+0000 7fece7088700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fecd4002f30 tx=0x7fece00a1c80).stop 2020-02-11T16:14:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.413+0000 7fece7088700 1 -- 172.21.15.88:0/1396856040 shutdown_connections 2020-02-11T16:14:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.413+0000 7fece7088700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecc0039fa0 0x7fecc003c460 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.413+0000 7fece7088700 1 --2- 172.21.15.88:0/1396856040 >> v2:172.21.15.52:3300/0 conn(0x7fece00a18a0 0x7fece01384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.413+0000 7fece7088700 1 --2- 172.21.15.88:0/1396856040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece00a5de0 0x7fece0138920 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.413+0000 7fece7088700 1 -- 172.21.15.88:0/1396856040 >> 172.21.15.88:0/1396856040 conn(0x7fece009d110 msgr2=0x7fece00a61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.413+0000 7fece7088700 1 -- 172.21.15.88:0/1396856040 shutdown_connections 2020-02-11T16:14:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.413+0000 7fece7088700 1 -- 172.21.15.88:0/1396856040 wait complete. 2020-02-11T16:14:44.427 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":82,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:14:44.427 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:14:44.428 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:14:44.428 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:14:44.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.533+0000 7fd2a57ba700 1 Processor -- start 2020-02-11T16:14:44.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.533+0000 7fd2a57ba700 1 -- start start 2020-02-11T16:14:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.533+0000 7fd2a57ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2a00a5de0 0x7fd2a00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.533+0000 7fd2a57ba700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2a0134a50 0x7fd2a0134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:44.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.533+0000 7fd2a57ba700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a00a31b0 con 0x7fd2a00a18a0 2020-02-11T16:14:44.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.533+0000 7fd2a57ba700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a00a3570 con 0x7fd2a00a5de0 2020-02-11T16:14:44.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.533+0000 7fd2a57ba700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00a3810 con 0x7fd2a0134a50 2020-02-11T16:14:44.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.533+0000 7fd29e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2a00a5de0 0x7fd2a00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2a00a5de0 0x7fd2a00a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55494/0 (socket says 172.21.15.88:55494) 2020-02-11T16:14:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 -- 172.21.15.88:0/2646220298 learned_addr learned my addr 172.21.15.88:0/2646220298 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29f7fe700 1 --2- 172.21.15.88:0/2646220298 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2a0134a50 0x7fd2a0134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 -- 172.21.15.88:0/2646220298 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2a0134a50 msgr2=0x7fd2a0134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/2646220298 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2a0134a50 0x7fd2a0134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:44.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 -- 172.21.15.88:0/2646220298 >> v1:172.21.15.88:6789/0 conn(0x7fd2a00a18a0 legacy=0x7fd2a00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 -- 172.21.15.88:0/2646220298 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a00a3ab0 con 0x7fd2a00a5de0 2020-02-11T16:14:44.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/2646220298 >> v2:172.21.15.88:3300/0 conn(0x7fd2a00a5de0 0x7fd2a00a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd290002f30 tx=0x7fd2900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/2646220298 >> v2:172.21.15.88:3300/0 conn(0x7fd2a00a5de0 0x7fd2a00a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd290002f30 tx=0x7fd2900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/2646220298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a00a6260 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7fd290002f30 tx=0x7fd2900088e0).ready entity=mon.1 client_cookie=b04bc3b3bb0e2e69 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/2646220298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a00a6260 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7fd290002f30 tx=0x7fd2900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/2646220298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a00a6260 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7fd290002f30 tx=0x7fd2900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29dffb700 1 -- 172.21.15.88:0/2646220298 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd290011760 con 0x7fd2a00a5de0 2020-02-11T16:14:44.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/2646220298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a00a6260 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7fd290002f30 tx=0x7fd2900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29dffb700 1 -- 172.21.15.88:0/2646220298 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2900118c0 con 0x7fd2a00a5de0 2020-02-11T16:14:44.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd29dffb700 1 -- 172.21.15.88:0/2646220298 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd290011ca0 con 0x7fd2a00a5de0 2020-02-11T16:14:44.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd2a57ba700 1 -- 172.21.15.88:0/2646220298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 msgr2=0x7fd2a00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.534+0000 7fd2a57ba700 1 --2- 172.21.15.88:0/2646220298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a00a6260 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7fd290002f30 tx=0x7fd2900088e0).stop 2020-02-11T16:14:44.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.535+0000 7fd2a57ba700 1 -- 172.21.15.88:0/2646220298 shutdown_connections 2020-02-11T16:14:44.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.535+0000 7fd2a57ba700 1 --2- 172.21.15.88:0/2646220298 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2a0134a50 0x7fd2a0134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:44.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.535+0000 7fd2a57ba700 1 --2- 172.21.15.88:0/2646220298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a00a6260 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.535+0000 7fd2a57ba700 1 -- 172.21.15.88:0/2646220298 >> 172.21.15.88:0/2646220298 conn(0x7fd2a009d110 msgr2=0x7fd2a009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:44.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.535+0000 7fd2a57ba700 1 -- 172.21.15.88:0/2646220298 shutdown_connections 2020-02-11T16:14:44.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.535+0000 7fd2a57ba700 1 -- 172.21.15.88:0/2646220298 wait complete. 2020-02-11T16:14:44.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.535+0000 7fd2a57ba700 1 Processor -- start 2020-02-11T16:14:44.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd2a57ba700 1 -- start start 2020-02-11T16:14:44.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd2a57ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2a00a5de0 0x7fd2a0130440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd2a57ba700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a0137a10 con 0x7fd2a0134a50 2020-02-11T16:14:44.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd2a57ba700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a0137cb0 con 0x7fd2a00a18a0 2020-02-11T16:14:44.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd2a57ba700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a012fb60 con 0x7fd2a00a5de0 2020-02-11T16:14:44.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd29effd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd2a00a18a0 0x7fd2a0135bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43124/0 (socket says 172.21.15.88:43124) 2020-02-11T16:14:44.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd29effd700 1 -- 172.21.15.88:0/624600636 learned_addr learned my addr 172.21.15.88:0/624600636 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/624600636 >> v2:172.21.15.88:3300/0 conn(0x7fd2a00a5de0 0x7fd2a0130440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd29e7fc700 1 -- 172.21.15.88:0/624600636 >> v1:172.21.15.88:6789/0 conn(0x7fd2a00a18a0 legacy=0x7fd2a0135bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd29e7fc700 1 -- 172.21.15.88:0/624600636 >> v1:172.21.15.52:6789/0 conn(0x7fd2a0134a50 legacy=0x7fd2a01367c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873499510 0 0) 0x7fd2a0137cb0 con 0x7fd2a00a18a0 2020-02-11T16:14:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.536+0000 7fd29e7fc700 1 -- 172.21.15.88:0/624600636 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0137f50 con 0x7fd2a00a5de0 2020-02-11T16:14:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/624600636 >> v2:172.21.15.88:3300/0 conn(0x7fd2a00a5de0 0x7fd2a0130440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2a00a5690 tx=0x7fd2a012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/624600636 >> v2:172.21.15.88:3300/0 conn(0x7fd2a00a5de0 0x7fd2a0130440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2a00a5690 tx=0x7fd2a012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a0130440 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7fd2a00a5690 tx=0x7fd2a012f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a0130440 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7fd2a00a5690 tx=0x7fd2a012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd290007340 con 0x7fd2a00a5de0 2020-02-11T16:14:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a0130440 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7fd2a00a5690 tx=0x7fd2a012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd2a57ba700 1 -- 172.21.15.88:0/624600636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a01381f0 con 0x7fd2a00a5de0 2020-02-11T16:14:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2900074a0 con 0x7fd2a00a5de0 2020-02-11T16:14:44.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a0130440 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7fd2a00a5690 tx=0x7fd2a012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2900058b0 con 0x7fd2a00a5de0 2020-02-11T16:14:44.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd2a57ba700 1 -- 172.21.15.88:0/624600636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a0138690 con 0x7fd2a00a5de0 2020-02-11T16:14:44.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.537+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a0130440 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7fd2a00a5690 tx=0x7fd2a012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd2a57ba700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 0x7fd2a012b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd2a57ba700 1 -- 172.21.15.88:0/624600636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a005e2f0 con 0x7fd2a012a570 2020-02-11T16:14:44.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd290005af0 con 0x7fd2a00a5de0 2020-02-11T16:14:44.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd29e7fc700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a0130440 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7fd2a00a5690 tx=0x7fd2a012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 0x7fd2a012b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd28ffff700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd27c039b60 0x7fd27c03c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fd29004a3b0 con 0x7fd2a00a5de0 2020-02-11T16:14:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd29effd700 1 -- 172.21.15.88:0/624600636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2a0138380 con 0x7fd2a012a570 2020-02-11T16:14:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 0x7fd2a012b6d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 0x7fd2a012b6d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 0x7fd2a012b6d0 secure :-1 s=READY pgs=433 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 0x7fd2a012b6d0 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29400ca30 con 0x7fd2a012a570 2020-02-11T16:14:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd29f7fe700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd27c039b60 0x7fd27c03c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 0x7fd2a012b6d0 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fd29400cb90 con 0x7fd2a012a570 2020-02-11T16:14:44.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 msgr2=0x7fd2a012b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd28ffff700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 0x7fd2a012b6d0 secure :-1 s=READY pgs=433 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).stop 2020-02-11T16:14:44.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 msgr2=0x7fd2a012b6d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:44.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd28ffff700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012a570 0x7fd2a012b6d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.538+0000 7fd29f7fe700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd27c039b60 0x7fd27c03c020 crc :-1 s=READY pgs=265 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.546+0000 7fd2a57ba700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 0x7fd2a012c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.546+0000 7fd2a57ba700 1 -- 172.21.15.88:0/624600636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00565b0 con 0x7fd2a012c090 2020-02-11T16:14:44.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.546+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 0x7fd2a012c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd29effd700 1 -- 172.21.15.88:0/624600636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd2a00a9dd0 con 0x7fd2a012c090 2020-02-11T16:14:44.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 0x7fd2a012c470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 0x7fd2a012c470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 0x7fd2a012c470 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 0x7fd2a012c470 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd294012e20 con 0x7fd2a012c090 2020-02-11T16:14:44.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd29effd700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 0x7fd2a012c470 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7fd29400f650 con 0x7fd2a012c090 2020-02-11T16:14:44.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 msgr2=0x7fd2a012c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd28ffff700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 0x7fd2a012c470 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).stop 2020-02-11T16:14:44.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd28ffff700 1 -- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 msgr2=0x7fd2a012c470 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:44.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd28ffff700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a012c090 0x7fd2a012c470 secure :-1 s=CLOSED pgs=434 cs=0 l=1 rx=0x7fd294001260 tx=0x7fd2940015d0).stop 2020-02-11T16:14:44.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd2a57ba700 1 -- 172.21.15.88:0/624600636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd27c039b60 msgr2=0x7fd27c03c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd2a57ba700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd27c039b60 0x7fd27c03c020 crc :-1 s=READY pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd2a57ba700 1 -- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 msgr2=0x7fd2a0130440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd2a57ba700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a0130440 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7fd2a00a5690 tx=0x7fd2a012f3b0).stop 2020-02-11T16:14:44.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd29f7fe700 1 -- 172.21.15.88:0/624600636 reap_dead start 2020-02-11T16:14:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.547+0000 7fd29f7fe700 1 -- 172.21.15.88:0/624600636 reap_dead start 2020-02-11T16:14:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.548+0000 7fd2a57ba700 1 -- 172.21.15.88:0/624600636 shutdown_connections 2020-02-11T16:14:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.548+0000 7fd2a57ba700 1 --2- 172.21.15.88:0/624600636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a00a5de0 0x7fd2a0130440 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.548+0000 7fd2a57ba700 1 -- 172.21.15.88:0/624600636 >> 172.21.15.88:0/624600636 conn(0x7fd2a009d110 msgr2=0x7fd2a00a9610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.548+0000 7fd2a57ba700 1 -- 172.21.15.88:0/624600636 shutdown_connections 2020-02-11T16:14:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.548+0000 7fd2a57ba700 1 -- 172.21.15.88:0/624600636 wait complete. 2020-02-11T16:14:44.568 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:14:44.569 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:14:44.569 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:14:44.569 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:14:44.569 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 82, 2020-02-11T16:14:44.569 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:14:44.569 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:14:44.570 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:14:44.570 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:14:44.570 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.570 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:14:44.570 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:44.570 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:14:44.570 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:14:44.571 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:44.571 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:44.571 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:44.571 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:44.571 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:44.571 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:44.572 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.572 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:14:44.572 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:14:44.572 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:44.572 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:44.572 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:44.573 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:44.573 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:44.573 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:44.573 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.574 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:14:44.574 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:14:44.574 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:14:44.574 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:14:44.574 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:14:44.574 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:14:44.574 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:44.575 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:44.575 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:14:44.575 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:14:44.575 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:44.575 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:14:44.575 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:44.575 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:44.576 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:44.576 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:44.576 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:44.576 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:44.576 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.576 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:14:44.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.577 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:14:44.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.577 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:14:44.578 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:14:44.578 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:44.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:44.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.578 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:44.579 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:14:44.579 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.579 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:44.579 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:14:44.579 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.580 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.580 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:14:44.580 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:14:44.580 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:44.580 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:44.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.581 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:14:44.581 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:14:44.581 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:44.581 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:44.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.582 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:44.582 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:14:44.582 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.582 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:44.582 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:14:44.583 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.583 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.583 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.583 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:14:44.583 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:14:44.583 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:44.584 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:44.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.584 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:14:44.584 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:14:44.584 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:44.584 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:44.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.585 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:44.585 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:14:44.585 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.585 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:44.586 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:14:44.586 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.586 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.586 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:14:44.586 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:14:44.587 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:44.587 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:44.587 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.587 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.587 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:14:44.587 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:14:44.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.588 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:44.588 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:44.588 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:14:44.588 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.588 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.588 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:14:44.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.589 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:44.589 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:44.589 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:14:44.589 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.589 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.589 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:14:44.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.590 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:44.590 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:44.590 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2020-02-11T16:14:44.590 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.590 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.590 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:14:44.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.591 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:44.591 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:44.591 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:14:44.591 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.591 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.591 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:14:44.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.592 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:44.592 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:44.592 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:14:44.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.592 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.592 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:14:44.593 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:14:44.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.697+0000 7f25e8d02700 1 Processor -- start 2020-02-11T16:14:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.697+0000 7f25e8d02700 1 -- start start 2020-02-11T16:14:44.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e8d02700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25e40a18a0 0x7f25e40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:44.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e8d02700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f25e40a5de0 0x7f25e40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e8d02700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e40a31b0 con 0x7f25e412e3a0 2020-02-11T16:14:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e8d02700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e40a3570 con 0x7f25e40a5de0 2020-02-11T16:14:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e8d02700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40a3810 con 0x7f25e40a18a0 2020-02-11T16:14:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f25e40a5de0 0x7f25e40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f25e40a5de0 0x7f25e40a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55510/0 (socket says 172.21.15.88:55510) 2020-02-11T16:14:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 -- 172.21.15.88:0/221352016 learned_addr learned my addr 172.21.15.88:0/221352016 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e259c700 1 --2- 172.21.15.88:0/221352016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25e40a18a0 0x7f25e40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 -- 172.21.15.88:0/221352016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25e40a18a0 msgr2=0x7f25e40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:44.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 --2- 172.21.15.88:0/221352016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25e40a18a0 0x7f25e40a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:44.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 -- 172.21.15.88:0/221352016 >> v1:172.21.15.52:6789/0 conn(0x7f25e412e3a0 legacy=0x7f25e412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 -- 172.21.15.88:0/221352016 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e40a3ab0 con 0x7f25e40a5de0 2020-02-11T16:14:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 --2- 172.21.15.88:0/221352016 >> v2:172.21.15.88:3300/0 conn(0x7f25e40a5de0 0x7f25e40a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f25e405b910 tx=0x7f25d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 --2- 172.21.15.88:0/221352016 >> v2:172.21.15.88:3300/0 conn(0x7f25e40a5de0 0x7f25e40a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f25e405b910 tx=0x7f25d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 --2- 172.21.15.88:0/221352016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e40a5de0 0x7f25e40a6260 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7f25e405b910 tx=0x7f25d40088e0).ready entity=mon.1 client_cookie=d8c5ab55cfd3f7b4 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 --2- 172.21.15.88:0/221352016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e40a5de0 0x7f25e40a6260 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f25e405b910 tx=0x7f25d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e159a700 1 -- 172.21.15.88:0/221352016 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d4011720 con 0x7f25e40a5de0 2020-02-11T16:14:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 --2- 172.21.15.88:0/221352016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e40a5de0 0x7f25e40a6260 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f25e405b910 tx=0x7f25d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e1d9b700 1 --2- 172.21.15.88:0/221352016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e40a5de0 0x7f25e40a6260 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f25e405b910 tx=0x7f25d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e159a700 1 -- 172.21.15.88:0/221352016 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d4011880 con 0x7f25e40a5de0 2020-02-11T16:14:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e159a700 1 -- 172.21.15.88:0/221352016 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d4011c20 con 0x7f25e40a5de0 2020-02-11T16:14:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.698+0000 7f25e8d02700 1 -- 172.21.15.88:0/221352016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e40a5de0 msgr2=0x7f25e40a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.699+0000 7f25e8d02700 1 --2- 172.21.15.88:0/221352016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e40a5de0 0x7f25e40a6260 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7f25e405b910 tx=0x7f25d40088e0).stop 2020-02-11T16:14:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.699+0000 7f25e8d02700 1 -- 172.21.15.88:0/221352016 shutdown_connections 2020-02-11T16:14:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.699+0000 7f25e8d02700 1 --2- 172.21.15.88:0/221352016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25e40a18a0 0x7f25e40a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.699+0000 7f25e8d02700 1 --2- 172.21.15.88:0/221352016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e40a5de0 0x7f25e40a6260 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.699+0000 7f25e8d02700 1 -- 172.21.15.88:0/221352016 >> 172.21.15.88:0/221352016 conn(0x7f25e409d110 msgr2=0x7f25e409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.699+0000 7f25e8d02700 1 -- 172.21.15.88:0/221352016 shutdown_connections 2020-02-11T16:14:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.699+0000 7f25e8d02700 1 -- 172.21.15.88:0/221352016 wait complete. 2020-02-11T16:14:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.700+0000 7f25e8d02700 1 Processor -- start 2020-02-11T16:14:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.700+0000 7f25e8d02700 1 -- start start 2020-02-11T16:14:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.700+0000 7f25e8d02700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25e40a18a0 0x7f25e412faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.700+0000 7f25e8d02700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f25e412e3a0 0x7f25e40a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.700+0000 7f25e8d02700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e4143040 con 0x7f25e40a5de0 2020-02-11T16:14:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.700+0000 7f25e8d02700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e412f330 con 0x7f25e412e3a0 2020-02-11T16:14:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.700+0000 7f25e8d02700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4142e50 con 0x7f25e40a18a0 2020-02-11T16:14:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f25e412e3a0 0x7f25e40a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f25e412e3a0 0x7f25e40a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55518/0 (socket says 172.21.15.88:55518) 2020-02-11T16:14:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 -- 172.21.15.88:0/3987854604 learned_addr learned my addr 172.21.15.88:0/3987854604 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25e40a18a0 0x7f25e412faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 -- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25e40a18a0 msgr2=0x7f25e412faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25e40a18a0 0x7f25e412faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 -- 172.21.15.88:0/3987854604 >> v1:172.21.15.88:6789/0 conn(0x7f25e40a5de0 legacy=0x7f25e4143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895650342 0 0) 0x7f25e4143040 con 0x7f25e40a5de0 2020-02-11T16:14:44.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 -- 172.21.15.88:0/3987854604 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e41432e0 con 0x7f25e412e3a0 2020-02-11T16:14:44.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 --2- 172.21.15.88:0/3987854604 >> v2:172.21.15.88:3300/0 conn(0x7f25e412e3a0 0x7f25e40a0610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25e405e470 tx=0x7f25dc010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 --2- 172.21.15.88:0/3987854604 >> v2:172.21.15.88:3300/0 conn(0x7f25e412e3a0 0x7f25e40a0610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25e405e470 tx=0x7f25dc010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e412e3a0 0x7f25e40a0610 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7f25e405e470 tx=0x7f25dc010c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e412e3a0 0x7f25e40a0610 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f25e405e470 tx=0x7f25dc010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25dc0122f0 con 0x7f25e412e3a0 2020-02-11T16:14:44.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e412e3a0 0x7f25e40a0610 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f25e405e470 tx=0x7f25dc010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e2d9d700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e412e3a0 0x7f25e40a0610 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f25e405e470 tx=0x7f25dc010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc012450 con 0x7f25e412e3a0 2020-02-11T16:14:44.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e8d02700 1 -- 172.21.15.88:0/3987854604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e412ff00 con 0x7f25e412e3a0 2020-02-11T16:14:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25dc012870 con 0x7f25e412e3a0 2020-02-11T16:14:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.701+0000 7f25e8d02700 1 -- 172.21.15.88:0/3987854604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e40a0a70 con 0x7f25e412e3a0 2020-02-11T16:14:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.702+0000 7f25e2d9d700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e412e3a0 0x7f25e40a0610 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f25e405e470 tx=0x7f25dc010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.702+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f25dc012ae0 con 0x7f25e412e3a0 2020-02-11T16:14:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.702+0000 7f25e2d9d700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e412e3a0 0x7f25e40a0610 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f25e405e470 tx=0x7f25dc010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.702+0000 7f25e8d02700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 0x7f25e40a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.702+0000 7f25e8d02700 1 -- 172.21.15.88:0/3987854604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4146620 con 0x7f25e4146e40 2020-02-11T16:14:44.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.702+0000 7f25d37fe700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f25c0039b80 0x7f25c003c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.702+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f25dc04a110 con 0x7f25e412e3a0 2020-02-11T16:14:44.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.702+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 0x7f25e40a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.702+0000 7f25e1d9b700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f25c0039b80 0x7f25c003c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25e1d9b700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f25c0039b80 0x7f25c003c040 crc :-1 s=READY pgs=266 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25e259c700 1 -- 172.21.15.88:0/3987854604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25e41434e0 con 0x7f25e4146e40 2020-02-11T16:14:44.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 0x7f25e40a4e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 0x7f25e40a4e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 0x7f25e40a4e00 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 0x7f25e40a4e00 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d8006650 con 0x7f25e4146e40 2020-02-11T16:14:44.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 0x7f25e40a4e00 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f25d80058b0 con 0x7f25e4146e40 2020-02-11T16:14:44.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 msgr2=0x7f25e40a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25d37fe700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 0x7f25e40a4e00 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).stop 2020-02-11T16:14:44.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 msgr2=0x7f25e40a4e00 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:44.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.703+0000 7f25d37fe700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e4146e40 0x7f25e40a4e00 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).stop 2020-02-11T16:14:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.711+0000 7f25e8d02700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 0x7f25e412c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.711+0000 7f25e8d02700 1 -- 172.21.15.88:0/3987854604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e405e2f0 con 0x7f25e412c390 2020-02-11T16:14:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 0x7f25e412c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25e259c700 1 -- 172.21.15.88:0/3987854604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f25e40a0d80 con 0x7f25e412c390 2020-02-11T16:14:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 0x7f25e412c7a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 0x7f25e412c7a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 0x7f25e412c7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 0x7f25e412c7a0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d800a640 con 0x7f25e412c390 2020-02-11T16:14:44.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25e259c700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 0x7f25e412c7a0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3852 (secure 0 0 0) 0x7f25d8015e90 con 0x7f25e412c390 2020-02-11T16:14:44.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 msgr2=0x7f25e412c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25d37fe700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 0x7f25e412c7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f25d8002f30 tx=0x7f25d8010e10).stop 2020-02-11T16:14:44.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25d37fe700 1 -- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 msgr2=0x7f25e412c7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:44.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.712+0000 7f25d37fe700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e412c390 0x7f25e412c7a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.713+0000 7f25e8d02700 1 -- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f25c0039b80 msgr2=0x7f25c003c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.713+0000 7f25e8d02700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f25c0039b80 0x7f25c003c040 crc :-1 s=READY pgs=266 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.713+0000 7f25e8d02700 1 -- 172.21.15.88:0/3987854604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e412e3a0 msgr2=0x7f25e40a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.713+0000 7f25e8d02700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e412e3a0 0x7f25e40a0610 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7f25e405e470 tx=0x7f25dc010c90).stop 2020-02-11T16:14:44.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.713+0000 7f25e2d9d700 1 -- 172.21.15.88:0/3987854604 reap_dead start 2020-02-11T16:14:44.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.713+0000 7f25e8d02700 1 -- 172.21.15.88:0/3987854604 shutdown_connections 2020-02-11T16:14:44.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.713+0000 7f25e8d02700 1 --2- 172.21.15.88:0/3987854604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e412e3a0 0x7f25e40a0610 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.713+0000 7f25e8d02700 1 -- 172.21.15.88:0/3987854604 >> 172.21.15.88:0/3987854604 conn(0x7f25e409d110 msgr2=0x7f25e40a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:44.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.713+0000 7f25e8d02700 1 -- 172.21.15.88:0/3987854604 shutdown_connections 2020-02-11T16:14:44.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.713+0000 7f25e8d02700 1 -- 172.21.15.88:0/3987854604 wait complete. 2020-02-11T16:14:44.725 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:14:44.726 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:14:44.726 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:14:44.726 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:14:44.726 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 82, 2020-02-11T16:14:44.726 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:14:44.726 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:14:44.726 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:14:44.727 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:14:44.727 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.727 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:14:44.727 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:44.727 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:14:44.727 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:14:44.727 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:44.728 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:44.728 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:44.728 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:44.728 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:44.728 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:44.728 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.729 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:14:44.729 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:14:44.729 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:44.730 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:44.730 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:44.730 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:44.730 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:44.730 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:44.730 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.730 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:14:44.731 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:14:44.731 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:14:44.731 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:14:44.731 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:14:44.731 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:14:44.731 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:44.731 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:44.732 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:14:44.732 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:14:44.732 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:44.732 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:14:44.732 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:44.732 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:44.732 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:44.733 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:44.733 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:44.733 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:44.733 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.733 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:14:44.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.734 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:14:44.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.734 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:14:44.734 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:14:44.734 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:44.734 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:44.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.735 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:44.735 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:14:44.735 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.735 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:44.735 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:14:44.736 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.736 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.736 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.736 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:14:44.736 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:14:44.736 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:44.737 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:44.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.737 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:14:44.737 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:14:44.737 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:44.737 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:44.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.738 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:44.738 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:14:44.738 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.739 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:44.739 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:14:44.739 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.739 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.740 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.740 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:14:44.740 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:14:44.740 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:44.740 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:44.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.741 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:14:44.741 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:14:44.741 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:44.741 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:44.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.741 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:44.742 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:14:44.742 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.742 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:44.742 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:14:44.742 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.743 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.743 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.743 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:14:44.743 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:14:44.743 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:44.743 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:44.743 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.744 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.744 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:14:44.744 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:14:44.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.744 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:44.745 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:44.745 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:14:44.745 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.745 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.745 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:14:44.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.745 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:44.746 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:44.746 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:14:44.746 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.746 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.746 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.746 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:14:44.748 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:14:44.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.851+0000 7f055b30d700 1 Processor -- start 2020-02-11T16:14:44.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.851+0000 7f055b30d700 1 -- start start 2020-02-11T16:14:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.852+0000 7f055b30d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f05540670f0 0x7f055413bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.852+0000 7f055b30d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05540a9750 0x7f055409d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:14:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.852+0000 7f055b30d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05541325d0 con 0x7f055405fc80 2020-02-11T16:14:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.852+0000 7f055b30d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055405c1a0 con 0x7f05540670f0 2020-02-11T16:14:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.852+0000 7f055b30d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05540a9b70 con 0x7f05540a9750 2020-02-11T16:14:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.852+0000 7f055ab0c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05540a9750 0x7f055409d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.852+0000 7f055ab0c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05540a9750 0x7f055409d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55528/0 (socket says 172.21.15.88:55528) 2020-02-11T16:14:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.852+0000 7f055ab0c700 1 -- 172.21.15.88:0/1732215268 learned_addr learned my addr 172.21.15.88:0/1732215268 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:14:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.852+0000 7f0559b0a700 1 --2- 172.21.15.88:0/1732215268 >> v2:172.21.15.52:3300/0 conn(0x7f05540670f0 0x7f055413bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055ab0c700 1 -- 172.21.15.88:0/1732215268 >> v2:172.21.15.52:3300/0 conn(0x7f05540670f0 msgr2=0x7f055413bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:14:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055ab0c700 1 --2- 172.21.15.88:0/1732215268 >> v2:172.21.15.52:3300/0 conn(0x7f05540670f0 0x7f055413bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055ab0c700 1 -- 172.21.15.88:0/1732215268 >> v1:172.21.15.88:6789/0 conn(0x7f055405fc80 legacy=0x7f05540669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f0559309700 1 -- 172.21.15.88:0/1732215268 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915833246 0 0) 0x7f05541325d0 con 0x7f055405fc80 2020-02-11T16:14:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055ab0c700 1 -- 172.21.15.88:0/1732215268 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055413b2f0 con 0x7f05540a9750 2020-02-11T16:14:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055ab0c700 1 --2- 172.21.15.88:0/1732215268 >> v2:172.21.15.88:3300/0 conn(0x7f05540a9750 0x7f055409d110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f054c0032b0 tx=0x7f054c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055ab0c700 1 --2- 172.21.15.88:0/1732215268 >> v2:172.21.15.88:3300/0 conn(0x7f05540a9750 0x7f055409d110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f054c0032b0 tx=0x7f054c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055ab0c700 1 --2- 172.21.15.88:0/1732215268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05540a9750 0x7f055409d110 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f054c0032b0 tx=0x7f054c007dc0).ready entity=mon.1 client_cookie=c41214a9edd00f1a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055ab0c700 1 --2- 172.21.15.88:0/1732215268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05540a9750 0x7f055409d110 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f054c0032b0 tx=0x7f054c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f0559309700 1 -- 172.21.15.88:0/1732215268 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c00a160 con 0x7f05540a9750 2020-02-11T16:14:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055ab0c700 1 --2- 172.21.15.88:0/1732215268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05540a9750 0x7f055409d110 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f054c0032b0 tx=0x7f054c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f0559309700 1 -- 172.21.15.88:0/1732215268 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c00a2c0 con 0x7f05540a9750 2020-02-11T16:14:44.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055ab0c700 1 --2- 172.21.15.88:0/1732215268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05540a9750 0x7f055409d110 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f054c0032b0 tx=0x7f054c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055b30d700 1 -- 172.21.15.88:0/1732215268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05540a9750 msgr2=0x7f055409d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f0559309700 1 -- 172.21.15.88:0/1732215268 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c00a660 con 0x7f05540a9750 2020-02-11T16:14:44.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055b30d700 1 --2- 172.21.15.88:0/1732215268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05540a9750 0x7f055409d110 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f054c0032b0 tx=0x7f054c007dc0).stop 2020-02-11T16:14:44.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055b30d700 1 -- 172.21.15.88:0/1732215268 shutdown_connections 2020-02-11T16:14:44.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055b30d700 1 --2- 172.21.15.88:0/1732215268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05540a9750 0x7f055409d110 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055b30d700 1 --2- 172.21.15.88:0/1732215268 >> v2:172.21.15.52:3300/0 conn(0x7f05540670f0 0x7f055413bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:14:44.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055b30d700 1 -- 172.21.15.88:0/1732215268 >> 172.21.15.88:0/1732215268 conn(0x7f05540aeea0 msgr2=0x7f05540aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:44.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055b30d700 1 -- 172.21.15.88:0/1732215268 shutdown_connections 2020-02-11T16:14:44.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.853+0000 7f055b30d700 1 -- 172.21.15.88:0/1732215268 wait complete. 2020-02-11T16:14:44.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.854+0000 7f055b30d700 1 Processor -- start 2020-02-11T16:14:44.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.854+0000 7f055b30d700 1 -- start start 2020-02-11T16:14:44.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f055b30d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f055405fc80 0x7f0554130730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f055b30d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05540670f0 0x7f0554130b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f055b30d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0554137fc0 con 0x7f05540a9750 2020-02-11T16:14:44.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f055b30d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0554138f10 con 0x7f055405fc80 2020-02-11T16:14:44.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f055b30d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055412e600 con 0x7f05540670f0 2020-02-11T16:14:44.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f055ab0c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f05540a9750 0x7f0554129680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43162/0 (socket says 172.21.15.88:43162) 2020-02-11T16:14:44.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f055ab0c700 1 -- 172.21.15.88:0/380287545 learned_addr learned my addr 172.21.15.88:0/380287545 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:14:44.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> v2:172.21.15.52:3300/0 conn(0x7f055405fc80 0x7f0554130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446915681 0 0) 0x7f0554137fc0 con 0x7f05540a9750 2020-02-11T16:14:44.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0534002fe0 con 0x7f05540a9750 2020-02-11T16:14:44.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05540670f0 0x7f0554130b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4124381104 0 0) 0x7f0534002fe0 con 0x7f05540a9750 2020-02-11T16:14:44.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0554137fc0 con 0x7f05540a9750 2020-02-11T16:14:44.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f054c011da0 con 0x7f05540a9750 2020-02-11T16:14:44.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05540670f0 msgr2=0x7f0554130b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05540670f0 0x7f0554130b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 >> v2:172.21.15.52:3300/0 conn(0x7f055405fc80 msgr2=0x7f0554130730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 --2- 172.21.15.88:0/380287545 >> v2:172.21.15.52:3300/0 conn(0x7f055405fc80 0x7f0554130730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 >> v1:172.21.15.88:6789/0 conn(0x7f05540a9750 legacy=0x7f0554129680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05540670f0 0x7f0534003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0534003d80 0x7f0534004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0554138f10 con 0x7f0534003d80 2020-02-11T16:14:44.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055412e600 con 0x7f05340049b0 2020-02-11T16:14:44.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.855+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0534005340 con 0x7f05540670f0 2020-02-11T16:14:44.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05540670f0 0x7f0534003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055ab0c700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0534003d80 0x7f0534004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 -- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05540670f0 msgr2=0x7f0534003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05540670f0 0x7f0534003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 -- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0534003d80 msgr2=0x7f0534004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0534003d80 0x7f0534004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 -- 172.21.15.88:0/380287545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055412e3d0 con 0x7f05340049b0 2020-02-11T16:14:44.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055b30d700 1 -- 172.21.15.88:0/380287545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05541323a0 con 0x7f05340049b0 2020-02-11T16:14:44.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0548000b80 tx=0x7f0548010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055b30d700 1 -- 172.21.15.88:0/380287545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05540a1ed0 con 0x7f05340049b0 2020-02-11T16:14:44.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0548000b80 tx=0x7f0548010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f0548000b80 tx=0x7f0548010c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f0548000b80 tx=0x7f0548010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f0548000b80 tx=0x7f0548010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0548001e10 con 0x7f05340049b0 2020-02-11T16:14:44.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f0548000b80 tx=0x7f0548010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05480064e0 con 0x7f05340049b0 2020-02-11T16:14:44.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05480068c0 con 0x7f05340049b0 2020-02-11T16:14:44.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.856+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f0548000b80 tx=0x7f0548010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0548006a20 con 0x7f05340049b0 2020-02-11T16:14:44.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f055a30b700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f0548000b80 tx=0x7f0548010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f055b30d700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 0x7f0554130b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f055b30d700 1 -- 172.21.15.88:0/380287545 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055405e2f0 con 0x7f0554129d90 2020-02-11T16:14:44.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f05477fe700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0534041e70 0x7f0534044330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 0x7f0554130b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f05480494b0 con 0x7f05340049b0 2020-02-11T16:14:44.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f055ab0c700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0534041e70 0x7f0534044330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f0559b0a700 1 -- 172.21.15.88:0/380287545 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f055412a1a0 con 0x7f0554129d90 2020-02-11T16:14:44.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 0x7f0554130b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f055ab0c700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0534041e70 0x7f0534044330 crc :-1 s=READY pgs=267 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 0x7f0554130b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.857+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 0x7f0554130b90 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.858+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 0x7f0554130b90 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.858+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f055000a240 con 0x7f0554129d90 2020-02-11T16:14:44.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.858+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 0x7f0554130b90 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.858+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f055000a3a0 con 0x7f0554129d90 2020-02-11T16:14:44.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.858+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 msgr2=0x7f0554130b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.858+0000 7f05477fe700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 0x7f0554130b90 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).stop 2020-02-11T16:14:44.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.858+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 msgr2=0x7f0554130b90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:44.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.858+0000 7f05477fe700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0554129d90 0x7f0554130b90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.858+0000 7f055ab0c700 1 -- 172.21.15.88:0/380287545 reap_dead start 2020-02-11T16:14:44.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.866+0000 7f055b30d700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 0x7f0554129680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:14:44.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.866+0000 7f055b30d700 1 -- 172.21.15.88:0/380287545 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05540565b0 con 0x7f05541304d0 2020-02-11T16:14:44.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.866+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 0x7f0554129680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:14:44.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.866+0000 7f0559b0a700 1 -- 172.21.15.88:0/380287545 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0554130ff0 con 0x7f05541304d0 2020-02-11T16:14:44.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.866+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 0x7f0554129680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.866+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 0x7f0554129680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.866+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 0x7f0554129680 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:14:44.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 0x7f0554129680 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0550015a10 con 0x7f05541304d0 2020-02-11T16:14:44.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f0559b0a700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 0x7f0554129680 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:14:44.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4020 (secure 0 0 0) 0x7f0550015e90 con 0x7f05541304d0 2020-02-11T16:14:44.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 msgr2=0x7f0554129680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f05477fe700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 0x7f0554129680 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f0550002f30 tx=0x7f0550011090).stop 2020-02-11T16:14:44.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f05477fe700 1 -- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 msgr2=0x7f0554129680 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:14:44.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f05477fe700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 0x7f0554129680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 -- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0534041e70 msgr2=0x7f0534044330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0534041e70 0x7f0534044330 crc :-1 s=READY pgs=267 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 -- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 msgr2=0x7f0534004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:14:44.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f0548000b80 tx=0x7f0548010c50).stop 2020-02-11T16:14:44.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 -- 172.21.15.88:0/380287545 shutdown_connections 2020-02-11T16:14:44.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340049b0 0x7f0534004dd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0534041e70 0x7f0534044330 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 --2- 172.21.15.88:0/380287545 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05541304d0 0x7f0554129680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:14:44.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 -- 172.21.15.88:0/380287545 >> 172.21.15.88:0/380287545 conn(0x7f05540aeea0 msgr2=0x7f05540aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:14:44.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 -- 172.21.15.88:0/380287545 shutdown_connections 2020-02-11T16:14:44.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:14:44.867+0000 7f055b30d700 1 -- 172.21.15.88:0/380287545 wait complete. 2020-02-11T16:14:44.889 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:14:44.890 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:14:44.890 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:14:44.890 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:14:44.890 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 82, 2020-02-11T16:14:44.890 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:14:44.890 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:14:44.890 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:14:44.891 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:14:44.891 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.891 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:14:44.891 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:44.891 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:14:44.891 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:14:44.891 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:44.892 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:44.892 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:44.892 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:44.892 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:44.892 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:44.892 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.893 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:14:44.893 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:14:44.893 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:44.893 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:44.893 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:44.893 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:44.893 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:44.894 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:44.894 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.894 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:14:44.894 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:14:44.894 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:14:44.894 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:14:44.894 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:14:44.895 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:14:44.895 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:44.895 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:14:44.895 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:14:44.895 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:14:44.895 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:14:44.895 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:14:44.896 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:14:44.896 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:14:44.896 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:14:44.896 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:14:44.896 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:14:44.896 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:14:44.897 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.897 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:14:44.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.897 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:14:44.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.897 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:14:44.898 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:14:44.898 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:44.898 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:44.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.898 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:44.898 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:14:44.898 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.899 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:44.899 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:14:44.899 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.899 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.900 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.900 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:14:44.900 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:14:44.900 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:44.902 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:44.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.902 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:14:44.902 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:14:44.902 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:44.902 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:44.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.903 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:44.903 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:14:44.903 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.903 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:44.904 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:14:44.904 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.904 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.904 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.904 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:14:44.904 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:14:44.905 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:44.905 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:44.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.905 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:14:44.905 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:14:44.905 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:14:44.906 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:14:44.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.906 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:14:44.906 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:14:44.906 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.907 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:14:44.907 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:14:44.907 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:14:44.907 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.907 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.907 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:14:44.908 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:14:44.908 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:14:44.908 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:14:44.908 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.908 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:14:44.908 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:14:44.908 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:14:44.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.909 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:44.909 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:44.909 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:14:44.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.910 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.910 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:14:44.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.910 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:44.910 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:44.910 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:14:44.911 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.911 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:14:44.911 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:14:44.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:14:44.911 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:14:44.911 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:14:44.911 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:14:44.912 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.912 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:14:44.912 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:14:44.912 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:14:44.912 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2020-02-11T16:14:44.913 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2020-02-11T16:14:44.913 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2020-02-11T16:14:44.913 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:14:44.913 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-02-11T16:14:44.913 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:14:44.925 INFO:tasks.ceph.mon.c:Stopped 2020-02-11T16:14:44.925 INFO:tasks.mon_thrash:Sending STOP to mon a 2020-02-11T16:14:44.925 INFO:tasks.ceph.mon.a:Sent signal 19 2020-02-11T16:14:44.926 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2020-02-11T16:14:59.926 INFO:tasks.mon_thrash:Sending CONT to mon a 2020-02-11T16:14:59.927 INFO:tasks.ceph.mon.a:Sent signal 18 2020-02-11T16:14:59.927 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:14:59.927 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:15:00.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.040+0000 7f8b393d9700 1 Processor -- start 2020-02-11T16:15:00.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.040+0000 7f8b393d9700 1 -- start start 2020-02-11T16:15:00.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b393d9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b393d9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b393d9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 0x7f8b3412e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b393d9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b340a3570 con 0x7f8b340a5de0 2020-02-11T16:15:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b393d9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b340a3810 con 0x7f8b340a18a0 2020-02-11T16:15:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b393d9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b340a3ab0 con 0x7f8b3412e3a0 2020-02-11T16:15:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b32ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b32ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55552/0 (socket says 172.21.15.88:55552) 2020-02-11T16:15:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b337fe700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 msgr2=0x7f8b3412e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:15:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 learned_addr learned my addr 172.21.15.88:0/3210498704 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b337fe700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 0x7f8b3412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:15:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:15:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:15:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b327fc700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:15:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b327fc700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.041+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:15:00.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:00.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b337fe700 1 -- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 msgr2=0x7f8b3412e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:15:00.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b337fe700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 0x7f8b3412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:15:00.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:15:00.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:00.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:00.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:15:00.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:00.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b327fc700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:15:00.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b327fc700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:00.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:00.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.242+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:15:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b337fe700 1 -- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 msgr2=0x7f8b3412e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:15:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b337fe700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 0x7f8b3412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:15:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:15:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:15:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b327fc700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:15:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b327fc700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:00.643+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:15:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b337fe700 1 -- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 msgr2=0x7f8b3412e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:15:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b337fe700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 0x7f8b3412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:15:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:15:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:01.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:01.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:15:01.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:01.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b327fc700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:15:01.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b327fc700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:01.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:01.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:01.444+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:15:03.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.045+0000 7f8b337fe700 1 -- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 msgr2=0x7f8b3412e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:15:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.045+0000 7f8b337fe700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 0x7f8b3412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:15:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.046+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.046+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:15:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.046+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.046+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:03.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.046+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:15:03.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.046+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:03.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.046+0000 7f8b327fc700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:15:03.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.046+0000 7f8b327fc700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:03.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.046+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:03.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:03.046+0000 7f8b327fc700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:15:06.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.249+0000 7f8b337fe700 1 -- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 msgr2=0x7f8b3412e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:15:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.249+0000 7f8b337fe700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 0x7f8b3412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:15:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.249+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.249+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 msgr2=0x7f8b3412e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:15:06.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.249+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 0x7f8b3412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:06.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.249+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:15:06.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.249+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:06.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b32ffd700 1 -- 172.21.15.88:0/3210498704 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b340a3d50 con 0x7f8b340a18a0 2020-02-11T16:15:06.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b1c002f30 tx=0x7f8b1c012140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.88:3300/0 conn(0x7f8b340a18a0 0x7f8b340a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b1c002f30 tx=0x7f8b1c012140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b340a18a0 0x7f8b340a6dd0 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7f8b1c002f30 tx=0x7f8b1c012140).ready entity=mon.1 client_cookie=e8c07d7b47ddf76f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b340a18a0 0x7f8b340a6dd0 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f8b1c002f30 tx=0x7f8b1c012140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b340a18a0 0x7f8b340a6dd0 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f8b1c002f30 tx=0x7f8b1c012140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b31ffb700 1 -- 172.21.15.88:0/3210498704 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b1c00c160 con 0x7f8b340a18a0 2020-02-11T16:15:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b340a18a0 0x7f8b340a6dd0 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f8b1c002f30 tx=0x7f8b1c012140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b31ffb700 1 -- 172.21.15.88:0/3210498704 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c00c2c0 con 0x7f8b340a18a0 2020-02-11T16:15:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b31ffb700 1 -- 172.21.15.88:0/3210498704 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b1c00c620 con 0x7f8b340a18a0 2020-02-11T16:15:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b393d9700 1 -- 172.21.15.88:0/3210498704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b340a18a0 msgr2=0x7f8b340a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.250+0000 7f8b393d9700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b340a18a0 0x7f8b340a6dd0 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7f8b1c002f30 tx=0x7f8b1c012140).stop 2020-02-11T16:15:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.251+0000 7f8b393d9700 1 -- 172.21.15.88:0/3210498704 shutdown_connections 2020-02-11T16:15:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.251+0000 7f8b393d9700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b3412e3a0 0x7f8b3412e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.251+0000 7f8b393d9700 1 --2- 172.21.15.88:0/3210498704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b340a18a0 0x7f8b340a6dd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.251+0000 7f8b393d9700 1 --2- 172.21.15.88:0/3210498704 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a5de0 0x7f8b340a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.251+0000 7f8b393d9700 1 -- 172.21.15.88:0/3210498704 >> 172.21.15.88:0/3210498704 conn(0x7f8b3409d110 msgr2=0x7f8b3409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.251+0000 7f8b393d9700 1 -- 172.21.15.88:0/3210498704 shutdown_connections 2020-02-11T16:15:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.251+0000 7f8b393d9700 1 -- 172.21.15.88:0/3210498704 wait complete. 2020-02-11T16:15:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.252+0000 7f8b393d9700 1 Processor -- start 2020-02-11T16:15:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.252+0000 7f8b393d9700 1 -- start start 2020-02-11T16:15:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b393d9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b340a18a0 0x7f8b34135070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b393d9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b3412e3a0 0x7f8b341316c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b393d9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b341354d0 con 0x7f8b340a5de0 2020-02-11T16:15:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b393d9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b34130f00 con 0x7f8b340a18a0 2020-02-11T16:15:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b393d9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b341311a0 con 0x7f8b3412e3a0 2020-02-11T16:15:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b337fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b3412e3a0 0x7f8b341316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b327fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8b340a5de0 0x7f8b341284b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43224/0 (socket says 172.21.15.88:43224) 2020-02-11T16:15:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b327fc700 1 -- 172.21.15.88:0/807111649 learned_addr learned my addr 172.21.15.88:0/807111649 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:15:06.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/807111649 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a18a0 0x7f8b34135070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b337fe700 1 -- 172.21.15.88:0/807111649 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a18a0 msgr2=0x7f8b34135070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a18a0 0x7f8b34135070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b337fe700 1 -- 172.21.15.88:0/807111649 >> v1:172.21.15.88:6789/0 conn(0x7f8b340a5de0 legacy=0x7f8b341284b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b337fe700 1 -- 172.21.15.88:0/807111649 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b34134160 con 0x7f8b3412e3a0 2020-02-11T16:15:06.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b2bfff700 1 -- 172.21.15.88:0/807111649 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767508439 0 0) 0x7f8b24000e90 con 0x7f8b340a5de0 2020-02-11T16:15:06.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.253+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> v2:172.21.15.88:3300/0 conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> v2:172.21.15.88:3300/0 conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b2bfff700 1 -- 172.21.15.88:0/807111649 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b2c00eba0 con 0x7f8b3412e3a0 2020-02-11T16:15:06.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b2bfff700 1 -- 172.21.15.88:0/807111649 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c00ed00 con 0x7f8b3412e3a0 2020-02-11T16:15:06.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b393d9700 1 -- 172.21.15.88:0/807111649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b34130bf0 con 0x7f8b3412e3a0 2020-02-11T16:15:06.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b2bfff700 1 -- 172.21.15.88:0/807111649 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b2c00ee70 con 0x7f8b3412e3a0 2020-02-11T16:15:06.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b393d9700 1 -- 172.21.15.88:0/807111649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b34128bc0 con 0x7f8b3412e3a0 2020-02-11T16:15:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.254+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.255+0000 7f8b2bfff700 1 -- 172.21.15.88:0/807111649 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8b2c012540 con 0x7f8b3412e3a0 2020-02-11T16:15:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.255+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.255+0000 7f8b2bfff700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8b18039ad0 0x7f8b1803bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.255+0000 7f8b2bfff700 1 -- 172.21.15.88:0/807111649 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8b2c04a120 con 0x7f8b3412e3a0 2020-02-11T16:15:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.255+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8b18039ad0 0x7f8b1803bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.255+0000 7f8b393d9700 1 -- 172.21.15.88:0/807111649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b340565b0 con 0x7f8b3412e3a0 2020-02-11T16:15:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.255+0000 7f8b32ffd700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8b18039ad0 0x7f8b1803bf90 crc :-1 s=READY pgs=268 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.259+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.259+0000 7f8b2bfff700 1 -- 172.21.15.88:0/807111649 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f8b2c02f740 con 0x7f8b3412e3a0 2020-02-11T16:15:06.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.444+0000 7f8b393d9700 1 -- 172.21.15.88:0/807111649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8b3405ccb0 con 0x7f8b3412e3a0 2020-02-11T16:15:06.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.444+0000 7f8b337fe700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.444+0000 7f8b2bfff700 1 -- 172.21.15.88:0/807111649 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7f8b2c032250 con 0x7f8b3412e3a0 2020-02-11T16:15:06.448 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":84,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:15:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 -- 172.21.15.88:0/807111649 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8b18039ad0 msgr2=0x7f8b1803bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8b18039ad0 0x7f8b1803bf90 crc :-1 s=READY pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 -- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 msgr2=0x7f8b341316c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 0x7f8b341316c0 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7f8b2c000b20 tx=0x7f8b2c010cf0).stop 2020-02-11T16:15:06.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 -- 172.21.15.88:0/807111649 shutdown_connections 2020-02-11T16:15:06.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b3412e3a0 0x7f8b341316c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 --2- 172.21.15.88:0/807111649 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8b18039ad0 0x7f8b1803bf90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 --2- 172.21.15.88:0/807111649 >> v2:172.21.15.52:3300/0 conn(0x7f8b340a18a0 0x7f8b34135070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 -- 172.21.15.88:0/807111649 >> 172.21.15.88:0/807111649 conn(0x7f8b3409d110 msgr2=0x7f8b340a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:06.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 -- 172.21.15.88:0/807111649 shutdown_connections 2020-02-11T16:15:06.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.446+0000 7f8b393d9700 1 -- 172.21.15.88:0/807111649 wait complete. 2020-02-11T16:15:06.460 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":84,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:15:06.460 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:15:06.461 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:15:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.564+0000 7efca004f700 1 Processor -- start 2020-02-11T16:15:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.564+0000 7efca004f700 1 -- start start 2020-02-11T16:15:06.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efca004f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc980a7120 0x7efc980a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:06.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efca004f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc980a3e70 0x7efc9812ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:06.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efca004f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc980a5320 con 0x7efc980a39e0 2020-02-11T16:15:06.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efca004f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc98130400 con 0x7efc980a3e70 2020-02-11T16:15:06.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efca004f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9809e7a0 con 0x7efc980a7120 2020-02-11T16:15:06.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9ddeb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc980a7120 0x7efc980a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9d5ea700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efc980a39e0 0x7efc9812f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43230/0 (socket says 172.21.15.88:43230) 2020-02-11T16:15:06.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9ddeb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc980a7120 0x7efc980a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55604/0 (socket says 172.21.15.88:55604) 2020-02-11T16:15:06.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9d5ea700 1 -- 172.21.15.88:0/3826740660 learned_addr learned my addr 172.21.15.88:0/3826740660 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:15:06.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9e5ec700 1 --2- 172.21.15.88:0/3826740660 >> v2:172.21.15.52:3300/0 conn(0x7efc980a3e70 0x7efc9812ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9ddeb700 1 -- 172.21.15.88:0/3826740660 >> v2:172.21.15.52:3300/0 conn(0x7efc980a3e70 msgr2=0x7efc9812ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:06.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/3826740660 >> v2:172.21.15.52:3300/0 conn(0x7efc980a3e70 0x7efc9812ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:06.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9ddeb700 1 -- 172.21.15.88:0/3826740660 >> v1:172.21.15.88:6789/0 conn(0x7efc980a39e0 legacy=0x7efc9812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9cde9700 1 -- 172.21.15.88:0/3826740660 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079592642 0 0) 0x7efc940010d0 con 0x7efc980a39e0 2020-02-11T16:15:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9ddeb700 1 -- 172.21.15.88:0/3826740660 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc980a5560 con 0x7efc980a7120 2020-02-11T16:15:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.565+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/3826740660 >> v2:172.21.15.88:3300/0 conn(0x7efc980a7120 0x7efc980a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/3826740660 >> v2:172.21.15.88:3300/0 conn(0x7efc980a7120 0x7efc980a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/3826740660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a7120 0x7efc980a4ec0 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).ready entity=mon.1 client_cookie=7f3a5964a29e50f2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/3826740660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a7120 0x7efc980a4ec0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efc9cde9700 1 -- 172.21.15.88:0/3826740660 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc88011470 con 0x7efc980a7120 2020-02-11T16:15:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/3826740660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a7120 0x7efc980a4ec0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/3826740660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a7120 0x7efc980a4ec0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efc9cde9700 1 -- 172.21.15.88:0/3826740660 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc880115d0 con 0x7efc980a7120 2020-02-11T16:15:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efc9cde9700 1 -- 172.21.15.88:0/3826740660 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc88011970 con 0x7efc980a7120 2020-02-11T16:15:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efca004f700 1 -- 172.21.15.88:0/3826740660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a7120 msgr2=0x7efc980a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efca004f700 1 --2- 172.21.15.88:0/3826740660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a7120 0x7efc980a4ec0 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).stop 2020-02-11T16:15:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efca004f700 1 -- 172.21.15.88:0/3826740660 shutdown_connections 2020-02-11T16:15:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efca004f700 1 --2- 172.21.15.88:0/3826740660 >> v2:172.21.15.52:3300/0 conn(0x7efc980a3e70 0x7efc9812ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efca004f700 1 --2- 172.21.15.88:0/3826740660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a7120 0x7efc980a4ec0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efca004f700 1 -- 172.21.15.88:0/3826740660 >> 172.21.15.88:0/3826740660 conn(0x7efc9809d110 msgr2=0x7efc9809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efca004f700 1 -- 172.21.15.88:0/3826740660 shutdown_connections 2020-02-11T16:15:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.566+0000 7efca004f700 1 -- 172.21.15.88:0/3826740660 wait complete. 2020-02-11T16:15:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.567+0000 7efca004f700 1 Processor -- start 2020-02-11T16:15:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.567+0000 7efca004f700 1 -- start start 2020-02-11T16:15:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efca004f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc980a39e0 0x7efc98133a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efca004f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc980a3e70 0x7efc981282d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efca004f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc98146da0 con 0x7efc980a7120 2020-02-11T16:15:06.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efca004f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc981366f0 con 0x7efc980a39e0 2020-02-11T16:15:06.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efca004f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc98133ea0 con 0x7efc980a3e70 2020-02-11T16:15:06.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc980a3e70 0x7efc981282d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc980a3e70 0x7efc981282d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55610/0 (socket says 172.21.15.88:55610) 2020-02-11T16:15:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 -- 172.21.15.88:0/143659890 learned_addr learned my addr 172.21.15.88:0/143659890 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> v2:172.21.15.52:3300/0 conn(0x7efc980a39e0 0x7efc98133a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 -- 172.21.15.88:0/143659890 >> v2:172.21.15.52:3300/0 conn(0x7efc980a39e0 msgr2=0x7efc98133a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 --2- 172.21.15.88:0/143659890 >> v2:172.21.15.52:3300/0 conn(0x7efc980a39e0 0x7efc98133a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 -- 172.21.15.88:0/143659890 >> v1:172.21.15.52:6789/0 conn(0x7efc980a7120 legacy=0x7efc981274a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 -- 172.21.15.88:0/143659890 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98136990 con 0x7efc980a3e70 2020-02-11T16:15:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 --2- 172.21.15.88:0/143659890 >> v2:172.21.15.88:3300/0 conn(0x7efc980a3e70 0x7efc981282d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc94000b80 tx=0x7efc94010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 --2- 172.21.15.88:0/143659890 >> v2:172.21.15.88:3300/0 conn(0x7efc980a3e70 0x7efc981282d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc94000b80 tx=0x7efc94010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a3e70 0x7efc981282d0 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7efc94000b80 tx=0x7efc94010960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a3e70 0x7efc981282d0 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7efc94000b80 tx=0x7efc94010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc94005ca0 con 0x7efc980a3e70 2020-02-11T16:15:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a3e70 0x7efc981282d0 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7efc94000b80 tx=0x7efc94010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc9d5ea700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a3e70 0x7efc981282d0 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7efc94000b80 tx=0x7efc94010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc94005e00 con 0x7efc980a3e70 2020-02-11T16:15:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc940062b0 con 0x7efc980a3e70 2020-02-11T16:15:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efca004f700 1 -- 172.21.15.88:0/143659890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc98147200 con 0x7efc980a3e70 2020-02-11T16:15:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.568+0000 7efca004f700 1 -- 172.21.15.88:0/143659890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc98136300 con 0x7efc980a3e70 2020-02-11T16:15:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.569+0000 7efc9d5ea700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a3e70 0x7efc981282d0 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7efc94000b80 tx=0x7efc94010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.569+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7efc940064f0 con 0x7efc980a3e70 2020-02-11T16:15:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.569+0000 7efc9d5ea700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a3e70 0x7efc981282d0 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7efc94000b80 tx=0x7efc94010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.569+0000 7efca004f700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 0x7efc9805aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.569+0000 7efca004f700 1 -- 172.21.15.88:0/143659890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9805e2f0 con 0x7efc98127bb0 2020-02-11T16:15:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.569+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 0x7efc9805aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc86ffd700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efc78039c00 0x7efc7803c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7efc94049840 con 0x7efc980a3e70 2020-02-11T16:15:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc9ddeb700 1 -- 172.21.15.88:0/143659890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc98146f60 con 0x7efc98127bb0 2020-02-11T16:15:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 0x7efc9805aa00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc9e5ec700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efc78039c00 0x7efc7803c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 0x7efc9805aa00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 0x7efc9805aa00 secure :-1 s=READY pgs=455 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 0x7efc9805aa00 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc88007150 con 0x7efc98127bb0 2020-02-11T16:15:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc9e5ec700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efc78039c00 0x7efc7803c0c0 crc :-1 s=READY pgs=269 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 0x7efc9805aa00 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7efc880072b0 con 0x7efc98127bb0 2020-02-11T16:15:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 msgr2=0x7efc9805aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc86ffd700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 0x7efc9805aa00 secure :-1 s=READY pgs=455 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).stop 2020-02-11T16:15:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 msgr2=0x7efc9805aa00 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:15:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.570+0000 7efc86ffd700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc98127bb0 0x7efc9805aa00 secure :-1 s=CLOSED pgs=455 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).stop 2020-02-11T16:15:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.578+0000 7efca004f700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 0x7efc9812d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.578+0000 7efca004f700 1 -- 172.21.15.88:0/143659890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc98136830 con 0x7efc9812d2b0 2020-02-11T16:15:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.578+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 0x7efc9812d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.578+0000 7efc9ddeb700 1 -- 172.21.15.88:0/143659890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efc980a5320 con 0x7efc9812d2b0 2020-02-11T16:15:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 0x7efc9812d6c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 0x7efc9812d6c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 0x7efc9812d6c0 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 0x7efc9812d6c0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8800e7d0 con 0x7efc9812d2b0 2020-02-11T16:15:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc9ddeb700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 0x7efc9812d6c0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4348 (secure 0 0 0) 0x7efc8800e930 con 0x7efc9812d2b0 2020-02-11T16:15:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 msgr2=0x7efc9812d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc86ffd700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 0x7efc9812d6c0 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7efc88002f30 tx=0x7efc88007a40).stop 2020-02-11T16:15:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc86ffd700 1 -- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 msgr2=0x7efc9812d6c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:15:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc86ffd700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9812d2b0 0x7efc9812d6c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efca004f700 1 -- 172.21.15.88:0/143659890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efc78039c00 msgr2=0x7efc7803c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efca004f700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efc78039c00 0x7efc7803c0c0 crc :-1 s=READY pgs=269 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efca004f700 1 -- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a3e70 msgr2=0x7efc981282d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efca004f700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a3e70 0x7efc981282d0 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7efc94000b80 tx=0x7efc94010960).stop 2020-02-11T16:15:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc9e5ec700 1 -- 172.21.15.88:0/143659890 reap_dead start 2020-02-11T16:15:06.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efc9e5ec700 1 -- 172.21.15.88:0/143659890 reap_dead start 2020-02-11T16:15:06.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efca004f700 1 -- 172.21.15.88:0/143659890 shutdown_connections 2020-02-11T16:15:06.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efca004f700 1 --2- 172.21.15.88:0/143659890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980a3e70 0x7efc981282d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efca004f700 1 -- 172.21.15.88:0/143659890 >> 172.21.15.88:0/143659890 conn(0x7efc9809d110 msgr2=0x7efc98069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:06.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efca004f700 1 -- 172.21.15.88:0/143659890 shutdown_connections 2020-02-11T16:15:06.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.579+0000 7efca004f700 1 -- 172.21.15.88:0/143659890 wait complete. 2020-02-11T16:15:06.601 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:15:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:15:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:15:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:15:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 84, 2020-02-11T16:15:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:15:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:15:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:15:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:15:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:15:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:15:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:15:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:15:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:15:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:15:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:15:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:15:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:15:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:15:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:15:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:15:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:15:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:15:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:15:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:15:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:15:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:15:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:15:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:15:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:15:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:15:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.615 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:06.615 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:15:06.615 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.615 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.615 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.616 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:15:06.616 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:15:06.616 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:06.616 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:06.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.616 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:15:06.617 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:15:06.617 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:06.617 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:06.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.617 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:06.617 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:15:06.617 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.618 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:06.618 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:15:06.618 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.618 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.618 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:15:06.619 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:15:06.619 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:06.619 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:06.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.619 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:15:06.620 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:15:06.620 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:06.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:06.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.620 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:06.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:15:06.620 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.621 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:06.621 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:15:06.621 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.621 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.621 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.622 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:15:06.622 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:15:06.622 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:06.622 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:06.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.622 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.623 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:15:06.623 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:15:06.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.623 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:06.623 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:06.623 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:15:06.623 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.624 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.624 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:15:06.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.624 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:06.624 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:06.624 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:15:06.624 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.625 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.625 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:15:06.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.625 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:06.625 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:06.625 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:15:06.625 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.626 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.626 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:15:06.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.626 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:06.626 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:15:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:15:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:15:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.628 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:15:06.629 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:15:06.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.732+0000 7f4567bcd700 1 Processor -- start 2020-02-11T16:15:06.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.733+0000 7f4567bcd700 1 -- start start 2020-02-11T16:15:06.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.733+0000 7f4567bcd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45600a18a0 0x7f45600a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:06.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.733+0000 7f4567bcd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f45600a5de0 0x7f45600a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:06.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.733+0000 7f4567bcd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45600a31b0 con 0x7f456012e3a0 2020-02-11T16:15:06.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.733+0000 7f4567bcd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45600a3570 con 0x7f45600a5de0 2020-02-11T16:15:06.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.733+0000 7f4567bcd700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45600a3810 con 0x7f45600a18a0 2020-02-11T16:15:06.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.733+0000 7f4565969700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45600a18a0 0x7f45600a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.733+0000 7f4565969700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45600a18a0 0x7f45600a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55620/0 (socket says 172.21.15.88:55620) 2020-02-11T16:15:06.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.733+0000 7f4565969700 1 -- 172.21.15.88:0/4081110208 learned_addr learned my addr 172.21.15.88:0/4081110208 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:06.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565168700 1 --2- 172.21.15.88:0/4081110208 >> v2:172.21.15.52:3300/0 conn(0x7f45600a5de0 0x7f45600a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565969700 1 -- 172.21.15.88:0/4081110208 >> v2:172.21.15.52:3300/0 conn(0x7f45600a5de0 msgr2=0x7f45600a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:06.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565969700 1 --2- 172.21.15.88:0/4081110208 >> v2:172.21.15.52:3300/0 conn(0x7f45600a5de0 0x7f45600a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:06.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565969700 1 -- 172.21.15.88:0/4081110208 >> v1:172.21.15.52:6789/0 conn(0x7f456012e3a0 legacy=0x7f456012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565969700 1 -- 172.21.15.88:0/4081110208 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45600a3ab0 con 0x7f45600a18a0 2020-02-11T16:15:06.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565168700 1 --2- 172.21.15.88:0/4081110208 >> v2:172.21.15.52:3300/0 conn(0x7f45600a5de0 0x7f45600a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:15:06.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565969700 1 --2- 172.21.15.88:0/4081110208 >> v2:172.21.15.88:3300/0 conn(0x7f45600a18a0 0x7f45600a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f455c002f30 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565969700 1 --2- 172.21.15.88:0/4081110208 >> v2:172.21.15.88:3300/0 conn(0x7f45600a18a0 0x7f45600a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f455c002f30 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565969700 1 --2- 172.21.15.88:0/4081110208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a18a0 0x7f45600a6dd0 secure :-1 s=READY pgs=457 cs=0 l=1 rx=0x7f455c002f30 tx=0x7f455c007a40).ready entity=mon.1 client_cookie=4d1aea0f0f8eab06 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565969700 1 --2- 172.21.15.88:0/4081110208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a18a0 0x7f45600a6dd0 secure :-1 s=THROTTLE_DONE pgs=457 cs=0 l=1 rx=0x7f455c002f30 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4564967700 1 -- 172.21.15.88:0/4081110208 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f455c011720 con 0x7f45600a18a0 2020-02-11T16:15:06.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565969700 1 --2- 172.21.15.88:0/4081110208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a18a0 0x7f45600a6dd0 secure :-1 s=THROTTLE_DONE pgs=457 cs=0 l=1 rx=0x7f455c002f30 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4565969700 1 --2- 172.21.15.88:0/4081110208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a18a0 0x7f45600a6dd0 secure :-1 s=THROTTLE_DONE pgs=457 cs=0 l=1 rx=0x7f455c002f30 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4564967700 1 -- 172.21.15.88:0/4081110208 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c011880 con 0x7f45600a18a0 2020-02-11T16:15:06.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4564967700 1 -- 172.21.15.88:0/4081110208 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f455c011c60 con 0x7f45600a18a0 2020-02-11T16:15:06.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4567bcd700 1 -- 172.21.15.88:0/4081110208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a18a0 msgr2=0x7f45600a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4567bcd700 1 --2- 172.21.15.88:0/4081110208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a18a0 0x7f45600a6dd0 secure :-1 s=READY pgs=457 cs=0 l=1 rx=0x7f455c002f30 tx=0x7f455c007a40).stop 2020-02-11T16:15:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4567bcd700 1 -- 172.21.15.88:0/4081110208 shutdown_connections 2020-02-11T16:15:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4567bcd700 1 --2- 172.21.15.88:0/4081110208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a18a0 0x7f45600a6dd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4567bcd700 1 --2- 172.21.15.88:0/4081110208 >> v2:172.21.15.52:3300/0 conn(0x7f45600a5de0 0x7f45600a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.734+0000 7f4567bcd700 1 -- 172.21.15.88:0/4081110208 >> 172.21.15.88:0/4081110208 conn(0x7f456009d110 msgr2=0x7f456009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.735+0000 7f4567bcd700 1 -- 172.21.15.88:0/4081110208 shutdown_connections 2020-02-11T16:15:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.735+0000 7f4567bcd700 1 -- 172.21.15.88:0/4081110208 wait complete. 2020-02-11T16:15:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.735+0000 7f4567bcd700 1 Processor -- start 2020-02-11T16:15:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.735+0000 7f4567bcd700 1 -- start start 2020-02-11T16:15:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4567bcd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45600a18a0 0x7f45601303a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4567bcd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45600a5de0 0x7f4560131570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4567bcd700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4560126eb0 con 0x7f456012e3a0 2020-02-11T16:15:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4567bcd700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4560127150 con 0x7f45600a5de0 2020-02-11T16:15:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4567bcd700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45601273f0 con 0x7f45600a18a0 2020-02-11T16:15:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565969700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45600a18a0 msgr2=0x7f45601303a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:15:06.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565969700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45600a18a0 0x7f45601303a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:15:06.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45600a5de0 0x7f4560131570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45600a5de0 0x7f4560131570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55626/0 (socket says 172.21.15.88:55626) 2020-02-11T16:15:06.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 -- 172.21.15.88:0/2360631611 learned_addr learned my addr 172.21.15.88:0/2360631611 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:06.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 -- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45600a18a0 msgr2=0x7f45601303a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:15:06.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106638487 0 0) 0x7f4560126eb0 con 0x7f456012e3a0 2020-02-11T16:15:06.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45600a18a0 0x7f45601303a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 -- 172.21.15.88:0/2360631611 >> v1:172.21.15.88:6789/0 conn(0x7f456012e3a0 legacy=0x7f456005aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 -- 172.21.15.88:0/2360631611 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456005a5d0 con 0x7f45600a5de0 2020-02-11T16:15:06.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 --2- 172.21.15.88:0/2360631611 >> v2:172.21.15.88:3300/0 conn(0x7f45600a5de0 0x7f4560131570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4550007920 tx=0x7f4550010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 --2- 172.21.15.88:0/2360631611 >> v2:172.21.15.88:3300/0 conn(0x7f45600a5de0 0x7f4560131570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4550007920 tx=0x7f4550010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a5de0 0x7f4560131570 secure :-1 s=READY pgs=459 cs=0 l=1 rx=0x7f4550007920 tx=0x7f4550010c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a5de0 0x7f4560131570 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7f4550007920 tx=0x7f4550010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45500122c0 con 0x7f45600a5de0 2020-02-11T16:15:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.736+0000 7f4565168700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a5de0 0x7f4560131570 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7f4550007920 tx=0x7f4550010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.737+0000 7f4565168700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a5de0 0x7f4560131570 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7f4550007920 tx=0x7f4550010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.737+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4550012420 con 0x7f45600a5de0 2020-02-11T16:15:06.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.737+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45500127c0 con 0x7f45600a5de0 2020-02-11T16:15:06.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.737+0000 7f4567bcd700 1 -- 172.21.15.88:0/2360631611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4560135790 con 0x7f45600a5de0 2020-02-11T16:15:06.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.737+0000 7f4567bcd700 1 -- 172.21.15.88:0/2360631611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4560132270 con 0x7f45600a5de0 2020-02-11T16:15:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.737+0000 7f4565168700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a5de0 0x7f4560131570 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7f4550007920 tx=0x7f4550010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.737+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4550012a30 con 0x7f45600a5de0 2020-02-11T16:15:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.737+0000 7f4565168700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a5de0 0x7f4560131570 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7f4550007920 tx=0x7f4550010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.737+0000 7f4567bcd700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 0x7f456005b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.737+0000 7f4567bcd700 1 -- 172.21.15.88:0/2360631611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456005e2f0 con 0x7f45601319d0 2020-02-11T16:15:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f454effd700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4540039b00 0x7f454003bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4550049f40 con 0x7f45600a5de0 2020-02-11T16:15:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 0x7f456005b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f456616a700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4540039b00 0x7f454003bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f4565969700 1 -- 172.21.15.88:0/2360631611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45601275f0 con 0x7f45601319d0 2020-02-11T16:15:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f456616a700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4540039b00 0x7f454003bfc0 crc :-1 s=READY pgs=270 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 0x7f456005b170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 0x7f456005b170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 0x7f456005b170 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 0x7f456005b170 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.738+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f455c011d10 con 0x7f45601319d0 2020-02-11T16:15:06.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.739+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 0x7f456005b170 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.739+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f455c007bd0 con 0x7f45601319d0 2020-02-11T16:15:06.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.739+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 msgr2=0x7f456005b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.739+0000 7f454effd700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 0x7f456005b170 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).stop 2020-02-11T16:15:06.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.739+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 msgr2=0x7f456005b170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:15:06.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.739+0000 7f454effd700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45601319d0 0x7f456005b170 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.747+0000 7f4567bcd700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 0x7f4560129430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:06.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.747+0000 7f4567bcd700 1 -- 172.21.15.88:0/2360631611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456005b5d0 con 0x7f45600a4990 2020-02-11T16:15:06.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.747+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 0x7f4560129430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:06.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.747+0000 7f4565969700 1 -- 172.21.15.88:0/2360631611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f45600565b0 con 0x7f45600a4990 2020-02-11T16:15:06.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.747+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 0x7f4560129430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.747+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 0x7f4560129430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.747+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 0x7f4560129430 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:06.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 0x7f4560129430 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f455c007880 con 0x7f45600a4990 2020-02-11T16:15:06.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4565969700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 0x7f4560129430 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:06.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f455c00b850 con 0x7f45600a4990 2020-02-11T16:15:06.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 msgr2=0x7f4560129430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f454effd700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 0x7f4560129430 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f455c007ed0 tx=0x7f455c007a40).stop 2020-02-11T16:15:06.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f454effd700 1 -- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 msgr2=0x7f4560129430 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:15:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f454effd700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45600a4990 0x7f4560129430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4567bcd700 1 -- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4540039b00 msgr2=0x7f454003bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4567bcd700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4540039b00 0x7f454003bfc0 crc :-1 s=READY pgs=270 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4567bcd700 1 -- 172.21.15.88:0/2360631611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a5de0 msgr2=0x7f4560131570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:06.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4567bcd700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a5de0 0x7f4560131570 secure :-1 s=READY pgs=459 cs=0 l=1 rx=0x7f4550007920 tx=0x7f4550010c60).stop 2020-02-11T16:15:06.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f456616a700 1 -- 172.21.15.88:0/2360631611 reap_dead start 2020-02-11T16:15:06.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f456616a700 1 -- 172.21.15.88:0/2360631611 reap_dead start 2020-02-11T16:15:06.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4567bcd700 1 -- 172.21.15.88:0/2360631611 shutdown_connections 2020-02-11T16:15:06.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4567bcd700 1 --2- 172.21.15.88:0/2360631611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45600a5de0 0x7f4560131570 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:06.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4567bcd700 1 -- 172.21.15.88:0/2360631611 >> 172.21.15.88:0/2360631611 conn(0x7f456009d110 msgr2=0x7f45600a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:06.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4567bcd700 1 -- 172.21.15.88:0/2360631611 shutdown_connections 2020-02-11T16:15:06.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:06.748+0000 7f4567bcd700 1 -- 172.21.15.88:0/2360631611 wait complete. 2020-02-11T16:15:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:15:06.767 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:15:06.767 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:15:06.767 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:15:06.768 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 84, 2020-02-11T16:15:06.768 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:15:06.768 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:15:06.768 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:15:06.768 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.769 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:15:06.769 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:15:06.769 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:15:06.769 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:15:06.769 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:06.769 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:06.769 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:06.770 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:06.770 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:06.770 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:06.770 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.770 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:15:06.770 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:15:06.770 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:06.771 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:06.771 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:06.771 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:06.771 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:06.771 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:06.771 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.772 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:15:06.772 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:15:06.772 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:15:06.772 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:15:06.772 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:15:06.772 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:15:06.773 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:15:06.773 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:15:06.773 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:15:06.773 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:15:06.773 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:15:06.773 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:15:06.773 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:06.773 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:06.774 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:06.774 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:06.774 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:06.774 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:06.775 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.775 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:15:06.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.775 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:15:06.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.776 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:15:06.776 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:15:06.776 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:06.776 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:06.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.777 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:06.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:15:06.777 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.777 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:06.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:15:06.778 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.778 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.778 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.778 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:15:06.778 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:15:06.778 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:06.779 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:06.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.779 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:15:06.779 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:15:06.779 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:06.779 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:06.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.780 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:06.780 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:15:06.780 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.780 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:06.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:15:06.781 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.781 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.781 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:15:06.781 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:15:06.782 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:06.782 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:06.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.782 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:15:06.782 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:15:06.782 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:06.782 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:06.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:06.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:15:06.783 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:06.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:15:06.784 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:06.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.784 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.785 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:15:06.785 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:15:06.785 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:06.785 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:06.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.786 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:06.786 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:15:06.786 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:15:06.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.787 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:06.787 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:06.787 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:15:06.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.787 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:06.787 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:15:06.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:06.788 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:06.788 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:06.788 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:15:06.788 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.788 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:06.788 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:06.788 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:15:06.789 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:15:13.132 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:15:13.135 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:15:26.790 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:15:26.792 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2020-02-11T16:15:26.793 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-11T16:15:26.793 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-11T16:15:26.796 INFO:tasks.ceph.mon.c:Started 2020-02-11T16:15:26.796 INFO:tasks.mon_thrash:Sending STOP to mon a 2020-02-11T16:15:26.796 INFO:tasks.ceph.mon.a:Sent signal 19 2020-02-11T16:15:26.796 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2020-02-11T16:15:41.797 INFO:tasks.mon_thrash:Sending CONT to mon a 2020-02-11T16:15:41.797 INFO:tasks.ceph.mon.a:Sent signal 18 2020-02-11T16:15:41.798 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:15:41.798 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:15:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.911+0000 7fbcf7d1d700 1 Processor -- start 2020-02-11T16:15:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.911+0000 7fbcf7d1d700 1 -- start start 2020-02-11T16:15:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.912+0000 7fbcf7d1d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.912+0000 7fbcf7d1d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf00a4350 con 0x7fbcf00a5410 2020-02-11T16:15:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.912+0000 7fbcf7d1d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf00a3a40 con 0x7fbcf0131990 2020-02-11T16:15:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.912+0000 7fbcf7d1d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00a1e60 con 0x7fbcf00a2fa0 2020-02-11T16:15:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.912+0000 7fbcf62ba700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbcf0131990 0x7fbcf013ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43268/0 (socket says 172.21.15.88:43268) 2020-02-11T16:15:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.912+0000 7fbcf62ba700 1 -- 172.21.15.88:0/3801232955 learned_addr learned my addr 172.21.15.88:0/3801232955 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:15:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.912+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.913+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:15:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.913+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.913+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:41.913+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:15:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:42.114+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:42.114+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:15:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:42.114+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:42.114+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:42.114+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:15:42.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:42.515+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:42.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:42.515+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:15:42.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:42.515+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:42.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:42.515+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:42.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:42.515+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:15:43.256 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:15:43.258 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:15:43.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:43.316+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:43.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:43.317+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:15:43.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:43.317+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:43.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:43.317+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:43.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:43.317+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:15:44.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:44.918+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:44.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:44.918+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:15:44.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:44.918+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:15:44.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:44.918+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:44.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:44.918+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:15:45.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.932+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235755472 0 0) 0x7fbcf00a4350 con 0x7fbcf00a5410 2020-02-11T16:15:45.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.932+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd8003230 con 0x7fbcf00a5410 2020-02-11T16:15:45.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 743204956 0 0) 0x7fbcd8003230 con 0x7fbcf00a5410 2020-02-11T16:15:45.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcf00a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:15:45.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcf00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 >> v1:172.21.15.88:6789/0 conn(0x7fbcf0131990 legacy=0x7fbcf013ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00a3ce0 con 0x7fbcf00a5410 2020-02-11T16:15:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fbcec0016d0 con 0x7fbcf00a5410 2020-02-11T16:15:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 >> v1:172.21.15.52:6789/0 conn(0x7fbcf00a5410 legacy=0x7fbcf0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcd8003750 0x7fbcd8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd80044d0 0x7fbcd8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcd8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00a1e60 con 0x7fbcd80044d0 2020-02-11T16:15:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd8004260 con 0x7fbcd8003750 2020-02-11T16:15:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd8005210 con 0x7fbcf00a2fa0 2020-02-11T16:15:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcd8003750 0x7fbcd8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd80044d0 0x7fbcd8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf62ba700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcd8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 msgr2=0x7fbcd8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:45.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf00a2fa0 0x7fbcd8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:45.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd80044d0 msgr2=0x7fbcd8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:45.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd80044d0 0x7fbcd8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:45.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 -- 172.21.15.88:0/3801232955 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd8003230 con 0x7fbcd8003750 2020-02-11T16:15:45.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcd8003750 0x7fbcd8003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbce0002f30 tx=0x7fbce000bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcd8003750 0x7fbcd8003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbce0002f30 tx=0x7fbce000bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcd8003750 0x7fbcd8003b70 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7fbce0002f30 tx=0x7fbce000bbe0).ready entity=mon.1 client_cookie=e9e4ff764aeefc29 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:45.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcd8003750 0x7fbcd8003b70 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fbce0002f30 tx=0x7fbce000bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbce0005b40 con 0x7fbcd8003750 2020-02-11T16:15:45.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcd8003750 0x7fbcd8003b70 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fbce0002f30 tx=0x7fbce000bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce0005ca0 con 0x7fbcd8003750 2020-02-11T16:15:45.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcd8003750 0x7fbcd8003b70 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fbce0002f30 tx=0x7fbce000bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf4ab7700 1 -- 172.21.15.88:0/3801232955 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbce0005e10 con 0x7fbcd8003750 2020-02-11T16:15:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3801232955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcd8003750 msgr2=0x7fbcd8003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf7d1d700 1 --2- 172.21.15.88:0/3801232955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcd8003750 0x7fbcd8003b70 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7fbce0002f30 tx=0x7fbce000bbe0).stop 2020-02-11T16:15:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.934+0000 7fbcf62ba700 1 -- 172.21.15.88:0/3801232955 reap_dead start 2020-02-11T16:15:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.935+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3801232955 shutdown_connections 2020-02-11T16:15:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.935+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3801232955 >> 172.21.15.88:0/3801232955 conn(0x7fbcf009d110 msgr2=0x7fbcf009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.935+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3801232955 shutdown_connections 2020-02-11T16:15:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.935+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3801232955 wait complete. 2020-02-11T16:15:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.936+0000 7fbcf7d1d700 1 Processor -- start 2020-02-11T16:15:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.936+0000 7fbcf7d1d700 1 -- start start 2020-02-11T16:15:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf7d1d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbcf01375e0 0x7fbcf0066e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf7d1d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbcf01455c0 0x7fbcf0145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf7d1d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf0136c60 con 0x7fbcf0136880 2020-02-11T16:15:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf7d1d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf01359e0 con 0x7fbcf01375e0 2020-02-11T16:15:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf7d1d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf00a9800 con 0x7fbcf01455c0 2020-02-11T16:15:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf62ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbcf01455c0 0x7fbcf0145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf62ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbcf01455c0 0x7fbcf0145a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55662/0 (socket says 172.21.15.88:55662) 2020-02-11T16:15:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf62ba700 1 -- 172.21.15.88:0/3080215844 learned_addr learned my addr 172.21.15.88:0/3080215844 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:45.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> v2:172.21.15.52:3300/0 conn(0x7fbcf01375e0 0x7fbcf0066e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:45.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf62ba700 1 -- 172.21.15.88:0/3080215844 >> v2:172.21.15.88:3300/0 conn(0x7fbcf01455c0 msgr2=0x7fbcf0145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:15:45.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf62ba700 1 -- 172.21.15.88:0/3080215844 >> v2:172.21.15.88:3300/0 conn(0x7fbcf01455c0 msgr2=0x7fbcf0145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:15:45.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf62ba700 1 --2- 172.21.15.88:0/3080215844 >> v2:172.21.15.88:3300/0 conn(0x7fbcf01455c0 0x7fbcf0145a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:15:45.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.937+0000 7fbcf62ba700 1 --2- 172.21.15.88:0/3080215844 >> v2:172.21.15.88:3300/0 conn(0x7fbcf01455c0 0x7fbcf0145a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:15:45.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf52b8700 1 -- 172.21.15.88:0/3080215844 >> v2:172.21.15.88:3300/0 conn(0x7fbcf01455c0 msgr2=0x7fbcf0145a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:15:45.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> v2:172.21.15.88:3300/0 conn(0x7fbcf01455c0 0x7fbcf0145a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:45.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf52b8700 1 -- 172.21.15.88:0/3080215844 >> v1:172.21.15.88:6789/0 conn(0x7fbcf0136880 legacy=0x7fbcf0136ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:45.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf52b8700 1 -- 172.21.15.88:0/3080215844 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00a9aa0 con 0x7fbcf01375e0 2020-02-11T16:15:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> v2:172.21.15.52:3300/0 conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> v2:172.21.15.52:3300/0 conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcdeffd700 1 -- 172.21.15.88:0/3080215844 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcec00e530 con 0x7fbcf01375e0 2020-02-11T16:15:45.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcdeffd700 1 -- 172.21.15.88:0/3080215844 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec0117e0 con 0x7fbcf01375e0 2020-02-11T16:15:45.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3080215844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf00a9d40 con 0x7fbcf01375e0 2020-02-11T16:15:45.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcdeffd700 1 -- 172.21.15.88:0/3080215844 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcec011c00 con 0x7fbcf01375e0 2020-02-11T16:15:45.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.938+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3080215844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf0145e70 con 0x7fbcf01375e0 2020-02-11T16:15:45.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.939+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.939+0000 7fbcdeffd700 1 -- 172.21.15.88:0/3080215844 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fbcec00c6f0 con 0x7fbcf01375e0 2020-02-11T16:15:45.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.939+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.939+0000 7fbcdeffd700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbcd0039cc0 0x7fbcd003c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.939+0000 7fbcdeffd700 1 -- 172.21.15.88:0/3080215844 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fbcec0495b0 con 0x7fbcf01375e0 2020-02-11T16:15:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.940+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbcd0039cc0 0x7fbcd003c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.940+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3080215844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf00565b0 con 0x7fbcf01375e0 2020-02-11T16:15:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.940+0000 7fbcf5ab9700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbcd0039cc0 0x7fbcd003c180 crc :-1 s=READY pgs=272 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.944+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:45.944+0000 7fbcdeffd700 1 -- 172.21.15.88:0/3080215844 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbcec02ebd0 con 0x7fbcf01375e0 2020-02-11T16:15:46.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.129+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3080215844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbcf00a1c40 con 0x7fbcf01375e0 2020-02-11T16:15:46.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.130+0000 7fbcf52b8700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:46.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.130+0000 7fbcdeffd700 1 -- 172.21.15.88:0/3080215844 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7fbcec0316a0 con 0x7fbcf01375e0 2020-02-11T16:15:46.132 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":86,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:15:46.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbcd0039cc0 msgr2=0x7fbcd003c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:46.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbcd0039cc0 0x7fbcd003c180 crc :-1 s=READY pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:46.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 msgr2=0x7fbcf0066e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:46.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 0x7fbcf0066e90 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fbcec0013e0 tx=0x7fbcf0067410).stop 2020-02-11T16:15:46.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3080215844 shutdown_connections 2020-02-11T16:15:46.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 --2- 172.21.15.88:0/3080215844 >> v2:172.21.15.88:3300/0 conn(0x7fbcf01455c0 0x7fbcf0145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:46.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbcd0039cc0 0x7fbcd003c180 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:46.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 --2- 172.21.15.88:0/3080215844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf01375e0 0x7fbcf0066e90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:46.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3080215844 >> 172.21.15.88:0/3080215844 conn(0x7fbcf009d110 msgr2=0x7fbcf0131280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:46.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3080215844 shutdown_connections 2020-02-11T16:15:46.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:46.131+0000 7fbcf7d1d700 1 -- 172.21.15.88:0/3080215844 wait complete. 2020-02-11T16:15:46.143 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":86,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:15:49.144 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:15:49.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.258+0000 7fb409a28700 1 Processor -- start 2020-02-11T16:15:49.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.258+0000 7fb409a28700 1 -- start start 2020-02-11T16:15:49.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.259+0000 7fb409a28700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb40412ffa0 0x7fb404141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.259+0000 7fb409a28700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4040a5560 con 0x7fb4040a4ec0 2020-02-11T16:15:49.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.259+0000 7fb409a28700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40409e060 con 0x7fb4040a7120 2020-02-11T16:15:49.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.259+0000 7fb409a28700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040a5350 con 0x7fb40412ffa0 2020-02-11T16:15:49.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.259+0000 7fb402ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb4040a7120 0x7fb4040a39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43294/0 (socket says 172.21.15.88:43294) 2020-02-11T16:15:49.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.259+0000 7fb402ffd700 1 -- 172.21.15.88:0/952079837 learned_addr learned my addr 172.21.15.88:0/952079837 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:15:49.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553810073 0 0) 0x7fb40409e060 con 0x7fb4040a7120 2020-02-11T16:15:49.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb4037fe700 1 --2- 172.21.15.88:0/952079837 >> v2:172.21.15.52:3300/0 conn(0x7fb40412ffa0 0x7fb404141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3e8003230 con 0x7fb4040a7120 2020-02-11T16:15:49.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 102326179 0 0) 0x7fb3e8003230 con 0x7fb4040a7120 2020-02-11T16:15:49.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 >> v2:172.21.15.52:3300/0 conn(0x7fb40412ffa0 msgr2=0x7fb404141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:49.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 --2- 172.21.15.88:0/952079837 >> v2:172.21.15.52:3300/0 conn(0x7fb40412ffa0 0x7fb404141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 >> v1:172.21.15.52:6789/0 conn(0x7fb4040a4ec0 legacy=0x7fb40412f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40409e300 con 0x7fb4040a7120 2020-02-11T16:15:49.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fb3f80016d0 con 0x7fb4040a7120 2020-02-11T16:15:49.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 >> v1:172.21.15.88:6789/0 conn(0x7fb4040a7120 legacy=0x7fb4040a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 0x7fb3e8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3e80044d0 0x7fb3e8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3e8004db0 0x7fb3e800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040a5350 con 0x7fb3e80044d0 2020-02-11T16:15:49.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80041c0 con 0x7fb3e8003720 2020-02-11T16:15:49.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e800bb80 con 0x7fb3e8004db0 2020-02-11T16:15:49.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb402ffd700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 0x7fb3e8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb4037fe700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3e8004db0 0x7fb3e800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb4027fc700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3e80044d0 0x7fb3e8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb402ffd700 1 -- 172.21.15.88:0/952079837 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3e8004db0 msgr2=0x7fb3e800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:49.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb402ffd700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3e8004db0 0x7fb3e800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb402ffd700 1 -- 172.21.15.88:0/952079837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3e80044d0 msgr2=0x7fb3e8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:49.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb402ffd700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3e80044d0 0x7fb3e8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb4037fe700 1 -- 172.21.15.88:0/952079837 reap_dead start 2020-02-11T16:15:49.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb402ffd700 1 -- 172.21.15.88:0/952079837 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8003230 con 0x7fb3e8003720 2020-02-11T16:15:49.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb4027fc700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3e80044d0 0x7fb3e8004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:15:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb402ffd700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 0x7fb3e8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb3e80054a0 tx=0x7fb4040a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb402ffd700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 0x7fb3e8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb3e80054a0 tx=0x7fb4040a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.260+0000 7fb402ffd700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 0x7fb3e8003b40 secure :-1 s=READY pgs=468 cs=0 l=1 rx=0x7fb3e80054a0 tx=0x7fb4040a11a0).ready entity=mon.1 client_cookie=69c4402dff93cc08 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb402ffd700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 0x7fb3e8003b40 secure :-1 s=THROTTLE_DONE pgs=468 cs=0 l=1 rx=0x7fb3e80054a0 tx=0x7fb4040a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb402ffd700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 0x7fb3e8003b40 secure :-1 s=THROTTLE_DONE pgs=468 cs=0 l=1 rx=0x7fb3e80054a0 tx=0x7fb4040a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb402ffd700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 0x7fb3e8003b40 secure :-1 s=THROTTLE_DONE pgs=468 cs=0 l=1 rx=0x7fb3e80054a0 tx=0x7fb4040a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3f800e160 con 0x7fb3e8003720 2020-02-11T16:15:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f800e2c0 con 0x7fb3e8003720 2020-02-11T16:15:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb401ffb700 1 -- 172.21.15.88:0/952079837 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3f80100b0 con 0x7fb3e8003720 2020-02-11T16:15:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb409a28700 1 -- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 msgr2=0x7fb3e8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb409a28700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 0x7fb3e8003b40 secure :-1 s=READY pgs=468 cs=0 l=1 rx=0x7fb3e80054a0 tx=0x7fb4040a11a0).stop 2020-02-11T16:15:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb409a28700 1 -- 172.21.15.88:0/952079837 shutdown_connections 2020-02-11T16:15:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb409a28700 1 --2- 172.21.15.88:0/952079837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e8003720 0x7fb3e8003b40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb409a28700 1 -- 172.21.15.88:0/952079837 >> 172.21.15.88:0/952079837 conn(0x7fb40409d110 msgr2=0x7fb40409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb409a28700 1 -- 172.21.15.88:0/952079837 shutdown_connections 2020-02-11T16:15:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.261+0000 7fb409a28700 1 -- 172.21.15.88:0/952079837 wait complete. 2020-02-11T16:15:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.262+0000 7fb409a28700 1 Processor -- start 2020-02-11T16:15:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.262+0000 7fb409a28700 1 -- start start 2020-02-11T16:15:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb409a28700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb40412b470 0x7fb40412a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb409a28700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4040a7770 con 0x7fb404133a40 2020-02-11T16:15:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb409a28700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4041312a0 con 0x7fb3e8003720 2020-02-11T16:15:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb409a28700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040a4780 con 0x7fb40412b470 2020-02-11T16:15:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb402ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb3e8003720 0x7fb404130b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43306/0 (socket says 172.21.15.88:43306) 2020-02-11T16:15:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb402ffd700 1 -- 172.21.15.88:0/887566173 learned_addr learned my addr 172.21.15.88:0/887566173 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:15:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> v2:172.21.15.88:3300/0 conn(0x7fb40412b470 0x7fb40412a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb4037fe700 1 -- 172.21.15.88:0/887566173 >> v1:172.21.15.88:6789/0 conn(0x7fb3e8003720 legacy=0x7fb404130b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb3f3fff700 1 -- 172.21.15.88:0/887566173 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245260713 0 0) 0x7fb4041312a0 con 0x7fb3e8003720 2020-02-11T16:15:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb4037fe700 1 -- 172.21.15.88:0/887566173 >> v1:172.21.15.52:6789/0 conn(0x7fb404133a40 legacy=0x7fb404129eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb4037fe700 1 -- 172.21.15.88:0/887566173 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404133ee0 con 0x7fb40412b470 2020-02-11T16:15:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> v2:172.21.15.88:3300/0 conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> v2:172.21.15.88:3300/0 conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=READY pgs=470 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb3f3fff700 1 -- 172.21.15.88:0/887566173 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3fc005e20 con 0x7fb40412b470 2020-02-11T16:15:49.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb3f3fff700 1 -- 172.21.15.88:0/887566173 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc011730 con 0x7fb40412b470 2020-02-11T16:15:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb409a28700 1 -- 172.21.15.88:0/887566173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb404130450 con 0x7fb40412b470 2020-02-11T16:15:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb3f3fff700 1 -- 172.21.15.88:0/887566173 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3fc011a90 con 0x7fb40412b470 2020-02-11T16:15:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.263+0000 7fb409a28700 1 -- 172.21.15.88:0/887566173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40412be80 con 0x7fb40412b470 2020-02-11T16:15:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.264+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.264+0000 7fb3f3fff700 1 -- 172.21.15.88:0/887566173 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb3fc011cc0 con 0x7fb40412b470 2020-02-11T16:15:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.264+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.264+0000 7fb3f3fff700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3e0039b90 0x7fb3e003c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.264+0000 7fb3f3fff700 1 -- 172.21.15.88:0/887566173 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb3fc049680 con 0x7fb40412b470 2020-02-11T16:15:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.264+0000 7fb409a28700 1 -- 172.21.15.88:0/887566173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4041308b0 con 0x7fb40412b470 2020-02-11T16:15:49.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.265+0000 7fb402ffd700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3e0039b90 0x7fb3e003c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.265+0000 7fb402ffd700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3e0039b90 0x7fb3e003c050 crc :-1 s=READY pgs=273 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.268+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.268+0000 7fb3f3fff700 1 -- 172.21.15.88:0/887566173 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb3fc02ed60 con 0x7fb40412b470 2020-02-11T16:15:49.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.448+0000 7fb409a28700 1 -- 172.21.15.88:0/887566173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb4040565b0 con 0x7fb40412b470 2020-02-11T16:15:49.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.449+0000 7fb4037fe700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.449+0000 7fb3f3fff700 1 -- 172.21.15.88:0/887566173 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7fb3fc0317d0 con 0x7fb40412b470 2020-02-11T16:15:49.452 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:15:49.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.450+0000 7fb409a28700 1 -- 172.21.15.88:0/887566173 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3e0039b90 msgr2=0x7fb3e003c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.450+0000 7fb409a28700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3e0039b90 0x7fb3e003c050 crc :-1 s=READY pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.450+0000 7fb409a28700 1 -- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 msgr2=0x7fb40412a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.450+0000 7fb409a28700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 0x7fb40412a5c0 secure :-1 s=READY pgs=470 cs=0 l=1 rx=0x7fb404135320 tx=0x7fb3fc010ec0).stop 2020-02-11T16:15:49.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.450+0000 7fb409a28700 1 -- 172.21.15.88:0/887566173 shutdown_connections 2020-02-11T16:15:49.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.450+0000 7fb409a28700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3e0039b90 0x7fb3e003c050 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.450+0000 7fb409a28700 1 --2- 172.21.15.88:0/887566173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40412b470 0x7fb40412a5c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.450+0000 7fb409a28700 1 -- 172.21.15.88:0/887566173 >> 172.21.15.88:0/887566173 conn(0x7fb40409d110 msgr2=0x7fb404069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:49.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.450+0000 7fb409a28700 1 -- 172.21.15.88:0/887566173 shutdown_connections 2020-02-11T16:15:49.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.450+0000 7fb409a28700 1 -- 172.21.15.88:0/887566173 wait complete. 2020-02-11T16:15:49.463 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":90,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:15:49.463 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:15:49.463 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:15:49.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.567+0000 7f6b1eef6700 1 Processor -- start 2020-02-11T16:15:49.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.567+0000 7f6b1eef6700 1 -- start start 2020-02-11T16:15:49.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b1eef6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b180a2fa0 0x7f6b180a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b1eef6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b180a5410 0x7f6b180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b1eef6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6b18131280 0x7f6b181316d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b1eef6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b180a1e60 con 0x7f6b180a2fa0 2020-02-11T16:15:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b1eef6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b180a3450 con 0x7f6b180a5410 2020-02-11T16:15:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b1eef6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180a4350 con 0x7f6b18131280 2020-02-11T16:15:49.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b180a5410 0x7f6b180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b180a5410 0x7f6b180a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55688/0 (socket says 172.21.15.88:55688) 2020-02-11T16:15:49.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 -- 172.21.15.88:0/3179175351 learned_addr learned my addr 172.21.15.88:0/3179175351 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:49.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b1d493700 1 --2- 172.21.15.88:0/3179175351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6b18131280 0x7f6b181316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/3179175351 >> v2:172.21.15.52:3300/0 conn(0x7f6b180a2fa0 0x7f6b180a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 -- 172.21.15.88:0/3179175351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6b18131280 msgr2=0x7f6b181316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:49.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 --2- 172.21.15.88:0/3179175351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6b18131280 0x7f6b181316d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 -- 172.21.15.88:0/3179175351 >> v2:172.21.15.52:3300/0 conn(0x7f6b180a2fa0 msgr2=0x7f6b180a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 --2- 172.21.15.88:0/3179175351 >> v2:172.21.15.52:3300/0 conn(0x7f6b180a2fa0 0x7f6b180a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 -- 172.21.15.88:0/3179175351 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180a3a40 con 0x7f6b180a5410 2020-02-11T16:15:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/3179175351 >> v2:172.21.15.52:3300/0 conn(0x7f6b180a2fa0 0x7f6b180a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:15:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 --2- 172.21.15.88:0/3179175351 >> v2:172.21.15.88:3300/0 conn(0x7f6b180a5410 0x7f6b180a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b0c002f30 tx=0x7f6b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 --2- 172.21.15.88:0/3179175351 >> v2:172.21.15.88:3300/0 conn(0x7f6b180a5410 0x7f6b180a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b0c002f30 tx=0x7f6b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 --2- 172.21.15.88:0/3179175351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b180a5410 0x7f6b180a5870 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7f6b0c002f30 tx=0x7f6b0c007a40).ready entity=mon.1 client_cookie=d8627bfc71ed7aef server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 --2- 172.21.15.88:0/3179175351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b180a5410 0x7f6b180a5870 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f6b0c002f30 tx=0x7f6b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 --2- 172.21.15.88:0/3179175351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b180a5410 0x7f6b180a5870 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f6b0c002f30 tx=0x7f6b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b177fe700 1 -- 172.21.15.88:0/3179175351 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c009e40 con 0x7f6b180a5410 2020-02-11T16:15:49.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b17fff700 1 --2- 172.21.15.88:0/3179175351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b180a5410 0x7f6b180a5870 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f6b0c002f30 tx=0x7f6b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.568+0000 7f6b177fe700 1 -- 172.21.15.88:0/3179175351 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c012a20 con 0x7f6b180a5410 2020-02-11T16:15:49.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.569+0000 7f6b177fe700 1 -- 172.21.15.88:0/3179175351 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c012e00 con 0x7f6b180a5410 2020-02-11T16:15:49.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.569+0000 7f6b1eef6700 1 -- 172.21.15.88:0/3179175351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b180a5410 msgr2=0x7f6b180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.569+0000 7f6b1eef6700 1 --2- 172.21.15.88:0/3179175351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b180a5410 0x7f6b180a5870 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7f6b0c002f30 tx=0x7f6b0c007a40).stop 2020-02-11T16:15:49.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.569+0000 7f6b1eef6700 1 -- 172.21.15.88:0/3179175351 shutdown_connections 2020-02-11T16:15:49.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.569+0000 7f6b1eef6700 1 --2- 172.21.15.88:0/3179175351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6b18131280 0x7f6b181316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.569+0000 7f6b1eef6700 1 --2- 172.21.15.88:0/3179175351 >> v2:172.21.15.52:3300/0 conn(0x7f6b180a2fa0 0x7f6b180a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.569+0000 7f6b1eef6700 1 --2- 172.21.15.88:0/3179175351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b180a5410 0x7f6b180a5870 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.569+0000 7f6b1eef6700 1 -- 172.21.15.88:0/3179175351 >> 172.21.15.88:0/3179175351 conn(0x7f6b1809d110 msgr2=0x7f6b1809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:49.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.569+0000 7f6b1eef6700 1 -- 172.21.15.88:0/3179175351 shutdown_connections 2020-02-11T16:15:49.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.569+0000 7f6b1eef6700 1 -- 172.21.15.88:0/3179175351 wait complete. 2020-02-11T16:15:49.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.570+0000 7f6b1eef6700 1 Processor -- start 2020-02-11T16:15:49.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.570+0000 7f6b1eef6700 1 -- start start 2020-02-11T16:15:49.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1eef6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b180a2fa0 0x7f6b18137d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1eef6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6b180a5410 0x7f6b180a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1eef6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b18131280 0x7f6b180a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1eef6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b181309e0 con 0x7f6b180a2fa0 2020-02-11T16:15:49.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1eef6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b18138230 con 0x7f6b18131280 2020-02-11T16:15:49.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1eef6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1809e510 con 0x7f6b180a5410 2020-02-11T16:15:49.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b18131280 0x7f6b180a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b18131280 0x7f6b180a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55696/0 (socket says 172.21.15.88:55696) 2020-02-11T16:15:49.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 -- 172.21.15.88:0/2168152870 learned_addr learned my addr 172.21.15.88:0/2168152870 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:49.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> v2:172.21.15.52:3300/0 conn(0x7f6b180a2fa0 0x7f6b18137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b17fff700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6b180a5410 0x7f6b180a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 -- 172.21.15.88:0/2168152870 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6b180a5410 msgr2=0x7f6b180a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6b180a5410 0x7f6b180a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 -- 172.21.15.88:0/2168152870 >> v2:172.21.15.52:3300/0 conn(0x7f6b180a2fa0 msgr2=0x7f6b18137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 --2- 172.21.15.88:0/2168152870 >> v2:172.21.15.52:3300/0 conn(0x7f6b180a2fa0 0x7f6b18137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 -- 172.21.15.88:0/2168152870 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1809def0 con 0x7f6b18131280 2020-02-11T16:15:49.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 --2- 172.21.15.88:0/2168152870 >> v2:172.21.15.88:3300/0 conn(0x7f6b18131280 0x7f6b180a09a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b100032b0 tx=0x7f6b10010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 --2- 172.21.15.88:0/2168152870 >> v2:172.21.15.88:3300/0 conn(0x7f6b18131280 0x7f6b180a09a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b100032b0 tx=0x7f6b10010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18131280 0x7f6b180a09a0 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7f6b100032b0 tx=0x7f6b10010e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18131280 0x7f6b180a09a0 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7f6b100032b0 tx=0x7f6b10010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b100103f0 con 0x7f6b18131280 2020-02-11T16:15:49.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18131280 0x7f6b180a09a0 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7f6b100032b0 tx=0x7f6b10010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1d493700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18131280 0x7f6b180a09a0 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7f6b100032b0 tx=0x7f6b10010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1000ea50 con 0x7f6b18131280 2020-02-11T16:15:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1eef6700 1 -- 172.21.15.88:0/2168152870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1809e9b0 con 0x7f6b18131280 2020-02-11T16:15:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b1000ee30 con 0x7f6b18131280 2020-02-11T16:15:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.571+0000 7f6b1eef6700 1 -- 172.21.15.88:0/2168152870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18134230 con 0x7f6b18131280 2020-02-11T16:15:49.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.572+0000 7f6b1d493700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18131280 0x7f6b180a09a0 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7f6b100032b0 tx=0x7f6b10010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.572+0000 7f6b1eef6700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 0x7f6b181336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.572+0000 7f6b1eef6700 1 -- 172.21.15.88:0/2168152870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1805e2f0 con 0x7f6b181301a0 2020-02-11T16:15:49.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.572+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6b10005a40 con 0x7f6b18131280 2020-02-11T16:15:49.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.572+0000 7f6b1d493700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18131280 0x7f6b180a09a0 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7f6b100032b0 tx=0x7f6b10010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.572+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 0x7f6b181336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.572+0000 7f6b15ffb700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6af8039ca0 0x7f6af803c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.572+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6b10049f80 con 0x7f6b18131280 2020-02-11T16:15:49.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b1cc92700 1 -- 172.21.15.88:0/2168152870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b1805ac30 con 0x7f6b181301a0 2020-02-11T16:15:49.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 0x7f6b181336e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b17fff700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6af8039ca0 0x7f6af803c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 0x7f6b181336e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 0x7f6b181336e0 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 0x7f6b181336e0 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b08005ab0 con 0x7f6b181301a0 2020-02-11T16:15:49.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b17fff700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6af8039ca0 0x7f6af803c160 crc :-1 s=READY pgs=274 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 0x7f6b181336e0 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6b08005c10 con 0x7f6b181301a0 2020-02-11T16:15:49.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 msgr2=0x7f6b181336e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b15ffb700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 0x7f6b181336e0 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).stop 2020-02-11T16:15:49.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 msgr2=0x7f6b181336e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:15:49.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.573+0000 7f6b15ffb700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b181301a0 0x7f6b181336e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.581+0000 7f6b1eef6700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 0x7f6b18140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.581+0000 7f6b1eef6700 1 -- 172.21.15.88:0/2168152870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1809e710 con 0x7f6b18140b00 2020-02-11T16:15:49.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.581+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 0x7f6b18140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1cc92700 1 -- 172.21.15.88:0/2168152870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6b180565b0 con 0x7f6b18140b00 2020-02-11T16:15:49.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 0x7f6b18140f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 0x7f6b18140f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 0x7f6b18140f10 secure :-1 s=READY pgs=474 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 0x7f6b18140f10 secure :-1 s=THROTTLE_DONE pgs=474 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b08015c40 con 0x7f6b18140b00 2020-02-11T16:15:49.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1cc92700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 0x7f6b18140f10 secure :-1 s=THROTTLE_DONE pgs=474 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7f6b0800a430 con 0x7f6b18140b00 2020-02-11T16:15:49.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 msgr2=0x7f6b18140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b15ffb700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 0x7f6b18140f10 secure :-1 s=READY pgs=474 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).stop 2020-02-11T16:15:49.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b15ffb700 1 -- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 msgr2=0x7f6b18140f10 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:15:49.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b15ffb700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18140b00 0x7f6b18140f10 secure :-1 s=CLOSED pgs=474 cs=0 l=1 rx=0x7f6b08002f30 tx=0x7f6b08010c90).stop 2020-02-11T16:15:49.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1eef6700 1 -- 172.21.15.88:0/2168152870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6af8039ca0 msgr2=0x7f6af803c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1eef6700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6af8039ca0 0x7f6af803c160 crc :-1 s=READY pgs=274 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1eef6700 1 -- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18131280 msgr2=0x7f6b180a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1eef6700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18131280 0x7f6b180a09a0 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7f6b100032b0 tx=0x7f6b10010e10).stop 2020-02-11T16:15:49.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1d493700 1 -- 172.21.15.88:0/2168152870 reap_dead start 2020-02-11T16:15:49.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1eef6700 1 -- 172.21.15.88:0/2168152870 shutdown_connections 2020-02-11T16:15:49.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1eef6700 1 --2- 172.21.15.88:0/2168152870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18131280 0x7f6b180a09a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1eef6700 1 -- 172.21.15.88:0/2168152870 >> 172.21.15.88:0/2168152870 conn(0x7f6b1809d110 msgr2=0x7f6b18069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:49.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1eef6700 1 -- 172.21.15.88:0/2168152870 shutdown_connections 2020-02-11T16:15:49.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.582+0000 7f6b1eef6700 1 -- 172.21.15.88:0/2168152870 wait complete. 2020-02-11T16:15:49.613 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:15:49.613 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:15:49.613 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:15:49.613 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:15:49.614 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 90, 2020-02-11T16:15:49.614 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:15:49.614 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:15:49.614 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:15:49.615 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:15:49.615 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.615 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2020-02-11T16:15:49.615 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:15:49.615 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:15:49.616 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:15:49.616 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:49.616 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:49.617 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:49.617 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:49.617 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:49.617 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:49.618 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.618 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:15:49.618 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:15:49.618 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:49.618 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:49.619 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:49.619 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:49.619 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:49.619 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:49.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.620 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:15:49.620 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:15:49.621 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:15:49.621 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:15:49.621 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:15:49.621 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:15:49.621 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:15:49.622 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:15:49.622 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:15:49.622 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:15:49.622 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:15:49.623 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:15:49.623 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:49.623 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:49.623 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:49.623 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:49.623 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:49.624 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:49.624 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.624 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:15:49.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.625 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:15:49.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.625 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:15:49.625 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:15:49.626 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:49.626 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:49.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.626 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:49.626 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:15:49.627 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.627 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:49.628 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:15:49.628 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.628 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.629 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:15:49.629 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:15:49.629 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:49.630 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:49.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.630 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:15:49.631 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:15:49.631 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:49.631 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:49.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.632 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:49.632 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:15:49.632 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.633 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:49.633 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:15:49.633 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.633 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.633 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.634 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:15:49.634 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:15:49.634 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:49.635 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:49.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.635 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:15:49.635 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:15:49.636 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:49.636 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:49.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.636 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:49.637 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:15:49.637 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.638 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:49.638 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:15:49.638 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.638 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.639 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.639 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:15:49.639 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:15:49.640 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:49.640 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:49.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.646 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.646 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:15:49.646 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:15:49.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.647 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:49.647 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:49.647 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:15:49.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.647 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.647 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:15:49.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.648 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:49.648 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:49.648 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:15:49.648 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.648 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.648 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:15:49.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.649 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:49.649 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:49.649 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:15:49.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.649 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.650 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:15:49.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.650 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:49.650 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:49.650 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:15:49.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.650 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.651 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:15:49.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.651 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:49.651 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:49.652 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:15:49.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.652 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.652 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:15:49.653 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:15:49.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.756+0000 7f3b3d083700 1 Processor -- start 2020-02-11T16:15:49.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.757+0000 7f3b3d083700 1 -- start start 2020-02-11T16:15:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.757+0000 7f3b3d083700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b380a7120 0x7f3b380a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.757+0000 7f3b3d083700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b380a5320 con 0x7f3b380a3e70 2020-02-11T16:15:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.757+0000 7f3b3d083700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b380a5560 con 0x7f3b380a39e0 2020-02-11T16:15:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.757+0000 7f3b3d083700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3809e7a0 con 0x7f3b380a7120 2020-02-11T16:15:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.757+0000 7f3b36d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b380a7120 0x7f3b380a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.757+0000 7f3b36d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b380a7120 0x7f3b380a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55704/0 (socket says 172.21.15.88:55704) 2020-02-11T16:15:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b36d9d700 1 -- 172.21.15.88:0/2648529162 learned_addr learned my addr 172.21.15.88:0/2648529162 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.757+0000 7f3b3659c700 1 --1- 172.21.15.88:0/2648529162 >> v1:172.21.15.88:6789/0 conn(0x7f3b380a39e0 0x7f3b3812f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43330/0 (socket says 172.21.15.88:43330) 2020-02-11T16:15:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b36d9d700 1 -- 172.21.15.88:0/2648529162 >> v1:172.21.15.88:6789/0 conn(0x7f3b380a39e0 legacy=0x7f3b3812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b36d9d700 1 -- 172.21.15.88:0/2648529162 >> v1:172.21.15.52:6789/0 conn(0x7f3b380a3e70 legacy=0x7f3b38140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b35d9b700 1 -- 172.21.15.88:0/2648529162 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018563408 0 0) 0x7f3b380a5560 con 0x7f3b380a39e0 2020-02-11T16:15:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b36d9d700 1 -- 172.21.15.88:0/2648529162 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3809e060 con 0x7f3b380a7120 2020-02-11T16:15:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/2648529162 >> v2:172.21.15.88:3300/0 conn(0x7f3b380a7120 0x7f3b380a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b2c002f30 tx=0x7f3b2c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/2648529162 >> v2:172.21.15.88:3300/0 conn(0x7f3b380a7120 0x7f3b380a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b2c002f30 tx=0x7f3b2c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/2648529162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a7120 0x7f3b380a4ec0 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b2c0088e0).ready entity=mon.1 client_cookie=f1f6c6f13926e0a4 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/2648529162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a7120 0x7f3b380a4ec0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b2c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b35d9b700 1 -- 172.21.15.88:0/2648529162 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b2c011760 con 0x7f3b380a7120 2020-02-11T16:15:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/2648529162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a7120 0x7f3b380a4ec0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b2c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b35d9b700 1 -- 172.21.15.88:0/2648529162 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c0118c0 con 0x7f3b380a7120 2020-02-11T16:15:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/2648529162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a7120 0x7f3b380a4ec0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b2c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b3d083700 1 -- 172.21.15.88:0/2648529162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a7120 msgr2=0x7f3b380a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b35d9b700 1 -- 172.21.15.88:0/2648529162 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b2c011ca0 con 0x7f3b380a7120 2020-02-11T16:15:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.758+0000 7f3b3d083700 1 --2- 172.21.15.88:0/2648529162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a7120 0x7f3b380a4ec0 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b2c0088e0).stop 2020-02-11T16:15:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.759+0000 7f3b3d083700 1 -- 172.21.15.88:0/2648529162 shutdown_connections 2020-02-11T16:15:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.759+0000 7f3b3d083700 1 --2- 172.21.15.88:0/2648529162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a7120 0x7f3b380a4ec0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.759+0000 7f3b3d083700 1 -- 172.21.15.88:0/2648529162 >> 172.21.15.88:0/2648529162 conn(0x7f3b3809d110 msgr2=0x7f3b3809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.759+0000 7f3b3d083700 1 -- 172.21.15.88:0/2648529162 shutdown_connections 2020-02-11T16:15:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.759+0000 7f3b3d083700 1 -- 172.21.15.88:0/2648529162 wait complete. 2020-02-11T16:15:49.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.759+0000 7f3b3d083700 1 Processor -- start 2020-02-11T16:15:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b3d083700 1 -- start start 2020-02-11T16:15:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b3d083700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b380a39e0 0x7f3b38136110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b3d083700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b380a7120 0x7f3b38127c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b3d083700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b38134db0 con 0x7f3b380a3e70 2020-02-11T16:15:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b3d083700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b38134fe0 con 0x7f3b380a39e0 2020-02-11T16:15:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b3d083700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38135410 con 0x7f3b380a7120 2020-02-11T16:15:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b36d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b380a39e0 0x7f3b38136110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b36d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b380a39e0 0x7f3b38136110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55708/0 (socket says 172.21.15.88:55708) 2020-02-11T16:15:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b36d9d700 1 -- 172.21.15.88:0/3712328125 learned_addr learned my addr 172.21.15.88:0/3712328125 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b3759e700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b380a7120 0x7f3b38127c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b36d9d700 1 -- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b380a7120 msgr2=0x7f3b38127c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b380a7120 0x7f3b38127c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b36d9d700 1 -- 172.21.15.88:0/3712328125 >> v1:172.21.15.52:6789/0 conn(0x7f3b380a3e70 legacy=0x7f3b38127510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b36d9d700 1 -- 172.21.15.88:0/3712328125 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b381356b0 con 0x7f3b380a39e0 2020-02-11T16:15:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b3759e700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b380a7120 0x7f3b38127c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:15:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.760+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/3712328125 >> v2:172.21.15.88:3300/0 conn(0x7f3b380a39e0 0x7f3b38136110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b380a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/3712328125 >> v2:172.21.15.88:3300/0 conn(0x7f3b380a39e0 0x7f3b38136110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b380a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a39e0 0x7f3b38136110 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b380a11a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a39e0 0x7f3b38136110 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b380a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b2c007340 con 0x7f3b380a39e0 2020-02-11T16:15:49.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a39e0 0x7f3b38136110 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b380a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a39e0 0x7f3b38136110 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b380a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c0074a0 con 0x7f3b380a39e0 2020-02-11T16:15:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b3d083700 1 -- 172.21.15.88:0/3712328125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b38135950 con 0x7f3b380a39e0 2020-02-11T16:15:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b2c0058b0 con 0x7f3b380a39e0 2020-02-11T16:15:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b3d083700 1 -- 172.21.15.88:0/3712328125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b38139790 con 0x7f3b380a39e0 2020-02-11T16:15:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a39e0 0x7f3b38136110 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b380a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b3d083700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 0x7f3b3805aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.761+0000 7f3b3d083700 1 -- 172.21.15.88:0/3712328125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3805e2f0 con 0x7f3b38136570 2020-02-11T16:15:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3b2c005b20 con 0x7f3b380a39e0 2020-02-11T16:15:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b36d9d700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a39e0 0x7f3b38136110 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b380a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 0x7f3b3805aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b27fff700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b14039d20 0x7f3b1403c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3b2c04a3b0 con 0x7f3b380a39e0 2020-02-11T16:15:49.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b3659c700 1 -- 172.21.15.88:0/3712328125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b380565b0 con 0x7f3b38136570 2020-02-11T16:15:49.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b3759e700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b14039d20 0x7f3b1403c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 0x7f3b3805aa30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 0x7f3b3805aa30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 0x7f3b3805aa30 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b3759e700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b14039d20 0x7f3b1403c1e0 crc :-1 s=READY pgs=275 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 0x7f3b3805aa30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.762+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b28010440 con 0x7f3b38136570 2020-02-11T16:15:49.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.763+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 0x7f3b3805aa30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.763+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f3b2800ca80 con 0x7f3b38136570 2020-02-11T16:15:49.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.763+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 msgr2=0x7f3b3805aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.763+0000 7f3b27fff700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 0x7f3b3805aa30 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).stop 2020-02-11T16:15:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.763+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 msgr2=0x7f3b3805aa30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:15:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.763+0000 7f3b27fff700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b38136570 0x7f3b3805aa30 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).stop 2020-02-11T16:15:49.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.770+0000 7f3b3d083700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 0x7f3b3812d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.770+0000 7f3b3d083700 1 -- 172.21.15.88:0/3712328125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38135550 con 0x7f3b3812d2b0 2020-02-11T16:15:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.771+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 0x7f3b3812d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.771+0000 7f3b3659c700 1 -- 172.21.15.88:0/3712328125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3b38136980 con 0x7f3b3812d2b0 2020-02-11T16:15:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.771+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 0x7f3b3812d690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.771+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 0x7f3b3812d690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.771+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 0x7f3b3812d690 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 0x7f3b3812d690 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b2800fe30 con 0x7f3b3812d2b0 2020-02-11T16:15:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3659c700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 0x7f3b3812d690 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7f3b2800d4c0 con 0x7f3b3812d2b0 2020-02-11T16:15:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 msgr2=0x7f3b3812d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b27fff700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 0x7f3b3812d690 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).stop 2020-02-11T16:15:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b27fff700 1 -- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 msgr2=0x7f3b3812d690 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:15:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b27fff700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3812d2b0 0x7f3b3812d690 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0x7f3b38133a00 tx=0x7f3b2800c530).stop 2020-02-11T16:15:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3d083700 1 -- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b14039d20 msgr2=0x7f3b1403c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3d083700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b14039d20 0x7f3b1403c1e0 crc :-1 s=READY pgs=275 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3d083700 1 -- 172.21.15.88:0/3712328125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a39e0 msgr2=0x7f3b38136110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3d083700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a39e0 0x7f3b38136110 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f3b2c002f30 tx=0x7f3b380a11a0).stop 2020-02-11T16:15:49.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3759e700 1 -- 172.21.15.88:0/3712328125 reap_dead start 2020-02-11T16:15:49.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3d083700 1 -- 172.21.15.88:0/3712328125 shutdown_connections 2020-02-11T16:15:49.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3d083700 1 --2- 172.21.15.88:0/3712328125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b380a39e0 0x7f3b38136110 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3d083700 1 -- 172.21.15.88:0/3712328125 >> 172.21.15.88:0/3712328125 conn(0x7f3b3809d110 msgr2=0x7f3b38069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:49.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3d083700 1 -- 172.21.15.88:0/3712328125 shutdown_connections 2020-02-11T16:15:49.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.772+0000 7f3b3d083700 1 -- 172.21.15.88:0/3712328125 wait complete. 2020-02-11T16:15:49.789 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:15:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:15:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:15:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:15:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 90, 2020-02-11T16:15:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:15:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:15:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:15:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:15:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2020-02-11T16:15:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:15:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:15:49.791 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:15:49.791 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:49.791 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:15:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:15:49.793 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:49.793 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:49.793 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:49.793 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:49.793 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:49.793 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:49.793 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.794 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:15:49.794 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:15:49.794 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:15:49.794 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:15:49.794 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:15:49.795 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:15:49.795 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:15:49.795 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:15:49.795 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:15:49.795 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:15:49.795 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:15:49.796 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:15:49.796 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:49.796 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:49.796 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:49.796 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:49.796 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:49.797 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:49.797 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.797 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:15:49.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.797 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:15:49.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.798 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:15:49.798 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:15:49.798 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:49.798 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:49.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.798 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:49.798 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:15:49.799 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.799 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:49.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:15:49.800 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.800 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.800 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:15:49.800 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:15:49.801 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:49.801 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:49.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.801 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:15:49.801 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:15:49.801 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:49.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:49.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.802 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:49.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:15:49.802 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.803 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:49.803 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:15:49.803 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.804 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.804 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.804 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:15:49.804 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:15:49.804 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:49.805 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:49.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.805 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:15:49.805 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:15:49.805 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:49.806 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:49.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.806 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:49.806 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:15:49.806 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.807 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:49.807 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:15:49.807 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.807 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.807 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.808 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:15:49.808 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:15:49.808 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:49.808 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:49.809 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.809 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.809 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:15:49.809 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:15:49.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.810 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:49.810 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:49.810 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:15:49.810 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.810 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.810 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:15:49.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.810 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:49.811 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:49.811 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:15:49.811 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.811 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.811 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.812 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:15:49.812 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:15:49.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.916+0000 7f1c5ed5f700 1 Processor -- start 2020-02-11T16:15:49.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.916+0000 7f1c5ed5f700 1 -- start start 2020-02-11T16:15:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.916+0000 7f1c5ed5f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c580a2fa0 0x7f1c580a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.916+0000 7f1c5ed5f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c580a5410 0x7f1c580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.916+0000 7f1c5ed5f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c580a4350 con 0x7f1c58131280 2020-02-11T16:15:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.916+0000 7f1c5ed5f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c580a1e60 con 0x7f1c580a2fa0 2020-02-11T16:15:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.916+0000 7f1c5ed5f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580a3450 con 0x7f1c580a5410 2020-02-11T16:15:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c5d2fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1c58131280 0x7f1c581316f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43346/0 (socket says 172.21.15.88:43346) 2020-02-11T16:15:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c5d2fc700 1 -- 172.21.15.88:0/934589905 learned_addr learned my addr 172.21.15.88:0/934589905 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:15:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c57fff700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c580a5410 0x7f1c580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c5cafb700 1 --2- 172.21.15.88:0/934589905 >> v2:172.21.15.52:3300/0 conn(0x7f1c580a2fa0 0x7f1c580a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252287176 0 0) 0x7f1c580a4350 con 0x7f1c58131280 2020-02-11T16:15:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c44003230 con 0x7f1c58131280 2020-02-11T16:15:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 817697430 0 0) 0x7f1c44003230 con 0x7f1c58131280 2020-02-11T16:15:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c580a5410 msgr2=0x7f1c580a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c580a5410 0x7f1c580a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 >> v2:172.21.15.52:3300/0 conn(0x7f1c580a2fa0 msgr2=0x7f1c580a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 --2- 172.21.15.88:0/934589905 >> v2:172.21.15.52:3300/0 conn(0x7f1c580a2fa0 0x7f1c580a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c580a3a40 con 0x7f1c58131280 2020-02-11T16:15:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f1c480016d0 con 0x7f1c58131280 2020-02-11T16:15:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 >> v1:172.21.15.88:6789/0 conn(0x7f1c58131280 legacy=0x7f1c581316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c44003720 0x7f1c44003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c580a5410 0x7f1c440044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c44004930 0x7f1c44004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:49.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580a1e60 con 0x7f1c44003720 2020-02-11T16:15:49.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c44005300 con 0x7f1c44004930 2020-02-11T16:15:49.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c440040f0 con 0x7f1c580a5410 2020-02-11T16:15:49.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c44004930 0x7f1c44004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c5cafb700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c44003720 0x7f1c44003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c57fff700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c580a5410 0x7f1c440044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.917+0000 7f1c5d2fc700 1 -- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c580a5410 msgr2=0x7f1c440044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:49.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c580a5410 0x7f1c440044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 -- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c44003720 msgr2=0x7f1c44003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:49.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c44003720 0x7f1c44003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:49.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 -- 172.21.15.88:0/934589905 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44003230 con 0x7f1c44004930 2020-02-11T16:15:49.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c44004930 0x7f1c44004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c480013e0 tx=0x7f1c58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c44004930 0x7f1c44004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c480013e0 tx=0x7f1c58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c44004930 0x7f1c44004db0 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7f1c480013e0 tx=0x7f1c58067410).ready entity=mon.1 client_cookie=b36fc9f412ab01c7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c44004930 0x7f1c44004db0 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7f1c480013e0 tx=0x7f1c58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c44004930 0x7f1c44004db0 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7f1c480013e0 tx=0x7f1c58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4800e160 con 0x7f1c44004930 2020-02-11T16:15:49.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c44004930 0x7f1c44004db0 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7f1c480013e0 tx=0x7f1c58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4800e2c0 con 0x7f1c44004930 2020-02-11T16:15:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c577fe700 1 -- 172.21.15.88:0/934589905 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4800e660 con 0x7f1c44004930 2020-02-11T16:15:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/934589905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c44004930 msgr2=0x7f1c44004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5ed5f700 1 --2- 172.21.15.88:0/934589905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c44004930 0x7f1c44004db0 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7f1c480013e0 tx=0x7f1c58067410).stop 2020-02-11T16:15:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5d2fc700 1 -- 172.21.15.88:0/934589905 reap_dead start 2020-02-11T16:15:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/934589905 shutdown_connections 2020-02-11T16:15:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/934589905 >> 172.21.15.88:0/934589905 conn(0x7f1c5809d110 msgr2=0x7f1c5809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/934589905 shutdown_connections 2020-02-11T16:15:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.918+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/934589905 wait complete. 2020-02-11T16:15:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.919+0000 7f1c5ed5f700 1 Processor -- start 2020-02-11T16:15:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.919+0000 7f1c5ed5f700 1 -- start start 2020-02-11T16:15:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5ed5f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c58133c80 0x7f1c580a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5ed5f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c581260a0 con 0x7f1c581402c0 2020-02-11T16:15:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5ed5f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c580a0e10 con 0x7f1c58140720 2020-02-11T16:15:49.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5ed5f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5813fb80 con 0x7f1c58133c80 2020-02-11T16:15:49.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5cafb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c58133c80 0x7f1c580a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5cafb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c58133c80 0x7f1c580a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55730/0 (socket says 172.21.15.88:55730) 2020-02-11T16:15:49.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5cafb700 1 -- 172.21.15.88:0/998325014 learned_addr learned my addr 172.21.15.88:0/998325014 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:49.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5d2fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1c58140720 0x7f1c5814d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43360/0 (socket says 172.21.15.88:43360) 2020-02-11T16:15:49.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5cafb700 1 -- 172.21.15.88:0/998325014 >> v1:172.21.15.88:6789/0 conn(0x7f1c58140720 legacy=0x7f1c5814d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5cafb700 1 -- 172.21.15.88:0/998325014 >> v1:172.21.15.52:6789/0 conn(0x7f1c581402c0 legacy=0x7f1c58146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183185979 0 0) 0x7f1c580a0e10 con 0x7f1c58140720 2020-02-11T16:15:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5cafb700 1 -- 172.21.15.88:0/998325014 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5813fe20 con 0x7f1c58133c80 2020-02-11T16:15:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5cafb700 1 --2- 172.21.15.88:0/998325014 >> v2:172.21.15.88:3300/0 conn(0x7f1c58133c80 0x7f1c580a0620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c50007d80 tx=0x7f1c50010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5cafb700 1 --2- 172.21.15.88:0/998325014 >> v2:172.21.15.88:3300/0 conn(0x7f1c58133c80 0x7f1c580a0620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c50007d80 tx=0x7f1c50010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5cafb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c58133c80 0x7f1c580a0620 secure :-1 s=READY pgs=481 cs=0 l=1 rx=0x7f1c50007d80 tx=0x7f1c50010ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c5cafb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c58133c80 0x7f1c580a0620 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7f1c50007d80 tx=0x7f1c50010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.920+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c50005e20 con 0x7f1c58133c80 2020-02-11T16:15:49.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c5cafb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c58133c80 0x7f1c580a0620 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7f1c50007d80 tx=0x7f1c50010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c5cafb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c58133c80 0x7f1c580a0620 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7f1c50007d80 tx=0x7f1c50010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c500117e0 con 0x7f1c58133c80 2020-02-11T16:15:49.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/998325014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c58134240 con 0x7f1c58133c80 2020-02-11T16:15:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c50011c00 con 0x7f1c58133c80 2020-02-11T16:15:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/998325014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c581464e0 con 0x7f1c58133c80 2020-02-11T16:15:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c5cafb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c58133c80 0x7f1c580a0620 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7f1c50007d80 tx=0x7f1c50010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c5ed5f700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 0x7f1c58124380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/998325014 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580a0cc0 con 0x7f1c58129a00 2020-02-11T16:15:49.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f1c50008700 con 0x7f1c58133c80 2020-02-11T16:15:49.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c5cafb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c58133c80 0x7f1c580a0620 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7f1c50007d80 tx=0x7f1c50010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.921+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 0x7f1c58124380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c55ffb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c38039b00 0x7f1c3803bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f1c500498e0 con 0x7f1c58133c80 2020-02-11T16:15:49.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c38039b00 0x7f1c3803bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c57fff700 1 -- 172.21.15.88:0/998325014 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c5813ffb0 con 0x7f1c58129a00 2020-02-11T16:15:49.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 0x7f1c58124380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c00c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 0x7f1c58124380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c00c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 0x7f1c58124380 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c00c2c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c5d2fc700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c38039b00 0x7f1c3803bfc0 crc :-1 s=READY pgs=276 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 0x7f1c58124380 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c00c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4c005e90 con 0x7f1c58129a00 2020-02-11T16:15:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 0x7f1c58124380 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c00c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f1c4c007160 con 0x7f1c58129a00 2020-02-11T16:15:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 msgr2=0x7f1c58124380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.922+0000 7f1c55ffb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 0x7f1c58124380 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c00c2c0).stop 2020-02-11T16:15:49.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.923+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 msgr2=0x7f1c58124380 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:15:49.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.923+0000 7f1c55ffb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c58129a00 0x7f1c58124380 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.930+0000 7f1c5ed5f700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 0x7f1c58124bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:49.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.930+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/998325014 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5805e2f0 con 0x7f1c581247e0 2020-02-11T16:15:49.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.931+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 0x7f1c58124bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:49.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.931+0000 7f1c57fff700 1 -- 172.21.15.88:0/998325014 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1c580565b0 con 0x7f1c581247e0 2020-02-11T16:15:49.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.931+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 0x7f1c58124bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c012120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.931+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 0x7f1c58124bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c012120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.931+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 0x7f1c58124bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c012120).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:49.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 0x7f1c58124bf0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c012120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4c008770 con 0x7f1c581247e0 2020-02-11T16:15:49.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c57fff700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 0x7f1c58124bf0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c012120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:49.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3849 (secure 0 0 0) 0x7f1c4c0088d0 con 0x7f1c581247e0 2020-02-11T16:15:49.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 msgr2=0x7f1c58124bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c55ffb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 0x7f1c58124bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f1c580a87a0 tx=0x7f1c4c012120).stop 2020-02-11T16:15:49.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c55ffb700 1 -- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 msgr2=0x7f1c58124bf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:15:49.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c55ffb700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1c581247e0 0x7f1c58124bf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c38039b00 msgr2=0x7f1c3803bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5ed5f700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1c38039b00 0x7f1c3803bfc0 crc :-1 s=READY pgs=276 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/998325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c58133c80 msgr2=0x7f1c580a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:49.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5ed5f700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c58133c80 0x7f1c580a0620 secure :-1 s=READY pgs=481 cs=0 l=1 rx=0x7f1c50007d80 tx=0x7f1c50010ef0).stop 2020-02-11T16:15:49.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5d2fc700 1 -- 172.21.15.88:0/998325014 reap_dead start 2020-02-11T16:15:49.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5d2fc700 1 -- 172.21.15.88:0/998325014 reap_dead start 2020-02-11T16:15:49.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/998325014 shutdown_connections 2020-02-11T16:15:49.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5ed5f700 1 --2- 172.21.15.88:0/998325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c58133c80 0x7f1c580a0620 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:49.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/998325014 >> 172.21.15.88:0/998325014 conn(0x7f1c5809d110 msgr2=0x7f1c58069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:49.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/998325014 shutdown_connections 2020-02-11T16:15:49.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:49.932+0000 7f1c5ed5f700 1 -- 172.21.15.88:0/998325014 wait complete. 2020-02-11T16:15:49.955 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:15:49.956 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:15:49.956 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:15:49.956 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:15:49.956 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 90, 2020-02-11T16:15:49.956 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:15:49.956 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:15:49.956 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:15:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:15:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2020-02-11T16:15:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:15:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:15:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:15:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:15:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:15:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:15:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:15:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:15:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:15:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:15:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:15:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:15:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:15:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:15:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:15:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:15:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:15:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:15:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:15:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:15:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:15:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:15:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:15:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:15:49.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.964 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:15:49.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.964 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:15:49.964 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:15:49.964 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:49.964 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:49.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.965 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:49.965 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:15:49.965 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.965 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:15:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:15:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:15:49.967 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:49.967 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:49.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.967 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:15:49.967 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:15:49.967 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:49.968 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:49.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.968 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:49.968 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:15:49.968 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.969 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:49.969 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:15:49.969 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.969 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.969 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.970 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:15:49.970 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:15:49.970 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:49.970 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:49.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.971 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:15:49.971 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:15:49.972 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:15:49.972 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:15:49.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.972 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:15:49.972 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:15:49.972 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.973 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:15:49.973 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:15:49.973 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:15:49.973 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.973 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.974 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:15:49.974 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:15:49.974 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:15:49.974 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:15:49.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.974 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:15:49.975 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:15:49.975 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:15:49.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.975 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:49.975 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:49.976 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:15:49.976 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.976 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:15:49.976 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:15:49.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:15:49.976 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:15:49.977 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:15:49.977 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:15:49.977 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.977 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:15:49.977 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:15:49.977 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:15:49.978 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:15:49.978 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:15:50.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.080+0000 7f13bf61e700 1 Processor -- start 2020-02-11T16:15:50.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.081+0000 7f13bf61e700 1 -- start start 2020-02-11T16:15:50.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.081+0000 7f13bf61e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13b80a18a0 0x7f13b80a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:50.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.081+0000 7f13bf61e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b80a31b0 con 0x7f13b80a5de0 2020-02-11T16:15:50.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.081+0000 7f13bf61e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b80a3570 con 0x7f13b80a6260 2020-02-11T16:15:50.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.081+0000 7f13bf61e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b80a3810 con 0x7f13b80a18a0 2020-02-11T16:15:50.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.081+0000 7f13bdbbb700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f13b80a6260 0x7f13b812eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43372/0 (socket says 172.21.15.88:43372) 2020-02-11T16:15:50.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.081+0000 7f13bdbbb700 1 -- 172.21.15.88:0/2362515071 learned_addr learned my addr 172.21.15.88:0/2362515071 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:15:50.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/2362515071 >> v2:172.21.15.52:3300/0 conn(0x7f13b80a18a0 0x7f13b80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:50.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889002203 0 0) 0x7f13b80a3570 con 0x7f13b80a6260 2020-02-11T16:15:50.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a0003230 con 0x7f13b80a6260 2020-02-11T16:15:50.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 579192631 0 0) 0x7f13a0003230 con 0x7f13b80a6260 2020-02-11T16:15:50.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 >> v2:172.21.15.52:3300/0 conn(0x7f13b80a18a0 msgr2=0x7f13b80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:50.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 --2- 172.21.15.88:0/2362515071 >> v2:172.21.15.52:3300/0 conn(0x7f13b80a18a0 0x7f13b80a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:50.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 >> v1:172.21.15.52:6789/0 conn(0x7f13b80a5de0 legacy=0x7f13b812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b80a3ab0 con 0x7f13b80a6260 2020-02-11T16:15:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f13b0001a50 con 0x7f13b80a6260 2020-02-11T16:15:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 >> v1:172.21.15.88:6789/0 conn(0x7f13b80a6260 legacy=0x7f13b812eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0003720 0x7f13a0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13a0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:50.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13a0004db0 0x7f13a000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:15:50.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b80a3810 con 0x7f13a0003720 2020-02-11T16:15:50.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00041c0 con 0x7f13a00044d0 2020-02-11T16:15:50.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a000bb80 con 0x7f13a0004db0 2020-02-11T16:15:50.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13a0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:50.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0003720 0x7f13a0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:50.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13bdbbb700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13a0004db0 0x7f13a000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:50.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13bcbb9700 1 -- 172.21.15.88:0/2362515071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13a0004db0 msgr2=0x7f13a000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13a0004db0 0x7f13a000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13bcbb9700 1 -- 172.21.15.88:0/2362515071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0003720 msgr2=0x7f13a0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:15:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0003720 0x7f13a0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:15:50.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13bcbb9700 1 -- 172.21.15.88:0/2362515071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a0003230 con 0x7f13a00044d0 2020-02-11T16:15:50.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.082+0000 7f13bdbbb700 1 -- 172.21.15.88:0/2362515071 reap_dead start 2020-02-11T16:15:50.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13a0004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f13a00054a0 tx=0x7f13b400fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13a0004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f13a00054a0 tx=0x7f13b400fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13a0004950 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f13a00054a0 tx=0x7f13b400fd40).ready entity=mon.1 client_cookie=334037a1ad08710d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:50.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13a0004950 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f13a00054a0 tx=0x7f13b400fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13b4003540 con 0x7f13a00044d0 2020-02-11T16:15:50.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13a0004950 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f13a00054a0 tx=0x7f13b400fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13a0004950 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f13a00054a0 tx=0x7f13b400fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b40036e0 con 0x7f13a00044d0 2020-02-11T16:15:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13a7fff700 1 -- 172.21.15.88:0/2362515071 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13b4003ac0 con 0x7f13a00044d0 2020-02-11T16:15:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bf61e700 1 -- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 msgr2=0x7f13a0004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bf61e700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13a0004950 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f13a00054a0 tx=0x7f13b400fd40).stop 2020-02-11T16:15:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bf61e700 1 -- 172.21.15.88:0/2362515071 shutdown_connections 2020-02-11T16:15:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bf61e700 1 --2- 172.21.15.88:0/2362515071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13a0004950 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:50.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bf61e700 1 -- 172.21.15.88:0/2362515071 >> 172.21.15.88:0/2362515071 conn(0x7f13b809d110 msgr2=0x7f13b809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:50.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bf61e700 1 -- 172.21.15.88:0/2362515071 shutdown_connections 2020-02-11T16:15:50.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.083+0000 7f13bf61e700 1 -- 172.21.15.88:0/2362515071 wait complete. 2020-02-11T16:15:50.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.084+0000 7f13bf61e700 1 Processor -- start 2020-02-11T16:15:50.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.084+0000 7f13bf61e700 1 -- start start 2020-02-11T16:15:50.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bf61e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13a00044d0 0x7f13b8133a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:50.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bf61e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13b8132f40 0x7f13b8142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:50.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bf61e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b8134350 con 0x7f13b8142480 2020-02-11T16:15:50.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bf61e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b8141c30 con 0x7f13b8132f40 2020-02-11T16:15:50.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bf61e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b81345f0 con 0x7f13a00044d0 2020-02-11T16:15:50.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13a00044d0 0x7f13b8133a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:50.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13a00044d0 0x7f13b8133a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55754/0 (socket says 172.21.15.88:55754) 2020-02-11T16:15:50.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 -- 172.21.15.88:0/1889667223 learned_addr learned my addr 172.21.15.88:0/1889667223 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:15:50.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/1889667223 >> v2:172.21.15.52:3300/0 conn(0x7f13b8132f40 0x7f13b8142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:50.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 -- 172.21.15.88:0/1889667223 >> v2:172.21.15.52:3300/0 conn(0x7f13b8132f40 msgr2=0x7f13b8142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:50.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> v2:172.21.15.52:3300/0 conn(0x7f13b8132f40 0x7f13b8142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 -- 172.21.15.88:0/1889667223 >> v1:172.21.15.52:6789/0 conn(0x7f13b8142480 legacy=0x7f13b8137f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 -- 172.21.15.88:0/1889667223 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b81328f0 con 0x7f13a00044d0 2020-02-11T16:15:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> v2:172.21.15.88:3300/0 conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> v2:172.21.15.88:3300/0 conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:50.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13a67fc700 1 -- 172.21.15.88:0/1889667223 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13a8007530 con 0x7f13a00044d0 2020-02-11T16:15:50.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13a67fc700 1 -- 172.21.15.88:0/1889667223 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a800c7d0 con 0x7f13a00044d0 2020-02-11T16:15:50.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13bf61e700 1 -- 172.21.15.88:0/1889667223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b81428c0 con 0x7f13a00044d0 2020-02-11T16:15:50.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.085+0000 7f13a67fc700 1 -- 172.21.15.88:0/1889667223 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13a800cbf0 con 0x7f13a00044d0 2020-02-11T16:15:50.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.086+0000 7f13bf61e700 1 -- 172.21.15.88:0/1889667223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b81340b0 con 0x7f13a00044d0 2020-02-11T16:15:50.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.086+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.086+0000 7f13a67fc700 1 -- 172.21.15.88:0/1889667223 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f13a8010170 con 0x7f13a00044d0 2020-02-11T16:15:50.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.086+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.086+0000 7f13a67fc700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1398039ca0 0x7f139803c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:15:50.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.086+0000 7f13a67fc700 1 -- 172.21.15.88:0/1889667223 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f13a8049da0 con 0x7f13a00044d0 2020-02-11T16:15:50.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.087+0000 7f13bf61e700 1 -- 172.21.15.88:0/1889667223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b80565b0 con 0x7f13a00044d0 2020-02-11T16:15:50.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.087+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1398039ca0 0x7f139803c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:15:50.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.087+0000 7f13bcbb9700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1398039ca0 0x7f139803c160 crc :-1 s=READY pgs=277 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:15:50.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.090+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.090+0000 7f13a67fc700 1 -- 172.21.15.88:0/1889667223 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f13a802f440 con 0x7f13a00044d0 2020-02-11T16:15:50.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.269+0000 7f13bf61e700 1 -- 172.21.15.88:0/1889667223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f13b8138a20 con 0x7f13a00044d0 2020-02-11T16:15:50.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.271+0000 7f13bd3ba700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:15:50.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.271+0000 7f13a67fc700 1 -- 172.21.15.88:0/1889667223 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f13a8031ef0 con 0x7f13a00044d0 2020-02-11T16:15:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 -- 172.21.15.88:0/1889667223 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1398039ca0 msgr2=0x7f139803c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1398039ca0 0x7f139803c160 crc :-1 s=READY pgs=277 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 -- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 msgr2=0x7f13b8133a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:15:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13b8133a90 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7f13a8007ed0 tx=0x7f13a8010c10).stop 2020-02-11T16:15:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 -- 172.21.15.88:0/1889667223 shutdown_connections 2020-02-11T16:15:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00044d0 0x7f13b8133a90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 --2- 172.21.15.88:0/1889667223 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1398039ca0 0x7f139803c160 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:50.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 --2- 172.21.15.88:0/1889667223 >> v2:172.21.15.52:3300/0 conn(0x7f13b8132f40 0x7f13b8142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:15:50.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 -- 172.21.15.88:0/1889667223 >> 172.21.15.88:0/1889667223 conn(0x7f13b809d110 msgr2=0x7f13b80a6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:15:50.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 -- 172.21.15.88:0/1889667223 shutdown_connections 2020-02-11T16:15:50.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:15:50.272+0000 7f13bf61e700 1 -- 172.21.15.88:0/1889667223 wait complete. 2020-02-11T16:15:50.286 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:16:00.287 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:16:00.288 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:00.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.401+0000 7f3eb4e73700 1 Processor -- start 2020-02-11T16:16:00.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.401+0000 7f3eb4e73700 1 -- start start 2020-02-11T16:16:00.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.401+0000 7f3eb4e73700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:00.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.401+0000 7f3eb4e73700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:00.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.401+0000 7f3eb4e73700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3eb012e3a0 0x7f3eb012e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:00.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.401+0000 7f3eb4e73700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb00a3570 con 0x7f3eb012e3a0 2020-02-11T16:16:00.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.401+0000 7f3eb4e73700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb00a3810 con 0x7f3eb00a18a0 2020-02-11T16:16:00.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.401+0000 7f3eb4e73700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00a3ab0 con 0x7f3eb00a5de0 2020-02-11T16:16:00.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55762/0 (socket says 172.21.15.88:55762) 2020-02-11T16:16:00.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 -- 172.21.15.88:0/980532831 learned_addr learned my addr 172.21.15.88:0/980532831 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:00.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/980532831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eaed9d700 1 --2- 172.21.15.88:0/980532831 >> v2:172.21.15.52:3300/0 conn(0x7f3eb012e3a0 0x7f3eb012e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 -- 172.21.15.88:0/980532831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 msgr2=0x7f3eb00a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:00.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 --2- 172.21.15.88:0/980532831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb00a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:00.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 -- 172.21.15.88:0/980532831 >> v2:172.21.15.52:3300/0 conn(0x7f3eb012e3a0 msgr2=0x7f3eb012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:00.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 --2- 172.21.15.88:0/980532831 >> v2:172.21.15.52:3300/0 conn(0x7f3eb012e3a0 0x7f3eb012e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:00.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 -- 172.21.15.88:0/980532831 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb00a3d50 con 0x7f3eb00a18a0 2020-02-11T16:16:00.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eaed9d700 1 --2- 172.21.15.88:0/980532831 >> v2:172.21.15.52:3300/0 conn(0x7f3eb012e3a0 0x7f3eb012e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:16:00.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 --2- 172.21.15.88:0/980532831 >> v2:172.21.15.88:3300/0 conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3eb005bbc0 tx=0x7f3ea40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 --2- 172.21.15.88:0/980532831 >> v2:172.21.15.88:3300/0 conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3eb005bbc0 tx=0x7f3ea40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 --2- 172.21.15.88:0/980532831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 secure :-1 s=READY pgs=485 cs=0 l=1 rx=0x7f3eb005bbc0 tx=0x7f3ea40088e0).ready entity=mon.1 client_cookie=44eae57f1f57a100 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 --2- 172.21.15.88:0/980532831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f3eb005bbc0 tx=0x7f3ea40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3ead59a700 1 -- 172.21.15.88:0/980532831 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea4011670 con 0x7f3eb00a18a0 2020-02-11T16:16:00.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 --2- 172.21.15.88:0/980532831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f3eb005bbc0 tx=0x7f3ea40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eae59c700 1 --2- 172.21.15.88:0/980532831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f3eb005bbc0 tx=0x7f3ea40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3ead59a700 1 -- 172.21.15.88:0/980532831 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea40117d0 con 0x7f3eb00a18a0 2020-02-11T16:16:00.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3ead59a700 1 -- 172.21.15.88:0/980532831 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea4011bb0 con 0x7f3eb00a18a0 2020-02-11T16:16:00.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eb4e73700 1 -- 172.21.15.88:0/980532831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb00a18a0 msgr2=0x7f3eb00a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.402+0000 7f3eb4e73700 1 --2- 172.21.15.88:0/980532831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 secure :-1 s=READY pgs=485 cs=0 l=1 rx=0x7f3eb005bbc0 tx=0x7f3ea40088e0).stop 2020-02-11T16:16:00.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.403+0000 7f3eb4e73700 1 -- 172.21.15.88:0/980532831 shutdown_connections 2020-02-11T16:16:00.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.403+0000 7f3eb4e73700 1 --2- 172.21.15.88:0/980532831 >> v2:172.21.15.52:3300/0 conn(0x7f3eb012e3a0 0x7f3eb012e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:00.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.403+0000 7f3eb4e73700 1 --2- 172.21.15.88:0/980532831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb00a18a0 0x7f3eb00a6dd0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.403+0000 7f3eb4e73700 1 --2- 172.21.15.88:0/980532831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb00a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:00.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.403+0000 7f3eb4e73700 1 -- 172.21.15.88:0/980532831 >> 172.21.15.88:0/980532831 conn(0x7f3eb009d110 msgr2=0x7f3eb009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:00.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.403+0000 7f3eb4e73700 1 -- 172.21.15.88:0/980532831 shutdown_connections 2020-02-11T16:16:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.403+0000 7f3eb4e73700 1 -- 172.21.15.88:0/980532831 wait complete. 2020-02-11T16:16:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eb4e73700 1 Processor -- start 2020-02-11T16:16:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eb4e73700 1 -- start start 2020-02-11T16:16:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eb4e73700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3eb00a18a0 0x7f3eb01372b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eb4e73700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eb4e73700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb0133360 con 0x7f3eb012e3a0 2020-02-11T16:16:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eb4e73700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb0133600 con 0x7f3eb00a18a0 2020-02-11T16:16:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eb4e73700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb0137b70 con 0x7f3eb00a5de0 2020-02-11T16:16:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eaed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3eb012e3a0 0x7f3eb005a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43398/0 (socket says 172.21.15.88:43398) 2020-02-11T16:16:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eaed9d700 1 -- 172.21.15.88:0/4107140761 learned_addr learned my addr 172.21.15.88:0/4107140761 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.404+0000 7f3eae59c700 1 --2- 172.21.15.88:0/4107140761 >> v2:172.21.15.52:3300/0 conn(0x7f3eb00a18a0 0x7f3eb01372b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3e9f7fe700 1 -- 172.21.15.88:0/4107140761 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489210780 0 0) 0x7f3eb0133360 con 0x7f3eb012e3a0 2020-02-11T16:16:00.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3e9f7fe700 1 -- 172.21.15.88:0/4107140761 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e8c002fe0 con 0x7f3eb012e3a0 2020-02-11T16:16:00.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eadd9b700 1 -- 172.21.15.88:0/4107140761 >> v2:172.21.15.52:3300/0 conn(0x7f3eb00a18a0 msgr2=0x7f3eb01372b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> v2:172.21.15.52:3300/0 conn(0x7f3eb00a18a0 0x7f3eb01372b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eadd9b700 1 -- 172.21.15.88:0/4107140761 >> v1:172.21.15.88:6789/0 conn(0x7f3eb012e3a0 legacy=0x7f3eb005a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eadd9b700 1 -- 172.21.15.88:0/4107140761 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb012aec0 con 0x7f3eb00a5de0 2020-02-11T16:16:00.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3e9f7fe700 1 -- 172.21.15.88:0/4107140761 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea0007340 con 0x7f3eb00a5de0 2020-02-11T16:16:00.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eb4e73700 1 -- 172.21.15.88:0/4107140761 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb01320b0 con 0x7f3eb00a5de0 2020-02-11T16:16:00.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3e9f7fe700 1 -- 172.21.15.88:0/4107140761 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea00074a0 con 0x7f3eb00a5de0 2020-02-11T16:16:00.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3e9f7fe700 1 -- 172.21.15.88:0/4107140761 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea00058b0 con 0x7f3eb00a5de0 2020-02-11T16:16:00.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.405+0000 7f3eb4e73700 1 -- 172.21.15.88:0/4107140761 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb0138ac0 con 0x7f3eb00a5de0 2020-02-11T16:16:00.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.406+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.406+0000 7f3e9f7fe700 1 -- 172.21.15.88:0/4107140761 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3ea0005b30 con 0x7f3eb00a5de0 2020-02-11T16:16:00.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.406+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.406+0000 7f3e9f7fe700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e8c039f70 0x7f3e8c03c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.406+0000 7f3e9f7fe700 1 -- 172.21.15.88:0/4107140761 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3ea000d0c0 con 0x7f3eb00a5de0 2020-02-11T16:16:00.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.406+0000 7f3eb4e73700 1 -- 172.21.15.88:0/4107140761 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb012ab30 con 0x7f3eb00a5de0 2020-02-11T16:16:00.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.407+0000 7f3eae59c700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e8c039f70 0x7f3e8c03c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.407+0000 7f3eae59c700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e8c039f70 0x7f3e8c03c430 crc :-1 s=READY pgs=278 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.411+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.411+0000 7f3e9f7fe700 1 -- 172.21.15.88:0/4107140761 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3ea002efb0 con 0x7f3eb00a5de0 2020-02-11T16:16:00.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.592+0000 7f3eb4e73700 1 -- 172.21.15.88:0/4107140761 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3eb00565b0 con 0x7f3eb00a5de0 2020-02-11T16:16:00.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.593+0000 7f3eadd9b700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.593+0000 7f3e9f7fe700 1 -- 172.21.15.88:0/4107140761 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f3ea0031aa0 con 0x7f3eb00a5de0 2020-02-11T16:16:00.596 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:00.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.594+0000 7f3eb4e73700 1 -- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e8c039f70 msgr2=0x7f3e8c03c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.594+0000 7f3eb4e73700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e8c039f70 0x7f3e8c03c430 crc :-1 s=READY pgs=278 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.594+0000 7f3eb4e73700 1 -- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 msgr2=0x7f3eb0137710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.594+0000 7f3eb4e73700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f3ea0002f30 tx=0x7f3ea0010bd0).stop 2020-02-11T16:16:00.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.595+0000 7f3eb4e73700 1 -- 172.21.15.88:0/4107140761 shutdown_connections 2020-02-11T16:16:00.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.595+0000 7f3eb4e73700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e8c039f70 0x7f3e8c03c430 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.595+0000 7f3eb4e73700 1 --2- 172.21.15.88:0/4107140761 >> v2:172.21.15.52:3300/0 conn(0x7f3eb00a18a0 0x7f3eb01372b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.595+0000 7f3eb4e73700 1 --2- 172.21.15.88:0/4107140761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3eb00a5de0 0x7f3eb0137710 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.595+0000 7f3eb4e73700 1 -- 172.21.15.88:0/4107140761 >> 172.21.15.88:0/4107140761 conn(0x7f3eb009d110 msgr2=0x7f3eb00a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:00.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.595+0000 7f3eb4e73700 1 -- 172.21.15.88:0/4107140761 shutdown_connections 2020-02-11T16:16:00.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.595+0000 7f3eb4e73700 1 -- 172.21.15.88:0/4107140761 wait complete. 2020-02-11T16:16:00.607 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":90,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:00.608 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:16:00.608 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:16:00.608 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:16:00.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.711+0000 7f8f40f27700 1 Processor -- start 2020-02-11T16:16:00.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.711+0000 7f8f40f27700 1 -- start start 2020-02-11T16:16:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.712+0000 7f8f40f27700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f3c12ffa0 0x7f8f3c141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.712+0000 7f8f40f27700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c0a5560 con 0x7f8f3c0a7120 2020-02-11T16:16:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.712+0000 7f8f40f27700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c09e060 con 0x7f8f3c0a4ec0 2020-02-11T16:16:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.712+0000 7f8f40f27700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0a5350 con 0x7f8f3c12ffa0 2020-02-11T16:16:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.712+0000 7f8f39d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8f3c0a4ec0 0x7f8f3c12f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43404/0 (socket says 172.21.15.88:43404) 2020-02-11T16:16:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.712+0000 7f8f39d9b700 1 -- 172.21.15.88:0/1630732909 learned_addr learned my addr 172.21.15.88:0/1630732909 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.712+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f3c12ffa0 0x7f8f3c141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.712+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067942546 0 0) 0x7f8f3c09e060 con 0x7f8f3c0a4ec0 2020-02-11T16:16:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.712+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f20003230 con 0x7f8f3c0a4ec0 2020-02-11T16:16:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892465635 0 0) 0x7f8f3c0a5560 con 0x7f8f3c0a7120 2020-02-11T16:16:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f3c09e060 con 0x7f8f3c0a7120 2020-02-11T16:16:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3508699808 0 0) 0x7f8f20003230 con 0x7f8f3c0a4ec0 2020-02-11T16:16:00.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f3c12ffa0 msgr2=0x7f8f3c141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:00.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f3c12ffa0 0x7f8f3c141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:00.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 >> v1:172.21.15.52:6789/0 conn(0x7f8f3c0a7120 legacy=0x7f8f3c0a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c09e300 con 0x7f8f3c0a4ec0 2020-02-11T16:16:00.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f8f2c0016d0 con 0x7f8f3c0a4ec0 2020-02-11T16:16:00.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 >> v1:172.21.15.88:6789/0 conn(0x7f8f3c0a4ec0 legacy=0x7f8f3c12f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f200038e0 0x7f8f20003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:00.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f200044d0 0x7f8f20004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20004db0 0x7f8f2000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0a5350 con 0x7f8f20004db0 2020-02-11T16:16:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20005320 con 0x7f8f200038e0 2020-02-11T16:16:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2000bb80 con 0x7f8f200044d0 2020-02-11T16:16:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f3c12ffa0 0x7f8f3c141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:16:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f200038e0 0x7f8f20003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20004db0 0x7f8f2000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f39d9b700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f200044d0 0x7f8f20004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 -- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f200044d0 msgr2=0x7f8f20004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f200044d0 0x7f8f20004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 -- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20004db0 msgr2=0x7f8f2000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20004db0 0x7f8f2000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 -- 172.21.15.88:0/1630732909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20003230 con 0x7f8f200038e0 2020-02-11T16:16:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f39d9b700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f200044d0 0x7f8f20004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:16:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f200038e0 0x7f8f20003ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f200038e0 0x7f8f20003ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f200038e0 0x7f8f20003ce0 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).ready entity=mon.1 client_cookie=af9cba61f6b0c7a7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f200038e0 0x7f8f20003ce0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f3000c920 con 0x7f8f200038e0 2020-02-11T16:16:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f200038e0 0x7f8f20003ce0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f200038e0 0x7f8f20003ce0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3000ca80 con 0x7f8f200038e0 2020-02-11T16:16:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3959a700 1 -- 172.21.15.88:0/1630732909 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f3000cea0 con 0x7f8f200038e0 2020-02-11T16:16:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f40f27700 1 -- 172.21.15.88:0/1630732909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f200038e0 msgr2=0x7f8f20003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f40f27700 1 --2- 172.21.15.88:0/1630732909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f200038e0 0x7f8f20003ce0 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).stop 2020-02-11T16:16:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.713+0000 7f8f3ad9d700 1 -- 172.21.15.88:0/1630732909 reap_dead start 2020-02-11T16:16:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.714+0000 7f8f40f27700 1 -- 172.21.15.88:0/1630732909 shutdown_connections 2020-02-11T16:16:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.714+0000 7f8f40f27700 1 -- 172.21.15.88:0/1630732909 >> 172.21.15.88:0/1630732909 conn(0x7f8f3c09d110 msgr2=0x7f8f3c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.714+0000 7f8f40f27700 1 -- 172.21.15.88:0/1630732909 shutdown_connections 2020-02-11T16:16:00.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.714+0000 7f8f40f27700 1 -- 172.21.15.88:0/1630732909 wait complete. 2020-02-11T16:16:00.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.715+0000 7f8f40f27700 1 Processor -- start 2020-02-11T16:16:00.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.715+0000 7f8f40f27700 1 -- start start 2020-02-11T16:16:00.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.715+0000 7f8f40f27700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f3c12eeb0 0x7f8f3c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.715+0000 7f8f40f27700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f3c1492a0 0x7f8f3c1496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.715+0000 7f8f40f27700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c0a7770 con 0x7f8f3c0669b0 2020-02-11T16:16:00.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.715+0000 7f8f40f27700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c0a4780 con 0x7f8f3c1492a0 2020-02-11T16:16:00.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.715+0000 7f8f40f27700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0a3030 con 0x7f8f3c12eeb0 2020-02-11T16:16:00.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.715+0000 7f8f3ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f3c1492a0 0x7f8f3c1496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f3c1492a0 0x7f8f3c1496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55792/0 (socket says 172.21.15.88:55792) 2020-02-11T16:16:00.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f39d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8f3c0669b0 0x7f8f3c148b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43414/0 (socket says 172.21.15.88:43414) 2020-02-11T16:16:00.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 -- 172.21.15.88:0/1781877874 learned_addr learned my addr 172.21.15.88:0/1781877874 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:00.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f3c12eeb0 0x7f8f3c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 -- 172.21.15.88:0/1781877874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f3c12eeb0 msgr2=0x7f8f3c066550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f3c12eeb0 0x7f8f3c066550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 -- 172.21.15.88:0/1781877874 >> v1:172.21.15.88:6789/0 conn(0x7f8f3c0669b0 legacy=0x7f8f3c148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596563522 0 0) 0x7f8f3c0a7770 con 0x7f8f3c0669b0 2020-02-11T16:16:00.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 -- 172.21.15.88:0/1781877874 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c0a16a0 con 0x7f8f3c1492a0 2020-02-11T16:16:00.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1781877874 >> v2:172.21.15.88:3300/0 conn(0x7f8f3c1492a0 0x7f8f3c1496c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f3c05ba50 tx=0x7f8f34010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1781877874 >> v2:172.21.15.88:3300/0 conn(0x7f8f3c1492a0 0x7f8f3c1496c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f3c05ba50 tx=0x7f8f34010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c1492a0 0x7f8f3c1496c0 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7f8f3c05ba50 tx=0x7f8f34010f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c1492a0 0x7f8f3c1496c0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8f3c05ba50 tx=0x7f8f34010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f34005e20 con 0x7f8f3c1492a0 2020-02-11T16:16:00.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c1492a0 0x7f8f3c1496c0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8f3c05ba50 tx=0x7f8f34010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c1492a0 0x7f8f3c1496c0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8f3c05ba50 tx=0x7f8f34010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34011780 con 0x7f8f3c1492a0 2020-02-11T16:16:00.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f40f27700 1 -- 172.21.15.88:0/1781877874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c09e940 con 0x7f8f3c1492a0 2020-02-11T16:16:00.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f34011b60 con 0x7f8f3c1492a0 2020-02-11T16:16:00.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.716+0000 7f8f40f27700 1 -- 172.21.15.88:0/1781877874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c066e30 con 0x7f8f3c1492a0 2020-02-11T16:16:00.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c1492a0 0x7f8f3c1496c0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8f3c05ba50 tx=0x7f8f34010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8f34011cc0 con 0x7f8f3c1492a0 2020-02-11T16:16:00.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f3ad9d700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c1492a0 0x7f8f3c1496c0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8f3c05ba50 tx=0x7f8f34010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f40f27700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 0x7f8f3c12d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f40f27700 1 -- 172.21.15.88:0/1781877874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c05e2f0 con 0x7f8f3c0a9330 2020-02-11T16:16:00.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f2b7fe700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f18039b60 0x7f8f1803c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 0x7f8f3c12d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8f34049650 con 0x7f8f3c1492a0 2020-02-11T16:16:00.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f3a59c700 1 -- 172.21.15.88:0/1781877874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f3c0a8100 con 0x7f8f3c0a9330 2020-02-11T16:16:00.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 0x7f8f3c12d2b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f39d9b700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f18039b60 0x7f8f1803c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 0x7f8f3c12d2b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.717+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 0x7f8f3c12d2b0 secure :-1 s=READY pgs=491 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.718+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 0x7f8f3c12d2b0 secure :-1 s=THROTTLE_DONE pgs=491 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.718+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f300118c0 con 0x7f8f3c0a9330 2020-02-11T16:16:00.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.718+0000 7f8f39d9b700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f18039b60 0x7f8f1803c020 crc :-1 s=READY pgs=279 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.718+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 0x7f8f3c12d2b0 secure :-1 s=THROTTLE_DONE pgs=491 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.718+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8f30011a20 con 0x7f8f3c0a9330 2020-02-11T16:16:00.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.718+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 msgr2=0x7f8f3c12d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.718+0000 7f8f2b7fe700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 0x7f8f3c12d2b0 secure :-1 s=READY pgs=491 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).stop 2020-02-11T16:16:00.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.718+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 msgr2=0x7f8f3c12d2b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:00.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.718+0000 7f8f2b7fe700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c0a9330 0x7f8f3c12d2b0 secure :-1 s=CLOSED pgs=491 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).stop 2020-02-11T16:16:00.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.726+0000 7f8f40f27700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 0x7f8f3c12daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.726+0000 7f8f40f27700 1 -- 172.21.15.88:0/1781877874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c12fe00 con 0x7f8f3c12d710 2020-02-11T16:16:00.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.726+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 0x7f8f3c12daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.726+0000 7f8f3a59c700 1 -- 172.21.15.88:0/1781877874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8f3c0a7ef0 con 0x7f8f3c12d710 2020-02-11T16:16:00.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.726+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 0x7f8f3c12daf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.726+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 0x7f8f3c12daf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.726+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 0x7f8f3c12daf0 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.726+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 0x7f8f3c12daf0 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.726+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f300180a0 con 0x7f8f3c12d710 2020-02-11T16:16:00.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f3a59c700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 0x7f8f3c12daf0 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f8f3000ce50 con 0x7f8f3c12d710 2020-02-11T16:16:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 msgr2=0x7f8f3c12daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f2b7fe700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 0x7f8f3c12daf0 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7f8f20004440 tx=0x7f8f30001590).stop 2020-02-11T16:16:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f2b7fe700 1 -- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 msgr2=0x7f8f3c12daf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f2b7fe700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c12d710 0x7f8f3c12daf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f40f27700 1 -- 172.21.15.88:0/1781877874 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f18039b60 msgr2=0x7f8f1803c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f40f27700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f18039b60 0x7f8f1803c020 crc :-1 s=READY pgs=279 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f40f27700 1 -- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c1492a0 msgr2=0x7f8f3c1496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f40f27700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c1492a0 0x7f8f3c1496c0 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7f8f3c05ba50 tx=0x7f8f34010f10).stop 2020-02-11T16:16:00.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f3ad9d700 1 -- 172.21.15.88:0/1781877874 reap_dead start 2020-02-11T16:16:00.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f3ad9d700 1 -- 172.21.15.88:0/1781877874 reap_dead start 2020-02-11T16:16:00.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f40f27700 1 -- 172.21.15.88:0/1781877874 shutdown_connections 2020-02-11T16:16:00.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f40f27700 1 --2- 172.21.15.88:0/1781877874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f3c1492a0 0x7f8f3c1496c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f40f27700 1 -- 172.21.15.88:0/1781877874 >> 172.21.15.88:0/1781877874 conn(0x7f8f3c09d110 msgr2=0x7f8f3c05adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:00.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f40f27700 1 -- 172.21.15.88:0/1781877874 shutdown_connections 2020-02-11T16:16:00.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.727+0000 7f8f40f27700 1 -- 172.21.15.88:0/1781877874 wait complete. 2020-02-11T16:16:00.762 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:16:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 90, 2020-02-11T16:16:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:16:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 13, 2020-02-11T16:16:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:00.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.773 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:00.773 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:00.773 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:00.773 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:00.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.774 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:00.774 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:00.774 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.774 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:00.775 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:00.775 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.775 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.775 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.775 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:00.775 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:00.776 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:00.776 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:00.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.776 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:00.776 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:00.776 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:00.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:00.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.777 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:00.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:00.777 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.778 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:00.778 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:00.778 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.778 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.778 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.778 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:00.779 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:00.779 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:00.779 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:00.779 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.779 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.779 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:00.779 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:00.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.780 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:00.780 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:00.780 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:00.780 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.780 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.780 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:16:00.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.781 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:00.781 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:00.781 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:16:00.781 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.781 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.781 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:16:00.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.782 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:00.782 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:00.782 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:16:00.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.782 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.782 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:00.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.783 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:00.783 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:00.783 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:16:00.783 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.783 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.783 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:16:00.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.783 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:00.784 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:00.784 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:16:00.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.784 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.784 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:00.786 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:16:00.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.889+0000 7f5b8f3ef700 1 Processor -- start 2020-02-11T16:16:00.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.889+0000 7f5b8f3ef700 1 -- start start 2020-02-11T16:16:00.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8f3ef700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b880a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:00.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8f3ef700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b880a3e60 0x7f5b8812ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:00.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8f3ef700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b880a5320 con 0x7f5b880a39e0 2020-02-11T16:16:00.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8f3ef700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8809e7a0 con 0x7f5b880a3e60 2020-02-11T16:16:00.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8f3ef700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880a4280 con 0x7f5b880a7120 2020-02-11T16:16:00.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8c98a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5b880a39e0 0x7f5b8812f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43428/0 (socket says 172.21.15.88:43428) 2020-02-11T16:16:00.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8c98a700 1 -- 172.21.15.88:0/4154328370 learned_addr learned my addr 172.21.15.88:0/4154328370 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:00.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/4154328370 >> v2:172.21.15.52:3300/0 conn(0x7f5b880a3e60 0x7f5b8812ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/4154328370 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b880a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b77fff700 1 -- 172.21.15.88:0/4154328370 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300085994 0 0) 0x7f5b840010d0 con 0x7f5b880a39e0 2020-02-11T16:16:00.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b77fff700 1 -- 172.21.15.88:0/4154328370 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b70003230 con 0x7f5b880a39e0 2020-02-11T16:16:00.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8d18b700 1 -- 172.21.15.88:0/4154328370 >> v2:172.21.15.52:3300/0 conn(0x7f5b880a3e60 msgr2=0x7f5b8812ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:00.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/4154328370 >> v2:172.21.15.52:3300/0 conn(0x7f5b880a3e60 0x7f5b8812ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:00.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8d18b700 1 -- 172.21.15.88:0/4154328370 >> v1:172.21.15.88:6789/0 conn(0x7f5b880a39e0 legacy=0x7f5b8812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8d18b700 1 -- 172.21.15.88:0/4154328370 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880a5560 con 0x7f5b880a7120 2020-02-11T16:16:00.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/4154328370 >> v2:172.21.15.52:3300/0 conn(0x7f5b880a3e60 0x7f5b8812ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:16:00.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.890+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/4154328370 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b880a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5b78002f30 tx=0x7f5b780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/4154328370 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b880a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5b78002f30 tx=0x7f5b780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/4154328370 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b880a4ec0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f5b78002f30 tx=0x7f5b780088e0).ready entity=mon.2 client_cookie=c1c991aea9d3bf35 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/4154328370 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b880a4ec0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f5b78002f30 tx=0x7f5b780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b77fff700 1 -- 172.21.15.88:0/4154328370 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b78008e40 con 0x7f5b880a7120 2020-02-11T16:16:00.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/4154328370 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b880a4ec0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f5b78002f30 tx=0x7f5b780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/4154328370 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b880a4ec0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f5b78002f30 tx=0x7f5b780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b77fff700 1 -- 172.21.15.88:0/4154328370 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b78011540 con 0x7f5b880a7120 2020-02-11T16:16:00.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b77fff700 1 -- 172.21.15.88:0/4154328370 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b780118e0 con 0x7f5b880a7120 2020-02-11T16:16:00.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/4154328370 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 msgr2=0x7f5b880a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8f3ef700 1 --2- 172.21.15.88:0/4154328370 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b880a4ec0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f5b78002f30 tx=0x7f5b780088e0).stop 2020-02-11T16:16:00.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/4154328370 shutdown_connections 2020-02-11T16:16:00.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8f3ef700 1 --2- 172.21.15.88:0/4154328370 >> v2:172.21.15.52:3300/0 conn(0x7f5b880a3e60 0x7f5b8812ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:00.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8f3ef700 1 --2- 172.21.15.88:0/4154328370 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b880a4ec0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/4154328370 >> 172.21.15.88:0/4154328370 conn(0x7f5b8809d110 msgr2=0x7f5b8809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:00.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/4154328370 shutdown_connections 2020-02-11T16:16:00.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.891+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/4154328370 wait complete. 2020-02-11T16:16:00.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.892+0000 7f5b8f3ef700 1 Processor -- start 2020-02-11T16:16:00.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.892+0000 7f5b8f3ef700 1 -- start start 2020-02-11T16:16:00.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8f3ef700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8f3ef700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8812a0b0 con 0x7f5b880a3e60 2020-02-11T16:16:00.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8f3ef700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b88130bf0 con 0x7f5b880a39e0 2020-02-11T16:16:00.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8f3ef700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b881313d0 con 0x7f5b880a7120 2020-02-11T16:16:00.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8d18b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5b880a39e0 0x7f5b881277a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43432/0 (socket says 172.21.15.88:43432) 2020-02-11T16:16:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8d18b700 1 -- 172.21.15.88:0/2686504726 learned_addr learned my addr 172.21.15.88:0/2686504726 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609452772 0 0) 0x7f5b88130bf0 con 0x7f5b880a39e0 2020-02-11T16:16:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b68002fe0 con 0x7f5b880a39e0 2020-02-11T16:16:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851374014 0 0) 0x7f5b8812a0b0 con 0x7f5b880a3e60 2020-02-11T16:16:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b88130bf0 con 0x7f5b880a3e60 2020-02-11T16:16:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1763884125 0 0) 0x7f5b68002fe0 con 0x7f5b880a39e0 2020-02-11T16:16:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b8812a0b0 con 0x7f5b880a39e0 2020-02-11T16:16:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f5b78008e40 con 0x7f5b880a39e0 2020-02-11T16:16:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8d98c700 1 -- 172.21.15.88:0/2686504726 >> v1:172.21.15.88:6789/0 conn(0x7f5b880a39e0 legacy=0x7f5b881277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8d98c700 1 -- 172.21.15.88:0/2686504726 >> v1:172.21.15.52:6789/0 conn(0x7f5b880a3e60 legacy=0x7f5b8814b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8d98c700 1 -- 172.21.15.88:0/2686504726 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880672b0 con 0x7f5b880a7120 2020-02-11T16:16:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b800032b0 tx=0x7f5b80010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b800032b0 tx=0x7f5b80010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.893+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f5b800032b0 tx=0x7f5b80010ff0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f5b800032b0 tx=0x7f5b80010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b8000c720 con 0x7f5b880a7120 2020-02-11T16:16:00.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f5b800032b0 tx=0x7f5b80010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/2686504726 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8812b280 con 0x7f5b880a7120 2020-02-11T16:16:00.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8000c880 con 0x7f5b880a7120 2020-02-11T16:16:00.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f5b800032b0 tx=0x7f5b80010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b8000cbe0 con 0x7f5b880a7120 2020-02-11T16:16:00.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/2686504726 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b881295a0 con 0x7f5b880a7120 2020-02-11T16:16:00.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f5b800032b0 tx=0x7f5b80010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5b80007160 con 0x7f5b880a7120 2020-02-11T16:16:00.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b8d98c700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f5b800032b0 tx=0x7f5b80010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.894+0000 7f5b8f3ef700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 0x7f5b88132af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/2686504726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8812a630 con 0x7f5b880a02f0 2020-02-11T16:16:00.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b767fc700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b6803a300 0x7f5b6803c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 0x7f5b88132af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5b80049650 con 0x7f5b880a7120 2020-02-11T16:16:00.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b8c98a700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b6803a300 0x7f5b6803c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b8d18b700 1 -- 172.21.15.88:0/2686504726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b88132320 con 0x7f5b880a02f0 2020-02-11T16:16:00.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 0x7f5b88132af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 0x7f5b88132af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 0x7f5b88132af0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b8c98a700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b6803a300 0x7f5b6803c7c0 crc :-1 s=READY pgs=280 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 0x7f5b88132af0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b78008710 con 0x7f5b880a02f0 2020-02-11T16:16:00.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 0x7f5b88132af0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5b7800f850 con 0x7f5b880a02f0 2020-02-11T16:16:00.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 msgr2=0x7f5b88132af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b767fc700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 0x7f5b88132af0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).stop 2020-02-11T16:16:00.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.895+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 msgr2=0x7f5b88132af0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:00.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.896+0000 7f5b767fc700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b880a02f0 0x7f5b88132af0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.904+0000 7f5b8f3ef700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 0x7f5b8809e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:00.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.904+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/2686504726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8805e2f0 con 0x7f5b8805aa70 2020-02-11T16:16:00.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.904+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 0x7f5b8809e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:00.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.904+0000 7f5b8d18b700 1 -- 172.21.15.88:0/2686504726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5b88132f50 con 0x7f5b8805aa70 2020-02-11T16:16:00.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.904+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 0x7f5b8809e8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.904+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 0x7f5b8809e8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.904+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 0x7f5b8809e8e0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:00.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.904+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 0x7f5b8809e8e0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.904+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b7800e8d0 con 0x7f5b8805aa70 2020-02-11T16:16:00.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8d18b700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 0x7f5b8809e8e0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:00.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3852 (secure 0 0 0) 0x7f5b7800ea30 con 0x7f5b8805aa70 2020-02-11T16:16:00.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 msgr2=0x7f5b8809e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b767fc700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 0x7f5b8809e8e0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f5b780100e0 tx=0x7f5b880a11a0).stop 2020-02-11T16:16:00.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b767fc700 1 -- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 msgr2=0x7f5b8809e8e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:00.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b767fc700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b8805aa70 0x7f5b8809e8e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b6803a300 msgr2=0x7f5b6803c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8f3ef700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b6803a300 0x7f5b6803c7c0 crc :-1 s=READY pgs=280 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:00.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 msgr2=0x7f5b881325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:00.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8f3ef700 1 --2- 172.21.15.88:0/2686504726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b880a7120 0x7f5b881325c0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f5b800032b0 tx=0x7f5b80010ff0).stop 2020-02-11T16:16:00.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8d98c700 1 -- 172.21.15.88:0/2686504726 reap_dead start 2020-02-11T16:16:00.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8d98c700 1 -- 172.21.15.88:0/2686504726 reap_dead start 2020-02-11T16:16:00.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/2686504726 shutdown_connections 2020-02-11T16:16:00.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/2686504726 >> 172.21.15.88:0/2686504726 conn(0x7f5b8809d110 msgr2=0x7f5b8812ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:00.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/2686504726 shutdown_connections 2020-02-11T16:16:00.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:00.905+0000 7f5b8f3ef700 1 -- 172.21.15.88:0/2686504726 wait complete. 2020-02-11T16:16:00.917 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:00.917 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:00.917 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:00.918 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:16:00.918 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 90, 2020-02-11T16:16:00.918 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:00.918 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:00.918 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:16:00.918 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:00.918 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.919 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2020-02-11T16:16:00.919 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:00.919 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:00.919 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:00.919 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:00.919 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:00.919 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:00.920 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:00.920 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:00.920 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:00.920 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.920 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:00.920 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:00.920 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:00.920 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:00.921 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:00.921 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:00.921 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:00.921 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:00.921 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.921 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:00.922 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:00.922 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:00.922 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:00.922 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:00.922 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:00.922 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:00.922 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:00.922 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:00.923 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:00.923 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:00.923 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:00.923 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:00.923 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:00.923 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:00.923 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:00.924 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:00.924 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:00.924 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.924 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:00.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.924 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:00.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.925 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:00.925 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:00.925 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:00.925 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:00.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.925 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:00.925 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:00.926 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.926 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:00.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:00.926 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.926 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.926 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.927 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:00.927 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:00.927 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:00.927 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:00.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.928 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:00.928 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:00.928 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:00.928 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:00.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.928 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:00.928 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:00.928 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.929 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:00.929 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:00.929 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.929 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.930 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:00.930 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:00.930 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:00.930 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:00.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.931 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:00.931 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:00.931 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:00.931 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:00.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.931 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:00.932 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:00.932 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.932 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:00.932 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:00.932 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:00.933 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.933 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:00.933 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:00.933 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:00.933 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:00.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:00.934 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:00.934 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:00.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.934 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:00.934 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:00.935 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:00.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.935 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:00.935 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:00.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:00.935 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:00.935 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:00.936 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:00.936 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.936 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:00.936 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:00.936 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:00.937 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:16:01.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.040+0000 7f336befe700 1 Processor -- start 2020-02-11T16:16:01.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.040+0000 7f336befe700 1 -- start start 2020-02-11T16:16:01.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.040+0000 7f336befe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33640a5de0 0x7f33640a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:01.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.040+0000 7f336befe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3364134a50 0x7f3364134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:01.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.040+0000 7f336befe700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33640a31b0 con 0x7f33640a18a0 2020-02-11T16:16:01.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.040+0000 7f336befe700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33640a3570 con 0x7f3364134a50 2020-02-11T16:16:01.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.040+0000 7f336befe700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33640a3810 con 0x7f33640a5de0 2020-02-11T16:16:01.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33640a5de0 0x7f33640a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:01.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369c9a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f33640a18a0 0x7f33640a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43444/0 (socket says 172.21.15.88:43444) 2020-02-11T16:16:01.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369c9a700 1 -- 172.21.15.88:0/2179845224 learned_addr learned my addr 172.21.15.88:0/2179845224 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:01.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 --2- 172.21.15.88:0/2179845224 >> v2:172.21.15.88:3300/0 conn(0x7f33640a5de0 0x7f33640a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55818/0 (socket says 172.21.15.88:55818) 2020-02-11T16:16:01.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f336a49b700 1 --2- 172.21.15.88:0/2179845224 >> v2:172.21.15.52:3300/0 conn(0x7f3364134a50 0x7f3364134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:01.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 -- 172.21.15.88:0/2179845224 >> v2:172.21.15.52:3300/0 conn(0x7f3364134a50 msgr2=0x7f3364134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:01.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 --2- 172.21.15.88:0/2179845224 >> v2:172.21.15.52:3300/0 conn(0x7f3364134a50 0x7f3364134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:01.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 -- 172.21.15.88:0/2179845224 >> v1:172.21.15.88:6789/0 conn(0x7f33640a18a0 legacy=0x7f33640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 -- 172.21.15.88:0/2179845224 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33640a3ab0 con 0x7f33640a5de0 2020-02-11T16:16:01.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3368c98700 1 -- 172.21.15.88:0/2179845224 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426821543 0 0) 0x7f33640a31b0 con 0x7f33640a18a0 2020-02-11T16:16:01.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f336a49b700 1 --2- 172.21.15.88:0/2179845224 >> v2:172.21.15.52:3300/0 conn(0x7f3364134a50 0x7f3364134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:16:01.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 --2- 172.21.15.88:0/2179845224 >> v2:172.21.15.88:3300/0 conn(0x7f33640a5de0 0x7f33640a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3360002f30 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 --2- 172.21.15.88:0/2179845224 >> v2:172.21.15.88:3300/0 conn(0x7f33640a5de0 0x7f33640a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3360002f30 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 --2- 172.21.15.88:0/2179845224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f33640a6260 secure :-1 s=READY pgs=496 cs=0 l=1 rx=0x7f3360002f30 tx=0x7f3360007a40).ready entity=mon.1 client_cookie=c317d1b4153512a3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:01.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 --2- 172.21.15.88:0/2179845224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f33640a6260 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7f3360002f30 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3368c98700 1 -- 172.21.15.88:0/2179845224 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3360011470 con 0x7f33640a5de0 2020-02-11T16:16:01.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 --2- 172.21.15.88:0/2179845224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f33640a6260 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7f3360002f30 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3368c98700 1 -- 172.21.15.88:0/2179845224 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33600115d0 con 0x7f33640a5de0 2020-02-11T16:16:01.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3369499700 1 --2- 172.21.15.88:0/2179845224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f33640a6260 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7f3360002f30 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f3368c98700 1 -- 172.21.15.88:0/2179845224 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3360011970 con 0x7f33640a5de0 2020-02-11T16:16:01.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f336befe700 1 -- 172.21.15.88:0/2179845224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 msgr2=0x7f33640a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.041+0000 7f336befe700 1 --2- 172.21.15.88:0/2179845224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f33640a6260 secure :-1 s=READY pgs=496 cs=0 l=1 rx=0x7f3360002f30 tx=0x7f3360007a40).stop 2020-02-11T16:16:01.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.042+0000 7f336befe700 1 -- 172.21.15.88:0/2179845224 shutdown_connections 2020-02-11T16:16:01.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.042+0000 7f336befe700 1 --2- 172.21.15.88:0/2179845224 >> v2:172.21.15.52:3300/0 conn(0x7f3364134a50 0x7f3364134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:01.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.042+0000 7f336befe700 1 --2- 172.21.15.88:0/2179845224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f33640a6260 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:01.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.042+0000 7f336befe700 1 -- 172.21.15.88:0/2179845224 >> 172.21.15.88:0/2179845224 conn(0x7f336409d110 msgr2=0x7f336409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:01.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.042+0000 7f336befe700 1 -- 172.21.15.88:0/2179845224 shutdown_connections 2020-02-11T16:16:01.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.042+0000 7f336befe700 1 -- 172.21.15.88:0/2179845224 wait complete. 2020-02-11T16:16:01.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f336befe700 1 Processor -- start 2020-02-11T16:16:01.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f336befe700 1 -- start start 2020-02-11T16:16:01.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f336befe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33640a5de0 0x7f3364137840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:01.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f336befe700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3364137120 con 0x7f3364134a50 2020-02-11T16:16:01.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f336befe700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33641316d0 con 0x7f33640a18a0 2020-02-11T16:16:01.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f336befe700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336405aaa0 con 0x7f33640a5de0 2020-02-11T16:16:01.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f3369c9a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f33640a18a0 0x7f33641308b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43450/0 (socket says 172.21.15.88:43450) 2020-02-11T16:16:01.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f3369c9a700 1 -- 172.21.15.88:0/3326470232 learned_addr learned my addr 172.21.15.88:0/3326470232 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:01.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f3369499700 1 --2- 172.21.15.88:0/3326470232 >> v2:172.21.15.88:3300/0 conn(0x7f33640a5de0 0x7f3364137840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:01.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f3369499700 1 -- 172.21.15.88:0/3326470232 >> v1:172.21.15.88:6789/0 conn(0x7f33640a18a0 legacy=0x7f33641308b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f3369499700 1 -- 172.21.15.88:0/3326470232 >> v1:172.21.15.52:6789/0 conn(0x7f3364134a50 legacy=0x7f3364130fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717805927 0 0) 0x7f33641316d0 con 0x7f33640a18a0 2020-02-11T16:16:01.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f3369499700 1 -- 172.21.15.88:0/3326470232 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3364136e80 con 0x7f33640a5de0 2020-02-11T16:16:01.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.043+0000 7f3369499700 1 --2- 172.21.15.88:0/3326470232 >> v2:172.21.15.88:3300/0 conn(0x7f33640a5de0 0x7f3364137840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f336405a850 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f3369499700 1 --2- 172.21.15.88:0/3326470232 >> v2:172.21.15.88:3300/0 conn(0x7f33640a5de0 0x7f3364137840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f336405a850 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f3369499700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f3364137840 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7f336405a850 tx=0x7f3360007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:01.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f3369499700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f3364137840 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f336405a850 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3360007150 con 0x7f33640a5de0 2020-02-11T16:16:01.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f3369499700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f3364137840 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f336405a850 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33600072b0 con 0x7f33640a5de0 2020-02-11T16:16:01.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f336befe700 1 -- 172.21.15.88:0/3326470232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33641373a0 con 0x7f33640a5de0 2020-02-11T16:16:01.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f3369499700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f3364137840 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f336405a850 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33600056c0 con 0x7f33640a5de0 2020-02-11T16:16:01.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f336befe700 1 -- 172.21.15.88:0/3326470232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3364131d90 con 0x7f33640a5de0 2020-02-11T16:16:01.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.044+0000 7f3369499700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f3364137840 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f336405a850 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f33600058c0 con 0x7f33640a5de0 2020-02-11T16:16:01.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f3369499700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f3364137840 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f336405a850 tx=0x7f3360007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f336befe700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 0x7f33641329c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:01.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f336befe700 1 -- 172.21.15.88:0/3326470232 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336405e2f0 con 0x7f336409e8b0 2020-02-11T16:16:01.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f3356ffd700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3344039ad0 0x7f334403bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:01.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f336004a070 con 0x7f33640a5de0 2020-02-11T16:16:01.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 0x7f33641329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:01.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f336a49b700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3344039ad0 0x7f334403bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:01.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f336a49b700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3344039ad0 0x7f334403bf90 crc :-1 s=READY pgs=281 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:01.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f3369c9a700 1 -- 172.21.15.88:0/3326470232 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33641375a0 con 0x7f336409e8b0 2020-02-11T16:16:01.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 0x7f33641329c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 0x7f33641329c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.045+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 0x7f33641329c0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:01.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.046+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 0x7f33641329c0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.046+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c010440 con 0x7f336409e8b0 2020-02-11T16:16:01.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.046+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 0x7f33641329c0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.046+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f335c0105a0 con 0x7f336409e8b0 2020-02-11T16:16:01.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.046+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 msgr2=0x7f33641329c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.046+0000 7f3356ffd700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 0x7f33641329c0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).stop 2020-02-11T16:16:01.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.046+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 msgr2=0x7f33641329c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:01.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.046+0000 7f3356ffd700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f336409e8b0 0x7f33641329c0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).stop 2020-02-11T16:16:01.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.054+0000 7f336befe700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 0x7f3364133200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:01.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.054+0000 7f336befe700 1 -- 172.21.15.88:0/3326470232 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33640565b0 con 0x7f3364132e20 2020-02-11T16:16:01.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.054+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 0x7f3364133200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:01.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.054+0000 7f3369c9a700 1 -- 172.21.15.88:0/3326470232 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f336409e5c0 con 0x7f3364132e20 2020-02-11T16:16:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.054+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 0x7f3364133200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.054+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 0x7f3364133200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.054+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 0x7f3364133200 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 0x7f3364133200 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c00f6f0 con 0x7f3364132e20 2020-02-11T16:16:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f3369c9a700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 0x7f3364133200 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f335c00f850 con 0x7f3364132e20 2020-02-11T16:16:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 msgr2=0x7f3364133200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f3356ffd700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 0x7f3364133200 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).stop 2020-02-11T16:16:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f3356ffd700 1 -- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 msgr2=0x7f3364133200 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f3356ffd700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3364132e20 0x7f3364133200 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0x7f335c0015e0 tx=0x7f335c001890).stop 2020-02-11T16:16:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f336befe700 1 -- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3344039ad0 msgr2=0x7f334403bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f336befe700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3344039ad0 0x7f334403bf90 crc :-1 s=READY pgs=281 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f336befe700 1 -- 172.21.15.88:0/3326470232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 msgr2=0x7f3364137840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f336befe700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f3364137840 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7f336405a850 tx=0x7f3360007a40).stop 2020-02-11T16:16:01.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f336a49b700 1 -- 172.21.15.88:0/3326470232 reap_dead start 2020-02-11T16:16:01.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f336befe700 1 -- 172.21.15.88:0/3326470232 shutdown_connections 2020-02-11T16:16:01.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f336befe700 1 --2- 172.21.15.88:0/3326470232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33640a5de0 0x7f3364137840 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:01.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f336befe700 1 -- 172.21.15.88:0/3326470232 >> 172.21.15.88:0/3326470232 conn(0x7f336409d110 msgr2=0x7f3364069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:01.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f336befe700 1 -- 172.21.15.88:0/3326470232 shutdown_connections 2020-02-11T16:16:01.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.055+0000 7f336befe700 1 -- 172.21.15.88:0/3326470232 wait complete. 2020-02-11T16:16:01.066 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:16:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 90, 2020-02-11T16:16:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:01.066 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:16:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2020-02-11T16:16:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:01.067 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:01.068 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:01.070 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:01.071 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:01.072 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:01.073 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.074 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:01.075 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.076 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:01.077 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:01.080 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:01.082 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:01.083 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:01.084 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:01.085 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:01.085 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:01.086 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:16:01.086 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:16:01.086 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:16:01.087 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:16:01.087 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:16:01.087 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:16:01.097 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:16:01.097 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:16:01.097 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:01.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.240+0000 7f7681ec1700 1 Processor -- start 2020-02-11T16:16:01.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.240+0000 7f7681ec1700 1 -- start start 2020-02-11T16:16:01.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.240+0000 7f7681ec1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f767c0a18a0 0x7f767c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:01.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.240+0000 7f7681ec1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:01.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.240+0000 7f7681ec1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f767c12e3a0 0x7f767c12e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:01.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.240+0000 7f7681ec1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c0a3570 con 0x7f767c12e3a0 2020-02-11T16:16:01.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.240+0000 7f7681ec1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c0a3810 con 0x7f767c0a18a0 2020-02-11T16:16:01.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.240+0000 7f7681ec1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0a3ab0 con 0x7f767c0a5de0 2020-02-11T16:16:01.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.240+0000 7f767b7fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f767c0a18a0 msgr2=0x7f767c0a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:01.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f767c0a18a0 0x7f767c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:01.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f767c12e3a0 0x7f767c12e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:01.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:01.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:50202/0 (socket says 172.21.15.88:50202) 2020-02-11T16:16:01.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f767c12e3a0 0x7f767c12e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:41868/0 (socket says 172.21.15.88:41868) 2020-02-11T16:16:01.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 -- 172.21.15.88:0/753291460 learned_addr learned my addr 172.21.15.88:0/753291460 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:01.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 -- 172.21.15.88:0/753291460 >> v2:172.21.15.88:3300/0 conn(0x7f767c0a18a0 msgr2=0x7f767c0a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:01.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 --2- 172.21.15.88:0/753291460 >> v2:172.21.15.88:3300/0 conn(0x7f767c0a18a0 0x7f767c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:01.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 -- 172.21.15.88:0/753291460 >> v2:172.21.15.52:3300/0 conn(0x7f767c12e3a0 msgr2=0x7f767c12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:01.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 --2- 172.21.15.88:0/753291460 >> v2:172.21.15.52:3300/0 conn(0x7f767c12e3a0 0x7f767c12e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:01.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 -- 172.21.15.88:0/753291460 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c0a3d50 con 0x7f767c0a5de0 2020-02-11T16:16:01.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767bfff700 1 --2- 172.21.15.88:0/753291460 >> v2:172.21.15.52:3300/0 conn(0x7f767c12e3a0 0x7f767c12e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:16:01.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 --2- 172.21.15.88:0/753291460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f767c05bbc0 tx=0x7f76700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 --2- 172.21.15.88:0/753291460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f767c05bbc0 tx=0x7f76700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 --2- 172.21.15.88:0/753291460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f767c05bbc0 tx=0x7f76700088e0).ready entity=mon.2 client_cookie=ffee78dd82cc62d5 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:01.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767affd700 1 --2- 172.21.15.88:0/753291460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f767c05bbc0 tx=0x7f76700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.241+0000 7f767a7fc700 1 -- 172.21.15.88:0/753291460 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7670008e20 con 0x7f767c0a5de0 2020-02-11T16:16:01.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f767affd700 1 --2- 172.21.15.88:0/753291460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f767c05bbc0 tx=0x7f76700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f767a7fc700 1 -- 172.21.15.88:0/753291460 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7670011820 con 0x7f767c0a5de0 2020-02-11T16:16:01.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f767affd700 1 --2- 172.21.15.88:0/753291460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f767c05bbc0 tx=0x7f76700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f767a7fc700 1 -- 172.21.15.88:0/753291460 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7670011c00 con 0x7f767c0a5de0 2020-02-11T16:16:01.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f7681ec1700 1 -- 172.21.15.88:0/753291460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 msgr2=0x7f767c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f7681ec1700 1 --2- 172.21.15.88:0/753291460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f767c05bbc0 tx=0x7f76700088e0).stop 2020-02-11T16:16:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f7681ec1700 1 -- 172.21.15.88:0/753291460 shutdown_connections 2020-02-11T16:16:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f7681ec1700 1 --2- 172.21.15.88:0/753291460 >> v2:172.21.15.52:3300/0 conn(0x7f767c12e3a0 0x7f767c12e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f7681ec1700 1 --2- 172.21.15.88:0/753291460 >> v2:172.21.15.88:3300/0 conn(0x7f767c0a18a0 0x7f767c0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f7681ec1700 1 --2- 172.21.15.88:0/753291460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c0a6260 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f7681ec1700 1 -- 172.21.15.88:0/753291460 >> 172.21.15.88:0/753291460 conn(0x7f767c09d110 msgr2=0x7f767c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f7681ec1700 1 -- 172.21.15.88:0/753291460 shutdown_connections 2020-02-11T16:16:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.242+0000 7f7681ec1700 1 -- 172.21.15.88:0/753291460 wait complete. 2020-02-11T16:16:01.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.243+0000 7f7681ec1700 1 Processor -- start 2020-02-11T16:16:01.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.243+0000 7f7681ec1700 1 -- start start 2020-02-11T16:16:01.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f7681ec1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:01.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f7681ec1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c12f320 con 0x7f767c12e3a0 2020-02-11T16:16:01.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f767b7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f767c0a18a0 legacy=0x7f767c131830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:16:01.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f7681ec1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c1342f0 con 0x7f767c0a18a0 2020-02-11T16:16:01.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f7681ec1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c135610 con 0x7f767c0a5de0 2020-02-11T16:16:01.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f767affd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:01.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f767bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f767c12e3a0 0x7f767c12f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:35296/0 (socket says 172.21.15.88:35296) 2020-02-11T16:16:01.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f767bfff700 1 -- 172.21.15.88:0/1779955445 learned_addr learned my addr 172.21.15.88:0/1779955445 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:01.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f7678ff9700 1 -- 172.21.15.88:0/1779955445 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799475549 0 0) 0x7f767c12f320 con 0x7f767c12e3a0 2020-02-11T16:16:01.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f7678ff9700 1 -- 172.21.15.88:0/1779955445 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f765c002fe0 con 0x7f767c12e3a0 2020-02-11T16:16:01.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f767affd700 1 -- 172.21.15.88:0/1779955445 >> v1:172.21.15.88:6789/0 conn(0x7f767c0a18a0 legacy=0x7f767c131830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:01.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f767affd700 1 -- 172.21.15.88:0/1779955445 >> v1:172.21.15.52:6789/0 conn(0x7f767c12e3a0 legacy=0x7f767c12f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f767affd700 1 -- 172.21.15.88:0/1779955445 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c134530 con 0x7f767c0a5de0 2020-02-11T16:16:01.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f767affd700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f767affd700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.244+0000 7f767affd700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:01.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.245+0000 7f767affd700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.245+0000 7f7678ff9700 1 -- 172.21.15.88:0/1779955445 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7670008e20 con 0x7f767c0a5de0 2020-02-11T16:16:01.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.245+0000 7f767affd700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.245+0000 7f7678ff9700 1 -- 172.21.15.88:0/1779955445 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76700058b0 con 0x7f767c0a5de0 2020-02-11T16:16:01.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.245+0000 7f767affd700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.245+0000 7f7681ec1700 1 -- 172.21.15.88:0/1779955445 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c12f550 con 0x7f767c0a5de0 2020-02-11T16:16:01.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.245+0000 7f7678ff9700 1 -- 172.21.15.88:0/1779955445 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7670005c10 con 0x7f767c0a5de0 2020-02-11T16:16:01.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.245+0000 7f7681ec1700 1 -- 172.21.15.88:0/1779955445 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c131f40 con 0x7f767c0a5de0 2020-02-11T16:16:01.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.245+0000 7f767affd700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.246+0000 7f7681ec1700 1 -- 172.21.15.88:0/1779955445 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c0565b0 con 0x7f767c0a5de0 2020-02-11T16:16:01.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.246+0000 7f7678ff9700 1 -- 172.21.15.88:0/1779955445 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7670007fa0 con 0x7f767c0a5de0 2020-02-11T16:16:01.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.246+0000 7f767affd700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.246+0000 7f7678ff9700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f765c039f40 0x7f765c03c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:01.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.246+0000 7f7678ff9700 1 -- 172.21.15.88:0/1779955445 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7670049860 con 0x7f767c0a5de0 2020-02-11T16:16:01.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.246+0000 7f767b7fe700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f765c039f40 0x7f765c03c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:01.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.246+0000 7f767b7fe700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f765c039f40 0x7f765c03c400 crc :-1 s=READY pgs=282 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:01.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.250+0000 7f767affd700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.250+0000 7f7678ff9700 1 -- 172.21.15.88:0/1779955445 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f767002ef20 con 0x7f767c0a5de0 2020-02-11T16:16:01.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.433+0000 7f7681ec1700 1 -- 172.21.15.88:0/1779955445 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f767c133760 con 0x7f767c0a5de0 2020-02-11T16:16:01.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f767affd700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:01.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7678ff9700 1 -- 172.21.15.88:0/1779955445 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f76700319f0 con 0x7f767c0a5de0 2020-02-11T16:16:01.437 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:01.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7681ec1700 1 -- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f765c039f40 msgr2=0x7f765c03c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7681ec1700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f765c039f40 0x7f765c03c400 crc :-1 s=READY pgs=282 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:01.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7681ec1700 1 -- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 msgr2=0x7f767c133e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:01.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7681ec1700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f767c135450 tx=0x7f767c0a1c80).stop 2020-02-11T16:16:01.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7681ec1700 1 -- 172.21.15.88:0/1779955445 shutdown_connections 2020-02-11T16:16:01.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7681ec1700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f765c039f40 0x7f765c03c400 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:01.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7681ec1700 1 --2- 172.21.15.88:0/1779955445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f767c0a5de0 0x7f767c133e90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:01.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7681ec1700 1 -- 172.21.15.88:0/1779955445 >> 172.21.15.88:0/1779955445 conn(0x7f767c09d110 msgr2=0x7f767c05ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:01.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7681ec1700 1 -- 172.21.15.88:0/1779955445 shutdown_connections 2020-02-11T16:16:01.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:01.435+0000 7f7681ec1700 1 -- 172.21.15.88:0/1779955445 wait complete. 2020-02-11T16:16:01.448 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":90,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:04.449 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:04.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.563+0000 7fd60b5a4700 1 Processor -- start 2020-02-11T16:16:04.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.563+0000 7fd60b5a4700 1 -- start start 2020-02-11T16:16:04.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.563+0000 7fd60b5a4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 0x7fd6040a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:04.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd60b5a4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:04.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd60b5a4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6040a31b0 con 0x7fd60412e3a0 2020-02-11T16:16:04.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd60b5a4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6040a3570 con 0x7fd6040a18a0 2020-02-11T16:16:04.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd60b5a4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040a3810 con 0x7fd6040a5de0 2020-02-11T16:16:04.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd609340700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 msgr2=0x7fd6040a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:04.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd609b41700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fd60412e3a0 legacy=0x7fd60412e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:16:04.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd609340700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 0x7fd6040a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:04.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd608b3f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:04.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd608b3f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:50218/0 (socket says 172.21.15.88:50218) 2020-02-11T16:16:04.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd608b3f700 1 -- 172.21.15.88:0/4093172046 learned_addr learned my addr 172.21.15.88:0/4093172046 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:04.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd608b3f700 1 -- 172.21.15.88:0/4093172046 >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 msgr2=0x7fd6040a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:04.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd608b3f700 1 --2- 172.21.15.88:0/4093172046 >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 0x7fd6040a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:04.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd608b3f700 1 -- 172.21.15.88:0/4093172046 >> v1:172.21.15.88:6789/0 conn(0x7fd60412e3a0 legacy=0x7fd60412e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:04.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd608b3f700 1 -- 172.21.15.88:0/4093172046 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6040a3ab0 con 0x7fd6040a5de0 2020-02-11T16:16:04.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.564+0000 7fd608b3f700 1 --2- 172.21.15.88:0/4093172046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd60405b910 tx=0x7fd5f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd608b3f700 1 --2- 172.21.15.88:0/4093172046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd60405b910 tx=0x7fd5f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd608b3f700 1 --2- 172.21.15.88:0/4093172046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fd60405b910 tx=0x7fd5f40088e0).ready entity=mon.2 client_cookie=f7d9e102a323643d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:04.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd608b3f700 1 --2- 172.21.15.88:0/4093172046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fd60405b910 tx=0x7fd5f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd5f3fff700 1 -- 172.21.15.88:0/4093172046 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f4008e20 con 0x7fd6040a5de0 2020-02-11T16:16:04.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd608b3f700 1 --2- 172.21.15.88:0/4093172046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fd60405b910 tx=0x7fd5f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd5f3fff700 1 -- 172.21.15.88:0/4093172046 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f4011910 con 0x7fd6040a5de0 2020-02-11T16:16:04.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd608b3f700 1 --2- 172.21.15.88:0/4093172046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fd60405b910 tx=0x7fd5f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd5f3fff700 1 -- 172.21.15.88:0/4093172046 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f4011cb0 con 0x7fd6040a5de0 2020-02-11T16:16:04.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd60b5a4700 1 -- 172.21.15.88:0/4093172046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 msgr2=0x7fd6040a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:04.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd60b5a4700 1 --2- 172.21.15.88:0/4093172046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fd60405b910 tx=0x7fd5f40088e0).stop 2020-02-11T16:16:04.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd60b5a4700 1 -- 172.21.15.88:0/4093172046 shutdown_connections 2020-02-11T16:16:04.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd60b5a4700 1 --2- 172.21.15.88:0/4093172046 >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 0x7fd6040a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:04.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd60b5a4700 1 --2- 172.21.15.88:0/4093172046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6040a5de0 0x7fd6040a6260 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:04.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd60b5a4700 1 -- 172.21.15.88:0/4093172046 >> 172.21.15.88:0/4093172046 conn(0x7fd60409d110 msgr2=0x7fd60409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:04.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd60b5a4700 1 -- 172.21.15.88:0/4093172046 shutdown_connections 2020-02-11T16:16:04.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.565+0000 7fd60b5a4700 1 -- 172.21.15.88:0/4093172046 wait complete. 2020-02-11T16:16:04.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.566+0000 7fd60b5a4700 1 Processor -- start 2020-02-11T16:16:04.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.566+0000 7fd60b5a4700 1 -- start start 2020-02-11T16:16:04.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd60b5a4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 0x7fd60412d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:04.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd60b5a4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd60412e3a0 0x7fd60412dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd60b5a4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd604130950 con 0x7fd6040a5de0 2020-02-11T16:16:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd60b5a4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd604130bf0 con 0x7fd60412e3a0 2020-02-11T16:16:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd60b5a4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd604130e90 con 0x7fd6040a18a0 2020-02-11T16:16:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd609340700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 msgr2=0x7fd60412d7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd608b3f700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fd6040a5de0 legacy=0x7fd604148830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:16:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd609340700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 0x7fd60412d7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:04.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd609b41700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd60412e3a0 0x7fd60412dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:04.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd609b41700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd60412e3a0 0x7fd60412dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:41888/0 (socket says 172.21.15.88:41888) 2020-02-11T16:16:04.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd609b41700 1 -- 172.21.15.88:0/2900643541 learned_addr learned my addr 172.21.15.88:0/2900643541 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:04.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd609b41700 1 -- 172.21.15.88:0/2900643541 >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 msgr2=0x7fd60412d7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:04.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 0x7fd60412d7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:04.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd609b41700 1 -- 172.21.15.88:0/2900643541 >> v1:172.21.15.88:6789/0 conn(0x7fd6040a5de0 legacy=0x7fd604148830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:04.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd609b41700 1 -- 172.21.15.88:0/2900643541 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60412e080 con 0x7fd60412e3a0 2020-02-11T16:16:04.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.567+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> v2:172.21.15.52:3300/0 conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> v2:172.21.15.52:3300/0 conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:04.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd5f27fc700 1 -- 172.21.15.88:0/2900643541 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd600011610 con 0x7fd60412e3a0 2020-02-11T16:16:04.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd5f27fc700 1 -- 172.21.15.88:0/2900643541 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6000117b0 con 0x7fd60412e3a0 2020-02-11T16:16:04.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd60b5a4700 1 -- 172.21.15.88:0/2900643541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd604065660 con 0x7fd60412e3a0 2020-02-11T16:16:04.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd5f27fc700 1 -- 172.21.15.88:0/2900643541 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd600011bd0 con 0x7fd60412e3a0 2020-02-11T16:16:04.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd60b5a4700 1 -- 172.21.15.88:0/2900643541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6041350b0 con 0x7fd60412e3a0 2020-02-11T16:16:04.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.568+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.569+0000 7fd5f27fc700 1 -- 172.21.15.88:0/2900643541 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd60000b180 con 0x7fd60412e3a0 2020-02-11T16:16:04.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.569+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.569+0000 7fd60b5a4700 1 -- 172.21.15.88:0/2900643541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6040565b0 con 0x7fd60412e3a0 2020-02-11T16:16:04.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.569+0000 7fd5f27fc700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd5e4039c40 0x7fd5e403c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:04.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.569+0000 7fd5f27fc700 1 -- 172.21.15.88:0/2900643541 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fd6000495a0 con 0x7fd60412e3a0 2020-02-11T16:16:04.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.569+0000 7fd609340700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd5e4039c40 0x7fd5e403c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:04.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.569+0000 7fd609340700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd5e4039c40 0x7fd5e403c100 crc :-1 s=READY pgs=283 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:04.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.573+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.573+0000 7fd5f27fc700 1 -- 172.21.15.88:0/2900643541 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd60002ec40 con 0x7fd60412e3a0 2020-02-11T16:16:04.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.752+0000 7fd60b5a4700 1 -- 172.21.15.88:0/2900643541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd6040657f0 con 0x7fd60412e3a0 2020-02-11T16:16:04.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.753+0000 7fd609b41700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:04.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.753+0000 7fd5f27fc700 1 -- 172.21.15.88:0/2900643541 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fd600031750 con 0x7fd60412e3a0 2020-02-11T16:16:04.756 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:04.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 -- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd5e4039c40 msgr2=0x7fd5e403c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:04.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd5e4039c40 0x7fd5e403c100 crc :-1 s=READY pgs=283 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:04.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 -- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 msgr2=0x7fd60412dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:04.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 0x7fd60412dc20 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fd6040668d0 tx=0x7fd600010940).stop 2020-02-11T16:16:04.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 -- 172.21.15.88:0/2900643541 shutdown_connections 2020-02-11T16:16:04.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd5e4039c40 0x7fd5e403c100 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:04.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 --2- 172.21.15.88:0/2900643541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd60412e3a0 0x7fd60412dc20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:04.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 --2- 172.21.15.88:0/2900643541 >> v2:172.21.15.88:3300/0 conn(0x7fd6040a18a0 0x7fd60412d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:04.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 -- 172.21.15.88:0/2900643541 >> 172.21.15.88:0/2900643541 conn(0x7fd60409d110 msgr2=0x7fd6040a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:04.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 -- 172.21.15.88:0/2900643541 shutdown_connections 2020-02-11T16:16:04.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:04.754+0000 7fd60b5a4700 1 -- 172.21.15.88:0/2900643541 wait complete. 2020-02-11T16:16:04.767 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":90,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:07.768 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:07.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.880+0000 7fded2543700 1 Processor -- start 2020-02-11T16:16:07.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.880+0000 7fded2543700 1 -- start start 2020-02-11T16:16:07.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.880+0000 7fded2543700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 0x7fdecc0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:07.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.880+0000 7fded2543700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdecc0a6260 0x7fdecc12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:07.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.880+0000 7fded2543700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc0a3570 con 0x7fdecc0a5de0 2020-02-11T16:16:07.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.880+0000 7fded2543700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc0a3810 con 0x7fdecc0a6260 2020-02-11T16:16:07.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.880+0000 7fded2543700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc0a3ab0 con 0x7fdecc0a18a0 2020-02-11T16:16:07.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fdecbfff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 msgr2=0x7fdecc0a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:07.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fdecb7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fdecc0a5de0 legacy=0x7fdecc12e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:16:07.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fdecbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 0x7fdecc0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fded0ae0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdecc0a6260 0x7fdecc12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fded0ae0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdecc0a6260 0x7fdecc12eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:41892/0 (socket says 172.21.15.88:41892) 2020-02-11T16:16:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fded0ae0700 1 -- 172.21.15.88:0/2007135506 learned_addr learned my addr 172.21.15.88:0/2007135506 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fded0ae0700 1 -- 172.21.15.88:0/2007135506 >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 msgr2=0x7fdecc0a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2007135506 >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 0x7fdecc0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fded0ae0700 1 -- 172.21.15.88:0/2007135506 >> v1:172.21.15.88:6789/0 conn(0x7fdecc0a5de0 legacy=0x7fdecc12e3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:07.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fded0ae0700 1 -- 172.21.15.88:0/2007135506 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc0a3d50 con 0x7fdecc0a6260 2020-02-11T16:16:07.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2007135506 >> v2:172.21.15.52:3300/0 conn(0x7fdecc0a6260 0x7fdecc12eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2007135506 >> v2:172.21.15.52:3300/0 conn(0x7fdecc0a6260 0x7fdecc12eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.881+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2007135506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc12eab0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).ready entity=mon.0 client_cookie=f37ce4874b0f3190 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:07.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2007135506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc12eab0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fdecaffd700 1 -- 172.21.15.88:0/2007135506 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec4011e50 con 0x7fdecc0a6260 2020-02-11T16:16:07.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2007135506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc12eab0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2007135506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc12eab0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fdecaffd700 1 -- 172.21.15.88:0/2007135506 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec400a350 con 0x7fdecc0a6260 2020-02-11T16:16:07.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fdecaffd700 1 -- 172.21.15.88:0/2007135506 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec400a730 con 0x7fdecc0a6260 2020-02-11T16:16:07.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded2543700 1 -- 172.21.15.88:0/2007135506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 msgr2=0x7fdecc12eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:07.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded2543700 1 --2- 172.21.15.88:0/2007135506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc12eab0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).stop 2020-02-11T16:16:07.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded2543700 1 -- 172.21.15.88:0/2007135506 shutdown_connections 2020-02-11T16:16:07.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded2543700 1 --2- 172.21.15.88:0/2007135506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc12eab0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:07.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded2543700 1 --2- 172.21.15.88:0/2007135506 >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 0x7fdecc0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:07.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded2543700 1 -- 172.21.15.88:0/2007135506 >> 172.21.15.88:0/2007135506 conn(0x7fdecc09d110 msgr2=0x7fdecc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:07.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded2543700 1 -- 172.21.15.88:0/2007135506 shutdown_connections 2020-02-11T16:16:07.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.882+0000 7fded2543700 1 -- 172.21.15.88:0/2007135506 wait complete. 2020-02-11T16:16:07.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.883+0000 7fded2543700 1 Processor -- start 2020-02-11T16:16:07.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.883+0000 7fded2543700 1 -- start start 2020-02-11T16:16:07.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded2543700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 0x7fdecc146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:07.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded2543700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdecc0a6260 0x7fdecc14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded2543700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc138cf0 con 0x7fdecc0a5de0 2020-02-11T16:16:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded2543700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc09e180 con 0x7fdecc0a6260 2020-02-11T16:16:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fdecbfff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 msgr2=0x7fdecc146840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded2543700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc09e390 con 0x7fdecc0a18a0 2020-02-11T16:16:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fdecbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 0x7fdecc146840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded0ae0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdecc0a6260 0x7fdecc14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:07.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded0ae0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdecc0a6260 0x7fdecc14dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:41898/0 (socket says 172.21.15.88:41898) 2020-02-11T16:16:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded0ae0700 1 -- 172.21.15.88:0/2553380403 learned_addr learned my addr 172.21.15.88:0/2553380403 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded0ae0700 1 -- 172.21.15.88:0/2553380403 >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 msgr2=0x7fdecc146840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 0x7fdecc146840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded0ae0700 1 -- 172.21.15.88:0/2553380403 >> v1:172.21.15.52:6789/0 conn(0x7fdecc0a5de0 legacy=0x7fdecc128690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded0ae0700 1 -- 172.21.15.88:0/2553380403 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc135bc0 con 0x7fdecc0a6260 2020-02-11T16:16:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> v2:172.21.15.52:3300/0 conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> v2:172.21.15.52:3300/0 conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.884+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fdec97fa700 1 -- 172.21.15.88:0/2553380403 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec4005c30 con 0x7fdecc0a6260 2020-02-11T16:16:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fdec97fa700 1 -- 172.21.15.88:0/2553380403 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec4005d90 con 0x7fdecc0a6260 2020-02-11T16:16:07.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fded2543700 1 -- 172.21.15.88:0/2553380403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc0a5220 con 0x7fdecc0a6260 2020-02-11T16:16:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fdec97fa700 1 -- 172.21.15.88:0/2553380403 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec400f760 con 0x7fdecc0a6260 2020-02-11T16:16:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fded2543700 1 -- 172.21.15.88:0/2553380403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc134300 con 0x7fdecc0a6260 2020-02-11T16:16:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fdec97fa700 1 -- 172.21.15.88:0/2553380403 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdec400f8c0 con 0x7fdecc0a6260 2020-02-11T16:16:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.885+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.886+0000 7fded2543700 1 -- 172.21.15.88:0/2553380403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc134690 con 0x7fdecc0a6260 2020-02-11T16:16:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.886+0000 7fdec97fa700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdeac039cb0 0x7fdeac03c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.886+0000 7fdec97fa700 1 -- 172.21.15.88:0/2553380403 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdec404aa40 con 0x7fdecc0a6260 2020-02-11T16:16:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.886+0000 7fdecbfff700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdeac039cb0 0x7fdeac03c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.886+0000 7fdecbfff700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdeac039cb0 0x7fdeac03c170 crc :-1 s=READY pgs=284 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.889+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:07.889+0000 7fdec97fa700 1 -- 172.21.15.88:0/2553380403 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fdec4030100 con 0x7fdecc0a6260 2020-02-11T16:16:08.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.072+0000 7fded2543700 1 -- 172.21.15.88:0/2553380403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdecc0565b0 con 0x7fdecc0a6260 2020-02-11T16:16:08.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.072+0000 7fded0ae0700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:08.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.072+0000 7fdec97fa700 1 -- 172.21.15.88:0/2553380403 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fdec4007c20 con 0x7fdecc0a6260 2020-02-11T16:16:08.076 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:08.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 -- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdeac039cb0 msgr2=0x7fdeac03c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:08.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdeac039cb0 0x7fdeac03c170 crc :-1 s=READY pgs=284 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:08.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 -- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 msgr2=0x7fdecc14dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:08.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc14dba0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fdecc05bbc0 tx=0x7fdec4007dc0).stop 2020-02-11T16:16:08.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 -- 172.21.15.88:0/2553380403 shutdown_connections 2020-02-11T16:16:08.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdeac039cb0 0x7fdeac03c170 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:08.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 --2- 172.21.15.88:0/2553380403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdecc0a6260 0x7fdecc14dba0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:08.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 --2- 172.21.15.88:0/2553380403 >> v2:172.21.15.88:3300/0 conn(0x7fdecc0a18a0 0x7fdecc146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:08.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 -- 172.21.15.88:0/2553380403 >> 172.21.15.88:0/2553380403 conn(0x7fdecc09d110 msgr2=0x7fdecc0a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:08.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 -- 172.21.15.88:0/2553380403 shutdown_connections 2020-02-11T16:16:08.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:08.074+0000 7fded2543700 1 -- 172.21.15.88:0/2553380403 wait complete. 2020-02-11T16:16:08.087 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":90,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:11.088 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:11.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.202+0000 7f93a8459700 1 Processor -- start 2020-02-11T16:16:11.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.202+0000 7f93a8459700 1 -- start start 2020-02-11T16:16:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a8459700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a8459700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 0x7f93a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a8459700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a00a4350 con 0x7f93a0131280 2020-02-11T16:16:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a8459700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a00a1e60 con 0x7f93a00a2fa0 2020-02-11T16:16:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a8459700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a00a3450 con 0x7f93a00a5410 2020-02-11T16:16:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a59f4700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 msgr2=0x7f93a00a5870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a59f4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 0x7f93a00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a61f5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a61f5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:41902/0 (socket says 172.21.15.88:41902) 2020-02-11T16:16:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 learned_addr learned my addr 172.21.15.88:0/375618247 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:16:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:16:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:16:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.203+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:11.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.404+0000 7f93a59f4700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 msgr2=0x7f93a00a5870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:11.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.404+0000 7f93a59f4700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 0x7f93a00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:16:11.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.404+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:11.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.404+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:16:11.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.404+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:16:11.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.404+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:16:11.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.404+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:16:11.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.805+0000 7f93a59f4700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 msgr2=0x7f93a00a5870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.805+0000 7f93a59f4700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 0x7f93a00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:16:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.805+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.805+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:16:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.805+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:16:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.805+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:16:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:11.805+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:16:12.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:12.606+0000 7f93a59f4700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 msgr2=0x7f93a00a5870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:12.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:12.606+0000 7f93a59f4700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 0x7f93a00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:16:12.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:12.606+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:12.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:12.607+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:16:12.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:12.607+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:16:12.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:12.607+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:16:12.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:12.607+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:16:13.328 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:16:13.333 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:16:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:14.207+0000 7f93a59f4700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 msgr2=0x7f93a00a5870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:14.207+0000 7f93a59f4700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 0x7f93a00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:16:14.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:14.209+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:14.209+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:16:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:14.209+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:16:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:14.209+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:16:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:14.209+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:16:15.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.808+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764404666 0 0) 0x7f93a00a4350 con 0x7f93a0131280 2020-02-11T16:16:15.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.808+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9388003230 con 0x7f93a0131280 2020-02-11T16:16:15.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4037404857 0 0) 0x7f9388003230 con 0x7f93a0131280 2020-02-11T16:16:15.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 msgr2=0x7f93a00a5870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:15.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.88:3300/0 conn(0x7f93a00a5410 0x7f93a00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:15.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 msgr2=0x7f93a00a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:15.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 --2- 172.21.15.88:0/375618247 >> v2:172.21.15.52:3300/0 conn(0x7f93a00a2fa0 0x7f93a00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:15.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a00a3a40 con 0x7f93a0131280 2020-02-11T16:16:15.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f939c0016b0 con 0x7f93a0131280 2020-02-11T16:16:15.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 >> v1:172.21.15.52:6789/0 conn(0x7f93a0131280 legacy=0x7f93a01316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:15.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f9388003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:15.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9388003ff0 0x7f93880044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:15.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9388004a40 0x7f9388004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:15.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00a1e60 con 0x7f9388003750 2020-02-11T16:16:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938800b810 con 0x7f9388003ff0 2020-02-11T16:16:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938800b9d0 con 0x7f9388004a40 2020-02-11T16:16:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a59f4700 1 -- 172.21.15.88:0/375618247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9388003ff0 msgr2=0x7f93880044d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a59f4700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9388003ff0 0x7f93880044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f9388003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a69f6700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9388004a40 0x7f9388004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9388004a40 msgr2=0x7f9388004ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9388004a40 0x7f9388004ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9388003ff0 msgr2=0x7f93880044d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9388003ff0 0x7f93880044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a61f5700 1 -- 172.21.15.88:0/375618247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9388003230 con 0x7f9388003750 2020-02-11T16:16:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.810+0000 7f93a69f6700 1 -- 172.21.15.88:0/375618247 reap_dead start 2020-02-11T16:16:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.811+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f9388003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f93980032b0 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.811+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f9388003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f93980032b0 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.811+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f9388003b70 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f93980032b0 tx=0x7f9398007ae0).ready entity=mon.0 client_cookie=d16564e3e9f33d2f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:15.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.812+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f9388003b70 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f93980032b0 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.812+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9398005c30 con 0x7f9388003750 2020-02-11T16:16:15.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.812+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f9388003b70 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f93980032b0 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.812+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9398005d90 con 0x7f9388003750 2020-02-11T16:16:15.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.812+0000 7f93a61f5700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f9388003b70 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f93980032b0 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.812+0000 7f93a51f3700 1 -- 172.21.15.88:0/375618247 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93980122b0 con 0x7f9388003750 2020-02-11T16:16:15.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.812+0000 7f93a8459700 1 -- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 msgr2=0x7f9388003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:15.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.812+0000 7f93a8459700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f9388003b70 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f93980032b0 tx=0x7f9398007ae0).stop 2020-02-11T16:16:15.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.813+0000 7f93a8459700 1 -- 172.21.15.88:0/375618247 shutdown_connections 2020-02-11T16:16:15.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.813+0000 7f93a8459700 1 --2- 172.21.15.88:0/375618247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f9388003b70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:15.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.813+0000 7f93a8459700 1 -- 172.21.15.88:0/375618247 >> 172.21.15.88:0/375618247 conn(0x7f93a009d110 msgr2=0x7f93a009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:15.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.813+0000 7f93a8459700 1 -- 172.21.15.88:0/375618247 shutdown_connections 2020-02-11T16:16:15.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.813+0000 7f93a8459700 1 -- 172.21.15.88:0/375618247 wait complete. 2020-02-11T16:16:15.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.814+0000 7f93a8459700 1 Processor -- start 2020-02-11T16:16:15.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.814+0000 7f93a8459700 1 -- start start 2020-02-11T16:16:15.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a8459700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9388003750 0x7f93a00617d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a8459700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93a0140b00 0x7f93a0061d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a8459700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a0140f90 con 0x7f93a012bed0 2020-02-11T16:16:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a8459700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a0063cd0 con 0x7f9388003750 2020-02-11T16:16:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a8459700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a0061330 con 0x7f93a0140b00 2020-02-11T16:16:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a59f4700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f93a0140b00 msgr2=0x7f93a0061d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a59f4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93a0140b00 0x7f93a0061d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a61f5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9388003750 0x7f93a00617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a61f5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9388003750 0x7f93a00617d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:41930/0 (socket says 172.21.15.88:41930) 2020-02-11T16:16:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a61f5700 1 -- 172.21.15.88:0/1699010150 learned_addr learned my addr 172.21.15.88:0/1699010150 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a61f5700 1 -- 172.21.15.88:0/1699010150 >> v2:172.21.15.88:3300/0 conn(0x7f93a0140b00 msgr2=0x7f93a0061d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> v2:172.21.15.88:3300/0 conn(0x7f93a0140b00 0x7f93a0061d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a61f5700 1 -- 172.21.15.88:0/1699010150 >> v1:172.21.15.52:6789/0 conn(0x7f93a012bed0 legacy=0x7f93a0144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a61f5700 1 -- 172.21.15.88:0/1699010150 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a012ff00 con 0x7f9388003750 2020-02-11T16:16:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.815+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> v2:172.21.15.52:3300/0 conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> v2:172.21.15.52:3300/0 conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f938f7fe700 1 -- 172.21.15.88:0/1699010150 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93980124c0 con 0x7f9388003750 2020-02-11T16:16:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f938f7fe700 1 -- 172.21.15.88:0/1699010150 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9398012660 con 0x7f9388003750 2020-02-11T16:16:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f93a8459700 1 -- 172.21.15.88:0/1699010150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a00a4780 con 0x7f9388003750 2020-02-11T16:16:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f938f7fe700 1 -- 172.21.15.88:0/1699010150 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9398012a80 con 0x7f9388003750 2020-02-11T16:16:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f93a8459700 1 -- 172.21.15.88:0/1699010150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a00a0ec0 con 0x7f9388003750 2020-02-11T16:16:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.816+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.817+0000 7f938f7fe700 1 -- 172.21.15.88:0/1699010150 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f9398012cf0 con 0x7f9388003750 2020-02-11T16:16:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.817+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.817+0000 7f938f7fe700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9380039ca0 0x7f938003c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.817+0000 7f938f7fe700 1 -- 172.21.15.88:0/1699010150 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f939804b220 con 0x7f9388003750 2020-02-11T16:16:15.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.817+0000 7f93a59f4700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9380039ca0 0x7f938003c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:15.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.817+0000 7f93a8459700 1 -- 172.21.15.88:0/1699010150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a00a0b30 con 0x7f9388003750 2020-02-11T16:16:15.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.818+0000 7f93a59f4700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9380039ca0 0x7f938003c160 crc :-1 s=READY pgs=285 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:15.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.821+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:15.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:15.821+0000 7f938f7fe700 1 -- 172.21.15.88:0/1699010150 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f93980308c0 con 0x7f9388003750 2020-02-11T16:16:16.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.008+0000 7f93a8459700 1 -- 172.21.15.88:0/1699010150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f93a00623b0 con 0x7f9388003750 2020-02-11T16:16:16.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.009+0000 7f93a61f5700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.009+0000 7f938f7fe700 1 -- 172.21.15.88:0/1699010150 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7f93980333d0 con 0x7f9388003750 2020-02-11T16:16:16.010 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":94,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:16.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 -- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9380039ca0 msgr2=0x7f938003c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9380039ca0 0x7f938003c160 crc :-1 s=READY pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 -- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 msgr2=0x7f93a00617d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f93a00617d0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f93a0141c30 tx=0x7f9398007ae0).stop 2020-02-11T16:16:16.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 -- 172.21.15.88:0/1699010150 shutdown_connections 2020-02-11T16:16:16.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9380039ca0 0x7f938003c160 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 --2- 172.21.15.88:0/1699010150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9388003750 0x7f93a00617d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 --2- 172.21.15.88:0/1699010150 >> v2:172.21.15.88:3300/0 conn(0x7f93a0140b00 0x7f93a0061d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 -- 172.21.15.88:0/1699010150 >> 172.21.15.88:0/1699010150 conn(0x7f93a009d110 msgr2=0x7f93a0130880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 -- 172.21.15.88:0/1699010150 shutdown_connections 2020-02-11T16:16:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.010+0000 7f93a8459700 1 -- 172.21.15.88:0/1699010150 wait complete. 2020-02-11T16:16:16.022 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":94,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:16.022 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:16:16.022 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:16:16.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.126+0000 7fe18c196700 1 Processor -- start 2020-02-11T16:16:16.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.126+0000 7fe18c196700 1 -- start start 2020-02-11T16:16:16.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe18c196700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1840a6ff0 0x7fe1840a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:16.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe18c196700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe1840a2870 0x7fe18413b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:16.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe18c196700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:16.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe18c196700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1840a8630 con 0x7fe1840a2870 2020-02-11T16:16:16.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe18c196700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1840a2cf0 con 0x7fe1840a6ff0 2020-02-11T16:16:16.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe18c196700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840a30c0 con 0x7fe18413b640 2020-02-11T16:16:16.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe189f32700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fe1840a6ff0 msgr2=0x7fe1840a73d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:16.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe189f32700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1840a6ff0 0x7fe1840a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:16.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe18a733700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe18a733700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:50280/0 (socket says 172.21.15.88:50280) 2020-02-11T16:16:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe189731700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe1840a2870 0x7fe18413b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.127+0000 7fe18a733700 1 -- 172.21.15.88:0/1470584180 learned_addr learned my addr 172.21.15.88:0/1470584180 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 -- 172.21.15.88:0/1470584180 >> v2:172.21.15.88:3300/0 conn(0x7fe1840a6ff0 msgr2=0x7fe1840a73d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 --2- 172.21.15.88:0/1470584180 >> v2:172.21.15.88:3300/0 conn(0x7fe1840a6ff0 0x7fe1840a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 -- 172.21.15.88:0/1470584180 >> v2:172.21.15.52:3300/0 conn(0x7fe1840a2870 msgr2=0x7fe18413b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 --2- 172.21.15.88:0/1470584180 >> v2:172.21.15.52:3300/0 conn(0x7fe1840a2870 0x7fe18413b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 -- 172.21.15.88:0/1470584180 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840a2130 con 0x7fe18413b640 2020-02-11T16:16:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 --2- 172.21.15.88:0/1470584180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe17c0032b0 tx=0x7fe17c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 --2- 172.21.15.88:0/1470584180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe17c0032b0 tx=0x7fe17c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 --2- 172.21.15.88:0/1470584180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fe17c0032b0 tx=0x7fe17c007dc0).ready entity=mon.2 client_cookie=d2b0f85a76418244 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:16.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 --2- 172.21.15.88:0/1470584180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fe17c0032b0 tx=0x7fe17c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe188f30700 1 -- 172.21.15.88:0/1470584180 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17c00a160 con 0x7fe18413b640 2020-02-11T16:16:16.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 --2- 172.21.15.88:0/1470584180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fe17c0032b0 tx=0x7fe17c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18a733700 1 --2- 172.21.15.88:0/1470584180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fe17c0032b0 tx=0x7fe17c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe188f30700 1 -- 172.21.15.88:0/1470584180 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c00a2c0 con 0x7fe18413b640 2020-02-11T16:16:16.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe188f30700 1 -- 172.21.15.88:0/1470584180 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17c00a660 con 0x7fe18413b640 2020-02-11T16:16:16.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18c196700 1 -- 172.21.15.88:0/1470584180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 msgr2=0x7fe18413baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.128+0000 7fe18c196700 1 --2- 172.21.15.88:0/1470584180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fe17c0032b0 tx=0x7fe17c007dc0).stop 2020-02-11T16:16:16.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.129+0000 7fe18c196700 1 -- 172.21.15.88:0/1470584180 shutdown_connections 2020-02-11T16:16:16.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.129+0000 7fe18c196700 1 --2- 172.21.15.88:0/1470584180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe18413b640 0x7fe18413baf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.129+0000 7fe18c196700 1 --2- 172.21.15.88:0/1470584180 >> v2:172.21.15.88:3300/0 conn(0x7fe1840a6ff0 0x7fe1840a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:16.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.129+0000 7fe18c196700 1 --2- 172.21.15.88:0/1470584180 >> v2:172.21.15.52:3300/0 conn(0x7fe1840a2870 0x7fe18413b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:16.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.129+0000 7fe18c196700 1 -- 172.21.15.88:0/1470584180 >> 172.21.15.88:0/1470584180 conn(0x7fe1840ac2d0 msgr2=0x7fe1840ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:16.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.129+0000 7fe18c196700 1 -- 172.21.15.88:0/1470584180 shutdown_connections 2020-02-11T16:16:16.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.129+0000 7fe18c196700 1 -- 172.21.15.88:0/1470584180 wait complete. 2020-02-11T16:16:16.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.129+0000 7fe18c196700 1 Processor -- start 2020-02-11T16:16:16.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.130+0000 7fe18c196700 1 -- start start 2020-02-11T16:16:16.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.130+0000 7fe18c196700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.130+0000 7fe189f32700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fe1840a2870 legacy=0x7fe1841315b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:16:16.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.130+0000 7fe18c196700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe184135ee0 con 0x7fe18413b640 2020-02-11T16:16:16.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.130+0000 7fe18c196700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe184136180 con 0x7fe1840a2870 2020-02-11T16:16:16.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.130+0000 7fe18c196700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe184144ef0 con 0x7fe1840a6ff0 2020-02-11T16:16:16.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.130+0000 7fe189731700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.130+0000 7fe189731700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:50284/0 (socket says 172.21.15.88:50284) 2020-02-11T16:16:16.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.130+0000 7fe189731700 1 -- 172.21.15.88:0/1214067486 learned_addr learned my addr 172.21.15.88:0/1214067486 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:16.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe189731700 1 -- 172.21.15.88:0/1214067486 >> v1:172.21.15.88:6789/0 conn(0x7fe1840a2870 legacy=0x7fe1841315b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:16.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe189731700 1 -- 172.21.15.88:0/1214067486 >> v1:172.21.15.52:6789/0 conn(0x7fe18413b640 legacy=0x7fe1841452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe189731700 1 -- 172.21.15.88:0/1214067486 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840a7460 con 0x7fe1840a6ff0 2020-02-11T16:16:16.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe189731700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1840aa620 tx=0x7fe180010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe189731700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1840aa620 tx=0x7fe180010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe189731700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fe1840aa620 tx=0x7fe180010da0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:16.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe189731700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fe1840aa620 tx=0x7fe180010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe180005e90 con 0x7fe1840a6ff0 2020-02-11T16:16:16.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe189731700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fe1840aa620 tx=0x7fe180010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe189731700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fe1840aa620 tx=0x7fe180010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe180007160 con 0x7fe1840a6ff0 2020-02-11T16:16:16.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe18c196700 1 -- 172.21.15.88:0/1214067486 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe184135a70 con 0x7fe1840a6ff0 2020-02-11T16:16:16.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe180007540 con 0x7fe1840a6ff0 2020-02-11T16:16:16.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.131+0000 7fe18c196700 1 -- 172.21.15.88:0/1214067486 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe184131e80 con 0x7fe1840a6ff0 2020-02-11T16:16:16.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.132+0000 7fe189731700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fe1840aa620 tx=0x7fe180010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.132+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe180012410 con 0x7fe1840a6ff0 2020-02-11T16:16:16.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.132+0000 7fe189731700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fe1840aa620 tx=0x7fe180010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.132+0000 7fe18c196700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 0x7fe184069d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.132+0000 7fe18c196700 1 -- 172.21.15.88:0/1214067486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18405e2f0 con 0x7fe1841459f0 2020-02-11T16:16:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.132+0000 7fe172ffd700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe164039c20 0x7fe16403c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.132+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe180049fe0 con 0x7fe1840a6ff0 2020-02-11T16:16:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.132+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 0x7fe184069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.132+0000 7fe18a733700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe164039c20 0x7fe16403c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe18a733700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe164039c20 0x7fe16403c0e0 crc :-1 s=READY pgs=286 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe189f32700 1 -- 172.21.15.88:0/1214067486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe184145040 con 0x7fe1841459f0 2020-02-11T16:16:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 0x7fe184069d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 0x7fe184069d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 0x7fe184069d30 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 0x7fe184069d30 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe174007550 con 0x7fe1841459f0 2020-02-11T16:16:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 0x7fe184069d30 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fe17400ed40 con 0x7fe1841459f0 2020-02-11T16:16:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 msgr2=0x7fe184069d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe172ffd700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 0x7fe184069d30 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).stop 2020-02-11T16:16:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 msgr2=0x7fe184069d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:16.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.133+0000 7fe172ffd700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1841459f0 0x7fe184069d30 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).stop 2020-02-11T16:16:16.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.141+0000 7fe18c196700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 0x7fe1841393d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.141+0000 7fe18c196700 1 -- 172.21.15.88:0/1214067486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe184135d50 con 0x7fe184138ff0 2020-02-11T16:16:16.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.142+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 0x7fe1841393d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.142+0000 7fe189f32700 1 -- 172.21.15.88:0/1214067486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe1840565b0 con 0x7fe184138ff0 2020-02-11T16:16:16.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.142+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 0x7fe1841393d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.142+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 0x7fe1841393d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.142+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 0x7fe1841393d0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:16.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.142+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 0x7fe1841393d0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.142+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17400f2b0 con 0x7fe184138ff0 2020-02-11T16:16:16.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe189f32700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 0x7fe1841393d0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4350 (secure 0 0 0) 0x7fe17400f410 con 0x7fe184138ff0 2020-02-11T16:16:16.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 msgr2=0x7fe1841393d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe172ffd700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 0x7fe1841393d0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).stop 2020-02-11T16:16:16.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe172ffd700 1 -- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 msgr2=0x7fe1841393d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:16.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe172ffd700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184138ff0 0x7fe1841393d0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0x7fe174003480 tx=0x7fe1740108c0).stop 2020-02-11T16:16:16.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe18c196700 1 -- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe164039c20 msgr2=0x7fe16403c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe18c196700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe164039c20 0x7fe16403c0e0 crc :-1 s=READY pgs=286 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe18c196700 1 -- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 msgr2=0x7fe184138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe18c196700 1 --2- 172.21.15.88:0/1214067486 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1840a6ff0 0x7fe184138700 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fe1840aa620 tx=0x7fe180010da0).stop 2020-02-11T16:16:16.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe18a733700 1 -- 172.21.15.88:0/1214067486 reap_dead start 2020-02-11T16:16:16.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe18a733700 1 -- 172.21.15.88:0/1214067486 reap_dead start 2020-02-11T16:16:16.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe18c196700 1 -- 172.21.15.88:0/1214067486 shutdown_connections 2020-02-11T16:16:16.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe18c196700 1 -- 172.21.15.88:0/1214067486 >> 172.21.15.88:0/1214067486 conn(0x7fe1840ac2d0 msgr2=0x7fe1840ac6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:16.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe18c196700 1 -- 172.21.15.88:0/1214067486 shutdown_connections 2020-02-11T16:16:16.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.143+0000 7fe18c196700 1 -- 172.21.15.88:0/1214067486 wait complete. 2020-02-11T16:16:16.152 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:16.152 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:16.152 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:16.152 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:16:16.152 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 94, 2020-02-11T16:16:16.152 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:16.153 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:16.153 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:16.153 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.153 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:16:16.153 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:16.153 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:16.153 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:16.155 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:16.155 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:16.155 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:16.155 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:16.157 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:16.157 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:16.157 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:16.157 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.157 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:16.157 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:16.158 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:16.158 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:16.158 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:16.158 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:16.158 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:16.158 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:16.158 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:16.159 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:16.159 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:16.159 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:16.159 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:16.159 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:16.159 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:16.159 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:16.160 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:16.160 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:16.160 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.160 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:16.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.160 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:16.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.160 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:16.161 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:16.161 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:16.161 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:16.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.161 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:16.161 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:16.161 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.162 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:16.162 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:16.162 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.162 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.163 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:16.163 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:16.163 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:16.163 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:16.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.163 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:16.164 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:16.164 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:16.164 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:16.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.164 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:16.164 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:16.164 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.165 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:16.165 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:16.165 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.165 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.165 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.166 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:16.166 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:16.166 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:16.166 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:16.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.166 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:16.167 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:16.167 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:16.167 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:16.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.167 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:16.167 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:16.167 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.168 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:16.168 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:16.168 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.168 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.168 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.169 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:16.169 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:16.169 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:16.169 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:16.169 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.169 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.170 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:16.170 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:16.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.170 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:16.170 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:16.170 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:16.170 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.170 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.171 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:16:16.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.171 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:16.171 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:16.171 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:16.171 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.171 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.172 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:16:16.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.172 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:16.172 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:16.172 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:16:16.172 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.172 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.172 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:16.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.173 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:16.173 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:16.173 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:16:16.173 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.173 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.173 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:16:16.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.174 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:16.174 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:16.174 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:16.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.174 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.174 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:16.176 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:16:16.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.279+0000 7f75948b7700 1 Processor -- start 2020-02-11T16:16:16.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.279+0000 7f75948b7700 1 -- start start 2020-02-11T16:16:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.280+0000 7f75948b7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75900a5de0 0x7f75900a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.280+0000 7f75948b7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75900a2980 0x7f75900a1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.280+0000 7f75948b7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759009de90 con 0x7f7590131be0 2020-02-11T16:16:16.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.280+0000 7f75948b7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75900a3c00 con 0x7f75900a2980 2020-02-11T16:16:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.280+0000 7f75948b7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75900a3e10 con 0x7f75900a5de0 2020-02-11T16:16:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.280+0000 7f758ed9d700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f75900a5de0 msgr2=0x7f75900a0d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.280+0000 7f758ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75900a5de0 0x7f75900a0d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.280+0000 7f758e59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75900a2980 0x7f75900a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75900a2980 0x7f75900a1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:41956/0 (socket says 172.21.15.88:41956) 2020-02-11T16:16:16.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 -- 172.21.15.88:0/2427959867 learned_addr learned my addr 172.21.15.88:0/2427959867 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 -- 172.21.15.88:0/2427959867 >> v2:172.21.15.88:3300/0 conn(0x7f75900a5de0 msgr2=0x7f75900a0d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 --2- 172.21.15.88:0/2427959867 >> v2:172.21.15.88:3300/0 conn(0x7f75900a5de0 0x7f75900a0d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 -- 172.21.15.88:0/2427959867 >> v1:172.21.15.52:6789/0 conn(0x7f7590131be0 legacy=0x7f7590132060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 -- 172.21.15.88:0/2427959867 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759009e0c0 con 0x7f75900a2980 2020-02-11T16:16:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 --2- 172.21.15.88:0/2427959867 >> v2:172.21.15.52:3300/0 conn(0x7f75900a2980 0x7f75900a1320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7580002f30 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 --2- 172.21.15.88:0/2427959867 >> v2:172.21.15.52:3300/0 conn(0x7f75900a2980 0x7f75900a1320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7580002f30 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 --2- 172.21.15.88:0/2427959867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75900a2980 0x7f75900a1320 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f7580002f30 tx=0x7f7580007a40).ready entity=mon.0 client_cookie=8d2d723290953674 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 --2- 172.21.15.88:0/2427959867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75900a2980 0x7f75900a1320 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f7580002f30 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758dd9b700 1 -- 172.21.15.88:0/2427959867 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7580008e20 con 0x7f75900a2980 2020-02-11T16:16:16.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 --2- 172.21.15.88:0/2427959867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75900a2980 0x7f75900a1320 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f7580002f30 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758e59c700 1 --2- 172.21.15.88:0/2427959867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75900a2980 0x7f75900a1320 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f7580002f30 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758dd9b700 1 -- 172.21.15.88:0/2427959867 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580011910 con 0x7f75900a2980 2020-02-11T16:16:16.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f758dd9b700 1 -- 172.21.15.88:0/2427959867 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7580011cf0 con 0x7f75900a2980 2020-02-11T16:16:16.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f75948b7700 1 -- 172.21.15.88:0/2427959867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75900a2980 msgr2=0x7f75900a1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.281+0000 7f75948b7700 1 --2- 172.21.15.88:0/2427959867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75900a2980 0x7f75900a1320 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f7580002f30 tx=0x7f7580007a40).stop 2020-02-11T16:16:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.282+0000 7f75948b7700 1 -- 172.21.15.88:0/2427959867 shutdown_connections 2020-02-11T16:16:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.282+0000 7f75948b7700 1 --2- 172.21.15.88:0/2427959867 >> v2:172.21.15.88:3300/0 conn(0x7f75900a5de0 0x7f75900a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.282+0000 7f75948b7700 1 --2- 172.21.15.88:0/2427959867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75900a2980 0x7f75900a1320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.282+0000 7f75948b7700 1 -- 172.21.15.88:0/2427959867 >> 172.21.15.88:0/2427959867 conn(0x7f75900a9fb0 msgr2=0x7f75900aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.282+0000 7f75948b7700 1 -- 172.21.15.88:0/2427959867 shutdown_connections 2020-02-11T16:16:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.282+0000 7f75948b7700 1 -- 172.21.15.88:0/2427959867 wait complete. 2020-02-11T16:16:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.283+0000 7f75948b7700 1 Processor -- start 2020-02-11T16:16:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.283+0000 7f75948b7700 1 -- start start 2020-02-11T16:16:16.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.283+0000 7f75948b7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7590131be0 0x7f7590150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.283+0000 7f75948b7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759013fb50 con 0x7f75900a2980 2020-02-11T16:16:16.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.283+0000 7f75948b7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7590136b40 con 0x7f75900a5de0 2020-02-11T16:16:16.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.283+0000 7f75948b7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7590136de0 con 0x7f7590131be0 2020-02-11T16:16:16.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.283+0000 7f758f59e700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f7590131be0 msgr2=0x7f7590150ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:16.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.283+0000 7f758e59c700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f75900a5de0 legacy=0x7f7590130d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:16:16.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.283+0000 7f758f59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7590131be0 0x7f7590150ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:16.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f758ed9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f75900a2980 0x7f7590138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:35384/0 (socket says 172.21.15.88:35384) 2020-02-11T16:16:16.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f758ed9d700 1 -- 172.21.15.88:0/2678052112 learned_addr learned my addr 172.21.15.88:0/2678052112 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:16.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054850894 0 0) 0x7f759013fb50 con 0x7f75900a2980 2020-02-11T16:16:16.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f756c002fe0 con 0x7f75900a2980 2020-02-11T16:16:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2158794967 0 0) 0x7f756c002fe0 con 0x7f75900a2980 2020-02-11T16:16:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f759013fb50 con 0x7f75900a2980 2020-02-11T16:16:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f7584003f20 con 0x7f75900a2980 2020-02-11T16:16:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 >> v2:172.21.15.88:3300/0 conn(0x7f7590131be0 msgr2=0x7f7590150ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 --2- 172.21.15.88:0/2678052112 >> v2:172.21.15.88:3300/0 conn(0x7f7590131be0 0x7f7590150ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 >> v1:172.21.15.88:6789/0 conn(0x7f75900a5de0 legacy=0x7f7590130d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 >> v1:172.21.15.52:6789/0 conn(0x7f75900a2980 legacy=0x7f7590138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f756c005280 0x7f756c003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c003ef0 0x7f756c004370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7590136de0 con 0x7f756c003ef0 2020-02-11T16:16:16.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c00b7e0 con 0x7f756c005280 2020-02-11T16:16:16.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756c00b9a0 con 0x7f756c0049b0 2020-02-11T16:16:16.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f758e59c700 1 -- 172.21.15.88:0/2678052112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f756c005280 msgr2=0x7f756c003980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:16:16.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f756c005280 0x7f756c003980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:16.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f758f59e700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c003ef0 0x7f756c004370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.284+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 -- 172.21.15.88:0/2678052112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f756c005280 msgr2=0x7f756c003980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:16.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f756c005280 0x7f756c003980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 -- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c003ef0 msgr2=0x7f756c004370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c003ef0 0x7f756c004370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 -- 172.21.15.88:0/2678052112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7590137080 con 0x7f756c0049b0 2020-02-11T16:16:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758f59e700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c003ef0 0x7f756c004370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:16:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f75948b7700 1 -- 172.21.15.88:0/2678052112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7590066cb0 con 0x7f756c0049b0 2020-02-11T16:16:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758f59e700 1 -- 172.21.15.88:0/2678052112 reap_dead start 2020-02-11T16:16:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f75948b7700 1 -- 172.21.15.88:0/2678052112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7590136040 con 0x7f756c0049b0 2020-02-11T16:16:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f756c0048f0 tx=0x7f75900684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f756c0048f0 tx=0x7f75900684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f756c0048f0 tx=0x7f75900684d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:16.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f756c0048f0 tx=0x7f75900684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f758400a390 con 0x7f756c0049b0 2020-02-11T16:16:16.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f756c0048f0 tx=0x7f75900684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f756c0048f0 tx=0x7f75900684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584012e30 con 0x7f756c0049b0 2020-02-11T16:16:16.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f758400ee70 con 0x7f756c0049b0 2020-02-11T16:16:16.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f75948b7700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 0x7f75700058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f75948b7700 1 -- 172.21.15.88:0/2678052112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7570005ea0 con 0x7f7570003420 2020-02-11T16:16:16.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f756c0048f0 tx=0x7f75900684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.285+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 0x7f75700058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f758400b070 con 0x7f756c0049b0 2020-02-11T16:16:16.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f758ed9d700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f756c0048f0 tx=0x7f75900684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f758e59c700 1 -- 172.21.15.88:0/2678052112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7570006060 con 0x7f7570003420 2020-02-11T16:16:16.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 0x7f75700058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 0x7f75700058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f757ffff700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c03dbd0 0x7f756c040090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 0x7f75700058e0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:16.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7584049c30 con 0x7f756c0049b0 2020-02-11T16:16:16.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 0x7f75700058e0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75800072a0 con 0x7f7570003420 2020-02-11T16:16:16.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f758f59e700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c03dbd0 0x7f756c040090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f758f59e700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c03dbd0 0x7f756c040090 crc :-1 s=READY pgs=287 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:16.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 0x7f75700058e0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f7580007400 con 0x7f7570003420 2020-02-11T16:16:16.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 msgr2=0x7f75700058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f757ffff700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 0x7f75700058e0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).stop 2020-02-11T16:16:16.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 msgr2=0x7f75700058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:16.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.286+0000 7f757ffff700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 0x7f75700058e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.294+0000 7f75948b7700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 0x7f75700068b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:16.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.294+0000 7f75948b7700 1 -- 172.21.15.88:0/2678052112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7570006de0 con 0x7f7570006400 2020-02-11T16:16:16.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 0x7f75700068b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:16.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f758e59c700 1 -- 172.21.15.88:0/2678052112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7570006fa0 con 0x7f7570006400 2020-02-11T16:16:16.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 0x7f75700068b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 0x7f75700068b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 0x7f75700068b0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:16.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 0x7f75700068b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f758000e8d0 con 0x7f7570006400 2020-02-11T16:16:16.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f758e59c700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 0x7f75700068b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:16.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4348 (secure 0 0 0) 0x7f758000ea30 con 0x7f7570006400 2020-02-11T16:16:16.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 msgr2=0x7f75700068b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f757ffff700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 0x7f75700068b0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f7580011e90 tx=0x7f7580007a40).stop 2020-02-11T16:16:16.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f757ffff700 1 -- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 msgr2=0x7f75700068b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:16.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.295+0000 7f757ffff700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 0x7f75700068b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 -- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c03dbd0 msgr2=0x7f756c040090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c03dbd0 0x7f756c040090 crc :-1 s=READY pgs=287 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 -- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 msgr2=0x7f756c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:16.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f756c0048f0 tx=0x7f75900684d0).stop 2020-02-11T16:16:16.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 -- 172.21.15.88:0/2678052112 shutdown_connections 2020-02-11T16:16:16.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c03dbd0 0x7f756c040090 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f756c0049b0 0x7f756c004db0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570003420 0x7f75700058e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 --2- 172.21.15.88:0/2678052112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7570006400 0x7f75700068b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:16.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 -- 172.21.15.88:0/2678052112 >> 172.21.15.88:0/2678052112 conn(0x7f75900a9fb0 msgr2=0x7f7590132060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:16.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 -- 172.21.15.88:0/2678052112 shutdown_connections 2020-02-11T16:16:16.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:16.296+0000 7f75948b7700 1 -- 172.21.15.88:0/2678052112 wait complete. 2020-02-11T16:16:16.311 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:16.311 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:16.311 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:16.311 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:16:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 94, 2020-02-11T16:16:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:16:16.312 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:16.313 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:16.314 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:16.315 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:16.316 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:16.317 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.320 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:16.321 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:16.325 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:16.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.325 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:16.325 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:16.325 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.326 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:16.326 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:16.326 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:16.326 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.326 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.326 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:16.327 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:16.327 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:16.327 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:16.327 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.327 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:16.327 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:16.327 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:16.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.328 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:16.328 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:16.328 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:16.328 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.328 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.328 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:16:16.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.329 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:16.329 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:16.329 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:16.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.329 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.329 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:16:16.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.330 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:16.330 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:16.330 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:16:16.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.330 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.330 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:16.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.331 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:16.331 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:16.331 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:16:16.331 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.331 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:16.331 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:16:16.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:16.332 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:16.332 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:16.332 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:16.332 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.332 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:16.332 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:16.332 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:16.333 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:16:36.333 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:16:36.334 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:16:36.334 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:16:36.334 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:16:36.337 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:16:36.337 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:16:36.337 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:36.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.454+0000 7f5916e36700 1 Processor -- start 2020-02-11T16:16:36.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.454+0000 7f5916e36700 1 -- start start 2020-02-11T16:16:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5916e36700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59100a2fa0 0x7f59100a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5916e36700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59100a5410 0x7f59100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5916e36700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59100a4350 con 0x7f5910131280 2020-02-11T16:16:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5916e36700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59100a1e60 con 0x7f59100a2fa0 2020-02-11T16:16:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5916e36700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59100a3450 con 0x7f59100a5410 2020-02-11T16:16:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f590ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59100a5410 0x7f59100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f59153d3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5910131280 0x7f59101316d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43630/0 (socket says 172.21.15.88:43630) 2020-02-11T16:16:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f59153d3700 1 -- 172.21.15.88:0/1658036932 learned_addr learned my addr 172.21.15.88:0/1658036932 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f590ffff700 1 -- 172.21.15.88:0/1658036932 >> v2:172.21.15.88:3300/0 conn(0x7f59100a5410 msgr2=0x7f59100a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:16:36.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f590ffff700 1 -- 172.21.15.88:0/1658036932 >> v2:172.21.15.88:3300/0 conn(0x7f59100a5410 msgr2=0x7f59100a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:16:36.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f590ffff700 1 --2- 172.21.15.88:0/1658036932 >> v2:172.21.15.88:3300/0 conn(0x7f59100a5410 0x7f59100a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:16:36.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f590ffff700 1 --2- 172.21.15.88:0/1658036932 >> v2:172.21.15.88:3300/0 conn(0x7f59100a5410 0x7f59100a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:36.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5914bd2700 1 --2- 172.21.15.88:0/1658036932 >> v2:172.21.15.52:3300/0 conn(0x7f59100a2fa0 0x7f59100a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:36.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5914bd2700 1 -- 172.21.15.88:0/1658036932 >> v2:172.21.15.88:3300/0 conn(0x7f59100a5410 msgr2=0x7f59100a5870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:36.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5914bd2700 1 --2- 172.21.15.88:0/1658036932 >> v2:172.21.15.88:3300/0 conn(0x7f59100a5410 0x7f59100a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5914bd2700 1 -- 172.21.15.88:0/1658036932 >> v1:172.21.15.88:6789/0 conn(0x7f5910131280 legacy=0x7f59101316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5914bd2700 1 -- 172.21.15.88:0/1658036932 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59100a3a40 con 0x7f59100a2fa0 2020-02-11T16:16:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.455+0000 7f5914bd2700 1 --2- 172.21.15.88:0/1658036932 >> v2:172.21.15.52:3300/0 conn(0x7f59100a2fa0 0x7f59100a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59100a33a0 tx=0x7f59040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5914bd2700 1 --2- 172.21.15.88:0/1658036932 >> v2:172.21.15.52:3300/0 conn(0x7f59100a2fa0 0x7f59100a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59100a33a0 tx=0x7f59040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5914bd2700 1 --2- 172.21.15.88:0/1658036932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a2fa0 0x7f59100a1520 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f59100a33a0 tx=0x7f59040088e0).ready entity=mon.0 client_cookie=af03c46f049e55cc server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5914bd2700 1 --2- 172.21.15.88:0/1658036932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a2fa0 0x7f59100a1520 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f59100a33a0 tx=0x7f59040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f590f7fe700 1 -- 172.21.15.88:0/1658036932 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5904008e40 con 0x7f59100a2fa0 2020-02-11T16:16:36.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5914bd2700 1 --2- 172.21.15.88:0/1658036932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a2fa0 0x7f59100a1520 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f59100a33a0 tx=0x7f59040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f590f7fe700 1 -- 172.21.15.88:0/1658036932 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5904011660 con 0x7f59100a2fa0 2020-02-11T16:16:36.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5914bd2700 1 --2- 172.21.15.88:0/1658036932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a2fa0 0x7f59100a1520 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f59100a33a0 tx=0x7f59040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f590f7fe700 1 -- 172.21.15.88:0/1658036932 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5904011a40 con 0x7f59100a2fa0 2020-02-11T16:16:36.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5916e36700 1 -- 172.21.15.88:0/1658036932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a2fa0 msgr2=0x7f59100a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:36.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5916e36700 1 --2- 172.21.15.88:0/1658036932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a2fa0 0x7f59100a1520 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f59100a33a0 tx=0x7f59040088e0).stop 2020-02-11T16:16:36.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5916e36700 1 -- 172.21.15.88:0/1658036932 shutdown_connections 2020-02-11T16:16:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5916e36700 1 --2- 172.21.15.88:0/1658036932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a2fa0 0x7f59100a1520 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5916e36700 1 --2- 172.21.15.88:0/1658036932 >> v2:172.21.15.88:3300/0 conn(0x7f59100a5410 0x7f59100a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5916e36700 1 -- 172.21.15.88:0/1658036932 >> 172.21.15.88:0/1658036932 conn(0x7f591009d110 msgr2=0x7f591009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5916e36700 1 -- 172.21.15.88:0/1658036932 shutdown_connections 2020-02-11T16:16:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.456+0000 7f5916e36700 1 -- 172.21.15.88:0/1658036932 wait complete. 2020-02-11T16:16:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.457+0000 7f5916e36700 1 Processor -- start 2020-02-11T16:16:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.457+0000 7f5916e36700 1 -- start start 2020-02-11T16:16:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.458+0000 7f5916e36700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59100a5410 0x7f5910061cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.458+0000 7f5916e36700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5910066950 con 0x7f59100a2fa0 2020-02-11T16:16:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.458+0000 7f5916e36700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59100614a0 con 0x7f5910131280 2020-02-11T16:16:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.458+0000 7f5916e36700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5910061290 con 0x7f59100a5410 2020-02-11T16:16:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.458+0000 7f59153d3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5910131280 0x7f591012fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43636/0 (socket says 172.21.15.88:43636) 2020-02-11T16:16:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.458+0000 7f59153d3700 1 -- 172.21.15.88:0/3610977585 learned_addr learned my addr 172.21.15.88:0/3610977585 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.458+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> v2:172.21.15.52:3300/0 conn(0x7f59100a5410 0x7f5910061cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590ffff700 1 -- 172.21.15.88:0/3610977585 >> v1:172.21.15.88:6789/0 conn(0x7f5910131280 legacy=0x7f591012fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590ffff700 1 -- 172.21.15.88:0/3610977585 >> v1:172.21.15.52:6789/0 conn(0x7f59100a2fa0 legacy=0x7f5910137140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590ffff700 1 -- 172.21.15.88:0/3610977585 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59101366a0 con 0x7f59100a5410 2020-02-11T16:16:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> v2:172.21.15.52:3300/0 conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> v2:172.21.15.52:3300/0 conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590dffb700 1 -- 172.21.15.88:0/3610977585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58fc007160 con 0x7f59100a5410 2020-02-11T16:16:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590dffb700 1 -- 172.21.15.88:0/3610977585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc0072c0 con 0x7f59100a5410 2020-02-11T16:16:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f590dffb700 1 -- 172.21.15.88:0/3610977585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58fc0122d0 con 0x7f59100a5410 2020-02-11T16:16:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f5916e36700 1 -- 172.21.15.88:0/3610977585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5910066bb0 con 0x7f59100a5410 2020-02-11T16:16:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.459+0000 7f5916e36700 1 -- 172.21.15.88:0/3610977585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5910137850 con 0x7f59100a5410 2020-02-11T16:16:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.460+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.460+0000 7f590dffb700 1 -- 172.21.15.88:0/3610977585 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f58fc012540 con 0x7f59100a5410 2020-02-11T16:16:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.460+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.460+0000 7f5916e36700 1 -- 172.21.15.88:0/3610977585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5910067010 con 0x7f59100a5410 2020-02-11T16:16:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.460+0000 7f590dffb700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f58f8039bf0 0x7f58f803c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.460+0000 7f590dffb700 1 -- 172.21.15.88:0/3610977585 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f58fc049f80 con 0x7f59100a5410 2020-02-11T16:16:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.460+0000 7f5914bd2700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f58f8039bf0 0x7f58f803c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:36.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.461+0000 7f5914bd2700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f58f8039bf0 0x7f58f803c0b0 crc :-1 s=READY pgs=289 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:36.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.464+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.464+0000 7f590dffb700 1 -- 172.21.15.88:0/3610977585 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f58fc02f4a0 con 0x7f59100a5410 2020-02-11T16:16:36.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.644+0000 7f5916e36700 1 -- 172.21.15.88:0/3610977585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f59100565b0 con 0x7f59100a5410 2020-02-11T16:16:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.644+0000 7f590ffff700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.644+0000 7f590dffb700 1 -- 172.21.15.88:0/3610977585 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f58fc00a510 con 0x7f59100a5410 2020-02-11T16:16:36.649 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":94,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.646+0000 7f5916e36700 1 -- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f58f8039bf0 msgr2=0x7f58f803c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.646+0000 7f5916e36700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f58f8039bf0 0x7f58f803c0b0 crc :-1 s=READY pgs=289 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.646+0000 7f5916e36700 1 -- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 msgr2=0x7f5910061cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.646+0000 7f5916e36700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 0x7f5910061cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f5910136c70 tx=0x7f58fc010c70).stop 2020-02-11T16:16:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.646+0000 7f5916e36700 1 -- 172.21.15.88:0/3610977585 shutdown_connections 2020-02-11T16:16:36.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.646+0000 7f5916e36700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f58f8039bf0 0x7f58f803c0b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:36.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.646+0000 7f5916e36700 1 --2- 172.21.15.88:0/3610977585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59100a5410 0x7f5910061cc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:36.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.646+0000 7f5916e36700 1 -- 172.21.15.88:0/3610977585 >> 172.21.15.88:0/3610977585 conn(0x7f591009d110 msgr2=0x7f5910069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:36.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.646+0000 7f5916e36700 1 -- 172.21.15.88:0/3610977585 shutdown_connections 2020-02-11T16:16:36.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:36.646+0000 7f5916e36700 1 -- 172.21.15.88:0/3610977585 wait complete. 2020-02-11T16:16:36.659 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":94,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:39.660 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:39.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.774+0000 7f38a644a700 1 Processor -- start 2020-02-11T16:16:39.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.774+0000 7f38a644a700 1 -- start start 2020-02-11T16:16:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.774+0000 7f38a644a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38a00a7120 0x7f38a00a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.774+0000 7f38a644a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 0x7f38a00a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.774+0000 7f38a644a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a0136930 con 0x7f38a013c120 2020-02-11T16:16:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.774+0000 7f38a644a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a00a6470 con 0x7f38a00a7120 2020-02-11T16:16:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.774+0000 7f38a644a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a00a49b0 con 0x7f38a00a50f0 2020-02-11T16:16:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389f7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 0x7f38a00a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38a00a7120 0x7f38a00a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38a00a7120 0x7f38a00a2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:42014/0 (socket says 172.21.15.88:42014) 2020-02-11T16:16:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389f7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 0x7f38a00a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:50354/0 (socket says 172.21.15.88:50354) 2020-02-11T16:16:39.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 -- 172.21.15.88:0/3265391953 learned_addr learned my addr 172.21.15.88:0/3265391953 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:39.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 -- 172.21.15.88:0/3265391953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 msgr2=0x7f38a00a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:39.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 --2- 172.21.15.88:0/3265391953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 0x7f38a00a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:39.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 -- 172.21.15.88:0/3265391953 >> v1:172.21.15.52:6789/0 conn(0x7f38a013c120 legacy=0x7f38a013c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:39.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389effd700 1 -- 172.21.15.88:0/3265391953 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232639406 0 0) 0x7f38a0136930 con 0x7f38a013c120 2020-02-11T16:16:39.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 -- 172.21.15.88:0/3265391953 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00a4c50 con 0x7f38a00a7120 2020-02-11T16:16:39.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 --2- 172.21.15.88:0/3265391953 >> v2:172.21.15.52:3300/0 conn(0x7f38a00a7120 0x7f38a00a2900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3890002f30 tx=0x7f38900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 --2- 172.21.15.88:0/3265391953 >> v2:172.21.15.52:3300/0 conn(0x7f38a00a7120 0x7f38a00a2900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3890002f30 tx=0x7f38900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 --2- 172.21.15.88:0/3265391953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a00a7120 0x7f38a00a2900 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f3890002f30 tx=0x7f38900088e0).ready entity=mon.0 client_cookie=9cf3e4762c6b1a4b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:39.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 --2- 172.21.15.88:0/3265391953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a00a7120 0x7f38a00a2900 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f3890002f30 tx=0x7f38900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389effd700 1 -- 172.21.15.88:0/3265391953 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38900116b0 con 0x7f38a00a7120 2020-02-11T16:16:39.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 --2- 172.21.15.88:0/3265391953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a00a7120 0x7f38a00a2900 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f3890002f30 tx=0x7f38900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389ffff700 1 --2- 172.21.15.88:0/3265391953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a00a7120 0x7f38a00a2900 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f3890002f30 tx=0x7f38900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389effd700 1 -- 172.21.15.88:0/3265391953 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3890011810 con 0x7f38a00a7120 2020-02-11T16:16:39.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f389effd700 1 -- 172.21.15.88:0/3265391953 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3890011bb0 con 0x7f38a00a7120 2020-02-11T16:16:39.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f38a644a700 1 -- 172.21.15.88:0/3265391953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a00a7120 msgr2=0x7f38a00a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:39.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.775+0000 7f38a644a700 1 --2- 172.21.15.88:0/3265391953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a00a7120 0x7f38a00a2900 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f3890002f30 tx=0x7f38900088e0).stop 2020-02-11T16:16:39.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.776+0000 7f38a644a700 1 -- 172.21.15.88:0/3265391953 shutdown_connections 2020-02-11T16:16:39.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.776+0000 7f38a644a700 1 --2- 172.21.15.88:0/3265391953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a00a7120 0x7f38a00a2900 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:39.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.776+0000 7f38a644a700 1 --2- 172.21.15.88:0/3265391953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 0x7f38a00a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:39.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.776+0000 7f38a644a700 1 -- 172.21.15.88:0/3265391953 >> 172.21.15.88:0/3265391953 conn(0x7f38a009d110 msgr2=0x7f38a009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:39.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.776+0000 7f38a644a700 1 -- 172.21.15.88:0/3265391953 shutdown_connections 2020-02-11T16:16:39.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.776+0000 7f38a644a700 1 -- 172.21.15.88:0/3265391953 wait complete. 2020-02-11T16:16:39.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.777+0000 7f38a644a700 1 Processor -- start 2020-02-11T16:16:39.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.777+0000 7f38a644a700 1 -- start start 2020-02-11T16:16:39.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.777+0000 7f38a644a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 0x7f38a0149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:39.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.777+0000 7f38a644a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38a013c120 0x7f38a013fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:39.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.777+0000 7f38a644a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a0149490 con 0x7f38a00a7120 2020-02-11T16:16:39.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.777+0000 7f38a644a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a00a6060 con 0x7f38a013c120 2020-02-11T16:16:39.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.777+0000 7f38a644a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a01496d0 con 0x7f38a00a50f0 2020-02-11T16:16:39.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f389f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f38a00a7120 0x7f38a0135ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43662/0 (socket says 172.21.15.88:43662) 2020-02-11T16:16:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f389f7fe700 1 -- 172.21.15.88:0/3114702856 learned_addr learned my addr 172.21.15.88:0/3114702856 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> v2:172.21.15.52:3300/0 conn(0x7f38a013c120 0x7f38a013fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f389ffff700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 0x7f38a0149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 -- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 msgr2=0x7f38a0149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 0x7f38a0149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:39.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 -- 172.21.15.88:0/3114702856 >> v1:172.21.15.88:6789/0 conn(0x7f38a00a7120 legacy=0x7f38a0135ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:39.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 -- 172.21.15.88:0/3114702856 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a0149970 con 0x7f38a013c120 2020-02-11T16:16:39.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> v2:172.21.15.52:3300/0 conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> v2:172.21.15.52:3300/0 conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:39.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f389d7fa700 1 -- 172.21.15.88:0/3114702856 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38980122c0 con 0x7f38a013c120 2020-02-11T16:16:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.778+0000 7f389d7fa700 1 -- 172.21.15.88:0/3114702856 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3898012460 con 0x7f38a013c120 2020-02-11T16:16:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.779+0000 7f38a644a700 1 -- 172.21.15.88:0/3114702856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a0149c10 con 0x7f38a013c120 2020-02-11T16:16:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.779+0000 7f389d7fa700 1 -- 172.21.15.88:0/3114702856 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3898012880 con 0x7f38a013c120 2020-02-11T16:16:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.779+0000 7f38a644a700 1 -- 172.21.15.88:0/3114702856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a013d4c0 con 0x7f38a013c120 2020-02-11T16:16:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.779+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.779+0000 7f389d7fa700 1 -- 172.21.15.88:0/3114702856 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3898012af0 con 0x7f38a013c120 2020-02-11T16:16:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.779+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.779+0000 7f38a644a700 1 -- 172.21.15.88:0/3114702856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a00565b0 con 0x7f38a013c120 2020-02-11T16:16:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.780+0000 7f389d7fa700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3880039d90 0x7f388003c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.780+0000 7f389d7fa700 1 -- 172.21.15.88:0/3114702856 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3898049fb0 con 0x7f38a013c120 2020-02-11T16:16:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.780+0000 7f389ffff700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3880039d90 0x7f388003c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.780+0000 7f389ffff700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3880039d90 0x7f388003c250 crc :-1 s=READY pgs=290 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:39.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.784+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.784+0000 7f389d7fa700 1 -- 172.21.15.88:0/3114702856 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f389802f550 con 0x7f38a013c120 2020-02-11T16:16:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.963+0000 7f38a644a700 1 -- 172.21.15.88:0/3114702856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f38a013d4c0 con 0x7f38a013c120 2020-02-11T16:16:39.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.964+0000 7f38a49e7700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:39.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.964+0000 7f389d7fa700 1 -- 172.21.15.88:0/3114702856 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f38a013d4c0 con 0x7f38a013c120 2020-02-11T16:16:39.967 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":94,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:39.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 -- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3880039d90 msgr2=0x7f388003c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3880039d90 0x7f388003c250 crc :-1 s=READY pgs=290 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 -- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 msgr2=0x7f38a013fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 0x7f38a013fb80 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f3898001210 tx=0x7f3898010c20).stop 2020-02-11T16:16:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 -- 172.21.15.88:0/3114702856 shutdown_connections 2020-02-11T16:16:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3880039d90 0x7f388003c250 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a013c120 0x7f38a013fb80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:39.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 --2- 172.21.15.88:0/3114702856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f38a00a50f0 0x7f38a0149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:39.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 -- 172.21.15.88:0/3114702856 >> 172.21.15.88:0/3114702856 conn(0x7f38a009d110 msgr2=0x7f38a01395b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:39.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 -- 172.21.15.88:0/3114702856 shutdown_connections 2020-02-11T16:16:39.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:39.965+0000 7f38a644a700 1 -- 172.21.15.88:0/3114702856 wait complete. 2020-02-11T16:16:39.978 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":94,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:42.979 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:43.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.092+0000 7f6d5cd52700 1 Processor -- start 2020-02-11T16:16:43.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.092+0000 7f6d5cd52700 1 -- start start 2020-02-11T16:16:43.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.093+0000 7f6d5cd52700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d580a4ec0 0x7f6d5812f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:43.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.093+0000 7f6d5cd52700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d5812fcf0 0x7f6d58140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:43.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.093+0000 7f6d5cd52700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580a5560 con 0x7f6d580a7120 2020-02-11T16:16:43.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.093+0000 7f6d5cd52700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580a5350 con 0x7f6d5812fcf0 2020-02-11T16:16:43.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.093+0000 7f6d5cd52700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5809e060 con 0x7f6d580a4ec0 2020-02-11T16:16:43.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.093+0000 7f6d55d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d580a4ec0 0x7f6d5812f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d55d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d580a4ec0 0x7f6d5812f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56044/0 (socket says 172.21.15.88:56044) 2020-02-11T16:16:43.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d55d9b700 1 -- 172.21.15.88:0/183662331 learned_addr learned my addr 172.21.15.88:0/183662331 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:43.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/183662331 >> v2:172.21.15.52:3300/0 conn(0x7f6d5812fcf0 0x7f6d58140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d55d9b700 1 -- 172.21.15.88:0/183662331 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a4ec0 msgr2=0x7f6d5812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:16:43.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d55d9b700 1 -- 172.21.15.88:0/183662331 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a4ec0 msgr2=0x7f6d5812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:16:43.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d55d9b700 1 --2- 172.21.15.88:0/183662331 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a4ec0 0x7f6d5812f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:16:43.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d55d9b700 1 --2- 172.21.15.88:0/183662331 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a4ec0 0x7f6d5812f890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:43.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 -- 172.21.15.88:0/183662331 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a4ec0 msgr2=0x7f6d5812f890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:43.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/183662331 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a4ec0 0x7f6d5812f890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:43.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 -- 172.21.15.88:0/183662331 >> v1:172.21.15.52:6789/0 conn(0x7f6d580a7120 legacy=0x7f6d580a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 -- 172.21.15.88:0/183662331 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5809e300 con 0x7f6d5812fcf0 2020-02-11T16:16:43.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/183662331 >> v2:172.21.15.52:3300/0 conn(0x7f6d5812fcf0 0x7f6d58140470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/183662331 >> v2:172.21.15.52:3300/0 conn(0x7f6d5812fcf0 0x7f6d58140470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/183662331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d58140470 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).ready entity=mon.0 client_cookie=e61bc182b80f757 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/183662331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d58140470 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d5559a700 1 -- 172.21.15.88:0/183662331 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5000a160 con 0x7f6d5812fcf0 2020-02-11T16:16:43.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/183662331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d58140470 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d5559a700 1 -- 172.21.15.88:0/183662331 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5000a2c0 con 0x7f6d5812fcf0 2020-02-11T16:16:43.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/183662331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d58140470 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d5cd52700 1 -- 172.21.15.88:0/183662331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 msgr2=0x7f6d58140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d5cd52700 1 --2- 172.21.15.88:0/183662331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d58140470 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).stop 2020-02-11T16:16:43.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.094+0000 7f6d5559a700 1 -- 172.21.15.88:0/183662331 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5000a6a0 con 0x7f6d5812fcf0 2020-02-11T16:16:43.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.095+0000 7f6d5cd52700 1 -- 172.21.15.88:0/183662331 shutdown_connections 2020-02-11T16:16:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.095+0000 7f6d5cd52700 1 --2- 172.21.15.88:0/183662331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d58140470 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.095+0000 7f6d5cd52700 1 --2- 172.21.15.88:0/183662331 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a4ec0 0x7f6d5812f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.095+0000 7f6d5cd52700 1 -- 172.21.15.88:0/183662331 >> 172.21.15.88:0/183662331 conn(0x7f6d5809d110 msgr2=0x7f6d5809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.095+0000 7f6d5cd52700 1 -- 172.21.15.88:0/183662331 shutdown_connections 2020-02-11T16:16:43.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.095+0000 7f6d5cd52700 1 -- 172.21.15.88:0/183662331 wait complete. 2020-02-11T16:16:43.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.096+0000 7f6d5cd52700 1 Processor -- start 2020-02-11T16:16:43.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.096+0000 7f6d5cd52700 1 -- start start 2020-02-11T16:16:43.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.096+0000 7f6d5cd52700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d580a7120 0x7f6d58130c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.096+0000 7f6d5cd52700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d5812fcf0 0x7f6d5812c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.096+0000 7f6d5cd52700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580aa0c0 con 0x7f6d580a4ec0 2020-02-11T16:16:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.096+0000 7f6d5cd52700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580aa360 con 0x7f6d5812fcf0 2020-02-11T16:16:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.096+0000 7f6d5cd52700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5805b740 con 0x7f6d580a7120 2020-02-11T16:16:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d55d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d580a7120 0x7f6d58130c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d55d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d580a7120 0x7f6d58130c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56052/0 (socket says 172.21.15.88:56052) 2020-02-11T16:16:43.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d55d9b700 1 -- 172.21.15.88:0/366751929 learned_addr learned my addr 172.21.15.88:0/366751929 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:43.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d55d9b700 1 -- 172.21.15.88:0/366751929 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a7120 msgr2=0x7f6d58130c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:16:43.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d55d9b700 1 -- 172.21.15.88:0/366751929 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a7120 msgr2=0x7f6d58130c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:16:43.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d55d9b700 1 --2- 172.21.15.88:0/366751929 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a7120 0x7f6d58130c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:16:43.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d55d9b700 1 --2- 172.21.15.88:0/366751929 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a7120 0x7f6d58130c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:43.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> v2:172.21.15.52:3300/0 conn(0x7f6d5812fcf0 0x7f6d5812c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d56d9d700 1 -- 172.21.15.88:0/366751929 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a7120 msgr2=0x7f6d58130c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:43.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a7120 0x7f6d58130c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d56d9d700 1 -- 172.21.15.88:0/366751929 >> v1:172.21.15.52:6789/0 conn(0x7f6d580a4ec0 legacy=0x7f6d581465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d56d9d700 1 -- 172.21.15.88:0/366751929 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580a9980 con 0x7f6d5812fcf0 2020-02-11T16:16:43.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> v2:172.21.15.52:3300/0 conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> v2:172.21.15.52:3300/0 conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.097+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.098+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.098+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.098+0000 7f6d477fe700 1 -- 172.21.15.88:0/366751929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d50008a90 con 0x7f6d5812fcf0 2020-02-11T16:16:43.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.098+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.098+0000 7f6d477fe700 1 -- 172.21.15.88:0/366751929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d50005c30 con 0x7f6d5812fcf0 2020-02-11T16:16:43.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.098+0000 7f6d477fe700 1 -- 172.21.15.88:0/366751929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5000f570 con 0x7f6d5812fcf0 2020-02-11T16:16:43.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.098+0000 7f6d5cd52700 1 -- 172.21.15.88:0/366751929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5809f380 con 0x7f6d5812fcf0 2020-02-11T16:16:43.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.098+0000 7f6d5cd52700 1 -- 172.21.15.88:0/366751929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d58146f20 con 0x7f6d5812fcf0 2020-02-11T16:16:43.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.098+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.099+0000 7f6d477fe700 1 -- 172.21.15.88:0/366751929 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6d5000f7e0 con 0x7f6d5812fcf0 2020-02-11T16:16:43.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.099+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.099+0000 7f6d5cd52700 1 -- 172.21.15.88:0/366751929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d580565b0 con 0x7f6d5812fcf0 2020-02-11T16:16:43.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.099+0000 7f6d477fe700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d34039be0 0x7f6d3403c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.099+0000 7f6d477fe700 1 -- 172.21.15.88:0/366751929 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6d5004a930 con 0x7f6d5812fcf0 2020-02-11T16:16:43.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.099+0000 7f6d5659c700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d34039be0 0x7f6d3403c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.099+0000 7f6d5659c700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d34039be0 0x7f6d3403c0a0 crc :-1 s=READY pgs=291 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.103+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.103+0000 7f6d477fe700 1 -- 172.21.15.88:0/366751929 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f6d50032f20 con 0x7f6d5812fcf0 2020-02-11T16:16:43.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.289+0000 7f6d5cd52700 1 -- 172.21.15.88:0/366751929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6d580008d0 con 0x7f6d5812fcf0 2020-02-11T16:16:43.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.289+0000 7f6d56d9d700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.289+0000 7f6d477fe700 1 -- 172.21.15.88:0/366751929 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1278 (secure 0 0 0) 0x7f6d50032ae0 con 0x7f6d5812fcf0 2020-02-11T16:16:43.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 -- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d34039be0 msgr2=0x7f6d3403c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d34039be0 0x7f6d3403c0a0 crc :-1 s=READY pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 -- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 msgr2=0x7f6d5812c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d5812c210 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f6d500032b0 tx=0x7f6d50007dc0).stop 2020-02-11T16:16:43.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 -- 172.21.15.88:0/366751929 shutdown_connections 2020-02-11T16:16:43.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d34039be0 0x7f6d3403c0a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 --2- 172.21.15.88:0/366751929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5812fcf0 0x7f6d5812c210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 --2- 172.21.15.88:0/366751929 >> v2:172.21.15.88:3300/0 conn(0x7f6d580a7120 0x7f6d58130c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 -- 172.21.15.88:0/366751929 >> 172.21.15.88:0/366751929 conn(0x7f6d5809d110 msgr2=0x7f6d58069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:43.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 -- 172.21.15.88:0/366751929 shutdown_connections 2020-02-11T16:16:43.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.291+0000 7f6d5cd52700 1 -- 172.21.15.88:0/366751929 wait complete. 2020-02-11T16:16:43.301 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:43.309 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":96,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:43.309 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:16:43.309 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:16:43.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.412+0000 7f61d5f63700 1 Processor -- start 2020-02-11T16:16:43.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.412+0000 7f61d5f63700 1 -- start start 2020-02-11T16:16:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.413+0000 7f61d5f63700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.413+0000 7f61d5f63700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61d00a5de0 0x7f61d00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.413+0000 7f61d5f63700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00a31b0 con 0x7f61d012e3a0 2020-02-11T16:16:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.413+0000 7f61d5f63700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00a3570 con 0x7f61d00a5de0 2020-02-11T16:16:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.413+0000 7f61d5f63700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00a3810 con 0x7f61d00a18a0 2020-02-11T16:16:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.413+0000 7f61ceffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61d00a5de0 0x7f61d00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.413+0000 7f61cf7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.413+0000 7f61ceffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61d00a5de0 0x7f61d00a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:42044/0 (socket says 172.21.15.88:42044) 2020-02-11T16:16:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.413+0000 7f61cf7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:50382/0 (socket says 172.21.15.88:50382) 2020-02-11T16:16:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.413+0000 7f61ceffd700 1 -- 172.21.15.88:0/1612593599 learned_addr learned my addr 172.21.15.88:0/1612593599 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61cf7fe700 1 -- 172.21.15.88:0/1612593599 >> v2:172.21.15.52:3300/0 conn(0x7f61d00a5de0 msgr2=0x7f61d00a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1612593599 >> v2:172.21.15.52:3300/0 conn(0x7f61d00a5de0 0x7f61d00a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61cf7fe700 1 -- 172.21.15.88:0/1612593599 >> v1:172.21.15.52:6789/0 conn(0x7f61d012e3a0 legacy=0x7f61d012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61cf7fe700 1 -- 172.21.15.88:0/1612593599 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00a3ab0 con 0x7f61d00a18a0 2020-02-11T16:16:43.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1612593599 >> v2:172.21.15.52:3300/0 conn(0x7f61d00a5de0 0x7f61d00a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:16:43.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1612593599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f61c4002f30 tx=0x7f61c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1612593599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f61c4002f30 tx=0x7f61c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1612593599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f61c4002f30 tx=0x7f61c40088e0).ready entity=mon.2 client_cookie=8e4fe43584e1b57c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1612593599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f61c4002f30 tx=0x7f61c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1612593599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f61c4002f30 tx=0x7f61c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61ce7fc700 1 -- 172.21.15.88:0/1612593599 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c4008e40 con 0x7f61d00a18a0 2020-02-11T16:16:43.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1612593599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f61c4002f30 tx=0x7f61c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61ce7fc700 1 -- 172.21.15.88:0/1612593599 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c40115f0 con 0x7f61d00a18a0 2020-02-11T16:16:43.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61ce7fc700 1 -- 172.21.15.88:0/1612593599 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c40119d0 con 0x7f61d00a18a0 2020-02-11T16:16:43.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61d5f63700 1 -- 172.21.15.88:0/1612593599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 msgr2=0x7f61d00a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1612593599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f61c4002f30 tx=0x7f61c40088e0).stop 2020-02-11T16:16:43.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61d5f63700 1 -- 172.21.15.88:0/1612593599 shutdown_connections 2020-02-11T16:16:43.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1612593599 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61d00a18a0 0x7f61d00a6dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1612593599 >> v2:172.21.15.52:3300/0 conn(0x7f61d00a5de0 0x7f61d00a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:43.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61d5f63700 1 -- 172.21.15.88:0/1612593599 >> 172.21.15.88:0/1612593599 conn(0x7f61d009d110 msgr2=0x7f61d009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:43.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.414+0000 7f61d5f63700 1 -- 172.21.15.88:0/1612593599 shutdown_connections 2020-02-11T16:16:43.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.415+0000 7f61d5f63700 1 -- 172.21.15.88:0/1612593599 wait complete. 2020-02-11T16:16:43.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.415+0000 7f61d5f63700 1 Processor -- start 2020-02-11T16:16:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61d5f63700 1 -- start start 2020-02-11T16:16:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61d5f63700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61d012e3a0 0x7f61d01509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61d5f63700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d0131470 con 0x7f61d00a5de0 2020-02-11T16:16:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61d5f63700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d01316a0 con 0x7f61d00a18a0 2020-02-11T16:16:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61d5f63700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d0130730 con 0x7f61d012e3a0 2020-02-11T16:16:43.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61cffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61d012e3a0 0x7f61d01509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61cffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61d012e3a0 0x7f61d01509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56068/0 (socket says 172.21.15.88:56068) 2020-02-11T16:16:43.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61cf7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f61d00a18a0 0x7f61d0065450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43692/0 (socket says 172.21.15.88:43692) 2020-02-11T16:16:43.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61cffff700 1 -- 172.21.15.88:0/1031017718 learned_addr learned my addr 172.21.15.88:0/1031017718 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:43.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61cffff700 1 -- 172.21.15.88:0/1031017718 >> v2:172.21.15.88:3300/0 conn(0x7f61d012e3a0 msgr2=0x7f61d01509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:16:43.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61cffff700 1 -- 172.21.15.88:0/1031017718 >> v2:172.21.15.88:3300/0 conn(0x7f61d012e3a0 msgr2=0x7f61d01509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:16:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> v2:172.21.15.88:3300/0 conn(0x7f61d012e3a0 0x7f61d01509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:16:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.416+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> v2:172.21.15.88:3300/0 conn(0x7f61d012e3a0 0x7f61d01509a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.417+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954447352 0 0) 0x7f61d0131470 con 0x7f61d00a5de0 2020-02-11T16:16:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.417+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b0002fe0 con 0x7f61d00a5de0 2020-02-11T16:16:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 431106915 0 0) 0x7f61b0002fe0 con 0x7f61d00a5de0 2020-02-11T16:16:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f61d0131470 con 0x7f61d00a5de0 2020-02-11T16:16:43.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f61c0001490 con 0x7f61d00a5de0 2020-02-11T16:16:43.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 >> v2:172.21.15.88:3300/0 conn(0x7f61d012e3a0 msgr2=0x7f61d01509a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:43.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 --2- 172.21.15.88:0/1031017718 >> v2:172.21.15.88:3300/0 conn(0x7f61d012e3a0 0x7f61d01509a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 >> v1:172.21.15.88:6789/0 conn(0x7f61d00a18a0 legacy=0x7f61d0065450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 >> v1:172.21.15.52:6789/0 conn(0x7f61d00a5de0 legacy=0x7f61d01283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b00049b0 0x7f61b0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0004200 0x7f61b000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0130730 con 0x7f61b00049b0 2020-02-11T16:16:43.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0004790 con 0x7f61b0004200 2020-02-11T16:16:43.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b000bbe0 con 0x7f61b0003920 2020-02-11T16:16:43.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0004200 0x7f61b000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b00049b0 0x7f61b0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61cffff700 1 -- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0004200 msgr2=0x7f61b000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:16:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61cffff700 1 -- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0004200 msgr2=0x7f61b000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:16:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0004200 0x7f61b000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:16:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0004200 0x7f61b000b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ceffd700 1 -- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0004200 msgr2=0x7f61b000b750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0004200 0x7f61b000b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ceffd700 1 -- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b00049b0 msgr2=0x7f61b0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b00049b0 0x7f61b0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61cffff700 1 -- 172.21.15.88:0/1031017718 reap_dead start 2020-02-11T16:16:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ceffd700 1 -- 172.21.15.88:0/1031017718 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d012fd50 con 0x7f61b0003920 2020-02-11T16:16:43.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61d5f63700 1 -- 172.21.15.88:0/1031017718 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d012fff0 con 0x7f61b0003920 2020-02-11T16:16:43.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61c0002ef0 tx=0x7f61b00048d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61d5f63700 1 -- 172.21.15.88:0/1031017718 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d0138dd0 con 0x7f61b0003920 2020-02-11T16:16:43.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61c0002ef0 tx=0x7f61b00048d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.418+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f61c0002ef0 tx=0x7f61b00048d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.419+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 0x7f61d0065450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.419+0000 7f61d5f63700 1 -- 172.21.15.88:0/1031017718 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d005e2f0 con 0x7f61d012b590 2020-02-11T16:16:43.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.419+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 0x7f61d0065450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.419+0000 7f61cf7fe700 1 -- 172.21.15.88:0/1031017718 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61d012f5d0 con 0x7f61d012b590 2020-02-11T16:16:43.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.419+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 0x7f61d0065450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61d0131830 tx=0x7f61d00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.419+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 0x7f61d0065450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61d0131830 tx=0x7f61d00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.419+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 0x7f61d0065450 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f61d0131830 tx=0x7f61d00a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 0x7f61d0065450 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f61d0131830 tx=0x7f61d00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c4007340 con 0x7f61d012b590 2020-02-11T16:16:43.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f61c0002ef0 tx=0x7f61b00048d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c0011220 con 0x7f61b0003920 2020-02-11T16:16:43.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f61c0002ef0 tx=0x7f61b00048d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f61c0002ef0 tx=0x7f61b00048d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c000da90 con 0x7f61b0003920 2020-02-11T16:16:43.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c000e4a0 con 0x7f61b0003920 2020-02-11T16:16:43.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 0x7f61d0065450 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f61d0131830 tx=0x7f61d00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f61c40074a0 con 0x7f61d012b590 2020-02-11T16:16:43.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 msgr2=0x7f61d0065450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ccff9700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 0x7f61d0065450 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f61d0131830 tx=0x7f61d00a1c80).stop 2020-02-11T16:16:43.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 msgr2=0x7f61d0065450 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:43.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ccff9700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 0x7f61d0065450 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0x7f61d0131830 tx=0x7f61d00a1c80).stop 2020-02-11T16:16:43.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.420+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f61c0002ef0 tx=0x7f61b00048d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.421+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f61c000e600 con 0x7f61b0003920 2020-02-11T16:16:43.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.421+0000 7f61ceffd700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f61c0002ef0 tx=0x7f61b00048d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.421+0000 7f61ccff9700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61b003dbd0 0x7f61b0040090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.421+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f61c004aa30 con 0x7f61b0003920 2020-02-11T16:16:43.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.421+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61b003dbd0 0x7f61b0040090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.421+0000 7f61cf7fe700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61b003dbd0 0x7f61b0040090 crc :-1 s=READY pgs=292 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.449 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:16:43.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.428+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 0x7f61d00658b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.428+0000 7f61d5f63700 1 -- 172.21.15.88:0/1031017718 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d01301f0 con 0x7f61d012b970 2020-02-11T16:16:43.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 0x7f61d00658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61cffff700 1 -- 172.21.15.88:0/1031017718 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f61d00565b0 con 0x7f61d012b970 2020-02-11T16:16:43.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 0x7f61d00658b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61c0008010 tx=0x7f61c8010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 0x7f61d00658b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61c0008010 tx=0x7f61c8010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 0x7f61d00658b0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f61c0008010 tx=0x7f61c8010c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 0x7f61d00658b0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f61c0008010 tx=0x7f61c8010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c8001920 con 0x7f61d012b970 2020-02-11T16:16:43.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61cffff700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 0x7f61d00658b0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f61c0008010 tx=0x7f61c8010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3849 (secure 0 0 0) 0x7f61c8001a80 con 0x7f61d012b970 2020-02-11T16:16:43.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 msgr2=0x7f61d00658b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61ccff9700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 0x7f61d00658b0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f61c0008010 tx=0x7f61c8010c90).stop 2020-02-11T16:16:43.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61ccff9700 1 -- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 msgr2=0x7f61d00658b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:43.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.429+0000 7f61ccff9700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 0x7f61d00658b0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0x7f61c0008010 tx=0x7f61c8010c90).stop 2020-02-11T16:16:43.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 -- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61b003dbd0 msgr2=0x7f61b0040090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61b003dbd0 0x7f61b0040090 crc :-1 s=READY pgs=292 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 -- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 msgr2=0x7f61b0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f61c0002ef0 tx=0x7f61b00048d0).stop 2020-02-11T16:16:43.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 -- 172.21.15.88:0/1031017718 shutdown_connections 2020-02-11T16:16:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61b003dbd0 0x7f61b0040090 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61b0003920 0x7f61b0003da0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b590 0x7f61d0065450 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 --2- 172.21.15.88:0/1031017718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d012b970 0x7f61d00658b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 -- 172.21.15.88:0/1031017718 >> 172.21.15.88:0/1031017718 conn(0x7f61d009d110 msgr2=0x7f61d00a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 -- 172.21.15.88:0/1031017718 shutdown_connections 2020-02-11T16:16:43.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.430+0000 7f61d5f63700 1 -- 172.21.15.88:0/1031017718 wait complete. 2020-02-11T16:16:43.455 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:43.455 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:43.455 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:43.455 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:16:43.456 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 96, 2020-02-11T16:16:43.456 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:43.456 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:43.457 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:16:43.457 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:43.457 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.457 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:16:43.457 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:43.457 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:43.458 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:43.458 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:43.458 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:43.458 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:43.458 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:43.458 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:43.459 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:43.459 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.459 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:43.459 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:43.459 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:43.459 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:43.460 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:43.460 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:43.460 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:43.460 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:43.460 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.461 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:43.461 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:43.461 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:43.461 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:43.461 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:43.461 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:43.462 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:43.462 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:43.462 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:43.462 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:43.462 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:43.462 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:43.463 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:43.463 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:43.463 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:43.463 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:43.463 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:43.464 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:43.464 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.464 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:43.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.464 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:43.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.465 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:43.465 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:43.465 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:43.465 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:43.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.466 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:43.466 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:43.466 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.467 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:43.467 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:43.467 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.467 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.467 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.468 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:43.468 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:43.468 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:43.468 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:43.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.469 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:43.469 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:43.469 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:43.469 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:43.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.470 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:43.470 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:43.470 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.470 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:43.470 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:43.471 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.471 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.471 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.471 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:43.471 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:43.471 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:43.472 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:43.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.472 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:43.472 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:43.472 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:43.473 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:43.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.473 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:43.473 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:43.474 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.475 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:43.475 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:43.475 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.475 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.475 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:43.476 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:43.476 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:43.476 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:43.476 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.477 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.477 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:43.477 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:43.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.477 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.477 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.478 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:43.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.478 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.478 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:43.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.479 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.479 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.479 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:43.479 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.479 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.479 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.479 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:43.480 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:16:43.483 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:16:43.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.588+0000 7f7575b1c700 1 Processor -- start 2020-02-11T16:16:43.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.588+0000 7f7575b1c700 1 -- start start 2020-02-11T16:16:43.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f7575b1c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75700a8690 0x7f7570136040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:43.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f7575b1c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75701364a0 0x7f7570140370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:43.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f7575b1c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75700a4af0 con 0x7f75700a3a90 2020-02-11T16:16:43.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f7575b1c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75701302a0 con 0x7f75700a8690 2020-02-11T16:16:43.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f7575b1c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7570135a20 con 0x7f75701364a0 2020-02-11T16:16:43.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75701364a0 0x7f7570140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75701364a0 0x7f7570140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56086/0 (socket says 172.21.15.88:56086) 2020-02-11T16:16:43.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 -- 172.21.15.88:0/255541915 learned_addr learned my addr 172.21.15.88:0/255541915 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:43.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756f7fe700 1 --1- 172.21.15.88:0/255541915 >> v1:172.21.15.88:6789/0 conn(0x7f75700a3a90 0x7f75700a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43708/0 (socket says 172.21.15.88:43708) 2020-02-11T16:16:43.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 -- 172.21.15.88:0/255541915 >> v2:172.21.15.52:3300/0 conn(0x7f75700a8690 msgr2=0x7f7570136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:43.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756effd700 1 --2- 172.21.15.88:0/255541915 >> v2:172.21.15.52:3300/0 conn(0x7f75700a8690 0x7f7570136040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 --2- 172.21.15.88:0/255541915 >> v2:172.21.15.52:3300/0 conn(0x7f75700a8690 0x7f7570136040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:43.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 -- 172.21.15.88:0/255541915 >> v1:172.21.15.88:6789/0 conn(0x7f75700a3a90 legacy=0x7f75700a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 -- 172.21.15.88:0/255541915 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75700a4d90 con 0x7f75701364a0 2020-02-11T16:16:43.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 --2- 172.21.15.88:0/255541915 >> v2:172.21.15.88:3300/0 conn(0x7f75701364a0 0x7f7570140370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 --2- 172.21.15.88:0/255541915 >> v2:172.21.15.88:3300/0 conn(0x7f75701364a0 0x7f7570140370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 --2- 172.21.15.88:0/255541915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570140370 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).ready entity=mon.1 client_cookie=62d703e11924efab server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 --2- 172.21.15.88:0/255541915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570140370 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 --2- 172.21.15.88:0/255541915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570140370 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756e7fc700 1 -- 172.21.15.88:0/255541915 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f756800a160 con 0x7f75701364a0 2020-02-11T16:16:43.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756ffff700 1 --2- 172.21.15.88:0/255541915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570140370 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756e7fc700 1 -- 172.21.15.88:0/255541915 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756800a2c0 con 0x7f75701364a0 2020-02-11T16:16:43.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f756e7fc700 1 -- 172.21.15.88:0/255541915 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f756800a660 con 0x7f75701364a0 2020-02-11T16:16:43.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f7575b1c700 1 -- 172.21.15.88:0/255541915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 msgr2=0x7f7570140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.589+0000 7f7575b1c700 1 --2- 172.21.15.88:0/255541915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570140370 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).stop 2020-02-11T16:16:43.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.590+0000 7f7575b1c700 1 -- 172.21.15.88:0/255541915 shutdown_connections 2020-02-11T16:16:43.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.590+0000 7f7575b1c700 1 --2- 172.21.15.88:0/255541915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570140370 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.590+0000 7f7575b1c700 1 --2- 172.21.15.88:0/255541915 >> v2:172.21.15.52:3300/0 conn(0x7f75700a8690 0x7f7570136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:43.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.590+0000 7f7575b1c700 1 -- 172.21.15.88:0/255541915 >> 172.21.15.88:0/255541915 conn(0x7f75700ac2d0 msgr2=0x7f75700ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:43.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.590+0000 7f7575b1c700 1 -- 172.21.15.88:0/255541915 shutdown_connections 2020-02-11T16:16:43.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.590+0000 7f7575b1c700 1 -- 172.21.15.88:0/255541915 wait complete. 2020-02-11T16:16:43.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.591+0000 7f7575b1c700 1 Processor -- start 2020-02-11T16:16:43.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.591+0000 7f7575b1c700 1 -- start start 2020-02-11T16:16:43.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.591+0000 7f7575b1c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75700a3a90 0x7f757012c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f7575b1c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75701364a0 0x7f7570129700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f7575b1c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757013d310 con 0x7f75700a8690 2020-02-11T16:16:43.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f7575b1c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757012ce40 con 0x7f75701364a0 2020-02-11T16:16:43.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f7575b1c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757012d0e0 con 0x7f75700a3a90 2020-02-11T16:16:43.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75701364a0 0x7f7570129700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75701364a0 0x7f7570129700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56092/0 (socket says 172.21.15.88:56092) 2020-02-11T16:16:43.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 -- 172.21.15.88:0/418848661 learned_addr learned my addr 172.21.15.88:0/418848661 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:43.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756f7fe700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75700a3a90 0x7f757012c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 -- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75700a3a90 msgr2=0x7f757012c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75700a3a90 0x7f757012c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 -- 172.21.15.88:0/418848661 >> v1:172.21.15.52:6789/0 conn(0x7f75700a8690 legacy=0x7f757012a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 -- 172.21.15.88:0/418848661 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757012cb90 con 0x7f75701364a0 2020-02-11T16:16:43.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756f7fe700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75700a3a90 0x7f757012c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:16:43.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 --2- 172.21.15.88:0/418848661 >> v2:172.21.15.88:3300/0 conn(0x7f75701364a0 0x7f7570129700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 --2- 172.21.15.88:0/418848661 >> v2:172.21.15.88:3300/0 conn(0x7f75701364a0 0x7f7570129700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570129700 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570129700 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7568010660 con 0x7f75701364a0 2020-02-11T16:16:43.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570129700 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756ffff700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570129700 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568005c30 con 0x7f75701364a0 2020-02-11T16:16:43.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f7575b1c700 1 -- 172.21.15.88:0/418848661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7570142c00 con 0x7f75701364a0 2020-02-11T16:16:43.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7568005e20 con 0x7f75701364a0 2020-02-11T16:16:43.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.592+0000 7f7575b1c700 1 -- 172.21.15.88:0/418848661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7570129da0 con 0x7f75701364a0 2020-02-11T16:16:43.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.593+0000 7f756ffff700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570129700 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.593+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f756800f760 con 0x7f75701364a0 2020-02-11T16:16:43.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.593+0000 7f756ffff700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570129700 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.593+0000 7f756cff9700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7550039bb0 0x7f755003c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.593+0000 7f7575b1c700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 0x7f7570143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.593+0000 7f7575b1c700 1 -- 172.21.15.88:0/418848661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757005e2f0 con 0x7f757005a960 2020-02-11T16:16:43.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.593+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f756804aa50 con 0x7f75701364a0 2020-02-11T16:16:43.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.593+0000 7f756f7fe700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7550039bb0 0x7f755003c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.593+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 0x7f7570143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756f7fe700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7550039bb0 0x7f755003c070 crc :-1 s=READY pgs=293 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756effd700 1 -- 172.21.15.88:0/418848661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7570142df0 con 0x7f757005a960 2020-02-11T16:16:43.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 0x7f7570143490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 0x7f7570143490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 0x7f7570143490 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 0x7f7570143490 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7564013060 con 0x7f757005a960 2020-02-11T16:16:43.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 0x7f7570143490 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f7564007540 con 0x7f757005a960 2020-02-11T16:16:43.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 msgr2=0x7f7570143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756cff9700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 0x7f7570143490 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).stop 2020-02-11T16:16:43.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 msgr2=0x7f7570143490 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:43.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.594+0000 7f756cff9700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757005a960 0x7f7570143490 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).stop 2020-02-11T16:16:43.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.602+0000 7f7575b1c700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 0x7f75700aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.602+0000 7f7575b1c700 1 -- 172.21.15.88:0/418848661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75700565b0 con 0x7f75700aa1b0 2020-02-11T16:16:43.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.603+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 0x7f75700aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.603+0000 7f756effd700 1 -- 172.21.15.88:0/418848661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f757005ccb0 con 0x7f75700aa1b0 2020-02-11T16:16:43.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.603+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 0x7f75700aa5c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.603+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 0x7f75700aa5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.603+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 0x7f75700aa5c0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.603+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 0x7f75700aa5c0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.603+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f756400f5c0 con 0x7f75700aa1b0 2020-02-11T16:16:43.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f756effd700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 0x7f75700aa5c0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f756400f720 con 0x7f75700aa1b0 2020-02-11T16:16:43.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 msgr2=0x7f75700aa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f756cff9700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 0x7f75700aa5c0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).stop 2020-02-11T16:16:43.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f756cff9700 1 -- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 msgr2=0x7f75700aa5c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f756cff9700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75700aa1b0 0x7f75700aa5c0 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0x7f757005b840 tx=0x7f75640109d0).stop 2020-02-11T16:16:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f7575b1c700 1 -- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7550039bb0 msgr2=0x7f755003c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f7575b1c700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7550039bb0 0x7f755003c070 crc :-1 s=READY pgs=293 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f7575b1c700 1 -- 172.21.15.88:0/418848661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 msgr2=0x7f7570129700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f7575b1c700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570129700 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f75680032b0 tx=0x7f7568007dc0).stop 2020-02-11T16:16:43.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f756ffff700 1 -- 172.21.15.88:0/418848661 reap_dead start 2020-02-11T16:16:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f7575b1c700 1 -- 172.21.15.88:0/418848661 shutdown_connections 2020-02-11T16:16:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f7575b1c700 1 --2- 172.21.15.88:0/418848661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75701364a0 0x7f7570129700 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f7575b1c700 1 -- 172.21.15.88:0/418848661 >> 172.21.15.88:0/418848661 conn(0x7f75700ac2d0 msgr2=0x7f757012f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f7575b1c700 1 -- 172.21.15.88:0/418848661 shutdown_connections 2020-02-11T16:16:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.604+0000 7f7575b1c700 1 -- 172.21.15.88:0/418848661 wait complete. 2020-02-11T16:16:43.626 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:43.627 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:43.627 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:43.627 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:16:43.627 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 96, 2020-02-11T16:16:43.627 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:43.628 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:43.628 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:16:43.628 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:43.628 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.628 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:16:43.628 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:43.629 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:43.629 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:43.629 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:43.629 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:43.630 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:43.630 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:43.630 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:43.630 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:43.630 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.631 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:43.631 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:43.631 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:43.631 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:43.631 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:43.631 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:43.631 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:43.632 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:43.632 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.632 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:43.633 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:43.633 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:43.633 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:43.633 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:43.633 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:43.633 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:43.634 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:43.634 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:43.634 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:43.634 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:43.634 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:43.634 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:43.634 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:43.635 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:43.635 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:43.635 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:43.635 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:43.635 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.635 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:43.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.636 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:43.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.636 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:43.636 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:43.636 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:43.636 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:43.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.637 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:43.637 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:43.637 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.638 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:43.638 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:43.638 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.638 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.638 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.639 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:43.639 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:43.639 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:43.639 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:43.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.640 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:43.640 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:43.640 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:43.640 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:43.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.641 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:43.641 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:43.641 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.642 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:43.642 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:43.642 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.643 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.643 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.643 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:43.643 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:43.643 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:43.644 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:43.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.644 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:43.644 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:43.645 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:43.645 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:43.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.645 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:43.645 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:43.645 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.646 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:43.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:43.646 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.647 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.647 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:43.647 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:43.647 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:43.648 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:43.648 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.648 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.648 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:43.648 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:43.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.649 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.649 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.649 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:43.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.650 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.650 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:16:43.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.650 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.650 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.651 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:43.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.651 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.651 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:16:43.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.651 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.652 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.652 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:16:43.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.652 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.652 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:43.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.652 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.653 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.653 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:16:43.653 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.653 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.653 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:16:43.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.655 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:43.655 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:16:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.765+0000 7fdd1d457700 1 Processor -- start 2020-02-11T16:16:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.765+0000 7fdd1d457700 1 -- start start 2020-02-11T16:16:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.766+0000 7fdd1d457700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd180a1520 0x7fdd18131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.766+0000 7fdd1d457700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd180a4350 con 0x7fdd180a5b20 2020-02-11T16:16:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.766+0000 7fdd1d457700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd180a3a40 con 0x7fdd180a2fa0 2020-02-11T16:16:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.766+0000 7fdd1d457700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180a1e60 con 0x7fdd180a1520 2020-02-11T16:16:43.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.766+0000 7fdd16ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdd180a2fa0 0x7fdd180a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43726/0 (socket says 172.21.15.88:43726) 2020-02-11T16:16:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.766+0000 7fdd16ffd700 1 -- 172.21.15.88:0/4188918900 learned_addr learned my addr 172.21.15.88:0/4188918900 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.766+0000 7fdd177fe700 1 --2- 172.21.15.88:0/4188918900 >> v2:172.21.15.52:3300/0 conn(0x7fdd180a1520 0x7fdd18131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.766+0000 7fdd15ffb700 1 -- 172.21.15.88:0/4188918900 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579598703 0 0) 0x7fdd180a3a40 con 0x7fdd180a2fa0 2020-02-11T16:16:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd15ffb700 1 -- 172.21.15.88:0/4188918900 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcfc003230 con 0x7fdd180a2fa0 2020-02-11T16:16:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd15ffb700 1 -- 172.21.15.88:0/4188918900 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2592540099 0 0) 0x7fdcfc003230 con 0x7fdd180a2fa0 2020-02-11T16:16:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd177fe700 1 -- 172.21.15.88:0/4188918900 >> v1:172.21.15.88:6789/0 conn(0x7fdd180a2fa0 legacy=0x7fdd180a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd177fe700 1 -- 172.21.15.88:0/4188918900 >> v1:172.21.15.52:6789/0 conn(0x7fdd180a5b20 legacy=0x7fdd18131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd177fe700 1 -- 172.21.15.88:0/4188918900 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180a3ce0 con 0x7fdd180a1520 2020-02-11T16:16:43.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd177fe700 1 --2- 172.21.15.88:0/4188918900 >> v2:172.21.15.52:3300/0 conn(0x7fdd180a1520 0x7fdd18131990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd080010d0 tx=0x7fdd10008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd177fe700 1 --2- 172.21.15.88:0/4188918900 >> v2:172.21.15.52:3300/0 conn(0x7fdd180a1520 0x7fdd18131990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd080010d0 tx=0x7fdd10008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd177fe700 1 --2- 172.21.15.88:0/4188918900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd180a1520 0x7fdd18131990 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fdd080010d0 tx=0x7fdd10008c60).ready entity=mon.0 client_cookie=7456ab87fad5ece4 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd177fe700 1 --2- 172.21.15.88:0/4188918900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd180a1520 0x7fdd18131990 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fdd080010d0 tx=0x7fdd10008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd15ffb700 1 -- 172.21.15.88:0/4188918900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c0016d0 con 0x7fdd180a1520 2020-02-11T16:16:43.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd177fe700 1 --2- 172.21.15.88:0/4188918900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd180a1520 0x7fdd18131990 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fdd080010d0 tx=0x7fdd10008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd15ffb700 1 -- 172.21.15.88:0/4188918900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10010b30 con 0x7fdd180a1520 2020-02-11T16:16:43.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd177fe700 1 --2- 172.21.15.88:0/4188918900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd180a1520 0x7fdd18131990 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fdd080010d0 tx=0x7fdd10008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd15ffb700 1 -- 172.21.15.88:0/4188918900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd10010e90 con 0x7fdd180a1520 2020-02-11T16:16:43.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd1d457700 1 -- 172.21.15.88:0/4188918900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd180a1520 msgr2=0x7fdd18131990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.767+0000 7fdd1d457700 1 --2- 172.21.15.88:0/4188918900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd180a1520 0x7fdd18131990 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fdd080010d0 tx=0x7fdd10008c60).stop 2020-02-11T16:16:43.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.768+0000 7fdd1d457700 1 -- 172.21.15.88:0/4188918900 shutdown_connections 2020-02-11T16:16:43.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.768+0000 7fdd1d457700 1 --2- 172.21.15.88:0/4188918900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd180a1520 0x7fdd18131990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.768+0000 7fdd1d457700 1 -- 172.21.15.88:0/4188918900 >> 172.21.15.88:0/4188918900 conn(0x7fdd1809d110 msgr2=0x7fdd1809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:43.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.768+0000 7fdd1d457700 1 -- 172.21.15.88:0/4188918900 shutdown_connections 2020-02-11T16:16:43.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.768+0000 7fdd1d457700 1 -- 172.21.15.88:0/4188918900 wait complete. 2020-02-11T16:16:43.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd1d457700 1 Processor -- start 2020-02-11T16:16:43.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd1d457700 1 -- start start 2020-02-11T16:16:43.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd1d457700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd180a1520 0x7fdd18140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd1d457700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd180a2fa0 0x7fdd18066660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd1d457700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd18067050 con 0x7fdd180a5b20 2020-02-11T16:16:43.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd1d457700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd18131df0 con 0x7fdd180a1520 2020-02-11T16:16:43.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd1d457700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18138260 con 0x7fdd180a2fa0 2020-02-11T16:16:43.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd16ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd180a1520 0x7fdd18140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd16ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd180a1520 0x7fdd18140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56102/0 (socket says 172.21.15.88:56102) 2020-02-11T16:16:43.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd16ffd700 1 -- 172.21.15.88:0/130873850 learned_addr learned my addr 172.21.15.88:0/130873850 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:43.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd16ffd700 1 -- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd180a2fa0 msgr2=0x7fdd18066660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.769+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd180a2fa0 0x7fdd18066660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd16ffd700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd180a2fa0 0x7fdd18066660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd16ffd700 1 -- 172.21.15.88:0/130873850 >> v1:172.21.15.52:6789/0 conn(0x7fdd180a5b20 legacy=0x7fdd181442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd16ffd700 1 -- 172.21.15.88:0/130873850 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1809def0 con 0x7fdd180a1520 2020-02-11T16:16:43.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd180a2fa0 0x7fdd18066660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:16:43.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd16ffd700 1 --2- 172.21.15.88:0/130873850 >> v2:172.21.15.88:3300/0 conn(0x7fdd180a1520 0x7fdd18140d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd18131d40 tx=0x7fdd0c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd16ffd700 1 --2- 172.21.15.88:0/130873850 >> v2:172.21.15.88:3300/0 conn(0x7fdd180a1520 0x7fdd18140d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd18131d40 tx=0x7fdd0c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd16ffd700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd180a1520 0x7fdd18140d80 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fdd18131d40 tx=0x7fdd0c010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd16ffd700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd180a1520 0x7fdd18140d80 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fdd18131d40 tx=0x7fdd0c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c012a10 con 0x7fdd180a1520 2020-02-11T16:16:43.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd16ffd700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd180a1520 0x7fdd18140d80 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fdd18131d40 tx=0x7fdd0c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd16ffd700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd180a1520 0x7fdd18140d80 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fdd18131d40 tx=0x7fdd0c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c012b70 con 0x7fdd180a1520 2020-02-11T16:16:43.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd1d457700 1 -- 172.21.15.88:0/130873850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1809e190 con 0x7fdd180a1520 2020-02-11T16:16:43.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c00c570 con 0x7fdd180a1520 2020-02-11T16:16:43.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd1d457700 1 -- 172.21.15.88:0/130873850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1809ec10 con 0x7fdd180a1520 2020-02-11T16:16:43.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.770+0000 7fdd16ffd700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd180a1520 0x7fdd18140d80 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fdd18131d40 tx=0x7fdd0c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdd0c00c7e0 con 0x7fdd180a1520 2020-02-11T16:16:43.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd16ffd700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd180a1520 0x7fdd18140d80 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fdd18131d40 tx=0x7fdd0c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd1d457700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 0x7fdd18066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd1d457700 1 -- 172.21.15.88:0/130873850 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1805e2f0 con 0x7fdd1809f380 2020-02-11T16:16:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd07fff700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdcf4039ca0 0x7fdcf403c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdd0c049cf0 con 0x7fdd180a1520 2020-02-11T16:16:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 0x7fdd18066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd177fe700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdcf4039ca0 0x7fdcf403c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd177fe700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdcf4039ca0 0x7fdcf403c160 crc :-1 s=READY pgs=294 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd167fc700 1 -- 172.21.15.88:0/130873850 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd181380e0 con 0x7fdd1809f380 2020-02-11T16:16:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 0x7fdd18066ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 0x7fdd18066ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.771+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 0x7fdd18066ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.772+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 0x7fdd18066ac0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.772+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0800cc20 con 0x7fdd1809f380 2020-02-11T16:16:43.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.772+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 0x7fdd18066ac0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.772+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fdd0800cd80 con 0x7fdd1809f380 2020-02-11T16:16:43.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.772+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 msgr2=0x7fdd18066ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.772+0000 7fdd07fff700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 0x7fdd18066ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).stop 2020-02-11T16:16:43.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.772+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 msgr2=0x7fdd18066ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.772+0000 7fdd07fff700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd1809f380 0x7fdd18066ac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.780+0000 7fdd1d457700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 0x7fdd181449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.780+0000 7fdd1d457700 1 -- 172.21.15.88:0/130873850 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18139720 con 0x7fdd181387d0 2020-02-11T16:16:43.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.780+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 0x7fdd181449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.780+0000 7fdd167fc700 1 -- 172.21.15.88:0/130873850 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdd1809e7f0 con 0x7fdd181387d0 2020-02-11T16:16:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.780+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 0x7fdd181449e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.780+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 0x7fdd181449e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.780+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 0x7fdd181449e0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 0x7fdd181449e0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd08010270 con 0x7fdd181387d0 2020-02-11T16:16:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd167fc700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 0x7fdd181449e0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4359 (secure 0 0 0) 0x7fdd08014070 con 0x7fdd181387d0 2020-02-11T16:16:43.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 msgr2=0x7fdd181449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd07fff700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 0x7fdd181449e0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).stop 2020-02-11T16:16:43.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd07fff700 1 -- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 msgr2=0x7fdd181449e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:43.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd07fff700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd181387d0 0x7fdd181449e0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0x7fdd08001190 tx=0x7fdd080015d0).stop 2020-02-11T16:16:43.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd1d457700 1 -- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdcf4039ca0 msgr2=0x7fdcf403c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd1d457700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdcf4039ca0 0x7fdcf403c160 crc :-1 s=READY pgs=294 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd1d457700 1 -- 172.21.15.88:0/130873850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd180a1520 msgr2=0x7fdd18140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd1d457700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd180a1520 0x7fdd18140d80 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fdd18131d40 tx=0x7fdd0c010cd0).stop 2020-02-11T16:16:43.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd177fe700 1 -- 172.21.15.88:0/130873850 reap_dead start 2020-02-11T16:16:43.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd177fe700 1 -- 172.21.15.88:0/130873850 reap_dead start 2020-02-11T16:16:43.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd1d457700 1 -- 172.21.15.88:0/130873850 shutdown_connections 2020-02-11T16:16:43.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd1d457700 1 --2- 172.21.15.88:0/130873850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd180a1520 0x7fdd18140d80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd1d457700 1 -- 172.21.15.88:0/130873850 >> 172.21.15.88:0/130873850 conn(0x7fdd1809d110 msgr2=0x7fdd18069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:43.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd1d457700 1 -- 172.21.15.88:0/130873850 shutdown_connections 2020-02-11T16:16:43.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.781+0000 7fdd1d457700 1 -- 172.21.15.88:0/130873850 wait complete. 2020-02-11T16:16:43.802 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:43.802 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:43.803 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:43.803 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:16:43.803 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 96, 2020-02-11T16:16:43.803 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:43.803 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:43.803 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:16:43.803 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:43.804 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.804 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:16:43.804 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:43.804 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:43.804 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:43.804 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:43.805 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:43.805 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:43.805 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:43.805 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:43.806 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:43.806 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.806 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:43.806 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:43.806 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:43.806 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:43.807 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:43.807 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:43.807 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:43.807 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:43.807 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.807 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:43.807 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:43.808 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:43.808 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:43.808 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:43.808 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:43.808 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:43.808 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:43.809 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:43.809 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:43.809 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:43.809 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:43.810 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:43.810 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:43.810 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:43.810 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:43.810 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:43.810 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:43.811 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.811 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:43.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.811 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:43.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.811 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:43.811 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:43.811 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:16:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:16:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:16:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:16:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:16:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:43.830 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:43.830 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:16:43.830 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:16:43.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.933+0000 7f240a7a6700 1 Processor -- start 2020-02-11T16:16:43.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.933+0000 7f240a7a6700 1 -- start start 2020-02-11T16:16:43.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f240a7a6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24040a7120 0x7f24040a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:43.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f240a7a6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2404136930 con 0x7f24040a5cf0 2020-02-11T16:16:43.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f240a7a6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24040a6470 con 0x7f24040a50f0 2020-02-11T16:16:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f240a7a6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24040a49b0 con 0x7f24040a7120 2020-02-11T16:16:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2403fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24040a7120 0x7f24040a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f24037fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f24040a50f0 0x7f240413c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43742/0 (socket says 172.21.15.88:43742) 2020-02-11T16:16:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f24037fe700 1 -- 172.21.15.88:0/3080294246 learned_addr learned my addr 172.21.15.88:0/3080294246 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:43.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2403fff700 1 -- 172.21.15.88:0/3080294246 >> v1:172.21.15.88:6789/0 conn(0x7f24040a50f0 legacy=0x7f240413c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2403fff700 1 -- 172.21.15.88:0/3080294246 >> v1:172.21.15.52:6789/0 conn(0x7f24040a5cf0 legacy=0x7f240413c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2403fff700 1 -- 172.21.15.88:0/3080294246 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24040a4c50 con 0x7f24040a7120 2020-02-11T16:16:43.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2403fff700 1 --2- 172.21.15.88:0/3080294246 >> v2:172.21.15.88:3300/0 conn(0x7f24040a7120 0x7f24040a2900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23f4002f30 tx=0x7f23f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2403fff700 1 --2- 172.21.15.88:0/3080294246 >> v2:172.21.15.88:3300/0 conn(0x7f24040a7120 0x7f24040a2900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23f4002f30 tx=0x7f23f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2403fff700 1 --2- 172.21.15.88:0/3080294246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a7120 0x7f24040a2900 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f23f4002f30 tx=0x7f23f40088e0).ready entity=mon.1 client_cookie=f1e19ebcdf7663e1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2403fff700 1 --2- 172.21.15.88:0/3080294246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a7120 0x7f24040a2900 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f23f4002f30 tx=0x7f23f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2403fff700 1 --2- 172.21.15.88:0/3080294246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a7120 0x7f24040a2900 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f23f4002f30 tx=0x7f23f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2402ffd700 1 -- 172.21.15.88:0/3080294246 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f4008e40 con 0x7f24040a7120 2020-02-11T16:16:43.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2403fff700 1 --2- 172.21.15.88:0/3080294246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a7120 0x7f24040a2900 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f23f4002f30 tx=0x7f23f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2402ffd700 1 -- 172.21.15.88:0/3080294246 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f40116a0 con 0x7f24040a7120 2020-02-11T16:16:43.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f2402ffd700 1 -- 172.21.15.88:0/3080294246 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f4011a80 con 0x7f24040a7120 2020-02-11T16:16:43.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f240a7a6700 1 -- 172.21.15.88:0/3080294246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a7120 msgr2=0x7f24040a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.934+0000 7f240a7a6700 1 --2- 172.21.15.88:0/3080294246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a7120 0x7f24040a2900 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f23f4002f30 tx=0x7f23f40088e0).stop 2020-02-11T16:16:43.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.935+0000 7f240a7a6700 1 -- 172.21.15.88:0/3080294246 shutdown_connections 2020-02-11T16:16:43.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.935+0000 7f240a7a6700 1 --2- 172.21.15.88:0/3080294246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a7120 0x7f24040a2900 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.935+0000 7f240a7a6700 1 -- 172.21.15.88:0/3080294246 >> 172.21.15.88:0/3080294246 conn(0x7f240409d110 msgr2=0x7f240409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.935+0000 7f240a7a6700 1 -- 172.21.15.88:0/3080294246 shutdown_connections 2020-02-11T16:16:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.935+0000 7f240a7a6700 1 -- 172.21.15.88:0/3080294246 wait complete. 2020-02-11T16:16:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.936+0000 7f240a7a6700 1 Processor -- start 2020-02-11T16:16:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.936+0000 7f240a7a6700 1 -- start start 2020-02-11T16:16:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.936+0000 7f240a7a6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24040a50f0 0x7f240414cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.936+0000 7f240a7a6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f24040a7120 0x7f240414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.936+0000 7f240a7a6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240413b100 con 0x7f24040a5cf0 2020-02-11T16:16:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.936+0000 7f240a7a6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2404134670 con 0x7f24040a7120 2020-02-11T16:16:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.936+0000 7f240a7a6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240413ce10 con 0x7f24040a50f0 2020-02-11T16:16:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24040a50f0 0x7f240414cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24040a50f0 0x7f240414cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56120/0 (socket says 172.21.15.88:56120) 2020-02-11T16:16:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 -- 172.21.15.88:0/4064495919 learned_addr learned my addr 172.21.15.88:0/4064495919 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 -- 172.21.15.88:0/4064495919 >> v2:172.21.15.52:3300/0 conn(0x7f24040a7120 msgr2=0x7f240414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> v2:172.21.15.52:3300/0 conn(0x7f24040a7120 0x7f240414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 -- 172.21.15.88:0/4064495919 >> v1:172.21.15.52:6789/0 conn(0x7f24040a5cf0 legacy=0x7f24040a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 -- 172.21.15.88:0/4064495919 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240413aeb0 con 0x7f24040a50f0 2020-02-11T16:16:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> v2:172.21.15.88:3300/0 conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> v2:172.21.15.88:3300/0 conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f24017fa700 1 -- 172.21.15.88:0/4064495919 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f4007150 con 0x7f24040a50f0 2020-02-11T16:16:43.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f24017fa700 1 -- 172.21.15.88:0/4064495919 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f40072b0 con 0x7f24040a50f0 2020-02-11T16:16:43.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f24017fa700 1 -- 172.21.15.88:0/4064495919 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f40056c0 con 0x7f24040a50f0 2020-02-11T16:16:43.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f240a7a6700 1 -- 172.21.15.88:0/4064495919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240413b4b0 con 0x7f24040a50f0 2020-02-11T16:16:43.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.937+0000 7f240a7a6700 1 -- 172.21.15.88:0/4064495919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24040a0fc0 con 0x7f24040a50f0 2020-02-11T16:16:43.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.938+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.938+0000 7f24017fa700 1 -- 172.21.15.88:0/4064495919 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f23f4005930 con 0x7f24040a50f0 2020-02-11T16:16:43.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.938+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.938+0000 7f240a7a6700 1 -- 172.21.15.88:0/4064495919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240413d010 con 0x7f24040a50f0 2020-02-11T16:16:43.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.938+0000 7f24017fa700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23e4039cc0 0x7f23e403c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:43.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.938+0000 7f24017fa700 1 -- 172.21.15.88:0/4064495919 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f23f404a330 con 0x7f24040a50f0 2020-02-11T16:16:43.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.938+0000 7f24037fe700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23e4039cc0 0x7f23e403c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:43.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.938+0000 7f24037fe700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23e4039cc0 0x7f23e403c180 crc :-1 s=READY pgs=295 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:43.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.941+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:43.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:43.942+0000 7f24017fa700 1 -- 172.21.15.88:0/4064495919 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f23f402f810 con 0x7f24040a50f0 2020-02-11T16:16:44.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.123+0000 7f240a7a6700 1 -- 172.21.15.88:0/4064495919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f24040565b0 con 0x7f24040a50f0 2020-02-11T16:16:44.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.124+0000 7f2403fff700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:44.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.124+0000 7f24017fa700 1 -- 172.21.15.88:0/4064495919 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f23f4032480 con 0x7f24040a50f0 2020-02-11T16:16:44.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.125+0000 7f240a7a6700 1 -- 172.21.15.88:0/4064495919 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23e4039cc0 msgr2=0x7f23e403c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:44.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.125+0000 7f240a7a6700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23e4039cc0 0x7f23e403c180 crc :-1 s=READY pgs=295 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:44.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.125+0000 7f240a7a6700 1 -- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 msgr2=0x7f240414cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:44.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.125+0000 7f240a7a6700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 0x7f240414cba0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f2404133a50 tx=0x7f23f4011450).stop 2020-02-11T16:16:44.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.126+0000 7f240a7a6700 1 -- 172.21.15.88:0/4064495919 shutdown_connections 2020-02-11T16:16:44.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.126+0000 7f240a7a6700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f23e4039cc0 0x7f23e403c180 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:44.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.126+0000 7f240a7a6700 1 --2- 172.21.15.88:0/4064495919 >> v2:172.21.15.52:3300/0 conn(0x7f24040a7120 0x7f240414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:44.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.126+0000 7f240a7a6700 1 --2- 172.21.15.88:0/4064495919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24040a50f0 0x7f240414cba0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:44.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.126+0000 7f240a7a6700 1 -- 172.21.15.88:0/4064495919 >> 172.21.15.88:0/4064495919 conn(0x7f240409d110 msgr2=0x7f24040a8580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:44.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.126+0000 7f240a7a6700 1 -- 172.21.15.88:0/4064495919 shutdown_connections 2020-02-11T16:16:44.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:44.126+0000 7f240a7a6700 1 -- 172.21.15.88:0/4064495919 wait complete. 2020-02-11T16:16:44.139 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:16:54.142 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:16:54.142 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.257+0000 7f6d6fc86700 1 Processor -- start 2020-02-11T16:16:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.257+0000 7f6d6fc86700 1 -- start start 2020-02-11T16:16:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6fc86700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6d680a18a0 0x7f6d680a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6fc86700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d680a6260 0x7f6d6812eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6fc86700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d680a3570 con 0x7f6d680a5de0 2020-02-11T16:16:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6fc86700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d680a3810 con 0x7f6d680a6260 2020-02-11T16:16:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6fc86700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680a3ab0 con 0x7f6d680a18a0 2020-02-11T16:16:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6e223700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d680a6260 0x7f6d6812eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6e223700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d680a6260 0x7f6d6812eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56130/0 (socket says 172.21.15.88:56130) 2020-02-11T16:16:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6e223700 1 -- 172.21.15.88:0/3119662199 learned_addr learned my addr 172.21.15.88:0/3119662199 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6d221700 1 --1- 172.21.15.88:0/3119662199 >> v1:172.21.15.88:6789/0 conn(0x7f6d680a5de0 0x7f6d6812e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43756/0 (socket says 172.21.15.88:43756) 2020-02-11T16:16:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6da22700 1 --2- 172.21.15.88:0/3119662199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6d680a18a0 0x7f6d680a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6e223700 1 -- 172.21.15.88:0/3119662199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6d680a18a0 msgr2=0x7f6d680a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6e223700 1 --2- 172.21.15.88:0/3119662199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6d680a18a0 0x7f6d680a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6e223700 1 -- 172.21.15.88:0/3119662199 >> v1:172.21.15.88:6789/0 conn(0x7f6d680a5de0 legacy=0x7f6d6812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6e223700 1 -- 172.21.15.88:0/3119662199 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d680a3d50 con 0x7f6d680a6260 2020-02-11T16:16:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.258+0000 7f6d6e223700 1 --2- 172.21.15.88:0/3119662199 >> v2:172.21.15.88:3300/0 conn(0x7f6d680a6260 0x7f6d6812eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d6805bbc0 tx=0x7f6d60008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6e223700 1 --2- 172.21.15.88:0/3119662199 >> v2:172.21.15.88:3300/0 conn(0x7f6d680a6260 0x7f6d6812eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d6805bbc0 tx=0x7f6d60008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6e223700 1 --2- 172.21.15.88:0/3119662199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a6260 0x7f6d6812eab0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f6d6805bbc0 tx=0x7f6d60008c60).ready entity=mon.1 client_cookie=8a90b63e9b19033e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6e223700 1 --2- 172.21.15.88:0/3119662199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a6260 0x7f6d6812eab0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f6d6805bbc0 tx=0x7f6d60008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6ca20700 1 -- 172.21.15.88:0/3119662199 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d6000a160 con 0x7f6d680a6260 2020-02-11T16:16:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6e223700 1 --2- 172.21.15.88:0/3119662199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a6260 0x7f6d6812eab0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f6d6805bbc0 tx=0x7f6d60008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6ca20700 1 -- 172.21.15.88:0/3119662199 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6000a2c0 con 0x7f6d680a6260 2020-02-11T16:16:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6e223700 1 --2- 172.21.15.88:0/3119662199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a6260 0x7f6d6812eab0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f6d6805bbc0 tx=0x7f6d60008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6ca20700 1 -- 172.21.15.88:0/3119662199 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d6000a6a0 con 0x7f6d680a6260 2020-02-11T16:16:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6fc86700 1 -- 172.21.15.88:0/3119662199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a6260 msgr2=0x7f6d6812eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6fc86700 1 --2- 172.21.15.88:0/3119662199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a6260 0x7f6d6812eab0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f6d6805bbc0 tx=0x7f6d60008c60).stop 2020-02-11T16:16:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6fc86700 1 -- 172.21.15.88:0/3119662199 shutdown_connections 2020-02-11T16:16:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6fc86700 1 --2- 172.21.15.88:0/3119662199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a6260 0x7f6d6812eab0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6fc86700 1 --2- 172.21.15.88:0/3119662199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6d680a18a0 0x7f6d680a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6fc86700 1 -- 172.21.15.88:0/3119662199 >> 172.21.15.88:0/3119662199 conn(0x7f6d6809d110 msgr2=0x7f6d6809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6fc86700 1 -- 172.21.15.88:0/3119662199 shutdown_connections 2020-02-11T16:16:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.259+0000 7f6d6fc86700 1 -- 172.21.15.88:0/3119662199 wait complete. 2020-02-11T16:16:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.260+0000 7f6d6fc86700 1 Processor -- start 2020-02-11T16:16:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.260+0000 7f6d6fc86700 1 -- start start 2020-02-11T16:16:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6fc86700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d680a18a0 0x7f6d6812f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6fc86700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d680a5de0 0x7f6d68130ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6fc86700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d68134470 con 0x7f6d680a6260 2020-02-11T16:16:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6fc86700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d68134710 con 0x7f6d680a5de0 2020-02-11T16:16:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6fc86700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d681356e0 con 0x7f6d680a18a0 2020-02-11T16:16:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d680a18a0 0x7f6d6812f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d680a18a0 0x7f6d6812f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56134/0 (socket says 172.21.15.88:56134) 2020-02-11T16:16:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 -- 172.21.15.88:0/1462395636 learned_addr learned my addr 172.21.15.88:0/1462395636 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6d221700 1 --2- 172.21.15.88:0/1462395636 >> v2:172.21.15.52:3300/0 conn(0x7f6d680a5de0 0x7f6d68130ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 -- 172.21.15.88:0/1462395636 >> v2:172.21.15.52:3300/0 conn(0x7f6d680a5de0 msgr2=0x7f6d68130ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> v2:172.21.15.52:3300/0 conn(0x7f6d680a5de0 0x7f6d68130ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 -- 172.21.15.88:0/1462395636 >> v1:172.21.15.52:6789/0 conn(0x7f6d680a6260 legacy=0x7f6d681281f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 -- 172.21.15.88:0/1462395636 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d68135850 con 0x7f6d680a18a0 2020-02-11T16:16:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6d221700 1 --2- 172.21.15.88:0/1462395636 >> v2:172.21.15.52:3300/0 conn(0x7f6d680a5de0 0x7f6d68130ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:16:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> v2:172.21.15.88:3300/0 conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> v2:172.21.15.88:3300/0 conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d56ffd700 1 -- 172.21.15.88:0/1462395636 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d58005b40 con 0x7f6d680a18a0 2020-02-11T16:16:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d56ffd700 1 -- 172.21.15.88:0/1462395636 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d58005ca0 con 0x7f6d680a18a0 2020-02-11T16:16:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.261+0000 7f6d56ffd700 1 -- 172.21.15.88:0/1462395636 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5800e8b0 con 0x7f6d680a18a0 2020-02-11T16:16:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.262+0000 7f6d6fc86700 1 -- 172.21.15.88:0/1462395636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d681316e0 con 0x7f6d680a18a0 2020-02-11T16:16:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.262+0000 7f6d6fc86700 1 -- 172.21.15.88:0/1462395636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d68131c30 con 0x7f6d680a18a0 2020-02-11T16:16:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.262+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.262+0000 7f6d56ffd700 1 -- 172.21.15.88:0/1462395636 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6d5800eb20 con 0x7f6d680a18a0 2020-02-11T16:16:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.262+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.263+0000 7f6d56ffd700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d48039d00 0x7f6d4803c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.263+0000 7f6d56ffd700 1 -- 172.21.15.88:0/1462395636 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6d5804a3e0 con 0x7f6d680a18a0 2020-02-11T16:16:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.263+0000 7f6d6d221700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d48039d00 0x7f6d4803c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.263+0000 7f6d6fc86700 1 -- 172.21.15.88:0/1462395636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d680565b0 con 0x7f6d680a18a0 2020-02-11T16:16:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.263+0000 7f6d6d221700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d48039d00 0x7f6d4803c1c0 crc :-1 s=READY pgs=296 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.267+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.267+0000 7f6d56ffd700 1 -- 172.21.15.88:0/1462395636 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f6d5802f960 con 0x7f6d680a18a0 2020-02-11T16:16:54.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.449+0000 7f6d6fc86700 1 -- 172.21.15.88:0/1462395636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6d68130d10 con 0x7f6d680a18a0 2020-02-11T16:16:54.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.450+0000 7f6d6da22700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.450+0000 7f6d56ffd700 1 -- 172.21.15.88:0/1462395636 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f6d58032470 con 0x7f6d680a18a0 2020-02-11T16:16:54.452 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 -- 172.21.15.88:0/1462395636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d48039d00 msgr2=0x7f6d4803c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d48039d00 0x7f6d4803c1c0 crc :-1 s=READY pgs=296 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 -- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 msgr2=0x7f6d6812f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 0x7f6d6812f410 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f6d58003070 tx=0x7f6d58010d40).stop 2020-02-11T16:16:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 -- 172.21.15.88:0/1462395636 shutdown_connections 2020-02-11T16:16:54.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d680a18a0 0x7f6d6812f410 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 --2- 172.21.15.88:0/1462395636 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6d48039d00 0x7f6d4803c1c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 --2- 172.21.15.88:0/1462395636 >> v2:172.21.15.52:3300/0 conn(0x7f6d680a5de0 0x7f6d68130ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 -- 172.21.15.88:0/1462395636 >> 172.21.15.88:0/1462395636 conn(0x7f6d6809d110 msgr2=0x7f6d680a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:54.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 -- 172.21.15.88:0/1462395636 shutdown_connections 2020-02-11T16:16:54.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.451+0000 7f6d6fc86700 1 -- 172.21.15.88:0/1462395636 wait complete. 2020-02-11T16:16:54.462 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":96,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:54.463 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:16:54.463 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:16:54.465 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:16:54.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.569+0000 7f3a3c3d9700 1 Processor -- start 2020-02-11T16:16:54.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.569+0000 7f3a3c3d9700 1 -- start start 2020-02-11T16:16:54.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3c3d9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 0x7f3a340a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:54.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3c3d9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a340a31b0 con 0x7f3a340a5de0 2020-02-11T16:16:54.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3c3d9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a340a3570 con 0x7f3a340a6260 2020-02-11T16:16:54.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3c3d9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340a3810 con 0x7f3a340a18a0 2020-02-11T16:16:54.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3a976700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3a340a6260 0x7f3a3412eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43772/0 (socket says 172.21.15.88:43772) 2020-02-11T16:16:54.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3a976700 1 -- 172.21.15.88:0/3793250783 learned_addr learned my addr 172.21.15.88:0/3793250783 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:54.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3793250783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 0x7f3a340a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a39173700 1 -- 172.21.15.88:0/3793250783 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955642518 0 0) 0x7f3a340a3570 con 0x7f3a340a6260 2020-02-11T16:16:54.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a39173700 1 -- 172.21.15.88:0/3793250783 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a1c003230 con 0x7f3a340a6260 2020-02-11T16:16:54.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a39173700 1 -- 172.21.15.88:0/3793250783 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2622284966 0 0) 0x7f3a1c003230 con 0x7f3a340a6260 2020-02-11T16:16:54.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3a175700 1 -- 172.21.15.88:0/3793250783 >> v1:172.21.15.88:6789/0 conn(0x7f3a340a6260 legacy=0x7f3a3412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3a175700 1 -- 172.21.15.88:0/3793250783 >> v1:172.21.15.52:6789/0 conn(0x7f3a340a5de0 legacy=0x7f3a3412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3a175700 1 -- 172.21.15.88:0/3793250783 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a340a3ab0 con 0x7f3a340a18a0 2020-02-11T16:16:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3793250783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 0x7f3a340a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a280010d0 tx=0x7f3a2c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3793250783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 0x7f3a340a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a280010d0 tx=0x7f3a2c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3793250783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 0x7f3a340a6dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a2c008c60).ready entity=mon.2 client_cookie=8ad5dce391dd219 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3793250783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 0x7f3a340a6dd0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a2c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.570+0000 7f3a39173700 1 -- 172.21.15.88:0/3793250783 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a300016d0 con 0x7f3a340a18a0 2020-02-11T16:16:54.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3793250783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 0x7f3a340a6dd0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a2c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3793250783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 0x7f3a340a6dd0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a2c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a39173700 1 -- 172.21.15.88:0/3793250783 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c010bb0 con 0x7f3a340a18a0 2020-02-11T16:16:54.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a39173700 1 -- 172.21.15.88:0/3793250783 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a2c0110c0 con 0x7f3a340a18a0 2020-02-11T16:16:54.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3793250783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 msgr2=0x7f3a340a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a3c3d9700 1 --2- 172.21.15.88:0/3793250783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 0x7f3a340a6dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a2c008c60).stop 2020-02-11T16:16:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3793250783 shutdown_connections 2020-02-11T16:16:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a3c3d9700 1 --2- 172.21.15.88:0/3793250783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a340a18a0 0x7f3a340a6dd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3793250783 >> 172.21.15.88:0/3793250783 conn(0x7f3a3409d110 msgr2=0x7f3a3409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3793250783 shutdown_connections 2020-02-11T16:16:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.571+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3793250783 wait complete. 2020-02-11T16:16:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.572+0000 7f3a3c3d9700 1 Processor -- start 2020-02-11T16:16:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.572+0000 7f3a3c3d9700 1 -- start start 2020-02-11T16:16:54.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.572+0000 7f3a3c3d9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a340a18a0 0x7f3a34130be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.572+0000 7f3a3c3d9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a34135bc0 con 0x7f3a340a6260 2020-02-11T16:16:54.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3c3d9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a340a0fc0 con 0x7f3a340a5de0 2020-02-11T16:16:54.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3c3d9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a34135400 con 0x7f3a340a18a0 2020-02-11T16:16:54.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a39974700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3a340a5de0 0x7f3a341345e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43776/0 (socket says 172.21.15.88:43776) 2020-02-11T16:16:54.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a39974700 1 -- 172.21.15.88:0/3744392270 learned_addr learned my addr 172.21.15.88:0/3744392270 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:54.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3744392270 >> v2:172.21.15.52:3300/0 conn(0x7f3a340a18a0 0x7f3a34130be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111565520 0 0) 0x7f3a340a0fc0 con 0x7f3a340a5de0 2020-02-11T16:16:54.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a14002fe0 con 0x7f3a340a5de0 2020-02-11T16:16:54.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3a175700 1 -- 172.21.15.88:0/3744392270 >> v1:172.21.15.88:6789/0 conn(0x7f3a340a5de0 legacy=0x7f3a341345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3a175700 1 -- 172.21.15.88:0/3744392270 >> v1:172.21.15.52:6789/0 conn(0x7f3a340a6260 legacy=0x7f3a34134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3a175700 1 -- 172.21.15.88:0/3744392270 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3412fd70 con 0x7f3a340a18a0 2020-02-11T16:16:54.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3744392270 >> v2:172.21.15.52:3300/0 conn(0x7f3a340a18a0 0x7f3a34130be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a340a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3744392270 >> v2:172.21.15.52:3300/0 conn(0x7f3a340a18a0 0x7f3a34130be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a340a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a340a18a0 0x7f3a34130be0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a340a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a340a18a0 0x7f3a34130be0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a340a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a2c010e20 con 0x7f3a340a18a0 2020-02-11T16:16:54.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a340a18a0 0x7f3a34130be0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a340a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c005c30 con 0x7f3a340a18a0 2020-02-11T16:16:54.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a340a18a0 0x7f3a34130be0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a340a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3744392270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a341328f0 con 0x7f3a340a18a0 2020-02-11T16:16:54.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a2c005da0 con 0x7f3a340a18a0 2020-02-11T16:16:54.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.573+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3744392270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a34130720 con 0x7f3a340a18a0 2020-02-11T16:16:54.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.574+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a340a18a0 0x7f3a34130be0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a340a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.574+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3a2c007350 con 0x7f3a340a18a0 2020-02-11T16:16:54.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.574+0000 7f3a3a175700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a340a18a0 0x7f3a34130be0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a340a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.574+0000 7f3a3c3d9700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 0x7f3a340a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.574+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3744392270 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3405e2f0 con 0x7f3a341331f0 2020-02-11T16:16:54.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.574+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 0x7f3a340a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.574+0000 7f3a277fe700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a14039ef0 0x7f3a1403c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.574+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3a2c049ea0 con 0x7f3a340a18a0 2020-02-11T16:16:54.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a3a976700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a14039ef0 0x7f3a1403c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a39974700 1 -- 172.21.15.88:0/3744392270 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a34132a80 con 0x7f3a341331f0 2020-02-11T16:16:54.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 0x7f3a340a7ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 0x7f3a340a7ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 0x7f3a340a7ef0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 0x7f3a340a7ef0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a3a976700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a14039ef0 0x7f3a1403c3b0 crc :-1 s=READY pgs=297 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a2800ca30 con 0x7f3a341331f0 2020-02-11T16:16:54.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 0x7f3a340a7ef0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f3a2800cb90 con 0x7f3a341331f0 2020-02-11T16:16:54.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 msgr2=0x7f3a340a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a277fe700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 0x7f3a340a7ef0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).stop 2020-02-11T16:16:54.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 msgr2=0x7f3a340a7ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:54.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.575+0000 7f3a277fe700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341331f0 0x7f3a340a7ef0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).stop 2020-02-11T16:16:54.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.583+0000 7f3a3c3d9700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 0x7f3a340a8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.583+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3744392270 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a34130a30 con 0x7f3a341335d0 2020-02-11T16:16:54.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.583+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 0x7f3a340a8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.583+0000 7f3a39974700 1 -- 172.21.15.88:0/3744392270 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3a34132ff0 con 0x7f3a341335d0 2020-02-11T16:16:54.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.583+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 0x7f3a340a8350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 0x7f3a340a8350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 0x7f3a340a8350 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 0x7f3a340a8350 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a2800f650 con 0x7f3a341335d0 2020-02-11T16:16:54.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a39974700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 0x7f3a340a8350 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f3a2800f7b0 con 0x7f3a341335d0 2020-02-11T16:16:54.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 msgr2=0x7f3a340a8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a277fe700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 0x7f3a340a8350 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f3a28001270 tx=0x7f3a2800c490).stop 2020-02-11T16:16:54.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a277fe700 1 -- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 msgr2=0x7f3a340a8350 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:54.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a277fe700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a341335d0 0x7f3a340a8350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a14039ef0 msgr2=0x7f3a1403c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3c3d9700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a14039ef0 0x7f3a1403c3b0 crc :-1 s=READY pgs=297 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a340a18a0 msgr2=0x7f3a34130be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3c3d9700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a340a18a0 0x7f3a34130be0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f3a280010d0 tx=0x7f3a340a1c80).stop 2020-02-11T16:16:54.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3a976700 1 -- 172.21.15.88:0/3744392270 reap_dead start 2020-02-11T16:16:54.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3a976700 1 -- 172.21.15.88:0/3744392270 reap_dead start 2020-02-11T16:16:54.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3744392270 shutdown_connections 2020-02-11T16:16:54.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3c3d9700 1 --2- 172.21.15.88:0/3744392270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a340a18a0 0x7f3a34130be0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3744392270 >> 172.21.15.88:0/3744392270 conn(0x7f3a3409d110 msgr2=0x7f3a340a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:54.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3744392270 shutdown_connections 2020-02-11T16:16:54.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.584+0000 7f3a3c3d9700 1 -- 172.21.15.88:0/3744392270 wait complete. 2020-02-11T16:16:54.597 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:54.598 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:54.598 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:54.598 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:16:54.598 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 96, 2020-02-11T16:16:54.598 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:54.598 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:54.598 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:16:54.599 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:54.599 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.599 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:16:54.599 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:54.599 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:54.599 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:54.600 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:54.600 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:54.600 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:54.600 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:54.600 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:54.601 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:54.601 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.601 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:54.601 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:54.601 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:54.601 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:54.601 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:54.602 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:54.602 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:54.602 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:54.602 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.602 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:54.602 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:54.602 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:54.603 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:54.603 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:54.603 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:54.603 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:54.603 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:54.603 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:54.603 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:54.604 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:54.604 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:54.604 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:54.604 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:54.604 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:54.604 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:54.604 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:54.605 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:54.605 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.605 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:54.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.605 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:54.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.605 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:54.606 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:54.606 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:54.606 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:54.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.606 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:54.606 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:54.606 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.607 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:54.607 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:54.607 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.607 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.607 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.608 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:54.608 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:54.608 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:54.608 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:54.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.608 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:54.609 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:54.609 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:54.609 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:54.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.609 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:54.609 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:54.609 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.610 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:54.610 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:54.610 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.610 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.610 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.611 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:54.611 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:54.611 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:54.611 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:54.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.611 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:54.612 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:54.612 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:54.612 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:54.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.612 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:54.612 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:54.612 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.613 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:54.613 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:54.613 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.613 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.613 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.614 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:54.614 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:54.614 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:54.614 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:54.614 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.614 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.615 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:54.615 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:54.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.615 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.615 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.615 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:54.616 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.616 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.616 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:54.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.616 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.616 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.616 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:54.616 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.617 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.617 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.617 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:54.618 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:16:54.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.723+0000 7f57215b7700 1 Processor -- start 2020-02-11T16:16:54.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.723+0000 7f57215b7700 1 -- start start 2020-02-11T16:16:54.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f57215b7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f571c0a5de0 0x7f571c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:54.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f57215b7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c0a31b0 con 0x7f571c0a18a0 2020-02-11T16:16:54.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f57215b7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c0a3570 con 0x7f571c134a50 2020-02-11T16:16:54.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f57215b7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c0a3810 con 0x7f571c0a5de0 2020-02-11T16:16:54.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f571c0a5de0 0x7f571c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f571c0a5de0 0x7f571c0a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56162/0 (socket says 172.21.15.88:56162) 2020-02-11T16:16:54.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 -- 172.21.15.88:0/3471330210 learned_addr learned my addr 172.21.15.88:0/3471330210 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:54.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571b7fe700 1 --1- 172.21.15.88:0/3471330210 >> v1:172.21.15.88:6789/0 conn(0x7f571c134a50 0x7f571c134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43790/0 (socket says 172.21.15.88:43790) 2020-02-11T16:16:54.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 -- 172.21.15.88:0/3471330210 >> v1:172.21.15.88:6789/0 conn(0x7f571c134a50 legacy=0x7f571c134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 -- 172.21.15.88:0/3471330210 >> v1:172.21.15.52:6789/0 conn(0x7f571c0a18a0 legacy=0x7f571c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:54.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 -- 172.21.15.88:0/3471330210 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0a3ab0 con 0x7f571c0a5de0 2020-02-11T16:16:54.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 --2- 172.21.15.88:0/3471330210 >> v2:172.21.15.88:3300/0 conn(0x7f571c0a5de0 0x7f571c0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f571c05bbc0 tx=0x7f57040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 --2- 172.21.15.88:0/3471330210 >> v2:172.21.15.88:3300/0 conn(0x7f571c0a5de0 0x7f571c0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f571c05bbc0 tx=0x7f57040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 --2- 172.21.15.88:0/3471330210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c0a6260 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f571c05bbc0 tx=0x7f57040088e0).ready entity=mon.1 client_cookie=bf83445a07eee34c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 --2- 172.21.15.88:0/3471330210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c0a6260 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f571c05bbc0 tx=0x7f57040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 --2- 172.21.15.88:0/3471330210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c0a6260 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f571c05bbc0 tx=0x7f57040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f571a7fc700 1 --2- 172.21.15.88:0/3471330210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c0a6260 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f571c05bbc0 tx=0x7f57040088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f5719ffb700 1 -- 172.21.15.88:0/3471330210 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5704013e20 con 0x7f571c0a5de0 2020-02-11T16:16:54.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f5719ffb700 1 -- 172.21.15.88:0/3471330210 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570400c160 con 0x7f571c0a5de0 2020-02-11T16:16:54.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f5719ffb700 1 -- 172.21.15.88:0/3471330210 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f570400c500 con 0x7f571c0a5de0 2020-02-11T16:16:54.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f57215b7700 1 -- 172.21.15.88:0/3471330210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 msgr2=0x7f571c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.724+0000 7f57215b7700 1 --2- 172.21.15.88:0/3471330210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c0a6260 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f571c05bbc0 tx=0x7f57040088e0).stop 2020-02-11T16:16:54.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.725+0000 7f57215b7700 1 -- 172.21.15.88:0/3471330210 shutdown_connections 2020-02-11T16:16:54.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.725+0000 7f57215b7700 1 --2- 172.21.15.88:0/3471330210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c0a6260 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.725+0000 7f57215b7700 1 -- 172.21.15.88:0/3471330210 >> 172.21.15.88:0/3471330210 conn(0x7f571c09d110 msgr2=0x7f571c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.725+0000 7f57215b7700 1 -- 172.21.15.88:0/3471330210 shutdown_connections 2020-02-11T16:16:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.725+0000 7f57215b7700 1 -- 172.21.15.88:0/3471330210 wait complete. 2020-02-11T16:16:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.726+0000 7f57215b7700 1 Processor -- start 2020-02-11T16:16:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.726+0000 7f57215b7700 1 -- start start 2020-02-11T16:16:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.726+0000 7f57215b7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f571c0a18a0 0x7f571c12cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.726+0000 7f57215b7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f571c0a5de0 0x7f571c12a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.726+0000 7f57215b7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f571c134a50 0x7f571c12a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.726+0000 7f57215b7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c12ac90 con 0x7f571c0a18a0 2020-02-11T16:16:54.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f57215b7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c12d0c0 con 0x7f571c0a5de0 2020-02-11T16:16:54.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f57215b7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c067200 con 0x7f571c134a50 2020-02-11T16:16:54.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f571c0a5de0 0x7f571c12a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f571c0a5de0 0x7f571c12a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56170/0 (socket says 172.21.15.88:56170) 2020-02-11T16:16:54.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 -- 172.21.15.88:0/989439810 learned_addr learned my addr 172.21.15.88:0/989439810 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:54.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571b7fe700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f571c134a50 0x7f571c12a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 -- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f571c134a50 msgr2=0x7f571c12a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f571c134a50 0x7f571c12a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 -- 172.21.15.88:0/989439810 >> v2:172.21.15.52:3300/0 conn(0x7f571c0a18a0 msgr2=0x7f571c12cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 --2- 172.21.15.88:0/989439810 >> v2:172.21.15.52:3300/0 conn(0x7f571c0a18a0 0x7f571c12cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 -- 172.21.15.88:0/989439810 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c134830 con 0x7f571c0a5de0 2020-02-11T16:16:54.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 --2- 172.21.15.88:0/989439810 >> v2:172.21.15.88:3300/0 conn(0x7f571c0a5de0 0x7f571c12a3d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f571c12dcc0 tx=0x7f57040136e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 --2- 172.21.15.88:0/989439810 >> v2:172.21.15.88:3300/0 conn(0x7f571c0a5de0 0x7f571c12a3d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f571c12dcc0 tx=0x7f57040136e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c12a3d0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f571c12dcc0 tx=0x7f57040136e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c12a3d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f571c12dcc0 tx=0x7f57040136e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5704007340 con 0x7f571c0a5de0 2020-02-11T16:16:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c12a3d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f571c12dcc0 tx=0x7f57040136e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f571a7fc700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c12a3d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f571c12dcc0 tx=0x7f57040136e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57040074a0 con 0x7f571c0a5de0 2020-02-11T16:16:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f57215b7700 1 -- 172.21.15.88:0/989439810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c133a80 con 0x7f571c0a5de0 2020-02-11T16:16:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57040058b0 con 0x7f571c0a5de0 2020-02-11T16:16:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.727+0000 7f57215b7700 1 -- 172.21.15.88:0/989439810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c1294c0 con 0x7f571c0a5de0 2020-02-11T16:16:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f571a7fc700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c12a3d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f571c12dcc0 tx=0x7f57040136e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5704005a10 con 0x7f571c0a5de0 2020-02-11T16:16:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f571a7fc700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c12a3d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f571c12dcc0 tx=0x7f57040136e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f57215b7700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 0x7f571c125380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f57215b7700 1 -- 172.21.15.88:0/989439810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c05e2f0 con 0x7f571c12e910 2020-02-11T16:16:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f5713fff700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5700039cb0 0x7f570003c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 0x7f571c125380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f570404cb30 con 0x7f571c0a5de0 2020-02-11T16:16:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f571b7fe700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5700039cb0 0x7f570003c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f571affd700 1 -- 172.21.15.88:0/989439810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f571c0565b0 con 0x7f571c12e910 2020-02-11T16:16:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 0x7f571c125380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f571b7fe700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5700039cb0 0x7f570003c170 crc :-1 s=READY pgs=298 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.728+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 0x7f571c125380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.729+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 0x7f571c125380 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.729+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 0x7f571c125380 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.729+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5714012200 con 0x7f571c12e910 2020-02-11T16:16:54.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.729+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 0x7f571c125380 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.729+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5714012360 con 0x7f571c12e910 2020-02-11T16:16:54.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.729+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 msgr2=0x7f571c125380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.729+0000 7f5713fff700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 0x7f571c125380 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).stop 2020-02-11T16:16:54.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.729+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 msgr2=0x7f571c125380 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:54.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.729+0000 7f5713fff700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c12e910 0x7f571c125380 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).stop 2020-02-11T16:16:54.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.737+0000 7f57215b7700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 0x7f571c05a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.737+0000 7f57215b7700 1 -- 172.21.15.88:0/989439810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c125bf0 con 0x7f571c1257e0 2020-02-11T16:16:54.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 0x7f571c05a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f571affd700 1 -- 172.21.15.88:0/989439810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f571c05ccb0 con 0x7f571c1257e0 2020-02-11T16:16:54.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 0x7f571c05a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 0x7f571c05a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 0x7f571c05a5d0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 0x7f571c05a5d0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571400b5c0 con 0x7f571c1257e0 2020-02-11T16:16:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f571affd700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 0x7f571c05a5d0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4362 (secure 0 0 0) 0x7f571400b720 con 0x7f571c1257e0 2020-02-11T16:16:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 msgr2=0x7f571c05a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f5713fff700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 0x7f571c05a5d0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).stop 2020-02-11T16:16:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f5713fff700 1 -- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 msgr2=0x7f571c05a5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.738+0000 7f5713fff700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c1257e0 0x7f571c05a5d0 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0x7f57140022d0 tx=0x7f5714010b60).stop 2020-02-11T16:16:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f57215b7700 1 -- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5700039cb0 msgr2=0x7f570003c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f57215b7700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5700039cb0 0x7f570003c170 crc :-1 s=READY pgs=298 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f57215b7700 1 -- 172.21.15.88:0/989439810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 msgr2=0x7f571c12a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f57215b7700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c12a3d0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f571c12dcc0 tx=0x7f57040136e0).stop 2020-02-11T16:16:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f571b7fe700 1 -- 172.21.15.88:0/989439810 reap_dead start 2020-02-11T16:16:54.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f571b7fe700 1 -- 172.21.15.88:0/989439810 reap_dead start 2020-02-11T16:16:54.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f57215b7700 1 -- 172.21.15.88:0/989439810 shutdown_connections 2020-02-11T16:16:54.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f57215b7700 1 --2- 172.21.15.88:0/989439810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571c0a5de0 0x7f571c12a3d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f57215b7700 1 -- 172.21.15.88:0/989439810 >> 172.21.15.88:0/989439810 conn(0x7f571c09d110 msgr2=0x7f571c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:54.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f57215b7700 1 -- 172.21.15.88:0/989439810 shutdown_connections 2020-02-11T16:16:54.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.739+0000 7f57215b7700 1 -- 172.21.15.88:0/989439810 wait complete. 2020-02-11T16:16:54.749 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:54.750 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:54.750 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:54.750 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:16:54.750 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 96, 2020-02-11T16:16:54.750 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:54.750 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:54.750 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:16:54.751 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:54.751 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.751 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:16:54.751 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:54.751 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:54.751 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:54.751 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:54.752 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:54.752 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:54.752 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:54.752 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:54.752 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:54.752 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.752 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:54.753 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:54.753 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:54.753 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:54.753 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:54.753 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:54.753 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:54.753 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:54.754 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.754 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:54.754 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:54.754 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:54.754 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:54.754 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:54.754 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:54.755 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:54.755 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:54.755 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:54.755 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:54.755 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:54.755 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:54.755 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:54.756 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:54.756 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:54.756 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:54.756 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:54.756 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:54.756 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.756 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:54.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.757 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:54.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.757 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:54.757 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:54.757 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:54.757 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:54.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.758 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:54.758 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:54.758 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.758 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:54.758 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:54.759 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.759 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.759 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.759 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:54.759 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:54.759 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:54.760 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:54.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.760 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:54.760 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:54.760 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:54.760 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:54.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.761 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:54.761 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:54.761 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.761 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:54.762 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:54.762 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.762 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.762 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.762 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:54.762 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:54.762 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:54.763 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:54.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.763 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:54.763 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:54.764 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:54.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:54.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.764 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:54.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:54.764 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.765 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:54.765 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:54.765 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.765 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.765 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:54.766 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:54.766 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:54.766 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:54.766 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.766 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.767 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:54.767 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:54.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.767 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.767 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.767 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:54.767 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.767 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.768 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:16:54.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.768 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.768 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.768 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:54.768 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.768 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.769 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:16:54.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.769 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.769 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.769 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:16:54.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.769 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.770 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:54.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.770 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.770 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.770 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:16:54.770 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.770 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.770 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:16:54.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.771 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.771 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.771 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:54.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.771 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.772 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:54.773 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:16:54.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.878+0000 7f191bf76700 1 Processor -- start 2020-02-11T16:16:54.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.878+0000 7f191bf76700 1 -- start start 2020-02-11T16:16:54.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191bf76700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19140a18a0 0x7f19140a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:54.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191bf76700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19140a6260 0x7f191412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:54.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191bf76700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19140a3570 con 0x7f19140a5de0 2020-02-11T16:16:54.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191bf76700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19140a3810 con 0x7f19140a6260 2020-02-11T16:16:54.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191bf76700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19140a3ab0 con 0x7f19140a18a0 2020-02-11T16:16:54.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19140a6260 0x7f191412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19140a6260 0x7f191412eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56178/0 (socket says 172.21.15.88:56178) 2020-02-11T16:16:54.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 -- 172.21.15.88:0/2411429119 learned_addr learned my addr 172.21.15.88:0/2411429119 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:54.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f1919d12700 1 --2- 172.21.15.88:0/2411429119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19140a18a0 0x7f19140a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 -- 172.21.15.88:0/2411429119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19140a18a0 msgr2=0x7f19140a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:54.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 --2- 172.21.15.88:0/2411429119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19140a18a0 0x7f19140a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:54.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 -- 172.21.15.88:0/2411429119 >> v1:172.21.15.52:6789/0 conn(0x7f19140a5de0 legacy=0x7f191412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:16:54.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 -- 172.21.15.88:0/2411429119 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19140a3d50 con 0x7f19140a6260 2020-02-11T16:16:54.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 --2- 172.21.15.88:0/2411429119 >> v2:172.21.15.88:3300/0 conn(0x7f19140a6260 0x7f191412eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f191405b910 tx=0x7f190c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 --2- 172.21.15.88:0/2411429119 >> v2:172.21.15.88:3300/0 conn(0x7f19140a6260 0x7f191412eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f191405b910 tx=0x7f190c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 --2- 172.21.15.88:0/2411429119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19140a6260 0x7f191412eab0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f191405b910 tx=0x7f190c008c60).ready entity=mon.1 client_cookie=52444a3eb9bd0e32 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 --2- 172.21.15.88:0/2411429119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19140a6260 0x7f191412eab0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f191405b910 tx=0x7f190c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f1918d10700 1 -- 172.21.15.88:0/2411429119 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f190c00a160 con 0x7f19140a6260 2020-02-11T16:16:54.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.879+0000 7f191a513700 1 --2- 172.21.15.88:0/2411429119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19140a6260 0x7f191412eab0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f191405b910 tx=0x7f190c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f191a513700 1 --2- 172.21.15.88:0/2411429119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19140a6260 0x7f191412eab0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f191405b910 tx=0x7f190c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f1918d10700 1 -- 172.21.15.88:0/2411429119 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c00a2c0 con 0x7f19140a6260 2020-02-11T16:16:54.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f1918d10700 1 -- 172.21.15.88:0/2411429119 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f190c00a660 con 0x7f19140a6260 2020-02-11T16:16:54.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f191bf76700 1 -- 172.21.15.88:0/2411429119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19140a6260 msgr2=0x7f191412eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f191bf76700 1 --2- 172.21.15.88:0/2411429119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19140a6260 0x7f191412eab0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f191405b910 tx=0x7f190c008c60).stop 2020-02-11T16:16:54.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f191bf76700 1 -- 172.21.15.88:0/2411429119 shutdown_connections 2020-02-11T16:16:54.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f191bf76700 1 --2- 172.21.15.88:0/2411429119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19140a6260 0x7f191412eab0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f191bf76700 1 --2- 172.21.15.88:0/2411429119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19140a18a0 0x7f19140a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:54.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f191bf76700 1 -- 172.21.15.88:0/2411429119 >> 172.21.15.88:0/2411429119 conn(0x7f191409d110 msgr2=0x7f191409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:54.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f191bf76700 1 -- 172.21.15.88:0/2411429119 shutdown_connections 2020-02-11T16:16:54.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.880+0000 7f191bf76700 1 -- 172.21.15.88:0/2411429119 wait complete. 2020-02-11T16:16:54.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.881+0000 7f191bf76700 1 Processor -- start 2020-02-11T16:16:54.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.881+0000 7f191bf76700 1 -- start start 2020-02-11T16:16:54.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f191bf76700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19140a18a0 0x7f1914134010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f191bf76700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191412f590 con 0x7f19140a6260 2020-02-11T16:16:54.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f191bf76700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1914130d40 con 0x7f19140a5de0 2020-02-11T16:16:54.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f191bf76700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19141311e0 con 0x7f19140a18a0 2020-02-11T16:16:54.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1919511700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f19140a5de0 0x7f1914128520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43812/0 (socket says 172.21.15.88:43812) 2020-02-11T16:16:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1919511700 1 -- 172.21.15.88:0/2936979274 learned_addr learned my addr 172.21.15.88:0/2936979274 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19140a18a0 0x7f1914134010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298886370 0 0) 0x7f1914130d40 con 0x7f19140a5de0 2020-02-11T16:16:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f4002fe0 con 0x7f19140a5de0 2020-02-11T16:16:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099971767 0 0) 0x7f191412f590 con 0x7f19140a6260 2020-02-11T16:16:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1914130d40 con 0x7f19140a6260 2020-02-11T16:16:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 248365978 0 0) 0x7f18f4002fe0 con 0x7f19140a5de0 2020-02-11T16:16:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f191412f590 con 0x7f19140a5de0 2020-02-11T16:16:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f19100029a0 con 0x7f19140a5de0 2020-02-11T16:16:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19140a18a0 msgr2=0x7f1914134010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19140a18a0 0x7f1914134010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 >> v1:172.21.15.88:6789/0 conn(0x7f19140a5de0 legacy=0x7f1914128520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 >> v1:172.21.15.52:6789/0 conn(0x7f19140a6260 legacy=0x7f191414fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f4004b20 0x7f18f4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f4003ab0 0x7f18f4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19141311e0 con 0x7f18f4004b20 2020-02-11T16:16:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4004800 con 0x7f18f4004350 2020-02-11T16:16:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f400bbb0 con 0x7f18f4003ab0 2020-02-11T16:16:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19140a18a0 0x7f1914134010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:16:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1919511700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f4003ab0 0x7f18f4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.882+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f4004b20 0x7f18f4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 -- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f4003ab0 msgr2=0x7f18f4003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f4003ab0 0x7f18f4003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 -- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f4004b20 msgr2=0x7f18f4004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f4004b20 0x7f18f4004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 -- 172.21.15.88:0/2936979274 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914130a30 con 0x7f18f4004350 2020-02-11T16:16:54.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191bf76700 1 -- 172.21.15.88:0/2936979274 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1914135400 con 0x7f18f4004350 2020-02-11T16:16:54.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f190c010640 tx=0x7f19140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191bf76700 1 -- 172.21.15.88:0/2936979274 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1914128c30 con 0x7f18f4004350 2020-02-11T16:16:54.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f190c010640 tx=0x7f19140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f190c010640 tx=0x7f19140a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f190c010640 tx=0x7f19140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f190c010640 tx=0x7f19140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f190c010640 tx=0x7f19140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f190c00a710 con 0x7f18f4004350 2020-02-11T16:16:54.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c005c30 con 0x7f18f4004350 2020-02-11T16:16:54.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f190c005e20 con 0x7f18f4004350 2020-02-11T16:16:54.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f190c010640 tx=0x7f19140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f190c00f760 con 0x7f18f4004350 2020-02-11T16:16:54.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.883+0000 7f191a513700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f190c010640 tx=0x7f19140a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f191bf76700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 0x7f18f00058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f191bf76700 1 -- 172.21.15.88:0/2936979274 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0005ea0 con 0x7f18f0003420 2020-02-11T16:16:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1902ffd700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18f40425e0 0x7f18f4044aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 0x7f18f00058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f190c04a770 con 0x7f18f4004350 2020-02-11T16:16:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1919511700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18f40425e0 0x7f18f4044aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1919d12700 1 -- 172.21.15.88:0/2936979274 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18f0006060 con 0x7f18f0003420 2020-02-11T16:16:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 0x7f18f00058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1919511700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18f40425e0 0x7f18f4044aa0 crc :-1 s=READY pgs=299 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 0x7f18f00058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 0x7f18f00058e0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 0x7f18f00058e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.884+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1904007530 con 0x7f18f0003420 2020-02-11T16:16:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.885+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 0x7f18f00058e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.885+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f19040056c0 con 0x7f18f0003420 2020-02-11T16:16:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.885+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 msgr2=0x7f18f00058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.885+0000 7f1902ffd700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 0x7f18f00058e0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).stop 2020-02-11T16:16:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.885+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 msgr2=0x7f18f00058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.885+0000 7f191a513700 1 -- 172.21.15.88:0/2936979274 reap_dead start 2020-02-11T16:16:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.885+0000 7f1902ffd700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f0003420 0x7f18f00058e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.893+0000 7f191bf76700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 0x7f18f00068a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.893+0000 7f191bf76700 1 -- 172.21.15.88:0/2936979274 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0006dd0 con 0x7f18f00063f0 2020-02-11T16:16:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.893+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 0x7f18f00068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.893+0000 7f1919d12700 1 -- 172.21.15.88:0/2936979274 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f18f0006f90 con 0x7f18f00063f0 2020-02-11T16:16:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 0x7f18f00068a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 0x7f18f00068a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 0x7f18f00068a0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:54.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 0x7f18f00068a0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1904012e40 con 0x7f18f00063f0 2020-02-11T16:16:54.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1919d12700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 0x7f18f00068a0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:54.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f190400a420 con 0x7f18f00063f0 2020-02-11T16:16:54.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 msgr2=0x7f18f00068a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1902ffd700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 0x7f18f00068a0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).stop 2020-02-11T16:16:54.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1902ffd700 1 -- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 msgr2=0x7f18f00068a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:16:54.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f1902ffd700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 0x7f18f00068a0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0x7f1904002f30 tx=0x7f1904010db0).stop 2020-02-11T16:16:54.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f191bf76700 1 -- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18f40425e0 msgr2=0x7f18f4044aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f191bf76700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18f40425e0 0x7f18f4044aa0 crc :-1 s=READY pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f191bf76700 1 -- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 msgr2=0x7f18f400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:54.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.894+0000 7f191bf76700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f190c010640 tx=0x7f19140a1c80).stop 2020-02-11T16:16:54.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.895+0000 7f191bf76700 1 -- 172.21.15.88:0/2936979274 shutdown_connections 2020-02-11T16:16:54.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.895+0000 7f191bf76700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18f40425e0 0x7f18f4044aa0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.895+0000 7f191bf76700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f4004350 0x7f18f400b750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.895+0000 7f191bf76700 1 --2- 172.21.15.88:0/2936979274 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18f00063f0 0x7f18f00068a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:54.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.895+0000 7f191bf76700 1 -- 172.21.15.88:0/2936979274 >> 172.21.15.88:0/2936979274 conn(0x7f191409d110 msgr2=0x7f19140a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:54.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.895+0000 7f191bf76700 1 -- 172.21.15.88:0/2936979274 shutdown_connections 2020-02-11T16:16:54.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:54.895+0000 7f191bf76700 1 -- 172.21.15.88:0/2936979274 wait complete. 2020-02-11T16:16:54.909 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:16:54.909 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:54.909 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:54.909 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:16:54.909 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 96, 2020-02-11T16:16:54.909 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:16:54.909 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:16:54.910 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:16:54.910 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:16:54.910 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.910 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:16:54.910 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:54.911 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:16:54.911 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:16:54.911 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:54.911 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:54.911 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:54.911 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:54.911 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:54.911 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:54.912 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.912 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:16:54.912 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:16:54.912 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:54.912 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:54.912 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:54.912 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:54.913 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:54.913 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:54.913 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.913 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:16:54.913 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:16:54.913 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:16:54.914 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:16:54.914 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:16:54.914 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:16:54.914 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:54.914 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:16:54.914 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:16:54.914 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:16:54.915 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:16:54.915 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:16:54.915 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:16:54.915 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:16:54.915 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:16:54.915 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:16:54.915 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:16:54.915 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:16:54.916 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.916 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:16:54.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.916 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:16:54.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.916 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:16:54.916 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:16:54.917 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:54.917 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:54.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.917 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:54.917 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:16:54.917 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.918 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:54.918 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:16:54.918 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.918 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.918 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:16:54.919 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:16:54.919 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:54.919 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:54.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.919 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:16:54.919 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:16:54.920 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:54.920 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:54.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.920 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:54.920 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:16:54.920 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.921 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:54.921 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:16:54.921 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.921 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.921 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.921 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:16:54.922 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:16:54.922 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:54.922 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:54.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.922 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:16:54.922 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:16:54.923 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:16:54.923 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:16:54.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.923 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:16:54.923 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:16:54.923 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.924 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:16:54.924 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:16:54.924 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:16:54.924 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.924 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.924 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:16:54.925 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:16:54.925 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:16:54.925 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:16:54.925 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.925 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:16:54.925 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:16:54.926 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:16:54.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.926 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.926 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.926 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:54.926 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.926 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.927 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:16:54.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.927 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.927 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.927 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:54.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.928 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.928 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:16:54.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.928 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.928 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.928 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:16:54.928 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.929 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.929 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:16:54.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.929 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.929 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.929 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:16:54.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.930 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:16:54.930 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:16:54.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:16:54.930 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:16:54.930 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:16:54.930 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:16:54.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.931 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:16:54.931 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:16:54.931 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:16:54.932 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2020-02-11T16:16:54.932 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:16:54.932 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2020-02-11T16:16:54.932 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:16:54.933 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-02-11T16:16:54.933 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:16:54.946 INFO:tasks.ceph.mon.b:Stopped 2020-02-11T16:16:54.946 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:16:54.946 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:55.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.048+0000 7f829f31e700 1 Processor -- start 2020-02-11T16:16:55.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.048+0000 7f829f31e700 1 -- start start 2020-02-11T16:16:55.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829f31e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82980a5de0 0x7f82980a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:55.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829f31e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8298134a50 0x7f8298134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:55.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829f31e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82980a31b0 con 0x7f82980a18a0 2020-02-11T16:16:55.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829f31e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82980a3570 con 0x7f8298134a50 2020-02-11T16:16:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829f31e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82980a3810 con 0x7f82980a5de0 2020-02-11T16:16:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829c8b9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82980a5de0 0x7f82980a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829d8bb700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8298134a50 msgr2=0x7f8298134ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:16:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829c8b9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82980a5de0 0x7f82980a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56228/0 (socket says 172.21.15.88:56228) 2020-02-11T16:16:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829d0ba700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f82980a18a0 0x7f82980a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43850/0 (socket says 172.21.15.88:43850) 2020-02-11T16:16:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829c8b9700 1 -- 172.21.15.88:0/2835172893 learned_addr learned my addr 172.21.15.88:0/2835172893 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.049+0000 7f829d8bb700 1 --2- 172.21.15.88:0/2835172893 >> v2:172.21.15.52:3300/0 conn(0x7f8298134a50 0x7f8298134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:55.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f8287fff700 1 -- 172.21.15.88:0/2835172893 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909559133 0 0) 0x7f82980a31b0 con 0x7f82980a18a0 2020-02-11T16:16:55.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f8287fff700 1 -- 172.21.15.88:0/2835172893 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8280003230 con 0x7f82980a18a0 2020-02-11T16:16:55.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829c8b9700 1 -- 172.21.15.88:0/2835172893 >> v2:172.21.15.52:3300/0 conn(0x7f8298134a50 msgr2=0x7f8298134ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:55.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829c8b9700 1 --2- 172.21.15.88:0/2835172893 >> v2:172.21.15.52:3300/0 conn(0x7f8298134a50 0x7f8298134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:55.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829c8b9700 1 -- 172.21.15.88:0/2835172893 >> v1:172.21.15.88:6789/0 conn(0x7f82980a18a0 legacy=0x7f82980a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:55.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829c8b9700 1 -- 172.21.15.88:0/2835172893 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980a3ab0 con 0x7f82980a5de0 2020-02-11T16:16:55.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829c8b9700 1 --2- 172.21.15.88:0/2835172893 >> v2:172.21.15.88:3300/0 conn(0x7f82980a5de0 0x7f82980a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8294002f30 tx=0x7f8294007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829c8b9700 1 --2- 172.21.15.88:0/2835172893 >> v2:172.21.15.88:3300/0 conn(0x7f82980a5de0 0x7f82980a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8294002f30 tx=0x7f8294007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829c8b9700 1 --2- 172.21.15.88:0/2835172893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a5de0 0x7f82980a6260 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f8294002f30 tx=0x7f8294007a40).ready entity=mon.1 client_cookie=4aceab4961657314 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:55.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829c8b9700 1 --2- 172.21.15.88:0/2835172893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a5de0 0x7f82980a6260 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f8294002f30 tx=0x7f8294007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f8287fff700 1 -- 172.21.15.88:0/2835172893 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8294008e20 con 0x7f82980a5de0 2020-02-11T16:16:55.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829c8b9700 1 --2- 172.21.15.88:0/2835172893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a5de0 0x7f82980a6260 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f8294002f30 tx=0x7f8294007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f8287fff700 1 -- 172.21.15.88:0/2835172893 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8294011860 con 0x7f82980a5de0 2020-02-11T16:16:55.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829c8b9700 1 --2- 172.21.15.88:0/2835172893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a5de0 0x7f82980a6260 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f8294002f30 tx=0x7f8294007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f8287fff700 1 -- 172.21.15.88:0/2835172893 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8294011c00 con 0x7f82980a5de0 2020-02-11T16:16:55.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829f31e700 1 -- 172.21.15.88:0/2835172893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a5de0 msgr2=0x7f82980a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:55.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829f31e700 1 --2- 172.21.15.88:0/2835172893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a5de0 0x7f82980a6260 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f8294002f30 tx=0x7f8294007a40).stop 2020-02-11T16:16:55.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829f31e700 1 -- 172.21.15.88:0/2835172893 shutdown_connections 2020-02-11T16:16:55.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829f31e700 1 --2- 172.21.15.88:0/2835172893 >> v2:172.21.15.52:3300/0 conn(0x7f8298134a50 0x7f8298134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:55.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829f31e700 1 --2- 172.21.15.88:0/2835172893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a5de0 0x7f82980a6260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:55.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829f31e700 1 -- 172.21.15.88:0/2835172893 >> 172.21.15.88:0/2835172893 conn(0x7f829809d110 msgr2=0x7f829809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:55.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829f31e700 1 -- 172.21.15.88:0/2835172893 shutdown_connections 2020-02-11T16:16:55.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.050+0000 7f829f31e700 1 -- 172.21.15.88:0/2835172893 wait complete. 2020-02-11T16:16:55.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.051+0000 7f829f31e700 1 Processor -- start 2020-02-11T16:16:55.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.051+0000 7f829f31e700 1 -- start start 2020-02-11T16:16:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829f31e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82980a18a0 0x7f829809f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829f31e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8298122240 con 0x7f82980a5de0 2020-02-11T16:16:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829f31e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829809fca0 con 0x7f8298134a50 2020-02-11T16:16:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829f31e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829809ff40 con 0x7f82980a18a0 2020-02-11T16:16:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82980a18a0 0x7f829809f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:55.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d8bb700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8298134a50 0x7f8298121b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43860/0 (socket says 172.21.15.88:43860) 2020-02-11T16:16:55.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82980a18a0 0x7f829809f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56230/0 (socket says 172.21.15.88:56230) 2020-02-11T16:16:55.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d8bb700 1 -- 172.21.15.88:0/58139906 learned_addr learned my addr 172.21.15.88:0/58139906 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:55.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829c8b9700 1 -- 172.21.15.88:0/58139906 >> v1:172.21.15.52:6789/0 conn(0x7f82980a5de0 legacy=0x7f8298121420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:16:55.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 -- 172.21.15.88:0/58139906 >> v1:172.21.15.88:6789/0 conn(0x7f8298134a50 legacy=0x7f8298121b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:55.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 -- 172.21.15.88:0/58139906 >> v1:172.21.15.52:6789/0 conn(0x7f82980a5de0 legacy=0x7f8298121420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:55.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f82867fc700 1 -- 172.21.15.88:0/58139906 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397058288 0 0) 0x7f829809fca0 con 0x7f8298134a50 2020-02-11T16:16:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 -- 172.21.15.88:0/58139906 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980a01e0 con 0x7f82980a18a0 2020-02-11T16:16:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 --2- 172.21.15.88:0/58139906 >> v2:172.21.15.88:3300/0 conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 --2- 172.21.15.88:0/58139906 >> v2:172.21.15.88:3300/0 conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f82867fc700 1 -- 172.21.15.88:0/58139906 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8288004bd0 con 0x7f82980a18a0 2020-02-11T16:16:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.052+0000 7f829d0ba700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.053+0000 7f82867fc700 1 -- 172.21.15.88:0/58139906 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288004d30 con 0x7f82980a18a0 2020-02-11T16:16:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.053+0000 7f82867fc700 1 -- 172.21.15.88:0/58139906 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8288005110 con 0x7f82980a18a0 2020-02-11T16:16:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.053+0000 7f829f31e700 1 -- 172.21.15.88:0/58139906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829812df30 con 0x7f82980a18a0 2020-02-11T16:16:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.053+0000 7f829f31e700 1 -- 172.21.15.88:0/58139906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82980a9200 con 0x7f82980a18a0 2020-02-11T16:16:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.053+0000 7f829d0ba700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.053+0000 7f82867fc700 1 -- 172.21.15.88:0/58139906 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8288008180 con 0x7f82980a18a0 2020-02-11T16:16:55.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.053+0000 7f829d0ba700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.054+0000 7f82867fc700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8278039b90 0x7f827803c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:55.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.054+0000 7f82867fc700 1 -- 172.21.15.88:0/58139906 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8288049620 con 0x7f82980a18a0 2020-02-11T16:16:55.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.054+0000 7f829f31e700 1 -- 172.21.15.88:0/58139906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82980565b0 con 0x7f82980a18a0 2020-02-11T16:16:55.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.054+0000 7f829c8b9700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8278039b90 0x7f827803c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:55.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.054+0000 7f829c8b9700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8278039b90 0x7f827803c050 crc :-1 s=READY pgs=300 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:55.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.057+0000 7f829d0ba700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.057+0000 7f82867fc700 1 -- 172.21.15.88:0/58139906 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f828802eba0 con 0x7f82980a18a0 2020-02-11T16:16:55.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.240+0000 7f829f31e700 1 -- 172.21.15.88:0/58139906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f829805ccb0 con 0x7f82980a18a0 2020-02-11T16:16:55.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.240+0000 7f829d0ba700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:55.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.240+0000 7f82867fc700 1 -- 172.21.15.88:0/58139906 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f82880316b0 con 0x7f82980a18a0 2020-02-11T16:16:55.242 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:55.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.241+0000 7f829f31e700 1 -- 172.21.15.88:0/58139906 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8278039b90 msgr2=0x7f827803c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:55.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.241+0000 7f829f31e700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8278039b90 0x7f827803c050 crc :-1 s=READY pgs=300 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:55.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.241+0000 7f829f31e700 1 -- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 msgr2=0x7f829809f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:55.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.241+0000 7f829f31e700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 0x7f829809f390 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f82980a68d0 tx=0x7f8288010980).stop 2020-02-11T16:16:55.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.241+0000 7f829f31e700 1 -- 172.21.15.88:0/58139906 shutdown_connections 2020-02-11T16:16:55.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.241+0000 7f829f31e700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8278039b90 0x7f827803c050 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:55.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.241+0000 7f829f31e700 1 --2- 172.21.15.88:0/58139906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82980a18a0 0x7f829809f390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:55.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.241+0000 7f829f31e700 1 -- 172.21.15.88:0/58139906 >> 172.21.15.88:0/58139906 conn(0x7f829809d110 msgr2=0x7f82980a4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:55.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.241+0000 7f829f31e700 1 -- 172.21.15.88:0/58139906 shutdown_connections 2020-02-11T16:16:55.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:55.241+0000 7f829f31e700 1 -- 172.21.15.88:0/58139906 wait complete. 2020-02-11T16:16:55.253 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":96,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:58.253 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:16:58.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.413+0000 7f8c72991700 1 Processor -- start 2020-02-11T16:16:58.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.413+0000 7f8c72991700 1 -- start start 2020-02-11T16:16:58.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c72991700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c6c0a2fa0 0x7f8c6c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:58.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c72991700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c6c131990 0x7f8c6c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:16:58.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c72991700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0a4350 con 0x7f8c6c0a5410 2020-02-11T16:16:58.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c72991700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0a1e60 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c72991700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0a3450 con 0x7f8c6c131990 2020-02-11T16:16:58.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c6bfff700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8c6c0a2fa0 msgr2=0x7f8c6c0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:16:58.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c6b7fe700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8c6c0a5410 legacy=0x7f8c6c131280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:16:58.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c6bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c6c0a2fa0 0x7f8c6c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:58.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c6c131990 0x7f8c6c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c6c131990 0x7f8c6c0a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56242/0 (socket says 172.21.15.88:56242) 2020-02-11T16:16:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 -- 172.21.15.88:0/2134745860 learned_addr learned my addr 172.21.15.88:0/2134745860 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:16:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 -- 172.21.15.88:0/2134745860 >> v2:172.21.15.52:3300/0 conn(0x7f8c6c0a2fa0 msgr2=0x7f8c6c0a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:58.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 --2- 172.21.15.88:0/2134745860 >> v2:172.21.15.52:3300/0 conn(0x7f8c6c0a2fa0 0x7f8c6c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:58.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 -- 172.21.15.88:0/2134745860 >> v1:172.21.15.52:6789/0 conn(0x7f8c6c0a5410 legacy=0x7f8c6c131280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:16:58.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 -- 172.21.15.88:0/2134745860 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c0a3a40 con 0x7f8c6c131990 2020-02-11T16:16:58.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 --2- 172.21.15.88:0/2134745860 >> v2:172.21.15.88:3300/0 conn(0x7f8c6c131990 0x7f8c6c0a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8c6c05ef00 tx=0x7f8c64008ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 --2- 172.21.15.88:0/2134745860 >> v2:172.21.15.88:3300/0 conn(0x7f8c6c131990 0x7f8c6c0a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8c6c05ef00 tx=0x7f8c64008ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 --2- 172.21.15.88:0/2134745860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c131990 0x7f8c6c0a5870 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f8c6c05ef00 tx=0x7f8c64008ed0).ready entity=mon.1 client_cookie=ad86f8bd3a4f5cd1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 --2- 172.21.15.88:0/2134745860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c131990 0x7f8c6c0a5870 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f8c6c05ef00 tx=0x7f8c64008ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c6affd700 1 -- 172.21.15.88:0/2134745860 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c6400b350 con 0x7f8c6c131990 2020-02-11T16:16:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 --2- 172.21.15.88:0/2134745860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c131990 0x7f8c6c0a5870 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f8c6c05ef00 tx=0x7f8c64008ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c70f2e700 1 --2- 172.21.15.88:0/2134745860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c131990 0x7f8c6c0a5870 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f8c6c05ef00 tx=0x7f8c64008ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c6affd700 1 -- 172.21.15.88:0/2134745860 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6400b4b0 con 0x7f8c6c131990 2020-02-11T16:16:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c6affd700 1 -- 172.21.15.88:0/2134745860 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c6400b850 con 0x7f8c6c131990 2020-02-11T16:16:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c72991700 1 -- 172.21.15.88:0/2134745860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c131990 msgr2=0x7f8c6c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.414+0000 7f8c72991700 1 --2- 172.21.15.88:0/2134745860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c131990 0x7f8c6c0a5870 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f8c6c05ef00 tx=0x7f8c64008ed0).stop 2020-02-11T16:16:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.415+0000 7f8c72991700 1 -- 172.21.15.88:0/2134745860 shutdown_connections 2020-02-11T16:16:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.415+0000 7f8c72991700 1 --2- 172.21.15.88:0/2134745860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c131990 0x7f8c6c0a5870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.415+0000 7f8c72991700 1 --2- 172.21.15.88:0/2134745860 >> v2:172.21.15.52:3300/0 conn(0x7f8c6c0a2fa0 0x7f8c6c0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:16:58.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.415+0000 7f8c72991700 1 -- 172.21.15.88:0/2134745860 >> 172.21.15.88:0/2134745860 conn(0x7f8c6c09d110 msgr2=0x7f8c6c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:58.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.415+0000 7f8c72991700 1 -- 172.21.15.88:0/2134745860 shutdown_connections 2020-02-11T16:16:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.415+0000 7f8c72991700 1 -- 172.21.15.88:0/2134745860 wait complete. 2020-02-11T16:16:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.416+0000 7f8c72991700 1 Processor -- start 2020-02-11T16:16:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.416+0000 7f8c72991700 1 -- start start 2020-02-11T16:16:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c72991700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c72991700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c6c131990 0x7f8c6c066de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c72991700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0aa8d0 con 0x7f8c6c0a5410 2020-02-11T16:16:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c72991700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c132510 con 0x7f8c6c131990 2020-02-11T16:16:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c72991700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c1327b0 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8c6c0a5410 0x7f8c6c0666d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43872/0 (socket says 172.21.15.88:43872) 2020-02-11T16:16:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56244/0 (socket says 172.21.15.88:56244) 2020-02-11T16:16:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6b7fe700 1 -- 172.21.15.88:0/3803921074 learned_addr learned my addr 172.21.15.88:0/3803921074 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:16:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c70f2e700 1 -- 172.21.15.88:0/3803921074 >> v2:172.21.15.52:3300/0 conn(0x7f8c6c131990 msgr2=0x7f8c6c066de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:16:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c70f2e700 1 --2- 172.21.15.88:0/3803921074 >> v2:172.21.15.52:3300/0 conn(0x7f8c6c131990 0x7f8c6c066de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:16:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 -- 172.21.15.88:0/3803921074 >> v2:172.21.15.52:3300/0 conn(0x7f8c6c131990 msgr2=0x7f8c6c066de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:16:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> v2:172.21.15.52:3300/0 conn(0x7f8c6c131990 0x7f8c6c066de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 -- 172.21.15.88:0/3803921074 >> v1:172.21.15.88:6789/0 conn(0x7f8c6c0a5410 legacy=0x7f8c6c0666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c697fa700 1 -- 172.21.15.88:0/3803921074 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997074762 0 0) 0x7f8c6c0aa8d0 con 0x7f8c6c0a5410 2020-02-11T16:16:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 -- 172.21.15.88:0/3803921074 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c1322e0 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> v2:172.21.15.88:3300/0 conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> v2:172.21.15.88:3300/0 conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c697fa700 1 -- 172.21.15.88:0/3803921074 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c5c008c70 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c697fa700 1 -- 172.21.15.88:0/3803921074 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c008e10 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c72991700 1 -- 172.21.15.88:0/3803921074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c132fe0 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c697fa700 1 -- 172.21.15.88:0/3803921074 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c5c003920 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.417+0000 7f8c72991700 1 -- 172.21.15.88:0/3803921074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c09e600 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.418+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.418+0000 7f8c697fa700 1 -- 172.21.15.88:0/3803921074 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8c5c003b50 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.418+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.418+0000 7f8c72991700 1 -- 172.21.15.88:0/3803921074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c0565b0 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.418+0000 7f8c697fa700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c4c039b00 0x7f8c4c03bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:16:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.419+0000 7f8c697fa700 1 -- 172.21.15.88:0/3803921074 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8c5c0494a0 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.419+0000 7f8c6b7fe700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c4c039b00 0x7f8c4c03bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:16:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.419+0000 7f8c6b7fe700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c4c039b00 0x7f8c4c03bfc0 crc :-1 s=READY pgs=301 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:16:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.422+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.422+0000 7f8c697fa700 1 -- 172.21.15.88:0/3803921074 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f8c5c02e910 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.602+0000 7f8c72991700 1 -- 172.21.15.88:0/3803921074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8c6c132980 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.603+0000 7f8c6bfff700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:16:58.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.603+0000 7f8c697fa700 1 -- 172.21.15.88:0/3803921074 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f8c5c0315f0 con 0x7f8c6c0a2fa0 2020-02-11T16:16:58.605 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:16:58.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 -- 172.21.15.88:0/3803921074 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c4c039b00 msgr2=0x7f8c4c03bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:58.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c4c039b00 0x7f8c4c03bfc0 crc :-1 s=READY pgs=301 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:58.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 -- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 msgr2=0x7f8c6c1451e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:16:58.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f8c5c000b20 tx=0x7f8c5c010980).stop 2020-02-11T16:16:58.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 -- 172.21.15.88:0/3803921074 shutdown_connections 2020-02-11T16:16:58.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c4c039b00 0x7f8c4c03bfc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:58.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 --2- 172.21.15.88:0/3803921074 >> v2:172.21.15.52:3300/0 conn(0x7f8c6c131990 0x7f8c6c066de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:58.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 --2- 172.21.15.88:0/3803921074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c0a2fa0 0x7f8c6c1451e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:16:58.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 -- 172.21.15.88:0/3803921074 >> 172.21.15.88:0/3803921074 conn(0x7f8c6c09d110 msgr2=0x7f8c6c0aa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:16:58.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 -- 172.21.15.88:0/3803921074 shutdown_connections 2020-02-11T16:16:58.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:16:58.604+0000 7f8c72991700 1 -- 172.21.15.88:0/3803921074 wait complete. 2020-02-11T16:16:58.616 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":96,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:01.617 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:17:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.732+0000 7f79e674c700 1 Processor -- start 2020-02-11T16:17:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.732+0000 7f79e674c700 1 -- start start 2020-02-11T16:17:01.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79e674c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 0x7f79e00a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:01.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79e674c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79e00a2870 0x7f79e013b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79e674c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00a2cf0 con 0x7f79e013b640 2020-02-11T16:17:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79e674c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00a8630 con 0x7f79e00a2870 2020-02-11T16:17:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79e674c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00a30c0 con 0x7f79e00a6ff0 2020-02-11T16:17:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79e4ce9700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f79e013b640 0x7f79e0137c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43884/0 (socket says 172.21.15.88:43884) 2020-02-11T16:17:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79e4ce9700 1 -- 172.21.15.88:0/1899264833 learned_addr learned my addr 172.21.15.88:0/1899264833 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79df7fe700 1 -- 172.21.15.88:0/1899264833 >> v2:172.21.15.52:3300/0 conn(0x7f79e00a2870 msgr2=0x7f79e013b1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:01.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79df7fe700 1 --2- 172.21.15.88:0/1899264833 >> v2:172.21.15.52:3300/0 conn(0x7f79e00a2870 0x7f79e013b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:01.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79dffff700 1 --2- 172.21.15.88:0/1899264833 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 0x7f79e00a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:01.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79dffff700 1 -- 172.21.15.88:0/1899264833 >> v2:172.21.15.52:3300/0 conn(0x7f79e00a2870 msgr2=0x7f79e013b1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:17:01.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79dffff700 1 --2- 172.21.15.88:0/1899264833 >> v2:172.21.15.52:3300/0 conn(0x7f79e00a2870 0x7f79e013b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:01.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79dffff700 1 -- 172.21.15.88:0/1899264833 >> v1:172.21.15.88:6789/0 conn(0x7f79e013b640 legacy=0x7f79e0137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:01.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79dffff700 1 -- 172.21.15.88:0/1899264833 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00a2130 con 0x7f79e00a6ff0 2020-02-11T16:17:01.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79dffff700 1 --2- 172.21.15.88:0/1899264833 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 0x7f79e00a73d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79d0002f30 tx=0x7f79d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79dffff700 1 --2- 172.21.15.88:0/1899264833 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 0x7f79e00a73d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79d0002f30 tx=0x7f79d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.733+0000 7f79dffff700 1 --2- 172.21.15.88:0/1899264833 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 0x7f79e00a73d0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f79d0002f30 tx=0x7f79d00088e0).ready entity=mon.2 client_cookie=6a4e8a796b91e8e9 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:01.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79dffff700 1 --2- 172.21.15.88:0/1899264833 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 0x7f79e00a73d0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f79d0002f30 tx=0x7f79d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79deffd700 1 -- 172.21.15.88:0/1899264833 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d00116a0 con 0x7f79e00a6ff0 2020-02-11T16:17:01.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79dffff700 1 --2- 172.21.15.88:0/1899264833 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 0x7f79e00a73d0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f79d0002f30 tx=0x7f79d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79dffff700 1 --2- 172.21.15.88:0/1899264833 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 0x7f79e00a73d0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f79d0002f30 tx=0x7f79d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79deffd700 1 -- 172.21.15.88:0/1899264833 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0011800 con 0x7f79e00a6ff0 2020-02-11T16:17:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79deffd700 1 -- 172.21.15.88:0/1899264833 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d0011be0 con 0x7f79e00a6ff0 2020-02-11T16:17:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79e674c700 1 -- 172.21.15.88:0/1899264833 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 msgr2=0x7f79e00a73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79e674c700 1 --2- 172.21.15.88:0/1899264833 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 0x7f79e00a73d0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f79d0002f30 tx=0x7f79d00088e0).stop 2020-02-11T16:17:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79e674c700 1 -- 172.21.15.88:0/1899264833 shutdown_connections 2020-02-11T16:17:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79e674c700 1 --2- 172.21.15.88:0/1899264833 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a6ff0 0x7f79e00a73d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79e674c700 1 --2- 172.21.15.88:0/1899264833 >> v2:172.21.15.52:3300/0 conn(0x7f79e00a2870 0x7f79e013b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79e674c700 1 -- 172.21.15.88:0/1899264833 >> 172.21.15.88:0/1899264833 conn(0x7f79e00ac2d0 msgr2=0x7f79e00ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79e674c700 1 -- 172.21.15.88:0/1899264833 shutdown_connections 2020-02-11T16:17:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.734+0000 7f79e674c700 1 -- 172.21.15.88:0/1899264833 wait complete. 2020-02-11T16:17:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.735+0000 7f79e674c700 1 Processor -- start 2020-02-11T16:17:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.735+0000 7f79e674c700 1 -- start start 2020-02-11T16:17:01.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e674c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a2870 0x7f79e01451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:01.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e674c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79e013b640 0x7f79e0132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:01.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e674c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00a3410 con 0x7f79e00a6ff0 2020-02-11T16:17:01.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e674c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e0145610 con 0x7f79e013b640 2020-02-11T16:17:01.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e674c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0134f70 con 0x7f79e00a2870 2020-02-11T16:17:01.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79df7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f79e00a6ff0 0x7f79e0137d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43888/0 (socket says 172.21.15.88:43888) 2020-02-11T16:17:01.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79df7fe700 1 -- 172.21.15.88:0/1730538990 learned_addr learned my addr 172.21.15.88:0/1730538990 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:01.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> v2:172.21.15.88:3300/0 conn(0x7f79e013b640 0x7f79e0132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:01.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79dffff700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a2870 0x7f79e01451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e4ce9700 1 -- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a2870 msgr2=0x7f79e01451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a2870 0x7f79e01451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e4ce9700 1 -- 172.21.15.88:0/1730538990 >> v1:172.21.15.88:6789/0 conn(0x7f79e00a6ff0 legacy=0x7f79e0137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e4ce9700 1 -- 172.21.15.88:0/1730538990 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0138de0 con 0x7f79e013b640 2020-02-11T16:17:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79dffff700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a2870 0x7f79e01451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:17:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> v2:172.21.15.88:3300/0 conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> v2:172.21.15.88:3300/0 conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:01.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.736+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.737+0000 7f79dd7fa700 1 -- 172.21.15.88:0/1730538990 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d8012250 con 0x7f79e013b640 2020-02-11T16:17:01.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.737+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.737+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.737+0000 7f79dd7fa700 1 -- 172.21.15.88:0/1730538990 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d80123f0 con 0x7f79e013b640 2020-02-11T16:17:01.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.737+0000 7f79dd7fa700 1 -- 172.21.15.88:0/1730538990 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d8012810 con 0x7f79e013b640 2020-02-11T16:17:01.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.737+0000 7f79e674c700 1 -- 172.21.15.88:0/1730538990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e0133030 con 0x7f79e013b640 2020-02-11T16:17:01.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.737+0000 7f79e674c700 1 -- 172.21.15.88:0/1730538990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e00a3640 con 0x7f79e013b640 2020-02-11T16:17:01.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.737+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.737+0000 7f79dd7fa700 1 -- 172.21.15.88:0/1730538990 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f79d8012a80 con 0x7f79e013b640 2020-02-11T16:17:01.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.737+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.738+0000 7f79dd7fa700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039cf0 0x7f79c003c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:01.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.738+0000 7f79e674c700 1 -- 172.21.15.88:0/1730538990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e0060960 con 0x7f79e013b640 2020-02-11T16:17:01.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.738+0000 7f79dd7fa700 1 -- 172.21.15.88:0/1730538990 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f79d8049c30 con 0x7f79e013b640 2020-02-11T16:17:01.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.738+0000 7f79dffff700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039cf0 0x7f79c003c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:01.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.738+0000 7f79dffff700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039cf0 0x7f79c003c1b0 crc :-1 s=READY pgs=302 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:01.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.741+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.741+0000 7f79dd7fa700 1 -- 172.21.15.88:0/1730538990 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f79e0060960 con 0x7f79e013b640 2020-02-11T16:17:01.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.922+0000 7f79e674c700 1 -- 172.21.15.88:0/1730538990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f79e00a2cf0 con 0x7f79e013b640 2020-02-11T16:17:01.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.922+0000 7f79e4ce9700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:01.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.922+0000 7f79dd7fa700 1 -- 172.21.15.88:0/1730538990 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f79e00a2cf0 con 0x7f79e013b640 2020-02-11T16:17:01.924 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:01.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.923+0000 7f79e674c700 1 -- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039cf0 msgr2=0x7f79c003c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:01.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.923+0000 7f79e674c700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039cf0 0x7f79c003c1b0 crc :-1 s=READY pgs=302 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.923+0000 7f79e674c700 1 -- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 msgr2=0x7f79e0132bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.923+0000 7f79e674c700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 0x7f79e0132bd0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f79e00ad0c0 tx=0x7f79d8010bb0).stop 2020-02-11T16:17:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.923+0000 7f79e674c700 1 -- 172.21.15.88:0/1730538990 shutdown_connections 2020-02-11T16:17:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.923+0000 7f79e674c700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039cf0 0x7f79c003c1b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.923+0000 7f79e674c700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e013b640 0x7f79e0132bd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.923+0000 7f79e674c700 1 --2- 172.21.15.88:0/1730538990 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e00a2870 0x7f79e01451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.924+0000 7f79e674c700 1 -- 172.21.15.88:0/1730538990 >> 172.21.15.88:0/1730538990 conn(0x7f79e00ac2d0 msgr2=0x7f79e013baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.924+0000 7f79e674c700 1 -- 172.21.15.88:0/1730538990 shutdown_connections 2020-02-11T16:17:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:01.924+0000 7f79e674c700 1 -- 172.21.15.88:0/1730538990 wait complete. 2020-02-11T16:17:01.935 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":96,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:04.941 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:17:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.056+0000 7f8025c85700 1 Processor -- start 2020-02-11T16:17:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.056+0000 7f8025c85700 1 -- start start 2020-02-11T16:17:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f8025c85700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f8025c85700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f8025c85700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 0x7f802012e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f8025c85700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80200a3570 con 0x7f802012e3a0 2020-02-11T16:17:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f8025c85700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80200a3810 con 0x7f80200a18a0 2020-02-11T16:17:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f8025c85700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80200a3ab0 con 0x7f80200a5de0 2020-02-11T16:17:05.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:05.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56270/0 (socket says 172.21.15.88:56270) 2020-02-11T16:17:05.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 learned_addr learned my addr 172.21.15.88:0/997067768 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:05.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801ffff700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 msgr2=0x7f802012e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:05.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801ffff700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 0x7f802012e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:05.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:17:05.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801effd700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:17:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801effd700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.057+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:05.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:05.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801ffff700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 msgr2=0x7f802012e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:05.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801ffff700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 0x7f802012e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:17:05.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:17:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:17:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801effd700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:17:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801effd700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:05.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.258+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:17:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801ffff700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 msgr2=0x7f802012e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801ffff700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 0x7f802012e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:17:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:17:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:17:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801effd700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:17:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801effd700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:05.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:05.659+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:17:06.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801ffff700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 msgr2=0x7f802012e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:06.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801ffff700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 0x7f802012e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:17:06.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:17:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:17:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801effd700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:17:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801effd700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:06.460+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:17:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801ffff700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 msgr2=0x7f802012e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801ffff700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 0x7f802012e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:17:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:17:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:17:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801effd700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:17:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801effd700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:08.062+0000 7f801effd700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:17:11.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.265+0000 7f801ffff700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 msgr2=0x7f802012e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:11.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.265+0000 7f801ffff700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 0x7f802012e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:17:11.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.265+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 msgr2=0x7f80200a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2020-02-11T16:17:11.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:11.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 msgr2=0x7f802012e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:17:11.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 0x7f802012e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:11.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 -- 172.21.15.88:0/997067768 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80200a3d50 con 0x7f80200a18a0 2020-02-11T16:17:11.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8010008cb0 tx=0x7f80100102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.88:3300/0 conn(0x7f80200a18a0 0x7f80200a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8010008cb0 tx=0x7f80100102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80200a18a0 0x7f80200a6dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f8010008cb0 tx=0x7f80100102b0).ready entity=mon.1 client_cookie=c3b63c34d37f9dea server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80200a18a0 0x7f80200a6dd0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f8010008cb0 tx=0x7f80100102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80200a18a0 0x7f80200a6dd0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f8010008cb0 tx=0x7f80100102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801e7fc700 1 -- 172.21.15.88:0/997067768 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f801000a160 con 0x7f80200a18a0 2020-02-11T16:17:11.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801f7fe700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80200a18a0 0x7f80200a6dd0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f8010008cb0 tx=0x7f80100102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801e7fc700 1 -- 172.21.15.88:0/997067768 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801000a2c0 con 0x7f80200a18a0 2020-02-11T16:17:11.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f801e7fc700 1 -- 172.21.15.88:0/997067768 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f801000a660 con 0x7f80200a18a0 2020-02-11T16:17:11.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f8025c85700 1 -- 172.21.15.88:0/997067768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80200a18a0 msgr2=0x7f80200a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.266+0000 7f8025c85700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80200a18a0 0x7f80200a6dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f8010008cb0 tx=0x7f80100102b0).stop 2020-02-11T16:17:11.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.267+0000 7f8025c85700 1 -- 172.21.15.88:0/997067768 shutdown_connections 2020-02-11T16:17:11.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.267+0000 7f8025c85700 1 --2- 172.21.15.88:0/997067768 >> v2:172.21.15.52:3300/0 conn(0x7f802012e3a0 0x7f802012e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:11.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.267+0000 7f8025c85700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80200a18a0 0x7f80200a6dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.267+0000 7f8025c85700 1 --2- 172.21.15.88:0/997067768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a5de0 0x7f80200a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:11.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.267+0000 7f8025c85700 1 -- 172.21.15.88:0/997067768 >> 172.21.15.88:0/997067768 conn(0x7f802009d110 msgr2=0x7f802009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:11.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.267+0000 7f8025c85700 1 -- 172.21.15.88:0/997067768 shutdown_connections 2020-02-11T16:17:11.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.267+0000 7f8025c85700 1 -- 172.21.15.88:0/997067768 wait complete. 2020-02-11T16:17:11.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.268+0000 7f8025c85700 1 Processor -- start 2020-02-11T16:17:11.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.268+0000 7f8025c85700 1 -- start start 2020-02-11T16:17:11.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.269+0000 7f8025c85700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a18a0 0x7f802012fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.269+0000 7f8025c85700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8020124dd0 con 0x7f802012e3a0 2020-02-11T16:17:11.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.269+0000 7f8025c85700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8020127df0 con 0x7f80200a5de0 2020-02-11T16:17:11.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.269+0000 7f8025c85700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802012faa0 con 0x7f80200a18a0 2020-02-11T16:17:11.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.269+0000 7f801effd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f80200a5de0 0x7f8020123fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43936/0 (socket says 172.21.15.88:43936) 2020-02-11T16:17:11.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.269+0000 7f801effd700 1 -- 172.21.15.88:0/1623160078 learned_addr learned my addr 172.21.15.88:0/1623160078 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:11.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.269+0000 7f801ffff700 1 -- 172.21.15.88:0/1623160078 >> v1:172.21.15.52:6789/0 conn(0x7f802012e3a0 legacy=0x7f80201246c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:17:11.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.269+0000 7f801f7fe700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a18a0 0x7f802012fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013867350 0 0) 0x7f8020127df0 con 0x7f80200a5de0 2020-02-11T16:17:11.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8000002fe0 con 0x7f80200a5de0 2020-02-11T16:17:11.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 503897547 0 0) 0x7f8000002fe0 con 0x7f80200a5de0 2020-02-11T16:17:11.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8020127df0 con 0x7f80200a5de0 2020-02-11T16:17:11.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f8014001550 con 0x7f80200a5de0 2020-02-11T16:17:11.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a18a0 msgr2=0x7f802012fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a18a0 0x7f802012fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 >> v1:172.21.15.88:6789/0 conn(0x7f80200a5de0 legacy=0x7f8020123fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 >> v1:172.21.15.52:6789/0 conn(0x7f802012e3a0 legacy=0x7f80201246c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:17:11.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80000049b0 0x7f8000004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a18a0 0x7f8000003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802012faa0 con 0x7f80000049b0 2020-02-11T16:17:11.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000052f0 con 0x7f8000003d80 2020-02-11T16:17:11.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000054b0 con 0x7f80200a18a0 2020-02-11T16:17:11.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801f7fe700 1 -- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80000049b0 msgr2=0x7f8000004db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:11.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801f7fe700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80000049b0 0x7f8000004db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:11.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.270+0000 7f801effd700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a18a0 0x7f8000003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 -- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a18a0 msgr2=0x7f8000003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80200a18a0 0x7f8000003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 -- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80000049b0 msgr2=0x7f8000004db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:17:11.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80000049b0 0x7f8000004db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 -- 172.21.15.88:0/1623160078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020133c00 con 0x7f8000003d80 2020-02-11T16:17:11.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f8025c85700 1 -- 172.21.15.88:0/1623160078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8020133ea0 con 0x7f8000003d80 2020-02-11T16:17:11.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f8025c85700 1 -- 172.21.15.88:0/1623160078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8020133770 con 0x7f8000003d80 2020-02-11T16:17:11.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f801800e8f0 con 0x7f8000003d80 2020-02-11T16:17:11.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801800ea50 con 0x7f8000003d80 2020-02-11T16:17:11.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f801800edf0 con 0x7f8000003d80 2020-02-11T16:17:11.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.271+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.272+0000 7f8025c85700 1 -- 172.21.15.88:0/1623160078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc003340 con 0x7f8000003d80 2020-02-11T16:17:11.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.272+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8018012150 con 0x7f8000003d80 2020-02-11T16:17:11.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.272+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.272+0000 7f801cff9700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8000042100 0x7f80000445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.272+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8018049510 con 0x7f8000003d80 2020-02-11T16:17:11.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.272+0000 7f801f7fe700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8000042100 0x7f80000445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.273+0000 7f801f7fe700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8000042100 0x7f80000445c0 crc :-1 s=READY pgs=303 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.276+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.276+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f801802eb90 con 0x7f8000003d80 2020-02-11T16:17:11.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.462+0000 7f8025c85700 1 -- 172.21.15.88:0/1623160078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7ffc0036e0 con 0x7f8000003d80 2020-02-11T16:17:11.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.462+0000 7f801ffff700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.462+0000 7f801cff9700 1 -- 172.21.15.88:0/1623160078 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1272 (secure 0 0 0) 0x7f801800a510 con 0x7f8000003d80 2020-02-11T16:17:11.466 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":98,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:11.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.464+0000 7f8025c85700 1 -- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8000042100 msgr2=0x7f80000445c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.464+0000 7f8025c85700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8000042100 0x7f80000445c0 crc :-1 s=READY pgs=303 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.464+0000 7f8025c85700 1 -- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 msgr2=0x7f8000004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.464+0000 7f8025c85700 1 --2- 172.21.15.88:0/1623160078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8000003d80 0x7f8000004200 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f8018003ae0 tx=0x7f8018010a90).stop 2020-02-11T16:17:11.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.464+0000 7f801ffff700 1 -- 172.21.15.88:0/1623160078 reap_dead start 2020-02-11T16:17:11.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.464+0000 7f801ffff700 1 -- 172.21.15.88:0/1623160078 reap_dead start 2020-02-11T16:17:11.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.464+0000 7f8025c85700 1 -- 172.21.15.88:0/1623160078 shutdown_connections 2020-02-11T16:17:11.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.464+0000 7f8025c85700 1 -- 172.21.15.88:0/1623160078 >> 172.21.15.88:0/1623160078 conn(0x7f802009d110 msgr2=0x7f80200a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:11.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.464+0000 7f8025c85700 1 -- 172.21.15.88:0/1623160078 shutdown_connections 2020-02-11T16:17:11.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.464+0000 7f8025c85700 1 -- 172.21.15.88:0/1623160078 wait complete. 2020-02-11T16:17:11.477 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":98,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:11.477 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:17:11.477 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:17:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.581+0000 7f6aad057700 1 Processor -- start 2020-02-11T16:17:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.581+0000 7f6aad057700 1 -- start start 2020-02-11T16:17:11.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aad057700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6aa80a5de0 0x7f6aa80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:11.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aad057700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6aa8134a50 0x7f6aa8134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:11.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aad057700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa80a31b0 con 0x7f6aa80a18a0 2020-02-11T16:17:11.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aad057700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa80a3570 con 0x7f6aa80a5de0 2020-02-11T16:17:11.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aad057700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa80a3810 con 0x7f6aa8134a50 2020-02-11T16:17:11.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6aa8134a50 0x7f6aa8134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa6d9d700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f6aa80a18a0 legacy=0x7f6aa80a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:17:11.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa659c700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f6aa80a5de0 msgr2=0x7f6aa80a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:11.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6aa8134a50 0x7f6aa8134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56324/0 (socket says 172.21.15.88:56324) 2020-02-11T16:17:11.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6aa80a5de0 0x7f6aa80a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:11.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 -- 172.21.15.88:0/4163208962 learned_addr learned my addr 172.21.15.88:0/4163208962 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:11.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 -- 172.21.15.88:0/4163208962 >> v2:172.21.15.52:3300/0 conn(0x7f6aa80a5de0 msgr2=0x7f6aa80a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:17:11.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 --2- 172.21.15.88:0/4163208962 >> v2:172.21.15.52:3300/0 conn(0x7f6aa80a5de0 0x7f6aa80a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:11.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 -- 172.21.15.88:0/4163208962 >> v1:172.21.15.52:6789/0 conn(0x7f6aa80a18a0 legacy=0x7f6aa80a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:17:11.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 -- 172.21.15.88:0/4163208962 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa80a3ab0 con 0x7f6aa8134a50 2020-02-11T16:17:11.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 --2- 172.21.15.88:0/4163208962 >> v2:172.21.15.88:3300/0 conn(0x7f6aa8134a50 0x7f6aa8134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6aa805bbc0 tx=0x7f6a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 --2- 172.21.15.88:0/4163208962 >> v2:172.21.15.88:3300/0 conn(0x7f6aa8134a50 0x7f6aa8134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6aa805bbc0 tx=0x7f6a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 --2- 172.21.15.88:0/4163208962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa8134a50 0x7f6aa8134ee0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f6aa805bbc0 tx=0x7f6a98007a40).ready entity=mon.1 client_cookie=7b954d2e1fa8e1f4 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 --2- 172.21.15.88:0/4163208962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa8134a50 0x7f6aa8134ee0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f6aa805bbc0 tx=0x7f6a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa5d9b700 1 -- 172.21.15.88:0/4163208962 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a98008e20 con 0x7f6aa8134a50 2020-02-11T16:17:11.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 --2- 172.21.15.88:0/4163208962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa8134a50 0x7f6aa8134ee0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f6aa805bbc0 tx=0x7f6a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa759e700 1 --2- 172.21.15.88:0/4163208962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa8134a50 0x7f6aa8134ee0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f6aa805bbc0 tx=0x7f6a98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa5d9b700 1 -- 172.21.15.88:0/4163208962 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a980118d0 con 0x7f6aa8134a50 2020-02-11T16:17:11.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aa5d9b700 1 -- 172.21.15.88:0/4163208962 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a98011cb0 con 0x7f6aa8134a50 2020-02-11T16:17:11.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aad057700 1 -- 172.21.15.88:0/4163208962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa8134a50 msgr2=0x7f6aa8134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.582+0000 7f6aad057700 1 --2- 172.21.15.88:0/4163208962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa8134a50 0x7f6aa8134ee0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f6aa805bbc0 tx=0x7f6a98007a40).stop 2020-02-11T16:17:11.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.583+0000 7f6aad057700 1 -- 172.21.15.88:0/4163208962 shutdown_connections 2020-02-11T16:17:11.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.583+0000 7f6aad057700 1 --2- 172.21.15.88:0/4163208962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa8134a50 0x7f6aa8134ee0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.583+0000 7f6aad057700 1 --2- 172.21.15.88:0/4163208962 >> v2:172.21.15.52:3300/0 conn(0x7f6aa80a5de0 0x7f6aa80a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:11.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.583+0000 7f6aad057700 1 -- 172.21.15.88:0/4163208962 >> 172.21.15.88:0/4163208962 conn(0x7f6aa809d110 msgr2=0x7f6aa809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:11.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.583+0000 7f6aad057700 1 -- 172.21.15.88:0/4163208962 shutdown_connections 2020-02-11T16:17:11.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.583+0000 7f6aad057700 1 -- 172.21.15.88:0/4163208962 wait complete. 2020-02-11T16:17:11.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aad057700 1 Processor -- start 2020-02-11T16:17:11.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aad057700 1 -- start start 2020-02-11T16:17:11.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aad057700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6aa80a5de0 0x7f6aa8148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aad057700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6aa8134a50 0x7f6aa8149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aad057700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa8066c90 con 0x7f6aa80a18a0 2020-02-11T16:17:11.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aad057700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa8066b20 con 0x7f6aa8134a50 2020-02-11T16:17:11.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aad057700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa8129c70 con 0x7f6aa80a5de0 2020-02-11T16:17:11.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aa6d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6aa80a18a0 0x7f6aa812a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43952/0 (socket says 172.21.15.88:43952) 2020-02-11T16:17:11.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aa6d9d700 1 -- 172.21.15.88:0/3422841924 learned_addr learned my addr 172.21.15.88:0/3422841924 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:11.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aa659c700 1 --2- 172.21.15.88:0/3422841924 >> v2:172.21.15.88:3300/0 conn(0x7f6aa80a5de0 0x7f6aa8148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aa759e700 1 -- 172.21.15.88:0/3422841924 >> v2:172.21.15.52:3300/0 conn(0x7f6aa8134a50 msgr2=0x7f6aa8149100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:11.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.584+0000 7f6aa759e700 1 --2- 172.21.15.88:0/3422841924 >> v2:172.21.15.52:3300/0 conn(0x7f6aa8134a50 0x7f6aa8149100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:11.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123451849 0 0) 0x7f6aa8066c90 con 0x7f6aa80a18a0 2020-02-11T16:17:11.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a84002fe0 con 0x7f6aa80a18a0 2020-02-11T16:17:11.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 -- 172.21.15.88:0/3422841924 >> v2:172.21.15.52:3300/0 conn(0x7f6aa8134a50 msgr2=0x7f6aa8149100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:17:11.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 --2- 172.21.15.88:0/3422841924 >> v2:172.21.15.52:3300/0 conn(0x7f6aa8134a50 0x7f6aa8149100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 -- 172.21.15.88:0/3422841924 >> v1:172.21.15.88:6789/0 conn(0x7f6aa80a18a0 legacy=0x7f6aa812a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 -- 172.21.15.88:0/3422841924 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa805e440 con 0x7f6aa80a5de0 2020-02-11T16:17:11.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 --2- 172.21.15.88:0/3422841924 >> v2:172.21.15.88:3300/0 conn(0x7f6aa80a5de0 0x7f6aa8148ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a94000b20 tx=0x7f6a940108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 --2- 172.21.15.88:0/3422841924 >> v2:172.21.15.88:3300/0 conn(0x7f6aa80a5de0 0x7f6aa8148ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a94000b20 tx=0x7f6a940108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a5de0 0x7f6aa8148ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f6a94000b20 tx=0x7f6a940108d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a5de0 0x7f6aa8148ca0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6a94000b20 tx=0x7f6a940108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a940115e0 con 0x7f6aa80a5de0 2020-02-11T16:17:11.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a5de0 0x7f6aa8148ca0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6a94000b20 tx=0x7f6a940108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a5de0 0x7f6aa8148ca0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6a94000b20 tx=0x7f6a940108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a94011780 con 0x7f6aa80a5de0 2020-02-11T16:17:11.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aad057700 1 -- 172.21.15.88:0/3422841924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa805b320 con 0x7f6aa80a5de0 2020-02-11T16:17:11.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a94011b60 con 0x7f6aa80a5de0 2020-02-11T16:17:11.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aad057700 1 -- 172.21.15.88:0/3422841924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa812b100 con 0x7f6aa80a5de0 2020-02-11T16:17:11.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.585+0000 7f6aa659c700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a5de0 0x7f6aa8148ca0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6a94000b20 tx=0x7f6a940108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aad057700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 0x7f6aa80a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6a9400b180 con 0x7f6aa80a5de0 2020-02-11T16:17:11.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aa659c700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a5de0 0x7f6aa8148ca0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6a94000b20 tx=0x7f6a940108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aad057700 1 -- 172.21.15.88:0/3422841924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa805e2f0 con 0x7f6aa805a950 2020-02-11T16:17:11.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 0x7f6aa80a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6a9ffff700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6a84039f90 0x7f6a8403c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6a94049650 con 0x7f6aa80a5de0 2020-02-11T16:17:11.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aa6d9d700 1 -- 172.21.15.88:0/3422841924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6aa80670c0 con 0x7f6aa805a950 2020-02-11T16:17:11.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aa759e700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6a84039f90 0x7f6a8403c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 0x7f6aa80a96f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 0x7f6aa80a96f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 0x7f6aa80a96f0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 0x7f6aa80a96f0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa0005e40 con 0x7f6aa805a950 2020-02-11T16:17:11.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.586+0000 7f6aa759e700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6a84039f90 0x7f6a8403c450 crc :-1 s=READY pgs=304 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.587+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 0x7f6aa80a96f0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.587+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6aa00127e0 con 0x7f6aa805a950 2020-02-11T16:17:11.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.587+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 msgr2=0x7f6aa80a96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.587+0000 7f6a9ffff700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 0x7f6aa80a96f0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).stop 2020-02-11T16:17:11.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.587+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 msgr2=0x7f6aa80a96f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:11.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.587+0000 7f6a9ffff700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa805a950 0x7f6aa80a96f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6aad057700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 0x7f6aa80a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6aad057700 1 -- 172.21.15.88:0/3422841924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa805b1a0 con 0x7f6aa80a7fb0 2020-02-11T16:17:11.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 0x7f6aa80a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6aa6d9d700 1 -- 172.21.15.88:0/3422841924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6aa8066830 con 0x7f6aa80a7fb0 2020-02-11T16:17:11.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 0x7f6aa80a83c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 0x7f6aa80a83c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 0x7f6aa80a83c0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 0x7f6aa80a83c0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa0008650 con 0x7f6aa80a7fb0 2020-02-11T16:17:11.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6aa6d9d700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 0x7f6aa80a83c0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4350 (secure 0 0 0) 0x7f6aa00087b0 con 0x7f6aa80a7fb0 2020-02-11T16:17:11.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 msgr2=0x7f6aa80a83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6a9ffff700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 0x7f6aa80a83c0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f6aa0003aa0 tx=0x7f6aa0010d60).stop 2020-02-11T16:17:11.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6a9ffff700 1 -- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 msgr2=0x7f6aa80a83c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:11.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.595+0000 7f6a9ffff700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a7fb0 0x7f6aa80a83c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aad057700 1 -- 172.21.15.88:0/3422841924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6a84039f90 msgr2=0x7f6a8403c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aad057700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6a84039f90 0x7f6a8403c450 crc :-1 s=READY pgs=304 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aad057700 1 -- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a5de0 msgr2=0x7f6aa8148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aad057700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a5de0 0x7f6aa8148ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f6a94000b20 tx=0x7f6a940108d0).stop 2020-02-11T16:17:11.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aa759e700 1 -- 172.21.15.88:0/3422841924 reap_dead start 2020-02-11T16:17:11.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aa759e700 1 -- 172.21.15.88:0/3422841924 reap_dead start 2020-02-11T16:17:11.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aad057700 1 -- 172.21.15.88:0/3422841924 shutdown_connections 2020-02-11T16:17:11.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aad057700 1 --2- 172.21.15.88:0/3422841924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6aa80a5de0 0x7f6aa8148ca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aad057700 1 -- 172.21.15.88:0/3422841924 >> 172.21.15.88:0/3422841924 conn(0x7f6aa809d110 msgr2=0x7f6aa8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:11.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aad057700 1 -- 172.21.15.88:0/3422841924 shutdown_connections 2020-02-11T16:17:11.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.596+0000 7f6aad057700 1 -- 172.21.15.88:0/3422841924 wait complete. 2020-02-11T16:17:11.616 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:17:11.617 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:11.617 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:11.617 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:17:11.617 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 98, 2020-02-11T16:17:11.617 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:17:11.617 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:17:11.617 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:17:11.618 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.618 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2020-02-11T16:17:11.618 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:11.618 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:17:11.618 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:17:11.618 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:11.618 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:11.623 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:11.623 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:11.624 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:11.624 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:11.624 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.624 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:17:11.624 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:17:11.625 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:11.625 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:11.625 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:11.625 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:11.625 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:11.625 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:11.626 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.626 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:17:11.626 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:17:11.626 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:17:11.626 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:17:11.626 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:17:11.627 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:17:11.627 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:11.627 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:11.627 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:17:11.627 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:17:11.627 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:11.628 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:17:11.628 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:11.628 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:11.628 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:11.628 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:11.628 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:11.629 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:11.629 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.629 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:17:11.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.629 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:17:11.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.629 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:17:11.630 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:17:11.630 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:11.630 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:11.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.630 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:11.630 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:17:11.631 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.631 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:11.632 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:17:11.632 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.632 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.632 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.632 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:17:11.633 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:17:11.633 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:11.633 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:11.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.634 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:11.634 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:11.634 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:11.634 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:11.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.635 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:11.635 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:17:11.635 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.635 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:11.635 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:17:11.636 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.636 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.636 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.636 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:17:11.636 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:17:11.637 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:11.637 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:11.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.637 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:11.637 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:11.637 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:11.638 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:11.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.638 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:11.638 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:17:11.638 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.639 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:11.639 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:17:11.639 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.640 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.640 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.640 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:17:11.640 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:17:11.640 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:11.640 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:11.641 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.641 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.641 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:17:11.641 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:17:11.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.641 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:11.642 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:11.642 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:11.642 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.642 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.642 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:17:11.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.643 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:11.643 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:11.643 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:11.643 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.643 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.643 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:17:11.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.644 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:11.644 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:11.644 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:17:11.644 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.644 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.644 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:17:11.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.645 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:11.645 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:11.645 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:17:11.645 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.645 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.645 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:17:11.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.646 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:11.646 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:11.646 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:11.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.646 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.647 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:17:11.647 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:17:11.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.750+0000 7f730a420700 1 Processor -- start 2020-02-11T16:17:11.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.750+0000 7f730a420700 1 -- start start 2020-02-11T16:17:11.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f730a420700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f73040a18a0 0x7f73040a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:11.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f730a420700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:11.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f730a420700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73040a31b0 con 0x7f730412e3a0 2020-02-11T16:17:11.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f730a420700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73040a3570 con 0x7f73040a18a0 2020-02-11T16:17:11.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f730a420700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73040a3810 con 0x7f73040a5de0 2020-02-11T16:17:11.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f7303fff700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f73040a18a0 msgr2=0x7f73040a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:11.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f73089bd700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f730412e3a0 legacy=0x7f730412e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:17:11.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f7303fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f73040a18a0 0x7f73040a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:11.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f73037fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f73037fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:50662/0 (socket says 172.21.15.88:50662) 2020-02-11T16:17:11.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.751+0000 7f73037fe700 1 -- 172.21.15.88:0/2544302488 learned_addr learned my addr 172.21.15.88:0/2544302488 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:11.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f73037fe700 1 -- 172.21.15.88:0/2544302488 >> v2:172.21.15.52:3300/0 conn(0x7f73040a18a0 msgr2=0x7f73040a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:17:11.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f73037fe700 1 --2- 172.21.15.88:0/2544302488 >> v2:172.21.15.52:3300/0 conn(0x7f73040a18a0 0x7f73040a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:11.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f73037fe700 1 -- 172.21.15.88:0/2544302488 >> v1:172.21.15.52:6789/0 conn(0x7f730412e3a0 legacy=0x7f730412e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:17:11.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f73037fe700 1 -- 172.21.15.88:0/2544302488 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040a3ab0 con 0x7f73040a5de0 2020-02-11T16:17:11.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f73037fe700 1 --2- 172.21.15.88:0/2544302488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f730405b910 tx=0x7f72f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f73037fe700 1 --2- 172.21.15.88:0/2544302488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f730405b910 tx=0x7f72f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f73037fe700 1 --2- 172.21.15.88:0/2544302488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f730405b910 tx=0x7f72f80088e0).ready entity=mon.2 client_cookie=b015632b57f0aee2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f73037fe700 1 --2- 172.21.15.88:0/2544302488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f730405b910 tx=0x7f72f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f7302ffd700 1 -- 172.21.15.88:0/2544302488 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f8008e20 con 0x7f73040a5de0 2020-02-11T16:17:11.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f73037fe700 1 --2- 172.21.15.88:0/2544302488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f730405b910 tx=0x7f72f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f73037fe700 1 --2- 172.21.15.88:0/2544302488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f730405b910 tx=0x7f72f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f7302ffd700 1 -- 172.21.15.88:0/2544302488 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8011910 con 0x7f73040a5de0 2020-02-11T16:17:11.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f7302ffd700 1 -- 172.21.15.88:0/2544302488 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f8011cb0 con 0x7f73040a5de0 2020-02-11T16:17:11.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f730a420700 1 -- 172.21.15.88:0/2544302488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 msgr2=0x7f73040a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.752+0000 7f730a420700 1 --2- 172.21.15.88:0/2544302488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f730405b910 tx=0x7f72f80088e0).stop 2020-02-11T16:17:11.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.753+0000 7f730a420700 1 -- 172.21.15.88:0/2544302488 shutdown_connections 2020-02-11T16:17:11.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.753+0000 7f730a420700 1 --2- 172.21.15.88:0/2544302488 >> v2:172.21.15.52:3300/0 conn(0x7f73040a18a0 0x7f73040a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:11.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.753+0000 7f730a420700 1 --2- 172.21.15.88:0/2544302488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73040a5de0 0x7f73040a6260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.753+0000 7f730a420700 1 -- 172.21.15.88:0/2544302488 >> 172.21.15.88:0/2544302488 conn(0x7f730409d110 msgr2=0x7f730409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:11.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.753+0000 7f730a420700 1 -- 172.21.15.88:0/2544302488 shutdown_connections 2020-02-11T16:17:11.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.753+0000 7f730a420700 1 -- 172.21.15.88:0/2544302488 wait complete. 2020-02-11T16:17:11.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.753+0000 7f730a420700 1 Processor -- start 2020-02-11T16:17:11.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.753+0000 7f730a420700 1 -- start start 2020-02-11T16:17:11.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.754+0000 7f730a420700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73040a18a0 0x7f73041320c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.754+0000 7f730a420700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7304135820 con 0x7f730412e3a0 2020-02-11T16:17:11.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.754+0000 7f730a420700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7304130440 con 0x7f73040a5de0 2020-02-11T16:17:11.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.754+0000 7f730a420700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73041306e0 con 0x7f73040a18a0 2020-02-11T16:17:11.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.754+0000 7f7303fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73040a18a0 0x7f73041320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.754+0000 7f73089bd700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f730412e3a0 legacy=0x7f7304130b80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:17:11.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.754+0000 7f73037fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f73040a5de0 0x7f7304135030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43970/0 (socket says 172.21.15.88:43970) 2020-02-11T16:17:11.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.754+0000 7f73037fe700 1 -- 172.21.15.88:0/2888357900 learned_addr learned my addr 172.21.15.88:0/2888357900 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:11.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f7303fff700 1 -- 172.21.15.88:0/2888357900 >> v1:172.21.15.88:6789/0 conn(0x7f73040a5de0 legacy=0x7f7304135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f7303fff700 1 -- 172.21.15.88:0/2888357900 >> v1:172.21.15.52:6789/0 conn(0x7f730412e3a0 legacy=0x7f7304130b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:17:11.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922380012 0 0) 0x7f7304130440 con 0x7f73040a5de0 2020-02-11T16:17:11.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f7303fff700 1 -- 172.21.15.88:0/2888357900 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304141d20 con 0x7f73040a18a0 2020-02-11T16:17:11.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f7303fff700 1 --2- 172.21.15.88:0/2888357900 >> v2:172.21.15.88:3300/0 conn(0x7f73040a18a0 0x7f73041320c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f730412ad90 tx=0x7f72f40109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f7303fff700 1 --2- 172.21.15.88:0/2888357900 >> v2:172.21.15.88:3300/0 conn(0x7f73040a18a0 0x7f73041320c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f730412ad90 tx=0x7f72f40109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f7303fff700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73040a18a0 0x7f73041320c0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f730412ad90 tx=0x7f72f40109b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f7303fff700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73040a18a0 0x7f73041320c0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f730412ad90 tx=0x7f72f40109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f4011640 con 0x7f73040a18a0 2020-02-11T16:17:11.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f7303fff700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73040a18a0 0x7f73041320c0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f730412ad90 tx=0x7f72f40109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f730a420700 1 -- 172.21.15.88:0/2888357900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730412a670 con 0x7f73040a18a0 2020-02-11T16:17:11.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f7303fff700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73040a18a0 0x7f73041320c0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f730412ad90 tx=0x7f72f40109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f40117e0 con 0x7f73040a18a0 2020-02-11T16:17:11.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f4011b80 con 0x7f73040a18a0 2020-02-11T16:17:11.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f730a420700 1 -- 172.21.15.88:0/2888357900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7304142260 con 0x7f73040a18a0 2020-02-11T16:17:11.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.755+0000 7f7303fff700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73040a18a0 0x7f73041320c0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f730412ad90 tx=0x7f72f40109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.756+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f72f400b180 con 0x7f73040a18a0 2020-02-11T16:17:11.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.756+0000 7f7303fff700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73040a18a0 0x7f73041320c0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f730412ad90 tx=0x7f72f40109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.756+0000 7f73017fa700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72e4039a80 0x7f72e403bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.756+0000 7f730a420700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 0x7f73040aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.756+0000 7f730a420700 1 -- 172.21.15.88:0/2888357900 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730405e2f0 con 0x7f73041428f0 2020-02-11T16:17:11.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.756+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f72f40495d0 con 0x7f73040a18a0 2020-02-11T16:17:11.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.756+0000 7f73037fe700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72e4039a80 0x7f72e403bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.756+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 0x7f73040aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73037fe700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72e4039a80 0x7f72e403bf40 crc :-1 s=READY pgs=305 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73089bd700 1 -- 172.21.15.88:0/2888357900 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7304142d00 con 0x7f73041428f0 2020-02-11T16:17:11.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 0x7f73040aa840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 0x7f73040aa840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 0x7f73040aa840 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 0x7f73040aa840 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72fc005e30 con 0x7f73041428f0 2020-02-11T16:17:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 0x7f73040aa840 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f72fc005890 con 0x7f73041428f0 2020-02-11T16:17:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 msgr2=0x7f73040aa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73017fa700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 0x7f73040aa840 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).stop 2020-02-11T16:17:11.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 msgr2=0x7f73040aa840 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:11.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.757+0000 7f73017fa700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73041428f0 0x7f73040aa840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.765+0000 7f730a420700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 0x7f7304129580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:11.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.765+0000 7f730a420700 1 -- 172.21.15.88:0/2888357900 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73041308a0 con 0x7f7304129170 2020-02-11T16:17:11.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 0x7f7304129580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:11.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73089bd700 1 -- 172.21.15.88:0/2888357900 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f73040565b0 con 0x7f7304129170 2020-02-11T16:17:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 0x7f7304129580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 0x7f7304129580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 0x7f7304129580 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 0x7f7304129580 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72fc0083b0 con 0x7f7304129170 2020-02-11T16:17:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73089bd700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 0x7f7304129580 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4348 (secure 0 0 0) 0x7f72fc007940 con 0x7f7304129170 2020-02-11T16:17:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 msgr2=0x7f7304129580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73017fa700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 0x7f7304129580 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).stop 2020-02-11T16:17:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73017fa700 1 -- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 msgr2=0x7f7304129580 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.766+0000 7f73017fa700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7304129170 0x7f7304129580 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0x7f72fc005a50 tx=0x7f72fc010b70).stop 2020-02-11T16:17:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f730a420700 1 -- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72e4039a80 msgr2=0x7f72e403bf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f730a420700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72e4039a80 0x7f72e403bf40 crc :-1 s=READY pgs=305 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f730a420700 1 -- 172.21.15.88:0/2888357900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73040a18a0 msgr2=0x7f73041320c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f730a420700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73040a18a0 0x7f73041320c0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f730412ad90 tx=0x7f72f40109b0).stop 2020-02-11T16:17:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f73089bd700 1 -- 172.21.15.88:0/2888357900 reap_dead start 2020-02-11T16:17:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f73089bd700 1 -- 172.21.15.88:0/2888357900 reap_dead start 2020-02-11T16:17:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f730a420700 1 -- 172.21.15.88:0/2888357900 shutdown_connections 2020-02-11T16:17:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f730a420700 1 --2- 172.21.15.88:0/2888357900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73040a18a0 0x7f73041320c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f730a420700 1 -- 172.21.15.88:0/2888357900 >> 172.21.15.88:0/2888357900 conn(0x7f730409d110 msgr2=0x7f730412db60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f730a420700 1 -- 172.21.15.88:0/2888357900 shutdown_connections 2020-02-11T16:17:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:11.767+0000 7f730a420700 1 -- 172.21.15.88:0/2888357900 wait complete. 2020-02-11T16:17:11.781 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:17:11.781 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:11.781 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:11.782 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:17:11.782 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 98, 2020-02-11T16:17:11.782 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:17:11.782 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:17:11.782 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:17:11.782 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.783 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2020-02-11T16:17:11.783 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:11.783 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:17:11.783 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:17:11.783 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:11.783 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:11.783 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:11.783 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:11.784 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:11.784 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:11.784 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.785 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:17:11.785 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:17:11.785 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:11.785 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:11.785 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:11.785 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:11.786 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:11.786 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:11.786 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.786 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:17:11.786 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:17:11.786 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:17:11.787 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:17:11.787 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:17:11.787 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:17:11.787 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:11.787 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:11.788 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:17:11.788 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:17:11.788 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:11.788 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:17:11.788 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:11.788 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:11.789 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:11.789 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:11.789 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:11.789 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:11.789 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.789 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:17:11.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.790 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:17:11.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.790 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:17:11.790 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:17:11.790 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:11.790 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:11.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.791 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:11.791 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:17:11.791 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.791 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:11.792 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:17:11.792 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.792 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.792 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.792 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:17:11.793 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:17:11.793 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:11.793 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:11.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.794 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:11.794 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:11.794 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:11.794 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:11.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.794 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:11.795 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:17:11.795 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.795 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:11.795 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:17:11.795 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.796 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.796 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.796 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:17:11.796 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:17:11.797 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:11.797 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:11.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.797 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:11.797 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:11.798 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:11.798 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:11.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.798 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:11.798 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:17:11.798 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.799 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:11.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:17:11.799 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:11.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.799 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:17:11.800 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:17:11.800 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:11.800 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:11.800 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.800 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:11.801 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:17:11.801 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:17:11.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.802 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:11.802 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:11.802 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:11.802 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.802 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.802 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:17:11.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.803 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:11.803 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:11.803 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:11.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.803 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.803 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:17:11.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.804 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:11.804 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:11.804 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:17:11.804 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.804 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.804 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:17:11.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.805 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:11.805 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:11.805 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:17:11.806 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.806 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:11.806 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:17:11.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:11.806 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:11.806 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:11.806 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:11.807 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.807 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:11.807 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:11.807 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:17:11.808 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:17:13.575 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:17:13.577 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:17:31.809 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:17:31.809 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2020-02-11T16:17:31.809 INFO:tasks.ceph.mon.b:Restarting daemon 2020-02-11T16:17:31.809 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-02-11T16:17:31.812 INFO:tasks.ceph.mon.b:Started 2020-02-11T16:17:31.812 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:17:31.812 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:17:31.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.925+0000 7f50bc224700 1 Processor -- start 2020-02-11T16:17:31.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.925+0000 7f50bc224700 1 -- start start 2020-02-11T16:17:31.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50bc224700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50b40a18a0 0x7f50b40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:31.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50bc224700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50b40a5de0 0x7f50b40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:31.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50bc224700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b40a31b0 con 0x7f50b412e3a0 2020-02-11T16:17:31.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50bc224700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b40a3570 con 0x7f50b40a5de0 2020-02-11T16:17:31.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50bc224700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b40a3810 con 0x7f50b40a18a0 2020-02-11T16:17:31.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50b97bf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50b40a5de0 0x7f50b40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:31.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50b97bf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50b40a5de0 0x7f50b40a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56360/0 (socket says 172.21.15.88:56360) 2020-02-11T16:17:31.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50b97bf700 1 -- 172.21.15.88:0/4256991943 learned_addr learned my addr 172.21.15.88:0/4256991943 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:31.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50b9fc0700 1 --2- 172.21.15.88:0/4256991943 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50b40a18a0 0x7f50b40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:31.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50b97bf700 1 -- 172.21.15.88:0/4256991943 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50b40a18a0 msgr2=0x7f50b40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:31.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50b97bf700 1 --2- 172.21.15.88:0/4256991943 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50b40a18a0 0x7f50b40a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:31.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50b97bf700 1 -- 172.21.15.88:0/4256991943 >> v1:172.21.15.52:6789/0 conn(0x7f50b412e3a0 legacy=0x7f50b412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:31.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.926+0000 7f50b97bf700 1 -- 172.21.15.88:0/4256991943 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b40a3ab0 con 0x7f50b40a5de0 2020-02-11T16:17:31.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50b97bf700 1 --2- 172.21.15.88:0/4256991943 >> v2:172.21.15.88:3300/0 conn(0x7f50b40a5de0 0x7f50b40a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f50b0002f30 tx=0x7f50b00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50b97bf700 1 --2- 172.21.15.88:0/4256991943 >> v2:172.21.15.88:3300/0 conn(0x7f50b40a5de0 0x7f50b40a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f50b0002f30 tx=0x7f50b00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50b97bf700 1 --2- 172.21.15.88:0/4256991943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b40a6260 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b00088e0).ready entity=mon.1 client_cookie=504149389b5b3ef server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:31.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50b97bf700 1 --2- 172.21.15.88:0/4256991943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b40a6260 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50b8fbe700 1 -- 172.21.15.88:0/4256991943 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50b00116b0 con 0x7f50b40a5de0 2020-02-11T16:17:31.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50b97bf700 1 --2- 172.21.15.88:0/4256991943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b40a6260 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50b97bf700 1 --2- 172.21.15.88:0/4256991943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b40a6260 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50b8fbe700 1 -- 172.21.15.88:0/4256991943 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0011810 con 0x7f50b40a5de0 2020-02-11T16:17:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50b8fbe700 1 -- 172.21.15.88:0/4256991943 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50b0011bf0 con 0x7f50b40a5de0 2020-02-11T16:17:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50bc224700 1 -- 172.21.15.88:0/4256991943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 msgr2=0x7f50b40a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50bc224700 1 --2- 172.21.15.88:0/4256991943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b40a6260 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b00088e0).stop 2020-02-11T16:17:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50bc224700 1 -- 172.21.15.88:0/4256991943 shutdown_connections 2020-02-11T16:17:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50bc224700 1 --2- 172.21.15.88:0/4256991943 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50b40a18a0 0x7f50b40a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50bc224700 1 --2- 172.21.15.88:0/4256991943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b40a6260 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50bc224700 1 -- 172.21.15.88:0/4256991943 >> 172.21.15.88:0/4256991943 conn(0x7f50b409d110 msgr2=0x7f50b409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:31.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50bc224700 1 -- 172.21.15.88:0/4256991943 shutdown_connections 2020-02-11T16:17:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.927+0000 7f50bc224700 1 -- 172.21.15.88:0/4256991943 wait complete. 2020-02-11T16:17:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.928+0000 7f50bc224700 1 Processor -- start 2020-02-11T16:17:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.928+0000 7f50bc224700 1 -- start start 2020-02-11T16:17:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50bc224700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50b40a5de0 0x7f50b4141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50bc224700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50b412e3a0 0x7f50b4134010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50bc224700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b4134470 con 0x7f50b40a18a0 2020-02-11T16:17:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50bc224700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b4133c20 con 0x7f50b412e3a0 2020-02-11T16:17:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50bc224700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b4141fd0 con 0x7f50b40a5de0 2020-02-11T16:17:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b9fc0700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f50b40a18a0 0x7f50b4142350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43992/0 (socket says 172.21.15.88:43992) 2020-02-11T16:17:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b9fc0700 1 -- 172.21.15.88:0/2969837317 learned_addr learned my addr 172.21.15.88:0/2969837317 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> v2:172.21.15.88:3300/0 conn(0x7f50b40a5de0 0x7f50b4141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50ba7c1700 1 --2- 172.21.15.88:0/2969837317 >> v2:172.21.15.52:3300/0 conn(0x7f50b412e3a0 0x7f50b4134010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50ba7c1700 1 -- 172.21.15.88:0/2969837317 >> v2:172.21.15.52:3300/0 conn(0x7f50b412e3a0 msgr2=0x7f50b4134010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:17:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50ba7c1700 1 -- 172.21.15.88:0/2969837317 >> v2:172.21.15.52:3300/0 conn(0x7f50b412e3a0 msgr2=0x7f50b4134010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:17:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50ba7c1700 1 --2- 172.21.15.88:0/2969837317 >> v2:172.21.15.52:3300/0 conn(0x7f50b412e3a0 0x7f50b4134010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50ba7c1700 1 --2- 172.21.15.88:0/2969837317 >> v2:172.21.15.52:3300/0 conn(0x7f50b412e3a0 0x7f50b4134010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b97bf700 1 -- 172.21.15.88:0/2969837317 >> v2:172.21.15.52:3300/0 conn(0x7f50b412e3a0 msgr2=0x7f50b4134010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:17:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> v2:172.21.15.52:3300/0 conn(0x7f50b412e3a0 0x7f50b4134010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b97bf700 1 -- 172.21.15.88:0/2969837317 >> v1:172.21.15.88:6789/0 conn(0x7f50b40a18a0 legacy=0x7f50b4142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50a2ffd700 1 -- 172.21.15.88:0/2969837317 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688019976 0 0) 0x7f50b4134470 con 0x7f50b40a18a0 2020-02-11T16:17:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b97bf700 1 -- 172.21.15.88:0/2969837317 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b41388c0 con 0x7f50b40a5de0 2020-02-11T16:17:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> v2:172.21.15.88:3300/0 conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> v2:172.21.15.88:3300/0 conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.929+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.930+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.930+0000 7f50a2ffd700 1 -- 172.21.15.88:0/2969837317 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50b000f910 con 0x7f50b40a5de0 2020-02-11T16:17:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.930+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.930+0000 7f50a2ffd700 1 -- 172.21.15.88:0/2969837317 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0011e60 con 0x7f50b40a5de0 2020-02-11T16:17:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.930+0000 7f50bc224700 1 -- 172.21.15.88:0/2969837317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b4138b60 con 0x7f50b40a5de0 2020-02-11T16:17:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.930+0000 7f50a2ffd700 1 -- 172.21.15.88:0/2969837317 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50b0007530 con 0x7f50b40a5de0 2020-02-11T16:17:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.930+0000 7f50bc224700 1 -- 172.21.15.88:0/2969837317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b4135bc0 con 0x7f50b40a5de0 2020-02-11T16:17:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.930+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.930+0000 7f50a2ffd700 1 -- 172.21.15.88:0/2969837317 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f50b00056c0 con 0x7f50b40a5de0 2020-02-11T16:17:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.930+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.931+0000 7f50a2ffd700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5094039b60 0x7f509403c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.931+0000 7f50a2ffd700 1 -- 172.21.15.88:0/2969837317 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f50b0049f90 con 0x7f50b40a5de0 2020-02-11T16:17:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.931+0000 7f50b9fc0700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5094039b60 0x7f509403c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.931+0000 7f50bc224700 1 -- 172.21.15.88:0/2969837317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b40565b0 con 0x7f50b40a5de0 2020-02-11T16:17:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.931+0000 7f50b9fc0700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5094039b60 0x7f509403c020 crc :-1 s=READY pgs=307 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.934+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:31.934+0000 7f50a2ffd700 1 -- 172.21.15.88:0/2969837317 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f50b0032520 con 0x7f50b40a5de0 2020-02-11T16:17:32.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.119+0000 7f50bc224700 1 -- 172.21.15.88:0/2969837317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f50b4137ff0 con 0x7f50b40a5de0 2020-02-11T16:17:32.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.119+0000 7f50b97bf700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:32.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.119+0000 7f50a2ffd700 1 -- 172.21.15.88:0/2969837317 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f50b00320e0 con 0x7f50b40a5de0 2020-02-11T16:17:32.122 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":98,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:32.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 -- 172.21.15.88:0/2969837317 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5094039b60 msgr2=0x7f509403c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:32.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5094039b60 0x7f509403c020 crc :-1 s=READY pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:32.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 -- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 msgr2=0x7f50b4141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:32.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b4141b70 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f50b0002f30 tx=0x7f50b40a1c80).stop 2020-02-11T16:17:32.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 -- 172.21.15.88:0/2969837317 shutdown_connections 2020-02-11T16:17:32.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5094039b60 0x7f509403c020 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:32.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 --2- 172.21.15.88:0/2969837317 >> v2:172.21.15.52:3300/0 conn(0x7f50b412e3a0 0x7f50b4134010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:32.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 --2- 172.21.15.88:0/2969837317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40a5de0 0x7f50b4141b70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:32.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 -- 172.21.15.88:0/2969837317 >> 172.21.15.88:0/2969837317 conn(0x7f50b409d110 msgr2=0x7f50b40a61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:32.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 -- 172.21.15.88:0/2969837317 shutdown_connections 2020-02-11T16:17:32.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:32.120+0000 7f50bc224700 1 -- 172.21.15.88:0/2969837317 wait complete. 2020-02-11T16:17:32.137 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":98,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:35.138 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:17:35.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.251+0000 7ffa1fc27700 1 Processor -- start 2020-02-11T16:17:35.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.251+0000 7ffa1fc27700 1 -- start start 2020-02-11T16:17:35.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1fc27700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa180a6260 0x7ffa18135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:35.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1fc27700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa180a31b0 con 0x7ffa180a18a0 2020-02-11T16:17:35.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1fc27700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa180a3570 con 0x7ffa180a5de0 2020-02-11T16:17:35.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1fc27700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa180a3810 con 0x7ffa180a6260 2020-02-11T16:17:35.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1d1c2700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffa180a5de0 0x7ffa18134a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44000/0 (socket says 172.21.15.88:44000) 2020-02-11T16:17:35.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1d1c2700 1 -- 172.21.15.88:0/1848886378 learned_addr learned my addr 172.21.15.88:0/1848886378 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:35.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> v2:172.21.15.52:3300/0 conn(0x7ffa180a6260 0x7ffa18135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:35.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478448630 0 0) 0x7ffa180a3570 con 0x7ffa180a5de0 2020-02-11T16:17:35.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9f8003230 con 0x7ffa180a5de0 2020-02-11T16:17:35.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1e1c4700 1 -- 172.21.15.88:0/1848886378 >> v2:172.21.15.52:3300/0 conn(0x7ffa180a6260 msgr2=0x7ffa18135160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:17:35.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1e1c4700 1 -- 172.21.15.88:0/1848886378 >> v2:172.21.15.52:3300/0 conn(0x7ffa180a6260 msgr2=0x7ffa18135160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:35.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> v2:172.21.15.52:3300/0 conn(0x7ffa180a6260 0x7ffa18135160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:35.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> v2:172.21.15.52:3300/0 conn(0x7ffa180a6260 0x7ffa18135160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:35.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3102507783 0 0) 0x7ff9f8003230 con 0x7ffa180a5de0 2020-02-11T16:17:35.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 >> v2:172.21.15.52:3300/0 conn(0x7ffa180a6260 msgr2=0x7ffa18135160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:17:35.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 --2- 172.21.15.88:0/1848886378 >> v2:172.21.15.52:3300/0 conn(0x7ffa180a6260 0x7ffa18135160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:35.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 >> v1:172.21.15.52:6789/0 conn(0x7ffa180a18a0 legacy=0x7ffa180a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:35.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa180a3ab0 con 0x7ffa180a5de0 2020-02-11T16:17:35.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7ffa00001a50 con 0x7ffa180a5de0 2020-02-11T16:17:35.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 >> v1:172.21.15.88:6789/0 conn(0x7ffa180a5de0 legacy=0x7ffa18134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:35.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f8003720 0x7ff9f8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:35.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f80044d0 0x7ff9f8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:35.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.252+0000 7ffa1c9c1700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 0x7ff9f800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:35.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180a3810 con 0x7ff9f8003720 2020-02-11T16:17:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80041c0 con 0x7ff9f8004db0 2020-02-11T16:17:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f800bb80 con 0x7ff9f80044d0 2020-02-11T16:17:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 0x7ff9f800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1d1c2700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f80044d0 0x7ff9f8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f8003720 0x7ff9f8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 -- 172.21.15.88:0/1848886378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f80044d0 msgr2=0x7ff9f8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f80044d0 0x7ff9f8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:35.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 -- 172.21.15.88:0/1848886378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f8003720 msgr2=0x7ff9f8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:35.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f8003720 0x7ff9f8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:35.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 -- 172.21.15.88:0/1848886378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f8003230 con 0x7ff9f8004db0 2020-02-11T16:17:35.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 0x7ff9f800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff9f80054a0 tx=0x7ffa10010000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 -- 172.21.15.88:0/1848886378 reap_dead start 2020-02-11T16:17:35.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 0x7ff9f800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff9f80054a0 tx=0x7ffa10010000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 0x7ff9f800b720 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7ff9f80054a0 tx=0x7ffa10010000).ready entity=mon.1 client_cookie=ffb48f9bcfb22f85 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:35.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 0x7ff9f800b720 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff9f80054a0 tx=0x7ffa10010000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa10008ce0 con 0x7ff9f8004db0 2020-02-11T16:17:35.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 0x7ff9f800b720 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff9f80054a0 tx=0x7ffa10010000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 0x7ff9f800b720 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff9f80054a0 tx=0x7ffa10010000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa10008e40 con 0x7ff9f8004db0 2020-02-11T16:17:35.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1c9c1700 1 -- 172.21.15.88:0/1848886378 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa10010940 con 0x7ff9f8004db0 2020-02-11T16:17:35.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1fc27700 1 -- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 msgr2=0x7ff9f800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:35.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.253+0000 7ffa1fc27700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 0x7ff9f800b720 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7ff9f80054a0 tx=0x7ffa10010000).stop 2020-02-11T16:17:35.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.254+0000 7ffa1fc27700 1 -- 172.21.15.88:0/1848886378 shutdown_connections 2020-02-11T16:17:35.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.254+0000 7ffa1fc27700 1 --2- 172.21.15.88:0/1848886378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8004db0 0x7ff9f800b720 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:35.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.254+0000 7ffa1fc27700 1 -- 172.21.15.88:0/1848886378 >> 172.21.15.88:0/1848886378 conn(0x7ffa1809d110 msgr2=0x7ffa1809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:35.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.254+0000 7ffa1fc27700 1 -- 172.21.15.88:0/1848886378 shutdown_connections 2020-02-11T16:17:35.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.254+0000 7ffa1fc27700 1 -- 172.21.15.88:0/1848886378 wait complete. 2020-02-11T16:17:35.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1fc27700 1 Processor -- start 2020-02-11T16:17:35.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1fc27700 1 -- start start 2020-02-11T16:17:35.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1fc27700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:35.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1fc27700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa1811ce20 0x7ffa1814f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:35.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1fc27700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa18117f50 con 0x7ffa18116f90 2020-02-11T16:17:35.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1fc27700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa180a7660 con 0x7ffa1811ce20 2020-02-11T16:17:35.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1fc27700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18118180 con 0x7ff9f8004db0 2020-02-11T16:17:35.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1d9c3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:35.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1e1c4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa1811ce20 0x7ffa1814f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:35.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1d1c2700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ffa18116f90 0x7ffa1811a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:35796/0 (socket says 172.21.15.88:35796) 2020-02-11T16:17:35.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1d9c3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:50710/0 (socket says 172.21.15.88:50710) 2020-02-11T16:17:35.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.255+0000 7ffa1d1c2700 1 -- 172.21.15.88:0/2223959905 learned_addr learned my addr 172.21.15.88:0/2223959905 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:35.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1e1c4700 1 -- 172.21.15.88:0/2223959905 >> v2:172.21.15.52:3300/0 conn(0x7ffa1811ce20 msgr2=0x7ffa1814f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:17:35.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1e1c4700 1 -- 172.21.15.88:0/2223959905 >> v2:172.21.15.52:3300/0 conn(0x7ffa1811ce20 msgr2=0x7ffa1814f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:17:35.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/2223959905 >> v2:172.21.15.52:3300/0 conn(0x7ffa1811ce20 0x7ffa1814f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:35.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1e1c4700 1 --2- 172.21.15.88:0/2223959905 >> v2:172.21.15.52:3300/0 conn(0x7ffa1811ce20 0x7ffa1814f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:35.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1d9c3700 1 -- 172.21.15.88:0/2223959905 >> v2:172.21.15.52:3300/0 conn(0x7ffa1811ce20 msgr2=0x7ffa1814f6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:17:35.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> v2:172.21.15.52:3300/0 conn(0x7ffa1811ce20 0x7ffa1814f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:35.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1d9c3700 1 -- 172.21.15.88:0/2223959905 >> v1:172.21.15.52:6789/0 conn(0x7ffa18116f90 legacy=0x7ffa1811a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:35.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1d9c3700 1 -- 172.21.15.88:0/2223959905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18066e00 con 0x7ff9f8004db0 2020-02-11T16:17:35.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:35.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa16ffd700 1 -- 172.21.15.88:0/2223959905 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa08001e70 con 0x7ff9f8004db0 2020-02-11T16:17:35.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa16ffd700 1 -- 172.21.15.88:0/2223959905 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa080124c0 con 0x7ff9f8004db0 2020-02-11T16:17:35.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa16ffd700 1 -- 172.21.15.88:0/2223959905 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa080128a0 con 0x7ff9f8004db0 2020-02-11T16:17:35.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1fc27700 1 -- 172.21.15.88:0/2223959905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa18118bd0 con 0x7ff9f8004db0 2020-02-11T16:17:35.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.256+0000 7ffa1fc27700 1 -- 172.21.15.88:0/2223959905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1812de60 con 0x7ff9f8004db0 2020-02-11T16:17:35.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.257+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.257+0000 7ffa16ffd700 1 -- 172.21.15.88:0/2223959905 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ffa08012b10 con 0x7ff9f8004db0 2020-02-11T16:17:35.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.257+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.257+0000 7ffa16ffd700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff9fc039cc0 0x7ff9fc03c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:35.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.257+0000 7ffa16ffd700 1 -- 172.21.15.88:0/2223959905 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ffa08049350 con 0x7ff9f8004db0 2020-02-11T16:17:35.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.257+0000 7ffa1d1c2700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff9fc039cc0 0x7ff9fc03c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:35.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.257+0000 7ffa1fc27700 1 -- 172.21.15.88:0/2223959905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa18119c60 con 0x7ff9f8004db0 2020-02-11T16:17:35.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.258+0000 7ffa1d1c2700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff9fc039cc0 0x7ff9fc03c180 crc :-1 s=READY pgs=308 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:35.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.262+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.262+0000 7ffa16ffd700 1 -- 172.21.15.88:0/2223959905 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ffa18119c60 con 0x7ff9f8004db0 2020-02-11T16:17:35.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.444+0000 7ffa1fc27700 1 -- 172.21.15.88:0/2223959905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ffa18119c60 con 0x7ff9f8004db0 2020-02-11T16:17:35.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.444+0000 7ffa1d9c3700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:35.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.444+0000 7ffa16ffd700 1 -- 172.21.15.88:0/2223959905 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7ffa18119c60 con 0x7ff9f8004db0 2020-02-11T16:17:35.447 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":98,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:35.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 -- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff9fc039cc0 msgr2=0x7ff9fc03c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:35.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff9fc039cc0 0x7ff9fc03c180 crc :-1 s=READY pgs=308 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:35.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 -- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 msgr2=0x7ffa18119640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:35.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7ffa1805bbc0 tx=0x7ffa08003e90).stop 2020-02-11T16:17:35.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 -- 172.21.15.88:0/2223959905 shutdown_connections 2020-02-11T16:17:35.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff9fc039cc0 0x7ff9fc03c180 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:35.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 --2- 172.21.15.88:0/2223959905 >> v2:172.21.15.52:3300/0 conn(0x7ffa1811ce20 0x7ffa1814f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:35.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 --2- 172.21.15.88:0/2223959905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9f8004db0 0x7ffa18119640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:35.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 -- 172.21.15.88:0/2223959905 >> 172.21.15.88:0/2223959905 conn(0x7ffa1809d110 msgr2=0x7ffa18069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:35.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 -- 172.21.15.88:0/2223959905 shutdown_connections 2020-02-11T16:17:35.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:35.446+0000 7ffa1fc27700 1 -- 172.21.15.88:0/2223959905 wait complete. 2020-02-11T16:17:35.458 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":98,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:38.459 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:17:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.574+0000 7f69f17a7700 1 Processor -- start 2020-02-11T16:17:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.574+0000 7f69f17a7700 1 -- start start 2020-02-11T16:17:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69f17a7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a7120 0x7f69ec0a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69f17a7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69f17a7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec0a5320 con 0x7f69ec12f890 2020-02-11T16:17:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69f17a7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec09e7a0 con 0x7f69ec0a7120 2020-02-11T16:17:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69f17a7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec1303c0 con 0x7f69ec0a39e0 2020-02-11T16:17:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69e3fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69eaffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a7120 0x7f69ec0a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69e3fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:50720/0 (socket says 172.21.15.88:50720) 2020-02-11T16:17:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69e3fff700 1 -- 172.21.15.88:0/3040006606 learned_addr learned my addr 172.21.15.88:0/3040006606 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69eaffd700 1 -- 172.21.15.88:0/3040006606 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a7120 msgr2=0x7f69ec0a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:17:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69eaffd700 1 -- 172.21.15.88:0/3040006606 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a7120 msgr2=0x7f69ec0a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:17:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69eaffd700 1 --2- 172.21.15.88:0/3040006606 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a7120 0x7f69ec0a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:17:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69eaffd700 1 --2- 172.21.15.88:0/3040006606 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a7120 0x7f69ec0a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69e3fff700 1 -- 172.21.15.88:0/3040006606 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a7120 msgr2=0x7f69ec0a4ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:17:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69e3fff700 1 --2- 172.21.15.88:0/3040006606 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a7120 0x7f69ec0a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69e3fff700 1 -- 172.21.15.88:0/3040006606 >> v1:172.21.15.52:6789/0 conn(0x7f69ec12f890 legacy=0x7f69ec12fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.575+0000 7f69e3fff700 1 -- 172.21.15.88:0/3040006606 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec0a5560 con 0x7f69ec0a39e0 2020-02-11T16:17:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69e3fff700 1 --2- 172.21.15.88:0/3040006606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f69d4002f30 tx=0x7f69d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69e3fff700 1 --2- 172.21.15.88:0/3040006606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f69d4002f30 tx=0x7f69d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69e3fff700 1 --2- 172.21.15.88:0/3040006606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f69d4002f30 tx=0x7f69d40088e0).ready entity=mon.2 client_cookie=2a9470ca44a0a75d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69e3fff700 1 --2- 172.21.15.88:0/3040006606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f69d4002f30 tx=0x7f69d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69ea7fc700 1 -- 172.21.15.88:0/3040006606 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d4011760 con 0x7f69ec0a39e0 2020-02-11T16:17:38.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69e3fff700 1 --2- 172.21.15.88:0/3040006606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f69d4002f30 tx=0x7f69d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69e3fff700 1 --2- 172.21.15.88:0/3040006606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f69d4002f30 tx=0x7f69d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69ea7fc700 1 -- 172.21.15.88:0/3040006606 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d40118c0 con 0x7f69ec0a39e0 2020-02-11T16:17:38.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69ea7fc700 1 -- 172.21.15.88:0/3040006606 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d4011ca0 con 0x7f69ec0a39e0 2020-02-11T16:17:38.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69f17a7700 1 -- 172.21.15.88:0/3040006606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 msgr2=0x7f69ec0a3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:38.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69f17a7700 1 --2- 172.21.15.88:0/3040006606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f69d4002f30 tx=0x7f69d40088e0).stop 2020-02-11T16:17:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69f17a7700 1 -- 172.21.15.88:0/3040006606 shutdown_connections 2020-02-11T16:17:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69f17a7700 1 --2- 172.21.15.88:0/3040006606 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a7120 0x7f69ec0a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69f17a7700 1 --2- 172.21.15.88:0/3040006606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69ec0a39e0 0x7f69ec0a3e40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69f17a7700 1 -- 172.21.15.88:0/3040006606 >> 172.21.15.88:0/3040006606 conn(0x7f69ec09d110 msgr2=0x7f69ec09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69f17a7700 1 -- 172.21.15.88:0/3040006606 shutdown_connections 2020-02-11T16:17:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.576+0000 7f69f17a7700 1 -- 172.21.15.88:0/3040006606 wait complete. 2020-02-11T16:17:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.577+0000 7f69f17a7700 1 Processor -- start 2020-02-11T16:17:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.577+0000 7f69f17a7700 1 -- start start 2020-02-11T16:17:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69f17a7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a39e0 0x7f69ec065490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69f17a7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69ec0a7120 0x7f69ec0658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69f17a7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec128570 con 0x7f69ec12f890 2020-02-11T16:17:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69f17a7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec0a18c0 con 0x7f69ec0a39e0 2020-02-11T16:17:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69f17a7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec0a1b60 con 0x7f69ec0a7120 2020-02-11T16:17:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69e3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69ec0a7120 0x7f69ec0658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:38.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69e3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69ec0a7120 0x7f69ec0658f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56402/0 (socket says 172.21.15.88:56402) 2020-02-11T16:17:38.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69e3fff700 1 -- 172.21.15.88:0/779758393 learned_addr learned my addr 172.21.15.88:0/779758393 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:38.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69eaffd700 1 --2- 172.21.15.88:0/779758393 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a39e0 0x7f69ec065490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:38.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69e3fff700 1 -- 172.21.15.88:0/779758393 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a39e0 msgr2=0x7f69ec065490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:38.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a39e0 0x7f69ec065490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:38.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69e3fff700 1 -- 172.21.15.88:0/779758393 >> v1:172.21.15.52:6789/0 conn(0x7f69ec12f890 legacy=0x7f69ec127410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:38.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69e3fff700 1 -- 172.21.15.88:0/779758393 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec0a1e00 con 0x7f69ec0a7120 2020-02-11T16:17:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> v2:172.21.15.88:3300/0 conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.578+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> v2:172.21.15.88:3300/0 conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.579+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.579+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.579+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.579+0000 7f69e8ff9700 1 -- 172.21.15.88:0/779758393 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d4007340 con 0x7f69ec0a7120 2020-02-11T16:17:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.579+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.579+0000 7f69e8ff9700 1 -- 172.21.15.88:0/779758393 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d40074a0 con 0x7f69ec0a7120 2020-02-11T16:17:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.579+0000 7f69f17a7700 1 -- 172.21.15.88:0/779758393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec12ac90 con 0x7f69ec0a7120 2020-02-11T16:17:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.579+0000 7f69e8ff9700 1 -- 172.21.15.88:0/779758393 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d40058b0 con 0x7f69ec0a7120 2020-02-11T16:17:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.579+0000 7f69f17a7700 1 -- 172.21.15.88:0/779758393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec0a15b0 con 0x7f69ec0a7120 2020-02-11T16:17:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.579+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.580+0000 7f69e8ff9700 1 -- 172.21.15.88:0/779758393 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f69d4005b20 con 0x7f69ec0a7120 2020-02-11T16:17:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.580+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.580+0000 7f69e8ff9700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69d0039cc0 0x7f69d003c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:38.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.580+0000 7f69e8ff9700 1 -- 172.21.15.88:0/779758393 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f69d404a0f0 con 0x7f69ec0a7120 2020-02-11T16:17:38.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.580+0000 7f69f17a7700 1 -- 172.21.15.88:0/779758393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec0565b0 con 0x7f69ec0a7120 2020-02-11T16:17:38.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.580+0000 7f69eaffd700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69d0039cc0 0x7f69d003c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.580+0000 7f69eaffd700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69d0039cc0 0x7f69d003c180 crc :-1 s=READY pgs=309 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.583+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.583+0000 7f69e8ff9700 1 -- 172.21.15.88:0/779758393 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f69d402f810 con 0x7f69ec0a7120 2020-02-11T16:17:38.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.765+0000 7f69f17a7700 1 -- 172.21.15.88:0/779758393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f69ec0a02c0 con 0x7f69ec0a7120 2020-02-11T16:17:38.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.765+0000 7f69e3fff700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:38.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.765+0000 7f69e8ff9700 1 -- 172.21.15.88:0/779758393 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f69d40322c0 con 0x7f69ec0a7120 2020-02-11T16:17:38.767 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":98,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":29,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.766+0000 7f69f17a7700 1 -- 172.21.15.88:0/779758393 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69d0039cc0 msgr2=0x7f69d003c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.766+0000 7f69f17a7700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69d0039cc0 0x7f69d003c180 crc :-1 s=READY pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.766+0000 7f69f17a7700 1 -- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 msgr2=0x7f69ec0658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.766+0000 7f69f17a7700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 0x7f69ec0658f0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f69ec1288b0 tx=0x7f69ec130500).stop 2020-02-11T16:17:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.766+0000 7f69f17a7700 1 -- 172.21.15.88:0/779758393 shutdown_connections 2020-02-11T16:17:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.766+0000 7f69f17a7700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69d0039cc0 0x7f69d003c180 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.766+0000 7f69f17a7700 1 --2- 172.21.15.88:0/779758393 >> v2:172.21.15.52:3300/0 conn(0x7f69ec0a39e0 0x7f69ec065490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.766+0000 7f69f17a7700 1 --2- 172.21.15.88:0/779758393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69ec0a7120 0x7f69ec0658f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:38.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.766+0000 7f69f17a7700 1 -- 172.21.15.88:0/779758393 >> 172.21.15.88:0/779758393 conn(0x7f69ec09d110 msgr2=0x7f69ec069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:38.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.767+0000 7f69f17a7700 1 -- 172.21.15.88:0/779758393 shutdown_connections 2020-02-11T16:17:38.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:38.767+0000 7f69f17a7700 1 -- 172.21.15.88:0/779758393 wait complete. 2020-02-11T16:17:38.778 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":98,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":29,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:41.785 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:17:41.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.899+0000 7fc84f59d700 1 Processor -- start 2020-02-11T16:17:41.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.899+0000 7fc84f59d700 1 -- start start 2020-02-11T16:17:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84f59d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc848134a30 0x7fc8480a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84f59d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8480a4070 0x7fc84812dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84f59d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8480a6170 con 0x7fc84805b1e0 2020-02-11T16:17:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84f59d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8480a6410 con 0x7fc848134a30 2020-02-11T16:17:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84f59d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8480a66b0 con 0x7fc8480a4070 2020-02-11T16:17:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84dd9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc848134a30 0x7fc8480a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84dd9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc848134a30 0x7fc8480a5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56408/0 (socket says 172.21.15.88:56408) 2020-02-11T16:17:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84dd9a700 1 -- 172.21.15.88:0/136715879 learned_addr learned my addr 172.21.15.88:0/136715879 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84ed9c700 1 --2- 172.21.15.88:0/136715879 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8480a4070 0x7fc84812dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84dd9a700 1 -- 172.21.15.88:0/136715879 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8480a4070 msgr2=0x7fc84812dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/136715879 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8480a4070 0x7fc84812dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.900+0000 7fc84dd9a700 1 -- 172.21.15.88:0/136715879 >> v1:172.21.15.52:6789/0 conn(0x7fc84805b1e0 legacy=0x7fc848134320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84dd9a700 1 -- 172.21.15.88:0/136715879 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8480a3de0 con 0x7fc848134a30 2020-02-11T16:17:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84ed9c700 1 --2- 172.21.15.88:0/136715879 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8480a4070 0x7fc84812dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:17:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/136715879 >> v2:172.21.15.88:3300/0 conn(0x7fc848134a30 0x7fc8480a5c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc84805eb00 tx=0x7fc8440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/136715879 >> v2:172.21.15.88:3300/0 conn(0x7fc848134a30 0x7fc8480a5c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc84805eb00 tx=0x7fc8440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/136715879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc848134a30 0x7fc8480a5c60 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8440088e0).ready entity=mon.1 client_cookie=fbe4a8e3d289526c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:41.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/136715879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc848134a30 0x7fc8480a5c60 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84d599700 1 -- 172.21.15.88:0/136715879 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc844011720 con 0x7fc848134a30 2020-02-11T16:17:41.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/136715879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc848134a30 0x7fc8480a5c60 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/136715879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc848134a30 0x7fc8480a5c60 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84d599700 1 -- 172.21.15.88:0/136715879 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844011880 con 0x7fc848134a30 2020-02-11T16:17:41.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84d599700 1 -- 172.21.15.88:0/136715879 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc844011c20 con 0x7fc848134a30 2020-02-11T16:17:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84f59d700 1 -- 172.21.15.88:0/136715879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc848134a30 msgr2=0x7fc8480a5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84f59d700 1 --2- 172.21.15.88:0/136715879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc848134a30 0x7fc8480a5c60 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8440088e0).stop 2020-02-11T16:17:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84f59d700 1 -- 172.21.15.88:0/136715879 shutdown_connections 2020-02-11T16:17:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84f59d700 1 --2- 172.21.15.88:0/136715879 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8480a4070 0x7fc84812dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84f59d700 1 --2- 172.21.15.88:0/136715879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc848134a30 0x7fc8480a5c60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84f59d700 1 -- 172.21.15.88:0/136715879 >> 172.21.15.88:0/136715879 conn(0x7fc8480a9f90 msgr2=0x7fc8480aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84f59d700 1 -- 172.21.15.88:0/136715879 shutdown_connections 2020-02-11T16:17:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.901+0000 7fc84f59d700 1 -- 172.21.15.88:0/136715879 wait complete. 2020-02-11T16:17:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.902+0000 7fc84f59d700 1 Processor -- start 2020-02-11T16:17:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.902+0000 7fc84f59d700 1 -- start start 2020-02-11T16:17:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84f59d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc84805b1e0 0x7fc848138130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84f59d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8480a4070 0x7fc84809ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84f59d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc848137590 con 0x7fc848134a30 2020-02-11T16:17:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84f59d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8481353f0 con 0x7fc8480a4070 2020-02-11T16:17:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84f59d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84809c2c0 con 0x7fc84805b1e0 2020-02-11T16:17:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8480a4070 0x7fc84809ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8480a4070 0x7fc84809ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56414/0 (socket says 172.21.15.88:56414) 2020-02-11T16:17:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 -- 172.21.15.88:0/574108807 learned_addr learned my addr 172.21.15.88:0/574108807 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:41.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84e59b700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc84805b1e0 0x7fc848138130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:41.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 -- 172.21.15.88:0/574108807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc84805b1e0 msgr2=0x7fc848138130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:41.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc84805b1e0 0x7fc848138130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:41.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 -- 172.21.15.88:0/574108807 >> v1:172.21.15.52:6789/0 conn(0x7fc848134a30 legacy=0x7fc8480a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:41.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 -- 172.21.15.88:0/574108807 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8481377c0 con 0x7fc8480a4070 2020-02-11T16:17:41.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> v2:172.21.15.88:3300/0 conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> v2:172.21.15.88:3300/0 conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:41.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.903+0000 7fc83b7fe700 1 -- 172.21.15.88:0/574108807 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc844007340 con 0x7fc8480a4070 2020-02-11T16:17:41.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.904+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.904+0000 7fc83b7fe700 1 -- 172.21.15.88:0/574108807 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8440074a0 con 0x7fc8480a4070 2020-02-11T16:17:41.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.904+0000 7fc84f59d700 1 -- 172.21.15.88:0/574108807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8480a4dd0 con 0x7fc8480a4070 2020-02-11T16:17:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.904+0000 7fc83b7fe700 1 -- 172.21.15.88:0/574108807 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8440058b0 con 0x7fc8480a4070 2020-02-11T16:17:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.904+0000 7fc84f59d700 1 -- 172.21.15.88:0/574108807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc848137c60 con 0x7fc8480a4070 2020-02-11T16:17:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.904+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.904+0000 7fc83b7fe700 1 -- 172.21.15.88:0/574108807 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc844005b20 con 0x7fc8480a4070 2020-02-11T16:17:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.904+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.905+0000 7fc83b7fe700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc828039e00 0x7fc82803c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.905+0000 7fc83b7fe700 1 -- 172.21.15.88:0/574108807 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc84404a310 con 0x7fc8480a4070 2020-02-11T16:17:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.905+0000 7fc84e59b700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc828039e00 0x7fc82803c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.905+0000 7fc84f59d700 1 -- 172.21.15.88:0/574108807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84809c430 con 0x7fc8480a4070 2020-02-11T16:17:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.905+0000 7fc84e59b700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc828039e00 0x7fc82803c2c0 crc :-1 s=READY pgs=310 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.908+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:41.908+0000 7fc83b7fe700 1 -- 172.21.15.88:0/574108807 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc84809c430 con 0x7fc8480a4070 2020-02-11T16:17:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.090+0000 7fc84f59d700 1 -- 172.21.15.88:0/574108807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc84809c430 con 0x7fc8480a4070 2020-02-11T16:17:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.090+0000 7fc84dd9a700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.091+0000 7fc83b7fe700 1 -- 172.21.15.88:0/574108807 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fc84809c430 con 0x7fc8480a4070 2020-02-11T16:17:42.092 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":98,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":32,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 -- 172.21.15.88:0/574108807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc828039e00 msgr2=0x7fc82803c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc828039e00 0x7fc82803c2c0 crc :-1 s=READY pgs=310 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 -- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 msgr2=0x7fc84809ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 0x7fc84809ff60 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fc84805eb00 tx=0x7fc8480a3f70).stop 2020-02-11T16:17:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 -- 172.21.15.88:0/574108807 shutdown_connections 2020-02-11T16:17:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc828039e00 0x7fc82803c2c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc84805b1e0 0x7fc848138130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:42.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 --2- 172.21.15.88:0/574108807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8480a4070 0x7fc84809ff60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:42.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 -- 172.21.15.88:0/574108807 >> 172.21.15.88:0/574108807 conn(0x7fc8480a9f90 msgr2=0x7fc8480a68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:42.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 -- 172.21.15.88:0/574108807 shutdown_connections 2020-02-11T16:17:42.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:42.092+0000 7fc84f59d700 1 -- 172.21.15.88:0/574108807 wait complete. 2020-02-11T16:17:42.103 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":98,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":32,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:43.647 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:17:43.650 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:17:45.104 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:17:45.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.218+0000 7f46aaa04700 1 Processor -- start 2020-02-11T16:17:45.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.218+0000 7f46aaa04700 1 -- start start 2020-02-11T16:17:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.219+0000 7f46aaa04700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46a40a50f0 0x7f46a40a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.219+0000 7f46aaa04700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a4136930 con 0x7f46a40a7120 2020-02-11T16:17:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.219+0000 7f46aaa04700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40a6470 con 0x7f46a40a2900 2020-02-11T16:17:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.219+0000 7f46aaa04700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a40a49b0 con 0x7f46a40a50f0 2020-02-11T16:17:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.219+0000 7f46a37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f46a40a2900 0x7f46a413c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44050/0 (socket says 172.21.15.88:44050) 2020-02-11T16:17:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.219+0000 7f46a37fe700 1 -- 172.21.15.88:0/1107060562 learned_addr learned my addr 172.21.15.88:0/1107060562 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/1107060562 >> v2:172.21.15.52:3300/0 conn(0x7f46a40a50f0 0x7f46a40a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a2ffd700 1 -- 172.21.15.88:0/1107060562 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533195321 0 0) 0x7f46a40a6470 con 0x7f46a40a2900 2020-02-11T16:17:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a2ffd700 1 -- 172.21.15.88:0/1107060562 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4690003230 con 0x7f46a40a2900 2020-02-11T16:17:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a2ffd700 1 -- 172.21.15.88:0/1107060562 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530960153 0 0) 0x7f46a4136930 con 0x7f46a40a7120 2020-02-11T16:17:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a2ffd700 1 -- 172.21.15.88:0/1107060562 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a40a6470 con 0x7f46a40a7120 2020-02-11T16:17:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a8fa1700 1 -- 172.21.15.88:0/1107060562 >> v1:172.21.15.88:6789/0 conn(0x7f46a40a2900 legacy=0x7f46a413c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a2ffd700 1 -- 172.21.15.88:0/1107060562 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 572553519 0 0) 0x7f4690003230 con 0x7f46a40a2900 2020-02-11T16:17:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a8fa1700 1 -- 172.21.15.88:0/1107060562 >> v1:172.21.15.52:6789/0 conn(0x7f46a40a7120 legacy=0x7f46a413c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a8fa1700 1 -- 172.21.15.88:0/1107060562 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a40a4c50 con 0x7f46a40a50f0 2020-02-11T16:17:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/1107060562 >> v2:172.21.15.52:3300/0 conn(0x7f46a40a50f0 0x7f46a40a5cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4698001110 tx=0x7f469c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/1107060562 >> v2:172.21.15.52:3300/0 conn(0x7f46a40a50f0 0x7f46a40a5cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4698001110 tx=0x7f469c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/1107060562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46a40a50f0 0x7f46a40a5cf0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c008c60).ready entity=mon.0 client_cookie=429ec86a827784d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/1107060562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46a40a50f0 0x7f46a40a5cf0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a2ffd700 1 -- 172.21.15.88:0/1107060562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4698001710 con 0x7f46a40a50f0 2020-02-11T16:17:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/1107060562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46a40a50f0 0x7f46a40a5cf0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/1107060562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46a40a50f0 0x7f46a40a5cf0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a2ffd700 1 -- 172.21.15.88:0/1107060562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c011b70 con 0x7f46a40a50f0 2020-02-11T16:17:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46a2ffd700 1 -- 172.21.15.88:0/1107060562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469c00a160 con 0x7f46a40a50f0 2020-02-11T16:17:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46aaa04700 1 -- 172.21.15.88:0/1107060562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46a40a50f0 msgr2=0x7f46a40a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.220+0000 7f46aaa04700 1 --2- 172.21.15.88:0/1107060562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46a40a50f0 0x7f46a40a5cf0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c008c60).stop 2020-02-11T16:17:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.221+0000 7f46aaa04700 1 -- 172.21.15.88:0/1107060562 shutdown_connections 2020-02-11T16:17:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.221+0000 7f46aaa04700 1 --2- 172.21.15.88:0/1107060562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46a40a50f0 0x7f46a40a5cf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.221+0000 7f46aaa04700 1 -- 172.21.15.88:0/1107060562 >> 172.21.15.88:0/1107060562 conn(0x7f46a409d110 msgr2=0x7f46a409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.221+0000 7f46aaa04700 1 -- 172.21.15.88:0/1107060562 shutdown_connections 2020-02-11T16:17:45.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.221+0000 7f46aaa04700 1 -- 172.21.15.88:0/1107060562 wait complete. 2020-02-11T16:17:45.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.222+0000 7f46aaa04700 1 Processor -- start 2020-02-11T16:17:45.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.222+0000 7f46aaa04700 1 -- start start 2020-02-11T16:17:45.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.222+0000 7f46aaa04700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46a40a50f0 0x7f46a4130a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.222+0000 7f46aaa04700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46a40a7120 0x7f46a4130ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.222+0000 7f46aaa04700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a409e430 con 0x7f46a40a2900 2020-02-11T16:17:45.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.222+0000 7f46aaa04700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a4067320 con 0x7f46a40a50f0 2020-02-11T16:17:45.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.222+0000 7f46aaa04700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a413e770 con 0x7f46a40a7120 2020-02-11T16:17:45.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46a40a7120 0x7f46a4130ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46a40a7120 0x7f46a4130ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56430/0 (socket says 172.21.15.88:56430) 2020-02-11T16:17:45.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 -- 172.21.15.88:0/427712201 learned_addr learned my addr 172.21.15.88:0/427712201 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:45.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a37fe700 1 --2- 172.21.15.88:0/427712201 >> v2:172.21.15.52:3300/0 conn(0x7f46a40a50f0 0x7f46a4130a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 -- 172.21.15.88:0/427712201 >> v2:172.21.15.52:3300/0 conn(0x7f46a40a50f0 msgr2=0x7f46a4130a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> v2:172.21.15.52:3300/0 conn(0x7f46a40a50f0 0x7f46a4130a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 -- 172.21.15.88:0/427712201 >> v1:172.21.15.52:6789/0 conn(0x7f46a40a2900 legacy=0x7f46a413e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 -- 172.21.15.88:0/427712201 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a413dbb0 con 0x7f46a40a7120 2020-02-11T16:17:45.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> v2:172.21.15.88:3300/0 conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> v2:172.21.15.88:3300/0 conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a17fa700 1 -- 172.21.15.88:0/427712201 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469c005a40 con 0x7f46a40a7120 2020-02-11T16:17:45.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a17fa700 1 -- 172.21.15.88:0/427712201 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c005ba0 con 0x7f46a40a7120 2020-02-11T16:17:45.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46aaa04700 1 -- 172.21.15.88:0/427712201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a413b210 con 0x7f46a40a7120 2020-02-11T16:17:45.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46a17fa700 1 -- 172.21.15.88:0/427712201 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469c007150 con 0x7f46a40a7120 2020-02-11T16:17:45.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.223+0000 7f46aaa04700 1 -- 172.21.15.88:0/427712201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a413e2d0 con 0x7f46a40a7120 2020-02-11T16:17:45.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.224+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.224+0000 7f46a17fa700 1 -- 172.21.15.88:0/427712201 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f469c007390 con 0x7f46a40a7120 2020-02-11T16:17:45.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.224+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.224+0000 7f46aaa04700 1 -- 172.21.15.88:0/427712201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a413e490 con 0x7f46a40a7120 2020-02-11T16:17:45.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.224+0000 7f46a17fa700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4684039cb0 0x7f468403c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.224+0000 7f46a17fa700 1 -- 172.21.15.88:0/427712201 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f469c04a510 con 0x7f46a40a7120 2020-02-11T16:17:45.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.224+0000 7f46a3fff700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4684039cb0 0x7f468403c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.225+0000 7f46a3fff700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4684039cb0 0x7f468403c170 crc :-1 s=READY pgs=311 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.228+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.228+0000 7f46a17fa700 1 -- 172.21.15.88:0/427712201 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f469c032a20 con 0x7f46a40a7120 2020-02-11T16:17:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.412+0000 7f46aaa04700 1 -- 172.21.15.88:0/427712201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f46a40565b0 con 0x7f46a40a7120 2020-02-11T16:17:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.412+0000 7f46a8fa1700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.412+0000 7f46a17fa700 1 -- 172.21.15.88:0/427712201 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f469c0325e0 con 0x7f46a40a7120 2020-02-11T16:17:45.414 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 -- 172.21.15.88:0/427712201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4684039cb0 msgr2=0x7f468403c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4684039cb0 0x7f468403c170 crc :-1 s=READY pgs=311 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 -- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 msgr2=0x7f46a4130ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 0x7f46a4130ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f4698001110 tx=0x7f469c011530).stop 2020-02-11T16:17:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 -- 172.21.15.88:0/427712201 shutdown_connections 2020-02-11T16:17:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a40a7120 0x7f46a4130ed0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 --2- 172.21.15.88:0/427712201 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4684039cb0 0x7f468403c170 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 --2- 172.21.15.88:0/427712201 >> v2:172.21.15.52:3300/0 conn(0x7f46a40a50f0 0x7f46a4130a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 -- 172.21.15.88:0/427712201 >> 172.21.15.88:0/427712201 conn(0x7f46a409d110 msgr2=0x7f46a405adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:45.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 -- 172.21.15.88:0/427712201 shutdown_connections 2020-02-11T16:17:45.417 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.414+0000 7f46aaa04700 1 -- 172.21.15.88:0/427712201 wait complete. 2020-02-11T16:17:45.425 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":102,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:45.426 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:17:45.426 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:17:45.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.538+0000 7fe88240b700 1 Processor -- start 2020-02-11T16:17:45.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.538+0000 7fe88240b700 1 -- start start 2020-02-11T16:17:45.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe88240b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe87c0a2fa0 0x7fe87c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:45.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe88240b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe87c0a5410 0x7fe87c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:45.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe88240b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe87c131280 0x7fe87c1316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:45.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe88240b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87c0a1e60 con 0x7fe87c131280 2020-02-11T16:17:45.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe88240b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87c0a3450 con 0x7fe87c0a2fa0 2020-02-11T16:17:45.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe88240b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c0a4350 con 0x7fe87c0a5410 2020-02-11T16:17:45.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe87c0a2fa0 0x7fe87c0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe87c0a2fa0 0x7fe87c0a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56436/0 (socket says 172.21.15.88:56436) 2020-02-11T16:17:45.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 -- 172.21.15.88:0/58834240 learned_addr learned my addr 172.21.15.88:0/58834240 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:45.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87b7fe700 1 --2- 172.21.15.88:0/58834240 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe87c0a5410 0x7fe87c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe8809a8700 1 --2- 172.21.15.88:0/58834240 >> v2:172.21.15.52:3300/0 conn(0x7fe87c131280 0x7fe87c1316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 -- 172.21.15.88:0/58834240 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe87c0a5410 msgr2=0x7fe87c0a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:45.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 --2- 172.21.15.88:0/58834240 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe87c0a5410 0x7fe87c0a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:45.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 -- 172.21.15.88:0/58834240 >> v2:172.21.15.52:3300/0 conn(0x7fe87c131280 msgr2=0x7fe87c1316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:45.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 --2- 172.21.15.88:0/58834240 >> v2:172.21.15.52:3300/0 conn(0x7fe87c131280 0x7fe87c1316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:45.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 -- 172.21.15.88:0/58834240 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c0a3a40 con 0x7fe87c0a2fa0 2020-02-11T16:17:45.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 --2- 172.21.15.88:0/58834240 >> v2:172.21.15.88:3300/0 conn(0x7fe87c0a2fa0 0x7fe87c0a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe86c002f30 tx=0x7fe86c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 --2- 172.21.15.88:0/58834240 >> v2:172.21.15.88:3300/0 conn(0x7fe87c0a2fa0 0x7fe87c0a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe86c002f30 tx=0x7fe86c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 --2- 172.21.15.88:0/58834240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a2fa0 0x7fe87c0a1520 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).ready entity=mon.1 client_cookie=9c79b3bc02299464 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 --2- 172.21.15.88:0/58834240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a2fa0 0x7fe87c0a1520 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87affd700 1 -- 172.21.15.88:0/58834240 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86c011720 con 0x7fe87c0a2fa0 2020-02-11T16:17:45.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 --2- 172.21.15.88:0/58834240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a2fa0 0x7fe87c0a1520 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87bfff700 1 --2- 172.21.15.88:0/58834240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a2fa0 0x7fe87c0a1520 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87affd700 1 -- 172.21.15.88:0/58834240 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c011880 con 0x7fe87c0a2fa0 2020-02-11T16:17:45.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe87affd700 1 -- 172.21.15.88:0/58834240 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86c011c60 con 0x7fe87c0a2fa0 2020-02-11T16:17:45.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe88240b700 1 -- 172.21.15.88:0/58834240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a2fa0 msgr2=0x7fe87c0a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.539+0000 7fe88240b700 1 --2- 172.21.15.88:0/58834240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a2fa0 0x7fe87c0a1520 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).stop 2020-02-11T16:17:45.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.540+0000 7fe88240b700 1 -- 172.21.15.88:0/58834240 shutdown_connections 2020-02-11T16:17:45.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.540+0000 7fe88240b700 1 --2- 172.21.15.88:0/58834240 >> v2:172.21.15.52:3300/0 conn(0x7fe87c131280 0x7fe87c1316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:45.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.540+0000 7fe88240b700 1 --2- 172.21.15.88:0/58834240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a2fa0 0x7fe87c0a1520 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.540+0000 7fe88240b700 1 --2- 172.21.15.88:0/58834240 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe87c0a5410 0x7fe87c0a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:45.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.540+0000 7fe88240b700 1 -- 172.21.15.88:0/58834240 >> 172.21.15.88:0/58834240 conn(0x7fe87c09d110 msgr2=0x7fe87c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:45.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.540+0000 7fe88240b700 1 -- 172.21.15.88:0/58834240 shutdown_connections 2020-02-11T16:17:45.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.540+0000 7fe88240b700 1 -- 172.21.15.88:0/58834240 wait complete. 2020-02-11T16:17:45.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.541+0000 7fe88240b700 1 Processor -- start 2020-02-11T16:17:45.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.541+0000 7fe88240b700 1 -- start start 2020-02-11T16:17:45.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.541+0000 7fe88240b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe87c0a2fa0 0x7fe87c09ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.541+0000 7fe88240b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe87c0a5410 0x7fe87c144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe88240b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87c0664d0 con 0x7fe87c131280 2020-02-11T16:17:45.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe88240b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87c0a6040 con 0x7fe87c0a2fa0 2020-02-11T16:17:45.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe88240b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87c066c50 con 0x7fe87c0a5410 2020-02-11T16:17:45.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe87c0a5410 0x7fe87c144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe87c0a5410 0x7fe87c144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56444/0 (socket says 172.21.15.88:56444) 2020-02-11T16:17:45.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 -- 172.21.15.88:0/2824470766 learned_addr learned my addr 172.21.15.88:0/2824470766 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:45.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> v2:172.21.15.52:3300/0 conn(0x7fe87c0a2fa0 0x7fe87c09ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 -- 172.21.15.88:0/2824470766 >> v2:172.21.15.52:3300/0 conn(0x7fe87c0a2fa0 msgr2=0x7fe87c09ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 --2- 172.21.15.88:0/2824470766 >> v2:172.21.15.52:3300/0 conn(0x7fe87c0a2fa0 0x7fe87c09ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 -- 172.21.15.88:0/2824470766 >> v1:172.21.15.88:6789/0 conn(0x7fe87c131280 legacy=0x7fe87c130510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 -- 172.21.15.88:0/2824470766 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c066ef0 con 0x7fe87c0a5410 2020-02-11T16:17:45.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 --2- 172.21.15.88:0/2824470766 >> v2:172.21.15.88:3300/0 conn(0x7fe87c0a5410 0x7fe87c144e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe870002f30 tx=0x7fe870010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 --2- 172.21.15.88:0/2824470766 >> v2:172.21.15.88:3300/0 conn(0x7fe87c0a5410 0x7fe87c144e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe870002f30 tx=0x7fe870010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a5410 0x7fe87c144e80 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fe870002f30 tx=0x7fe870010c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a5410 0x7fe87c144e80 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fe870002f30 tx=0x7fe870010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a5410 0x7fe87c144e80 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fe870002f30 tx=0x7fe870010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8700128b0 con 0x7fe87c0a5410 2020-02-11T16:17:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe87b7fe700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a5410 0x7fe87c144e80 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fe870002f30 tx=0x7fe870010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe870012a10 con 0x7fe87c0a5410 2020-02-11T16:17:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe870012df0 con 0x7fe87c0a5410 2020-02-11T16:17:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe88240b700 1 -- 172.21.15.88:0/2824470766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87c09def0 con 0x7fe87c0a5410 2020-02-11T16:17:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.542+0000 7fe88240b700 1 -- 172.21.15.88:0/2824470766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87c1452e0 con 0x7fe87c0a5410 2020-02-11T16:17:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe87b7fe700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a5410 0x7fe87c144e80 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fe870002f30 tx=0x7fe870010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe88240b700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 0x7fe87c0aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe88240b700 1 -- 172.21.15.88:0/2824470766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c05e2f0 con 0x7fe87c0a07d0 2020-02-11T16:17:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe870007170 con 0x7fe87c0a5410 2020-02-11T16:17:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe87b7fe700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a5410 0x7fe87c144e80 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fe870002f30 tx=0x7fe870010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 0x7fe87c0aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe8797fa700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe85c039be0 0x7fe85c03c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe870049ce0 con 0x7fe87c0a5410 2020-02-11T16:17:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe87bfff700 1 -- 172.21.15.88:0/2824470766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe87c09fc10 con 0x7fe87c0a07d0 2020-02-11T16:17:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 0x7fe87c0aa8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 0x7fe87c0aa8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 0x7fe87c0aa8d0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.543+0000 7fe8809a8700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe85c039be0 0x7fe85c03c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.544+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 0x7fe87c0aa8d0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.544+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86c011ba0 con 0x7fe87c0a07d0 2020-02-11T16:17:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.544+0000 7fe8809a8700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe85c039be0 0x7fe85c03c0a0 crc :-1 s=READY pgs=312 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.544+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 0x7fe87c0aa8d0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.544+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fe86c011d00 con 0x7fe87c0a07d0 2020-02-11T16:17:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.544+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 msgr2=0x7fe87c0aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.544+0000 7fe8797fa700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 0x7fe87c0aa8d0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).stop 2020-02-11T16:17:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.544+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 msgr2=0x7fe87c0aa8d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.544+0000 7fe8797fa700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a07d0 0x7fe87c0aa8d0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007a40).stop 2020-02-11T16:17:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.552+0000 7fe88240b700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 0x7fe87c0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.552+0000 7fe88240b700 1 -- 172.21.15.88:0/2824470766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c066d90 con 0x7fe87c0a8070 2020-02-11T16:17:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.552+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 0x7fe87c0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.552+0000 7fe87bfff700 1 -- 172.21.15.88:0/2824470766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe87c138420 con 0x7fe87c0a8070 2020-02-11T16:17:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.552+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 0x7fe87c0a8480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe86c007a00 tx=0x7fe86c008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.552+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 0x7fe87c0a8480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe86c007a00 tx=0x7fe86c008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.552+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 0x7fe87c0a8480 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fe86c007a00 tx=0x7fe86c008fa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.552+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 0x7fe87c0a8480 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fe86c007a00 tx=0x7fe86c008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.552+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86c00c730 con 0x7fe87c0a8070 2020-02-11T16:17:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe87bfff700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 0x7fe87c0a8480 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fe86c007a00 tx=0x7fe86c008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7fe86c00c890 con 0x7fe87c0a8070 2020-02-11T16:17:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 msgr2=0x7fe87c0a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe8797fa700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 0x7fe87c0a8480 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fe86c007a00 tx=0x7fe86c008fa0).stop 2020-02-11T16:17:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe8797fa700 1 -- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 msgr2=0x7fe87c0a8480 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe8797fa700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a8070 0x7fe87c0a8480 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0x7fe86c007a00 tx=0x7fe86c008fa0).stop 2020-02-11T16:17:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe88240b700 1 -- 172.21.15.88:0/2824470766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe85c039be0 msgr2=0x7fe85c03c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe88240b700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe85c039be0 0x7fe85c03c0a0 crc :-1 s=READY pgs=312 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe88240b700 1 -- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a5410 msgr2=0x7fe87c144e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe88240b700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a5410 0x7fe87c144e80 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fe870002f30 tx=0x7fe870010c70).stop 2020-02-11T16:17:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe8809a8700 1 -- 172.21.15.88:0/2824470766 reap_dead start 2020-02-11T16:17:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe8809a8700 1 -- 172.21.15.88:0/2824470766 reap_dead start 2020-02-11T16:17:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe88240b700 1 -- 172.21.15.88:0/2824470766 shutdown_connections 2020-02-11T16:17:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe88240b700 1 --2- 172.21.15.88:0/2824470766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe87c0a5410 0x7fe87c144e80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe88240b700 1 -- 172.21.15.88:0/2824470766 >> 172.21.15.88:0/2824470766 conn(0x7fe87c09d110 msgr2=0x7fe87c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe88240b700 1 -- 172.21.15.88:0/2824470766 shutdown_connections 2020-02-11T16:17:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.553+0000 7fe88240b700 1 -- 172.21.15.88:0/2824470766 wait complete. 2020-02-11T16:17:45.568 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:17:45.568 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:17:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 102, 2020-02-11T16:17:45.570 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:17:45.570 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:17:45.570 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:17:45.570 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:17:45.570 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.571 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:17:45.571 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:45.571 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:17:45.571 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:17:45.571 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:45.572 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:45.572 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:45.572 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:45.572 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:45.572 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:45.572 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.572 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:17:45.573 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:17:45.573 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:45.573 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:45.573 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:45.573 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:45.573 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:45.573 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:45.574 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.574 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:17:45.574 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:17:45.574 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:17:45.574 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:17:45.574 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:17:45.575 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:17:45.575 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:45.575 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:45.575 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:17:45.575 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:17:45.575 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:45.575 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:17:45.576 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:45.576 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:45.576 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:45.576 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:45.576 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:45.576 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:45.577 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.577 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:17:45.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.577 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:17:45.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.577 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:17:45.577 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:17:45.578 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:45.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:45.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.578 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:45.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:17:45.578 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.579 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:45.579 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:17:45.579 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.579 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.580 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:17:45.580 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:17:45.580 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:45.581 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:45.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.582 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:45.582 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:45.582 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:45.582 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:45.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.582 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:45.583 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:17:45.583 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.584 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:45.584 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:17:45.584 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.584 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.584 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.585 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:17:45.585 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:17:45.585 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:45.585 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:45.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.586 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:45.586 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:45.586 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:45.586 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:45.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.586 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:45.587 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:17:45.587 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.587 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:45.587 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:17:45.587 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.588 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.588 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.588 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:17:45.588 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:17:45.588 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:45.588 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:45.589 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.589 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.589 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:17:45.589 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:17:45.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.590 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.590 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.590 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:45.590 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.590 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.591 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:17:45.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.591 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.592 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.592 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:45.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.592 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.593 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:17:45.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.593 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.593 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.594 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:17:45.595 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.595 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.595 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:17:45.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.595 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.595 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.596 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:17:45.596 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.596 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.596 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:17:45.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.596 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.596 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.597 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:45.597 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.597 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.597 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.597 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:17:45.599 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:17:45.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.704+0000 7fe54a26d700 1 Processor -- start 2020-02-11T16:17:45.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.704+0000 7fe54a26d700 1 -- start start 2020-02-11T16:17:45.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54a26d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5440a7120 0x7fe5440a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54a26d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5440a3e60 0x7fe54412ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54a26d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5440a5320 con 0x7fe5440a39e0 2020-02-11T16:17:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54a26d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54409e7a0 con 0x7fe5440a3e60 2020-02-11T16:17:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54a26d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440a4280 con 0x7fe5440a7120 2020-02-11T16:17:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5440a3e60 0x7fe54412ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5440a3e60 0x7fe54412ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56454/0 (socket says 172.21.15.88:56454) 2020-02-11T16:17:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 -- 172.21.15.88:0/2881244067 learned_addr learned my addr 172.21.15.88:0/2881244067 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe543fff700 1 --2- 172.21.15.88:0/2881244067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5440a7120 0x7fe5440a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 -- 172.21.15.88:0/2881244067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5440a7120 msgr2=0x7fe5440a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 --2- 172.21.15.88:0/2881244067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5440a7120 0x7fe5440a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 -- 172.21.15.88:0/2881244067 >> v1:172.21.15.52:6789/0 conn(0x7fe5440a39e0 legacy=0x7fe54412f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 -- 172.21.15.88:0/2881244067 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440a5560 con 0x7fe5440a3e60 2020-02-11T16:17:45.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 --2- 172.21.15.88:0/2881244067 >> v2:172.21.15.88:3300/0 conn(0x7fe5440a3e60 0x7fe54412ffa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe54405ef00 tx=0x7fe53c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 --2- 172.21.15.88:0/2881244067 >> v2:172.21.15.88:3300/0 conn(0x7fe5440a3e60 0x7fe54412ffa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe54405ef00 tx=0x7fe53c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 --2- 172.21.15.88:0/2881244067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe54412ffa0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fe54405ef00 tx=0x7fe53c008c60).ready entity=mon.1 client_cookie=25f55f5a88b989e5 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 --2- 172.21.15.88:0/2881244067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe54412ffa0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fe54405ef00 tx=0x7fe53c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe542ffd700 1 -- 172.21.15.88:0/2881244067 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53c00a160 con 0x7fe5440a3e60 2020-02-11T16:17:45.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 --2- 172.21.15.88:0/2881244067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe54412ffa0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fe54405ef00 tx=0x7fe53c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54880a700 1 --2- 172.21.15.88:0/2881244067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe54412ffa0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fe54405ef00 tx=0x7fe53c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe542ffd700 1 -- 172.21.15.88:0/2881244067 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c00a2c0 con 0x7fe5440a3e60 2020-02-11T16:17:45.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe542ffd700 1 -- 172.21.15.88:0/2881244067 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53c00a660 con 0x7fe5440a3e60 2020-02-11T16:17:45.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54a26d700 1 -- 172.21.15.88:0/2881244067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 msgr2=0x7fe54412ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.705+0000 7fe54a26d700 1 --2- 172.21.15.88:0/2881244067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe54412ffa0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fe54405ef00 tx=0x7fe53c008c60).stop 2020-02-11T16:17:45.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.706+0000 7fe54a26d700 1 -- 172.21.15.88:0/2881244067 shutdown_connections 2020-02-11T16:17:45.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.706+0000 7fe54a26d700 1 --2- 172.21.15.88:0/2881244067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe54412ffa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.706+0000 7fe54a26d700 1 --2- 172.21.15.88:0/2881244067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5440a7120 0x7fe5440a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:45.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.706+0000 7fe54a26d700 1 -- 172.21.15.88:0/2881244067 >> 172.21.15.88:0/2881244067 conn(0x7fe54409d110 msgr2=0x7fe54409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:45.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.706+0000 7fe54a26d700 1 -- 172.21.15.88:0/2881244067 shutdown_connections 2020-02-11T16:17:45.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.706+0000 7fe54a26d700 1 -- 172.21.15.88:0/2881244067 wait complete. 2020-02-11T16:17:45.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.707+0000 7fe54a26d700 1 Processor -- start 2020-02-11T16:17:45.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.707+0000 7fe54a26d700 1 -- start start 2020-02-11T16:17:45.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.707+0000 7fe54a26d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5440a3e60 0x7fe5440a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.707+0000 7fe54a26d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5440a7120 0x7fe54412d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.707+0000 7fe54a26d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe544131980 con 0x7fe5440a39e0 2020-02-11T16:17:45.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.707+0000 7fe54a26d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe544131240 con 0x7fe5440a3e60 2020-02-11T16:17:45.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.707+0000 7fe54a26d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5441314e0 con 0x7fe5440a7120 2020-02-11T16:17:45.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.707+0000 7fe5437fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5440a3e60 0x7fe5440a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5440a3e60 0x7fe5440a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56462/0 (socket says 172.21.15.88:56462) 2020-02-11T16:17:45.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 -- 172.21.15.88:0/598773519 learned_addr learned my addr 172.21.15.88:0/598773519 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:45.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe54880a700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5440a7120 0x7fe54412d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 -- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5440a7120 msgr2=0x7fe54412d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5440a7120 0x7fe54412d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 -- 172.21.15.88:0/598773519 >> v1:172.21.15.52:6789/0 conn(0x7fe5440a39e0 legacy=0x7fe5440a2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 -- 172.21.15.88:0/598773519 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440a2f10 con 0x7fe5440a3e60 2020-02-11T16:17:45.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe54880a700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5440a7120 0x7fe54412d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:17:45.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 --2- 172.21.15.88:0/598773519 >> v2:172.21.15.88:3300/0 conn(0x7fe5440a3e60 0x7fe5440a1720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe54412e0b0 tx=0x7fe538002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 --2- 172.21.15.88:0/598773519 >> v2:172.21.15.88:3300/0 conn(0x7fe5440a3e60 0x7fe5440a1720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe54412e0b0 tx=0x7fe538002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe5440a1720 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fe54412e0b0 tx=0x7fe538002e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe5440a1720 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe54412e0b0 tx=0x7fe538002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53800cbe0 con 0x7fe5440a3e60 2020-02-11T16:17:45.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe5440a1720 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe54412e0b0 tx=0x7fe538002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5437fe700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe5440a1720 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe54412e0b0 tx=0x7fe538002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53800cd40 con 0x7fe5440a3e60 2020-02-11T16:17:45.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53800e350 con 0x7fe5440a3e60 2020-02-11T16:17:45.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe54a26d700 1 -- 172.21.15.88:0/598773519 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5441452b0 con 0x7fe5440a3e60 2020-02-11T16:17:45.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.708+0000 7fe54a26d700 1 -- 172.21.15.88:0/598773519 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe544145800 con 0x7fe5440a3e60 2020-02-11T16:17:45.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe5437fe700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe5440a1720 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe54412e0b0 tx=0x7fe538002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe53800e5c0 con 0x7fe5440a3e60 2020-02-11T16:17:45.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe5437fe700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe5440a1720 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe54412e0b0 tx=0x7fe538002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe54a26d700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 0x7fe54405a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe54a26d700 1 -- 172.21.15.88:0/598773519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54405e2f0 con 0x7fe544132f20 2020-02-11T16:17:45.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe5417fa700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe524039cd0 0x7fe52403c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 0x7fe54405a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe538049890 con 0x7fe5440a3e60 2020-02-11T16:17:45.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe54880a700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe524039cd0 0x7fe52403c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe543fff700 1 -- 172.21.15.88:0/598773519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe544145b10 con 0x7fe544132f20 2020-02-11T16:17:45.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 0x7fe54405a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.709+0000 7fe54880a700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe524039cd0 0x7fe52403c190 crc :-1 s=READY pgs=313 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.710+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 0x7fe54405a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.710+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 0x7fe54405a5d0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.710+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 0x7fe54405a5d0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.710+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5340075e0 con 0x7fe544132f20 2020-02-11T16:17:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.710+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 0x7fe54405a5d0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.710+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fe534008920 con 0x7fe544132f20 2020-02-11T16:17:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.710+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 msgr2=0x7fe54405a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.710+0000 7fe5417fa700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 0x7fe54405a5d0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).stop 2020-02-11T16:17:45.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.710+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 msgr2=0x7fe54405a5d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:45.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.710+0000 7fe5417fa700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe544132f20 0x7fe54405a5d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.718+0000 7fe54a26d700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 0x7fe54409ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.718+0000 7fe54a26d700 1 -- 172.21.15.88:0/598773519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544131380 con 0x7fe54409e8e0 2020-02-11T16:17:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.718+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 0x7fe54409ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe543fff700 1 -- 172.21.15.88:0/598773519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe5440565b0 con 0x7fe54409e8e0 2020-02-11T16:17:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 0x7fe54409ecf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 0x7fe54409ecf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 0x7fe54409ecf0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 0x7fe54409ecf0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53400b240 con 0x7fe54409e8e0 2020-02-11T16:17:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe543fff700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 0x7fe54409ecf0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3852 (secure 0 0 0) 0x7fe53400b3a0 con 0x7fe54409e8e0 2020-02-11T16:17:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 msgr2=0x7fe54409ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe5417fa700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 0x7fe54409ecf0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).stop 2020-02-11T16:17:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe5417fa700 1 -- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 msgr2=0x7fe54409ecf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.719+0000 7fe5417fa700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54409e8e0 0x7fe54409ecf0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0x7fe534002f30 tx=0x7fe534010870).stop 2020-02-11T16:17:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.720+0000 7fe54a26d700 1 -- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe524039cd0 msgr2=0x7fe52403c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.720+0000 7fe54a26d700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe524039cd0 0x7fe52403c190 crc :-1 s=READY pgs=313 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.720+0000 7fe54a26d700 1 -- 172.21.15.88:0/598773519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 msgr2=0x7fe5440a1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.720+0000 7fe54a26d700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe5440a1720 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fe54412e0b0 tx=0x7fe538002e60).stop 2020-02-11T16:17:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.720+0000 7fe54880a700 1 -- 172.21.15.88:0/598773519 reap_dead start 2020-02-11T16:17:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.720+0000 7fe54a26d700 1 -- 172.21.15.88:0/598773519 shutdown_connections 2020-02-11T16:17:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.720+0000 7fe54a26d700 1 --2- 172.21.15.88:0/598773519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5440a3e60 0x7fe5440a1720 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.720+0000 7fe54a26d700 1 -- 172.21.15.88:0/598773519 >> 172.21.15.88:0/598773519 conn(0x7fe54409d110 msgr2=0x7fe54405b250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.720+0000 7fe54a26d700 1 -- 172.21.15.88:0/598773519 shutdown_connections 2020-02-11T16:17:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.720+0000 7fe54a26d700 1 -- 172.21.15.88:0/598773519 wait complete. 2020-02-11T16:17:45.737 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:17:45.737 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:17:45.737 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:17:45.737 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:17:45.737 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 102, 2020-02-11T16:17:45.738 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:17:45.738 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:17:45.738 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:17:45.738 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:17:45.738 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.739 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:17:45.739 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:45.739 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:17:45.739 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:17:45.739 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:45.740 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:45.740 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:45.740 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:45.740 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:45.740 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:45.740 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.741 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:17:45.741 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:17:45.741 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:45.741 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:45.741 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:45.741 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:45.741 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:45.742 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:45.742 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.742 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:17:45.742 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:17:45.742 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:17:45.742 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:17:45.743 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:17:45.743 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:17:45.743 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:45.743 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:45.743 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:17:45.743 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:17:45.743 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:45.744 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:17:45.744 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:45.744 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:45.744 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:45.744 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:45.744 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:45.745 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:45.745 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.745 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:17:45.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.745 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:17:45.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.746 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:17:45.746 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:17:45.746 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:45.746 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:45.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.746 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:45.746 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:17:45.747 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.747 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:45.747 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:17:45.748 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.748 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.748 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.748 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:17:45.749 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:17:45.749 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:45.749 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:45.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.749 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:45.749 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:45.750 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:45.750 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:45.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.750 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:45.750 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:17:45.750 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:17:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.751 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:17:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:17:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:45.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.753 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:17:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:17:45.754 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:17:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:17:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:45.755 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:17:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:17:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.757 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:17:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.758 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.759 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:17:45.759 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:17:45.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.864+0000 7f43d9190700 1 Processor -- start 2020-02-11T16:17:45.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.864+0000 7f43d9190700 1 -- start start 2020-02-11T16:17:45.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d9190700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43d412ffa0 0x7f43d4141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:45.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d9190700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40a5560 con 0x7f43d40a7120 2020-02-11T16:17:45.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d9190700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d409e060 con 0x7f43d40a4ec0 2020-02-11T16:17:45.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d9190700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40a5350 con 0x7f43d412ffa0 2020-02-11T16:17:45.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43d412ffa0 0x7f43d4141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43d412ffa0 0x7f43d4141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56476/0 (socket says 172.21.15.88:56476) 2020-02-11T16:17:45.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 -- 172.21.15.88:0/2313580480 learned_addr learned my addr 172.21.15.88:0/2313580480 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:45.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43cbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f43d40a4ec0 0x7f43d412f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44100/0 (socket says 172.21.15.88:44100) 2020-02-11T16:17:45.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 -- 172.21.15.88:0/2313580480 >> v1:172.21.15.88:6789/0 conn(0x7f43d40a4ec0 legacy=0x7f43d412f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 -- 172.21.15.88:0/2313580480 >> v1:172.21.15.52:6789/0 conn(0x7f43d40a7120 legacy=0x7f43d40a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 -- 172.21.15.88:0/2313580480 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d409e300 con 0x7f43d412ffa0 2020-02-11T16:17:45.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 --2- 172.21.15.88:0/2313580480 >> v2:172.21.15.88:3300/0 conn(0x7f43d412ffa0 0x7f43d4141480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f43cc0032b0 tx=0x7f43cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 --2- 172.21.15.88:0/2313580480 >> v2:172.21.15.88:3300/0 conn(0x7f43d412ffa0 0x7f43d4141480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f43cc0032b0 tx=0x7f43cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 --2- 172.21.15.88:0/2313580480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d412ffa0 0x7f43d4141480 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43cc008c60).ready entity=mon.1 client_cookie=6ebdaacb913b3b29 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 --2- 172.21.15.88:0/2313580480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d412ffa0 0x7f43d4141480 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 --2- 172.21.15.88:0/2313580480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d412ffa0 0x7f43d4141480 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d359e700 1 --2- 172.21.15.88:0/2313580480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d412ffa0 0x7f43d4141480 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d259c700 1 -- 172.21.15.88:0/2313580480 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc00a160 con 0x7f43d412ffa0 2020-02-11T16:17:45.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d259c700 1 -- 172.21.15.88:0/2313580480 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00a2c0 con 0x7f43d412ffa0 2020-02-11T16:17:45.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d259c700 1 -- 172.21.15.88:0/2313580480 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc00a6a0 con 0x7f43d412ffa0 2020-02-11T16:17:45.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d9190700 1 -- 172.21.15.88:0/2313580480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d412ffa0 msgr2=0x7f43d4141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.865+0000 7f43d9190700 1 --2- 172.21.15.88:0/2313580480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d412ffa0 0x7f43d4141480 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43cc008c60).stop 2020-02-11T16:17:45.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.866+0000 7f43d9190700 1 -- 172.21.15.88:0/2313580480 shutdown_connections 2020-02-11T16:17:45.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.866+0000 7f43d9190700 1 --2- 172.21.15.88:0/2313580480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d412ffa0 0x7f43d4141480 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.866+0000 7f43d9190700 1 -- 172.21.15.88:0/2313580480 >> 172.21.15.88:0/2313580480 conn(0x7f43d409d110 msgr2=0x7f43d409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:45.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.866+0000 7f43d9190700 1 -- 172.21.15.88:0/2313580480 shutdown_connections 2020-02-11T16:17:45.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.866+0000 7f43d9190700 1 -- 172.21.15.88:0/2313580480 wait complete. 2020-02-11T16:17:45.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.867+0000 7f43d9190700 1 Processor -- start 2020-02-11T16:17:45.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.867+0000 7f43d9190700 1 -- start start 2020-02-11T16:17:45.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.867+0000 7f43d9190700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43d412ffa0 0x7f43d41278f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.867+0000 7f43d9190700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d4132930 con 0x7f43d40a7120 2020-02-11T16:17:45.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.867+0000 7f43d9190700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d4131aa0 con 0x7f43d40a4ec0 2020-02-11T16:17:45.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.867+0000 7f43d9190700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d4127d50 con 0x7f43d412ffa0 2020-02-11T16:17:45.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d2d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f43d40a4ec0 0x7f43d4131ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44104/0 (socket says 172.21.15.88:44104) 2020-02-11T16:17:45.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d2d9d700 1 -- 172.21.15.88:0/1032741411 learned_addr learned my addr 172.21.15.88:0/1032741411 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:45.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d359e700 1 --2- 172.21.15.88:0/1032741411 >> v2:172.21.15.52:3300/0 conn(0x7f43d412ffa0 0x7f43d41278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421499812 0 0) 0x7f43d4131aa0 con 0x7f43d40a4ec0 2020-02-11T16:17:45.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b8002fe0 con 0x7f43d40a4ec0 2020-02-11T16:17:45.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988421315 0 0) 0x7f43d4132930 con 0x7f43d40a7120 2020-02-11T16:17:45.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d4131aa0 con 0x7f43d40a7120 2020-02-11T16:17:45.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1431630596 0 0) 0x7f43b8002fe0 con 0x7f43d40a4ec0 2020-02-11T16:17:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f43d4132930 con 0x7f43d40a4ec0 2020-02-11T16:17:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f43c4001930 con 0x7f43d40a4ec0 2020-02-11T16:17:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d359e700 1 -- 172.21.15.88:0/1032741411 >> v1:172.21.15.88:6789/0 conn(0x7f43d40a4ec0 legacy=0x7f43d4131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d359e700 1 -- 172.21.15.88:0/1032741411 >> v1:172.21.15.52:6789/0 conn(0x7f43d40a7120 legacy=0x7f43d41271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d359e700 1 -- 172.21.15.88:0/1032741411 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4138c80 con 0x7f43d412ffa0 2020-02-11T16:17:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d359e700 1 --2- 172.21.15.88:0/1032741411 >> v2:172.21.15.52:3300/0 conn(0x7f43d412ffa0 0x7f43d41278f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d359e700 1 --2- 172.21.15.88:0/1032741411 >> v2:172.21.15.52:3300/0 conn(0x7f43d412ffa0 0x7f43d41278f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d359e700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d412ffa0 0x7f43d41278f0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43d40a11a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d359e700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d412ffa0 0x7f43d41278f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc010640 con 0x7f43d412ffa0 2020-02-11T16:17:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d359e700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d412ffa0 0x7f43d41278f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d359e700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d412ffa0 0x7f43d41278f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc005a40 con 0x7f43d412ffa0 2020-02-11T16:17:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d9190700 1 -- 172.21.15.88:0/1032741411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d4130720 con 0x7f43d412ffa0 2020-02-11T16:17:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc005da0 con 0x7f43d412ffa0 2020-02-11T16:17:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.868+0000 7f43d9190700 1 -- 172.21.15.88:0/1032741411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d4139c60 con 0x7f43d412ffa0 2020-02-11T16:17:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.869+0000 7f43d359e700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d412ffa0 0x7f43d41278f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.869+0000 7f43d9190700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 0x7f43d405a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.869+0000 7f43d9190700 1 -- 172.21.15.88:0/1032741411 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d405e2f0 con 0x7f43d412d5b0 2020-02-11T16:17:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.869+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f43cc007150 con 0x7f43d412ffa0 2020-02-11T16:17:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.869+0000 7f43d359e700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d412ffa0 0x7f43d41278f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.869+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 0x7f43d405a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.869+0000 7f43d0d99700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43b803a300 0x7f43b803c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.869+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f43cc04a500 con 0x7f43d412ffa0 2020-02-11T16:17:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d2d9d700 1 -- 172.21.15.88:0/1032741411 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43d4138e80 con 0x7f43d412d5b0 2020-02-11T16:17:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 0x7f43d405a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43cbfff700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43b803a300 0x7f43b803c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 0x7f43d405a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 0x7f43d405a5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43cbfff700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43b803a300 0x7f43b803c7c0 crc :-1 s=READY pgs=314 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 0x7f43d405a5d0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c4012db0 con 0x7f43d412d5b0 2020-02-11T16:17:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 0x7f43d405a5d0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f43c400ad40 con 0x7f43d412d5b0 2020-02-11T16:17:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 msgr2=0x7f43d405a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d0d99700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 0x7f43d405a5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).stop 2020-02-11T16:17:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 msgr2=0x7f43d405a5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.870+0000 7f43d0d99700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d412d5b0 0x7f43d405a5d0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).stop 2020-02-11T16:17:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.878+0000 7f43d9190700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 0x7f43d405ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.878+0000 7f43d9190700 1 -- 172.21.15.88:0/1032741411 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4130920 con 0x7f43d405aa30 2020-02-11T16:17:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 0x7f43d405ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d2d9d700 1 -- 172.21.15.88:0/1032741411 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f43d41318e0 con 0x7f43d405aa30 2020-02-11T16:17:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 0x7f43d405ae10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 0x7f43d405ae10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 0x7f43d405ae10 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 0x7f43d405ae10 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c40109c0 con 0x7f43d405aa30 2020-02-11T16:17:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d2d9d700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 0x7f43d405ae10 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f43c40058d0 con 0x7f43d405aa30 2020-02-11T16:17:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 msgr2=0x7f43d405ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.879+0000 7f43d0d99700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 0x7f43d405ae10 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).stop 2020-02-11T16:17:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d0d99700 1 -- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 msgr2=0x7f43d405ae10 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d0d99700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f43d405aa30 0x7f43d405ae10 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0x7f43c4001700 tx=0x7f43c4011330).stop 2020-02-11T16:17:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d9190700 1 -- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43b803a300 msgr2=0x7f43b803c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d9190700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43b803a300 0x7f43b803c7c0 crc :-1 s=READY pgs=314 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d9190700 1 -- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d412ffa0 msgr2=0x7f43d41278f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d9190700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d412ffa0 0x7f43d41278f0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43d40a11a0).stop 2020-02-11T16:17:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d359e700 1 -- 172.21.15.88:0/1032741411 reap_dead start 2020-02-11T16:17:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d359e700 1 -- 172.21.15.88:0/1032741411 reap_dead start 2020-02-11T16:17:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d9190700 1 -- 172.21.15.88:0/1032741411 shutdown_connections 2020-02-11T16:17:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d9190700 1 --2- 172.21.15.88:0/1032741411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d412ffa0 0x7f43d41278f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:45.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d9190700 1 -- 172.21.15.88:0/1032741411 >> 172.21.15.88:0/1032741411 conn(0x7f43d409d110 msgr2=0x7f43d4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:45.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d9190700 1 -- 172.21.15.88:0/1032741411 shutdown_connections 2020-02-11T16:17:45.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:45.880+0000 7f43d9190700 1 -- 172.21.15.88:0/1032741411 wait complete. 2020-02-11T16:17:45.901 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:17:45.902 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:45.902 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:45.902 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:17:45.902 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 102, 2020-02-11T16:17:45.903 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:17:45.903 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:17:45.903 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:17:45.903 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:17:45.903 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.904 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:17:45.904 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:45.904 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:17:45.904 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:17:45.905 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:45.905 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:45.905 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:45.905 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:45.906 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:45.906 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:45.906 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.906 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:17:45.906 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:17:45.907 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:45.907 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:45.907 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:45.908 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:45.908 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:45.908 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:45.908 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.909 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:17:45.909 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:17:45.909 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:17:45.910 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:17:45.910 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:17:45.910 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:17:45.910 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:45.910 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:45.911 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:17:45.911 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:17:45.911 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:45.911 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:17:45.912 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:45.912 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:45.912 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:45.912 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:45.912 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:45.913 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:45.913 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.913 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:17:45.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:17:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:17:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:17:45.915 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:45.915 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:45.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.915 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:45.915 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:17:45.916 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.916 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:45.917 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:17:45.917 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.917 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.917 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.918 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:17:45.919 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:17:45.919 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:45.919 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:45.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.920 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:45.920 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:45.921 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:45.921 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:45.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.921 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:45.921 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:17:45.922 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.922 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:45.922 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:17:45.923 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.923 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.923 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.923 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:17:45.923 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:17:45.924 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:45.924 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:45.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.924 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:45.924 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:45.925 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:45.925 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:45.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.925 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:45.925 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:17:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:17:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:17:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:17:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:17:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:17:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:17:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:17:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.932 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:17:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:17:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:17:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:17:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:17:45.936 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:17:45.936 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:17:46.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.041+0000 7fe443235700 1 Processor -- start 2020-02-11T16:17:46.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.041+0000 7fe443235700 1 -- start start 2020-02-11T16:17:46.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.042+0000 7fe443235700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c0a0d90 0x7fe43c1322f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:46.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.042+0000 7fe443235700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c09de90 con 0x7fe43c0a2980 2020-02-11T16:17:46.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.042+0000 7fe443235700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c0a3e10 con 0x7fe43c0a5de0 2020-02-11T16:17:46.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.042+0000 7fe443235700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0a3c00 con 0x7fe43c0a0d90 2020-02-11T16:17:46.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.042+0000 7fe442233700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe43c0a5de0 0x7fe43c131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44116/0 (socket says 172.21.15.88:44116) 2020-02-11T16:17:46.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.042+0000 7fe442233700 1 -- 172.21.15.88:0/3025899913 learned_addr learned my addr 172.21.15.88:0/3025899913 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:46.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.042+0000 7fe441a32700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c0a0d90 0x7fe43c1322f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:46.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.042+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552141481 0 0) 0x7fe43c0a3e10 con 0x7fe43c0a5de0 2020-02-11T16:17:46.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe424003230 con 0x7fe43c0a5de0 2020-02-11T16:17:46.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4110280319 0 0) 0x7fe424003230 con 0x7fe43c0a5de0 2020-02-11T16:17:46.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c0a0d90 msgr2=0x7fe43c1322f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:46.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c0a0d90 0x7fe43c1322f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:46.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 >> v1:172.21.15.52:6789/0 conn(0x7fe43c0a2980 legacy=0x7fe43c13f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:46.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c09e0c0 con 0x7fe43c0a5de0 2020-02-11T16:17:46.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe434001c10 con 0x7fe43c0a5de0 2020-02-11T16:17:46.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 >> v1:172.21.15.88:6789/0 conn(0x7fe43c0a5de0 legacy=0x7fe43c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:46.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c0a0d90 0x7fe424003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:46.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe424003bb0 0x7fe424004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:46.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4240045e0 0x7fe424004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:46.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0a3c00 con 0x7fe424003bb0 2020-02-11T16:17:46.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe424005010 con 0x7fe4240045e0 2020-02-11T16:17:46.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240051d0 con 0x7fe43c0a0d90 2020-02-11T16:17:46.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4240045e0 0x7fe424004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:46.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442233700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c0a0d90 0x7fe424003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:46.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441a32700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe424003bb0 0x7fe424004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:46.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 -- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c0a0d90 msgr2=0x7fe424003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:46.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c0a0d90 0x7fe424003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:46.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 -- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe424003bb0 msgr2=0x7fe424004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:46.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe424003bb0 0x7fe424004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:46.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 -- 172.21.15.88:0/3025899913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe424003230 con 0x7fe4240045e0 2020-02-11T16:17:46.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441a32700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe424003bb0 0x7fe424004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:17:46.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4240045e0 0x7fe424004a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe43c05eef0 tx=0x7fe430011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4240045e0 0x7fe424004a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe43c05eef0 tx=0x7fe430011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4240045e0 0x7fe424004a60 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fe43c05eef0 tx=0x7fe430011f20).ready entity=mon.1 client_cookie=3c49a8071e4729cf server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:46.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4240045e0 0x7fe424004a60 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fe43c05eef0 tx=0x7fe430011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe430003540 con 0x7fe4240045e0 2020-02-11T16:17:46.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4240045e0 0x7fe424004a60 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fe43c05eef0 tx=0x7fe430011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4300036a0 con 0x7fe4240045e0 2020-02-11T16:17:46.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4240045e0 0x7fe424004a60 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fe43c05eef0 tx=0x7fe430011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe441231700 1 -- 172.21.15.88:0/3025899913 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe430003a80 con 0x7fe4240045e0 2020-02-11T16:17:46.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe443235700 1 -- 172.21.15.88:0/3025899913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4240045e0 msgr2=0x7fe424004a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:46.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe443235700 1 --2- 172.21.15.88:0/3025899913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4240045e0 0x7fe424004a60 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fe43c05eef0 tx=0x7fe430011f20).stop 2020-02-11T16:17:46.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.043+0000 7fe442a34700 1 -- 172.21.15.88:0/3025899913 reap_dead start 2020-02-11T16:17:46.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.044+0000 7fe443235700 1 -- 172.21.15.88:0/3025899913 shutdown_connections 2020-02-11T16:17:46.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.044+0000 7fe443235700 1 -- 172.21.15.88:0/3025899913 >> 172.21.15.88:0/3025899913 conn(0x7fe43c0a9fb0 msgr2=0x7fe43c0aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:46.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.044+0000 7fe443235700 1 -- 172.21.15.88:0/3025899913 shutdown_connections 2020-02-11T16:17:46.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.044+0000 7fe443235700 1 -- 172.21.15.88:0/3025899913 wait complete. 2020-02-11T16:17:46.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.045+0000 7fe443235700 1 Processor -- start 2020-02-11T16:17:46.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.045+0000 7fe443235700 1 -- start start 2020-02-11T16:17:46.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.045+0000 7fe443235700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:46.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.045+0000 7fe443235700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c1374e0 con 0x7fe43c130770 2020-02-11T16:17:46.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.045+0000 7fe443235700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c062a10 con 0x7fe43c135090 2020-02-11T16:17:46.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.045+0000 7fe443235700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c137f60 con 0x7fe43c062630 2020-02-11T16:17:46.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.045+0000 7fe441a32700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe43c135090 0x7fe43c136dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44126/0 (socket says 172.21.15.88:44126) 2020-02-11T16:17:46.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe441a32700 1 -- 172.21.15.88:0/1438527841 learned_addr learned my addr 172.21.15.88:0/1438527841 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:46.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:46.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132802430 0 0) 0x7fe43c062a10 con 0x7fe43c135090 2020-02-11T16:17:46.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe41c002fe0 con 0x7fe43c135090 2020-02-11T16:17:46.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430153520 0 0) 0x7fe43c1374e0 con 0x7fe43c130770 2020-02-11T16:17:46.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe43c062a10 con 0x7fe43c130770 2020-02-11T16:17:46.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe442233700 1 -- 172.21.15.88:0/1438527841 >> v1:172.21.15.88:6789/0 conn(0x7fe43c135090 legacy=0x7fe43c136dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:46.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe442233700 1 -- 172.21.15.88:0/1438527841 >> v1:172.21.15.52:6789/0 conn(0x7fe43c130770 legacy=0x7fe43c130bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:46.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe442233700 1 -- 172.21.15.88:0/1438527841 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c138200 con 0x7fe43c062630 2020-02-11T16:17:46.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:46.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe434005830 con 0x7fe43c062630 2020-02-11T16:17:46.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe434005990 con 0x7fe43c062630 2020-02-11T16:17:46.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe443235700 1 -- 172.21.15.88:0/1438527841 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c1384a0 con 0x7fe43c062630 2020-02-11T16:17:46.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe434005cf0 con 0x7fe43c062630 2020-02-11T16:17:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.046+0000 7fe443235700 1 -- 172.21.15.88:0/1438527841 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c131300 con 0x7fe43c062630 2020-02-11T16:17:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.047+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.047+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe434007180 con 0x7fe43c062630 2020-02-11T16:17:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.047+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.048+0000 7fe42f7fe700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe41c03a070 0x7fe41c03c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.048+0000 7fe443235700 1 -- 172.21.15.88:0/1438527841 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c0565b0 con 0x7fe43c062630 2020-02-11T16:17:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.048+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe434049ac0 con 0x7fe43c062630 2020-02-11T16:17:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.048+0000 7fe441a32700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe41c03a070 0x7fe41c03c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.048+0000 7fe441a32700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe41c03a070 0x7fe41c03c530 crc :-1 s=READY pgs=315 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:46.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.052+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.052+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe43402ee50 con 0x7fe43c062630 2020-02-11T16:17:46.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.238+0000 7fe443235700 1 -- 172.21.15.88:0/1438527841 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fe43c0a4390 con 0x7fe43c062630 2020-02-11T16:17:46.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.239+0000 7fe442233700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:46.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.239+0000 7fe42f7fe700 1 -- 172.21.15.88:0/1438527841 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fe434031b30 con 0x7fe43c062630 2020-02-11T16:17:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.241+0000 7fe443235700 1 -- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe41c03a070 msgr2=0x7fe41c03c530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.241+0000 7fe443235700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe41c03a070 0x7fe41c03c530 crc :-1 s=READY pgs=315 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.241+0000 7fe443235700 1 -- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 msgr2=0x7fe43c09d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.241+0000 7fe443235700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fe434001920 tx=0x7fe43c0a61c0).stop 2020-02-11T16:17:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.241+0000 7fe443235700 1 -- 172.21.15.88:0/1438527841 shutdown_connections 2020-02-11T16:17:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.241+0000 7fe443235700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe41c03a070 0x7fe41c03c530 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.241+0000 7fe443235700 1 --2- 172.21.15.88:0/1438527841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe43c062630 0x7fe43c09d8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.241+0000 7fe443235700 1 -- 172.21.15.88:0/1438527841 >> 172.21.15.88:0/1438527841 conn(0x7fe43c0a9fb0 msgr2=0x7fe43c0a1320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.241+0000 7fe443235700 1 -- 172.21.15.88:0/1438527841 shutdown_connections 2020-02-11T16:17:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:46.241+0000 7fe443235700 1 -- 172.21.15.88:0/1438527841 wait complete. 2020-02-11T16:17:46.253 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:17:56.253 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:17:56.253 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:17:56.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.366+0000 7fa0538de700 1 Processor -- start 2020-02-11T16:17:56.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.367+0000 7fa0538de700 1 -- start start 2020-02-11T16:17:56.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.367+0000 7fa0538de700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa04c0a1520 0x7fa04c131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:56.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.367+0000 7fa0538de700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c0a4350 con 0x7fa04c0a5b20 2020-02-11T16:17:56.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.367+0000 7fa0538de700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c0a3a40 con 0x7fa04c0a2fa0 2020-02-11T16:17:56.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.367+0000 7fa0538de700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c0a1e60 con 0x7fa04c0a1520 2020-02-11T16:17:56.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.367+0000 7fa051e7b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa04c0a1520 0x7fa04c131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.367+0000 7fa051e7b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa04c0a1520 0x7fa04c131990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56510/0 (socket says 172.21.15.88:56510) 2020-02-11T16:17:56.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.367+0000 7fa051e7b700 1 -- 172.21.15.88:0/3463477046 learned_addr learned my addr 172.21.15.88:0/3463477046 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:56.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa051e7b700 1 -- 172.21.15.88:0/3463477046 >> v1:172.21.15.88:6789/0 conn(0x7fa04c0a2fa0 legacy=0x7fa04c0a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa051e7b700 1 -- 172.21.15.88:0/3463477046 >> v1:172.21.15.52:6789/0 conn(0x7fa04c0a5b20 legacy=0x7fa04c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:56.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa051e7b700 1 -- 172.21.15.88:0/3463477046 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c0a3ce0 con 0x7fa04c0a1520 2020-02-11T16:17:56.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa051e7b700 1 --2- 172.21.15.88:0/3463477046 >> v2:172.21.15.88:3300/0 conn(0x7fa04c0a1520 0x7fa04c131990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa04c05ef00 tx=0x7fa044008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa051e7b700 1 --2- 172.21.15.88:0/3463477046 >> v2:172.21.15.88:3300/0 conn(0x7fa04c0a1520 0x7fa04c131990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa04c05ef00 tx=0x7fa044008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa051e7b700 1 --2- 172.21.15.88:0/3463477046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a1520 0x7fa04c131990 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044008c60).ready entity=mon.1 client_cookie=1ad7f43bc467aa88 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa051e7b700 1 --2- 172.21.15.88:0/3463477046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a1520 0x7fa04c131990 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa03bfff700 1 -- 172.21.15.88:0/3463477046 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04400a160 con 0x7fa04c0a1520 2020-02-11T16:17:56.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa051e7b700 1 --2- 172.21.15.88:0/3463477046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a1520 0x7fa04c131990 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa051e7b700 1 --2- 172.21.15.88:0/3463477046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a1520 0x7fa04c131990 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa03bfff700 1 -- 172.21.15.88:0/3463477046 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04400a2c0 con 0x7fa04c0a1520 2020-02-11T16:17:56.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa03bfff700 1 -- 172.21.15.88:0/3463477046 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04400a660 con 0x7fa04c0a1520 2020-02-11T16:17:56.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa0538de700 1 -- 172.21.15.88:0/3463477046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a1520 msgr2=0x7fa04c131990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.368+0000 7fa0538de700 1 --2- 172.21.15.88:0/3463477046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a1520 0x7fa04c131990 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044008c60).stop 2020-02-11T16:17:56.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.369+0000 7fa0538de700 1 -- 172.21.15.88:0/3463477046 shutdown_connections 2020-02-11T16:17:56.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.369+0000 7fa0538de700 1 --2- 172.21.15.88:0/3463477046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a1520 0x7fa04c131990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.369+0000 7fa0538de700 1 -- 172.21.15.88:0/3463477046 >> 172.21.15.88:0/3463477046 conn(0x7fa04c09d110 msgr2=0x7fa04c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:56.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.369+0000 7fa0538de700 1 -- 172.21.15.88:0/3463477046 shutdown_connections 2020-02-11T16:17:56.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.369+0000 7fa0538de700 1 -- 172.21.15.88:0/3463477046 wait complete. 2020-02-11T16:17:56.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.369+0000 7fa0538de700 1 Processor -- start 2020-02-11T16:17:56.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa0538de700 1 -- start start 2020-02-11T16:17:56.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa0538de700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa04c0a2fa0 0x7fa04c1281f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa0538de700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa04c0a5b20 0x7fa04c128650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa0538de700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c135330 con 0x7fa04c0a1520 2020-02-11T16:17:56.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa0538de700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c131df0 con 0x7fa04c0a5b20 2020-02-11T16:17:56.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa0538de700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c09fa90 con 0x7fa04c0a2fa0 2020-02-11T16:17:56.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa05167a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa04c0a1520 0x7fa04c0a0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44138/0 (socket says 172.21.15.88:44138) 2020-02-11T16:17:56.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa05167a700 1 -- 172.21.15.88:0/2080255948 learned_addr learned my addr 172.21.15.88:0/2080255948 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:56.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> v2:172.21.15.88:3300/0 conn(0x7fa04c0a5b20 0x7fa04c128650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa050e79700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa04c0a2fa0 0x7fa04c1281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa051e7b700 1 -- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa04c0a2fa0 msgr2=0x7fa04c1281f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa04c0a2fa0 0x7fa04c1281f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa051e7b700 1 -- 172.21.15.88:0/2080255948 >> v1:172.21.15.88:6789/0 conn(0x7fa04c0a1520 legacy=0x7fa04c0a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa051e7b700 1 -- 172.21.15.88:0/2080255948 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c05adc0 con 0x7fa04c0a5b20 2020-02-11T16:17:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa03a7fc700 1 -- 172.21.15.88:0/2080255948 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600526566 0 0) 0x7fa04c135330 con 0x7fa04c0a1520 2020-02-11T16:17:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa050e79700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa04c0a2fa0 0x7fa04c1281f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:17:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.370+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> v2:172.21.15.88:3300/0 conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> v2:172.21.15.88:3300/0 conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa03a7fc700 1 -- 172.21.15.88:0/2080255948 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa044005c30 con 0x7fa04c0a5b20 2020-02-11T16:17:56.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa03a7fc700 1 -- 172.21.15.88:0/2080255948 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044005d90 con 0x7fa04c0a5b20 2020-02-11T16:17:56.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa0538de700 1 -- 172.21.15.88:0/2080255948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c1377d0 con 0x7fa04c0a5b20 2020-02-11T16:17:56.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa03a7fc700 1 -- 172.21.15.88:0/2080255948 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04400f780 con 0x7fa04c0a5b20 2020-02-11T16:17:56.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa0538de700 1 -- 172.21.15.88:0/2080255948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c137d10 con 0x7fa04c0a5b20 2020-02-11T16:17:56.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.371+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.372+0000 7fa03a7fc700 1 -- 172.21.15.88:0/2080255948 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa04400f980 con 0x7fa04c0a5b20 2020-02-11T16:17:56.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.372+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.372+0000 7fa03a7fc700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa02c039a60 0x7fa02c03bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.372+0000 7fa03a7fc700 1 -- 172.21.15.88:0/2080255948 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa04404aae0 con 0x7fa04c0a5b20 2020-02-11T16:17:56.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.372+0000 7fa0538de700 1 -- 172.21.15.88:0/2080255948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c09ff30 con 0x7fa04c0a5b20 2020-02-11T16:17:56.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.372+0000 7fa05167a700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa02c039a60 0x7fa02c03bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.372+0000 7fa05167a700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa02c039a60 0x7fa02c03bf20 crc :-1 s=READY pgs=316 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.375+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.375+0000 7fa03a7fc700 1 -- 172.21.15.88:0/2080255948 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fa0440301a0 con 0x7fa04c0a5b20 2020-02-11T16:17:56.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.557+0000 7fa0538de700 1 -- 172.21.15.88:0/2080255948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa04c0565b0 con 0x7fa04c0a5b20 2020-02-11T16:17:56.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.557+0000 7fa051e7b700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.557+0000 7fa03a7fc700 1 -- 172.21.15.88:0/2080255948 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fa044032c70 con 0x7fa04c0a5b20 2020-02-11T16:17:56.560 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:56.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 -- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa02c039a60 msgr2=0x7fa02c03bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa02c039a60 0x7fa02c03bf20 crc :-1 s=READY pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 -- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 msgr2=0x7fa04c128650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 0x7fa04c128650 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fa04c05ef00 tx=0x7fa044011850).stop 2020-02-11T16:17:56.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 -- 172.21.15.88:0/2080255948 shutdown_connections 2020-02-11T16:17:56.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa02c039a60 0x7fa02c03bf20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0a5b20 0x7fa04c128650 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 --2- 172.21.15.88:0/2080255948 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa04c0a2fa0 0x7fa04c1281f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 -- 172.21.15.88:0/2080255948 >> 172.21.15.88:0/2080255948 conn(0x7fa04c09d110 msgr2=0x7fa04c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:56.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 -- 172.21.15.88:0/2080255948 shutdown_connections 2020-02-11T16:17:56.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.558+0000 7fa0538de700 1 -- 172.21.15.88:0/2080255948 wait complete. 2020-02-11T16:17:56.571 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":102,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:56.571 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:17:56.571 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:17:56.572 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:17:56.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.677+0000 7f5a70fc0700 1 Processor -- start 2020-02-11T16:17:56.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.677+0000 7f5a70fc0700 1 -- start start 2020-02-11T16:17:56.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a70fc0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:56.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a70fc0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a6c134a50 0x7f5a6c134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:56.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a70fc0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c0a31b0 con 0x7f5a6c0a18a0 2020-02-11T16:17:56.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a70fc0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c0a3570 con 0x7f5a6c134a50 2020-02-11T16:17:56.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a70fc0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0a3810 con 0x7f5a6c0a5de0 2020-02-11T16:17:56.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a69d9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a6ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a6c134a50 0x7f5a6c134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a6a59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5a6c0a18a0 0x7f5a6c0a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:35928/0 (socket says 172.21.15.88:35928) 2020-02-11T16:17:56.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a6a59c700 1 -- 172.21.15.88:0/2411911069 learned_addr learned my addr 172.21.15.88:0/2411911069 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:56.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a6ad9d700 1 -- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 msgr2=0x7f5a6c0a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:17:56.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a6ad9d700 1 --2- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c0a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:56.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a6ad9d700 1 -- 172.21.15.88:0/2411911069 >> v1:172.21.15.52:6789/0 conn(0x7f5a6c0a18a0 legacy=0x7f5a6c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a6ad9d700 1 -- 172.21.15.88:0/2411911069 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0a3ab0 con 0x7f5a6c134a50 2020-02-11T16:17:56.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a6959a700 1 -- 172.21.15.88:0/2411911069 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351011258 0 0) 0x7f5a6c0a31b0 con 0x7f5a6c0a18a0 2020-02-11T16:17:56.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a69d9b700 1 --2- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:17:56.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.678+0000 7f5a6ad9d700 1 --2- 172.21.15.88:0/2411911069 >> v2:172.21.15.52:3300/0 conn(0x7f5a6c134a50 0x7f5a6c134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a6c0a5cc0 tx=0x7f5a64008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a6ad9d700 1 --2- 172.21.15.88:0/2411911069 >> v2:172.21.15.52:3300/0 conn(0x7f5a6c134a50 0x7f5a6c134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a6c0a5cc0 tx=0x7f5a64008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a6ad9d700 1 --2- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a6c134a50 0x7f5a6c134ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f5a6c0a5cc0 tx=0x7f5a64008c60).ready entity=mon.0 client_cookie=abd95ee168658f26 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a6ad9d700 1 --2- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a6c134a50 0x7f5a6c134ee0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f5a6c0a5cc0 tx=0x7f5a64008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a6959a700 1 -- 172.21.15.88:0/2411911069 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a64011e20 con 0x7f5a6c134a50 2020-02-11T16:17:56.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a6ad9d700 1 --2- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a6c134a50 0x7f5a6c134ee0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f5a6c0a5cc0 tx=0x7f5a64008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a6959a700 1 -- 172.21.15.88:0/2411911069 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6400a160 con 0x7f5a6c134a50 2020-02-11T16:17:56.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a6ad9d700 1 --2- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a6c134a50 0x7f5a6c134ee0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f5a6c0a5cc0 tx=0x7f5a64008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a6959a700 1 -- 172.21.15.88:0/2411911069 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6400a500 con 0x7f5a6c134a50 2020-02-11T16:17:56.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a70fc0700 1 -- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a6c134a50 msgr2=0x7f5a6c134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a70fc0700 1 --2- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a6c134a50 0x7f5a6c134ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f5a6c0a5cc0 tx=0x7f5a64008c60).stop 2020-02-11T16:17:56.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a70fc0700 1 -- 172.21.15.88:0/2411911069 shutdown_connections 2020-02-11T16:17:56.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a70fc0700 1 --2- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a6c134a50 0x7f5a6c134ee0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a70fc0700 1 --2- 172.21.15.88:0/2411911069 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:56.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a70fc0700 1 -- 172.21.15.88:0/2411911069 >> 172.21.15.88:0/2411911069 conn(0x7f5a6c09d110 msgr2=0x7f5a6c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:56.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a70fc0700 1 -- 172.21.15.88:0/2411911069 shutdown_connections 2020-02-11T16:17:56.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.679+0000 7f5a70fc0700 1 -- 172.21.15.88:0/2411911069 wait complete. 2020-02-11T16:17:56.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.680+0000 7f5a70fc0700 1 Processor -- start 2020-02-11T16:17:56.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.680+0000 7f5a70fc0700 1 -- start start 2020-02-11T16:17:56.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a70fc0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a70fc0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a6c134a50 0x7f5a6c136060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a70fc0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c138500 con 0x7f5a6c0a18a0 2020-02-11T16:17:56.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a70fc0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c137620 con 0x7f5a6c134a50 2020-02-11T16:17:56.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a70fc0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c1387a0 con 0x7f5a6c0a5de0 2020-02-11T16:17:56.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a6ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a6c134a50 0x7f5a6c136060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:50850/0 (socket says 172.21.15.88:50850) 2020-02-11T16:17:56.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 -- 172.21.15.88:0/3906353310 learned_addr learned my addr 172.21.15.88:0/3906353310 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:56.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 -- 172.21.15.88:0/3906353310 >> v2:172.21.15.52:3300/0 conn(0x7f5a6c134a50 msgr2=0x7f5a6c136060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 --2- 172.21.15.88:0/3906353310 >> v2:172.21.15.52:3300/0 conn(0x7f5a6c134a50 0x7f5a6c136060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 -- 172.21.15.88:0/3906353310 >> v1:172.21.15.52:6789/0 conn(0x7f5a6c0a18a0 legacy=0x7f5a6c136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 -- 172.21.15.88:0/3906353310 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c135bc0 con 0x7f5a6c0a5de0 2020-02-11T16:17:56.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a6ad9d700 1 --2- 172.21.15.88:0/3906353310 >> v2:172.21.15.52:3300/0 conn(0x7f5a6c134a50 0x7f5a6c136060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:17:56.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a5c002ef0 tx=0x7f5a5c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a5c002ef0 tx=0x7f5a5c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f5a5c002ef0 tx=0x7f5a5c010ec0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a69d9b700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f5a5c002ef0 tx=0x7f5a5c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a69d9b700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f5a5c002ef0 tx=0x7f5a5c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.681+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a5c007540 con 0x7f5a6c0a5de0 2020-02-11T16:17:56.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a69d9b700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f5a5c002ef0 tx=0x7f5a5c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c0059c0 con 0x7f5a6c0a5de0 2020-02-11T16:17:56.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a5c005da0 con 0x7f5a6c0a5de0 2020-02-11T16:17:56.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a70fc0700 1 -- 172.21.15.88:0/3906353310 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c138060 con 0x7f5a6c0a5de0 2020-02-11T16:17:56.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a70fc0700 1 -- 172.21.15.88:0/3906353310 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c131a60 con 0x7f5a6c0a5de0 2020-02-11T16:17:56.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a69d9b700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f5a5c002ef0 tx=0x7f5a5c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5a5c010180 con 0x7f5a6c0a5de0 2020-02-11T16:17:56.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a69d9b700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f5a5c002ef0 tx=0x7f5a5c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a70fc0700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 0x7f5a6c12b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.682+0000 7f5a70fc0700 1 -- 172.21.15.88:0/3906353310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c05e2f0 con 0x7f5a6c12a850 2020-02-11T16:17:56.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a5b7fe700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a48039d30 0x7f5a4803c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 0x7f5a6c12b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5a5c049cc0 con 0x7f5a6c0a5de0 2020-02-11T16:17:56.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a6ad9d700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a48039d30 0x7f5a4803c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a6a59c700 1 -- 172.21.15.88:0/3906353310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a6c138370 con 0x7f5a6c12a850 2020-02-11T16:17:56.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 0x7f5a6c12b300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 0x7f5a6c12b300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 0x7f5a6c12b300 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a6ad9d700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a48039d30 0x7f5a4803c1f0 crc :-1 s=READY pgs=317 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 0x7f5a6c12b300 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a60005cc0 con 0x7f5a6c12a850 2020-02-11T16:17:56.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 0x7f5a6c12b300 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5a60005e20 con 0x7f5a6c12a850 2020-02-11T16:17:56.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 msgr2=0x7f5a6c12b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a5b7fe700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 0x7f5a6c12b300 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).stop 2020-02-11T16:17:56.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 msgr2=0x7f5a6c12b300 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:56.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.683+0000 7f5a5b7fe700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12a850 0x7f5a6c12b300 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).stop 2020-02-11T16:17:56.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.691+0000 7f5a70fc0700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 0x7f5a6c12c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.691+0000 7f5a70fc0700 1 -- 172.21.15.88:0/3906353310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c1388e0 con 0x7f5a6c12c090 2020-02-11T16:17:56.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 0x7f5a6c12c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a6a59c700 1 -- 172.21.15.88:0/3906353310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5a6c135d50 con 0x7f5a6c12c090 2020-02-11T16:17:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 0x7f5a6c12c4a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 0x7f5a6c12c4a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 0x7f5a6c12c4a0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 0x7f5a6c12c4a0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a60008650 con 0x7f5a6c12c090 2020-02-11T16:17:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a6a59c700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 0x7f5a6c12c4a0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f5a600087b0 con 0x7f5a6c12c090 2020-02-11T16:17:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 msgr2=0x7f5a6c12c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a5b7fe700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 0x7f5a6c12c4a0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).stop 2020-02-11T16:17:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a5b7fe700 1 -- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 msgr2=0x7f5a6c12c4a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.692+0000 7f5a5b7fe700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6c12c090 0x7f5a6c12c4a0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0x7f5a6c138ff0 tx=0x7f5a60010860).stop 2020-02-11T16:17:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.693+0000 7f5a70fc0700 1 -- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a48039d30 msgr2=0x7f5a4803c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.693+0000 7f5a70fc0700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a48039d30 0x7f5a4803c1f0 crc :-1 s=READY pgs=317 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.693+0000 7f5a70fc0700 1 -- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 msgr2=0x7f5a6c12daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.693+0000 7f5a70fc0700 1 --2- 172.21.15.88:0/3906353310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a6c0a5de0 0x7f5a6c12daa0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f5a5c002ef0 tx=0x7f5a5c010ec0).stop 2020-02-11T16:17:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.693+0000 7f5a6ad9d700 1 -- 172.21.15.88:0/3906353310 reap_dead start 2020-02-11T16:17:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.693+0000 7f5a6ad9d700 1 -- 172.21.15.88:0/3906353310 reap_dead start 2020-02-11T16:17:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.693+0000 7f5a70fc0700 1 -- 172.21.15.88:0/3906353310 shutdown_connections 2020-02-11T16:17:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.693+0000 7f5a70fc0700 1 -- 172.21.15.88:0/3906353310 >> 172.21.15.88:0/3906353310 conn(0x7f5a6c09d110 msgr2=0x7f5a6c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:56.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.693+0000 7f5a70fc0700 1 -- 172.21.15.88:0/3906353310 shutdown_connections 2020-02-11T16:17:56.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.693+0000 7f5a70fc0700 1 -- 172.21.15.88:0/3906353310 wait complete. 2020-02-11T16:17:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:17:56.712 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:56.712 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:56.712 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:17:56.712 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 102, 2020-02-11T16:17:56.713 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:17:56.713 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:17:56.713 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:17:56.713 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:17:56.713 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.713 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:17:56.713 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:56.714 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:17:56.714 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:17:56.714 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:56.714 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:56.714 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:56.714 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:56.714 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:56.715 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:56.715 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.715 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:17:56.715 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:17:56.715 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:56.715 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:56.715 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:56.716 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:56.716 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:56.716 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:56.716 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.716 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:17:56.716 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:17:56.716 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:17:56.717 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:17:56.717 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:17:56.717 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:17:56.717 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:56.717 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:56.717 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:17:56.717 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:17:56.718 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:56.718 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:17:56.718 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:56.718 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:56.718 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:56.718 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:56.718 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:56.719 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:56.719 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.719 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:17:56.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.720 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:17:56.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.720 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:17:56.720 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:17:56.720 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:56.720 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:56.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.721 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:56.721 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:17:56.721 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.721 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:56.721 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:17:56.721 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.722 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.722 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:17:56.722 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:17:56.722 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:56.722 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:56.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.723 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:56.723 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:56.723 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:56.723 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:56.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.724 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:56.724 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:17:56.724 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.724 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:56.724 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:17:56.725 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.725 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.725 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.725 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:17:56.725 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:17:56.725 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:56.726 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:56.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.726 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:56.726 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:56.726 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:56.726 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:56.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.727 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:56.727 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:17:56.727 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.727 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:56.727 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:17:56.728 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.728 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.728 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.728 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:17:56.728 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:17:56.728 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:56.729 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:56.729 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.729 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.729 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:17:56.730 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:17:56.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.730 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:56.730 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:56.730 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:56.730 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.730 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.731 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:17:56.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.731 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:56.731 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:56.731 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:56.731 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.731 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.732 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:17:56.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.732 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:56.732 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:56.732 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:17:56.732 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.732 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.733 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:17:56.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.733 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:56.733 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:56.733 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:17:56.733 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.733 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.733 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:17:56.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.734 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:56.734 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:56.734 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:56.734 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.734 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.734 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:17:56.735 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:17:56.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.839+0000 7f4e126a7700 1 Processor -- start 2020-02-11T16:17:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.839+0000 7f4e126a7700 1 -- start start 2020-02-11T16:17:56.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.839+0000 7f4e126a7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e0c0ad380 0x7f4e0c0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:56.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e126a7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c13bfe0 con 0x7f4e0c138280 2020-02-11T16:17:56.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e126a7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c0adb40 con 0x7f4e0c138710 2020-02-11T16:17:56.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e126a7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c137bf0 con 0x7f4e0c0ad380 2020-02-11T16:17:56.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e10c44700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4e0c138710 0x7f4e0c13b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44166/0 (socket says 172.21.15.88:44166) 2020-02-11T16:17:56.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e10c44700 1 -- 172.21.15.88:0/2725952077 learned_addr learned my addr 172.21.15.88:0/2725952077 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:56.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/2725952077 >> v2:172.21.15.52:3300/0 conn(0x7f4e0c0ad380 0x7f4e0c0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0affd700 1 -- 172.21.15.88:0/2725952077 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156311296 0 0) 0x7f4e0c0adb40 con 0x7f4e0c138710 2020-02-11T16:17:56.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0affd700 1 -- 172.21.15.88:0/2725952077 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4df8003230 con 0x7f4e0c138710 2020-02-11T16:17:56.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0affd700 1 -- 172.21.15.88:0/2725952077 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712290654 0 0) 0x7f4e0c13bfe0 con 0x7f4e0c138280 2020-02-11T16:17:56.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0affd700 1 -- 172.21.15.88:0/2725952077 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e0c0adb40 con 0x7f4e0c138280 2020-02-11T16:17:56.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0affd700 1 -- 172.21.15.88:0/2725952077 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2820705141 0 0) 0x7f4df8003230 con 0x7f4e0c138710 2020-02-11T16:17:56.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0bfff700 1 -- 172.21.15.88:0/2725952077 >> v1:172.21.15.88:6789/0 conn(0x7f4e0c138710 legacy=0x7f4e0c13b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0bfff700 1 -- 172.21.15.88:0/2725952077 >> v1:172.21.15.52:6789/0 conn(0x7f4e0c138280 legacy=0x7f4e0c13b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0bfff700 1 -- 172.21.15.88:0/2725952077 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c137de0 con 0x7f4e0c0ad380 2020-02-11T16:17:56.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/2725952077 >> v2:172.21.15.52:3300/0 conn(0x7f4e0c0ad380 0x7f4e0c0a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e04001450 tx=0x7f4dfc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/2725952077 >> v2:172.21.15.52:3300/0 conn(0x7f4e0c0ad380 0x7f4e0c0a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e04001450 tx=0x7f4dfc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/2725952077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c0ad380 0x7f4e0c0a9130 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0088e0).ready entity=mon.0 client_cookie=60e3055f2d60d616 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/2725952077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c0ad380 0x7f4e0c0a9130 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0affd700 1 -- 172.21.15.88:0/2725952077 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e04001a50 con 0x7f4e0c0ad380 2020-02-11T16:17:56.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/2725952077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c0ad380 0x7f4e0c0a9130 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.840+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/2725952077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c0ad380 0x7f4e0c0a9130 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.841+0000 7f4e0affd700 1 -- 172.21.15.88:0/2725952077 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc011210 con 0x7f4e0c0ad380 2020-02-11T16:17:56.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.841+0000 7f4e0affd700 1 -- 172.21.15.88:0/2725952077 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dfc011570 con 0x7f4e0c0ad380 2020-02-11T16:17:56.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.841+0000 7f4e126a7700 1 -- 172.21.15.88:0/2725952077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c0ad380 msgr2=0x7f4e0c0a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.841+0000 7f4e126a7700 1 --2- 172.21.15.88:0/2725952077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c0ad380 0x7f4e0c0a9130 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0088e0).stop 2020-02-11T16:17:56.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.841+0000 7f4e126a7700 1 -- 172.21.15.88:0/2725952077 shutdown_connections 2020-02-11T16:17:56.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.841+0000 7f4e126a7700 1 --2- 172.21.15.88:0/2725952077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c0ad380 0x7f4e0c0a9130 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.841+0000 7f4e126a7700 1 -- 172.21.15.88:0/2725952077 >> 172.21.15.88:0/2725952077 conn(0x7f4e0c05ac70 msgr2=0x7f4e0c0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:56.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.841+0000 7f4e126a7700 1 -- 172.21.15.88:0/2725952077 shutdown_connections 2020-02-11T16:17:56.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.841+0000 7f4e126a7700 1 -- 172.21.15.88:0/2725952077 wait complete. 2020-02-11T16:17:56.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.842+0000 7f4e126a7700 1 Processor -- start 2020-02-11T16:17:56.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.842+0000 7f4e126a7700 1 -- start start 2020-02-11T16:17:56.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e126a7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e0c0ad380 0x7f4e0c133060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e126a7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e0c138710 0x7f4e0c12b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e126a7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c0a7240 con 0x7f4e0c138280 2020-02-11T16:17:56.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e126a7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c0a74e0 con 0x7f4e0c138710 2020-02-11T16:17:56.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e126a7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0a7780 con 0x7f4e0c0ad380 2020-02-11T16:17:56.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e0c138710 0x7f4e0c12b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e0c138710 0x7f4e0c12b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56546/0 (socket says 172.21.15.88:56546) 2020-02-11T16:17:56.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 -- 172.21.15.88:0/1399910514 learned_addr learned my addr 172.21.15.88:0/1399910514 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:56.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e0c0ad380 0x7f4e0c133060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 -- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e0c0ad380 msgr2=0x7f4e0c133060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e0c0ad380 0x7f4e0c133060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 -- 172.21.15.88:0/1399910514 >> v1:172.21.15.52:6789/0 conn(0x7f4e0c138280 legacy=0x7f4e0c0a6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 -- 172.21.15.88:0/1399910514 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c134e10 con 0x7f4e0c138710 2020-02-11T16:17:56.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 --2- 172.21.15.88:0/1399910514 >> v2:172.21.15.88:3300/0 conn(0x7f4e0c138710 0x7f4e0c12b6d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e0c12fda0 tx=0x7f4e0400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 --2- 172.21.15.88:0/1399910514 >> v2:172.21.15.88:3300/0 conn(0x7f4e0c138710 0x7f4e0c12b6d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e0c12fda0 tx=0x7f4e0400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e0c138710 0x7f4e0c12b6d0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f4e0c12fda0 tx=0x7f4e0400c880).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e0c138710 0x7f4e0c12b6d0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f4e0c12fda0 tx=0x7f4e0400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e0c138710 0x7f4e0c12b6d0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f4e0c12fda0 tx=0x7f4e0400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e04012e00 con 0x7f4e0c138710 2020-02-11T16:17:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e10c44700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e0c138710 0x7f4e0c12b6d0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f4e0c12fda0 tx=0x7f4e0400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0400c8f0 con 0x7f4e0c138710 2020-02-11T16:17:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e126a7700 1 -- 172.21.15.88:0/1399910514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c12fe70 con 0x7f4e0c138710 2020-02-11T16:17:56.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0400ccd0 con 0x7f4e0c138710 2020-02-11T16:17:56.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.843+0000 7f4e126a7700 1 -- 172.21.15.88:0/1399910514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c12fa80 con 0x7f4e0c138710 2020-02-11T16:17:56.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.844+0000 7f4e10c44700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e0c138710 0x7f4e0c12b6d0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f4e0c12fda0 tx=0x7f4e0400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.844+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4e04004870 con 0x7f4e0c138710 2020-02-11T16:17:56.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.844+0000 7f4e10c44700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e0c138710 0x7f4e0c12b6d0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f4e0c12fda0 tx=0x7f4e0400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.844+0000 7f4e126a7700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 0x7f4e0c136b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.844+0000 7f4e126a7700 1 -- 172.21.15.88:0/1399910514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c05e2f0 con 0x7f4e0c12bb30 2020-02-11T16:17:56.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.844+0000 7f4e097fa700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4dec039ca0 0x7f4dec03c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.844+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4e04049c30 con 0x7f4e0c138710 2020-02-11T16:17:56.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.844+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 0x7f4e0c136b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.844+0000 7f4e0b7fe700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4dec039ca0 0x7f4dec03c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e0bfff700 1 -- 172.21.15.88:0/1399910514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e0c0a70c0 con 0x7f4e0c12bb30 2020-02-11T16:17:56.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 0x7f4e0c136b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 0x7f4e0c136b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 0x7f4e0c136b70 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e0b7fe700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4dec039ca0 0x7f4dec03c160 crc :-1 s=READY pgs=318 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 0x7f4e0c136b70 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dfc007bd0 con 0x7f4e0c12bb30 2020-02-11T16:17:56.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 0x7f4e0c136b70 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f4dfc00f830 con 0x7f4e0c12bb30 2020-02-11T16:17:56.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 msgr2=0x7f4e0c136b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e097fa700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 0x7f4e0c136b70 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).stop 2020-02-11T16:17:56.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 msgr2=0x7f4e0c136b70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:56.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.845+0000 7f4e097fa700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12bb30 0x7f4e0c136b70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.853+0000 7f4e126a7700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 0x7f4e0c12c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:56.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.853+0000 7f4e126a7700 1 -- 172.21.15.88:0/1399910514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0565b0 con 0x7f4e0c12c4b0 2020-02-11T16:17:56.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.853+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 0x7f4e0c12c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:56.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e0bfff700 1 -- 172.21.15.88:0/1399910514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4e0c05ccb0 con 0x7f4e0c12c4b0 2020-02-11T16:17:56.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 0x7f4e0c12c8c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 0x7f4e0c12c8c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 0x7f4e0c12c8c0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:56.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 0x7f4e0c12c8c0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dfc005cc0 con 0x7f4e0c12c4b0 2020-02-11T16:17:56.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e0bfff700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 0x7f4e0c12c8c0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:56.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3853 (secure 0 0 0) 0x7f4dfc005e20 con 0x7f4e0c12c4b0 2020-02-11T16:17:56.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 msgr2=0x7f4e0c12c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e097fa700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 0x7f4e0c12c8c0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f4e04001450 tx=0x7f4dfc0111b0).stop 2020-02-11T16:17:56.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e097fa700 1 -- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 msgr2=0x7f4e0c12c8c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:56.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.854+0000 7f4e097fa700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e0c12c4b0 0x7f4e0c12c8c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e126a7700 1 -- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4dec039ca0 msgr2=0x7f4dec03c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e126a7700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4dec039ca0 0x7f4dec03c160 crc :-1 s=READY pgs=318 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e126a7700 1 -- 172.21.15.88:0/1399910514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e0c138710 msgr2=0x7f4e0c12b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:56.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e126a7700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e0c138710 0x7f4e0c12b6d0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f4e0c12fda0 tx=0x7f4e0400c880).stop 2020-02-11T16:17:56.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e10c44700 1 -- 172.21.15.88:0/1399910514 reap_dead start 2020-02-11T16:17:56.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e10c44700 1 -- 172.21.15.88:0/1399910514 reap_dead start 2020-02-11T16:17:56.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e126a7700 1 -- 172.21.15.88:0/1399910514 shutdown_connections 2020-02-11T16:17:56.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e126a7700 1 --2- 172.21.15.88:0/1399910514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e0c138710 0x7f4e0c12b6d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:56.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e126a7700 1 -- 172.21.15.88:0/1399910514 >> 172.21.15.88:0/1399910514 conn(0x7f4e0c05ac70 msgr2=0x7f4e0c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:56.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e126a7700 1 -- 172.21.15.88:0/1399910514 shutdown_connections 2020-02-11T16:17:56.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:56.855+0000 7f4e126a7700 1 -- 172.21.15.88:0/1399910514 wait complete. 2020-02-11T16:17:56.872 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:17:56.872 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:17:56.872 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:17:56.872 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:17:56.872 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 102, 2020-02-11T16:17:56.872 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:17:56.873 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:17:56.873 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:17:56.873 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:17:56.873 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.873 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:17:56.873 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:56.874 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:17:56.874 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:17:56.874 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:56.881 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:56.882 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:56.882 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:56.882 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:56.882 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:56.882 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.882 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:17:56.882 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:17:56.883 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:56.883 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:56.883 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:56.883 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:56.883 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:56.883 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:56.883 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.884 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:17:56.884 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:17:56.884 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:17:56.884 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:17:56.884 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:17:56.884 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:17:56.884 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:17:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:17:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:17:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:56.885 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:17:56.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:17:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:17:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:17:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:56.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:17:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:56.888 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:17:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:17:56.889 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:17:56.890 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:56.890 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:56.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.890 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:56.891 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:56.891 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:56.891 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:56.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.891 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:56.891 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:17:56.892 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.892 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:56.892 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:17:56.892 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.892 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.893 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.893 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:17:56.893 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:17:56.893 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:56.893 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:56.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.894 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:56.894 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:56.894 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:56.894 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:56.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.894 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:56.895 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:17:56.895 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.895 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:56.895 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:17:56.895 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:56.895 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.896 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.896 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:17:56.896 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:17:56.896 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:56.896 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:56.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.897 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:56.897 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:17:56.897 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:17:56.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.898 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:56.898 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:56.898 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:56.899 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.899 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:56.899 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:17:56.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:56.899 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:56.900 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:56.900 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:56.901 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.901 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:56.901 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:56.902 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:17:56.902 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:17:57.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.007+0000 7f75e0c17700 1 Processor -- start 2020-02-11T16:17:57.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.007+0000 7f75e0c17700 1 -- start start 2020-02-11T16:17:57.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75e0c17700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75dc0a5de0 0x7f75dc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:57.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75e0c17700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc0a31b0 con 0x7f75dc134a50 2020-02-11T16:17:57.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75e0c17700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc0a3570 con 0x7f75dc0a18a0 2020-02-11T16:17:57.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75e0c17700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75dc0a3810 con 0x7f75dc0a5de0 2020-02-11T16:17:57.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75d9d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75dc0a5de0 0x7f75dc0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75d9d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75dc0a5de0 0x7f75dc0a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56556/0 (socket says 172.21.15.88:56556) 2020-02-11T16:17:57.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75d9d9b700 1 -- 172.21.15.88:0/928265694 learned_addr learned my addr 172.21.15.88:0/928265694 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:57.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75da59c700 1 --1- 172.21.15.88:0/928265694 >> v1:172.21.15.88:6789/0 conn(0x7f75dc0a18a0 0x7f75dc0a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44180/0 (socket says 172.21.15.88:44180) 2020-02-11T16:17:57.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75d9d9b700 1 -- 172.21.15.88:0/928265694 >> v1:172.21.15.88:6789/0 conn(0x7f75dc0a18a0 legacy=0x7f75dc0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75d9d9b700 1 -- 172.21.15.88:0/928265694 >> v1:172.21.15.52:6789/0 conn(0x7f75dc134a50 legacy=0x7f75dc134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75d9d9b700 1 -- 172.21.15.88:0/928265694 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc0a3ab0 con 0x7f75dc0a5de0 2020-02-11T16:17:57.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75d9d9b700 1 --2- 172.21.15.88:0/928265694 >> v2:172.21.15.88:3300/0 conn(0x7f75dc0a5de0 0x7f75dc0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f75cc002f30 tx=0x7f75cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75d9d9b700 1 --2- 172.21.15.88:0/928265694 >> v2:172.21.15.88:3300/0 conn(0x7f75dc0a5de0 0x7f75dc0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f75cc002f30 tx=0x7f75cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.008+0000 7f75d9d9b700 1 --2- 172.21.15.88:0/928265694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75dc0a5de0 0x7f75dc0a6260 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f75cc002f30 tx=0x7f75cc0088e0).ready entity=mon.1 client_cookie=c7cc232cb7054dcb server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:57.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75d9d9b700 1 --2- 172.21.15.88:0/928265694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75dc0a5de0 0x7f75dc0a6260 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f75cc002f30 tx=0x7f75cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75d9d9b700 1 --2- 172.21.15.88:0/928265694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75dc0a5de0 0x7f75dc0a6260 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f75cc002f30 tx=0x7f75cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75d959a700 1 -- 172.21.15.88:0/928265694 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75cc011760 con 0x7f75dc0a5de0 2020-02-11T16:17:57.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75d9d9b700 1 --2- 172.21.15.88:0/928265694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75dc0a5de0 0x7f75dc0a6260 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f75cc002f30 tx=0x7f75cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75d959a700 1 -- 172.21.15.88:0/928265694 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc0118c0 con 0x7f75dc0a5de0 2020-02-11T16:17:57.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75d959a700 1 -- 172.21.15.88:0/928265694 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75cc011ca0 con 0x7f75dc0a5de0 2020-02-11T16:17:57.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75e0c17700 1 -- 172.21.15.88:0/928265694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75dc0a5de0 msgr2=0x7f75dc0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75e0c17700 1 --2- 172.21.15.88:0/928265694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75dc0a5de0 0x7f75dc0a6260 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f75cc002f30 tx=0x7f75cc0088e0).stop 2020-02-11T16:17:57.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75e0c17700 1 -- 172.21.15.88:0/928265694 shutdown_connections 2020-02-11T16:17:57.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75e0c17700 1 --2- 172.21.15.88:0/928265694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75dc0a5de0 0x7f75dc0a6260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:57.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75e0c17700 1 -- 172.21.15.88:0/928265694 >> 172.21.15.88:0/928265694 conn(0x7f75dc09d110 msgr2=0x7f75dc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:57.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75e0c17700 1 -- 172.21.15.88:0/928265694 shutdown_connections 2020-02-11T16:17:57.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.009+0000 7f75e0c17700 1 -- 172.21.15.88:0/928265694 wait complete. 2020-02-11T16:17:57.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.010+0000 7f75e0c17700 1 Processor -- start 2020-02-11T16:17:57.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.010+0000 7f75e0c17700 1 -- start start 2020-02-11T16:17:57.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75e0c17700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0a18a0 0x7f75dc1263a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:57.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75e0c17700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75dc134a50 0x7f75dc126800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:57.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75e0c17700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc131d80 con 0x7f75dc0a5de0 2020-02-11T16:17:57.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75e0c17700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75dc12fce0 con 0x7f75dc134a50 2020-02-11T16:17:57.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75e0c17700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc12ff80 con 0x7f75dc0a18a0 2020-02-11T16:17:57.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75dad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75dc134a50 0x7f75dc126800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75da59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0a18a0 0x7f75dc1263a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75d9d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f75dc0a5de0 0x7f75dc065cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:35970/0 (socket says 172.21.15.88:35970) 2020-02-11T16:17:57.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75d9d9b700 1 -- 172.21.15.88:0/2714063256 learned_addr learned my addr 172.21.15.88:0/2714063256 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:57.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75dad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75dc134a50 0x7f75dc126800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:42550/0 (socket says 172.21.15.88:42550) 2020-02-11T16:17:57.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75dad9d700 1 -- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0a18a0 msgr2=0x7f75dc1263a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75dad9d700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0a18a0 0x7f75dc1263a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:57.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75dad9d700 1 -- 172.21.15.88:0/2714063256 >> v1:172.21.15.52:6789/0 conn(0x7f75dc0a5de0 legacy=0x7f75dc065cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087509711 0 0) 0x7f75dc0a3ab0 con 0x7f75dc0a5de0 2020-02-11T16:17:57.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75dad9d700 1 -- 172.21.15.88:0/2714063256 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc130220 con 0x7f75dc134a50 2020-02-11T16:17:57.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75dad9d700 1 --2- 172.21.15.88:0/2714063256 >> v2:172.21.15.52:3300/0 conn(0x7f75dc134a50 0x7f75dc126800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75dc05bbc0 tx=0x7f75d4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75dad9d700 1 --2- 172.21.15.88:0/2714063256 >> v2:172.21.15.52:3300/0 conn(0x7f75dc134a50 0x7f75dc126800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75dc05bbc0 tx=0x7f75d4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.011+0000 7f75dad9d700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75dc134a50 0x7f75dc126800 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f75dc05bbc0 tx=0x7f75d4010ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:57.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.012+0000 7f75dad9d700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75dc134a50 0x7f75dc126800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f75dc05bbc0 tx=0x7f75d4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.012+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d4012240 con 0x7f75dc134a50 2020-02-11T16:17:57.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.012+0000 7f75dad9d700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75dc134a50 0x7f75dc126800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f75dc05bbc0 tx=0x7f75d4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.012+0000 7f75dad9d700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75dc134a50 0x7f75dc126800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f75dc05bbc0 tx=0x7f75d4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.012+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d40123a0 con 0x7f75dc134a50 2020-02-11T16:17:57.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.012+0000 7f75e0c17700 1 -- 172.21.15.88:0/2714063256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc126c60 con 0x7f75dc134a50 2020-02-11T16:17:57.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.012+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d40127c0 con 0x7f75dc134a50 2020-02-11T16:17:57.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.012+0000 7f75e0c17700 1 -- 172.21.15.88:0/2714063256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc0657c0 con 0x7f75dc134a50 2020-02-11T16:17:57.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.012+0000 7f75dad9d700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75dc134a50 0x7f75dc126800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f75dc05bbc0 tx=0x7f75d4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.012+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f75d4012a80 con 0x7f75dc134a50 2020-02-11T16:17:57.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75dad9d700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75dc134a50 0x7f75dc126800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f75dc05bbc0 tx=0x7f75d4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75e0c17700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 0x7f75dc0a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:57.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75e0c17700 1 -- 172.21.15.88:0/2714063256 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc05e2f0 con 0x7f75dc0663e0 2020-02-11T16:17:57.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75cb7fe700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b8039ab0 0x7f75b803bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:57.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 0x7f75dc0a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f75d404a010 con 0x7f75dc134a50 2020-02-11T16:17:57.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75d9d9b700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b8039ab0 0x7f75b803bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75da59c700 1 -- 172.21.15.88:0/2714063256 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75dc1303b0 con 0x7f75dc0663e0 2020-02-11T16:17:57.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 0x7f75dc0a5220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d000c500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 0x7f75dc0a5220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d000c500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 0x7f75dc0a5220 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d000c500).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:57.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75d9d9b700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b8039ab0 0x7f75b803bf70 crc :-1 s=READY pgs=319 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:57.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 0x7f75dc0a5220 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d000c500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.013+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d000c950 con 0x7f75dc0663e0 2020-02-11T16:17:57.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.014+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 0x7f75dc0a5220 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d000c500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.014+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f75d000cab0 con 0x7f75dc0663e0 2020-02-11T16:17:57.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.014+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 msgr2=0x7f75dc0a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.014+0000 7f75cb7fe700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 0x7f75dc0a5220 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d000c500).stop 2020-02-11T16:17:57.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.014+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 msgr2=0x7f75dc0a5220 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:57.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.014+0000 7f75cb7fe700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc0663e0 0x7f75dc0a5220 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d000c500).stop 2020-02-11T16:17:57.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.022+0000 7f75e0c17700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 0x7f75dc12c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:57.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.022+0000 7f75e0c17700 1 -- 172.21.15.88:0/2714063256 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc065610 con 0x7f75dc12c090 2020-02-11T16:17:57.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.022+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 0x7f75dc12c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.022+0000 7f75da59c700 1 -- 172.21.15.88:0/2714063256 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f75dc0565b0 con 0x7f75dc12c090 2020-02-11T16:17:57.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.022+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 0x7f75dc12c4a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d00121b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.022+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 0x7f75dc12c4a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d00121b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.022+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 0x7f75dc12c4a0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d00121b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.022+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 0x7f75dc12c4a0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d00121b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.022+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d0012a90 con 0x7f75dc12c090 2020-02-11T16:17:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75da59c700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 0x7f75dc12c4a0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d00121b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f75d0012bf0 con 0x7f75dc12c090 2020-02-11T16:17:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 msgr2=0x7f75dc12c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75cb7fe700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 0x7f75dc12c4a0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d00121b0).stop 2020-02-11T16:17:57.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75cb7fe700 1 -- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 msgr2=0x7f75dc12c4a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:17:57.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75cb7fe700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75dc12c090 0x7f75dc12c4a0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0x7f75dc0a5cc0 tx=0x7f75d00121b0).stop 2020-02-11T16:17:57.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75e0c17700 1 -- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b8039ab0 msgr2=0x7f75b803bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75e0c17700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b8039ab0 0x7f75b803bf70 crc :-1 s=READY pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:57.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75e0c17700 1 -- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75dc134a50 msgr2=0x7f75dc126800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75e0c17700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75dc134a50 0x7f75dc126800 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f75dc05bbc0 tx=0x7f75d4010ba0).stop 2020-02-11T16:17:57.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75dad9d700 1 -- 172.21.15.88:0/2714063256 reap_dead start 2020-02-11T16:17:57.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75dad9d700 1 -- 172.21.15.88:0/2714063256 reap_dead start 2020-02-11T16:17:57.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75e0c17700 1 -- 172.21.15.88:0/2714063256 shutdown_connections 2020-02-11T16:17:57.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75e0c17700 1 --2- 172.21.15.88:0/2714063256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75dc134a50 0x7f75dc126800 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:57.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75e0c17700 1 -- 172.21.15.88:0/2714063256 >> 172.21.15.88:0/2714063256 conn(0x7f75dc09d110 msgr2=0x7f75dc12e310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:57.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75e0c17700 1 -- 172.21.15.88:0/2714063256 shutdown_connections 2020-02-11T16:17:57.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.023+0000 7f75e0c17700 1 -- 172.21.15.88:0/2714063256 wait complete. 2020-02-11T16:17:57.037 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:17:57.037 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:57.037 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:57.037 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:17:57.038 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 102, 2020-02-11T16:17:57.038 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:17:57.038 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:17:57.038 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:17:57.038 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:17:57.039 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:57.039 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:17:57.039 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:57.039 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:17:57.039 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:17:57.039 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:57.039 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:57.040 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:57.040 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:57.040 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:57.040 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:57.040 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:57.040 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:17:57.040 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:17:57.040 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:57.041 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:57.041 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:57.041 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:57.041 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:57.041 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:57.041 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:57.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.042 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:17:57.042 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:17:57.042 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:17:57.042 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:17:57.042 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:17:57.042 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:17:57.042 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:57.043 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:17:57.043 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:17:57.043 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:17:57.043 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:17:57.043 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:17:57.044 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:17:57.044 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:17:57.044 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:17:57.044 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:17:57.044 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:17:57.044 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:17:57.044 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:57.045 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:17:57.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.045 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:17:57.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.045 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:17:57.045 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:17:57.045 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:57.046 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:57.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.046 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:57.046 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:17:57.046 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:57.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.046 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:57.047 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:17:57.047 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:57.047 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:57.047 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:57.047 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.048 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:17:57.048 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:17:57.048 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:57.048 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:57.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.048 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.048 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:17:57.049 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:17:57.049 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:57.049 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:57.049 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.049 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:57.049 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:17:57.049 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:57.050 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.050 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:57.050 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:17:57.050 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:57.050 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:57.050 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:57.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.051 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:17:57.051 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:17:57.051 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:57.051 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:57.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.051 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:17:57.052 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:17:57.052 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:17:57.052 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:17:57.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.052 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:17:57.052 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:17:57.052 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:57.053 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.053 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.053 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:17:57.053 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:17:57.053 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:17:57.054 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:57.054 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:57.054 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.054 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:17:57.054 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:17:57.054 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:17:57.054 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:17:57.055 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:57.055 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:57.055 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:17:57.055 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:17:57.055 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:17:57.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.055 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:57.055 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:57.056 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:57.056 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:57.056 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:57.056 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:17:57.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.056 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:57.056 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:57.057 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:57.057 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:57.057 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:57.057 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:17:57.057 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.057 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:57.057 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:57.058 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:17:57.058 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:57.058 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:57.058 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:17:57.058 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.059 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:57.059 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:57.059 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:17:57.059 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:57.059 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:17:57.059 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:17:57.059 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:17:57.059 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:17:57.060 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:17:57.060 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:17:57.060 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:57.060 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:17:57.060 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:17:57.060 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:17:57.061 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2020-02-11T16:17:57.062 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:17:57.062 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2020-02-11T16:17:57.062 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:17:57.062 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-02-11T16:17:57.062 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:17:57.074 INFO:tasks.ceph.mon.b:Stopped 2020-02-11T16:17:57.075 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:17:57.075 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:17:57.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.177+0000 7f733c14c700 1 Processor -- start 2020-02-11T16:17:57.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.177+0000 7f733c14c700 1 -- start start 2020-02-11T16:17:57.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f733c14c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f73340a18a0 0x7f73340a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:57.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f733c14c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73340a5de0 0x7f73340a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:17:57.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f733c14c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73340a31b0 con 0x7f733412e3a0 2020-02-11T16:17:57.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f733c14c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73340a3570 con 0x7f73340a18a0 2020-02-11T16:17:57.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f733c14c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73340a3810 con 0x7f73340a5de0 2020-02-11T16:17:57.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73340a5de0 0x7f73340a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f7339ee8700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f73340a18a0 msgr2=0x7f73340a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:57.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73340a5de0 0x7f73340a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56576/0 (socket says 172.21.15.88:56576) 2020-02-11T16:17:57.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 -- 172.21.15.88:0/3331326062 learned_addr learned my addr 172.21.15.88:0/3331326062 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:17:57.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f7339ee8700 1 --2- 172.21.15.88:0/3331326062 >> v2:172.21.15.52:3300/0 conn(0x7f73340a18a0 0x7f73340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:57.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 -- 172.21.15.88:0/3331326062 >> v2:172.21.15.52:3300/0 conn(0x7f73340a18a0 msgr2=0x7f73340a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:17:57.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 --2- 172.21.15.88:0/3331326062 >> v2:172.21.15.52:3300/0 conn(0x7f73340a18a0 0x7f73340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:57.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 -- 172.21.15.88:0/3331326062 >> v1:172.21.15.88:6789/0 conn(0x7f733412e3a0 legacy=0x7f733412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 -- 172.21.15.88:0/3331326062 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73340a3ab0 con 0x7f73340a5de0 2020-02-11T16:17:57.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 --2- 172.21.15.88:0/3331326062 >> v2:172.21.15.88:3300/0 conn(0x7f73340a5de0 0x7f73340a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7330002f30 tx=0x7f7330007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 --2- 172.21.15.88:0/3331326062 >> v2:172.21.15.88:3300/0 conn(0x7f73340a5de0 0x7f73340a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7330002f30 tx=0x7f7330007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 --2- 172.21.15.88:0/3331326062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73340a5de0 0x7f73340a6260 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f7330002f30 tx=0x7f7330007a40).ready entity=mon.1 client_cookie=4b32e221c66dd5ea server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:57.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 --2- 172.21.15.88:0/3331326062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73340a5de0 0x7f73340a6260 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f7330002f30 tx=0x7f7330007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f7338ee6700 1 -- 172.21.15.88:0/3331326062 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7330008e20 con 0x7f73340a5de0 2020-02-11T16:17:57.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 --2- 172.21.15.88:0/3331326062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73340a5de0 0x7f73340a6260 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f7330002f30 tx=0x7f7330007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f73396e7700 1 --2- 172.21.15.88:0/3331326062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73340a5de0 0x7f73340a6260 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f7330002f30 tx=0x7f7330007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f7338ee6700 1 -- 172.21.15.88:0/3331326062 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7330011910 con 0x7f73340a5de0 2020-02-11T16:17:57.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f7338ee6700 1 -- 172.21.15.88:0/3331326062 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7330011cf0 con 0x7f73340a5de0 2020-02-11T16:17:57.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f733c14c700 1 -- 172.21.15.88:0/3331326062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73340a5de0 msgr2=0x7f73340a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.178+0000 7f733c14c700 1 --2- 172.21.15.88:0/3331326062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73340a5de0 0x7f73340a6260 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f7330002f30 tx=0x7f7330007a40).stop 2020-02-11T16:17:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.179+0000 7f733c14c700 1 -- 172.21.15.88:0/3331326062 shutdown_connections 2020-02-11T16:17:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.179+0000 7f733c14c700 1 --2- 172.21.15.88:0/3331326062 >> v2:172.21.15.52:3300/0 conn(0x7f73340a18a0 0x7f73340a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:17:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.179+0000 7f733c14c700 1 --2- 172.21.15.88:0/3331326062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73340a5de0 0x7f73340a6260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.179+0000 7f733c14c700 1 -- 172.21.15.88:0/3331326062 >> 172.21.15.88:0/3331326062 conn(0x7f733409d110 msgr2=0x7f733409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:57.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.179+0000 7f733c14c700 1 -- 172.21.15.88:0/3331326062 shutdown_connections 2020-02-11T16:17:57.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.179+0000 7f733c14c700 1 -- 172.21.15.88:0/3331326062 wait complete. 2020-02-11T16:17:57.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.180+0000 7f733c14c700 1 Processor -- start 2020-02-11T16:17:57.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.180+0000 7f733c14c700 1 -- start start 2020-02-11T16:17:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.180+0000 7f733c14c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f733412e3a0 0x7f733409e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.180+0000 7f733c14c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73341338c0 con 0x7f73340a18a0 2020-02-11T16:17:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.180+0000 7f733c14c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7334133b60 con 0x7f73340a5de0 2020-02-11T16:17:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.180+0000 7f733c14c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733406a280 con 0x7f733412e3a0 2020-02-11T16:17:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.180+0000 7f73396e7700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f73340a5de0 0x7f733414bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44208/0 (socket says 172.21.15.88:44208) 2020-02-11T16:17:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.180+0000 7f73396e7700 1 -- 172.21.15.88:0/841383995 learned_addr learned my addr 172.21.15.88:0/841383995 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:17:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.180+0000 7f7339ee8700 1 -- 172.21.15.88:0/841383995 >> v1:172.21.15.52:6789/0 conn(0x7f73340a18a0 legacy=0x7f7334120170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:17:57.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147184668 0 0) 0x7f7334133b60 con 0x7f73340a5de0 2020-02-11T16:17:57.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f733412e3a0 0x7f733409e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7314002fe0 con 0x7f73340a5de0 2020-02-11T16:17:57.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3901431424 0 0) 0x7f7314002fe0 con 0x7f73340a5de0 2020-02-11T16:17:57.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7334133b60 con 0x7f73340a5de0 2020-02-11T16:17:57.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f7330008e20 con 0x7f73340a5de0 2020-02-11T16:17:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f733412e3a0 msgr2=0x7f733409e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f733412e3a0 0x7f733409e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 >> v1:172.21.15.88:6789/0 conn(0x7f73340a5de0 legacy=0x7f733414bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 >> v1:172.21.15.52:6789/0 conn(0x7f73340a18a0 legacy=0x7f7334120170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:17:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73140049b0 0x7f7314004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f733412e3a0 0x7f7314005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733406a280 con 0x7f73140049b0 2020-02-11T16:17:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7314004450 con 0x7f7314003990 2020-02-11T16:17:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7314004610 con 0x7f733412e3a0 2020-02-11T16:17:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7339ee8700 1 -- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73140049b0 msgr2=0x7f7314004d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:17:57.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f7339ee8700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73140049b0 0x7f7314004d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:17:57.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f73396e7700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f733412e3a0 0x7f7314005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733a6e9700 1 -- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f733412e3a0 msgr2=0x7f7314005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f733412e3a0 0x7f7314005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:57.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733a6e9700 1 -- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73140049b0 msgr2=0x7f7314004d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:17:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73140049b0 0x7f7314004d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733a6e9700 1 -- 172.21.15.88:0/841383995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7334132870 con 0x7f7314003990 2020-02-11T16:17:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733c14c700 1 -- 172.21.15.88:0/841383995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7334122900 con 0x7f7314003990 2020-02-11T16:17:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733c14c700 1 -- 172.21.15.88:0/841383995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733409e590 con 0x7f7314003990 2020-02-11T16:17:57.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.181+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:57.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.182+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.182+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7328001e30 con 0x7f7314003990 2020-02-11T16:17:57.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.182+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.182+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.182+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73280066d0 con 0x7f7314003990 2020-02-11T16:17:57.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.182+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7328006ab0 con 0x7f7314003990 2020-02-11T16:17:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.182+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.182+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7328006c10 con 0x7f7314003990 2020-02-11T16:17:57.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.182+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.183+0000 7f7326ffd700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7314041fa0 0x7f7314044460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:17:57.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.183+0000 7f733c14c700 1 -- 172.21.15.88:0/841383995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7334134620 con 0x7f7314003990 2020-02-11T16:17:57.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.183+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7328049630 con 0x7f7314003990 2020-02-11T16:17:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.183+0000 7f7339ee8700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7314041fa0 0x7f7314044460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:17:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.183+0000 7f7339ee8700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7314041fa0 0x7f7314044460 crc :-1 s=READY pgs=320 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:17:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.186+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.186+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f732802ecf0 con 0x7f7314003990 2020-02-11T16:17:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.367+0000 7f733c14c700 1 -- 172.21.15.88:0/841383995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7334133cf0 con 0x7f7314003990 2020-02-11T16:17:57.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.367+0000 7f733a6e9700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:17:57.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.367+0000 7f7326ffd700 1 -- 172.21.15.88:0/841383995 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f73280317e0 con 0x7f7314003990 2020-02-11T16:17:57.370 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:17:57.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.368+0000 7f733c14c700 1 -- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7314041fa0 msgr2=0x7f7314044460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.368+0000 7f733c14c700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7314041fa0 0x7f7314044460 crc :-1 s=READY pgs=320 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:17:57.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.368+0000 7f733c14c700 1 -- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 msgr2=0x7f7314003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:17:57.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.368+0000 7f733c14c700 1 --2- 172.21.15.88:0/841383995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7314003990 0x7f7314003e10 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f732800c500 tx=0x7f7328010c20).stop 2020-02-11T16:17:57.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.368+0000 7f733a6e9700 1 -- 172.21.15.88:0/841383995 reap_dead start 2020-02-11T16:17:57.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.368+0000 7f733a6e9700 1 -- 172.21.15.88:0/841383995 reap_dead start 2020-02-11T16:17:57.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.368+0000 7f733c14c700 1 -- 172.21.15.88:0/841383995 shutdown_connections 2020-02-11T16:17:57.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.368+0000 7f733c14c700 1 -- 172.21.15.88:0/841383995 >> 172.21.15.88:0/841383995 conn(0x7f733409d110 msgr2=0x7f73340a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:17:57.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.368+0000 7f733c14c700 1 -- 172.21.15.88:0/841383995 shutdown_connections 2020-02-11T16:17:57.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:17:57.368+0000 7f733c14c700 1 -- 172.21.15.88:0/841383995 wait complete. 2020-02-11T16:17:57.381 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":102,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:00.382 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:18:00.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.495+0000 7fb182316700 1 Processor -- start 2020-02-11T16:18:00.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.496+0000 7fb182316700 1 -- start start 2020-02-11T16:18:00.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.496+0000 7fb182316700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb17c0a18a0 0x7fb17c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:00.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.496+0000 7fb182316700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c0a31b0 con 0x7fb17c0a6260 2020-02-11T16:18:00.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.496+0000 7fb182316700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c0a3570 con 0x7fb17c0a5de0 2020-02-11T16:18:00.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.496+0000 7fb182316700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c0a3810 con 0x7fb17c0a18a0 2020-02-11T16:18:00.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.496+0000 7fb17bfff700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fb17c0a18a0 msgr2=0x7fb17c0a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:00.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.496+0000 7fb1808b3700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7fb17c0a6260 legacy=0x7fb17c12eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:18:00.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.496+0000 7fb173fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb17c0a5de0 0x7fb17c12e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44220/0 (socket says 172.21.15.88:44220) 2020-02-11T16:18:00.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.496+0000 7fb173fff700 1 -- 172.21.15.88:0/3560771807 learned_addr learned my addr 172.21.15.88:0/3560771807 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:00.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.496+0000 7fb17bfff700 1 --2- 172.21.15.88:0/3560771807 >> v2:172.21.15.52:3300/0 conn(0x7fb17c0a18a0 0x7fb17c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394856623 0 0) 0x7fb17c0a3570 con 0x7fb17c0a5de0 2020-02-11T16:18:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb15c003230 con 0x7fb17c0a5de0 2020-02-11T16:18:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1947945040 0 0) 0x7fb15c003230 con 0x7fb17c0a5de0 2020-02-11T16:18:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 >> v2:172.21.15.52:3300/0 conn(0x7fb17c0a18a0 msgr2=0x7fb17c0a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 --2- 172.21.15.88:0/3560771807 >> v2:172.21.15.52:3300/0 conn(0x7fb17c0a18a0 0x7fb17c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 >> v1:172.21.15.52:6789/0 conn(0x7fb17c0a6260 legacy=0x7fb17c12eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0a3ab0 con 0x7fb17c0a5de0 2020-02-11T16:18:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fb1640016d0 con 0x7fb17c0a5de0 2020-02-11T16:18:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 >> v1:172.21.15.88:6789/0 conn(0x7fb17c0a5de0 legacy=0x7fb17c12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 0x7fb15c003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15c003ff0 0x7fb15c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb15c004a40 0x7fb15c004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:00.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0a3810 con 0x7fb15c003ff0 2020-02-11T16:18:00.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c00b810 con 0x7fb15c003720 2020-02-11T16:18:00.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c00b9d0 con 0x7fb15c004a40 2020-02-11T16:18:00.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb173fff700 1 -- 172.21.15.88:0/3560771807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15c003ff0 msgr2=0x7fb15c0044d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb173fff700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15c003ff0 0x7fb15c0044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17bfff700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 0x7fb15c003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb1808b3700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb15c004a40 0x7fb15c004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17bfff700 1 -- 172.21.15.88:0/3560771807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb15c004a40 msgr2=0x7fb15c004ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17bfff700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb15c004a40 0x7fb15c004ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17bfff700 1 -- 172.21.15.88:0/3560771807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15c003ff0 msgr2=0x7fb15c0044d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17bfff700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15c003ff0 0x7fb15c0044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17bfff700 1 -- 172.21.15.88:0/3560771807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c003230 con 0x7fb15c003720 2020-02-11T16:18:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb1808b3700 1 -- 172.21.15.88:0/3560771807 reap_dead start 2020-02-11T16:18:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17bfff700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 0x7fb15c003b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb16c005750 tx=0x7fb16c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17bfff700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 0x7fb15c003b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb16c005750 tx=0x7fb16c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.497+0000 7fb17bfff700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 0x7fb15c003b20 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fb16c005750 tx=0x7fb16c0088e0).ready entity=mon.1 client_cookie=1319238a62747ac7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:00.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb17bfff700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 0x7fb15c003b20 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fb16c005750 tx=0x7fb16c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb16c003e10 con 0x7fb15c003720 2020-02-11T16:18:00.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb17bfff700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 0x7fb15c003b20 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fb16c005750 tx=0x7fb16c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c008950 con 0x7fb15c003720 2020-02-11T16:18:00.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb17bfff700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 0x7fb15c003b20 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fb16c005750 tx=0x7fb16c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb182316700 1 -- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 msgr2=0x7fb15c003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb17b7fe700 1 -- 172.21.15.88:0/3560771807 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb16c008d70 con 0x7fb15c003720 2020-02-11T16:18:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb182316700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 0x7fb15c003b20 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fb16c005750 tx=0x7fb16c0088e0).stop 2020-02-11T16:18:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb182316700 1 -- 172.21.15.88:0/3560771807 shutdown_connections 2020-02-11T16:18:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb182316700 1 --2- 172.21.15.88:0/3560771807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15c003720 0x7fb15c003b20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb182316700 1 -- 172.21.15.88:0/3560771807 >> 172.21.15.88:0/3560771807 conn(0x7fb17c09d110 msgr2=0x7fb17c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb182316700 1 -- 172.21.15.88:0/3560771807 shutdown_connections 2020-02-11T16:18:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.498+0000 7fb182316700 1 -- 172.21.15.88:0/3560771807 wait complete. 2020-02-11T16:18:00.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.499+0000 7fb182316700 1 Processor -- start 2020-02-11T16:18:00.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.499+0000 7fb182316700 1 -- start start 2020-02-11T16:18:00.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb182316700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb17c12d390 0x7fb17c0a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:00.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb182316700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb17c12aec0 0x7fb17c12b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:00.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb182316700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c131520 con 0x7fb15c003720 2020-02-11T16:18:00.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb182316700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c12d810 con 0x7fb17c12aec0 2020-02-11T16:18:00.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb182316700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0a0b00 con 0x7fb17c12d390 2020-02-11T16:18:00.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb17bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb15c003720 0x7fb17c09f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44232/0 (socket says 172.21.15.88:44232) 2020-02-11T16:18:00.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb17bfff700 1 -- 172.21.15.88:0/910451043 learned_addr learned my addr 172.21.15.88:0/910451043 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:00.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> v2:172.21.15.88:3300/0 conn(0x7fb17c12aec0 0x7fb17c12b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb173fff700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb17c12d390 0x7fb17c0a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 -- 172.21.15.88:0/910451043 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb17c12d390 msgr2=0x7fb17c0a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:00.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb17c12d390 0x7fb17c0a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:00.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 -- 172.21.15.88:0/910451043 >> v1:172.21.15.88:6789/0 conn(0x7fb15c003720 legacy=0x7fb17c09f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:00.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 -- 172.21.15.88:0/910451043 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0a0d70 con 0x7fb17c12aec0 2020-02-11T16:18:00.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb179ffb700 1 -- 172.21.15.88:0/910451043 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930125859 0 0) 0x7fb17c131520 con 0x7fb15c003720 2020-02-11T16:18:00.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> v2:172.21.15.88:3300/0 conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> v2:172.21.15.88:3300/0 conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:00.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb179ffb700 1 -- 172.21.15.88:0/910451043 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb174003ea0 con 0x7fb17c12aec0 2020-02-11T16:18:00.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb179ffb700 1 -- 172.21.15.88:0/910451043 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174005540 con 0x7fb17c12aec0 2020-02-11T16:18:00.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb182316700 1 -- 172.21.15.88:0/910451043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c131750 con 0x7fb17c12aec0 2020-02-11T16:18:00.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb179ffb700 1 -- 172.21.15.88:0/910451043 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1740058a0 con 0x7fb17c12aec0 2020-02-11T16:18:00.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.500+0000 7fb182316700 1 -- 172.21.15.88:0/910451043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c131bf0 con 0x7fb17c12aec0 2020-02-11T16:18:00.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.501+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.501+0000 7fb179ffb700 1 -- 172.21.15.88:0/910451043 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb17400e1f0 con 0x7fb17c12aec0 2020-02-11T16:18:00.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.501+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.501+0000 7fb179ffb700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb160039a50 0x7fb16003bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:00.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.501+0000 7fb182316700 1 -- 172.21.15.88:0/910451043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c0565b0 con 0x7fb17c12aec0 2020-02-11T16:18:00.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.501+0000 7fb179ffb700 1 -- 172.21.15.88:0/910451043 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb174049900 con 0x7fb17c12aec0 2020-02-11T16:18:00.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.502+0000 7fb17bfff700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb160039a50 0x7fb16003bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:00.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.502+0000 7fb17bfff700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb160039a50 0x7fb16003bf10 crc :-1 s=READY pgs=321 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:00.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.505+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.505+0000 7fb179ffb700 1 -- 172.21.15.88:0/910451043 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb17402ef40 con 0x7fb17c12aec0 2020-02-11T16:18:00.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.686+0000 7fb182316700 1 -- 172.21.15.88:0/910451043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb17c05ccb0 con 0x7fb17c12aec0 2020-02-11T16:18:00.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.687+0000 7fb1808b3700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:00.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.687+0000 7fb179ffb700 1 -- 172.21.15.88:0/910451043 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fb174031a50 con 0x7fb17c12aec0 2020-02-11T16:18:00.690 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:00.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 -- 172.21.15.88:0/910451043 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb160039a50 msgr2=0x7fb16003bf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:00.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb160039a50 0x7fb16003bf10 crc :-1 s=READY pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:00.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 -- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 msgr2=0x7fb17c12b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:00.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 0x7fb17c12b340 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fb17c0a5cc0 tx=0x7fb15c005480).stop 2020-02-11T16:18:00.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 -- 172.21.15.88:0/910451043 shutdown_connections 2020-02-11T16:18:00.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb160039a50 0x7fb16003bf10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:00.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb17c12aec0 0x7fb17c12b340 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:00.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 --2- 172.21.15.88:0/910451043 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb17c12d390 0x7fb17c0a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:00.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 -- 172.21.15.88:0/910451043 >> 172.21.15.88:0/910451043 conn(0x7fb17c09d110 msgr2=0x7fb17c0a6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:00.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 -- 172.21.15.88:0/910451043 shutdown_connections 2020-02-11T16:18:00.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:00.688+0000 7fb182316700 1 -- 172.21.15.88:0/910451043 wait complete. 2020-02-11T16:18:00.701 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":102,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:03.702 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:18:03.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.815+0000 7f086f3f2700 1 Processor -- start 2020-02-11T16:18:03.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.815+0000 7f086f3f2700 1 -- start start 2020-02-11T16:18:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086f3f2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08680a2fa0 0x7f08680a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086f3f2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08680a4350 con 0x7f08680a5410 2020-02-11T16:18:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086f3f2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08680a3a40 con 0x7f0868131990 2020-02-11T16:18:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086f3f2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08680a1e60 con 0x7f08680a2fa0 2020-02-11T16:18:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086c98d700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f08680a5410 legacy=0x7f0868131280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:18:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086d18e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08680a2fa0 0x7f08680a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086d18e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08680a2fa0 0x7f08680a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56614/0 (socket says 172.21.15.88:56614) 2020-02-11T16:18:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086d18e700 1 -- 172.21.15.88:0/3577743355 learned_addr learned my addr 172.21.15.88:0/3577743355 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086d18e700 1 -- 172.21.15.88:0/3577743355 >> v1:172.21.15.88:6789/0 conn(0x7f0868131990 legacy=0x7f086813ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086d18e700 1 -- 172.21.15.88:0/3577743355 >> v1:172.21.15.52:6789/0 conn(0x7f08680a5410 legacy=0x7f0868131280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086d18e700 1 -- 172.21.15.88:0/3577743355 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08680a3ce0 con 0x7f08680a2fa0 2020-02-11T16:18:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086d18e700 1 --2- 172.21.15.88:0/3577743355 >> v2:172.21.15.88:3300/0 conn(0x7f08680a2fa0 0x7f08680a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f086805ef00 tx=0x7f08580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086d18e700 1 --2- 172.21.15.88:0/3577743355 >> v2:172.21.15.88:3300/0 conn(0x7f08680a2fa0 0x7f08680a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f086805ef00 tx=0x7f08580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.816+0000 7f086d18e700 1 --2- 172.21.15.88:0/3577743355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a2fa0 0x7f08680a1520 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f086805ef00 tx=0x7f08580088e0).ready entity=mon.1 client_cookie=eda725583a709958 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f086d18e700 1 --2- 172.21.15.88:0/3577743355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a2fa0 0x7f08680a1520 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f086805ef00 tx=0x7f08580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f0857fff700 1 -- 172.21.15.88:0/3577743355 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0858012830 con 0x7f08680a2fa0 2020-02-11T16:18:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f086d18e700 1 --2- 172.21.15.88:0/3577743355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a2fa0 0x7f08680a1520 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f086805ef00 tx=0x7f08580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f086d18e700 1 --2- 172.21.15.88:0/3577743355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a2fa0 0x7f08680a1520 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f086805ef00 tx=0x7f08580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f0857fff700 1 -- 172.21.15.88:0/3577743355 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0858012990 con 0x7f08680a2fa0 2020-02-11T16:18:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f0857fff700 1 -- 172.21.15.88:0/3577743355 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0858012d30 con 0x7f08680a2fa0 2020-02-11T16:18:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f086f3f2700 1 -- 172.21.15.88:0/3577743355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a2fa0 msgr2=0x7f08680a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:03.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f086f3f2700 1 --2- 172.21.15.88:0/3577743355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a2fa0 0x7f08680a1520 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f086805ef00 tx=0x7f08580088e0).stop 2020-02-11T16:18:03.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f086f3f2700 1 -- 172.21.15.88:0/3577743355 shutdown_connections 2020-02-11T16:18:03.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f086f3f2700 1 --2- 172.21.15.88:0/3577743355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a2fa0 0x7f08680a1520 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:03.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f086f3f2700 1 -- 172.21.15.88:0/3577743355 >> 172.21.15.88:0/3577743355 conn(0x7f086809d110 msgr2=0x7f086809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:03.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f086f3f2700 1 -- 172.21.15.88:0/3577743355 shutdown_connections 2020-02-11T16:18:03.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.817+0000 7f086f3f2700 1 -- 172.21.15.88:0/3577743355 wait complete. 2020-02-11T16:18:03.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.818+0000 7f086f3f2700 1 Processor -- start 2020-02-11T16:18:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.818+0000 7f086f3f2700 1 -- start start 2020-02-11T16:18:03.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086f3f2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08680a5410 0x7f0868066160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:03.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086f3f2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0868131990 0x7f08680665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:03.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086f3f2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08680a0d90 con 0x7f08680a2fa0 2020-02-11T16:18:03.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086f3f2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08680a95f0 con 0x7f08680a5410 2020-02-11T16:18:03.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086f3f2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0868135330 con 0x7f0868131990 2020-02-11T16:18:03.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086d18e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f08680a2fa0 0x7f0868144360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44246/0 (socket says 172.21.15.88:44246) 2020-02-11T16:18:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086d18e700 1 -- 172.21.15.88:0/995343337 learned_addr learned my addr 172.21.15.88:0/995343337 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> v2:172.21.15.88:3300/0 conn(0x7f08680a5410 0x7f0868066160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086d98f700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0868131990 0x7f08680665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 -- 172.21.15.88:0/995343337 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0868131990 msgr2=0x7f08680665c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0868131990 0x7f08680665c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 -- 172.21.15.88:0/995343337 >> v1:172.21.15.88:6789/0 conn(0x7f08680a2fa0 legacy=0x7f0868144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 -- 172.21.15.88:0/995343337 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08680a0af0 con 0x7f08680a5410 2020-02-11T16:18:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> v2:172.21.15.88:3300/0 conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> v2:172.21.15.88:3300/0 conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f08567fc700 1 -- 172.21.15.88:0/995343337 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0864011640 con 0x7f08680a5410 2020-02-11T16:18:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f08567fc700 1 -- 172.21.15.88:0/995343337 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08640117e0 con 0x7f08680a5410 2020-02-11T16:18:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f086f3f2700 1 -- 172.21.15.88:0/995343337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0868136310 con 0x7f08680a5410 2020-02-11T16:18:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.819+0000 7f08567fc700 1 -- 172.21.15.88:0/995343337 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0864011c00 con 0x7f08680a5410 2020-02-11T16:18:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.820+0000 7f086f3f2700 1 -- 172.21.15.88:0/995343337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0868135f10 con 0x7f08680a5410 2020-02-11T16:18:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.820+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.820+0000 7f08567fc700 1 -- 172.21.15.88:0/995343337 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f086400b180 con 0x7f08680a5410 2020-02-11T16:18:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.820+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.820+0000 7f08567fc700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0848039c70 0x7f084803c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.820+0000 7f08567fc700 1 -- 172.21.15.88:0/995343337 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f0864049690 con 0x7f08680a5410 2020-02-11T16:18:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.821+0000 7f086f3f2700 1 -- 172.21.15.88:0/995343337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08680565b0 con 0x7f08680a5410 2020-02-11T16:18:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.821+0000 7f086d18e700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0848039c70 0x7f084803c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.821+0000 7f086d18e700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0848039c70 0x7f084803c130 crc :-1 s=READY pgs=322 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.824+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:03.824+0000 7f08567fc700 1 -- 172.21.15.88:0/995343337 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f086402ec10 con 0x7f08680a5410 2020-02-11T16:18:04.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.005+0000 7f086f3f2700 1 -- 172.21.15.88:0/995343337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f086805ccb0 con 0x7f08680a5410 2020-02-11T16:18:04.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.006+0000 7f086c98d700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:04.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.006+0000 7f08567fc700 1 -- 172.21.15.88:0/995343337 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f0864031720 con 0x7f08680a5410 2020-02-11T16:18:04.009 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:04.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 -- 172.21.15.88:0/995343337 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0848039c70 msgr2=0x7f084803c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:04.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0848039c70 0x7f084803c130 crc :-1 s=READY pgs=322 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:04.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 -- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 msgr2=0x7f0868066160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:04.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 0x7f0868066160 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f0864000b20 tx=0x7f0864010930).stop 2020-02-11T16:18:04.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 -- 172.21.15.88:0/995343337 shutdown_connections 2020-02-11T16:18:04.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0848039c70 0x7f084803c130 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:04.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0868131990 0x7f08680665c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:04.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 --2- 172.21.15.88:0/995343337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08680a5410 0x7f0868066160 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:04.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 -- 172.21.15.88:0/995343337 >> 172.21.15.88:0/995343337 conn(0x7f086809d110 msgr2=0x7f0868069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:04.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 -- 172.21.15.88:0/995343337 shutdown_connections 2020-02-11T16:18:04.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:04.007+0000 7f086f3f2700 1 -- 172.21.15.88:0/995343337 wait complete. 2020-02-11T16:18:04.020 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":102,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:07.020 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:18:07.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.135+0000 7fb41ceca700 1 Processor -- start 2020-02-11T16:18:07.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.135+0000 7fb41ceca700 1 -- start start 2020-02-11T16:18:07.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.135+0000 7fb41ceca700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 0x7fb4180a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:07.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.135+0000 7fb41ceca700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180a31b0 con 0x7fb4180a6260 2020-02-11T16:18:07.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.135+0000 7fb41ceca700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180a3570 con 0x7fb4180a5de0 2020-02-11T16:18:07.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.135+0000 7fb41ceca700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4180a3810 con 0x7fb4180a18a0 2020-02-11T16:18:07.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.136+0000 7fb416d9d700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7fb4180a6260 legacy=0x7fb41812eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:18:07.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.136+0000 7fb41659c700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 msgr2=0x7fb4180a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:07.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.136+0000 7fb41659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 0x7fb4180a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:07.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.136+0000 7fb415d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb4180a5de0 0x7fb41812e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44256/0 (socket says 172.21.15.88:44256) 2020-02-11T16:18:07.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.136+0000 7fb415d9b700 1 -- 172.21.15.88:0/2003703062 learned_addr learned my addr 172.21.15.88:0/2003703062 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:07.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.337+0000 7fb41659c700 1 -- 172.21.15.88:0/2003703062 >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 msgr2=0x7fb4180a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:07.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.337+0000 7fb416d9d700 1 -- 172.21.15.88:0/2003703062 >> v1:172.21.15.52:6789/0 conn(0x7fb4180a6260 legacy=0x7fb41812eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:18:07.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.337+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 0x7fb4180a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:18:07.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.738+0000 7fb41659c700 1 -- 172.21.15.88:0/2003703062 >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 msgr2=0x7fb4180a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:07.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.738+0000 7fb416d9d700 1 -- 172.21.15.88:0/2003703062 >> v1:172.21.15.52:6789/0 conn(0x7fb4180a6260 legacy=0x7fb41812eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:18:07.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:07.738+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 0x7fb4180a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:18:08.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:08.539+0000 7fb41659c700 1 -- 172.21.15.88:0/2003703062 >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 msgr2=0x7fb4180a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:08.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:08.539+0000 7fb416d9d700 1 -- 172.21.15.88:0/2003703062 >> v1:172.21.15.52:6789/0 conn(0x7fb4180a6260 legacy=0x7fb41812eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:18:08.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:08.539+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 0x7fb4180a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:18:10.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:10.140+0000 7fb416d9d700 1 -- 172.21.15.88:0/2003703062 >> v1:172.21.15.52:6789/0 conn(0x7fb4180a6260 legacy=0x7fb41812eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:18:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:10.141+0000 7fb41659c700 1 -- 172.21.15.88:0/2003703062 >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 msgr2=0x7fb4180a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:10.141+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 0x7fb4180a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:18:11.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.931+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891760202 0 0) 0x7fb4180a3570 con 0x7fb4180a5de0 2020-02-11T16:18:11.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.931+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3fc003230 con 0x7fb4180a5de0 2020-02-11T16:18:11.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2976182700 0 0) 0x7fb3fc003230 con 0x7fb4180a5de0 2020-02-11T16:18:11.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 msgr2=0x7fb4180a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:11.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 --2- 172.21.15.88:0/2003703062 >> v2:172.21.15.52:3300/0 conn(0x7fb4180a18a0 0x7fb4180a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:11.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 >> v1:172.21.15.52:6789/0 conn(0x7fb4180a6260 legacy=0x7fb41812eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:11.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180a3ab0 con 0x7fb4180a5de0 2020-02-11T16:18:11.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fb40c0015d0 con 0x7fb4180a5de0 2020-02-11T16:18:11.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 >> v1:172.21.15.88:6789/0 conn(0x7fb4180a5de0 legacy=0x7fb41812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:11.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 0x7fb3fc003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:11.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3fc003fa0 0x7fb3fc0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:11.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3fc004a20 0x7fb3fc004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:11.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180a3810 con 0x7fb3fc004a20 2020-02-11T16:18:11.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc00b7b0 con 0x7fb3fc003720 2020-02-11T16:18:11.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc00b970 con 0x7fb3fc003fa0 2020-02-11T16:18:11.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb416d9d700 1 -- 172.21.15.88:0/2003703062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3fc004a20 msgr2=0x7fb3fc004ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:11.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 0x7fb3fc003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:11.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb416d9d700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3fc004a20 0x7fb3fc004ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:11.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb415d9b700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3fc003fa0 0x7fb3fc0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:11.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41659c700 1 -- 172.21.15.88:0/2003703062 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3fc003fa0 msgr2=0x7fb3fc0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:11.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3fc003fa0 0x7fb3fc0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:11.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41659c700 1 -- 172.21.15.88:0/2003703062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3fc004a20 msgr2=0x7fb3fc004ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3fc004a20 0x7fb3fc004ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb416d9d700 1 -- 172.21.15.88:0/2003703062 reap_dead start 2020-02-11T16:18:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41659c700 1 -- 172.21.15.88:0/2003703062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc003230 con 0x7fb3fc003720 2020-02-11T16:18:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.933+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 0x7fb3fc003b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb3fc004440 tx=0x7fb408007d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.934+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 0x7fb3fc003b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb3fc004440 tx=0x7fb408007d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.934+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 0x7fb3fc003b20 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fb3fc004440 tx=0x7fb408007d30).ready entity=mon.1 client_cookie=99e5e33c1fbe0e65 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:11.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.934+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 0x7fb3fc003b20 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fb3fc004440 tx=0x7fb408007d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.934+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4080107f0 con 0x7fb3fc003720 2020-02-11T16:18:11.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.934+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 0x7fb3fc003b20 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fb3fc004440 tx=0x7fb408007d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.934+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408010950 con 0x7fb3fc003720 2020-02-11T16:18:11.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.934+0000 7fb41659c700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 0x7fb3fc003b20 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fb3fc004440 tx=0x7fb408007d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.934+0000 7fb41559a700 1 -- 172.21.15.88:0/2003703062 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb408010cb0 con 0x7fb3fc003720 2020-02-11T16:18:11.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.935+0000 7fb41ceca700 1 -- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 msgr2=0x7fb3fc003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:11.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.935+0000 7fb41ceca700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 0x7fb3fc003b20 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fb3fc004440 tx=0x7fb408007d30).stop 2020-02-11T16:18:11.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.935+0000 7fb41ceca700 1 -- 172.21.15.88:0/2003703062 shutdown_connections 2020-02-11T16:18:11.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.935+0000 7fb41ceca700 1 --2- 172.21.15.88:0/2003703062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3fc003720 0x7fb3fc003b20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:11.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.935+0000 7fb41ceca700 1 -- 172.21.15.88:0/2003703062 >> 172.21.15.88:0/2003703062 conn(0x7fb41809d110 msgr2=0x7fb41809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:11.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.935+0000 7fb41ceca700 1 -- 172.21.15.88:0/2003703062 shutdown_connections 2020-02-11T16:18:11.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.935+0000 7fb41ceca700 1 -- 172.21.15.88:0/2003703062 wait complete. 2020-02-11T16:18:11.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.937+0000 7fb41ceca700 1 Processor -- start 2020-02-11T16:18:11.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.937+0000 7fb41ceca700 1 -- start start 2020-02-11T16:18:11.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.937+0000 7fb41ceca700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4180a0480 0x7fb418128ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:11.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.937+0000 7fb41ceca700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb418129300 0x7fb418129780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.937+0000 7fb41ceca700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb418146ed0 con 0x7fb3fc003720 2020-02-11T16:18:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.937+0000 7fb41ceca700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4181476c0 con 0x7fb418129300 2020-02-11T16:18:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.937+0000 7fb41ceca700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb418131d60 con 0x7fb4180a0480 2020-02-11T16:18:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.937+0000 7fb41659c700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7fb3fc003720 legacy=0x7fb4181467c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:18:11.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.937+0000 7fb416d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb418129300 0x7fb418129780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:11.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb418129300 0x7fb418129780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56660/0 (socket says 172.21.15.88:56660) 2020-02-11T16:18:11.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 -- 172.21.15.88:0/407230376 learned_addr learned my addr 172.21.15.88:0/407230376 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:11.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb415d9b700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4180a0480 0x7fb418128ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:11.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 -- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4180a0480 msgr2=0x7fb418128ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:11.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4180a0480 0x7fb418128ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:11.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 -- 172.21.15.88:0/407230376 >> v1:172.21.15.52:6789/0 conn(0x7fb3fc003720 legacy=0x7fb4181467c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:18:11.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 -- 172.21.15.88:0/407230376 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180a4a20 con 0x7fb418129300 2020-02-11T16:18:11.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb415d9b700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4180a0480 0x7fb418128ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:18:11.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> v2:172.21.15.88:3300/0 conn(0x7fb418129300 0x7fb418129780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> v2:172.21.15.88:3300/0 conn(0x7fb418129300 0x7fb418129780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 0x7fb418129780 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:11.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 0x7fb418129780 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 0x7fb418129780 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 0x7fb418129780 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb4077fe700 1 -- 172.21.15.88:0/407230376 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4100114d0 con 0x7fb418129300 2020-02-11T16:18:11.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb4077fe700 1 -- 172.21.15.88:0/407230376 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb410011630 con 0x7fb418129300 2020-02-11T16:18:11.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb41ceca700 1 -- 172.21.15.88:0/407230376 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41812f500 con 0x7fb418129300 2020-02-11T16:18:11.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb4077fe700 1 -- 172.21.15.88:0/407230376 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4100119d0 con 0x7fb418129300 2020-02-11T16:18:11.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.938+0000 7fb41ceca700 1 -- 172.21.15.88:0/407230376 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb418130cb0 con 0x7fb418129300 2020-02-11T16:18:11.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.939+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 0x7fb418129780 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.939+0000 7fb4077fe700 1 -- 172.21.15.88:0/407230376 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb410011d70 con 0x7fb418129300 2020-02-11T16:18:11.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.939+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 0x7fb418129780 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.939+0000 7fb4077fe700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3f4039ca0 0x7fb3f403c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:11.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.939+0000 7fb4077fe700 1 -- 172.21.15.88:0/407230376 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb410049810 con 0x7fb418129300 2020-02-11T16:18:11.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.939+0000 7fb41659c700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3f4039ca0 0x7fb3f403c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:11.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.940+0000 7fb41ceca700 1 -- 172.21.15.88:0/407230376 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41812f690 con 0x7fb418129300 2020-02-11T16:18:11.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.940+0000 7fb41659c700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3f4039ca0 0x7fb3f403c160 crc :-1 s=READY pgs=323 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:11.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.943+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 0x7fb418129780 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:11.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:11.943+0000 7fb4077fe700 1 -- 172.21.15.88:0/407230376 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb41002ed90 con 0x7fb418129300 2020-02-11T16:18:12.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.129+0000 7fb41ceca700 1 -- 172.21.15.88:0/407230376 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb4180565b0 con 0x7fb418129300 2020-02-11T16:18:12.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.129+0000 7fb416d9d700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 0x7fb418129780 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.129+0000 7fb4077fe700 1 -- 172.21.15.88:0/407230376 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fb4100318a0 con 0x7fb418129300 2020-02-11T16:18:12.132 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:12.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 -- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3f4039ca0 msgr2=0x7fb3f403c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3f4039ca0 0x7fb3f403c160 crc :-1 s=READY pgs=323 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 -- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 msgr2=0x7fb418129780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 0x7fb418129780 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fb4180a4c50 tx=0x7fb410010790).stop 2020-02-11T16:18:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 -- 172.21.15.88:0/407230376 shutdown_connections 2020-02-11T16:18:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb3f4039ca0 0x7fb3f403c160 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb418129300 0x7fb418129780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 --2- 172.21.15.88:0/407230376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb4180a0480 0x7fb418128ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 -- 172.21.15.88:0/407230376 >> 172.21.15.88:0/407230376 conn(0x7fb41809d110 msgr2=0x7fb4180a6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 -- 172.21.15.88:0/407230376 shutdown_connections 2020-02-11T16:18:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.131+0000 7fb41ceca700 1 -- 172.21.15.88:0/407230376 wait complete. 2020-02-11T16:18:12.143 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":104,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:12.144 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:18:12.144 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:18:12.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.247+0000 7f3b03099700 1 Processor -- start 2020-02-11T16:18:12.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.247+0000 7f3b03099700 1 -- start start 2020-02-11T16:18:12.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b03099700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 0x7f3afc0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:12.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b03099700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a6260 0x7f3afc12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:12.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b03099700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3afc0a3570 con 0x7f3afc0a5de0 2020-02-11T16:18:12.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b03099700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc0a3810 con 0x7f3afc0a6260 2020-02-11T16:18:12.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b03099700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0a3ab0 con 0x7f3afc0a18a0 2020-02-11T16:18:12.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b01636700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a6260 msgr2=0x7f3afc12eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:12.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b01636700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a6260 0x7f3afc12eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:12.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3afbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3afc0a5de0 0x7f3afc12e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44296/0 (socket says 172.21.15.88:44296) 2020-02-11T16:18:12.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3afbfff700 1 -- 172.21.15.88:0/3738100259 learned_addr learned my addr 172.21.15.88:0/3738100259 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:12.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b00e35700 1 --2- 172.21.15.88:0/3738100259 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 0x7f3afc0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3afb7fe700 1 -- 172.21.15.88:0/3738100259 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506060765 0 0) 0x7f3afc0a3570 con 0x7f3afc0a5de0 2020-02-11T16:18:12.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3afb7fe700 1 -- 172.21.15.88:0/3738100259 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae8003230 con 0x7f3afc0a5de0 2020-02-11T16:18:12.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b00e35700 1 -- 172.21.15.88:0/3738100259 >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a6260 msgr2=0x7f3afc12eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:12.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b00e35700 1 --2- 172.21.15.88:0/3738100259 >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a6260 0x7f3afc12eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:12.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3afb7fe700 1 -- 172.21.15.88:0/3738100259 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 246686025 0 0) 0x7f3ae8003230 con 0x7f3afc0a5de0 2020-02-11T16:18:12.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b00e35700 1 -- 172.21.15.88:0/3738100259 >> v1:172.21.15.88:6789/0 conn(0x7f3afc0a5de0 legacy=0x7f3afc12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b00e35700 1 -- 172.21.15.88:0/3738100259 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc0a3d50 con 0x7f3afc0a18a0 2020-02-11T16:18:12.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.248+0000 7f3b00e35700 1 --2- 172.21.15.88:0/3738100259 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 0x7f3afc0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3af0001870 tx=0x7f3aec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b00e35700 1 --2- 172.21.15.88:0/3738100259 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 0x7f3afc0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3af0001870 tx=0x7f3aec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b00e35700 1 --2- 172.21.15.88:0/3738100259 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 0x7f3afc0a6dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f3af0001870 tx=0x7f3aec0088e0).ready entity=mon.2 client_cookie=fa0536abf07fa450 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b00e35700 1 --2- 172.21.15.88:0/3738100259 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 0x7f3afc0a6dd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f3af0001870 tx=0x7f3aec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3afb7fe700 1 -- 172.21.15.88:0/3738100259 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3af00016d0 con 0x7f3afc0a18a0 2020-02-11T16:18:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b00e35700 1 --2- 172.21.15.88:0/3738100259 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 0x7f3afc0a6dd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f3af0001870 tx=0x7f3aec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b00e35700 1 --2- 172.21.15.88:0/3738100259 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 0x7f3afc0a6dd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f3af0001870 tx=0x7f3aec0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3afb7fe700 1 -- 172.21.15.88:0/3738100259 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec0112c0 con 0x7f3afc0a18a0 2020-02-11T16:18:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3afb7fe700 1 -- 172.21.15.88:0/3738100259 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aec011620 con 0x7f3afc0a18a0 2020-02-11T16:18:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b03099700 1 -- 172.21.15.88:0/3738100259 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 msgr2=0x7f3afc0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b03099700 1 --2- 172.21.15.88:0/3738100259 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 0x7f3afc0a6dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f3af0001870 tx=0x7f3aec0088e0).stop 2020-02-11T16:18:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b03099700 1 -- 172.21.15.88:0/3738100259 shutdown_connections 2020-02-11T16:18:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b03099700 1 --2- 172.21.15.88:0/3738100259 >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a6260 0x7f3afc12eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b03099700 1 --2- 172.21.15.88:0/3738100259 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3afc0a18a0 0x7f3afc0a6dd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b03099700 1 -- 172.21.15.88:0/3738100259 >> 172.21.15.88:0/3738100259 conn(0x7f3afc09d110 msgr2=0x7f3afc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b03099700 1 -- 172.21.15.88:0/3738100259 shutdown_connections 2020-02-11T16:18:12.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.249+0000 7f3b03099700 1 -- 172.21.15.88:0/3738100259 wait complete. 2020-02-11T16:18:12.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.250+0000 7f3b03099700 1 Processor -- start 2020-02-11T16:18:12.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.250+0000 7f3b03099700 1 -- start start 2020-02-11T16:18:12.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b03099700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3afc0a18a0 0x7f3afc09e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:12.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b03099700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a5de0 0x7f3afc137df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:12.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b03099700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3afc09ebb0 con 0x7f3afc0a6260 2020-02-11T16:18:12.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b03099700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc142c40 con 0x7f3afc0a5de0 2020-02-11T16:18:12.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b03099700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc09e910 con 0x7f3afc0a18a0 2020-02-11T16:18:12.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3afc0a18a0 0x7f3afc09e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3afbfff700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a5de0 msgr2=0x7f3afc137df0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:12.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b01636700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f3afc0a6260 legacy=0x7f3afc1432c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:18:12.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3afc0a18a0 0x7f3afc09e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56672/0 (socket says 172.21.15.88:56672) 2020-02-11T16:18:12.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 -- 172.21.15.88:0/1190113061 learned_addr learned my addr 172.21.15.88:0/1190113061 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:12.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a5de0 0x7f3afc137df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:12.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 -- 172.21.15.88:0/1190113061 >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a5de0 msgr2=0x7f3afc137df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:18:12.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 --2- 172.21.15.88:0/1190113061 >> v2:172.21.15.52:3300/0 conn(0x7f3afc0a5de0 0x7f3afc137df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 -- 172.21.15.88:0/1190113061 >> v1:172.21.15.52:6789/0 conn(0x7f3afc0a6260 legacy=0x7f3afc1432c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:18:12.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 -- 172.21.15.88:0/1190113061 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc1462a0 con 0x7f3afc0a18a0 2020-02-11T16:18:12.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 --2- 172.21.15.88:0/1190113061 >> v2:172.21.15.88:3300/0 conn(0x7f3afc0a18a0 0x7f3afc09e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3afc135450 tx=0x7f3afc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 --2- 172.21.15.88:0/1190113061 >> v2:172.21.15.88:3300/0 conn(0x7f3afc0a18a0 0x7f3afc09e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3afc135450 tx=0x7f3afc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a18a0 0x7f3afc09e320 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f3afc135450 tx=0x7f3afc0a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:12.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a18a0 0x7f3afc09e320 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f3afc135450 tx=0x7f3afc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aec011c90 con 0x7f3afc0a18a0 2020-02-11T16:18:12.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.251+0000 7f3b00e35700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a18a0 0x7f3afc09e320 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f3afc135450 tx=0x7f3afc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3b00e35700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a18a0 0x7f3afc09e320 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f3afc135450 tx=0x7f3afc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec011df0 con 0x7f3afc0a18a0 2020-02-11T16:18:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3b03099700 1 -- 172.21.15.88:0/1190113061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc135670 con 0x7f3afc0a18a0 2020-02-11T16:18:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aec007340 con 0x7f3afc0a18a0 2020-02-11T16:18:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3b03099700 1 -- 172.21.15.88:0/1190113061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc134f50 con 0x7f3afc0a18a0 2020-02-11T16:18:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3b00e35700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a18a0 0x7f3afc09e320 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f3afc135450 tx=0x7f3afc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3aec007880 con 0x7f3afc0a18a0 2020-02-11T16:18:12.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3b00e35700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a18a0 0x7f3afc09e320 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f3afc135450 tx=0x7f3afc0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3b03099700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 0x7f3afc12e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:12.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3b03099700 1 -- 172.21.15.88:0/1190113061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc05e2f0 con 0x7f3afc146ac0 2020-02-11T16:18:12.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 0x7f3afc12e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3af9ffb700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3adc039c10 0x7f3adc03c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.252+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3aec04a360 con 0x7f3afc0a18a0 2020-02-11T16:18:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3afbfff700 1 -- 172.21.15.88:0/1190113061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3afc135260 con 0x7f3afc146ac0 2020-02-11T16:18:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 0x7f3afc12e670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 0x7f3afc12e670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 0x7f3afc12e670 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3b01636700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3adc039c10 0x7f3adc03c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 0x7f3afc12e670 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3af0012b20 con 0x7f3afc146ac0 2020-02-11T16:18:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 0x7f3afc12e670 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f3af0012c80 con 0x7f3afc146ac0 2020-02-11T16:18:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 msgr2=0x7f3afc12e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3b01636700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3adc039c10 0x7f3adc03c0d0 crc :-1 s=READY pgs=324 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3af9ffb700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 0x7f3afc12e670 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).stop 2020-02-11T16:18:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 msgr2=0x7f3afc12e670 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:12.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.253+0000 7f3af9ffb700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc146ac0 0x7f3afc12e670 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).stop 2020-02-11T16:18:12.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.261+0000 7f3b03099700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 0x7f3afc0a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:12.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.261+0000 7f3b03099700 1 -- 172.21.15.88:0/1190113061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0565b0 con 0x7f3afc0a87d0 2020-02-11T16:18:12.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.261+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 0x7f3afc0a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.261+0000 7f3afbfff700 1 -- 172.21.15.88:0/1190113061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3afc05ccb0 con 0x7f3afc0a87d0 2020-02-11T16:18:12.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.261+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 0x7f3afc0a8be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.261+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 0x7f3afc0a8be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.261+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 0x7f3afc0a8be0 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 0x7f3afc0a8be0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3af0004cd0 con 0x7f3afc0a87d0 2020-02-11T16:18:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3afbfff700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 0x7f3afc0a8be0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4351 (secure 0 0 0) 0x7f3af0004e30 con 0x7f3afc0a87d0 2020-02-11T16:18:12.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 msgr2=0x7f3afc0a8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3af9ffb700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 0x7f3afc0a8be0 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f3af0001930 tx=0x7f3af0010d70).stop 2020-02-11T16:18:12.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3af9ffb700 1 -- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 msgr2=0x7f3afc0a8be0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:12.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3af9ffb700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a87d0 0x7f3afc0a8be0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3b03099700 1 -- 172.21.15.88:0/1190113061 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3adc039c10 msgr2=0x7f3adc03c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3b03099700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3adc039c10 0x7f3adc03c0d0 crc :-1 s=READY pgs=324 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3b03099700 1 -- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a18a0 msgr2=0x7f3afc09e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3b03099700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a18a0 0x7f3afc09e320 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f3afc135450 tx=0x7f3afc0a1c80).stop 2020-02-11T16:18:12.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3b01636700 1 -- 172.21.15.88:0/1190113061 reap_dead start 2020-02-11T16:18:12.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3b03099700 1 -- 172.21.15.88:0/1190113061 shutdown_connections 2020-02-11T16:18:12.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3b03099700 1 --2- 172.21.15.88:0/1190113061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc0a18a0 0x7f3afc09e320 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3b03099700 1 -- 172.21.15.88:0/1190113061 >> 172.21.15.88:0/1190113061 conn(0x7f3afc09d110 msgr2=0x7f3afc0a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:12.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3b03099700 1 -- 172.21.15.88:0/1190113061 shutdown_connections 2020-02-11T16:18:12.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.262+0000 7f3b03099700 1 -- 172.21.15.88:0/1190113061 wait complete. 2020-02-11T16:18:12.275 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:18:12.275 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:12.275 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:12.275 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:18:12.275 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 104, 2020-02-11T16:18:12.275 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:18:12.276 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:18:12.276 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:18:12.276 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.276 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:18:12.276 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:12.276 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:18:12.276 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:18:12.277 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:12.277 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:12.277 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:12.277 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:12.277 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:12.277 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:12.277 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.278 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:18:12.278 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:18:12.278 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:12.278 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:12.278 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:12.278 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:12.278 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:12.279 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:12.279 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.279 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:18:12.279 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:18:12.279 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:18:12.279 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:18:12.279 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:18:12.280 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:18:12.280 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:12.280 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:12.280 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:18:12.280 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:18:12.280 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:12.280 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:18:12.281 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:12.281 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:12.281 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:12.281 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:12.281 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:12.281 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:12.282 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.282 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:18:12.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.282 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:18:12.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.282 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:18:12.282 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:18:12.283 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:12.283 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:12.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.283 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:12.283 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:18:12.283 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.284 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:12.284 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:18:12.284 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.284 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.284 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.284 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:18:12.285 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:18:12.285 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:12.285 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:12.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.285 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:12.285 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:12.286 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:12.286 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:12.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.286 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:12.286 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:18:12.286 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.287 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:12.287 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:18:12.287 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.287 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.287 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.288 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:18:12.288 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:18:12.288 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:12.288 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:12.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.288 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:12.288 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:12.289 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:12.289 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:12.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.289 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:12.289 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:18:12.289 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.290 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:12.290 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:18:12.290 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.290 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.290 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.291 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:18:12.291 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:18:12.291 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:12.291 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:12.291 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.291 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.292 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:18:12.292 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:18:12.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.292 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:12.292 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:12.292 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:12.292 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.292 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.293 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:18:12.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.293 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:12.293 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:12.293 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:12.293 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.293 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:18:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:18:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.295 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:18:12.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.295 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:12.295 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:12.295 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:18:12.295 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.295 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:18:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.297 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:18:12.298 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:18:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.402+0000 7f40b8bf1700 1 Processor -- start 2020-02-11T16:18:12.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.402+0000 7f40b8bf1700 1 -- start start 2020-02-11T16:18:12.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.402+0000 7f40b8bf1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40b40a5de0 0x7f40b40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:12.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.402+0000 7f40b8bf1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4134a50 0x7f40b4134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:12.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.402+0000 7f40b8bf1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b40a31b0 con 0x7f40b40a18a0 2020-02-11T16:18:12.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.402+0000 7f40b8bf1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40a3570 con 0x7f40b40a5de0 2020-02-11T16:18:12.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.402+0000 7f40b8bf1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40a3810 con 0x7f40b4134a50 2020-02-11T16:18:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f40b40a18a0 0x7f40b40a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44310/0 (socket says 172.21.15.88:44310) 2020-02-11T16:18:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b1d9b700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f40b40a5de0 msgr2=0x7f40b40a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b259c700 1 -- 172.21.15.88:0/4156085611 learned_addr learned my addr 172.21.15.88:0/4156085611 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:12.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/4156085611 >> v2:172.21.15.52:3300/0 conn(0x7f40b40a5de0 0x7f40b40a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:12.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4134a50 0x7f40b4134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772883038 0 0) 0x7f40b40a31b0 con 0x7f40b40a18a0 2020-02-11T16:18:12.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4094003230 con 0x7f40b40a18a0 2020-02-11T16:18:12.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2982860565 0 0) 0x7f4094003230 con 0x7f40b40a18a0 2020-02-11T16:18:12.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4134a50 msgr2=0x7f40b4134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:12.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4134a50 0x7f40b4134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:12.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 >> v2:172.21.15.52:3300/0 conn(0x7f40b40a5de0 msgr2=0x7f40b40a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:12.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 --2- 172.21.15.88:0/4156085611 >> v2:172.21.15.52:3300/0 conn(0x7f40b40a5de0 0x7f40b40a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:12.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b40a3ab0 con 0x7f40b40a18a0 2020-02-11T16:18:12.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f40ac001a50 con 0x7f40b40a18a0 2020-02-11T16:18:12.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4134a50 0x7f40b4134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:18:12.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 >> v1:172.21.15.88:6789/0 conn(0x7f40b40a18a0 legacy=0x7f40b40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4134a50 0x7f4094003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:12.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094003b80 0x7f4094004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:12.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4094004570 0x7f40940049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:12.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40a3570 con 0x7f4094003b80 2020-02-11T16:18:12.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40a3810 con 0x7f4094004570 2020-02-11T16:18:12.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940050b0 con 0x7f40b4134a50 2020-02-11T16:18:12.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4094004570 0x7f40940049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b1d9b700 1 -- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094003b80 msgr2=0x7f4094004000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:18:12.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094003b80 0x7f4094004000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:12.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b259c700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4134a50 0x7f4094003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b2d9d700 1 -- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4134a50 msgr2=0x7f4094003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:12.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4134a50 0x7f4094003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:12.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b2d9d700 1 -- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094003b80 msgr2=0x7f4094004000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:12.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094003b80 0x7f4094004000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:12.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.403+0000 7f40b2d9d700 1 -- 172.21.15.88:0/4156085611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4094003230 con 0x7f4094004570 2020-02-11T16:18:12.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4094004570 0x7f40940049f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f40a4002f30 tx=0x7f40a400bf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4094004570 0x7f40940049f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f40a4002f30 tx=0x7f40a400bf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4094004570 0x7f40940049f0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f40a4002f30 tx=0x7f40a400bf70).ready entity=mon.1 client_cookie=1099db2b87a0efc1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:12.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4094004570 0x7f40940049f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f40a4002f30 tx=0x7f40a400bf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40a4011c00 con 0x7f4094004570 2020-02-11T16:18:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4094004570 0x7f40940049f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f40a4002f30 tx=0x7f40a400bf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4094004570 0x7f40940049f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f40a4002f30 tx=0x7f40a400bf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a4011d60 con 0x7f4094004570 2020-02-11T16:18:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b159a700 1 -- 172.21.15.88:0/4156085611 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40a40058b0 con 0x7f4094004570 2020-02-11T16:18:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b8bf1700 1 -- 172.21.15.88:0/4156085611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4094004570 msgr2=0x7f40940049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b8bf1700 1 --2- 172.21.15.88:0/4156085611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4094004570 0x7f40940049f0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f40a4002f30 tx=0x7f40a400bf70).stop 2020-02-11T16:18:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b2d9d700 1 -- 172.21.15.88:0/4156085611 reap_dead start 2020-02-11T16:18:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b8bf1700 1 -- 172.21.15.88:0/4156085611 shutdown_connections 2020-02-11T16:18:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b8bf1700 1 -- 172.21.15.88:0/4156085611 >> 172.21.15.88:0/4156085611 conn(0x7f40b409d110 msgr2=0x7f40b409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b8bf1700 1 -- 172.21.15.88:0/4156085611 shutdown_connections 2020-02-11T16:18:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.404+0000 7f40b8bf1700 1 -- 172.21.15.88:0/4156085611 wait complete. 2020-02-11T16:18:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.405+0000 7f40b8bf1700 1 Processor -- start 2020-02-11T16:18:12.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.405+0000 7f40b8bf1700 1 -- start start 2020-02-11T16:18:12.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b8bf1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40b40a94e0 0x7f40b4065c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:12.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b8bf1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4137470 0x7f40b4127270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:12.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b8bf1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b40a7660 con 0x7f40b41378f0 2020-02-11T16:18:12.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b8bf1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b4127de0 con 0x7f40b40a94e0 2020-02-11T16:18:12.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b8bf1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4066b00 con 0x7f40b4137470 2020-02-11T16:18:12.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40b40a94e0 0x7f40b4065c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b2d9d700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f40b41378f0 legacy=0x7f40b41276d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:18:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40b40a94e0 0x7f40b4065c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56694/0 (socket says 172.21.15.88:56694) 2020-02-11T16:18:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 -- 172.21.15.88:0/2319521520 learned_addr learned my addr 172.21.15.88:0/2319521520 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4137470 0x7f40b4127270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 -- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4137470 msgr2=0x7f40b4127270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b4137470 0x7f40b4127270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 -- 172.21.15.88:0/2319521520 >> v1:172.21.15.52:6789/0 conn(0x7f40b41378f0 legacy=0x7f40b41276d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:18:12.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 -- 172.21.15.88:0/2319521520 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b4066da0 con 0x7f40b40a94e0 2020-02-11T16:18:12.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 --2- 172.21.15.88:0/2319521520 >> v2:172.21.15.88:3300/0 conn(0x7f40b40a94e0 0x7f40b4065c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f40b40659e0 tx=0x7f40b412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 --2- 172.21.15.88:0/2319521520 >> v2:172.21.15.88:3300/0 conn(0x7f40b40a94e0 0x7f40b4065c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f40b40659e0 tx=0x7f40b412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b40a94e0 0x7f40b4065c20 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f40b40659e0 tx=0x7f40b412f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:12.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b40a94e0 0x7f40b4065c20 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f40b40659e0 tx=0x7f40b412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b40a94e0 0x7f40b4065c20 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f40b40659e0 tx=0x7f40b412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40ac011ae0 con 0x7f40b40a94e0 2020-02-11T16:18:12.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b259c700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b40a94e0 0x7f40b4065c20 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f40b40659e0 tx=0x7f40b412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac011c40 con 0x7f40b40a94e0 2020-02-11T16:18:12.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b8bf1700 1 -- 172.21.15.88:0/2319521520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b4067040 con 0x7f40b40a94e0 2020-02-11T16:18:12.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40ac011e30 con 0x7f40b40a94e0 2020-02-11T16:18:12.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.406+0000 7f40b8bf1700 1 -- 172.21.15.88:0/2319521520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b40a9c80 con 0x7f40b40a94e0 2020-02-11T16:18:12.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.407+0000 7f40b259c700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b40a94e0 0x7f40b4065c20 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f40b40659e0 tx=0x7f40b412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.407+0000 7f40b259c700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b40a94e0 0x7f40b4065c20 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f40b40659e0 tx=0x7f40b412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.407+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f40ac004930 con 0x7f40b40a94e0 2020-02-11T16:18:12.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.407+0000 7f40b8bf1700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 0x7f40b40a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:12.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.407+0000 7f40b8bf1700 1 -- 172.21.15.88:0/2319521520 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b405e2f0 con 0x7f40b412e710 2020-02-11T16:18:12.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.407+0000 7f40ab7fe700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4098039ca0 0x7f409803c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:12.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.407+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f40ac0498d0 con 0x7f40b40a94e0 2020-02-11T16:18:12.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.407+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 0x7f40b40a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4098039ca0 0x7f409803c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40b2d9d700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4098039ca0 0x7f409803c160 crc :-1 s=READY pgs=325 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:12.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40b1d9b700 1 -- 172.21.15.88:0/2319521520 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40b4066140 con 0x7f40b412e710 2020-02-11T16:18:12.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 0x7f40b40a7fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 0x7f40b40a7fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 0x7f40b40a7fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c00c890).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:12.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 0x7f40b40a7fe0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f409c008cd0 con 0x7f40b412e710 2020-02-11T16:18:12.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 0x7f40b40a7fe0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f409c008e30 con 0x7f40b412e710 2020-02-11T16:18:12.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 msgr2=0x7f40b40a7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40ab7fe700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 0x7f40b40a7fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c00c890).stop 2020-02-11T16:18:12.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 msgr2=0x7f40b40a7fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:12.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.408+0000 7f40ab7fe700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b412e710 0x7f40b40a7fe0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c00c890).stop 2020-02-11T16:18:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.416+0000 7f40b8bf1700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 0x7f40b40a8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.416+0000 7f40b8bf1700 1 -- 172.21.15.88:0/2319521520 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4066c40 con 0x7f40b40a8440 2020-02-11T16:18:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 0x7f40b40a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40b1d9b700 1 -- 172.21.15.88:0/2319521520 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f40b4067240 con 0x7f40b40a8440 2020-02-11T16:18:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 0x7f40b40a8820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 0x7f40b40a8820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 0x7f40b40a8820 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c008fa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 0x7f40b40a8820 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f409c00b650 con 0x7f40b40a8440 2020-02-11T16:18:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40b1d9b700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 0x7f40b40a8820 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f409c007110 con 0x7f40b40a8440 2020-02-11T16:18:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 msgr2=0x7f40b40a8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40ab7fe700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 0x7f40b40a8820 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f409c000b20 tx=0x7f409c008fa0).stop 2020-02-11T16:18:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40ab7fe700 1 -- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 msgr2=0x7f40b40a8820 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.417+0000 7f40ab7fe700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40b40a8440 0x7f40b40a8820 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b8bf1700 1 -- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4098039ca0 msgr2=0x7f409803c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b8bf1700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4098039ca0 0x7f409803c160 crc :-1 s=READY pgs=325 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b8bf1700 1 -- 172.21.15.88:0/2319521520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b40a94e0 msgr2=0x7f40b4065c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b8bf1700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b40a94e0 0x7f40b4065c20 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f40b40659e0 tx=0x7f40b412f3b0).stop 2020-02-11T16:18:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b2d9d700 1 -- 172.21.15.88:0/2319521520 reap_dead start 2020-02-11T16:18:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b2d9d700 1 -- 172.21.15.88:0/2319521520 reap_dead start 2020-02-11T16:18:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b8bf1700 1 -- 172.21.15.88:0/2319521520 shutdown_connections 2020-02-11T16:18:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b8bf1700 1 --2- 172.21.15.88:0/2319521520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b40a94e0 0x7f40b4065c20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b8bf1700 1 -- 172.21.15.88:0/2319521520 >> 172.21.15.88:0/2319521520 conn(0x7f40b409d110 msgr2=0x7f40b40a6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b8bf1700 1 -- 172.21.15.88:0/2319521520 shutdown_connections 2020-02-11T16:18:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:12.418+0000 7f40b8bf1700 1 -- 172.21.15.88:0/2319521520 wait complete. 2020-02-11T16:18:12.453 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:18:12.453 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:12.453 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:12.453 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:18:12.453 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 104, 2020-02-11T16:18:12.454 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:18:12.454 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:18:12.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:18:12.454 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.454 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:18:12.454 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:12.454 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:18:12.455 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:18:12.455 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:12.455 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:12.455 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:12.457 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:12.457 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:12.457 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:12.457 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.457 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:18:12.458 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:18:12.458 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:12.458 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:12.458 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:12.458 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:12.458 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:12.458 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:12.459 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.459 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:18:12.459 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:18:12.459 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:18:12.459 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:18:12.459 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:18:12.459 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:18:12.460 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:12.460 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:12.460 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:18:12.460 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:18:12.460 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:12.460 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:18:12.460 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:12.461 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:12.461 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:12.461 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:12.461 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:12.461 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:12.461 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.461 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:18:12.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.462 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:18:12.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.462 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:18:12.462 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:18:12.462 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:12.462 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:12.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.463 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:12.463 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:18:12.463 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.463 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:12.464 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:18:12.464 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.464 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.464 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.464 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:18:12.464 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:18:12.465 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:12.465 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:12.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.465 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:12.465 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:12.465 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:12.466 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:12.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.466 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:12.466 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:18:12.466 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.467 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:12.467 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:18:12.467 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.467 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.467 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.467 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:18:12.468 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:18:12.468 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:12.468 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:12.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.468 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:12.469 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:12.469 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:12.469 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:12.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.469 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:12.469 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:18:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:18:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:18:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:18:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:18:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:18:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:18:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:18:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:18:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:18:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:12.476 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:12.476 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:18:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:18:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:12.478 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:18:12.478 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:18:13.719 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:18:13.722 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:18:32.479 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:18:32.480 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2020-02-11T16:18:32.480 INFO:tasks.ceph.mon.b:Restarting daemon 2020-02-11T16:18:32.480 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-02-11T16:18:32.483 INFO:tasks.ceph.mon.b:Started 2020-02-11T16:18:32.483 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:18:32.483 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:18:32.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.600+0000 7fe8ec7e9700 1 Processor -- start 2020-02-11T16:18:32.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.600+0000 7fe8ec7e9700 1 -- start start 2020-02-11T16:18:32.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.600+0000 7fe8ec7e9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe8e40a7120 0x7fe8e40a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:32.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ec7e9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e40a5320 con 0x7fe8e40a39e0 2020-02-11T16:18:32.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ec7e9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e40a5560 con 0x7fe8e40a3e70 2020-02-11T16:18:32.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ec7e9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e409e7a0 con 0x7fe8e40a7120 2020-02-11T16:18:32.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe8e40a7120 0x7fe8e40a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:32.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe8e40a7120 0x7fe8e40a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56708/0 (socket says 172.21.15.88:56708) 2020-02-11T16:18:32.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 -- 172.21.15.88:0/4031195999 learned_addr learned my addr 172.21.15.88:0/4031195999 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:32.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 -- 172.21.15.88:0/4031195999 >> v1:172.21.15.88:6789/0 conn(0x7fe8e40a3e70 legacy=0x7fe8e4140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:32.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 -- 172.21.15.88:0/4031195999 >> v1:172.21.15.52:6789/0 conn(0x7fe8e40a39e0 legacy=0x7fe8e412f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:32.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 -- 172.21.15.88:0/4031195999 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e409e060 con 0x7fe8e40a7120 2020-02-11T16:18:32.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 --2- 172.21.15.88:0/4031195999 >> v2:172.21.15.88:3300/0 conn(0x7fe8e40a7120 0x7fe8e40a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe8e0002f30 tx=0x7fe8e00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 --2- 172.21.15.88:0/4031195999 >> v2:172.21.15.88:3300/0 conn(0x7fe8e40a7120 0x7fe8e40a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe8e0002f30 tx=0x7fe8e00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 --2- 172.21.15.88:0/4031195999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8e40a7120 0x7fe8e40a4ec0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fe8e0002f30 tx=0x7fe8e00088e0).ready entity=mon.1 client_cookie=671147ce22bedd83 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:32.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 --2- 172.21.15.88:0/4031195999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8e40a7120 0x7fe8e40a4ec0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fe8e0002f30 tx=0x7fe8e00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8e9583700 1 -- 172.21.15.88:0/4031195999 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8e0011760 con 0x7fe8e40a7120 2020-02-11T16:18:32.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 --2- 172.21.15.88:0/4031195999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8e40a7120 0x7fe8e40a4ec0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fe8e0002f30 tx=0x7fe8e00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ea585700 1 --2- 172.21.15.88:0/4031195999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8e40a7120 0x7fe8e40a4ec0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fe8e0002f30 tx=0x7fe8e00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8e9583700 1 -- 172.21.15.88:0/4031195999 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00118c0 con 0x7fe8e40a7120 2020-02-11T16:18:32.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8e9583700 1 -- 172.21.15.88:0/4031195999 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8e0011ca0 con 0x7fe8e40a7120 2020-02-11T16:18:32.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/4031195999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8e40a7120 msgr2=0x7fe8e40a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:32.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.601+0000 7fe8ec7e9700 1 --2- 172.21.15.88:0/4031195999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8e40a7120 0x7fe8e40a4ec0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fe8e0002f30 tx=0x7fe8e00088e0).stop 2020-02-11T16:18:32.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.602+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/4031195999 shutdown_connections 2020-02-11T16:18:32.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.602+0000 7fe8ec7e9700 1 --2- 172.21.15.88:0/4031195999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8e40a7120 0x7fe8e40a4ec0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:32.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.602+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/4031195999 >> 172.21.15.88:0/4031195999 conn(0x7fe8e409d110 msgr2=0x7fe8e409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:32.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.602+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/4031195999 shutdown_connections 2020-02-11T16:18:32.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.602+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/4031195999 wait complete. 2020-02-11T16:18:32.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.603+0000 7fe8ec7e9700 1 Processor -- start 2020-02-11T16:18:32.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.603+0000 7fe8ec7e9700 1 -- start start 2020-02-11T16:18:32.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.603+0000 7fe8ec7e9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8e40a39e0 0x7fe8e4135e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:32.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.603+0000 7fe8ec7e9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:32.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.603+0000 7fe8ec7e9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e4135c60 con 0x7fe8e40a7120 2020-02-11T16:18:32.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.603+0000 7fe8ec7e9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e4135410 con 0x7fe8e40a39e0 2020-02-11T16:18:32.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.603+0000 7fe8ec7e9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e412ac60 con 0x7fe8e40a3e70 2020-02-11T16:18:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8ea585700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8e40a39e0 0x7fe8e4135e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8ea585700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8e40a39e0 0x7fe8e4135e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:42696/0 (socket says 172.21.15.88:42696) 2020-02-11T16:18:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8ea585700 1 -- 172.21.15.88:0/738874606 learned_addr learned my addr 172.21.15.88:0/738874606 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8ead86700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe8e40a7120 0x7fe8e4133a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:36122/0 (socket says 172.21.15.88:36122) 2020-02-11T16:18:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8ea585700 1 -- 172.21.15.88:0/738874606 >> v2:172.21.15.52:3300/0 conn(0x7fe8e40a39e0 msgr2=0x7fe8e4135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:18:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8ea585700 1 -- 172.21.15.88:0/738874606 >> v2:172.21.15.52:3300/0 conn(0x7fe8e40a39e0 msgr2=0x7fe8e4135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:18:32.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8ea585700 1 --2- 172.21.15.88:0/738874606 >> v2:172.21.15.52:3300/0 conn(0x7fe8e40a39e0 0x7fe8e4135e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:18:32.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8ea585700 1 --2- 172.21.15.88:0/738874606 >> v2:172.21.15.52:3300/0 conn(0x7fe8e40a39e0 0x7fe8e4135e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:32.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 -- 172.21.15.88:0/738874606 >> v2:172.21.15.52:3300/0 conn(0x7fe8e40a39e0 msgr2=0x7fe8e4135e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:18:32.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> v2:172.21.15.52:3300/0 conn(0x7fe8e40a39e0 0x7fe8e4135e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:32.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 -- 172.21.15.88:0/738874606 >> v1:172.21.15.52:6789/0 conn(0x7fe8e40a7120 legacy=0x7fe8e4133a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:32.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 -- 172.21.15.88:0/738874606 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e412af00 con 0x7fe8e40a3e70 2020-02-11T16:18:32.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:32.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8d37fe700 1 -- 172.21.15.88:0/738874606 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8d400cc00 con 0x7fe8e40a3e70 2020-02-11T16:18:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8d37fe700 1 -- 172.21.15.88:0/738874606 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400cd60 con 0x7fe8e40a3e70 2020-02-11T16:18:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/738874606 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e412a360 con 0x7fe8e40a3e70 2020-02-11T16:18:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8d37fe700 1 -- 172.21.15.88:0/738874606 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8d4012210 con 0x7fe8e40a3e70 2020-02-11T16:18:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.604+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/738874606 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e412ee80 con 0x7fe8e40a3e70 2020-02-11T16:18:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.605+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.605+0000 7fe8d37fe700 1 -- 172.21.15.88:0/738874606 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe8d40064e0 con 0x7fe8e40a3e70 2020-02-11T16:18:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.605+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.605+0000 7fe8d37fe700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8c4039c20 0x7fe8c403c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.605+0000 7fe8d37fe700 1 -- 172.21.15.88:0/738874606 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe8d4049450 con 0x7fe8e40a3e70 2020-02-11T16:18:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.605+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/738874606 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e40a5320 con 0x7fe8e40a3e70 2020-02-11T16:18:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.606+0000 7fe8ea585700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8c4039c20 0x7fe8c403c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:32.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.606+0000 7fe8ea585700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8c4039c20 0x7fe8c403c0e0 crc :-1 s=READY pgs=327 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:32.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.609+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.610+0000 7fe8d37fe700 1 -- 172.21.15.88:0/738874606 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe8e40a5320 con 0x7fe8e40a3e70 2020-02-11T16:18:32.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.791+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/738874606 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe8e40a5320 con 0x7fe8e40a3e70 2020-02-11T16:18:32.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.791+0000 7fe8e9d84700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:32.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.791+0000 7fe8d37fe700 1 -- 172.21.15.88:0/738874606 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7fe8e40a5320 con 0x7fe8e40a3e70 2020-02-11T16:18:32.794 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:32.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.792+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8c4039c20 msgr2=0x7fe8c403c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:32.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.792+0000 7fe8ec7e9700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8c4039c20 0x7fe8c403c0e0 crc :-1 s=READY pgs=327 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:32.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.792+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 msgr2=0x7fe8e4135800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:32.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.792+0000 7fe8ec7e9700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fe8d40013f0 tx=0x7fe8d40109c0).stop 2020-02-11T16:18:32.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.793+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/738874606 shutdown_connections 2020-02-11T16:18:32.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.793+0000 7fe8ec7e9700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8c4039c20 0x7fe8c403c0e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:32.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.793+0000 7fe8ec7e9700 1 --2- 172.21.15.88:0/738874606 >> v2:172.21.15.52:3300/0 conn(0x7fe8e40a39e0 0x7fe8e4135e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:32.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.793+0000 7fe8ec7e9700 1 --2- 172.21.15.88:0/738874606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8e40a3e70 0x7fe8e4135800 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:32.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.793+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/738874606 >> 172.21.15.88:0/738874606 conn(0x7fe8e409d110 msgr2=0x7fe8e4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:32.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.793+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/738874606 shutdown_connections 2020-02-11T16:18:32.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:32.793+0000 7fe8ec7e9700 1 -- 172.21.15.88:0/738874606 wait complete. 2020-02-11T16:18:32.805 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":104,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:35.805 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:18:35.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.919+0000 7f16e6398700 1 Processor -- start 2020-02-11T16:18:35.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.919+0000 7f16e6398700 1 -- start start 2020-02-11T16:18:35.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.920+0000 7f16e6398700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f16e012ffa0 0x7f16e0141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:35.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.920+0000 7f16e6398700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e00a5560 con 0x7f16e00a7120 2020-02-11T16:18:35.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.920+0000 7f16e6398700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e009e060 con 0x7f16e00a4ec0 2020-02-11T16:18:35.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.920+0000 7f16e6398700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e00a5350 con 0x7f16e012ffa0 2020-02-11T16:18:35.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.920+0000 7f16df7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f16e00a4ec0 0x7f16e012f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44344/0 (socket says 172.21.15.88:44344) 2020-02-11T16:18:35.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.920+0000 7f16df7fe700 1 -- 172.21.15.88:0/143291759 learned_addr learned my addr 172.21.15.88:0/143291759 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:35.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.920+0000 7f16e4935700 1 --2- 172.21.15.88:0/143291759 >> v2:172.21.15.52:3300/0 conn(0x7f16e012ffa0 0x7f16e0141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:35.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512142040 0 0) 0x7f16e009e060 con 0x7f16e00a4ec0 2020-02-11T16:18:35.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16cc003230 con 0x7f16e00a4ec0 2020-02-11T16:18:35.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16e4935700 1 -- 172.21.15.88:0/143291759 >> v2:172.21.15.52:3300/0 conn(0x7f16e012ffa0 msgr2=0x7f16e0141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:18:35.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16e4935700 1 -- 172.21.15.88:0/143291759 >> v2:172.21.15.52:3300/0 conn(0x7f16e012ffa0 msgr2=0x7f16e0141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:18:35.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16e4935700 1 --2- 172.21.15.88:0/143291759 >> v2:172.21.15.52:3300/0 conn(0x7f16e012ffa0 0x7f16e0141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:18:35.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16e4935700 1 --2- 172.21.15.88:0/143291759 >> v2:172.21.15.52:3300/0 conn(0x7f16e012ffa0 0x7f16e0141480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:35.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 700945308 0 0) 0x7f16cc003230 con 0x7f16e00a4ec0 2020-02-11T16:18:35.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 >> v2:172.21.15.52:3300/0 conn(0x7f16e012ffa0 msgr2=0x7f16e0141480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:35.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 --2- 172.21.15.88:0/143291759 >> v2:172.21.15.52:3300/0 conn(0x7f16e012ffa0 0x7f16e0141480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:35.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 >> v1:172.21.15.52:6789/0 conn(0x7f16e00a7120 legacy=0x7f16e00a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:35.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e009e300 con 0x7f16e00a4ec0 2020-02-11T16:18:35.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f16d40016d0 con 0x7f16e00a4ec0 2020-02-11T16:18:35.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 >> v1:172.21.15.88:6789/0 conn(0x7f16e00a4ec0 legacy=0x7f16e012f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:35.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 0x7f16cc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:35.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16cc0044d0 0x7f16cc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:35.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16cc004db0 0x7f16cc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:35.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00a5350 con 0x7f16cc0044d0 2020-02-11T16:18:35.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0041c0 con 0x7f16cc003720 2020-02-11T16:18:35.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc00bb80 con 0x7f16cc004db0 2020-02-11T16:18:35.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16dffff700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 0x7f16cc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:35.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16df7fe700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16cc0044d0 0x7f16cc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:35.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16e4935700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16cc004db0 0x7f16cc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:35.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16dffff700 1 -- 172.21.15.88:0/143291759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16cc004db0 msgr2=0x7f16cc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:35.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16dffff700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16cc004db0 0x7f16cc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:35.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16dffff700 1 -- 172.21.15.88:0/143291759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16cc0044d0 msgr2=0x7f16cc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:35.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16dffff700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16cc0044d0 0x7f16cc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:35.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16dffff700 1 -- 172.21.15.88:0/143291759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc003230 con 0x7f16cc003720 2020-02-11T16:18:35.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16e4935700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16cc004db0 0x7f16cc00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:18:35.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16e4935700 1 -- 172.21.15.88:0/143291759 reap_dead start 2020-02-11T16:18:35.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16dffff700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 0x7f16cc003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f16cc0054a0 tx=0x7f16d000fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16dffff700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 0x7f16cc003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f16cc0054a0 tx=0x7f16d000fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.921+0000 7f16dffff700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 0x7f16cc003b40 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f16cc0054a0 tx=0x7f16d000fd50).ready entity=mon.1 client_cookie=16838ab051fec144 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:35.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16dffff700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 0x7f16cc003b40 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f16cc0054a0 tx=0x7f16d000fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16dffff700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 0x7f16cc003b40 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f16cc0054a0 tx=0x7f16d000fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16d0003540 con 0x7f16cc003720 2020-02-11T16:18:35.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16dffff700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 0x7f16cc003b40 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f16cc0054a0 tx=0x7f16d000fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d00036e0 con 0x7f16cc003720 2020-02-11T16:18:35.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16deffd700 1 -- 172.21.15.88:0/143291759 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16d0003ac0 con 0x7f16cc003720 2020-02-11T16:18:35.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16e6398700 1 -- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 msgr2=0x7f16cc003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:35.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16e6398700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 0x7f16cc003b40 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f16cc0054a0 tx=0x7f16d000fd50).stop 2020-02-11T16:18:35.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16e6398700 1 -- 172.21.15.88:0/143291759 shutdown_connections 2020-02-11T16:18:35.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16e6398700 1 --2- 172.21.15.88:0/143291759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc003720 0x7f16cc003b40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:35.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16e6398700 1 -- 172.21.15.88:0/143291759 >> 172.21.15.88:0/143291759 conn(0x7f16e009d110 msgr2=0x7f16e009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:35.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16e6398700 1 -- 172.21.15.88:0/143291759 shutdown_connections 2020-02-11T16:18:35.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.922+0000 7f16e6398700 1 -- 172.21.15.88:0/143291759 wait complete. 2020-02-11T16:18:35.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.923+0000 7f16e6398700 1 Processor -- start 2020-02-11T16:18:35.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.923+0000 7f16e6398700 1 -- start start 2020-02-11T16:18:35.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e6398700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:35.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e6398700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e00a2430 con 0x7f16e00a2d10 2020-02-11T16:18:35.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e6398700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e00a9460 con 0x7f16cc003720 2020-02-11T16:18:35.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e6398700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00a2870 con 0x7f16e00a8fb0 2020-02-11T16:18:35.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16dffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f16cc003720 0x7f16e0065490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44356/0 (socket says 172.21.15.88:44356) 2020-02-11T16:18:35.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16dffff700 1 -- 172.21.15.88:0/1981105525 learned_addr learned my addr 172.21.15.88:0/1981105525 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:35.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16dd7fa700 1 -- 172.21.15.88:0/1981105525 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369983642 0 0) 0x7f16e00a9460 con 0x7f16cc003720 2020-02-11T16:18:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16dd7fa700 1 -- 172.21.15.88:0/1981105525 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c0002fe0 con 0x7f16cc003720 2020-02-11T16:18:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e4935700 1 -- 172.21.15.88:0/1981105525 >> v1:172.21.15.88:6789/0 conn(0x7f16cc003720 legacy=0x7f16e0065490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16dd7fa700 1 -- 172.21.15.88:0/1981105525 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 761423064 0 0) 0x7f16c0002fe0 con 0x7f16cc003720 2020-02-11T16:18:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e4935700 1 -- 172.21.15.88:0/1981105525 >> v1:172.21.15.52:6789/0 conn(0x7f16e00a2d10 legacy=0x7f16e0129eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e4935700 1 -- 172.21.15.88:0/1981105525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e00a4780 con 0x7f16e00a8fb0 2020-02-11T16:18:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.924+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:35.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16dd7fa700 1 -- 172.21.15.88:0/1981105525 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16d8005c30 con 0x7f16e00a8fb0 2020-02-11T16:18:35.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16dd7fa700 1 -- 172.21.15.88:0/1981105525 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d0001040 con 0x7f16e00a8fb0 2020-02-11T16:18:35.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16dd7fa700 1 -- 172.21.15.88:0/1981105525 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16d8007150 con 0x7f16e00a8fb0 2020-02-11T16:18:35.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16e6398700 1 -- 172.21.15.88:0/1981105525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e00a7770 con 0x7f16e00a8fb0 2020-02-11T16:18:35.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16e6398700 1 -- 172.21.15.88:0/1981105525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e00a2120 con 0x7f16e00a8fb0 2020-02-11T16:18:35.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16dd7fa700 1 -- 172.21.15.88:0/1981105525 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f16d8010170 con 0x7f16e00a8fb0 2020-02-11T16:18:35.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.925+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.926+0000 7f16e6398700 1 -- 172.21.15.88:0/1981105525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e00565b0 con 0x7f16e00a8fb0 2020-02-11T16:18:35.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.926+0000 7f16dd7fa700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f16c0039ea0 0x7f16c003c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:35.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.926+0000 7f16dd7fa700 1 -- 172.21.15.88:0/1981105525 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f16d8049290 con 0x7f16e00a8fb0 2020-02-11T16:18:35.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.926+0000 7f16dffff700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f16c0039ea0 0x7f16c003c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:35.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.926+0000 7f16dffff700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f16c0039ea0 0x7f16c003c360 crc :-1 s=READY pgs=328 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:35.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.929+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:35.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:35.929+0000 7f16dd7fa700 1 -- 172.21.15.88:0/1981105525 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f16d802e910 con 0x7f16e00a8fb0 2020-02-11T16:18:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.109+0000 7f16e6398700 1 -- 172.21.15.88:0/1981105525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f16e00a29b0 con 0x7f16e00a8fb0 2020-02-11T16:18:36.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.110+0000 7f16e4935700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:36.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.110+0000 7f16dd7fa700 1 -- 172.21.15.88:0/1981105525 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f16d80313c0 con 0x7f16e00a8fb0 2020-02-11T16:18:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.111+0000 7f16e6398700 1 -- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f16c0039ea0 msgr2=0x7f16c003c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.111+0000 7f16e6398700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f16c0039ea0 0x7f16c003c360 crc :-1 s=READY pgs=328 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.111+0000 7f16e6398700 1 -- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 msgr2=0x7f16e012a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.111+0000 7f16e6398700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f16d0000f50 tx=0x7f16d800c280).stop 2020-02-11T16:18:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.111+0000 7f16e6398700 1 -- 172.21.15.88:0/1981105525 shutdown_connections 2020-02-11T16:18:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.111+0000 7f16e6398700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f16c0039ea0 0x7f16c003c360 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.111+0000 7f16e6398700 1 --2- 172.21.15.88:0/1981105525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f16e00a8fb0 0x7f16e012a5c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.111+0000 7f16e6398700 1 -- 172.21.15.88:0/1981105525 >> 172.21.15.88:0/1981105525 conn(0x7f16e009d110 msgr2=0x7f16e0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.112+0000 7f16e6398700 1 -- 172.21.15.88:0/1981105525 shutdown_connections 2020-02-11T16:18:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:36.112+0000 7f16e6398700 1 -- 172.21.15.88:0/1981105525 wait complete. 2020-02-11T16:18:36.123 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":104,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:39.124 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:18:39.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.237+0000 7f45a0f26700 1 Processor -- start 2020-02-11T16:18:39.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.237+0000 7f45a0f26700 1 -- start start 2020-02-11T16:18:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.238+0000 7f45a0f26700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f459c0a4ec0 0x7f459c12f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.238+0000 7f45a0f26700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f459c12fcf0 0x7f459c140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.238+0000 7f45a0f26700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c0a5560 con 0x7f459c0a7120 2020-02-11T16:18:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.238+0000 7f45a0f26700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c0a5350 con 0x7f459c12fcf0 2020-02-11T16:18:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.238+0000 7f45a0f26700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c09e060 con 0x7f459c0a4ec0 2020-02-11T16:18:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.238+0000 7f4599d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f459c0a4ec0 0x7f459c12f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.238+0000 7f4599d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f459c0a4ec0 0x7f459c12f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56738/0 (socket says 172.21.15.88:56738) 2020-02-11T16:18:39.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.238+0000 7f4599d9b700 1 -- 172.21.15.88:0/3924488070 learned_addr learned my addr 172.21.15.88:0/3924488070 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:39.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.238+0000 7f459ad9d700 1 --2- 172.21.15.88:0/3924488070 >> v2:172.21.15.52:3300/0 conn(0x7f459c12fcf0 0x7f459c140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:39.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f4599d9b700 1 -- 172.21.15.88:0/3924488070 >> v2:172.21.15.52:3300/0 conn(0x7f459c12fcf0 msgr2=0x7f459c140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:39.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f4599d9b700 1 --2- 172.21.15.88:0/3924488070 >> v2:172.21.15.52:3300/0 conn(0x7f459c12fcf0 0x7f459c140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:39.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f4599d9b700 1 -- 172.21.15.88:0/3924488070 >> v1:172.21.15.52:6789/0 conn(0x7f459c0a7120 legacy=0x7f459c0a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:39.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f4599d9b700 1 -- 172.21.15.88:0/3924488070 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c09e300 con 0x7f459c0a4ec0 2020-02-11T16:18:39.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f4599d9b700 1 --2- 172.21.15.88:0/3924488070 >> v2:172.21.15.88:3300/0 conn(0x7f459c0a4ec0 0x7f459c12f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f458c002f30 tx=0x7f458c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f4599d9b700 1 --2- 172.21.15.88:0/3924488070 >> v2:172.21.15.88:3300/0 conn(0x7f459c0a4ec0 0x7f459c12f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f458c002f30 tx=0x7f458c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f4599d9b700 1 --2- 172.21.15.88:0/3924488070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f459c0a4ec0 0x7f459c12f890 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f458c002f30 tx=0x7f458c007a40).ready entity=mon.1 client_cookie=689de3b6092ba82a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:39.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f4599d9b700 1 --2- 172.21.15.88:0/3924488070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f459c0a4ec0 0x7f459c12f890 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f458c002f30 tx=0x7f458c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f459959a700 1 -- 172.21.15.88:0/3924488070 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f458c011720 con 0x7f459c0a4ec0 2020-02-11T16:18:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f4599d9b700 1 --2- 172.21.15.88:0/3924488070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f459c0a4ec0 0x7f459c12f890 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f458c002f30 tx=0x7f458c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f459959a700 1 -- 172.21.15.88:0/3924488070 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c011880 con 0x7f459c0a4ec0 2020-02-11T16:18:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f4599d9b700 1 --2- 172.21.15.88:0/3924488070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f459c0a4ec0 0x7f459c12f890 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f458c002f30 tx=0x7f458c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f459959a700 1 -- 172.21.15.88:0/3924488070 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f458c011c60 con 0x7f459c0a4ec0 2020-02-11T16:18:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f45a0f26700 1 -- 172.21.15.88:0/3924488070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f459c0a4ec0 msgr2=0x7f459c12f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f45a0f26700 1 --2- 172.21.15.88:0/3924488070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f459c0a4ec0 0x7f459c12f890 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f458c002f30 tx=0x7f458c007a40).stop 2020-02-11T16:18:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f45a0f26700 1 -- 172.21.15.88:0/3924488070 shutdown_connections 2020-02-11T16:18:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f45a0f26700 1 --2- 172.21.15.88:0/3924488070 >> v2:172.21.15.52:3300/0 conn(0x7f459c12fcf0 0x7f459c140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f45a0f26700 1 --2- 172.21.15.88:0/3924488070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f459c0a4ec0 0x7f459c12f890 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f45a0f26700 1 -- 172.21.15.88:0/3924488070 >> 172.21.15.88:0/3924488070 conn(0x7f459c09d110 msgr2=0x7f459c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f45a0f26700 1 -- 172.21.15.88:0/3924488070 shutdown_connections 2020-02-11T16:18:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.239+0000 7f45a0f26700 1 -- 172.21.15.88:0/3924488070 wait complete. 2020-02-11T16:18:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.240+0000 7f45a0f26700 1 Processor -- start 2020-02-11T16:18:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.240+0000 7f45a0f26700 1 -- start start 2020-02-11T16:18:39.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f45a0f26700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f45a0f26700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c1358d0 con 0x7f459c0a7120 2020-02-11T16:18:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f45a0f26700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c136130 con 0x7f459c12fcf0 2020-02-11T16:18:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f45a0f26700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c0a99d0 con 0x7f459c0a4ec0 2020-02-11T16:18:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f459ad9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f459c12fcf0 0x7f459c146660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44374/0 (socket says 172.21.15.88:44374) 2020-02-11T16:18:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f459ad9d700 1 -- 172.21.15.88:0/678815612 learned_addr learned my addr 172.21.15.88:0/678815612 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f45937fe700 1 -- 172.21.15.88:0/678815612 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832850917 0 0) 0x7f459c136130 con 0x7f459c12fcf0 2020-02-11T16:18:39.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f45937fe700 1 -- 172.21.15.88:0/678815612 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4580002fe0 con 0x7f459c12fcf0 2020-02-11T16:18:39.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f459a59c700 1 -- 172.21.15.88:0/678815612 >> v1:172.21.15.88:6789/0 conn(0x7f459c12fcf0 legacy=0x7f459c146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:39.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f459a59c700 1 -- 172.21.15.88:0/678815612 >> v1:172.21.15.52:6789/0 conn(0x7f459c0a7120 legacy=0x7f459c1273b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:39.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f459a59c700 1 -- 172.21.15.88:0/678815612 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0a9c70 con 0x7f459c0a4ec0 2020-02-11T16:18:39.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.241+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:39.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f45937fe700 1 -- 172.21.15.88:0/678815612 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4584006bc0 con 0x7f459c0a4ec0 2020-02-11T16:18:39.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f45937fe700 1 -- 172.21.15.88:0/678815612 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4584006d60 con 0x7f459c0a4ec0 2020-02-11T16:18:39.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f45a0f26700 1 -- 172.21.15.88:0/678815612 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c0a95a0 con 0x7f459c0a4ec0 2020-02-11T16:18:39.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f45937fe700 1 -- 172.21.15.88:0/678815612 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4584011100 con 0x7f459c0a4ec0 2020-02-11T16:18:39.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f45a0f26700 1 -- 172.21.15.88:0/678815612 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c127c80 con 0x7f459c0a4ec0 2020-02-11T16:18:39.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.242+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.243+0000 7f45937fe700 1 -- 172.21.15.88:0/678815612 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4584011380 con 0x7f459c0a4ec0 2020-02-11T16:18:39.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.243+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.243+0000 7f45937fe700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4580039ef0 0x7f458003c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:39.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.243+0000 7f45937fe700 1 -- 172.21.15.88:0/678815612 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4584049950 con 0x7f459c0a4ec0 2020-02-11T16:18:39.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.243+0000 7f45a0f26700 1 -- 172.21.15.88:0/678815612 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c1463c0 con 0x7f459c0a4ec0 2020-02-11T16:18:39.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.243+0000 7f4599d9b700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4580039ef0 0x7f458003c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:39.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.243+0000 7f4599d9b700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4580039ef0 0x7f458003c3b0 crc :-1 s=READY pgs=329 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:39.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.247+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.247+0000 7f45937fe700 1 -- 172.21.15.88:0/678815612 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f459c1463c0 con 0x7f459c0a4ec0 2020-02-11T16:18:39.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.426+0000 7f45a0f26700 1 -- 172.21.15.88:0/678815612 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f459c1463c0 con 0x7f459c0a4ec0 2020-02-11T16:18:39.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.427+0000 7f459a59c700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:39.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.427+0000 7f45937fe700 1 -- 172.21.15.88:0/678815612 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f459c1463c0 con 0x7f459c0a4ec0 2020-02-11T16:18:39.428 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":27,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:39.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.428+0000 7f45a0f26700 1 -- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4580039ef0 msgr2=0x7f458003c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:39.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.428+0000 7f45a0f26700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4580039ef0 0x7f458003c3b0 crc :-1 s=READY pgs=329 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:39.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.428+0000 7f45a0f26700 1 -- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 msgr2=0x7f459c135470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:39.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.428+0000 7f45a0f26700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f459c05ee60 tx=0x7f45840108e0).stop 2020-02-11T16:18:39.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.428+0000 7f45a0f26700 1 -- 172.21.15.88:0/678815612 shutdown_connections 2020-02-11T16:18:39.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.428+0000 7f45a0f26700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4580039ef0 0x7f458003c3b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:39.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.428+0000 7f45a0f26700 1 --2- 172.21.15.88:0/678815612 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f459c0a4ec0 0x7f459c135470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:39.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.428+0000 7f45a0f26700 1 -- 172.21.15.88:0/678815612 >> 172.21.15.88:0/678815612 conn(0x7f459c09d110 msgr2=0x7f459c0a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:39.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.428+0000 7f45a0f26700 1 -- 172.21.15.88:0/678815612 shutdown_connections 2020-02-11T16:18:39.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:39.428+0000 7f45a0f26700 1 -- 172.21.15.88:0/678815612 wait complete. 2020-02-11T16:18:39.439 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":104,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":27,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:42.441 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:18:42.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.555+0000 7f4ec2118700 1 Processor -- start 2020-02-11T16:18:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.555+0000 7f4ec2118700 1 -- start start 2020-02-11T16:18:42.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ec2118700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ebc0a5b20 0x7f4ebc0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ec2118700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ebc131280 0x7f4ebc1316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ec2118700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc0a4350 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ec2118700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ebc0a1e60 con 0x7f4ebc0a5b20 2020-02-11T16:18:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ec2118700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ebc0a3450 con 0x7f4ebc131280 2020-02-11T16:18:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ebc131280 0x7f4ebc1316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ebc131280 0x7f4ebc1316f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56758/0 (socket says 172.21.15.88:56758) 2020-02-11T16:18:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 -- 172.21.15.88:0/866436069 learned_addr learned my addr 172.21.15.88:0/866436069 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebaffd700 1 --2- 172.21.15.88:0/866436069 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc0a5b20 0x7f4ebc0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 -- 172.21.15.88:0/866436069 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc0a5b20 msgr2=0x7f4ebc0a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 --2- 172.21.15.88:0/866436069 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc0a5b20 0x7f4ebc0a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 -- 172.21.15.88:0/866436069 >> v1:172.21.15.88:6789/0 conn(0x7f4ebc0a2fa0 legacy=0x7f4ebc0a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 -- 172.21.15.88:0/866436069 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc0a3a40 con 0x7f4ebc131280 2020-02-11T16:18:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebaffd700 1 --2- 172.21.15.88:0/866436069 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc0a5b20 0x7f4ebc0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:18:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 --2- 172.21.15.88:0/866436069 >> v2:172.21.15.88:3300/0 conn(0x7f4ebc131280 0x7f4ebc1316f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4eb4002f30 tx=0x7f4eb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 --2- 172.21.15.88:0/866436069 >> v2:172.21.15.88:3300/0 conn(0x7f4ebc131280 0x7f4ebc1316f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4eb4002f30 tx=0x7f4eb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 --2- 172.21.15.88:0/866436069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc131280 0x7f4ebc1316f0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f4eb4002f30 tx=0x7f4eb4007a40).ready entity=mon.1 client_cookie=5432c2d75061f5c2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:42.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 --2- 172.21.15.88:0/866436069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc131280 0x7f4ebc1316f0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f4eb4002f30 tx=0x7f4eb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4eba7fc700 1 -- 172.21.15.88:0/866436069 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb4011720 con 0x7f4ebc131280 2020-02-11T16:18:42.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 --2- 172.21.15.88:0/866436069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc131280 0x7f4ebc1316f0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f4eb4002f30 tx=0x7f4eb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ebbfff700 1 --2- 172.21.15.88:0/866436069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc131280 0x7f4ebc1316f0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f4eb4002f30 tx=0x7f4eb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4eba7fc700 1 -- 172.21.15.88:0/866436069 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb4011880 con 0x7f4ebc131280 2020-02-11T16:18:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4eba7fc700 1 -- 172.21.15.88:0/866436069 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb4011c20 con 0x7f4ebc131280 2020-02-11T16:18:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ec2118700 1 -- 172.21.15.88:0/866436069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc131280 msgr2=0x7f4ebc1316f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.556+0000 7f4ec2118700 1 --2- 172.21.15.88:0/866436069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc131280 0x7f4ebc1316f0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f4eb4002f30 tx=0x7f4eb4007a40).stop 2020-02-11T16:18:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.557+0000 7f4ec2118700 1 -- 172.21.15.88:0/866436069 shutdown_connections 2020-02-11T16:18:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.557+0000 7f4ec2118700 1 --2- 172.21.15.88:0/866436069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc131280 0x7f4ebc1316f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.557+0000 7f4ec2118700 1 --2- 172.21.15.88:0/866436069 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc0a5b20 0x7f4ebc0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.557+0000 7f4ec2118700 1 -- 172.21.15.88:0/866436069 >> 172.21.15.88:0/866436069 conn(0x7f4ebc09d110 msgr2=0x7f4ebc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.557+0000 7f4ec2118700 1 -- 172.21.15.88:0/866436069 shutdown_connections 2020-02-11T16:18:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.557+0000 7f4ec2118700 1 -- 172.21.15.88:0/866436069 wait complete. 2020-02-11T16:18:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.558+0000 7f4ec2118700 1 Processor -- start 2020-02-11T16:18:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.558+0000 7f4ec2118700 1 -- start start 2020-02-11T16:18:42.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ec2118700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:42.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ec2118700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ebc131280 0x7f4ebc0669a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:42.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ec2118700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc0a0450 con 0x7f4ebc0a5b20 2020-02-11T16:18:42.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ec2118700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ebc0a0240 con 0x7f4ebc131280 2020-02-11T16:18:42.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ec2118700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ebc0617f0 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:42.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56760/0 (socket says 172.21.15.88:56760) 2020-02-11T16:18:42.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebaffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4ebc0a5b20 0x7f4ebc066290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44388/0 (socket says 172.21.15.88:44388) 2020-02-11T16:18:42.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 -- 172.21.15.88:0/3793496573 learned_addr learned my addr 172.21.15.88:0/3793496573 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:42.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebbfff700 1 --2- 172.21.15.88:0/3793496573 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc131280 0x7f4ebc0669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:42.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 -- 172.21.15.88:0/3793496573 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc131280 msgr2=0x7f4ebc0669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:42.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebbfff700 1 -- 172.21.15.88:0/3793496573 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc131280 msgr2=0x7f4ebc0669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:18:42.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebbfff700 1 -- 172.21.15.88:0/3793496573 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc131280 msgr2=0x7f4ebc0669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:18:42.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebbfff700 1 --2- 172.21.15.88:0/3793496573 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc131280 0x7f4ebc0669a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:18:42.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebbfff700 1 --2- 172.21.15.88:0/3793496573 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc131280 0x7f4ebc0669a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:42.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc131280 0x7f4ebc0669a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:42.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 -- 172.21.15.88:0/3793496573 >> v1:172.21.15.88:6789/0 conn(0x7f4ebc0a5b20 legacy=0x7f4ebc066290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 -- 172.21.15.88:0/3793496573 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc0a5010 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> v2:172.21.15.88:3300/0 conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> v2:172.21.15.88:3300/0 conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4eb8ff9700 1 -- 172.21.15.88:0/3793496573 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eac00cbf0 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4eb8ff9700 1 -- 172.21.15.88:0/3793496573 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac00cd50 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ec2118700 1 -- 172.21.15.88:0/3793496573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ebc0a0f00 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4eb8ff9700 1 -- 172.21.15.88:0/3793496573 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eac0122c0 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.559+0000 7f4ec2118700 1 -- 172.21.15.88:0/3793496573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ebc09fd80 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.560+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.560+0000 7f4eb8ff9700 1 -- 172.21.15.88:0/3793496573 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4eac012540 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.560+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.560+0000 7f4eb8ff9700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea0039bf0 0x7f4ea003c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:42.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.560+0000 7f4ec2118700 1 -- 172.21.15.88:0/3793496573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ebc0565b0 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.560+0000 7f4eb8ff9700 1 -- 172.21.15.88:0/3793496573 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4eac049830 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.560+0000 7f4ebaffd700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea0039bf0 0x7f4ea003c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:42.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.561+0000 7f4ebaffd700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea0039bf0 0x7f4ea003c0b0 crc :-1 s=READY pgs=330 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:42.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.564+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.564+0000 7f4eb8ff9700 1 -- 172.21.15.88:0/3793496573 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4eac02ee50 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.745+0000 7f4ec2118700 1 -- 172.21.15.88:0/3793496573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4ebc05ccb0 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.745+0000 7f4ebb7fe700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:42.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.745+0000 7f4eb8ff9700 1 -- 172.21.15.88:0/3793496573 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f4eac031960 con 0x7f4ebc0a2fa0 2020-02-11T16:18:42.748 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":30,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:42.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 -- 172.21.15.88:0/3793496573 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea0039bf0 msgr2=0x7f4ea003c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:42.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea0039bf0 0x7f4ea003c0b0 crc :-1 s=READY pgs=330 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:42.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 -- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 msgr2=0x7f4ebc061d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:42.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f4ebc05ef00 tx=0x7f4eac010a70).stop 2020-02-11T16:18:42.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 -- 172.21.15.88:0/3793496573 shutdown_connections 2020-02-11T16:18:42.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea0039bf0 0x7f4ea003c0b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:42.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 --2- 172.21.15.88:0/3793496573 >> v2:172.21.15.52:3300/0 conn(0x7f4ebc131280 0x7f4ebc0669a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:42.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 --2- 172.21.15.88:0/3793496573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ebc0a2fa0 0x7f4ebc061d00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:42.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 -- 172.21.15.88:0/3793496573 >> 172.21.15.88:0/3793496573 conn(0x7f4ebc09d110 msgr2=0x7f4ebc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:42.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 -- 172.21.15.88:0/3793496573 shutdown_connections 2020-02-11T16:18:42.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:42.747+0000 7f4ec2118700 1 -- 172.21.15.88:0/3793496573 wait complete. 2020-02-11T16:18:42.759 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":104,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":30,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:43.820 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:18:43.823 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:18:45.760 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:18:45.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.873+0000 7f704e39b700 1 Processor -- start 2020-02-11T16:18:45.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.873+0000 7f704e39b700 1 -- start start 2020-02-11T16:18:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f704e39b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 0x7f7048141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f704e39b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70480a5560 con 0x7f70480a7120 2020-02-11T16:18:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f704e39b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704809e060 con 0x7f70480a4ec0 2020-02-11T16:18:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f704e39b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70480a5350 con 0x7f704812ffa0 2020-02-11T16:18:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f70477fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f70480a4ec0 0x7f704812f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44396/0 (socket says 172.21.15.88:44396) 2020-02-11T16:18:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f70477fe700 1 -- 172.21.15.88:0/3624602159 learned_addr learned my addr 172.21.15.88:0/3624602159 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f704c938700 1 --2- 172.21.15.88:0/3624602159 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 0x7f7048141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f7046ffd700 1 -- 172.21.15.88:0/3624602159 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170756106 0 0) 0x7f704809e060 con 0x7f70480a4ec0 2020-02-11T16:18:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f7046ffd700 1 -- 172.21.15.88:0/3624602159 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7034003230 con 0x7f70480a4ec0 2020-02-11T16:18:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f7046ffd700 1 -- 172.21.15.88:0/3624602159 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661733804 0 0) 0x7f70480a5560 con 0x7f70480a7120 2020-02-11T16:18:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f7046ffd700 1 -- 172.21.15.88:0/3624602159 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f704809e060 con 0x7f70480a7120 2020-02-11T16:18:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f704c938700 1 -- 172.21.15.88:0/3624602159 >> v1:172.21.15.88:6789/0 conn(0x7f70480a4ec0 legacy=0x7f704812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f704c938700 1 -- 172.21.15.88:0/3624602159 >> v1:172.21.15.52:6789/0 conn(0x7f70480a7120 legacy=0x7f70480a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.874+0000 7f704c938700 1 -- 172.21.15.88:0/3624602159 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704809e300 con 0x7f704812ffa0 2020-02-11T16:18:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704c938700 1 --2- 172.21.15.88:0/3624602159 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 0x7f7048141480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70400032b0 tx=0x7f7040008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704c938700 1 --2- 172.21.15.88:0/3624602159 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 0x7f7048141480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70400032b0 tx=0x7f7040008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704c938700 1 --2- 172.21.15.88:0/3624602159 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 0x7f7048141480 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f70400032b0 tx=0x7f7040008c60).ready entity=mon.2 client_cookie=593ca592d44377a0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704c938700 1 --2- 172.21.15.88:0/3624602159 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 0x7f7048141480 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f70400032b0 tx=0x7f7040008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f7046ffd700 1 -- 172.21.15.88:0/3624602159 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7040011db0 con 0x7f704812ffa0 2020-02-11T16:18:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704c938700 1 --2- 172.21.15.88:0/3624602159 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 0x7f7048141480 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f70400032b0 tx=0x7f7040008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704c938700 1 --2- 172.21.15.88:0/3624602159 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 0x7f7048141480 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f70400032b0 tx=0x7f7040008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f7046ffd700 1 -- 172.21.15.88:0/3624602159 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704000a160 con 0x7f704812ffa0 2020-02-11T16:18:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f7046ffd700 1 -- 172.21.15.88:0/3624602159 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704000a4c0 con 0x7f704812ffa0 2020-02-11T16:18:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704e39b700 1 -- 172.21.15.88:0/3624602159 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 msgr2=0x7f7048141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704e39b700 1 --2- 172.21.15.88:0/3624602159 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 0x7f7048141480 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f70400032b0 tx=0x7f7040008c60).stop 2020-02-11T16:18:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704e39b700 1 -- 172.21.15.88:0/3624602159 shutdown_connections 2020-02-11T16:18:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704e39b700 1 --2- 172.21.15.88:0/3624602159 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f704812ffa0 0x7f7048141480 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704e39b700 1 -- 172.21.15.88:0/3624602159 >> 172.21.15.88:0/3624602159 conn(0x7f704809d110 msgr2=0x7f704809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704e39b700 1 -- 172.21.15.88:0/3624602159 shutdown_connections 2020-02-11T16:18:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.875+0000 7f704e39b700 1 -- 172.21.15.88:0/3624602159 wait complete. 2020-02-11T16:18:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.876+0000 7f704e39b700 1 Processor -- start 2020-02-11T16:18:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.876+0000 7f704e39b700 1 -- start start 2020-02-11T16:18:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f704e39b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70480a4ec0 0x7f7048138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f704e39b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70480a7120 0x7f7048127550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f704e39b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7048139d70 con 0x7f704812ffa0 2020-02-11T16:18:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f704e39b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7048128d20 con 0x7f70480a4ec0 2020-02-11T16:18:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f704e39b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7048139ad0 con 0x7f70480a7120 2020-02-11T16:18:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f7047fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70480a4ec0 0x7f7048138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f7047fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70480a4ec0 0x7f7048138770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56774/0 (socket says 172.21.15.88:56774) 2020-02-11T16:18:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f7047fff700 1 -- 172.21.15.88:0/795239875 learned_addr learned my addr 172.21.15.88:0/795239875 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f70477fe700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70480a7120 0x7f7048127550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f7047fff700 1 -- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70480a7120 msgr2=0x7f7048127550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70480a7120 0x7f7048127550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f7047fff700 1 -- 172.21.15.88:0/795239875 >> v1:172.21.15.52:6789/0 conn(0x7f704812ffa0 legacy=0x7f70481279b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f7047fff700 1 -- 172.21.15.88:0/795239875 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7048129bf0 con 0x7f70480a4ec0 2020-02-11T16:18:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.877+0000 7f70477fe700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70480a7120 0x7f7048127550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:18:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> v2:172.21.15.88:3300/0 conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> v2:172.21.15.88:3300/0 conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f70457fa700 1 -- 172.21.15.88:0/795239875 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f703800cc20 con 0x7f70480a4ec0 2020-02-11T16:18:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f70457fa700 1 -- 172.21.15.88:0/795239875 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703800cdc0 con 0x7f70480a4ec0 2020-02-11T16:18:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f704e39b700 1 -- 172.21.15.88:0/795239875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704812f1d0 con 0x7f70480a4ec0 2020-02-11T16:18:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f70457fa700 1 -- 172.21.15.88:0/795239875 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f703800e350 con 0x7f70480a4ec0 2020-02-11T16:18:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f704e39b700 1 -- 172.21.15.88:0/795239875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704812bdc0 con 0x7f70480a4ec0 2020-02-11T16:18:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.878+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.879+0000 7f70457fa700 1 -- 172.21.15.88:0/795239875 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f703800e5c0 con 0x7f70480a4ec0 2020-02-11T16:18:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.879+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.879+0000 7f70457fa700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7028039c50 0x7f702803c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.879+0000 7f704e39b700 1 -- 172.21.15.88:0/795239875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7048129d80 con 0x7f70480a4ec0 2020-02-11T16:18:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.879+0000 7f70457fa700 1 -- 172.21.15.88:0/795239875 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7038049940 con 0x7f70480a4ec0 2020-02-11T16:18:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.879+0000 7f70477fe700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7028039c50 0x7f702803c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.879+0000 7f70477fe700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7028039c50 0x7f702803c110 crc :-1 s=READY pgs=331 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.882+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:45.882+0000 7f70457fa700 1 -- 172.21.15.88:0/795239875 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f703802edb0 con 0x7f70480a4ec0 2020-02-11T16:18:46.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.062+0000 7f704e39b700 1 -- 172.21.15.88:0/795239875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f70480565b0 con 0x7f70480a4ec0 2020-02-11T16:18:46.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.062+0000 7f7047fff700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.062+0000 7f70457fa700 1 -- 172.21.15.88:0/795239875 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f7038031a90 con 0x7f70480a4ec0 2020-02-11T16:18:46.065 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:46.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 -- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7028039c50 msgr2=0x7f702803c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7028039c50 0x7f702803c110 crc :-1 s=READY pgs=331 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 -- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 msgr2=0x7f7048138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 0x7f7048138770 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f70481392d0 tx=0x7f7038002490).stop 2020-02-11T16:18:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 -- 172.21.15.88:0/795239875 shutdown_connections 2020-02-11T16:18:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7028039c50 0x7f702803c110 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70480a4ec0 0x7f7048138770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 --2- 172.21.15.88:0/795239875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70480a7120 0x7f7048127550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 -- 172.21.15.88:0/795239875 >> 172.21.15.88:0/795239875 conn(0x7f704809d110 msgr2=0x7f70480a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 -- 172.21.15.88:0/795239875 shutdown_connections 2020-02-11T16:18:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.063+0000 7f704e39b700 1 -- 172.21.15.88:0/795239875 wait complete. 2020-02-11T16:18:46.076 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":108,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:46.076 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:18:46.076 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:18:46.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.180+0000 7f8092d7c700 1 Processor -- start 2020-02-11T16:18:46.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.180+0000 7f8092d7c700 1 -- start start 2020-02-11T16:18:46.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8092d7c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f808c0a7120 0x7f808c0a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8092d7c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f808c0a50f0 0x7f808c0a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8092d7c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808c13c120 0x7f808c13c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8092d7c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c0a6470 con 0x7f808c0a50f0 2020-02-11T16:18:46.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8092d7c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c0a49b0 con 0x7f808c0a7120 2020-02-11T16:18:46.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8092d7c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0a4c50 con 0x7f808c13c120 2020-02-11T16:18:46.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f808c0a7120 0x7f808c0a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f808c0a7120 0x7f808c0a2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56782/0 (socket says 172.21.15.88:56782) 2020-02-11T16:18:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 -- 172.21.15.88:0/4217040320 learned_addr learned my addr 172.21.15.88:0/4217040320 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8091319700 1 --2- 172.21.15.88:0/4217040320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808c13c120 0x7f808c13c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f808bfff700 1 --2- 172.21.15.88:0/4217040320 >> v2:172.21.15.52:3300/0 conn(0x7f808c0a50f0 0x7f808c0a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 -- 172.21.15.88:0/4217040320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808c13c120 msgr2=0x7f808c13c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 --2- 172.21.15.88:0/4217040320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808c13c120 0x7f808c13c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 -- 172.21.15.88:0/4217040320 >> v2:172.21.15.52:3300/0 conn(0x7f808c0a50f0 msgr2=0x7f808c0a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:46.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 --2- 172.21.15.88:0/4217040320 >> v2:172.21.15.52:3300/0 conn(0x7f808c0a50f0 0x7f808c0a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 -- 172.21.15.88:0/4217040320 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0a55a0 con 0x7f808c0a7120 2020-02-11T16:18:46.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 --2- 172.21.15.88:0/4217040320 >> v2:172.21.15.88:3300/0 conn(0x7f808c0a7120 0x7f808c0a2900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 --2- 172.21.15.88:0/4217040320 >> v2:172.21.15.88:3300/0 conn(0x7f808c0a7120 0x7f808c0a2900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 --2- 172.21.15.88:0/4217040320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a7120 0x7f808c0a2900 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).ready entity=mon.1 client_cookie=b5baca141d696d61 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 --2- 172.21.15.88:0/4217040320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a7120 0x7f808c0a2900 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f808b7fe700 1 -- 172.21.15.88:0/4217040320 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8080011720 con 0x7f808c0a7120 2020-02-11T16:18:46.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 --2- 172.21.15.88:0/4217040320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a7120 0x7f808c0a2900 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8090b18700 1 --2- 172.21.15.88:0/4217040320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a7120 0x7f808c0a2900 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f808b7fe700 1 -- 172.21.15.88:0/4217040320 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8080011880 con 0x7f808c0a7120 2020-02-11T16:18:46.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f808b7fe700 1 -- 172.21.15.88:0/4217040320 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8080011c60 con 0x7f808c0a7120 2020-02-11T16:18:46.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8092d7c700 1 -- 172.21.15.88:0/4217040320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a7120 msgr2=0x7f808c0a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.181+0000 7f8092d7c700 1 --2- 172.21.15.88:0/4217040320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a7120 0x7f808c0a2900 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).stop 2020-02-11T16:18:46.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.182+0000 7f8092d7c700 1 -- 172.21.15.88:0/4217040320 shutdown_connections 2020-02-11T16:18:46.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.182+0000 7f8092d7c700 1 --2- 172.21.15.88:0/4217040320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808c13c120 0x7f808c13c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.182+0000 7f8092d7c700 1 --2- 172.21.15.88:0/4217040320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a7120 0x7f808c0a2900 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.182+0000 7f8092d7c700 1 --2- 172.21.15.88:0/4217040320 >> v2:172.21.15.52:3300/0 conn(0x7f808c0a50f0 0x7f808c0a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.182+0000 7f8092d7c700 1 -- 172.21.15.88:0/4217040320 >> 172.21.15.88:0/4217040320 conn(0x7f808c09d110 msgr2=0x7f808c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:46.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.182+0000 7f8092d7c700 1 -- 172.21.15.88:0/4217040320 shutdown_connections 2020-02-11T16:18:46.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.182+0000 7f8092d7c700 1 -- 172.21.15.88:0/4217040320 wait complete. 2020-02-11T16:18:46.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.183+0000 7f8092d7c700 1 Processor -- start 2020-02-11T16:18:46.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.183+0000 7f8092d7c700 1 -- start start 2020-02-11T16:18:46.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8092d7c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f808c0a50f0 0x7f808c140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8092d7c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f808c0a7120 0x7f808c0a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8092d7c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808c13c120 0x7f808c13efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8092d7c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c09f710 con 0x7f808c0a7120 2020-02-11T16:18:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8092d7c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c09f9b0 con 0x7f808c0a50f0 2020-02-11T16:18:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8092d7c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c09fc50 con 0x7f808c13c120 2020-02-11T16:18:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f808c0a50f0 0x7f808c140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f808c0a50f0 0x7f808c140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56788/0 (socket says 172.21.15.88:56788) 2020-02-11T16:18:46.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 -- 172.21.15.88:0/1461630492 learned_addr learned my addr 172.21.15.88:0/1461630492 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:46.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8091319700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808c13c120 0x7f808c13efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> v2:172.21.15.52:3300/0 conn(0x7f808c0a7120 0x7f808c0a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 -- 172.21.15.88:0/1461630492 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808c13c120 msgr2=0x7f808c13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808c13c120 0x7f808c13efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 -- 172.21.15.88:0/1461630492 >> v2:172.21.15.52:3300/0 conn(0x7f808c0a7120 msgr2=0x7f808c0a0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 --2- 172.21.15.88:0/1461630492 >> v2:172.21.15.52:3300/0 conn(0x7f808c0a7120 0x7f808c0a0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 -- 172.21.15.88:0/1461630492 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c139110 con 0x7f808c0a50f0 2020-02-11T16:18:46.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 --2- 172.21.15.88:0/1461630492 >> v2:172.21.15.88:3300/0 conn(0x7f808c0a50f0 0x7f808c140220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 --2- 172.21.15.88:0/1461630492 >> v2:172.21.15.88:3300/0 conn(0x7f808c0a50f0 0x7f808c140220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a50f0 0x7f808c140220 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a50f0 0x7f808c140220 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8080007340 con 0x7f808c0a50f0 2020-02-11T16:18:46.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a50f0 0x7f808c140220 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8090b18700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a50f0 0x7f808c140220 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80800074a0 con 0x7f808c0a50f0 2020-02-11T16:18:46.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8092d7c700 1 -- 172.21.15.88:0/1461630492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c139360 con 0x7f808c0a50f0 2020-02-11T16:18:46.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80800058b0 con 0x7f808c0a50f0 2020-02-11T16:18:46.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.184+0000 7f8092d7c700 1 -- 172.21.15.88:0/1461630492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c13f670 con 0x7f808c0a50f0 2020-02-11T16:18:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f8090b18700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a50f0 0x7f808c140220 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f8092d7c700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 0x7f808c132db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f8092d7c700 1 -- 172.21.15.88:0/1461630492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c05e2f0 con 0x7f808c0a3290 2020-02-11T16:18:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8080005b20 con 0x7f808c0a50f0 2020-02-11T16:18:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f8090b18700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a50f0 0x7f808c140220 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 0x7f808c132db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f8089ffb700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8074039ca0 0x7f807403c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f808004a2e0 con 0x7f808c0a50f0 2020-02-11T16:18:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f808bfff700 1 -- 172.21.15.88:0/1461630492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f808c09f3c0 con 0x7f808c0a3290 2020-02-11T16:18:46.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 0x7f808c132db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f8091319700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8074039ca0 0x7f807403c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 0x7f808c132db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 0x7f808c132db0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 0x7f808c132db0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.185+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8078012480 con 0x7f808c0a3290 2020-02-11T16:18:46.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.186+0000 7f8091319700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8074039ca0 0x7f807403c160 crc :-1 s=READY pgs=332 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.186+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 0x7f808c132db0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.186+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f80780125e0 con 0x7f808c0a3290 2020-02-11T16:18:46.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.186+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 msgr2=0x7f808c132db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.186+0000 7f8089ffb700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 0x7f808c132db0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).stop 2020-02-11T16:18:46.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.186+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 msgr2=0x7f808c132db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:46.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.186+0000 7f8089ffb700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a3290 0x7f808c132db0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).stop 2020-02-11T16:18:46.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f8092d7c700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 0x7f808c14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f8092d7c700 1 -- 172.21.15.88:0/1461630492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c09f850 con 0x7f808c133210 2020-02-11T16:18:46.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 0x7f808c14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f808bfff700 1 -- 172.21.15.88:0/1461630492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f808c133620 con 0x7f808c133210 2020-02-11T16:18:46.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 0x7f808c14cad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 0x7f808c14cad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 0x7f808c14cad0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 0x7f808c14cad0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f807800d3d0 con 0x7f808c133210 2020-02-11T16:18:46.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f808bfff700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 0x7f808c14cad0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f807800d530 con 0x7f808c133210 2020-02-11T16:18:46.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 msgr2=0x7f808c14cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f8089ffb700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 0x7f808c14cad0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).stop 2020-02-11T16:18:46.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.194+0000 7f8089ffb700 1 -- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 msgr2=0x7f808c14cad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:46.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8089ffb700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c133210 0x7f808c14cad0 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0x7f8078002f30 tx=0x7f8078010bf0).stop 2020-02-11T16:18:46.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8092d7c700 1 -- 172.21.15.88:0/1461630492 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8074039ca0 msgr2=0x7f807403c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8092d7c700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8074039ca0 0x7f807403c160 crc :-1 s=READY pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8092d7c700 1 -- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a50f0 msgr2=0x7f808c140220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8092d7c700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a50f0 0x7f808c140220 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f8080002f30 tx=0x7f8080007a40).stop 2020-02-11T16:18:46.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8091319700 1 -- 172.21.15.88:0/1461630492 reap_dead start 2020-02-11T16:18:46.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8091319700 1 -- 172.21.15.88:0/1461630492 reap_dead start 2020-02-11T16:18:46.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8092d7c700 1 -- 172.21.15.88:0/1461630492 shutdown_connections 2020-02-11T16:18:46.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8092d7c700 1 --2- 172.21.15.88:0/1461630492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f808c0a50f0 0x7f808c140220 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8092d7c700 1 -- 172.21.15.88:0/1461630492 >> 172.21.15.88:0/1461630492 conn(0x7f808c09d110 msgr2=0x7f808c13b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:46.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8092d7c700 1 -- 172.21.15.88:0/1461630492 shutdown_connections 2020-02-11T16:18:46.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.195+0000 7f8092d7c700 1 -- 172.21.15.88:0/1461630492 wait complete. 2020-02-11T16:18:46.213 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:18:46.213 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:46.213 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:46.213 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:18:46.214 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 108, 2020-02-11T16:18:46.214 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:18:46.214 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:18:46.214 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:18:46.214 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:18:46.215 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.215 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:18:46.215 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:46.215 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:18:46.215 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:18:46.215 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:46.216 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:46.216 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:46.216 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:46.216 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:46.216 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:46.216 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.216 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:18:46.217 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:18:46.217 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:46.217 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:46.217 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:46.217 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:46.217 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:46.217 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:46.218 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.218 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:18:46.218 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:18:46.218 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:18:46.219 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:18:46.219 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:18:46.219 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:18:46.219 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:46.219 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:46.219 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:18:46.219 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:18:46.219 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:46.220 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:18:46.220 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:46.220 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:46.220 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:46.220 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:46.220 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:46.220 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:46.221 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.221 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:18:46.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.221 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:18:46.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.221 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:18:46.221 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:18:46.222 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:46.222 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:46.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.222 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:46.222 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:18:46.222 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.223 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:46.223 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:18:46.223 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.223 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.223 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.223 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:18:46.224 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:18:46.224 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:46.224 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:46.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.224 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:46.225 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:46.225 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:46.225 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:46.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.226 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:46.226 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:18:46.226 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.227 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:46.227 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:18:46.227 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.227 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.228 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.228 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:18:46.228 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:18:46.229 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:46.229 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:46.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.230 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:46.230 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:46.230 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:46.230 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:46.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.230 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:46.230 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:18:46.231 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.231 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:46.231 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:18:46.231 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.232 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.232 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.232 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:18:46.232 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:18:46.232 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:46.232 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:46.233 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.233 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.233 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:18:46.233 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:18:46.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.234 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.234 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.234 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:46.234 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.234 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.234 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:18:46.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.235 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.235 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.235 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:46.235 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.235 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.235 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:18:46.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.235 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.236 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.236 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:18:46.236 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.236 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.236 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:18:46.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.236 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.237 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.237 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:18:46.237 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.237 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.237 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:18:46.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.237 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.237 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.238 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:46.238 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.238 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.238 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.238 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:18:46.239 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:18:46.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.341+0000 7fcc1f954700 1 Processor -- start 2020-02-11T16:18:46.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.342+0000 7fcc1f954700 1 -- start start 2020-02-11T16:18:46.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.342+0000 7fcc1f954700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc180ad380 0x7fcc180a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.342+0000 7fcc1f954700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc181386e0 0x7fcc1813b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.342+0000 7fcc1f954700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc18138b20 con 0x7fcc18138280 2020-02-11T16:18:46.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.342+0000 7fcc1f954700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc18137bf0 con 0x7fcc181386e0 2020-02-11T16:18:46.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.342+0000 7fcc1f954700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180adb40 con 0x7fcc180ad380 2020-02-11T16:18:46.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.342+0000 7fcc1def1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc181386e0 0x7fcc1813b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.342+0000 7fcc1def1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc181386e0 0x7fcc1813b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56802/0 (socket says 172.21.15.88:56802) 2020-02-11T16:18:46.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.342+0000 7fcc1def1700 1 -- 172.21.15.88:0/1998554606 learned_addr learned my addr 172.21.15.88:0/1998554606 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:46.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.342+0000 7fcc1ceef700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcc18138280 0x7fcc1813b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44426/0 (socket says 172.21.15.88:44426) 2020-02-11T16:18:46.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1d6f0700 1 --2- 172.21.15.88:0/1998554606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc180ad380 0x7fcc180a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1def1700 1 -- 172.21.15.88:0/1998554606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc180ad380 msgr2=0x7fcc180a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:46.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1998554606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc180ad380 0x7fcc180a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1def1700 1 -- 172.21.15.88:0/1998554606 >> v1:172.21.15.88:6789/0 conn(0x7fcc18138280 legacy=0x7fcc1813b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc0bfff700 1 -- 172.21.15.88:0/1998554606 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245389134 0 0) 0x7fcc140010d0 con 0x7fcc18138280 2020-02-11T16:18:46.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1def1700 1 -- 172.21.15.88:0/1998554606 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18137de0 con 0x7fcc181386e0 2020-02-11T16:18:46.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1998554606 >> v2:172.21.15.88:3300/0 conn(0x7fcc181386e0 0x7fcc1813b8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcc100032b0 tx=0x7fcc10008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1998554606 >> v2:172.21.15.88:3300/0 conn(0x7fcc181386e0 0x7fcc1813b8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcc100032b0 tx=0x7fcc10008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1998554606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181386e0 0x7fcc1813b8d0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fcc100032b0 tx=0x7fcc10008c60).ready entity=mon.1 client_cookie=3644a634d0e6ebf server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1998554606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181386e0 0x7fcc1813b8d0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fcc100032b0 tx=0x7fcc10008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc0bfff700 1 -- 172.21.15.88:0/1998554606 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc1000a160 con 0x7fcc181386e0 2020-02-11T16:18:46.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1998554606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181386e0 0x7fcc1813b8d0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fcc100032b0 tx=0x7fcc10008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1998554606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181386e0 0x7fcc1813b8d0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fcc100032b0 tx=0x7fcc10008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc0bfff700 1 -- 172.21.15.88:0/1998554606 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1000a2c0 con 0x7fcc181386e0 2020-02-11T16:18:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc0bfff700 1 -- 172.21.15.88:0/1998554606 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc1000a660 con 0x7fcc181386e0 2020-02-11T16:18:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1f954700 1 -- 172.21.15.88:0/1998554606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181386e0 msgr2=0x7fcc1813b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1f954700 1 --2- 172.21.15.88:0/1998554606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181386e0 0x7fcc1813b8d0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fcc100032b0 tx=0x7fcc10008c60).stop 2020-02-11T16:18:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1f954700 1 -- 172.21.15.88:0/1998554606 shutdown_connections 2020-02-11T16:18:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1f954700 1 --2- 172.21.15.88:0/1998554606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181386e0 0x7fcc1813b8d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1f954700 1 --2- 172.21.15.88:0/1998554606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc180ad380 0x7fcc180a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.343+0000 7fcc1f954700 1 -- 172.21.15.88:0/1998554606 >> 172.21.15.88:0/1998554606 conn(0x7fcc1805ac70 msgr2=0x7fcc180ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.344+0000 7fcc1f954700 1 -- 172.21.15.88:0/1998554606 shutdown_connections 2020-02-11T16:18:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.344+0000 7fcc1f954700 1 -- 172.21.15.88:0/1998554606 wait complete. 2020-02-11T16:18:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.344+0000 7fcc1f954700 1 Processor -- start 2020-02-11T16:18:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.344+0000 7fcc1f954700 1 -- start start 2020-02-11T16:18:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1f954700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc180ad380 0x7fcc1813a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1f954700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc181386e0 0x7fcc1812be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1f954700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc18139560 con 0x7fcc18138280 2020-02-11T16:18:46.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1f954700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc18139790 con 0x7fcc181386e0 2020-02-11T16:18:46.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1f954700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc18139a30 con 0x7fcc180ad380 2020-02-11T16:18:46.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1d6f0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc180ad380 0x7fcc1813a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1d6f0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc180ad380 0x7fcc1813a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56806/0 (socket says 172.21.15.88:56806) 2020-02-11T16:18:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1d6f0700 1 -- 172.21.15.88:0/1030334833 learned_addr learned my addr 172.21.15.88:0/1030334833 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:46.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1030334833 >> v2:172.21.15.52:3300/0 conn(0x7fcc181386e0 0x7fcc1812be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1d6f0700 1 -- 172.21.15.88:0/1030334833 >> v2:172.21.15.52:3300/0 conn(0x7fcc181386e0 msgr2=0x7fcc1812be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1d6f0700 1 --2- 172.21.15.88:0/1030334833 >> v2:172.21.15.52:3300/0 conn(0x7fcc181386e0 0x7fcc1812be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1d6f0700 1 -- 172.21.15.88:0/1030334833 >> v1:172.21.15.88:6789/0 conn(0x7fcc18138280 legacy=0x7fcc1812b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918778247 0 0) 0x7fcc18139560 con 0x7fcc18138280 2020-02-11T16:18:46.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1d6f0700 1 -- 172.21.15.88:0/1030334833 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1813a250 con 0x7fcc180ad380 2020-02-11T16:18:46.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1030334833 >> v2:172.21.15.52:3300/0 conn(0x7fcc181386e0 0x7fcc1812be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:18:46.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1d6f0700 1 --2- 172.21.15.88:0/1030334833 >> v2:172.21.15.88:3300/0 conn(0x7fcc180ad380 0x7fcc1813a5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc0c002f30 tx=0x7fcc0c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1d6f0700 1 --2- 172.21.15.88:0/1030334833 >> v2:172.21.15.88:3300/0 conn(0x7fcc180ad380 0x7fcc1813a5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc0c002f30 tx=0x7fcc0c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.345+0000 7fcc1d6f0700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc180ad380 0x7fcc1813a5b0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fcc0c002f30 tx=0x7fcc0c010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc1d6f0700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc180ad380 0x7fcc1813a5b0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fcc0c002f30 tx=0x7fcc0c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc1d6f0700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc180ad380 0x7fcc1813a5b0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fcc0c002f30 tx=0x7fcc0c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc0c012b50 con 0x7fcc180ad380 2020-02-11T16:18:46.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc1d6f0700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc180ad380 0x7fcc1813a5b0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fcc0c002f30 tx=0x7fcc0c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c012cb0 con 0x7fcc180ad380 2020-02-11T16:18:46.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc0c012e20 con 0x7fcc180ad380 2020-02-11T16:18:46.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc1f954700 1 -- 172.21.15.88:0/1030334833 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc18138dc0 con 0x7fcc180ad380 2020-02-11T16:18:46.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc1f954700 1 -- 172.21.15.88:0/1030334833 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc18132ff0 con 0x7fcc180ad380 2020-02-11T16:18:46.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc1d6f0700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc180ad380 0x7fcc1813a5b0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fcc0c002f30 tx=0x7fcc0c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fcc0c007170 con 0x7fcc180ad380 2020-02-11T16:18:46.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.346+0000 7fcc1d6f0700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc180ad380 0x7fcc1813a5b0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fcc0c002f30 tx=0x7fcc0c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc1f954700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 0x7fcc1812eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc1f954700 1 -- 172.21.15.88:0/1030334833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc18138fe0 con 0x7fcc18137060 2020-02-11T16:18:46.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc0a7fc700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcbf8039b20 0x7fcbf803bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fcc0c04a070 con 0x7fcc180ad380 2020-02-11T16:18:46.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 0x7fcc1812eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcbf8039b20 0x7fcbf803bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc1ceef700 1 -- 172.21.15.88:0/1030334833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc180565b0 con 0x7fcc18137060 2020-02-11T16:18:46.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc1def1700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcbf8039b20 0x7fcbf803bfe0 crc :-1 s=READY pgs=333 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 0x7fcc1812eba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 0x7fcc1812eba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 0x7fcc1812eba0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 0x7fcc1812eba0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.347+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc14010440 con 0x7fcc18137060 2020-02-11T16:18:46.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.348+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 0x7fcc1812eba0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.348+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fcc1400ca80 con 0x7fcc18137060 2020-02-11T16:18:46.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.348+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 msgr2=0x7fcc1812eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.348+0000 7fcc0a7fc700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 0x7fcc1812eba0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).stop 2020-02-11T16:18:46.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.348+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 msgr2=0x7fcc1812eba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:46.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.348+0000 7fcc0a7fc700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18137060 0x7fcc1812eba0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).stop 2020-02-11T16:18:46.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.356+0000 7fcc1f954700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 0x7fcc18135f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.356+0000 7fcc1f954700 1 -- 172.21.15.88:0/1030334833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1813a090 con 0x7fcc18135b60 2020-02-11T16:18:46.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.356+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 0x7fcc18135f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.356+0000 7fcc1ceef700 1 -- 172.21.15.88:0/1030334833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcc1805ccb0 con 0x7fcc18135b60 2020-02-11T16:18:46.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.356+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 0x7fcc18135f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.356+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 0x7fcc18135f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.356+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 0x7fcc18135f70 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 0x7fcc18135f70 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc1400f460 con 0x7fcc18135b60 2020-02-11T16:18:46.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1ceef700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 0x7fcc18135f70 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3852 (secure 0 0 0) 0x7fcc1400f5c0 con 0x7fcc18135b60 2020-02-11T16:18:46.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 msgr2=0x7fcc18135f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc0a7fc700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 0x7fcc18135f70 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fcc14000ee0 tx=0x7fcc14010b70).stop 2020-02-11T16:18:46.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc0a7fc700 1 -- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 msgr2=0x7fcc18135f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:46.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc0a7fc700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc18135b60 0x7fcc18135f70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1f954700 1 -- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcbf8039b20 msgr2=0x7fcbf803bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1f954700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcbf8039b20 0x7fcbf803bfe0 crc :-1 s=READY pgs=333 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1f954700 1 -- 172.21.15.88:0/1030334833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc180ad380 msgr2=0x7fcc1813a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1f954700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc180ad380 0x7fcc1813a5b0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fcc0c002f30 tx=0x7fcc0c010ce0).stop 2020-02-11T16:18:46.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1def1700 1 -- 172.21.15.88:0/1030334833 reap_dead start 2020-02-11T16:18:46.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1def1700 1 -- 172.21.15.88:0/1030334833 reap_dead start 2020-02-11T16:18:46.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1f954700 1 -- 172.21.15.88:0/1030334833 shutdown_connections 2020-02-11T16:18:46.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1f954700 1 --2- 172.21.15.88:0/1030334833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc180ad380 0x7fcc1813a5b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1f954700 1 -- 172.21.15.88:0/1030334833 >> 172.21.15.88:0/1030334833 conn(0x7fcc1805ac70 msgr2=0x7fcc18069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:46.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1f954700 1 -- 172.21.15.88:0/1030334833 shutdown_connections 2020-02-11T16:18:46.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.357+0000 7fcc1f954700 1 -- 172.21.15.88:0/1030334833 wait complete. 2020-02-11T16:18:46.372 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:18:46.372 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:18:46.372 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:18:46.373 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:18:46.373 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 108, 2020-02-11T16:18:46.373 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:18:46.373 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:18:46.373 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:18:46.373 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:18:46.373 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.375 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:18:46.375 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:46.375 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:18:46.375 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:18:46.376 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:46.376 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:46.376 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:46.376 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:46.376 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:46.376 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:46.377 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.377 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:18:46.378 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:18:46.378 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:46.378 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:46.378 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:46.378 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:46.379 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:46.379 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:46.379 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:18:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:18:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:18:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:18:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:18:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:18:46.391 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:46.391 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:46.391 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:18:46.391 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:18:46.391 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:46.391 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:18:46.391 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:46.392 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:46.392 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:46.392 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:46.392 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:46.392 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:46.392 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.393 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:18:46.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.393 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:18:46.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.394 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:18:46.394 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:18:46.394 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:46.394 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:46.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.395 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:46.395 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:18:46.395 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.396 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:46.396 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:18:46.396 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.396 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.396 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.397 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:18:46.397 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:18:46.397 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:46.397 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:46.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.398 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:46.398 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:46.398 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:46.398 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:46.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.399 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:46.399 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:18:46.399 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.399 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:46.399 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:18:46.400 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.400 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.400 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.400 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:18:46.400 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:18:46.400 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:46.400 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:46.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.401 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:46.401 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:46.401 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:46.401 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:46.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.402 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:46.402 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:18:46.402 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.402 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:46.402 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:18:46.403 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.403 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.403 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:18:46.403 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:18:46.404 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:46.404 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:46.404 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.404 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.404 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:18:46.404 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:18:46.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.405 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.405 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.405 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:46.405 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.405 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.405 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:18:46.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.407 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.414 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.414 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:46.414 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.414 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.414 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.414 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:18:46.416 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:18:46.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.536+0000 7f0f7e521700 1 Processor -- start 2020-02-11T16:18:46.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.536+0000 7f0f7e521700 1 -- start start 2020-02-11T16:18:46.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.536+0000 7f0f7e521700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f780a2fa0 0x7f0f780a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.536+0000 7f0f7e521700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f78131990 0x7f0f780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.536+0000 7f0f7e521700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f780a4350 con 0x7f0f780a5410 2020-02-11T16:18:46.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.536+0000 7f0f7e521700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f780a1e60 con 0x7f0f780a2fa0 2020-02-11T16:18:46.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.536+0000 7f0f7e521700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f780a3450 con 0x7f0f78131990 2020-02-11T16:18:46.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.536+0000 7f0f777fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0f780a5410 0x7f0f78131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44444/0 (socket says 172.21.15.88:44444) 2020-02-11T16:18:46.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.536+0000 7f0f777fe700 1 -- 172.21.15.88:0/4050791947 learned_addr learned my addr 172.21.15.88:0/4050791947 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:46.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f77fff700 1 --2- 172.21.15.88:0/4050791947 >> v2:172.21.15.52:3300/0 conn(0x7f0f780a2fa0 0x7f0f780a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f7cabe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f78131990 0x7f0f780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103230675 0 0) 0x7f0f780a4350 con 0x7f0f780a5410 2020-02-11T16:18:46.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f64003230 con 0x7f0f780a5410 2020-02-11T16:18:46.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 624496131 0 0) 0x7f0f64003230 con 0x7f0f780a5410 2020-02-11T16:18:46.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f78131990 msgr2=0x7f0f780a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:46.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f78131990 0x7f0f780a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 >> v2:172.21.15.52:3300/0 conn(0x7f0f780a2fa0 msgr2=0x7f0f780a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:46.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 --2- 172.21.15.88:0/4050791947 >> v2:172.21.15.52:3300/0 conn(0x7f0f780a2fa0 0x7f0f780a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f780a3a40 con 0x7f0f780a5410 2020-02-11T16:18:46.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f0f6c0016d0 con 0x7f0f780a5410 2020-02-11T16:18:46.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 >> v1:172.21.15.88:6789/0 conn(0x7f0f780a5410 legacy=0x7f0f78131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64003750 0x7f0f64003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f64004090 0x7f0f64004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f78131990 0x7f0f64004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f780a1e60 con 0x7f0f64003750 2020-02-11T16:18:46.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f64004fb0 con 0x7f0f64004090 2020-02-11T16:18:46.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f64005170 con 0x7f0f78131990 2020-02-11T16:18:46.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f77fff700 1 --2- 172.21.15.88:0/4050791947 >> v2:172.21.15.52:3300/0 conn(0x7f0f780a2fa0 0x7f0f780a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:18:46.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f777fe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f64004090 0x7f0f64004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f7cabe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f78131990 0x7f0f64004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f77fff700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64003750 0x7f0f64003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f777fe700 1 -- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f78131990 msgr2=0x7f0f64004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f777fe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f78131990 0x7f0f64004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f777fe700 1 -- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64003750 msgr2=0x7f0f64003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f777fe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64003750 0x7f0f64003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f777fe700 1 -- 172.21.15.88:0/4050791947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64003230 con 0x7f0f64004090 2020-02-11T16:18:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f777fe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f64004090 0x7f0f64004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f777fe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f64004090 0x7f0f64004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.537+0000 7f0f777fe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f64004090 0x7f0f64004570 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).ready entity=mon.1 client_cookie=4b0770687ead4b44 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f777fe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f64004090 0x7f0f64004570 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6c00ce70 con 0x7f0f64004090 2020-02-11T16:18:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f777fe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f64004090 0x7f0f64004570 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f777fe700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f64004090 0x7f0f64004570 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c00e350 con 0x7f0f64004090 2020-02-11T16:18:46.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f76ffd700 1 -- 172.21.15.88:0/4050791947 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6c0100b0 con 0x7f0f64004090 2020-02-11T16:18:46.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f7e521700 1 -- 172.21.15.88:0/4050791947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f64004090 msgr2=0x7f0f64004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f7e521700 1 --2- 172.21.15.88:0/4050791947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f64004090 0x7f0f64004570 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).stop 2020-02-11T16:18:46.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f7cabe700 1 -- 172.21.15.88:0/4050791947 reap_dead start 2020-02-11T16:18:46.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f7e521700 1 -- 172.21.15.88:0/4050791947 shutdown_connections 2020-02-11T16:18:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f7e521700 1 -- 172.21.15.88:0/4050791947 >> 172.21.15.88:0/4050791947 conn(0x7f0f7809d110 msgr2=0x7f0f7809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f7e521700 1 -- 172.21.15.88:0/4050791947 shutdown_connections 2020-02-11T16:18:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.538+0000 7f0f7e521700 1 -- 172.21.15.88:0/4050791947 wait complete. 2020-02-11T16:18:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.539+0000 7f0f7e521700 1 Processor -- start 2020-02-11T16:18:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.539+0000 7f0f7e521700 1 -- start start 2020-02-11T16:18:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f7e521700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f78134230 0x7f0f78062270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f7e521700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f780a0180 0x7f0f78144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f7e521700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f781450c0 0x7f0f78130270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f7e521700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f780a07b0 con 0x7f0f78134230 2020-02-11T16:18:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f7e521700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f781447c0 con 0x7f0f780a0180 2020-02-11T16:18:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f7e521700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f78145530 con 0x7f0f781450c0 2020-02-11T16:18:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f780a0180 0x7f0f78144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f780a0180 0x7f0f78144c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56832/0 (socket says 172.21.15.88:56832) 2020-02-11T16:18:46.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 -- 172.21.15.88:0/505860552 learned_addr learned my addr 172.21.15.88:0/505860552 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f7cabe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f781450c0 0x7f0f78130270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> v2:172.21.15.52:3300/0 conn(0x7f0f78134230 0x7f0f78062270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 -- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f781450c0 msgr2=0x7f0f78130270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f781450c0 0x7f0f78130270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 -- 172.21.15.88:0/505860552 >> v2:172.21.15.52:3300/0 conn(0x7f0f78134230 msgr2=0x7f0f78062270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 --2- 172.21.15.88:0/505860552 >> v2:172.21.15.52:3300/0 conn(0x7f0f78134230 0x7f0f78062270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 -- 172.21.15.88:0/505860552 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f780a0a50 con 0x7f0f780a0180 2020-02-11T16:18:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> v2:172.21.15.52:3300/0 conn(0x7f0f78134230 0x7f0f78062270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:18:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f7cabe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f781450c0 0x7f0f78130270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:18:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 --2- 172.21.15.88:0/505860552 >> v2:172.21.15.88:3300/0 conn(0x7f0f780a0180 0x7f0f78144c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 --2- 172.21.15.88:0/505860552 >> v2:172.21.15.88:3300/0 conn(0x7f0f780a0180 0x7f0f78144c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f780a0180 0x7f0f78144c60 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f780a0180 0x7f0f78144c60 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6c00e6e0 con 0x7f0f780a0180 2020-02-11T16:18:46.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f780a0180 0x7f0f78144c60 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f7e521700 1 -- 172.21.15.88:0/505860552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f781306d0 con 0x7f0f780a0180 2020-02-11T16:18:46.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f777fe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f780a0180 0x7f0f78144c60 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c0045b0 con 0x7f0f780a0180 2020-02-11T16:18:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6c004990 con 0x7f0f780a0180 2020-02-11T16:18:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.540+0000 7f0f7e521700 1 -- 172.21.15.88:0/505860552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f78130ba0 con 0x7f0f780a0180 2020-02-11T16:18:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.541+0000 7f0f777fe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f780a0180 0x7f0f78144c60 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.541+0000 7f0f7e521700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 0x7f0f7809f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.541+0000 7f0f7e521700 1 -- 172.21.15.88:0/505860552 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f781456a0 con 0x7f0f780a7fe0 2020-02-11T16:18:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.541+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0f6c004b80 con 0x7f0f780a0180 2020-02-11T16:18:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.541+0000 7f0f777fe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f780a0180 0x7f0f78144c60 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 0x7f0f7809f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f757fa700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0f58039dd0 0x7f0f5803c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f0f6c049f70 con 0x7f0f780a0180 2020-02-11T16:18:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f77fff700 1 -- 172.21.15.88:0/505860552 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f780a0be0 con 0x7f0f780a7fe0 2020-02-11T16:18:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f7cabe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0f58039dd0 0x7f0f5803c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 0x7f0f7809f2a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 0x7f0f7809f2a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 0x7f0f7809f2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f7cabe700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0f58039dd0 0x7f0f5803c290 crc :-1 s=READY pgs=334 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 0x7f0f7809f2a0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f68007160 con 0x7f0f780a7fe0 2020-02-11T16:18:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 0x7f0f7809f2a0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f0f680072c0 con 0x7f0f780a7fe0 2020-02-11T16:18:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 msgr2=0x7f0f7809f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f757fa700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 0x7f0f7809f2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).stop 2020-02-11T16:18:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 msgr2=0x7f0f7809f2a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.542+0000 7f0f757fa700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f780a7fe0 0x7f0f7809f2a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.550+0000 7f0f7e521700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 0x7f0f78131da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.550+0000 7f0f7e521700 1 -- 172.21.15.88:0/505860552 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7805e2f0 con 0x7f0f7809f700 2020-02-11T16:18:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.551+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 0x7f0f78131da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.551+0000 7f0f77fff700 1 -- 172.21.15.88:0/505860552 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0f780565b0 con 0x7f0f7809f700 2020-02-11T16:18:46.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.551+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 0x7f0f78131da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.551+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 0x7f0f78131da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.551+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 0x7f0f78131da0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.551+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 0x7f0f78131da0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.551+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f680086f0 con 0x7f0f7809f700 2020-02-11T16:18:46.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f77fff700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 0x7f0f78131da0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f0f68008850 con 0x7f0f7809f700 2020-02-11T16:18:46.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 msgr2=0x7f0f78131da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f757fa700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 0x7f0f78131da0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f0f68002f30 tx=0x7f0f68010c50).stop 2020-02-11T16:18:46.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f757fa700 1 -- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 msgr2=0x7f0f78131da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:46.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f757fa700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f7809f700 0x7f0f78131da0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7e521700 1 -- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0f58039dd0 msgr2=0x7f0f5803c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7e521700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0f58039dd0 0x7f0f5803c290 crc :-1 s=READY pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7e521700 1 -- 172.21.15.88:0/505860552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f780a0180 msgr2=0x7f0f78144c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7e521700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f780a0180 0x7f0f78144c60 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f0f7805efb0 tx=0x7f0f780a4120).stop 2020-02-11T16:18:46.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7cabe700 1 -- 172.21.15.88:0/505860552 reap_dead start 2020-02-11T16:18:46.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7cabe700 1 -- 172.21.15.88:0/505860552 reap_dead start 2020-02-11T16:18:46.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7e521700 1 -- 172.21.15.88:0/505860552 shutdown_connections 2020-02-11T16:18:46.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7e521700 1 --2- 172.21.15.88:0/505860552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f780a0180 0x7f0f78144c60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7e521700 1 -- 172.21.15.88:0/505860552 >> 172.21.15.88:0/505860552 conn(0x7f0f7809d110 msgr2=0x7f0f78069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:46.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7e521700 1 -- 172.21.15.88:0/505860552 shutdown_connections 2020-02-11T16:18:46.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.552+0000 7f0f7e521700 1 -- 172.21.15.88:0/505860552 wait complete. 2020-02-11T16:18:46.572 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:18:46.572 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:46.572 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:46.572 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:18:46.572 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 108, 2020-02-11T16:18:46.572 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:18:46.573 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:18:46.573 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:18:46.573 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:18:46.573 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.573 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:18:46.573 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:46.573 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:18:46.574 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:18:46.574 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:46.574 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:46.574 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:46.574 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:46.574 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:46.575 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:46.575 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.575 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:18:46.575 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:18:46.575 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:46.575 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:46.576 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:46.576 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:46.576 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:46.576 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:46.576 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.576 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:18:46.577 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:18:46.577 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:18:46.577 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:18:46.577 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:18:46.577 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:18:46.577 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:46.577 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:46.578 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:18:46.578 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:18:46.578 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:46.578 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:18:46.578 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:46.578 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:46.578 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:46.579 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:46.579 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:46.579 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:46.579 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.579 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:18:46.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.579 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:18:46.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.580 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:18:46.580 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:18:46.580 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:46.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:46.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.580 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:46.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:18:46.581 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.581 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:46.581 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:18:46.581 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.582 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.582 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:18:46.582 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:18:46.582 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:46.582 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:46.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.583 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:46.583 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:46.583 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:46.583 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:46.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.584 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:46.584 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:18:46.584 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.584 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:46.584 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:18:46.585 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.585 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.585 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.586 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:18:46.586 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:18:46.586 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:46.586 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:46.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.586 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:46.586 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:46.587 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:46.587 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:46.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.587 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:46.587 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:18:46.587 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.588 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:46.588 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:18:46.588 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:46.588 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.589 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.589 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:18:46.589 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:18:46.589 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:46.589 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:46.589 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.590 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:46.590 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:18:46.590 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:18:46.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.590 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.590 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.591 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:46.591 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.591 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.591 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:18:46.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.591 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.591 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.591 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:46.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.592 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.592 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:18:46.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.592 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.592 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.592 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:18:46.593 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.593 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.593 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:18:46.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.593 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.593 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.593 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:18:46.594 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.594 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:46.594 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:18:46.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:46.594 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:46.594 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:46.594 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:46.594 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.595 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:46.595 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:46.595 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:18:46.596 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:18:46.597 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:18:46.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.713+0000 7f3d2d484700 1 Processor -- start 2020-02-11T16:18:46.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.713+0000 7f3d2d484700 1 -- start start 2020-02-11T16:18:46.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d2d484700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d280a51a0 0x7f3d2812f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d2d484700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3d280a3ad0 0x7f3d2812fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d2d484700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d28135eb0 0x7f3d28136360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:46.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d2d484700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d280a44b0 con 0x7f3d280a3ad0 2020-02-11T16:18:46.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d2d484700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d280a5670 con 0x7f3d28135eb0 2020-02-11T16:18:46.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d2d484700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d280a3f70 con 0x7f3d280a51a0 2020-02-11T16:18:46.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d277fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d28135eb0 0x7f3d28136360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d277fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d28135eb0 0x7f3d28136360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56842/0 (socket says 172.21.15.88:56842) 2020-02-11T16:18:46.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d277fe700 1 -- 172.21.15.88:0/3175066509 learned_addr learned my addr 172.21.15.88:0/3175066509 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:46.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d26ffd700 1 --2- 172.21.15.88:0/3175066509 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d280a51a0 0x7f3d2812f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d267fc700 1 --2- 172.21.15.88:0/3175066509 >> v2:172.21.15.52:3300/0 conn(0x7f3d280a3ad0 0x7f3d2812fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d277fe700 1 -- 172.21.15.88:0/3175066509 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d280a51a0 msgr2=0x7f3d2812f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:46.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d277fe700 1 --2- 172.21.15.88:0/3175066509 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d280a51a0 0x7f3d2812f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d277fe700 1 -- 172.21.15.88:0/3175066509 >> v2:172.21.15.52:3300/0 conn(0x7f3d280a3ad0 msgr2=0x7f3d2812fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:46.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d277fe700 1 --2- 172.21.15.88:0/3175066509 >> v2:172.21.15.52:3300/0 conn(0x7f3d280a3ad0 0x7f3d2812fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d277fe700 1 -- 172.21.15.88:0/3175066509 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d280a4210 con 0x7f3d28135eb0 2020-02-11T16:18:46.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d267fc700 1 --2- 172.21.15.88:0/3175066509 >> v2:172.21.15.52:3300/0 conn(0x7f3d280a3ad0 0x7f3d2812fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:18:46.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d277fe700 1 --2- 172.21.15.88:0/3175066509 >> v2:172.21.15.88:3300/0 conn(0x7f3d28135eb0 0x7f3d28136360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3d200032b0 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.714+0000 7f3d277fe700 1 --2- 172.21.15.88:0/3175066509 >> v2:172.21.15.88:3300/0 conn(0x7f3d28135eb0 0x7f3d28136360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3d200032b0 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d277fe700 1 --2- 172.21.15.88:0/3175066509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d28135eb0 0x7f3d28136360 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f3d200032b0 tx=0x7f3d20007dc0).ready entity=mon.1 client_cookie=fd1edd83764a2849 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d277fe700 1 --2- 172.21.15.88:0/3175066509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d28135eb0 0x7f3d28136360 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f3d200032b0 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d25ffb700 1 -- 172.21.15.88:0/3175066509 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d20010e70 con 0x7f3d28135eb0 2020-02-11T16:18:46.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d277fe700 1 --2- 172.21.15.88:0/3175066509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d28135eb0 0x7f3d28136360 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f3d200032b0 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d277fe700 1 --2- 172.21.15.88:0/3175066509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d28135eb0 0x7f3d28136360 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f3d200032b0 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d25ffb700 1 -- 172.21.15.88:0/3175066509 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d200110c0 con 0x7f3d28135eb0 2020-02-11T16:18:46.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d25ffb700 1 -- 172.21.15.88:0/3175066509 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d20011420 con 0x7f3d28135eb0 2020-02-11T16:18:46.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d2d484700 1 -- 172.21.15.88:0/3175066509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d28135eb0 msgr2=0x7f3d28136360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d2d484700 1 --2- 172.21.15.88:0/3175066509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d28135eb0 0x7f3d28136360 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f3d200032b0 tx=0x7f3d20007dc0).stop 2020-02-11T16:18:46.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d2d484700 1 -- 172.21.15.88:0/3175066509 shutdown_connections 2020-02-11T16:18:46.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d2d484700 1 --2- 172.21.15.88:0/3175066509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d28135eb0 0x7f3d28136360 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d2d484700 1 --2- 172.21.15.88:0/3175066509 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d280a51a0 0x7f3d2812f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d2d484700 1 --2- 172.21.15.88:0/3175066509 >> v2:172.21.15.52:3300/0 conn(0x7f3d280a3ad0 0x7f3d2812fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:46.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d2d484700 1 -- 172.21.15.88:0/3175066509 >> 172.21.15.88:0/3175066509 conn(0x7f3d280aa480 msgr2=0x7f3d280aa890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:46.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d2d484700 1 -- 172.21.15.88:0/3175066509 shutdown_connections 2020-02-11T16:18:46.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.715+0000 7f3d2d484700 1 -- 172.21.15.88:0/3175066509 wait complete. 2020-02-11T16:18:46.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.716+0000 7f3d2d484700 1 Processor -- start 2020-02-11T16:18:46.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.716+0000 7f3d2d484700 1 -- start start 2020-02-11T16:18:46.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d2d484700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3d28135eb0 0x7f3d281325b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d2d484700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d28143af0 con 0x7f3d280a3ad0 2020-02-11T16:18:46.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d2d484700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d28143d90 con 0x7f3d280a51a0 2020-02-11T16:18:46.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d2d484700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d28143570 con 0x7f3d28135eb0 2020-02-11T16:18:46.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d267fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3d280a51a0 0x7f3d28130470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44476/0 (socket says 172.21.15.88:44476) 2020-02-11T16:18:46.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d267fc700 1 -- 172.21.15.88:0/2125949616 learned_addr learned my addr 172.21.15.88:0/2125949616 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:46.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> v2:172.21.15.52:3300/0 conn(0x7f3d28135eb0 0x7f3d281325b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d1ffff700 1 -- 172.21.15.88:0/2125949616 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784206559 0 0) 0x7f3d28143d90 con 0x7f3d280a51a0 2020-02-11T16:18:46.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d1ffff700 1 -- 172.21.15.88:0/2125949616 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d0c002fe0 con 0x7f3d280a51a0 2020-02-11T16:18:46.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d277fe700 1 -- 172.21.15.88:0/2125949616 >> v1:172.21.15.88:6789/0 conn(0x7f3d280a51a0 legacy=0x7f3d28130470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d277fe700 1 -- 172.21.15.88:0/2125949616 >> v1:172.21.15.52:6789/0 conn(0x7f3d280a3ad0 legacy=0x7f3d28142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d1ffff700 1 -- 172.21.15.88:0/2125949616 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584674489 0 0) 0x7f3d28143af0 con 0x7f3d280a3ad0 2020-02-11T16:18:46.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d277fe700 1 -- 172.21.15.88:0/2125949616 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2809f450 con 0x7f3d28135eb0 2020-02-11T16:18:46.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> v2:172.21.15.52:3300/0 conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> v2:172.21.15.52:3300/0 conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d1ffff700 1 -- 172.21.15.88:0/2125949616 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d20005c30 con 0x7f3d28135eb0 2020-02-11T16:18:46.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d1ffff700 1 -- 172.21.15.88:0/2125949616 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d20005d90 con 0x7f3d28135eb0 2020-02-11T16:18:46.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d2d484700 1 -- 172.21.15.88:0/2125949616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d280a9670 con 0x7f3d28135eb0 2020-02-11T16:18:46.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.717+0000 7f3d1ffff700 1 -- 172.21.15.88:0/2125949616 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d20002430 con 0x7f3d28135eb0 2020-02-11T16:18:46.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.718+0000 7f3d2d484700 1 -- 172.21.15.88:0/2125949616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d28130b80 con 0x7f3d28135eb0 2020-02-11T16:18:46.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.718+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.718+0000 7f3d1ffff700 1 -- 172.21.15.88:0/2125949616 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3d200026a0 con 0x7f3d28135eb0 2020-02-11T16:18:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.718+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.718+0000 7f3d2d484700 1 -- 172.21.15.88:0/2125949616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d28130e30 con 0x7f3d28135eb0 2020-02-11T16:18:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.719+0000 7f3d1ffff700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3d0c039ef0 0x7f3d0c03c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.719+0000 7f3d1ffff700 1 -- 172.21.15.88:0/2125949616 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3d20049f60 con 0x7f3d28135eb0 2020-02-11T16:18:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.719+0000 7f3d26ffd700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3d0c039ef0 0x7f3d0c03c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.719+0000 7f3d26ffd700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3d0c039ef0 0x7f3d0c03c3b0 crc :-1 s=READY pgs=335 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.723+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.723+0000 7f3d1ffff700 1 -- 172.21.15.88:0/2125949616 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3d28130e30 con 0x7f3d28135eb0 2020-02-11T16:18:46.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.903+0000 7f3d2d484700 1 -- 172.21.15.88:0/2125949616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f3d281436b0 con 0x7f3d28135eb0 2020-02-11T16:18:46.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.905+0000 7f3d277fe700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:46.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.905+0000 7f3d1ffff700 1 -- 172.21.15.88:0/2125949616 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f3d281436b0 con 0x7f3d28135eb0 2020-02-11T16:18:46.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.906+0000 7f3d2d484700 1 -- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3d0c039ef0 msgr2=0x7f3d0c03c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.906+0000 7f3d2d484700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3d0c039ef0 0x7f3d0c03c3b0 crc :-1 s=READY pgs=335 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.906+0000 7f3d2d484700 1 -- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 msgr2=0x7f3d281325b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:46.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.906+0000 7f3d2d484700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 0x7f3d281325b0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f3d2809ec20 tx=0x7f3d20007dc0).stop 2020-02-11T16:18:46.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.906+0000 7f3d2d484700 1 -- 172.21.15.88:0/2125949616 shutdown_connections 2020-02-11T16:18:46.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.906+0000 7f3d2d484700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3d0c039ef0 0x7f3d0c03c3b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.906+0000 7f3d2d484700 1 --2- 172.21.15.88:0/2125949616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d28135eb0 0x7f3d281325b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:46.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.906+0000 7f3d2d484700 1 -- 172.21.15.88:0/2125949616 >> 172.21.15.88:0/2125949616 conn(0x7f3d280aa480 msgr2=0x7f3d28069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:46.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.906+0000 7f3d2d484700 1 -- 172.21.15.88:0/2125949616 shutdown_connections 2020-02-11T16:18:46.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:46.906+0000 7f3d2d484700 1 -- 172.21.15.88:0/2125949616 wait complete. 2020-02-11T16:18:46.919 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:18:56.919 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:18:56.920 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:18:57.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.033+0000 7ff54c8e3700 1 Processor -- start 2020-02-11T16:18:57.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.033+0000 7ff54c8e3700 1 -- start start 2020-02-11T16:18:57.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff54c8e3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5480a18a0 0x7ff5480a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff54c8e3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff5480a5de0 0x7ff5480a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff54c8e3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5480a31b0 con 0x7ff54812e3a0 2020-02-11T16:18:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff54c8e3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480a3570 con 0x7ff5480a5de0 2020-02-11T16:18:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff54c8e3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480a3810 con 0x7ff5480a18a0 2020-02-11T16:18:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff546d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff54812e3a0 0x7ff54812e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44482/0 (socket says 172.21.15.88:44482) 2020-02-11T16:18:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff546d9d700 1 -- 172.21.15.88:0/632030853 learned_addr learned my addr 172.21.15.88:0/632030853 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff54659c700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5480a18a0 0x7ff5480a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809930491 0 0) 0x7ff5480a31b0 con 0x7ff54812e3a0 2020-02-11T16:18:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff545d9b700 1 --2- 172.21.15.88:0/632030853 >> v2:172.21.15.52:3300/0 conn(0x7ff5480a5de0 0x7ff5480a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.034+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff52c003230 con 0x7ff54812e3a0 2020-02-11T16:18:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 162863480 0 0) 0x7ff52c003230 con 0x7ff54812e3a0 2020-02-11T16:18:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5480a18a0 msgr2=0x7ff5480a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5480a18a0 0x7ff5480a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 >> v2:172.21.15.52:3300/0 conn(0x7ff5480a5de0 msgr2=0x7ff5480a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 --2- 172.21.15.88:0/632030853 >> v2:172.21.15.52:3300/0 conn(0x7ff5480a5de0 0x7ff5480a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480a3ab0 con 0x7ff54812e3a0 2020-02-11T16:18:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7ff540001a50 con 0x7ff54812e3a0 2020-02-11T16:18:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 >> v1:172.21.15.88:6789/0 conn(0x7ff54812e3a0 legacy=0x7ff54812e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5480a18a0 0x7ff52c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff52c003b80 0x7ff52c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff52c0045c0 0x7ff52c004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480a3570 con 0x7ff52c003b80 2020-02-11T16:18:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480a3810 con 0x7ff52c0045c0 2020-02-11T16:18:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c005050 con 0x7ff5480a18a0 2020-02-11T16:18:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff52c0045c0 0x7ff52c004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54659c700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5480a18a0 0x7ff52c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff545d9b700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff52c003b80 0x7ff52c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 -- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5480a18a0 msgr2=0x7ff52c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5480a18a0 0x7ff52c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 -- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff52c003b80 msgr2=0x7ff52c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff52c003b80 0x7ff52c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 -- 172.21.15.88:0/632030853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c003230 con 0x7ff52c0045c0 2020-02-11T16:18:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff52c0045c0 0x7ff52c004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff540001760 tx=0x7ff5480a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff52c0045c0 0x7ff52c004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff540001760 tx=0x7ff5480a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff52c0045c0 0x7ff52c004a20 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7ff540001760 tx=0x7ff5480a1c80).ready entity=mon.1 client_cookie=d1a1332195c653b3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff52c0045c0 0x7ff52c004a20 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7ff540001760 tx=0x7ff5480a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff52c0045c0 0x7ff52c004a20 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7ff540001760 tx=0x7ff5480a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54000e540 con 0x7ff52c0045c0 2020-02-11T16:18:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff52c0045c0 0x7ff52c004a20 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7ff540001760 tx=0x7ff5480a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54000e6a0 con 0x7ff52c0045c0 2020-02-11T16:18:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54559a700 1 -- 172.21.15.88:0/632030853 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54000ea00 con 0x7ff52c0045c0 2020-02-11T16:18:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54c8e3700 1 -- 172.21.15.88:0/632030853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff52c0045c0 msgr2=0x7ff52c004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff54c8e3700 1 --2- 172.21.15.88:0/632030853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff52c0045c0 0x7ff52c004a20 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7ff540001760 tx=0x7ff5480a1c80).stop 2020-02-11T16:18:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.035+0000 7ff546d9d700 1 -- 172.21.15.88:0/632030853 reap_dead start 2020-02-11T16:18:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.036+0000 7ff54c8e3700 1 -- 172.21.15.88:0/632030853 shutdown_connections 2020-02-11T16:18:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.036+0000 7ff54c8e3700 1 -- 172.21.15.88:0/632030853 >> 172.21.15.88:0/632030853 conn(0x7ff54809d110 msgr2=0x7ff54809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.036+0000 7ff54c8e3700 1 -- 172.21.15.88:0/632030853 shutdown_connections 2020-02-11T16:18:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.036+0000 7ff54c8e3700 1 -- 172.21.15.88:0/632030853 wait complete. 2020-02-11T16:18:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.037+0000 7ff54c8e3700 1 Processor -- start 2020-02-11T16:18:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.037+0000 7ff54c8e3700 1 -- start start 2020-02-11T16:18:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.037+0000 7ff54c8e3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5481343d0 0x7ff548146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.037+0000 7ff54c8e3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff548146fe0 0x7ff548129290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.037+0000 7ff54c8e3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff5481296f0 0x7ff548129b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.037+0000 7ff54c8e3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54805af40 con 0x7ff5481296f0 2020-02-11T16:18:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.037+0000 7ff54c8e3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54812bed0 con 0x7ff548146fe0 2020-02-11T16:18:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.037+0000 7ff54c8e3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5481347b0 con 0x7ff5481343d0 2020-02-11T16:18:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff548146fe0 0x7ff548129290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff548146fe0 0x7ff548129290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56870/0 (socket says 172.21.15.88:56870) 2020-02-11T16:18:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 -- 172.21.15.88:0/1588691598 learned_addr learned my addr 172.21.15.88:0/1588691598 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff54659c700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5481343d0 0x7ff548146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff546d9d700 1 --2- 172.21.15.88:0/1588691598 >> v2:172.21.15.52:3300/0 conn(0x7ff5481296f0 0x7ff548129b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 -- 172.21.15.88:0/1588691598 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5481343d0 msgr2=0x7ff548146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5481343d0 0x7ff548146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 -- 172.21.15.88:0/1588691598 >> v2:172.21.15.52:3300/0 conn(0x7ff5481296f0 msgr2=0x7ff548129b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> v2:172.21.15.52:3300/0 conn(0x7ff5481296f0 0x7ff548129b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 -- 172.21.15.88:0/1588691598 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff548138150 con 0x7ff548146fe0 2020-02-11T16:18:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> v2:172.21.15.88:3300/0 conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> v2:172.21.15.88:3300/0 conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff5377fe700 1 -- 172.21.15.88:0/1588691598 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff538005e90 con 0x7ff548146fe0 2020-02-11T16:18:57.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff5377fe700 1 -- 172.21.15.88:0/1588691598 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff538007160 con 0x7ff548146fe0 2020-02-11T16:18:57.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff5377fe700 1 -- 172.21.15.88:0/1588691598 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff538007580 con 0x7ff548146fe0 2020-02-11T16:18:57.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff54c8e3700 1 -- 172.21.15.88:0/1588691598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff548138450 con 0x7ff548146fe0 2020-02-11T16:18:57.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.038+0000 7ff54c8e3700 1 -- 172.21.15.88:0/1588691598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54805aca0 con 0x7ff548146fe0 2020-02-11T16:18:57.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.039+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.039+0000 7ff5377fe700 1 -- 172.21.15.88:0/1588691598 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff538008970 con 0x7ff548146fe0 2020-02-11T16:18:57.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.039+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.039+0000 7ff5377fe700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff524039cd0 0x7ff52403c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.039+0000 7ff5377fe700 1 -- 172.21.15.88:0/1588691598 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff538049810 con 0x7ff548146fe0 2020-02-11T16:18:57.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.039+0000 7ff54c8e3700 1 -- 172.21.15.88:0/1588691598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5480565b0 con 0x7ff548146fe0 2020-02-11T16:18:57.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.039+0000 7ff54659c700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff524039cd0 0x7ff52403c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.040+0000 7ff54659c700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff524039cd0 0x7ff52403c190 crc :-1 s=READY pgs=336 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.043+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.043+0000 7ff5377fe700 1 -- 172.21.15.88:0/1588691598 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff53802ee70 con 0x7ff548146fe0 2020-02-11T16:18:57.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.226+0000 7ff54c8e3700 1 -- 172.21.15.88:0/1588691598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff548132440 con 0x7ff548146fe0 2020-02-11T16:18:57.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.226+0000 7ff545d9b700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.226+0000 7ff5377fe700 1 -- 172.21.15.88:0/1588691598 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7ff538031960 con 0x7ff548146fe0 2020-02-11T16:18:57.229 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:57.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.227+0000 7ff54c8e3700 1 -- 172.21.15.88:0/1588691598 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff524039cd0 msgr2=0x7ff52403c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff524039cd0 0x7ff52403c190 crc :-1 s=READY pgs=336 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 -- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 msgr2=0x7ff548129290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 0x7ff548129290 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7ff538002f30 tx=0x7ff538010ae0).stop 2020-02-11T16:18:57.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 -- 172.21.15.88:0/1588691598 shutdown_connections 2020-02-11T16:18:57.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff524039cd0 0x7ff52403c190 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 --2- 172.21.15.88:0/1588691598 >> v2:172.21.15.52:3300/0 conn(0x7ff5481296f0 0x7ff548129b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5481343d0 0x7ff548146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 --2- 172.21.15.88:0/1588691598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff548146fe0 0x7ff548129290 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 -- 172.21.15.88:0/1588691598 >> 172.21.15.88:0/1588691598 conn(0x7ff54809d110 msgr2=0x7ff54812b750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 -- 172.21.15.88:0/1588691598 shutdown_connections 2020-02-11T16:18:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.228+0000 7ff54c8e3700 1 -- 172.21.15.88:0/1588691598 wait complete. 2020-02-11T16:18:57.240 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":108,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:57.240 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:18:57.240 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:18:57.241 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:18:57.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.344+0000 7f06889cd700 1 Processor -- start 2020-02-11T16:18:57.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.344+0000 7f06889cd700 1 -- start start 2020-02-11T16:18:57.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f06889cd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f06840a18a0 0x7f06840a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f06889cd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06840a5de0 0x7f06840a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f06889cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f068412e3a0 0x7f068412e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f06889cd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06840a3570 con 0x7f068412e3a0 2020-02-11T16:18:57.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f06889cd700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06840a3810 con 0x7f06840a18a0 2020-02-11T16:18:57.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f06889cd700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06840a3ab0 con 0x7f06840a5de0 2020-02-11T16:18:57.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f06840a18a0 0x7f06840a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f06840a18a0 0x7f06840a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56876/0 (socket says 172.21.15.88:56876) 2020-02-11T16:18:57.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 -- 172.21.15.88:0/1062624035 learned_addr learned my addr 172.21.15.88:0/1062624035 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:57.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f0681d9b700 1 --2- 172.21.15.88:0/1062624035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06840a5de0 0x7f06840a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f0682d9d700 1 --2- 172.21.15.88:0/1062624035 >> v2:172.21.15.52:3300/0 conn(0x7f068412e3a0 0x7f068412e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 -- 172.21.15.88:0/1062624035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06840a5de0 msgr2=0x7f06840a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 --2- 172.21.15.88:0/1062624035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06840a5de0 0x7f06840a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 -- 172.21.15.88:0/1062624035 >> v2:172.21.15.52:3300/0 conn(0x7f068412e3a0 msgr2=0x7f068412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 --2- 172.21.15.88:0/1062624035 >> v2:172.21.15.52:3300/0 conn(0x7f068412e3a0 0x7f068412e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 -- 172.21.15.88:0/1062624035 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840a3d50 con 0x7f06840a18a0 2020-02-11T16:18:57.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f0681d9b700 1 --2- 172.21.15.88:0/1062624035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06840a5de0 0x7f06840a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:18:57.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f0682d9d700 1 --2- 172.21.15.88:0/1062624035 >> v2:172.21.15.52:3300/0 conn(0x7f068412e3a0 0x7f068412e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:18:57.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 --2- 172.21.15.88:0/1062624035 >> v2:172.21.15.88:3300/0 conn(0x7f06840a18a0 0x7f06840a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f068405bbc0 tx=0x7f067c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 --2- 172.21.15.88:0/1062624035 >> v2:172.21.15.88:3300/0 conn(0x7f06840a18a0 0x7f06840a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f068405bbc0 tx=0x7f067c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 --2- 172.21.15.88:0/1062624035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a18a0 0x7f06840a6dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f067c008c60).ready entity=mon.1 client_cookie=538945ed64781b70 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 --2- 172.21.15.88:0/1062624035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a18a0 0x7f06840a6dd0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f067c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068159a700 1 -- 172.21.15.88:0/1062624035 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f067c00a160 con 0x7f06840a18a0 2020-02-11T16:18:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 --2- 172.21.15.88:0/1062624035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a18a0 0x7f06840a6dd0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f067c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068159a700 1 -- 172.21.15.88:0/1062624035 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c00a2c0 con 0x7f06840a18a0 2020-02-11T16:18:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068259c700 1 --2- 172.21.15.88:0/1062624035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a18a0 0x7f06840a6dd0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f067c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f068159a700 1 -- 172.21.15.88:0/1062624035 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f067c00a6a0 con 0x7f06840a18a0 2020-02-11T16:18:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f06889cd700 1 -- 172.21.15.88:0/1062624035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a18a0 msgr2=0x7f06840a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.345+0000 7f06889cd700 1 --2- 172.21.15.88:0/1062624035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a18a0 0x7f06840a6dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f067c008c60).stop 2020-02-11T16:18:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.346+0000 7f06889cd700 1 -- 172.21.15.88:0/1062624035 shutdown_connections 2020-02-11T16:18:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.346+0000 7f06889cd700 1 --2- 172.21.15.88:0/1062624035 >> v2:172.21.15.52:3300/0 conn(0x7f068412e3a0 0x7f068412e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.346+0000 7f06889cd700 1 --2- 172.21.15.88:0/1062624035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a18a0 0x7f06840a6dd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.346+0000 7f06889cd700 1 --2- 172.21.15.88:0/1062624035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06840a5de0 0x7f06840a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.346+0000 7f06889cd700 1 -- 172.21.15.88:0/1062624035 >> 172.21.15.88:0/1062624035 conn(0x7f068409d110 msgr2=0x7f068409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:57.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.346+0000 7f06889cd700 1 -- 172.21.15.88:0/1062624035 shutdown_connections 2020-02-11T16:18:57.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.346+0000 7f06889cd700 1 -- 172.21.15.88:0/1062624035 wait complete. 2020-02-11T16:18:57.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.347+0000 7f06889cd700 1 Processor -- start 2020-02-11T16:18:57.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.347+0000 7f06889cd700 1 -- start start 2020-02-11T16:18:57.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.347+0000 7f06889cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06840a18a0 0x7f0684146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.347+0000 7f06889cd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0684136730 con 0x7f068412e3a0 2020-02-11T16:18:57.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.347+0000 7f06889cd700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06841369d0 con 0x7f06840a5de0 2020-02-11T16:18:57.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.347+0000 7f06889cd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0684136540 con 0x7f06840a18a0 2020-02-11T16:18:57.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.347+0000 7f0681d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f06840a5de0 0x7f06841283c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44508/0 (socket says 172.21.15.88:44508) 2020-02-11T16:18:57.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.347+0000 7f0681d9b700 1 -- 172.21.15.88:0/3875626743 learned_addr learned my addr 172.21.15.88:0/3875626743 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.347+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865554222 0 0) 0x7f06841369d0 con 0x7f06840a5de0 2020-02-11T16:18:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0668002fe0 con 0x7f06840a5de0 2020-02-11T16:18:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> v2:172.21.15.52:3300/0 conn(0x7f06840a18a0 0x7f0684146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2080051057 0 0) 0x7f0668002fe0 con 0x7f06840a5de0 2020-02-11T16:18:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f06841369d0 con 0x7f06840a5de0 2020-02-11T16:18:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f066c0026d0 con 0x7f06840a5de0 2020-02-11T16:18:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 >> v2:172.21.15.52:3300/0 conn(0x7f06840a18a0 msgr2=0x7f0684146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 --2- 172.21.15.88:0/3875626743 >> v2:172.21.15.52:3300/0 conn(0x7f06840a18a0 0x7f0684146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 >> v1:172.21.15.88:6789/0 conn(0x7f06840a5de0 legacy=0x7f06841283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 >> v1:172.21.15.52:6789/0 conn(0x7f068412e3a0 legacy=0x7f068414d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06680049b0 0x7f0668004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0668003920 0x7f0668003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0668004740 con 0x7f0668003920 2020-02-11T16:18:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066800bbb0 con 0x7f0668004200 2020-02-11T16:18:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066800bcf0 con 0x7f06680049b0 2020-02-11T16:18:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06680049b0 0x7f0668004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0681d9b700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0668003920 0x7f0668003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0682d9d700 1 -- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06680049b0 msgr2=0x7f0668004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06680049b0 0x7f0668004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0682d9d700 1 -- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0668003920 msgr2=0x7f0668003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0668003920 0x7f0668003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0682d9d700 1 -- 172.21.15.88:0/3875626743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0684136c70 con 0x7f0668004200 2020-02-11T16:18:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f06889cd700 1 -- 172.21.15.88:0/3875626743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06840a5ac0 con 0x7f0668004200 2020-02-11T16:18:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06840a92d0 tx=0x7f0674010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0682d9d700 1 -- 172.21.15.88:0/3875626743 reap_dead start 2020-02-11T16:18:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f06889cd700 1 -- 172.21.15.88:0/3875626743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0684135a50 con 0x7f0668004200 2020-02-11T16:18:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06840a92d0 tx=0x7f0674010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.348+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f06840a92d0 tx=0x7f0674010900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f06840a92d0 tx=0x7f0674010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0674007170 con 0x7f0668004200 2020-02-11T16:18:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f06840a92d0 tx=0x7f0674010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f06840a92d0 tx=0x7f0674010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0674011e90 con 0x7f0668004200 2020-02-11T16:18:57.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06740074c0 con 0x7f0668004200 2020-02-11T16:18:57.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f06840a92d0 tx=0x7f0674010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f06740056c0 con 0x7f0668004200 2020-02-11T16:18:57.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f0682d9d700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f06840a92d0 tx=0x7f0674010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f06889cd700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 0x7f06841283c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f06889cd700 1 -- 172.21.15.88:0/3875626743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068405e2f0 con 0x7f06840a4e50 2020-02-11T16:18:57.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 0x7f06841283c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f067b7fe700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f066803de40 0x7f0668040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.349+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f0674048ed0 con 0x7f0668004200 2020-02-11T16:18:57.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f068259c700 1 -- 172.21.15.88:0/3875626743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06840565b0 con 0x7f06840a4e50 2020-02-11T16:18:57.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f0681d9b700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f066803de40 0x7f0668040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 0x7f06841283c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 0x7f06841283c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 0x7f06841283c0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 0x7f06841283c0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f067c005c30 con 0x7f06840a4e50 2020-02-11T16:18:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f0681d9b700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f066803de40 0x7f0668040300 crc :-1 s=READY pgs=337 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 0x7f06841283c0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f067c005d90 con 0x7f06840a4e50 2020-02-11T16:18:57.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 msgr2=0x7f06841283c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f067b7fe700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 0x7f06841283c0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).stop 2020-02-11T16:18:57.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 msgr2=0x7f06841283c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:57.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.350+0000 7f067b7fe700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 0x7f06841283c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.358+0000 7f06889cd700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 0x7f0684128820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.358+0000 7f06889cd700 1 -- 172.21.15.88:0/3875626743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068405ccb0 con 0x7f06840a5230 2020-02-11T16:18:57.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.358+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 0x7f0684128820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.358+0000 7f068259c700 1 -- 172.21.15.88:0/3875626743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0684128c80 con 0x7f06840a5230 2020-02-11T16:18:57.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.358+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 0x7f0684128820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.358+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 0x7f0684128820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.358+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 0x7f0684128820 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 0x7f0684128820 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f067c007930 con 0x7f06840a5230 2020-02-11T16:18:57.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f068259c700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 0x7f0684128820 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f067c00d5c0 con 0x7f06840a5230 2020-02-11T16:18:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 msgr2=0x7f0684128820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f067b7fe700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 0x7f0684128820 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).stop 2020-02-11T16:18:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f067b7fe700 1 -- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 msgr2=0x7f0684128820 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f067b7fe700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 0x7f0684128820 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0x7f068405bbc0 tx=0x7f06840a1c80).stop 2020-02-11T16:18:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 -- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f066803de40 msgr2=0x7f0668040300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f066803de40 0x7f0668040300 crc :-1 s=READY pgs=337 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 -- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 msgr2=0x7f066800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f06840a92d0 tx=0x7f0674010900).stop 2020-02-11T16:18:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 -- 172.21.15.88:0/3875626743 shutdown_connections 2020-02-11T16:18:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f066803de40 0x7f0668040300 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0668004200 0x7f066800b750 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a4e50 0x7f06841283c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 --2- 172.21.15.88:0/3875626743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06840a5230 0x7f0684128820 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 -- 172.21.15.88:0/3875626743 >> 172.21.15.88:0/3875626743 conn(0x7f068409d110 msgr2=0x7f06840a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:57.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 -- 172.21.15.88:0/3875626743 shutdown_connections 2020-02-11T16:18:57.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.359+0000 7f06889cd700 1 -- 172.21.15.88:0/3875626743 wait complete. 2020-02-11T16:18:57.377 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:18:57.377 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:57.377 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:57.377 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:18:57.377 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 108, 2020-02-11T16:18:57.378 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:18:57.378 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:18:57.378 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:18:57.378 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:18:57.378 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.379 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:18:57.379 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:57.379 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:18:57.379 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:18:57.379 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:57.379 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:57.379 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:57.380 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:57.380 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:57.380 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:57.380 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.380 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:18:57.380 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:18:57.380 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:57.380 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:57.381 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:57.381 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:57.381 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:57.381 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:57.381 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.381 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:18:57.382 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:18:57.382 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:18:57.382 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:18:57.382 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:18:57.382 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:18:57.382 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:57.382 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:57.383 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:18:57.383 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:18:57.383 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:57.383 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:18:57.383 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:57.383 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:57.383 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:57.383 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:57.384 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:57.384 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:57.384 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.384 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:18:57.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.384 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:18:57.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.385 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:18:57.385 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:18:57.385 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:57.385 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:57.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.385 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:57.385 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:18:57.386 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.386 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:57.386 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:18:57.386 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.386 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.386 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.387 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:18:57.387 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:18:57.387 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:57.387 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:57.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.388 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:57.388 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:57.388 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:57.388 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:57.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.389 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:57.389 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:18:57.389 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.390 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:57.390 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:18:57.390 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.390 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.390 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.391 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:18:57.391 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:18:57.391 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:57.391 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:57.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.392 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:57.392 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:57.392 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:57.392 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:57.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.392 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:57.392 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:18:57.392 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.393 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:57.393 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:18:57.393 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.393 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.393 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.394 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:18:57.394 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:18:57.394 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:57.394 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:57.394 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.394 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.395 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:18:57.395 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:18:57.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.395 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.395 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.395 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:57.395 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.396 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.396 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:18:57.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.396 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.396 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.396 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:57.396 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.397 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.397 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:18:57.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.397 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.397 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.397 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:18:57.397 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.397 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.398 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:18:57.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.398 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.398 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.398 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:18:57.398 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.399 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.399 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:18:57.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.399 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.399 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.399 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:57.400 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.400 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.400 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.400 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:18:57.400 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:18:57.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.504+0000 7f8f60191700 1 Processor -- start 2020-02-11T16:18:57.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.504+0000 7f8f60191700 1 -- start start 2020-02-11T16:18:57.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f60191700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f580a2fa0 0x7f8f580a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f60191700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f580a5410 0x7f8f580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f60191700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f580a4350 con 0x7f8f58131280 2020-02-11T16:18:57.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f60191700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f580a1e60 con 0x7f8f580a5410 2020-02-11T16:18:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f60191700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f580a3450 con 0x7f8f580a2fa0 2020-02-11T16:18:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f580a2fa0 0x7f8f580a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5e72e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8f58131280 0x7f8f581316d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44530/0 (socket says 172.21.15.88:44530) 2020-02-11T16:18:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f580a2fa0 0x7f8f580a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56900/0 (socket says 172.21.15.88:56900) 2020-02-11T16:18:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5e72e700 1 -- 172.21.15.88:0/343736315 learned_addr learned my addr 172.21.15.88:0/343736315 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/343736315 >> v2:172.21.15.52:3300/0 conn(0x7f8f580a5410 0x7f8f580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 -- 172.21.15.88:0/343736315 >> v2:172.21.15.52:3300/0 conn(0x7f8f580a5410 msgr2=0x7f8f580a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/343736315 >> v2:172.21.15.52:3300/0 conn(0x7f8f580a5410 0x7f8f580a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 -- 172.21.15.88:0/343736315 >> v1:172.21.15.88:6789/0 conn(0x7f8f58131280 legacy=0x7f8f581316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 -- 172.21.15.88:0/343736315 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580a3a40 con 0x7f8f580a2fa0 2020-02-11T16:18:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5cf2b700 1 -- 172.21.15.88:0/343736315 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132349241 0 0) 0x7f8f580a4350 con 0x7f8f58131280 2020-02-11T16:18:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/343736315 >> v2:172.21.15.52:3300/0 conn(0x7f8f580a5410 0x7f8f580a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:18:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/343736315 >> v2:172.21.15.88:3300/0 conn(0x7f8f580a2fa0 0x7f8f580a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8f48002f30 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/343736315 >> v2:172.21.15.88:3300/0 conn(0x7f8f580a2fa0 0x7f8f580a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8f48002f30 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/343736315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a2fa0 0x7f8f580a1520 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f8f48002f30 tx=0x7f8f48007a40).ready entity=mon.1 client_cookie=2e9887b8858b57ed server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/343736315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a2fa0 0x7f8f580a1520 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f8f48002f30 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5cf2b700 1 -- 172.21.15.88:0/343736315 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f48011470 con 0x7f8f580a2fa0 2020-02-11T16:18:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/343736315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a2fa0 0x7f8f580a1520 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f8f48002f30 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/343736315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a2fa0 0x7f8f580a1520 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f8f48002f30 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5cf2b700 1 -- 172.21.15.88:0/343736315 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f480115d0 con 0x7f8f580a2fa0 2020-02-11T16:18:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f5cf2b700 1 -- 172.21.15.88:0/343736315 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f48011930 con 0x7f8f580a2fa0 2020-02-11T16:18:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f60191700 1 -- 172.21.15.88:0/343736315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a2fa0 msgr2=0x7f8f580a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.505+0000 7f8f60191700 1 --2- 172.21.15.88:0/343736315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a2fa0 0x7f8f580a1520 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f8f48002f30 tx=0x7f8f48007a40).stop 2020-02-11T16:18:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.506+0000 7f8f60191700 1 -- 172.21.15.88:0/343736315 shutdown_connections 2020-02-11T16:18:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.506+0000 7f8f60191700 1 --2- 172.21.15.88:0/343736315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a2fa0 0x7f8f580a1520 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.506+0000 7f8f60191700 1 --2- 172.21.15.88:0/343736315 >> v2:172.21.15.52:3300/0 conn(0x7f8f580a5410 0x7f8f580a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.506+0000 7f8f60191700 1 -- 172.21.15.88:0/343736315 >> 172.21.15.88:0/343736315 conn(0x7f8f5809d110 msgr2=0x7f8f5809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.506+0000 7f8f60191700 1 -- 172.21.15.88:0/343736315 shutdown_connections 2020-02-11T16:18:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.506+0000 7f8f60191700 1 -- 172.21.15.88:0/343736315 wait complete. 2020-02-11T16:18:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.507+0000 7f8f60191700 1 Processor -- start 2020-02-11T16:18:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.507+0000 7f8f60191700 1 -- start start 2020-02-11T16:18:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f60191700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f580a5410 0x7f8f58145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f60191700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f58131280 0x7f8f58145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f60191700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f58133870 con 0x7f8f580a2fa0 2020-02-11T16:18:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f60191700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f58133b10 con 0x7f8f58131280 2020-02-11T16:18:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f60191700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f58133db0 con 0x7f8f580a5410 2020-02-11T16:18:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f580a5410 0x7f8f58145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f580a5410 0x7f8f58145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56908/0 (socket says 172.21.15.88:56908) 2020-02-11T16:18:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 -- 172.21.15.88:0/2770475344 learned_addr learned my addr 172.21.15.88:0/2770475344 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5e72e700 1 --2- 172.21.15.88:0/2770475344 >> v2:172.21.15.52:3300/0 conn(0x7f8f58131280 0x7f8f58145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 -- 172.21.15.88:0/2770475344 >> v2:172.21.15.52:3300/0 conn(0x7f8f58131280 msgr2=0x7f8f58145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/2770475344 >> v2:172.21.15.52:3300/0 conn(0x7f8f58131280 0x7f8f58145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 -- 172.21.15.88:0/2770475344 >> v1:172.21.15.52:6789/0 conn(0x7f8f580a2fa0 legacy=0x7f8f58066b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 -- 172.21.15.88:0/2770475344 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f58132350 con 0x7f8f580a5410 2020-02-11T16:18:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5e72e700 1 --2- 172.21.15.88:0/2770475344 >> v2:172.21.15.52:3300/0 conn(0x7f8f58131280 0x7f8f58145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:18:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/2770475344 >> v2:172.21.15.88:3300/0 conn(0x7f8f580a5410 0x7f8f58145000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f54002f30 tx=0x7f8f54010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/2770475344 >> v2:172.21.15.88:3300/0 conn(0x7f8f580a5410 0x7f8f58145000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f54002f30 tx=0x7f8f54010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a5410 0x7f8f58145000 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f8f54002f30 tx=0x7f8f54010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a5410 0x7f8f58145000 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f8f54002f30 tx=0x7f8f54010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f54007160 con 0x7f8f580a5410 2020-02-11T16:18:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a5410 0x7f8f58145000 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f8f54002f30 tx=0x7f8f54010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f540072c0 con 0x7f8f580a5410 2020-02-11T16:18:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a5410 0x7f8f58145000 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f8f54002f30 tx=0x7f8f54010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f540059c0 con 0x7f8f580a5410 2020-02-11T16:18:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f60191700 1 -- 172.21.15.88:0/2770475344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f581458c0 con 0x7f8f580a5410 2020-02-11T16:18:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.508+0000 7f8f60191700 1 -- 172.21.15.88:0/2770475344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f581316d0 con 0x7f8f580a5410 2020-02-11T16:18:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.509+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a5410 0x7f8f58145000 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f8f54002f30 tx=0x7f8f54010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.509+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8f54005c40 con 0x7f8f580a5410 2020-02-11T16:18:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.509+0000 7f8f5d72c700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a5410 0x7f8f58145000 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f8f54002f30 tx=0x7f8f54010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.509+0000 7f8f60191700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 0x7f8f580aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.509+0000 7f8f60191700 1 -- 172.21.15.88:0/2770475344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5805e2f0 con 0x7f8f580a92b0 2020-02-11T16:18:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.509+0000 7f8f46ffd700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f38039bc0 0x7f8f3803c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.509+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 0x7f8f580aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.509+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8f54049a70 con 0x7f8f580a5410 2020-02-11T16:18:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.509+0000 7f8f5e72e700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f38039bc0 0x7f8f3803c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f5df2d700 1 -- 172.21.15.88:0/2770475344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f58133fb0 con 0x7f8f580a92b0 2020-02-11T16:18:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 0x7f8f580aa8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f5e72e700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f38039bc0 0x7f8f3803c080 crc :-1 s=READY pgs=338 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 0x7f8f580aa8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 0x7f8f580aa8d0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 0x7f8f580aa8d0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f4800f760 con 0x7f8f580a92b0 2020-02-11T16:18:57.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 0x7f8f580aa8d0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8f48007150 con 0x7f8f580a92b0 2020-02-11T16:18:57.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 msgr2=0x7f8f580aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f46ffd700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 0x7f8f580aa8d0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).stop 2020-02-11T16:18:57.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 msgr2=0x7f8f580aa8d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:57.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.510+0000 7f8f46ffd700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f580a92b0 0x7f8f580aa8d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.518+0000 7f8f60191700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 0x7f8f5812b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.518+0000 7f8f60191700 1 -- 172.21.15.88:0/2770475344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f58133c50 con 0x7f8f5812b3f0 2020-02-11T16:18:57.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.519+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 0x7f8f5812b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.519+0000 7f8f5df2d700 1 -- 172.21.15.88:0/2770475344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8f580565b0 con 0x7f8f5812b3f0 2020-02-11T16:18:57.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.519+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 0x7f8f5812b7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.519+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 0x7f8f5812b7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.519+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 0x7f8f5812b7d0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.519+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 0x7f8f5812b7d0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.519+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f4800d5c0 con 0x7f8f5812b3f0 2020-02-11T16:18:57.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f5df2d700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 0x7f8f5812b7d0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3853 (secure 0 0 0) 0x7f8f4800d720 con 0x7f8f5812b3f0 2020-02-11T16:18:57.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 msgr2=0x7f8f5812b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f46ffd700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 0x7f8f5812b7d0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f8f5812d0e0 tx=0x7f8f48007a40).stop 2020-02-11T16:18:57.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f46ffd700 1 -- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 msgr2=0x7f8f5812b7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:57.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f46ffd700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f5812b3f0 0x7f8f5812b7d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f60191700 1 -- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f38039bc0 msgr2=0x7f8f3803c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f60191700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f38039bc0 0x7f8f3803c080 crc :-1 s=READY pgs=338 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f60191700 1 -- 172.21.15.88:0/2770475344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a5410 msgr2=0x7f8f58145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f60191700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a5410 0x7f8f58145000 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f8f54002f30 tx=0x7f8f54010b70).stop 2020-02-11T16:18:57.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f5e72e700 1 -- 172.21.15.88:0/2770475344 reap_dead start 2020-02-11T16:18:57.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f5e72e700 1 -- 172.21.15.88:0/2770475344 reap_dead start 2020-02-11T16:18:57.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f60191700 1 -- 172.21.15.88:0/2770475344 shutdown_connections 2020-02-11T16:18:57.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f60191700 1 --2- 172.21.15.88:0/2770475344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f580a5410 0x7f8f58145000 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f60191700 1 -- 172.21.15.88:0/2770475344 >> 172.21.15.88:0/2770475344 conn(0x7f8f5809d110 msgr2=0x7f8f58069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:57.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f60191700 1 -- 172.21.15.88:0/2770475344 shutdown_connections 2020-02-11T16:18:57.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.520+0000 7f8f60191700 1 -- 172.21.15.88:0/2770475344 wait complete. 2020-02-11T16:18:57.534 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:18:57.535 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:18:57.535 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:18:57.535 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:18:57.535 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 108, 2020-02-11T16:18:57.535 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:18:57.535 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:18:57.535 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:18:57.536 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:18:57.536 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.536 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:18:57.536 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:57.536 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:18:57.536 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:18:57.536 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:57.537 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:57.537 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:57.537 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:57.537 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:57.537 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:57.537 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.537 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:18:57.538 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:18:57.538 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:57.538 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:57.538 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:57.538 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:57.538 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:57.538 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:57.539 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.539 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:18:57.539 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:18:57.539 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:18:57.539 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:18:57.539 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:18:57.540 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:18:57.540 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:57.540 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:57.540 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:18:57.540 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:18:57.540 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:57.540 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:18:57.540 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:57.541 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:57.541 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:57.541 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:57.541 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:57.541 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:57.541 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.542 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:18:57.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.542 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:18:57.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.542 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:18:57.543 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:18:57.543 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:57.543 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:57.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.543 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:57.543 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:18:57.543 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.544 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:57.544 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:18:57.544 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.544 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.544 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.545 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:18:57.545 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:18:57.545 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:57.545 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:57.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.545 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:57.546 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:57.546 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:57.546 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:57.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.546 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:57.546 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:18:57.546 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.547 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:57.547 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:18:57.547 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.547 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.547 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.548 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:18:57.548 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:18:57.548 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:57.548 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:57.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.549 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:57.549 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:57.549 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:57.549 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:57.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.549 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:57.550 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:18:57.550 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.551 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:57.551 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:18:57.551 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.552 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.552 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.552 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:18:57.552 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:18:57.552 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:57.552 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:57.553 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.553 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.553 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:18:57.553 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:18:57.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.553 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.554 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.554 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:57.554 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.554 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.554 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:18:57.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.554 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.554 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.555 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:57.555 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.555 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.555 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.555 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:18:57.556 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:18:57.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.660+0000 7f541885d700 1 Processor -- start 2020-02-11T16:18:57.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.660+0000 7f541885d700 1 -- start start 2020-02-11T16:18:57.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.660+0000 7f541885d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5de0 0x7f54140a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.660+0000 7f541885d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5414134a50 0x7f5414134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.660+0000 7f541885d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54140a31b0 con 0x7f54140a18a0 2020-02-11T16:18:57.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.660+0000 7f541885d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54140a3570 con 0x7f5414134a50 2020-02-11T16:18:57.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.660+0000 7f541885d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54140a3810 con 0x7f54140a5de0 2020-02-11T16:18:57.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.660+0000 7f541259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f54140a18a0 0x7f54140a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44544/0 (socket says 172.21.15.88:44544) 2020-02-11T16:18:57.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.660+0000 7f541259c700 1 -- 172.21.15.88:0/1797702544 learned_addr learned my addr 172.21.15.88:0/1797702544 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:57.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325583872 0 0) 0x7f54140a31b0 con 0x7f54140a18a0 2020-02-11T16:18:57.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f5411d9b700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5de0 0x7f54140a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f8003230 con 0x7f54140a18a0 2020-02-11T16:18:57.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f5412d9d700 1 --2- 172.21.15.88:0/1797702544 >> v2:172.21.15.52:3300/0 conn(0x7f5414134a50 0x7f5414134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3539859979 0 0) 0x7f53f8003230 con 0x7f54140a18a0 2020-02-11T16:18:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5de0 msgr2=0x7f54140a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5de0 0x7f54140a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 >> v2:172.21.15.52:3300/0 conn(0x7f5414134a50 msgr2=0x7f5414134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 --2- 172.21.15.88:0/1797702544 >> v2:172.21.15.52:3300/0 conn(0x7f5414134a50 0x7f5414134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54140a3ab0 con 0x7f54140a18a0 2020-02-11T16:18:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f54080016d0 con 0x7f54140a18a0 2020-02-11T16:18:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 >> v1:172.21.15.88:6789/0 conn(0x7f54140a18a0 legacy=0x7f54140a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5de0 0x7f53f8003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8003bb0 0x7f53f8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f80045e0 0x7f53f8004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140a3570 con 0x7f53f8003bb0 2020-02-11T16:18:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140a3810 con 0x7f53f80045e0 2020-02-11T16:18:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8005090 con 0x7f54140a5de0 2020-02-11T16:18:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f5412d9d700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f80045e0 0x7f53f8004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f5411d9b700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8003bb0 0x7f53f8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f541259c700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5de0 0x7f53f8003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f5412d9d700 1 -- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5de0 msgr2=0x7f53f8003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f5412d9d700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5de0 0x7f53f8003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f5412d9d700 1 -- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8003bb0 msgr2=0x7f53f8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f5412d9d700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8003bb0 0x7f53f8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.661+0000 7f5412d9d700 1 -- 172.21.15.88:0/1797702544 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f8003230 con 0x7f53f80045e0 2020-02-11T16:18:57.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f5412d9d700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f80045e0 0x7f53f8004a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f540c0032b0 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f5412d9d700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f80045e0 0x7f53f8004a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f540c0032b0 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f5412d9d700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f80045e0 0x7f53f8004a60 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f540c0032b0 tx=0x7f540c0103d0).ready entity=mon.1 client_cookie=7caf5ab6461d6465 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f5412d9d700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f80045e0 0x7f53f8004a60 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f540c0032b0 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c010e40 con 0x7f53f80045e0 2020-02-11T16:18:57.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f5412d9d700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f80045e0 0x7f53f8004a60 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f540c0032b0 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f5412d9d700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f80045e0 0x7f53f8004a60 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f540c0032b0 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c0112b0 con 0x7f53f80045e0 2020-02-11T16:18:57.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f541159a700 1 -- 172.21.15.88:0/1797702544 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c011650 con 0x7f53f80045e0 2020-02-11T16:18:57.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f541885d700 1 -- 172.21.15.88:0/1797702544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f80045e0 msgr2=0x7f53f8004a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f541885d700 1 --2- 172.21.15.88:0/1797702544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f80045e0 0x7f53f8004a60 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f540c0032b0 tx=0x7f540c0103d0).stop 2020-02-11T16:18:57.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f5412d9d700 1 -- 172.21.15.88:0/1797702544 reap_dead start 2020-02-11T16:18:57.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f541885d700 1 -- 172.21.15.88:0/1797702544 shutdown_connections 2020-02-11T16:18:57.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f541885d700 1 -- 172.21.15.88:0/1797702544 >> 172.21.15.88:0/1797702544 conn(0x7f541409d110 msgr2=0x7f541409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:57.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f541885d700 1 -- 172.21.15.88:0/1797702544 shutdown_connections 2020-02-11T16:18:57.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.662+0000 7f541885d700 1 -- 172.21.15.88:0/1797702544 wait complete. 2020-02-11T16:18:57.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.663+0000 7f541885d700 1 Processor -- start 2020-02-11T16:18:57.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.663+0000 7f541885d700 1 -- start start 2020-02-11T16:18:57.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f541885d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f541412c9b0 0x7f541412f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f541885d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f54141290b0 0x7f5414129530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f541885d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5414148ca0 0x7f5414149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f541885d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54140a47f0 con 0x7f54141290b0 2020-02-11T16:18:57.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f541885d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54140a7660 con 0x7f5414148ca0 2020-02-11T16:18:57.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f541885d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5414129990 con 0x7f541412c9b0 2020-02-11T16:18:57.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5414148ca0 0x7f5414149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5414148ca0 0x7f5414149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56934/0 (socket says 172.21.15.88:56934) 2020-02-11T16:18:57.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 -- 172.21.15.88:0/3561155721 learned_addr learned my addr 172.21.15.88:0/3561155721 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:57.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f541412c9b0 0x7f541412f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5411d9b700 1 --2- 172.21.15.88:0/3561155721 >> v2:172.21.15.52:3300/0 conn(0x7f54141290b0 0x7f5414129530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 -- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f541412c9b0 msgr2=0x7f541412f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f541412c9b0 0x7f541412f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 -- 172.21.15.88:0/3561155721 >> v2:172.21.15.52:3300/0 conn(0x7f54141290b0 msgr2=0x7f5414129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 --2- 172.21.15.88:0/3561155721 >> v2:172.21.15.52:3300/0 conn(0x7f54141290b0 0x7f5414129530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 -- 172.21.15.88:0/3561155721 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541412d1e0 con 0x7f5414148ca0 2020-02-11T16:18:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 --2- 172.21.15.88:0/3561155721 >> v2:172.21.15.88:3300/0 conn(0x7f5414148ca0 0x7f5414149110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5408001930 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 --2- 172.21.15.88:0/3561155721 >> v2:172.21.15.88:3300/0 conn(0x7f5414148ca0 0x7f5414149110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5408001930 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5414148ca0 0x7f5414149110 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f5408001930 tx=0x7f540c0103d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5414148ca0 0x7f5414149110 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f5408001930 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5414148ca0 0x7f5414149110 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f5408001930 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c007c20 con 0x7f5414148ca0 2020-02-11T16:18:57.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f5412d9d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5414148ca0 0x7f5414149110 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f5408001930 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c010e40 con 0x7f5414148ca0 2020-02-11T16:18:57.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f541885d700 1 -- 172.21.15.88:0/3561155721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5414066dd0 con 0x7f5414148ca0 2020-02-11T16:18:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c005e20 con 0x7f5414148ca0 2020-02-11T16:18:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.664+0000 7f541885d700 1 -- 172.21.15.88:0/3561155721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5414149570 con 0x7f5414148ca0 2020-02-11T16:18:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.665+0000 7f5412d9d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5414148ca0 0x7f5414149110 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f5408001930 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.665+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f540c007160 con 0x7f5414148ca0 2020-02-11T16:18:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.665+0000 7f5412d9d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5414148ca0 0x7f5414149110 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f5408001930 tx=0x7f540c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.665+0000 7f541885d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 0x7f541405a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.665+0000 7f541885d700 1 -- 172.21.15.88:0/3561155721 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541405e2f0 con 0x7f54140a5310 2020-02-11T16:18:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.665+0000 7f54037fe700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f53f0039c10 0x7f53f003c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.665+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f540c049930 con 0x7f5414148ca0 2020-02-11T16:18:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 0x7f541405a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f5411d9b700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f53f0039c10 0x7f53f003c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f541259c700 1 -- 172.21.15.88:0/3561155721 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5414065d70 con 0x7f54140a5310 2020-02-11T16:18:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 0x7f541405a950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 0x7f541405a950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f5411d9b700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f53f0039c10 0x7f53f003c0d0 crc :-1 s=READY pgs=339 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 0x7f541405a950 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 0x7f541405a950 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540800e530 con 0x7f54140a5310 2020-02-11T16:18:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 0x7f541405a950 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f540800e690 con 0x7f54140a5310 2020-02-11T16:18:57.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 msgr2=0x7f541405a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f54037fe700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 0x7f541405a950 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).stop 2020-02-11T16:18:57.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 msgr2=0x7f541405a950 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:57.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.666+0000 7f54037fe700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a5310 0x7f541405a950 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.674+0000 7f541885d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 0x7f541405adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.674+0000 7f541885d700 1 -- 172.21.15.88:0/3561155721 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54140565b0 con 0x7f54140a56f0 2020-02-11T16:18:57.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.675+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 0x7f541405adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.675+0000 7f541259c700 1 -- 172.21.15.88:0/3561155721 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f54140008d0 con 0x7f54140a56f0 2020-02-11T16:18:57.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.675+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 0x7f541405adb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.675+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 0x7f541405adb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.675+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 0x7f541405adb0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.675+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 0x7f541405adb0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.675+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5408007420 con 0x7f54140a56f0 2020-02-11T16:18:57.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f541259c700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 0x7f541405adb0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f540800b2a0 con 0x7f54140a56f0 2020-02-11T16:18:57.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 msgr2=0x7f541405adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f54037fe700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 0x7f541405adb0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f54140a5cc0 tx=0x7f541412f3b0).stop 2020-02-11T16:18:57.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f54037fe700 1 -- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 msgr2=0x7f541405adb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:18:57.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f54037fe700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54140a56f0 0x7f541405adb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f541885d700 1 -- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f53f0039c10 msgr2=0x7f53f003c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f541885d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f53f0039c10 0x7f53f003c0d0 crc :-1 s=READY pgs=339 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f541885d700 1 -- 172.21.15.88:0/3561155721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5414148ca0 msgr2=0x7f5414149110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f541885d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5414148ca0 0x7f5414149110 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f5408001930 tx=0x7f540c0103d0).stop 2020-02-11T16:18:57.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f5412d9d700 1 -- 172.21.15.88:0/3561155721 reap_dead start 2020-02-11T16:18:57.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f541885d700 1 -- 172.21.15.88:0/3561155721 shutdown_connections 2020-02-11T16:18:57.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f541885d700 1 --2- 172.21.15.88:0/3561155721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5414148ca0 0x7f5414149110 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f541885d700 1 -- 172.21.15.88:0/3561155721 >> 172.21.15.88:0/3561155721 conn(0x7f541409d110 msgr2=0x7f541412db00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:57.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f541885d700 1 -- 172.21.15.88:0/3561155721 shutdown_connections 2020-02-11T16:18:57.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.676+0000 7f541885d700 1 -- 172.21.15.88:0/3561155721 wait complete. 2020-02-11T16:18:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:18:57.690 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:57.691 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:57.691 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:18:57.691 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 108, 2020-02-11T16:18:57.691 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:18:57.691 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:18:57.691 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:18:57.691 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:18:57.692 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.692 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:18:57.692 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:57.692 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:18:57.692 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:18:57.692 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:57.692 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:57.693 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:57.693 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:57.693 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:57.693 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:57.693 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.693 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:18:57.693 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:18:57.694 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:57.694 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:57.694 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:57.694 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:57.694 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:57.694 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:57.695 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.695 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:18:57.695 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:18:57.695 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:18:57.695 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:18:57.696 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:18:57.696 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:18:57.696 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:57.696 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:18:57.696 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:18:57.696 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:18:57.696 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:18:57.697 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:18:57.697 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:18:57.697 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:18:57.697 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:18:57.697 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:18:57.697 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:18:57.698 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:18:57.698 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.698 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:18:57.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.698 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:18:57.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.698 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:18:57.698 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:18:57.699 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:57.699 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:57.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.699 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:57.699 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:18:57.699 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.700 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:57.700 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:18:57.700 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.700 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.700 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.701 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:18:57.701 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:18:57.701 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:57.701 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:57.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.701 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:18:57.701 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:18:57.702 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:57.702 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:57.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.702 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:57.702 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:18:57.702 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.703 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:57.703 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:18:57.703 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.703 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.703 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.704 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:18:57.704 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:18:57.704 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:57.704 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:57.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.704 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:18:57.704 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:18:57.705 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:18:57.705 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:18:57.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.705 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:18:57.705 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:18:57.705 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.706 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:18:57.706 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:18:57.706 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:18:57.706 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.706 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.707 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:18:57.707 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:18:57.707 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:18:57.707 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:18:57.707 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.707 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:18:57.707 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:18:57.708 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:18:57.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.708 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.708 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.708 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:57.708 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.708 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.709 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:18:57.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.709 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.709 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.709 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:57.709 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.709 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.709 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:18:57.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.710 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.710 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.710 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:18:57.710 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.710 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.710 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:18:57.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.711 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.711 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.711 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:18:57.711 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.711 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:18:57.712 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:18:57.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:18:57.712 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:18:57.712 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:18:57.712 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:18:57.712 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.712 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:18:57.713 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:18:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:18:57.714 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:18:57.714 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:18:57.714 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:18:57.714 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:18:57.714 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:18:57.715 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:18:57.724 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:18:57.724 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:18:57.725 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:18:57.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.866+0000 7f08cd69c700 1 Processor -- start 2020-02-11T16:18:57.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.866+0000 7f08cd69c700 1 -- start start 2020-02-11T16:18:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.867+0000 7f08cd69c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.867+0000 7f08cd69c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08c80a6260 0x7f08c812eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:18:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.867+0000 7f08cd69c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c80a3570 con 0x7f08c80a5de0 2020-02-11T16:18:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.867+0000 7f08cd69c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c80a3810 con 0x7f08c80a6260 2020-02-11T16:18:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.867+0000 7f08cd69c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80a3ab0 con 0x7f08c80a18a0 2020-02-11T16:18:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.867+0000 7f08c67fc700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f08c80a5de0 legacy=0x7f08c812e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:18:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.867+0000 7f08c6ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.867+0000 7f08c77fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08c80a6260 0x7f08c812eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.867+0000 7f08c6ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:51284/0 (socket says 172.21.15.88:51284) 2020-02-11T16:18:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.867+0000 7f08c6ffd700 1 -- 172.21.15.88:0/3421797398 learned_addr learned my addr 172.21.15.88:0/3421797398 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:18:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c6ffd700 1 -- 172.21.15.88:0/3421797398 >> v2:172.21.15.52:3300/0 conn(0x7f08c80a6260 msgr2=0x7f08c812eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:18:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c6ffd700 1 --2- 172.21.15.88:0/3421797398 >> v2:172.21.15.52:3300/0 conn(0x7f08c80a6260 0x7f08c812eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c6ffd700 1 -- 172.21.15.88:0/3421797398 >> v1:172.21.15.88:6789/0 conn(0x7f08c80a5de0 legacy=0x7f08c812e3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:18:57.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c6ffd700 1 -- 172.21.15.88:0/3421797398 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c80a3d50 con 0x7f08c80a18a0 2020-02-11T16:18:57.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c6ffd700 1 --2- 172.21.15.88:0/3421797398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f08c805b910 tx=0x7f08bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c6ffd700 1 --2- 172.21.15.88:0/3421797398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f08c805b910 tx=0x7f08bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c6ffd700 1 --2- 172.21.15.88:0/3421797398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f08c805b910 tx=0x7f08bc0088e0).ready entity=mon.2 client_cookie=4dae3a261c1f9743 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c6ffd700 1 --2- 172.21.15.88:0/3421797398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f08c805b910 tx=0x7f08bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c5ffb700 1 -- 172.21.15.88:0/3421797398 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08bc011630 con 0x7f08c80a18a0 2020-02-11T16:18:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c6ffd700 1 --2- 172.21.15.88:0/3421797398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f08c805b910 tx=0x7f08bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c6ffd700 1 --2- 172.21.15.88:0/3421797398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f08c805b910 tx=0x7f08bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c5ffb700 1 -- 172.21.15.88:0/3421797398 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc011790 con 0x7f08c80a18a0 2020-02-11T16:18:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08c5ffb700 1 -- 172.21.15.88:0/3421797398 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08bc011b30 con 0x7f08c80a18a0 2020-02-11T16:18:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08cd69c700 1 -- 172.21.15.88:0/3421797398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 msgr2=0x7f08c80a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.868+0000 7f08cd69c700 1 --2- 172.21.15.88:0/3421797398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f08c805b910 tx=0x7f08bc0088e0).stop 2020-02-11T16:18:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.869+0000 7f08cd69c700 1 -- 172.21.15.88:0/3421797398 shutdown_connections 2020-02-11T16:18:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.869+0000 7f08cd69c700 1 --2- 172.21.15.88:0/3421797398 >> v2:172.21.15.52:3300/0 conn(0x7f08c80a6260 0x7f08c812eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:18:57.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.869+0000 7f08cd69c700 1 --2- 172.21.15.88:0/3421797398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a18a0 0x7f08c80a6dd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.869+0000 7f08cd69c700 1 -- 172.21.15.88:0/3421797398 >> 172.21.15.88:0/3421797398 conn(0x7f08c809d110 msgr2=0x7f08c809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:57.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.869+0000 7f08cd69c700 1 -- 172.21.15.88:0/3421797398 shutdown_connections 2020-02-11T16:18:57.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.869+0000 7f08cd69c700 1 -- 172.21.15.88:0/3421797398 wait complete. 2020-02-11T16:18:57.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.870+0000 7f08cd69c700 1 Processor -- start 2020-02-11T16:18:57.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.870+0000 7f08cd69c700 1 -- start start 2020-02-11T16:18:57.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.870+0000 7f08cd69c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08c80a18a0 0x7f08c8137e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.870+0000 7f08cd69c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.870+0000 7f08cd69c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c8134ad0 con 0x7f08c80a5de0 2020-02-11T16:18:57.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.870+0000 7f08c6ffd700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f08c80a18a0 msgr2=0x7f08c8137e40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:18:57.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.870+0000 7f08cd69c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c8136080 con 0x7f08c80a18a0 2020-02-11T16:18:57.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.870+0000 7f08c6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08c80a18a0 0x7f08c8137e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:18:57.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.870+0000 7f08cd69c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8134d00 con 0x7f08c80a6260 2020-02-11T16:18:57.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.870+0000 7f08c77fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c67fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f08c80a5de0 0x7f08c8124310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:36374/0 (socket says 172.21.15.88:36374) 2020-02-11T16:18:57.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c67fc700 1 -- 172.21.15.88:0/718660736 learned_addr learned my addr 172.21.15.88:0/718660736 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:18:57.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08b7fff700 1 -- 172.21.15.88:0/718660736 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898524323 0 0) 0x7f08c8134ad0 con 0x7f08c80a5de0 2020-02-11T16:18:57.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08b7fff700 1 -- 172.21.15.88:0/718660736 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a4002fe0 con 0x7f08c80a5de0 2020-02-11T16:18:57.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c77fe700 1 -- 172.21.15.88:0/718660736 >> v2:172.21.15.88:3300/0 conn(0x7f08c80a18a0 msgr2=0x7f08c8137e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:18:57.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> v2:172.21.15.88:3300/0 conn(0x7f08c80a18a0 0x7f08c8137e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:57.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c77fe700 1 -- 172.21.15.88:0/718660736 >> v1:172.21.15.52:6789/0 conn(0x7f08c80a5de0 legacy=0x7f08c8124310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:57.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c77fe700 1 -- 172.21.15.88:0/718660736 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c81351a0 con 0x7f08c80a6260 2020-02-11T16:18:57.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08b7fff700 1 -- 172.21.15.88:0/718660736 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08c000e350 con 0x7f08c80a6260 2020-02-11T16:18:57.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08b7fff700 1 -- 172.21.15.88:0/718660736 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0005c30 con 0x7f08c80a6260 2020-02-11T16:18:57.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08b7fff700 1 -- 172.21.15.88:0/718660736 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08c0012940 con 0x7f08c80a6260 2020-02-11T16:18:57.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08cd69c700 1 -- 172.21.15.88:0/718660736 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c8136910 con 0x7f08c80a6260 2020-02-11T16:18:57.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.871+0000 7f08cd69c700 1 -- 172.21.15.88:0/718660736 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c8066740 con 0x7f08c80a6260 2020-02-11T16:18:57.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.872+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.872+0000 7f08cd69c700 1 -- 172.21.15.88:0/718660736 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c80565b0 con 0x7f08c80a6260 2020-02-11T16:18:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.872+0000 7f08b7fff700 1 -- 172.21.15.88:0/718660736 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f08c0012b40 con 0x7f08c80a6260 2020-02-11T16:18:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.872+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.872+0000 7f08b7fff700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f08a4039f30 0x7f08a403c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:18:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.872+0000 7f08b7fff700 1 -- 172.21.15.88:0/718660736 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f08c0049940 con 0x7f08c80a6260 2020-02-11T16:18:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.873+0000 7f08c6ffd700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f08a4039f30 0x7f08a403c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:18:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.873+0000 7f08c6ffd700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f08a4039f30 0x7f08a403c3f0 crc :-1 s=READY pgs=340 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:18:57.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.877+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:57.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:57.877+0000 7f08b7fff700 1 -- 172.21.15.88:0/718660736 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f08c002ef00 con 0x7f08c80a6260 2020-02-11T16:18:58.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.057+0000 7f08cd69c700 1 -- 172.21.15.88:0/718660736 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f08c8134ea0 con 0x7f08c80a6260 2020-02-11T16:18:58.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.057+0000 7f08c77fe700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:18:58.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.057+0000 7f08b7fff700 1 -- 172.21.15.88:0/718660736 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f08c0031a10 con 0x7f08c80a6260 2020-02-11T16:18:58.060 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:18:58.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.058+0000 7f08cd69c700 1 -- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f08a4039f30 msgr2=0x7f08a403c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:58.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.058+0000 7f08cd69c700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f08a4039f30 0x7f08a403c3f0 crc :-1 s=READY pgs=340 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:58.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.058+0000 7f08cd69c700 1 -- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 msgr2=0x7f08c81382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:18:58.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.058+0000 7f08cd69c700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f08c8137d50 tx=0x7f08c0010ef0).stop 2020-02-11T16:18:58.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.058+0000 7f08cd69c700 1 -- 172.21.15.88:0/718660736 shutdown_connections 2020-02-11T16:18:58.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.058+0000 7f08cd69c700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f08a4039f30 0x7f08a403c3f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:58.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.058+0000 7f08cd69c700 1 --2- 172.21.15.88:0/718660736 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08c80a6260 0x7f08c81382a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:58.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.058+0000 7f08cd69c700 1 --2- 172.21.15.88:0/718660736 >> v2:172.21.15.88:3300/0 conn(0x7f08c80a18a0 0x7f08c8137e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:18:58.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.058+0000 7f08cd69c700 1 -- 172.21.15.88:0/718660736 >> 172.21.15.88:0/718660736 conn(0x7f08c809d110 msgr2=0x7f08c80a9200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:18:58.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.059+0000 7f08cd69c700 1 -- 172.21.15.88:0/718660736 shutdown_connections 2020-02-11T16:18:58.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:18:58.059+0000 7f08cd69c700 1 -- 172.21.15.88:0/718660736 wait complete. 2020-02-11T16:18:58.071 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":108,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:01.072 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:19:01.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.185+0000 7f8d0bfff700 1 Processor -- start 2020-02-11T16:19:01.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.185+0000 7f8d0bfff700 1 -- start start 2020-02-11T16:19:01.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d0bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a5c00 0x7f8d0c134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d0bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d0c0a2590 0x7f8d0c0a1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d0bfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c0a1b30 con 0x7f8d0c135310 2020-02-11T16:19:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d0bfff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c0a1e50 con 0x7f8d0c0a2590 2020-02-11T16:19:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d0bfff700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0a20f0 con 0x7f8d0c0a5c00 2020-02-11T16:19:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d0b7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f8d0c135310 legacy=0x7f8d0c138110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:19:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d027fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d0c0a2590 0x7f8d0c0a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:01.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d0affd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a5c00 0x7f8d0c134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:01.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d0affd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a5c00 0x7f8d0c134bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:51296/0 (socket says 172.21.15.88:51296) 2020-02-11T16:19:01.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d027fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d0c0a2590 0x7f8d0c0a1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:42960/0 (socket says 172.21.15.88:42960) 2020-02-11T16:19:01.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d0affd700 1 -- 172.21.15.88:0/3532182164 learned_addr learned my addr 172.21.15.88:0/3532182164 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:01.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d027fc700 1 -- 172.21.15.88:0/3532182164 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a5c00 msgr2=0x7f8d0c134bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:01.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d027fc700 1 --2- 172.21.15.88:0/3532182164 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a5c00 0x7f8d0c134bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:01.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d027fc700 1 -- 172.21.15.88:0/3532182164 >> v1:172.21.15.88:6789/0 conn(0x7f8d0c135310 legacy=0x7f8d0c138110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:01.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d027fc700 1 -- 172.21.15.88:0/3532182164 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0a5fe0 con 0x7f8d0c0a2590 2020-02-11T16:19:01.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d027fc700 1 --2- 172.21.15.88:0/3532182164 >> v2:172.21.15.52:3300/0 conn(0x7f8d0c0a2590 0x7f8d0c0a1300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d0c0a62e0 tx=0x7f8cf40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d027fc700 1 --2- 172.21.15.88:0/3532182164 >> v2:172.21.15.52:3300/0 conn(0x7f8d0c0a2590 0x7f8d0c0a1300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d0c0a62e0 tx=0x7f8cf40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.186+0000 7f8d027fc700 1 --2- 172.21.15.88:0/3532182164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d0c0a2590 0x7f8d0c0a1300 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f8d0c0a62e0 tx=0x7f8cf40088e0).ready entity=mon.0 client_cookie=b1b274e42f69395e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:01.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d027fc700 1 --2- 172.21.15.88:0/3532182164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d0c0a2590 0x7f8d0c0a1300 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f8d0c0a62e0 tx=0x7f8cf40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0a7fc700 1 -- 172.21.15.88:0/3532182164 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf4008e40 con 0x7f8d0c0a2590 2020-02-11T16:19:01.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d027fc700 1 --2- 172.21.15.88:0/3532182164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d0c0a2590 0x7f8d0c0a1300 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f8d0c0a62e0 tx=0x7f8cf40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d027fc700 1 --2- 172.21.15.88:0/3532182164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d0c0a2590 0x7f8d0c0a1300 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f8d0c0a62e0 tx=0x7f8cf40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0a7fc700 1 -- 172.21.15.88:0/3532182164 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf40115b0 con 0x7f8d0c0a2590 2020-02-11T16:19:01.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0a7fc700 1 -- 172.21.15.88:0/3532182164 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf4011990 con 0x7f8d0c0a2590 2020-02-11T16:19:01.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0bfff700 1 -- 172.21.15.88:0/3532182164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d0c0a2590 msgr2=0x7f8d0c0a1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:01.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0bfff700 1 --2- 172.21.15.88:0/3532182164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d0c0a2590 0x7f8d0c0a1300 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f8d0c0a62e0 tx=0x7f8cf40088e0).stop 2020-02-11T16:19:01.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0bfff700 1 -- 172.21.15.88:0/3532182164 shutdown_connections 2020-02-11T16:19:01.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0bfff700 1 --2- 172.21.15.88:0/3532182164 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a5c00 0x7f8d0c134bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:01.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0bfff700 1 --2- 172.21.15.88:0/3532182164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d0c0a2590 0x7f8d0c0a1300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:01.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0bfff700 1 -- 172.21.15.88:0/3532182164 >> 172.21.15.88:0/3532182164 conn(0x7f8d0c0a9f90 msgr2=0x7f8d0c0aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:01.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0bfff700 1 -- 172.21.15.88:0/3532182164 shutdown_connections 2020-02-11T16:19:01.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.187+0000 7f8d0bfff700 1 -- 172.21.15.88:0/3532182164 wait complete. 2020-02-11T16:19:01.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.188+0000 7f8d0bfff700 1 Processor -- start 2020-02-11T16:19:01.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.188+0000 7f8d0bfff700 1 -- start start 2020-02-11T16:19:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d0bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d0bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8d0c135310 0x7f8d0c14c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d0bfff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c130640 con 0x7f8d0c0a5c00 2020-02-11T16:19:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d0bfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c136690 con 0x7f8d0c135310 2020-02-11T16:19:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d0bfff700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c138870 con 0x7f8d0c0a2590 2020-02-11T16:19:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d0b7fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f8d0c135310 msgr2=0x7f8d0c14c850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:19:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d0b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8d0c135310 0x7f8d0c14c850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d0affd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d027fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8d0c0a5c00 0x7f8d0c12cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:36388/0 (socket says 172.21.15.88:36388) 2020-02-11T16:19:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d027fc700 1 -- 172.21.15.88:0/77152905 learned_addr learned my addr 172.21.15.88:0/77152905 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d08ff9700 1 -- 172.21.15.88:0/77152905 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715220258 0 0) 0x7f8d0c130640 con 0x7f8d0c0a5c00 2020-02-11T16:19:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.189+0000 7f8d08ff9700 1 -- 172.21.15.88:0/77152905 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cf0002fe0 con 0x7f8d0c0a5c00 2020-02-11T16:19:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0affd700 1 -- 172.21.15.88:0/77152905 >> v2:172.21.15.88:3300/0 conn(0x7f8d0c135310 msgr2=0x7f8d0c14c850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:19:01.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> v2:172.21.15.88:3300/0 conn(0x7f8d0c135310 0x7f8d0c14c850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:01.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0affd700 1 -- 172.21.15.88:0/77152905 >> v1:172.21.15.52:6789/0 conn(0x7f8d0c0a5c00 legacy=0x7f8d0c12cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:01.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0affd700 1 -- 172.21.15.88:0/77152905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0a8950 con 0x7f8d0c0a2590 2020-02-11T16:19:01.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:01.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d08ff9700 1 -- 172.21.15.88:0/77152905 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cfc007530 con 0x7f8d0c0a2590 2020-02-11T16:19:01.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d08ff9700 1 -- 172.21.15.88:0/77152905 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc0056c0 con 0x7f8d0c0a2590 2020-02-11T16:19:01.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d08ff9700 1 -- 172.21.15.88:0/77152905 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cfc005a60 con 0x7f8d0c0a2590 2020-02-11T16:19:01.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0bfff700 1 -- 172.21.15.88:0/77152905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0c12fbf0 con 0x7f8d0c0a2590 2020-02-11T16:19:01.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.190+0000 7f8d0bfff700 1 -- 172.21.15.88:0/77152905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0c136270 con 0x7f8d0c0a2590 2020-02-11T16:19:01.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.191+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.191+0000 7f8d08ff9700 1 -- 172.21.15.88:0/77152905 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8cfc005c60 con 0x7f8d0c0a2590 2020-02-11T16:19:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.191+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.191+0000 7f8d0bfff700 1 -- 172.21.15.88:0/77152905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c0a0100 con 0x7f8d0c0a2590 2020-02-11T16:19:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.191+0000 7f8d08ff9700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cf0039ef0 0x7f8cf003c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.191+0000 7f8d08ff9700 1 -- 172.21.15.88:0/77152905 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8cfc049b90 con 0x7f8d0c0a2590 2020-02-11T16:19:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.191+0000 7f8d027fc700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cf0039ef0 0x7f8cf003c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.192+0000 7f8d027fc700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cf0039ef0 0x7f8cf003c3b0 crc :-1 s=READY pgs=341 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:01.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.195+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.195+0000 7f8d08ff9700 1 -- 172.21.15.88:0/77152905 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f8cfc02f1d0 con 0x7f8d0c0a2590 2020-02-11T16:19:01.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.376+0000 7f8d0bfff700 1 -- 172.21.15.88:0/77152905 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8d0c130050 con 0x7f8d0c0a2590 2020-02-11T16:19:01.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0affd700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:01.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d08ff9700 1 -- 172.21.15.88:0/77152905 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f8cfc031c80 con 0x7f8d0c0a2590 2020-02-11T16:19:01.380 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:01.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 -- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cf0039ef0 msgr2=0x7f8cf003c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:01.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cf0039ef0 0x7f8cf003c3b0 crc :-1 s=READY pgs=341 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:01.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 -- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 msgr2=0x7f8d0c09fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:01.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f8cfc002f30 tx=0x7f8d0c0684d0).stop 2020-02-11T16:19:01.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 -- 172.21.15.88:0/77152905 shutdown_connections 2020-02-11T16:19:01.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cf0039ef0 0x7f8cf003c3b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:01.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 --2- 172.21.15.88:0/77152905 >> v2:172.21.15.88:3300/0 conn(0x7f8d0c135310 0x7f8d0c14c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:01.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 --2- 172.21.15.88:0/77152905 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d0c0a2590 0x7f8d0c09fae0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:01.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 -- 172.21.15.88:0/77152905 >> 172.21.15.88:0/77152905 conn(0x7f8d0c0a9f90 msgr2=0x7f8d0c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:01.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 -- 172.21.15.88:0/77152905 shutdown_connections 2020-02-11T16:19:01.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:01.378+0000 7f8d0bfff700 1 -- 172.21.15.88:0/77152905 wait complete. 2020-02-11T16:19:01.391 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":108,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:04.395 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:19:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.510+0000 7f9fcb710700 1 Processor -- start 2020-02-11T16:19:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.510+0000 7f9fcb710700 1 -- start start 2020-02-11T16:19:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.510+0000 7f9fcb710700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 0x7f9fc40a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.510+0000 7f9fcb710700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9fc4131280 0x7f9fc41316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.510+0000 7f9fcb710700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc40a4350 con 0x7f9fc40a2fa0 2020-02-11T16:19:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.510+0000 7f9fcb710700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc40a1e60 con 0x7f9fc4131280 2020-02-11T16:19:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.510+0000 7f9fcb710700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc40a3450 con 0x7f9fc40a5b20 2020-02-11T16:19:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.510+0000 7f9fc94ac700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f9fc40a2fa0 legacy=0x7f9fc40a5410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:19:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.510+0000 7f9fc8cab700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 msgr2=0x7f9fc40a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:19:04.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc8cab700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 0x7f9fc40a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:04.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9fc4131280 0x7f9fc41316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:04.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9fc4131280 0x7f9fc41316f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:42976/0 (socket says 172.21.15.88:42976) 2020-02-11T16:19:04.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 -- 172.21.15.88:0/2567664892 learned_addr learned my addr 172.21.15.88:0/2567664892 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:04.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 -- 172.21.15.88:0/2567664892 >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 msgr2=0x7f9fc40a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:04.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/2567664892 >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 0x7f9fc40a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:04.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 -- 172.21.15.88:0/2567664892 >> v1:172.21.15.88:6789/0 conn(0x7f9fc40a2fa0 legacy=0x7f9fc40a5410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:04.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 -- 172.21.15.88:0/2567664892 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc40a3a40 con 0x7f9fc4131280 2020-02-11T16:19:04.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/2567664892 >> v2:172.21.15.52:3300/0 conn(0x7f9fc4131280 0x7f9fc41316f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9fc405ef00 tx=0x7f9fbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/2567664892 >> v2:172.21.15.52:3300/0 conn(0x7f9fc4131280 0x7f9fc41316f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9fc405ef00 tx=0x7f9fbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/2567664892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41316f0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f9fc405ef00 tx=0x7f9fbc0088e0).ready entity=mon.0 client_cookie=de7efc9ccbfcd119 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:04.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/2567664892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41316f0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f9fc405ef00 tx=0x7f9fbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fbbfff700 1 -- 172.21.15.88:0/2567664892 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fbc0129e0 con 0x7f9fc4131280 2020-02-11T16:19:04.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/2567664892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41316f0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f9fc405ef00 tx=0x7f9fbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/2567664892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41316f0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f9fc405ef00 tx=0x7f9fbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.511+0000 7f9fbbfff700 1 -- 172.21.15.88:0/2567664892 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc012b40 con 0x7f9fc4131280 2020-02-11T16:19:04.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.512+0000 7f9fbbfff700 1 -- 172.21.15.88:0/2567664892 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fbc00b160 con 0x7f9fc4131280 2020-02-11T16:19:04.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.512+0000 7f9fcb710700 1 -- 172.21.15.88:0/2567664892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 msgr2=0x7f9fc41316f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:04.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.512+0000 7f9fcb710700 1 --2- 172.21.15.88:0/2567664892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41316f0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f9fc405ef00 tx=0x7f9fbc0088e0).stop 2020-02-11T16:19:04.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.512+0000 7f9fcb710700 1 -- 172.21.15.88:0/2567664892 shutdown_connections 2020-02-11T16:19:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.512+0000 7f9fcb710700 1 --2- 172.21.15.88:0/2567664892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41316f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.512+0000 7f9fcb710700 1 --2- 172.21.15.88:0/2567664892 >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 0x7f9fc40a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.512+0000 7f9fcb710700 1 -- 172.21.15.88:0/2567664892 >> 172.21.15.88:0/2567664892 conn(0x7f9fc409d110 msgr2=0x7f9fc409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.512+0000 7f9fcb710700 1 -- 172.21.15.88:0/2567664892 shutdown_connections 2020-02-11T16:19:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.512+0000 7f9fcb710700 1 -- 172.21.15.88:0/2567664892 wait complete. 2020-02-11T16:19:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.513+0000 7f9fcb710700 1 Processor -- start 2020-02-11T16:19:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.513+0000 7f9fcb710700 1 -- start start 2020-02-11T16:19:04.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fcb710700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 0x7f9fc4137000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:04.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fcb710700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9fc4131280 0x7f9fc41369b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:04.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fcb710700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc41374c0 con 0x7f9fc40a2fa0 2020-02-11T16:19:04.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fcb710700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc4137710 con 0x7f9fc4131280 2020-02-11T16:19:04.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fcb710700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc41379b0 con 0x7f9fc40a5b20 2020-02-11T16:19:04.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc94ac700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f9fc40a2fa0 legacy=0x7f9fc4148820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:19:04.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc8cab700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 msgr2=0x7f9fc4137000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:19:04.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc8cab700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 0x7f9fc4137000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:04.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9fc4131280 0x7f9fc41369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:04.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9fc4131280 0x7f9fc41369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:42982/0 (socket says 172.21.15.88:42982) 2020-02-11T16:19:04.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 -- 172.21.15.88:0/4216997798 learned_addr learned my addr 172.21.15.88:0/4216997798 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:04.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 -- 172.21.15.88:0/4216997798 >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 msgr2=0x7f9fc4137000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:19:04.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 0x7f9fc4137000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:04.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 -- 172.21.15.88:0/4216997798 >> v1:172.21.15.88:6789/0 conn(0x7f9fc40a2fa0 legacy=0x7f9fc4148820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:19:04.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 -- 172.21.15.88:0/4216997798 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc4137c50 con 0x7f9fc4131280 2020-02-11T16:19:04.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> v2:172.21.15.52:3300/0 conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> v2:172.21.15.52:3300/0 conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:04.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fba7fc700 1 -- 172.21.15.88:0/4216997798 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fbc0108b0 con 0x7f9fc4131280 2020-02-11T16:19:04.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fba7fc700 1 -- 172.21.15.88:0/4216997798 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc010a10 con 0x7f9fc4131280 2020-02-11T16:19:04.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fcb710700 1 -- 172.21.15.88:0/4216997798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc4133f30 con 0x7f9fc4131280 2020-02-11T16:19:04.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fba7fc700 1 -- 172.21.15.88:0/4216997798 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fbc007340 con 0x7f9fc4131280 2020-02-11T16:19:04.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fcb710700 1 -- 172.21.15.88:0/4216997798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc4149170 con 0x7f9fc4131280 2020-02-11T16:19:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fba7fc700 1 -- 172.21.15.88:0/4216997798 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f9fbc00f0c0 con 0x7f9fc4131280 2020-02-11T16:19:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.515+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.516+0000 7f9fcb710700 1 -- 172.21.15.88:0/4216997798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc40565b0 con 0x7f9fc4131280 2020-02-11T16:19:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.516+0000 7f9fba7fc700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9fa4039bc0 0x7f9fa403c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.516+0000 7f9fba7fc700 1 -- 172.21.15.88:0/4216997798 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f9fbc04a210 con 0x7f9fc4131280 2020-02-11T16:19:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.516+0000 7f9fc94ac700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9fa4039bc0 0x7f9fa403c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.516+0000 7f9fc94ac700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9fa4039bc0 0x7f9fa403c080 crc :-1 s=READY pgs=342 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.521+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.521+0000 7f9fba7fc700 1 -- 172.21.15.88:0/4216997798 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f9fbc032800 con 0x7f9fc4131280 2020-02-11T16:19:04.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.707+0000 7f9fcb710700 1 -- 172.21.15.88:0/4216997798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9fc40565b0 con 0x7f9fc4131280 2020-02-11T16:19:04.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.707+0000 7f9fc9cad700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:04.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.707+0000 7f9fba7fc700 1 -- 172.21.15.88:0/4216997798 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f9fbc0323c0 con 0x7f9fc4131280 2020-02-11T16:19:04.710 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.708+0000 7f9fcb710700 1 -- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9fa4039bc0 msgr2=0x7f9fa403c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:04.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.708+0000 7f9fcb710700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9fa4039bc0 0x7f9fa403c080 crc :-1 s=READY pgs=342 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:04.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.709+0000 7f9fcb710700 1 -- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 msgr2=0x7f9fc41369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:04.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.709+0000 7f9fcb710700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41369b0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f9fc41451c0 tx=0x7f9fc4067410).stop 2020-02-11T16:19:04.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.709+0000 7f9fcb710700 1 -- 172.21.15.88:0/4216997798 shutdown_connections 2020-02-11T16:19:04.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.709+0000 7f9fcb710700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9fa4039bc0 0x7f9fa403c080 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:04.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.709+0000 7f9fcb710700 1 --2- 172.21.15.88:0/4216997798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4131280 0x7f9fc41369b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:04.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.709+0000 7f9fcb710700 1 --2- 172.21.15.88:0/4216997798 >> v2:172.21.15.88:3300/0 conn(0x7f9fc40a5b20 0x7f9fc4137000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:04.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.709+0000 7f9fcb710700 1 -- 172.21.15.88:0/4216997798 >> 172.21.15.88:0/4216997798 conn(0x7f9fc409d110 msgr2=0x7f9fc4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:04.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.709+0000 7f9fcb710700 1 -- 172.21.15.88:0/4216997798 shutdown_connections 2020-02-11T16:19:04.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:04.709+0000 7f9fcb710700 1 -- 172.21.15.88:0/4216997798 wait complete. 2020-02-11T16:19:04.721 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":108,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:07.722 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:19:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.837+0000 7f6f1929f700 1 Processor -- start 2020-02-11T16:19:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.837+0000 7f6f1929f700 1 -- start start 2020-02-11T16:19:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f1929f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f1929f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f1929f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f140a5320 con 0x7f6f1412f890 2020-02-11T16:19:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f1929f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1409e7a0 con 0x7f6f140a7120 2020-02-11T16:19:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f1929f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f141303c0 con 0x7f6f140a39e0 2020-02-11T16:19:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f12ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f127fc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f137fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6f1412f890 0x7f6f1412fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:36408/0 (socket says 172.21.15.88:36408) 2020-02-11T16:19:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f137fe700 1 -- 172.21.15.88:0/684965077 learned_addr learned my addr 172.21.15.88:0/684965077 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f12ffd700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:19:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f12ffd700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:19:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:07.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:07.838+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:08.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.039+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:08.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.039+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:08.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.039+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:19:08.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.039+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:08.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.039+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:08.043 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.039+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:19:08.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.039+0000 7f6f12ffd700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:19:08.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.039+0000 7f6f12ffd700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:08.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.039+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:08.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.039+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:19:08.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.440+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:08.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.440+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:08.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.440+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:19:08.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.440+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:08.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.440+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:08.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.440+0000 7f6f12ffd700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:19:08.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.440+0000 7f6f12ffd700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:08.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.440+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:19:08.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.440+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:08.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:08.440+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:19:09.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:09.241+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:09.241+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:09.242+0000 7f6f12ffd700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:19:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:09.242+0000 7f6f12ffd700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:09.242+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:09.242+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:19:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:09.242+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:09.242+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:19:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:09.242+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:09.242+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:19:10.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:10.843+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:10.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:10.843+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:10.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:10.843+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:19:10.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:10.843+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:10.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:10.843+0000 7f6f12ffd700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:19:10.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:10.843+0000 7f6f12ffd700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:10.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:10.843+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:10.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:10.843+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:10.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:10.843+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:19:10.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:10.843+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:19:12.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.602+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435455390 0 0) 0x7f6f0c001450 con 0x7f6f1412f890 2020-02-11T16:19:12.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.602+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef8003230 con 0x7f6f1412f890 2020-02-11T16:19:12.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1412708219 0 0) 0x7f6ef8003230 con 0x7f6f1412f890 2020-02-11T16:19:12.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6f140a3e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:12.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6f140a3e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:12.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 msgr2=0x7f6f140a4ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:12.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 --2- 172.21.15.88:0/684965077 >> v2:172.21.15.52:3300/0 conn(0x7f6f140a7120 0x7f6f140a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:12.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f140a5560 con 0x7f6f1412f890 2020-02-11T16:19:12.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f6f0c001be0 con 0x7f6f1412f890 2020-02-11T16:19:12.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 >> v1:172.21.15.52:6789/0 conn(0x7f6f1412f890 legacy=0x7f6f1412fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef80037a0 0x7f6ef8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:12.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef80044d0 0x7f6ef8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:12.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6ef8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:12.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1409e7a0 con 0x7f6ef80037a0 2020-02-11T16:19:12.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f141303c0 con 0x7f6ef80044d0 2020-02-11T16:19:12.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8005210 con 0x7f6f140a39e0 2020-02-11T16:19:12.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f127fc700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef80044d0 msgr2=0x7f6ef8004950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:19:12.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f127fc700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef80044d0 0x7f6ef8004950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:12.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef80037a0 0x7f6ef8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f137fe700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6ef8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f137fe700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef80044d0 msgr2=0x7f6ef8004950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:12.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f137fe700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ef80044d0 0x7f6ef8004950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:12.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f137fe700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef80037a0 msgr2=0x7f6ef8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:12.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f137fe700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef80037a0 0x7f6ef8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:12.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f137fe700 1 -- 172.21.15.88:0/684965077 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8003230 con 0x7f6f140a39e0 2020-02-11T16:19:12.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef80037a0 0x7f6ef8003bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:12.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.603+0000 7f6f137fe700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6ef8004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f0c0018f0 tx=0x7f6f14130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.604+0000 7f6f137fe700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6ef8004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f0c0018f0 tx=0x7f6f14130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.604+0000 7f6f137fe700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6ef8004db0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f6f0c0018f0 tx=0x7f6f14130500).ready entity=mon.2 client_cookie=b5ada1205da6fc71 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:12.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.605+0000 7f6f137fe700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6ef8004db0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6f0c0018f0 tx=0x7f6f14130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.605+0000 7f6f137fe700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6ef8004db0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6f0c0018f0 tx=0x7f6f14130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.605+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f0c005d40 con 0x7f6f140a39e0 2020-02-11T16:19:12.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.605+0000 7f6f137fe700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6ef8004db0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6f0c0018f0 tx=0x7f6f14130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.605+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c013060 con 0x7f6f140a39e0 2020-02-11T16:19:12.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.605+0000 7f6f11ffb700 1 -- 172.21.15.88:0/684965077 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f0c005ea0 con 0x7f6f140a39e0 2020-02-11T16:19:12.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.605+0000 7f6f1929f700 1 -- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 msgr2=0x7f6ef8004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.605+0000 7f6f1929f700 1 --2- 172.21.15.88:0/684965077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f140a39e0 0x7f6ef8004db0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f6f0c0018f0 tx=0x7f6f14130500).stop 2020-02-11T16:19:12.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.605+0000 7f6f137fe700 1 -- 172.21.15.88:0/684965077 reap_dead start 2020-02-11T16:19:12.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.606+0000 7f6f1929f700 1 -- 172.21.15.88:0/684965077 shutdown_connections 2020-02-11T16:19:12.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.606+0000 7f6f1929f700 1 -- 172.21.15.88:0/684965077 >> 172.21.15.88:0/684965077 conn(0x7f6f1409d110 msgr2=0x7f6f1409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:12.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.606+0000 7f6f1929f700 1 -- 172.21.15.88:0/684965077 shutdown_connections 2020-02-11T16:19:12.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.606+0000 7f6f1929f700 1 -- 172.21.15.88:0/684965077 wait complete. 2020-02-11T16:19:12.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.607+0000 7f6f1929f700 1 Processor -- start 2020-02-11T16:19:12.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.607+0000 7f6f1929f700 1 -- start start 2020-02-11T16:19:12.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f1929f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:12.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f1929f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f141333f0 0x7f6f1414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:12.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f1929f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f14143e50 con 0x7f6f14142eb0 2020-02-11T16:19:12.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f1929f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f140a9af0 con 0x7f6f141333f0 2020-02-11T16:19:12.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f1929f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140a9d90 con 0x7f6f14128680 2020-02-11T16:19:12.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f127fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6f14142eb0 0x7f6f14132ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:36436/0 (socket says 172.21.15.88:36436) 2020-02-11T16:19:12.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f12ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f137fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f141333f0 0x7f6f1414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f127fc700 1 -- 172.21.15.88:0/2406161448 learned_addr learned my addr 172.21.15.88:0/2406161448 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:12.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f12ffd700 1 -- 172.21.15.88:0/2406161448 >> v2:172.21.15.52:3300/0 conn(0x7f6f141333f0 msgr2=0x7f6f1414d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> v2:172.21.15.52:3300/0 conn(0x7f6f141333f0 0x7f6f1414d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f12ffd700 1 -- 172.21.15.88:0/2406161448 >> v1:172.21.15.52:6789/0 conn(0x7f6f14142eb0 legacy=0x7f6f14132ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f12ffd700 1 -- 172.21.15.88:0/2406161448 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f140aa030 con 0x7f6f14128680 2020-02-11T16:19:12.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:12.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.608+0000 7f6f03fff700 1 -- 172.21.15.88:0/2406161448 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f04007540 con 0x7f6f14128680 2020-02-11T16:19:12.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.609+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.609+0000 7f6f03fff700 1 -- 172.21.15.88:0/2406161448 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f04005920 con 0x7f6f14128680 2020-02-11T16:19:12.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.609+0000 7f6f1929f700 1 -- 172.21.15.88:0/2406161448 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1413d520 con 0x7f6f14128680 2020-02-11T16:19:12.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.609+0000 7f6f03fff700 1 -- 172.21.15.88:0/2406161448 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f04005d40 con 0x7f6f14128680 2020-02-11T16:19:12.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.609+0000 7f6f1929f700 1 -- 172.21.15.88:0/2406161448 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f14143330 con 0x7f6f14128680 2020-02-11T16:19:12.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.609+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.610+0000 7f6f03fff700 1 -- 172.21.15.88:0/2406161448 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6f04012330 con 0x7f6f14128680 2020-02-11T16:19:12.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.610+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.610+0000 7f6f03fff700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ef0039cd0 0x7f6ef003c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:12.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.610+0000 7f6f03fff700 1 -- 172.21.15.88:0/2406161448 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6f04049fe0 con 0x7f6f14128680 2020-02-11T16:19:12.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.610+0000 7f6f1929f700 1 -- 172.21.15.88:0/2406161448 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f140565b0 con 0x7f6f14128680 2020-02-11T16:19:12.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.610+0000 7f6f127fc700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ef0039cd0 0x7f6ef003c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.610+0000 7f6f127fc700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ef0039cd0 0x7f6ef003c190 crc :-1 s=READY pgs=343 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:12.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.614+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.614+0000 7f6f03fff700 1 -- 172.21.15.88:0/2406161448 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f6f0402f640 con 0x7f6f14128680 2020-02-11T16:19:12.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.800+0000 7f6f1929f700 1 -- 172.21.15.88:0/2406161448 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6f1405ccb0 con 0x7f6f14128680 2020-02-11T16:19:12.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.801+0000 7f6f12ffd700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.801+0000 7f6f03fff700 1 -- 172.21.15.88:0/2406161448 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f6f0400a510 con 0x7f6f14128680 2020-02-11T16:19:12.803 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":112,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:12.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 -- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ef0039cd0 msgr2=0x7f6ef003c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ef0039cd0 0x7f6ef003c190 crc :-1 s=READY pgs=343 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 -- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 msgr2=0x7f6f140aaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f6f04002f30 tx=0x7f6f04010c90).stop 2020-02-11T16:19:12.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 -- 172.21.15.88:0/2406161448 shutdown_connections 2020-02-11T16:19:12.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6ef0039cd0 0x7f6ef003c190 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 --2- 172.21.15.88:0/2406161448 >> v2:172.21.15.52:3300/0 conn(0x7f6f141333f0 0x7f6f1414d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 --2- 172.21.15.88:0/2406161448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f14128680 0x7f6f140aaa90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 -- 172.21.15.88:0/2406161448 >> 172.21.15.88:0/2406161448 conn(0x7f6f1409d110 msgr2=0x7f6f14069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:12.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 -- 172.21.15.88:0/2406161448 shutdown_connections 2020-02-11T16:19:12.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.802+0000 7f6f1929f700 1 -- 172.21.15.88:0/2406161448 wait complete. 2020-02-11T16:19:12.814 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":112,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:12.814 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:19:12.814 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:19:12.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.918+0000 7f4a521a9700 1 Processor -- start 2020-02-11T16:19:12.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.918+0000 7f4a521a9700 1 -- start start 2020-02-11T16:19:12.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a521a9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:12.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a521a9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4a4c0a5de0 0x7f4a4c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:12.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a521a9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 0x7f4a4c12e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:12.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a521a9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c0a3570 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a521a9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c0a3810 con 0x7f4a4c0a5de0 2020-02-11T16:19:12.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a521a9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0a3ab0 con 0x7f4a4c12e3a0 2020-02-11T16:19:12.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a4affd700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f4a4c0a5de0 msgr2=0x7f4a4c0a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:19:12.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a4affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4a4c0a5de0 0x7f4a4c0a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:12.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a4bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 0x7f4a4c12e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a4b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a4b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43022/0 (socket says 172.21.15.88:43022) 2020-02-11T16:19:12.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a4bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 0x7f4a4c12e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:51364/0 (socket says 172.21.15.88:51364) 2020-02-11T16:19:12.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.919+0000 7f4a4b7fe700 1 -- 172.21.15.88:0/3315282723 learned_addr learned my addr 172.21.15.88:0/3315282723 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:12.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 -- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 msgr2=0x7f4a4c12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:12.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 0x7f4a4c12e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:12.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 -- 172.21.15.88:0/3315282723 >> v2:172.21.15.88:3300/0 conn(0x7f4a4c0a5de0 msgr2=0x7f4a4c0a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:12.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/3315282723 >> v2:172.21.15.88:3300/0 conn(0x7f4a4c0a5de0 0x7f4a4c0a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:12.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 -- 172.21.15.88:0/3315282723 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0a3d50 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4bfff700 1 --2- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 0x7f4a4c12e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:12.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/3315282723 >> v2:172.21.15.52:3300/0 conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a3c0032b0 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/3315282723 >> v2:172.21.15.52:3300/0 conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a3c0032b0 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f4a3c0032b0 tx=0x7f4a3c007dc0).ready entity=mon.0 client_cookie=6c6c15492624398f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:12.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f4a3c0032b0 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f4a3c0032b0 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4a7fc700 1 -- 172.21.15.88:0/3315282723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3c00a160 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f4a3c0032b0 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4a7fc700 1 -- 172.21.15.88:0/3315282723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c00a2c0 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a4a7fc700 1 -- 172.21.15.88:0/3315282723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3c00a6a0 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a521a9700 1 -- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 msgr2=0x7f4a4c0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a521a9700 1 --2- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f4a3c0032b0 tx=0x7f4a3c007dc0).stop 2020-02-11T16:19:12.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a521a9700 1 -- 172.21.15.88:0/3315282723 shutdown_connections 2020-02-11T16:19:12.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a521a9700 1 --2- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 0x7f4a4c12e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:12.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a521a9700 1 --2- 172.21.15.88:0/3315282723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c0a6dd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a521a9700 1 --2- 172.21.15.88:0/3315282723 >> v2:172.21.15.88:3300/0 conn(0x7f4a4c0a5de0 0x7f4a4c0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:12.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a521a9700 1 -- 172.21.15.88:0/3315282723 >> 172.21.15.88:0/3315282723 conn(0x7f4a4c09d110 msgr2=0x7f4a4c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:12.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.920+0000 7f4a521a9700 1 -- 172.21.15.88:0/3315282723 shutdown_connections 2020-02-11T16:19:12.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.921+0000 7f4a521a9700 1 -- 172.21.15.88:0/3315282723 wait complete. 2020-02-11T16:19:12.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.921+0000 7f4a521a9700 1 Processor -- start 2020-02-11T16:19:12.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a521a9700 1 -- start start 2020-02-11T16:19:12.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a521a9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:12.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a521a9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 0x7f4a4c135450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:12.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a521a9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c132a00 con 0x7f4a4c0a5de0 2020-02-11T16:19:12.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a521a9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c132ca0 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a521a9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c12d3d0 con 0x7f4a4c12e3a0 2020-02-11T16:19:12.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a4affd700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f4a4c0a5de0 legacy=0x7f4a4c121210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:19:12.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a4b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a4bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 0x7f4a4c135450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a4b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43028/0 (socket says 172.21.15.88:43028) 2020-02-11T16:19:12.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.922+0000 7f4a4b7fe700 1 -- 172.21.15.88:0/1173406887 learned_addr learned my addr 172.21.15.88:0/1173406887 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:12.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4b7fe700 1 -- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 msgr2=0x7f4a4c135450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 0x7f4a4c135450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4b7fe700 1 -- 172.21.15.88:0/1173406887 >> v1:172.21.15.88:6789/0 conn(0x7f4a4c0a5de0 legacy=0x7f4a4c121210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:19:12.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4b7fe700 1 -- 172.21.15.88:0/1173406887 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c134ac0 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4bfff700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a4c12e3a0 0x7f4a4c135450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:12.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/1173406887 >> v2:172.21.15.52:3300/0 conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a4c128290 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/1173406887 >> v2:172.21.15.52:3300/0 conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a4c128290 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f4a4c128290 tx=0x7f4a3c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:12.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f4a4c128290 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3c005c30 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f4a4c128290 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f4a4c128290 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c005d90 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a521a9700 1 -- 172.21.15.88:0/1173406887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c133140 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3c007340 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.923+0000 7f4a521a9700 1 -- 172.21.15.88:0/1173406887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c12df80 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f4a4c128290 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a521a9700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 0x7f4a4c0a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:12.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a521a9700 1 -- 172.21.15.88:0/1173406887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c05e2f0 con 0x7f4a4c121920 2020-02-11T16:19:12.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4a3c007540 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a4b7fe700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f4a4c128290 tx=0x7f4a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 0x7f4a4c0a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a48ff9700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4a2c039ce0 0x7f4a2c03c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:12.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4a3c04a310 con 0x7f4a4c0a18a0 2020-02-11T16:19:12.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a4bfff700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4a2c039ce0 0x7f4a2c03c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a4affd700 1 -- 172.21.15.88:0/1173406887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a4c0565b0 con 0x7f4a4c121920 2020-02-11T16:19:12.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 0x7f4a4c0a9500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 0x7f4a4c0a9500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.924+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 0x7f4a4c0a9500 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:12.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.925+0000 7f4a4bfff700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4a2c039ce0 0x7f4a2c03c1a0 crc :-1 s=READY pgs=344 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:12.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.925+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 0x7f4a4c0a9500 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.925+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a40004c90 con 0x7f4a4c121920 2020-02-11T16:19:12.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.925+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 0x7f4a4c0a9500 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.925+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f4a40004df0 con 0x7f4a4c121920 2020-02-11T16:19:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.925+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 msgr2=0x7f4a4c0a9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.925+0000 7f4a48ff9700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 0x7f4a4c0a9500 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).stop 2020-02-11T16:19:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.925+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 msgr2=0x7f4a4c0a9500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.925+0000 7f4a48ff9700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c121920 0x7f4a4c0a9500 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.933+0000 7f4a521a9700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 0x7f4a4c122450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:12.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.933+0000 7f4a521a9700 1 -- 172.21.15.88:0/1173406887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c124ee0 con 0x7f4a4c122040 2020-02-11T16:19:12.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.933+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 0x7f4a4c122450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:12.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.933+0000 7f4a4affd700 1 -- 172.21.15.88:0/1173406887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4a4c05ccb0 con 0x7f4a4c122040 2020-02-11T16:19:12.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 0x7f4a4c122450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 0x7f4a4c122450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 0x7f4a4c122450 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:12.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 0x7f4a4c122450 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000f5b0 con 0x7f4a4c122040 2020-02-11T16:19:12.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a4affd700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 0x7f4a4c122450 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:12.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4181 (secure 0 0 0) 0x7f4a4000f710 con 0x7f4a4c122040 2020-02-11T16:19:12.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 msgr2=0x7f4a4c122450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a48ff9700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 0x7f4a4c122450 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f4a40003480 tx=0x7f4a40010950).stop 2020-02-11T16:19:12.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a48ff9700 1 -- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 msgr2=0x7f4a4c122450 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:12.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.934+0000 7f4a48ff9700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c122040 0x7f4a4c122450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a521a9700 1 -- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4a2c039ce0 msgr2=0x7f4a2c03c1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a521a9700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4a2c039ce0 0x7f4a2c03c1a0 crc :-1 s=READY pgs=344 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a521a9700 1 -- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 msgr2=0x7f4a4c134ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a521a9700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f4a4c128290 tx=0x7f4a3c007dc0).stop 2020-02-11T16:19:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a4bfff700 1 -- 172.21.15.88:0/1173406887 reap_dead start 2020-02-11T16:19:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a4bfff700 1 -- 172.21.15.88:0/1173406887 reap_dead start 2020-02-11T16:19:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a521a9700 1 -- 172.21.15.88:0/1173406887 shutdown_connections 2020-02-11T16:19:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a521a9700 1 --2- 172.21.15.88:0/1173406887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a4c0a18a0 0x7f4a4c134ff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a521a9700 1 -- 172.21.15.88:0/1173406887 >> 172.21.15.88:0/1173406887 conn(0x7f4a4c09d110 msgr2=0x7f4a4c0a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a521a9700 1 -- 172.21.15.88:0/1173406887 shutdown_connections 2020-02-11T16:19:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:12.935+0000 7f4a521a9700 1 -- 172.21.15.88:0/1173406887 wait complete. 2020-02-11T16:19:12.954 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:19:12.954 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:12.954 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:12.955 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:19:12.955 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 112, 2020-02-11T16:19:12.955 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:19:12.955 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:19:12.955 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:19:12.955 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:12.956 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:19:12.956 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:12.956 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:19:12.956 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:19:12.956 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:12.956 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:12.956 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:12.956 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:12.957 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:12.957 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:12.957 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:12.957 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:19:12.957 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:19:12.957 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:12.957 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:12.958 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:12.958 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:12.958 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:12.958 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:12.958 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:12.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.958 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:19:12.959 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:19:12.959 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:19:12.959 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:19:12.959 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:19:12.959 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:19:12.959 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:12.959 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:12.960 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:19:12.960 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:19:12.960 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:12.960 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:19:12.960 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:12.960 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:12.960 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:12.961 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:12.961 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:12.961 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:12.961 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:12.961 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:19:12.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.961 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:19:12.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.962 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:12.962 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:12.962 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:12.962 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:12.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.962 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:12.963 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:19:12.963 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:12.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.963 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:12.964 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:19:12.964 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:12.964 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:12.964 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:12.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.964 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:19:12.964 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:19:12.965 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:12.965 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:12.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.965 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:19:12.965 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:19:12.966 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:12.966 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:12.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.966 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:12.966 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:19:12.967 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:12.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.967 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:12.967 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:19:12.967 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:12.967 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:12.968 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:12.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.968 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:19:12.968 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:19:12.968 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:12.968 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:12.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.969 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:12.969 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:12.969 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:12.969 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:12.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.969 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:12.969 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:19:12.970 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:12.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.970 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:12.970 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:19:12.970 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:12.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:12.971 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:12.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.971 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:19:12.971 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:19:12.971 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:12.971 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:12.972 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:12.972 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:12.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:12.972 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:19:12.972 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:19:12.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.972 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:12.972 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:12.973 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:12.973 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:12.973 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:12.973 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:19:12.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.973 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:12.973 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:12.974 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:12.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:12.974 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:12.974 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:19:12.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.974 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:12.974 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:12.975 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:19:12.975 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:12.975 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:12.975 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:19:12.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:12.975 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:12.975 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:12.976 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:12.976 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:12.976 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:12.976 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:12.976 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:19:12.977 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:19:13.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.081+0000 7f6136df1700 1 Processor -- start 2020-02-11T16:19:13.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.081+0000 7f6136df1700 1 -- start start 2020-02-11T16:19:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.082+0000 7f6136df1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61300a1520 0x7f6130131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.082+0000 7f6136df1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61300a4350 con 0x7f61300a2fa0 2020-02-11T16:19:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.082+0000 7f6136df1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61300a3a40 con 0x7f61300a5b20 2020-02-11T16:19:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.082+0000 7f6136df1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61300a1e60 con 0x7f61300a1520 2020-02-11T16:19:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.082+0000 7f613538e700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f61300a1520 msgr2=0x7f6130131990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:19:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.082+0000 7f612ffff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f61300a5b20 legacy=0x7f6130131280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:19:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.082+0000 7f613538e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61300a1520 0x7f6130131990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.082+0000 7f6134b8d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f61300a2fa0 0x7f61300a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:36462/0 (socket says 172.21.15.88:36462) 2020-02-11T16:19:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.082+0000 7f6134b8d700 1 -- 172.21.15.88:0/891431021 learned_addr learned my addr 172.21.15.88:0/891431021 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755580848 0 0) 0x7f61300a4350 con 0x7f61300a2fa0 2020-02-11T16:19:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f611c003230 con 0x7f61300a2fa0 2020-02-11T16:19:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2497155520 0 0) 0x7f611c003230 con 0x7f61300a2fa0 2020-02-11T16:19:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 >> v2:172.21.15.88:3300/0 conn(0x7f61300a1520 msgr2=0x7f6130131990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 --2- 172.21.15.88:0/891431021 >> v2:172.21.15.88:3300/0 conn(0x7f61300a1520 0x7f6130131990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:13.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 >> v1:172.21.15.88:6789/0 conn(0x7f61300a5b20 legacy=0x7f6130131280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:13.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61300a3ce0 con 0x7f61300a2fa0 2020-02-11T16:19:13.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f61200016d0 con 0x7f61300a2fa0 2020-02-11T16:19:13.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 >> v1:172.21.15.52:6789/0 conn(0x7f61300a2fa0 legacy=0x7f61300a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:13.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f611c003720 0x7f611c003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:13.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c004040 0x7f611c004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:13.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f611c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:13.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61300a1e60 con 0x7f611c004a80 2020-02-11T16:19:13.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c00c970 con 0x7f611c004040 2020-02-11T16:19:13.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c00cb30 con 0x7f611c003720 2020-02-11T16:19:13.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612ffff700 1 -- 172.21.15.88:0/891431021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c004040 msgr2=0x7f611c004510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:19:13.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f612ffff700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c004040 0x7f611c004510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:13.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f613538e700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f611c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:13.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f6134b8d700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f611c003720 0x7f611c003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f613538e700 1 -- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f611c003720 msgr2=0x7f611c003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f613538e700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f611c003720 0x7f611c003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f613538e700 1 -- 172.21.15.88:0/891431021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c004040 msgr2=0x7f611c004510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f613538e700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c004040 0x7f611c004510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f613538e700 1 -- 172.21.15.88:0/891431021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c003230 con 0x7f611c004a80 2020-02-11T16:19:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f6134b8d700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f611c003720 0x7f611c003b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f613538e700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f611c004f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6128005ad0 tx=0x7f6128008c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.083+0000 7f613538e700 1 -- 172.21.15.88:0/891431021 reap_dead start 2020-02-11T16:19:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f613538e700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f611c004f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6128005ad0 tx=0x7f6128008c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f613538e700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f611c004f30 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f6128005ad0 tx=0x7f6128008c80).ready entity=mon.0 client_cookie=e63a5387e59e39f5 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f613538e700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f611c004f30 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f6128005ad0 tx=0x7f6128008c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6128005350 con 0x7f611c004a80 2020-02-11T16:19:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f613538e700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f611c004f30 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f6128005ad0 tx=0x7f6128008c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f613538e700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f611c004f30 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f6128005ad0 tx=0x7f6128008c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61280054b0 con 0x7f611c004a80 2020-02-11T16:19:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f612f7fe700 1 -- 172.21.15.88:0/891431021 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6128005830 con 0x7f611c004a80 2020-02-11T16:19:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f6136df1700 1 -- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 msgr2=0x7f611c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f6136df1700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f611c004f30 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f6128005ad0 tx=0x7f6128008c80).stop 2020-02-11T16:19:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f6136df1700 1 -- 172.21.15.88:0/891431021 shutdown_connections 2020-02-11T16:19:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f6136df1700 1 --2- 172.21.15.88:0/891431021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f611c004f30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:13.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f6136df1700 1 -- 172.21.15.88:0/891431021 >> 172.21.15.88:0/891431021 conn(0x7f613009d110 msgr2=0x7f613009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:13.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f6136df1700 1 -- 172.21.15.88:0/891431021 shutdown_connections 2020-02-11T16:19:13.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.084+0000 7f6136df1700 1 -- 172.21.15.88:0/891431021 wait complete. 2020-02-11T16:19:13.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.085+0000 7f6136df1700 1 Processor -- start 2020-02-11T16:19:13.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.085+0000 7f6136df1700 1 -- start start 2020-02-11T16:19:13.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.086+0000 7f6136df1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f611c004a80 0x7f6130063cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.086+0000 7f6136df1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6130146480 con 0x7f6130146f50 2020-02-11T16:19:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.086+0000 7f6136df1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6130061080 con 0x7f61300a0910 2020-02-11T16:19:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.086+0000 7f6136df1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6130131df0 con 0x7f611c004a80 2020-02-11T16:19:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.086+0000 7f612ffff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f61300a0910 legacy=0x7f6130146840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:19:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.086+0000 7f6134b8d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f611c004a80 0x7f6130063cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.086+0000 7f6134b8d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f611c004a80 0x7f6130063cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43052/0 (socket says 172.21.15.88:43052) 2020-02-11T16:19:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.086+0000 7f6134b8d700 1 -- 172.21.15.88:0/2306412552 learned_addr learned my addr 172.21.15.88:0/2306412552 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.086+0000 7f6134b8d700 1 -- 172.21.15.88:0/2306412552 >> v1:172.21.15.88:6789/0 conn(0x7f61300a0910 legacy=0x7f6130146840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:19:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6134b8d700 1 -- 172.21.15.88:0/2306412552 >> v1:172.21.15.52:6789/0 conn(0x7f6130146f50 legacy=0x7f613014d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6134b8d700 1 -- 172.21.15.88:0/2306412552 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61300612b0 con 0x7f611c004a80 2020-02-11T16:19:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391210986 0 0) 0x7f6130146480 con 0x7f6130146f50 2020-02-11T16:19:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6134b8d700 1 --2- 172.21.15.88:0/2306412552 >> v2:172.21.15.52:3300/0 conn(0x7f611c004a80 0x7f6130063cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f612000e870 tx=0x7f6120010fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6134b8d700 1 --2- 172.21.15.88:0/2306412552 >> v2:172.21.15.52:3300/0 conn(0x7f611c004a80 0x7f6130063cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f612000e870 tx=0x7f6120010fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6134b8d700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f6130063cb0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f612000e870 tx=0x7f6120010fc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6134b8d700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f6130063cb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f612000e870 tx=0x7f6120010fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6120010350 con 0x7f611c004a80 2020-02-11T16:19:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6134b8d700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f6130063cb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f612000e870 tx=0x7f6120010fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6136df1700 1 -- 172.21.15.88:0/2306412552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6130061550 con 0x7f611c004a80 2020-02-11T16:19:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61200104b0 con 0x7f611c004a80 2020-02-11T16:19:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6134b8d700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f6130063cb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f612000e870 tx=0x7f6120010fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61200125a0 con 0x7f611c004a80 2020-02-11T16:19:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6136df1700 1 -- 172.21.15.88:0/2306412552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6130062750 con 0x7f611c004a80 2020-02-11T16:19:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.087+0000 7f6134b8d700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f6130063cb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f612000e870 tx=0x7f6120010fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f6136df1700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 0x7f61300a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f6136df1700 1 -- 172.21.15.88:0/2306412552 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613005e2f0 con 0x7f61300642d0 2020-02-11T16:19:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6120012750 con 0x7f611c004a80 2020-02-11T16:19:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f6134b8d700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f6130063cb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f612000e870 tx=0x7f6120010fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 0x7f61300a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:13.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f612dffb700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039a80 0x7f611003bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:13.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6120049a50 con 0x7f611c004a80 2020-02-11T16:19:13.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f612ffff700 1 -- 172.21.15.88:0/2306412552 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6130061750 con 0x7f61300642d0 2020-02-11T16:19:13.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f613538e700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039a80 0x7f611003bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:13.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 0x7f61300a7ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 0x7f61300a7ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 0x7f61300a7ef0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:13.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 0x7f61300a7ef0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6124007550 con 0x7f61300642d0 2020-02-11T16:19:13.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.088+0000 7f613538e700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039a80 0x7f611003bf40 crc :-1 s=READY pgs=345 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:13.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.089+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 0x7f61300a7ef0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.089+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f61240076b0 con 0x7f61300642d0 2020-02-11T16:19:13.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.089+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 msgr2=0x7f61300a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:13.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.089+0000 7f612dffb700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 0x7f61300a7ef0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).stop 2020-02-11T16:19:13.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.089+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 msgr2=0x7f61300a7ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:13.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.089+0000 7f612dffb700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300642d0 0x7f61300a7ef0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).stop 2020-02-11T16:19:13.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.097+0000 7f6136df1700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 0x7f613009e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:13.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.097+0000 7f6136df1700 1 -- 172.21.15.88:0/2306412552 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61301473c0 con 0x7f613009def0 2020-02-11T16:19:13.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.097+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 0x7f613009e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:13.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.097+0000 7f612ffff700 1 -- 172.21.15.88:0/2306412552 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6130062010 con 0x7f613009def0 2020-02-11T16:19:13.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.097+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 0x7f613009e300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.097+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 0x7f613009e300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.097+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 0x7f613009e300 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:13.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.097+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 0x7f613009e300 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f612400f4c0 con 0x7f613009def0 2020-02-11T16:19:13.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f612ffff700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 0x7f613009e300 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:13.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f612400f620 con 0x7f613009def0 2020-02-11T16:19:13.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 msgr2=0x7f613009e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:13.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f612dffb700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 0x7f613009e300 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).stop 2020-02-11T16:19:13.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f612dffb700 1 -- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 msgr2=0x7f613009e300 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:13.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f612dffb700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f613009def0 0x7f613009e300 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0x7f6124003540 tx=0x7f6124010920).stop 2020-02-11T16:19:13.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f6136df1700 1 -- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039a80 msgr2=0x7f611003bf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:13.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f6136df1700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039a80 0x7f611003bf40 crc :-1 s=READY pgs=345 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:13.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f6136df1700 1 -- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 msgr2=0x7f6130063cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:13.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f6136df1700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f6130063cb0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f612000e870 tx=0x7f6120010fc0).stop 2020-02-11T16:19:13.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f613538e700 1 -- 172.21.15.88:0/2306412552 reap_dead start 2020-02-11T16:19:13.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f6136df1700 1 -- 172.21.15.88:0/2306412552 shutdown_connections 2020-02-11T16:19:13.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f6136df1700 1 --2- 172.21.15.88:0/2306412552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f611c004a80 0x7f6130063cb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:13.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f6136df1700 1 -- 172.21.15.88:0/2306412552 >> 172.21.15.88:0/2306412552 conn(0x7f613009d110 msgr2=0x7f6130069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:13.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f6136df1700 1 -- 172.21.15.88:0/2306412552 shutdown_connections 2020-02-11T16:19:13.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:13.098+0000 7f6136df1700 1 -- 172.21.15.88:0/2306412552 wait complete. 2020-02-11T16:19:13.112 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:19:13.112 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:13.112 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:13.112 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:19:13.112 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 112, 2020-02-11T16:19:13.112 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:19:13.113 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:19:13.113 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:19:13.113 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:13.113 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:19:13.113 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:13.113 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:19:13.114 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:19:13.114 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:13.114 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:13.114 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:13.114 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:13.114 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:13.114 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:13.115 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:13.115 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:19:13.115 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:19:13.115 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:13.115 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:13.115 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:13.115 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:13.115 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:13.116 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:13.116 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:13.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.116 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:19:13.116 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:19:13.116 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:19:13.116 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:19:13.117 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:19:13.117 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:19:13.117 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:13.117 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:13.117 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:19:13.117 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:19:13.117 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:19:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:13.118 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:19:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:19:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:13.119 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:19:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:13.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:19:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.121 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:19:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:19:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:19:13.122 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:19:13.123 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:13.123 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:13.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.123 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:13.123 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:19:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:19:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:13.124 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:13.125 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:13.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.125 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:19:13.125 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:19:13.125 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:13.125 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:13.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:19:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:13.127 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:19:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:19:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:19:13.128 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:19:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:19:13.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:19:13.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:19:13.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:19:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:19:13.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.133 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:13.133 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:13.133 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:19:13.133 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:13.133 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:13.134 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:19:13.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:13.134 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:13.134 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:13.134 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:13.134 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:13.134 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:13.135 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:13.135 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:19:13.136 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:19:13.898 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:19:14.136 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:19:33.136 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:19:33.137 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:19:33.137 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:19:33.137 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:19:33.140 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:19:33.140 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:19:33.140 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:19:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.256+0000 7f0f05873700 1 Processor -- start 2020-02-11T16:19:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.256+0000 7f0f05873700 1 -- start start 2020-02-11T16:19:33.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.256+0000 7f0f05873700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a2fa0 0x7f0f000a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.256+0000 7f0f05873700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f000a5410 0x7f0f000a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.256+0000 7f0f05873700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f00131280 0x7f0f001316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.256+0000 7f0f05873700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f000a1e60 con 0x7f0f000a5410 2020-02-11T16:19:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.256+0000 7f0f05873700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f000a3450 con 0x7f0f00131280 2020-02-11T16:19:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.256+0000 7f0f05873700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f000a4350 con 0x7f0f000a2fa0 2020-02-11T16:19:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.256+0000 7f0eff7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f00131280 0x7f0f001316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:33.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0eff7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f00131280 0x7f0f001316f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57086/0 (socket says 172.21.15.88:57086) 2020-02-11T16:19:33.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0eff7fe700 1 -- 172.21.15.88:0/2137232685 learned_addr learned my addr 172.21.15.88:0/2137232685 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:33.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0eff7fe700 1 -- 172.21.15.88:0/2137232685 >> v2:172.21.15.88:3300/0 conn(0x7f0f00131280 msgr2=0x7f0f001316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:19:33.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0eff7fe700 1 -- 172.21.15.88:0/2137232685 >> v2:172.21.15.88:3300/0 conn(0x7f0f00131280 msgr2=0x7f0f001316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:33.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0eff7fe700 1 --2- 172.21.15.88:0/2137232685 >> v2:172.21.15.88:3300/0 conn(0x7f0f00131280 0x7f0f001316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:33.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0eff7fe700 1 --2- 172.21.15.88:0/2137232685 >> v2:172.21.15.88:3300/0 conn(0x7f0f00131280 0x7f0f001316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:33.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0efeffd700 1 --2- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a2fa0 0x7f0f000a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/2137232685 >> v2:172.21.15.52:3300/0 conn(0x7f0f000a5410 0x7f0f000a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 -- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a2fa0 msgr2=0x7f0f000a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a2fa0 0x7f0f000a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 -- 172.21.15.88:0/2137232685 >> v2:172.21.15.88:3300/0 conn(0x7f0f00131280 msgr2=0x7f0f001316f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/2137232685 >> v2:172.21.15.88:3300/0 conn(0x7f0f00131280 0x7f0f001316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 -- 172.21.15.88:0/2137232685 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f000a3a40 con 0x7f0f000a5410 2020-02-11T16:19:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0efeffd700 1 --2- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a2fa0 0x7f0f000a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/2137232685 >> v2:172.21.15.52:3300/0 conn(0x7f0f000a5410 0x7f0f000a5890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/2137232685 >> v2:172.21.15.52:3300/0 conn(0x7f0f000a5410 0x7f0f000a5890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000a5410 0x7f0f000a5890 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).ready entity=mon.0 client_cookie=b12588b1e9cf5c5a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000a5410 0x7f0f000a5890 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0efe7fc700 1 -- 172.21.15.88:0/2137232685 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ee80113c0 con 0x7f0f000a5410 2020-02-11T16:19:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000a5410 0x7f0f000a5890 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000a5410 0x7f0f000a5890 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0efe7fc700 1 -- 172.21.15.88:0/2137232685 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee8011520 con 0x7f0f000a5410 2020-02-11T16:19:33.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.257+0000 7f0efe7fc700 1 -- 172.21.15.88:0/2137232685 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ee8011900 con 0x7f0f000a5410 2020-02-11T16:19:33.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.258+0000 7f0f05873700 1 -- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000a5410 msgr2=0x7f0f000a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:33.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.258+0000 7f0f05873700 1 --2- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000a5410 0x7f0f000a5890 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).stop 2020-02-11T16:19:33.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.258+0000 7f0f05873700 1 -- 172.21.15.88:0/2137232685 shutdown_connections 2020-02-11T16:19:33.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.258+0000 7f0f05873700 1 --2- 172.21.15.88:0/2137232685 >> v2:172.21.15.88:3300/0 conn(0x7f0f00131280 0x7f0f001316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:33.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.258+0000 7f0f05873700 1 --2- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a2fa0 0x7f0f000a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:33.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.258+0000 7f0f05873700 1 --2- 172.21.15.88:0/2137232685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000a5410 0x7f0f000a5890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:33.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.258+0000 7f0f05873700 1 -- 172.21.15.88:0/2137232685 >> 172.21.15.88:0/2137232685 conn(0x7f0f0009d110 msgr2=0x7f0f0009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:33.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.258+0000 7f0f05873700 1 -- 172.21.15.88:0/2137232685 shutdown_connections 2020-02-11T16:19:33.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.258+0000 7f0f05873700 1 -- 172.21.15.88:0/2137232685 wait complete. 2020-02-11T16:19:33.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.259+0000 7f0f05873700 1 Processor -- start 2020-02-11T16:19:33.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.259+0000 7f0f05873700 1 -- start start 2020-02-11T16:19:33.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0f05873700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:33.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0f05873700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f001387f0 con 0x7f0f00131280 2020-02-11T16:19:33.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0f05873700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f00137b90 con 0x7f0f000a2fa0 2020-02-11T16:19:33.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0f05873700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00137ea0 con 0x7f0f000a5410 2020-02-11T16:19:33.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0efeffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0f000a2fa0 0x7f0f001306b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44714/0 (socket says 172.21.15.88:44714) 2020-02-11T16:19:33.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0efeffd700 1 -- 172.21.15.88:0/619259113 learned_addr learned my addr 172.21.15.88:0/619259113 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:33.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:33.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0efcff9700 1 -- 172.21.15.88:0/619259113 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857085578 0 0) 0x7f0f001387f0 con 0x7f0f00131280 2020-02-11T16:19:33.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0efcff9700 1 -- 172.21.15.88:0/619259113 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee4002fe0 con 0x7f0f00131280 2020-02-11T16:19:33.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0ef7fff700 1 -- 172.21.15.88:0/619259113 >> v1:172.21.15.88:6789/0 conn(0x7f0f000a2fa0 legacy=0x7f0f001306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:33.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0ef7fff700 1 -- 172.21.15.88:0/619259113 >> v1:172.21.15.52:6789/0 conn(0x7f0f00131280 legacy=0x7f0f00144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:33.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0ef7fff700 1 -- 172.21.15.88:0/619259113 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f000a9eb0 con 0x7f0f000a5410 2020-02-11T16:19:33.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.260+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:33.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0efcff9700 1 -- 172.21.15.88:0/619259113 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ee8011840 con 0x7f0f000a5410 2020-02-11T16:19:33.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0f05873700 1 -- 172.21.15.88:0/619259113 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f00138a20 con 0x7f0f000a5410 2020-02-11T16:19:33.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0efcff9700 1 -- 172.21.15.88:0/619259113 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee80119a0 con 0x7f0f000a5410 2020-02-11T16:19:33.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0efcff9700 1 -- 172.21.15.88:0/619259113 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ee8007340 con 0x7f0f000a5410 2020-02-11T16:19:33.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0f05873700 1 -- 172.21.15.88:0/619259113 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f00135330 con 0x7f0f000a5410 2020-02-11T16:19:33.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.261+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.262+0000 7f0f05873700 1 -- 172.21.15.88:0/619259113 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f001378b0 con 0x7f0f000a5410 2020-02-11T16:19:33.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.262+0000 7f0efcff9700 1 -- 172.21.15.88:0/619259113 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0ee80056c0 con 0x7f0f000a5410 2020-02-11T16:19:33.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.262+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.262+0000 7f0efcff9700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0ee4039f40 0x7f0ee403c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:33.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.262+0000 7f0efcff9700 1 -- 172.21.15.88:0/619259113 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f0ee8049f40 con 0x7f0f000a5410 2020-02-11T16:19:33.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.262+0000 7f0efeffd700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0ee4039f40 0x7f0ee403c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:33.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.262+0000 7f0efeffd700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0ee4039f40 0x7f0ee403c400 crc :-1 s=READY pgs=347 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:33.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.266+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.266+0000 7f0efcff9700 1 -- 172.21.15.88:0/619259113 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f0ee802f5e0 con 0x7f0f000a5410 2020-02-11T16:19:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.449+0000 7f0f05873700 1 -- 172.21.15.88:0/619259113 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0f000565b0 con 0x7f0f000a5410 2020-02-11T16:19:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.450+0000 7f0ef7fff700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:33.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.450+0000 7f0efcff9700 1 -- 172.21.15.88:0/619259113 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f0ee80320d0 con 0x7f0f000a5410 2020-02-11T16:19:33.453 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":112,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:33.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.451+0000 7f0f05873700 1 -- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0ee4039f40 msgr2=0x7f0ee403c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:33.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.451+0000 7f0f05873700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0ee4039f40 0x7f0ee403c400 crc :-1 s=READY pgs=347 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:33.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.451+0000 7f0f05873700 1 -- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 msgr2=0x7f0f0013df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:33.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.451+0000 7f0f05873700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f0ee8002f30 tx=0x7f0ee8007a40).stop 2020-02-11T16:19:33.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.451+0000 7f0f05873700 1 -- 172.21.15.88:0/619259113 shutdown_connections 2020-02-11T16:19:33.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.451+0000 7f0f05873700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0ee4039f40 0x7f0ee403c400 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:33.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.451+0000 7f0f05873700 1 --2- 172.21.15.88:0/619259113 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f000a5410 0x7f0f0013df20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:33.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.451+0000 7f0f05873700 1 -- 172.21.15.88:0/619259113 >> 172.21.15.88:0/619259113 conn(0x7f0f0009d110 msgr2=0x7f0f00069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:33.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.451+0000 7f0f05873700 1 -- 172.21.15.88:0/619259113 shutdown_connections 2020-02-11T16:19:33.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:33.451+0000 7f0f05873700 1 -- 172.21.15.88:0/619259113 wait complete. 2020-02-11T16:19:33.464 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":112,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:36.465 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:19:36.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.579+0000 7f9821906700 1 Processor -- start 2020-02-11T16:19:36.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.579+0000 7f9821906700 1 -- start start 2020-02-11T16:19:36.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9821906700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f981c0a3960 0x7f981c1360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:36.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9821906700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c139fa0 con 0x7f981c139720 2020-02-11T16:19:36.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9821906700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c05b3f0 con 0x7f981c139b70 2020-02-11T16:19:36.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9821906700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c05bc70 con 0x7f981c0a3960 2020-02-11T16:19:36.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9821105700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f981c139b70 0x7f981c05ace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44740/0 (socket says 172.21.15.88:44740) 2020-02-11T16:19:36.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9821105700 1 -- 172.21.15.88:0/862559200 learned_addr learned my addr 172.21.15.88:0/862559200 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:36.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9820904700 1 --2- 172.21.15.88:0/862559200 >> v2:172.21.15.52:3300/0 conn(0x7f981c0a3960 0x7f981c1360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:36.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9820904700 1 -- 172.21.15.88:0/862559200 >> v1:172.21.15.88:6789/0 conn(0x7f981c139b70 legacy=0x7f981c05ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:36.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9820904700 1 -- 172.21.15.88:0/862559200 >> v1:172.21.15.52:6789/0 conn(0x7f981c139720 legacy=0x7f981c05a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:36.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9820904700 1 -- 172.21.15.88:0/862559200 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c136870 con 0x7f981c0a3960 2020-02-11T16:19:36.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f981b7fe700 1 -- 172.21.15.88:0/862559200 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723241863 0 0) 0x7f981c139fa0 con 0x7f981c139720 2020-02-11T16:19:36.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.580+0000 7f9820904700 1 --2- 172.21.15.88:0/862559200 >> v2:172.21.15.52:3300/0 conn(0x7f981c0a3960 0x7f981c1360f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9820904700 1 --2- 172.21.15.88:0/862559200 >> v2:172.21.15.52:3300/0 conn(0x7f981c0a3960 0x7f981c1360f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9820904700 1 --2- 172.21.15.88:0/862559200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c1360f0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).ready entity=mon.0 client_cookie=7ead9e377627ecba server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:36.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9820904700 1 --2- 172.21.15.88:0/862559200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c1360f0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f981b7fe700 1 -- 172.21.15.88:0/862559200 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f981400a160 con 0x7f981c0a3960 2020-02-11T16:19:36.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9820904700 1 --2- 172.21.15.88:0/862559200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c1360f0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9820904700 1 --2- 172.21.15.88:0/862559200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c1360f0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f981b7fe700 1 -- 172.21.15.88:0/862559200 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981400a2c0 con 0x7f981c0a3960 2020-02-11T16:19:36.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f981b7fe700 1 -- 172.21.15.88:0/862559200 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f981400a6a0 con 0x7f981c0a3960 2020-02-11T16:19:36.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9821906700 1 -- 172.21.15.88:0/862559200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 msgr2=0x7f981c1360f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:36.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9821906700 1 --2- 172.21.15.88:0/862559200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c1360f0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).stop 2020-02-11T16:19:36.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9821906700 1 -- 172.21.15.88:0/862559200 shutdown_connections 2020-02-11T16:19:36.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9821906700 1 --2- 172.21.15.88:0/862559200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c1360f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:36.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9821906700 1 -- 172.21.15.88:0/862559200 >> 172.21.15.88:0/862559200 conn(0x7f981c0a9f90 msgr2=0x7f981c0aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:36.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9821906700 1 -- 172.21.15.88:0/862559200 shutdown_connections 2020-02-11T16:19:36.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.581+0000 7f9821906700 1 -- 172.21.15.88:0/862559200 wait complete. 2020-02-11T16:19:36.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.582+0000 7f9821906700 1 Processor -- start 2020-02-11T16:19:36.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.582+0000 7f9821906700 1 -- start start 2020-02-11T16:19:36.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f9821906700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f981c0a3960 0x7f981c09d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:36.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f9821906700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f981c139720 0x7f981c09c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:36.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f9821906700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c09d7c0 con 0x7f981c139b70 2020-02-11T16:19:36.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f9821906700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c061df0 con 0x7f981c0a3960 2020-02-11T16:19:36.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f9821906700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c062090 con 0x7f981c139720 2020-02-11T16:19:36.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f9820904700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f981c0a3960 0x7f981c09d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:36.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f981bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f981c139720 0x7f981c09c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:36.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f9820904700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f981c0a3960 0x7f981c09d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43102/0 (socket says 172.21.15.88:43102) 2020-02-11T16:19:36.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f9820904700 1 -- 172.21.15.88:0/1443617718 learned_addr learned my addr 172.21.15.88:0/1443617718 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:36.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f9820904700 1 -- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f981c139720 msgr2=0x7f981c09c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:36.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.583+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f981c139720 0x7f981c09c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:36.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9820904700 1 -- 172.21.15.88:0/1443617718 >> v1:172.21.15.52:6789/0 conn(0x7f981c139b70 legacy=0x7f981c143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:36.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9820904700 1 -- 172.21.15.88:0/1443617718 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c062330 con 0x7f981c0a3960 2020-02-11T16:19:36.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9819ffb700 1 -- 172.21.15.88:0/1443617718 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504820249 0 0) 0x7f981c05b3f0 con 0x7f981c139b70 2020-02-11T16:19:36.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> v2:172.21.15.52:3300/0 conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> v2:172.21.15.52:3300/0 conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:36.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9819ffb700 1 -- 172.21.15.88:0/1443617718 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9814005c30 con 0x7f981c0a3960 2020-02-11T16:19:36.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9819ffb700 1 -- 172.21.15.88:0/1443617718 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814005d90 con 0x7f981c0a3960 2020-02-11T16:19:36.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9821906700 1 -- 172.21.15.88:0/1443617718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c0625d0 con 0x7f981c0a3960 2020-02-11T16:19:36.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9819ffb700 1 -- 172.21.15.88:0/1443617718 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f981400f760 con 0x7f981c0a3960 2020-02-11T16:19:36.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9821906700 1 -- 172.21.15.88:0/1443617718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c09c720 con 0x7f981c0a3960 2020-02-11T16:19:36.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.584+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.585+0000 7f9819ffb700 1 -- 172.21.15.88:0/1443617718 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f981400f960 con 0x7f981c0a3960 2020-02-11T16:19:36.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.585+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.585+0000 7f9821906700 1 -- 172.21.15.88:0/1443617718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981c0565b0 con 0x7f981c0a3960 2020-02-11T16:19:36.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.585+0000 7f9819ffb700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f97fc039b00 0x7f97fc03bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:36.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.585+0000 7f9819ffb700 1 -- 172.21.15.88:0/1443617718 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f981404aae0 con 0x7f981c0a3960 2020-02-11T16:19:36.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.585+0000 7f981bfff700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f97fc039b00 0x7f97fc03bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:36.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.586+0000 7f981bfff700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f97fc039b00 0x7f97fc03bfc0 crc :-1 s=READY pgs=348 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:36.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.589+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.589+0000 7f9819ffb700 1 -- 172.21.15.88:0/1443617718 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f98140301a0 con 0x7f981c0a3960 2020-02-11T16:19:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.768+0000 7f9821906700 1 -- 172.21.15.88:0/1443617718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f981c05b7a0 con 0x7f981c0a3960 2020-02-11T16:19:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.769+0000 7f9820904700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.769+0000 7f9819ffb700 1 -- 172.21.15.88:0/1443617718 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f9814032c70 con 0x7f981c0a3960 2020-02-11T16:19:36.772 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":112,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:36.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 -- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f97fc039b00 msgr2=0x7f97fc03bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:36.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f97fc039b00 0x7f97fc03bfc0 crc :-1 s=READY pgs=348 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:36.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 -- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 msgr2=0x7f981c09d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:36.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c09d360 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f98140032b0 tx=0x7f981c0684d0).stop 2020-02-11T16:19:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 -- 172.21.15.88:0/1443617718 shutdown_connections 2020-02-11T16:19:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f97fc039b00 0x7f97fc03bfc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f981c0a3960 0x7f981c09d360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 --2- 172.21.15.88:0/1443617718 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f981c139720 0x7f981c09c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 -- 172.21.15.88:0/1443617718 >> 172.21.15.88:0/1443617718 conn(0x7f981c0a9f90 msgr2=0x7f981c0a3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 -- 172.21.15.88:0/1443617718 shutdown_connections 2020-02-11T16:19:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:36.770+0000 7f9821906700 1 -- 172.21.15.88:0/1443617718 wait complete. 2020-02-11T16:19:36.783 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":112,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:39.784 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:19:39.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.898+0000 7febf5868700 1 Processor -- start 2020-02-11T16:19:39.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.898+0000 7febf5868700 1 -- start start 2020-02-11T16:19:39.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febf5868700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febf00a7120 0x7febf00a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:39.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febf5868700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febf00a3e70 0x7febf012ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:39.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febf5868700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf00a5320 con 0x7febf00a39e0 2020-02-11T16:19:39.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febf5868700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf0130400 con 0x7febf00a7120 2020-02-11T16:19:39.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febf5868700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf009e7a0 con 0x7febf00a3e70 2020-02-11T16:19:39.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febef7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febf00a3e70 0x7febf012ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:39.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febef7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febf00a3e70 0x7febf012ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57130/0 (socket says 172.21.15.88:57130) 2020-02-11T16:19:39.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febef7fe700 1 -- 172.21.15.88:0/3430947579 learned_addr learned my addr 172.21.15.88:0/3430947579 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:39.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febef7fe700 1 -- 172.21.15.88:0/3430947579 >> v2:172.21.15.88:3300/0 conn(0x7febf00a3e70 msgr2=0x7febf012ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:19:39.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febef7fe700 1 -- 172.21.15.88:0/3430947579 >> v2:172.21.15.88:3300/0 conn(0x7febf00a3e70 msgr2=0x7febf012ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:19:39.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febef7fe700 1 --2- 172.21.15.88:0/3430947579 >> v2:172.21.15.88:3300/0 conn(0x7febf00a3e70 0x7febf012ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:39.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febeeffd700 1 --2- 172.21.15.88:0/3430947579 >> v2:172.21.15.52:3300/0 conn(0x7febf00a7120 0x7febf00a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:39.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.899+0000 7febef7fe700 1 --2- 172.21.15.88:0/3430947579 >> v2:172.21.15.88:3300/0 conn(0x7febf00a3e70 0x7febf012ffa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:39.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febedffb700 1 -- 172.21.15.88:0/3430947579 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131980917 0 0) 0x7febe00010d0 con 0x7febf00a39e0 2020-02-11T16:19:39.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febedffb700 1 -- 172.21.15.88:0/3430947579 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd4003230 con 0x7febf00a39e0 2020-02-11T16:19:39.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febeeffd700 1 -- 172.21.15.88:0/3430947579 >> v2:172.21.15.88:3300/0 conn(0x7febf00a3e70 msgr2=0x7febf012ffa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:19:39.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febeeffd700 1 --2- 172.21.15.88:0/3430947579 >> v2:172.21.15.88:3300/0 conn(0x7febf00a3e70 0x7febf012ffa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:39.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febeeffd700 1 -- 172.21.15.88:0/3430947579 >> v1:172.21.15.52:6789/0 conn(0x7febf00a39e0 legacy=0x7febf012f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:39.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febeeffd700 1 -- 172.21.15.88:0/3430947579 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf00a5560 con 0x7febf00a7120 2020-02-11T16:19:39.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febeeffd700 1 --2- 172.21.15.88:0/3430947579 >> v2:172.21.15.52:3300/0 conn(0x7febf00a7120 0x7febf00a4ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febeeffd700 1 --2- 172.21.15.88:0/3430947579 >> v2:172.21.15.52:3300/0 conn(0x7febf00a7120 0x7febf00a4ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febeeffd700 1 --2- 172.21.15.88:0/3430947579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00a7120 0x7febf00a4ec0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).ready entity=mon.0 client_cookie=7357c737c252fcbf server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:39.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febeeffd700 1 --2- 172.21.15.88:0/3430947579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00a7120 0x7febf00a4ec0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febedffb700 1 -- 172.21.15.88:0/3430947579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe40113c0 con 0x7febf00a7120 2020-02-11T16:19:39.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febeeffd700 1 --2- 172.21.15.88:0/3430947579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00a7120 0x7febf00a4ec0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febedffb700 1 -- 172.21.15.88:0/3430947579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe4011520 con 0x7febf00a7120 2020-02-11T16:19:39.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febeeffd700 1 --2- 172.21.15.88:0/3430947579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00a7120 0x7febf00a4ec0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febedffb700 1 -- 172.21.15.88:0/3430947579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe40118c0 con 0x7febf00a7120 2020-02-11T16:19:39.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febf5868700 1 -- 172.21.15.88:0/3430947579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00a7120 msgr2=0x7febf00a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:39.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.900+0000 7febf5868700 1 --2- 172.21.15.88:0/3430947579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00a7120 0x7febf00a4ec0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).stop 2020-02-11T16:19:39.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.901+0000 7febf5868700 1 -- 172.21.15.88:0/3430947579 shutdown_connections 2020-02-11T16:19:39.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.901+0000 7febf5868700 1 --2- 172.21.15.88:0/3430947579 >> v2:172.21.15.88:3300/0 conn(0x7febf00a3e70 0x7febf012ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:39.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.901+0000 7febf5868700 1 --2- 172.21.15.88:0/3430947579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00a7120 0x7febf00a4ec0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:39.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.901+0000 7febf5868700 1 -- 172.21.15.88:0/3430947579 >> 172.21.15.88:0/3430947579 conn(0x7febf009d110 msgr2=0x7febf009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:39.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.901+0000 7febf5868700 1 -- 172.21.15.88:0/3430947579 shutdown_connections 2020-02-11T16:19:39.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.901+0000 7febf5868700 1 -- 172.21.15.88:0/3430947579 wait complete. 2020-02-11T16:19:39.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.901+0000 7febf5868700 1 Processor -- start 2020-02-11T16:19:39.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febf5868700 1 -- start start 2020-02-11T16:19:39.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febf5868700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:39.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febf5868700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febf00a7120 0x7febf012a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:39.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febf5868700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf0132d90 con 0x7febf00a3e70 2020-02-11T16:19:39.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febf5868700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf0148560 con 0x7febf00a7120 2020-02-11T16:19:39.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febf5868700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf0148800 con 0x7febf00a39e0 2020-02-11T16:19:39.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febee7fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7febf00a3e70 0x7febf01314e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44760/0 (socket says 172.21.15.88:44760) 2020-02-11T16:19:39.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febee7fc700 1 -- 172.21.15.88:0/1375312002 learned_addr learned my addr 172.21.15.88:0/1375312002 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:39.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febef7fe700 1 --2- 172.21.15.88:0/1375312002 >> v2:172.21.15.88:3300/0 conn(0x7febf00a7120 0x7febf012a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:39.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febef7fe700 1 -- 172.21.15.88:0/1375312002 >> v2:172.21.15.88:3300/0 conn(0x7febf00a7120 msgr2=0x7febf012a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:19:39.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febef7fe700 1 -- 172.21.15.88:0/1375312002 >> v2:172.21.15.88:3300/0 conn(0x7febf00a7120 msgr2=0x7febf012a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:19:39.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febef7fe700 1 --2- 172.21.15.88:0/1375312002 >> v2:172.21.15.88:3300/0 conn(0x7febf00a7120 0x7febf012a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:19:39.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febef7fe700 1 --2- 172.21.15.88:0/1375312002 >> v2:172.21.15.88:3300/0 conn(0x7febf00a7120 0x7febf012a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:19:39.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.902+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:39.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febeeffd700 1 -- 172.21.15.88:0/1375312002 >> v2:172.21.15.88:3300/0 conn(0x7febf00a7120 msgr2=0x7febf012a540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:19:39.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> v2:172.21.15.88:3300/0 conn(0x7febf00a7120 0x7febf012a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:39.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febeeffd700 1 -- 172.21.15.88:0/1375312002 >> v1:172.21.15.88:6789/0 conn(0x7febf00a3e70 legacy=0x7febf01314e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:39.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febeeffd700 1 -- 172.21.15.88:0/1375312002 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf0148aa0 con 0x7febf00a39e0 2020-02-11T16:19:39.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:39.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febdffff700 1 -- 172.21.15.88:0/1375312002 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe4007150 con 0x7febf00a39e0 2020-02-11T16:19:39.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febdffff700 1 -- 172.21.15.88:0/1375312002 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe40072b0 con 0x7febf00a39e0 2020-02-11T16:19:39.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febf5868700 1 -- 172.21.15.88:0/1375312002 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf0148d40 con 0x7febf00a39e0 2020-02-11T16:19:39.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febdffff700 1 -- 172.21.15.88:0/1375312002 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe40056c0 con 0x7febf00a39e0 2020-02-11T16:19:39.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.903+0000 7febf5868700 1 -- 172.21.15.88:0/1375312002 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf01491e0 con 0x7febf00a39e0 2020-02-11T16:19:39.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.904+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.904+0000 7febdffff700 1 -- 172.21.15.88:0/1375312002 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7febe4005940 con 0x7febf00a39e0 2020-02-11T16:19:39.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.904+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.904+0000 7febf5868700 1 -- 172.21.15.88:0/1375312002 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf00565b0 con 0x7febf00a39e0 2020-02-11T16:19:39.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.904+0000 7febdffff700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febcc039b60 0x7febcc03c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:39.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.904+0000 7febdffff700 1 -- 172.21.15.88:0/1375312002 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7febe404a320 con 0x7febf00a39e0 2020-02-11T16:19:39.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.904+0000 7febee7fc700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febcc039b60 0x7febcc03c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:39.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.905+0000 7febee7fc700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febcc039b60 0x7febcc03c020 crc :-1 s=READY pgs=349 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:39.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.909+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:39.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:39.909+0000 7febdffff700 1 -- 172.21.15.88:0/1375312002 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7febe40328f0 con 0x7febf00a39e0 2020-02-11T16:19:40.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.089+0000 7febf5868700 1 -- 172.21.15.88:0/1375312002 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7febf0148ed0 con 0x7febf00a39e0 2020-02-11T16:19:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.090+0000 7febeeffd700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.090+0000 7febdffff700 1 -- 172.21.15.88:0/1375312002 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7febe40324b0 con 0x7febf00a39e0 2020-02-11T16:19:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 -- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febcc039b60 msgr2=0x7febcc03c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febcc039b60 0x7febcc03c020 crc :-1 s=READY pgs=349 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 -- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 msgr2=0x7febf0066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7febe4002f30 tx=0x7febe4007a40).stop 2020-02-11T16:19:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 -- 172.21.15.88:0/1375312002 shutdown_connections 2020-02-11T16:19:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7febcc039b60 0x7febcc03c020 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 --2- 172.21.15.88:0/1375312002 >> v2:172.21.15.88:3300/0 conn(0x7febf00a7120 0x7febf012a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 --2- 172.21.15.88:0/1375312002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf00a39e0 0x7febf0066f20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 -- 172.21.15.88:0/1375312002 >> 172.21.15.88:0/1375312002 conn(0x7febf009d110 msgr2=0x7febf005aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 -- 172.21.15.88:0/1375312002 shutdown_connections 2020-02-11T16:19:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.091+0000 7febf5868700 1 -- 172.21.15.88:0/1375312002 wait complete. 2020-02-11T16:19:40.103 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:40.106 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":114,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:40.107 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:19:40.107 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:19:40.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.212+0000 7f7be8964700 1 Processor -- start 2020-02-11T16:19:40.214 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.212+0000 7f7be8964700 1 -- start start 2020-02-11T16:19:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be8964700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7be40a2fa0 0x7f7be40a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be8964700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be8964700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be40a4350 con 0x7f7be40a6da0 2020-02-11T16:19:40.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be8964700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be40a1e60 con 0x7f7be40a2fa0 2020-02-11T16:19:40.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be8964700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40a3450 con 0x7f7be40a5410 2020-02-11T16:19:40.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be1d9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7be40a2fa0 0x7f7be40a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be1d9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:51466/0 (socket says 172.21.15.88:51466) 2020-02-11T16:19:40.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7be40a2fa0 0x7f7be40a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43126/0 (socket says 172.21.15.88:43126) 2020-02-11T16:19:40.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be1d9b700 1 -- 172.21.15.88:0/3621930857 learned_addr learned my addr 172.21.15.88:0/3621930857 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:40.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be1d9b700 1 -- 172.21.15.88:0/3621930857 >> v2:172.21.15.52:3300/0 conn(0x7f7be40a2fa0 msgr2=0x7f7be40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:40.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be1d9b700 1 --2- 172.21.15.88:0/3621930857 >> v2:172.21.15.52:3300/0 conn(0x7f7be40a2fa0 0x7f7be40a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:40.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be1d9b700 1 -- 172.21.15.88:0/3621930857 >> v1:172.21.15.52:6789/0 conn(0x7f7be40a6da0 legacy=0x7f7be4131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be1d9b700 1 -- 172.21.15.88:0/3621930857 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40a3a40 con 0x7f7be40a5410 2020-02-11T16:19:40.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be259c700 1 --2- 172.21.15.88:0/3621930857 >> v2:172.21.15.52:3300/0 conn(0x7f7be40a2fa0 0x7f7be40a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:40.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be1d9b700 1 --2- 172.21.15.88:0/3621930857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7bcc002f30 tx=0x7f7bcc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.213+0000 7f7be1d9b700 1 --2- 172.21.15.88:0/3621930857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7bcc002f30 tx=0x7f7bcc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be1d9b700 1 --2- 172.21.15.88:0/3621930857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f7bcc002f30 tx=0x7f7bcc0088e0).ready entity=mon.2 client_cookie=6f496d5f3e32f4db server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be1d9b700 1 --2- 172.21.15.88:0/3621930857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7bcc002f30 tx=0x7f7bcc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be1d9b700 1 --2- 172.21.15.88:0/3621930857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7bcc002f30 tx=0x7f7bcc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be159a700 1 -- 172.21.15.88:0/3621930857 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bcc0116b0 con 0x7f7be40a5410 2020-02-11T16:19:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be1d9b700 1 --2- 172.21.15.88:0/3621930857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7bcc002f30 tx=0x7f7bcc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be159a700 1 -- 172.21.15.88:0/3621930857 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc011810 con 0x7f7be40a5410 2020-02-11T16:19:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be159a700 1 -- 172.21.15.88:0/3621930857 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bcc011bf0 con 0x7f7be40a5410 2020-02-11T16:19:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be8964700 1 -- 172.21.15.88:0/3621930857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 msgr2=0x7f7be40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be8964700 1 --2- 172.21.15.88:0/3621930857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f7bcc002f30 tx=0x7f7bcc0088e0).stop 2020-02-11T16:19:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be8964700 1 -- 172.21.15.88:0/3621930857 shutdown_connections 2020-02-11T16:19:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be8964700 1 --2- 172.21.15.88:0/3621930857 >> v2:172.21.15.52:3300/0 conn(0x7f7be40a2fa0 0x7f7be40a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be8964700 1 --2- 172.21.15.88:0/3621930857 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a5410 0x7f7be40a5870 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be8964700 1 -- 172.21.15.88:0/3621930857 >> 172.21.15.88:0/3621930857 conn(0x7f7be409d110 msgr2=0x7f7be409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be8964700 1 -- 172.21.15.88:0/3621930857 shutdown_connections 2020-02-11T16:19:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.214+0000 7f7be8964700 1 -- 172.21.15.88:0/3621930857 wait complete. 2020-02-11T16:19:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.215+0000 7f7be8964700 1 Processor -- start 2020-02-11T16:19:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.215+0000 7f7be8964700 1 -- start start 2020-02-11T16:19:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be8964700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7be40a5410 0x7f7be4138340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be8964700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be8964700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be4139160 con 0x7f7be40a2fa0 2020-02-11T16:19:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be8964700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be4145570 con 0x7f7be40a5410 2020-02-11T16:19:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be8964700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4138c20 con 0x7f7be40a6da0 2020-02-11T16:19:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7be40a2fa0 0x7f7be4137740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44772/0 (socket says 172.21.15.88:44772) 2020-02-11T16:19:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be259c700 1 -- 172.21.15.88:0/2467880768 learned_addr learned my addr 172.21.15.88:0/2467880768 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be1d9b700 1 --2- 172.21.15.88:0/2467880768 >> v2:172.21.15.52:3300/0 conn(0x7f7be40a5410 0x7f7be4138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470546347 0 0) 0x7f7be4139160 con 0x7f7be40a2fa0 2020-02-11T16:19:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc8002fe0 con 0x7f7be40a2fa0 2020-02-11T16:19:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 -- 172.21.15.88:0/2467880768 >> v2:172.21.15.52:3300/0 conn(0x7f7be40a5410 msgr2=0x7f7be4138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 --2- 172.21.15.88:0/2467880768 >> v2:172.21.15.52:3300/0 conn(0x7f7be40a5410 0x7f7be4138340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 -- 172.21.15.88:0/2467880768 >> v1:172.21.15.88:6789/0 conn(0x7f7be40a2fa0 legacy=0x7f7be4137740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 -- 172.21.15.88:0/2467880768 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4138ec0 con 0x7f7be40a6da0 2020-02-11T16:19:40.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7be40a52f0 tx=0x7f7bd4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7be40a52f0 tx=0x7f7bd4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f7be40a52f0 tx=0x7f7bd4010820).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f7be40a52f0 tx=0x7f7bd4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd40069d0 con 0x7f7be40a6da0 2020-02-11T16:19:40.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f7be40a52f0 tx=0x7f7bd4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd4006b30 con 0x7f7be40a6da0 2020-02-11T16:19:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be2d9d700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f7be40a52f0 tx=0x7f7bd4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7be8964700 1 -- 172.21.15.88:0/2467880768 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be4137e50 con 0x7f7be40a6da0 2020-02-11T16:19:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.216+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd4010da0 con 0x7f7be40a6da0 2020-02-11T16:19:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.217+0000 7f7be8964700 1 -- 172.21.15.88:0/2467880768 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be41387f0 con 0x7f7be40a6da0 2020-02-11T16:19:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.217+0000 7f7be2d9d700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f7be40a52f0 tx=0x7f7bd4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.217+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7bd4011060 con 0x7f7be40a6da0 2020-02-11T16:19:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.217+0000 7f7be2d9d700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f7be40a52f0 tx=0x7f7bd4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.217+0000 7f7be8964700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 0x7f7be412e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.217+0000 7f7be8964700 1 -- 172.21.15.88:0/2467880768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4138ad0 con 0x7f7be4145e00 2020-02-11T16:19:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.217+0000 7f7bdb7fe700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7bc8039f50 0x7f7bc803c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.217+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 0x7f7be412e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7bd40497d0 con 0x7f7be40a6da0 2020-02-11T16:19:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7be259c700 1 -- 172.21.15.88:0/2467880768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7be413c950 con 0x7f7be4145e00 2020-02-11T16:19:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 0x7f7be412e100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7be1d9b700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7bc8039f50 0x7f7bc803c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 0x7f7be412e100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 0x7f7be412e100 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 0x7f7be412e100 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bdc012e50 con 0x7f7be4145e00 2020-02-11T16:19:40.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7be1d9b700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7bc8039f50 0x7f7bc803c410 crc :-1 s=READY pgs=350 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 0x7f7be412e100 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f7bdc005e20 con 0x7f7be4145e00 2020-02-11T16:19:40.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 msgr2=0x7f7be412e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7bdb7fe700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 0x7f7be412e100 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).stop 2020-02-11T16:19:40.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 msgr2=0x7f7be412e100 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:40.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.218+0000 7f7bdb7fe700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4145e00 0x7f7be412e100 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).stop 2020-02-11T16:19:40.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.226+0000 7f7be8964700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 0x7f7be412e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.226+0000 7f7be8964700 1 -- 172.21.15.88:0/2467880768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be405e2f0 con 0x7f7be4146210 2020-02-11T16:19:40.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.226+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 0x7f7be412e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be259c700 1 -- 172.21.15.88:0/2467880768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7be41374a0 con 0x7f7be4146210 2020-02-11T16:19:40.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 0x7f7be412e560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 0x7f7be412e560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 0x7f7be412e560 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 0x7f7be412e560 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bdc00ec10 con 0x7f7be4146210 2020-02-11T16:19:40.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be259c700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 0x7f7be412e560 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f7bdc00ed70 con 0x7f7be4146210 2020-02-11T16:19:40.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 msgr2=0x7f7be412e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7bdb7fe700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 0x7f7be412e560 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).stop 2020-02-11T16:19:40.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7bdb7fe700 1 -- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 msgr2=0x7f7be412e560 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:40.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7bdb7fe700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7be4146210 0x7f7be412e560 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0x7f7bdc0032b0 tx=0x7f7bdc011320).stop 2020-02-11T16:19:40.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be8964700 1 -- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7bc8039f50 msgr2=0x7f7bc803c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be8964700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7bc8039f50 0x7f7bc803c410 crc :-1 s=READY pgs=350 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be8964700 1 -- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 msgr2=0x7f7be41459a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be8964700 1 --2- 172.21.15.88:0/2467880768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be40a6da0 0x7f7be41459a0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f7be40a52f0 tx=0x7f7bd4010820).stop 2020-02-11T16:19:40.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be2d9d700 1 -- 172.21.15.88:0/2467880768 reap_dead start 2020-02-11T16:19:40.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be2d9d700 1 -- 172.21.15.88:0/2467880768 reap_dead start 2020-02-11T16:19:40.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be8964700 1 -- 172.21.15.88:0/2467880768 shutdown_connections 2020-02-11T16:19:40.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be8964700 1 -- 172.21.15.88:0/2467880768 >> 172.21.15.88:0/2467880768 conn(0x7f7be409d110 msgr2=0x7f7be409d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:40.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.227+0000 7f7be8964700 1 -- 172.21.15.88:0/2467880768 shutdown_connections 2020-02-11T16:19:40.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.228+0000 7f7be8964700 1 -- 172.21.15.88:0/2467880768 wait complete. 2020-02-11T16:19:40.241 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:19:40.241 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:19:40.241 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:19:40.241 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:19:40.242 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 114, 2020-02-11T16:19:40.242 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:19:40.242 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:19:40.242 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:19:40.242 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:19:40.242 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.242 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:19:40.243 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:40.243 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:19:40.243 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:19:40.244 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:40.244 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:40.244 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:40.244 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:40.244 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:40.244 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:40.244 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.245 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:19:40.245 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:19:40.245 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:40.245 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:40.245 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:40.245 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:40.246 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:40.246 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:40.246 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.246 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:19:40.246 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:19:40.246 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:19:40.247 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:19:40.247 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:19:40.247 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:19:40.247 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:40.247 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:40.247 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:19:40.247 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:19:40.248 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:40.248 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:19:40.248 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:40.248 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:40.248 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:40.248 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:40.248 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:40.249 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:40.249 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.249 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:19:40.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.249 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:19:40.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:19:40.251 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.251 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:40.251 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:19:40.251 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.251 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.251 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.252 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:19:40.252 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:19:40.252 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:40.252 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:40.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.253 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:19:40.253 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:19:40.253 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:40.253 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:40.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.254 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:40.254 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:19:40.254 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.254 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:40.255 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:19:40.255 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.255 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.255 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.256 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:19:40.256 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:19:40.256 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:40.256 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:40.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.257 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:40.257 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:40.257 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:40.257 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:40.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.257 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:40.258 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:19:40.258 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.258 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:40.258 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:19:40.259 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.259 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.259 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.259 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:19:40.259 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:19:40.259 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:40.259 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:40.260 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.260 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.260 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:19:40.260 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:19:40.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.260 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.261 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.261 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:40.261 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.261 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.261 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:19:40.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.262 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.262 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.262 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:40.262 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.262 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.262 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.263 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:19:40.265 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:19:40.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.372+0000 7f8a1d220700 1 Processor -- start 2020-02-11T16:19:40.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.372+0000 7f8a1d220700 1 -- start start 2020-02-11T16:19:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a1d220700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a180a18a0 0x7f8a180a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a1d220700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8a180a5de0 0x7f8a180a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a1d220700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a180a31b0 con 0x7f8a1812e3a0 2020-02-11T16:19:40.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a1d220700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a180a3570 con 0x7f8a180a5de0 2020-02-11T16:19:40.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a1d220700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a180a3810 con 0x7f8a180a18a0 2020-02-11T16:19:40.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a16d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a180a18a0 0x7f8a180a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a16d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a180a18a0 0x7f8a180a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57158/0 (socket says 172.21.15.88:57158) 2020-02-11T16:19:40.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a16d9d700 1 -- 172.21.15.88:0/1952795733 learned_addr learned my addr 172.21.15.88:0/1952795733 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a16d9d700 1 -- 172.21.15.88:0/1952795733 >> v2:172.21.15.52:3300/0 conn(0x7f8a180a5de0 msgr2=0x7f8a180a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a1659c700 1 --2- 172.21.15.88:0/1952795733 >> v2:172.21.15.52:3300/0 conn(0x7f8a180a5de0 0x7f8a180a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/1952795733 >> v2:172.21.15.52:3300/0 conn(0x7f8a180a5de0 0x7f8a180a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a16d9d700 1 -- 172.21.15.88:0/1952795733 >> v1:172.21.15.52:6789/0 conn(0x7f8a1812e3a0 legacy=0x7f8a1812e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a16d9d700 1 -- 172.21.15.88:0/1952795733 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a180a3ab0 con 0x7f8a180a18a0 2020-02-11T16:19:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/1952795733 >> v2:172.21.15.88:3300/0 conn(0x7f8a180a18a0 0x7f8a180a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.373+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/1952795733 >> v2:172.21.15.88:3300/0 conn(0x7f8a180a18a0 0x7f8a180a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/1952795733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a18a0 0x7f8a180a6dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).ready entity=mon.1 client_cookie=4d535a1501321efc server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/1952795733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a18a0 0x7f8a180a6dd0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/1952795733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a18a0 0x7f8a180a6dd0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a15d9b700 1 -- 172.21.15.88:0/1952795733 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0c0116e0 con 0x7f8a180a18a0 2020-02-11T16:19:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/1952795733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a18a0 0x7f8a180a6dd0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a15d9b700 1 -- 172.21.15.88:0/1952795733 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c011840 con 0x7f8a180a18a0 2020-02-11T16:19:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a15d9b700 1 -- 172.21.15.88:0/1952795733 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0c011c20 con 0x7f8a180a18a0 2020-02-11T16:19:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a1d220700 1 -- 172.21.15.88:0/1952795733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a18a0 msgr2=0x7f8a180a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a1d220700 1 --2- 172.21.15.88:0/1952795733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a18a0 0x7f8a180a6dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).stop 2020-02-11T16:19:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a1d220700 1 -- 172.21.15.88:0/1952795733 shutdown_connections 2020-02-11T16:19:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a1d220700 1 --2- 172.21.15.88:0/1952795733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a18a0 0x7f8a180a6dd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a1d220700 1 --2- 172.21.15.88:0/1952795733 >> v2:172.21.15.52:3300/0 conn(0x7f8a180a5de0 0x7f8a180a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a1d220700 1 -- 172.21.15.88:0/1952795733 >> 172.21.15.88:0/1952795733 conn(0x7f8a1809d110 msgr2=0x7f8a1809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a1d220700 1 -- 172.21.15.88:0/1952795733 shutdown_connections 2020-02-11T16:19:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.374+0000 7f8a1d220700 1 -- 172.21.15.88:0/1952795733 wait complete. 2020-02-11T16:19:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.375+0000 7f8a1d220700 1 Processor -- start 2020-02-11T16:19:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.375+0000 7f8a1d220700 1 -- start start 2020-02-11T16:19:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1d220700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a180a18a0 0x7f8a1809dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1d220700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a180a5de0 0x7f8a18135210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1d220700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8a1812e3a0 0x7f8a1812a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1d220700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a180a08e0 con 0x7f8a1812e3a0 2020-02-11T16:19:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1d220700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a180a0b80 con 0x7f8a180a5de0 2020-02-11T16:19:40.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1d220700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a18135670 con 0x7f8a180a18a0 2020-02-11T16:19:40.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a180a5de0 0x7f8a18135210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a180a5de0 0x7f8a18135210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57164/0 (socket says 172.21.15.88:57164) 2020-02-11T16:19:40.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 -- 172.21.15.88:0/3228399016 learned_addr learned my addr 172.21.15.88:0/3228399016 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:40.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a180a18a0 0x7f8a1809dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1759e700 1 --2- 172.21.15.88:0/3228399016 >> v2:172.21.15.52:3300/0 conn(0x7f8a1812e3a0 0x7f8a1812a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 -- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a180a18a0 msgr2=0x7f8a1809dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a180a18a0 0x7f8a1809dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 -- 172.21.15.88:0/3228399016 >> v2:172.21.15.52:3300/0 conn(0x7f8a1812e3a0 msgr2=0x7f8a1812a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 --2- 172.21.15.88:0/3228399016 >> v2:172.21.15.52:3300/0 conn(0x7f8a1812e3a0 0x7f8a1812a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 -- 172.21.15.88:0/3228399016 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a18142a90 con 0x7f8a180a5de0 2020-02-11T16:19:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a180a18a0 0x7f8a1809dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:19:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 --2- 172.21.15.88:0/3228399016 >> v2:172.21.15.88:3300/0 conn(0x7f8a180a5de0 0x7f8a18135210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a08002f30 tx=0x7f8a08010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 --2- 172.21.15.88:0/3228399016 >> v2:172.21.15.88:3300/0 conn(0x7f8a180a5de0 0x7f8a18135210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a08002f30 tx=0x7f8a08010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a5de0 0x7f8a18135210 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f8a08002f30 tx=0x7f8a08010b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a5de0 0x7f8a18135210 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f8a08002f30 tx=0x7f8a08010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a5de0 0x7f8a18135210 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f8a08002f30 tx=0x7f8a08010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a080123c0 con 0x7f8a180a5de0 2020-02-11T16:19:40.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1659c700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a5de0 0x7f8a18135210 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f8a08002f30 tx=0x7f8a08010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a08012560 con 0x7f8a180a5de0 2020-02-11T16:19:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1d220700 1 -- 172.21.15.88:0/3228399016 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1812aba0 con 0x7f8a180a5de0 2020-02-11T16:19:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a08012980 con 0x7f8a180a5de0 2020-02-11T16:19:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.376+0000 7f8a1d220700 1 -- 172.21.15.88:0/3228399016 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1809ec00 con 0x7f8a180a5de0 2020-02-11T16:19:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.377+0000 7f8a1659c700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a5de0 0x7f8a18135210 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f8a08002f30 tx=0x7f8a08010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.377+0000 7f8a1d220700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 0x7f8a18133950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.377+0000 7f8a1d220700 1 -- 172.21.15.88:0/3228399016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a18141e70 con 0x7f8a180a4990 2020-02-11T16:19:40.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.377+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8a08012bf0 con 0x7f8a180a5de0 2020-02-11T16:19:40.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.377+0000 7f8a1659c700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a5de0 0x7f8a18135210 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f8a08002f30 tx=0x7f8a08010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.377+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 0x7f8a18133950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.377+0000 7f8a07fff700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f89f4039d80 0x7f89f403c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.377+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8a080498f0 con 0x7f8a180a5de0 2020-02-11T16:19:40.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a1759e700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f89f4039d80 0x7f89f403c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a16d9d700 1 -- 172.21.15.88:0/3228399016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a180565b0 con 0x7f8a180a4990 2020-02-11T16:19:40.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 0x7f8a18133950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 0x7f8a18133950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 0x7f8a18133950 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a1759e700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f89f4039d80 0x7f89f403c240 crc :-1 s=READY pgs=351 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 0x7f8a18133950 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0c011cd0 con 0x7f8a180a4990 2020-02-11T16:19:40.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 0x7f8a18133950 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8a0c007340 con 0x7f8a180a4990 2020-02-11T16:19:40.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 msgr2=0x7f8a18133950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a07fff700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 0x7f8a18133950 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).stop 2020-02-11T16:19:40.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 msgr2=0x7f8a18133950 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:40.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.378+0000 7f8a07fff700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4990 0x7f8a18133950 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).stop 2020-02-11T16:19:40.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.386+0000 7f8a1d220700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 0x7f8a18133db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.386+0000 7f8a1d220700 1 -- 172.21.15.88:0/3228399016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1805e2f0 con 0x7f8a180a4da0 2020-02-11T16:19:40.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.386+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 0x7f8a18133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a16d9d700 1 -- 172.21.15.88:0/3228399016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8a181357e0 con 0x7f8a180a4da0 2020-02-11T16:19:40.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 0x7f8a18133db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.416 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 0x7f8a18133db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 0x7f8a18133db0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 0x7f8a18133db0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0c00e8d0 con 0x7f8a180a4da0 2020-02-11T16:19:40.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a16d9d700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 0x7f8a18133db0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4192 (secure 0 0 0) 0x7f8a0c00ea30 con 0x7f8a180a4da0 2020-02-11T16:19:40.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 msgr2=0x7f8a18133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a07fff700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 0x7f8a18133db0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).stop 2020-02-11T16:19:40.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a07fff700 1 -- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 msgr2=0x7f8a18133db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:40.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.387+0000 7f8a07fff700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a180a4da0 0x7f8a18133db0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0x7f8a1805bbc0 tx=0x7f8a0c007a40).stop 2020-02-11T16:19:40.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1d220700 1 -- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f89f4039d80 msgr2=0x7f89f403c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1d220700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f89f4039d80 0x7f89f403c240 crc :-1 s=READY pgs=351 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1d220700 1 -- 172.21.15.88:0/3228399016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a5de0 msgr2=0x7f8a18135210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1d220700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a5de0 0x7f8a18135210 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f8a08002f30 tx=0x7f8a08010b30).stop 2020-02-11T16:19:40.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1759e700 1 -- 172.21.15.88:0/3228399016 reap_dead start 2020-02-11T16:19:40.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1759e700 1 -- 172.21.15.88:0/3228399016 reap_dead start 2020-02-11T16:19:40.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1d220700 1 -- 172.21.15.88:0/3228399016 shutdown_connections 2020-02-11T16:19:40.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1d220700 1 --2- 172.21.15.88:0/3228399016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a180a5de0 0x7f8a18135210 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1d220700 1 -- 172.21.15.88:0/3228399016 >> 172.21.15.88:0/3228399016 conn(0x7f8a1809d110 msgr2=0x7f8a180a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:40.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1d220700 1 -- 172.21.15.88:0/3228399016 shutdown_connections 2020-02-11T16:19:40.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.388+0000 7f8a1d220700 1 -- 172.21.15.88:0/3228399016 wait complete. 2020-02-11T16:19:40.423 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:19:40.423 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:40.423 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:40.423 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:19:40.424 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 114, 2020-02-11T16:19:40.424 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:19:40.424 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:19:40.424 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:19:40.424 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:19:40.424 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.424 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:19:40.425 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:40.425 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:19:40.425 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:19:40.425 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:40.425 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:40.425 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:40.425 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:40.426 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:40.426 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:40.426 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.426 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:19:40.426 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:19:40.426 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:40.426 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:40.427 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:40.427 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:40.427 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:40.427 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:40.427 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.427 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:19:40.428 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:19:40.428 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:19:40.428 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:19:40.428 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:19:40.428 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:19:40.428 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:40.428 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:40.428 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:19:40.429 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:19:40.429 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:40.429 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:19:40.429 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:40.429 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:40.429 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:40.429 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:40.430 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:40.430 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:40.430 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.430 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:19:40.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.430 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:19:40.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.431 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:40.431 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:40.431 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:40.432 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:40.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.432 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:40.432 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:19:40.432 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.433 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:40.433 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:19:40.433 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.433 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.433 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.434 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:19:40.434 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:19:40.434 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:40.434 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:40.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.435 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:19:40.435 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:19:40.435 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:40.435 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:40.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.435 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:40.436 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:19:40.436 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:19:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.437 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:19:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:19:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:19:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:19:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.440 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:19:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:19:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:40.441 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:19:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:19:40.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:19:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:19:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:19:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:19:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.445 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.446 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.446 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:19:40.450 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:19:40.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.553+0000 7f5f0e7fa700 1 Processor -- start 2020-02-11T16:19:40.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.554+0000 7f5f0e7fa700 1 -- start start 2020-02-11T16:19:40.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.554+0000 7f5f0e7fa700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f080a18a0 0x7f5f080a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.554+0000 7f5f0e7fa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f080a6260 0x7f5f0812eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.554+0000 7f5f0e7fa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f080a3570 con 0x7f5f080a5de0 2020-02-11T16:19:40.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.554+0000 7f5f0e7fa700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f080a3810 con 0x7f5f080a18a0 2020-02-11T16:19:40.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.554+0000 7f5f0e7fa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f080a3ab0 con 0x7f5f080a6260 2020-02-11T16:19:40.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.554+0000 7f5f0cd97700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f080a6260 0x7f5f0812eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.554+0000 7f5f0cd97700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f080a6260 0x7f5f0812eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57178/0 (socket says 172.21.15.88:57178) 2020-02-11T16:19:40.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.554+0000 7f5f0cd97700 1 -- 172.21.15.88:0/145635823 learned_addr learned my addr 172.21.15.88:0/145635823 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f07fff700 1 --2- 172.21.15.88:0/145635823 >> v2:172.21.15.52:3300/0 conn(0x7f5f080a18a0 0x7f5f080a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0cd97700 1 -- 172.21.15.88:0/145635823 >> v2:172.21.15.52:3300/0 conn(0x7f5f080a18a0 msgr2=0x7f5f080a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/145635823 >> v2:172.21.15.52:3300/0 conn(0x7f5f080a18a0 0x7f5f080a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0cd97700 1 -- 172.21.15.88:0/145635823 >> v1:172.21.15.52:6789/0 conn(0x7f5f080a5de0 legacy=0x7f5f0812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0cd97700 1 -- 172.21.15.88:0/145635823 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f080a3d50 con 0x7f5f080a6260 2020-02-11T16:19:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f07fff700 1 --2- 172.21.15.88:0/145635823 >> v2:172.21.15.52:3300/0 conn(0x7f5f080a18a0 0x7f5f080a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:19:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/145635823 >> v2:172.21.15.88:3300/0 conn(0x7f5f080a6260 0x7f5f0812eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f0805bbc0 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/145635823 >> v2:172.21.15.88:3300/0 conn(0x7f5f080a6260 0x7f5f0812eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f0805bbc0 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/145635823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f080a6260 0x7f5f0812eab0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f5f0805bbc0 tx=0x7f5f00007dc0).ready entity=mon.1 client_cookie=272a058dd2fdaedf server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/145635823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f080a6260 0x7f5f0812eab0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5f0805bbc0 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f06ffd700 1 -- 172.21.15.88:0/145635823 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0000a160 con 0x7f5f080a6260 2020-02-11T16:19:40.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/145635823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f080a6260 0x7f5f0812eab0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5f0805bbc0 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.576 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/145635823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f080a6260 0x7f5f0812eab0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5f0805bbc0 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f06ffd700 1 -- 172.21.15.88:0/145635823 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0000a2c0 con 0x7f5f080a6260 2020-02-11T16:19:40.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f06ffd700 1 -- 172.21.15.88:0/145635823 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0000a6a0 con 0x7f5f080a6260 2020-02-11T16:19:40.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/145635823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f080a6260 msgr2=0x7f5f0812eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0e7fa700 1 --2- 172.21.15.88:0/145635823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f080a6260 0x7f5f0812eab0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f5f0805bbc0 tx=0x7f5f00007dc0).stop 2020-02-11T16:19:40.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/145635823 shutdown_connections 2020-02-11T16:19:40.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0e7fa700 1 --2- 172.21.15.88:0/145635823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f080a6260 0x7f5f0812eab0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0e7fa700 1 --2- 172.21.15.88:0/145635823 >> v2:172.21.15.52:3300/0 conn(0x7f5f080a18a0 0x7f5f080a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:40.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/145635823 >> 172.21.15.88:0/145635823 conn(0x7f5f0809d110 msgr2=0x7f5f0809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:40.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/145635823 shutdown_connections 2020-02-11T16:19:40.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.555+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/145635823 wait complete. 2020-02-11T16:19:40.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.556+0000 7f5f0e7fa700 1 Processor -- start 2020-02-11T16:19:40.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.556+0000 7f5f0e7fa700 1 -- start start 2020-02-11T16:19:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f0e7fa700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f080a5de0 0x7f5f0809f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f0e7fa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f08141950 con 0x7f5f080a6260 2020-02-11T16:19:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f0e7fa700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f08130630 con 0x7f5f080a18a0 2020-02-11T16:19:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f0e7fa700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f081308d0 con 0x7f5f080a5de0 2020-02-11T16:19:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f07fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5f080a18a0 0x7f5f08140ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44806/0 (socket says 172.21.15.88:44806) 2020-02-11T16:19:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f07fff700 1 -- 172.21.15.88:0/3113514537 learned_addr learned my addr 172.21.15.88:0/3113514537 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f077fe700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f080a5de0 0x7f5f0809f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381836000 0 0) 0x7f5f08130630 con 0x7f5f080a18a0 2020-02-11T16:19:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee8002fe0 con 0x7f5f080a18a0 2020-02-11T16:19:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243986460 0 0) 0x7f5f08141950 con 0x7f5f080a6260 2020-02-11T16:19:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f08130630 con 0x7f5f080a6260 2020-02-11T16:19:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.557+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1471829972 0 0) 0x7f5ee8002fe0 con 0x7f5f080a18a0 2020-02-11T16:19:40.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5f08141950 con 0x7f5f080a18a0 2020-02-11T16:19:40.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f5ef80026d0 con 0x7f5f080a18a0 2020-02-11T16:19:40.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f080a5de0 msgr2=0x7f5f0809f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f080a5de0 0x7f5f0809f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 >> v1:172.21.15.88:6789/0 conn(0x7f5f080a18a0 legacy=0x7f5f08140ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 >> v1:172.21.15.52:6789/0 conn(0x7f5f080a6260 legacy=0x7f5f08130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ee8004b20 0x7f5ee8004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee8003800 0x7f5ee8003c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f081308d0 con 0x7f5ee8004b20 2020-02-11T16:19:40.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8004670 con 0x7f5ee80040e0 2020-02-11T16:19:40.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee800bbe0 con 0x7f5ee8003800 2020-02-11T16:19:40.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f077fe700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f080a5de0 0x7f5f0809f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:40.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ee8004b20 0x7f5ee8004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f077fe700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee8003800 0x7f5ee8003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 -- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee8003800 msgr2=0x7f5ee8003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee8003800 0x7f5ee8003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 -- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ee8004b20 msgr2=0x7f5ee8004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ee8004b20 0x7f5ee8004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 -- 172.21.15.88:0/3113514537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08132270 con 0x7f5ee80040e0 2020-02-11T16:19:40.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/3113514537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f08136690 con 0x7f5ee80040e0 2020-02-11T16:19:40.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f077fe700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee8003800 0x7f5ee8003c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:19:40.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f00010640 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/3113514537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f08136940 con 0x7f5ee80040e0 2020-02-11T16:19:40.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f00010640 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f5f00010640 tx=0x7f5f00007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5f00010640 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f00005e40 con 0x7f5ee80040e0 2020-02-11T16:19:40.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5f00010640 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5f00010640 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f00007160 con 0x7f5ee80040e0 2020-02-11T16:19:40.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.558+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f00007580 con 0x7f5ee80040e0 2020-02-11T16:19:40.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5f00010640 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f0e7fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 0x7f5ee40058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/3113514537 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee4005ea0 con 0x7f5ee4003420 2020-02-11T16:19:40.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5f000076e0 con 0x7f5ee80040e0 2020-02-11T16:19:40.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f0cd97700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5f00010640 tx=0x7f5f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 0x7f5ee40058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f057fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ee8042700 0x7f5ee8044bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5f0004c2d0 con 0x7f5ee80040e0 2020-02-11T16:19:40.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f07fff700 1 -- 172.21.15.88:0/3113514537 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ee4006060 con 0x7f5ee4003420 2020-02-11T16:19:40.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 0x7f5ee40058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f077fe700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ee8042700 0x7f5ee8044bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 0x7f5ee40058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.559+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 0x7f5ee40058e0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.560+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 0x7f5ee40058e0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.560+0000 7f5f077fe700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ee8042700 0x7f5ee8044bc0 crc :-1 s=READY pgs=352 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.560+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ef8007160 con 0x7f5ee4003420 2020-02-11T16:19:40.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.560+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 0x7f5ee40058e0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.560+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5ef80072c0 con 0x7f5ee4003420 2020-02-11T16:19:40.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.560+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 msgr2=0x7f5ee40058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.560+0000 7f5f057fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 0x7f5ee40058e0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).stop 2020-02-11T16:19:40.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.560+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 msgr2=0x7f5ee40058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:40.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.560+0000 7f5f0cd97700 1 -- 172.21.15.88:0/3113514537 reap_dead start 2020-02-11T16:19:40.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.560+0000 7f5f057fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4003420 0x7f5ee40058e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.568+0000 7f5f0e7fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 0x7f5ee40068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.568+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/3113514537 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee4006dd0 con 0x7f5ee4006440 2020-02-11T16:19:40.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.568+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 0x7f5ee40068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.568+0000 7f5f07fff700 1 -- 172.21.15.88:0/3113514537 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5ee4006f90 con 0x7f5ee4006440 2020-02-11T16:19:40.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.568+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 0x7f5ee40068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 0x7f5ee40068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 0x7f5ee40068f0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 0x7f5ee40068f0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ef8005e80 con 0x7f5ee4006440 2020-02-11T16:19:40.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f07fff700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 0x7f5ee40068f0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f5ef8007bc0 con 0x7f5ee4006440 2020-02-11T16:19:40.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 msgr2=0x7f5ee40068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f057fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 0x7f5ee40068f0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).stop 2020-02-11T16:19:40.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f057fa700 1 -- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 msgr2=0x7f5ee40068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:40.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f057fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 0x7f5ee40068f0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0x7f5ef80024a0 tx=0x7f5ef80116d0).stop 2020-02-11T16:19:40.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ee8042700 msgr2=0x7f5ee8044bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f0e7fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ee8042700 0x7f5ee8044bc0 crc :-1 s=READY pgs=352 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 msgr2=0x7f5ee800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f0e7fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f5f00010640 tx=0x7f5f00007dc0).stop 2020-02-11T16:19:40.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.569+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/3113514537 shutdown_connections 2020-02-11T16:19:40.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.570+0000 7f5f0e7fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5ee8042700 0x7f5ee8044bc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.570+0000 7f5f0e7fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ee80040e0 0x7f5ee800b750 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.570+0000 7f5f0e7fa700 1 --2- 172.21.15.88:0/3113514537 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5ee4006440 0x7f5ee40068f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.570+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/3113514537 >> 172.21.15.88:0/3113514537 conn(0x7f5f0809d110 msgr2=0x7f5f080a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:40.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.570+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/3113514537 shutdown_connections 2020-02-11T16:19:40.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.570+0000 7f5f0e7fa700 1 -- 172.21.15.88:0/3113514537 wait complete. 2020-02-11T16:19:40.595 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:19:40.595 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:40.595 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:40.596 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:19:40.596 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 114, 2020-02-11T16:19:40.596 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:19:40.596 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:19:40.596 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:19:40.596 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:19:40.596 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.597 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:19:40.597 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:40.597 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:19:40.597 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:19:40.597 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:40.597 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:40.598 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:40.598 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:40.598 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:40.598 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:40.598 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.598 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:19:40.599 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:19:40.599 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:40.599 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:40.599 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:40.599 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:40.599 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:40.599 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:40.600 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.600 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:19:40.600 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:19:40.600 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:19:40.600 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:19:40.600 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:19:40.601 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:19:40.601 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:40.601 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:40.601 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:19:40.602 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:19:40.602 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:40.602 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:19:40.602 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:40.602 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:40.602 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:40.602 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:40.603 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:40.603 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:40.603 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.603 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:19:40.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.603 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:19:40.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.604 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:40.604 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:40.604 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:40.604 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:40.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:19:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:19:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:19:40.607 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:19:40.607 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:40.607 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:40.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.607 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:19:40.608 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:19:40.608 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:40.608 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:40.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.609 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:40.609 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:19:40.609 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.610 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:40.610 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:19:40.610 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.610 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.610 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.610 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:19:40.611 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:19:40.611 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:40.611 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:40.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.612 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:40.612 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:40.612 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:40.612 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:40.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.612 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:40.612 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:19:40.613 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.613 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:40.613 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:19:40.613 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:40.614 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.614 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.614 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:19:40.614 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:19:40.614 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:40.615 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:40.615 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.615 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:40.615 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:19:40.615 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:19:40.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.616 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.616 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.616 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:40.616 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.617 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.617 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:19:40.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.617 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.617 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.617 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:40.617 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.618 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.618 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:19:40.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.618 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.618 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.618 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:19:40.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.619 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.619 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:19:40.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.620 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.620 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.620 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:19:40.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.620 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:40.620 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:19:40.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:40.621 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:40.621 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:40.621 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:40.621 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.622 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:40.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:40.622 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:19:40.624 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:19:40.624 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:19:40.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.726+0000 7fdd7969f700 1 Processor -- start 2020-02-11T16:19:40.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.726+0000 7fdd7969f700 1 -- start start 2020-02-11T16:19:40.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.727+0000 7fdd7969f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd740a5b20 0x7fdd740a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.727+0000 7fdd7969f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd74131280 0x7fdd741316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.727+0000 7fdd7969f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd740a4350 con 0x7fdd740a2fa0 2020-02-11T16:19:40.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.727+0000 7fdd7969f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd740a1e60 con 0x7fdd740a5b20 2020-02-11T16:19:40.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.727+0000 7fdd7969f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740a3450 con 0x7fdd74131280 2020-02-11T16:19:40.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.727+0000 7fdd72ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdd740a2fa0 0x7fdd740a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44824/0 (socket says 172.21.15.88:44824) 2020-02-11T16:19:40.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.727+0000 7fdd72ffd700 1 -- 172.21.15.88:0/1513854154 learned_addr learned my addr 172.21.15.88:0/1513854154 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:40.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.727+0000 7fdd737fe700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd74131280 0x7fdd741316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd727fc700 1 --2- 172.21.15.88:0/1513854154 >> v2:172.21.15.52:3300/0 conn(0x7fdd740a5b20 0x7fdd740a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290137203 0 0) 0x7fdd740a4350 con 0x7fdd740a2fa0 2020-02-11T16:19:40.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd54003230 con 0x7fdd740a2fa0 2020-02-11T16:19:40.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2239758142 0 0) 0x7fdd54003230 con 0x7fdd740a2fa0 2020-02-11T16:19:40.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd74131280 msgr2=0x7fdd741316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:40.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd74131280 0x7fdd741316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:40.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 >> v2:172.21.15.52:3300/0 conn(0x7fdd740a5b20 msgr2=0x7fdd740a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:40.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 --2- 172.21.15.88:0/1513854154 >> v2:172.21.15.52:3300/0 conn(0x7fdd740a5b20 0x7fdd740a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:40.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740a3a40 con 0x7fdd740a2fa0 2020-02-11T16:19:40.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fdd5c0016d0 con 0x7fdd740a2fa0 2020-02-11T16:19:40.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 >> v1:172.21.15.88:6789/0 conn(0x7fdd740a2fa0 legacy=0x7fdd740a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd74131280 0x7fdd54003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd54003bb0 0x7fdd54004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd540045e0 0x7fdd54004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:40.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740a1e60 con 0x7fdd540045e0 2020-02-11T16:19:40.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54005010 con 0x7fdd54003bb0 2020-02-11T16:19:40.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540051d0 con 0x7fdd74131280 2020-02-11T16:19:40.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd727fc700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd54003bb0 0x7fdd54004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd74131280 0x7fdd54003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd737fe700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd540045e0 0x7fdd54004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd727fc700 1 -- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd74131280 msgr2=0x7fdd54003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:40.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd727fc700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdd74131280 0x7fdd54003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:40.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd727fc700 1 -- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd540045e0 msgr2=0x7fdd54004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:40.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd727fc700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd540045e0 0x7fdd54004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:40.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd727fc700 1 -- 172.21.15.88:0/1513854154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54003230 con 0x7fdd54003bb0 2020-02-11T16:19:40.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd727fc700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd54003bb0 0x7fdd54004010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd64008910 tx=0x7fdd64010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd727fc700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd54003bb0 0x7fdd54004010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd64008910 tx=0x7fdd64010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.728+0000 7fdd727fc700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd54003bb0 0x7fdd54004010 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7fdd64008910 tx=0x7fdd64010050).ready entity=mon.1 client_cookie=66374d6f589de02d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd727fc700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd54003bb0 0x7fdd54004010 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fdd64008910 tx=0x7fdd64010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd64008d50 con 0x7fdd54003bb0 2020-02-11T16:19:40.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd727fc700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd54003bb0 0x7fdd54004010 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fdd64008910 tx=0x7fdd64010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd727fc700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd54003bb0 0x7fdd54004010 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fdd64008910 tx=0x7fdd64010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd64010890 con 0x7fdd54003bb0 2020-02-11T16:19:40.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd71ffb700 1 -- 172.21.15.88:0/1513854154 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd64010c30 con 0x7fdd54003bb0 2020-02-11T16:19:40.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd7969f700 1 -- 172.21.15.88:0/1513854154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd54003bb0 msgr2=0x7fdd54004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd7969f700 1 --2- 172.21.15.88:0/1513854154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd54003bb0 0x7fdd54004010 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7fdd64008910 tx=0x7fdd64010050).stop 2020-02-11T16:19:40.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd737fe700 1 -- 172.21.15.88:0/1513854154 reap_dead start 2020-02-11T16:19:40.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd7969f700 1 -- 172.21.15.88:0/1513854154 shutdown_connections 2020-02-11T16:19:40.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd7969f700 1 -- 172.21.15.88:0/1513854154 >> 172.21.15.88:0/1513854154 conn(0x7fdd7409d110 msgr2=0x7fdd7409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:40.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd7969f700 1 -- 172.21.15.88:0/1513854154 shutdown_connections 2020-02-11T16:19:40.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.729+0000 7fdd7969f700 1 -- 172.21.15.88:0/1513854154 wait complete. 2020-02-11T16:19:40.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.730+0000 7fdd7969f700 1 Processor -- start 2020-02-11T16:19:40.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.730+0000 7fdd7969f700 1 -- start start 2020-02-11T16:19:40.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd7969f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd740a05a0 0x7fdd74135290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd7969f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd74137400 0x7fdd74144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd7969f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd740616d0 con 0x7fdd7412ff10 2020-02-11T16:19:40.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd7969f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd740a4780 con 0x7fdd74137400 2020-02-11T16:19:40.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd7969f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd74145240 con 0x7fdd740a05a0 2020-02-11T16:19:40.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd740a05a0 0x7fdd74135290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd740a05a0 0x7fdd74135290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57206/0 (socket says 172.21.15.88:57206) 2020-02-11T16:19:40.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 -- 172.21.15.88:0/549385413 learned_addr learned my addr 172.21.15.88:0/549385413 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:40.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd727fc700 1 --2- 172.21.15.88:0/549385413 >> v2:172.21.15.52:3300/0 conn(0x7fdd74137400 0x7fdd74144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 -- 172.21.15.88:0/549385413 >> v2:172.21.15.52:3300/0 conn(0x7fdd74137400 msgr2=0x7fdd74144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> v2:172.21.15.52:3300/0 conn(0x7fdd74137400 0x7fdd74144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 -- 172.21.15.88:0/549385413 >> v1:172.21.15.88:6789/0 conn(0x7fdd7412ff10 legacy=0x7fdd741303c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd6bfff700 1 -- 172.21.15.88:0/549385413 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386826981 0 0) 0x7fdd740616d0 con 0x7fdd7412ff10 2020-02-11T16:19:40.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 -- 172.21.15.88:0/549385413 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740a7840 con 0x7fdd740a05a0 2020-02-11T16:19:40.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> v2:172.21.15.88:3300/0 conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> v2:172.21.15.88:3300/0 conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd6bfff700 1 -- 172.21.15.88:0/549385413 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5c00e530 con 0x7fdd740a05a0 2020-02-11T16:19:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd6bfff700 1 -- 172.21.15.88:0/549385413 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c00e690 con 0x7fdd740a05a0 2020-02-11T16:19:40.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd7969f700 1 -- 172.21.15.88:0/549385413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd74061900 con 0x7fdd740a05a0 2020-02-11T16:19:40.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd6bfff700 1 -- 172.21.15.88:0/549385413 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5c011ae0 con 0x7fdd740a05a0 2020-02-11T16:19:40.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.731+0000 7fdd7969f700 1 -- 172.21.15.88:0/549385413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd741446a0 con 0x7fdd740a05a0 2020-02-11T16:19:40.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.732+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.732+0000 7fdd6bfff700 1 -- 172.21.15.88:0/549385413 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdd5c011d50 con 0x7fdd740a05a0 2020-02-11T16:19:40.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.732+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.732+0000 7fdd7969f700 1 -- 172.21.15.88:0/549385413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd740565b0 con 0x7fdd740a05a0 2020-02-11T16:19:40.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.732+0000 7fdd6bfff700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd58039bb0 0x7fdd5803c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:40.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.732+0000 7fdd6bfff700 1 -- 172.21.15.88:0/549385413 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdd5c049770 con 0x7fdd740a05a0 2020-02-11T16:19:40.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.733+0000 7fdd727fc700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd58039bb0 0x7fdd5803c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:40.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.733+0000 7fdd727fc700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd58039bb0 0x7fdd5803c070 crc :-1 s=READY pgs=353 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:40.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.736+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.736+0000 7fdd6bfff700 1 -- 172.21.15.88:0/549385413 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fdd5c02ec20 con 0x7fdd740a05a0 2020-02-11T16:19:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.917+0000 7fdd7969f700 1 -- 172.21.15.88:0/549385413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fdd74144a90 con 0x7fdd740a05a0 2020-02-11T16:19:40.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.918+0000 7fdd72ffd700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:40.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.918+0000 7fdd6bfff700 1 -- 172.21.15.88:0/549385413 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fdd5c0070c0 con 0x7fdd740a05a0 2020-02-11T16:19:40.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 -- 172.21.15.88:0/549385413 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd58039bb0 msgr2=0x7fdd5803c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd58039bb0 0x7fdd5803c070 crc :-1 s=READY pgs=353 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 -- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 msgr2=0x7fdd74135290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 0x7fdd74135290 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fdd7405efb0 tx=0x7fdd740a4120).stop 2020-02-11T16:19:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 -- 172.21.15.88:0/549385413 shutdown_connections 2020-02-11T16:19:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd740a05a0 0x7fdd74135290 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 --2- 172.21.15.88:0/549385413 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd58039bb0 0x7fdd5803c070 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 --2- 172.21.15.88:0/549385413 >> v2:172.21.15.52:3300/0 conn(0x7fdd74137400 0x7fdd74144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:40.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 -- 172.21.15.88:0/549385413 >> 172.21.15.88:0/549385413 conn(0x7fdd7409d110 msgr2=0x7fdd74069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:40.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 -- 172.21.15.88:0/549385413 shutdown_connections 2020-02-11T16:19:40.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:40.920+0000 7fdd7969f700 1 -- 172.21.15.88:0/549385413 wait complete. 2020-02-11T16:19:40.933 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:19:44.204 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:19:44.207 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:19:50.934 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:19:50.934 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:19:51.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.048+0000 7fae29776700 1 Processor -- start 2020-02-11T16:19:51.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.048+0000 7fae29776700 1 -- start start 2020-02-11T16:19:51.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.048+0000 7fae29776700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae2405b1e0 0x7fae240a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:51.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.048+0000 7fae29776700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 0x7fae2412dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:51.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.048+0000 7fae29776700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae240a6840 con 0x7fae240a5c60 2020-02-11T16:19:51.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.048+0000 7fae29776700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae240a60f0 con 0x7fae2405b1e0 2020-02-11T16:19:51.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.048+0000 7fae29776700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae240a6300 con 0x7fae24134d10 2020-02-11T16:19:51.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae237fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fae240a5c60 0x7fae24134600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44840/0 (socket says 172.21.15.88:44840) 2020-02-11T16:19:51.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae237fe700 1 -- 172.21.15.88:0/139794494 learned_addr learned my addr 172.21.15.88:0/139794494 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:51.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae28f75700 1 --2- 172.21.15.88:0/139794494 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 0x7fae2412dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae23fff700 1 --2- 172.21.15.88:0/139794494 >> v2:172.21.15.52:3300/0 conn(0x7fae2405b1e0 0x7fae240a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae22ffd700 1 -- 172.21.15.88:0/139794494 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568343819 0 0) 0x7fae240a6840 con 0x7fae240a5c60 2020-02-11T16:19:51.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae22ffd700 1 -- 172.21.15.88:0/139794494 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae10003230 con 0x7fae240a5c60 2020-02-11T16:19:51.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae22ffd700 1 -- 172.21.15.88:0/139794494 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 863546225 0 0) 0x7fae10003230 con 0x7fae240a5c60 2020-02-11T16:19:51.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae28f75700 1 -- 172.21.15.88:0/139794494 >> v2:172.21.15.52:3300/0 conn(0x7fae2405b1e0 msgr2=0x7fae240a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:51.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae28f75700 1 --2- 172.21.15.88:0/139794494 >> v2:172.21.15.52:3300/0 conn(0x7fae2405b1e0 0x7fae240a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:51.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae28f75700 1 -- 172.21.15.88:0/139794494 >> v1:172.21.15.88:6789/0 conn(0x7fae240a5c60 legacy=0x7fae24134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae28f75700 1 -- 172.21.15.88:0/139794494 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae240a65a0 con 0x7fae24134d10 2020-02-11T16:19:51.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae23fff700 1 --2- 172.21.15.88:0/139794494 >> v2:172.21.15.52:3300/0 conn(0x7fae2405b1e0 0x7fae240a3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:51.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae28f75700 1 --2- 172.21.15.88:0/139794494 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 0x7fae2412dc10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae18001870 tx=0x7fae1c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae28f75700 1 --2- 172.21.15.88:0/139794494 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 0x7fae2412dc10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae18001870 tx=0x7fae1c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae28f75700 1 --2- 172.21.15.88:0/139794494 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 0x7fae2412dc10 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae1c008c60).ready entity=mon.2 client_cookie=1c8e8a56b1fee118 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae28f75700 1 --2- 172.21.15.88:0/139794494 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 0x7fae2412dc10 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae1c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.049+0000 7fae22ffd700 1 -- 172.21.15.88:0/139794494 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae180016d0 con 0x7fae24134d10 2020-02-11T16:19:51.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae28f75700 1 --2- 172.21.15.88:0/139794494 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 0x7fae2412dc10 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae1c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae22ffd700 1 -- 172.21.15.88:0/139794494 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c011a80 con 0x7fae24134d10 2020-02-11T16:19:51.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae28f75700 1 --2- 172.21.15.88:0/139794494 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 0x7fae2412dc10 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae1c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae22ffd700 1 -- 172.21.15.88:0/139794494 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1c011de0 con 0x7fae24134d10 2020-02-11T16:19:51.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae29776700 1 -- 172.21.15.88:0/139794494 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 msgr2=0x7fae2412dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae29776700 1 --2- 172.21.15.88:0/139794494 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 0x7fae2412dc10 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae1c008c60).stop 2020-02-11T16:19:51.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae29776700 1 -- 172.21.15.88:0/139794494 shutdown_connections 2020-02-11T16:19:51.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae29776700 1 --2- 172.21.15.88:0/139794494 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fae24134d10 0x7fae2412dc10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae29776700 1 --2- 172.21.15.88:0/139794494 >> v2:172.21.15.52:3300/0 conn(0x7fae2405b1e0 0x7fae240a3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:51.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae29776700 1 -- 172.21.15.88:0/139794494 >> 172.21.15.88:0/139794494 conn(0x7fae240a9f90 msgr2=0x7fae240aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:51.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae29776700 1 -- 172.21.15.88:0/139794494 shutdown_connections 2020-02-11T16:19:51.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.050+0000 7fae29776700 1 -- 172.21.15.88:0/139794494 wait complete. 2020-02-11T16:19:51.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.051+0000 7fae29776700 1 Processor -- start 2020-02-11T16:19:51.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.051+0000 7fae29776700 1 -- start start 2020-02-11T16:19:51.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae29776700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae24134d10 0x7fae2414d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae29776700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae241353f0 con 0x7fae2405b1e0 2020-02-11T16:19:51.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae29776700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae240a4b70 con 0x7fae240a5c60 2020-02-11T16:19:51.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae29776700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae24136170 con 0x7fae24134d10 2020-02-11T16:19:51.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae237fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fae240a5c60 0x7fae2412dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44848/0 (socket says 172.21.15.88:44848) 2020-02-11T16:19:51.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae237fe700 1 -- 172.21.15.88:0/217941954 learned_addr learned my addr 172.21.15.88:0/217941954 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:51.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> v2:172.21.15.88:3300/0 conn(0x7fae24134d10 0x7fae2414d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae28f75700 1 -- 172.21.15.88:0/217941954 >> v1:172.21.15.88:6789/0 conn(0x7fae240a5c60 legacy=0x7fae2412dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae28f75700 1 -- 172.21.15.88:0/217941954 >> v1:172.21.15.52:6789/0 conn(0x7fae2405b1e0 legacy=0x7fae24137f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae217fa700 1 -- 172.21.15.88:0/217941954 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571793339 0 0) 0x7fae240a4b70 con 0x7fae240a5c60 2020-02-11T16:19:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae28f75700 1 -- 172.21.15.88:0/217941954 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24137820 con 0x7fae24134d10 2020-02-11T16:19:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> v2:172.21.15.88:3300/0 conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> v2:172.21.15.88:3300/0 conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae217fa700 1 -- 172.21.15.88:0/217941954 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1c008ab0 con 0x7fae24134d10 2020-02-11T16:19:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae217fa700 1 -- 172.21.15.88:0/217941954 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c005a40 con 0x7fae24134d10 2020-02-11T16:19:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae217fa700 1 -- 172.21.15.88:0/217941954 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1c005de0 con 0x7fae24134d10 2020-02-11T16:19:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae29776700 1 -- 172.21.15.88:0/217941954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae24135620 con 0x7fae24134d10 2020-02-11T16:19:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.052+0000 7fae29776700 1 -- 172.21.15.88:0/217941954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae24137b60 con 0x7fae24134d10 2020-02-11T16:19:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.053+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.053+0000 7fae217fa700 1 -- 172.21.15.88:0/217941954 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fae1c007150 con 0x7fae24134d10 2020-02-11T16:19:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.053+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.053+0000 7fae29776700 1 -- 172.21.15.88:0/217941954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae241357b0 con 0x7fae24134d10 2020-02-11T16:19:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.054+0000 7fae217fa700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fae04039c80 0x7fae0403c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.054+0000 7fae217fa700 1 -- 172.21.15.88:0/217941954 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fae1c04a140 con 0x7fae24134d10 2020-02-11T16:19:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.054+0000 7fae23fff700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fae04039c80 0x7fae0403c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.054+0000 7fae23fff700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fae04039c80 0x7fae0403c140 crc :-1 s=READY pgs=354 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.057+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.057+0000 7fae217fa700 1 -- 172.21.15.88:0/217941954 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fae1c032670 con 0x7fae24134d10 2020-02-11T16:19:51.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.238+0000 7fae29776700 1 -- 172.21.15.88:0/217941954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fae240565b0 con 0x7fae24134d10 2020-02-11T16:19:51.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.238+0000 7fae28f75700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.239+0000 7fae217fa700 1 -- 172.21.15.88:0/217941954 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fae1c032230 con 0x7fae24134d10 2020-02-11T16:19:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.240+0000 7fae29776700 1 -- 172.21.15.88:0/217941954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fae04039c80 msgr2=0x7fae0403c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.240+0000 7fae29776700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fae04039c80 0x7fae0403c140 crc :-1 s=READY pgs=354 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.240+0000 7fae29776700 1 -- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 msgr2=0x7fae2414d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.240+0000 7fae29776700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 0x7fae2414d4f0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fae18001870 tx=0x7fae2405b5c0).stop 2020-02-11T16:19:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.240+0000 7fae29776700 1 -- 172.21.15.88:0/217941954 shutdown_connections 2020-02-11T16:19:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.240+0000 7fae29776700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fae04039c80 0x7fae0403c140 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.240+0000 7fae29776700 1 --2- 172.21.15.88:0/217941954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae24134d10 0x7fae2414d4f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.240+0000 7fae29776700 1 -- 172.21.15.88:0/217941954 >> 172.21.15.88:0/217941954 conn(0x7fae240a9f90 msgr2=0x7fae24069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:51.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.240+0000 7fae29776700 1 -- 172.21.15.88:0/217941954 shutdown_connections 2020-02-11T16:19:51.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.240+0000 7fae29776700 1 -- 172.21.15.88:0/217941954 wait complete. 2020-02-11T16:19:51.249 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:51.252 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":114,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:19:51.252 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:19:51.252 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:19:51.252 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:19:51.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.357+0000 7f52dd723700 1 Processor -- start 2020-02-11T16:19:51.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.357+0000 7f52dd723700 1 -- start start 2020-02-11T16:19:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52dd723700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52d80a5de0 0x7f52d80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52dd723700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f52d8134a50 0x7f52d8134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52dd723700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d80a31b0 con 0x7f52d80a18a0 2020-02-11T16:19:51.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52dd723700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80a3570 con 0x7f52d8134a50 2020-02-11T16:19:51.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52dd723700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80a3810 con 0x7f52d80a5de0 2020-02-11T16:19:51.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52d67fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52d80a5de0 0x7f52d80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52d67fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52d80a5de0 0x7f52d80a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57228/0 (socket says 172.21.15.88:57228) 2020-02-11T16:19:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52d67fc700 1 -- 172.21.15.88:0/878887549 learned_addr learned my addr 172.21.15.88:0/878887549 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52d77fe700 1 --2- 172.21.15.88:0/878887549 >> v2:172.21.15.52:3300/0 conn(0x7f52d8134a50 0x7f52d8134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52d67fc700 1 -- 172.21.15.88:0/878887549 >> v2:172.21.15.52:3300/0 conn(0x7f52d8134a50 msgr2=0x7f52d8134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52d67fc700 1 --2- 172.21.15.88:0/878887549 >> v2:172.21.15.52:3300/0 conn(0x7f52d8134a50 0x7f52d8134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:51.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52d67fc700 1 -- 172.21.15.88:0/878887549 >> v1:172.21.15.52:6789/0 conn(0x7f52d80a18a0 legacy=0x7f52d80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:51.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52d67fc700 1 -- 172.21.15.88:0/878887549 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80a3ab0 con 0x7f52d80a5de0 2020-02-11T16:19:51.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.358+0000 7f52d67fc700 1 --2- 172.21.15.88:0/878887549 >> v2:172.21.15.88:3300/0 conn(0x7f52d80a5de0 0x7f52d80a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52d805bbc0 tx=0x7f52c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52d67fc700 1 --2- 172.21.15.88:0/878887549 >> v2:172.21.15.88:3300/0 conn(0x7f52d80a5de0 0x7f52d80a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52d805bbc0 tx=0x7f52c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52d67fc700 1 --2- 172.21.15.88:0/878887549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80a5de0 0x7f52d80a6260 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f52d805bbc0 tx=0x7f52c8007a40).ready entity=mon.1 client_cookie=5be93a8eea637f36 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52d67fc700 1 --2- 172.21.15.88:0/878887549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80a5de0 0x7f52d80a6260 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f52d805bbc0 tx=0x7f52c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52d5ffb700 1 -- 172.21.15.88:0/878887549 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c80116e0 con 0x7f52d80a5de0 2020-02-11T16:19:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52d67fc700 1 --2- 172.21.15.88:0/878887549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80a5de0 0x7f52d80a6260 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f52d805bbc0 tx=0x7f52c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52d67fc700 1 --2- 172.21.15.88:0/878887549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80a5de0 0x7f52d80a6260 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f52d805bbc0 tx=0x7f52c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52d5ffb700 1 -- 172.21.15.88:0/878887549 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8011840 con 0x7f52d80a5de0 2020-02-11T16:19:51.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52d5ffb700 1 -- 172.21.15.88:0/878887549 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c8011c20 con 0x7f52d80a5de0 2020-02-11T16:19:51.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52dd723700 1 -- 172.21.15.88:0/878887549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80a5de0 msgr2=0x7f52d80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52dd723700 1 --2- 172.21.15.88:0/878887549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80a5de0 0x7f52d80a6260 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f52d805bbc0 tx=0x7f52c8007a40).stop 2020-02-11T16:19:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52dd723700 1 -- 172.21.15.88:0/878887549 shutdown_connections 2020-02-11T16:19:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52dd723700 1 --2- 172.21.15.88:0/878887549 >> v2:172.21.15.52:3300/0 conn(0x7f52d8134a50 0x7f52d8134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52dd723700 1 --2- 172.21.15.88:0/878887549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80a5de0 0x7f52d80a6260 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52dd723700 1 -- 172.21.15.88:0/878887549 >> 172.21.15.88:0/878887549 conn(0x7f52d809d110 msgr2=0x7f52d809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52dd723700 1 -- 172.21.15.88:0/878887549 shutdown_connections 2020-02-11T16:19:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.359+0000 7f52dd723700 1 -- 172.21.15.88:0/878887549 wait complete. 2020-02-11T16:19:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.360+0000 7f52dd723700 1 Processor -- start 2020-02-11T16:19:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.360+0000 7f52dd723700 1 -- start start 2020-02-11T16:19:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52dd723700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f52d80a18a0 0x7f52d812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52dd723700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52d8134a50 0x7f52d8065f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52dd723700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d8144fd0 con 0x7f52d80a5de0 2020-02-11T16:19:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52dd723700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d8066dd0 con 0x7f52d80a18a0 2020-02-11T16:19:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52dd723700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8067070 con 0x7f52d8134a50 2020-02-11T16:19:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52d67fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f52d80a5de0 0x7f52d8145760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44862/0 (socket says 172.21.15.88:44862) 2020-02-11T16:19:51.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52d67fc700 1 -- 172.21.15.88:0/2467480481 learned_addr learned my addr 172.21.15.88:0/2467480481 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:51.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52d77fe700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52d8134a50 0x7f52d8065f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> v2:172.21.15.52:3300/0 conn(0x7f52d80a18a0 0x7f52d812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095863227 0 0) 0x7f52d8144fd0 con 0x7f52d80a5de0 2020-02-11T16:19:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b4002fe0 con 0x7f52d80a5de0 2020-02-11T16:19:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1713296622 0 0) 0x7f52b4002fe0 con 0x7f52d80a5de0 2020-02-11T16:19:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52d8144fd0 con 0x7f52d80a5de0 2020-02-11T16:19:51.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f52c8011e90 con 0x7f52d80a5de0 2020-02-11T16:19:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52d8134a50 msgr2=0x7f52d8065f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52d8134a50 0x7f52d8065f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 >> v2:172.21.15.52:3300/0 conn(0x7f52d80a18a0 msgr2=0x7f52d812d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 --2- 172.21.15.88:0/2467480481 >> v2:172.21.15.52:3300/0 conn(0x7f52d80a18a0 0x7f52d812d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 >> v1:172.21.15.88:6789/0 conn(0x7f52d80a5de0 legacy=0x7f52d8145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b40049b0 0x7f52b4004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52b4004200 0x7f52b400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8066dd0 con 0x7f52b4004200 2020-02-11T16:19:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8067070 con 0x7f52b4003920 2020-02-11T16:19:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b4004670 con 0x7f52b40049b0 2020-02-11T16:19:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52d77fe700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52d8134a50 0x7f52d8065f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:51.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.361+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> v2:172.21.15.52:3300/0 conn(0x7f52d80a18a0 0x7f52d812d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d77fe700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52b4004200 0x7f52b400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b40049b0 0x7f52b4004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 -- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b40049b0 msgr2=0x7f52b4004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b40049b0 0x7f52b4004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 -- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52b4004200 msgr2=0x7f52b400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52b4004200 0x7f52b400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 -- 172.21.15.88:0/2467480481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d8145e70 con 0x7f52b4003920 2020-02-11T16:19:51.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b40049b0 0x7f52b4004df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:19:51.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52dd723700 1 -- 172.21.15.88:0/2467480481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d80669a0 con 0x7f52b4003920 2020-02-11T16:19:51.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52c8008320 tx=0x7f52c8008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52dd723700 1 -- 172.21.15.88:0/2467480481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d812d690 con 0x7f52b4003920 2020-02-11T16:19:51.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52c8008320 tx=0x7f52c8008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f52c8008320 tx=0x7f52c8008fa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f52c8008320 tx=0x7f52c8008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c800ae20 con 0x7f52b4003920 2020-02-11T16:19:51.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f52c8008320 tx=0x7f52c8008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f52c8008320 tx=0x7f52c8008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c80056c0 con 0x7f52b4003920 2020-02-11T16:19:51.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c8005aa0 con 0x7f52b4003920 2020-02-11T16:19:51.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.362+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f52c8008320 tx=0x7f52c8008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52dd723700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 0x7f52b80058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52dd723700 1 -- 172.21.15.88:0/2467480481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8005ea0 con 0x7f52b8003420 2020-02-11T16:19:51.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 0x7f52b80058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f52c8005c00 con 0x7f52b4003920 2020-02-11T16:19:51.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d67fc700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f52c8008320 tx=0x7f52c8008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d6ffd700 1 -- 172.21.15.88:0/2467480481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52b8006060 con 0x7f52b8003420 2020-02-11T16:19:51.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 0x7f52b80058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52c7fff700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f52b4042390 0x7f52b4044850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 0x7f52b80058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f52c804aca0 con 0x7f52b4003920 2020-02-11T16:19:51.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 0x7f52b80058e0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 0x7f52b80058e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d77fe700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f52b4042390 0x7f52b4044850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52cc012a00 con 0x7f52b8003420 2020-02-11T16:19:51.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 0x7f52b80058e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f52cc012b60 con 0x7f52b8003420 2020-02-11T16:19:51.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d77fe700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f52b4042390 0x7f52b4044850 crc :-1 s=READY pgs=355 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 msgr2=0x7f52b80058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52c7fff700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 0x7f52b80058e0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).stop 2020-02-11T16:19:51.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 msgr2=0x7f52b80058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:51.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52d77fe700 1 -- 172.21.15.88:0/2467480481 reap_dead start 2020-02-11T16:19:51.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.363+0000 7f52c7fff700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8003420 0x7f52b80058e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.371+0000 7f52dd723700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 0x7f52b80068c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.371+0000 7f52dd723700 1 -- 172.21.15.88:0/2467480481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8006df0 con 0x7f52b8006410 2020-02-11T16:19:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 0x7f52b80068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52d6ffd700 1 -- 172.21.15.88:0/2467480481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f52b8006fb0 con 0x7f52b8006410 2020-02-11T16:19:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 0x7f52b80068c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 0x7f52b80068c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 0x7f52b80068c0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 0x7f52b80068c0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52cc00ec60 con 0x7f52b8006410 2020-02-11T16:19:51.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52d6ffd700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 0x7f52b80068c0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7f52cc00edc0 con 0x7f52b8006410 2020-02-11T16:19:51.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 msgr2=0x7f52b80068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52c7fff700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 0x7f52b80068c0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).stop 2020-02-11T16:19:51.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52c7fff700 1 -- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 msgr2=0x7f52b80068c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:51.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.372+0000 7f52c7fff700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 0x7f52b80068c0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0x7f52cc001f50 tx=0x7f52cc010fb0).stop 2020-02-11T16:19:51.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 -- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f52b4042390 msgr2=0x7f52b4044850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f52b4042390 0x7f52b4044850 crc :-1 s=READY pgs=355 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 -- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 msgr2=0x7f52b4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f52c8008320 tx=0x7f52c8008fa0).stop 2020-02-11T16:19:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 -- 172.21.15.88:0/2467480481 shutdown_connections 2020-02-11T16:19:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b4003920 0x7f52b4003da0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f52b4042390 0x7f52b4044850 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 --2- 172.21.15.88:0/2467480481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b8006410 0x7f52b80068c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 -- 172.21.15.88:0/2467480481 >> 172.21.15.88:0/2467480481 conn(0x7f52d809d110 msgr2=0x7f52d8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 -- 172.21.15.88:0/2467480481 shutdown_connections 2020-02-11T16:19:51.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.373+0000 7f52dd723700 1 -- 172.21.15.88:0/2467480481 wait complete. 2020-02-11T16:19:51.412 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:19:51.412 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:19:51.412 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:19:51.413 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:19:51.413 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 114, 2020-02-11T16:19:51.413 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:19:51.413 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:19:51.414 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:19:51.414 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:19:51.414 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.414 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:19:51.414 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:51.415 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:19:51.415 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:19:51.415 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:51.415 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:51.416 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:51.416 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:51.416 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:51.416 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:51.416 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.417 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:19:51.417 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:19:51.417 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:51.417 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:51.418 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:51.418 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:51.418 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:51.418 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:51.419 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.419 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:19:51.420 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:19:51.420 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:19:51.420 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:19:51.420 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:19:51.421 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:19:51.421 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:51.421 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:51.421 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:19:51.421 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:19:51.422 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:51.422 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:19:51.422 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:51.422 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:51.423 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:51.423 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:51.423 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:51.423 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:51.423 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.424 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:19:51.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.424 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:19:51.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.424 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:51.424 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:51.424 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:51.425 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:51.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.425 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:51.425 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:19:51.425 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.426 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:51.426 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:19:51.426 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.426 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.426 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.426 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:19:51.426 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:19:51.427 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:51.427 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:51.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.427 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:19:51.427 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:19:51.427 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:51.428 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:51.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.428 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:51.428 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:19:51.428 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.429 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:51.429 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:19:51.429 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.429 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.429 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.429 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:19:51.430 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:19:51.430 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:51.430 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:51.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.430 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:51.430 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:51.430 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:51.431 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:51.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.431 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:51.431 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:19:51.431 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.432 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:51.432 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:19:51.432 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.432 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.432 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.432 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:19:51.433 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:19:51.433 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:51.433 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:51.433 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.433 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.433 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:19:51.434 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:19:51.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.434 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.434 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.434 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:51.434 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.434 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.434 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:19:51.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.435 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.435 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.435 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:19:51.435 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.435 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.435 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.436 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:19:51.437 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:19:51.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.541+0000 7fc3a34ad700 1 Processor -- start 2020-02-11T16:19:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.541+0000 7fc3a34ad700 1 -- start start 2020-02-11T16:19:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a34ad700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a2900 0x7fc39c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a34ad700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc39c0a5cf0 0x7fc39c13c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a34ad700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c136930 con 0x7fc39c0a7120 2020-02-11T16:19:51.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a34ad700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39c0a6470 con 0x7fc39c0a5cf0 2020-02-11T16:19:51.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a34ad700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0a49b0 con 0x7fc39c0a2900 2020-02-11T16:19:51.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a0a48700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a2900 0x7fc39c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a1a4a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc39c0a5cf0 0x7fc39c13c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a0a48700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a2900 0x7fc39c0a50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:51580/0 (socket says 172.21.15.88:51580) 2020-02-11T16:19:51.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a0a48700 1 -- 172.21.15.88:0/1157361584 learned_addr learned my addr 172.21.15.88:0/1157361584 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:51.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a1a4a700 1 -- 172.21.15.88:0/1157361584 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a2900 msgr2=0x7fc39c0a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:51.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/1157361584 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a2900 0x7fc39c0a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:51.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a1a4a700 1 -- 172.21.15.88:0/1157361584 >> v1:172.21.15.52:6789/0 conn(0x7fc39c0a7120 legacy=0x7fc39c13c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.542+0000 7fc3a1a4a700 1 -- 172.21.15.88:0/1157361584 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c0a4c50 con 0x7fc39c0a5cf0 2020-02-11T16:19:51.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/1157361584 >> v2:172.21.15.52:3300/0 conn(0x7fc39c0a5cf0 0x7fc39c13c830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc398002f30 tx=0x7fc3980088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/1157361584 >> v2:172.21.15.52:3300/0 conn(0x7fc39c0a5cf0 0x7fc39c13c830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc398002f30 tx=0x7fc3980088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/1157361584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a5cf0 0x7fc39c13c830 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc3980088e0).ready entity=mon.0 client_cookie=2a3dc169cfd3939f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/1157361584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a5cf0 0x7fc39c13c830 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc3980088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/1157361584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a5cf0 0x7fc39c13c830 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc3980088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc387fff700 1 -- 172.21.15.88:0/1157361584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc398008e40 con 0x7fc39c0a5cf0 2020-02-11T16:19:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/1157361584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a5cf0 0x7fc39c13c830 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc3980088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc387fff700 1 -- 172.21.15.88:0/1157361584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3980115f0 con 0x7fc39c0a5cf0 2020-02-11T16:19:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc387fff700 1 -- 172.21.15.88:0/1157361584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3980119d0 con 0x7fc39c0a5cf0 2020-02-11T16:19:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a34ad700 1 -- 172.21.15.88:0/1157361584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a5cf0 msgr2=0x7fc39c13c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a34ad700 1 --2- 172.21.15.88:0/1157361584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a5cf0 0x7fc39c13c830 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc3980088e0).stop 2020-02-11T16:19:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a34ad700 1 -- 172.21.15.88:0/1157361584 shutdown_connections 2020-02-11T16:19:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a34ad700 1 --2- 172.21.15.88:0/1157361584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a5cf0 0x7fc39c13c830 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a34ad700 1 --2- 172.21.15.88:0/1157361584 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a2900 0x7fc39c0a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a34ad700 1 -- 172.21.15.88:0/1157361584 >> 172.21.15.88:0/1157361584 conn(0x7fc39c09d110 msgr2=0x7fc39c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a34ad700 1 -- 172.21.15.88:0/1157361584 shutdown_connections 2020-02-11T16:19:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.543+0000 7fc3a34ad700 1 -- 172.21.15.88:0/1157361584 wait complete. 2020-02-11T16:19:51.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.544+0000 7fc3a34ad700 1 Processor -- start 2020-02-11T16:19:51.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.544+0000 7fc3a34ad700 1 -- start start 2020-02-11T16:19:51.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a34ad700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a34ad700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c1393a0 con 0x7fc39c0a5cf0 2020-02-11T16:19:51.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a34ad700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c13e940 con 0x7fc39c0a2900 2020-02-11T16:19:51.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a34ad700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c13e730 con 0x7fc39c0a7120 2020-02-11T16:19:51.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a1249700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc39c0a2900 0x7fc39c13ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44886/0 (socket says 172.21.15.88:44886) 2020-02-11T16:19:51.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a1249700 1 -- 172.21.15.88:0/2138892653 learned_addr learned my addr 172.21.15.88:0/2138892653 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:51.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738624342 0 0) 0x7fc39c13e940 con 0x7fc39c0a2900 2020-02-11T16:19:51.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc378002fe0 con 0x7fc39c0a2900 2020-02-11T16:19:51.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465148234 0 0) 0x7fc39c1393a0 con 0x7fc39c0a5cf0 2020-02-11T16:19:51.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc39c13e940 con 0x7fc39c0a5cf0 2020-02-11T16:19:51.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a1a4a700 1 -- 172.21.15.88:0/2138892653 >> v1:172.21.15.88:6789/0 conn(0x7fc39c0a2900 legacy=0x7fc39c13ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a1a4a700 1 -- 172.21.15.88:0/2138892653 >> v1:172.21.15.52:6789/0 conn(0x7fc39c0a5cf0 legacy=0x7fc39c12faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a1a4a700 1 -- 172.21.15.88:0/2138892653 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c1395d0 con 0x7fc39c0a7120 2020-02-11T16:19:51.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc39c0a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.545+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc39c0a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.546+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc39c0a7500).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.546+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc39c0a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.546+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc398010170 con 0x7fc39c0a7120 2020-02-11T16:19:51.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.546+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc39c0a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.546+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398011880 con 0x7fc39c0a7120 2020-02-11T16:19:51.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.546+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc39c0a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.546+0000 7fc3a34ad700 1 -- 172.21.15.88:0/2138892653 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c138650 con 0x7fc39c0a7120 2020-02-11T16:19:51.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.546+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc398007150 con 0x7fc39c0a7120 2020-02-11T16:19:51.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.546+0000 7fc3a34ad700 1 -- 172.21.15.88:0/2138892653 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c140350 con 0x7fc39c0a7120 2020-02-11T16:19:51.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.546+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc39c0a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a34ad700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 0x7fc39c05a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a34ad700 1 -- 172.21.15.88:0/2138892653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c05e2f0 con 0x7fc39c0a9570 2020-02-11T16:19:51.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc398007350 con 0x7fc39c0a7120 2020-02-11T16:19:51.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a1a4a700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc39c0a7500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 0x7fc39c05a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc38effd700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc37803a080 0x7fc37803c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc398049ce0 con 0x7fc39c0a7120 2020-02-11T16:19:51.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a0a48700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc37803a080 0x7fc37803c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a1249700 1 -- 172.21.15.88:0/2138892653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc39c139760 con 0x7fc39c0a9570 2020-02-11T16:19:51.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 0x7fc39c05a990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 0x7fc39c05a990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 0x7fc39c05a990 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 0x7fc39c05a990 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc3a0a48700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc37803a080 0x7fc37803c540 crc :-1 s=READY pgs=356 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.547+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc394010250 con 0x7fc39c0a9570 2020-02-11T16:19:51.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.548+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 0x7fc39c05a990 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.548+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fc3940103b0 con 0x7fc39c0a9570 2020-02-11T16:19:51.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.548+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 msgr2=0x7fc39c05a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.548+0000 7fc38effd700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 0x7fc39c05a990 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).stop 2020-02-11T16:19:51.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.548+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 msgr2=0x7fc39c05a990 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:51.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.548+0000 7fc38effd700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a9570 0x7fc39c05a990 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).stop 2020-02-11T16:19:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.556+0000 7fc3a34ad700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 0x7fc39c0a3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.556+0000 7fc3a34ad700 1 -- 172.21.15.88:0/2138892653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0565b0 con 0x7fc39c0a2d80 2020-02-11T16:19:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.556+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 0x7fc39c0a3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.556+0000 7fc3a1249700 1 -- 172.21.15.88:0/2138892653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc39c139990 con 0x7fc39c0a2d80 2020-02-11T16:19:51.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.556+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 0x7fc39c0a3160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.556+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 0x7fc39c0a3160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.556+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 0x7fc39c0a3160 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.556+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 0x7fc39c0a3160 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.556+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc39400f670 con 0x7fc39c0a2d80 2020-02-11T16:19:51.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a1249700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 0x7fc39c0a3160 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4193 (secure 0 0 0) 0x7fc39400f7d0 con 0x7fc39c0a2d80 2020-02-11T16:19:51.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 msgr2=0x7fc39c0a3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc38effd700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 0x7fc39c0a3160 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fc394001450 tx=0x7fc394001930).stop 2020-02-11T16:19:51.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc38effd700 1 -- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 msgr2=0x7fc39c0a3160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:51.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc38effd700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc39c0a2d80 0x7fc39c0a3160 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a34ad700 1 -- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc37803a080 msgr2=0x7fc37803c540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a34ad700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc37803a080 0x7fc37803c540 crc :-1 s=READY pgs=356 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a34ad700 1 -- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 msgr2=0x7fc39c130200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a34ad700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fc398002f30 tx=0x7fc39c0a7500).stop 2020-02-11T16:19:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a1a4a700 1 -- 172.21.15.88:0/2138892653 reap_dead start 2020-02-11T16:19:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a34ad700 1 -- 172.21.15.88:0/2138892653 shutdown_connections 2020-02-11T16:19:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a34ad700 1 --2- 172.21.15.88:0/2138892653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc39c0a7120 0x7fc39c130200 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a34ad700 1 -- 172.21.15.88:0/2138892653 >> 172.21.15.88:0/2138892653 conn(0x7fc39c09d110 msgr2=0x7fc39c132fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a34ad700 1 -- 172.21.15.88:0/2138892653 shutdown_connections 2020-02-11T16:19:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.557+0000 7fc3a34ad700 1 -- 172.21.15.88:0/2138892653 wait complete. 2020-02-11T16:19:51.568 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:19:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:19:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 114, 2020-02-11T16:19:51.568 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:19:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:19:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:19:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:19:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.569 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:19:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:19:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:19:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:51.570 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:19:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:19:51.571 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:19:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:19:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:19:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:19:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:19:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:19:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:19:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:19:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:19:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:51.574 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:19:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.575 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:19:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:51.576 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:19:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:19:51.577 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:19:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:19:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:51.578 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:19:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:19:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:51.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:19:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:19:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.581 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:19:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:19:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:51.582 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:19:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:19:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.584 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:19:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:19:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.585 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:19:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:19:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.586 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:19:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.587 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:19:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:19:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.588 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:19:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.590 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:19:51.591 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:19:51.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.696+0000 7f7694b94700 1 Processor -- start 2020-02-11T16:19:51.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.696+0000 7f7694b94700 1 -- start start 2020-02-11T16:19:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f7694b94700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f7694b94700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7690134a50 0x7f7690134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:19:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f7694b94700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76900a31b0 con 0x7f76900a18a0 2020-02-11T16:19:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f7694b94700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76900a3570 con 0x7f7690134a50 2020-02-11T16:19:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f7694b94700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76900a3810 con 0x7f76900a5de0 2020-02-11T16:19:51.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768dd9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768ed9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7690134a50 0x7f7690134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768e59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f76900a18a0 0x7f76900a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:36678/0 (socket says 172.21.15.88:36678) 2020-02-11T16:19:51.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768dd9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:51596/0 (socket says 172.21.15.88:51596) 2020-02-11T16:19:51.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768e59c700 1 -- 172.21.15.88:0/2879965304 learned_addr learned my addr 172.21.15.88:0/2879965304 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:19:51.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768dd9b700 1 -- 172.21.15.88:0/2879965304 >> v2:172.21.15.52:3300/0 conn(0x7f7690134a50 msgr2=0x7f7690134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:19:51.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2879965304 >> v2:172.21.15.52:3300/0 conn(0x7f7690134a50 0x7f7690134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:51.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768dd9b700 1 -- 172.21.15.88:0/2879965304 >> v1:172.21.15.52:6789/0 conn(0x7f76900a18a0 legacy=0x7f76900a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768dd9b700 1 -- 172.21.15.88:0/2879965304 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76900a3ab0 con 0x7f76900a5de0 2020-02-11T16:19:51.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768ed9d700 1 --2- 172.21.15.88:0/2879965304 >> v2:172.21.15.52:3300/0 conn(0x7f7690134a50 0x7f7690134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:51.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.697+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2879965304 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76900a5cc0 tx=0x7f76800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2879965304 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76900a5cc0 tx=0x7f76800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2879965304 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f76800088e0).ready entity=mon.2 client_cookie=56d5aa25efd600a7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2879965304 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f76800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2879965304 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f76800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f768d59a700 1 -- 172.21.15.88:0/2879965304 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7680008e40 con 0x7f76900a5de0 2020-02-11T16:19:51.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2879965304 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f76800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f768d59a700 1 -- 172.21.15.88:0/2879965304 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76800115b0 con 0x7f76900a5de0 2020-02-11T16:19:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f768d59a700 1 -- 172.21.15.88:0/2879965304 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7680011990 con 0x7f76900a5de0 2020-02-11T16:19:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f7694b94700 1 -- 172.21.15.88:0/2879965304 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 msgr2=0x7f76900a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f7694b94700 1 --2- 172.21.15.88:0/2879965304 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f76800088e0).stop 2020-02-11T16:19:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f7694b94700 1 -- 172.21.15.88:0/2879965304 shutdown_connections 2020-02-11T16:19:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f7694b94700 1 --2- 172.21.15.88:0/2879965304 >> v2:172.21.15.52:3300/0 conn(0x7f7690134a50 0x7f7690134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:19:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f7694b94700 1 --2- 172.21.15.88:0/2879965304 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a5de0 0x7f76900a6260 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f7694b94700 1 -- 172.21.15.88:0/2879965304 >> 172.21.15.88:0/2879965304 conn(0x7f769009d110 msgr2=0x7f769009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f7694b94700 1 -- 172.21.15.88:0/2879965304 shutdown_connections 2020-02-11T16:19:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.698+0000 7f7694b94700 1 -- 172.21.15.88:0/2879965304 wait complete. 2020-02-11T16:19:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.699+0000 7f7694b94700 1 Processor -- start 2020-02-11T16:19:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.699+0000 7f7694b94700 1 -- start start 2020-02-11T16:19:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f7694b94700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a18a0 0x7f7690124960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f7694b94700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76900a5de0 0x7f76900a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f7694b94700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76900a8a70 con 0x7f7690134a50 2020-02-11T16:19:51.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f7694b94700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7690125930 con 0x7f76900a5de0 2020-02-11T16:19:51.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f7694b94700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769012f8e0 con 0x7f76900a18a0 2020-02-11T16:19:51.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76900a5de0 0x7f76900a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768e59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a18a0 0x7f7690124960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76900a5de0 0x7f76900a84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57278/0 (socket says 172.21.15.88:57278) 2020-02-11T16:19:51.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768dd9b700 1 -- 172.21.15.88:0/2470034748 learned_addr learned my addr 172.21.15.88:0/2470034748 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:19:51.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768dd9b700 1 -- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a18a0 msgr2=0x7f7690124960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a18a0 0x7f7690124960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768dd9b700 1 -- 172.21.15.88:0/2470034748 >> v1:172.21.15.88:6789/0 conn(0x7f7690134a50 legacy=0x7f7690131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768dd9b700 1 -- 172.21.15.88:0/2470034748 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769012fad0 con 0x7f76900a5de0 2020-02-11T16:19:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76900a18a0 0x7f7690124960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:19:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2470034748 >> v2:172.21.15.88:3300/0 conn(0x7f76900a5de0 0x7f76900a84f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f769012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2470034748 >> v2:172.21.15.88:3300/0 conn(0x7f76900a5de0 0x7f76900a84f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f769012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.700+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76900a5de0 0x7f76900a84f0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f769012f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76900a5de0 0x7f76900a84f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f769012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76800118c0 con 0x7f76900a5de0 2020-02-11T16:19:51.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76900a5de0 0x7f76900a84f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f769012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76900a5de0 0x7f76900a84f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f769012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680011a20 con 0x7f76900a5de0 2020-02-11T16:19:51.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f7694b94700 1 -- 172.21.15.88:0/2470034748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76901262d0 con 0x7f76900a5de0 2020-02-11T16:19:51.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7680007340 con 0x7f76900a5de0 2020-02-11T16:19:51.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f7694b94700 1 -- 172.21.15.88:0/2470034748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7690125240 con 0x7f76900a5de0 2020-02-11T16:19:51.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76900a5de0 0x7f76900a84f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f769012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f76800056c0 con 0x7f76900a5de0 2020-02-11T16:19:51.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.701+0000 7f768dd9b700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76900a5de0 0x7f76900a84f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f769012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f7694b94700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 0x7f76901302f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f7694b94700 1 -- 172.21.15.88:0/2470034748 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769005e2f0 con 0x7f7690126500 2020-02-11T16:19:51.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f767f7fe700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f766c039c20 0x7f766c03c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f768004a060 con 0x7f76900a5de0 2020-02-11T16:19:51.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 0x7f76901302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f768ed9d700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f766c039c20 0x7f766c03c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f768e59c700 1 -- 172.21.15.88:0/2470034748 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76901324c0 con 0x7f7690126500 2020-02-11T16:19:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 0x7f76901302f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f768ed9d700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f766c039c20 0x7f766c03c0e0 crc :-1 s=READY pgs=357 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 0x7f76901302f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 0x7f76901302f0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 0x7f76901302f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.702+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768400ca00 con 0x7f7690126500 2020-02-11T16:19:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.703+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 0x7f76901302f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.703+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f768400cb60 con 0x7f7690126500 2020-02-11T16:19:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.703+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 msgr2=0x7f76901302f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.703+0000 7f767f7fe700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 0x7f76901302f0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).stop 2020-02-11T16:19:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.703+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 msgr2=0x7f76901302f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.703+0000 7f767f7fe700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7690126500 0x7f76901302f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.710+0000 7f7694b94700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 0x7f769005a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:19:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.710+0000 7f7694b94700 1 -- 172.21.15.88:0/2470034748 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769012fcd0 con 0x7f769005a5d0 2020-02-11T16:19:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.711+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 0x7f769005a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:19:51.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.711+0000 7f768e59c700 1 -- 172.21.15.88:0/2470034748 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f76900565b0 con 0x7f769005a5d0 2020-02-11T16:19:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.711+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 0x7f769005a9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.711+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 0x7f769005a9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.711+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 0x7f769005a9e0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:19:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.711+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 0x7f769005a9e0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.711+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7684012e20 con 0x7f769005a5d0 2020-02-11T16:19:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f768e59c700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 0x7f769005a9e0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:19:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f768400e940 con 0x7f769005a5d0 2020-02-11T16:19:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 msgr2=0x7f769005a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f767f7fe700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 0x7f769005a9e0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f769005b910 tx=0x7f768400c5b0).stop 2020-02-11T16:19:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f767f7fe700 1 -- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 msgr2=0x7f769005a9e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:19:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f767f7fe700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f769005a5d0 0x7f769005a9e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f7694b94700 1 -- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f766c039c20 msgr2=0x7f766c03c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f7694b94700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f766c039c20 0x7f766c03c0e0 crc :-1 s=READY pgs=357 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f7694b94700 1 -- 172.21.15.88:0/2470034748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76900a5de0 msgr2=0x7f76900a84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:19:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f7694b94700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76900a5de0 0x7f76900a84f0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f76900a5cc0 tx=0x7f769012f3b0).stop 2020-02-11T16:19:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f768ed9d700 1 -- 172.21.15.88:0/2470034748 reap_dead start 2020-02-11T16:19:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f768ed9d700 1 -- 172.21.15.88:0/2470034748 reap_dead start 2020-02-11T16:19:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f7694b94700 1 -- 172.21.15.88:0/2470034748 shutdown_connections 2020-02-11T16:19:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f7694b94700 1 --2- 172.21.15.88:0/2470034748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76900a5de0 0x7f76900a84f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:19:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f7694b94700 1 -- 172.21.15.88:0/2470034748 >> 172.21.15.88:0/2470034748 conn(0x7f769009d110 msgr2=0x7f7690069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:19:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f7694b94700 1 -- 172.21.15.88:0/2470034748 shutdown_connections 2020-02-11T16:19:51.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:19:51.712+0000 7f7694b94700 1 -- 172.21.15.88:0/2470034748 wait complete. 2020-02-11T16:19:51.724 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:19:51.724 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:51.724 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:51.724 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:19:51.724 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 114, 2020-02-11T16:19:51.725 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:19:51.725 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:19:51.725 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:19:51.725 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:19:51.725 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.726 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 13, 2020-02-11T16:19:51.726 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:51.726 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:19:51.726 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:19:51.726 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:51.726 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:51.726 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:51.727 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:51.727 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:51.727 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:51.727 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.727 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:19:51.727 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:19:51.727 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:51.728 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:51.728 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:51.728 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:51.728 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:51.728 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:51.728 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.729 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:19:51.729 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:19:51.729 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:19:51.729 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:19:51.729 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:19:51.729 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:19:51.729 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:51.730 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:19:51.730 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:19:51.730 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:19:51.730 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:19:51.730 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:19:51.730 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:19:51.732 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:19:51.733 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:19:51.733 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:19:51.733 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:19:51.733 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:19:51.733 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.733 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:19:51.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.734 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:19:51.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.734 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:19:51.734 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:19:51.734 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:51.734 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:51.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.735 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:51.735 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:19:51.735 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.736 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:51.736 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:19:51.736 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.736 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.736 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.737 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:19:51.737 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:19:51.737 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:51.737 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:51.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.737 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:19:51.738 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:19:51.738 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:51.738 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:51.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.738 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:51.738 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:19:51.738 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.739 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:51.739 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:19:51.739 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.739 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.739 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:19:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:19:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:19:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:19:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:19:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:19:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:19:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:19:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:19:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:19:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:19:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:19:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:19:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:19:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:19:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:19:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:19:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:19:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:51.745 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.745 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.745 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:19:51.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.745 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.745 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.745 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:51.745 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.746 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.746 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:19:51.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.746 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.747 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.747 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:19:51.747 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.747 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.747 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:19:51.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.747 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.748 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.748 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:19:51.748 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.748 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:19:51.748 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:19:51.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:19:51.748 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:19:51.749 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:19:51.749 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:19:51.749 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.749 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:19:51.749 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:19:51.749 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:19:51.751 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2020-02-11T16:19:51.751 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a', 'c'] 2020-02-11T16:19:51.751 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2020-02-11T16:19:51.751 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:19:51.751 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-02-11T16:19:51.752 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:19:51.763 INFO:tasks.ceph.mon.b:Stopped 2020-02-11T16:19:51.764 INFO:tasks.mon_thrash:Sending STOP to mon a 2020-02-11T16:19:51.764 INFO:tasks.ceph.mon.a:Sent signal 19 2020-02-11T16:19:51.764 INFO:tasks.mon_thrash:Sending STOP to mon c 2020-02-11T16:19:51.764 INFO:tasks.ceph.mon.c:Sent signal 19 2020-02-11T16:19:51.764 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2020-02-11T16:20:06.766 INFO:tasks.mon_thrash:Sending CONT to mon a 2020-02-11T16:20:06.766 INFO:tasks.ceph.mon.a:Sent signal 18 2020-02-11T16:20:06.766 INFO:tasks.mon_thrash:Sending CONT to mon c 2020-02-11T16:20:06.767 INFO:tasks.ceph.mon.c:Sent signal 18 2020-02-11T16:20:06.767 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:20:06.767 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:20:06.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.881+0000 7fecc8152700 1 Processor -- start 2020-02-11T16:20:06.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.881+0000 7fecc8152700 1 -- start start 2020-02-11T16:20:06.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.882+0000 7fecc8152700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 0x7fecc00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:06.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.882+0000 7fecc8152700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc00a31b0 con 0x7fecc00a18a0 2020-02-11T16:20:06.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.882+0000 7fecc8152700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc00a3570 con 0x7fecc0134a50 2020-02-11T16:20:06.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.882+0000 7fecc8152700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc00a3810 con 0x7fecc00a5de0 2020-02-11T16:20:06.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.882+0000 7fecc56ed700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 msgr2=0x7fecc00a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.882+0000 7fecc5eee700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7fecc00a18a0 legacy=0x7fecc00a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:20:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.882+0000 7fecc56ed700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 0x7fecc00a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:20:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.882+0000 7fecc66ef700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fecc0134a50 0x7fecc0134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44928/0 (socket says 172.21.15.88:44928) 2020-02-11T16:20:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:06.882+0000 7fecc66ef700 1 -- 172.21.15.88:0/144056966 learned_addr learned my addr 172.21.15.88:0/144056966 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:07.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:07.083+0000 7fecc56ed700 1 -- 172.21.15.88:0/144056966 >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 msgr2=0x7fecc00a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:07.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:07.083+0000 7fecc5eee700 1 -- 172.21.15.88:0/144056966 >> v1:172.21.15.52:6789/0 conn(0x7fecc00a18a0 legacy=0x7fecc00a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:20:07.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:07.083+0000 7fecc56ed700 1 --2- 172.21.15.88:0/144056966 >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 0x7fecc00a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:20:07.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:07.484+0000 7fecc5eee700 1 -- 172.21.15.88:0/144056966 >> v1:172.21.15.52:6789/0 conn(0x7fecc00a18a0 legacy=0x7fecc00a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:20:07.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:07.484+0000 7fecc56ed700 1 -- 172.21.15.88:0/144056966 >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 msgr2=0x7fecc00a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:07.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:07.484+0000 7fecc56ed700 1 --2- 172.21.15.88:0/144056966 >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 0x7fecc00a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:20:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:08.285+0000 7fecc56ed700 1 -- 172.21.15.88:0/144056966 >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 msgr2=0x7fecc00a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:08.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:08.285+0000 7fecc5eee700 1 -- 172.21.15.88:0/144056966 >> v1:172.21.15.52:6789/0 conn(0x7fecc00a18a0 legacy=0x7fecc00a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:20:08.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:08.285+0000 7fecc56ed700 1 --2- 172.21.15.88:0/144056966 >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 0x7fecc00a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:20:09.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:09.887+0000 7fecc5eee700 1 -- 172.21.15.88:0/144056966 >> v1:172.21.15.52:6789/0 conn(0x7fecc00a18a0 legacy=0x7fecc00a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:20:09.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:09.887+0000 7fecc56ed700 1 -- 172.21.15.88:0/144056966 >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 msgr2=0x7fecc00a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:09.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:09.887+0000 7fecc56ed700 1 --2- 172.21.15.88:0/144056966 >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 0x7fecc00a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:20:11.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.787+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583104938 0 0) 0x7fecc00a3570 con 0x7fecc0134a50 2020-02-11T16:20:11.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.787+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca8003230 con 0x7fecc0134a50 2020-02-11T16:20:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1288055551 0 0) 0x7feca8003230 con 0x7fecc0134a50 2020-02-11T16:20:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 msgr2=0x7fecc00a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:20:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 --2- 172.21.15.88:0/144056966 >> v2:172.21.15.52:3300/0 conn(0x7fecc00a5de0 0x7fecc00a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 >> v1:172.21.15.52:6789/0 conn(0x7fecc00a18a0 legacy=0x7fecc00a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:20:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc00a3ab0 con 0x7fecc0134a50 2020-02-11T16:20:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fecbc001670 con 0x7fecc0134a50 2020-02-11T16:20:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 >> v1:172.21.15.88:6789/0 conn(0x7fecc0134a50 legacy=0x7fecc0134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 0x7feca8003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8003fa0 0x7feca80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8004a20 0x7feca8004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc00a3810 con 0x7feca8004a20 2020-02-11T16:20:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca800b7b0 con 0x7feca8003720 2020-02-11T16:20:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca800b970 con 0x7feca8003fa0 2020-02-11T16:20:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc66ef700 1 -- 172.21.15.88:0/144056966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8004a20 msgr2=0x7feca8004ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc66ef700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8004a20 0x7feca8004ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:20:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.788+0000 7fecc5eee700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 0x7feca8003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.789+0000 7fecc56ed700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8003fa0 0x7feca80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.789+0000 7fecc5eee700 1 -- 172.21.15.88:0/144056966 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8003fa0 msgr2=0x7feca80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.789+0000 7fecc5eee700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8003fa0 0x7feca80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.789+0000 7fecc5eee700 1 -- 172.21.15.88:0/144056966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8004a20 msgr2=0x7feca8004ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:20:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.789+0000 7fecc5eee700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8004a20 0x7feca8004ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.789+0000 7fecc5eee700 1 -- 172.21.15.88:0/144056966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8003230 con 0x7feca8003720 2020-02-11T16:20:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.789+0000 7fecc66ef700 1 -- 172.21.15.88:0/144056966 reap_dead start 2020-02-11T16:20:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.789+0000 7fecc5eee700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 0x7feca8003b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feca8004440 tx=0x7fecb8008db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.789+0000 7fecc5eee700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 0x7feca8003b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feca8004440 tx=0x7fecb8008db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.789+0000 7fecc5eee700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 0x7feca8003b20 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7feca8004440 tx=0x7fecb8008db0).ready entity=mon.1 client_cookie=15fa9a059741ae49 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:11.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.790+0000 7fecc5eee700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 0x7feca8003b20 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7feca8004440 tx=0x7fecb8008db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.790+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecb800d4a0 con 0x7feca8003720 2020-02-11T16:20:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.790+0000 7fecc5eee700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 0x7feca8003b20 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7feca8004440 tx=0x7fecb8008db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.790+0000 7fecc4eec700 1 -- 172.21.15.88:0/144056966 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb800d600 con 0x7feca8003720 2020-02-11T16:20:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.790+0000 7fecc5eee700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 0x7feca8003b20 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7feca8004440 tx=0x7fecb8008db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.790+0000 7fecc8152700 1 -- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 msgr2=0x7feca8003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.790+0000 7fecc8152700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 0x7feca8003b20 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7feca8004440 tx=0x7fecb8008db0).stop 2020-02-11T16:20:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.791+0000 7fecc8152700 1 -- 172.21.15.88:0/144056966 shutdown_connections 2020-02-11T16:20:11.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.791+0000 7fecc8152700 1 --2- 172.21.15.88:0/144056966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca8003720 0x7feca8003b20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:11.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.791+0000 7fecc8152700 1 -- 172.21.15.88:0/144056966 >> 172.21.15.88:0/144056966 conn(0x7fecc009d110 msgr2=0x7fecc009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:11.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.791+0000 7fecc8152700 1 -- 172.21.15.88:0/144056966 shutdown_connections 2020-02-11T16:20:11.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.791+0000 7fecc8152700 1 -- 172.21.15.88:0/144056966 wait complete. 2020-02-11T16:20:11.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.792+0000 7fecc8152700 1 Processor -- start 2020-02-11T16:20:11.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.792+0000 7fecc8152700 1 -- start start 2020-02-11T16:20:11.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc8152700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc005a950 0x7fecc0136380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:11.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc8152700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fecc0129300 0x7fecc01297b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:11.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc8152700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc0067070 con 0x7feca8003720 2020-02-11T16:20:11.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc8152700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc0066690 con 0x7fecc0129300 2020-02-11T16:20:11.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc8152700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc0066930 con 0x7fecc005a950 2020-02-11T16:20:11.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc5eee700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7feca8003720 legacy=0x7fecc00a7fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:20:11.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc66ef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fecc0129300 0x7fecc01297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:11.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc66ef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fecc0129300 0x7fecc01297b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57330/0 (socket says 172.21.15.88:57330) 2020-02-11T16:20:11.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc66ef700 1 -- 172.21.15.88:0/1589705513 learned_addr learned my addr 172.21.15.88:0/1589705513 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:20:11.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc56ed700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc005a950 0x7fecc0136380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:11.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc66ef700 1 -- 172.21.15.88:0/1589705513 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc005a950 msgr2=0x7fecc0136380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:11.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc005a950 0x7fecc0136380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:11.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc66ef700 1 -- 172.21.15.88:0/1589705513 >> v1:172.21.15.52:6789/0 conn(0x7feca8003720 legacy=0x7fecc00a7fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:20:11.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.793+0000 7fecc66ef700 1 -- 172.21.15.88:0/1589705513 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc0066bd0 con 0x7fecc0129300 2020-02-11T16:20:11.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> v2:172.21.15.88:3300/0 conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> v2:172.21.15.88:3300/0 conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:11.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecaeffd700 1 -- 172.21.15.88:0/1589705513 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecbc0111b0 con 0x7fecc0129300 2020-02-11T16:20:11.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecaeffd700 1 -- 172.21.15.88:0/1589705513 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc011310 con 0x7fecc0129300 2020-02-11T16:20:11.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecc8152700 1 -- 172.21.15.88:0/1589705513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc00a86f0 con 0x7fecc0129300 2020-02-11T16:20:11.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecaeffd700 1 -- 172.21.15.88:0/1589705513 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecbc011670 con 0x7fecc0129300 2020-02-11T16:20:11.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecc8152700 1 -- 172.21.15.88:0/1589705513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc01346b0 con 0x7fecc0129300 2020-02-11T16:20:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.794+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.795+0000 7fecaeffd700 1 -- 172.21.15.88:0/1589705513 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fecbc00b0a0 con 0x7fecc0129300 2020-02-11T16:20:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.795+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.795+0000 7fecaeffd700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feca0039be0 0x7feca003c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.795+0000 7fecaeffd700 1 -- 172.21.15.88:0/1589705513 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fecbc0493d0 con 0x7fecc0129300 2020-02-11T16:20:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.795+0000 7fecc5eee700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feca0039be0 0x7feca003c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.795+0000 7fecc8152700 1 -- 172.21.15.88:0/1589705513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc0129dd0 con 0x7fecc0129300 2020-02-11T16:20:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.795+0000 7fecc5eee700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feca0039be0 0x7feca003c0a0 crc :-1 s=READY pgs=358 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.799+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.799+0000 7fecaeffd700 1 -- 172.21.15.88:0/1589705513 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fecbc02ea70 con 0x7fecc0129300 2020-02-11T16:20:11.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.988+0000 7fecc8152700 1 -- 172.21.15.88:0/1589705513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fecc00565b0 con 0x7fecc0129300 2020-02-11T16:20:11.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.988+0000 7fecc66ef700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:11.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.988+0000 7fecaeffd700 1 -- 172.21.15.88:0/1589705513 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fecbc0090c0 con 0x7fecc0129300 2020-02-11T16:20:11.991 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":116,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:20:11.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.989+0000 7fecc8152700 1 -- 172.21.15.88:0/1589705513 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feca0039be0 msgr2=0x7feca003c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:11.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.990+0000 7fecc8152700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feca0039be0 0x7feca003c0a0 crc :-1 s=READY pgs=358 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:11.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.990+0000 7fecc8152700 1 -- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 msgr2=0x7fecc01297b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:11.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.990+0000 7fecc8152700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 0x7fecc01297b0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fecc0066f50 tx=0x7fecbc010650).stop 2020-02-11T16:20:11.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.990+0000 7fecc8152700 1 -- 172.21.15.88:0/1589705513 shutdown_connections 2020-02-11T16:20:11.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.990+0000 7fecc8152700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feca0039be0 0x7feca003c0a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:11.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.990+0000 7fecc8152700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc0129300 0x7fecc01297b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:11.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.990+0000 7fecc8152700 1 --2- 172.21.15.88:0/1589705513 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc005a950 0x7fecc0136380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:11.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.990+0000 7fecc8152700 1 -- 172.21.15.88:0/1589705513 >> 172.21.15.88:0/1589705513 conn(0x7fecc009d110 msgr2=0x7fecc012e280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:11.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.990+0000 7fecc8152700 1 -- 172.21.15.88:0/1589705513 shutdown_connections 2020-02-11T16:20:11.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:11.990+0000 7fecc8152700 1 -- 172.21.15.88:0/1589705513 wait complete. 2020-02-11T16:20:12.002 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":116,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:20:12.002 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:20:12.002 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:20:12.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.105+0000 7f97205ce700 1 Processor -- start 2020-02-11T16:20:12.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.105+0000 7f97205ce700 1 -- start start 2020-02-11T16:20:12.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f97205ce700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97180a18a0 0x7f97180a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:12.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f97205ce700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f97180a5de0 0x7f97180a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:12.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f97205ce700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97180a31b0 con 0x7f971812e3a0 2020-02-11T16:20:12.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f97205ce700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97180a3570 con 0x7f97180a5de0 2020-02-11T16:20:12.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f97205ce700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97180a3810 con 0x7f97180a18a0 2020-02-11T16:20:12.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f971eb6b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f971812e3a0 0x7f971812e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44960/0 (socket says 172.21.15.88:44960) 2020-02-11T16:20:12.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f971eb6b700 1 -- 172.21.15.88:0/2105548032 learned_addr learned my addr 172.21.15.88:0/2105548032 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:12.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f971db69700 1 -- 172.21.15.88:0/2105548032 >> v2:172.21.15.52:3300/0 conn(0x7f97180a5de0 msgr2=0x7f97180a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:12.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f971db69700 1 --2- 172.21.15.88:0/2105548032 >> v2:172.21.15.52:3300/0 conn(0x7f97180a5de0 0x7f97180a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:20:12.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f971e36a700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97180a18a0 0x7f97180a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363604344 0 0) 0x7f97180a31b0 con 0x7f971812e3a0 2020-02-11T16:20:12.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.106+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9700003230 con 0x7f971812e3a0 2020-02-11T16:20:12.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1690817374 0 0) 0x7f9700003230 con 0x7f971812e3a0 2020-02-11T16:20:12.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97180a18a0 msgr2=0x7f97180a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:12.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97180a18a0 0x7f97180a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:12.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 >> v2:172.21.15.52:3300/0 conn(0x7f97180a5de0 msgr2=0x7f97180a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:20:12.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 --2- 172.21.15.88:0/2105548032 >> v2:172.21.15.52:3300/0 conn(0x7f97180a5de0 0x7f97180a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:12.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97180a3ab0 con 0x7f971812e3a0 2020-02-11T16:20:12.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f9710001a50 con 0x7f971812e3a0 2020-02-11T16:20:12.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 >> v1:172.21.15.88:6789/0 conn(0x7f971812e3a0 legacy=0x7f971812e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97180a18a0 0x7f9700003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:12.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9700003b80 0x7f9700003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:12.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9700004570 0x7f97000049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:12.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97180a3570 con 0x7f9700004570 2020-02-11T16:20:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97180a3810 con 0x7f9700003b80 2020-02-11T16:20:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9700005000 con 0x7f97180a18a0 2020-02-11T16:20:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971eb6b700 1 -- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9700004570 msgr2=0x7f97000049d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9700003b80 0x7f9700003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971eb6b700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9700004570 0x7f97000049d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:20:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971e36a700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97180a18a0 0x7f9700003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 -- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97180a18a0 msgr2=0x7f9700003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97180a18a0 0x7f9700003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 -- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9700004570 msgr2=0x7f97000049d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:20:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9700004570 0x7f97000049d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 -- 172.21.15.88:0/2105548032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700003230 con 0x7f9700003b80 2020-02-11T16:20:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9700003b80 0x7f9700003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f970c0057e0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9700003b80 0x7f9700003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f970c0057e0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9700003b80 0x7f9700003fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f970c0057e0 tx=0x7f970c00fd50).ready entity=mon.1 client_cookie=9dbd8d4a981aa607 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:12.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9700003b80 0x7f9700003fe0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f970c0057e0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9700003b80 0x7f9700003fe0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f970c0057e0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f970c003ea0 con 0x7f9700003b80 2020-02-11T16:20:12.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971db69700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9700003b80 0x7f9700003fe0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f970c0057e0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c0089e0 con 0x7f9700003b80 2020-02-11T16:20:12.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971d368700 1 -- 172.21.15.88:0/2105548032 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f970c008e00 con 0x7f9700003b80 2020-02-11T16:20:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f97205ce700 1 -- 172.21.15.88:0/2105548032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9700003b80 msgr2=0x7f9700003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f97205ce700 1 --2- 172.21.15.88:0/2105548032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9700003b80 0x7f9700003fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f970c0057e0 tx=0x7f970c00fd50).stop 2020-02-11T16:20:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.107+0000 7f971eb6b700 1 -- 172.21.15.88:0/2105548032 reap_dead start 2020-02-11T16:20:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.108+0000 7f97205ce700 1 -- 172.21.15.88:0/2105548032 shutdown_connections 2020-02-11T16:20:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.108+0000 7f97205ce700 1 -- 172.21.15.88:0/2105548032 >> 172.21.15.88:0/2105548032 conn(0x7f971809d110 msgr2=0x7f971809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.108+0000 7f97205ce700 1 -- 172.21.15.88:0/2105548032 shutdown_connections 2020-02-11T16:20:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.108+0000 7f97205ce700 1 -- 172.21.15.88:0/2105548032 wait complete. 2020-02-11T16:20:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.109+0000 7f97205ce700 1 Processor -- start 2020-02-11T16:20:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.109+0000 7f97205ce700 1 -- start start 2020-02-11T16:20:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.109+0000 7f97205ce700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9718061890 0x7f9718129200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.109+0000 7f97205ce700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9718129660 0x7f971814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.109+0000 7f97205ce700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9718130e50 con 0x7f971809f1d0 2020-02-11T16:20:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.109+0000 7f97205ce700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9718130c70 con 0x7f9718061890 2020-02-11T16:20:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.109+0000 7f97205ce700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97181310f0 con 0x7f9718129660 2020-02-11T16:20:12.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.109+0000 7f971db69700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9718061890 0x7f9718129200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.109+0000 7f971e36a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f971809f1d0 0x7f971812f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44972/0 (socket says 172.21.15.88:44972) 2020-02-11T16:20:12.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.109+0000 7f971e36a700 1 -- 172.21.15.88:0/1112179672 learned_addr learned my addr 172.21.15.88:0/1112179672 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:12.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971eb6b700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9718129660 0x7f971814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 -- 172.21.15.88:0/1112179672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9718129660 msgr2=0x7f971814c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9718129660 0x7f971814c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:12.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 -- 172.21.15.88:0/1112179672 >> v1:172.21.15.88:6789/0 conn(0x7f971809f1d0 legacy=0x7f971812f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 -- 172.21.15.88:0/1112179672 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9718131590 con 0x7f9718061890 2020-02-11T16:20:12.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 --2- 172.21.15.88:0/1112179672 >> v2:172.21.15.88:3300/0 conn(0x7f9718061890 0x7f9718129200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9718131cb0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 --2- 172.21.15.88:0/1112179672 >> v2:172.21.15.88:3300/0 conn(0x7f9718061890 0x7f9718129200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9718131cb0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9718061890 0x7f9718129200 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f9718131cb0 tx=0x7f970c00fd50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9718061890 0x7f9718129200 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9718131cb0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f970c00f400 con 0x7f9718061890 2020-02-11T16:20:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9718061890 0x7f9718129200 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9718131cb0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9718061890 0x7f9718129200 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9718131cb0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c00f560 con 0x7f9718061890 2020-02-11T16:20:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f97205ce700 1 -- 172.21.15.88:0/1112179672 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971809f890 con 0x7f9718061890 2020-02-11T16:20:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f970c005820 con 0x7f9718061890 2020-02-11T16:20:12.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f97205ce700 1 -- 172.21.15.88:0/1112179672 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9718138c30 con 0x7f9718061890 2020-02-11T16:20:12.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.110+0000 7f971db69700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9718061890 0x7f9718129200 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9718131cb0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f970c005a90 con 0x7f9718061890 2020-02-11T16:20:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f971db69700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9718061890 0x7f9718129200 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9718131cb0 tx=0x7f970c00fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f97205ce700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 0x7f971812c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f97205ce700 1 -- 172.21.15.88:0/1112179672 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971805e2f0 con 0x7f97180a3f10 2020-02-11T16:20:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f970b7fe700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f96f8039bb0 0x7f96f803c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f970c049dc0 con 0x7f9718061890 2020-02-11T16:20:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 0x7f971812c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f971eb6b700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f96f8039bb0 0x7f96f803c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f971e36a700 1 -- 172.21.15.88:0/1112179672 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9718130230 con 0x7f97180a3f10 2020-02-11T16:20:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 0x7f971812c8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 0x7f971812c8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f971eb6b700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f96f8039bb0 0x7f96f803c070 crc :-1 s=READY pgs=359 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 0x7f971812c8d0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 0x7f971812c8d0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.111+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9714007530 con 0x7f97180a3f10 2020-02-11T16:20:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.112+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 0x7f971812c8d0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.112+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f971400b160 con 0x7f97180a3f10 2020-02-11T16:20:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.112+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 msgr2=0x7f971812c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.112+0000 7f970b7fe700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 0x7f971812c8d0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714010d00).stop 2020-02-11T16:20:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.112+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 msgr2=0x7f971812c8d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.112+0000 7f970b7fe700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97180a3f10 0x7f971812c8d0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714010d00).stop 2020-02-11T16:20:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f97205ce700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 0x7f971812d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f97205ce700 1 -- 172.21.15.88:0/1112179672 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97180565b0 con 0x7f971812cd30 2020-02-11T16:20:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 0x7f971812d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f971e36a700 1 -- 172.21.15.88:0/1112179672 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9718131230 con 0x7f971812cd30 2020-02-11T16:20:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 0x7f971812d110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 0x7f971812d110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 0x7f971812d110 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714002f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 0x7f971812d110 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9714005ea0 con 0x7f971812cd30 2020-02-11T16:20:12.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f971e36a700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 0x7f971812d110 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4011 (secure 0 0 0) 0x7f97140110f0 con 0x7f971812cd30 2020-02-11T16:20:12.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 msgr2=0x7f971812d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f970b7fe700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 0x7f971812d110 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714002f10).stop 2020-02-11T16:20:12.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f970b7fe700 1 -- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 msgr2=0x7f971812d110 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:12.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.120+0000 7f970b7fe700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f971812cd30 0x7f971812d110 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0x7f971812be90 tx=0x7f9714002f10).stop 2020-02-11T16:20:12.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f97205ce700 1 -- 172.21.15.88:0/1112179672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f96f8039bb0 msgr2=0x7f96f803c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f97205ce700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f96f8039bb0 0x7f96f803c070 crc :-1 s=READY pgs=359 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:12.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f97205ce700 1 -- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9718061890 msgr2=0x7f9718129200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f97205ce700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9718061890 0x7f9718129200 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f9718131cb0 tx=0x7f970c00fd50).stop 2020-02-11T16:20:12.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f971eb6b700 1 -- 172.21.15.88:0/1112179672 reap_dead start 2020-02-11T16:20:12.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f971eb6b700 1 -- 172.21.15.88:0/1112179672 reap_dead start 2020-02-11T16:20:12.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f97205ce700 1 -- 172.21.15.88:0/1112179672 shutdown_connections 2020-02-11T16:20:12.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f97205ce700 1 --2- 172.21.15.88:0/1112179672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9718061890 0x7f9718129200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:12.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f97205ce700 1 -- 172.21.15.88:0/1112179672 >> 172.21.15.88:0/1112179672 conn(0x7f971809d110 msgr2=0x7f97180a6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:12.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f97205ce700 1 -- 172.21.15.88:0/1112179672 shutdown_connections 2020-02-11T16:20:12.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.121+0000 7f97205ce700 1 -- 172.21.15.88:0/1112179672 wait complete. 2020-02-11T16:20:12.138 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:20:12.138 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:12.139 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:12.139 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:20:12.139 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 116, 2020-02-11T16:20:12.139 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:20:12.139 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:20:12.139 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:20:12.139 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.140 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:20:12.140 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:12.140 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:20:12.140 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:20:12.140 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:12.140 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:12.140 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:12.141 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:12.141 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:12.141 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:12.141 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.141 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:20:12.141 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:20:12.141 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:12.141 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:12.142 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:12.142 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:12.142 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:12.142 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:12.142 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.142 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:20:12.143 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:20:12.143 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:20:12.143 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:20:12.143 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:20:12.143 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:20:12.143 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:12.143 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:12.144 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:20:12.144 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:20:12.144 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:12.144 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:20:12.144 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:12.144 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:12.144 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:12.145 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:12.145 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:12.145 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:12.145 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.145 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:20:12.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.145 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:20:12.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.146 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:20:12.146 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:20:12.146 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:12.146 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:12.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.146 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:12.146 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:20:12.147 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.147 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:12.147 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:20:12.147 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.147 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.148 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.148 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:20:12.148 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:20:12.148 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:12.148 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:12.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.149 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:12.149 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:12.149 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:12.149 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:12.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.150 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:12.150 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:20:12.150 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.150 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:12.150 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:20:12.151 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.151 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.151 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.151 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:20:12.151 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:20:12.151 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:12.152 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:12.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.152 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:12.152 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:12.152 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:12.152 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:12.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.153 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:12.153 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:20:12.153 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.153 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:12.154 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:20:12.154 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.154 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.154 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.154 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:20:12.155 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:20:12.155 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:12.155 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:12.155 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.155 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.155 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:20:12.156 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:20:12.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.156 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:12.156 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:12.156 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:12.156 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.156 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.156 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:20:12.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.157 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:12.157 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:12.157 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:20:12.157 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.157 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.157 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:20:12.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.158 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:12.158 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:12.158 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:12.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.158 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.158 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:20:12.159 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:20:12.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.263+0000 7fa3f1b47700 1 Processor -- start 2020-02-11T16:20:12.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.263+0000 7fa3f1b47700 1 -- start start 2020-02-11T16:20:12.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3f1b47700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa3ec05c1f0 0x7fa3ec09df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:12.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3f1b47700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec09e7e0 con 0x7fa3ec139050 2020-02-11T16:20:12.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3f1b47700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec0a4cd0 con 0x7fa3ec0a6bf0 2020-02-11T16:20:12.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3f1b47700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec09e540 con 0x7fa3ec05c1f0 2020-02-11T16:20:12.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3eaffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa3ec0a6bf0 0x7fa3ec0a45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44984/0 (socket says 172.21.15.88:44984) 2020-02-11T16:20:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3eaffd700 1 -- 172.21.15.88:0/2645850116 learned_addr learned my addr 172.21.15.88:0/2645850116 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3ebfff700 1 -- 172.21.15.88:0/2645850116 >> v1:172.21.15.52:6789/0 conn(0x7fa3ec139050 legacy=0x7fa3ec1394e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:20:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3eb7fe700 1 -- 172.21.15.88:0/2645850116 >> v2:172.21.15.52:3300/0 conn(0x7fa3ec05c1f0 msgr2=0x7fa3ec09df50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/2645850116 >> v2:172.21.15.52:3300/0 conn(0x7fa3ec05c1f0 0x7fa3ec09df50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:20:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745650106 0 0) 0x7fa3ec0a4cd0 con 0x7fa3ec0a6bf0 2020-02-11T16:20:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.264+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d8003230 con 0x7fa3ec0a6bf0 2020-02-11T16:20:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1999714421 0 0) 0x7fa3d8003230 con 0x7fa3ec0a6bf0 2020-02-11T16:20:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 >> v2:172.21.15.52:3300/0 conn(0x7fa3ec05c1f0 msgr2=0x7fa3ec09df50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:20:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 --2- 172.21.15.88:0/2645850116 >> v2:172.21.15.52:3300/0 conn(0x7fa3ec05c1f0 0x7fa3ec09df50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 >> v1:172.21.15.52:6789/0 conn(0x7fa3ec139050 legacy=0x7fa3ec1394e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:20:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec0a4120 con 0x7fa3ec0a6bf0 2020-02-11T16:20:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa3e00016d0 con 0x7fa3ec0a6bf0 2020-02-11T16:20:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 >> v1:172.21.15.88:6789/0 conn(0x7fa3ec0a6bf0 legacy=0x7fa3ec0a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 0x7fa3d8003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8004040 0x7fa3d8004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3d8004a80 0x7fa3d8004f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec09e540 con 0x7fa3d8004a80 2020-02-11T16:20:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d800b860 con 0x7fa3d8003720 2020-02-11T16:20:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d800ba20 con 0x7fa3d8004040 2020-02-11T16:20:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 0x7fa3d8003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ebfff700 1 -- 172.21.15.88:0/2645850116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3d8004a80 msgr2=0x7fa3d8004f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ebfff700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3d8004a80 0x7fa3d8004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:20:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 -- 172.21.15.88:0/2645850116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8004040 msgr2=0x7fa3d8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8004040 0x7fa3d8004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 -- 172.21.15.88:0/2645850116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3d8004a80 msgr2=0x7fa3d8004f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:20:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3d8004a80 0x7fa3d8004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ebfff700 1 -- 172.21.15.88:0/2645850116 reap_dead start 2020-02-11T16:20:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 -- 172.21.15.88:0/2645850116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8003230 con 0x7fa3d8003720 2020-02-11T16:20:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 0x7fa3d8003b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa3dc005680 tx=0x7fa3dc008810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 0x7fa3d8003b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa3dc005680 tx=0x7fa3dc008810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 0x7fa3d8003b20 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3dc008810).ready entity=mon.1 client_cookie=f728ec13e2a64971 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 0x7fa3d8003b20 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3dc008810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc003d40 con 0x7fa3d8003720 2020-02-11T16:20:12.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 0x7fa3d8003b20 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3dc008810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 0x7fa3d8003b20 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3dc008810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc008880 con 0x7fa3d8003720 2020-02-11T16:20:12.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3ea7fc700 1 -- 172.21.15.88:0/2645850116 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc003ea0 con 0x7fa3d8003720 2020-02-11T16:20:12.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3f1b47700 1 -- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 msgr2=0x7fa3d8003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.265+0000 7fa3f1b47700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 0x7fa3d8003b20 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3dc008810).stop 2020-02-11T16:20:12.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.266+0000 7fa3f1b47700 1 -- 172.21.15.88:0/2645850116 shutdown_connections 2020-02-11T16:20:12.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.266+0000 7fa3f1b47700 1 --2- 172.21.15.88:0/2645850116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d8003720 0x7fa3d8003b20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:12.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.266+0000 7fa3f1b47700 1 -- 172.21.15.88:0/2645850116 >> 172.21.15.88:0/2645850116 conn(0x7fa3ec0ab400 msgr2=0x7fa3ec0a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:12.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.266+0000 7fa3f1b47700 1 -- 172.21.15.88:0/2645850116 shutdown_connections 2020-02-11T16:20:12.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.266+0000 7fa3f1b47700 1 -- 172.21.15.88:0/2645850116 wait complete. 2020-02-11T16:20:12.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.267+0000 7fa3f1b47700 1 Processor -- start 2020-02-11T16:20:12.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.267+0000 7fa3f1b47700 1 -- start start 2020-02-11T16:20:12.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.267+0000 7fa3f1b47700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:12.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.267+0000 7fa3f1b47700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa3ec137800 0x7fa3ec065590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:12.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.267+0000 7fa3f1b47700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec05aa00 con 0x7fa3ec1464e0 2020-02-11T16:20:12.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.267+0000 7fa3f1b47700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec143290 con 0x7fa3ec137800 2020-02-11T16:20:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.267+0000 7fa3f1b47700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec143530 con 0x7fa3d8003720 2020-02-11T16:20:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eaffd700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fa3ec137800 msgr2=0x7fa3ec065590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:20:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3ebfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa3ec1464e0 0x7fa3ec146950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45000/0 (socket says 172.21.15.88:45000) 2020-02-11T16:20:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3ebfff700 1 -- 172.21.15.88:0/4013078715 learned_addr learned my addr 172.21.15.88:0/4013078715 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> v2:172.21.15.52:3300/0 conn(0x7fa3ec137800 0x7fa3ec065590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:20:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55860928 0 0) 0x7fa3ec05aa00 con 0x7fa3ec1464e0 2020-02-11T16:20:12.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3cc002fe0 con 0x7fa3ec1464e0 2020-02-11T16:20:12.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 100380907 0 0) 0x7fa3cc002fe0 con 0x7fa3ec1464e0 2020-02-11T16:20:12.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa3ec05aa00 con 0x7fa3ec1464e0 2020-02-11T16:20:12.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa3e40040b0 con 0x7fa3ec1464e0 2020-02-11T16:20:12.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 -- 172.21.15.88:0/4013078715 >> v2:172.21.15.52:3300/0 conn(0x7fa3ec137800 msgr2=0x7fa3ec065590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:20:12.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/4013078715 >> v2:172.21.15.52:3300/0 conn(0x7fa3ec137800 0x7fa3ec065590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:12.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 -- 172.21.15.88:0/4013078715 >> v1:172.21.15.88:6789/0 conn(0x7fa3ec1464e0 legacy=0x7fa3ec146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 -- 172.21.15.88:0/4013078715 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec1437d0 con 0x7fa3d8003720 2020-02-11T16:20:12.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3d800bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3d800bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3d800bca0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3d800bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc00f3e0 con 0x7fa3d8003720 2020-02-11T16:20:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3d800bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3f1b47700 1 -- 172.21.15.88:0/4013078715 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec137db0 con 0x7fa3d8003720 2020-02-11T16:20:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc00f540 con 0x7fa3d8003720 2020-02-11T16:20:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3d800bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc00f6b0 con 0x7fa3d8003720 2020-02-11T16:20:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.268+0000 7fa3f1b47700 1 -- 172.21.15.88:0/4013078715 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec0659f0 con 0x7fa3d8003720 2020-02-11T16:20:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.269+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3d800bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.269+0000 7fa3f1b47700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 0x7fa3ec134af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.269+0000 7fa3f1b47700 1 -- 172.21.15.88:0/4013078715 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec143150 con 0x7fa3ec147060 2020-02-11T16:20:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.269+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa3dc0058b0 con 0x7fa3d8003720 2020-02-11T16:20:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.269+0000 7fa3eb7fe700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3d800bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.269+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 0x7fa3ec134af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3e8ff9700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa3cc03a1a0 0x7fa3cc03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa3dc049df0 con 0x7fa3d8003720 2020-02-11T16:20:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3ebfff700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa3cc03a1a0 0x7fa3cc03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3eaffd700 1 -- 172.21.15.88:0/4013078715 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3ec1439d0 con 0x7fa3ec147060 2020-02-11T16:20:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 0x7fa3ec134af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e0001e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 0x7fa3ec134af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e0001e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 0x7fa3ec134af0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e0001e50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:12.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3ebfff700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa3cc03a1a0 0x7fa3cc03c660 crc :-1 s=READY pgs=360 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:12.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 0x7fa3ec134af0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e0001e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e000ca10 con 0x7fa3ec147060 2020-02-11T16:20:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 0x7fa3ec134af0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e0001e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa3e000cb70 con 0x7fa3ec147060 2020-02-11T16:20:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 msgr2=0x7fa3ec134af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3e8ff9700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 0x7fa3ec134af0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e0001e50).stop 2020-02-11T16:20:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 msgr2=0x7fa3ec134af0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.270+0000 7fa3e8ff9700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec147060 0x7fa3ec134af0 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e0001e50).stop 2020-02-11T16:20:12.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.278+0000 7fa3f1b47700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 0x7fa3ec0a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.278+0000 7fa3f1b47700 1 -- 172.21.15.88:0/4013078715 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec05c630 con 0x7fa3ec0a8810 2020-02-11T16:20:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.279+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 0x7fa3ec0a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.279+0000 7fa3eaffd700 1 -- 172.21.15.88:0/4013078715 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa3ec0565b0 con 0x7fa3ec0a8810 2020-02-11T16:20:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.279+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 0x7fa3ec0a8c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e00011d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.279+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 0x7fa3ec0a8c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e00011d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.279+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 0x7fa3ec0a8c20 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e00011d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.279+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 0x7fa3ec0a8c20 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e00011d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.279+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e0012a20 con 0x7fa3ec0a8810 2020-02-11T16:20:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3eaffd700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 0x7fa3ec0a8c20 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e00011d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7fa3e0012b80 con 0x7fa3ec0a8810 2020-02-11T16:20:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 msgr2=0x7fa3ec0a8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3e8ff9700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 0x7fa3ec0a8c20 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e00011d0).stop 2020-02-11T16:20:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3e8ff9700 1 -- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 msgr2=0x7fa3ec0a8c20 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3e8ff9700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3ec0a8810 0x7fa3ec0a8c20 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0x7fa3e0001190 tx=0x7fa3e00011d0).stop 2020-02-11T16:20:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3f1b47700 1 -- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa3cc03a1a0 msgr2=0x7fa3cc03c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3f1b47700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa3cc03a1a0 0x7fa3cc03c660 crc :-1 s=READY pgs=360 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3f1b47700 1 -- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 msgr2=0x7fa3ec0650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3f1b47700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fa3dc005680 tx=0x7fa3d800bca0).stop 2020-02-11T16:20:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3ebfff700 1 -- 172.21.15.88:0/4013078715 reap_dead start 2020-02-11T16:20:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3f1b47700 1 -- 172.21.15.88:0/4013078715 shutdown_connections 2020-02-11T16:20:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3f1b47700 1 --2- 172.21.15.88:0/4013078715 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3d8003720 0x7fa3ec0650c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:12.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3f1b47700 1 -- 172.21.15.88:0/4013078715 >> 172.21.15.88:0/4013078715 conn(0x7fa3ec0ab400 msgr2=0x7fa3ec0a44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:12.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3f1b47700 1 -- 172.21.15.88:0/4013078715 shutdown_connections 2020-02-11T16:20:12.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:12.280+0000 7fa3f1b47700 1 -- 172.21.15.88:0/4013078715 wait complete. 2020-02-11T16:20:12.302 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:20:12.302 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:12.303 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:12.303 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:20:12.303 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 116, 2020-02-11T16:20:12.303 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:20:12.303 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:20:12.303 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:20:12.303 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.304 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:20:12.304 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:12.304 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:20:12.304 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:20:12.304 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:12.304 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:12.304 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:20:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:20:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:20:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:20:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:20:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:20:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:20:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:20:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:20:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:20:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:20:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:20:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:20:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:20:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:20:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:20:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:20:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:20:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:20:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:12.315 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:12.315 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:12.315 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:12.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:20:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:20:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:20:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:20:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:20:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:20:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.322 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:20:12.322 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:20:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:20:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:20:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:20:12.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.325 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:12.325 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:20:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:20:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:20:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:20:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:20:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:20:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:12.330 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:12.330 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:12.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.330 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:12.331 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:12.331 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:20:12.331 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:20:14.284 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:20:14.287 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:20:32.332 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:20:32.332 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2020-02-11T16:20:32.332 INFO:tasks.ceph.mon.b:Restarting daemon 2020-02-11T16:20:32.332 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-02-11T16:20:32.335 INFO:tasks.ceph.mon.b:Started 2020-02-11T16:20:32.335 INFO:tasks.mon_thrash:Sending STOP to mon a 2020-02-11T16:20:32.336 INFO:tasks.ceph.mon.a:Sent signal 19 2020-02-11T16:20:32.336 INFO:tasks.mon_thrash:Sending STOP to mon c 2020-02-11T16:20:32.336 INFO:tasks.ceph.mon.c:Sent signal 19 2020-02-11T16:20:32.336 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2020-02-11T16:20:44.349 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:20:44.352 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:20:47.337 INFO:tasks.mon_thrash:Sending CONT to mon a 2020-02-11T16:20:47.337 INFO:tasks.ceph.mon.a:Sent signal 18 2020-02-11T16:20:47.338 INFO:tasks.mon_thrash:Sending CONT to mon c 2020-02-11T16:20:47.338 INFO:tasks.ceph.mon.c:Sent signal 18 2020-02-11T16:20:47.338 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:20:47.338 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:20:47.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.451+0000 7f5fd8f46700 1 Processor -- start 2020-02-11T16:20:47.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.451+0000 7f5fd8f46700 1 -- start start 2020-02-11T16:20:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.452+0000 7f5fd8f46700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.452+0000 7f5fd8f46700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.452+0000 7f5fd8f46700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 0x7f5fd412e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.452+0000 7f5fd8f46700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd40a3570 con 0x7f5fd40a5de0 2020-02-11T16:20:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.452+0000 7f5fd8f46700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd40a3810 con 0x7f5fd40a18a0 2020-02-11T16:20:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.452+0000 7f5fd8f46700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40a3ab0 con 0x7f5fd412e3a0 2020-02-11T16:20:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.452+0000 7f5fd259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.452+0000 7f5fd259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57394/0 (socket says 172.21.15.88:57394) 2020-02-11T16:20:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.452+0000 7f5fd259c700 1 -- 172.21.15.88:0/1866636672 learned_addr learned my addr 172.21.15.88:0/1866636672 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:20:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd259c700 1 -- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 msgr2=0x7f5fd40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:20:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd259c700 1 -- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 msgr2=0x7f5fd40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:20:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:20:47.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:20:47.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd2d9d700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 0x7f5fd412e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd1d9b700 1 -- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 msgr2=0x7f5fd40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:20:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd2d9d700 1 -- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 msgr2=0x7f5fd412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:20:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd1d9b700 1 -- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 msgr2=0x7f5fd40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:20:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd2d9d700 1 -- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 msgr2=0x7f5fd412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:20:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd2d9d700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 0x7f5fd412e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:20:47.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:20:47.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:20:47.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.453+0000 7f5fd2d9d700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 0x7f5fd412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:20:47.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:47.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd259c700 1 -- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 msgr2=0x7f5fd40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:20:47.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd259c700 1 -- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 msgr2=0x7f5fd40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:20:47.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:20:47.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:20:47.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:47.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd2d9d700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 0x7f5fd412e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:47.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd2d9d700 1 -- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 msgr2=0x7f5fd412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:20:47.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd1d9b700 1 -- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 msgr2=0x7f5fd40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:20:47.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd2d9d700 1 -- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 msgr2=0x7f5fd412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:20:47.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd1d9b700 1 -- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 msgr2=0x7f5fd40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:20:47.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd2d9d700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 0x7f5fd412e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:20:47.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:20:47.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd2d9d700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 0x7f5fd412e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:20:47.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:47.654+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:20:48.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 -- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 msgr2=0x7f5fd412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:48.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 0x7f5fd412e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 -- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 msgr2=0x7f5fd40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 -- 172.21.15.88:0/1866636672 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd40a3d50 con 0x7f5fd40a18a0 2020-02-11T16:20:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:20:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5fc4002f30 tx=0x7f5fc400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5fc4002f30 tx=0x7f5fc400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f5fc4002f30 tx=0x7f5fc400ff30).ready entity=mon.1 client_cookie=df1102ad2f4d03f4 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f5fc4002f30 tx=0x7f5fc400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f5fc4002f30 tx=0x7f5fc400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd159a700 1 -- 172.21.15.88:0/1866636672 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fc4011740 con 0x7f5fd40a18a0 2020-02-11T16:20:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd259c700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f5fc4002f30 tx=0x7f5fc400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd159a700 1 -- 172.21.15.88:0/1866636672 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc40118a0 con 0x7f5fd40a18a0 2020-02-11T16:20:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd159a700 1 -- 172.21.15.88:0/1866636672 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fc4011c80 con 0x7f5fd40a18a0 2020-02-11T16:20:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd8f46700 1 -- 172.21.15.88:0/1866636672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a18a0 msgr2=0x7f5fd40a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.055+0000 7f5fd8f46700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f5fc4002f30 tx=0x7f5fc400ff30).stop 2020-02-11T16:20:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.056+0000 7f5fd8f46700 1 -- 172.21.15.88:0/1866636672 shutdown_connections 2020-02-11T16:20:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.056+0000 7f5fd8f46700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd412e3a0 0x7f5fd412e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.056+0000 7f5fd8f46700 1 --2- 172.21.15.88:0/1866636672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a18a0 0x7f5fd40a6dd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.056+0000 7f5fd8f46700 1 --2- 172.21.15.88:0/1866636672 >> v2:172.21.15.52:3300/0 conn(0x7f5fd40a5de0 0x7f5fd40a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.056+0000 7f5fd8f46700 1 -- 172.21.15.88:0/1866636672 >> 172.21.15.88:0/1866636672 conn(0x7f5fd409d110 msgr2=0x7f5fd409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.056+0000 7f5fd8f46700 1 -- 172.21.15.88:0/1866636672 shutdown_connections 2020-02-11T16:20:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.056+0000 7f5fd8f46700 1 -- 172.21.15.88:0/1866636672 wait complete. 2020-02-11T16:20:48.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd8f46700 1 Processor -- start 2020-02-11T16:20:48.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd8f46700 1 -- start start 2020-02-11T16:20:48.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd8f46700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd40a18a0 0x7f5fd41378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd8f46700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a5de0 0x7f5fd4134420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd8f46700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5fd412e3a0 0x7f5fd4134880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd8f46700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd4137d20 con 0x7f5fd412e3a0 2020-02-11T16:20:48.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd8f46700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd4136090 con 0x7f5fd40a5de0 2020-02-11T16:20:48.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd8f46700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd41370a0 con 0x7f5fd40a18a0 2020-02-11T16:20:48.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd1d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a5de0 0x7f5fd4134420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd1d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a5de0 0x7f5fd4134420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57410/0 (socket says 172.21.15.88:57410) 2020-02-11T16:20:48.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd1d9b700 1 -- 172.21.15.88:0/883842727 learned_addr learned my addr 172.21.15.88:0/883842727 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:20:48.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd259c700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd40a18a0 0x7f5fd41378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.058+0000 7f5fd2d9d700 1 --2- 172.21.15.88:0/883842727 >> v2:172.21.15.52:3300/0 conn(0x7f5fd412e3a0 0x7f5fd4134880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 -- 172.21.15.88:0/883842727 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd40a18a0 msgr2=0x7f5fd41378c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd40a18a0 0x7f5fd41378c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 -- 172.21.15.88:0/883842727 >> v2:172.21.15.52:3300/0 conn(0x7f5fd412e3a0 msgr2=0x7f5fd4134880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> v2:172.21.15.52:3300/0 conn(0x7f5fd412e3a0 0x7f5fd4134880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 -- 172.21.15.88:0/883842727 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd412e010 con 0x7f5fd40a5de0 2020-02-11T16:20:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> v2:172.21.15.88:3300/0 conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fcb7fe700 1 -- 172.21.15.88:0/883842727 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fbc0127a0 con 0x7f5fd40a5de0 2020-02-11T16:20:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fcb7fe700 1 -- 172.21.15.88:0/883842727 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc012900 con 0x7f5fd40a5de0 2020-02-11T16:20:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd8f46700 1 -- 172.21.15.88:0/883842727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd412da60 con 0x7f5fd40a5de0 2020-02-11T16:20:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fcb7fe700 1 -- 172.21.15.88:0/883842727 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fbc012ce0 con 0x7f5fd40a5de0 2020-02-11T16:20:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.059+0000 7f5fd8f46700 1 -- 172.21.15.88:0/883842727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd4133ae0 con 0x7f5fd40a5de0 2020-02-11T16:20:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.060+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.060+0000 7f5fcb7fe700 1 -- 172.21.15.88:0/883842727 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5fbc007170 con 0x7f5fd40a5de0 2020-02-11T16:20:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.060+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.061+0000 7f5fcb7fe700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5fb8039d00 0x7f5fb803c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.061+0000 7f5fcb7fe700 1 -- 172.21.15.88:0/883842727 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5fbc049800 con 0x7f5fd40a5de0 2020-02-11T16:20:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.061+0000 7f5fd8f46700 1 -- 172.21.15.88:0/883842727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd4134dd0 con 0x7f5fd40a5de0 2020-02-11T16:20:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.061+0000 7f5fd259c700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5fb8039d00 0x7f5fb803c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.061+0000 7f5fd259c700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5fb8039d00 0x7f5fb803c1c0 crc :-1 s=READY pgs=371 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.065+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.065+0000 7f5fcb7fe700 1 -- 172.21.15.88:0/883842727 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f5fbc02ee00 con 0x7f5fd40a5de0 2020-02-11T16:20:48.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.249+0000 7f5fd8f46700 1 -- 172.21.15.88:0/883842727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5fd40565b0 con 0x7f5fd40a5de0 2020-02-11T16:20:48.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.249+0000 7f5fd1d9b700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.250+0000 7f5fcb7fe700 1 -- 172.21.15.88:0/883842727 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f5fbc007400 con 0x7f5fd40a5de0 2020-02-11T16:20:48.251 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":122,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:20:48.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 -- 172.21.15.88:0/883842727 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5fb8039d00 msgr2=0x7f5fb803c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5fb8039d00 0x7f5fb803c1c0 crc :-1 s=READY pgs=371 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 -- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 msgr2=0x7f5fd4134420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 0x7f5fd4134420 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f5fbc002f30 tx=0x7f5fbc010c10).stop 2020-02-11T16:20:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 -- 172.21.15.88:0/883842727 shutdown_connections 2020-02-11T16:20:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5fb8039d00 0x7f5fb803c1c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 --2- 172.21.15.88:0/883842727 >> v2:172.21.15.52:3300/0 conn(0x7f5fd412e3a0 0x7f5fd4134880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5fd40a18a0 0x7f5fd41378c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 --2- 172.21.15.88:0/883842727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fd40a5de0 0x7f5fd4134420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 -- 172.21.15.88:0/883842727 >> 172.21.15.88:0/883842727 conn(0x7f5fd409d110 msgr2=0x7f5fd40a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:48.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 -- 172.21.15.88:0/883842727 shutdown_connections 2020-02-11T16:20:48.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.251+0000 7f5fd8f46700 1 -- 172.21.15.88:0/883842727 wait complete. 2020-02-11T16:20:48.264 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":122,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:20:48.264 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:20:48.264 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:20:48.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.368+0000 7f5350e74700 1 Processor -- start 2020-02-11T16:20:48.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.368+0000 7f5350e74700 1 -- start start 2020-02-11T16:20:48.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.369+0000 7f5350e74700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f534c0a5de0 0x7f534c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:48.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.369+0000 7f5350e74700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c0a31b0 con 0x7f534c0a18a0 2020-02-11T16:20:48.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.369+0000 7f5350e74700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c0a3570 con 0x7f534c134a50 2020-02-11T16:20:48.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.369+0000 7f5350e74700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c0a3810 con 0x7f534c0a5de0 2020-02-11T16:20:48.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.369+0000 7f534ad9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f534c134a50 0x7f534c134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45042/0 (socket says 172.21.15.88:45042) 2020-02-11T16:20:48.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.369+0000 7f534ad9d700 1 -- 172.21.15.88:0/2698609930 learned_addr learned my addr 172.21.15.88:0/2698609930 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:48.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.369+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2698609930 >> v2:172.21.15.52:3300/0 conn(0x7f534c0a5de0 0x7f534c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.369+0000 7f534959a700 1 -- 172.21.15.88:0/2698609930 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896723912 0 0) 0x7f534c0a3570 con 0x7f534c134a50 2020-02-11T16:20:48.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.369+0000 7f534959a700 1 -- 172.21.15.88:0/2698609930 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5330003230 con 0x7f534c134a50 2020-02-11T16:20:48.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5349d9b700 1 -- 172.21.15.88:0/2698609930 >> v1:172.21.15.88:6789/0 conn(0x7f534c134a50 legacy=0x7f534c134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f534959a700 1 -- 172.21.15.88:0/2698609930 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3543759924 0 0) 0x7f5330003230 con 0x7f534c134a50 2020-02-11T16:20:48.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5349d9b700 1 -- 172.21.15.88:0/2698609930 >> v1:172.21.15.52:6789/0 conn(0x7f534c0a18a0 legacy=0x7f534c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5349d9b700 1 -- 172.21.15.88:0/2698609930 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0a3ab0 con 0x7f534c0a5de0 2020-02-11T16:20:48.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2698609930 >> v2:172.21.15.52:3300/0 conn(0x7f534c0a5de0 0x7f534c0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f53400010d0 tx=0x7f533c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2698609930 >> v2:172.21.15.52:3300/0 conn(0x7f534c0a5de0 0x7f534c0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f53400010d0 tx=0x7f533c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2698609930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f534c0a5de0 0x7f534c0a6260 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c0088e0).ready entity=mon.0 client_cookie=e565953e4abf9b5c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2698609930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f534c0a5de0 0x7f534c0a6260 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f534959a700 1 -- 172.21.15.88:0/2698609930 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5344001a50 con 0x7f534c0a5de0 2020-02-11T16:20:48.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2698609930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f534c0a5de0 0x7f534c0a6260 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f534959a700 1 -- 172.21.15.88:0/2698609930 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c008b40 con 0x7f534c0a5de0 2020-02-11T16:20:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2698609930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f534c0a5de0 0x7f534c0a6260 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5350e74700 1 -- 172.21.15.88:0/2698609930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f534c0a5de0 msgr2=0x7f534c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f5350e74700 1 --2- 172.21.15.88:0/2698609930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f534c0a5de0 0x7f534c0a6260 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c0088e0).stop 2020-02-11T16:20:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.370+0000 7f534959a700 1 -- 172.21.15.88:0/2698609930 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f533c008ea0 con 0x7f534c0a5de0 2020-02-11T16:20:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.371+0000 7f5350e74700 1 -- 172.21.15.88:0/2698609930 shutdown_connections 2020-02-11T16:20:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.371+0000 7f5350e74700 1 --2- 172.21.15.88:0/2698609930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f534c0a5de0 0x7f534c0a6260 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.371+0000 7f5350e74700 1 -- 172.21.15.88:0/2698609930 >> 172.21.15.88:0/2698609930 conn(0x7f534c09d110 msgr2=0x7f534c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.371+0000 7f5350e74700 1 -- 172.21.15.88:0/2698609930 shutdown_connections 2020-02-11T16:20:48.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.371+0000 7f5350e74700 1 -- 172.21.15.88:0/2698609930 wait complete. 2020-02-11T16:20:48.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.371+0000 7f5350e74700 1 Processor -- start 2020-02-11T16:20:48.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.371+0000 7f5350e74700 1 -- start start 2020-02-11T16:20:48.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.372+0000 7f5350e74700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.372+0000 7f5350e74700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f534c0a5de0 0x7f534c146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.372+0000 7f5350e74700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c0a92f0 con 0x7f534c134a50 2020-02-11T16:20:48.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.372+0000 7f5350e74700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c09f900 con 0x7f534c0a5de0 2020-02-11T16:20:48.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.372+0000 7f5350e74700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c09f560 con 0x7f534c0a18a0 2020-02-11T16:20:48.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.372+0000 7f534a59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.372+0000 7f5349d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f534c0a5de0 0x7f534c146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.372+0000 7f534a59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:51746/0 (socket says 172.21.15.88:51746) 2020-02-11T16:20:48.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.372+0000 7f534a59c700 1 -- 172.21.15.88:0/2368103527 learned_addr learned my addr 172.21.15.88:0/2368103527 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:20:48.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302025425 0 0) 0x7f534c0a92f0 con 0x7f534c134a50 2020-02-11T16:20:48.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5328002fe0 con 0x7f534c134a50 2020-02-11T16:20:48.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f534a59c700 1 -- 172.21.15.88:0/2368103527 >> v2:172.21.15.52:3300/0 conn(0x7f534c0a5de0 msgr2=0x7f534c146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f534a59c700 1 --2- 172.21.15.88:0/2368103527 >> v2:172.21.15.52:3300/0 conn(0x7f534c0a5de0 0x7f534c146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f534a59c700 1 -- 172.21.15.88:0/2368103527 >> v1:172.21.15.52:6789/0 conn(0x7f534c134a50 legacy=0x7f534c146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f534a59c700 1 -- 172.21.15.88:0/2368103527 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c09e2f0 con 0x7f534c0a18a0 2020-02-11T16:20:48.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f534a59c700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5340001190 tx=0x7f5340010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f534a59c700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5340001190 tx=0x7f5340010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f534a59c700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f5340001190 tx=0x7f5340010af0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f534a59c700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f5340001190 tx=0x7f5340010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f534000cc20 con 0x7f534c0a18a0 2020-02-11T16:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f534a59c700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f5340001190 tx=0x7f5340010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f5350e74700 1 -- 172.21.15.88:0/2368103527 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c09fb50 con 0x7f534c0a18a0 2020-02-11T16:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000cd80 con 0x7f534c0a18a0 2020-02-11T16:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f534a59c700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f5340001190 tx=0x7f5340010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53400122d0 con 0x7f534c0a18a0 2020-02-11T16:20:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.373+0000 7f5350e74700 1 -- 172.21.15.88:0/2368103527 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c05aa30 con 0x7f534c0a18a0 2020-02-11T16:20:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f534a59c700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f5340001190 tx=0x7f5340010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f5350e74700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 0x7f534c147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f5350e74700 1 -- 172.21.15.88:0/2368103527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c05e2f0 con 0x7f534c131940 2020-02-11T16:20:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5340012550 con 0x7f534c0a18a0 2020-02-11T16:20:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f534a59c700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f5340001190 tx=0x7f5340010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 0x7f534c147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f533b7fe700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5328039f50 0x7f532803c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5340049610 con 0x7f534c0a18a0 2020-02-11T16:20:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f5349d9b700 1 -- 172.21.15.88:0/2368103527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f534c09fcf0 con 0x7f534c131940 2020-02-11T16:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 0x7f534c147080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f534ad9d700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5328039f50 0x7f532803c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 0x7f534c147080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.374+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 0x7f534c147080 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.375+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 0x7f534c147080 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.375+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f533c011c00 con 0x7f534c131940 2020-02-11T16:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.375+0000 7f534ad9d700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5328039f50 0x7f532803c410 crc :-1 s=READY pgs=372 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.375+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 0x7f534c147080 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.375+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f533c011d60 con 0x7f534c131940 2020-02-11T16:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.375+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 msgr2=0x7f534c147080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.375+0000 7f533b7fe700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 0x7f534c147080 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).stop 2020-02-11T16:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.375+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 msgr2=0x7f534c147080 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.375+0000 7f533b7fe700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c131940 0x7f534c147080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.383+0000 7f5350e74700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 0x7f534c0a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.383+0000 7f5350e74700 1 -- 172.21.15.88:0/2368103527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0565b0 con 0x7f534c09fe90 2020-02-11T16:20:48.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.383+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 0x7f534c0a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.383+0000 7f5349d9b700 1 -- 172.21.15.88:0/2368103527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f534c0a72c0 con 0x7f534c09fe90 2020-02-11T16:20:48.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.383+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 0x7f534c0a4a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.383+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 0x7f534c0a4a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.383+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 0x7f534c0a4a60 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.383+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 0x7f534c0a4a60 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.383+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f533c005ea0 con 0x7f534c09fe90 2020-02-11T16:20:48.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f5349d9b700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 0x7f534c0a4a60 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4020 (secure 0 0 0) 0x7f533c015640 con 0x7f534c09fe90 2020-02-11T16:20:48.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 msgr2=0x7f534c0a4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f533b7fe700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 0x7f534c0a4a60 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).stop 2020-02-11T16:20:48.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f533b7fe700 1 -- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 msgr2=0x7f534c0a4a60 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:48.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f533b7fe700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f534c09fe90 0x7f534c0a4a60 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0x7f53400010d0 tx=0x7f533c007f10).stop 2020-02-11T16:20:48.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f5350e74700 1 -- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5328039f50 msgr2=0x7f532803c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f5350e74700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5328039f50 0x7f532803c410 crc :-1 s=READY pgs=372 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f5350e74700 1 -- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 msgr2=0x7f534c05a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f5350e74700 1 --2- 172.21.15.88:0/2368103527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f534c0a18a0 0x7f534c05a5d0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f5340001190 tx=0x7f5340010af0).stop 2020-02-11T16:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f534ad9d700 1 -- 172.21.15.88:0/2368103527 reap_dead start 2020-02-11T16:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f534ad9d700 1 -- 172.21.15.88:0/2368103527 reap_dead start 2020-02-11T16:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f5350e74700 1 -- 172.21.15.88:0/2368103527 shutdown_connections 2020-02-11T16:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f5350e74700 1 -- 172.21.15.88:0/2368103527 >> 172.21.15.88:0/2368103527 conn(0x7f534c09d110 msgr2=0x7f534c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f5350e74700 1 -- 172.21.15.88:0/2368103527 shutdown_connections 2020-02-11T16:20:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.384+0000 7f5350e74700 1 -- 172.21.15.88:0/2368103527 wait complete. 2020-02-11T16:20:48.397 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:20:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:20:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 122, 2020-02-11T16:20:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:20:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:20:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:20:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:20:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.399 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:20:48.399 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:48.399 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:20:48.399 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:20:48.399 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:48.399 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:20:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:20:48.401 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:48.401 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:48.401 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:48.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:48.401 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:48.402 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:48.402 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.402 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:20:48.402 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:20:48.402 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:20:48.402 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:20:48.403 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:20:48.403 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:20:48.403 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:48.403 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:48.403 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:20:48.403 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:20:48.403 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:48.404 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:20:48.404 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:48.404 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:48.404 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:48.404 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:48.404 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:48.404 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:48.405 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.405 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:20:48.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.405 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:20:48.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.405 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:20:48.405 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:20:48.406 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:48.406 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:48.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.406 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:48.406 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:20:48.406 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.407 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:48.407 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:20:48.407 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.407 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.408 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.408 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:20:48.408 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:20:48.409 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:48.409 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:48.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.409 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:48.409 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:48.409 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:48.410 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:48.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.410 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:48.410 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:20:48.410 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.410 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:48.411 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:20:48.411 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.411 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.411 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.411 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:20:48.411 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:20:48.412 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:48.413 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:48.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.414 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:48.414 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:48.414 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:48.414 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:48.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.415 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:48.415 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:20:48.416 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.417 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:48.417 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:20:48.418 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.418 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.418 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.418 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:20:48.419 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:20:48.419 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:48.419 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:48.419 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.420 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.420 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:20:48.420 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:20:48.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.421 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:48.421 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:48.421 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:48.421 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.421 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.421 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:20:48.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.422 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:48.422 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:48.422 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:20:48.422 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.422 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.422 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:20:48.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.423 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:48.423 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:48.423 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:48.423 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.423 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.423 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.423 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:20:48.425 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:20:48.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.529+0000 7f6ea816d700 1 Processor -- start 2020-02-11T16:20:48.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.529+0000 7f6ea816d700 1 -- start start 2020-02-11T16:20:48.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea816d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ea00a6260 0x7f6ea0135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:48.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea816d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea00a31b0 con 0x7f6ea00a18a0 2020-02-11T16:20:48.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea816d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea00a3570 con 0x7f6ea00a5de0 2020-02-11T16:20:48.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea816d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea00a3810 con 0x7f6ea00a6260 2020-02-11T16:20:48.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea5708700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6ea00a5de0 0x7f6ea0134a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45060/0 (socket says 172.21.15.88:45060) 2020-02-11T16:20:48.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea5708700 1 -- 172.21.15.88:0/3924957324 learned_addr learned my addr 172.21.15.88:0/3924957324 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:48.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea670a700 1 --2- 172.21.15.88:0/3924957324 >> v2:172.21.15.52:3300/0 conn(0x7f6ea00a6260 0x7f6ea0135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea4f07700 1 -- 172.21.15.88:0/3924957324 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274338010 0 0) 0x7f6ea00a3570 con 0x7f6ea00a5de0 2020-02-11T16:20:48.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea4f07700 1 -- 172.21.15.88:0/3924957324 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e88003230 con 0x7f6ea00a5de0 2020-02-11T16:20:48.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea4f07700 1 -- 172.21.15.88:0/3924957324 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540813783 0 0) 0x7f6ea00a31b0 con 0x7f6ea00a18a0 2020-02-11T16:20:48.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea4f07700 1 -- 172.21.15.88:0/3924957324 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea00a3570 con 0x7f6ea00a18a0 2020-02-11T16:20:48.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea670a700 1 -- 172.21.15.88:0/3924957324 >> v1:172.21.15.88:6789/0 conn(0x7f6ea00a5de0 legacy=0x7f6ea0134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea670a700 1 -- 172.21.15.88:0/3924957324 >> v1:172.21.15.52:6789/0 conn(0x7f6ea00a18a0 legacy=0x7f6ea00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea670a700 1 -- 172.21.15.88:0/3924957324 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea00a3ab0 con 0x7f6ea00a6260 2020-02-11T16:20:48.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.530+0000 7f6ea670a700 1 --2- 172.21.15.88:0/3924957324 >> v2:172.21.15.52:3300/0 conn(0x7f6ea00a6260 0x7f6ea0135160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6e980032b0 tx=0x7f6e98008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea670a700 1 --2- 172.21.15.88:0/3924957324 >> v2:172.21.15.52:3300/0 conn(0x7f6ea00a6260 0x7f6ea0135160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6e980032b0 tx=0x7f6e98008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea670a700 1 --2- 172.21.15.88:0/3924957324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a6260 0x7f6ea0135160 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f6e980032b0 tx=0x7f6e98008c60).ready entity=mon.0 client_cookie=7f33868c22c094d6 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea670a700 1 --2- 172.21.15.88:0/3924957324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a6260 0x7f6ea0135160 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f6e980032b0 tx=0x7f6e98008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea4f07700 1 -- 172.21.15.88:0/3924957324 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e98011db0 con 0x7f6ea00a6260 2020-02-11T16:20:48.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea670a700 1 --2- 172.21.15.88:0/3924957324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a6260 0x7f6ea0135160 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f6e980032b0 tx=0x7f6e98008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea670a700 1 --2- 172.21.15.88:0/3924957324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a6260 0x7f6ea0135160 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f6e980032b0 tx=0x7f6e98008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea4f07700 1 -- 172.21.15.88:0/3924957324 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9800a160 con 0x7f6ea00a6260 2020-02-11T16:20:48.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea4f07700 1 -- 172.21.15.88:0/3924957324 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9800a500 con 0x7f6ea00a6260 2020-02-11T16:20:48.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea816d700 1 -- 172.21.15.88:0/3924957324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a6260 msgr2=0x7f6ea0135160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea816d700 1 --2- 172.21.15.88:0/3924957324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a6260 0x7f6ea0135160 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f6e980032b0 tx=0x7f6e98008c60).stop 2020-02-11T16:20:48.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea816d700 1 -- 172.21.15.88:0/3924957324 shutdown_connections 2020-02-11T16:20:48.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea816d700 1 --2- 172.21.15.88:0/3924957324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a6260 0x7f6ea0135160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea816d700 1 -- 172.21.15.88:0/3924957324 >> 172.21.15.88:0/3924957324 conn(0x7f6ea009d110 msgr2=0x7f6ea009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:48.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea816d700 1 -- 172.21.15.88:0/3924957324 shutdown_connections 2020-02-11T16:20:48.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.531+0000 7f6ea816d700 1 -- 172.21.15.88:0/3924957324 wait complete. 2020-02-11T16:20:48.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.532+0000 7f6ea816d700 1 Processor -- start 2020-02-11T16:20:48.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.532+0000 7f6ea816d700 1 -- start start 2020-02-11T16:20:48.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6ea816d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ea00a5de0 0x7f6ea0133f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6ea816d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea01343f0 con 0x7f6ea00a6260 2020-02-11T16:20:48.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6ea816d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea01331b0 con 0x7f6ea00a18a0 2020-02-11T16:20:48.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6ea816d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea0133450 con 0x7f6ea00a5de0 2020-02-11T16:20:48.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6ea5f09700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6ea00a18a0 0x7f6ea00a8f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45066/0 (socket says 172.21.15.88:45066) 2020-02-11T16:20:48.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6ea5f09700 1 -- 172.21.15.88:0/2343155666 learned_addr learned my addr 172.21.15.88:0/2343155666 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:48.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947526558 0 0) 0x7f6ea01331b0 con 0x7f6ea00a18a0 2020-02-11T16:20:48.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e80002fe0 con 0x7f6ea00a18a0 2020-02-11T16:20:48.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6ea5708700 1 --2- 172.21.15.88:0/2343155666 >> v2:172.21.15.52:3300/0 conn(0x7f6ea00a5de0 0x7f6ea0133f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1159075073 0 0) 0x7f6e80002fe0 con 0x7f6ea00a18a0 2020-02-11T16:20:48.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ea01331b0 con 0x7f6ea00a18a0 2020-02-11T16:20:48.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f6e90001980 con 0x7f6ea00a18a0 2020-02-11T16:20:48.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 >> v2:172.21.15.52:3300/0 conn(0x7f6ea00a5de0 msgr2=0x7f6ea0133f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 --2- 172.21.15.88:0/2343155666 >> v2:172.21.15.52:3300/0 conn(0x7f6ea00a5de0 0x7f6ea0133f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 >> v1:172.21.15.88:6789/0 conn(0x7f6ea00a18a0 legacy=0x7f6ea00a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 >> v1:172.21.15.52:6789/0 conn(0x7f6ea00a6260 legacy=0x7f6ea012f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6e800049b0 0x7f6e80004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e80003920 0x7f6e80003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea0133450 con 0x7f6e80003920 2020-02-11T16:20:48.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e80004690 con 0x7f6e800041e0 2020-02-11T16:20:48.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8000bbb0 con 0x7f6e800049b0 2020-02-11T16:20:48.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6ea5708700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e80003920 0x7f6e80003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.533+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6e800049b0 0x7f6e80004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 -- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6e800049b0 msgr2=0x7f6e80004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6e800049b0 0x7f6e80004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 -- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e80003920 msgr2=0x7f6e80003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e80003920 0x7f6e80003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 -- 172.21.15.88:0/2343155666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea01336f0 con 0x7f6e800041e0 2020-02-11T16:20:48.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea816d700 1 -- 172.21.15.88:0/2343155666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea0132ee0 con 0x7f6e800041e0 2020-02-11T16:20:48.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ea00a9820 tx=0x7f6ea012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 -- 172.21.15.88:0/2343155666 reap_dead start 2020-02-11T16:20:48.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea816d700 1 -- 172.21.15.88:0/2343155666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea0141bc0 con 0x7f6e800041e0 2020-02-11T16:20:48.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ea00a9820 tx=0x7f6ea012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f6ea00a9820 tx=0x7f6ea012f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6ea00a9820 tx=0x7f6ea012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9800ae80 con 0x7f6e800041e0 2020-02-11T16:20:48.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6ea00a9820 tx=0x7f6ea012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6ea00a9820 tx=0x7f6ea012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e98005c30 con 0x7f6e800041e0 2020-02-11T16:20:48.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e98007150 con 0x7f6e800041e0 2020-02-11T16:20:48.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.534+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6ea00a9820 tx=0x7f6ea012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6e980072b0 con 0x7f6e800041e0 2020-02-11T16:20:48.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6ea670a700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6ea00a9820 tx=0x7f6ea012f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6ea816d700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 0x7f6ea012f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6ea816d700 1 -- 172.21.15.88:0/2343155666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea005e2f0 con 0x7f6ea00a8f00 2020-02-11T16:20:48.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6e8effd700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e8003dbf0 0x7f6e800400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6e9804a250 con 0x7f6e800041e0 2020-02-11T16:20:48.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 0x7f6ea012f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6ea5708700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e8003dbf0 0x7f6e800400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6ea5f09700 1 -- 172.21.15.88:0/2343155666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ea00565b0 con 0x7f6ea00a8f00 2020-02-11T16:20:48.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 0x7f6ea012f980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6ea5708700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e8003dbf0 0x7f6e800400b0 crc :-1 s=READY pgs=373 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 0x7f6ea012f980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.535+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 0x7f6ea012f980 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.536+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 0x7f6ea012f980 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.536+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9000a540 con 0x7f6ea00a8f00 2020-02-11T16:20:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.536+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 0x7f6ea012f980 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.536+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6e90007f10 con 0x7f6ea00a8f00 2020-02-11T16:20:48.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.536+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 msgr2=0x7f6ea012f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.536+0000 7f6e8effd700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 0x7f6ea012f980 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).stop 2020-02-11T16:20:48.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.536+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 msgr2=0x7f6ea012f980 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:48.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.536+0000 7f6e8effd700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 0x7f6ea012f980 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).stop 2020-02-11T16:20:48.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.544+0000 7f6ea816d700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 0x7f6ea0141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.544+0000 7f6ea816d700 1 -- 172.21.15.88:0/2343155666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea0133590 con 0x7f6ea0128600 2020-02-11T16:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.544+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 0x7f6ea0141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.544+0000 7f6ea5f09700 1 -- 172.21.15.88:0/2343155666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6ea0134310 con 0x7f6ea0128600 2020-02-11T16:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 0x7f6ea0141d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 0x7f6ea0141d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 0x7f6ea0141d50 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 0x7f6ea0141d50 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e90005950 con 0x7f6ea0128600 2020-02-11T16:20:48.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6ea5f09700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 0x7f6ea0141d50 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3852 (secure 0 0 0) 0x7f6e90015e90 con 0x7f6ea0128600 2020-02-11T16:20:48.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 msgr2=0x7f6ea0141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6e8effd700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 0x7f6ea0141d50 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).stop 2020-02-11T16:20:48.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6e8effd700 1 -- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 msgr2=0x7f6ea0141d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:48.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.545+0000 7f6e8effd700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 0x7f6ea0141d50 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0x7f6e90001690 tx=0x7f6e90011530).stop 2020-02-11T16:20:48.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 -- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e8003dbf0 msgr2=0x7f6e800400b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e8003dbf0 0x7f6e800400b0 crc :-1 s=READY pgs=373 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 -- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 msgr2=0x7f6e8000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f6ea00a9820 tx=0x7f6ea012f3b0).stop 2020-02-11T16:20:48.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 -- 172.21.15.88:0/2343155666 shutdown_connections 2020-02-11T16:20:48.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6e8003dbf0 0x7f6e800400b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800041e0 0x7f6e8000b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea00a8f00 0x7f6ea012f980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 --2- 172.21.15.88:0/2343155666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea0128600 0x7f6ea0141d50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 -- 172.21.15.88:0/2343155666 >> 172.21.15.88:0/2343155666 conn(0x7f6ea009d110 msgr2=0x7f6ea0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:48.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 -- 172.21.15.88:0/2343155666 shutdown_connections 2020-02-11T16:20:48.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.546+0000 7f6ea816d700 1 -- 172.21.15.88:0/2343155666 wait complete. 2020-02-11T16:20:48.562 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:20:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:20:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:20:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:20:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 122, 2020-02-11T16:20:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:20:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:20:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:20:48.564 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:20:48.564 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.564 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:20:48.564 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:48.564 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:20:48.564 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:20:48.564 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:20:48.566 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:20:48.566 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:48.566 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:48.566 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:48.566 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:48.566 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:20:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:20:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:20:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:20:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:20:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:20:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:20:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:20:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:20:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:20:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:20:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:20:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:20:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:20:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:48.572 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:20:48.572 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.572 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.572 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.572 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:20:48.572 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:20:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:48.574 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:48.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.574 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:48.574 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:20:48.574 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:20:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:20:48.576 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:20:48.576 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:48.576 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:48.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.576 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:48.576 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:20:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:20:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:20:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:20:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:20:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:20:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:20:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.582 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:20:48.582 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:20:48.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.687+0000 7fb3386df700 1 Processor -- start 2020-02-11T16:20:48.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.687+0000 7fb3386df700 1 -- start start 2020-02-11T16:20:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.687+0000 7fb3386df700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb3300a2fa0 0x7fb3300a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:48.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.687+0000 7fb3386df700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3300a5410 0x7fb3300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb3386df700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb330131280 0x7fb3301316d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb3386df700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3300a1e60 con 0x7fb3300a2fa0 2020-02-11T16:20:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb3386df700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3300a3450 con 0x7fb3300a5410 2020-02-11T16:20:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb3386df700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300a4350 con 0x7fb330131280 2020-02-11T16:20:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3300a5410 0x7fb3300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3300a5410 0x7fb3300a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57458/0 (socket says 172.21.15.88:57458) 2020-02-11T16:20:48.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 -- 172.21.15.88:0/2594214119 learned_addr learned my addr 172.21.15.88:0/2594214119 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:20:48.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb33647b700 1 --2- 172.21.15.88:0/2594214119 >> v2:172.21.15.52:3300/0 conn(0x7fb3300a2fa0 0x7fb3300a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb336c7c700 1 --2- 172.21.15.88:0/2594214119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb330131280 0x7fb3301316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 -- 172.21.15.88:0/2594214119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb330131280 msgr2=0x7fb3301316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:48.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 --2- 172.21.15.88:0/2594214119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb330131280 0x7fb3301316d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 -- 172.21.15.88:0/2594214119 >> v2:172.21.15.52:3300/0 conn(0x7fb3300a2fa0 msgr2=0x7fb3300a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:48.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 --2- 172.21.15.88:0/2594214119 >> v2:172.21.15.52:3300/0 conn(0x7fb3300a2fa0 0x7fb3300a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 -- 172.21.15.88:0/2594214119 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3300a3a40 con 0x7fb3300a5410 2020-02-11T16:20:48.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb33647b700 1 --2- 172.21.15.88:0/2594214119 >> v2:172.21.15.52:3300/0 conn(0x7fb3300a2fa0 0x7fb3300a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:20:48.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb336c7c700 1 --2- 172.21.15.88:0/2594214119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb330131280 0x7fb3301316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:20:48.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 --2- 172.21.15.88:0/2594214119 >> v2:172.21.15.88:3300/0 conn(0x7fb3300a5410 0x7fb3300a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb324002f30 tx=0x7fb324007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 --2- 172.21.15.88:0/2594214119 >> v2:172.21.15.88:3300/0 conn(0x7fb3300a5410 0x7fb3300a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb324002f30 tx=0x7fb324007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 --2- 172.21.15.88:0/2594214119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3300a5410 0x7fb3300a5870 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fb324002f30 tx=0x7fb324007a40).ready entity=mon.1 client_cookie=c62ca0141ed3dd8c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 --2- 172.21.15.88:0/2594214119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3300a5410 0x7fb3300a5870 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fb324002f30 tx=0x7fb324007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335479700 1 -- 172.21.15.88:0/2594214119 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb324011720 con 0x7fb3300a5410 2020-02-11T16:20:48.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 --2- 172.21.15.88:0/2594214119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3300a5410 0x7fb3300a5870 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fb324002f30 tx=0x7fb324007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335c7a700 1 --2- 172.21.15.88:0/2594214119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3300a5410 0x7fb3300a5870 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fb324002f30 tx=0x7fb324007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335479700 1 -- 172.21.15.88:0/2594214119 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb324011880 con 0x7fb3300a5410 2020-02-11T16:20:48.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb335479700 1 -- 172.21.15.88:0/2594214119 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb324011c20 con 0x7fb3300a5410 2020-02-11T16:20:48.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb3386df700 1 -- 172.21.15.88:0/2594214119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3300a5410 msgr2=0x7fb3300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.688+0000 7fb3386df700 1 --2- 172.21.15.88:0/2594214119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3300a5410 0x7fb3300a5870 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fb324002f30 tx=0x7fb324007a40).stop 2020-02-11T16:20:48.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.689+0000 7fb3386df700 1 -- 172.21.15.88:0/2594214119 shutdown_connections 2020-02-11T16:20:48.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.689+0000 7fb3386df700 1 --2- 172.21.15.88:0/2594214119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb330131280 0x7fb3301316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.689+0000 7fb3386df700 1 --2- 172.21.15.88:0/2594214119 >> v2:172.21.15.52:3300/0 conn(0x7fb3300a2fa0 0x7fb3300a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.689+0000 7fb3386df700 1 --2- 172.21.15.88:0/2594214119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3300a5410 0x7fb3300a5870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.689+0000 7fb3386df700 1 -- 172.21.15.88:0/2594214119 >> 172.21.15.88:0/2594214119 conn(0x7fb33009d110 msgr2=0x7fb33009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:48.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.689+0000 7fb3386df700 1 -- 172.21.15.88:0/2594214119 shutdown_connections 2020-02-11T16:20:48.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.689+0000 7fb3386df700 1 -- 172.21.15.88:0/2594214119 wait complete. 2020-02-11T16:20:48.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb3386df700 1 Processor -- start 2020-02-11T16:20:48.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb3386df700 1 -- start start 2020-02-11T16:20:48.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb3386df700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3300a5410 0x7fb330064ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb3386df700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb330131280 0x7fb330130440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb3386df700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3300646a0 con 0x7fb3300a2fa0 2020-02-11T16:20:48.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb3386df700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb330065250 con 0x7fb330131280 2020-02-11T16:20:48.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb3386df700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb330141c70 con 0x7fb3300a5410 2020-02-11T16:20:48.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb33647b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb3300a2fa0 0x7fb3301423b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45090/0 (socket says 172.21.15.88:45090) 2020-02-11T16:20:48.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb33647b700 1 -- 172.21.15.88:0/1447073369 learned_addr learned my addr 172.21.15.88:0/1447073369 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:48.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb336c7c700 1 --2- 172.21.15.88:0/1447073369 >> v2:172.21.15.88:3300/0 conn(0x7fb330131280 0x7fb330130440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.690+0000 7fb335c7a700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3300a5410 0x7fb330064ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 -- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3300a5410 msgr2=0x7fb330064ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3300a5410 0x7fb330064ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 -- 172.21.15.88:0/1447073369 >> v1:172.21.15.88:6789/0 conn(0x7fb3300a2fa0 legacy=0x7fb3301423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994132308 0 0) 0x7fb3300646a0 con 0x7fb3300a2fa0 2020-02-11T16:20:48.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 -- 172.21.15.88:0/1447073369 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb330141f10 con 0x7fb330131280 2020-02-11T16:20:48.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb335c7a700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3300a5410 0x7fb330064ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:20:48.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 --2- 172.21.15.88:0/1447073369 >> v2:172.21.15.88:3300/0 conn(0x7fb330131280 0x7fb330130440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb330063ad0 tx=0x7fb32c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 --2- 172.21.15.88:0/1447073369 >> v2:172.21.15.88:3300/0 conn(0x7fb330131280 0x7fb330130440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb330063ad0 tx=0x7fb32c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb330131280 0x7fb330130440 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fb330063ad0 tx=0x7fb32c010a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb330131280 0x7fb330130440 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fb330063ad0 tx=0x7fb32c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb32c005aa0 con 0x7fb330131280 2020-02-11T16:20:48.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb330131280 0x7fb330130440 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fb330063ad0 tx=0x7fb32c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb330131280 0x7fb330130440 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fb330063ad0 tx=0x7fb32c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c005c00 con 0x7fb330131280 2020-02-11T16:20:48.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb3386df700 1 -- 172.21.15.88:0/1447073369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb330064f30 con 0x7fb330131280 2020-02-11T16:20:48.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb32c012470 con 0x7fb330131280 2020-02-11T16:20:48.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb3386df700 1 -- 172.21.15.88:0/1447073369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3300a0ea0 con 0x7fb330131280 2020-02-11T16:20:48.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.691+0000 7fb336c7c700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb330131280 0x7fb330130440 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fb330063ad0 tx=0x7fb32c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb32c007180 con 0x7fb330131280 2020-02-11T16:20:48.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb336c7c700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb330131280 0x7fb330130440 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fb330063ad0 tx=0x7fb32c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb3386df700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 0x7fb33005a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb3386df700 1 -- 172.21.15.88:0/1447073369 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33005e2f0 con 0x7fb3301308a0 2020-02-11T16:20:48.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb3237fe700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb310039b00 0x7fb31003bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 0x7fb33005a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb32c0497d0 con 0x7fb330131280 2020-02-11T16:20:48.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb335c7a700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb310039b00 0x7fb31003bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb33647b700 1 -- 172.21.15.88:0/1447073369 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb330142110 con 0x7fb3301308a0 2020-02-11T16:20:48.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 0x7fb33005a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb335c7a700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb310039b00 0x7fb31003bfc0 crc :-1 s=READY pgs=374 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 0x7fb33005a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.692+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 0x7fb33005a5d0 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.693+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 0x7fb33005a5d0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.693+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3280128e0 con 0x7fb3301308a0 2020-02-11T16:20:48.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.693+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 0x7fb33005a5d0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.693+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fb328012a40 con 0x7fb3301308a0 2020-02-11T16:20:48.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.693+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 msgr2=0x7fb33005a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.693+0000 7fb3237fe700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 0x7fb33005a5d0 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).stop 2020-02-11T16:20:48.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.693+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 msgr2=0x7fb33005a5d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:48.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.693+0000 7fb3237fe700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb3301308a0 0x7fb33005a5d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.701+0000 7fb3386df700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 0x7fb33014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.701+0000 7fb3386df700 1 -- 172.21.15.88:0/1447073369 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300650c0 con 0x7fb33014c4d0 2020-02-11T16:20:48.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.701+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 0x7fb33014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.701+0000 7fb33647b700 1 -- 172.21.15.88:0/1447073369 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb3300565b0 con 0x7fb33014c4d0 2020-02-11T16:20:48.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.701+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 0x7fb33014c8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.701+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 0x7fb33014c8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.701+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 0x7fb33014c8e0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 0x7fb33014c8e0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb32800c790 con 0x7fb33014c4d0 2020-02-11T16:20:48.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb33647b700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 0x7fb33014c8e0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7fb32800c8f0 con 0x7fb33014c4d0 2020-02-11T16:20:48.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 msgr2=0x7fb33014c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3237fe700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 0x7fb33014c8e0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fb328007dc0 tx=0x7fb328011050).stop 2020-02-11T16:20:48.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3237fe700 1 -- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 msgr2=0x7fb33014c8e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:48.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3237fe700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb33014c4d0 0x7fb33014c8e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3386df700 1 -- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb310039b00 msgr2=0x7fb31003bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3386df700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb310039b00 0x7fb31003bfc0 crc :-1 s=READY pgs=374 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3386df700 1 -- 172.21.15.88:0/1447073369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb330131280 msgr2=0x7fb330130440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb336c7c700 1 -- 172.21.15.88:0/1447073369 reap_dead start 2020-02-11T16:20:48.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3386df700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb330131280 0x7fb330130440 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fb330063ad0 tx=0x7fb32c010a20).stop 2020-02-11T16:20:48.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3386df700 1 -- 172.21.15.88:0/1447073369 shutdown_connections 2020-02-11T16:20:48.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3386df700 1 --2- 172.21.15.88:0/1447073369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb330131280 0x7fb330130440 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3386df700 1 -- 172.21.15.88:0/1447073369 >> 172.21.15.88:0/1447073369 conn(0x7fb33009d110 msgr2=0x7fb330069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:48.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3386df700 1 -- 172.21.15.88:0/1447073369 shutdown_connections 2020-02-11T16:20:48.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.702+0000 7fb3386df700 1 -- 172.21.15.88:0/1447073369 wait complete. 2020-02-11T16:20:48.713 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:20:48.713 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:48.714 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:48.714 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:20:48.714 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 122, 2020-02-11T16:20:48.714 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:20:48.714 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:20:48.714 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:20:48.714 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:20:48.715 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.715 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:20:48.715 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:48.715 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:20:48.715 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:20:48.715 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:48.715 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:48.715 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:48.716 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:48.716 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:48.716 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:48.716 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.716 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:20:48.716 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:20:48.716 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:48.717 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:48.717 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:48.717 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:48.717 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:48.717 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:48.717 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.718 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:20:48.718 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:20:48.718 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:20:48.718 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:20:48.718 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:20:48.718 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:20:48.718 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:48.718 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:48.719 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:20:48.719 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:20:48.719 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:48.719 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:20:48.719 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:48.719 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:48.719 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:48.720 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:48.720 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:48.720 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:48.720 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.720 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:20:48.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.720 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:20:48.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.721 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:20:48.721 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:20:48.721 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:48.721 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:48.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.721 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:48.721 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:20:48.722 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.722 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:48.722 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:20:48.722 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.723 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.723 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:20:48.723 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:20:48.723 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:48.723 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:48.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.724 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:48.724 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:48.724 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:48.724 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:48.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.724 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:48.724 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:20:48.725 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.725 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:48.725 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:20:48.725 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.725 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.726 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.726 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:20:48.726 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:20:48.726 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:48.726 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:48.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.727 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:48.727 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:48.727 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:48.727 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:48.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.727 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:48.727 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:20:48.728 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.728 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:48.728 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:20:48.728 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:48.728 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.728 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.729 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:20:48.729 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:20:48.729 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:48.729 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:48.729 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.729 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:48.730 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:20:48.730 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:20:48.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.730 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:48.730 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:48.730 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:48.731 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.731 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.731 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:20:48.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.731 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:48.731 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:48.731 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:20:48.731 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.732 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.732 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:20:48.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.732 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:48.732 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:48.732 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:20:48.732 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.733 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.733 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:20:48.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.733 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:48.733 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:48.733 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:20:48.733 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.733 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:48.734 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:20:48.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:48.734 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:48.734 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:48.734 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:48.734 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.734 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:48.735 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:48.735 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:20:48.736 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:20:48.736 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:20:48.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.840+0000 7fa246461700 1 Processor -- start 2020-02-11T16:20:48.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.840+0000 7fa246461700 1 -- start start 2020-02-11T16:20:48.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.841+0000 7fa246461700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa24005c250 0x7fa2400a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:48.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.841+0000 7fa246461700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24009d6b0 con 0x7fa24005be70 2020-02-11T16:20:48.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.841+0000 7fa246461700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24012ee50 con 0x7fa240137f10 2020-02-11T16:20:48.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.841+0000 7fa246461700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2400a3f20 con 0x7fa24005c250 2020-02-11T16:20:48.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.841+0000 7fa2449fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa240137f10 0x7fa24012e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45106/0 (socket says 172.21.15.88:45106) 2020-02-11T16:20:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.841+0000 7fa2449fe700 1 -- 172.21.15.88:0/3561139157 learned_addr learned my addr 172.21.15.88:0/3561139157 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.841+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491917314 0 0) 0x7fa24012ee50 con 0x7fa240137f10 2020-02-11T16:20:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.841+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/3561139157 >> v2:172.21.15.52:3300/0 conn(0x7fa24005c250 0x7fa2400a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.841+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa22c003230 con 0x7fa240137f10 2020-02-11T16:20:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2283212209 0 0) 0x7fa22c003230 con 0x7fa240137f10 2020-02-11T16:20:48.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 >> v2:172.21.15.52:3300/0 conn(0x7fa24005c250 msgr2=0x7fa2400a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 --2- 172.21.15.88:0/3561139157 >> v2:172.21.15.52:3300/0 conn(0x7fa24005c250 0x7fa2400a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 >> v1:172.21.15.52:6789/0 conn(0x7fa24005be70 legacy=0x7fa2400a6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24012f050 con 0x7fa240137f10 2020-02-11T16:20:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa238001a50 con 0x7fa240137f10 2020-02-11T16:20:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 >> v1:172.21.15.88:6789/0 conn(0x7fa240137f10 legacy=0x7fa24012e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c003720 0x7fa22c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:48.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 0x7fa22c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:48.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa22c004db0 0x7fa22c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:48.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0041c0 con 0x7fa22c003720 2020-02-11T16:20:48.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c004330 con 0x7fa22c0044d0 2020-02-11T16:20:48.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c00bbd0 con 0x7fa22c004db0 2020-02-11T16:20:48.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 0x7fa22c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23ffff700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c003720 0x7fa22c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa2449fe700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa22c004db0 0x7fa22c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 -- 172.21.15.88:0/3561139157 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa22c004db0 msgr2=0x7fa22c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:48.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa22c004db0 0x7fa22c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 -- 172.21.15.88:0/3561139157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c003720 msgr2=0x7fa22c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:48.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c003720 0x7fa22c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:48.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 -- 172.21.15.88:0/3561139157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c003230 con 0x7fa22c0044d0 2020-02-11T16:20:48.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa2449fe700 1 -- 172.21.15.88:0/3561139157 reap_dead start 2020-02-11T16:20:48.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 0x7fa22c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa230008910 tx=0x7fa230010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 0x7fa22c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa230008910 tx=0x7fa230010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 0x7fa22c004950 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fa230008910 tx=0x7fa230010080).ready entity=mon.1 client_cookie=ac44e6418dc0d154 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 0x7fa22c004950 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fa230008910 tx=0x7fa230010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa230010d50 con 0x7fa22c0044d0 2020-02-11T16:20:48.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 0x7fa22c004950 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fa230008910 tx=0x7fa230010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa230008950 con 0x7fa22c0044d0 2020-02-11T16:20:48.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 0x7fa22c004950 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fa230008910 tx=0x7fa230010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa23effd700 1 -- 172.21.15.88:0/3561139157 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa230008cb0 con 0x7fa22c0044d0 2020-02-11T16:20:48.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa246461700 1 -- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 msgr2=0x7fa22c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.842+0000 7fa246461700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 0x7fa22c004950 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fa230008910 tx=0x7fa230010080).stop 2020-02-11T16:20:48.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.843+0000 7fa246461700 1 -- 172.21.15.88:0/3561139157 shutdown_connections 2020-02-11T16:20:48.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.843+0000 7fa246461700 1 --2- 172.21.15.88:0/3561139157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa22c0044d0 0x7fa22c004950 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:48.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.843+0000 7fa246461700 1 -- 172.21.15.88:0/3561139157 >> 172.21.15.88:0/3561139157 conn(0x7fa2400ab400 msgr2=0x7fa2400a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:48.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.843+0000 7fa246461700 1 -- 172.21.15.88:0/3561139157 shutdown_connections 2020-02-11T16:20:48.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.843+0000 7fa246461700 1 -- 172.21.15.88:0/3561139157 wait complete. 2020-02-11T16:20:48.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.844+0000 7fa246461700 1 Processor -- start 2020-02-11T16:20:48.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.844+0000 7fa246461700 1 -- start start 2020-02-11T16:20:48.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.844+0000 7fa246461700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa22c0044d0 0x7fa240141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.844+0000 7fa246461700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2401372b0 con 0x7fa2401422d0 2020-02-11T16:20:48.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa246461700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa240142950 con 0x7fa24012fdf0 2020-02-11T16:20:48.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa246461700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa240142730 con 0x7fa22c0044d0 2020-02-11T16:20:48.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa2449fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa24012fdf0 0x7fa240130240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45116/0 (socket says 172.21.15.88:45116) 2020-02-11T16:20:48.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa2449fe700 1 -- 172.21.15.88:0/2183236815 learned_addr learned my addr 172.21.15.88:0/2183236815 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:48.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> v2:172.21.15.52:3300/0 conn(0x7fa22c0044d0 0x7fa240141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23d7fa700 1 -- 172.21.15.88:0/2183236815 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898709579 0 0) 0x7fa240142950 con 0x7fa24012fdf0 2020-02-11T16:20:48.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23d7fa700 1 -- 172.21.15.88:0/2183236815 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa220002fe0 con 0x7fa24012fdf0 2020-02-11T16:20:48.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23d7fa700 1 -- 172.21.15.88:0/2183236815 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1774167931 0 0) 0x7fa220002fe0 con 0x7fa24012fdf0 2020-02-11T16:20:48.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23ffff700 1 -- 172.21.15.88:0/2183236815 >> v1:172.21.15.88:6789/0 conn(0x7fa24012fdf0 legacy=0x7fa240130240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23ffff700 1 -- 172.21.15.88:0/2183236815 >> v1:172.21.15.52:6789/0 conn(0x7fa2401422d0 legacy=0x7fa2400a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:48.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23ffff700 1 -- 172.21.15.88:0/2183236815 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24012f6b0 con 0x7fa22c0044d0 2020-02-11T16:20:48.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> v2:172.21.15.52:3300/0 conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> v2:172.21.15.52:3300/0 conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23d7fa700 1 -- 172.21.15.88:0/2183236815 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa238001a50 con 0x7fa22c0044d0 2020-02-11T16:20:48.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa246461700 1 -- 172.21.15.88:0/2183236815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24012f950 con 0x7fa22c0044d0 2020-02-11T16:20:48.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23d7fa700 1 -- 172.21.15.88:0/2183236815 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa234011e90 con 0x7fa22c0044d0 2020-02-11T16:20:48.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa23d7fa700 1 -- 172.21.15.88:0/2183236815 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2340034b0 con 0x7fa22c0044d0 2020-02-11T16:20:48.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.845+0000 7fa246461700 1 -- 172.21.15.88:0/2183236815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa240137730 con 0x7fa22c0044d0 2020-02-11T16:20:48.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.846+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.846+0000 7fa23d7fa700 1 -- 172.21.15.88:0/2183236815 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa2340036b0 con 0x7fa22c0044d0 2020-02-11T16:20:48.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.846+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.846+0000 7fa246461700 1 -- 172.21.15.88:0/2183236815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24012fb10 con 0x7fa22c0044d0 2020-02-11T16:20:48.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.846+0000 7fa23d7fa700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa220039ea0 0x7fa22003c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:48.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.847+0000 7fa23d7fa700 1 -- 172.21.15.88:0/2183236815 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa234048dd0 con 0x7fa22c0044d0 2020-02-11T16:20:48.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.847+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa220039ea0 0x7fa22003c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:48.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.847+0000 7fa23f7fe700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa220039ea0 0x7fa22003c360 crc :-1 s=READY pgs=375 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:48.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.851+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:48.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:48.851+0000 7fa23d7fa700 1 -- 172.21.15.88:0/2183236815 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fa23402e330 con 0x7fa22c0044d0 2020-02-11T16:20:49.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.033+0000 7fa246461700 1 -- 172.21.15.88:0/2183236815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fa2400565b0 con 0x7fa22c0044d0 2020-02-11T16:20:49.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.034+0000 7fa23ffff700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:49.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.034+0000 7fa23d7fa700 1 -- 172.21.15.88:0/2183236815 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fa234030e40 con 0x7fa22c0044d0 2020-02-11T16:20:49.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.035+0000 7fa246461700 1 -- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa220039ea0 msgr2=0x7fa22003c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:49.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.035+0000 7fa246461700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa220039ea0 0x7fa22003c360 crc :-1 s=READY pgs=375 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:49.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.035+0000 7fa246461700 1 -- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 msgr2=0x7fa240141e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:49.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.035+0000 7fa246461700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 0x7fa240141e70 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7fa230007fa0 tx=0x7fa23400c460).stop 2020-02-11T16:20:49.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.036+0000 7fa246461700 1 -- 172.21.15.88:0/2183236815 shutdown_connections 2020-02-11T16:20:49.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.036+0000 7fa246461700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa220039ea0 0x7fa22003c360 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:49.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.036+0000 7fa246461700 1 --2- 172.21.15.88:0/2183236815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa22c0044d0 0x7fa240141e70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:49.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.036+0000 7fa246461700 1 -- 172.21.15.88:0/2183236815 >> 172.21.15.88:0/2183236815 conn(0x7fa2400ab400 msgr2=0x7fa2400a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:49.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.036+0000 7fa246461700 1 -- 172.21.15.88:0/2183236815 shutdown_connections 2020-02-11T16:20:49.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:49.036+0000 7fa246461700 1 -- 172.21.15.88:0/2183236815 wait complete. 2020-02-11T16:20:49.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:20:59.048 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:20:59.049 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:20:59.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.162+0000 7f532abb3700 1 Processor -- start 2020-02-11T16:20:59.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.162+0000 7f532abb3700 1 -- start start 2020-02-11T16:20:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.163+0000 7f532abb3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53240a4ec0 0x7f532412f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.163+0000 7f532abb3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f532412fcf0 0x7f5324140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.163+0000 7f532abb3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53240a5560 con 0x7f53240a7120 2020-02-11T16:20:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.163+0000 7f532abb3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240a5350 con 0x7f53240a4ec0 2020-02-11T16:20:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.163+0000 7f532abb3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532409e060 con 0x7f532412fcf0 2020-02-11T16:20:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.163+0000 7f5329150700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f532412fcf0 0x7f5324140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.163+0000 7f5329150700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f532412fcf0 0x7f5324140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57500/0 (socket says 172.21.15.88:57500) 2020-02-11T16:20:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.163+0000 7f5329150700 1 -- 172.21.15.88:0/2475949699 learned_addr learned my addr 172.21.15.88:0/2475949699 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:20:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.163+0000 7f5323fff700 1 --2- 172.21.15.88:0/2475949699 >> v2:172.21.15.52:3300/0 conn(0x7f53240a4ec0 0x7f532412f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f5329150700 1 -- 172.21.15.88:0/2475949699 >> v2:172.21.15.52:3300/0 conn(0x7f53240a4ec0 msgr2=0x7f532412f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f5329150700 1 --2- 172.21.15.88:0/2475949699 >> v2:172.21.15.52:3300/0 conn(0x7f53240a4ec0 0x7f532412f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f5329150700 1 -- 172.21.15.88:0/2475949699 >> v1:172.21.15.52:6789/0 conn(0x7f53240a7120 legacy=0x7f53240a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f5329150700 1 -- 172.21.15.88:0/2475949699 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532409e300 con 0x7f532412fcf0 2020-02-11T16:20:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f5329150700 1 --2- 172.21.15.88:0/2475949699 >> v2:172.21.15.88:3300/0 conn(0x7f532412fcf0 0x7f5324140470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f531c0032b0 tx=0x7f531c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f5329150700 1 --2- 172.21.15.88:0/2475949699 >> v2:172.21.15.88:3300/0 conn(0x7f532412fcf0 0x7f5324140470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f531c0032b0 tx=0x7f531c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f5329150700 1 --2- 172.21.15.88:0/2475949699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532412fcf0 0x7f5324140470 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f531c0032b0 tx=0x7f531c007dc0).ready entity=mon.1 client_cookie=3054f9f1747a5b6 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f5329150700 1 --2- 172.21.15.88:0/2475949699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532412fcf0 0x7f5324140470 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f531c0032b0 tx=0x7f531c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f5329150700 1 --2- 172.21.15.88:0/2475949699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532412fcf0 0x7f5324140470 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f531c0032b0 tx=0x7f531c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f53237fe700 1 -- 172.21.15.88:0/2475949699 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f531c00a160 con 0x7f532412fcf0 2020-02-11T16:20:59.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f5329150700 1 --2- 172.21.15.88:0/2475949699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532412fcf0 0x7f5324140470 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f531c0032b0 tx=0x7f531c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f53237fe700 1 -- 172.21.15.88:0/2475949699 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00a2c0 con 0x7f532412fcf0 2020-02-11T16:20:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f53237fe700 1 -- 172.21.15.88:0/2475949699 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f531c00a6a0 con 0x7f532412fcf0 2020-02-11T16:20:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f532abb3700 1 -- 172.21.15.88:0/2475949699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532412fcf0 msgr2=0x7f5324140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f532abb3700 1 --2- 172.21.15.88:0/2475949699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532412fcf0 0x7f5324140470 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f531c0032b0 tx=0x7f531c007dc0).stop 2020-02-11T16:20:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f532abb3700 1 -- 172.21.15.88:0/2475949699 shutdown_connections 2020-02-11T16:20:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f532abb3700 1 --2- 172.21.15.88:0/2475949699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532412fcf0 0x7f5324140470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f532abb3700 1 --2- 172.21.15.88:0/2475949699 >> v2:172.21.15.52:3300/0 conn(0x7f53240a4ec0 0x7f532412f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f532abb3700 1 -- 172.21.15.88:0/2475949699 >> 172.21.15.88:0/2475949699 conn(0x7f532409d110 msgr2=0x7f532409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f532abb3700 1 -- 172.21.15.88:0/2475949699 shutdown_connections 2020-02-11T16:20:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.164+0000 7f532abb3700 1 -- 172.21.15.88:0/2475949699 wait complete. 2020-02-11T16:20:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.165+0000 7f532abb3700 1 Processor -- start 2020-02-11T16:20:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.165+0000 7f532abb3700 1 -- start start 2020-02-11T16:20:59.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.166+0000 7f532abb3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.166+0000 7f532abb3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53240a7120 0x7f5324134280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.166+0000 7f532abb3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53240a1ed0 con 0x7f532412fcf0 2020-02-11T16:20:59.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.166+0000 7f532abb3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53241364c0 con 0x7f53240a7120 2020-02-11T16:20:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.166+0000 7f532abb3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240a2410 con 0x7f53240a4ec0 2020-02-11T16:20:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.166+0000 7f5323fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53240a7120 0x7f5324134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.166+0000 7f532894f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.166+0000 7f5329150700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f532412fcf0 0x7f5324127290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:36912/0 (socket says 172.21.15.88:36912) 2020-02-11T16:20:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.166+0000 7f5329150700 1 -- 172.21.15.88:0/1064158294 learned_addr learned my addr 172.21.15.88:0/1064158294 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532894f700 1 -- 172.21.15.88:0/1064158294 >> v2:172.21.15.52:3300/0 conn(0x7f53240a7120 msgr2=0x7f5324134280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> v2:172.21.15.52:3300/0 conn(0x7f53240a7120 0x7f5324134280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532894f700 1 -- 172.21.15.88:0/1064158294 >> v1:172.21.15.52:6789/0 conn(0x7f532412fcf0 legacy=0x7f5324127290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f5321ffb700 1 -- 172.21.15.88:0/1064158294 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328673048 0 0) 0x7f53240a1ed0 con 0x7f532412fcf0 2020-02-11T16:20:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532894f700 1 -- 172.21.15.88:0/1064158294 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240a2170 con 0x7f53240a4ec0 2020-02-11T16:20:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f5323fff700 1 --2- 172.21.15.88:0/1064158294 >> v2:172.21.15.52:3300/0 conn(0x7f53240a7120 0x7f5324134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:20:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f5321ffb700 1 -- 172.21.15.88:0/1064158294 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5314006bc0 con 0x7f53240a4ec0 2020-02-11T16:20:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f5321ffb700 1 -- 172.21.15.88:0/1064158294 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5314006d60 con 0x7f53240a4ec0 2020-02-11T16:20:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532abb3700 1 -- 172.21.15.88:0/1064158294 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53241346e0 con 0x7f53240a4ec0 2020-02-11T16:20:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f5321ffb700 1 -- 172.21.15.88:0/1064158294 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53140110d0 con 0x7f53240a4ec0 2020-02-11T16:20:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.167+0000 7f532abb3700 1 -- 172.21.15.88:0/1064158294 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53240a18a0 con 0x7f53240a4ec0 2020-02-11T16:20:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.168+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.168+0000 7f5321ffb700 1 -- 172.21.15.88:0/1064158294 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5314011350 con 0x7f53240a4ec0 2020-02-11T16:20:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.168+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.168+0000 7f532abb3700 1 -- 172.21.15.88:0/1064158294 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53240565b0 con 0x7f53240a4ec0 2020-02-11T16:20:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.168+0000 7f5321ffb700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5304039af0 0x7f530403bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.168+0000 7f5321ffb700 1 -- 172.21.15.88:0/1064158294 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5314049990 con 0x7f53240a4ec0 2020-02-11T16:20:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.168+0000 7f5323fff700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5304039af0 0x7f530403bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.169+0000 7f5323fff700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5304039af0 0x7f530403bfb0 crc :-1 s=READY pgs=376 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.172+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.172+0000 7f5321ffb700 1 -- 172.21.15.88:0/1064158294 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f531402ef50 con 0x7f53240a4ec0 2020-02-11T16:20:59.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.353+0000 7f532abb3700 1 -- 172.21.15.88:0/1064158294 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f532405ccb0 con 0x7f53240a4ec0 2020-02-11T16:20:59.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.354+0000 7f532894f700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.354+0000 7f5321ffb700 1 -- 172.21.15.88:0/1064158294 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f5314031a60 con 0x7f53240a4ec0 2020-02-11T16:20:59.357 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":122,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:20:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 -- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5304039af0 msgr2=0x7f530403bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5304039af0 0x7f530403bfb0 crc :-1 s=READY pgs=376 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 -- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 msgr2=0x7f532405ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f532405ee60 tx=0x7f53140108b0).stop 2020-02-11T16:20:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 -- 172.21.15.88:0/1064158294 shutdown_connections 2020-02-11T16:20:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f53240a4ec0 0x7f532405ab60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 --2- 172.21.15.88:0/1064158294 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5304039af0 0x7f530403bfb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 --2- 172.21.15.88:0/1064158294 >> v2:172.21.15.52:3300/0 conn(0x7f53240a7120 0x7f5324134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 -- 172.21.15.88:0/1064158294 >> 172.21.15.88:0/1064158294 conn(0x7f532409d110 msgr2=0x7f5324069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 -- 172.21.15.88:0/1064158294 shutdown_connections 2020-02-11T16:20:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.355+0000 7f532abb3700 1 -- 172.21.15.88:0/1064158294 wait complete. 2020-02-11T16:20:59.368 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":122,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:20:59.368 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:20:59.368 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:20:59.368 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:20:59.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.473+0000 7efdfffff700 1 Processor -- start 2020-02-11T16:20:59.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.473+0000 7efdfffff700 1 -- start start 2020-02-11T16:20:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.473+0000 7efdfffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe000a5de0 0x7efe000a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.473+0000 7efdfffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe001322f0 0x7efe000a1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.473+0000 7efdfffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0009de90 con 0x7efe000a2980 2020-02-11T16:20:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.473+0000 7efdfffff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000a3c00 con 0x7efe001322f0 2020-02-11T16:20:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.473+0000 7efdfffff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000a3e10 con 0x7efe000a5de0 2020-02-11T16:20:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.473+0000 7efdfeffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe000a5de0 0x7efe000a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe000a5de0 0x7efe000a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57510/0 (socket says 172.21.15.88:57510) 2020-02-11T16:20:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 -- 172.21.15.88:0/1288682349 learned_addr learned my addr 172.21.15.88:0/1288682349 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:20:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdff7fe700 1 --2- 172.21.15.88:0/1288682349 >> v2:172.21.15.52:3300/0 conn(0x7efe001322f0 0x7efe000a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 -- 172.21.15.88:0/1288682349 >> v2:172.21.15.52:3300/0 conn(0x7efe001322f0 msgr2=0x7efe000a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 --2- 172.21.15.88:0/1288682349 >> v2:172.21.15.52:3300/0 conn(0x7efe001322f0 0x7efe000a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 -- 172.21.15.88:0/1288682349 >> v1:172.21.15.88:6789/0 conn(0x7efe000a2980 legacy=0x7efe00131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 -- 172.21.15.88:0/1288682349 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0009e0c0 con 0x7efe000a5de0 2020-02-11T16:20:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfdffb700 1 -- 172.21.15.88:0/1288682349 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671850739 0 0) 0x7efe0009de90 con 0x7efe000a2980 2020-02-11T16:20:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdff7fe700 1 --2- 172.21.15.88:0/1288682349 >> v2:172.21.15.52:3300/0 conn(0x7efe001322f0 0x7efe000a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:20:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 --2- 172.21.15.88:0/1288682349 >> v2:172.21.15.88:3300/0 conn(0x7efe000a5de0 0x7efe000a0d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efdf0002f30 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 --2- 172.21.15.88:0/1288682349 >> v2:172.21.15.88:3300/0 conn(0x7efe000a5de0 0x7efe000a0d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efdf0002f30 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 --2- 172.21.15.88:0/1288682349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe000a5de0 0x7efe000a0d90 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7efdf0002f30 tx=0x7efe000684d0).ready entity=mon.1 client_cookie=5107ad2bd9d6ec6f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 --2- 172.21.15.88:0/1288682349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe000a5de0 0x7efe000a0d90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7efdf0002f30 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfdffb700 1 -- 172.21.15.88:0/1288682349 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf0011720 con 0x7efe000a5de0 2020-02-11T16:20:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 --2- 172.21.15.88:0/1288682349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe000a5de0 0x7efe000a0d90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7efdf0002f30 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfdffb700 1 -- 172.21.15.88:0/1288682349 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf0011880 con 0x7efe000a5de0 2020-02-11T16:20:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfeffd700 1 --2- 172.21.15.88:0/1288682349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe000a5de0 0x7efe000a0d90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7efdf0002f30 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfdffb700 1 -- 172.21.15.88:0/1288682349 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf0011c20 con 0x7efe000a5de0 2020-02-11T16:20:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfffff700 1 -- 172.21.15.88:0/1288682349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe000a5de0 msgr2=0x7efe000a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.474+0000 7efdfffff700 1 --2- 172.21.15.88:0/1288682349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe000a5de0 0x7efe000a0d90 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7efdf0002f30 tx=0x7efe000684d0).stop 2020-02-11T16:20:59.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.475+0000 7efdfffff700 1 -- 172.21.15.88:0/1288682349 shutdown_connections 2020-02-11T16:20:59.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.475+0000 7efdfffff700 1 --2- 172.21.15.88:0/1288682349 >> v2:172.21.15.52:3300/0 conn(0x7efe001322f0 0x7efe000a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.475+0000 7efdfffff700 1 --2- 172.21.15.88:0/1288682349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe000a5de0 0x7efe000a0d90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.475+0000 7efdfffff700 1 -- 172.21.15.88:0/1288682349 >> 172.21.15.88:0/1288682349 conn(0x7efe000a9fb0 msgr2=0x7efe000aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:59.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.475+0000 7efdfffff700 1 -- 172.21.15.88:0/1288682349 shutdown_connections 2020-02-11T16:20:59.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.475+0000 7efdfffff700 1 -- 172.21.15.88:0/1288682349 wait complete. 2020-02-11T16:20:59.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.475+0000 7efdfffff700 1 Processor -- start 2020-02-11T16:20:59.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.476+0000 7efdfffff700 1 -- start start 2020-02-11T16:20:59.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.476+0000 7efdfffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe000a5de0 0x7efe0012ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.476+0000 7efdfffff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe000a03d0 con 0x7efe001322f0 2020-02-11T16:20:59.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.476+0000 7efdfffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe000a0600 con 0x7efe000a2980 2020-02-11T16:20:59.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.476+0000 7efdfffff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe00133c50 con 0x7efe000a5de0 2020-02-11T16:20:59.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.476+0000 7efdfeffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efe000a2980 0x7efe00098dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45140/0 (socket says 172.21.15.88:45140) 2020-02-11T16:20:59.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.476+0000 7efdfeffd700 1 -- 172.21.15.88:0/25741053 learned_addr learned my addr 172.21.15.88:0/25741053 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.476+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> v2:172.21.15.52:3300/0 conn(0x7efe000a5de0 0x7efe0012ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.476+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662908847 0 0) 0x7efe000a0600 con 0x7efe000a2980 2020-02-11T16:20:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.476+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde4002fe0 con 0x7efe000a2980 2020-02-11T16:20:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167914132 0 0) 0x7efe000a03d0 con 0x7efe001322f0 2020-02-11T16:20:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe000a0600 con 0x7efe001322f0 2020-02-11T16:20:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1172668437 0 0) 0x7efde4002fe0 con 0x7efe000a2980 2020-02-11T16:20:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe000a03d0 con 0x7efe000a2980 2020-02-11T16:20:59.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7efdf0011e20 con 0x7efe000a2980 2020-02-11T16:20:59.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 >> v2:172.21.15.52:3300/0 conn(0x7efe000a5de0 msgr2=0x7efe0012ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 --2- 172.21.15.88:0/25741053 >> v2:172.21.15.52:3300/0 conn(0x7efe000a5de0 0x7efe0012ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 >> v1:172.21.15.88:6789/0 conn(0x7efe000a2980 legacy=0x7efe00098dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 >> v1:172.21.15.52:6789/0 conn(0x7efe001322f0 legacy=0x7efe0014d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efde4003800 0x7efde4003c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efde40040e0 0x7efde400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe00133c50 con 0x7efde40040e0 2020-02-11T16:20:59.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde40046c0 con 0x7efde4004b20 2020-02-11T16:20:59.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde400bc30 con 0x7efde4003800 2020-02-11T16:20:59.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efde4003800 0x7efde4003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdff7fe700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efde40040e0 0x7efde400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 -- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efde4003800 msgr2=0x7efde4003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efde4003800 0x7efde4003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 -- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efde40040e0 msgr2=0x7efde400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efde40040e0 0x7efde400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdff7fe700 1 -- 172.21.15.88:0/25741053 reap_dead start 2020-02-11T16:20:59.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 -- 172.21.15.88:0/25741053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe001339b0 con 0x7efde4004b20 2020-02-11T16:20:59.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfffff700 1 -- 172.21.15.88:0/25741053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0009d9c0 con 0x7efde4004b20 2020-02-11T16:20:59.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efde4003800 0x7efde4003c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:20:59.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efdf00084c0 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfffff700 1 -- 172.21.15.88:0/25741053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe001342b0 con 0x7efde4004b20 2020-02-11T16:20:59.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efdf00084c0 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7efdf00084c0 tx=0x7efe000684d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7efdf00084c0 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf0008750 con 0x7efde4004b20 2020-02-11T16:20:59.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7efdf00084c0 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7efdf00084c0 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf000f8d0 con 0x7efde4004b20 2020-02-11T16:20:59.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.477+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf000ae20 con 0x7efde4004b20 2020-02-11T16:20:59.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7efdf00084c0 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdfffff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 0x7efdd80058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdfffff700 1 -- 172.21.15.88:0/25741053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd8005ea0 con 0x7efdd8003420 2020-02-11T16:20:59.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 0x7efdd80058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7efdf0007340 con 0x7efde4004b20 2020-02-11T16:20:59.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdfeffd700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7efdf00084c0 tx=0x7efe000684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdfe7fc700 1 -- 172.21.15.88:0/25741053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efdd8006060 con 0x7efdd8003420 2020-02-11T16:20:59.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdf7fff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efde403de10 0x7efde40402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 0x7efdd80058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7efdf004aa60 con 0x7efde4004b20 2020-02-11T16:20:59.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 0x7efdd80058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 0x7efdd80058e0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 0x7efdd80058e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.478+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efde8001dc0 con 0x7efdd8003420 2020-02-11T16:20:59.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.479+0000 7efdff7fe700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efde403de10 0x7efde40402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.479+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 0x7efdd80058e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.479+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7efde800c930 con 0x7efdd8003420 2020-02-11T16:20:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.479+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 msgr2=0x7efdd80058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.479+0000 7efdf7fff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 0x7efdd80058e0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).stop 2020-02-11T16:20:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.479+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 msgr2=0x7efdd80058e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.479+0000 7efdf7fff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 0x7efdd80058e0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).stop 2020-02-11T16:20:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.479+0000 7efdff7fe700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efde403de10 0x7efde40402d0 crc :-1 s=READY pgs=377 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdfffff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 0x7efdd80068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdfffff700 1 -- 172.21.15.88:0/25741053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd8006da0 con 0x7efdd8006440 2020-02-11T16:20:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 0x7efdd80068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdfe7fc700 1 -- 172.21.15.88:0/25741053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efdd8006f60 con 0x7efdd8006440 2020-02-11T16:20:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 0x7efdd80068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 0x7efdd80068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 0x7efdd80068f0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 0x7efdd80068f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efde8003920 con 0x7efdd8006440 2020-02-11T16:20:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdfe7fc700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 0x7efdd80068f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4021 (secure 0 0 0) 0x7efde8012410 con 0x7efdd8006440 2020-02-11T16:20:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 msgr2=0x7efdd80068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdf7fff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 0x7efdd80068f0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).stop 2020-02-11T16:20:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdf7fff700 1 -- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 msgr2=0x7efdd80068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.487+0000 7efdf7fff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 0x7efdd80068f0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0x7efde8000b80 tx=0x7efde8010ba0).stop 2020-02-11T16:20:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 -- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efde403de10 msgr2=0x7efde40402d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efde403de10 0x7efde40402d0 crc :-1 s=READY pgs=377 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 -- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 msgr2=0x7efde4004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7efdf00084c0 tx=0x7efe000684d0).stop 2020-02-11T16:20:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 -- 172.21.15.88:0/25741053 shutdown_connections 2020-02-11T16:20:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efde403de10 0x7efde40402d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efde4004b20 0x7efde4004f00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8003420 0x7efdd80058e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 --2- 172.21.15.88:0/25741053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdd8006440 0x7efdd80068f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 -- 172.21.15.88:0/25741053 >> 172.21.15.88:0/25741053 conn(0x7efe000a9fb0 msgr2=0x7efe001319b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:59.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 -- 172.21.15.88:0/25741053 shutdown_connections 2020-02-11T16:20:59.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.488+0000 7efdfffff700 1 -- 172.21.15.88:0/25741053 wait complete. 2020-02-11T16:20:59.511 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:20:59.512 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:59.512 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:59.512 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:20:59.512 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 122, 2020-02-11T16:20:59.512 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:20:59.512 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:20:59.512 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:20:59.512 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:20:59.513 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.513 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:20:59.513 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:59.513 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:20:59.513 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:20:59.513 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:59.514 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:59.514 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:59.514 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:59.514 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:59.514 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:59.514 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.515 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:20:59.515 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:20:59.515 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:59.515 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:59.515 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:59.515 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:59.515 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:59.516 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:59.516 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.516 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:20:59.516 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:20:59.516 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:20:59.516 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:20:59.517 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:20:59.517 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:20:59.517 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:59.517 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:59.517 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:20:59.517 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:20:59.517 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:59.518 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:20:59.518 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:59.518 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:59.518 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:59.518 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:59.518 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:59.518 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:59.519 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.519 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:20:59.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.519 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:20:59.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.519 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:20:59.519 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:20:59.519 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:59.520 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:59.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.520 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:59.520 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:20:59.520 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.521 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:59.521 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:20:59.521 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.521 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.521 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.522 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:20:59.522 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:20:59.522 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:59.522 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:59.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.523 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:59.523 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:59.523 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:59.523 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:59.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.524 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:59.524 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:20:59.524 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.524 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:59.524 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:20:59.525 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.525 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.525 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.525 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:20:59.525 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:20:59.526 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:59.526 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:59.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.526 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:59.526 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:59.526 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:59.527 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:59.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:59.527 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:20:59.527 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.528 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:59.528 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:20:59.528 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.528 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.528 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.528 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:20:59.528 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:20:59.529 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:59.529 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:59.529 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.529 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.529 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:20:59.530 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:20:59.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.530 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:59.530 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:59.530 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:59.530 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.530 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.531 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:20:59.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.531 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:59.531 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:59.531 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:20:59.531 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.531 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.531 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:20:59.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.532 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:59.532 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:59.532 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:59.532 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.532 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.532 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.533 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:20:59.533 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:20:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.636+0000 7fa431275700 1 Processor -- start 2020-02-11T16:20:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.636+0000 7fa431275700 1 -- start start 2020-02-11T16:20:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa431275700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa42c0a5de0 0x7fa42c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa431275700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa42c134a50 0x7fa42c134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa431275700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0a31b0 con 0x7fa42c0a18a0 2020-02-11T16:20:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa431275700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0a3570 con 0x7fa42c0a5de0 2020-02-11T16:20:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa431275700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0a3810 con 0x7fa42c134a50 2020-02-11T16:20:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa42affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa42c0a18a0 0x7fa42c0a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45158/0 (socket says 172.21.15.88:45158) 2020-02-11T16:20:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa42affd700 1 -- 172.21.15.88:0/3983071610 learned_addr learned my addr 172.21.15.88:0/3983071610 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787353132 0 0) 0x7fa42c0a31b0 con 0x7fa42c0a18a0 2020-02-11T16:20:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa42a7fc700 1 --2- 172.21.15.88:0/3983071610 >> v2:172.21.15.52:3300/0 conn(0x7fa42c0a5de0 0x7fa42c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa42c134a50 0x7fa42c134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.637+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa410003230 con 0x7fa42c0a18a0 2020-02-11T16:20:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 237955147 0 0) 0x7fa410003230 con 0x7fa42c0a18a0 2020-02-11T16:20:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa42c134a50 msgr2=0x7fa42c134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa42c134a50 0x7fa42c134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 >> v2:172.21.15.52:3300/0 conn(0x7fa42c0a5de0 msgr2=0x7fa42c0a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 --2- 172.21.15.88:0/3983071610 >> v2:172.21.15.52:3300/0 conn(0x7fa42c0a5de0 0x7fa42c0a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0a3ab0 con 0x7fa42c0a18a0 2020-02-11T16:20:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa4200016d0 con 0x7fa42c0a18a0 2020-02-11T16:20:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa42c134a50 0x7fa42c134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:20:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42a7fc700 1 --2- 172.21.15.88:0/3983071610 >> v2:172.21.15.52:3300/0 conn(0x7fa42c0a5de0 0x7fa42c0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:20:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 >> v1:172.21.15.88:6789/0 conn(0x7fa42c0a18a0 legacy=0x7fa42c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa410003720 0x7fa410003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa42c134a50 0x7fa4100044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa410004930 0x7fa410004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0a3570 con 0x7fa410003720 2020-02-11T16:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0a3810 con 0x7fa410004930 2020-02-11T16:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa410004110 con 0x7fa42c134a50 2020-02-11T16:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa410004930 0x7fa410004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42affd700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa410003720 0x7fa410003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42a7fc700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa42c134a50 0x7fa4100044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 -- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa42c134a50 msgr2=0x7fa4100044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa42c134a50 0x7fa4100044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 -- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa410003720 msgr2=0x7fa410003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa410003720 0x7fa410003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 -- 172.21.15.88:0/3983071610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410003230 con 0x7fa410004930 2020-02-11T16:20:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa410004930 0x7fa410004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4240032b0 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa410004930 0x7fa410004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4240032b0 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa410004930 0x7fa410004db0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fa4240032b0 tx=0x7fa4240102b0).ready entity=mon.1 client_cookie=76bbf56580e9a1e0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa410004930 0x7fa410004db0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fa4240032b0 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa424005a40 con 0x7fa410004930 2020-02-11T16:20:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa410004930 0x7fa410004db0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fa4240032b0 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa410004930 0x7fa410004db0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fa4240032b0 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424005ba0 con 0x7fa410004930 2020-02-11T16:20:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa429ffb700 1 -- 172.21.15.88:0/3983071610 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4240110c0 con 0x7fa410004930 2020-02-11T16:20:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa431275700 1 -- 172.21.15.88:0/3983071610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa410004930 msgr2=0x7fa410004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa431275700 1 --2- 172.21.15.88:0/3983071610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa410004930 0x7fa410004db0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fa4240032b0 tx=0x7fa4240102b0).stop 2020-02-11T16:20:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.638+0000 7fa42b7fe700 1 -- 172.21.15.88:0/3983071610 reap_dead start 2020-02-11T16:20:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.639+0000 7fa431275700 1 -- 172.21.15.88:0/3983071610 shutdown_connections 2020-02-11T16:20:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.639+0000 7fa431275700 1 -- 172.21.15.88:0/3983071610 >> 172.21.15.88:0/3983071610 conn(0x7fa42c09d110 msgr2=0x7fa42c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.639+0000 7fa431275700 1 -- 172.21.15.88:0/3983071610 shutdown_connections 2020-02-11T16:20:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.639+0000 7fa431275700 1 -- 172.21.15.88:0/3983071610 wait complete. 2020-02-11T16:20:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.640+0000 7fa431275700 1 Processor -- start 2020-02-11T16:20:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.640+0000 7fa431275700 1 -- start start 2020-02-11T16:20:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.640+0000 7fa431275700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa42c126e80 0x7fa42c127330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.640+0000 7fa431275700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa42c127790 0x7fa42c150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.640+0000 7fa431275700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0a7660 con 0x7fa42c136df0 2020-02-11T16:20:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.640+0000 7fa431275700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0a96d0 con 0x7fa42c126e80 2020-02-11T16:20:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.640+0000 7fa431275700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c137750 con 0x7fa42c127790 2020-02-11T16:20:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.640+0000 7fa42affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa42c136df0 0x7fa42c0a9b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45168/0 (socket says 172.21.15.88:45168) 2020-02-11T16:20:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.640+0000 7fa42affd700 1 -- 172.21.15.88:0/3469903587 learned_addr learned my addr 172.21.15.88:0/3469903587 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.640+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3469903587 >> v2:172.21.15.88:3300/0 conn(0x7fa42c127790 0x7fa42c150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42a7fc700 1 --2- 172.21.15.88:0/3469903587 >> v2:172.21.15.52:3300/0 conn(0x7fa42c126e80 0x7fa42c127330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 -- 172.21.15.88:0/3469903587 >> v2:172.21.15.52:3300/0 conn(0x7fa42c126e80 msgr2=0x7fa42c127330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3469903587 >> v2:172.21.15.52:3300/0 conn(0x7fa42c126e80 0x7fa42c127330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 -- 172.21.15.88:0/3469903587 >> v1:172.21.15.88:6789/0 conn(0x7fa42c136df0 legacy=0x7fa42c0a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989235705 0 0) 0x7fa42c0a7660 con 0x7fa42c136df0 2020-02-11T16:20:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 -- 172.21.15.88:0/3469903587 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c1384b0 con 0x7fa42c127790 2020-02-11T16:20:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3469903587 >> v2:172.21.15.88:3300/0 conn(0x7fa42c127790 0x7fa42c150030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa42c0a1410 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3469903587 >> v2:172.21.15.88:3300/0 conn(0x7fa42c127790 0x7fa42c150030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa42c0a1410 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa42c127790 0x7fa42c150030 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fa42c0a1410 tx=0x7fa4240102b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa42c127790 0x7fa42c150030 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fa42c0a1410 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa424005ea0 con 0x7fa42c127790 2020-02-11T16:20:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa42c127790 0x7fa42c150030 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fa42c0a1410 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa42c127790 0x7fa42c150030 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fa42c0a1410 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42400f1f0 con 0x7fa42c127790 2020-02-11T16:20:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa431275700 1 -- 172.21.15.88:0/3469903587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c0aa600 con 0x7fa42c127790 2020-02-11T16:20:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa42400f550 con 0x7fa42c127790 2020-02-11T16:20:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa431275700 1 -- 172.21.15.88:0/3469903587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c0a4780 con 0x7fa42c127790 2020-02-11T16:20:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.641+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa42c127790 0x7fa42c150030 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fa42c0a1410 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa42400f6b0 con 0x7fa42c127790 2020-02-11T16:20:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa42b7fe700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa42c127790 0x7fa42c150030 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fa42c0a1410 tx=0x7fa4240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa431275700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 0x7fa42c1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa431275700 1 -- 172.21.15.88:0/3469903587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c05e2f0 con 0x7fa42c12a630 2020-02-11T16:20:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa41bfff700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa408039be0 0x7fa40803c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 0x7fa42c1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa424049bd0 con 0x7fa42c127790 2020-02-11T16:20:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa42a7fc700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa408039be0 0x7fa40803c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa42affd700 1 -- 172.21.15.88:0/3469903587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa42c138330 con 0x7fa42c12a630 2020-02-11T16:20:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 0x7fa42c1358f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa42a7fc700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa408039be0 0x7fa40803c0a0 crc :-1 s=READY pgs=378 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 0x7fa42c1358f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.642+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 0x7fa42c1358f0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.643+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 0x7fa42c1358f0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.643+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa42000cbe0 con 0x7fa42c12a630 2020-02-11T16:20:59.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.643+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 0x7fa42c1358f0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.643+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa42000cd40 con 0x7fa42c12a630 2020-02-11T16:20:59.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.643+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 msgr2=0x7fa42c1358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.643+0000 7fa41bfff700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 0x7fa42c1358f0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).stop 2020-02-11T16:20:59.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.643+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 msgr2=0x7fa42c1358f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:59.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.643+0000 7fa41bfff700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12a630 0x7fa42c1358f0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).stop 2020-02-11T16:20:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.651+0000 7fa431275700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 0x7fa42c135d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.651+0000 7fa431275700 1 -- 172.21.15.88:0/3469903587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0aaa60 con 0x7fa42c12aa10 2020-02-11T16:20:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.651+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 0x7fa42c135d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.651+0000 7fa42affd700 1 -- 172.21.15.88:0/3469903587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa42c0565b0 con 0x7fa42c12aa10 2020-02-11T16:20:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.651+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 0x7fa42c135d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 0x7fa42c135d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 0x7fa42c135d50 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 0x7fa42c135d50 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa420011db0 con 0x7fa42c12aa10 2020-02-11T16:20:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa42affd700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 0x7fa42c135d50 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3853 (secure 0 0 0) 0x7fa420007f20 con 0x7fa42c12aa10 2020-02-11T16:20:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 msgr2=0x7fa42c135d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa41bfff700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 0x7fa42c135d50 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fa42000e940 tx=0x7fa42c12f3b0).stop 2020-02-11T16:20:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa41bfff700 1 -- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 msgr2=0x7fa42c135d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa41bfff700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42c12aa10 0x7fa42c135d50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa431275700 1 -- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa408039be0 msgr2=0x7fa40803c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa431275700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa408039be0 0x7fa40803c0a0 crc :-1 s=READY pgs=378 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa431275700 1 -- 172.21.15.88:0/3469903587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa42c127790 msgr2=0x7fa42c150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa431275700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa42c127790 0x7fa42c150030 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fa42c0a1410 tx=0x7fa4240102b0).stop 2020-02-11T16:20:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa42b7fe700 1 -- 172.21.15.88:0/3469903587 reap_dead start 2020-02-11T16:20:59.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa42b7fe700 1 -- 172.21.15.88:0/3469903587 reap_dead start 2020-02-11T16:20:59.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa431275700 1 -- 172.21.15.88:0/3469903587 shutdown_connections 2020-02-11T16:20:59.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa431275700 1 --2- 172.21.15.88:0/3469903587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa42c127790 0x7fa42c150030 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa431275700 1 -- 172.21.15.88:0/3469903587 >> 172.21.15.88:0/3469903587 conn(0x7fa42c09d110 msgr2=0x7fa42c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:59.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa431275700 1 -- 172.21.15.88:0/3469903587 shutdown_connections 2020-02-11T16:20:59.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.652+0000 7fa431275700 1 -- 172.21.15.88:0/3469903587 wait complete. 2020-02-11T16:20:59.671 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:20:59.671 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:20:59.671 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:20:59.671 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:20:59.671 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 122, 2020-02-11T16:20:59.672 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:20:59.672 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:20:59.672 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:20:59.672 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:20:59.672 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.672 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:20:59.672 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:59.673 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:20:59.673 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:20:59.673 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:59.673 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:59.673 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:59.673 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:59.673 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:59.674 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:59.674 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.674 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:20:59.674 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:20:59.674 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:59.674 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:59.674 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:59.675 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:59.675 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:59.675 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:59.675 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.675 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:20:59.675 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:20:59.676 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:20:59.676 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:20:59.676 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:20:59.676 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:20:59.676 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:59.676 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:59.676 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:20:59.677 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:20:59.677 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:59.677 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:20:59.677 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:59.677 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:59.677 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:59.677 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:59.678 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:59.678 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:59.678 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.678 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:20:59.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.678 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:20:59.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.679 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:20:59.679 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:20:59.681 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:59.682 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:59.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.682 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:59.682 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:20:59.682 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.683 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:59.683 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:20:59.683 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.683 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.683 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.684 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:20:59.684 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:20:59.684 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:59.684 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:59.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.684 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:59.685 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:59.685 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:59.685 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:59.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.685 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:59.685 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:20:59.685 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.686 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:59.686 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:20:59.686 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.686 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.686 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.687 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:20:59.687 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:20:59.687 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:59.687 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:59.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.688 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:59.688 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:59.688 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:59.688 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:59.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.688 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:59.689 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:20:59.689 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.689 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:59.689 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:20:59.689 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.690 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.690 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.690 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:20:59.690 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:20:59.690 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:59.690 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:59.691 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.691 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.691 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:20:59.691 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:20:59.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.692 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:59.692 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:59.692 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:59.692 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.692 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.692 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:20:59.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.693 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:59.693 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:59.693 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:59.693 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.693 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.693 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.693 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:20:59.694 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:20:59.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.798+0000 7fa19903f700 1 Processor -- start 2020-02-11T16:20:59.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.798+0000 7fa19903f700 1 -- start start 2020-02-11T16:20:59.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19903f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1940a7120 0x7fa1940a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19903f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1940a50f0 0x7fa1940a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19903f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa19413c120 0x7fa19413c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19903f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1940a6470 con 0x7fa1940a7120 2020-02-11T16:20:59.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19903f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1940a49b0 con 0x7fa1940a50f0 2020-02-11T16:20:59.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19903f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940a4c50 con 0x7fa19413c120 2020-02-11T16:20:59.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1940a50f0 0x7fa1940a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1940a50f0 0x7fa1940a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57558/0 (socket says 172.21.15.88:57558) 2020-02-11T16:20:59.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 -- 172.21.15.88:0/3183766034 learned_addr learned my addr 172.21.15.88:0/3183766034 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:20:59.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19359e700 1 --2- 172.21.15.88:0/3183766034 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa19413c120 0x7fa19413c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3183766034 >> v2:172.21.15.52:3300/0 conn(0x7fa1940a7120 0x7fa1940a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 -- 172.21.15.88:0/3183766034 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa19413c120 msgr2=0x7fa19413c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:59.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3183766034 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa19413c120 0x7fa19413c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 -- 172.21.15.88:0/3183766034 >> v2:172.21.15.52:3300/0 conn(0x7fa1940a7120 msgr2=0x7fa1940a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:59.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3183766034 >> v2:172.21.15.52:3300/0 conn(0x7fa1940a7120 0x7fa1940a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 -- 172.21.15.88:0/3183766034 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1940a55a0 con 0x7fa1940a50f0 2020-02-11T16:20:59.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3183766034 >> v2:172.21.15.52:3300/0 conn(0x7fa1940a7120 0x7fa1940a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:20:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3183766034 >> v2:172.21.15.88:3300/0 conn(0x7fa1940a50f0 0x7fa1940a5cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3183766034 >> v2:172.21.15.88:3300/0 conn(0x7fa1940a50f0 0x7fa1940a5cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3183766034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1940a50f0 0x7fa1940a5cf0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).ready entity=mon.1 client_cookie=cf0b5f062aecee99 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3183766034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1940a50f0 0x7fa1940a5cf0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19259c700 1 -- 172.21.15.88:0/3183766034 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa17c011720 con 0x7fa1940a50f0 2020-02-11T16:20:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3183766034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1940a50f0 0x7fa1940a5cf0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3183766034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1940a50f0 0x7fa1940a5cf0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19259c700 1 -- 172.21.15.88:0/3183766034 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c011880 con 0x7fa1940a50f0 2020-02-11T16:20:59.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19259c700 1 -- 172.21.15.88:0/3183766034 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa17c011c20 con 0x7fa1940a50f0 2020-02-11T16:20:59.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19903f700 1 -- 172.21.15.88:0/3183766034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1940a50f0 msgr2=0x7fa1940a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.799+0000 7fa19903f700 1 --2- 172.21.15.88:0/3183766034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1940a50f0 0x7fa1940a5cf0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).stop 2020-02-11T16:20:59.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.800+0000 7fa19903f700 1 -- 172.21.15.88:0/3183766034 shutdown_connections 2020-02-11T16:20:59.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.800+0000 7fa19903f700 1 --2- 172.21.15.88:0/3183766034 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa19413c120 0x7fa19413c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.800+0000 7fa19903f700 1 --2- 172.21.15.88:0/3183766034 >> v2:172.21.15.52:3300/0 conn(0x7fa1940a7120 0x7fa1940a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.800+0000 7fa19903f700 1 --2- 172.21.15.88:0/3183766034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1940a50f0 0x7fa1940a5cf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.800+0000 7fa19903f700 1 -- 172.21.15.88:0/3183766034 >> 172.21.15.88:0/3183766034 conn(0x7fa19409d110 msgr2=0x7fa19409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:59.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.800+0000 7fa19903f700 1 -- 172.21.15.88:0/3183766034 shutdown_connections 2020-02-11T16:20:59.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.800+0000 7fa19903f700 1 -- 172.21.15.88:0/3183766034 wait complete. 2020-02-11T16:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa19903f700 1 Processor -- start 2020-02-11T16:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa19903f700 1 -- start start 2020-02-11T16:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa19903f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1940a7120 0x7fa194130d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa19903f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa19413c120 0x7fa194131190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa19903f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19413bf30 con 0x7fa1940a50f0 2020-02-11T16:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa19903f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1941315f0 con 0x7fa1940a7120 2020-02-11T16:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa19903f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1941395b0 con 0x7fa19413c120 2020-02-11T16:20:59.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa192d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa1940a50f0 0x7fa19413b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45186/0 (socket says 172.21.15.88:45186) 2020-02-11T16:20:59.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa192d9d700 1 -- 172.21.15.88:0/3966207407 learned_addr learned my addr 172.21.15.88:0/3966207407 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:20:59.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3966207407 >> v2:172.21.15.52:3300/0 conn(0x7fa1940a7120 0x7fa194130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.801+0000 7fa19359e700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa19413c120 0x7fa194131190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729507397 0 0) 0x7fa184001ec0 con 0x7fa1940a50f0 2020-02-11T16:20:59.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa178002fe0 con 0x7fa1940a50f0 2020-02-11T16:20:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa18bfff700 1 -- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa19413c120 msgr2=0x7fa194131190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa19413c120 0x7fa194131190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa18bfff700 1 -- 172.21.15.88:0/3966207407 >> v1:172.21.15.88:6789/0 conn(0x7fa1940a50f0 legacy=0x7fa19413b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa18bfff700 1 -- 172.21.15.88:0/3966207407 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194139850 con 0x7fa1940a7120 2020-02-11T16:20:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa19359e700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa19413c120 0x7fa194131190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:20:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3966207407 >> v2:172.21.15.52:3300/0 conn(0x7fa1940a7120 0x7fa194130d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3966207407 >> v2:172.21.15.52:3300/0 conn(0x7fa1940a7120 0x7fa194130d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1940a7120 0x7fa194130d30 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1940a7120 0x7fa194130d30 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa17c00f910 con 0x7fa1940a7120 2020-02-11T16:20:59.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1940a7120 0x7fa194130d30 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c011e60 con 0x7fa1940a7120 2020-02-11T16:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1940a7120 0x7fa194130d30 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa17c007340 con 0x7fa1940a7120 2020-02-11T16:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa19903f700 1 -- 172.21.15.88:0/3966207407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1941391c0 con 0x7fa1940a7120 2020-02-11T16:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.802+0000 7fa19903f700 1 -- 172.21.15.88:0/3966207407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1940a95b0 con 0x7fa1940a7120 2020-02-11T16:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1940a7120 0x7fa194130d30 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa19903f700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 0x7fa194132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa19903f700 1 -- 172.21.15.88:0/3966207407 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19405e2f0 con 0x7fa1941371e0 2020-02-11T16:20:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 0x7fa194132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa17c0056c0 con 0x7fa1940a7120 2020-02-11T16:20:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa18bfff700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1940a7120 0x7fa194130d30 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa190d99700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa178039f30 0x7fa17803c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa17c049e30 con 0x7fa1940a7120 2020-02-11T16:20:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa192d9d700 1 -- 172.21.15.88:0/3966207407 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa194136b70 con 0x7fa1941371e0 2020-02-11T16:20:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 0x7fa194132ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa19359e700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa178039f30 0x7fa17803c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 0x7fa194132ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.803+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 0x7fa194132ea0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.804+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 0x7fa194132ea0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.804+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa184007540 con 0x7fa1941371e0 2020-02-11T16:20:59.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.804+0000 7fa19359e700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa178039f30 0x7fa17803c3f0 crc :-1 s=READY pgs=379 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.804+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 0x7fa194132ea0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.804+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa1840059c0 con 0x7fa1941371e0 2020-02-11T16:20:59.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.804+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 msgr2=0x7fa194132ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.804+0000 7fa190d99700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 0x7fa194132ea0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).stop 2020-02-11T16:20:59.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.804+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 msgr2=0x7fa194132ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:59.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.804+0000 7fa190d99700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1941371e0 0x7fa194132ea0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.812+0000 7fa19903f700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 0x7fa1940a82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.812+0000 7fa19903f700 1 -- 172.21.15.88:0/3966207407 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1941396f0 con 0x7fa1940a7ef0 2020-02-11T16:20:59.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.812+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 0x7fa1940a82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.812+0000 7fa192d9d700 1 -- 172.21.15.88:0/3966207407 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa1940565b0 con 0x7fa1940a7ef0 2020-02-11T16:20:59.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.812+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 0x7fa1940a82d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.812+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 0x7fa1940a82d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.812+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 0x7fa1940a82d0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 0x7fa1940a82d0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa18400b430 con 0x7fa1940a7ef0 2020-02-11T16:20:59.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa192d9d700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 0x7fa1940a82d0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7fa18400b590 con 0x7fa1940a7ef0 2020-02-11T16:20:59.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 msgr2=0x7fa1940a82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa190d99700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 0x7fa1940a82d0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fa184002f30 tx=0x7fa184010e40).stop 2020-02-11T16:20:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa190d99700 1 -- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 msgr2=0x7fa1940a82d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:20:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa190d99700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1940a7ef0 0x7fa1940a82d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19903f700 1 -- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa178039f30 msgr2=0x7fa17803c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19903f700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa178039f30 0x7fa17803c3f0 crc :-1 s=READY pgs=379 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19903f700 1 -- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1940a7120 msgr2=0x7fa194130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19903f700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1940a7120 0x7fa194130d30 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fa17c002f30 tx=0x7fa17c007a40).stop 2020-02-11T16:20:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19359e700 1 -- 172.21.15.88:0/3966207407 reap_dead start 2020-02-11T16:20:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19359e700 1 -- 172.21.15.88:0/3966207407 reap_dead start 2020-02-11T16:20:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19903f700 1 -- 172.21.15.88:0/3966207407 shutdown_connections 2020-02-11T16:20:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19903f700 1 --2- 172.21.15.88:0/3966207407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1940a7120 0x7fa194130d30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19903f700 1 -- 172.21.15.88:0/3966207407 >> 172.21.15.88:0/3966207407 conn(0x7fa19409d110 msgr2=0x7fa19405b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19903f700 1 -- 172.21.15.88:0/3966207407 shutdown_connections 2020-02-11T16:20:59.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.813+0000 7fa19903f700 1 -- 172.21.15.88:0/3966207407 wait complete. 2020-02-11T16:20:59.831 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:20:59.831 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:59.831 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:59.831 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:20:59.831 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 122, 2020-02-11T16:20:59.832 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:20:59.832 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:20:59.832 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:20:59.832 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:20:59.832 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.832 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:20:59.833 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:59.833 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:20:59.833 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:20:59.833 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:59.833 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:59.833 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:59.833 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:59.834 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:59.834 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:59.834 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.834 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:20:59.834 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:20:59.834 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:59.835 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:59.835 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:59.835 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:59.835 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:59.835 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:59.835 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.836 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:20:59.836 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:20:59.836 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:20:59.836 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:20:59.836 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:20:59.836 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:20:59.836 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:59.837 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:20:59.837 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:20:59.837 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:20:59.837 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:20:59.837 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:20:59.837 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:20:59.837 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:20:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:20:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:20:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:20:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:20:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:20:59.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:20:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:20:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:20:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:59.839 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:20:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:20:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:20:59.841 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:20:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:20:59.842 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:20:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:20:59.843 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:20:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.844 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:20:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:20:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:59.845 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:20:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:20:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:20:59.846 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:20:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:20:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:20:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.847 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:20:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:20:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:20:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.848 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:20:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:20:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:20:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:20:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:20:59.849 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:20:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:20:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:20:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:20:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:20:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:59.852 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:20:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:20:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:59.853 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:20:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:20:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:20:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:20:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:20:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:20:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:20:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:20:59.863 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:20:59.863 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:20:59.864 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2020-02-11T16:20:59.864 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:20:59.864 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2020-02-11T16:20:59.864 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:20:59.865 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-02-11T16:20:59.865 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:20:59.879 INFO:tasks.ceph.mon.c:Stopped 2020-02-11T16:20:59.879 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:20:59.880 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:20:59.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.981+0000 7eff31468700 1 Processor -- start 2020-02-11T16:20:59.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.981+0000 7eff31468700 1 -- start start 2020-02-11T16:20:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.982+0000 7eff31468700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff2c0a5b20 0x7eff2c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.982+0000 7eff31468700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7eff2c131280 0x7eff2c1316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:20:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.982+0000 7eff31468700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c0a4350 con 0x7eff2c0a2fa0 2020-02-11T16:20:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.982+0000 7eff31468700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c0a1e60 con 0x7eff2c131280 2020-02-11T16:20:59.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.982+0000 7eff31468700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c0a3450 con 0x7eff2c0a5b20 2020-02-11T16:20:59.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.982+0000 7eff2a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff2c0a5b20 0x7eff2c0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.982+0000 7eff2a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff2c0a5b20 0x7eff2c0a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57608/0 (socket says 172.21.15.88:57608) 2020-02-11T16:20:59.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.982+0000 7eff2a7fc700 1 -- 172.21.15.88:0/2827232740 learned_addr learned my addr 172.21.15.88:0/2827232740 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:20:59.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2a7fc700 1 -- 172.21.15.88:0/2827232740 >> v2:172.21.15.52:3300/0 conn(0x7eff2c131280 msgr2=0x7eff2c1316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:59.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2b7fe700 1 --2- 172.21.15.88:0/2827232740 >> v2:172.21.15.52:3300/0 conn(0x7eff2c131280 0x7eff2c1316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2827232740 >> v2:172.21.15.52:3300/0 conn(0x7eff2c131280 0x7eff2c1316f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2a7fc700 1 -- 172.21.15.88:0/2827232740 >> v1:172.21.15.52:6789/0 conn(0x7eff2c0a2fa0 legacy=0x7eff2c0a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:20:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2a7fc700 1 -- 172.21.15.88:0/2827232740 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0a3a40 con 0x7eff2c0a5b20 2020-02-11T16:20:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2827232740 >> v2:172.21.15.88:3300/0 conn(0x7eff2c0a5b20 0x7eff2c0a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2827232740 >> v2:172.21.15.88:3300/0 conn(0x7eff2c0a5b20 0x7eff2c0a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2827232740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c0a1520 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).ready entity=mon.1 client_cookie=87d84a6c729d5fc0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2827232740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c0a1520 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff29ffb700 1 -- 172.21.15.88:0/2827232740 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1c0116e0 con 0x7eff2c0a5b20 2020-02-11T16:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2827232740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c0a1520 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2827232740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c0a1520 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff29ffb700 1 -- 172.21.15.88:0/2827232740 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c011840 con 0x7eff2c0a5b20 2020-02-11T16:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff29ffb700 1 -- 172.21.15.88:0/2827232740 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1c011be0 con 0x7eff2c0a5b20 2020-02-11T16:20:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff31468700 1 -- 172.21.15.88:0/2827232740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 msgr2=0x7eff2c0a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff31468700 1 --2- 172.21.15.88:0/2827232740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c0a1520 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).stop 2020-02-11T16:20:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff31468700 1 -- 172.21.15.88:0/2827232740 shutdown_connections 2020-02-11T16:20:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff31468700 1 --2- 172.21.15.88:0/2827232740 >> v2:172.21.15.52:3300/0 conn(0x7eff2c131280 0x7eff2c1316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:20:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff31468700 1 --2- 172.21.15.88:0/2827232740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c0a1520 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:20:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff31468700 1 -- 172.21.15.88:0/2827232740 >> 172.21.15.88:0/2827232740 conn(0x7eff2c09d110 msgr2=0x7eff2c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff31468700 1 -- 172.21.15.88:0/2827232740 shutdown_connections 2020-02-11T16:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.983+0000 7eff31468700 1 -- 172.21.15.88:0/2827232740 wait complete. 2020-02-11T16:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.984+0000 7eff31468700 1 Processor -- start 2020-02-11T16:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.984+0000 7eff31468700 1 -- start start 2020-02-11T16:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff31468700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff2c0a5b20 0x7eff2c132b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff31468700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c09f8b0 con 0x7eff2c131280 2020-02-11T16:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff31468700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c09fd00 con 0x7eff2c0a2fa0 2020-02-11T16:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff31468700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c09ffa0 con 0x7eff2c0a5b20 2020-02-11T16:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff2c0a5b20 0x7eff2c132b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff2c0a5b20 0x7eff2c132b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57616/0 (socket says 172.21.15.88:57616) 2020-02-11T16:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 -- 172.21.15.88:0/2445574466 learned_addr learned my addr 172.21.15.88:0/2445574466 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2affd700 1 --1- 172.21.15.88:0/2445574466 >> v1:172.21.15.88:6789/0 conn(0x7eff2c0a2fa0 0x7eff2c146460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45240/0 (socket says 172.21.15.88:45240) 2020-02-11T16:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 -- 172.21.15.88:0/2445574466 >> v1:172.21.15.88:6789/0 conn(0x7eff2c0a2fa0 legacy=0x7eff2c146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 -- 172.21.15.88:0/2445574466 >> v1:172.21.15.52:6789/0 conn(0x7eff2c131280 legacy=0x7eff2c09f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:20:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff23fff700 1 -- 172.21.15.88:0/2445574466 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437991954 0 0) 0x7eff2c09fd00 con 0x7eff2c0a2fa0 2020-02-11T16:20:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 -- 172.21.15.88:0/2445574466 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0a0240 con 0x7eff2c0a5b20 2020-02-11T16:20:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2445574466 >> v2:172.21.15.88:3300/0 conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2445574466 >> v2:172.21.15.88:3300/0 conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:20:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff23fff700 1 -- 172.21.15.88:0/2445574466 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1c007340 con 0x7eff2c0a5b20 2020-02-11T16:20:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff23fff700 1 -- 172.21.15.88:0/2445574466 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c0074a0 con 0x7eff2c0a5b20 2020-02-11T16:20:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.985+0000 7eff31468700 1 -- 172.21.15.88:0/2445574466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c0a04e0 con 0x7eff2c0a5b20 2020-02-11T16:20:59.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.986+0000 7eff23fff700 1 -- 172.21.15.88:0/2445574466 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1c0058b0 con 0x7eff2c0a5b20 2020-02-11T16:20:59.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.986+0000 7eff31468700 1 -- 172.21.15.88:0/2445574466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c0a0980 con 0x7eff2c0a5b20 2020-02-11T16:20:59.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.986+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.986+0000 7eff23fff700 1 -- 172.21.15.88:0/2445574466 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7eff1c005b70 con 0x7eff2c0a5b20 2020-02-11T16:20:59.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.986+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:20:59.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.986+0000 7eff23fff700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff100399f0 0x7eff1003beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:00.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.986+0000 7eff31468700 1 -- 172.21.15.88:0/2445574466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c0a0670 con 0x7eff2c0a5b20 2020-02-11T16:21:00.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.987+0000 7eff23fff700 1 -- 172.21.15.88:0/2445574466 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7eff1c04a3b0 con 0x7eff2c0a5b20 2020-02-11T16:21:00.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.987+0000 7eff2affd700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff100399f0 0x7eff1003beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:00.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.987+0000 7eff2affd700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff100399f0 0x7eff1003beb0 crc :-1 s=READY pgs=380 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.990+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:20:59.990+0000 7eff23fff700 1 -- 172.21.15.88:0/2445574466 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7eff1c032980 con 0x7eff2c0a5b20 2020-02-11T16:21:00.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.171+0000 7eff31468700 1 -- 172.21.15.88:0/2445574466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7eff2c0565b0 con 0x7eff2c0a5b20 2020-02-11T16:21:00.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.171+0000 7eff2a7fc700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:00.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.171+0000 7eff23fff700 1 -- 172.21.15.88:0/2445574466 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7eff1c032540 con 0x7eff2c0a5b20 2020-02-11T16:21:00.174 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":122,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.172+0000 7eff31468700 1 -- 172.21.15.88:0/2445574466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff100399f0 msgr2=0x7eff1003beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.172+0000 7eff31468700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff100399f0 0x7eff1003beb0 crc :-1 s=READY pgs=380 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.172+0000 7eff31468700 1 -- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 msgr2=0x7eff2c132b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.172+0000 7eff31468700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c132b40 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7eff2c05ef00 tx=0x7eff1c007a40).stop 2020-02-11T16:21:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.173+0000 7eff31468700 1 -- 172.21.15.88:0/2445574466 shutdown_connections 2020-02-11T16:21:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.173+0000 7eff31468700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7eff100399f0 0x7eff1003beb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.173+0000 7eff31468700 1 --2- 172.21.15.88:0/2445574466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff2c0a5b20 0x7eff2c132b40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.173+0000 7eff31468700 1 -- 172.21.15.88:0/2445574466 >> 172.21.15.88:0/2445574466 conn(0x7eff2c09d110 msgr2=0x7eff2c0aa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.173+0000 7eff31468700 1 -- 172.21.15.88:0/2445574466 shutdown_connections 2020-02-11T16:21:00.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:00.173+0000 7eff31468700 1 -- 172.21.15.88:0/2445574466 wait complete. 2020-02-11T16:21:00.185 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":122,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:03.187 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:21:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.301+0000 7f3b63624700 1 Processor -- start 2020-02-11T16:21:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.301+0000 7f3b63624700 1 -- start start 2020-02-11T16:21:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.301+0000 7f3b63624700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.301+0000 7f3b63624700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b5c134a50 0x7f3b5c134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.301+0000 7f3b63624700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c0a31b0 con 0x7f3b5c0a18a0 2020-02-11T16:21:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.301+0000 7f3b63624700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c0a3570 con 0x7f3b5c0a5de0 2020-02-11T16:21:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.301+0000 7f3b63624700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0a3810 con 0x7f3b5c134a50 2020-02-11T16:21:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b61bc1700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b5c134a50 msgr2=0x7f3b5c134ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b61bc1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b5c134a50 0x7f3b5c134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43608/0 (socket says 172.21.15.88:43608) 2020-02-11T16:21:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 -- 172.21.15.88:0/3925031307 learned_addr learned my addr 172.21.15.88:0/3925031307 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b613c0700 1 --1- 172.21.15.88:0/3925031307 >> v1:172.21.15.52:6789/0 conn(0x7f3b5c0a18a0 0x7f3b5c0a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37030/0 (socket says 172.21.15.88:37030) 2020-02-11T16:21:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 -- 172.21.15.88:0/3925031307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b5c134a50 msgr2=0x7f3b5c134ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 --2- 172.21.15.88:0/3925031307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b5c134a50 0x7f3b5c134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 -- 172.21.15.88:0/3925031307 >> v1:172.21.15.52:6789/0 conn(0x7f3b5c0a18a0 legacy=0x7f3b5c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b4bfff700 1 -- 172.21.15.88:0/3925031307 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129870071 0 0) 0x7f3b5c0a31b0 con 0x7f3b5c0a18a0 2020-02-11T16:21:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 -- 172.21.15.88:0/3925031307 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0a3ab0 con 0x7f3b5c0a5de0 2020-02-11T16:21:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 --2- 172.21.15.88:0/3925031307 >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b4c002f30 tx=0x7f3b4c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 --2- 172.21.15.88:0/3925031307 >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b4c002f30 tx=0x7f3b4c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 --2- 172.21.15.88:0/3925031307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f3b4c002f30 tx=0x7f3b4c0088e0).ready entity=mon.0 client_cookie=c8c41f93e4dd3b35 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 --2- 172.21.15.88:0/3925031307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f3b4c002f30 tx=0x7f3b4c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b4bfff700 1 -- 172.21.15.88:0/3925031307 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b4c008e20 con 0x7f3b5c0a5de0 2020-02-11T16:21:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 --2- 172.21.15.88:0/3925031307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f3b4c002f30 tx=0x7f3b4c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b4bfff700 1 -- 172.21.15.88:0/3925031307 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c011950 con 0x7f3b5c0a5de0 2020-02-11T16:21:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b60bbf700 1 --2- 172.21.15.88:0/3925031307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f3b4c002f30 tx=0x7f3b4c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b4bfff700 1 -- 172.21.15.88:0/3925031307 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b4c011d30 con 0x7f3b5c0a5de0 2020-02-11T16:21:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b63624700 1 -- 172.21.15.88:0/3925031307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0a5de0 msgr2=0x7f3b5c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.302+0000 7f3b63624700 1 --2- 172.21.15.88:0/3925031307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f3b4c002f30 tx=0x7f3b4c0088e0).stop 2020-02-11T16:21:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.303+0000 7f3b63624700 1 -- 172.21.15.88:0/3925031307 shutdown_connections 2020-02-11T16:21:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.303+0000 7f3b63624700 1 --2- 172.21.15.88:0/3925031307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b5c134a50 0x7f3b5c134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.303+0000 7f3b63624700 1 --2- 172.21.15.88:0/3925031307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0a5de0 0x7f3b5c0a6260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.303+0000 7f3b63624700 1 -- 172.21.15.88:0/3925031307 >> 172.21.15.88:0/3925031307 conn(0x7f3b5c09d110 msgr2=0x7f3b5c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.303+0000 7f3b63624700 1 -- 172.21.15.88:0/3925031307 shutdown_connections 2020-02-11T16:21:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.303+0000 7f3b63624700 1 -- 172.21.15.88:0/3925031307 wait complete. 2020-02-11T16:21:03.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.304+0000 7f3b63624700 1 Processor -- start 2020-02-11T16:21:03.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.304+0000 7f3b63624700 1 -- start start 2020-02-11T16:21:03.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.304+0000 7f3b63624700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0a18a0 0x7f3b5c130ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b63624700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b5c134a50 0x7f3b5c130f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b63624700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c0aa560 con 0x7f3b5c0a5de0 2020-02-11T16:21:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b63624700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c0aa800 con 0x7f3b5c0a18a0 2020-02-11T16:21:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b63624700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c0aaaa0 con 0x7f3b5c134a50 2020-02-11T16:21:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b5c134a50 0x7f3b5c130f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b60bbf700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3b5c0a5de0 0x7f3b5c1294c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45254/0 (socket says 172.21.15.88:45254) 2020-02-11T16:21:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b5c134a50 0x7f3b5c130f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57630/0 (socket says 172.21.15.88:57630) 2020-02-11T16:21:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b60bbf700 1 -- 172.21.15.88:0/2757505392 learned_addr learned my addr 172.21.15.88:0/2757505392 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b613c0700 1 --2- 172.21.15.88:0/2757505392 >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0a18a0 0x7f3b5c130ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 -- 172.21.15.88:0/2757505392 >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0a18a0 msgr2=0x7f3b5c130ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0a18a0 0x7f3b5c130ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 -- 172.21.15.88:0/2757505392 >> v1:172.21.15.88:6789/0 conn(0x7f3b5c0a5de0 legacy=0x7f3b5c1294c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 -- 172.21.15.88:0/2757505392 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c129bd0 con 0x7f3b5c134a50 2020-02-11T16:21:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> v2:172.21.15.88:3300/0 conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> v2:172.21.15.88:3300/0 conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b4a7fc700 1 -- 172.21.15.88:0/2757505392 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b54003a60 con 0x7f3b5c134a50 2020-02-11T16:21:03.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b4a7fc700 1 -- 172.21.15.88:0/2757505392 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b54003c00 con 0x7f3b5c134a50 2020-02-11T16:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b63624700 1 -- 172.21.15.88:0/2757505392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c136460 con 0x7f3b5c134a50 2020-02-11T16:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.305+0000 7f3b4a7fc700 1 -- 172.21.15.88:0/2757505392 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b54003e30 con 0x7f3b5c134a50 2020-02-11T16:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.306+0000 7f3b63624700 1 -- 172.21.15.88:0/2757505392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c12fba0 con 0x7f3b5c134a50 2020-02-11T16:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.306+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.306+0000 7f3b4a7fc700 1 -- 172.21.15.88:0/2757505392 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3b54014920 con 0x7f3b5c134a50 2020-02-11T16:21:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.306+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.306+0000 7f3b4a7fc700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b3c039c20 0x7f3b3c03c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.306+0000 7f3b4a7fc700 1 -- 172.21.15.88:0/2757505392 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3b5404baa0 con 0x7f3b5c134a50 2020-02-11T16:21:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.307+0000 7f3b613c0700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b3c039c20 0x7f3b3c03c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.307+0000 7f3b63624700 1 -- 172.21.15.88:0/2757505392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c0565b0 con 0x7f3b5c134a50 2020-02-11T16:21:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.307+0000 7f3b613c0700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b3c039c20 0x7f3b3c03c0e0 crc :-1 s=READY pgs=381 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.310+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.310+0000 7f3b4a7fc700 1 -- 172.21.15.88:0/2757505392 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3b54031060 con 0x7f3b5c134a50 2020-02-11T16:21:03.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.490+0000 7f3b63624700 1 -- 172.21.15.88:0/2757505392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3b5c0aac10 con 0x7f3b5c134a50 2020-02-11T16:21:03.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.491+0000 7f3b61bc1700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:03.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.491+0000 7f3b4a7fc700 1 -- 172.21.15.88:0/2757505392 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f3b54033b30 con 0x7f3b5c134a50 2020-02-11T16:21:03.494 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":122,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:03.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 -- 172.21.15.88:0/2757505392 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b3c039c20 msgr2=0x7f3b3c03c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:03.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b3c039c20 0x7f3b3c03c0e0 crc :-1 s=READY pgs=381 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:03.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 -- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 msgr2=0x7f3b5c130f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:03.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 0x7f3b5c130f10 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f3b54000b20 tx=0x7f3b54012d90).stop 2020-02-11T16:21:03.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 -- 172.21.15.88:0/2757505392 shutdown_connections 2020-02-11T16:21:03.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5c134a50 0x7f3b5c130f10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:03.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 --2- 172.21.15.88:0/2757505392 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b3c039c20 0x7f3b3c03c0e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:03.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 --2- 172.21.15.88:0/2757505392 >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0a18a0 0x7f3b5c130ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:03.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 -- 172.21.15.88:0/2757505392 >> 172.21.15.88:0/2757505392 conn(0x7f3b5c09d110 msgr2=0x7f3b5c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:03.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 -- 172.21.15.88:0/2757505392 shutdown_connections 2020-02-11T16:21:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:03.492+0000 7f3b63624700 1 -- 172.21.15.88:0/2757505392 wait complete. 2020-02-11T16:21:03.505 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":122,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:06.506 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:21:06.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.620+0000 7f9601bfa700 1 Processor -- start 2020-02-11T16:21:06.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.620+0000 7f9601bfa700 1 -- start start 2020-02-11T16:21:06.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f9601bfa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:06.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f9601bfa700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 0x7f95fc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:06.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f9601bfa700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0a31b0 con 0x7f95fc12e3a0 2020-02-11T16:21:06.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f9601bfa700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc0a3570 con 0x7f95fc0a5de0 2020-02-11T16:21:06.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f9601bfa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc0a3810 con 0x7f95fc0a18a0 2020-02-11T16:21:06.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:06.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57634/0 (socket says 172.21.15.88:57634) 2020-02-11T16:21:06.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f95fc12e3a0 0x7f95fc12e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45260/0 (socket says 172.21.15.88:45260) 2020-02-11T16:21:06.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 -- 172.21.15.88:0/1855852098 learned_addr learned my addr 172.21.15.88:0/1855852098 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:06.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95faffd700 1 --2- 172.21.15.88:0/1855852098 >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 0x7f95fc0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:06.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 -- 172.21.15.88:0/1855852098 >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 msgr2=0x7f95fc0a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:21:06.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 --2- 172.21.15.88:0/1855852098 >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 0x7f95fc0a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:06.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 -- 172.21.15.88:0/1855852098 >> v1:172.21.15.88:6789/0 conn(0x7f95fc12e3a0 legacy=0x7f95fc12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:06.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 -- 172.21.15.88:0/1855852098 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0a3ab0 con 0x7f95fc0a18a0 2020-02-11T16:21:06.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95faffd700 1 --2- 172.21.15.88:0/1855852098 >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 0x7f95fc0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:21:06.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 --2- 172.21.15.88:0/1855852098 >> v2:172.21.15.88:3300/0 conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f95ec0032b0 tx=0x7f95ec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 --2- 172.21.15.88:0/1855852098 >> v2:172.21.15.88:3300/0 conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f95ec0032b0 tx=0x7f95ec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 --2- 172.21.15.88:0/1855852098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f95ec0032b0 tx=0x7f95ec007dc0).ready entity=mon.1 client_cookie=4f5b506caa8e1cdc server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:06.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 --2- 172.21.15.88:0/1855852098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f95ec0032b0 tx=0x7f95ec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 --2- 172.21.15.88:0/1855852098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f95ec0032b0 tx=0x7f95ec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fa7fc700 1 -- 172.21.15.88:0/1855852098 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95ec00a160 con 0x7f95fc0a18a0 2020-02-11T16:21:06.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fb7fe700 1 --2- 172.21.15.88:0/1855852098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f95ec0032b0 tx=0x7f95ec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fa7fc700 1 -- 172.21.15.88:0/1855852098 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec00a2c0 con 0x7f95fc0a18a0 2020-02-11T16:21:06.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f95fa7fc700 1 -- 172.21.15.88:0/1855852098 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95ec00a6a0 con 0x7f95fc0a18a0 2020-02-11T16:21:06.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f9601bfa700 1 -- 172.21.15.88:0/1855852098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc0a18a0 msgr2=0x7f95fc0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:06.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.621+0000 7f9601bfa700 1 --2- 172.21.15.88:0/1855852098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f95ec0032b0 tx=0x7f95ec007dc0).stop 2020-02-11T16:21:06.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.622+0000 7f9601bfa700 1 -- 172.21.15.88:0/1855852098 shutdown_connections 2020-02-11T16:21:06.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.622+0000 7f9601bfa700 1 --2- 172.21.15.88:0/1855852098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc0a18a0 0x7f95fc0a6dd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:06.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.622+0000 7f9601bfa700 1 --2- 172.21.15.88:0/1855852098 >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 0x7f95fc0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:06.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.622+0000 7f9601bfa700 1 -- 172.21.15.88:0/1855852098 >> 172.21.15.88:0/1855852098 conn(0x7f95fc09d110 msgr2=0x7f95fc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:06.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.622+0000 7f9601bfa700 1 -- 172.21.15.88:0/1855852098 shutdown_connections 2020-02-11T16:21:06.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.622+0000 7f9601bfa700 1 -- 172.21.15.88:0/1855852098 wait complete. 2020-02-11T16:21:06.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.623+0000 7f9601bfa700 1 Processor -- start 2020-02-11T16:21:06.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.623+0000 7f9601bfa700 1 -- start start 2020-02-11T16:21:06.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f9601bfa700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 0x7f95fc12a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:06.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f9601bfa700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f95fc12e3a0 0x7f95fc12a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:06.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f9601bfa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc131ad0 con 0x7f95fc0a18a0 2020-02-11T16:21:06.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f9601bfa700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc12ae00 con 0x7f95fc0a5de0 2020-02-11T16:21:06.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f9601bfa700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc131d00 con 0x7f95fc12e3a0 2020-02-11T16:21:06.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95fbfff700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f95fc12e3a0 msgr2=0x7f95fc12a9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:06.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95fbfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f95fc12e3a0 0x7f95fc12a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:06.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95faffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 0x7f95fc12a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:06.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95faffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 0x7f95fc12a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43628/0 (socket says 172.21.15.88:43628) 2020-02-11T16:21:06.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95faffd700 1 -- 172.21.15.88:0/4079285120 learned_addr learned my addr 172.21.15.88:0/4079285120 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:06.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95faffd700 1 -- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f95fc12e3a0 msgr2=0x7f95fc12a9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:21:06.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f95fc12e3a0 0x7f95fc12a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:06.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95faffd700 1 -- 172.21.15.88:0/4079285120 >> v1:172.21.15.52:6789/0 conn(0x7f95fc0a18a0 legacy=0x7f95fc138310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:06.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95faffd700 1 -- 172.21.15.88:0/4079285120 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc131fa0 con 0x7f95fc0a5de0 2020-02-11T16:21:06.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> v2:172.21.15.52:3300/0 conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.624+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:06.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.625+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.625+0000 7f95f8ff9700 1 -- 172.21.15.88:0/4079285120 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f0008e70 con 0x7f95fc0a5de0 2020-02-11T16:21:06.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.625+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.625+0000 7f95f8ff9700 1 -- 172.21.15.88:0/4079285120 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f0012660 con 0x7f95fc0a5de0 2020-02-11T16:21:06.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.625+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.625+0000 7f9601bfa700 1 -- 172.21.15.88:0/4079285120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc132240 con 0x7f95fc0a5de0 2020-02-11T16:21:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.625+0000 7f95f8ff9700 1 -- 172.21.15.88:0/4079285120 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f0012a40 con 0x7f95fc0a5de0 2020-02-11T16:21:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.625+0000 7f9601bfa700 1 -- 172.21.15.88:0/4079285120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc135360 con 0x7f95fc0a5de0 2020-02-11T16:21:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.625+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.626+0000 7f95f8ff9700 1 -- 172.21.15.88:0/4079285120 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f95f0012cc0 con 0x7f95fc0a5de0 2020-02-11T16:21:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.626+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.626+0000 7f9601bfa700 1 -- 172.21.15.88:0/4079285120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc0565b0 con 0x7f95fc0a5de0 2020-02-11T16:21:06.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.626+0000 7f95f8ff9700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f95dc039b40 0x7f95dc03c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:06.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.626+0000 7f95f8ff9700 1 -- 172.21.15.88:0/4079285120 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f95f004a070 con 0x7f95fc0a5de0 2020-02-11T16:21:06.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.626+0000 7f95fb7fe700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f95dc039b40 0x7f95dc03c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:06.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.626+0000 7f95fb7fe700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f95dc039b40 0x7f95dc03c000 crc :-1 s=READY pgs=382 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:06.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.630+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.630+0000 7f95f8ff9700 1 -- 172.21.15.88:0/4079285120 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f95f002f630 con 0x7f95fc0a5de0 2020-02-11T16:21:06.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.810+0000 7f9601bfa700 1 -- 172.21.15.88:0/4079285120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f95fc05ccb0 con 0x7f95fc0a5de0 2020-02-11T16:21:06.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.811+0000 7f95faffd700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:06.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.811+0000 7f95f8ff9700 1 -- 172.21.15.88:0/4079285120 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f95f0032140 con 0x7f95fc0a5de0 2020-02-11T16:21:06.814 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":122,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:06.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 -- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f95dc039b40 msgr2=0x7f95dc03c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:06.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f95dc039b40 0x7f95dc03c000 crc :-1 s=READY pgs=382 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:06.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 -- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 msgr2=0x7f95fc12a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 0x7f95fc12a540 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0010be0).stop 2020-02-11T16:21:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 -- 172.21.15.88:0/4079285120 shutdown_connections 2020-02-11T16:21:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f95fc12e3a0 0x7f95fc12a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:06.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f95dc039b40 0x7f95dc03c000 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:06.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 --2- 172.21.15.88:0/4079285120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95fc0a5de0 0x7f95fc12a540 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:06.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 -- 172.21.15.88:0/4079285120 >> 172.21.15.88:0/4079285120 conn(0x7f95fc09d110 msgr2=0x7f95fc0a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:06.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 -- 172.21.15.88:0/4079285120 shutdown_connections 2020-02-11T16:21:06.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:06.812+0000 7f9601bfa700 1 -- 172.21.15.88:0/4079285120 wait complete. 2020-02-11T16:21:06.825 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":122,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:09.826 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:21:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.938+0000 7f0abde8c700 1 Processor -- start 2020-02-11T16:21:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.938+0000 7f0abde8c700 1 -- start start 2020-02-11T16:21:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0abde8c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 0x7f0ab80a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0abde8c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0abde8c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab80a5320 con 0x7f0ab812f890 2020-02-11T16:21:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0abde8c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab809e7a0 con 0x7f0ab80a39e0 2020-02-11T16:21:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0abde8c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81303c0 con 0x7f0ab80a7120 2020-02-11T16:21:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0ab77fe700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 msgr2=0x7f0ab80a4ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0ab77fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 0x7f0ab80a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0ab6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0ab6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57652/0 (socket says 172.21.15.88:57652) 2020-02-11T16:21:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 learned_addr learned my addr 172.21.15.88:0/3350900282 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:21:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:21:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:09.939+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:10.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.140+0000 7f0ab77fe700 1 -- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 msgr2=0x7f0ab80a4ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:10.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.140+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 0x7f0ab80a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:21:10.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.140+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:10.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.140+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:21:10.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.140+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:21:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.140+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:10.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.140+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:21:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.541+0000 7f0ab77fe700 1 -- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 msgr2=0x7f0ab80a4ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.541+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 0x7f0ab80a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:21:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.541+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.541+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:21:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.541+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:21:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.541+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:10.541+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:21:11.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:11.342+0000 7f0ab77fe700 1 -- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 msgr2=0x7f0ab80a4ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:11.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:11.342+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 0x7f0ab80a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:21:11.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:11.342+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:11.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:11.342+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:21:11.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:11.342+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:21:11.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:11.342+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:11.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:11.342+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:21:12.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:12.944+0000 7f0ab77fe700 1 -- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 msgr2=0x7f0ab80a4ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:12.944+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 0x7f0ab80a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:21:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:12.944+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:12.944+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:21:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:12.944+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:21:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:12.944+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:12.944+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:21:14.429 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:21:14.432 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:21:14.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.471+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735100737 0 0) 0x7f0ab0001450 con 0x7f0ab812f890 2020-02-11T16:21:14.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.471+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa4003230 con 0x7f0ab812f890 2020-02-11T16:21:14.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.471+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2887818157 0 0) 0x7f0aa4003230 con 0x7f0ab812f890 2020-02-11T16:21:14.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 msgr2=0x7f0ab80a4ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:14.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 0x7f0ab80a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:14.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 msgr2=0x7f0ab80a3e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:14.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 --2- 172.21.15.88:0/3350900282 >> v2:172.21.15.88:3300/0 conn(0x7f0ab80a39e0 0x7f0ab80a3e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:14.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80a5560 con 0x7f0ab812f890 2020-02-11T16:21:14.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f0ab0001bc0 con 0x7f0ab812f890 2020-02-11T16:21:14.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 >> v1:172.21.15.52:6789/0 conn(0x7f0ab812f890 legacy=0x7f0ab812fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0aa4003720 0x7f0aa4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 0x7f0aa40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0aa4004930 0x7f0aa4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab809e7a0 con 0x7f0aa4003720 2020-02-11T16:21:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81303c0 con 0x7f0aa4004930 2020-02-11T16:21:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40040b0 con 0x7f0ab80a7120 2020-02-11T16:21:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab6ffd700 1 -- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 msgr2=0x7f0aa40044d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 0x7f0aa40044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0aa4004930 0x7f0aa4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0aa4003720 0x7f0aa4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab7fff700 1 -- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 msgr2=0x7f0aa40044d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab80a7120 0x7f0aa40044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab7fff700 1 -- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0aa4003720 msgr2=0x7f0aa4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:21:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0aa4003720 0x7f0aa4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:14.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab7fff700 1 -- 172.21.15.88:0/3350900282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4003230 con 0x7f0aa4004930 2020-02-11T16:21:14.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0aa4003720 0x7f0aa4003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:21:14.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0aa4004930 0x7f0aa4004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ab0001990 tx=0x7f0ab8130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0aa4004930 0x7f0aa4004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ab0001990 tx=0x7f0ab8130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.472+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0aa4004930 0x7f0aa4004db0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f0ab0001990 tx=0x7f0ab8130500).ready entity=mon.1 client_cookie=88badbd22482587f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.473+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0aa4004930 0x7f0aa4004db0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f0ab0001990 tx=0x7f0ab8130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.473+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0aa4004930 0x7f0aa4004db0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f0ab0001990 tx=0x7f0ab8130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.473+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ab0006ce0 con 0x7f0aa4004930 2020-02-11T16:21:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.473+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0aa4004930 0x7f0aa4004db0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f0ab0001990 tx=0x7f0ab8130500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.473+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab0006e40 con 0x7f0aa4004930 2020-02-11T16:21:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.473+0000 7f0ab67fc700 1 -- 172.21.15.88:0/3350900282 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ab000d080 con 0x7f0aa4004930 2020-02-11T16:21:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.473+0000 7f0abde8c700 1 -- 172.21.15.88:0/3350900282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0aa4004930 msgr2=0x7f0aa4004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.473+0000 7f0abde8c700 1 --2- 172.21.15.88:0/3350900282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0aa4004930 0x7f0aa4004db0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f0ab0001990 tx=0x7f0ab8130500).stop 2020-02-11T16:21:14.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.473+0000 7f0ab7fff700 1 -- 172.21.15.88:0/3350900282 reap_dead start 2020-02-11T16:21:14.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.474+0000 7f0abde8c700 1 -- 172.21.15.88:0/3350900282 shutdown_connections 2020-02-11T16:21:14.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.474+0000 7f0abde8c700 1 -- 172.21.15.88:0/3350900282 >> 172.21.15.88:0/3350900282 conn(0x7f0ab809d110 msgr2=0x7f0ab809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:14.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.474+0000 7f0abde8c700 1 -- 172.21.15.88:0/3350900282 shutdown_connections 2020-02-11T16:21:14.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.474+0000 7f0abde8c700 1 -- 172.21.15.88:0/3350900282 wait complete. 2020-02-11T16:21:14.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.475+0000 7f0abde8c700 1 Processor -- start 2020-02-11T16:21:14.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.475+0000 7f0abde8c700 1 -- start start 2020-02-11T16:21:14.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0abde8c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ab8131cd0 0x7f0ab8064ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0abde8c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab812bed0 0x7f0ab812c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0abde8c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab80a7770 con 0x7f0ab8063610 2020-02-11T16:21:14.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0abde8c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab80a4780 con 0x7f0ab8131cd0 2020-02-11T16:21:14.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0abde8c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab8065220 con 0x7f0ab812bed0 2020-02-11T16:21:14.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0ab7fff700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab812bed0 msgr2=0x7f0ab812c360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:14.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab812bed0 0x7f0ab812c360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:14.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0ab77fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ab8131cd0 0x7f0ab8064ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0ab77fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ab8131cd0 0x7f0ab8064ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43672/0 (socket says 172.21.15.88:43672) 2020-02-11T16:21:14.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0ab77fe700 1 -- 172.21.15.88:0/1434485749 learned_addr learned my addr 172.21.15.88:0/1434485749 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:14.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0ab77fe700 1 -- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab812bed0 msgr2=0x7f0ab812c360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:21:14.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab812bed0 0x7f0ab812c360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0ab77fe700 1 -- 172.21.15.88:0/1434485749 >> v1:172.21.15.52:6789/0 conn(0x7f0ab8063610 legacy=0x7f0ab8143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.476+0000 7f0ab77fe700 1 -- 172.21.15.88:0/1434485749 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80654c0 con 0x7f0ab8131cd0 2020-02-11T16:21:14.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> v2:172.21.15.52:3300/0 conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> v2:172.21.15.52:3300/0 conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0ab4ff9700 1 -- 172.21.15.88:0/1434485749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0aa8008b80 con 0x7f0ab8131cd0 2020-02-11T16:21:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0ab4ff9700 1 -- 172.21.15.88:0/1434485749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa8008ce0 con 0x7f0ab8131cd0 2020-02-11T16:21:14.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0abde8c700 1 -- 172.21.15.88:0/1434485749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab8063170 con 0x7f0ab8131cd0 2020-02-11T16:21:14.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0ab4ff9700 1 -- 172.21.15.88:0/1434485749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0aa8012820 con 0x7f0ab8131cd0 2020-02-11T16:21:14.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0abde8c700 1 -- 172.21.15.88:0/1434485749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab812c7c0 con 0x7f0ab8131cd0 2020-02-11T16:21:14.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.477+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.478+0000 7f0ab4ff9700 1 -- 172.21.15.88:0/1434485749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0aa8012a90 con 0x7f0ab8131cd0 2020-02-11T16:21:14.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.478+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.478+0000 7f0ab4ff9700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0a98039cb0 0x7f0a9803c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.478+0000 7f0ab4ff9700 1 -- 172.21.15.88:0/1434485749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f0aa8049aa0 con 0x7f0ab8131cd0 2020-02-11T16:21:14.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.478+0000 7f0abde8c700 1 -- 172.21.15.88:0/1434485749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab8064950 con 0x7f0ab8131cd0 2020-02-11T16:21:14.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.478+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0a98039cb0 0x7f0a9803c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.479+0000 7f0ab6ffd700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0a98039cb0 0x7f0a9803c170 crc :-1 s=READY pgs=383 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.483+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.483+0000 7f0ab4ff9700 1 -- 172.21.15.88:0/1434485749 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f0aa802f080 con 0x7f0ab8131cd0 2020-02-11T16:21:14.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.668+0000 7f0abde8c700 1 -- 172.21.15.88:0/1434485749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0ab80565b0 con 0x7f0ab8131cd0 2020-02-11T16:21:14.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.669+0000 7f0ab77fe700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.669+0000 7f0ab4ff9700 1 -- 172.21.15.88:0/1434485749 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f0aa8031b90 con 0x7f0ab8131cd0 2020-02-11T16:21:14.673 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":126,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:14.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.670+0000 7f0abde8c700 1 -- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0a98039cb0 msgr2=0x7f0a9803c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.670+0000 7f0abde8c700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0a98039cb0 0x7f0a9803c170 crc :-1 s=READY pgs=383 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.670+0000 7f0abde8c700 1 -- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 msgr2=0x7f0ab8064ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.670+0000 7f0abde8c700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 0x7f0ab8064ca0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f0aa8005b90 tx=0x7f0aa8010f90).stop 2020-02-11T16:21:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.670+0000 7f0abde8c700 1 -- 172.21.15.88:0/1434485749 shutdown_connections 2020-02-11T16:21:14.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.670+0000 7f0abde8c700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ab812bed0 0x7f0ab812c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.670+0000 7f0abde8c700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0a98039cb0 0x7f0a9803c170 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.670+0000 7f0abde8c700 1 --2- 172.21.15.88:0/1434485749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ab8131cd0 0x7f0ab8064ca0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.670+0000 7f0abde8c700 1 -- 172.21.15.88:0/1434485749 >> 172.21.15.88:0/1434485749 conn(0x7f0ab809d110 msgr2=0x7f0ab80a4990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:14.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.671+0000 7f0abde8c700 1 -- 172.21.15.88:0/1434485749 shutdown_connections 2020-02-11T16:21:14.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.671+0000 7f0abde8c700 1 -- 172.21.15.88:0/1434485749 wait complete. 2020-02-11T16:21:14.684 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":126,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:14.684 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:21:14.684 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:21:14.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.787+0000 7f5a50f2b700 1 Processor -- start 2020-02-11T16:21:14.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.787+0000 7f5a50f2b700 1 -- start start 2020-02-11T16:21:14.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.788+0000 7f5a50f2b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a4c0ad380 0x7f5a4c0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:14.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.788+0000 7f5a50f2b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c138710 0x7f5a4c13b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:14.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.788+0000 7f5a50f2b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c0adb40 con 0x7f5a4c138280 2020-02-11T16:21:14.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.788+0000 7f5a50f2b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c137bf0 con 0x7f5a4c0ad380 2020-02-11T16:21:14.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.788+0000 7f5a50f2b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c138b50 con 0x7f5a4c138710 2020-02-11T16:21:14.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.788+0000 7f5a4ad9d700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c138710 msgr2=0x7f5a4c13b8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:14.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.788+0000 7f5a4a59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a4c0ad380 0x7f5a4c0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.788+0000 7f5a4ad9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c138710 0x7f5a4c13b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:14.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.788+0000 7f5a4a59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a4c0ad380 0x7f5a4c0a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57694/0 (socket says 172.21.15.88:57694) 2020-02-11T16:21:14.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.788+0000 7f5a4a59c700 1 -- 172.21.15.88:0/1592205791 learned_addr learned my addr 172.21.15.88:0/1592205791 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:14.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4a59c700 1 -- 172.21.15.88:0/1592205791 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c138710 msgr2=0x7f5a4c13b8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:14.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/1592205791 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c138710 0x7f5a4c13b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:14.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4a59c700 1 -- 172.21.15.88:0/1592205791 >> v1:172.21.15.52:6789/0 conn(0x7f5a4c138280 legacy=0x7f5a4c13b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4a59c700 1 -- 172.21.15.88:0/1592205791 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c137de0 con 0x7f5a4c0ad380 2020-02-11T16:21:14.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/1592205791 >> v2:172.21.15.88:3300/0 conn(0x7f5a4c0ad380 0x7f5a4c0a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a3c002f30 tx=0x7f5a3c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/1592205791 >> v2:172.21.15.88:3300/0 conn(0x7f5a4c0ad380 0x7f5a4c0a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a3c002f30 tx=0x7f5a3c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/1592205791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c0ad380 0x7f5a4c0a9130 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f5a3c002f30 tx=0x7f5a3c0088e0).ready entity=mon.1 client_cookie=73765ef3f2d00d36 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/1592205791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c0ad380 0x7f5a4c0a9130 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f5a3c002f30 tx=0x7f5a3c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4959a700 1 -- 172.21.15.88:0/1592205791 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c008e20 con 0x7f5a4c0ad380 2020-02-11T16:21:14.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/1592205791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c0ad380 0x7f5a4c0a9130 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f5a3c002f30 tx=0x7f5a3c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/1592205791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c0ad380 0x7f5a4c0a9130 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f5a3c002f30 tx=0x7f5a3c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4959a700 1 -- 172.21.15.88:0/1592205791 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c011950 con 0x7f5a4c0ad380 2020-02-11T16:21:14.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a4959a700 1 -- 172.21.15.88:0/1592205791 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c011d30 con 0x7f5a4c0ad380 2020-02-11T16:21:14.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a50f2b700 1 -- 172.21.15.88:0/1592205791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c0ad380 msgr2=0x7f5a4c0a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a50f2b700 1 --2- 172.21.15.88:0/1592205791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c0ad380 0x7f5a4c0a9130 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f5a3c002f30 tx=0x7f5a3c0088e0).stop 2020-02-11T16:21:14.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a50f2b700 1 -- 172.21.15.88:0/1592205791 shutdown_connections 2020-02-11T16:21:14.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a50f2b700 1 --2- 172.21.15.88:0/1592205791 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c138710 0x7f5a4c13b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:14.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a50f2b700 1 --2- 172.21.15.88:0/1592205791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c0ad380 0x7f5a4c0a9130 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a50f2b700 1 -- 172.21.15.88:0/1592205791 >> 172.21.15.88:0/1592205791 conn(0x7f5a4c05ac70 msgr2=0x7f5a4c0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:14.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a50f2b700 1 -- 172.21.15.88:0/1592205791 shutdown_connections 2020-02-11T16:21:14.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.789+0000 7f5a50f2b700 1 -- 172.21.15.88:0/1592205791 wait complete. 2020-02-11T16:21:14.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.790+0000 7f5a50f2b700 1 Processor -- start 2020-02-11T16:21:14.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.790+0000 7f5a50f2b700 1 -- start start 2020-02-11T16:21:14.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a50f2b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c0ad380 0x7f5a4c134070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a50f2b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a4c138280 0x7f5a4c1326c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a50f2b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a4c138710 0x7f5a4c132b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a50f2b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c134680 con 0x7f5a4c138710 2020-02-11T16:21:14.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a50f2b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c134890 con 0x7f5a4c138280 2020-02-11T16:21:14.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a50f2b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c134b30 con 0x7f5a4c0ad380 2020-02-11T16:21:14.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a4a59c700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c0ad380 msgr2=0x7f5a4c134070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:14.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a4a59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c0ad380 0x7f5a4c134070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:14.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a4c138280 0x7f5a4c1326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a4c138280 0x7f5a4c1326c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57702/0 (socket says 172.21.15.88:57702) 2020-02-11T16:21:14.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 -- 172.21.15.88:0/950340488 learned_addr learned my addr 172.21.15.88:0/950340488 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:14.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a4ad9d700 1 --2- 172.21.15.88:0/950340488 >> v2:172.21.15.52:3300/0 conn(0x7f5a4c138710 0x7f5a4c132b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 -- 172.21.15.88:0/950340488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c0ad380 msgr2=0x7f5a4c134070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:21:14.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a4c0ad380 0x7f5a4c134070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 -- 172.21.15.88:0/950340488 >> v2:172.21.15.52:3300/0 conn(0x7f5a4c138710 msgr2=0x7f5a4c132b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 --2- 172.21.15.88:0/950340488 >> v2:172.21.15.52:3300/0 conn(0x7f5a4c138710 0x7f5a4c132b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 -- 172.21.15.88:0/950340488 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c130770 con 0x7f5a4c138280 2020-02-11T16:21:14.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 --2- 172.21.15.88:0/950340488 >> v2:172.21.15.88:3300/0 conn(0x7f5a4c138280 0x7f5a4c1326c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a4c0af2b0 tx=0x7f5a3400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 --2- 172.21.15.88:0/950340488 >> v2:172.21.15.88:3300/0 conn(0x7f5a4c138280 0x7f5a4c1326c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a4c0af2b0 tx=0x7f5a3400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c138280 0x7f5a4c1326c0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f5a4c0af2b0 tx=0x7f5a3400c460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c138280 0x7f5a4c1326c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f5a4c0af2b0 tx=0x7f5a3400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c138280 0x7f5a4c1326c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f5a4c0af2b0 tx=0x7f5a3400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3400cc20 con 0x7f5a4c138280 2020-02-11T16:21:14.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a49d9b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c138280 0x7f5a4c1326c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f5a4c0af2b0 tx=0x7f5a3400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3400cd80 con 0x7f5a4c138280 2020-02-11T16:21:14.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a50f2b700 1 -- 172.21.15.88:0/950340488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c132f80 con 0x7f5a4c138280 2020-02-11T16:21:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a34011170 con 0x7f5a4c138280 2020-02-11T16:21:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.791+0000 7f5a50f2b700 1 -- 172.21.15.88:0/950340488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c133e70 con 0x7f5a4c138280 2020-02-11T16:21:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.792+0000 7f5a49d9b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c138280 0x7f5a4c1326c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f5a4c0af2b0 tx=0x7f5a3400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.792+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5a340064e0 con 0x7f5a4c138280 2020-02-11T16:21:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.792+0000 7f5a49d9b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c138280 0x7f5a4c1326c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f5a4c0af2b0 tx=0x7f5a3400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a50f2b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 0x7f5a4c148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a50f2b700 1 -- 172.21.15.88:0/950340488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c05e2f0 con 0x7f5a4c05efa0 2020-02-11T16:21:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a437fe700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a30039c70 0x7f5a3003c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 0x7f5a4c148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5a340494d0 con 0x7f5a4c138280 2020-02-11T16:21:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a4ad9d700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a30039c70 0x7f5a3003c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a4a59c700 1 -- 172.21.15.88:0/950340488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a4c0565b0 con 0x7f5a4c05efa0 2020-02-11T16:21:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 0x7f5a4c148940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 0x7f5a4c148940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 0x7f5a4c148940 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 0x7f5a4c148940 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a4ad9d700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a30039c70 0x7f5a3003c130 crc :-1 s=READY pgs=384 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c00f800 con 0x7f5a4c05efa0 2020-02-11T16:21:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 0x7f5a4c148940 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5a3c007150 con 0x7f5a4c05efa0 2020-02-11T16:21:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 msgr2=0x7f5a4c148940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a437fe700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 0x7f5a4c148940 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).stop 2020-02-11T16:21:14.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 msgr2=0x7f5a4c148940 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:14.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.793+0000 7f5a437fe700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c05efa0 0x7f5a4c148940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.801+0000 7f5a50f2b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 0x7f5a4c1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.801+0000 7f5a50f2b700 1 -- 172.21.15.88:0/950340488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c132550 con 0x7f5a4c148da0 2020-02-11T16:21:14.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.801+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 0x7f5a4c1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a4a59c700 1 -- 172.21.15.88:0/950340488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5a4c149610 con 0x7f5a4c148da0 2020-02-11T16:21:14.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 0x7f5a4c1491b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 0x7f5a4c1491b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 0x7f5a4c1491b0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 0x7f5a4c1491b0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c00c730 con 0x7f5a4c148da0 2020-02-11T16:21:14.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a4a59c700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 0x7f5a4c1491b0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f5a3c00c890 con 0x7f5a4c148da0 2020-02-11T16:21:14.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 msgr2=0x7f5a4c1491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a437fe700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 0x7f5a4c1491b0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).stop 2020-02-11T16:21:14.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a437fe700 1 -- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 msgr2=0x7f5a4c1491b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:14.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a437fe700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c148da0 0x7f5a4c1491b0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0x7f5a3c007ed0 tx=0x7f5a3c011510).stop 2020-02-11T16:21:14.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a50f2b700 1 -- 172.21.15.88:0/950340488 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a30039c70 msgr2=0x7f5a3003c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a50f2b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5a30039c70 0x7f5a3003c130 crc :-1 s=READY pgs=384 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a50f2b700 1 -- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c138280 msgr2=0x7f5a4c1326c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a50f2b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c138280 0x7f5a4c1326c0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f5a4c0af2b0 tx=0x7f5a3400c460).stop 2020-02-11T16:21:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.802+0000 7f5a4ad9d700 1 -- 172.21.15.88:0/950340488 reap_dead start 2020-02-11T16:21:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.803+0000 7f5a4ad9d700 1 -- 172.21.15.88:0/950340488 reap_dead start 2020-02-11T16:21:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.803+0000 7f5a50f2b700 1 -- 172.21.15.88:0/950340488 shutdown_connections 2020-02-11T16:21:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.803+0000 7f5a50f2b700 1 --2- 172.21.15.88:0/950340488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a4c138280 0x7f5a4c1326c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.803+0000 7f5a50f2b700 1 -- 172.21.15.88:0/950340488 >> 172.21.15.88:0/950340488 conn(0x7f5a4c05ac70 msgr2=0x7f5a4c12eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:14.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.803+0000 7f5a50f2b700 1 -- 172.21.15.88:0/950340488 shutdown_connections 2020-02-11T16:21:14.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.803+0000 7f5a50f2b700 1 -- 172.21.15.88:0/950340488 wait complete. 2020-02-11T16:21:14.817 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:21:14.817 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:14.817 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:14.817 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:21:14.818 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 126, 2020-02-11T16:21:14.818 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:21:14.818 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:21:14.818 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:21:14.818 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.818 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:21:14.818 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:14.818 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:21:14.819 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:21:14.819 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:14.819 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:14.819 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:14.819 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:14.819 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:14.819 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:14.820 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.820 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:21:14.820 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:21:14.820 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:14.820 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:14.820 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:14.820 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:14.821 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:14.821 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:14.821 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.821 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:21:14.821 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:21:14.821 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:21:14.822 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:21:14.822 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:21:14.822 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:21:14.822 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:14.822 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:14.822 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:21:14.822 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:21:14.822 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:14.823 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:21:14.823 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:14.823 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:14.823 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:14.823 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:14.823 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:14.823 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:14.824 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.824 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:21:14.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.824 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:21:14.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.824 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:14.824 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:14.825 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:14.825 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:14.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.825 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:14.825 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:21:14.825 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.826 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:14.826 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:21:14.826 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.826 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.826 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.827 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:21:14.827 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:21:14.827 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:14.827 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:14.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.827 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:14.828 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:14.828 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:14.828 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:14.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.828 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:14.828 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:21:14.828 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.829 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:14.829 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:21:14.829 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.829 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.829 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.830 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:21:14.830 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:21:14.830 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:14.830 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:14.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.830 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:21:14.831 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:21:14.831 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:14.831 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:14.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.831 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:14.831 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:21:14.831 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.832 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:14.832 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:21:14.832 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.832 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.832 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.833 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:21:14.833 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:21:14.833 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:14.833 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:14.833 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.833 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.834 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:21:14.834 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:21:14.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.834 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:14.834 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:14.834 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:14.834 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.835 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.835 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:21:14.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.835 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:14.835 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:14.835 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:21:14.836 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.836 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.836 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:21:14.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.836 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:14.836 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:14.836 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2020-02-11T16:21:14.837 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.837 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.837 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:21:14.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.837 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:14.837 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:14.837 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:21:14.838 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.838 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.838 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:21:14.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.838 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:14.838 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:14.838 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:21:14.838 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.839 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.839 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.839 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:21:14.840 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:21:14.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.943+0000 7fa15a6bf700 1 Processor -- start 2020-02-11T16:21:14.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.944+0000 7fa15a6bf700 1 -- start start 2020-02-11T16:21:14.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.944+0000 7fa15a6bf700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1540a2fa0 0x7fa1540a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:14.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.944+0000 7fa15a6bf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1540a5410 0x7fa1540a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:14.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.944+0000 7fa15a6bf700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1540a4350 con 0x7fa1540a6da0 2020-02-11T16:21:14.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.944+0000 7fa15a6bf700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1540a1e60 con 0x7fa1540a5410 2020-02-11T16:21:14.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.944+0000 7fa15a6bf700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540a3450 con 0x7fa1540a2fa0 2020-02-11T16:21:14.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.944+0000 7fa153fff700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1540a2fa0 msgr2=0x7fa1540a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:21:14.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.944+0000 7fa153fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1540a2fa0 0x7fa1540a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:14.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1540a5410 0x7fa1540a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1540a5410 0x7fa1540a5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43700/0 (socket says 172.21.15.88:43700) 2020-02-11T16:21:14.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 -- 172.21.15.88:0/3579094131 learned_addr learned my addr 172.21.15.88:0/3579094131 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:14.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa158c5c700 1 --1- 172.21.15.88:0/3579094131 >> v1:172.21.15.52:6789/0 conn(0x7fa1540a6da0 0x7fa154131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37124/0 (socket says 172.21.15.88:37124) 2020-02-11T16:21:14.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 -- 172.21.15.88:0/3579094131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1540a2fa0 msgr2=0x7fa1540a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:14.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 --2- 172.21.15.88:0/3579094131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1540a2fa0 0x7fa1540a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:14.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 -- 172.21.15.88:0/3579094131 >> v1:172.21.15.52:6789/0 conn(0x7fa1540a6da0 legacy=0x7fa154131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 -- 172.21.15.88:0/3579094131 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1540a3a40 con 0x7fa1540a5410 2020-02-11T16:21:14.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 --2- 172.21.15.88:0/3579094131 >> v2:172.21.15.52:3300/0 conn(0x7fa1540a5410 0x7fa1540a5890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa148002f30 tx=0x7fa1480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 --2- 172.21.15.88:0/3579094131 >> v2:172.21.15.52:3300/0 conn(0x7fa1540a5410 0x7fa1540a5890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa148002f30 tx=0x7fa1480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 --2- 172.21.15.88:0/3579094131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1540a5410 0x7fa1540a5890 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa1480088e0).ready entity=mon.0 client_cookie=d3f5af50fdbe8a52 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 --2- 172.21.15.88:0/3579094131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1540a5410 0x7fa1540a5890 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa1480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa152ffd700 1 -- 172.21.15.88:0/3579094131 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa148008e20 con 0x7fa1540a5410 2020-02-11T16:21:14.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 --2- 172.21.15.88:0/3579094131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1540a5410 0x7fa1540a5890 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa1480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa152ffd700 1 -- 172.21.15.88:0/3579094131 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa148011950 con 0x7fa1540a5410 2020-02-11T16:21:14.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa1537fe700 1 --2- 172.21.15.88:0/3579094131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1540a5410 0x7fa1540a5890 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa1480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa152ffd700 1 -- 172.21.15.88:0/3579094131 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa148011d30 con 0x7fa1540a5410 2020-02-11T16:21:14.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa15a6bf700 1 -- 172.21.15.88:0/3579094131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1540a5410 msgr2=0x7fa1540a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.945+0000 7fa15a6bf700 1 --2- 172.21.15.88:0/3579094131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1540a5410 0x7fa1540a5890 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa1480088e0).stop 2020-02-11T16:21:14.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.946+0000 7fa15a6bf700 1 -- 172.21.15.88:0/3579094131 shutdown_connections 2020-02-11T16:21:14.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.946+0000 7fa15a6bf700 1 --2- 172.21.15.88:0/3579094131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1540a2fa0 0x7fa1540a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:14.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.946+0000 7fa15a6bf700 1 --2- 172.21.15.88:0/3579094131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1540a5410 0x7fa1540a5890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.946+0000 7fa15a6bf700 1 -- 172.21.15.88:0/3579094131 >> 172.21.15.88:0/3579094131 conn(0x7fa15409d110 msgr2=0x7fa15409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:14.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.946+0000 7fa15a6bf700 1 -- 172.21.15.88:0/3579094131 shutdown_connections 2020-02-11T16:21:14.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.946+0000 7fa15a6bf700 1 -- 172.21.15.88:0/3579094131 wait complete. 2020-02-11T16:21:14.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.947+0000 7fa15a6bf700 1 Processor -- start 2020-02-11T16:21:14.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.947+0000 7fa15a6bf700 1 -- start start 2020-02-11T16:21:14.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.947+0000 7fa15a6bf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1540a2fa0 0x7fa154137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.947+0000 7fa15a6bf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1540a5410 0x7fa15412a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.947+0000 7fa15a6bf700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa154130150 con 0x7fa1540a6da0 2020-02-11T16:21:14.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.947+0000 7fa15a6bf700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1541367b0 con 0x7fa1540a5410 2020-02-11T16:21:14.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.947+0000 7fa15a6bf700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1541303f0 con 0x7fa1540a2fa0 2020-02-11T16:21:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.947+0000 7fa153fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1540a2fa0 0x7fa154137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1540a2fa0 0x7fa154137a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57718/0 (socket says 172.21.15.88:57718) 2020-02-11T16:21:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 -- 172.21.15.88:0/1474306860 learned_addr learned my addr 172.21.15.88:0/1474306860 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> v2:172.21.15.52:3300/0 conn(0x7fa1540a5410 0x7fa15412a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 -- 172.21.15.88:0/1474306860 >> v2:172.21.15.52:3300/0 conn(0x7fa1540a5410 msgr2=0x7fa15412a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 --2- 172.21.15.88:0/1474306860 >> v2:172.21.15.52:3300/0 conn(0x7fa1540a5410 0x7fa15412a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 -- 172.21.15.88:0/1474306860 >> v1:172.21.15.52:6789/0 conn(0x7fa1540a6da0 legacy=0x7fa1541356e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 -- 172.21.15.88:0/1474306860 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa154130690 con 0x7fa1540a2fa0 2020-02-11T16:21:14.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 --2- 172.21.15.88:0/1474306860 >> v2:172.21.15.88:3300/0 conn(0x7fa1540a2fa0 0x7fa154137a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa154136b70 tx=0x7fa144010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 --2- 172.21.15.88:0/1474306860 >> v2:172.21.15.88:3300/0 conn(0x7fa1540a2fa0 0x7fa154137a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa154136b70 tx=0x7fa144010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1540a2fa0 0x7fa154137a60 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fa154136b70 tx=0x7fa144010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1540a2fa0 0x7fa154137a60 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa154136b70 tx=0x7fa144010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14400d0c0 con 0x7fa1540a2fa0 2020-02-11T16:21:14.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1540a2fa0 0x7fa154137a60 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa154136b70 tx=0x7fa144010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa153fff700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1540a2fa0 0x7fa154137a60 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa154136b70 tx=0x7fa144010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14400d220 con 0x7fa1540a2fa0 2020-02-11T16:21:14.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14400d600 con 0x7fa1540a2fa0 2020-02-11T16:21:14.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa15a6bf700 1 -- 172.21.15.88:0/1474306860 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1540a0070 con 0x7fa1540a2fa0 2020-02-11T16:21:14.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.948+0000 7fa15a6bf700 1 -- 172.21.15.88:0/1474306860 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa154138300 con 0x7fa1540a2fa0 2020-02-11T16:21:14.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa153fff700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1540a2fa0 0x7fa154137a60 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa154136b70 tx=0x7fa144010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa15a6bf700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 0x7fa15412d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa15a6bf700 1 -- 172.21.15.88:0/1474306860 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15405e2f0 con 0x7fa15412aa00 2020-02-11T16:21:14.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa14400d880 con 0x7fa1540a2fa0 2020-02-11T16:21:14.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa153fff700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1540a2fa0 0x7fa154137a60 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa154136b70 tx=0x7fa144010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 0x7fa15412d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa1517fa700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa134039c80 0x7fa13403c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa144049600 con 0x7fa1540a2fa0 2020-02-11T16:21:14.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa158c5c700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa134039c80 0x7fa13403c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa1537fe700 1 -- 172.21.15.88:0/1474306860 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa15412ae10 con 0x7fa15412aa00 2020-02-11T16:21:14.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.949+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 0x7fa15412d0b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 0x7fa15412d0b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 0x7fa15412d0b0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa158c5c700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa134039c80 0x7fa13403c140 crc :-1 s=READY pgs=385 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 0x7fa15412d0b0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14800f8f0 con 0x7fa15412aa00 2020-02-11T16:21:14.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 0x7fa15412d0b0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa148007150 con 0x7fa15412aa00 2020-02-11T16:21:14.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 msgr2=0x7fa15412d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa1517fa700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 0x7fa15412d0b0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).stop 2020-02-11T16:21:14.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 msgr2=0x7fa15412d0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:14.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.950+0000 7fa1517fa700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15412aa00 0x7fa15412d0b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.958+0000 7fa15a6bf700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 0x7fa15414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:14.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.958+0000 7fa15a6bf700 1 -- 172.21.15.88:0/1474306860 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1541354f0 con 0x7fa15414c7f0 2020-02-11T16:21:14.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.958+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 0x7fa15414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:14.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.958+0000 7fa1537fe700 1 -- 172.21.15.88:0/1474306860 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa1540565b0 con 0x7fa15414c7f0 2020-02-11T16:21:14.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.958+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 0x7fa15414cc00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 0x7fa15414cc00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 0x7fa15414cc00 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:14.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 0x7fa15414cc00 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14800e7d0 con 0x7fa15414c7f0 2020-02-11T16:21:14.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa1537fe700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 0x7fa15414cc00 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:14.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4011 (secure 0 0 0) 0x7fa14800e930 con 0x7fa15414c7f0 2020-02-11T16:21:14.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 msgr2=0x7fa15414cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa1517fa700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 0x7fa15414cc00 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).stop 2020-02-11T16:21:14.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa1517fa700 1 -- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 msgr2=0x7fa15414cc00 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:14.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa1517fa700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15414c7f0 0x7fa15414cc00 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0x7fa148002f30 tx=0x7fa154067410).stop 2020-02-11T16:21:14.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa15a6bf700 1 -- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa134039c80 msgr2=0x7fa13403c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa15a6bf700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa134039c80 0x7fa13403c140 crc :-1 s=READY pgs=385 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa15a6bf700 1 -- 172.21.15.88:0/1474306860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1540a2fa0 msgr2=0x7fa154137a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:14.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa15a6bf700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1540a2fa0 0x7fa154137a60 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fa154136b70 tx=0x7fa144010a10).stop 2020-02-11T16:21:14.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa158c5c700 1 -- 172.21.15.88:0/1474306860 reap_dead start 2020-02-11T16:21:14.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa15a6bf700 1 -- 172.21.15.88:0/1474306860 shutdown_connections 2020-02-11T16:21:14.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa15a6bf700 1 --2- 172.21.15.88:0/1474306860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1540a2fa0 0x7fa154137a60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:14.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa15a6bf700 1 -- 172.21.15.88:0/1474306860 >> 172.21.15.88:0/1474306860 conn(0x7fa15409d110 msgr2=0x7fa154069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:14.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.959+0000 7fa15a6bf700 1 -- 172.21.15.88:0/1474306860 shutdown_connections 2020-02-11T16:21:14.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:14.960+0000 7fa15a6bf700 1 -- 172.21.15.88:0/1474306860 wait complete. 2020-02-11T16:21:14.973 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:21:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:14.973 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:21:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 126, 2020-02-11T16:21:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:21:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:21:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:21:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:21:14.974 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:21:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:21:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:14.975 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:21:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:21:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:14.976 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:21:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:21:14.977 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:21:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:21:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:21:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:21:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:21:14.978 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:21:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:21:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:14.979 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:21:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:21:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:14.980 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:21:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:21:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:21:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:21:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.983 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:21:14.984 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:21:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.985 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:21:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:21:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.986 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:21:14.987 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:21:14.987 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:14.987 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:14.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.987 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:14.987 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:21:14.987 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.988 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:14.988 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:21:14.988 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:14.988 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.988 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.989 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:21:14.989 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:21:14.989 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:14.989 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:14.989 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.989 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:14.990 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:21:14.990 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:21:14.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.990 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:14.990 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:14.990 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:14.990 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.991 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.991 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:21:14.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.991 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:14.991 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:14.991 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:14.991 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.992 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:14.992 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:21:14.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:14.992 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:14.992 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:14.992 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:21:14.992 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.992 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:14.993 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:14.993 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:21:14.994 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:21:34.994 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:21:34.995 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2020-02-11T16:21:34.995 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-11T16:21:34.995 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-11T16:21:34.998 INFO:tasks.ceph.mon.c:Started 2020-02-11T16:21:34.998 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:21:34.998 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:21:35.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.111+0000 7fbba1d51700 1 Processor -- start 2020-02-11T16:21:35.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.111+0000 7fbba1d51700 1 -- start start 2020-02-11T16:21:35.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.112+0000 7fbba1d51700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:35.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.112+0000 7fbba1d51700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c0a5560 con 0x7fbb9c12fcf0 2020-02-11T16:21:35.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.112+0000 7fbba1d51700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c09e060 con 0x7fbb9c0a7120 2020-02-11T16:21:35.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.112+0000 7fbba1d51700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9c0a5350 con 0x7fbb9c0a4ec0 2020-02-11T16:21:35.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.112+0000 7fbb9affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:35.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.112+0000 7fbb9b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbb9c0a7120 0x7fbb9c0a39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45362/0 (socket says 172.21.15.88:45362) 2020-02-11T16:21:35.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.112+0000 7fbb9affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57740/0 (socket says 172.21.15.88:57740) 2020-02-11T16:21:35.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.112+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/484156831 learned_addr learned my addr 172.21.15.88:0/484156831 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:35.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9affd700 1 -- 172.21.15.88:0/484156831 >> v1:172.21.15.88:6789/0 conn(0x7fbb9c0a7120 legacy=0x7fbb9c0a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:35.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/484156831 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838261538 0 0) 0x7fbb9c09e060 con 0x7fbb9c0a7120 2020-02-11T16:21:35.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9affd700 1 -- 172.21.15.88:0/484156831 >> v1:172.21.15.52:6789/0 conn(0x7fbb9c12fcf0 legacy=0x7fbb9c140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:35.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9affd700 1 -- 172.21.15.88:0/484156831 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c09e300 con 0x7fbb9c0a4ec0 2020-02-11T16:21:35.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9affd700 1 --2- 172.21.15.88:0/484156831 >> v2:172.21.15.88:3300/0 conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb90002f30 tx=0x7fbb900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9affd700 1 --2- 172.21.15.88:0/484156831 >> v2:172.21.15.88:3300/0 conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb90002f30 tx=0x7fbb900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9affd700 1 --2- 172.21.15.88:0/484156831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fbb90002f30 tx=0x7fbb900088e0).ready entity=mon.1 client_cookie=79880c903fc3582d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:35.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9affd700 1 --2- 172.21.15.88:0/484156831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fbb90002f30 tx=0x7fbb900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/484156831 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb90008e40 con 0x7fbb9c0a4ec0 2020-02-11T16:21:35.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9affd700 1 --2- 172.21.15.88:0/484156831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fbb90002f30 tx=0x7fbb900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/484156831 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb900116a0 con 0x7fbb9c0a4ec0 2020-02-11T16:21:35.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9affd700 1 --2- 172.21.15.88:0/484156831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fbb90002f30 tx=0x7fbb900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/484156831 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb90011a80 con 0x7fbb9c0a4ec0 2020-02-11T16:21:35.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbba1d51700 1 -- 172.21.15.88:0/484156831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0a4ec0 msgr2=0x7fbb9c12f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:35.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbba1d51700 1 --2- 172.21.15.88:0/484156831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fbb90002f30 tx=0x7fbb900088e0).stop 2020-02-11T16:21:35.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbba1d51700 1 -- 172.21.15.88:0/484156831 shutdown_connections 2020-02-11T16:21:35.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbba1d51700 1 --2- 172.21.15.88:0/484156831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0a4ec0 0x7fbb9c12f890 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:35.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbba1d51700 1 -- 172.21.15.88:0/484156831 >> 172.21.15.88:0/484156831 conn(0x7fbb9c09d110 msgr2=0x7fbb9c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:35.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbba1d51700 1 -- 172.21.15.88:0/484156831 shutdown_connections 2020-02-11T16:21:35.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.113+0000 7fbba1d51700 1 -- 172.21.15.88:0/484156831 wait complete. 2020-02-11T16:21:35.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.114+0000 7fbba1d51700 1 Processor -- start 2020-02-11T16:21:35.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.114+0000 7fbba1d51700 1 -- start start 2020-02-11T16:21:35.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbba1d51700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 0x7fbb9c1399e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:35.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbba1d51700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c138890 con 0x7fbb9c0a4ec0 2020-02-11T16:21:35.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbba1d51700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c138b30 con 0x7fbb9c12fcf0 2020-02-11T16:21:35.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbba1d51700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c1369e0 con 0x7fbb9c0a7120 2020-02-11T16:21:35.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb9b7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbb9c0a4ec0 0x7fbb9c1392d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37150/0 (socket says 172.21.15.88:37150) 2020-02-11T16:21:35.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb9bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbb9c12fcf0 0x7fbb9c129eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45372/0 (socket says 172.21.15.88:45372) 2020-02-11T16:21:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/3799909195 learned_addr learned my addr 172.21.15.88:0/3799909195 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb9affd700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 0x7fbb9c1399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb9affd700 1 -- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 msgr2=0x7fbb9c1399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:21:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb9affd700 1 -- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 msgr2=0x7fbb9c1399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:21:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb9affd700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 0x7fbb9c1399e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb9affd700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 0x7fbb9c1399e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137388847 0 0) 0x7fbb9c138b30 con 0x7fbb9c12fcf0 2020-02-11T16:21:35.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c002fe0 con 0x7fbb9c12fcf0 2020-02-11T16:21:35.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427698872 0 0) 0x7fbb9c138890 con 0x7fbb9c0a4ec0 2020-02-11T16:21:35.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.115+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb9c138b30 con 0x7fbb9c0a4ec0 2020-02-11T16:21:35.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3697335153 0 0) 0x7fbb7c002fe0 con 0x7fbb9c12fcf0 2020-02-11T16:21:35.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb9c138890 con 0x7fbb9c12fcf0 2020-02-11T16:21:35.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fbb940017f0 con 0x7fbb9c12fcf0 2020-02-11T16:21:35.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 msgr2=0x7fbb9c1399e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:21:35.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 0x7fbb9c1399e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:35.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 >> v1:172.21.15.88:6789/0 conn(0x7fbb9c12fcf0 legacy=0x7fbb9c129eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:35.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 >> v1:172.21.15.52:6789/0 conn(0x7fbb9c0a4ec0 legacy=0x7fbb9c1392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:35.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:35.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 0x7fbb7c003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:35.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb7c003f10 0x7fbb7c004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:35.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c1369e0 con 0x7fbb7c003f10 2020-02-11T16:21:35.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c005540 con 0x7fbb7c004b20 2020-02-11T16:21:35.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c004870 con 0x7fbb9c0a7120 2020-02-11T16:21:35.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:35.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb7c003f10 0x7fbb7c004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:35.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9affd700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 0x7fbb7c003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:35.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9affd700 1 -- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 msgr2=0x7fbb7c003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:21:35.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9affd700 1 -- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 msgr2=0x7fbb7c003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:21:35.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9affd700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 0x7fbb7c003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:35.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9affd700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 0x7fbb7c003ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:35.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 msgr2=0x7fbb7c003ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:21:35.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb9c0a7120 0x7fbb7c003ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:35.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb7c003f10 msgr2=0x7fbb7c004390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:35.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb7c003f10 0x7fbb7c004390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:35.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/3799909195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c138dd0 con 0x7fbb7c004b20 2020-02-11T16:21:35.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbba1d51700 1 -- 172.21.15.88:0/3799909195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c135b00 con 0x7fbb7c004b20 2020-02-11T16:21:35.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbba1d51700 1 -- 172.21.15.88:0/3799909195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c137090 con 0x7fbb7c004b20 2020-02-11T16:21:35.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:35.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb8c005d20 con 0x7fbb7c004b20 2020-02-11T16:21:35.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c00cef0 con 0x7fbb7c004b20 2020-02-11T16:21:35.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.116+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb8c00d310 con 0x7fbb7c004b20 2020-02-11T16:21:35.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.117+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.117+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fbb8c00d470 con 0x7fbb7c004b20 2020-02-11T16:21:35.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.117+0000 7fbba1d51700 1 -- 172.21.15.88:0/3799909195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb78003340 con 0x7fbb7c004b20 2020-02-11T16:21:35.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.117+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.117+0000 7fbb98ff9700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb7c0420e0 0x7fbb7c0445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:35.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.117+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fbb8c04a660 con 0x7fbb7c004b20 2020-02-11T16:21:35.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.118+0000 7fbb9affd700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb7c0420e0 0x7fbb7c0445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:35.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.118+0000 7fbb9affd700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb7c0420e0 0x7fbb7c0445a0 crc :-1 s=READY pgs=388 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:35.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.121+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.121+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbb8c02fce0 con 0x7fbb7c004b20 2020-02-11T16:21:35.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.304+0000 7fbba1d51700 1 -- 172.21.15.88:0/3799909195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbb780036e0 con 0x7fbb7c004b20 2020-02-11T16:21:35.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.304+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:35.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.304+0000 7fbb98ff9700 1 -- 172.21.15.88:0/3799909195 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7fbb8c032e60 con 0x7fbb7c004b20 2020-02-11T16:21:35.308 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":126,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:35.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.306+0000 7fbba1d51700 1 -- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb7c0420e0 msgr2=0x7fbb7c0445a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:35.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.306+0000 7fbba1d51700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb7c0420e0 0x7fbb7c0445a0 crc :-1 s=READY pgs=388 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:35.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.306+0000 7fbba1d51700 1 -- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 msgr2=0x7fbb7c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:35.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.306+0000 7fbba1d51700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fbb8c001370 tx=0x7fbb8c0116f0).stop 2020-02-11T16:21:35.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.306+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3799909195 reap_dead start 2020-02-11T16:21:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.306+0000 7fbba1d51700 1 -- 172.21.15.88:0/3799909195 shutdown_connections 2020-02-11T16:21:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.306+0000 7fbba1d51700 1 --2- 172.21.15.88:0/3799909195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb7c004b20 0x7fbb7c004f00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.306+0000 7fbba1d51700 1 -- 172.21.15.88:0/3799909195 >> 172.21.15.88:0/3799909195 conn(0x7fbb9c09d110 msgr2=0x7fbb9c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.306+0000 7fbba1d51700 1 -- 172.21.15.88:0/3799909195 shutdown_connections 2020-02-11T16:21:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:35.306+0000 7fbba1d51700 1 -- 172.21.15.88:0/3799909195 wait complete. 2020-02-11T16:21:35.319 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":126,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:38.320 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:21:38.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.433+0000 7fb81e032700 1 Processor -- start 2020-02-11T16:21:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.433+0000 7fb81e032700 1 -- start start 2020-02-11T16:21:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb81e032700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8180a18a0 0x7fb8180a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb81e032700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8180a6260 0x7fb81812eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb81e032700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180a3570 con 0x7fb8180a5de0 2020-02-11T16:21:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb81e032700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8180a3810 con 0x7fb8180a18a0 2020-02-11T16:21:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb81e032700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8180a3ab0 con 0x7fb8180a6260 2020-02-11T16:21:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb817fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8180a6260 0x7fb81812eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:38.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb817fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8180a6260 0x7fb81812eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57756/0 (socket says 172.21.15.88:57756) 2020-02-11T16:21:38.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb816ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb8180a5de0 0x7fb81812e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45382/0 (socket says 172.21.15.88:45382) 2020-02-11T16:21:38.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb817fff700 1 -- 172.21.15.88:0/6715212 learned_addr learned my addr 172.21.15.88:0/6715212 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:38.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb8177fe700 1 --2- 172.21.15.88:0/6715212 >> v2:172.21.15.52:3300/0 conn(0x7fb8180a18a0 0x7fb8180a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:38.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb817fff700 1 -- 172.21.15.88:0/6715212 >> v2:172.21.15.52:3300/0 conn(0x7fb8180a18a0 msgr2=0x7fb8180a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:21:38.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb817fff700 1 --2- 172.21.15.88:0/6715212 >> v2:172.21.15.52:3300/0 conn(0x7fb8180a18a0 0x7fb8180a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:38.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb817fff700 1 -- 172.21.15.88:0/6715212 >> v1:172.21.15.88:6789/0 conn(0x7fb8180a5de0 legacy=0x7fb81812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.434+0000 7fb8167fc700 1 -- 172.21.15.88:0/6715212 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275259887 0 0) 0x7fb8180a3570 con 0x7fb8180a5de0 2020-02-11T16:21:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb817fff700 1 -- 172.21.15.88:0/6715212 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180a3d50 con 0x7fb8180a6260 2020-02-11T16:21:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb817fff700 1 --2- 172.21.15.88:0/6715212 >> v2:172.21.15.88:3300/0 conn(0x7fb8180a6260 0x7fb81812eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb817fff700 1 --2- 172.21.15.88:0/6715212 >> v2:172.21.15.88:3300/0 conn(0x7fb8180a6260 0x7fb81812eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb817fff700 1 --2- 172.21.15.88:0/6715212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180a6260 0x7fb81812eab0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).ready entity=mon.1 client_cookie=43c0c9703ccfd678 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb817fff700 1 --2- 172.21.15.88:0/6715212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180a6260 0x7fb81812eab0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb8167fc700 1 -- 172.21.15.88:0/6715212 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb810011670 con 0x7fb8180a6260 2020-02-11T16:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb817fff700 1 --2- 172.21.15.88:0/6715212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180a6260 0x7fb81812eab0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb817fff700 1 --2- 172.21.15.88:0/6715212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180a6260 0x7fb81812eab0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb8167fc700 1 -- 172.21.15.88:0/6715212 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8100117d0 con 0x7fb8180a6260 2020-02-11T16:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb8167fc700 1 -- 172.21.15.88:0/6715212 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb810011b70 con 0x7fb8180a6260 2020-02-11T16:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb81e032700 1 -- 172.21.15.88:0/6715212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180a6260 msgr2=0x7fb81812eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb81e032700 1 --2- 172.21.15.88:0/6715212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180a6260 0x7fb81812eab0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).stop 2020-02-11T16:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb81e032700 1 -- 172.21.15.88:0/6715212 shutdown_connections 2020-02-11T16:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb81e032700 1 --2- 172.21.15.88:0/6715212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180a6260 0x7fb81812eab0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb81e032700 1 --2- 172.21.15.88:0/6715212 >> v2:172.21.15.52:3300/0 conn(0x7fb8180a18a0 0x7fb8180a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb81e032700 1 -- 172.21.15.88:0/6715212 >> 172.21.15.88:0/6715212 conn(0x7fb81809d110 msgr2=0x7fb81809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb81e032700 1 -- 172.21.15.88:0/6715212 shutdown_connections 2020-02-11T16:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.435+0000 7fb81e032700 1 -- 172.21.15.88:0/6715212 wait complete. 2020-02-11T16:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.436+0000 7fb81e032700 1 Processor -- start 2020-02-11T16:21:38.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb81e032700 1 -- start start 2020-02-11T16:21:38.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb81e032700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 0x7fb818148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:38.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb81e032700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8180a6260 0x7fb818133c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:38.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb81e032700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8181484c0 con 0x7fb8180a5de0 2020-02-11T16:21:38.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb81e032700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb818149060 con 0x7fb8180a6260 2020-02-11T16:21:38.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb81e032700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8181491a0 con 0x7fb8180a18a0 2020-02-11T16:21:38.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb816ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb8180a5de0 0x7fb818134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45388/0 (socket says 172.21.15.88:45388) 2020-02-11T16:21:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb816ffd700 1 -- 172.21.15.88:0/319634351 learned_addr learned my addr 172.21.15.88:0/319634351 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227964790 0 0) 0x7fb8181484c0 con 0x7fb8180a5de0 2020-02-11T16:21:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> v2:172.21.15.52:3300/0 conn(0x7fb8180a6260 0x7fb818133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.437+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7f8002fe0 con 0x7fb8180a5de0 2020-02-11T16:21:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb8177fe700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 0x7fb818148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb8177fe700 1 -- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 msgr2=0x7fb818148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:21:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb8177fe700 1 -- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 msgr2=0x7fb818148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:21:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1213111609 0 0) 0x7fb7f8002fe0 con 0x7fb8180a5de0 2020-02-11T16:21:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb8177fe700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 0x7fb818148c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb8177fe700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 0x7fb818148c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb8181484c0 con 0x7fb8180a5de0 2020-02-11T16:21:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fb80c001980 con 0x7fb8180a5de0 2020-02-11T16:21:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 msgr2=0x7fb818148c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:21:38.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 0x7fb818148c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:38.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 >> v2:172.21.15.52:3300/0 conn(0x7fb8180a6260 msgr2=0x7fb818133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:38.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 --2- 172.21.15.88:0/319634351 >> v2:172.21.15.52:3300/0 conn(0x7fb8180a6260 0x7fb818133c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:38.454 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 >> v1:172.21.15.88:6789/0 conn(0x7fb8180a5de0 legacy=0x7fb818134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 0x7fb7f80049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7f8004e10 0x7fb7f8005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818149060 con 0x7fb7f8004e10 2020-02-11T16:21:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8181491a0 con 0x7fb7f8003a30 2020-02-11T16:21:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80044e0 con 0x7fb8180a18a0 2020-02-11T16:21:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb816ffd700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7f8004e10 0x7fb7f8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:38.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb8177fe700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 0x7fb7f80049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:38.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb8177fe700 1 -- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 msgr2=0x7fb7f80049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:21:38.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb8177fe700 1 -- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 msgr2=0x7fb7f80049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:21:38.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb8177fe700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 0x7fb7f80049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:38.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb8177fe700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 0x7fb7f80049b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:38.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb817fff700 1 -- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 msgr2=0x7fb7f80049b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:21:38.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8180a18a0 0x7fb7f80049b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:38.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb817fff700 1 -- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7f8004e10 msgr2=0x7fb7f8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:38.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7f8004e10 0x7fb7f8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:38.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb817fff700 1 -- 172.21.15.88:0/319634351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818144df0 con 0x7fb7f8003a30 2020-02-11T16:21:38.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb81e032700 1 -- 172.21.15.88:0/319634351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb818145040 con 0x7fb7f8003a30 2020-02-11T16:21:38.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb81e032700 1 -- 172.21.15.88:0/319634351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb818135620 con 0x7fb7f8003a30 2020-02-11T16:21:38.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:38.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.438+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb810007bd0 con 0x7fb7f8003a30 2020-02-11T16:21:38.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.439+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.439+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb810007340 con 0x7fb7f8003a30 2020-02-11T16:21:38.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.439+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.439+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8100074b0 con 0x7fb7f8003a30 2020-02-11T16:21:38.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.439+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.439+0000 7fb81e032700 1 -- 172.21.15.88:0/319634351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f4003340 con 0x7fb7f8003a30 2020-02-11T16:21:38.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.439+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb8100058b0 con 0x7fb7f8003a30 2020-02-11T16:21:38.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.439+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.439+0000 7fb814ff9700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb7f8041e50 0x7fb7f8044310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:38.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.439+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb810049f50 con 0x7fb7f8003a30 2020-02-11T16:21:38.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.440+0000 7fb8177fe700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb7f8041e50 0x7fb7f8044310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:38.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.440+0000 7fb8177fe700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb7f8041e50 0x7fb7f8044310 crc :-1 s=READY pgs=389 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:38.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.443+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.443+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb810032520 con 0x7fb7f8003a30 2020-02-11T16:21:38.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.624+0000 7fb81e032700 1 -- 172.21.15.88:0/319634351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb7f40036e0 con 0x7fb7f8003a30 2020-02-11T16:21:38.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.625+0000 7fb817fff700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:38.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.625+0000 7fb814ff9700 1 -- 172.21.15.88:0/319634351 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7fb810032100 con 0x7fb7f8003a30 2020-02-11T16:21:38.628 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":126,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:38.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.626+0000 7fb81e032700 1 -- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb7f8041e50 msgr2=0x7fb7f8044310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:38.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.626+0000 7fb81e032700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb7f8041e50 0x7fb7f8044310 crc :-1 s=READY pgs=389 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:38.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.626+0000 7fb81e032700 1 -- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 msgr2=0x7fb7f8003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:38.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.626+0000 7fb81e032700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fb810002f30 tx=0x7fb810007a40).stop 2020-02-11T16:21:38.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.626+0000 7fb817fff700 1 -- 172.21.15.88:0/319634351 reap_dead start 2020-02-11T16:21:38.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.626+0000 7fb81e032700 1 -- 172.21.15.88:0/319634351 shutdown_connections 2020-02-11T16:21:38.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.626+0000 7fb81e032700 1 --2- 172.21.15.88:0/319634351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f8003a30 0x7fb7f8003eb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:38.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.626+0000 7fb81e032700 1 -- 172.21.15.88:0/319634351 >> 172.21.15.88:0/319634351 conn(0x7fb81809d110 msgr2=0x7fb8180a4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:38.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.626+0000 7fb81e032700 1 -- 172.21.15.88:0/319634351 shutdown_connections 2020-02-11T16:21:38.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:38.626+0000 7fb81e032700 1 -- 172.21.15.88:0/319634351 wait complete. 2020-02-11T16:21:38.639 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":126,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:41.640 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:21:41.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.755+0000 7f854b6db700 1 Processor -- start 2020-02-11T16:21:41.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.755+0000 7f854b6db700 1 -- start start 2020-02-11T16:21:41.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f854b6db700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85440a2fa0 0x7f85440a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:41.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f854b6db700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8544131990 0x7f85440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:41.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f854b6db700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85440a4350 con 0x7f85440a5410 2020-02-11T16:21:41.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f854b6db700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85440a1e60 con 0x7f85440a2fa0 2020-02-11T16:21:41.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f854b6db700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85440a3450 con 0x7f8544131990 2020-02-11T16:21:41.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8544131990 0x7f85440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:41.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8544131990 0x7f85440a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57778/0 (socket says 172.21.15.88:57778) 2020-02-11T16:21:41.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8548c76700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f85440a5410 0x7f8544131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45402/0 (socket says 172.21.15.88:45402) 2020-02-11T16:21:41.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 -- 172.21.15.88:0/3726214160 learned_addr learned my addr 172.21.15.88:0/3726214160 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:41.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549477700 1 --2- 172.21.15.88:0/3726214160 >> v2:172.21.15.52:3300/0 conn(0x7f85440a2fa0 0x7f85440a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:41.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 -- 172.21.15.88:0/3726214160 >> v2:172.21.15.52:3300/0 conn(0x7f85440a2fa0 msgr2=0x7f85440a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:21:41.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 --2- 172.21.15.88:0/3726214160 >> v2:172.21.15.52:3300/0 conn(0x7f85440a2fa0 0x7f85440a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:41.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 -- 172.21.15.88:0/3726214160 >> v1:172.21.15.88:6789/0 conn(0x7f85440a5410 legacy=0x7f8544131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:41.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8533fff700 1 -- 172.21.15.88:0/3726214160 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606328947 0 0) 0x7f85440a4350 con 0x7f85440a5410 2020-02-11T16:21:41.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 -- 172.21.15.88:0/3726214160 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85440a3a40 con 0x7f8544131990 2020-02-11T16:21:41.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 --2- 172.21.15.88:0/3726214160 >> v2:172.21.15.88:3300/0 conn(0x7f8544131990 0x7f85440a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f85400032b0 tx=0x7f8540007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 --2- 172.21.15.88:0/3726214160 >> v2:172.21.15.88:3300/0 conn(0x7f8544131990 0x7f85440a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f85400032b0 tx=0x7f8540007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 --2- 172.21.15.88:0/3726214160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8544131990 0x7f85440a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f85400032b0 tx=0x7f8540007dc0).ready entity=mon.1 client_cookie=5d8e852079538375 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:41.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 --2- 172.21.15.88:0/3726214160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8544131990 0x7f85440a5870 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f85400032b0 tx=0x7f8540007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8533fff700 1 -- 172.21.15.88:0/3726214160 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854000a160 con 0x7f8544131990 2020-02-11T16:21:41.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 --2- 172.21.15.88:0/3726214160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8544131990 0x7f85440a5870 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f85400032b0 tx=0x7f8540007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8533fff700 1 -- 172.21.15.88:0/3726214160 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854000a2c0 con 0x7f8544131990 2020-02-11T16:21:41.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.756+0000 7f8549c78700 1 --2- 172.21.15.88:0/3726214160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8544131990 0x7f85440a5870 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f85400032b0 tx=0x7f8540007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.757+0000 7f8533fff700 1 -- 172.21.15.88:0/3726214160 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854000a620 con 0x7f8544131990 2020-02-11T16:21:41.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.757+0000 7f854b6db700 1 -- 172.21.15.88:0/3726214160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8544131990 msgr2=0x7f85440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:41.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.757+0000 7f854b6db700 1 --2- 172.21.15.88:0/3726214160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8544131990 0x7f85440a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f85400032b0 tx=0x7f8540007dc0).stop 2020-02-11T16:21:41.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.757+0000 7f854b6db700 1 -- 172.21.15.88:0/3726214160 shutdown_connections 2020-02-11T16:21:41.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.757+0000 7f854b6db700 1 --2- 172.21.15.88:0/3726214160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8544131990 0x7f85440a5870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:41.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.757+0000 7f854b6db700 1 --2- 172.21.15.88:0/3726214160 >> v2:172.21.15.52:3300/0 conn(0x7f85440a2fa0 0x7f85440a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:41.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.757+0000 7f854b6db700 1 -- 172.21.15.88:0/3726214160 >> 172.21.15.88:0/3726214160 conn(0x7f854409d110 msgr2=0x7f854409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:41.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.757+0000 7f854b6db700 1 -- 172.21.15.88:0/3726214160 shutdown_connections 2020-02-11T16:21:41.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.757+0000 7f854b6db700 1 -- 172.21.15.88:0/3726214160 wait complete. 2020-02-11T16:21:41.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.758+0000 7f854b6db700 1 Processor -- start 2020-02-11T16:21:41.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.758+0000 7f854b6db700 1 -- start start 2020-02-11T16:21:41.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.758+0000 7f854b6db700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85440a2fa0 0x7f8544142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:41.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.758+0000 7f854b6db700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854409def0 con 0x7f8544131990 2020-02-11T16:21:41.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.758+0000 7f854b6db700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85440a04f0 con 0x7f85440a5410 2020-02-11T16:21:41.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.758+0000 7f854b6db700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8544141ed0 con 0x7f85440a2fa0 2020-02-11T16:21:41.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8548c76700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f85440a5410 0x7f8544130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45408/0 (socket says 172.21.15.88:45408) 2020-02-11T16:21:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8548c76700 1 -- 172.21.15.88:0/362639325 learned_addr learned my addr 172.21.15.88:0/362639325 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> v2:172.21.15.52:3300/0 conn(0x7f85440a2fa0 0x7f8544142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f85327fc700 1 -- 172.21.15.88:0/362639325 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056002954 0 0) 0x7f85440a04f0 con 0x7f85440a5410 2020-02-11T16:21:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f85327fc700 1 -- 172.21.15.88:0/362639325 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8524002fe0 con 0x7f85440a5410 2020-02-11T16:21:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f85327fc700 1 -- 172.21.15.88:0/362639325 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1384841695 0 0) 0x7f8524002fe0 con 0x7f85440a5410 2020-02-11T16:21:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8549477700 1 -- 172.21.15.88:0/362639325 >> v1:172.21.15.88:6789/0 conn(0x7f85440a5410 legacy=0x7f8544130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8549477700 1 -- 172.21.15.88:0/362639325 >> v1:172.21.15.52:6789/0 conn(0x7f8544131990 legacy=0x7f854414c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8549477700 1 -- 172.21.15.88:0/362639325 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544141c00 con 0x7f85440a2fa0 2020-02-11T16:21:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> v2:172.21.15.52:3300/0 conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> v2:172.21.15.52:3300/0 conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:41.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f85327fc700 1 -- 172.21.15.88:0/362639325 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8534001960 con 0x7f85440a2fa0 2020-02-11T16:21:41.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f85327fc700 1 -- 172.21.15.88:0/362639325 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c0058b0 con 0x7f85440a2fa0 2020-02-11T16:21:41.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f854b6db700 1 -- 172.21.15.88:0/362639325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85440a0210 con 0x7f85440a2fa0 2020-02-11T16:21:41.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.759+0000 7f85327fc700 1 -- 172.21.15.88:0/362639325 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f853c005c10 con 0x7f85440a2fa0 2020-02-11T16:21:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.760+0000 7f854b6db700 1 -- 172.21.15.88:0/362639325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8544134de0 con 0x7f85440a2fa0 2020-02-11T16:21:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.760+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.760+0000 7f85327fc700 1 -- 172.21.15.88:0/362639325 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f853c0123b0 con 0x7f85440a2fa0 2020-02-11T16:21:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.760+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.760+0000 7f854b6db700 1 -- 172.21.15.88:0/362639325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85440565b0 con 0x7f85440a2fa0 2020-02-11T16:21:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.761+0000 7f85327fc700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8524039ee0 0x7f852403c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.761+0000 7f85327fc700 1 -- 172.21.15.88:0/362639325 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f853c00d070 con 0x7f85440a2fa0 2020-02-11T16:21:41.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.761+0000 7f8548c76700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8524039ee0 0x7f852403c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:41.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.761+0000 7f8548c76700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8524039ee0 0x7f852403c3a0 crc :-1 s=READY pgs=390 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:41.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.765+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.765+0000 7f85327fc700 1 -- 172.21.15.88:0/362639325 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f853c02ea20 con 0x7f85440a2fa0 2020-02-11T16:21:41.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.945+0000 7f854b6db700 1 -- 172.21.15.88:0/362639325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f85441343f0 con 0x7f85440a2fa0 2020-02-11T16:21:41.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.945+0000 7f8549477700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:41.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.945+0000 7f85327fc700 1 -- 172.21.15.88:0/362639325 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f853c031530 con 0x7f85440a2fa0 2020-02-11T16:21:41.949 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.947+0000 7f854b6db700 1 -- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8524039ee0 msgr2=0x7f852403c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.947+0000 7f854b6db700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8524039ee0 0x7f852403c3a0 crc :-1 s=READY pgs=390 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.947+0000 7f854b6db700 1 -- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 msgr2=0x7f8544142370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.947+0000 7f854b6db700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 0x7f8544142370 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f8540008840 tx=0x7f853c010bc0).stop 2020-02-11T16:21:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.947+0000 7f854b6db700 1 -- 172.21.15.88:0/362639325 shutdown_connections 2020-02-11T16:21:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.947+0000 7f854b6db700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8524039ee0 0x7f852403c3a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.947+0000 7f854b6db700 1 --2- 172.21.15.88:0/362639325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85440a2fa0 0x7f8544142370 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.947+0000 7f854b6db700 1 -- 172.21.15.88:0/362639325 >> 172.21.15.88:0/362639325 conn(0x7f854409d110 msgr2=0x7f8544131050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.947+0000 7f854b6db700 1 -- 172.21.15.88:0/362639325 shutdown_connections 2020-02-11T16:21:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:41.947+0000 7f854b6db700 1 -- 172.21.15.88:0/362639325 wait complete. 2020-02-11T16:21:41.960 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":128,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:41.960 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:21:41.960 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:21:42.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.065+0000 7ff25cf26700 1 Processor -- start 2020-02-11T16:21:42.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.065+0000 7ff25cf26700 1 -- start start 2020-02-11T16:21:42.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.065+0000 7ff25cf26700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff258131bd0 0x7ff258132010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.065+0000 7ff25cf26700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2580adb40 con 0x7ff2580a9130 2020-02-11T16:21:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.065+0000 7ff25cf26700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff258137de0 con 0x7ff2580ad380 2020-02-11T16:21:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.065+0000 7ff25cf26700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff258137bf0 con 0x7ff258131bd0 2020-02-11T16:21:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff25659c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff2580ad380 0x7ff258138280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45414/0 (socket says 172.21.15.88:45414) 2020-02-11T16:21:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff25659c700 1 -- 172.21.15.88:0/2555664005 learned_addr learned my addr 172.21.15.88:0/2555664005 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2555664005 >> v2:172.21.15.52:3300/0 conn(0x7ff258131bd0 0x7ff258132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff25559a700 1 -- 172.21.15.88:0/2555664005 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419033548 0 0) 0x7ff258137de0 con 0x7ff2580ad380 2020-02-11T16:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff25559a700 1 -- 172.21.15.88:0/2555664005 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff238003230 con 0x7ff2580ad380 2020-02-11T16:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff256d9d700 1 -- 172.21.15.88:0/2555664005 >> v1:172.21.15.88:6789/0 conn(0x7ff2580ad380 legacy=0x7ff258138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff25559a700 1 -- 172.21.15.88:0/2555664005 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2030832408 0 0) 0x7ff238003230 con 0x7ff2580ad380 2020-02-11T16:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff256d9d700 1 -- 172.21.15.88:0/2555664005 >> v1:172.21.15.52:6789/0 conn(0x7ff2580a9130 legacy=0x7ff2581314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff256d9d700 1 -- 172.21.15.88:0/2555664005 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2580a95c0 con 0x7ff258131bd0 2020-02-11T16:21:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2555664005 >> v2:172.21.15.52:3300/0 conn(0x7ff258131bd0 0x7ff258132010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff2400010d0 tx=0x7ff2480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2555664005 >> v2:172.21.15.52:3300/0 conn(0x7ff258131bd0 0x7ff258132010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff2400010d0 tx=0x7ff2480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2555664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258132010 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2480088e0).ready entity=mon.0 client_cookie=623988eb55b381ed server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2555664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258132010 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff25559a700 1 -- 172.21.15.88:0/2555664005 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff248008d30 con 0x7ff258131bd0 2020-02-11T16:21:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2555664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258132010 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff25559a700 1 -- 172.21.15.88:0/2555664005 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff248008e90 con 0x7ff258131bd0 2020-02-11T16:21:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2555664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258132010 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2480088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff25559a700 1 -- 172.21.15.88:0/2555664005 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff248011830 con 0x7ff258131bd0 2020-02-11T16:21:42.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.066+0000 7ff25cf26700 1 -- 172.21.15.88:0/2555664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 msgr2=0x7ff258132010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.067+0000 7ff25cf26700 1 --2- 172.21.15.88:0/2555664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258132010 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2480088e0).stop 2020-02-11T16:21:42.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.067+0000 7ff25cf26700 1 -- 172.21.15.88:0/2555664005 shutdown_connections 2020-02-11T16:21:42.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.067+0000 7ff25cf26700 1 --2- 172.21.15.88:0/2555664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258132010 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:42.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.067+0000 7ff25cf26700 1 -- 172.21.15.88:0/2555664005 >> 172.21.15.88:0/2555664005 conn(0x7ff25805ac70 msgr2=0x7ff2580ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.067+0000 7ff25cf26700 1 -- 172.21.15.88:0/2555664005 shutdown_connections 2020-02-11T16:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.067+0000 7ff25cf26700 1 -- 172.21.15.88:0/2555664005 wait complete. 2020-02-11T16:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.068+0000 7ff25cf26700 1 Processor -- start 2020-02-11T16:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.068+0000 7ff25cf26700 1 -- start start 2020-02-11T16:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.068+0000 7ff25cf26700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2580ad380 0x7ff258123650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.068+0000 7ff25cf26700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff258131bd0 0x7ff258123ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.068+0000 7ff25cf26700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff258128fd0 con 0x7ff2580a9130 2020-02-11T16:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff25cf26700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff258136e70 con 0x7ff258131bd0 2020-02-11T16:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff25cf26700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff258129270 con 0x7ff2580ad380 2020-02-11T16:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff255d9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2580ad380 0x7ff258123650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff258131bd0 0x7ff258123ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff255d9b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2580ad380 0x7ff258123650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52120/0 (socket says 172.21.15.88:52120) 2020-02-11T16:21:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff255d9b700 1 -- 172.21.15.88:0/2941833246 learned_addr learned my addr 172.21.15.88:0/2941833246 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff25659c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff2580a9130 0x7ff25812cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37202/0 (socket says 172.21.15.88:37202) 2020-02-11T16:21:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff255d9b700 1 -- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2580ad380 msgr2=0x7ff258123650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:21:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff255d9b700 1 -- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2580ad380 msgr2=0x7ff258123650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:21:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff255d9b700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2580ad380 0x7ff258123650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff255d9b700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2580ad380 0x7ff258123650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 -- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2580ad380 msgr2=0x7ff258123650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2580ad380 0x7ff258123650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 -- 172.21.15.88:0/2941833246 >> v1:172.21.15.52:6789/0 conn(0x7ff2580a9130 legacy=0x7ff25812cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484578664 0 0) 0x7ff258128fd0 con 0x7ff2580a9130 2020-02-11T16:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 -- 172.21.15.88:0/2941833246 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff258128d10 con 0x7ff258131bd0 2020-02-11T16:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2941833246 >> v2:172.21.15.52:3300/0 conn(0x7ff258131bd0 0x7ff258123ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2580a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2941833246 >> v2:172.21.15.52:3300/0 conn(0x7ff258131bd0 0x7ff258123ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2580a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258123ab0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2580a9750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258123ab0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2580a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff24800f880 con 0x7ff258131bd0 2020-02-11T16:21:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258123ab0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2580a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258123ab0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2580a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2480056c0 con 0x7ff258131bd0 2020-02-11T16:21:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff25cf26700 1 -- 172.21.15.88:0/2941833246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25812c490 con 0x7ff258131bd0 2020-02-11T16:21:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff248005aa0 con 0x7ff258131bd0 2020-02-11T16:21:42.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.069+0000 7ff25cf26700 1 -- 172.21.15.88:0/2941833246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25812d660 con 0x7ff258131bd0 2020-02-11T16:21:42.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.070+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258123ab0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2580a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.070+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff248012060 con 0x7ff258131bd0 2020-02-11T16:21:42.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.070+0000 7ff256d9d700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258123ab0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2580a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.070+0000 7ff25cf26700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 0x7ff258128820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.070+0000 7ff25cf26700 1 -- 172.21.15.88:0/2941833246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25805e2f0 con 0x7ff25812b520 2020-02-11T16:21:42.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.070+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 0x7ff258128820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.070+0000 7ff24f7fe700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff23c039b80 0x7ff23c03c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.070+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff24804a4b0 con 0x7ff258131bd0 2020-02-11T16:21:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff255d9b700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff23c039b80 0x7ff23c03c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff25659c700 1 -- 172.21.15.88:0/2941833246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff258129470 con 0x7ff25812b520 2020-02-11T16:21:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 0x7ff258128820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 0x7ff258128820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 0x7ff258128820 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff255d9b700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff23c039b80 0x7ff23c03c040 crc :-1 s=READY pgs=391 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 0x7ff258128820 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff25000ccd0 con 0x7ff25812b520 2020-02-11T16:21:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 0x7ff258128820 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff25000ce30 con 0x7ff25812b520 2020-02-11T16:21:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 msgr2=0x7ff258128820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff24f7fe700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 0x7ff258128820 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).stop 2020-02-11T16:21:42.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 msgr2=0x7ff258128820 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:42.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.071+0000 7ff24f7fe700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25812b520 0x7ff258128820 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).stop 2020-02-11T16:21:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.079+0000 7ff25cf26700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 0x7ff258130180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.079+0000 7ff25cf26700 1 -- 172.21.15.88:0/2941833246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580565b0 con 0x7ff25805ee70 2020-02-11T16:21:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.079+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 0x7ff258130180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.079+0000 7ff25659c700 1 -- 172.21.15.88:0/2941833246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff2580af350 con 0x7ff25805ee70 2020-02-11T16:21:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.079+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 0x7ff258130180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 0x7ff258130180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 0x7ff258130180 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 0x7ff258130180 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2500107b0 con 0x7ff25805ee70 2020-02-11T16:21:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25659c700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 0x7ff258130180 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7ff2500073a0 con 0x7ff25805ee70 2020-02-11T16:21:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 msgr2=0x7ff258130180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff24f7fe700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 0x7ff258130180 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).stop 2020-02-11T16:21:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff24f7fe700 1 -- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 msgr2=0x7ff258130180 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff24f7fe700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25805ee70 0x7ff258130180 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0x7ff250001490 tx=0x7ff250010e20).stop 2020-02-11T16:21:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25cf26700 1 -- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff23c039b80 msgr2=0x7ff23c03c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25cf26700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff23c039b80 0x7ff23c03c040 crc :-1 s=READY pgs=391 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25cf26700 1 -- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 msgr2=0x7ff258123ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25cf26700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258123ab0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7ff2400010d0 tx=0x7ff2580a9750).stop 2020-02-11T16:21:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff256d9d700 1 -- 172.21.15.88:0/2941833246 reap_dead start 2020-02-11T16:21:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff256d9d700 1 -- 172.21.15.88:0/2941833246 reap_dead start 2020-02-11T16:21:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25cf26700 1 -- 172.21.15.88:0/2941833246 shutdown_connections 2020-02-11T16:21:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25cf26700 1 --2- 172.21.15.88:0/2941833246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff258131bd0 0x7ff258123ab0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25cf26700 1 -- 172.21.15.88:0/2941833246 >> 172.21.15.88:0/2941833246 conn(0x7ff25805ac70 msgr2=0x7ff258069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25cf26700 1 -- 172.21.15.88:0/2941833246 shutdown_connections 2020-02-11T16:21:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.080+0000 7ff25cf26700 1 -- 172.21.15.88:0/2941833246 wait complete. 2020-02-11T16:21:42.095 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:21:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:21:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 128, 2020-02-11T16:21:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:21:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:21:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:21:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:21:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:21:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:21:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:21:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:21:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:21:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:42.099 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:42.099 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:42.099 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:42.099 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:42.100 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.100 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.100 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:21:42.100 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:21:42.100 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:21:42.100 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:21:42.100 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:21:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:21:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:21:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:21:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:21:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:21:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:21:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:21:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:21:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:21:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:21:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:21:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:21:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:21:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:21:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:21:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:21:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:21:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:21:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:21:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:21:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:21:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:21:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:21:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:21:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:21:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2020-02-11T16:21:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:21:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:21:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:21:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:21:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.119 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:21:42.120 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:21:42.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.224+0000 7ff7b0537700 1 Processor -- start 2020-02-11T16:21:42.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.224+0000 7ff7b0537700 1 -- start start 2020-02-11T16:21:42.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7b0537700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:42.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7b0537700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a5de0 0x7ff7a80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:42.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7b0537700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80a31b0 con 0x7ff7a812e3a0 2020-02-11T16:21:42.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7b0537700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a80a3570 con 0x7ff7a80a18a0 2020-02-11T16:21:42.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7b0537700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80a3810 con 0x7ff7a80a5de0 2020-02-11T16:21:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7ae2d3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7adad2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a5de0 0x7ff7a80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7ae2d3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43792/0 (socket says 172.21.15.88:43792) 2020-02-11T16:21:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7adad2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a5de0 0x7ff7a80a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52132/0 (socket says 172.21.15.88:52132) 2020-02-11T16:21:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7ae2d3700 1 -- 172.21.15.88:0/3604897362 learned_addr learned my addr 172.21.15.88:0/3604897362 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7aead4700 1 --1- 172.21.15.88:0/3604897362 >> v1:172.21.15.52:6789/0 conn(0x7ff7a812e3a0 0x7ff7a812e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37218/0 (socket says 172.21.15.88:37218) 2020-02-11T16:21:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7adad2700 1 -- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a5de0 msgr2=0x7ff7a80a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:21:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7adad2700 1 -- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a5de0 msgr2=0x7ff7a80a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:21:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a5de0 0x7ff7a80a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a5de0 0x7ff7a80a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7ae2d3700 1 -- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a5de0 msgr2=0x7ff7a80a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a5de0 0x7ff7a80a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7ae2d3700 1 -- 172.21.15.88:0/3604897362 >> v1:172.21.15.52:6789/0 conn(0x7ff7a812e3a0 legacy=0x7ff7a812e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.225+0000 7ff7ae2d3700 1 -- 172.21.15.88:0/3604897362 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80a3ab0 con 0x7ff7a80a18a0 2020-02-11T16:21:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3604897362 >> v2:172.21.15.52:3300/0 conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7a00032b0 tx=0x7ff7a0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3604897362 >> v2:172.21.15.52:3300/0 conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7a00032b0 tx=0x7ff7a0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a0008c60).ready entity=mon.0 client_cookie=60fa90ffc0a25413 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7ad2d1700 1 -- 172.21.15.88:0/3604897362 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a000c350 con 0x7ff7a80a18a0 2020-02-11T16:21:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7ad2d1700 1 -- 172.21.15.88:0/3604897362 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a000c4b0 con 0x7ff7a80a18a0 2020-02-11T16:21:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7b0537700 1 -- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a80a18a0 msgr2=0x7ff7a80a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7ad2d1700 1 -- 172.21.15.88:0/3604897362 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a000ca40 con 0x7ff7a80a18a0 2020-02-11T16:21:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7b0537700 1 --2- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a0008c60).stop 2020-02-11T16:21:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7b0537700 1 -- 172.21.15.88:0/3604897362 shutdown_connections 2020-02-11T16:21:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7b0537700 1 --2- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a80a18a0 0x7ff7a80a6dd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7b0537700 1 --2- 172.21.15.88:0/3604897362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a5de0 0x7ff7a80a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7b0537700 1 -- 172.21.15.88:0/3604897362 >> 172.21.15.88:0/3604897362 conn(0x7ff7a809d110 msgr2=0x7ff7a809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7b0537700 1 -- 172.21.15.88:0/3604897362 shutdown_connections 2020-02-11T16:21:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.226+0000 7ff7b0537700 1 -- 172.21.15.88:0/3604897362 wait complete. 2020-02-11T16:21:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.227+0000 7ff7b0537700 1 Processor -- start 2020-02-11T16:21:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.227+0000 7ff7b0537700 1 -- start start 2020-02-11T16:21:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7b0537700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a18a0 0x7ff7a81285d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7b0537700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7a80a5de0 0x7ff7a8128a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7b0537700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7a812e3a0 0x7ff7a8131700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7b0537700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a8130b10 con 0x7ff7a812e3a0 2020-02-11T16:21:42.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7b0537700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a8130d00 con 0x7ff7a80a5de0 2020-02-11T16:21:42.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7b0537700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8130fa0 con 0x7ff7a80a18a0 2020-02-11T16:21:42.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7a80a5de0 0x7ff7a8128a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7a80a5de0 0x7ff7a8128a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57812/0 (socket says 172.21.15.88:57812) 2020-02-11T16:21:42.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 -- 172.21.15.88:0/3347049019 learned_addr learned my addr 172.21.15.88:0/3347049019 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:42.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7aead4700 1 --2- 172.21.15.88:0/3347049019 >> v2:172.21.15.52:3300/0 conn(0x7ff7a812e3a0 0x7ff7a8131700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a18a0 0x7ff7a81285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7ae2d3700 1 -- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a18a0 msgr2=0x7ff7a81285d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:21:42.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7ae2d3700 1 -- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a18a0 msgr2=0x7ff7a81285d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:21:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a18a0 0x7ff7a81285d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a18a0 0x7ff7a81285d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 -- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a18a0 msgr2=0x7ff7a81285d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:21:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff7a80a18a0 0x7ff7a81285d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 -- 172.21.15.88:0/3347049019 >> v2:172.21.15.52:3300/0 conn(0x7ff7a812e3a0 msgr2=0x7ff7a8131700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3347049019 >> v2:172.21.15.52:3300/0 conn(0x7ff7a812e3a0 0x7ff7a8131700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 -- 172.21.15.88:0/3347049019 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8131240 con 0x7ff7a80a5de0 2020-02-11T16:21:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3347049019 >> v2:172.21.15.88:3300/0 conn(0x7ff7a80a5de0 0x7ff7a8128a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff79c002f30 tx=0x7ff79c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3347049019 >> v2:172.21.15.88:3300/0 conn(0x7ff7a80a5de0 0x7ff7a8128a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff79c002f30 tx=0x7ff79c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.228+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7a80a5de0 0x7ff7a8128a30 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7ff79c002f30 tx=0x7ff79c010c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7a80a5de0 0x7ff7a8128a30 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff79c002f30 tx=0x7ff79c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff79c007540 con 0x7ff7a80a5de0 2020-02-11T16:21:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7a80a5de0 0x7ff7a8128a30 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff79c002f30 tx=0x7ff79c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7a80a5de0 0x7ff7a8128a30 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff79c002f30 tx=0x7ff79c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c0059c0 con 0x7ff7a80a5de0 2020-02-11T16:21:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff7b0537700 1 -- 172.21.15.88:0/3347049019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a812dc40 con 0x7ff7a80a5de0 2020-02-11T16:21:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff79c005de0 con 0x7ff7a80a5de0 2020-02-11T16:21:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff7b0537700 1 -- 172.21.15.88:0/3347049019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a8135700 con 0x7ff7a80a5de0 2020-02-11T16:21:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7a80a5de0 0x7ff7a8128a30 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff79c002f30 tx=0x7ff79c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff79c008970 con 0x7ff7a80a5de0 2020-02-11T16:21:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.229+0000 7ff7adad2700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7a80a5de0 0x7ff7a8128a30 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff79c002f30 tx=0x7ff79c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff7b0537700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 0x7ff7a80a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff7b0537700 1 -- 172.21.15.88:0/3347049019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a805e2f0 con 0x7ff7a8131b60 2020-02-11T16:21:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff79b7fe700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff788039c40 0x7ff78803c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff79c049bf0 con 0x7ff7a80a5de0 2020-02-11T16:21:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 0x7ff7a80a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff7aead4700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff788039c40 0x7ff78803c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff7aead4700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff788039c40 0x7ff78803c100 crc :-1 s=READY pgs=392 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff7ae2d3700 1 -- 172.21.15.88:0/3347049019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7a80565b0 con 0x7ff7a8131b60 2020-02-11T16:21:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 0x7ff7a80a4bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 0x7ff7a80a4bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 0x7ff7a80a4bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 0x7ff7a80a4bb0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.230+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a0005a40 con 0x7ff7a8131b60 2020-02-11T16:21:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.231+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 0x7ff7a80a4bb0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.231+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff7a0005ba0 con 0x7ff7a8131b60 2020-02-11T16:21:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.231+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 msgr2=0x7ff7a80a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.231+0000 7ff79b7fe700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 0x7ff7a80a4bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).stop 2020-02-11T16:21:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.231+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 msgr2=0x7ff7a80a4bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.231+0000 7ff79b7fe700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a8131b60 0x7ff7a80a4bb0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).stop 2020-02-11T16:21:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.239+0000 7ff7b0537700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 0x7ff7a8132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.239+0000 7ff7b0537700 1 -- 172.21.15.88:0/3347049019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a81308e0 con 0x7ff7a81328f0 2020-02-11T16:21:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.239+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 0x7ff7a8132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.239+0000 7ff7ae2d3700 1 -- 172.21.15.88:0/3347049019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff7a8135330 con 0x7ff7a81328f0 2020-02-11T16:21:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.239+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 0x7ff7a8132cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.239+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 0x7ff7a8132cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.239+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 0x7ff7a8132cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.239+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 0x7ff7a8132cd0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.239+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a00078f0 con 0x7ff7a81328f0 2020-02-11T16:21:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7ae2d3700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 0x7ff7a8132cd0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4022 (secure 0 0 0) 0x7ff7a000f610 con 0x7ff7a81328f0 2020-02-11T16:21:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 msgr2=0x7ff7a8132cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff79b7fe700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 0x7ff7a8132cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).stop 2020-02-11T16:21:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff79b7fe700 1 -- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 msgr2=0x7ff7a8132cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff79b7fe700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a81328f0 0x7ff7a8132cd0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0x7ff7a00032b0 tx=0x7ff7a80a1c80).stop 2020-02-11T16:21:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7b0537700 1 -- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff788039c40 msgr2=0x7ff78803c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7b0537700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff788039c40 0x7ff78803c100 crc :-1 s=READY pgs=392 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7b0537700 1 -- 172.21.15.88:0/3347049019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7a80a5de0 msgr2=0x7ff7a8128a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7b0537700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7a80a5de0 0x7ff7a8128a30 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7ff79c002f30 tx=0x7ff79c010c60).stop 2020-02-11T16:21:42.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7aead4700 1 -- 172.21.15.88:0/3347049019 reap_dead start 2020-02-11T16:21:42.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7aead4700 1 -- 172.21.15.88:0/3347049019 reap_dead start 2020-02-11T16:21:42.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7b0537700 1 -- 172.21.15.88:0/3347049019 shutdown_connections 2020-02-11T16:21:42.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7b0537700 1 --2- 172.21.15.88:0/3347049019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7a80a5de0 0x7ff7a8128a30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:42.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7b0537700 1 -- 172.21.15.88:0/3347049019 >> 172.21.15.88:0/3347049019 conn(0x7ff7a809d110 msgr2=0x7ff7a80a61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:42.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7b0537700 1 -- 172.21.15.88:0/3347049019 shutdown_connections 2020-02-11T16:21:42.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.240+0000 7ff7b0537700 1 -- 172.21.15.88:0/3347049019 wait complete. 2020-02-11T16:21:42.255 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:21:42.255 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:42.255 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:42.255 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:21:42.255 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 128, 2020-02-11T16:21:42.255 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:21:42.256 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:21:42.256 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:21:42.256 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:21:42.256 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.256 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:21:42.256 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:42.257 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:21:42.257 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:21:42.257 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:42.257 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:42.257 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:42.257 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:42.257 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:42.258 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:42.258 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.258 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:21:42.258 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:21:42.258 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:42.258 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:42.258 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:42.259 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:42.259 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:42.259 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:42.259 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.259 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:21:42.259 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:21:42.260 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:21:42.260 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:21:42.260 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:21:42.260 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:21:42.260 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:42.260 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:42.260 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:21:42.261 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:21:42.261 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:42.261 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:21:42.261 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:42.261 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:42.261 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:42.261 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:42.262 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:42.262 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:42.262 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.262 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:21:42.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.262 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:21:42.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.262 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:42.263 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:42.263 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:42.263 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:42.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.263 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:42.263 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:21:42.263 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.264 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:42.264 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:21:42.264 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.264 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.264 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.265 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:21:42.265 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:21:42.265 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:42.265 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:42.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.265 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:42.266 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:42.266 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:42.266 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:42.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.266 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:42.266 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:21:42.266 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.267 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:42.267 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:21:42.267 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.267 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.267 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.268 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:21:42.268 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:21:42.268 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:42.268 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:42.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.268 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:21:42.269 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:21:42.269 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:42.269 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:42.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.269 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:42.269 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:21:42.269 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.270 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:42.270 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:21:42.270 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:42.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.270 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.271 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:21:42.271 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:21:42.271 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:42.271 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:42.271 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.271 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:42.271 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:21:42.272 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:21:42.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.272 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:42.272 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:42.272 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:42.272 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.272 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.272 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:21:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:21:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:21:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:42.274 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:21:42.276 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:21:42.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.379+0000 7f4b323ce700 1 Processor -- start 2020-02-11T16:21:42.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.379+0000 7f4b323ce700 1 -- start start 2020-02-11T16:21:42.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b323ce700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c0a18a0 0x7f4b2c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:42.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b323ce700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b2c0a6260 0x7f4b2c12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:42.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b323ce700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c0a3570 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b323ce700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c0a3810 con 0x7f4b2c0a6260 2020-02-11T16:21:42.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b323ce700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0a3ab0 con 0x7f4b2c0a18a0 2020-02-11T16:21:42.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b2bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c0a18a0 0x7f4b2c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b3096b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b2c0a6260 0x7f4b2c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b2bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c0a18a0 0x7f4b2c0a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52148/0 (socket says 172.21.15.88:52148) 2020-02-11T16:21:42.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b2bfff700 1 -- 172.21.15.88:0/1287629045 learned_addr learned my addr 172.21.15.88:0/1287629045 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:42.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b2bfff700 1 -- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c0a18a0 msgr2=0x7f4b2c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:21:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b2bfff700 1 -- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c0a18a0 msgr2=0x7f4b2c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:21:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c0a18a0 0x7f4b2c0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.380+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c0a18a0 0x7f4b2c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b3096b700 1 -- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c0a18a0 msgr2=0x7f4b2c0a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b3096b700 1 --2- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c0a18a0 0x7f4b2c0a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b3096b700 1 -- 172.21.15.88:0/1287629045 >> v1:172.21.15.52:6789/0 conn(0x7f4b2c0a5de0 legacy=0x7f4b2c12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b3096b700 1 -- 172.21.15.88:0/1287629045 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0a3d50 con 0x7f4b2c0a6260 2020-02-11T16:21:42.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b2affd700 1 -- 172.21.15.88:0/1287629045 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525802404 0 0) 0x7f4b2c0a3570 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b3096b700 1 --2- 172.21.15.88:0/1287629045 >> v2:172.21.15.52:3300/0 conn(0x7f4b2c0a6260 0x7f4b2c12eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4b2c05bbc0 tx=0x7f4b24008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b3096b700 1 --2- 172.21.15.88:0/1287629045 >> v2:172.21.15.52:3300/0 conn(0x7f4b2c0a6260 0x7f4b2c12eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4b2c05bbc0 tx=0x7f4b24008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b3096b700 1 --2- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a6260 0x7f4b2c12eab0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f4b2c05bbc0 tx=0x7f4b24008c60).ready entity=mon.0 client_cookie=f81d2289211c28e3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b3096b700 1 --2- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a6260 0x7f4b2c12eab0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f4b2c05bbc0 tx=0x7f4b24008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b2affd700 1 -- 172.21.15.88:0/1287629045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2400a160 con 0x7f4b2c0a6260 2020-02-11T16:21:42.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b3096b700 1 --2- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a6260 0x7f4b2c12eab0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f4b2c05bbc0 tx=0x7f4b24008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b2affd700 1 -- 172.21.15.88:0/1287629045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2400a2c0 con 0x7f4b2c0a6260 2020-02-11T16:21:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b3096b700 1 --2- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a6260 0x7f4b2c12eab0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f4b2c05bbc0 tx=0x7f4b24008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b2affd700 1 -- 172.21.15.88:0/1287629045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2400a660 con 0x7f4b2c0a6260 2020-02-11T16:21:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b323ce700 1 -- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a6260 msgr2=0x7f4b2c12eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b323ce700 1 --2- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a6260 0x7f4b2c12eab0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f4b2c05bbc0 tx=0x7f4b24008c60).stop 2020-02-11T16:21:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b323ce700 1 -- 172.21.15.88:0/1287629045 shutdown_connections 2020-02-11T16:21:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b323ce700 1 --2- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a6260 0x7f4b2c12eab0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:42.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b323ce700 1 --2- 172.21.15.88:0/1287629045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c0a18a0 0x7f4b2c0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:42.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.381+0000 7f4b323ce700 1 -- 172.21.15.88:0/1287629045 >> 172.21.15.88:0/1287629045 conn(0x7f4b2c09d110 msgr2=0x7f4b2c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:42.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.382+0000 7f4b323ce700 1 -- 172.21.15.88:0/1287629045 shutdown_connections 2020-02-11T16:21:42.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.382+0000 7f4b323ce700 1 -- 172.21.15.88:0/1287629045 wait complete. 2020-02-11T16:21:42.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.382+0000 7f4b323ce700 1 Processor -- start 2020-02-11T16:21:42.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.382+0000 7f4b323ce700 1 -- start start 2020-02-11T16:21:42.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.383+0000 7f4b323ce700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.383+0000 7f4b323ce700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c1352e0 con 0x7f4b2c0a18a0 2020-02-11T16:21:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.383+0000 7f4b323ce700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c12e110 con 0x7f4b2c0a6260 2020-02-11T16:21:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.383+0000 7f4b323ce700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c137ce0 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.383+0000 7f4b2bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4b2c0a18a0 0x7f4b2c12b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37236/0 (socket says 172.21.15.88:37236) 2020-02-11T16:21:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.383+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 learned_addr learned my addr 172.21.15.88:0/3943710766 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.383+0000 7f4b2b7fe700 1 --2- 172.21.15.88:0/3943710766 >> v2:172.21.15.52:3300/0 conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.383+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845993318 0 0) 0x7f4b2c0a3d50 con 0x7f4b2c0a6260 2020-02-11T16:21:42.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.383+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b0c002fe0 con 0x7f4b2c0a6260 2020-02-11T16:21:42.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750197225 0 0) 0x7f4b2c1352e0 con 0x7f4b2c0a18a0 2020-02-11T16:21:42.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b2c0a3d50 con 0x7f4b2c0a18a0 2020-02-11T16:21:42.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2899769427 0 0) 0x7f4b0c002fe0 con 0x7f4b2c0a6260 2020-02-11T16:21:42.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4b2c1352e0 con 0x7f4b2c0a6260 2020-02-11T16:21:42.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f4b2400a570 con 0x7f4b2c0a6260 2020-02-11T16:21:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b2b7fe700 1 -- 172.21.15.88:0/3943710766 >> v1:172.21.15.88:6789/0 conn(0x7f4b2c0a6260 legacy=0x7f4b2c138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b2b7fe700 1 -- 172.21.15.88:0/3943710766 >> v1:172.21.15.52:6789/0 conn(0x7f4b2c0a18a0 legacy=0x7f4b2c12b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b2b7fe700 1 -- 172.21.15.88:0/3943710766 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c137f80 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b2b7fe700 1 --2- 172.21.15.88:0/3943710766 >> v2:172.21.15.52:3300/0 conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b1c0013a0 tx=0x7f4b1c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b2b7fe700 1 --2- 172.21.15.88:0/3943710766 >> v2:172.21.15.52:3300/0 conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b1c0013a0 tx=0x7f4b1c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b2b7fe700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f4b1c0013a0 tx=0x7f4b1c001e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b2b7fe700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4b1c0013a0 tx=0x7f4b1c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1c001ea0 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b2b7fe700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4b1c0013a0 tx=0x7f4b1c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b323ce700 1 -- 172.21.15.88:0/3943710766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c135030 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c00c9f0 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b2b7fe700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4b1c0013a0 tx=0x7f4b1c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1c00cd50 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.384+0000 7f4b323ce700 1 -- 172.21.15.88:0/3943710766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c12bb60 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b2b7fe700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4b1c0013a0 tx=0x7f4b1c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b323ce700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b323ce700 1 -- 172.21.15.88:0/3943710766 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c05e2f0 con 0x7f4b2c138b30 2020-02-11T16:21:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4b1c0064e0 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b2b7fe700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4b1c0013a0 tx=0x7f4b1c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 msgr2=0x7f4b2c0a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:21:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 msgr2=0x7f4b2c0a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:21:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b297fa700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b0c03a300 0x7f4b0c03c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4b1c049190 con 0x7f4b2c0a5de0 2020-02-11T16:21:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b3096b700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b0c03a300 0x7f4b0c03c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.385+0000 7f4b3096b700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b0c03a300 0x7f4b0c03c7c0 crc :-1 s=READY pgs=393 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.586+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.586+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 msgr2=0x7f4b2c0a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:21:42.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.586+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 msgr2=0x7f4b2c0a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:21:42.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.586+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:42.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.586+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:21:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.987+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.987+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 msgr2=0x7f4b2c0a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:21:42.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.987+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 msgr2=0x7f4b2c0a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:21:42.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.987+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:42.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:42.987+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:21:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:43.788+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:43.788+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 msgr2=0x7f4b2c0a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:21:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:43.788+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 msgr2=0x7f4b2c0a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:21:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:43.788+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:21:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:43.788+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:21:44.511 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:21:44.514 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:21:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.390+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:45.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.390+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b2c138180 con 0x7f4b2c138b30 2020-02-11T16:21:45.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.390+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.391+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.391+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.391+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.391+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b200059c0 con 0x7f4b2c138b30 2020-02-11T16:21:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.391+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.391+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f4b20005b20 con 0x7f4b2c138b30 2020-02-11T16:21:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.391+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 msgr2=0x7f4b2c0a7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.391+0000 7f4b297fa700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).stop 2020-02-11T16:21:45.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.391+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 msgr2=0x7f4b2c0a7fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:45.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.391+0000 7f4b297fa700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c138b30 0x7f4b2c0a7fe0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.400+0000 7f4b323ce700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 0x7f4b2c12f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:45.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.400+0000 7f4b323ce700 1 -- 172.21.15.88:0/3943710766 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c137e20 con 0x7f4b2c12f410 2020-02-11T16:21:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.401+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 0x7f4b2c12f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.401+0000 7f4b2bfff700 1 -- 172.21.15.88:0/3943710766 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4b2c0565b0 con 0x7f4b2c12f410 2020-02-11T16:21:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.401+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 0x7f4b2c12f820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.401+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 0x7f4b2c12f820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.401+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 0x7f4b2c12f820 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.401+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 0x7f4b2c12f820 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.401+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b20012e40 con 0x7f4b2c12f410 2020-02-11T16:21:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b2bfff700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 0x7f4b2c12f820 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f4b2000b430 con 0x7f4b2c12f410 2020-02-11T16:21:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 msgr2=0x7f4b2c12f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b297fa700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 0x7f4b2c12f820 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f4b20000ee0 tx=0x7f4b20010df0).stop 2020-02-11T16:21:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b297fa700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 msgr2=0x7f4b2c12f820 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b297fa700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b2c12f410 0x7f4b2c12f820 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.406 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:21:45.406 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:21:45.407 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:21:45.407 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:21:45.407 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 128, 2020-02-11T16:21:45.407 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:21:45.407 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:21:45.407 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:21:45.407 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:21:45.408 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:45.408 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 4, 2020-02-11T16:21:45.408 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:45.408 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:21:45.408 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:21:45.408 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:45.408 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:45.409 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:45.409 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:45.409 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:45.409 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:45.409 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:45.409 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:21:45.409 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:21:45.410 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:45.410 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:45.410 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:45.410 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:45.410 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:45.410 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:45.410 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:45.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.411 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:21:45.411 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:21:45.411 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:21:45.411 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:21:45.411 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:21:45.411 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:21:45.412 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:45.412 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:45.412 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:21:45.412 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:21:45.412 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:45.412 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:21:45.412 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:45.412 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:45.413 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:45.413 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:45.413 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:45.413 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:45.413 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:45.413 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:21:45.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.414 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:21:45.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.414 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:45.414 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:45.414 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:45.414 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:45.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.415 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:45.415 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:21:45.415 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:45.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.415 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:45.415 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:21:45.416 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:45.416 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:45.416 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:45.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.416 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:21:45.416 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:21:45.416 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:45.417 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:45.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.417 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:45.417 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:45.417 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:45.417 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:45.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.419 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:45.420 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:21:45.420 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:45.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.420 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:45.420 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:21:45.420 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:45.421 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:45.421 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:45.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.421 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:21:45.421 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:21:45.421 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:45.422 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:45.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.422 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:21:45.422 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:21:45.422 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:45.422 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:45.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.423 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:45.423 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:21:45.423 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:45.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.423 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:45.424 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:21:45.424 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:45.424 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:45.424 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:45.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.424 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:21:45.424 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:21:45.425 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:45.425 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:45.425 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:45.425 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:45.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:45.425 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:21:45.425 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:21:45.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.426 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:45.426 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:45.426 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:45.426 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:45.426 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:45.426 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:21:45.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:45.427 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:45.427 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:45.427 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:45.427 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:45.427 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:45.427 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:45.428 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:21:45.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b323ce700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b0c03a300 msgr2=0x7f4b0c03c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b323ce700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4b0c03a300 0x7f4b0c03c7c0 crc :-1 s=READY pgs=393 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b323ce700 1 -- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a5de0 msgr2=0x7f4b2c134bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b323ce700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f4b1c0013a0 tx=0x7f4b1c001e40).stop 2020-02-11T16:21:45.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b3096b700 1 -- 172.21.15.88:0/3943710766 reap_dead start 2020-02-11T16:21:45.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.402+0000 7f4b3096b700 1 -- 172.21.15.88:0/3943710766 reap_dead start 2020-02-11T16:21:45.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.403+0000 7f4b323ce700 1 -- 172.21.15.88:0/3943710766 shutdown_connections 2020-02-11T16:21:45.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.403+0000 7f4b323ce700 1 --2- 172.21.15.88:0/3943710766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b2c0a5de0 0x7f4b2c134bd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.403+0000 7f4b323ce700 1 -- 172.21.15.88:0/3943710766 >> 172.21.15.88:0/3943710766 conn(0x7f4b2c09d110 msgr2=0x7f4b2c0a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:45.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.403+0000 7f4b323ce700 1 -- 172.21.15.88:0/3943710766 shutdown_connections 2020-02-11T16:21:45.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.403+0000 7f4b323ce700 1 -- 172.21.15.88:0/3943710766 wait complete. 2020-02-11T16:21:45.440 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:21:45.440 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:21:45.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.551+0000 7f09bafa2700 1 Processor -- start 2020-02-11T16:21:45.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.551+0000 7f09bafa2700 1 -- start start 2020-02-11T16:21:45.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.551+0000 7f09bafa2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09b40a1520 0x7f09b4131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:45.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.551+0000 7f09bafa2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b40a4350 con 0x7f09b40a2fa0 2020-02-11T16:21:45.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.551+0000 7f09bafa2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b40a3a40 con 0x7f09b40a5b20 2020-02-11T16:21:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.551+0000 7f09bafa2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b40a1e60 con 0x7f09b40a1520 2020-02-11T16:21:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.551+0000 7f09b3fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f09b40a5b20 0x7f09b4131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45474/0 (socket says 172.21.15.88:45474) 2020-02-11T16:21:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.551+0000 7f09b3fff700 1 -- 172.21.15.88:0/2577312277 learned_addr learned my addr 172.21.15.88:0/2577312277 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.551+0000 7f09b953f700 1 --2- 172.21.15.88:0/2577312277 >> v2:172.21.15.52:3300/0 conn(0x7f09b40a1520 0x7f09b4131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b37fe700 1 -- 172.21.15.88:0/2577312277 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53498337 0 0) 0x7f09b40a3a40 con 0x7f09b40a5b20 2020-02-11T16:21:45.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b37fe700 1 -- 172.21.15.88:0/2577312277 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a0003230 con 0x7f09b40a5b20 2020-02-11T16:21:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b953f700 1 -- 172.21.15.88:0/2577312277 >> v1:172.21.15.88:6789/0 conn(0x7f09b40a5b20 legacy=0x7f09b4131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b953f700 1 -- 172.21.15.88:0/2577312277 >> v1:172.21.15.52:6789/0 conn(0x7f09b40a2fa0 legacy=0x7f09b40a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b37fe700 1 -- 172.21.15.88:0/2577312277 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340178547 0 0) 0x7f09b40a4350 con 0x7f09b40a2fa0 2020-02-11T16:21:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b953f700 1 -- 172.21.15.88:0/2577312277 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40a3ce0 con 0x7f09b40a1520 2020-02-11T16:21:45.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b953f700 1 --2- 172.21.15.88:0/2577312277 >> v2:172.21.15.52:3300/0 conn(0x7f09b40a1520 0x7f09b4131990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f09ac0032b0 tx=0x7f09ac008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b953f700 1 --2- 172.21.15.88:0/2577312277 >> v2:172.21.15.52:3300/0 conn(0x7f09b40a1520 0x7f09b4131990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f09ac0032b0 tx=0x7f09ac008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b953f700 1 --2- 172.21.15.88:0/2577312277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b40a1520 0x7f09b4131990 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f09ac0032b0 tx=0x7f09ac008c60).ready entity=mon.0 client_cookie=7b5d5569ebb1b56d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b953f700 1 --2- 172.21.15.88:0/2577312277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b40a1520 0x7f09b4131990 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f09ac0032b0 tx=0x7f09ac008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b37fe700 1 -- 172.21.15.88:0/2577312277 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ac011e60 con 0x7f09b40a1520 2020-02-11T16:21:45.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b953f700 1 --2- 172.21.15.88:0/2577312277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b40a1520 0x7f09b4131990 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f09ac0032b0 tx=0x7f09ac008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b37fe700 1 -- 172.21.15.88:0/2577312277 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac00a160 con 0x7f09b40a1520 2020-02-11T16:21:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b953f700 1 --2- 172.21.15.88:0/2577312277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b40a1520 0x7f09b4131990 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f09ac0032b0 tx=0x7f09ac008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09b37fe700 1 -- 172.21.15.88:0/2577312277 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ac00a4c0 con 0x7f09b40a1520 2020-02-11T16:21:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09bafa2700 1 -- 172.21.15.88:0/2577312277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b40a1520 msgr2=0x7f09b4131990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.552+0000 7f09bafa2700 1 --2- 172.21.15.88:0/2577312277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b40a1520 0x7f09b4131990 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f09ac0032b0 tx=0x7f09ac008c60).stop 2020-02-11T16:21:45.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.553+0000 7f09bafa2700 1 -- 172.21.15.88:0/2577312277 shutdown_connections 2020-02-11T16:21:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.553+0000 7f09bafa2700 1 --2- 172.21.15.88:0/2577312277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b40a1520 0x7f09b4131990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.553+0000 7f09bafa2700 1 -- 172.21.15.88:0/2577312277 >> 172.21.15.88:0/2577312277 conn(0x7f09b409d110 msgr2=0x7f09b409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.553+0000 7f09bafa2700 1 -- 172.21.15.88:0/2577312277 shutdown_connections 2020-02-11T16:21:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.553+0000 7f09bafa2700 1 -- 172.21.15.88:0/2577312277 wait complete. 2020-02-11T16:21:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09bafa2700 1 Processor -- start 2020-02-11T16:21:45.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09bafa2700 1 -- start start 2020-02-11T16:21:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09bafa2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09b40a1520 0x7f09b40a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09bafa2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b40a2fa0 0x7f09b4146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09bafa2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09b40a5b20 0x7f09b4066720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09bafa2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b4131df0 con 0x7f09b40a5b20 2020-02-11T16:21:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09bafa2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b4061ac0 con 0x7f09b40a1520 2020-02-11T16:21:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09bafa2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40626c0 con 0x7f09b40a2fa0 2020-02-11T16:21:45.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09b8d3e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09b40a1520 0x7f09b40a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09b8d3e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09b40a1520 0x7f09b40a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57852/0 (socket says 172.21.15.88:57852) 2020-02-11T16:21:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.554+0000 7f09b8d3e700 1 -- 172.21.15.88:0/414429468 learned_addr learned my addr 172.21.15.88:0/414429468 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b953f700 1 --2- 172.21.15.88:0/414429468 >> v2:172.21.15.52:3300/0 conn(0x7f09b40a5b20 0x7f09b4066720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b3fff700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b40a2fa0 0x7f09b4146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 -- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b40a2fa0 msgr2=0x7f09b4146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b40a2fa0 0x7f09b4146200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 -- 172.21.15.88:0/414429468 >> v2:172.21.15.52:3300/0 conn(0x7f09b40a5b20 msgr2=0x7f09b4066720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> v2:172.21.15.52:3300/0 conn(0x7f09b40a5b20 0x7f09b4066720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 -- 172.21.15.88:0/414429468 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40632f0 con 0x7f09b40a1520 2020-02-11T16:21:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b3fff700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b40a2fa0 0x7f09b4146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:21:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> v2:172.21.15.88:3300/0 conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> v2:172.21.15.88:3300/0 conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b1ffb700 1 -- 172.21.15.88:0/414429468 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a400cc20 con 0x7f09b40a1520 2020-02-11T16:21:45.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b1ffb700 1 -- 172.21.15.88:0/414429468 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a400cd80 con 0x7f09b40a1520 2020-02-11T16:21:45.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09bafa2700 1 -- 172.21.15.88:0/414429468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b4135330 con 0x7f09b40a1520 2020-02-11T16:21:45.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b1ffb700 1 -- 172.21.15.88:0/414429468 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a40122a0 con 0x7f09b40a1520 2020-02-11T16:21:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09bafa2700 1 -- 172.21.15.88:0/414429468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b40aa3e0 con 0x7f09b40a1520 2020-02-11T16:21:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.555+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.556+0000 7f09b1ffb700 1 -- 172.21.15.88:0/414429468 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f09a4012510 con 0x7f09b40a1520 2020-02-11T16:21:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.556+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.556+0000 7f09bafa2700 1 -- 172.21.15.88:0/414429468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b4063160 con 0x7f09b40a1520 2020-02-11T16:21:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.556+0000 7f09b1ffb700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039d00 0x7f099403c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.556+0000 7f09b1ffb700 1 -- 172.21.15.88:0/414429468 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f09a40496a0 con 0x7f09b40a1520 2020-02-11T16:21:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.556+0000 7f09b3fff700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039d00 0x7f099403c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.556+0000 7f09b3fff700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039d00 0x7f099403c1c0 crc :-1 s=READY pgs=394 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.560+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.560+0000 7f09b1ffb700 1 -- 172.21.15.88:0/414429468 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f09a402eb10 con 0x7f09b40a1520 2020-02-11T16:21:45.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.741+0000 7f09bafa2700 1 -- 172.21.15.88:0/414429468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f09b40565b0 con 0x7f09b40a1520 2020-02-11T16:21:45.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.742+0000 7f09b8d3e700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:45.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.742+0000 7f09b1ffb700 1 -- 172.21.15.88:0/414429468 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f09a40317f0 con 0x7f09b40a1520 2020-02-11T16:21:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.743+0000 7f09bafa2700 1 -- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039d00 msgr2=0x7f099403c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.743+0000 7f09bafa2700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039d00 0x7f099403c1c0 crc :-1 s=READY pgs=394 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.743+0000 7f09bafa2700 1 -- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 msgr2=0x7f09b40a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.743+0000 7f09bafa2700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 0x7f09b40a04e0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f09a4000b80 tx=0x7f09a4010a10).stop 2020-02-11T16:21:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.744+0000 7f09bafa2700 1 -- 172.21.15.88:0/414429468 shutdown_connections 2020-02-11T16:21:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.744+0000 7f09bafa2700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039d00 0x7f099403c1c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.744+0000 7f09bafa2700 1 --2- 172.21.15.88:0/414429468 >> v2:172.21.15.52:3300/0 conn(0x7f09b40a5b20 0x7f09b4066720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.744+0000 7f09bafa2700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09b40a1520 0x7f09b40a04e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.744+0000 7f09bafa2700 1 --2- 172.21.15.88:0/414429468 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b40a2fa0 0x7f09b4146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.744+0000 7f09bafa2700 1 -- 172.21.15.88:0/414429468 >> 172.21.15.88:0/414429468 conn(0x7f09b409d110 msgr2=0x7f09b405a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.744+0000 7f09bafa2700 1 -- 172.21.15.88:0/414429468 shutdown_connections 2020-02-11T16:21:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:45.744+0000 7f09bafa2700 1 -- 172.21.15.88:0/414429468 wait complete. 2020-02-11T16:21:45.756 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:21:55.757 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:21:55.758 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:21:55.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f7611b46700 1 Processor -- start 2020-02-11T16:21:55.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f7611b46700 1 -- start start 2020-02-11T16:21:55.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f7611b46700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f760c0a18a0 0x7f760c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:55.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f7611b46700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f760c0a5de0 0x7f760c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:55.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f7611b46700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0a31b0 con 0x7f760c12e3a0 2020-02-11T16:21:55.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f7611b46700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0a3570 con 0x7f760c0a18a0 2020-02-11T16:21:55.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f7611b46700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0a3810 con 0x7f760c0a5de0 2020-02-11T16:21:55.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f760b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f760c0a18a0 0x7f760c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:55.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f760b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f760c0a18a0 0x7f760c0a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57862/0 (socket says 172.21.15.88:57862) 2020-02-11T16:21:55.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f760bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f760c12e3a0 0x7f760c12e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45492/0 (socket says 172.21.15.88:45492) 2020-02-11T16:21:55.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.871+0000 7f760b7fe700 1 -- 172.21.15.88:0/732130915 learned_addr learned my addr 172.21.15.88:0/732130915 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:55.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760affd700 1 --2- 172.21.15.88:0/732130915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f760c0a5de0 0x7f760c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:55.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760b7fe700 1 -- 172.21.15.88:0/732130915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f760c0a5de0 msgr2=0x7f760c0a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:21:55.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760b7fe700 1 --2- 172.21.15.88:0/732130915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f760c0a5de0 0x7f760c0a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:55.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760a7fc700 1 -- 172.21.15.88:0/732130915 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038835146 0 0) 0x7f760c0a31b0 con 0x7f760c12e3a0 2020-02-11T16:21:55.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760b7fe700 1 -- 172.21.15.88:0/732130915 >> v1:172.21.15.88:6789/0 conn(0x7f760c12e3a0 legacy=0x7f760c12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:55.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760b7fe700 1 -- 172.21.15.88:0/732130915 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0a3ab0 con 0x7f760c0a18a0 2020-02-11T16:21:55.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760b7fe700 1 --2- 172.21.15.88:0/732130915 >> v2:172.21.15.88:3300/0 conn(0x7f760c0a18a0 0x7f760c0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f75fc002f30 tx=0x7f75fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760b7fe700 1 --2- 172.21.15.88:0/732130915 >> v2:172.21.15.88:3300/0 conn(0x7f760c0a18a0 0x7f760c0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f75fc002f30 tx=0x7f75fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760b7fe700 1 --2- 172.21.15.88:0/732130915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c0a6dd0 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f75fc0088e0).ready entity=mon.1 client_cookie=9463726e48500332 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760b7fe700 1 --2- 172.21.15.88:0/732130915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f75fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760a7fc700 1 -- 172.21.15.88:0/732130915 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75fc011760 con 0x7f760c0a18a0 2020-02-11T16:21:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760b7fe700 1 --2- 172.21.15.88:0/732130915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f75fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760a7fc700 1 -- 172.21.15.88:0/732130915 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc0118c0 con 0x7f760c0a18a0 2020-02-11T16:21:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760b7fe700 1 --2- 172.21.15.88:0/732130915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f75fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f760a7fc700 1 -- 172.21.15.88:0/732130915 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75fc011c60 con 0x7f760c0a18a0 2020-02-11T16:21:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f7611b46700 1 -- 172.21.15.88:0/732130915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 msgr2=0x7f760c0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.872+0000 7f7611b46700 1 --2- 172.21.15.88:0/732130915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c0a6dd0 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f75fc0088e0).stop 2020-02-11T16:21:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.873+0000 7f7611b46700 1 -- 172.21.15.88:0/732130915 shutdown_connections 2020-02-11T16:21:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.873+0000 7f7611b46700 1 --2- 172.21.15.88:0/732130915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c0a6dd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.873+0000 7f7611b46700 1 --2- 172.21.15.88:0/732130915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f760c0a5de0 0x7f760c0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.873+0000 7f7611b46700 1 -- 172.21.15.88:0/732130915 >> 172.21.15.88:0/732130915 conn(0x7f760c09d110 msgr2=0x7f760c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.873+0000 7f7611b46700 1 -- 172.21.15.88:0/732130915 shutdown_connections 2020-02-11T16:21:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.873+0000 7f7611b46700 1 -- 172.21.15.88:0/732130915 wait complete. 2020-02-11T16:21:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.873+0000 7f7611b46700 1 Processor -- start 2020-02-11T16:21:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.874+0000 7f7611b46700 1 -- start start 2020-02-11T16:21:55.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.874+0000 7f7611b46700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f760c0a18a0 0x7f760c09ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:55.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.874+0000 7f7611b46700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f760c12e3a0 0x7f760c1389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:55.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.874+0000 7f7611b46700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0a0b00 con 0x7f760c0a5de0 2020-02-11T16:21:55.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.874+0000 7f7611b46700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0a0320 con 0x7f760c12e3a0 2020-02-11T16:21:55.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.874+0000 7f7611b46700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0a05c0 con 0x7f760c0a18a0 2020-02-11T16:21:55.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.874+0000 7f760b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f760c0a18a0 0x7f760c09ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:55.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.874+0000 7f760b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f760c0a18a0 0x7f760c09ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57868/0 (socket says 172.21.15.88:57868) 2020-02-11T16:21:55.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.874+0000 7f760affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f760c0a5de0 0x7f760c12b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45496/0 (socket says 172.21.15.88:45496) 2020-02-11T16:21:55.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.874+0000 7f760b7fe700 1 -- 172.21.15.88:0/3020025240 learned_addr learned my addr 172.21.15.88:0/3020025240 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:55.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760bfff700 1 --2- 172.21.15.88:0/3020025240 >> v2:172.21.15.52:3300/0 conn(0x7f760c12e3a0 0x7f760c1389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:55.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 -- 172.21.15.88:0/3020025240 >> v2:172.21.15.52:3300/0 conn(0x7f760c12e3a0 msgr2=0x7f760c1389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:55.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> v2:172.21.15.52:3300/0 conn(0x7f760c12e3a0 0x7f760c1389b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:55.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 -- 172.21.15.88:0/3020025240 >> v1:172.21.15.88:6789/0 conn(0x7f760c0a5de0 legacy=0x7f760c12b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f7608ff9700 1 -- 172.21.15.88:0/3020025240 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362060509 0 0) 0x7f760c0a0b00 con 0x7f760c0a5de0 2020-02-11T16:21:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 -- 172.21.15.88:0/3020025240 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0a0860 con 0x7f760c0a18a0 2020-02-11T16:21:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760bfff700 1 --2- 172.21.15.88:0/3020025240 >> v2:172.21.15.52:3300/0 conn(0x7f760c12e3a0 0x7f760c1389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:21:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> v2:172.21.15.88:3300/0 conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> v2:172.21.15.88:3300/0 conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f7608ff9700 1 -- 172.21.15.88:0/3020025240 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75fc00f910 con 0x7f760c0a18a0 2020-02-11T16:21:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f7608ff9700 1 -- 172.21.15.88:0/3020025240 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc011e60 con 0x7f760c0a18a0 2020-02-11T16:21:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f7611b46700 1 -- 172.21.15.88:0/3020025240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c12bb00 con 0x7f760c0a18a0 2020-02-11T16:21:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f7608ff9700 1 -- 172.21.15.88:0/3020025240 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75fc011c40 con 0x7f760c0a18a0 2020-02-11T16:21:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f7611b46700 1 -- 172.21.15.88:0/3020025240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c135d80 con 0x7f760c0a18a0 2020-02-11T16:21:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.875+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.876+0000 7f7608ff9700 1 -- 172.21.15.88:0/3020025240 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f75fc0056c0 con 0x7f760c0a18a0 2020-02-11T16:21:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.876+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.876+0000 7f7611b46700 1 -- 172.21.15.88:0/3020025240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0565b0 con 0x7f760c0a18a0 2020-02-11T16:21:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.876+0000 7f7608ff9700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75ec03bd00 0x7f75ec03e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.876+0000 7f7608ff9700 1 -- 172.21.15.88:0/3020025240 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f75fc04a1b0 con 0x7f760c0a18a0 2020-02-11T16:21:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.876+0000 7f760affd700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75ec03bd00 0x7f75ec03e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.876+0000 7f760affd700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75ec03bd00 0x7f75ec03e1c0 crc :-1 s=READY pgs=395 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.879+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:55.879+0000 7f7608ff9700 1 -- 172.21.15.88:0/3020025240 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f75fc02f7b0 con 0x7f760c0a18a0 2020-02-11T16:21:56.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.061+0000 7f7611b46700 1 -- 172.21.15.88:0/3020025240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f760c05ccb0 con 0x7f760c0a18a0 2020-02-11T16:21:56.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.061+0000 7f760b7fe700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.061+0000 7f7608ff9700 1 -- 172.21.15.88:0/3020025240 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f75fc032280 con 0x7f760c0a18a0 2020-02-11T16:21:56.064 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:56.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.062+0000 7f7611b46700 1 -- 172.21.15.88:0/3020025240 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75ec03bd00 msgr2=0x7f75ec03e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.062+0000 7f7611b46700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75ec03bd00 0x7f75ec03e1c0 crc :-1 s=READY pgs=395 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.062+0000 7f7611b46700 1 -- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 msgr2=0x7f760c09ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.062+0000 7f7611b46700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c09ef30 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f75fc002f30 tx=0x7f760c0a1c80).stop 2020-02-11T16:21:56.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.062+0000 7f7611b46700 1 -- 172.21.15.88:0/3020025240 shutdown_connections 2020-02-11T16:21:56.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.062+0000 7f7611b46700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75ec03bd00 0x7f75ec03e1c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.062+0000 7f7611b46700 1 --2- 172.21.15.88:0/3020025240 >> v2:172.21.15.52:3300/0 conn(0x7f760c12e3a0 0x7f760c1389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.062+0000 7f7611b46700 1 --2- 172.21.15.88:0/3020025240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f760c0a18a0 0x7f760c09ef30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.062+0000 7f7611b46700 1 -- 172.21.15.88:0/3020025240 >> 172.21.15.88:0/3020025240 conn(0x7f760c09d110 msgr2=0x7f760c0a4990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:56.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.063+0000 7f7611b46700 1 -- 172.21.15.88:0/3020025240 shutdown_connections 2020-02-11T16:21:56.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.063+0000 7f7611b46700 1 -- 172.21.15.88:0/3020025240 wait complete. 2020-02-11T16:21:56.075 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":128,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:56.075 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:21:56.075 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:21:56.075 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:21:56.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.178+0000 7f769b953700 1 Processor -- start 2020-02-11T16:21:56.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f769b953700 1 -- start start 2020-02-11T16:21:56.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f769b953700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76940a18a0 0x7f76940a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f769b953700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a6260 0x7f769412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.188 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f769b953700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76940a3570 con 0x7f76940a5de0 2020-02-11T16:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f769b953700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76940a3810 con 0x7f76940a18a0 2020-02-11T16:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f769b953700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76940a3ab0 con 0x7f76940a6260 2020-02-11T16:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f76996ef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76940a18a0 0x7f76940a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f76996ef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76940a18a0 0x7f76940a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57876/0 (socket says 172.21.15.88:57876) 2020-02-11T16:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f7698eee700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f76940a5de0 0x7f769412e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45504/0 (socket says 172.21.15.88:45504) 2020-02-11T16:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f76996ef700 1 -- 172.21.15.88:0/280497120 learned_addr learned my addr 172.21.15.88:0/280497120 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.179+0000 7f7699ef0700 1 --2- 172.21.15.88:0/280497120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a6260 0x7f769412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f76996ef700 1 -- 172.21.15.88:0/280497120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a6260 msgr2=0x7f769412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f76996ef700 1 --2- 172.21.15.88:0/280497120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a6260 0x7f769412eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f76996ef700 1 -- 172.21.15.88:0/280497120 >> v1:172.21.15.88:6789/0 conn(0x7f76940a5de0 legacy=0x7f769412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f7687fff700 1 -- 172.21.15.88:0/280497120 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365251661 0 0) 0x7f76940a3570 con 0x7f76940a5de0 2020-02-11T16:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f76996ef700 1 -- 172.21.15.88:0/280497120 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76940a3d50 con 0x7f76940a18a0 2020-02-11T16:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f76996ef700 1 --2- 172.21.15.88:0/280497120 >> v2:172.21.15.88:3300/0 conn(0x7f76940a18a0 0x7f76940a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7688002f30 tx=0x7f76880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f76996ef700 1 --2- 172.21.15.88:0/280497120 >> v2:172.21.15.88:3300/0 conn(0x7f76940a18a0 0x7f76940a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7688002f30 tx=0x7f76880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f76996ef700 1 --2- 172.21.15.88:0/280497120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a18a0 0x7f76940a6dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f7688002f30 tx=0x7f76880088e0).ready entity=mon.1 client_cookie=984a32097d0fbb00 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f76996ef700 1 --2- 172.21.15.88:0/280497120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a18a0 0x7f76940a6dd0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f7688002f30 tx=0x7f76880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f7687fff700 1 -- 172.21.15.88:0/280497120 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7688011760 con 0x7f76940a18a0 2020-02-11T16:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f76996ef700 1 --2- 172.21.15.88:0/280497120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a18a0 0x7f76940a6dd0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f7688002f30 tx=0x7f76880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f7687fff700 1 -- 172.21.15.88:0/280497120 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76880118c0 con 0x7f76940a18a0 2020-02-11T16:21:56.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f76996ef700 1 --2- 172.21.15.88:0/280497120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a18a0 0x7f76940a6dd0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f7688002f30 tx=0x7f76880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f7687fff700 1 -- 172.21.15.88:0/280497120 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7688011c60 con 0x7f76940a18a0 2020-02-11T16:21:56.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f769b953700 1 -- 172.21.15.88:0/280497120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a18a0 msgr2=0x7f76940a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f769b953700 1 --2- 172.21.15.88:0/280497120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a18a0 0x7f76940a6dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f7688002f30 tx=0x7f76880088e0).stop 2020-02-11T16:21:56.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f769b953700 1 -- 172.21.15.88:0/280497120 shutdown_connections 2020-02-11T16:21:56.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f769b953700 1 --2- 172.21.15.88:0/280497120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a6260 0x7f769412eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f769b953700 1 --2- 172.21.15.88:0/280497120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a18a0 0x7f76940a6dd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f769b953700 1 -- 172.21.15.88:0/280497120 >> 172.21.15.88:0/280497120 conn(0x7f769409d110 msgr2=0x7f769409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f769b953700 1 -- 172.21.15.88:0/280497120 shutdown_connections 2020-02-11T16:21:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.180+0000 7f769b953700 1 -- 172.21.15.88:0/280497120 wait complete. 2020-02-11T16:21:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.181+0000 7f769b953700 1 Processor -- start 2020-02-11T16:21:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.181+0000 7f769b953700 1 -- start start 2020-02-11T16:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f769b953700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f769b953700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76940a5a10 con 0x7f76940a6260 2020-02-11T16:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f769b953700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7694146c00 con 0x7f76940a18a0 2020-02-11T16:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f769b953700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7694146ea0 con 0x7f76940a5de0 2020-02-11T16:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f76996ef700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f76940a18a0 0x7f7694131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45508/0 (socket says 172.21.15.88:45508) 2020-02-11T16:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f76996ef700 1 -- 172.21.15.88:0/426805868 learned_addr learned my addr 172.21.15.88:0/426805868 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f7698eee700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211266106 0 0) 0x7f7694146c00 con 0x7f76940a18a0 2020-02-11T16:21:56.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7674002fe0 con 0x7f76940a18a0 2020-02-11T16:21:56.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608278116 0 0) 0x7f76940a5a10 con 0x7f76940a6260 2020-02-11T16:21:56.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7694146c00 con 0x7f76940a6260 2020-02-11T16:21:56.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3949642139 0 0) 0x7f7674002fe0 con 0x7f76940a18a0 2020-02-11T16:21:56.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f76940a5a10 con 0x7f76940a18a0 2020-02-11T16:21:56.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f7688011e60 con 0x7f76940a18a0 2020-02-11T16:21:56.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f7698eee700 1 -- 172.21.15.88:0/426805868 >> v1:172.21.15.88:6789/0 conn(0x7f76940a18a0 legacy=0x7f7694131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f7698eee700 1 -- 172.21.15.88:0/426805868 >> v1:172.21.15.52:6789/0 conn(0x7f76940a6260 legacy=0x7f7694143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.182+0000 7f7698eee700 1 -- 172.21.15.88:0/426805868 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7694132460 con 0x7f76940a5de0 2020-02-11T16:21:56.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f7698eee700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7690000b80 tx=0x7f7690001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f7698eee700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7690000b80 tx=0x7f7690001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f7698eee700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f7690000b80 tx=0x7f7690001e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f7698eee700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f7690000b80 tx=0x7f7690001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7690011390 con 0x7f76940a5de0 2020-02-11T16:21:56.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f769b953700 1 -- 172.21.15.88:0/426805868 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769412f350 con 0x7f76940a5de0 2020-02-11T16:21:56.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f7698eee700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f7690000b80 tx=0x7f7690001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76900114f0 con 0x7f76940a5de0 2020-02-11T16:21:56.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f7698eee700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f7690000b80 tx=0x7f7690001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76900118a0 con 0x7f76940a5de0 2020-02-11T16:21:56.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f769b953700 1 -- 172.21.15.88:0/426805868 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7694138520 con 0x7f76940a5de0 2020-02-11T16:21:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.183+0000 7f7698eee700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f7690000b80 tx=0x7f7690001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f769b953700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 0x7f769412b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f769b953700 1 -- 172.21.15.88:0/426805868 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769405e2f0 con 0x7f769412b590 2020-02-11T16:21:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7690011a00 con 0x7f76940a5de0 2020-02-11T16:21:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f7698eee700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f7690000b80 tx=0x7f7690001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 0x7f769412b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f76867fc700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f767403a370 0x7f767403c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7690011e40 con 0x7f76940a5de0 2020-02-11T16:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f76996ef700 1 -- 172.21.15.88:0/426805868 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7694146fe0 con 0x7f769412b590 2020-02-11T16:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 0x7f769412b9a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 0x7f769412b9a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f7699ef0700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f767403a370 0x7f767403c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 0x7f769412b9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 0x7f769412b9a0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.184+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7688007530 con 0x7f769412b590 2020-02-11T16:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.185+0000 7f7699ef0700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f767403a370 0x7f767403c830 crc :-1 s=READY pgs=396 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.185+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 0x7f769412b9a0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.185+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f76880056c0 con 0x7f769412b590 2020-02-11T16:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.185+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 msgr2=0x7f769412b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.185+0000 7f76867fc700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 0x7f769412b9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).stop 2020-02-11T16:21:56.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.185+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 msgr2=0x7f769412b9a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:56.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.185+0000 7f76867fc700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f769412b590 0x7f769412b9a0 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).stop 2020-02-11T16:21:56.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f769b953700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 0x7f76940a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f769b953700 1 -- 172.21.15.88:0/426805868 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76940565b0 con 0x7f76940a7fe0 2020-02-11T16:21:56.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 0x7f76940a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76996ef700 1 -- 172.21.15.88:0/426805868 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f769405ccb0 con 0x7f76940a7fe0 2020-02-11T16:21:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 0x7f76940a83f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 0x7f76940a83f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 0x7f76940a83f0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 0x7f76940a83f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768800ec30 con 0x7f76940a7fe0 2020-02-11T16:21:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76996ef700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 0x7f76940a83f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f768800b450 con 0x7f76940a7fe0 2020-02-11T16:21:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 msgr2=0x7f76940a83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76867fc700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 0x7f76940a83f0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).stop 2020-02-11T16:21:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76867fc700 1 -- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 msgr2=0x7f76940a83f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.193+0000 7f76867fc700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76940a7fe0 0x7f76940a83f0 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0x7f76880082e0 tx=0x7f76940a1c80).stop 2020-02-11T16:21:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.194+0000 7f769b953700 1 -- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f767403a370 msgr2=0x7f767403c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.194+0000 7f769b953700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f767403a370 0x7f767403c830 crc :-1 s=READY pgs=396 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.194+0000 7f769b953700 1 -- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 msgr2=0x7f7694146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.194+0000 7f769b953700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f7690000b80 tx=0x7f7690001e40).stop 2020-02-11T16:21:56.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.194+0000 7f7699ef0700 1 -- 172.21.15.88:0/426805868 reap_dead start 2020-02-11T16:21:56.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.194+0000 7f769b953700 1 -- 172.21.15.88:0/426805868 shutdown_connections 2020-02-11T16:21:56.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.194+0000 7f769b953700 1 --2- 172.21.15.88:0/426805868 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f76940a5de0 0x7f7694146640 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.194+0000 7f769b953700 1 -- 172.21.15.88:0/426805868 >> 172.21.15.88:0/426805868 conn(0x7f769409d110 msgr2=0x7f76940a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:56.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.194+0000 7f769b953700 1 -- 172.21.15.88:0/426805868 shutdown_connections 2020-02-11T16:21:56.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.194+0000 7f769b953700 1 -- 172.21.15.88:0/426805868 wait complete. 2020-02-11T16:21:56.207 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:21:56.207 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:56.207 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:56.207 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:21:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 128, 2020-02-11T16:21:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:21:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:21:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:21:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:21:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:21:56.208 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:56.209 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:21:56.209 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:21:56.209 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:56.209 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:56.209 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:56.209 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:56.209 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:56.210 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:56.210 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.210 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:21:56.210 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:21:56.210 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:56.210 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:56.210 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:56.211 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:56.211 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:56.211 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:56.211 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.211 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:21:56.211 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:21:56.212 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:21:56.212 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:21:56.212 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:21:56.212 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:21:56.212 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:56.212 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:56.212 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:21:56.213 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:21:56.213 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:56.213 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:21:56.213 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:56.213 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:56.213 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:56.213 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:56.213 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:56.214 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:56.214 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.214 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:21:56.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.214 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:21:56.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.214 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:56.215 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:56.215 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:56.215 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:56.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.215 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:56.215 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:21:56.216 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.216 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:56.216 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:21:56.216 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.216 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.217 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.217 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:21:56.217 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:21:56.217 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:56.217 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:56.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.218 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:56.218 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:56.218 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:56.218 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:56.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.218 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:56.219 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:21:56.219 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.219 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:56.219 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:21:56.219 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.219 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.220 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.220 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:21:56.220 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:21:56.220 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:56.220 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:56.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.221 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:21:56.221 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:21:56.221 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:56.221 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:56.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.222 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:56.222 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:21:56.222 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.222 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:56.222 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:21:56.222 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.223 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.223 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.223 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:21:56.223 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:21:56.223 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:56.223 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:56.224 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.224 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.224 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:21:56.224 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:21:56.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.224 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:56.224 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:56.225 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:56.225 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.225 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.225 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:21:56.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.225 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:56.225 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:56.226 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:21:56.226 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.226 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.226 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:21:56.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.226 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:56.226 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:56.227 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2020-02-11T16:21:56.227 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.227 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.227 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:21:56.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.227 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:56.227 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:56.227 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:21:56.228 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.228 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.228 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:21:56.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.228 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:56.228 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:56.228 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:21:56.229 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.229 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.229 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.229 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:21:56.230 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:21:56.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.333+0000 7f8e951a0700 1 Processor -- start 2020-02-11T16:21:56.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.333+0000 7f8e951a0700 1 -- start start 2020-02-11T16:21:56.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.334+0000 7f8e951a0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 0x7f8e900a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.334+0000 7f8e951a0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e900a2870 0x7f8e9013b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.334+0000 7f8e951a0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e900a2cf0 con 0x7f8e9013b640 2020-02-11T16:21:56.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.334+0000 7f8e951a0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e900a8630 con 0x7f8e900a2870 2020-02-11T16:21:56.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.334+0000 7f8e951a0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e900a30c0 con 0x7f8e900a6ff0 2020-02-11T16:21:56.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.334+0000 7f8e8e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e900a2870 0x7f8e9013b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.334+0000 7f8e8e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e900a2870 0x7f8e9013b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57894/0 (socket says 172.21.15.88:57894) 2020-02-11T16:21:56.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.334+0000 7f8e8f59e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8e9013b640 0x7f8e90137c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45524/0 (socket says 172.21.15.88:45524) 2020-02-11T16:21:56.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.334+0000 7f8e8e59c700 1 -- 172.21.15.88:0/506853586 learned_addr learned my addr 172.21.15.88:0/506853586 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:56.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/506853586 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 0x7f8e900a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8e59c700 1 -- 172.21.15.88:0/506853586 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 msgr2=0x7f8e900a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:21:56.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/506853586 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 0x7f8e900a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8e59c700 1 -- 172.21.15.88:0/506853586 >> v1:172.21.15.88:6789/0 conn(0x7f8e9013b640 legacy=0x7f8e90137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8dd9b700 1 -- 172.21.15.88:0/506853586 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260791198 0 0) 0x7f8e88001450 con 0x7f8e9013b640 2020-02-11T16:21:56.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8e59c700 1 -- 172.21.15.88:0/506853586 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e900a2130 con 0x7f8e900a2870 2020-02-11T16:21:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/506853586 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 0x7f8e900a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:21:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/506853586 >> v2:172.21.15.88:3300/0 conn(0x7f8e900a2870 0x7f8e9013b1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8e84002f30 tx=0x7f8e840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/506853586 >> v2:172.21.15.88:3300/0 conn(0x7f8e900a2870 0x7f8e9013b1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8e84002f30 tx=0x7f8e840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/506853586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e9013b1e0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e840088e0).ready entity=mon.1 client_cookie=60b7c1a4fd371426 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/506853586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e9013b1e0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8dd9b700 1 -- 172.21.15.88:0/506853586 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e84011760 con 0x7f8e900a2870 2020-02-11T16:21:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/506853586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e9013b1e0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8dd9b700 1 -- 172.21.15.88:0/506853586 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e840118c0 con 0x7f8e900a2870 2020-02-11T16:21:56.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/506853586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e9013b1e0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e951a0700 1 -- 172.21.15.88:0/506853586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 msgr2=0x7f8e9013b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e951a0700 1 --2- 172.21.15.88:0/506853586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e9013b1e0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e840088e0).stop 2020-02-11T16:21:56.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e8dd9b700 1 -- 172.21.15.88:0/506853586 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e84011c60 con 0x7f8e900a2870 2020-02-11T16:21:56.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e951a0700 1 -- 172.21.15.88:0/506853586 shutdown_connections 2020-02-11T16:21:56.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e951a0700 1 --2- 172.21.15.88:0/506853586 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 0x7f8e900a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e951a0700 1 --2- 172.21.15.88:0/506853586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e9013b1e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.335+0000 7f8e951a0700 1 -- 172.21.15.88:0/506853586 >> 172.21.15.88:0/506853586 conn(0x7f8e900ac2d0 msgr2=0x7f8e900ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:56.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.336+0000 7f8e951a0700 1 -- 172.21.15.88:0/506853586 shutdown_connections 2020-02-11T16:21:56.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.336+0000 7f8e951a0700 1 -- 172.21.15.88:0/506853586 wait complete. 2020-02-11T16:21:56.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.336+0000 7f8e951a0700 1 Processor -- start 2020-02-11T16:21:56.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.336+0000 7f8e951a0700 1 -- start start 2020-02-11T16:21:56.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e951a0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e900a2870 0x7f8e90144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e951a0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 0x7f8e901452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e951a0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e90149250 con 0x7f8e9013b640 2020-02-11T16:21:56.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e951a0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e900a64e0 con 0x7f8e900a2870 2020-02-11T16:21:56.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e951a0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e90148870 con 0x7f8e900a6ff0 2020-02-11T16:21:56.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e900a2870 0x7f8e90144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e900a2870 0x7f8e90144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57900/0 (socket says 172.21.15.88:57900) 2020-02-11T16:21:56.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 -- 172.21.15.88:0/3386073783 learned_addr learned my addr 172.21.15.88:0/3386073783 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:56.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 0x7f8e901452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 -- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 msgr2=0x7f8e901452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 0x7f8e901452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 -- 172.21.15.88:0/3386073783 >> v1:172.21.15.88:6789/0 conn(0x7f8e9013b640 legacy=0x7f8e90145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758910773 0 0) 0x7f8e90149250 con 0x7f8e9013b640 2020-02-11T16:21:56.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 -- 172.21.15.88:0/3386073783 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e90148b10 con 0x7f8e900a2870 2020-02-11T16:21:56.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e900a6ff0 0x7f8e901452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:21:56.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/3386073783 >> v2:172.21.15.88:3300/0 conn(0x7f8e900a2870 0x7f8e90144e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e80002f30 tx=0x7f8e80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/3386073783 >> v2:172.21.15.88:3300/0 conn(0x7f8e900a2870 0x7f8e90144e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e80002f30 tx=0x7f8e80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e90144e60 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f8e80002f30 tx=0x7f8e80010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.337+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e90144e60 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f8e80002f30 tx=0x7f8e80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e80008e80 con 0x7f8e900a2870 2020-02-11T16:21:56.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e90144e60 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f8e80002f30 tx=0x7f8e80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e80007160 con 0x7f8e900a2870 2020-02-11T16:21:56.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e90144e60 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f8e80002f30 tx=0x7f8e80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e951a0700 1 -- 172.21.15.88:0/3386073783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e90148db0 con 0x7f8e900a2870 2020-02-11T16:21:56.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e80007500 con 0x7f8e900a2870 2020-02-11T16:21:56.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e951a0700 1 -- 172.21.15.88:0/3386073783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e900a3410 con 0x7f8e900a2870 2020-02-11T16:21:56.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e90144e60 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f8e80002f30 tx=0x7f8e80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8e800059c0 con 0x7f8e900a2870 2020-02-11T16:21:56.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e951a0700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 0x7f8e90137b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e951a0700 1 -- 172.21.15.88:0/3386073783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9005e2f0 con 0x7f8e9013aa80 2020-02-11T16:21:56.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.338+0000 7f8e8ed9d700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e90144e60 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f8e80002f30 tx=0x7f8e80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e7ffff700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8e6c039ad0 0x7f8e6c03bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8e80049b10 con 0x7f8e900a2870 2020-02-11T16:21:56.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 0x7f8e90137b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e8f59e700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8e6c039ad0 0x7f8e6c03bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e8e59c700 1 -- 172.21.15.88:0/3386073783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e90148fb0 con 0x7f8e9013aa80 2020-02-11T16:21:56.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 0x7f8e90137b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e8f59e700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8e6c039ad0 0x7f8e6c03bf90 crc :-1 s=READY pgs=397 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 0x7f8e90137b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 0x7f8e90137b20 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 0x7f8e90137b20 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.339+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e84008710 con 0x7f8e9013aa80 2020-02-11T16:21:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.340+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 0x7f8e90137b20 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.340+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8e84007340 con 0x7f8e9013aa80 2020-02-11T16:21:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.340+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 msgr2=0x7f8e90137b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.340+0000 7f8e7ffff700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 0x7f8e90137b20 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).stop 2020-02-11T16:21:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.340+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 msgr2=0x7f8e90137b20 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.340+0000 7f8e7ffff700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e9013aa80 0x7f8e90137b20 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).stop 2020-02-11T16:21:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.348+0000 7f8e951a0700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 0x7f8e90138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.348+0000 7f8e951a0700 1 -- 172.21.15.88:0/3386073783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e901489b0 con 0x7f8e900ab1e0 2020-02-11T16:21:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.348+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 0x7f8e90138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.348+0000 7f8e8e59c700 1 -- 172.21.15.88:0/3386073783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8e900565b0 con 0x7f8e900ab1e0 2020-02-11T16:21:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.348+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 0x7f8e90138ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.348+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 0x7f8e90138ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.348+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 0x7f8e90138ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 0x7f8e90138ff0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e8400c730 con 0x7f8e900ab1e0 2020-02-11T16:21:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e8e59c700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 0x7f8e90138ff0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4023 (secure 0 0 0) 0x7f8e8400c890 con 0x7f8e900ab1e0 2020-02-11T16:21:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 msgr2=0x7f8e90138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e7ffff700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 0x7f8e90138ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).stop 2020-02-11T16:21:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e7ffff700 1 -- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 msgr2=0x7f8e90138ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e7ffff700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e900ab1e0 0x7f8e90138ff0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0x7f8e84002f30 tx=0x7f8e900ac270).stop 2020-02-11T16:21:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e951a0700 1 -- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8e6c039ad0 msgr2=0x7f8e6c03bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e951a0700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8e6c039ad0 0x7f8e6c03bf90 crc :-1 s=READY pgs=397 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e951a0700 1 -- 172.21.15.88:0/3386073783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 msgr2=0x7f8e90144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e951a0700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e90144e60 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f8e80002f30 tx=0x7f8e80010ba0).stop 2020-02-11T16:21:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e8f59e700 1 -- 172.21.15.88:0/3386073783 reap_dead start 2020-02-11T16:21:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e8f59e700 1 -- 172.21.15.88:0/3386073783 reap_dead start 2020-02-11T16:21:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e951a0700 1 -- 172.21.15.88:0/3386073783 shutdown_connections 2020-02-11T16:21:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e951a0700 1 --2- 172.21.15.88:0/3386073783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e900a2870 0x7f8e90144e60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e951a0700 1 -- 172.21.15.88:0/3386073783 >> 172.21.15.88:0/3386073783 conn(0x7f8e900ac2d0 msgr2=0x7f8e90069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e951a0700 1 -- 172.21.15.88:0/3386073783 shutdown_connections 2020-02-11T16:21:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.349+0000 7f8e951a0700 1 -- 172.21.15.88:0/3386073783 wait complete. 2020-02-11T16:21:56.362 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:21:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:21:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 128, 2020-02-11T16:21:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:21:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:21:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:21:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:21:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:21:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:21:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:21:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:21:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:21:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:21:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:21:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:21:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:21:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:21:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:21:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:21:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:21:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:21:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:21:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:21:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:21:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:21:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:21:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:21:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:21:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:21:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:21:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:21:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:21:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:21:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:21:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:21:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:21:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:21:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:21:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:21:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:21:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:21:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:21:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.390 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:21:56.391 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:21:56.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.494+0000 7f3dd562e700 1 Processor -- start 2020-02-11T16:21:56.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.494+0000 7f3dd562e700 1 -- start start 2020-02-11T16:21:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dd562e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a18a0 0x7f3dd00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dd562e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3dd00a5de0 0x7f3dd00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dd562e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3dd012e3a0 0x7f3dd012e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dd562e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd00a3570 con 0x7f3dd012e3a0 2020-02-11T16:21:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dd562e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd00a3810 con 0x7f3dd00a5de0 2020-02-11T16:21:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dd562e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00a3ab0 con 0x7f3dd00a18a0 2020-02-11T16:21:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dce7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3dd00a5de0 0x7f3dd00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dce7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3dd00a5de0 0x7f3dd00a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57912/0 (socket says 172.21.15.88:57912) 2020-02-11T16:21:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dce7fc700 1 -- 172.21.15.88:0/3920162067 learned_addr learned my addr 172.21.15.88:0/3920162067 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:56.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dcf7fe700 1 --2- 172.21.15.88:0/3920162067 >> v2:172.21.15.52:3300/0 conn(0x7f3dd012e3a0 0x7f3dd012e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.495+0000 7f3dceffd700 1 --2- 172.21.15.88:0/3920162067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a18a0 0x7f3dd00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 -- 172.21.15.88:0/3920162067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a18a0 msgr2=0x7f3dd00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:21:56.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/3920162067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a18a0 0x7f3dd00a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 -- 172.21.15.88:0/3920162067 >> v2:172.21.15.52:3300/0 conn(0x7f3dd012e3a0 msgr2=0x7f3dd012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:21:56.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/3920162067 >> v2:172.21.15.52:3300/0 conn(0x7f3dd012e3a0 0x7f3dd012e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 -- 172.21.15.88:0/3920162067 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00a3d50 con 0x7f3dd00a5de0 2020-02-11T16:21:56.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/3920162067 >> v2:172.21.15.88:3300/0 conn(0x7f3dd00a5de0 0x7f3dd00a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3dd005bbc0 tx=0x7f3dc00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/3920162067 >> v2:172.21.15.88:3300/0 conn(0x7f3dd00a5de0 0x7f3dd00a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3dd005bbc0 tx=0x7f3dc00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/3920162067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a5de0 0x7f3dd00a6260 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00088e0).ready entity=mon.1 client_cookie=548f4574c1f65028 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/3920162067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a5de0 0x7f3dd00a6260 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dcdffb700 1 -- 172.21.15.88:0/3920162067 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc0011720 con 0x7f3dd00a5de0 2020-02-11T16:21:56.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/3920162067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a5de0 0x7f3dd00a6260 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/3920162067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a5de0 0x7f3dd00a6260 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dcdffb700 1 -- 172.21.15.88:0/3920162067 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc0011880 con 0x7f3dd00a5de0 2020-02-11T16:21:56.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dcdffb700 1 -- 172.21.15.88:0/3920162067 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc0011c60 con 0x7f3dd00a5de0 2020-02-11T16:21:56.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dd562e700 1 -- 172.21.15.88:0/3920162067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a5de0 msgr2=0x7f3dd00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dd562e700 1 --2- 172.21.15.88:0/3920162067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a5de0 0x7f3dd00a6260 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00088e0).stop 2020-02-11T16:21:56.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dd562e700 1 -- 172.21.15.88:0/3920162067 shutdown_connections 2020-02-11T16:21:56.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dd562e700 1 --2- 172.21.15.88:0/3920162067 >> v2:172.21.15.52:3300/0 conn(0x7f3dd012e3a0 0x7f3dd012e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dd562e700 1 --2- 172.21.15.88:0/3920162067 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a18a0 0x7f3dd00a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dd562e700 1 --2- 172.21.15.88:0/3920162067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a5de0 0x7f3dd00a6260 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dd562e700 1 -- 172.21.15.88:0/3920162067 >> 172.21.15.88:0/3920162067 conn(0x7f3dd009d110 msgr2=0x7f3dd009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:56.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dd562e700 1 -- 172.21.15.88:0/3920162067 shutdown_connections 2020-02-11T16:21:56.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.496+0000 7f3dd562e700 1 -- 172.21.15.88:0/3920162067 wait complete. 2020-02-11T16:21:56.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.497+0000 7f3dd562e700 1 Processor -- start 2020-02-11T16:21:56.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.497+0000 7f3dd562e700 1 -- start start 2020-02-11T16:21:56.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dd562e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3dd00a18a0 0x7f3dd0130aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dd562e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a5de0 0x7f3dd0123e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dd562e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3dd012e3a0 0x7f3dd01242b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dd562e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd01375f0 con 0x7f3dd012e3a0 2020-02-11T16:21:56.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dd562e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd01377d0 con 0x7f3dd00a18a0 2020-02-11T16:21:56.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dd562e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0137ad0 con 0x7f3dd00a5de0 2020-02-11T16:21:56.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dceffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3dd00a18a0 0x7f3dd0130aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dceffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3dd00a18a0 0x7f3dd0130aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57918/0 (socket says 172.21.15.88:57918) 2020-02-11T16:21:56.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dceffd700 1 -- 172.21.15.88:0/2244694458 learned_addr learned my addr 172.21.15.88:0/2244694458 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:21:56.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dcf7fe700 1 --2- 172.21.15.88:0/2244694458 >> v2:172.21.15.52:3300/0 conn(0x7f3dd012e3a0 0x7f3dd01242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a5de0 0x7f3dd0123e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dceffd700 1 -- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a5de0 msgr2=0x7f3dd0123e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dceffd700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a5de0 0x7f3dd0123e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dceffd700 1 -- 172.21.15.88:0/2244694458 >> v2:172.21.15.52:3300/0 conn(0x7f3dd012e3a0 msgr2=0x7f3dd01242b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dceffd700 1 --2- 172.21.15.88:0/2244694458 >> v2:172.21.15.52:3300/0 conn(0x7f3dd012e3a0 0x7f3dd01242b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dceffd700 1 -- 172.21.15.88:0/2244694458 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd012f520 con 0x7f3dd00a18a0 2020-02-11T16:21:56.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a5de0 0x7f3dd0123e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:21:56.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.498+0000 7f3dceffd700 1 --2- 172.21.15.88:0/2244694458 >> v2:172.21.15.88:3300/0 conn(0x7f3dd00a18a0 0x7f3dd0130aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3dc4002f30 tx=0x7f3dc4010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dceffd700 1 --2- 172.21.15.88:0/2244694458 >> v2:172.21.15.88:3300/0 conn(0x7f3dd00a18a0 0x7f3dd0130aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3dc4002f30 tx=0x7f3dc4010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dceffd700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a18a0 0x7f3dd0130aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f3dc4002f30 tx=0x7f3dc4010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dceffd700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a18a0 0x7f3dd0130aa0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f3dc4002f30 tx=0x7f3dc4010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc4012380 con 0x7f3dd00a18a0 2020-02-11T16:21:56.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dceffd700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a18a0 0x7f3dd0130aa0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f3dc4002f30 tx=0x7f3dc4010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dceffd700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a18a0 0x7f3dd0130aa0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f3dc4002f30 tx=0x7f3dc4010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc40124e0 con 0x7f3dd00a18a0 2020-02-11T16:21:56.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dd562e700 1 -- 172.21.15.88:0/2244694458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd01321e0 con 0x7f3dd00a18a0 2020-02-11T16:21:56.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc4012900 con 0x7f3dd00a18a0 2020-02-11T16:21:56.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dd562e700 1 -- 172.21.15.88:0/2244694458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd0130f00 con 0x7f3dd00a18a0 2020-02-11T16:21:56.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dceffd700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a18a0 0x7f3dd0130aa0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f3dc4002f30 tx=0x7f3dc4010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dd562e700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 0x7f3dd0124710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dd562e700 1 -- 172.21.15.88:0/2244694458 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd005e2f0 con 0x7f3dd0131880 2020-02-11T16:21:56.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3dc4012b70 con 0x7f3dd00a18a0 2020-02-11T16:21:56.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.499+0000 7f3dceffd700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a18a0 0x7f3dd0130aa0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f3dc4002f30 tx=0x7f3dc4010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 0x7f3dd0124710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dbffff700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3dac039d80 0x7f3dac03c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3dc4013060 con 0x7f3dd00a18a0 2020-02-11T16:21:56.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dcf7fe700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3dac039d80 0x7f3dac03c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dce7fc700 1 -- 172.21.15.88:0/2244694458 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3dd00565b0 con 0x7f3dd0131880 2020-02-11T16:21:56.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 0x7f3dd0124710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dd00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 0x7f3dd0124710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dd00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dcf7fe700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3dac039d80 0x7f3dac03c240 crc :-1 s=READY pgs=398 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 0x7f3dd0124710 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dd00a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 0x7f3dd0124710 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dd00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.500+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc0011d10 con 0x7f3dd0131880 2020-02-11T16:21:56.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.501+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 0x7f3dd0124710 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dd00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.516 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.501+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f3dc0007340 con 0x7f3dd0131880 2020-02-11T16:21:56.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.501+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 msgr2=0x7f3dd0124710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.501+0000 7f3dbffff700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 0x7f3dd0124710 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dd00a1c80).stop 2020-02-11T16:21:56.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.501+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 msgr2=0x7f3dd0124710 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:56.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.501+0000 7f3dbffff700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd0131880 0x7f3dd0124710 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dd00a1c80).stop 2020-02-11T16:21:56.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.509+0000 7f3dd562e700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 0x7f3dd012c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.509+0000 7f3dd562e700 1 -- 172.21.15.88:0/2244694458 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0130870 con 0x7f3dd00a4860 2020-02-11T16:21:56.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.509+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 0x7f3dd012c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.509+0000 7f3dce7fc700 1 -- 172.21.15.88:0/2244694458 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3dd0132440 con 0x7f3dd00a4860 2020-02-11T16:21:56.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.509+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 0x7f3dd012c970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00082e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.509+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 0x7f3dd012c970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00082e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.509+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 0x7f3dd012c970 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00082e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.509+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 0x7f3dd012c970 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00082e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.509+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc000e950 con 0x7f3dd00a4860 2020-02-11T16:21:56.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dce7fc700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 0x7f3dd012c970 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00082e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7f3dc000eab0 con 0x7f3dd00a4860 2020-02-11T16:21:56.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 msgr2=0x7f3dd012c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dbffff700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 0x7f3dd012c970 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f3dd005bbc0 tx=0x7f3dc00082e0).stop 2020-02-11T16:21:56.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dbffff700 1 -- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 msgr2=0x7f3dd012c970 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:21:56.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dbffff700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd00a4860 0x7f3dd012c970 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dd562e700 1 -- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3dac039d80 msgr2=0x7f3dac03c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dd562e700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3dac039d80 0x7f3dac03c240 crc :-1 s=READY pgs=398 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dd562e700 1 -- 172.21.15.88:0/2244694458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a18a0 msgr2=0x7f3dd0130aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dd562e700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a18a0 0x7f3dd0130aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f3dc4002f30 tx=0x7f3dc4010af0).stop 2020-02-11T16:21:56.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dcf7fe700 1 -- 172.21.15.88:0/2244694458 reap_dead start 2020-02-11T16:21:56.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dcf7fe700 1 -- 172.21.15.88:0/2244694458 reap_dead start 2020-02-11T16:21:56.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dd562e700 1 -- 172.21.15.88:0/2244694458 shutdown_connections 2020-02-11T16:21:56.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dd562e700 1 --2- 172.21.15.88:0/2244694458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dd00a18a0 0x7f3dd0130aa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dd562e700 1 -- 172.21.15.88:0/2244694458 >> 172.21.15.88:0/2244694458 conn(0x7f3dd009d110 msgr2=0x7f3dd00a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:56.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dd562e700 1 -- 172.21.15.88:0/2244694458 shutdown_connections 2020-02-11T16:21:56.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.510+0000 7f3dd562e700 1 -- 172.21.15.88:0/2244694458 wait complete. 2020-02-11T16:21:56.523 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:21:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:21:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:21:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:21:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 128, 2020-02-11T16:21:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:21:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:21:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:21:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:21:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:21:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:21:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:21:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:56.525 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:21:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:21:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:21:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:21:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:21:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:21:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:21:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:21:56.528 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:21:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:21:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:21:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:21:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:21:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:21:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:21:56.529 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:21:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:21:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:21:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:21:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:21:56.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.531 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:21:56.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.531 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:21:56.531 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:21:56.531 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:56.531 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:56.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.532 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:56.532 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:21:56.532 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.532 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:56.532 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:21:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:21:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:21:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:56.533 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:21:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:21:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:56.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:21:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:56.535 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:21:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:21:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:21:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:56.536 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:21:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:21:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:21:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:21:56.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:21:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:21:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:21:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:21:56.538 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:21:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:21:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:21:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:21:56.539 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:21:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:21:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:21:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:21:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.540 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:21:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:21:56.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:21:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:21:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:21:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:21:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:21:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:21:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:21:56.544 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:21:56.544 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:21:56.544 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:21:56.544 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:21:56.545 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:21:56.545 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:21:56.554 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:21:56.555 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:21:56.555 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:21:56.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.696+0000 7ff3c1540700 1 Processor -- start 2020-02-11T16:21:56.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.696+0000 7ff3c1540700 1 -- start start 2020-02-11T16:21:56.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3c1540700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff3bc0a5de0 0x7ff3bc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3c1540700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc0a31b0 con 0x7ff3bc0a18a0 2020-02-11T16:21:56.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3c1540700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc0a3570 con 0x7ff3bc134a50 2020-02-11T16:21:56.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3c1540700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3bc0a3810 con 0x7ff3bc0a5de0 2020-02-11T16:21:56.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3b3fff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7ff3bc0a5de0 msgr2=0x7ff3bc0a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:21:56.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3bb7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7ff3bc134a50 legacy=0x7ff3bc134ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:21:56.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3b3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff3bc0a5de0 0x7ff3bc0a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:56.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3baffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff3bc0a18a0 0x7ff3bc0a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37372/0 (socket says 172.21.15.88:37372) 2020-02-11T16:21:56.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3baffd700 1 -- 172.21.15.88:0/920452409 learned_addr learned my addr 172.21.15.88:0/920452409 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:56.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852272716 0 0) 0x7ff3bc0a31b0 con 0x7ff3bc0a18a0 2020-02-11T16:21:56.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.697+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff39c003230 con 0x7ff3bc0a18a0 2020-02-11T16:21:56.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2494839027 0 0) 0x7ff39c003230 con 0x7ff3bc0a18a0 2020-02-11T16:21:56.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 >> v2:172.21.15.88:3300/0 conn(0x7ff3bc0a5de0 msgr2=0x7ff3bc0a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:56.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 --2- 172.21.15.88:0/920452409 >> v2:172.21.15.88:3300/0 conn(0x7ff3bc0a5de0 0x7ff3bc0a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 >> v1:172.21.15.88:6789/0 conn(0x7ff3bc134a50 legacy=0x7ff3bc134ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:56.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0a3ab0 con 0x7ff3bc0a18a0 2020-02-11T16:21:56.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7ff3ac0016d0 con 0x7ff3bc0a18a0 2020-02-11T16:21:56.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 >> v1:172.21.15.52:6789/0 conn(0x7ff3bc0a18a0 legacy=0x7ff3bc0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39c003720 0x7ff39c003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff39c004040 0x7ff39c004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 0x7ff39c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:21:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0a3810 con 0x7ff39c003720 2020-02-11T16:21:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c00b860 con 0x7ff39c004040 2020-02-11T16:21:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c00ba20 con 0x7ff39c004a80 2020-02-11T16:21:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3b3fff700 1 -- 172.21.15.88:0/920452409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff39c004040 msgr2=0x7ff39c004510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:21:56.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3b3fff700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff39c004040 0x7ff39c004510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:21:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3baffd700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39c003720 0x7ff39c003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 0x7ff39c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 -- 172.21.15.88:0/920452409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff39c004040 msgr2=0x7ff39c004510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:21:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff39c004040 0x7ff39c004510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 -- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39c003720 msgr2=0x7ff39c003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:21:56.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39c003720 0x7ff39c003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:21:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 -- 172.21.15.88:0/920452409 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c003230 con 0x7ff39c004a80 2020-02-11T16:21:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3baffd700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39c003720 0x7ff39c003b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:21:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 0x7ff39c004f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff3b4005a00 tx=0x7ff3b4008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 -- 172.21.15.88:0/920452409 reap_dead start 2020-02-11T16:21:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 0x7ff39c004f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff3b4005a00 tx=0x7ff3b4008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 0x7ff39c004f30 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7ff3b4005a00 tx=0x7ff3b4008b90).ready entity=mon.2 client_cookie=30b43c22cee00060 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 0x7ff39c004f30 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7ff3b4005a00 tx=0x7ff3b4008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b4010830 con 0x7ff39c004a80 2020-02-11T16:21:56.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 0x7ff39c004f30 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7ff3b4005a00 tx=0x7ff3b4008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b4010990 con 0x7ff39c004a80 2020-02-11T16:21:56.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 0x7ff39c004f30 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7ff3b4005a00 tx=0x7ff3b4008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.698+0000 7ff3ba7fc700 1 -- 172.21.15.88:0/920452409 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b4010d10 con 0x7ff39c004a80 2020-02-11T16:21:56.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.699+0000 7ff3c1540700 1 -- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 msgr2=0x7ff39c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.699+0000 7ff3c1540700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 0x7ff39c004f30 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7ff3b4005a00 tx=0x7ff3b4008b90).stop 2020-02-11T16:21:56.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.699+0000 7ff3c1540700 1 -- 172.21.15.88:0/920452409 shutdown_connections 2020-02-11T16:21:56.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.699+0000 7ff3c1540700 1 --2- 172.21.15.88:0/920452409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff39c004a80 0x7ff39c004f30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.699+0000 7ff3c1540700 1 -- 172.21.15.88:0/920452409 >> 172.21.15.88:0/920452409 conn(0x7ff3bc09d110 msgr2=0x7ff3bc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:56.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.699+0000 7ff3c1540700 1 -- 172.21.15.88:0/920452409 shutdown_connections 2020-02-11T16:21:56.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.699+0000 7ff3c1540700 1 -- 172.21.15.88:0/920452409 wait complete. 2020-02-11T16:21:56.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.700+0000 7ff3c1540700 1 Processor -- start 2020-02-11T16:21:56.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.700+0000 7ff3c1540700 1 -- start start 2020-02-11T16:21:56.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.700+0000 7ff3c1540700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.700+0000 7ff3c1540700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc138d10 con 0x7ff39c004a80 2020-02-11T16:21:56.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.700+0000 7ff3c1540700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc0a0440 con 0x7ff3bc12d660 2020-02-11T16:21:56.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.700+0000 7ff3b3fff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7ff3bc12d660 legacy=0x7ff3bc12a2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:21:56.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.700+0000 7ff3c1540700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3bc066360 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3baffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff39c004a80 0x7ff3bc066b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37384/0 (socket says 172.21.15.88:37384) 2020-02-11T16:21:56.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3baffd700 1 -- 172.21.15.88:0/1146772530 learned_addr learned my addr 172.21.15.88:0/1146772530 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:21:56.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> v2:172.21.15.52:3300/0 conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3bb7fe700 1 -- 172.21.15.88:0/1146772530 >> v1:172.21.15.88:6789/0 conn(0x7ff3bc12d660 legacy=0x7ff3bc12a2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:21:56.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3bb7fe700 1 -- 172.21.15.88:0/1146772530 >> v1:172.21.15.52:6789/0 conn(0x7ff39c004a80 legacy=0x7ff3bc066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3b8ff9700 1 -- 172.21.15.88:0/1146772530 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109386143 0 0) 0x7ff3bc138d10 con 0x7ff39c004a80 2020-02-11T16:21:56.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3bb7fe700 1 -- 172.21.15.88:0/1146772530 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0a0180 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> v2:172.21.15.52:3300/0 conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> v2:172.21.15.52:3300/0 conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3b8ff9700 1 -- 172.21.15.88:0/1146772530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b4005880 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3b8ff9700 1 -- 172.21.15.88:0/1146772530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b4010e60 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3c1540700 1 -- 172.21.15.88:0/1146772530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc0a06e0 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3b8ff9700 1 -- 172.21.15.88:0/1146772530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b4005e20 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.701+0000 7ff3c1540700 1 -- 172.21.15.88:0/1146772530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc12a9b0 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.702+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.702+0000 7ff3c1540700 1 -- 172.21.15.88:0/1146772530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc0565b0 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.703+0000 7ff3b8ff9700 1 -- 172.21.15.88:0/1146772530 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff3b400f1f0 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.703+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.703+0000 7ff3b8ff9700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff3a0039ab0 0x7ff3a003bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:21:56.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.703+0000 7ff3b8ff9700 1 -- 172.21.15.88:0/1146772530 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff3b4049e60 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.703+0000 7ff3baffd700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff3a0039ab0 0x7ff3a003bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:21:56.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.703+0000 7ff3baffd700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff3a0039ab0 0x7ff3a003bf70 crc :-1 s=READY pgs=399 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:21:56.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.707+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.707+0000 7ff3b8ff9700 1 -- 172.21.15.88:0/1146772530 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff3b4032430 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.886+0000 7ff3c1540700 1 -- 172.21.15.88:0/1146772530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff3bc05ccb0 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.887+0000 7ff3bb7fe700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:21:56.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.887+0000 7ff3b8ff9700 1 -- 172.21.15.88:0/1146772530 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7ff3b4031ff0 con 0x7ff3bc0a0bf0 2020-02-11T16:21:56.890 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.888+0000 7ff3c1540700 1 -- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff3a0039ab0 msgr2=0x7ff3a003bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.888+0000 7ff3c1540700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff3a0039ab0 0x7ff3a003bf70 crc :-1 s=READY pgs=399 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.888+0000 7ff3c1540700 1 -- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 msgr2=0x7ff3bc09def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:21:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.888+0000 7ff3c1540700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7ff3bc12de60 tx=0x7ff39c00bca0).stop 2020-02-11T16:21:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.888+0000 7ff3c1540700 1 -- 172.21.15.88:0/1146772530 shutdown_connections 2020-02-11T16:21:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.888+0000 7ff3c1540700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff3a0039ab0 0x7ff3a003bf70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.888+0000 7ff3c1540700 1 --2- 172.21.15.88:0/1146772530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0a0bf0 0x7ff3bc09def0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:21:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.888+0000 7ff3c1540700 1 -- 172.21.15.88:0/1146772530 >> 172.21.15.88:0/1146772530 conn(0x7ff3bc09d110 msgr2=0x7ff3bc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:21:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.889+0000 7ff3c1540700 1 -- 172.21.15.88:0/1146772530 shutdown_connections 2020-02-11T16:21:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:21:56.889+0000 7ff3c1540700 1 -- 172.21.15.88:0/1146772530 wait complete. 2020-02-11T16:21:56.901 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":128,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:21:59.902 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:22:00.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.016+0000 7f6137851700 1 Processor -- start 2020-02-11T16:22:00.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.016+0000 7f6137851700 1 -- start start 2020-02-11T16:22:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.017+0000 7f6137851700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61300a2fa0 0x7f61300a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.017+0000 7f6137851700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 0x7f61300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.017+0000 7f6137851700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61300a4350 con 0x7f61300a5410 2020-02-11T16:22:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.017+0000 7f6137851700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61300a1e60 con 0x7f61300a2fa0 2020-02-11T16:22:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.017+0000 7f6137851700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61300a3450 con 0x7f6130131990 2020-02-11T16:22:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.017+0000 7f61355ed700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f61300a2fa0 msgr2=0x7f61300a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.017+0000 7f61355ed700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61300a2fa0 0x7f61300a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.017+0000 7f6135dee700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 0x7f61300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.017+0000 7f6134dec700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f61300a5410 0x7f6130131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37396/0 (socket says 172.21.15.88:37396) 2020-02-11T16:22:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.017+0000 7f6134dec700 1 -- 172.21.15.88:0/501268686 learned_addr learned my addr 172.21.15.88:0/501268686 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:22:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6135dee700 1 -- 172.21.15.88:0/501268686 >> v2:172.21.15.88:3300/0 conn(0x7f61300a2fa0 msgr2=0x7f61300a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:22:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6135dee700 1 --2- 172.21.15.88:0/501268686 >> v2:172.21.15.88:3300/0 conn(0x7f61300a2fa0 0x7f61300a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6135dee700 1 -- 172.21.15.88:0/501268686 >> v1:172.21.15.52:6789/0 conn(0x7f61300a5410 legacy=0x7f6130131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6135dee700 1 -- 172.21.15.88:0/501268686 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61300a3a40 con 0x7f6130131990 2020-02-11T16:22:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f611ffff700 1 -- 172.21.15.88:0/501268686 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229757701 0 0) 0x7f61300a4350 con 0x7f61300a5410 2020-02-11T16:22:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6135dee700 1 --2- 172.21.15.88:0/501268686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 0x7f61300a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f61280032b0 tx=0x7f6128008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6135dee700 1 --2- 172.21.15.88:0/501268686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 0x7f61300a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f61280032b0 tx=0x7f6128008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6135dee700 1 --2- 172.21.15.88:0/501268686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 0x7f61300a5870 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f61280032b0 tx=0x7f6128008c60).ready entity=mon.2 client_cookie=d8b971a58ac5f922 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6135dee700 1 --2- 172.21.15.88:0/501268686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 0x7f61300a5870 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f61280032b0 tx=0x7f6128008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f611ffff700 1 -- 172.21.15.88:0/501268686 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f612800a160 con 0x7f6130131990 2020-02-11T16:22:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6135dee700 1 --2- 172.21.15.88:0/501268686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 0x7f61300a5870 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f61280032b0 tx=0x7f6128008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f611ffff700 1 -- 172.21.15.88:0/501268686 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612800a2c0 con 0x7f6130131990 2020-02-11T16:22:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6135dee700 1 --2- 172.21.15.88:0/501268686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 0x7f61300a5870 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f61280032b0 tx=0x7f6128008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f611ffff700 1 -- 172.21.15.88:0/501268686 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f612800a620 con 0x7f6130131990 2020-02-11T16:22:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6137851700 1 -- 172.21.15.88:0/501268686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 msgr2=0x7f61300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.018+0000 7f6137851700 1 --2- 172.21.15.88:0/501268686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 0x7f61300a5870 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f61280032b0 tx=0x7f6128008c60).stop 2020-02-11T16:22:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.019+0000 7f6137851700 1 -- 172.21.15.88:0/501268686 shutdown_connections 2020-02-11T16:22:00.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.019+0000 7f6137851700 1 --2- 172.21.15.88:0/501268686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6130131990 0x7f61300a5870 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:00.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.019+0000 7f6137851700 1 --2- 172.21.15.88:0/501268686 >> v2:172.21.15.88:3300/0 conn(0x7f61300a2fa0 0x7f61300a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:00.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.019+0000 7f6137851700 1 -- 172.21.15.88:0/501268686 >> 172.21.15.88:0/501268686 conn(0x7f613009d110 msgr2=0x7f613009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:00.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.019+0000 7f6137851700 1 -- 172.21.15.88:0/501268686 shutdown_connections 2020-02-11T16:22:00.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.019+0000 7f6137851700 1 -- 172.21.15.88:0/501268686 wait complete. 2020-02-11T16:22:00.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.019+0000 7f6137851700 1 Processor -- start 2020-02-11T16:22:00.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f6137851700 1 -- start start 2020-02-11T16:22:00.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f6137851700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:00.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f6137851700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6130131990 0x7f6130146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:00.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f6137851700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6130134300 con 0x7f61300a5410 2020-02-11T16:22:00.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f6137851700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6130135330 con 0x7f6130131990 2020-02-11T16:22:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f6137851700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6130134620 con 0x7f61300a2fa0 2020-02-11T16:22:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f6134dec700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f61300a5410 legacy=0x7f6130145c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:22:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f6135dee700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f6130131990 msgr2=0x7f6130146350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f6135dee700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6130131990 0x7f6130146350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f61355ed700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f61355ed700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52314/0 (socket says 172.21.15.88:52314) 2020-02-11T16:22:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.020+0000 7f61355ed700 1 -- 172.21.15.88:0/3034043142 learned_addr learned my addr 172.21.15.88:0/3034043142 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f61355ed700 1 -- 172.21.15.88:0/3034043142 >> v2:172.21.15.88:3300/0 conn(0x7f6130131990 msgr2=0x7f6130146350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> v2:172.21.15.88:3300/0 conn(0x7f6130131990 0x7f6130146350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f61355ed700 1 -- 172.21.15.88:0/3034043142 >> v1:172.21.15.88:6789/0 conn(0x7f61300a5410 legacy=0x7f6130145c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f61355ed700 1 -- 172.21.15.88:0/3034043142 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61301348c0 con 0x7f61300a2fa0 2020-02-11T16:22:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f611e7fc700 1 -- 172.21.15.88:0/3034043142 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6120008ce0 con 0x7f61300a2fa0 2020-02-11T16:22:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f611e7fc700 1 -- 172.21.15.88:0/3034043142 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120008e40 con 0x7f61300a2fa0 2020-02-11T16:22:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f6137851700 1 -- 172.21.15.88:0/3034043142 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61300a0470 con 0x7f61300a2fa0 2020-02-11T16:22:00.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f611e7fc700 1 -- 172.21.15.88:0/3034043142 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6120003900 con 0x7f61300a2fa0 2020-02-11T16:22:00.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.021+0000 7f6137851700 1 -- 172.21.15.88:0/3034043142 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61300624a0 con 0x7f61300a2fa0 2020-02-11T16:22:00.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.022+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.022+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.022+0000 7f611e7fc700 1 -- 172.21.15.88:0/3034043142 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6120003b70 con 0x7f61300a2fa0 2020-02-11T16:22:00.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.022+0000 7f6137851700 1 -- 172.21.15.88:0/3034043142 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6130130e90 con 0x7f61300a2fa0 2020-02-11T16:22:00.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.022+0000 7f611e7fc700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039b40 0x7f611003c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:00.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.022+0000 7f611e7fc700 1 -- 172.21.15.88:0/3034043142 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f61200495a0 con 0x7f61300a2fa0 2020-02-11T16:22:00.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.022+0000 7f6134dec700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039b40 0x7f611003c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:00.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.023+0000 7f6134dec700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039b40 0x7f611003c000 crc :-1 s=READY pgs=400 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:00.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.027+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.027+0000 7f611e7fc700 1 -- 172.21.15.88:0/3034043142 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f6130130e90 con 0x7f61300a2fa0 2020-02-11T16:22:00.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.205+0000 7f6137851700 1 -- 172.21.15.88:0/3034043142 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6130130e90 con 0x7f61300a2fa0 2020-02-11T16:22:00.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.206+0000 7f61355ed700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:00.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.206+0000 7f611e7fc700 1 -- 172.21.15.88:0/3034043142 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f6130130e90 con 0x7f61300a2fa0 2020-02-11T16:22:00.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 -- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039b40 msgr2=0x7f611003c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039b40 0x7f611003c000 crc :-1 s=READY pgs=400 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 -- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 msgr2=0x7f6130062040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f6130134e40 tx=0x7f61200109f0).stop 2020-02-11T16:22:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 -- 172.21.15.88:0/3034043142 shutdown_connections 2020-02-11T16:22:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6110039b40 0x7f611003c000 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 --2- 172.21.15.88:0/3034043142 >> v2:172.21.15.88:3300/0 conn(0x7f6130131990 0x7f6130146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 --2- 172.21.15.88:0/3034043142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61300a2fa0 0x7f6130062040 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:00.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 -- 172.21.15.88:0/3034043142 >> 172.21.15.88:0/3034043142 conn(0x7f613009d110 msgr2=0x7f6130069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:00.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 -- 172.21.15.88:0/3034043142 shutdown_connections 2020-02-11T16:22:00.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:00.208+0000 7f6137851700 1 -- 172.21.15.88:0/3034043142 wait complete. 2020-02-11T16:22:00.213 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:00.222 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":128,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:03.223 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:22:03.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.337+0000 7f33b88f0700 1 Processor -- start 2020-02-11T16:22:03.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.337+0000 7f33b88f0700 1 -- start start 2020-02-11T16:22:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b88f0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33b40a18a0 0x7f33b40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b88f0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f33b40a5de0 0x7f33b40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:03.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b88f0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b40a31b0 con 0x7f33b412e3a0 2020-02-11T16:22:03.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b88f0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b40a3570 con 0x7f33b40a5de0 2020-02-11T16:22:03.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b88f0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b40a3810 con 0x7f33b40a18a0 2020-02-11T16:22:03.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b259c700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f33b40a18a0 msgr2=0x7f33b40a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:03.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b2d9d700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f33b412e3a0 legacy=0x7f33b412e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:22:03.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33b40a18a0 0x7f33b40a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:03.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b1d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f33b40a5de0 0x7f33b40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:03.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b1d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f33b40a5de0 0x7f33b40a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:43984/0 (socket says 172.21.15.88:43984) 2020-02-11T16:22:03.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.338+0000 7f33b1d9b700 1 -- 172.21.15.88:0/245508775 learned_addr learned my addr 172.21.15.88:0/245508775 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:03.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b1d9b700 1 -- 172.21.15.88:0/245508775 >> v2:172.21.15.88:3300/0 conn(0x7f33b40a18a0 msgr2=0x7f33b40a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:22:03.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b1d9b700 1 --2- 172.21.15.88:0/245508775 >> v2:172.21.15.88:3300/0 conn(0x7f33b40a18a0 0x7f33b40a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:03.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b1d9b700 1 -- 172.21.15.88:0/245508775 >> v1:172.21.15.88:6789/0 conn(0x7f33b412e3a0 legacy=0x7f33b412e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:22:03.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b1d9b700 1 -- 172.21.15.88:0/245508775 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b40a3ab0 con 0x7f33b40a5de0 2020-02-11T16:22:03.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b1d9b700 1 --2- 172.21.15.88:0/245508775 >> v2:172.21.15.52:3300/0 conn(0x7f33b40a5de0 0x7f33b40a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f33b405bbc0 tx=0x7f33a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b1d9b700 1 --2- 172.21.15.88:0/245508775 >> v2:172.21.15.52:3300/0 conn(0x7f33b40a5de0 0x7f33b40a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f33b405bbc0 tx=0x7f33a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b1d9b700 1 --2- 172.21.15.88:0/245508775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b40a5de0 0x7f33b40a6260 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f33b405bbc0 tx=0x7f33a4007a40).ready entity=mon.0 client_cookie=f12e971d8ecf908e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:03.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b1d9b700 1 --2- 172.21.15.88:0/245508775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b40a5de0 0x7f33b40a6260 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f33b405bbc0 tx=0x7f33a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b1d9b700 1 --2- 172.21.15.88:0/245508775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b40a5de0 0x7f33b40a6260 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f33b405bbc0 tx=0x7f33a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b159a700 1 -- 172.21.15.88:0/245508775 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33a4008e20 con 0x7f33b40a5de0 2020-02-11T16:22:03.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b1d9b700 1 --2- 172.21.15.88:0/245508775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b40a5de0 0x7f33b40a6260 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f33b405bbc0 tx=0x7f33a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b159a700 1 -- 172.21.15.88:0/245508775 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a40118d0 con 0x7f33b40a5de0 2020-02-11T16:22:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b159a700 1 -- 172.21.15.88:0/245508775 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33a4011cb0 con 0x7f33b40a5de0 2020-02-11T16:22:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b88f0700 1 -- 172.21.15.88:0/245508775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b40a5de0 msgr2=0x7f33b40a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.339+0000 7f33b88f0700 1 --2- 172.21.15.88:0/245508775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b40a5de0 0x7f33b40a6260 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f33b405bbc0 tx=0x7f33a4007a40).stop 2020-02-11T16:22:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.340+0000 7f33b88f0700 1 -- 172.21.15.88:0/245508775 shutdown_connections 2020-02-11T16:22:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.340+0000 7f33b88f0700 1 --2- 172.21.15.88:0/245508775 >> v2:172.21.15.88:3300/0 conn(0x7f33b40a18a0 0x7f33b40a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.340+0000 7f33b88f0700 1 --2- 172.21.15.88:0/245508775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b40a5de0 0x7f33b40a6260 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.340+0000 7f33b88f0700 1 -- 172.21.15.88:0/245508775 >> 172.21.15.88:0/245508775 conn(0x7f33b409d110 msgr2=0x7f33b409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.340+0000 7f33b88f0700 1 -- 172.21.15.88:0/245508775 shutdown_connections 2020-02-11T16:22:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.340+0000 7f33b88f0700 1 -- 172.21.15.88:0/245508775 wait complete. 2020-02-11T16:22:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.340+0000 7f33b88f0700 1 Processor -- start 2020-02-11T16:22:03.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b88f0700 1 -- start start 2020-02-11T16:22:03.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b88f0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:03.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b88f0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33b412e3a0 0x7f33b4133d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:03.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b88f0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b409e040 con 0x7f33b40a5de0 2020-02-11T16:22:03.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b88f0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b4133910 con 0x7f33b412e3a0 2020-02-11T16:22:03.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b88f0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4134170 con 0x7f33b40a18a0 2020-02-11T16:22:03.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b2d9d700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f33b412e3a0 msgr2=0x7f33b4133d10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:03.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b1d9b700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f33b40a5de0 legacy=0x7f33b4132c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:22:03.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b2d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33b412e3a0 0x7f33b4133d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:03.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b259c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:03.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b259c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52326/0 (socket says 172.21.15.88:52326) 2020-02-11T16:22:03.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.341+0000 7f33b259c700 1 -- 172.21.15.88:0/553097961 learned_addr learned my addr 172.21.15.88:0/553097961 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:03.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b259c700 1 -- 172.21.15.88:0/553097961 >> v2:172.21.15.88:3300/0 conn(0x7f33b412e3a0 msgr2=0x7f33b4133d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:03.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> v2:172.21.15.88:3300/0 conn(0x7f33b412e3a0 0x7f33b4133d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:03.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b259c700 1 -- 172.21.15.88:0/553097961 >> v1:172.21.15.88:6789/0 conn(0x7f33b40a5de0 legacy=0x7f33b4132c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:03.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b259c700 1 -- 172.21.15.88:0/553097961 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b4135520 con 0x7f33b40a18a0 2020-02-11T16:22:03.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:03.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33ab7fe700 1 -- 172.21.15.88:0/553097961 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f339c008d20 con 0x7f33b40a18a0 2020-02-11T16:22:03.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33ab7fe700 1 -- 172.21.15.88:0/553097961 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c008e80 con 0x7f33b40a18a0 2020-02-11T16:22:03.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33ab7fe700 1 -- 172.21.15.88:0/553097961 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f339c003900 con 0x7f33b40a18a0 2020-02-11T16:22:03.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b88f0700 1 -- 172.21.15.88:0/553097961 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b4145220 con 0x7f33b40a18a0 2020-02-11T16:22:03.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.342+0000 7f33b88f0700 1 -- 172.21.15.88:0/553097961 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b4145770 con 0x7f33b40a18a0 2020-02-11T16:22:03.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.343+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.343+0000 7f33ab7fe700 1 -- 172.21.15.88:0/553097961 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f339c003b80 con 0x7f33b40a18a0 2020-02-11T16:22:03.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.343+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.343+0000 7f33b88f0700 1 -- 172.21.15.88:0/553097961 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b4133a50 con 0x7f33b40a18a0 2020-02-11T16:22:03.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.343+0000 7f33ab7fe700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3398039c80 0x7f339803c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:03.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.343+0000 7f33ab7fe700 1 -- 172.21.15.88:0/553097961 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f339c0496b0 con 0x7f33b40a18a0 2020-02-11T16:22:03.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.343+0000 7f33b1d9b700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3398039c80 0x7f339803c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:03.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.344+0000 7f33b1d9b700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3398039c80 0x7f339803c140 crc :-1 s=READY pgs=401 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:03.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.347+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.348+0000 7f33ab7fe700 1 -- 172.21.15.88:0/553097961 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f33b4133a50 con 0x7f33b40a18a0 2020-02-11T16:22:03.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.527+0000 7f33b88f0700 1 -- 172.21.15.88:0/553097961 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f33b4133a50 con 0x7f33b40a18a0 2020-02-11T16:22:03.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.528+0000 7f33b259c700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:03.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.528+0000 7f33ab7fe700 1 -- 172.21.15.88:0/553097961 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f33b4133a50 con 0x7f33b40a18a0 2020-02-11T16:22:03.531 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:03.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.529+0000 7f33b88f0700 1 -- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3398039c80 msgr2=0x7f339803c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:03.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.529+0000 7f33b88f0700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3398039c80 0x7f339803c140 crc :-1 s=READY pgs=401 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:03.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.529+0000 7f33b88f0700 1 -- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 msgr2=0x7f33b40aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:03.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.529+0000 7f33b88f0700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f33b40a7a40 tx=0x7f339c010a40).stop 2020-02-11T16:22:03.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.529+0000 7f33b88f0700 1 -- 172.21.15.88:0/553097961 shutdown_connections 2020-02-11T16:22:03.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.529+0000 7f33b88f0700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3398039c80 0x7f339803c140 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:03.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.529+0000 7f33b88f0700 1 --2- 172.21.15.88:0/553097961 >> v2:172.21.15.88:3300/0 conn(0x7f33b412e3a0 0x7f33b4133d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:03.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.529+0000 7f33b88f0700 1 --2- 172.21.15.88:0/553097961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f33b40a18a0 0x7f33b40aac60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:03.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.529+0000 7f33b88f0700 1 -- 172.21.15.88:0/553097961 >> 172.21.15.88:0/553097961 conn(0x7f33b409d110 msgr2=0x7f33b40a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:03.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.530+0000 7f33b88f0700 1 -- 172.21.15.88:0/553097961 shutdown_connections 2020-02-11T16:22:03.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:03.530+0000 7f33b88f0700 1 -- 172.21.15.88:0/553097961 wait complete. 2020-02-11T16:22:03.541 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":128,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:06.542 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:22:06.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.657+0000 7f09b640d700 1 Processor -- start 2020-02-11T16:22:06.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.657+0000 7f09b640d700 1 -- start start 2020-02-11T16:22:06.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b640d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 0x7f09b00a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:06.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b640d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:06.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b640d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:06.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b640d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b00a1e60 con 0x7f09b00a5410 2020-02-11T16:22:06.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b640d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b00a3450 con 0x7f09b00a2fa0 2020-02-11T16:22:06.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b640d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00a4350 con 0x7f09b00a6da0 2020-02-11T16:22:06.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09affff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 msgr2=0x7f09b00a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:06.661 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09affff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 0x7f09b00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:06.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b49aa700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:06.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09a7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:06.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b49aa700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52338/0 (socket says 172.21.15.88:52338) 2020-02-11T16:22:06.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 learned_addr learned my addr 172.21.15.88:0/2989376397 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:06.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:22:06.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:06.662 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:06.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:22:06.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:06.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:06.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:06.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.658+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:06.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09affff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 msgr2=0x7f09b00a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:06.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09affff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 0x7f09b00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:22:06.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:06.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:06.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:22:06.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:06.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:06.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:22:06.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:22:06.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:06.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:06.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:06.859+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:22:07.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09affff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 msgr2=0x7f09b00a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:07.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09affff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 0x7f09b00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:22:07.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:07.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:07.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:22:07.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:07.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:07.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:22:07.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:22:07.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:07.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:07.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:07.260+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:22:08.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09affff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 msgr2=0x7f09b00a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:08.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09affff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 0x7f09b00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:22:08.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:08.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:08.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:22:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:22:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:22:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:08.061+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:22:09.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.662+0000 7f09affff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 msgr2=0x7f09b00a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:09.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.662+0000 7f09affff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 0x7f09b00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:22:09.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.663+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:09.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.663+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:09.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.663+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:22:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.663+0000 7f09b49aa700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.663+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.663+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:22:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.663+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:22:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.663+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.663+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:09.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:09.663+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:22:12.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.866+0000 7f09affff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 msgr2=0x7f09b00a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:12.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.866+0000 7f09affff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 0x7f09b00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:22:12.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:12.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:12.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 msgr2=0x7f09b0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:12.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:12.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 msgr2=0x7f09b00a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:22:12.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 0x7f09b00a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:12.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 -- 172.21.15.88:0/2989376397 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00a3a40 con 0x7f09b00a5410 2020-02-11T16:22:12.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09b49aa700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:22:12.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0998002f30 tx=0x7f099800b9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b00a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0998002f30 tx=0x7f099800b9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b00a5410 0x7f09b00a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f0998002f30 tx=0x7f099800b9f0).ready entity=mon.0 client_cookie=4b8034b26e07e724 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:12.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b00a5410 0x7f09b00a5870 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f0998002f30 tx=0x7f099800b9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b00a5410 0x7f09b00a5870 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f0998002f30 tx=0x7f099800b9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09af7fe700 1 -- 172.21.15.88:0/2989376397 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0998011be0 con 0x7f09b00a5410 2020-02-11T16:22:12.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09a7fff700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b00a5410 0x7f09b00a5870 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f0998002f30 tx=0x7f099800b9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.867+0000 7f09af7fe700 1 -- 172.21.15.88:0/2989376397 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0998011d40 con 0x7f09b00a5410 2020-02-11T16:22:12.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.868+0000 7f09af7fe700 1 -- 172.21.15.88:0/2989376397 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f099800e2f0 con 0x7f09b00a5410 2020-02-11T16:22:12.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.868+0000 7f09b640d700 1 -- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b00a5410 msgr2=0x7f09b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:12.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.868+0000 7f09b640d700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b00a5410 0x7f09b00a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f0998002f30 tx=0x7f099800b9f0).stop 2020-02-11T16:22:12.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.868+0000 7f09b640d700 1 -- 172.21.15.88:0/2989376397 shutdown_connections 2020-02-11T16:22:12.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.868+0000 7f09b640d700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a6da0 0x7f09b0131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:12.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.868+0000 7f09b640d700 1 --2- 172.21.15.88:0/2989376397 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a2fa0 0x7f09b00a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:12.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.868+0000 7f09b640d700 1 --2- 172.21.15.88:0/2989376397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09b00a5410 0x7f09b00a5870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:12.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.868+0000 7f09b640d700 1 -- 172.21.15.88:0/2989376397 >> 172.21.15.88:0/2989376397 conn(0x7f09b009d110 msgr2=0x7f09b009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:12.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.868+0000 7f09b640d700 1 -- 172.21.15.88:0/2989376397 shutdown_connections 2020-02-11T16:22:12.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.868+0000 7f09b640d700 1 -- 172.21.15.88:0/2989376397 wait complete. 2020-02-11T16:22:12.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.869+0000 7f09b640d700 1 Processor -- start 2020-02-11T16:22:12.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.870+0000 7f09b640d700 1 -- start start 2020-02-11T16:22:12.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.870+0000 7f09b640d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:12.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.870+0000 7f09b640d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b01321f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:12.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.870+0000 7f09b640d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09b00a6da0 0x7f09b0134290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:12.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.870+0000 7f09b640d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b01353a0 con 0x7f09b00a5410 2020-02-11T16:22:12.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.870+0000 7f09b640d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b0062150 con 0x7f09b00a6da0 2020-02-11T16:22:12.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.870+0000 7f09b640d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0132650 con 0x7f09b00a2fa0 2020-02-11T16:22:12.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.870+0000 7f09b49aa700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f09b00a6da0 msgr2=0x7f09b0134290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:12.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.870+0000 7f09b49aa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09b00a6da0 0x7f09b0134290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:12.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:12.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09a7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b01321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:12.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52370/0 (socket says 172.21.15.88:52370) 2020-02-11T16:22:12.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 -- 172.21.15.88:0/656601759 learned_addr learned my addr 172.21.15.88:0/656601759 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:12.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09a7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b01321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44034/0 (socket says 172.21.15.88:44034) 2020-02-11T16:22:12.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 -- 172.21.15.88:0/656601759 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a6da0 msgr2=0x7f09b0134290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:12.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a6da0 0x7f09b0134290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:12.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 -- 172.21.15.88:0/656601759 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 msgr2=0x7f09b01321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:12.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b01321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:12.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 -- 172.21.15.88:0/656601759 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00a1690 con 0x7f09b00a2fa0 2020-02-11T16:22:12.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09a7fff700 1 --2- 172.21.15.88:0/656601759 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b01321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:22:12.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:12.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09adffb700 1 -- 172.21.15.88:0/656601759 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a000e960 con 0x7f09b00a2fa0 2020-02-11T16:22:12.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09adffb700 1 -- 172.21.15.88:0/656601759 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a000eac0 con 0x7f09b00a2fa0 2020-02-11T16:22:12.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09b640d700 1 -- 172.21.15.88:0/656601759 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b01332d0 con 0x7f09b00a2fa0 2020-02-11T16:22:12.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09adffb700 1 -- 172.21.15.88:0/656601759 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a0012110 con 0x7f09b00a2fa0 2020-02-11T16:22:12.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.871+0000 7f09b640d700 1 -- 172.21.15.88:0/656601759 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b01346f0 con 0x7f09b00a2fa0 2020-02-11T16:22:12.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.872+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.872+0000 7f09adffb700 1 -- 172.21.15.88:0/656601759 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f09a000a220 con 0x7f09b00a2fa0 2020-02-11T16:22:12.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.872+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.873+0000 7f09adffb700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039c40 0x7f099403c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:12.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.873+0000 7f09adffb700 1 -- 172.21.15.88:0/656601759 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f09a000f0c0 con 0x7f09b00a2fa0 2020-02-11T16:22:12.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.873+0000 7f09b640d700 1 -- 172.21.15.88:0/656601759 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b0134900 con 0x7f09b00a2fa0 2020-02-11T16:22:12.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.873+0000 7f09a7fff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039c40 0x7f099403c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:12.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.873+0000 7f09a7fff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039c40 0x7f099403c100 crc :-1 s=READY pgs=402 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:12.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.877+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:12.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:12.877+0000 7f09adffb700 1 -- 172.21.15.88:0/656601759 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f09a002f460 con 0x7f09b00a2fa0 2020-02-11T16:22:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.062+0000 7f09b640d700 1 -- 172.21.15.88:0/656601759 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f09b00565b0 con 0x7f09b00a2fa0 2020-02-11T16:22:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.063+0000 7f09affff700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.063+0000 7f09adffb700 1 -- 172.21.15.88:0/656601759 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f09a0031f70 con 0x7f09b00a2fa0 2020-02-11T16:22:13.065 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":132,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 -- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039c40 msgr2=0x7f099403c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039c40 0x7f099403c100 crc :-1 s=READY pgs=402 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 -- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 msgr2=0x7f09b0061cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f09a0000b20 tx=0x7f09a0010ab0).stop 2020-02-11T16:22:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 -- 172.21.15.88:0/656601759 shutdown_connections 2020-02-11T16:22:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 --2- 172.21.15.88:0/656601759 >> v2:172.21.15.88:3300/0 conn(0x7f09b00a6da0 0x7f09b0134290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09b00a2fa0 0x7f09b0061cf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 --2- 172.21.15.88:0/656601759 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0994039c40 0x7f099403c100 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 --2- 172.21.15.88:0/656601759 >> v2:172.21.15.52:3300/0 conn(0x7f09b00a5410 0x7f09b01321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 -- 172.21.15.88:0/656601759 >> 172.21.15.88:0/656601759 conn(0x7f09b009d110 msgr2=0x7f09b0137550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 -- 172.21.15.88:0/656601759 shutdown_connections 2020-02-11T16:22:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.065+0000 7f09b640d700 1 -- 172.21.15.88:0/656601759 wait complete. 2020-02-11T16:22:13.076 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":132,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:13.076 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:22:13.077 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:22:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.180+0000 7fa226ee4700 1 Processor -- start 2020-02-11T16:22:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.180+0000 7fa226ee4700 1 -- start start 2020-02-11T16:22:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa226ee4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa226ee4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2200a6260 0x7fa22012eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa226ee4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2200a3570 con 0x7fa2200a5de0 2020-02-11T16:22:13.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa226ee4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2200a3810 con 0x7fa2200a6260 2020-02-11T16:22:13.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa226ee4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200a3ab0 con 0x7fa2200a18a0 2020-02-11T16:22:13.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa21ffff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa2200a5de0 legacy=0x7fa22012e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:22:13.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa225481700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa2200a6260 msgr2=0x7fa22012eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:13.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa225481700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2200a6260 0x7fa22012eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:13.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa224c80700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:13.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa224c80700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52380/0 (socket says 172.21.15.88:52380) 2020-02-11T16:22:13.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.181+0000 7fa224c80700 1 -- 172.21.15.88:0/3049758967 learned_addr learned my addr 172.21.15.88:0/3049758967 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:13.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa224c80700 1 -- 172.21.15.88:0/3049758967 >> v2:172.21.15.88:3300/0 conn(0x7fa2200a6260 msgr2=0x7fa22012eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:22:13.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa224c80700 1 --2- 172.21.15.88:0/3049758967 >> v2:172.21.15.88:3300/0 conn(0x7fa2200a6260 0x7fa22012eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:13.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa224c80700 1 -- 172.21.15.88:0/3049758967 >> v1:172.21.15.88:6789/0 conn(0x7fa2200a5de0 legacy=0x7fa22012e3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:22:13.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa224c80700 1 -- 172.21.15.88:0/3049758967 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2200a3d50 con 0x7fa2200a18a0 2020-02-11T16:22:13.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa224c80700 1 --2- 172.21.15.88:0/3049758967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa22005b910 tx=0x7fa2100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa224c80700 1 --2- 172.21.15.88:0/3049758967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa22005b910 tx=0x7fa2100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa224c80700 1 --2- 172.21.15.88:0/3049758967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fa22005b910 tx=0x7fa2100088e0).ready entity=mon.2 client_cookie=84c74cea5dfa4d61 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:13.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa224c80700 1 --2- 172.21.15.88:0/3049758967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fa22005b910 tx=0x7fa2100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa21f7fe700 1 -- 172.21.15.88:0/3049758967 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa210008e20 con 0x7fa2200a18a0 2020-02-11T16:22:13.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa224c80700 1 --2- 172.21.15.88:0/3049758967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fa22005b910 tx=0x7fa2100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa224c80700 1 --2- 172.21.15.88:0/3049758967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fa22005b910 tx=0x7fa2100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa21f7fe700 1 -- 172.21.15.88:0/3049758967 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2100118d0 con 0x7fa2200a18a0 2020-02-11T16:22:13.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa21f7fe700 1 -- 172.21.15.88:0/3049758967 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa210011c70 con 0x7fa2200a18a0 2020-02-11T16:22:13.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa226ee4700 1 -- 172.21.15.88:0/3049758967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 msgr2=0x7fa2200a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.182+0000 7fa226ee4700 1 --2- 172.21.15.88:0/3049758967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fa22005b910 tx=0x7fa2100088e0).stop 2020-02-11T16:22:13.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.183+0000 7fa226ee4700 1 -- 172.21.15.88:0/3049758967 shutdown_connections 2020-02-11T16:22:13.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.183+0000 7fa226ee4700 1 --2- 172.21.15.88:0/3049758967 >> v2:172.21.15.88:3300/0 conn(0x7fa2200a6260 0x7fa22012eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:13.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.183+0000 7fa226ee4700 1 --2- 172.21.15.88:0/3049758967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa2200a6dd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.183+0000 7fa226ee4700 1 -- 172.21.15.88:0/3049758967 >> 172.21.15.88:0/3049758967 conn(0x7fa22009d110 msgr2=0x7fa22009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:13.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.183+0000 7fa226ee4700 1 -- 172.21.15.88:0/3049758967 shutdown_connections 2020-02-11T16:22:13.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.183+0000 7fa226ee4700 1 -- 172.21.15.88:0/3049758967 wait complete. 2020-02-11T16:22:13.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.183+0000 7fa226ee4700 1 Processor -- start 2020-02-11T16:22:13.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.183+0000 7fa226ee4700 1 -- start start 2020-02-11T16:22:13.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.184+0000 7fa226ee4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:13.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.184+0000 7fa226ee4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2200a5de0 0x7fa2201386f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:13.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.184+0000 7fa226ee4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2201303a0 con 0x7fa2200a6260 2020-02-11T16:22:13.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.184+0000 7fa226ee4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa220130640 con 0x7fa2200a5de0 2020-02-11T16:22:13.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.184+0000 7fa226ee4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2201308e0 con 0x7fa2200a18a0 2020-02-11T16:22:13.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.184+0000 7fa225481700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa2200a6260 legacy=0x7fa220142e70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:22:13.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.184+0000 7fa21ffff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa2200a5de0 msgr2=0x7fa2201386f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:13.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.184+0000 7fa21ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2200a5de0 0x7fa2201386f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:13.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.184+0000 7fa224c80700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:13.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.184+0000 7fa224c80700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52384/0 (socket says 172.21.15.88:52384) 2020-02-11T16:22:13.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 -- 172.21.15.88:0/737864160 learned_addr learned my addr 172.21.15.88:0/737864160 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:13.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 -- 172.21.15.88:0/737864160 >> v2:172.21.15.88:3300/0 conn(0x7fa2200a5de0 msgr2=0x7fa2201386f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:13.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 --2- 172.21.15.88:0/737864160 >> v2:172.21.15.88:3300/0 conn(0x7fa2200a5de0 0x7fa2201386f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 -- 172.21.15.88:0/737864160 >> v1:172.21.15.88:6789/0 conn(0x7fa2200a6260 legacy=0x7fa220142e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:13.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 -- 172.21.15.88:0/737864160 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220131020 con 0x7fa2200a18a0 2020-02-11T16:22:13.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa220130f00 tx=0x7fa2200a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa220130f00 tx=0x7fa2200a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fa220130f00 tx=0x7fa2200a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa220130f00 tx=0x7fa2200a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa210007ed0 con 0x7fa2200a18a0 2020-02-11T16:22:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa220130f00 tx=0x7fa2200a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210007340 con 0x7fa2200a18a0 2020-02-11T16:22:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa226ee4700 1 -- 172.21.15.88:0/737864160 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa220143580 con 0x7fa2200a18a0 2020-02-11T16:22:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa224c80700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa220130f00 tx=0x7fa2200a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2100056c0 con 0x7fa2200a18a0 2020-02-11T16:22:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.185+0000 7fa226ee4700 1 -- 172.21.15.88:0/737864160 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa220135860 con 0x7fa2200a18a0 2020-02-11T16:22:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.186+0000 7fa224c80700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa220130f00 tx=0x7fa2200a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.186+0000 7fa226ee4700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 0x7fa220138b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.186+0000 7fa226ee4700 1 -- 172.21.15.88:0/737864160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22005e2f0 con 0x7fa220130a50 2020-02-11T16:22:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.186+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa210005900 con 0x7fa2200a18a0 2020-02-11T16:22:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.186+0000 7fa224c80700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa220130f00 tx=0x7fa2200a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.186+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 0x7fa220138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.186+0000 7fa21dffb700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa200039b10 0x7fa20003bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.186+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa21004a2a0 con 0x7fa2200a18a0 2020-02-11T16:22:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.186+0000 7fa225481700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa200039b10 0x7fa20003bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.186+0000 7fa21ffff700 1 -- 172.21.15.88:0/737864160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2200565b0 con 0x7fa220130a50 2020-02-11T16:22:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 0x7fa220138b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 0x7fa220138b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 0x7fa220138b50 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:13.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa225481700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa200039b10 0x7fa20003bfd0 crc :-1 s=READY pgs=403 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:13.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 0x7fa220138b50 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa214007550 con 0x7fa220130a50 2020-02-11T16:22:13.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 0x7fa220138b50 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.203 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa2140076b0 con 0x7fa220130a50 2020-02-11T16:22:13.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 msgr2=0x7fa220138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21dffb700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 0x7fa220138b50 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).stop 2020-02-11T16:22:13.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 msgr2=0x7fa220138b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:13.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.187+0000 7fa21dffb700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa220130a50 0x7fa220138b50 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).stop 2020-02-11T16:22:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.195+0000 7fa226ee4700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 0x7fa220129170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.195+0000 7fa226ee4700 1 -- 172.21.15.88:0/737864160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa220130780 con 0x7fa2200a89d0 2020-02-11T16:22:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.195+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 0x7fa220129170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.196+0000 7fa21ffff700 1 -- 172.21.15.88:0/737864160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa22005ccb0 con 0x7fa2200a89d0 2020-02-11T16:22:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.196+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 0x7fa220129170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.196+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 0x7fa220129170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.196+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 0x7fa220129170 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.196+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 0x7fa220129170 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.196+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa21400f480 con 0x7fa2200a89d0 2020-02-11T16:22:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa21ffff700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 0x7fa220129170 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4011 (secure 0 0 0) 0x7fa21400f5e0 con 0x7fa2200a89d0 2020-02-11T16:22:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 msgr2=0x7fa220129170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa21dffb700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 0x7fa220129170 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).stop 2020-02-11T16:22:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa21dffb700 1 -- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 msgr2=0x7fa220129170 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa21dffb700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2200a89d0 0x7fa220129170 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0x7fa214003480 tx=0x7fa214010900).stop 2020-02-11T16:22:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa226ee4700 1 -- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa200039b10 msgr2=0x7fa20003bfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa226ee4700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa200039b10 0x7fa20003bfd0 crc :-1 s=READY pgs=403 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa226ee4700 1 -- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 msgr2=0x7fa220135240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa226ee4700 1 --2- 172.21.15.88:0/737864160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2200a18a0 0x7fa220135240 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fa220130f00 tx=0x7fa2200a1c80).stop 2020-02-11T16:22:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa225481700 1 -- 172.21.15.88:0/737864160 reap_dead start 2020-02-11T16:22:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa225481700 1 -- 172.21.15.88:0/737864160 reap_dead start 2020-02-11T16:22:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa226ee4700 1 -- 172.21.15.88:0/737864160 shutdown_connections 2020-02-11T16:22:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa226ee4700 1 -- 172.21.15.88:0/737864160 >> 172.21.15.88:0/737864160 conn(0x7fa22009d110 msgr2=0x7fa2200a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa226ee4700 1 -- 172.21.15.88:0/737864160 shutdown_connections 2020-02-11T16:22:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.197+0000 7fa226ee4700 1 -- 172.21.15.88:0/737864160 wait complete. 2020-02-11T16:22:13.211 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:22:13.211 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:13.212 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:13.212 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:22:13.212 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 132, 2020-02-11T16:22:13.212 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:22:13.212 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:22:13.212 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:22:13.212 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.213 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:22:13.213 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:13.213 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:22:13.213 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:22:13.213 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:13.213 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:13.213 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:13.214 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:13.214 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:13.214 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:13.214 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.214 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:22:13.215 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:22:13.215 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:13.215 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:13.215 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:13.215 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:13.215 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:13.215 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:13.215 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.216 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:22:13.216 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:22:13.216 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:22:13.217 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:22:13.217 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:22:13.217 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:22:13.217 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:13.217 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:13.218 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:22:13.218 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:22:13.218 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:13.218 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:22:13.218 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:13.218 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:13.218 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:13.218 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:13.219 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:13.219 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:13.219 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.219 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:22:13.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.219 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:22:13.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.220 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:13.220 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:13.220 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:13.220 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:13.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.220 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:13.220 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:22:13.221 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.221 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:13.221 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:22:13.222 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.222 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.222 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.222 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:22:13.223 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:22:13.223 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:13.223 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:13.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.223 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:22:13.224 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:22:13.224 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:13.224 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:13.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.224 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:13.224 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:22:13.225 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.225 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:13.225 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:22:13.225 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.226 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.226 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.226 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:22:13.226 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:22:13.227 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:13.227 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:13.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.227 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:13.228 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:13.228 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:13.228 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:13.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.228 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:13.228 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:22:13.228 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.229 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:13.229 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:22:13.229 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.229 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.229 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.230 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:22:13.230 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:22:13.230 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:13.230 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:13.230 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.230 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.231 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:22:13.231 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:22:13.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.231 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:13.231 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:13.231 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:22:13.232 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.232 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.233 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:22:13.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.233 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:13.233 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:13.233 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:22:13.233 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.233 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.234 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:22:13.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.234 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:13.234 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:13.234 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:22:13.234 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.234 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.235 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.235 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:22:13.236 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:22:13.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.340+0000 7f8f90270700 1 Processor -- start 2020-02-11T16:22:13.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.340+0000 7f8f90270700 1 -- start start 2020-02-11T16:22:13.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.340+0000 7f8f90270700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 0x7f8f880a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:13.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f90270700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f880a31b0 con 0x7f8f880a18a0 2020-02-11T16:22:13.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f90270700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f880a3570 con 0x7f8f88134a50 2020-02-11T16:22:13.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f90270700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880a3810 con 0x7f8f880a5de0 2020-02-11T16:22:13.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8e80d700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f8f88134a50 legacy=0x7f8f88134ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:22:13.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8d80b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 0x7f8f880a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:13.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8e00c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8f880a18a0 0x7f8f880a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37480/0 (socket says 172.21.15.88:37480) 2020-02-11T16:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8e00c700 1 -- 172.21.15.88:0/4193127339 learned_addr learned my addr 172.21.15.88:0/4193127339 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8d00a700 1 -- 172.21.15.88:0/4193127339 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389771636 0 0) 0x7f8f880a31b0 con 0x7f8f880a18a0 2020-02-11T16:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8d80b700 1 -- 172.21.15.88:0/4193127339 >> v1:172.21.15.88:6789/0 conn(0x7f8f88134a50 legacy=0x7f8f88134ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8d80b700 1 -- 172.21.15.88:0/4193127339 >> v1:172.21.15.52:6789/0 conn(0x7f8f880a18a0 legacy=0x7f8f880a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8d80b700 1 -- 172.21.15.88:0/4193127339 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880a3ab0 con 0x7f8f880a5de0 2020-02-11T16:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/4193127339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 0x7f8f880a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8f880a7ba0 tx=0x7f8f840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/4193127339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 0x7f8f880a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8f880a7ba0 tx=0x7f8f840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/4193127339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 0x7f8f880a6260 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f8f880a7ba0 tx=0x7f8f840088e0).ready entity=mon.2 client_cookie=5adce90e4f1f2d7e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.341+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/4193127339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 0x7f8f880a6260 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f8f880a7ba0 tx=0x7f8f840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f8d00a700 1 -- 172.21.15.88:0/4193127339 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f84008e40 con 0x7f8f880a5de0 2020-02-11T16:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/4193127339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 0x7f8f880a6260 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f8f880a7ba0 tx=0x7f8f840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f8d00a700 1 -- 172.21.15.88:0/4193127339 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f84011660 con 0x7f8f880a5de0 2020-02-11T16:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/4193127339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 0x7f8f880a6260 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f8f880a7ba0 tx=0x7f8f840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f8d00a700 1 -- 172.21.15.88:0/4193127339 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f84011a40 con 0x7f8f880a5de0 2020-02-11T16:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f90270700 1 -- 172.21.15.88:0/4193127339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 msgr2=0x7f8f880a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f90270700 1 --2- 172.21.15.88:0/4193127339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 0x7f8f880a6260 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f8f880a7ba0 tx=0x7f8f840088e0).stop 2020-02-11T16:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f90270700 1 -- 172.21.15.88:0/4193127339 shutdown_connections 2020-02-11T16:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f90270700 1 --2- 172.21.15.88:0/4193127339 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880a5de0 0x7f8f880a6260 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f90270700 1 -- 172.21.15.88:0/4193127339 >> 172.21.15.88:0/4193127339 conn(0x7f8f8809d110 msgr2=0x7f8f8809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f90270700 1 -- 172.21.15.88:0/4193127339 shutdown_connections 2020-02-11T16:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.342+0000 7f8f90270700 1 -- 172.21.15.88:0/4193127339 wait complete. 2020-02-11T16:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.343+0000 7f8f90270700 1 Processor -- start 2020-02-11T16:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.343+0000 7f8f90270700 1 -- start start 2020-02-11T16:22:13.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.343+0000 7f8f90270700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f880a5de0 0x7f8f8805aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.343+0000 7f8f90270700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f88134a50 0x7f8f88128260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f90270700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f881367a0 con 0x7f8f880a18a0 2020-02-11T16:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8e00c700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f8f880a18a0 legacy=0x7f8f88131620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f90270700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880a9e40 con 0x7f8f880a5de0 2020-02-11T16:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f90270700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f88136ea0 con 0x7f8f88134a50 2020-02-11T16:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8e80d700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f8f88134a50 msgr2=0x7f8f88128260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8e80d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f88134a50 0x7f8f88128260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8d80b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f880a5de0 0x7f8f8805aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8d80b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f880a5de0 0x7f8f8805aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44064/0 (socket says 172.21.15.88:44064) 2020-02-11T16:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8d80b700 1 -- 172.21.15.88:0/1981340250 learned_addr learned my addr 172.21.15.88:0/1981340250 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8d80b700 1 -- 172.21.15.88:0/1981340250 >> v2:172.21.15.88:3300/0 conn(0x7f8f88134a50 msgr2=0x7f8f88128260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/1981340250 >> v2:172.21.15.88:3300/0 conn(0x7f8f88134a50 0x7f8f88128260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8d80b700 1 -- 172.21.15.88:0/1981340250 >> v1:172.21.15.88:6789/0 conn(0x7f8f880a18a0 legacy=0x7f8f88131620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:13.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8d80b700 1 -- 172.21.15.88:0/1981340250 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88135bc0 con 0x7f8f880a5de0 2020-02-11T16:22:13.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/1981340250 >> v2:172.21.15.52:3300/0 conn(0x7f8f880a5de0 0x7f8f8805aa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f8805b720 tx=0x7f8f8812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/1981340250 >> v2:172.21.15.52:3300/0 conn(0x7f8f880a5de0 0x7f8f8805aa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f8805b720 tx=0x7f8f8812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.344+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880a5de0 0x7f8f8805aa90 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f8f8805b720 tx=0x7f8f8812f3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:13.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880a5de0 0x7f8f8805aa90 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8f8805b720 tx=0x7f8f8812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f84011b00 con 0x7f8f880a5de0 2020-02-11T16:22:13.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880a5de0 0x7f8f8805aa90 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8f8805b720 tx=0x7f8f8812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880a5de0 0x7f8f8805aa90 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8f8805b720 tx=0x7f8f8812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8400f830 con 0x7f8f880a5de0 2020-02-11T16:22:13.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f8400b830 con 0x7f8f880a5de0 2020-02-11T16:22:13.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f90270700 1 -- 172.21.15.88:0/1981340250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f88136a60 con 0x7f8f880a5de0 2020-02-11T16:22:13.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f90270700 1 -- 172.21.15.88:0/1981340250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f88131d30 con 0x7f8f880a5de0 2020-02-11T16:22:13.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880a5de0 0x7f8f8805aa90 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8f8805b720 tx=0x7f8f8812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8f8400ba70 con 0x7f8f880a5de0 2020-02-11T16:22:13.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f90270700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 0x7f8f881286c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:13.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f90270700 1 -- 172.21.15.88:0/1981340250 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8805e2f0 con 0x7f8f880aa050 2020-02-11T16:22:13.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.345+0000 7f8f8d80b700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880a5de0 0x7f8f8805aa90 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8f8805b720 tx=0x7f8f8812f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f777fe700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f68039b90 0x7f8f6803c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:13.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 0x7f8f881286c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:13.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8f8404a180 con 0x7f8f880a5de0 2020-02-11T16:22:13.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f8e80d700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f68039b90 0x7f8f6803c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:13.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f8e00c700 1 -- 172.21.15.88:0/1981340250 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f88136c00 con 0x7f8f880aa050 2020-02-11T16:22:13.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 0x7f8f881286c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 0x7f8f881286c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 0x7f8f881286c0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:13.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f8e80d700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f68039b90 0x7f8f6803c050 crc :-1 s=READY pgs=404 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:13.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 0x7f8f881286c0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.346+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f780059a0 con 0x7f8f880aa050 2020-02-11T16:22:13.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.347+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 0x7f8f881286c0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.347+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8f78005b00 con 0x7f8f880aa050 2020-02-11T16:22:13.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.347+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 msgr2=0x7f8f881286c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.347+0000 7f8f777fe700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 0x7f8f881286c0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).stop 2020-02-11T16:22:13.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.347+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 msgr2=0x7f8f881286c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:13.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.347+0000 7f8f777fe700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f880aa050 0x7f8f881286c0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).stop 2020-02-11T16:22:13.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.354+0000 7f8f90270700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 0x7f8f881294e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:13.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.354+0000 7f8f90270700 1 -- 172.21.15.88:0/1981340250 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880565b0 con 0x7f8f881290d0 2020-02-11T16:22:13.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.355+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 0x7f8f881294e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:13.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.355+0000 7f8f8e00c700 1 -- 172.21.15.88:0/1981340250 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8f880a72c0 con 0x7f8f881290d0 2020-02-11T16:22:13.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.355+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 0x7f8f881294e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.355+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 0x7f8f881294e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.355+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 0x7f8f881294e0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:13.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.355+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 0x7f8f881294e0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.355+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f78011440 con 0x7f8f881290d0 2020-02-11T16:22:13.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f8e00c700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 0x7f8f881294e0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:13.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f8f780115a0 con 0x7f8f881290d0 2020-02-11T16:22:13.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 msgr2=0x7f8f881294e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f777fe700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 0x7f8f881294e0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).stop 2020-02-11T16:22:13.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f777fe700 1 -- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 msgr2=0x7f8f881294e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:13.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f777fe700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f881290d0 0x7f8f881294e0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0x7f8f780010d0 tx=0x7f8f78010960).stop 2020-02-11T16:22:13.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f90270700 1 -- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f68039b90 msgr2=0x7f8f6803c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f90270700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f68039b90 0x7f8f6803c050 crc :-1 s=READY pgs=404 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f90270700 1 -- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880a5de0 msgr2=0x7f8f8805aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:13.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f90270700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880a5de0 0x7f8f8805aa90 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f8f8805b720 tx=0x7f8f8812f3b0).stop 2020-02-11T16:22:13.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f8e80d700 1 -- 172.21.15.88:0/1981340250 reap_dead start 2020-02-11T16:22:13.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f8e80d700 1 -- 172.21.15.88:0/1981340250 reap_dead start 2020-02-11T16:22:13.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f90270700 1 -- 172.21.15.88:0/1981340250 shutdown_connections 2020-02-11T16:22:13.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f90270700 1 --2- 172.21.15.88:0/1981340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880a5de0 0x7f8f8805aa90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:13.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f90270700 1 -- 172.21.15.88:0/1981340250 >> 172.21.15.88:0/1981340250 conn(0x7f8f8809d110 msgr2=0x7f8f88069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:13.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f90270700 1 -- 172.21.15.88:0/1981340250 shutdown_connections 2020-02-11T16:22:13.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:13.356+0000 7f8f90270700 1 -- 172.21.15.88:0/1981340250 wait complete. 2020-02-11T16:22:13.369 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:22:13.369 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:13.369 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:13.370 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:22:13.370 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 132, 2020-02-11T16:22:13.370 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:22:13.370 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:22:13.370 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:22:13.370 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.371 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2020-02-11T16:22:13.371 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:13.371 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:22:13.371 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:22:13.371 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:13.371 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:13.371 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:13.371 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:13.372 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:13.372 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:13.372 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.372 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:22:13.372 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:22:13.372 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:13.372 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:13.373 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:13.373 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:13.373 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:13.373 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:13.373 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.373 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:22:13.374 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:22:13.374 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:22:13.374 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:22:13.374 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:22:13.374 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:22:13.375 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:13.375 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:13.375 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:22:13.375 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:22:13.375 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:13.375 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:22:13.375 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:13.375 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:13.376 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:13.376 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:13.376 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:13.376 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:13.376 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.376 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:22:13.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.377 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:22:13.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.377 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:13.378 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:13.378 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:13.378 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:13.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.378 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:13.378 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:22:13.378 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.379 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:13.379 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:22:13.379 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.379 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.379 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.380 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:22:13.380 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:22:13.380 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:13.380 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:13.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.381 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:22:13.381 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:22:13.381 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:13.381 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:13.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.381 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:13.381 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:22:13.382 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.382 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:13.382 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:22:13.382 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.383 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.383 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.383 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:22:13.383 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:22:13.383 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:13.383 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:13.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.384 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:13.384 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:13.384 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:13.386 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:13.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.386 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:13.386 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:22:13.386 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.387 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:13.388 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:22:13.388 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:13.388 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.388 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.388 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:22:13.389 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:22:13.389 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:13.389 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:13.389 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.389 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:13.389 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:22:13.390 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:22:13.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.390 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:13.390 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:13.390 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:22:13.390 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.390 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.390 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:22:13.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.391 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:13.391 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:13.391 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:22:13.391 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.391 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.391 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:22:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:22:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:22:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:22:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:22:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:13.394 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:13.394 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:13.394 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:22:13.394 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.394 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:13.394 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:13.394 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:22:13.396 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:22:14.614 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:22:14.617 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:22:33.397 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:22:33.397 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:22:33.397 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:22:33.397 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:22:33.399 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:22:33.400 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:22:33.400 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:22:33.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.517+0000 7fed91663700 1 Processor -- start 2020-02-11T16:22:33.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.517+0000 7fed91663700 1 -- start start 2020-02-11T16:22:33.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed91663700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed8c05fac0 0x7fed8c134b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:33.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed91663700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:33.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed91663700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c0a48a0 con 0x7fed8c0a7230 2020-02-11T16:22:33.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed91663700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c0a3c70 con 0x7fed8c05fac0 2020-02-11T16:22:33.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed91663700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0a4fa0 con 0x7fed8c0a2720 2020-02-11T16:22:33.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8b7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:33.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8affd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed8c05fac0 0x7fed8c134b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:33.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8b7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52422/0 (socket says 172.21.15.88:52422) 2020-02-11T16:22:33.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8b7fe700 1 -- 172.21.15.88:0/1980249182 learned_addr learned my addr 172.21.15.88:0/1980249182 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:33.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8b7fe700 1 -- 172.21.15.88:0/1980249182 >> v2:172.21.15.52:3300/0 conn(0x7fed8c05fac0 msgr2=0x7fed8c134b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:33.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/1980249182 >> v2:172.21.15.52:3300/0 conn(0x7fed8c05fac0 0x7fed8c134b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:33.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8b7fe700 1 -- 172.21.15.88:0/1980249182 >> v1:172.21.15.52:6789/0 conn(0x7fed8c0a7230 legacy=0x7fed8c0a2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8b7fe700 1 -- 172.21.15.88:0/1980249182 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0a4d70 con 0x7fed8c0a2720 2020-02-11T16:22:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8affd700 1 --2- 172.21.15.88:0/1980249182 >> v2:172.21.15.52:3300/0 conn(0x7fed8c05fac0 0x7fed8c134b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:22:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/1980249182 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed840032b0 tx=0x7fed84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/1980249182 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed840032b0 tx=0x7fed84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.518+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/1980249182 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed84008c60).ready entity=mon.2 client_cookie=6f7ce65023f73dba server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:33.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/1980249182 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed89ffb700 1 -- 172.21.15.88:0/1980249182 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8400a160 con 0x7fed8c0a2720 2020-02-11T16:22:33.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/1980249182 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/1980249182 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed84008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed89ffb700 1 -- 172.21.15.88:0/1980249182 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8400a2c0 con 0x7fed8c0a2720 2020-02-11T16:22:33.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed89ffb700 1 -- 172.21.15.88:0/1980249182 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8400a6a0 con 0x7fed8c0a2720 2020-02-11T16:22:33.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed91663700 1 -- 172.21.15.88:0/1980249182 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 msgr2=0x7fed8c134f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:33.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed91663700 1 --2- 172.21.15.88:0/1980249182 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed84008c60).stop 2020-02-11T16:22:33.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed91663700 1 -- 172.21.15.88:0/1980249182 shutdown_connections 2020-02-11T16:22:33.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed91663700 1 --2- 172.21.15.88:0/1980249182 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed8c0a2720 0x7fed8c134f80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:33.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed91663700 1 --2- 172.21.15.88:0/1980249182 >> v2:172.21.15.52:3300/0 conn(0x7fed8c05fac0 0x7fed8c134b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:33.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed91663700 1 -- 172.21.15.88:0/1980249182 >> 172.21.15.88:0/1980249182 conn(0x7fed8c0a7a70 msgr2=0x7fed8c0a7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:33.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed91663700 1 -- 172.21.15.88:0/1980249182 shutdown_connections 2020-02-11T16:22:33.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.519+0000 7fed91663700 1 -- 172.21.15.88:0/1980249182 wait complete. 2020-02-11T16:22:33.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.520+0000 7fed91663700 1 Processor -- start 2020-02-11T16:22:33.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.520+0000 7fed91663700 1 -- start start 2020-02-11T16:22:33.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed91663700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed8c05fac0 0x7fed8c061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:33.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed91663700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed8c0a7230 0x7fed8c065c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:33.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed91663700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c0a0880 con 0x7fed8c0a2720 2020-02-11T16:22:33.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed91663700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c0a1c70 con 0x7fed8c0a7230 2020-02-11T16:22:33.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed91663700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c09f400 con 0x7fed8c05fac0 2020-02-11T16:22:33.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed8c05fac0 0x7fed8c061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:33.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed8c05fac0 0x7fed8c061be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58100/0 (socket says 172.21.15.88:58100) 2020-02-11T16:22:33.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8affd700 1 -- 172.21.15.88:0/3512226207 learned_addr learned my addr 172.21.15.88:0/3512226207 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:33.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8affd700 1 -- 172.21.15.88:0/3512226207 >> v2:172.21.15.88:3300/0 conn(0x7fed8c05fac0 msgr2=0x7fed8c061be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:22:33.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8affd700 1 -- 172.21.15.88:0/3512226207 >> v2:172.21.15.88:3300/0 conn(0x7fed8c05fac0 msgr2=0x7fed8c061be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:22:33.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> v2:172.21.15.52:3300/0 conn(0x7fed8c0a7230 0x7fed8c065c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:33.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8affd700 1 --2- 172.21.15.88:0/3512226207 >> v2:172.21.15.88:3300/0 conn(0x7fed8c05fac0 0x7fed8c061be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:33.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8affd700 1 --2- 172.21.15.88:0/3512226207 >> v2:172.21.15.88:3300/0 conn(0x7fed8c05fac0 0x7fed8c061be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:33.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8b7fe700 1 -- 172.21.15.88:0/3512226207 >> v2:172.21.15.88:3300/0 conn(0x7fed8c05fac0 msgr2=0x7fed8c061be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:33.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> v2:172.21.15.88:3300/0 conn(0x7fed8c05fac0 0x7fed8c061be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:33.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8b7fe700 1 -- 172.21.15.88:0/3512226207 >> v1:172.21.15.52:6789/0 conn(0x7fed8c0a2720 legacy=0x7fed8c065540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:33.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8b7fe700 1 -- 172.21.15.88:0/3512226207 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c066240 con 0x7fed8c0a7230 2020-02-11T16:22:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> v2:172.21.15.52:3300/0 conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> v2:172.21.15.52:3300/0 conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.521+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.522+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.522+0000 7fed7bfff700 1 -- 172.21.15.88:0/3512226207 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed84010590 con 0x7fed8c0a7230 2020-02-11T16:22:33.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.522+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.522+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.522+0000 7fed7bfff700 1 -- 172.21.15.88:0/3512226207 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed84005c30 con 0x7fed8c0a7230 2020-02-11T16:22:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.522+0000 7fed91663700 1 -- 172.21.15.88:0/3512226207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c09f100 con 0x7fed8c0a7230 2020-02-11T16:22:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.522+0000 7fed7bfff700 1 -- 172.21.15.88:0/3512226207 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed84005e60 con 0x7fed8c0a7230 2020-02-11T16:22:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.522+0000 7fed91663700 1 -- 172.21.15.88:0/3512226207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c0615e0 con 0x7fed8c0a7230 2020-02-11T16:22:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.522+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.523+0000 7fed91663700 1 -- 172.21.15.88:0/3512226207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c0565b0 con 0x7fed8c0a7230 2020-02-11T16:22:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.523+0000 7fed7bfff700 1 -- 172.21.15.88:0/3512226207 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fed84007340 con 0x7fed8c0a7230 2020-02-11T16:22:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.523+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.523+0000 7fed7bfff700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed68039cf0 0x7fed6803c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:33.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.523+0000 7fed7bfff700 1 -- 172.21.15.88:0/3512226207 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fed8404a560 con 0x7fed8c0a7230 2020-02-11T16:22:33.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.523+0000 7fed8affd700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed68039cf0 0x7fed6803c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:33.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.523+0000 7fed8affd700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed68039cf0 0x7fed6803c1b0 crc :-1 s=READY pgs=406 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:33.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.527+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.527+0000 7fed7bfff700 1 -- 172.21.15.88:0/3512226207 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fed8402fc00 con 0x7fed8c0a7230 2020-02-11T16:22:33.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.737+0000 7fed91663700 1 -- 172.21.15.88:0/3512226207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fed8c05cb20 con 0x7fed8c0a7230 2020-02-11T16:22:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.737+0000 7fed8b7fe700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.737+0000 7fed7bfff700 1 -- 172.21.15.88:0/3512226207 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7fed84032710 con 0x7fed8c0a7230 2020-02-11T16:22:33.740 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":132,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 -- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed68039cf0 msgr2=0x7fed6803c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed68039cf0 0x7fed6803c1b0 crc :-1 s=READY pgs=406 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 -- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 msgr2=0x7fed8c065c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 0x7fed8c065c50 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fed840032b0 tx=0x7fed8c0a5110).stop 2020-02-11T16:22:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 -- 172.21.15.88:0/3512226207 shutdown_connections 2020-02-11T16:22:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed68039cf0 0x7fed6803c1b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 --2- 172.21.15.88:0/3512226207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed8c0a7230 0x7fed8c065c50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 --2- 172.21.15.88:0/3512226207 >> v2:172.21.15.88:3300/0 conn(0x7fed8c05fac0 0x7fed8c061be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 -- 172.21.15.88:0/3512226207 >> 172.21.15.88:0/3512226207 conn(0x7fed8c0a7a70 msgr2=0x7fed8c0a7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 -- 172.21.15.88:0/3512226207 shutdown_connections 2020-02-11T16:22:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:33.739+0000 7fed91663700 1 -- 172.21.15.88:0/3512226207 wait complete. 2020-02-11T16:22:33.752 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":132,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:36.753 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:22:36.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.866+0000 7f327d8d2700 1 Processor -- start 2020-02-11T16:22:36.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.866+0000 7f327d8d2700 1 -- start start 2020-02-11T16:22:36.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f327d8d2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:36.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f327d8d2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:36.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f327d8d2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3278138360 con 0x7f327813b290 2020-02-11T16:22:36.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f327d8d2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3278138180 con 0x7f3278131f50 2020-02-11T16:22:36.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f327d8d2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3278138600 con 0x7f327813b6f0 2020-02-11T16:22:36.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f32777fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:36.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f3276ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:36.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f32777fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52448/0 (socket says 172.21.15.88:52448) 2020-02-11T16:22:36.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 learned_addr learned my addr 172.21.15.88:0/147355792 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:36.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f3276ffd700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:22:36.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f3276ffd700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:36.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:22:36.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:36.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:36.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:36.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:36.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:36.867+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:37.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.068+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:37.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.068+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:37.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.068+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:22:37.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.068+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:37.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.068+0000 7f3276ffd700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:22:37.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.068+0000 7f3276ffd700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:37.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.068+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:37.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.068+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:37.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.068+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:22:37.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.068+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:22:37.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.469+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:37.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.469+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:37.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.469+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:22:37.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.469+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:37.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.469+0000 7f3276ffd700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:22:37.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.469+0000 7f3276ffd700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:37.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.469+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:37.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.469+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:37.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.469+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:22:37.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:37.469+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:22:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:38.270+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:38.270+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:38.270+0000 7f3276ffd700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:22:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:38.270+0000 7f3276ffd700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:38.270+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:38.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:38.270+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:22:38.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:38.270+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:38.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:38.270+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:22:38.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:38.270+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:38.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:38.270+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:39.872+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:39.872+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:39.872+0000 7f3276ffd700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:39.872+0000 7f3276ffd700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:39.872+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:39.872+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:39.872+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:39.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:39.872+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:39.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:39.872+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:22:39.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:39.872+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:22:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.517+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714212771 0 0) 0x7f3278138360 con 0x7f327813b290 2020-02-11T16:22:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.517+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f325c003230 con 0x7f327813b290 2020-02-11T16:22:41.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.539+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 572884795 0 0) 0x7f325c003230 con 0x7f327813b290 2020-02-11T16:22:41.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.539+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 msgr2=0x7f3278142630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:22:41.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.539+0000 7f3275ffb700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327813b6f0 0x7f3278142630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.539+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 msgr2=0x7f327805f900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:22:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.539+0000 7f3275ffb700 1 --2- 172.21.15.88:0/147355792 >> v2:172.21.15.52:3300/0 conn(0x7f3278131f50 0x7f327805f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.539+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327809d8b0 con 0x7f327813b290 2020-02-11T16:22:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.539+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f326c0016d0 con 0x7f327813b290 2020-02-11T16:22:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.539+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 >> v1:172.21.15.52:6789/0 conn(0x7f327813b290 legacy=0x7f327809d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.539+0000 7f3275ffb700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f325c003720 0x7f325c003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f3275ffb700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f325c003f60 0x7f325c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f3275ffb700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f325c004980 0x7f325c004e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3278138180 con 0x7f325c003f60 2020-02-11T16:22:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3278138600 con 0x7f325c004980 2020-02-11T16:22:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c00b720 con 0x7f325c003720 2020-02-11T16:22:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f325c004980 0x7f325c004e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f3276ffd700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f325c003720 0x7f325c003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f32767fc700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f325c003f60 0x7f325c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f325c003720 msgr2=0x7f325c003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f325c003720 0x7f325c003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f325c003f60 msgr2=0x7f325c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f325c003f60 0x7f325c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c003230 con 0x7f325c004980 2020-02-11T16:22:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f325c004980 0x7f325c004e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f32700032b0 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f325c004980 0x7f325c004e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f32700032b0 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.540+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f325c004980 0x7f325c004e00 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f32700032b0 tx=0x7f3270010410).ready entity=mon.1 client_cookie=e9ca30660b3c405 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.541+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f325c004980 0x7f325c004e00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f32700032b0 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.541+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3270005c30 con 0x7f325c004980 2020-02-11T16:22:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.541+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f325c004980 0x7f325c004e00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f32700032b0 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.541+0000 7f32777fe700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f325c004980 0x7f325c004e00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f32700032b0 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.541+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270005d90 con 0x7f325c004980 2020-02-11T16:22:41.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.541+0000 7f3275ffb700 1 -- 172.21.15.88:0/147355792 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32700112b0 con 0x7f325c004980 2020-02-11T16:22:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.541+0000 7f327d8d2700 1 -- 172.21.15.88:0/147355792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f325c004980 msgr2=0x7f325c004e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.541+0000 7f327d8d2700 1 --2- 172.21.15.88:0/147355792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f325c004980 0x7f325c004e00 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f32700032b0 tx=0x7f3270010410).stop 2020-02-11T16:22:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.542+0000 7f32777fe700 1 -- 172.21.15.88:0/147355792 reap_dead start 2020-02-11T16:22:41.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.542+0000 7f327d8d2700 1 -- 172.21.15.88:0/147355792 shutdown_connections 2020-02-11T16:22:41.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.542+0000 7f327d8d2700 1 -- 172.21.15.88:0/147355792 >> 172.21.15.88:0/147355792 conn(0x7f32780a7bb0 msgr2=0x7f32780a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:41.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.542+0000 7f327d8d2700 1 -- 172.21.15.88:0/147355792 shutdown_connections 2020-02-11T16:22:41.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.542+0000 7f327d8d2700 1 -- 172.21.15.88:0/147355792 wait complete. 2020-02-11T16:22:41.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.543+0000 7f327d8d2700 1 Processor -- start 2020-02-11T16:22:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f327d8d2700 1 -- start start 2020-02-11T16:22:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f327d8d2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f327813a3b0 0x7f3278148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f327d8d2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3278137880 0x7f327812ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f327d8d2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f327d8d2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32780a4810 con 0x7f3278137880 2020-02-11T16:22:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f327d8d2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32780a4a70 con 0x7f327813a3b0 2020-02-11T16:22:41.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f327d8d2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32780a4d10 con 0x7f327812f380 2020-02-11T16:22:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f3276ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f327813a3b0 0x7f3278148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f3276ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f327813a3b0 0x7f3278148470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58144/0 (socket says 172.21.15.88:58144) 2020-02-11T16:22:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f3276ffd700 1 -- 172.21.15.88:0/338942432 learned_addr learned my addr 172.21.15.88:0/338942432 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f32767fc700 1 --2- 172.21.15.88:0/338942432 >> v2:172.21.15.52:3300/0 conn(0x7f3278137880 0x7f327812ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f3276ffd700 1 -- 172.21.15.88:0/338942432 >> v2:172.21.15.88:3300/0 conn(0x7f327813a3b0 msgr2=0x7f3278148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:22:41.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f3276ffd700 1 -- 172.21.15.88:0/338942432 >> v2:172.21.15.88:3300/0 conn(0x7f327813a3b0 msgr2=0x7f3278148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:22:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f3276ffd700 1 --2- 172.21.15.88:0/338942432 >> v2:172.21.15.88:3300/0 conn(0x7f327813a3b0 0x7f3278148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:22:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.544+0000 7f3276ffd700 1 --2- 172.21.15.88:0/338942432 >> v2:172.21.15.88:3300/0 conn(0x7f327813a3b0 0x7f3278148470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:22:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 -- 172.21.15.88:0/338942432 >> v2:172.21.15.88:3300/0 conn(0x7f327813a3b0 msgr2=0x7f3278148470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:22:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> v2:172.21.15.88:3300/0 conn(0x7f327813a3b0 0x7f3278148470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 -- 172.21.15.88:0/338942432 >> v2:172.21.15.52:3300/0 conn(0x7f3278137880 msgr2=0x7f327812ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> v2:172.21.15.52:3300/0 conn(0x7f3278137880 0x7f327812ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 -- 172.21.15.88:0/338942432 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327813ace0 con 0x7f327812f380 2020-02-11T16:22:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32767fc700 1 --2- 172.21.15.88:0/338942432 >> v2:172.21.15.52:3300/0 conn(0x7f3278137880 0x7f327812ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:22:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f3267fff700 1 -- 172.21.15.88:0/338942432 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3270005ea0 con 0x7f327812f380 2020-02-11T16:22:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f3267fff700 1 -- 172.21.15.88:0/338942432 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327000f3e0 con 0x7f327812f380 2020-02-11T16:22:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f3267fff700 1 -- 172.21.15.88:0/338942432 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f327000f740 con 0x7f327812f380 2020-02-11T16:22:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f327d8d2700 1 -- 172.21.15.88:0/338942432 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327812fc40 con 0x7f327812f380 2020-02-11T16:22:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.545+0000 7f327d8d2700 1 -- 172.21.15.88:0/338942432 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3278148a90 con 0x7f327812f380 2020-02-11T16:22:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.546+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.546+0000 7f3267fff700 1 -- 172.21.15.88:0/338942432 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3270007f80 con 0x7f327812f380 2020-02-11T16:22:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.546+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.546+0000 7f3267fff700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3254039cf0 0x7f325403c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.546+0000 7f3267fff700 1 -- 172.21.15.88:0/338942432 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3270049c30 con 0x7f327812f380 2020-02-11T16:22:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.546+0000 7f3276ffd700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3254039cf0 0x7f325403c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.546+0000 7f327d8d2700 1 -- 172.21.15.88:0/338942432 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32780565b0 con 0x7f327812f380 2020-02-11T16:22:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.547+0000 7f3276ffd700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3254039cf0 0x7f325403c1b0 crc :-1 s=READY pgs=407 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.550+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.550+0000 7f3267fff700 1 -- 172.21.15.88:0/338942432 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f327002f3b0 con 0x7f327812f380 2020-02-11T16:22:41.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.765+0000 7f327d8d2700 1 -- 172.21.15.88:0/338942432 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f32780a4e80 con 0x7f327812f380 2020-02-11T16:22:41.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.765+0000 7f32777fe700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.765+0000 7f3267fff700 1 -- 172.21.15.88:0/338942432 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f3270031de0 con 0x7f327812f380 2020-02-11T16:22:41.768 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 -- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3254039cf0 msgr2=0x7f325403c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3254039cf0 0x7f325403c1b0 crc :-1 s=READY pgs=407 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 -- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 msgr2=0x7f327812f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f3278061690 tx=0x7f3270010410).stop 2020-02-11T16:22:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 -- 172.21.15.88:0/338942432 shutdown_connections 2020-02-11T16:22:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f327812f380 0x7f327812f7e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 --2- 172.21.15.88:0/338942432 >> v2:172.21.15.88:3300/0 conn(0x7f327813a3b0 0x7f3278148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 --2- 172.21.15.88:0/338942432 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3254039cf0 0x7f325403c1b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 --2- 172.21.15.88:0/338942432 >> v2:172.21.15.52:3300/0 conn(0x7f3278137880 0x7f327812ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 -- 172.21.15.88:0/338942432 >> 172.21.15.88:0/338942432 conn(0x7f32780a7bb0 msgr2=0x7f32780a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 -- 172.21.15.88:0/338942432 shutdown_connections 2020-02-11T16:22:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.767+0000 7f327d8d2700 1 -- 172.21.15.88:0/338942432 wait complete. 2020-02-11T16:22:41.780 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":140,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:41.780 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:22:41.780 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:22:41.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.897+0000 7f2fabfff700 1 Processor -- start 2020-02-11T16:22:41.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.897+0000 7f2fabfff700 1 -- start start 2020-02-11T16:22:41.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.897+0000 7f2fabfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2fac05ec50 0x7f2fac143a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:41.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2fabfff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fac0a8a70 con 0x7f2fac0a37f0 2020-02-11T16:22:41.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2fabfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fac05b3f0 con 0x7f2fac0a7e40 2020-02-11T16:22:41.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2fabfff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fac0a7a50 con 0x7f2fac05ec50 2020-02-11T16:22:41.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2faa7fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2fac0a7e40 0x7f2fac05ace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45780/0 (socket says 172.21.15.88:45780) 2020-02-11T16:22:41.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2faa7fc700 1 -- 172.21.15.88:0/4168290376 learned_addr learned my addr 172.21.15.88:0/4168290376 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:22:41.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2fab7fe700 1 --2- 172.21.15.88:0/4168290376 >> v2:172.21.15.52:3300/0 conn(0x7f2fac05ec50 0x7f2fac143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2fab7fe700 1 -- 172.21.15.88:0/4168290376 >> v1:172.21.15.88:6789/0 conn(0x7f2fac0a7e40 legacy=0x7f2fac05ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2fab7fe700 1 -- 172.21.15.88:0/4168290376 >> v1:172.21.15.52:6789/0 conn(0x7f2fac0a37f0 legacy=0x7f2fac05a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2fab7fe700 1 -- 172.21.15.88:0/4168290376 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac060080 con 0x7f2fac05ec50 2020-02-11T16:22:41.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2fab7fe700 1 --2- 172.21.15.88:0/4168290376 >> v2:172.21.15.52:3300/0 conn(0x7f2fac05ec50 0x7f2fac143a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2fac0a7680 tx=0x7f2fa4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2fab7fe700 1 --2- 172.21.15.88:0/4168290376 >> v2:172.21.15.52:3300/0 conn(0x7f2fac05ec50 0x7f2fac143a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2fac0a7680 tx=0x7f2fa4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.898+0000 7f2fab7fe700 1 --2- 172.21.15.88:0/4168290376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac143a60 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f2fac0a7680 tx=0x7f2fa4008c60).ready entity=mon.0 client_cookie=4d5a56ac167867a9 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:41.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.899+0000 7f2fab7fe700 1 --2- 172.21.15.88:0/4168290376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac143a60 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f2fac0a7680 tx=0x7f2fa4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.899+0000 7f2fa9ffb700 1 -- 172.21.15.88:0/4168290376 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa400a160 con 0x7f2fac05ec50 2020-02-11T16:22:41.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.899+0000 7f2fab7fe700 1 --2- 172.21.15.88:0/4168290376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac143a60 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f2fac0a7680 tx=0x7f2fa4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.899+0000 7f2fab7fe700 1 --2- 172.21.15.88:0/4168290376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac143a60 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f2fac0a7680 tx=0x7f2fa4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.899+0000 7f2fa9ffb700 1 -- 172.21.15.88:0/4168290376 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa400a2c0 con 0x7f2fac05ec50 2020-02-11T16:22:41.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.899+0000 7f2fa9ffb700 1 -- 172.21.15.88:0/4168290376 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa400a6a0 con 0x7f2fac05ec50 2020-02-11T16:22:41.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.899+0000 7f2fabfff700 1 -- 172.21.15.88:0/4168290376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 msgr2=0x7f2fac143a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.899+0000 7f2fabfff700 1 --2- 172.21.15.88:0/4168290376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac143a60 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f2fac0a7680 tx=0x7f2fa4008c60).stop 2020-02-11T16:22:41.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.900+0000 7f2fabfff700 1 -- 172.21.15.88:0/4168290376 shutdown_connections 2020-02-11T16:22:41.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.900+0000 7f2fabfff700 1 --2- 172.21.15.88:0/4168290376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac143a60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.900+0000 7f2fabfff700 1 -- 172.21.15.88:0/4168290376 >> 172.21.15.88:0/4168290376 conn(0x7f2fac0ac1c0 msgr2=0x7f2fac0ac5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:41.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.900+0000 7f2fabfff700 1 -- 172.21.15.88:0/4168290376 shutdown_connections 2020-02-11T16:22:41.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.900+0000 7f2fabfff700 1 -- 172.21.15.88:0/4168290376 wait complete. 2020-02-11T16:22:41.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.900+0000 7f2fabfff700 1 Processor -- start 2020-02-11T16:22:41.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.901+0000 7f2fabfff700 1 -- start start 2020-02-11T16:22:41.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.901+0000 7f2fabfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2fac05ec50 0x7f2fac145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:41.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.901+0000 7f2fabfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2fac0a7e40 0x7f2fac145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:41.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.901+0000 7f2fabfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fac0a1c80 con 0x7f2fac0a37f0 2020-02-11T16:22:41.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.901+0000 7f2fabfff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fac09c2a0 con 0x7f2fac05ec50 2020-02-11T16:22:41.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.901+0000 7f2fabfff700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac0a0010 con 0x7f2fac0a7e40 2020-02-11T16:22:41.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.901+0000 7f2faa7fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2fac0a37f0 0x7f2fac13b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45786/0 (socket says 172.21.15.88:45786) 2020-02-11T16:22:41.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.901+0000 7f2faa7fc700 1 -- 172.21.15.88:0/776838363 learned_addr learned my addr 172.21.15.88:0/776838363 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:22:41.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.901+0000 7f2faaffd700 1 --2- 172.21.15.88:0/776838363 >> v2:172.21.15.52:3300/0 conn(0x7f2fac05ec50 0x7f2fac145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.901+0000 7f2fab7fe700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2fac0a7e40 0x7f2fac145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2faaffd700 1 -- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2fac0a7e40 msgr2=0x7f2fac145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2faaffd700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2fac0a7e40 0x7f2fac145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2faaffd700 1 -- 172.21.15.88:0/776838363 >> v1:172.21.15.88:6789/0 conn(0x7f2fac0a37f0 legacy=0x7f2fac13b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2faaffd700 1 -- 172.21.15.88:0/776838363 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0a2220 con 0x7f2fac05ec50 2020-02-11T16:22:41.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2faaffd700 1 --2- 172.21.15.88:0/776838363 >> v2:172.21.15.52:3300/0 conn(0x7f2fac05ec50 0x7f2fac145b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2fac060660 tx=0x7f2f9c0108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2faaffd700 1 --2- 172.21.15.88:0/776838363 >> v2:172.21.15.52:3300/0 conn(0x7f2fac05ec50 0x7f2fac145b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2fac060660 tx=0x7f2f9c0108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2faaffd700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac145b70 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f2fac060660 tx=0x7f2f9c0108b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:41.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2faaffd700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac145b70 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f2fac060660 tx=0x7f2f9c0108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f9c006bc0 con 0x7f2fac05ec50 2020-02-11T16:22:41.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2faaffd700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac145b70 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f2fac060660 tx=0x7f2f9c0108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2faaffd700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac145b70 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f2fac060660 tx=0x7f2f9c0108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c006d60 con 0x7f2fac05ec50 2020-02-11T16:22:41.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2fabfff700 1 -- 172.21.15.88:0/776838363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fac0a1eb0 con 0x7f2fac05ec50 2020-02-11T16:22:41.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f9c0110d0 con 0x7f2fac05ec50 2020-02-11T16:22:41.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.902+0000 7f2fabfff700 1 -- 172.21.15.88:0/776838363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fac13d970 con 0x7f2fac05ec50 2020-02-11T16:22:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2faaffd700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac145b70 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f2fac060660 tx=0x7f2f9c0108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2fabfff700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 0x7f2fac13bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2fabfff700 1 -- 172.21.15.88:0/776838363 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac13b9c0 con 0x7f2fac09ef90 2020-02-11T16:22:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2f9c011340 con 0x7f2fac05ec50 2020-02-11T16:22:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2faaffd700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac145b70 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f2fac060660 tx=0x7f2f9c0108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 0x7f2fac13bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2f9bfff700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2f88039cc0 0x7f2f8803c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f2f9c049ab0 con 0x7f2fac05ec50 2020-02-11T16:22:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2faa7fc700 1 -- 172.21.15.88:0/776838363 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fac0a2730 con 0x7f2fac09ef90 2020-02-11T16:22:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 0x7f2fac13bbc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 0x7f2fac13bbc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 0x7f2fac13bbc0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.903+0000 7f2fab7fe700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2f88039cc0 0x7f2f8803c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.904+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 0x7f2fac13bbc0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.904+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa000c950 con 0x7f2fac09ef90 2020-02-11T16:22:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.904+0000 7f2fab7fe700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2f88039cc0 0x7f2f8803c180 crc :-1 s=READY pgs=408 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.904+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 0x7f2fac13bbc0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.904+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f2fa000cab0 con 0x7f2fac09ef90 2020-02-11T16:22:41.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.904+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 msgr2=0x7f2fac13bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.904+0000 7f2f9bfff700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 0x7f2fac13bbc0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).stop 2020-02-11T16:22:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.904+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 msgr2=0x7f2fac13bbc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.904+0000 7f2f9bfff700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09ef90 0x7f2fac13bbc0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).stop 2020-02-11T16:22:41.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2fabfff700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 0x7f2fac09cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:41.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2fabfff700 1 -- 172.21.15.88:0/776838363 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac0a2040 con 0x7f2fac09cae0 2020-02-11T16:22:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 0x7f2fac09cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2faa7fc700 1 -- 172.21.15.88:0/776838363 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2fac0565b0 con 0x7f2fac09cae0 2020-02-11T16:22:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 0x7f2fac09cef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 0x7f2fac09cef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 0x7f2fac09cef0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 0x7f2fac09cef0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa00143e0 con 0x7f2fac09cae0 2020-02-11T16:22:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2faa7fc700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 0x7f2fac09cef0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.913+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f2fa0014540 con 0x7f2fac09cae0 2020-02-11T16:22:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 msgr2=0x7f2fac09cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2f9bfff700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 0x7f2fac09cef0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).stop 2020-02-11T16:22:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2f9bfff700 1 -- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 msgr2=0x7f2fac09cef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2f9bfff700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fac09cae0 0x7f2fac09cef0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0x7f2fac0a4010 tx=0x7f2fa00013d0).stop 2020-02-11T16:22:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fabfff700 1 -- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2f88039cc0 msgr2=0x7f2f8803c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fabfff700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2f88039cc0 0x7f2f8803c180 crc :-1 s=READY pgs=408 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fabfff700 1 -- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 msgr2=0x7f2fac145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fabfff700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac145b70 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f2fac060660 tx=0x7f2f9c0108b0).stop 2020-02-11T16:22:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fab7fe700 1 -- 172.21.15.88:0/776838363 reap_dead start 2020-02-11T16:22:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fab7fe700 1 -- 172.21.15.88:0/776838363 reap_dead start 2020-02-11T16:22:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fabfff700 1 -- 172.21.15.88:0/776838363 shutdown_connections 2020-02-11T16:22:41.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fabfff700 1 --2- 172.21.15.88:0/776838363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fac05ec50 0x7f2fac145b70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:41.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fabfff700 1 -- 172.21.15.88:0/776838363 >> 172.21.15.88:0/776838363 conn(0x7f2fac0ac1c0 msgr2=0x7f2fac0ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:41.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fabfff700 1 -- 172.21.15.88:0/776838363 shutdown_connections 2020-02-11T16:22:41.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:41.914+0000 7f2fabfff700 1 -- 172.21.15.88:0/776838363 wait complete. 2020-02-11T16:22:41.922 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:22:41.922 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:22:41.922 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:22:41.922 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:22:41.923 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 140, 2020-02-11T16:22:41.923 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:22:41.923 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:22:41.923 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:22:41.923 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:22:41.923 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:41.923 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:22:41.923 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:41.924 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:22:41.924 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:22:41.924 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:41.924 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:41.924 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:41.924 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:41.924 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:41.925 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:41.925 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:41.925 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:22:41.925 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:22:41.925 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:41.925 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:41.925 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:41.926 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:41.926 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:41.926 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:41.926 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:41.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.926 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:22:41.927 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:22:41.927 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:22:41.927 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:22:41.927 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:22:41.927 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:22:41.927 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:41.927 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:41.928 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:22:41.928 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:22:41.929 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:41.929 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:22:41.929 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:41.930 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:41.930 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:41.930 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:41.930 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:41.930 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:41.930 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:41.931 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:22:41.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.931 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:22:41.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.931 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:41.931 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:41.931 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:41.932 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:41.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.932 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:41.932 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:22:41.932 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:41.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:41.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:22:41.933 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:41.933 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:41.933 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:41.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:22:41.934 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:22:41.934 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:41.934 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:41.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.934 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:22:41.934 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:22:41.935 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:41.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:41.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:41.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:22:41.935 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:41.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.936 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:41.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:22:41.936 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:41.936 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:41.936 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:41.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.937 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:22:41.937 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:22:41.937 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:41.937 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:41.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.938 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:41.938 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:41.938 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:41.938 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:41.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.938 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:41.938 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:22:41.938 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:41.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.939 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:41.939 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:22:41.939 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:41.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:41.939 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:41.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.940 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:22:41.940 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:22:41.940 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:41.940 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:41.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:41.940 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:41.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:41.941 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:22:41.941 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:22:41.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.941 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:41.941 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:41.942 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:22:41.942 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:41.942 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:41.942 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:22:41.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:41.942 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:41.943 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:41.943 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:22:41.943 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:41.943 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:41.943 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:41.944 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:22:41.945 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:22:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.083+0000 7f68227b8700 1 Processor -- start 2020-02-11T16:22:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.083+0000 7f68227b8700 1 -- start start 2020-02-11T16:22:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f68227b8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f681c0a73d0 0x7f681c0a2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f68227b8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f681c13b8f0 0x7f681c142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f68227b8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681c0a2cd0 con 0x7f681c0a6ff0 2020-02-11T16:22:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f68227b8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681c132460 con 0x7f681c0a73d0 2020-02-11T16:22:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f68227b8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681c0a8630 con 0x7f681c13b8f0 2020-02-11T16:22:42.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f6820d55700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f681c13b8f0 0x7f681c142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f6820d55700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f681c13b8f0 0x7f681c142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58174/0 (socket says 172.21.15.88:58174) 2020-02-11T16:22:42.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f6820d55700 1 -- 172.21.15.88:0/190710748 learned_addr learned my addr 172.21.15.88:0/190710748 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:42.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f681bfff700 1 --1- 172.21.15.88:0/190710748 >> v1:172.21.15.88:6789/0 conn(0x7f681c0a6ff0 0x7f681c13b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45796/0 (socket says 172.21.15.88:45796) 2020-02-11T16:22:42.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f681b7fe700 1 --2- 172.21.15.88:0/190710748 >> v2:172.21.15.52:3300/0 conn(0x7f681c0a73d0 0x7f681c0a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f6820d55700 1 -- 172.21.15.88:0/190710748 >> v2:172.21.15.52:3300/0 conn(0x7f681c0a73d0 msgr2=0x7f681c0a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:42.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f6820d55700 1 --2- 172.21.15.88:0/190710748 >> v2:172.21.15.52:3300/0 conn(0x7f681c0a73d0 0x7f681c0a2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f6820d55700 1 -- 172.21.15.88:0/190710748 >> v1:172.21.15.88:6789/0 conn(0x7f681c0a6ff0 legacy=0x7f681c13b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.084+0000 7f6820d55700 1 -- 172.21.15.88:0/190710748 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c0a30c0 con 0x7f681c13b8f0 2020-02-11T16:22:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f6820d55700 1 --2- 172.21.15.88:0/190710748 >> v2:172.21.15.88:3300/0 conn(0x7f681c13b8f0 0x7f681c142580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68140032b0 tx=0x7f6814007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f6820d55700 1 --2- 172.21.15.88:0/190710748 >> v2:172.21.15.88:3300/0 conn(0x7f681c13b8f0 0x7f681c142580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68140032b0 tx=0x7f6814007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f6820d55700 1 --2- 172.21.15.88:0/190710748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f681c13b8f0 0x7f681c142580 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f68140032b0 tx=0x7f6814007dc0).ready entity=mon.1 client_cookie=4ebcf2d072e03922 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f6820d55700 1 --2- 172.21.15.88:0/190710748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f681c13b8f0 0x7f681c142580 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f68140032b0 tx=0x7f6814007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f681affd700 1 -- 172.21.15.88:0/190710748 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f681400a160 con 0x7f681c13b8f0 2020-02-11T16:22:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f6820d55700 1 --2- 172.21.15.88:0/190710748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f681c13b8f0 0x7f681c142580 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f68140032b0 tx=0x7f6814007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f681affd700 1 -- 172.21.15.88:0/190710748 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681400a2c0 con 0x7f681c13b8f0 2020-02-11T16:22:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f6820d55700 1 --2- 172.21.15.88:0/190710748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f681c13b8f0 0x7f681c142580 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f68140032b0 tx=0x7f6814007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f681affd700 1 -- 172.21.15.88:0/190710748 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f681400a660 con 0x7f681c13b8f0 2020-02-11T16:22:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f68227b8700 1 -- 172.21.15.88:0/190710748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f681c13b8f0 msgr2=0x7f681c142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f68227b8700 1 --2- 172.21.15.88:0/190710748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f681c13b8f0 0x7f681c142580 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f68140032b0 tx=0x7f6814007dc0).stop 2020-02-11T16:22:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f68227b8700 1 -- 172.21.15.88:0/190710748 shutdown_connections 2020-02-11T16:22:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f68227b8700 1 --2- 172.21.15.88:0/190710748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f681c13b8f0 0x7f681c142580 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f68227b8700 1 --2- 172.21.15.88:0/190710748 >> v2:172.21.15.52:3300/0 conn(0x7f681c0a73d0 0x7f681c0a2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f68227b8700 1 -- 172.21.15.88:0/190710748 >> 172.21.15.88:0/190710748 conn(0x7f681c0ac2d0 msgr2=0x7f681c0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f68227b8700 1 -- 172.21.15.88:0/190710748 shutdown_connections 2020-02-11T16:22:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.085+0000 7f68227b8700 1 -- 172.21.15.88:0/190710748 wait complete. 2020-02-11T16:22:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.086+0000 7f68227b8700 1 Processor -- start 2020-02-11T16:22:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.086+0000 7f68227b8700 1 -- start start 2020-02-11T16:22:42.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f68227b8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f68227b8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f681c13b8f0 0x7f681c12c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f68227b8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681c135f10 con 0x7f681c0a6ff0 2020-02-11T16:22:42.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f68227b8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681c137050 con 0x7f681c13b8f0 2020-02-11T16:22:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f68227b8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681c136150 con 0x7f681c0a73d0 2020-02-11T16:22:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f681bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f681c0a6ff0 0x7f681c136940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45802/0 (socket says 172.21.15.88:45802) 2020-02-11T16:22:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f681bfff700 1 -- 172.21.15.88:0/929839960 learned_addr learned my addr 172.21.15.88:0/929839960 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:22:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f681b7fe700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f6820d55700 1 --2- 172.21.15.88:0/929839960 >> v2:172.21.15.52:3300/0 conn(0x7f681c13b8f0 0x7f681c12c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345702305 0 0) 0x7f681c0a2cd0 con 0x7f681c0a6ff0 2020-02-11T16:22:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.087+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67fc002fe0 con 0x7f681c0a6ff0 2020-02-11T16:22:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f681b7fe700 1 -- 172.21.15.88:0/929839960 >> v2:172.21.15.52:3300/0 conn(0x7f681c13b8f0 msgr2=0x7f681c12c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f681b7fe700 1 --2- 172.21.15.88:0/929839960 >> v2:172.21.15.52:3300/0 conn(0x7f681c13b8f0 0x7f681c12c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f681b7fe700 1 -- 172.21.15.88:0/929839960 >> v1:172.21.15.88:6789/0 conn(0x7f681c0a6ff0 legacy=0x7f681c136940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3676736982 0 0) 0x7f67fc002fe0 con 0x7f681c0a6ff0 2020-02-11T16:22:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f681b7fe700 1 -- 172.21.15.88:0/929839960 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c05ab80 con 0x7f681c0a73d0 2020-02-11T16:22:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f681b7fe700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f680c001a50 tx=0x7f6810010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f6820d55700 1 --2- 172.21.15.88:0/929839960 >> v2:172.21.15.52:3300/0 conn(0x7f681c13b8f0 0x7f681c12c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:22:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f681b7fe700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f680c001a50 tx=0x7f6810010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f681b7fe700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f680c001a50 tx=0x7f6810010b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f681b7fe700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f680c001a50 tx=0x7f6810010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f681b7fe700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f680c001a50 tx=0x7f6810010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f680c0018b0 con 0x7f681c0a73d0 2020-02-11T16:22:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f681b7fe700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f680c001a50 tx=0x7f6810010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6810005ca0 con 0x7f681c0a73d0 2020-02-11T16:22:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f68227b8700 1 -- 172.21.15.88:0/929839960 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681c05ae20 con 0x7f681c0a73d0 2020-02-11T16:22:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6810007160 con 0x7f681c0a73d0 2020-02-11T16:22:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.088+0000 7f68227b8700 1 -- 172.21.15.88:0/929839960 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681c05b2c0 con 0x7f681c0a73d0 2020-02-11T16:22:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.089+0000 7f681b7fe700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f680c001a50 tx=0x7f6810010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.089+0000 7f68227b8700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 0x7f681c12cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.089+0000 7f68227b8700 1 -- 172.21.15.88:0/929839960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c0a67b0 con 0x7f681c12f710 2020-02-11T16:22:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.089+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f68100073d0 con 0x7f681c0a73d0 2020-02-11T16:22:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.089+0000 7f681b7fe700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f680c001a50 tx=0x7f6810010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.089+0000 7f68197fa700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f67fc039f50 0x7f67fc03c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.089+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 0x7f681c12cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.089+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6810049630 con 0x7f681c0a73d0 2020-02-11T16:22:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.089+0000 7f6820d55700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f67fc039f50 0x7f67fc03c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f681bfff700 1 -- 172.21.15.88:0/929839960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f681c05b020 con 0x7f681c12f710 2020-02-11T16:22:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 0x7f681c12cb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 0x7f681c12cb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f6820d55700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f67fc039f50 0x7f67fc03c410 crc :-1 s=READY pgs=409 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 0x7f681c12cb70 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 0x7f681c12cb70 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f680c012e50 con 0x7f681c12f710 2020-02-11T16:22:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 0x7f681c12cb70 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f680c007f10 con 0x7f681c12f710 2020-02-11T16:22:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 msgr2=0x7f681c12cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f68197fa700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 0x7f681c12cb70 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).stop 2020-02-11T16:22:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 msgr2=0x7f681c12cb70 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.090+0000 7f68197fa700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c12f710 0x7f681c12cb70 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).stop 2020-02-11T16:22:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.100+0000 7f68227b8700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 0x7f681c0aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.100+0000 7f68227b8700 1 -- 172.21.15.88:0/929839960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c05e2f0 con 0x7f681c0aa0e0 2020-02-11T16:22:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.100+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 0x7f681c0aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.100+0000 7f681bfff700 1 -- 172.21.15.88:0/929839960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f681c0565b0 con 0x7f681c0aa0e0 2020-02-11T16:22:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 0x7f681c0aa4f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 0x7f681c0aa4f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 0x7f681c0aa4f0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 0x7f681c0aa4f0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f680c005aa0 con 0x7f681c0aa0e0 2020-02-11T16:22:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f681bfff700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 0x7f681c0aa4f0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4022 (secure 0 0 0) 0x7f680c005c00 con 0x7f681c0aa0e0 2020-02-11T16:22:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 msgr2=0x7f681c0aa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f68197fa700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 0x7f681c0aa4f0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f680c000fa0 tx=0x7f680c011410).stop 2020-02-11T16:22:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f68197fa700 1 -- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 msgr2=0x7f681c0aa4f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f68197fa700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c0aa0e0 0x7f681c0aa4f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f68227b8700 1 -- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f67fc039f50 msgr2=0x7f67fc03c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f68227b8700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f67fc039f50 0x7f67fc03c410 crc :-1 s=READY pgs=409 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f68227b8700 1 -- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 msgr2=0x7f681c135ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f68227b8700 1 --2- 172.21.15.88:0/929839960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f681c0a73d0 0x7f681c135ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f680c001a50 tx=0x7f6810010b90).stop 2020-02-11T16:22:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f6820d55700 1 -- 172.21.15.88:0/929839960 reap_dead start 2020-02-11T16:22:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.101+0000 7f6820d55700 1 -- 172.21.15.88:0/929839960 reap_dead start 2020-02-11T16:22:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.102+0000 7f68227b8700 1 -- 172.21.15.88:0/929839960 shutdown_connections 2020-02-11T16:22:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.102+0000 7f68227b8700 1 -- 172.21.15.88:0/929839960 >> 172.21.15.88:0/929839960 conn(0x7f681c0ac2d0 msgr2=0x7f681c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.102+0000 7f68227b8700 1 -- 172.21.15.88:0/929839960 shutdown_connections 2020-02-11T16:22:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.102+0000 7f68227b8700 1 -- 172.21.15.88:0/929839960 wait complete. 2020-02-11T16:22:42.110 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:22:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:22:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 140, 2020-02-11T16:22:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:22:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:22:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:22:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:22:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:22:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:22:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:22:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:22:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:22:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:22:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:22:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:22:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:22:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:22:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:22:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:22:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:22:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:22:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:22:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:22:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:22:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:22:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:22:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:22:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:22:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:22:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:22:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:22:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:22:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:22:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.124 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:42.124 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:42.124 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:42.124 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:42.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.124 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:42.124 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:22:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:22:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:22:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:22:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.127 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.127 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:22:42.127 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:22:42.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.127 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:42.127 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:22:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:22:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:22:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:22:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:22:42.130 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.130 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.130 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.130 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:22:42.131 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:22:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.244+0000 7f592feed700 1 Processor -- start 2020-02-11T16:22:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.244+0000 7f592feed700 1 -- start start 2020-02-11T16:22:42.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592feed700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59280a2fa0 0x7f59280a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:42.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592feed700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5928131990 0x7f59280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:42.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592feed700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59280a4350 con 0x7f59280a5410 2020-02-11T16:22:42.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592feed700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59280a1e60 con 0x7f59280a2fa0 2020-02-11T16:22:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592feed700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59280a3450 con 0x7f5928131990 2020-02-11T16:22:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5928131990 0x7f59280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5928131990 0x7f59280a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58190/0 (socket says 172.21.15.88:58190) 2020-02-11T16:22:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 -- 172.21.15.88:0/2388043319 learned_addr learned my addr 172.21.15.88:0/2388043319 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592dc89700 1 --2- 172.21.15.88:0/2388043319 >> v2:172.21.15.52:3300/0 conn(0x7f59280a2fa0 0x7f59280a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 -- 172.21.15.88:0/2388043319 >> v2:172.21.15.52:3300/0 conn(0x7f59280a2fa0 msgr2=0x7f59280a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 --2- 172.21.15.88:0/2388043319 >> v2:172.21.15.52:3300/0 conn(0x7f59280a2fa0 0x7f59280a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 -- 172.21.15.88:0/2388043319 >> v1:172.21.15.52:6789/0 conn(0x7f59280a5410 legacy=0x7f5928131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 -- 172.21.15.88:0/2388043319 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59280a3a40 con 0x7f5928131990 2020-02-11T16:22:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 --2- 172.21.15.88:0/2388043319 >> v2:172.21.15.88:3300/0 conn(0x7f5928131990 0x7f59280a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f592805ef00 tx=0x7f5920007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 --2- 172.21.15.88:0/2388043319 >> v2:172.21.15.88:3300/0 conn(0x7f5928131990 0x7f59280a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f592805ef00 tx=0x7f5920007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 --2- 172.21.15.88:0/2388043319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5928131990 0x7f59280a5870 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f592805ef00 tx=0x7f5920007dc0).ready entity=mon.1 client_cookie=cd6c11de2e65275f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 --2- 172.21.15.88:0/2388043319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5928131990 0x7f59280a5870 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f592805ef00 tx=0x7f5920007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 --2- 172.21.15.88:0/2388043319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5928131990 0x7f59280a5870 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f592805ef00 tx=0x7f5920007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592e48a700 1 --2- 172.21.15.88:0/2388043319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5928131990 0x7f59280a5870 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f592805ef00 tx=0x7f5920007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592cc87700 1 -- 172.21.15.88:0/2388043319 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f592000a160 con 0x7f5928131990 2020-02-11T16:22:42.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.245+0000 7f592cc87700 1 -- 172.21.15.88:0/2388043319 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000a2c0 con 0x7f5928131990 2020-02-11T16:22:42.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.246+0000 7f592cc87700 1 -- 172.21.15.88:0/2388043319 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f592000a660 con 0x7f5928131990 2020-02-11T16:22:42.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.246+0000 7f592feed700 1 -- 172.21.15.88:0/2388043319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5928131990 msgr2=0x7f59280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.246+0000 7f592feed700 1 --2- 172.21.15.88:0/2388043319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5928131990 0x7f59280a5870 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f592805ef00 tx=0x7f5920007dc0).stop 2020-02-11T16:22:42.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.246+0000 7f592feed700 1 -- 172.21.15.88:0/2388043319 shutdown_connections 2020-02-11T16:22:42.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.246+0000 7f592feed700 1 --2- 172.21.15.88:0/2388043319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5928131990 0x7f59280a5870 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.246+0000 7f592feed700 1 --2- 172.21.15.88:0/2388043319 >> v2:172.21.15.52:3300/0 conn(0x7f59280a2fa0 0x7f59280a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:42.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.246+0000 7f592feed700 1 -- 172.21.15.88:0/2388043319 >> 172.21.15.88:0/2388043319 conn(0x7f592809d110 msgr2=0x7f592809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:42.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.246+0000 7f592feed700 1 -- 172.21.15.88:0/2388043319 shutdown_connections 2020-02-11T16:22:42.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.246+0000 7f592feed700 1 -- 172.21.15.88:0/2388043319 wait complete. 2020-02-11T16:22:42.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.247+0000 7f592feed700 1 Processor -- start 2020-02-11T16:22:42.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.247+0000 7f592feed700 1 -- start start 2020-02-11T16:22:42.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.247+0000 7f592feed700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59280a5410 0x7f592812be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592feed700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5928131990 0x7f592814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592feed700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5928135330 con 0x7f59280a2fa0 2020-02-11T16:22:42.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592feed700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592812b6f0 con 0x7f59280a5410 2020-02-11T16:22:42.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592feed700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592812c2c0 con 0x7f5928131990 2020-02-11T16:22:42.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592dc89700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f59280a2fa0 0x7f592809ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45818/0 (socket says 172.21.15.88:45818) 2020-02-11T16:22:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592dc89700 1 -- 172.21.15.88:0/2056174522 learned_addr learned my addr 172.21.15.88:0/2056174522 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:22:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 --2- 172.21.15.88:0/2056174522 >> v2:172.21.15.88:3300/0 conn(0x7f59280a5410 0x7f592812be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592e48a700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5928131990 0x7f592814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 -- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5928131990 msgr2=0x7f592814bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5928131990 0x7f592814bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 -- 172.21.15.88:0/2056174522 >> v1:172.21.15.88:6789/0 conn(0x7f59280a2fa0 legacy=0x7f592809ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556476540 0 0) 0x7f5928135330 con 0x7f59280a2fa0 2020-02-11T16:22:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 -- 172.21.15.88:0/2056174522 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592809fac0 con 0x7f59280a5410 2020-02-11T16:22:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 --2- 172.21.15.88:0/2056174522 >> v2:172.21.15.88:3300/0 conn(0x7f59280a5410 0x7f592812be60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5918001f50 tx=0x7f5918010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 --2- 172.21.15.88:0/2056174522 >> v2:172.21.15.88:3300/0 conn(0x7f59280a5410 0x7f592812be60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5918001f50 tx=0x7f5918010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280a5410 0x7f592812be60 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f5918001f50 tx=0x7f5918010930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280a5410 0x7f592812be60 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5918001f50 tx=0x7f5918010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5918006bc0 con 0x7f59280a5410 2020-02-11T16:22:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592feed700 1 -- 172.21.15.88:0/2056174522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592812abc0 con 0x7f59280a5410 2020-02-11T16:22:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280a5410 0x7f592812be60 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5918001f50 tx=0x7f5918010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592d488700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280a5410 0x7f592812be60 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5918001f50 tx=0x7f5918010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918006d20 con 0x7f59280a5410 2020-02-11T16:22:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f592feed700 1 -- 172.21.15.88:0/2056174522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5928138380 con 0x7f59280a5410 2020-02-11T16:22:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.248+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5918006e90 con 0x7f59280a5410 2020-02-11T16:22:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.249+0000 7f592d488700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280a5410 0x7f592812be60 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5918001f50 tx=0x7f5918010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.249+0000 7f592feed700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 0x7f59280a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.249+0000 7f592feed700 1 -- 172.21.15.88:0/2056174522 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592805e2f0 con 0x7f592805b1d0 2020-02-11T16:22:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.249+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5918008350 con 0x7f59280a5410 2020-02-11T16:22:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.249+0000 7f592d488700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280a5410 0x7f592812be60 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5918001f50 tx=0x7f5918010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.249+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 0x7f59280a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f5916ffd700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5908039a90 0x7f590803bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5918049b60 con 0x7f59280a5410 2020-02-11T16:22:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f592e48a700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5908039a90 0x7f590803bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f592dc89700 1 -- 172.21.15.88:0/2056174522 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f592809eb70 con 0x7f592805b1d0 2020-02-11T16:22:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 0x7f59280a7fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f592e48a700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5908039a90 0x7f590803bf50 crc :-1 s=READY pgs=410 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 0x7f59280a7fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 0x7f59280a7fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 0x7f59280a7fe0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59240059c0 con 0x7f592805b1d0 2020-02-11T16:22:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 0x7f59280a7fe0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5924005b20 con 0x7f592805b1d0 2020-02-11T16:22:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 msgr2=0x7f59280a7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f5916ffd700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 0x7f59280a7fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).stop 2020-02-11T16:22:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 msgr2=0x7f59280a7fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.250+0000 7f5916ffd700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b1d0 0x7f59280a7fe0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).stop 2020-02-11T16:22:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.259+0000 7f592feed700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 0x7f59280a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.259+0000 7f592feed700 1 -- 172.21.15.88:0/2056174522 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59280565b0 con 0x7f592805b5e0 2020-02-11T16:22:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 0x7f59280a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f592dc89700 1 -- 172.21.15.88:0/2056174522 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f59280a1650 con 0x7f592805b5e0 2020-02-11T16:22:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 0x7f59280a8440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 0x7f59280a8440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 0x7f59280a8440 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 0x7f59280a8440 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f592400b430 con 0x7f592805b5e0 2020-02-11T16:22:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f592dc89700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 0x7f59280a8440 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f592400b590 con 0x7f592805b5e0 2020-02-11T16:22:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 msgr2=0x7f59280a8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f5916ffd700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 0x7f59280a8440 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f5924007a40 tx=0x7f5924010db0).stop 2020-02-11T16:22:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f5916ffd700 1 -- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 msgr2=0x7f59280a8440 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.260+0000 7f5916ffd700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592805b5e0 0x7f59280a8440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.261+0000 7f592feed700 1 -- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5908039a90 msgr2=0x7f590803bf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.261+0000 7f592feed700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5908039a90 0x7f590803bf50 crc :-1 s=READY pgs=410 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.261+0000 7f592feed700 1 -- 172.21.15.88:0/2056174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280a5410 msgr2=0x7f592812be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.261+0000 7f592feed700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280a5410 0x7f592812be60 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f5918001f50 tx=0x7f5918010930).stop 2020-02-11T16:22:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.261+0000 7f592e48a700 1 -- 172.21.15.88:0/2056174522 reap_dead start 2020-02-11T16:22:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.261+0000 7f592feed700 1 -- 172.21.15.88:0/2056174522 shutdown_connections 2020-02-11T16:22:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.261+0000 7f592feed700 1 --2- 172.21.15.88:0/2056174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280a5410 0x7f592812be60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.261+0000 7f592feed700 1 -- 172.21.15.88:0/2056174522 >> 172.21.15.88:0/2056174522 conn(0x7f592809d110 msgr2=0x7f5928131130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.261+0000 7f592feed700 1 -- 172.21.15.88:0/2056174522 shutdown_connections 2020-02-11T16:22:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.261+0000 7f592feed700 1 -- 172.21.15.88:0/2056174522 wait complete. 2020-02-11T16:22:42.273 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:22:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:22:42.273 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 140, 2020-02-11T16:22:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:22:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:22:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:22:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:22:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:22:42.274 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:42.275 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:22:42.275 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:22:42.275 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:42.275 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:42.275 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:42.276 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:42.276 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:42.276 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:42.276 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.276 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:22:42.276 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:22:42.276 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:42.277 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:42.277 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:42.277 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:42.277 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:42.277 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:42.277 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.278 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:22:42.278 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:22:42.278 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:22:42.278 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:22:42.278 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:22:42.278 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:22:42.278 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:42.279 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:42.279 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:22:42.279 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:22:42.279 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:42.279 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:22:42.279 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:42.280 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:42.280 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:42.280 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:42.280 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:42.280 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:42.280 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.280 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:22:42.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.281 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:22:42.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.281 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:42.281 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:42.281 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:42.281 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:42.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.282 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:42.282 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:22:42.282 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.283 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:42.283 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:22:42.283 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.283 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.283 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.283 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:22:42.284 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:22:42.284 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:42.284 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:42.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.284 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:22:42.284 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:22:42.285 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:42.285 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:42.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.285 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:42.285 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:22:42.285 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.286 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:42.286 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:22:42.286 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.286 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.286 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.287 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:22:42.287 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:22:42.287 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:42.287 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:42.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.287 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:42.287 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:42.288 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:42.288 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:42.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.288 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:42.288 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:22:42.288 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.289 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:42.289 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:22:42.289 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:42.289 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.289 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.290 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:22:42.290 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:22:42.290 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:42.290 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:42.290 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.290 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:42.291 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:22:42.291 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:22:42.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.291 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:42.291 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:42.291 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:22:42.291 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.292 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.292 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:22:42.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.292 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:42.292 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:42.292 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:22:42.292 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.293 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.293 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:22:42.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.293 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:42.293 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:42.293 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:22:42.293 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.294 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.294 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:22:42.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.294 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:42.294 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:42.294 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:22:42.294 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.295 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:42.295 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:22:42.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:42.295 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:42.295 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:42.295 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:22:42.296 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.296 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:42.296 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:42.296 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:22:42.297 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:22:42.298 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:22:42.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.412+0000 7f4e22036700 1 Processor -- start 2020-02-11T16:22:42.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.412+0000 7f4e22036700 1 -- start start 2020-02-11T16:22:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e22036700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e22036700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e1c0a5de0 0x7f4e1c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e22036700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e1c12e3a0 0x7f4e1c12e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:42.418 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e22036700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c0a3570 con 0x7f4e1c12e3a0 2020-02-11T16:22:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e22036700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c0a3810 con 0x7f4e1c0a18a0 2020-02-11T16:22:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e22036700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c0a3ab0 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e1b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e1b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58204/0 (socket says 172.21.15.88:58204) 2020-02-11T16:22:42.419 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e1b7fe700 1 -- 172.21.15.88:0/1365734214 learned_addr learned my addr 172.21.15.88:0/1365734214 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e13fff700 1 --2- 172.21.15.88:0/1365734214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e1c0a5de0 0x7f4e1c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e1bfff700 1 --2- 172.21.15.88:0/1365734214 >> v2:172.21.15.52:3300/0 conn(0x7f4e1c12e3a0 0x7f4e1c12e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e1b7fe700 1 -- 172.21.15.88:0/1365734214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e1c0a5de0 msgr2=0x7f4e1c0a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/1365734214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e1c0a5de0 0x7f4e1c0a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e1b7fe700 1 -- 172.21.15.88:0/1365734214 >> v2:172.21.15.52:3300/0 conn(0x7f4e1c12e3a0 msgr2=0x7f4e1c12e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/1365734214 >> v2:172.21.15.52:3300/0 conn(0x7f4e1c12e3a0 0x7f4e1c12e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:42.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e1b7fe700 1 -- 172.21.15.88:0/1365734214 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c0a3d50 con 0x7f4e1c0a18a0 2020-02-11T16:22:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.413+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/1365734214 >> v2:172.21.15.88:3300/0 conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e1c05bbc0 tx=0x7f4e0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/1365734214 >> v2:172.21.15.88:3300/0 conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e1c05bbc0 tx=0x7f4e0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/1365734214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f4e1c05bbc0 tx=0x7f4e0c0088e0).ready entity=mon.1 client_cookie=7d635ea49829938f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/1365734214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f4e1c05bbc0 tx=0x7f4e0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/1365734214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f4e1c05bbc0 tx=0x7f4e0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e1affd700 1 -- 172.21.15.88:0/1365734214 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0c013930 con 0x7f4e1c0a18a0 2020-02-11T16:22:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/1365734214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f4e1c05bbc0 tx=0x7f4e0c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e1affd700 1 -- 172.21.15.88:0/1365734214 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c013a90 con 0x7f4e1c0a18a0 2020-02-11T16:22:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e1affd700 1 -- 172.21.15.88:0/1365734214 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0c013e70 con 0x7f4e1c0a18a0 2020-02-11T16:22:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e22036700 1 -- 172.21.15.88:0/1365734214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a18a0 msgr2=0x7f4e1c0a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e22036700 1 --2- 172.21.15.88:0/1365734214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f4e1c05bbc0 tx=0x7f4e0c0088e0).stop 2020-02-11T16:22:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e22036700 1 -- 172.21.15.88:0/1365734214 shutdown_connections 2020-02-11T16:22:42.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e22036700 1 --2- 172.21.15.88:0/1365734214 >> v2:172.21.15.52:3300/0 conn(0x7f4e1c12e3a0 0x7f4e1c12e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e22036700 1 --2- 172.21.15.88:0/1365734214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a18a0 0x7f4e1c0a6dd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e22036700 1 --2- 172.21.15.88:0/1365734214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e1c0a5de0 0x7f4e1c0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e22036700 1 -- 172.21.15.88:0/1365734214 >> 172.21.15.88:0/1365734214 conn(0x7f4e1c09d110 msgr2=0x7f4e1c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e22036700 1 -- 172.21.15.88:0/1365734214 shutdown_connections 2020-02-11T16:22:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.414+0000 7f4e22036700 1 -- 172.21.15.88:0/1365734214 wait complete. 2020-02-11T16:22:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.415+0000 7f4e22036700 1 Processor -- start 2020-02-11T16:22:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.415+0000 7f4e22036700 1 -- start start 2020-02-11T16:22:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.416+0000 7f4e22036700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e1c0a18a0 0x7f4e1c066b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.416+0000 7f4e22036700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.416+0000 7f4e22036700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1c12f510 con 0x7f4e1c12e3a0 2020-02-11T16:22:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.416+0000 7f4e22036700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c144d40 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.416+0000 7f4e22036700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c131c30 con 0x7f4e1c0a18a0 2020-02-11T16:22:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.416+0000 7f4e13fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.416+0000 7f4e13fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58210/0 (socket says 172.21.15.88:58210) 2020-02-11T16:22:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.416+0000 7f4e13fff700 1 -- 172.21.15.88:0/576853903 learned_addr learned my addr 172.21.15.88:0/576853903 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:42.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.416+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e1c0a18a0 0x7f4e1c066b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 -- 172.21.15.88:0/576853903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e1c0a18a0 msgr2=0x7f4e1c066b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e1c0a18a0 0x7f4e1c066b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 -- 172.21.15.88:0/576853903 >> v1:172.21.15.52:6789/0 conn(0x7f4e1c12e3a0 legacy=0x7f4e1c145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 -- 172.21.15.88:0/576853903 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c131ed0 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> v2:172.21.15.88:3300/0 conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> v2:172.21.15.88:3300/0 conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e197fa700 1 -- 172.21.15.88:0/576853903 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e040128f0 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e197fa700 1 -- 172.21.15.88:0/576853903 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e04012a50 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e22036700 1 -- 172.21.15.88:0/576853903 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c132170 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e197fa700 1 -- 172.21.15.88:0/576853903 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e04012e30 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e22036700 1 -- 172.21.15.88:0/576853903 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c067130 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.417+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.418+0000 7f4e197fa700 1 -- 172.21.15.88:0/576853903 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4e04007170 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.418+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.418+0000 7f4e197fa700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e00039d00 0x7f4e0003c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.418+0000 7f4e22036700 1 -- 172.21.15.88:0/576853903 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c0565b0 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.418+0000 7f4e197fa700 1 -- 172.21.15.88:0/576853903 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4e04049cf0 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.418+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e00039d00 0x7f4e0003c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.418+0000 7f4e1b7fe700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e00039d00 0x7f4e0003c1c0 crc :-1 s=READY pgs=411 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.423+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.423+0000 7f4e197fa700 1 -- 172.21.15.88:0/576853903 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4e0402f2d0 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.628+0000 7f4e22036700 1 -- 172.21.15.88:0/576853903 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f4e1c0aaaa0 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.629+0000 7f4e13fff700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:42.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.629+0000 7f4e197fa700 1 -- 172.21.15.88:0/576853903 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f4e04031de0 con 0x7f4e1c0a5de0 2020-02-11T16:22:42.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.631+0000 7f4e22036700 1 -- 172.21.15.88:0/576853903 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e00039d00 msgr2=0x7f4e0003c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.631+0000 7f4e22036700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e00039d00 0x7f4e0003c1c0 crc :-1 s=READY pgs=411 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.631+0000 7f4e22036700 1 -- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 msgr2=0x7f4e1c12fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:42.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.631+0000 7f4e22036700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f4e04002f30 tx=0x7f4e04010c70).stop 2020-02-11T16:22:42.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.631+0000 7f4e22036700 1 -- 172.21.15.88:0/576853903 shutdown_connections 2020-02-11T16:22:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.631+0000 7f4e22036700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4e00039d00 0x7f4e0003c1c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.631+0000 7f4e22036700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e1c0a18a0 0x7f4e1c066b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.631+0000 7f4e22036700 1 --2- 172.21.15.88:0/576853903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0a5de0 0x7f4e1c12fe20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.631+0000 7f4e22036700 1 -- 172.21.15.88:0/576853903 >> 172.21.15.88:0/576853903 conn(0x7f4e1c09d110 msgr2=0x7f4e1c0a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:42.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.634+0000 7f4e22036700 1 -- 172.21.15.88:0/576853903 shutdown_connections 2020-02-11T16:22:42.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:42.634+0000 7f4e22036700 1 -- 172.21.15.88:0/576853903 wait complete. 2020-02-11T16:22:42.649 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:22:44.699 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:22:44.702 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:22:52.649 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:22:52.650 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:22:52.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.765+0000 7fecb02ac700 1 Processor -- start 2020-02-11T16:22:52.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.765+0000 7fecb02ac700 1 -- start start 2020-02-11T16:22:52.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecb02ac700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feca805c1f0 0x7feca8137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:52.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecb02ac700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:52.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecb02ac700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca81382e0 con 0x7feca80a1e50 2020-02-11T16:22:52.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecb02ac700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca8138580 con 0x7feca805c1f0 2020-02-11T16:22:52.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecb02ac700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca8138820 con 0x7feca8134e30 2020-02-11T16:22:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae849700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae849700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52542/0 (socket says 172.21.15.88:52542) 2020-02-11T16:22:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae048700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feca805c1f0 0x7feca8137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae849700 1 -- 172.21.15.88:0/2648607669 learned_addr learned my addr 172.21.15.88:0/2648607669 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae849700 1 -- 172.21.15.88:0/2648607669 >> v2:172.21.15.52:3300/0 conn(0x7feca805c1f0 msgr2=0x7feca8137cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae849700 1 --2- 172.21.15.88:0/2648607669 >> v2:172.21.15.52:3300/0 conn(0x7feca805c1f0 0x7feca8137cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae849700 1 -- 172.21.15.88:0/2648607669 >> v1:172.21.15.52:6789/0 conn(0x7feca80a1e50 legacy=0x7feca80a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae849700 1 -- 172.21.15.88:0/2648607669 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8135720 con 0x7feca8134e30 2020-02-11T16:22:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae849700 1 --2- 172.21.15.88:0/2648607669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feca00032b0 tx=0x7feca0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae849700 1 --2- 172.21.15.88:0/2648607669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feca00032b0 tx=0x7feca0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.766+0000 7fecae849700 1 --2- 172.21.15.88:0/2648607669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7feca00032b0 tx=0x7feca0008c60).ready entity=mon.2 client_cookie=d270e7b21b3677cd server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecae849700 1 --2- 172.21.15.88:0/2648607669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7feca00032b0 tx=0x7feca0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecae849700 1 --2- 172.21.15.88:0/2648607669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7feca00032b0 tx=0x7feca0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecad046700 1 -- 172.21.15.88:0/2648607669 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feca000a160 con 0x7feca8134e30 2020-02-11T16:22:52.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecae849700 1 --2- 172.21.15.88:0/2648607669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7feca00032b0 tx=0x7feca0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecad046700 1 -- 172.21.15.88:0/2648607669 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca000a2c0 con 0x7feca8134e30 2020-02-11T16:22:52.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecad046700 1 -- 172.21.15.88:0/2648607669 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feca000a6a0 con 0x7feca8134e30 2020-02-11T16:22:52.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecb02ac700 1 -- 172.21.15.88:0/2648607669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 msgr2=0x7feca81352c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:52.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecb02ac700 1 --2- 172.21.15.88:0/2648607669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7feca00032b0 tx=0x7feca0008c60).stop 2020-02-11T16:22:52.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecb02ac700 1 -- 172.21.15.88:0/2648607669 shutdown_connections 2020-02-11T16:22:52.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecb02ac700 1 --2- 172.21.15.88:0/2648607669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca81352c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:52.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecb02ac700 1 --2- 172.21.15.88:0/2648607669 >> v2:172.21.15.52:3300/0 conn(0x7feca805c1f0 0x7feca8137cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:52.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecb02ac700 1 -- 172.21.15.88:0/2648607669 >> 172.21.15.88:0/2648607669 conn(0x7feca80ab400 msgr2=0x7feca80a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:52.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecb02ac700 1 -- 172.21.15.88:0/2648607669 shutdown_connections 2020-02-11T16:22:52.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.767+0000 7fecb02ac700 1 -- 172.21.15.88:0/2648607669 wait complete. 2020-02-11T16:22:52.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.768+0000 7fecb02ac700 1 Processor -- start 2020-02-11T16:22:52.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.768+0000 7fecb02ac700 1 -- start start 2020-02-11T16:22:52.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecb02ac700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feca80a1e50 0x7feca812ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecb02ac700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca812f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecb02ac700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca8133080 con 0x7feca805c1f0 2020-02-11T16:22:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecb02ac700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca81332e0 con 0x7feca80a1e50 2020-02-11T16:22:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecb02ac700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca8133580 con 0x7feca8134e30 2020-02-11T16:22:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecad847700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feca80a1e50 0x7feca812ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecad847700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feca80a1e50 0x7feca812ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58224/0 (socket says 172.21.15.88:58224) 2020-02-11T16:22:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecad847700 1 -- 172.21.15.88:0/437041704 learned_addr learned my addr 172.21.15.88:0/437041704 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecae849700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca812f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fec977fe700 1 -- 172.21.15.88:0/437041704 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956796560 0 0) 0x7feca8133080 con 0x7feca805c1f0 2020-02-11T16:22:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fec977fe700 1 -- 172.21.15.88:0/437041704 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec88002fe0 con 0x7feca805c1f0 2020-02-11T16:22:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecad847700 1 -- 172.21.15.88:0/437041704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 msgr2=0x7feca812f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca812f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecad847700 1 -- 172.21.15.88:0/437041704 >> v1:172.21.15.52:6789/0 conn(0x7feca805c1f0 legacy=0x7feca8060dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:52.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecad847700 1 -- 172.21.15.88:0/437041704 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca812f530 con 0x7feca80a1e50 2020-02-11T16:22:52.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.769+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> v2:172.21.15.88:3300/0 conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> v2:172.21.15.88:3300/0 conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:52.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fec977fe700 1 -- 172.21.15.88:0/437041704 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec9800cc20 con 0x7feca80a1e50 2020-02-11T16:22:52.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fec977fe700 1 -- 172.21.15.88:0/437041704 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800cd80 con 0x7feca80a1e50 2020-02-11T16:22:52.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fecb02ac700 1 -- 172.21.15.88:0/437041704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca80614e0 con 0x7feca80a1e50 2020-02-11T16:22:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fec977fe700 1 -- 172.21.15.88:0/437041704 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec98011100 con 0x7feca80a1e50 2020-02-11T16:22:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fecb02ac700 1 -- 172.21.15.88:0/437041704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca8063700 con 0x7feca80a1e50 2020-02-11T16:22:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.770+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.771+0000 7fec977fe700 1 -- 172.21.15.88:0/437041704 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fec980064e0 con 0x7feca80a1e50 2020-02-11T16:22:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.771+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.771+0000 7fec977fe700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec88039fc0 0x7fec8803c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.771+0000 7fec977fe700 1 -- 172.21.15.88:0/437041704 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fec98049420 con 0x7feca80a1e50 2020-02-11T16:22:52.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.771+0000 7fecb02ac700 1 -- 172.21.15.88:0/437041704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca80565b0 con 0x7feca80a1e50 2020-02-11T16:22:52.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.771+0000 7fecae048700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec88039fc0 0x7fec8803c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:52.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.771+0000 7fecae048700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec88039fc0 0x7fec8803c480 crc :-1 s=READY pgs=412 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:52.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.775+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.775+0000 7fec977fe700 1 -- 172.21.15.88:0/437041704 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fec9802ea80 con 0x7feca80a1e50 2020-02-11T16:22:52.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.987+0000 7fecb02ac700 1 -- 172.21.15.88:0/437041704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7feca81336c0 con 0x7feca80a1e50 2020-02-11T16:22:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.988+0000 7fecad847700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.988+0000 7fec977fe700 1 -- 172.21.15.88:0/437041704 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fec98031570 con 0x7feca80a1e50 2020-02-11T16:22:52.990 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:52.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.989+0000 7fecb02ac700 1 -- 172.21.15.88:0/437041704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec88039fc0 msgr2=0x7fec8803c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:52.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.989+0000 7fecb02ac700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec88039fc0 0x7fec8803c480 crc :-1 s=READY pgs=412 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.989+0000 7fecb02ac700 1 -- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 msgr2=0x7feca812ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.989+0000 7fecb02ac700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 0x7feca812ec70 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7feca80a1700 tx=0x7fec9800c490).stop 2020-02-11T16:22:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.990+0000 7fecb02ac700 1 -- 172.21.15.88:0/437041704 shutdown_connections 2020-02-11T16:22:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.990+0000 7fecb02ac700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fec88039fc0 0x7fec8803c480 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.990+0000 7fecb02ac700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feca8134e30 0x7feca812f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.990+0000 7fecb02ac700 1 --2- 172.21.15.88:0/437041704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80a1e50 0x7feca812ec70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.990+0000 7fecb02ac700 1 -- 172.21.15.88:0/437041704 >> 172.21.15.88:0/437041704 conn(0x7feca80ab400 msgr2=0x7feca8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:52.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.990+0000 7fecb02ac700 1 -- 172.21.15.88:0/437041704 shutdown_connections 2020-02-11T16:22:52.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:52.990+0000 7fecb02ac700 1 -- 172.21.15.88:0/437041704 wait complete. 2020-02-11T16:22:53.002 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":140,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:22:53.002 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:22:53.002 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:22:53.002 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:22:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.112+0000 7feb87ba3700 1 Processor -- start 2020-02-11T16:22:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.112+0000 7feb87ba3700 1 -- start start 2020-02-11T16:22:53.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb87ba3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb8013b290 0x7feb8009d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:53.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb87ba3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb8013b6f0 0x7feb8009d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:53.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb87ba3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb801380c0 con 0x7feb80131f50 2020-02-11T16:22:53.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb87ba3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb80138360 con 0x7feb8013b290 2020-02-11T16:22:53.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb87ba3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb80138600 con 0x7feb8013b6f0 2020-02-11T16:22:53.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8593f700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7feb80131f50 0x7feb8005f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45856/0 (socket says 172.21.15.88:45856) 2020-02-11T16:22:53.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8593f700 1 -- 172.21.15.88:0/4048171294 learned_addr learned my addr 172.21.15.88:0/4048171294 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:22:53.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8513e700 1 --2- 172.21.15.88:0/4048171294 >> v2:172.21.15.52:3300/0 conn(0x7feb8013b290 0x7feb8009d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb86140700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb8013b6f0 0x7feb8009d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416958867 0 0) 0x7feb801380c0 con 0x7feb80131f50 2020-02-11T16:22:53.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb68003230 con 0x7feb80131f50 2020-02-11T16:22:53.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3211609452 0 0) 0x7feb68003230 con 0x7feb80131f50 2020-02-11T16:22:53.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb8013b6f0 msgr2=0x7feb8009d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:53.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb8013b6f0 0x7feb8009d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:53.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 >> v2:172.21.15.52:3300/0 conn(0x7feb8013b290 msgr2=0x7feb8009d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:53.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 --2- 172.21.15.88:0/4048171294 >> v2:172.21.15.52:3300/0 conn(0x7feb8013b290 0x7feb8009d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:53.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80137d40 con 0x7feb80131f50 2020-02-11T16:22:53.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7feb7c0016d0 con 0x7feb80131f50 2020-02-11T16:22:53.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 >> v1:172.21.15.88:6789/0 conn(0x7feb80131f50 legacy=0x7feb8005f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68003720 0x7feb68003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:53.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb68004060 0x7feb68004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:53.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb68004aa0 0x7feb68004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:53.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80138360 con 0x7feb68003720 2020-02-11T16:22:53.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80138600 con 0x7feb68004060 2020-02-11T16:22:53.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.113+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6800b720 con 0x7feb68004aa0 2020-02-11T16:22:53.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb68004060 0x7feb68004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8593f700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68003720 0x7feb68003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb86140700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb68004aa0 0x7feb68004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 -- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb68004aa0 msgr2=0x7feb68004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:53.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb68004aa0 0x7feb68004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:53.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 -- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68003720 msgr2=0x7feb68003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:53.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68003720 0x7feb68003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:53.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 -- 172.21.15.88:0/4048171294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68003230 con 0x7feb68004060 2020-02-11T16:22:53.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb86140700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb68004aa0 0x7feb68004ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:22:53.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb68004060 0x7feb68004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb68004060 0x7feb68004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb68004060 0x7feb68004530 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).ready entity=mon.1 client_cookie=cfb27678dc398f83 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb68004060 0x7feb68004530 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb68004060 0x7feb68004530 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8513e700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb68004060 0x7feb68004530 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb70010d60 con 0x7feb68004060 2020-02-11T16:22:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70008970 con 0x7feb68004060 2020-02-11T16:22:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb8493d700 1 -- 172.21.15.88:0/4048171294 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb70008d50 con 0x7feb68004060 2020-02-11T16:22:53.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb87ba3700 1 -- 172.21.15.88:0/4048171294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb68004060 msgr2=0x7feb68004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb87ba3700 1 --2- 172.21.15.88:0/4048171294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb68004060 0x7feb68004530 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).stop 2020-02-11T16:22:53.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.114+0000 7feb86140700 1 -- 172.21.15.88:0/4048171294 reap_dead start 2020-02-11T16:22:53.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.115+0000 7feb87ba3700 1 -- 172.21.15.88:0/4048171294 shutdown_connections 2020-02-11T16:22:53.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.115+0000 7feb87ba3700 1 -- 172.21.15.88:0/4048171294 >> 172.21.15.88:0/4048171294 conn(0x7feb800a7bb0 msgr2=0x7feb800a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:53.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.115+0000 7feb87ba3700 1 -- 172.21.15.88:0/4048171294 shutdown_connections 2020-02-11T16:22:53.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.115+0000 7feb87ba3700 1 -- 172.21.15.88:0/4048171294 wait complete. 2020-02-11T16:22:53.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.116+0000 7feb87ba3700 1 Processor -- start 2020-02-11T16:22:53.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.116+0000 7feb87ba3700 1 -- start start 2020-02-11T16:22:53.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb87ba3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb80139da0 0x7feb800a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb87ba3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb8012e420 0x7feb8012e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb87ba3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb800a86d0 con 0x7feb800a92c0 2020-02-11T16:22:53.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb87ba3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800a9c40 con 0x7feb80139da0 2020-02-11T16:22:53.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb87ba3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb80135570 con 0x7feb8012e420 2020-02-11T16:22:53.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb8012e420 0x7feb8012e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb8012e420 0x7feb8012e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58246/0 (socket says 172.21.15.88:58246) 2020-02-11T16:22:53.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 -- 172.21.15.88:0/1892219336 learned_addr learned my addr 172.21.15.88:0/1892219336 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:53.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> v2:172.21.15.52:3300/0 conn(0x7feb80139da0 0x7feb800a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 -- 172.21.15.88:0/1892219336 >> v2:172.21.15.52:3300/0 conn(0x7feb80139da0 msgr2=0x7feb800a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 --2- 172.21.15.88:0/1892219336 >> v2:172.21.15.52:3300/0 conn(0x7feb80139da0 0x7feb800a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 -- 172.21.15.88:0/1892219336 >> v1:172.21.15.52:6789/0 conn(0x7feb800a92c0 legacy=0x7feb80139690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 -- 172.21.15.88:0/1892219336 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8013a8f0 con 0x7feb8012e420 2020-02-11T16:22:53.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 --2- 172.21.15.88:0/1892219336 >> v2:172.21.15.88:3300/0 conn(0x7feb8012e420 0x7feb8012e8b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb8013a1b0 tx=0x7feb78010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 --2- 172.21.15.88:0/1892219336 >> v2:172.21.15.88:3300/0 conn(0x7feb8012e420 0x7feb8012e8b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb8013a1b0 tx=0x7feb78010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8012e420 0x7feb8012e8b0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7feb8013a1b0 tx=0x7feb78010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8012e420 0x7feb8012e8b0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7feb8013a1b0 tx=0x7feb78010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8012e420 0x7feb8012e8b0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7feb8013a1b0 tx=0x7feb78010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb86140700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8012e420 0x7feb8012e8b0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7feb8013a1b0 tx=0x7feb78010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb78005e20 con 0x7feb8012e420 2020-02-11T16:22:53.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb780125e0 con 0x7feb8012e420 2020-02-11T16:22:53.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb87ba3700 1 -- 172.21.15.88:0/1892219336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8013ab90 con 0x7feb8012e420 2020-02-11T16:22:53.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb78012940 con 0x7feb8012e420 2020-02-11T16:22:53.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.117+0000 7feb87ba3700 1 -- 172.21.15.88:0/1892219336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8012ed10 con 0x7feb8012e420 2020-02-11T16:22:53.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.118+0000 7feb86140700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8012e420 0x7feb8012e8b0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7feb8013a1b0 tx=0x7feb78010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.118+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7feb78012aa0 con 0x7feb8012e420 2020-02-11T16:22:53.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.118+0000 7feb86140700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8012e420 0x7feb8012e8b0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7feb8013a1b0 tx=0x7feb78010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.118+0000 7feb6effd700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb60039cd0 0x7feb6003c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.118+0000 7feb87ba3700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 0x7feb8005e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.118+0000 7feb87ba3700 1 -- 172.21.15.88:0/1892219336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8005e2f0 con 0x7feb80130700 2020-02-11T16:22:53.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.118+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7feb78049580 con 0x7feb8012e420 2020-02-11T16:22:53.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.118+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 0x7feb8005e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.118+0000 7feb8593f700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb60039cd0 0x7feb6003c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb8593f700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb60039cd0 0x7feb6003c190 crc :-1 s=READY pgs=413 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb8513e700 1 -- 172.21.15.88:0/1892219336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb8013aff0 con 0x7feb80130700 2020-02-11T16:22:53.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 0x7feb8005e8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 0x7feb8005e8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 0x7feb8005e8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 0x7feb8005e8f0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb70007350 con 0x7feb80130700 2020-02-11T16:22:53.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 0x7feb8005e8f0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7feb700074b0 con 0x7feb80130700 2020-02-11T16:22:53.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 msgr2=0x7feb8005e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb6effd700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 0x7feb8005e8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).stop 2020-02-11T16:22:53.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 msgr2=0x7feb8005e8f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:53.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.119+0000 7feb6effd700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80130700 0x7feb8005e8f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.127+0000 7feb87ba3700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 0x7feb8005f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.127+0000 7feb87ba3700 1 -- 172.21.15.88:0/1892219336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800565b0 con 0x7feb8005ed50 2020-02-11T16:22:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 0x7feb8005f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb8513e700 1 -- 172.21.15.88:0/1892219336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7feb8005cb20 con 0x7feb8005ed50 2020-02-11T16:22:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 0x7feb8005f130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 0x7feb8005f130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 0x7feb8005f130 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 0x7feb8005f130 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb70005e20 con 0x7feb8005ed50 2020-02-11T16:22:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb8513e700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 0x7feb8005f130 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7feb70015430 con 0x7feb8005ed50 2020-02-11T16:22:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 msgr2=0x7feb8005f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb6effd700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 0x7feb8005f130 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).stop 2020-02-11T16:22:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb6effd700 1 -- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 msgr2=0x7feb8005f130 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.128+0000 7feb6effd700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8005ed50 0x7feb8005f130 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0x7feb70002f30 tx=0x7feb70010050).stop 2020-02-11T16:22:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb87ba3700 1 -- 172.21.15.88:0/1892219336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb60039cd0 msgr2=0x7feb6003c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb87ba3700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb60039cd0 0x7feb6003c190 crc :-1 s=READY pgs=413 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb87ba3700 1 -- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8012e420 msgr2=0x7feb8012e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb87ba3700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8012e420 0x7feb8012e8b0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7feb8013a1b0 tx=0x7feb78010b90).stop 2020-02-11T16:22:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb86140700 1 -- 172.21.15.88:0/1892219336 reap_dead start 2020-02-11T16:22:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb86140700 1 -- 172.21.15.88:0/1892219336 reap_dead start 2020-02-11T16:22:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb87ba3700 1 -- 172.21.15.88:0/1892219336 shutdown_connections 2020-02-11T16:22:53.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb87ba3700 1 --2- 172.21.15.88:0/1892219336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb8012e420 0x7feb8012e8b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb87ba3700 1 -- 172.21.15.88:0/1892219336 >> 172.21.15.88:0/1892219336 conn(0x7feb800a7bb0 msgr2=0x7feb800a62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:53.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb87ba3700 1 -- 172.21.15.88:0/1892219336 shutdown_connections 2020-02-11T16:22:53.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.129+0000 7feb87ba3700 1 -- 172.21.15.88:0/1892219336 wait complete. 2020-02-11T16:22:53.163 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:22:53.163 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:22:53.163 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:22:53.164 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:22:53.164 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 140, 2020-02-11T16:22:53.164 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:22:53.164 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:22:53.164 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:22:53.164 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:22:53.164 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.165 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:22:53.165 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:53.165 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:22:53.165 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:22:53.165 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:53.165 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:53.165 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:53.166 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:53.166 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:53.166 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:53.166 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.166 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:22:53.166 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:22:53.166 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:53.167 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:53.167 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:53.167 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:53.167 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:53.167 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:53.167 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.168 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:22:53.168 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:22:53.168 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:22:53.168 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:22:53.168 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:22:53.168 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:22:53.168 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:53.168 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:53.169 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:22:53.169 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:22:53.169 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:53.169 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:22:53.169 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:53.169 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:53.170 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:53.171 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:53.171 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:53.171 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:53.171 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.171 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:22:53.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:22:53.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.172 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:53.172 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:53.172 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:53.173 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:53.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.173 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:53.173 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:22:53.173 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.174 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:53.174 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:22:53.174 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.174 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.175 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:22:53.175 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:22:53.175 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:53.175 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:53.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.175 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:22:53.176 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:22:53.176 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:53.176 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:53.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.176 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:53.176 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:22:53.177 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.177 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:53.177 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:22:53.177 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.177 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.178 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.178 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:22:53.178 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:22:53.178 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:53.178 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:53.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.179 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:53.179 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:53.179 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:53.179 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:53.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.179 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:53.180 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:22:53.180 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.180 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:53.180 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:22:53.181 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.181 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.181 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.181 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:22:53.181 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:22:53.181 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:53.182 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:53.182 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.182 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.182 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:22:53.182 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:22:53.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.183 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:53.183 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:53.183 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:22:53.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.183 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.183 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:22:53.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.184 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:53.184 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:53.184 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:22:53.184 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.184 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.184 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.185 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:22:53.185 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:22:53.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.305+0000 7f6ed6bb8700 1 Processor -- start 2020-02-11T16:22:53.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.305+0000 7f6ed6bb8700 1 -- start start 2020-02-11T16:22:53.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.306+0000 7f6ed6bb8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:53.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.306+0000 7f6ed6bb8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ed014d2f0 0x7f6ed014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:53.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.306+0000 7f6ed6bb8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed00a1c90 con 0x7f6ed00a6e90 2020-02-11T16:22:53.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.306+0000 7f6ed6bb8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed00a1f30 con 0x7f6ed014d2f0 2020-02-11T16:22:53.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.306+0000 7f6ed6bb8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00a2470 con 0x7f6ed00a4a90 2020-02-11T16:22:53.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.306+0000 7f6ecffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ed5155700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ed014d2f0 0x7f6ed014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52580/0 (socket says 172.21.15.88:52580) 2020-02-11T16:22:53.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 -- 172.21.15.88:0/74303175 learned_addr learned my addr 172.21.15.88:0/74303175 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:53.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 -- 172.21.15.88:0/74303175 >> v2:172.21.15.52:3300/0 conn(0x7f6ed014d2f0 msgr2=0x7f6ed014f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:53.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 --2- 172.21.15.88:0/74303175 >> v2:172.21.15.52:3300/0 conn(0x7f6ed014d2f0 0x7f6ed014f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:53.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 -- 172.21.15.88:0/74303175 >> v1:172.21.15.52:6789/0 conn(0x7f6ed00a6e90 legacy=0x7f6ed0145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 -- 172.21.15.88:0/74303175 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00a2710 con 0x7f6ed00a4a90 2020-02-11T16:22:53.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 --2- 172.21.15.88:0/74303175 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ed00a2270 tx=0x7f6ebc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 --2- 172.21.15.88:0/74303175 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ed00a2270 tx=0x7f6ebc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 --2- 172.21.15.88:0/74303175 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f6ed00a2270 tx=0x7f6ebc0088e0).ready entity=mon.2 client_cookie=7b4084ab248be2bf server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 --2- 172.21.15.88:0/74303175 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f6ed00a2270 tx=0x7f6ebc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecf7fe700 1 -- 172.21.15.88:0/74303175 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ebc012780 con 0x7f6ed00a4a90 2020-02-11T16:22:53.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 --2- 172.21.15.88:0/74303175 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f6ed00a2270 tx=0x7f6ebc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecffff700 1 --2- 172.21.15.88:0/74303175 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f6ed00a2270 tx=0x7f6ebc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecf7fe700 1 -- 172.21.15.88:0/74303175 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc0128e0 con 0x7f6ed00a4a90 2020-02-11T16:22:53.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ecf7fe700 1 -- 172.21.15.88:0/74303175 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ebc012cc0 con 0x7f6ed00a4a90 2020-02-11T16:22:53.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/74303175 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 msgr2=0x7f6ed00a4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.307+0000 7f6ed6bb8700 1 --2- 172.21.15.88:0/74303175 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f6ed00a2270 tx=0x7f6ebc0088e0).stop 2020-02-11T16:22:53.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.313+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/74303175 shutdown_connections 2020-02-11T16:22:53.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.313+0000 7f6ed6bb8700 1 --2- 172.21.15.88:0/74303175 >> v2:172.21.15.52:3300/0 conn(0x7f6ed014d2f0 0x7f6ed014f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:22:53.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.313+0000 7f6ed6bb8700 1 --2- 172.21.15.88:0/74303175 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ed00a4a90 0x7f6ed00a4ef0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.313+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/74303175 >> 172.21.15.88:0/74303175 conn(0x7f6ed009d110 msgr2=0x7f6ed009d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:53.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.313+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/74303175 shutdown_connections 2020-02-11T16:22:53.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.313+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/74303175 wait complete. 2020-02-11T16:22:53.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.314+0000 7f6ed6bb8700 1 Processor -- start 2020-02-11T16:22:53.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.314+0000 7f6ed6bb8700 1 -- start start 2020-02-11T16:22:53.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.315+0000 7f6ed6bb8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ed00a4a90 0x7f6ed0143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.315+0000 7f6ed6bb8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ed014d2f0 0x7f6ed00666c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.315+0000 7f6ed6bb8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed01429f0 con 0x7f6ed00a6e90 2020-02-11T16:22:53.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.315+0000 7f6ed6bb8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed01579b0 con 0x7f6ed014d2f0 2020-02-11T16:22:53.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.315+0000 7f6ed6bb8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed0143fe0 con 0x7f6ed00a4a90 2020-02-11T16:22:53.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.315+0000 7f6ed4954700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ed00a4a90 0x7f6ed0143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.315+0000 7f6ed4954700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ed00a4a90 0x7f6ed0143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58260/0 (socket says 172.21.15.88:58260) 2020-02-11T16:22:53.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.315+0000 7f6ed4954700 1 -- 172.21.15.88:0/1472188171 learned_addr learned my addr 172.21.15.88:0/1472188171 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:53.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.315+0000 7f6ed5155700 1 --2- 172.21.15.88:0/1472188171 >> v2:172.21.15.52:3300/0 conn(0x7f6ed014d2f0 0x7f6ed00666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed4954700 1 -- 172.21.15.88:0/1472188171 >> v2:172.21.15.52:3300/0 conn(0x7f6ed014d2f0 msgr2=0x7f6ed00666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed4954700 1 --2- 172.21.15.88:0/1472188171 >> v2:172.21.15.52:3300/0 conn(0x7f6ed014d2f0 0x7f6ed00666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed4954700 1 -- 172.21.15.88:0/1472188171 >> v1:172.21.15.88:6789/0 conn(0x7f6ed00a6e90 legacy=0x7f6ed01572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129904009 0 0) 0x7f6ed01429f0 con 0x7f6ed00a6e90 2020-02-11T16:22:53.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed4954700 1 -- 172.21.15.88:0/1472188171 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0142c20 con 0x7f6ed00a4a90 2020-02-11T16:22:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed4954700 1 --2- 172.21.15.88:0/1472188171 >> v2:172.21.15.88:3300/0 conn(0x7f6ed00a4a90 0x7f6ed0143b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ed00a2d30 tx=0x7f6ec400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed4954700 1 --2- 172.21.15.88:0/1472188171 >> v2:172.21.15.88:3300/0 conn(0x7f6ed00a4a90 0x7f6ed0143b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ed00a2d30 tx=0x7f6ec400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed4954700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ed00a4a90 0x7f6ed0143b80 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f6ed00a2d30 tx=0x7f6ec400c460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed4954700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ed00a4a90 0x7f6ed0143b80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f6ed00a2d30 tx=0x7f6ec400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ec400cc20 con 0x7f6ed00a4a90 2020-02-11T16:22:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed4954700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ed00a4a90 0x7f6ed0143b80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f6ed00a2d30 tx=0x7f6ec400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed4954700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ed00a4a90 0x7f6ed0143b80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f6ed00a2d30 tx=0x7f6ec400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400cd80 con 0x7f6ed00a4a90 2020-02-11T16:22:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/1472188171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed0142ec0 con 0x7f6ed00a4a90 2020-02-11T16:22:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ec4011170 con 0x7f6ed00a4a90 2020-02-11T16:22:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.316+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/1472188171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed0143600 con 0x7f6ed00a4a90 2020-02-11T16:22:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.317+0000 7f6ed4954700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ed00a4a90 0x7f6ed0143b80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f6ed00a2d30 tx=0x7f6ec400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.317+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6ec40064e0 con 0x7f6ed00a4a90 2020-02-11T16:22:53.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.317+0000 7f6ed4954700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ed00a4a90 0x7f6ed0143b80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f6ed00a2d30 tx=0x7f6ec400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.317+0000 7f6ed6bb8700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 0x7f6ed00a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.317+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/1472188171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed005e2f0 con 0x7f6ed0066b20 2020-02-11T16:22:53.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.317+0000 7f6ecdffb700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6eb8039b50 0x7f6eb803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.317+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6ec4049550 con 0x7f6ed00a4a90 2020-02-11T16:22:53.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.317+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 0x7f6ed00a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.317+0000 7f6ed5155700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6eb8039b50 0x7f6eb803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecffff700 1 -- 172.21.15.88:0/1472188171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ed0066f30 con 0x7f6ed0066b20 2020-02-11T16:22:53.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 0x7f6ed00a2e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ed5155700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6eb8039b50 0x7f6eb803c010 crc :-1 s=READY pgs=414 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 0x7f6ed00a2e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 0x7f6ed00a2e10 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 0x7f6ed00a2e10 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ebc012c80 con 0x7f6ed0066b20 2020-02-11T16:22:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 0x7f6ed00a2e10 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6ebc015e90 con 0x7f6ed0066b20 2020-02-11T16:22:53.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 msgr2=0x7f6ed00a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecdffb700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 0x7f6ed00a2e10 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012530).stop 2020-02-11T16:22:53.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 msgr2=0x7f6ed00a2e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:53.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.318+0000 7f6ecdffb700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0066b20 0x7f6ed00a2e10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.329+0000 7f6ed6bb8700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 0x7f6ed015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.329+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/1472188171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0143320 con 0x7f6ed015e640 2020-02-11T16:22:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.329+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 0x7f6ed015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.329+0000 7f6ecffff700 1 -- 172.21.15.88:0/1472188171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6ed009fee0 con 0x7f6ed015e640 2020-02-11T16:22:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.329+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 0x7f6ed015ea20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.329+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 0x7f6ed015ea20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.329+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 0x7f6ed015ea20 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 0x7f6ed015ea20 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ebc002ed0 con 0x7f6ed015e640 2020-02-11T16:22:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ecffff700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 0x7f6ed015ea20 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4023 (secure 0 0 0) 0x7f6ebc005e60 con 0x7f6ed015e640 2020-02-11T16:22:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 msgr2=0x7f6ed015ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ecdffb700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 0x7f6ed015ea20 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012f70).stop 2020-02-11T16:22:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ecdffb700 1 -- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 msgr2=0x7f6ed015ea20 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ecdffb700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed015e640 0x7f6ed015ea20 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0x7f6ebc000b80 tx=0x7f6ebc012f70).stop 2020-02-11T16:22:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6eb8039b50 msgr2=0x7f6eb803c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ed6bb8700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6eb8039b50 0x7f6eb803c010 crc :-1 s=READY pgs=414 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/1472188171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ed00a4a90 msgr2=0x7f6ed0143b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ed6bb8700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ed00a4a90 0x7f6ed0143b80 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f6ed00a2d30 tx=0x7f6ec400c460).stop 2020-02-11T16:22:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ed5155700 1 -- 172.21.15.88:0/1472188171 reap_dead start 2020-02-11T16:22:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ed5155700 1 -- 172.21.15.88:0/1472188171 reap_dead start 2020-02-11T16:22:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/1472188171 shutdown_connections 2020-02-11T16:22:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ed6bb8700 1 --2- 172.21.15.88:0/1472188171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ed00a4a90 0x7f6ed0143b80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.330+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/1472188171 >> 172.21.15.88:0/1472188171 conn(0x7f6ed009d110 msgr2=0x7f6ed00a7290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.331+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/1472188171 shutdown_connections 2020-02-11T16:22:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.331+0000 7f6ed6bb8700 1 -- 172.21.15.88:0/1472188171 wait complete. 2020-02-11T16:22:53.339 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:22:53.339 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:53.339 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:53.339 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:22:53.339 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 140, 2020-02-11T16:22:53.340 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:22:53.340 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:22:53.340 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:22:53.340 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:22:53.340 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.340 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:22:53.340 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:53.341 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:22:53.341 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:22:53.341 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:53.341 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:53.341 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:53.341 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:53.342 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:53.342 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:53.342 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.342 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:22:53.342 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:22:53.342 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:53.342 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:53.343 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:53.343 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:53.343 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:53.343 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:53.343 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.344 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:22:53.344 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:22:53.344 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:22:53.344 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:22:53.344 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:22:53.344 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:22:53.344 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:53.345 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:53.345 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:22:53.345 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:22:53.345 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:53.345 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:22:53.345 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:53.346 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:53.346 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:53.346 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:53.346 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:53.346 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:53.347 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.347 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:22:53.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.347 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:22:53.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.348 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:53.348 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:53.348 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:53.348 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:53.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.349 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:53.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:22:53.349 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.350 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:53.350 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:22:53.350 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.350 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.350 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.351 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:22:53.351 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:22:53.351 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:53.351 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:53.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.352 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:22:53.352 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:22:53.352 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:53.352 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:53.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.352 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:53.353 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:22:53.353 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.353 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:53.354 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:22:53.354 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.354 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.354 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.354 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:22:53.355 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:22:53.355 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:53.355 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:53.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.355 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:53.355 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:53.356 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:53.356 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:53.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.356 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:53.356 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:22:53.356 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.357 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:53.357 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:22:53.357 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.357 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.357 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.358 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:22:53.358 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:22:53.358 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:53.358 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.360 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:53.360 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:53.360 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:22:53.360 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.360 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.360 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:22:53.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.361 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:53.361 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:53.361 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:22:53.361 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.361 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.362 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:22:53.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.362 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:53.362 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:53.362 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:22:53.362 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.363 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.363 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.363 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:22:53.364 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:22:53.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.488+0000 7f765f1d1700 1 Processor -- start 2020-02-11T16:22:53.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.488+0000 7f765f1d1700 1 -- start start 2020-02-11T16:22:53.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f765f1d1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76580a4050 0x7f76581315f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:22:53.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f765f1d1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76580a45c0 con 0x7f7658131a50 2020-02-11T16:22:53.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f765f1d1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7658138c00 con 0x7f76580a3490 2020-02-11T16:22:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f765f1d1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76580a47f0 con 0x7f76580a4050 2020-02-11T16:22:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76580a4050 0x7f76581315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76580a4050 0x7f76581315f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58274/0 (socket says 172.21.15.88:58274) 2020-02-11T16:22:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 -- 172.21.15.88:0/3806753924 learned_addr learned my addr 172.21.15.88:0/3806753924 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:22:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 -- 172.21.15.88:0/3806753924 >> v1:172.21.15.88:6789/0 conn(0x7f76580a3490 legacy=0x7f76581384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 -- 172.21.15.88:0/3806753924 >> v1:172.21.15.52:6789/0 conn(0x7f7658131a50 legacy=0x7f7658131ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:22:53.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 -- 172.21.15.88:0/3806753924 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7658137db0 con 0x7f76580a4050 2020-02-11T16:22:53.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 --2- 172.21.15.88:0/3806753924 >> v2:172.21.15.88:3300/0 conn(0x7f76580a4050 0x7f76581315f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76580a26f0 tx=0x7f76440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 --2- 172.21.15.88:0/3806753924 >> v2:172.21.15.88:3300/0 conn(0x7f76580a4050 0x7f76581315f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76580a26f0 tx=0x7f76440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 --2- 172.21.15.88:0/3806753924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76580a4050 0x7f76581315f0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f76440088e0).ready entity=mon.1 client_cookie=61de2720f8412e1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 --2- 172.21.15.88:0/3806753924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76580a4050 0x7f76581315f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f76440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f76577fe700 1 -- 172.21.15.88:0/3806753924 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7644008e10 con 0x7f76580a4050 2020-02-11T16:22:53.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 --2- 172.21.15.88:0/3806753924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76580a4050 0x7f76581315f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f76440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f7657fff700 1 --2- 172.21.15.88:0/3806753924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76580a4050 0x7f76581315f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f76440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f76577fe700 1 -- 172.21.15.88:0/3806753924 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76440107c0 con 0x7f76580a4050 2020-02-11T16:22:53.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f76577fe700 1 -- 172.21.15.88:0/3806753924 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7644010b20 con 0x7f76580a4050 2020-02-11T16:22:53.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f765f1d1700 1 -- 172.21.15.88:0/3806753924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76580a4050 msgr2=0x7f76581315f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.489+0000 7f765f1d1700 1 --2- 172.21.15.88:0/3806753924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76580a4050 0x7f76581315f0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f76440088e0).stop 2020-02-11T16:22:53.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.490+0000 7f765f1d1700 1 -- 172.21.15.88:0/3806753924 shutdown_connections 2020-02-11T16:22:53.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.490+0000 7f765f1d1700 1 --2- 172.21.15.88:0/3806753924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76580a4050 0x7f76581315f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.490+0000 7f765f1d1700 1 -- 172.21.15.88:0/3806753924 >> 172.21.15.88:0/3806753924 conn(0x7f76580aa480 msgr2=0x7f76580aa890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.490+0000 7f765f1d1700 1 -- 172.21.15.88:0/3806753924 shutdown_connections 2020-02-11T16:22:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.490+0000 7f765f1d1700 1 -- 172.21.15.88:0/3806753924 wait complete. 2020-02-11T16:22:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.491+0000 7f765f1d1700 1 Processor -- start 2020-02-11T16:22:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.491+0000 7f765f1d1700 1 -- start start 2020-02-11T16:22:53.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.491+0000 7f765f1d1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f76580a4050 0x7f76581352a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.491+0000 7f765f1d1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7658134b60 con 0x7f7658131a50 2020-02-11T16:22:53.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.491+0000 7f765f1d1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7658134e00 con 0x7f76580a3490 2020-02-11T16:22:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.491+0000 7f765f1d1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7658134970 con 0x7f76580a4050 2020-02-11T16:22:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f765cf6d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f76580a3490 0x7f765812fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45904/0 (socket says 172.21.15.88:45904) 2020-02-11T16:22:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f765cf6d700 1 -- 172.21.15.88:0/416532734 learned_addr learned my addr 172.21.15.88:0/416532734 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:22:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7657fff700 1 --2- 172.21.15.88:0/416532734 >> v2:172.21.15.52:3300/0 conn(0x7f76580a4050 0x7f76581352a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243829450 0 0) 0x7f7658134e00 con 0x7f76580a3490 2020-02-11T16:22:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7640002fe0 con 0x7f76580a3490 2020-02-11T16:22:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3077278514 0 0) 0x7f7640002fe0 con 0x7f76580a3490 2020-02-11T16:22:53.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7658134e00 con 0x7f76580a3490 2020-02-11T16:22:53.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f764c001930 con 0x7f76580a3490 2020-02-11T16:22:53.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7657fff700 1 -- 172.21.15.88:0/416532734 >> v1:172.21.15.88:6789/0 conn(0x7f76580a3490 legacy=0x7f765812fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7657fff700 1 -- 172.21.15.88:0/416532734 >> v1:172.21.15.52:6789/0 conn(0x7f7658131a50 legacy=0x7f765812b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7657fff700 1 -- 172.21.15.88:0/416532734 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76581301a0 con 0x7f76580a4050 2020-02-11T16:22:53.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7657fff700 1 --2- 172.21.15.88:0/416532734 >> v2:172.21.15.52:3300/0 conn(0x7f76580a4050 0x7f76581352a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f7658138d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7657fff700 1 --2- 172.21.15.88:0/416532734 >> v2:172.21.15.52:3300/0 conn(0x7f76580a4050 0x7f76581352a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f7658138d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7657fff700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76580a4050 0x7f76581352a0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f7658138d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7657fff700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76580a4050 0x7f76581352a0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f7658138d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7644007350 con 0x7f76580a4050 2020-02-11T16:22:53.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7657fff700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76580a4050 0x7f76581352a0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f7658138d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7657fff700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76580a4050 0x7f76581352a0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f7658138d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.492+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76440074b0 con 0x7f76580a4050 2020-02-11T16:22:53.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.493+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764400f5d0 con 0x7f76580a4050 2020-02-11T16:22:53.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.493+0000 7f765f1d1700 1 -- 172.21.15.88:0/416532734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7658137110 con 0x7f76580a4050 2020-02-11T16:22:53.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.493+0000 7f765f1d1700 1 -- 172.21.15.88:0/416532734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765812bfa0 con 0x7f76580a4050 2020-02-11T16:22:53.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.493+0000 7f7657fff700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76580a4050 0x7f76581352a0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f7658138d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.493+0000 7f765f1d1700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 0x7f76580a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.493+0000 7f765f1d1700 1 -- 172.21.15.88:0/416532734 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765805e2f0 con 0x7f7658132c30 2020-02-11T16:22:53.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.493+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f764400f730 con 0x7f76580a4050 2020-02-11T16:22:53.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.493+0000 7f7657fff700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76580a4050 0x7f76581352a0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f7658138d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 0x7f76580a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f7655ffb700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f764003a1f0 0x7f764003c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7644049920 con 0x7f76580a4050 2020-02-11T16:22:53.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f765cf6d700 1 -- 172.21.15.88:0/416532734 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7658134f90 con 0x7f7658132c30 2020-02-11T16:22:53.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f765d76e700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f764003a1f0 0x7f764003c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 0x7f76580a3870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 0x7f76580a3870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 0x7f76580a3870 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 0x7f76580a3870 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764c012e30 con 0x7f7658132c30 2020-02-11T16:22:53.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.494+0000 7f765d76e700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f764003a1f0 0x7f764003c6b0 crc :-1 s=READY pgs=415 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.495+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 0x7f76580a3870 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.495+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f764c0101a0 con 0x7f7658132c30 2020-02-11T16:22:53.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.495+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 msgr2=0x7f76580a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.495+0000 7f7655ffb700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 0x7f76580a3870 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).stop 2020-02-11T16:22:53.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.495+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 msgr2=0x7f76580a3870 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:53.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.495+0000 7f7655ffb700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658132c30 0x7f76580a3870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.504+0000 7f765f1d1700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 0x7f7658136020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:22:53.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.504+0000 7f765f1d1700 1 -- 172.21.15.88:0/416532734 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7658130390 con 0x7f7658135c10 2020-02-11T16:22:53.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.504+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 0x7f7658136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:22:53.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.504+0000 7f765cf6d700 1 -- 172.21.15.88:0/416532734 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f76580565b0 con 0x7f7658135c10 2020-02-11T16:22:53.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.504+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 0x7f7658136020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.504+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 0x7f7658136020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.504+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 0x7f7658136020 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:22:53.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 0x7f7658136020 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764c00b420 con 0x7f7658135c10 2020-02-11T16:22:53.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765cf6d700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 0x7f7658136020 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:22:53.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f764c0082a0 con 0x7f7658135c10 2020-02-11T16:22:53.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 msgr2=0x7f7658136020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f7655ffb700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 0x7f7658136020 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f764c001640 tx=0x7f764c0113b0).stop 2020-02-11T16:22:53.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f7655ffb700 1 -- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 msgr2=0x7f7658136020 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:22:53.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f7655ffb700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7658135c10 0x7f7658136020 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765f1d1700 1 -- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f764003a1f0 msgr2=0x7f764003c6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765f1d1700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f764003a1f0 0x7f764003c6b0 crc :-1 s=READY pgs=415 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765f1d1700 1 -- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76580a4050 msgr2=0x7f76581352a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:22:53.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765f1d1700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76580a4050 0x7f76581352a0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f76580a26f0 tx=0x7f7658138d90).stop 2020-02-11T16:22:53.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765d76e700 1 -- 172.21.15.88:0/416532734 reap_dead start 2020-02-11T16:22:53.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765f1d1700 1 -- 172.21.15.88:0/416532734 shutdown_connections 2020-02-11T16:22:53.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765f1d1700 1 --2- 172.21.15.88:0/416532734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76580a4050 0x7f76581352a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:22:53.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765f1d1700 1 -- 172.21.15.88:0/416532734 >> 172.21.15.88:0/416532734 conn(0x7f76580aa480 msgr2=0x7f7658138410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:22:53.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765f1d1700 1 -- 172.21.15.88:0/416532734 shutdown_connections 2020-02-11T16:22:53.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:22:53.505+0000 7f765f1d1700 1 -- 172.21.15.88:0/416532734 wait complete. 2020-02-11T16:22:53.514 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:22:53.514 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:53.514 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:53.515 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:22:53.515 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 140, 2020-02-11T16:22:53.515 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:22:53.515 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:22:53.515 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:22:53.515 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:22:53.515 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.516 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:22:53.516 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:53.516 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:22:53.516 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:22:53.516 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:53.516 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:53.516 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:53.516 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:53.517 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:53.517 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:53.517 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.517 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:22:53.517 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:22:53.517 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:53.518 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:53.518 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:53.518 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:53.518 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:53.518 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:53.518 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.519 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:22:53.519 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:22:53.519 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:22:53.519 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:22:53.519 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:22:53.519 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:22:53.519 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:53.520 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:22:53.520 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:22:53.520 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:22:53.520 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:22:53.520 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:22:53.520 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:22:53.520 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:22:53.520 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:22:53.521 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:22:53.521 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:22:53.521 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:22:53.521 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.521 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:22:53.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.522 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:22:53.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.522 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:22:53.522 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:22:53.522 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:53.522 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:53.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.523 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:53.523 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:22:53.523 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.523 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:53.524 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:22:53.524 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.524 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.524 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.524 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:22:53.524 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:22:53.524 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:53.525 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:53.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.525 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:22:53.525 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:22:53.525 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:53.525 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:53.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.526 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:53.526 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:22:53.526 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:53.527 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:22:53.527 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.527 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.527 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.528 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:22:53.528 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:22:53.528 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:53.528 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:53.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.528 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:22:53.528 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:22:53.529 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:22:53.529 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:22:53.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.529 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:22:53.529 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:22:53.529 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.530 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:22:53.530 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:22:53.530 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:22:53.530 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.530 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.531 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:22:53.531 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:22:53.531 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:22:53.531 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:22:53.531 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.531 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:22:53.532 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:22:53.532 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:22:53.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.532 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:53.532 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:53.533 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:22:53.533 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.533 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.533 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:22:53.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.533 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:53.533 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:53.533 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:22:53.534 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.534 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.534 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:22:53.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.534 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:53.534 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:53.534 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:22:53.535 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.535 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.535 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:22:53.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.535 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:53.535 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:53.535 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:22:53.536 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.536 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:22:53.536 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:22:53.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:22:53.536 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:22:53.536 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:22:53.536 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:22:53.536 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.537 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:22:53.537 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:22:53.537 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:22:53.538 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:22:53.538 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2020-02-11T16:22:53.538 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:22:53.539 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:22:53.539 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:22:53.539 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:22:53.547 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:22:53.547 INFO:tasks.mon_thrash:Sending STOP to mon b 2020-02-11T16:22:53.548 INFO:tasks.ceph.mon.b:Sent signal 19 2020-02-11T16:22:53.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2020-02-11T16:23:08.549 INFO:tasks.mon_thrash:Sending CONT to mon b 2020-02-11T16:23:08.549 INFO:tasks.ceph.mon.b:Sent signal 18 2020-02-11T16:23:08.549 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:23:08.549 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:23:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.672+0000 7fe6ca8ae700 1 Processor -- start 2020-02-11T16:23:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.672+0000 7fe6ca8ae700 1 -- start start 2020-02-11T16:23:08.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.673+0000 7fe6ca8ae700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:08.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.673+0000 7fe6ca8ae700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c40a4350 con 0x7fe6c4131280 2020-02-11T16:23:08.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.673+0000 7fe6ca8ae700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c40a3a40 con 0x7fe6c40a2fa0 2020-02-11T16:23:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.673+0000 7fe6ca8ae700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c40a1e60 con 0x7fe6c40a5b20 2020-02-11T16:23:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.673+0000 7fe6c3fff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fe6c40a2fa0 legacy=0x7fe6c40a5410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:23:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.673+0000 7fe6c37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.673+0000 7fe6c37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44278/0 (socket says 172.21.15.88:44278) 2020-02-11T16:23:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.673+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 learned_addr learned my addr 172.21.15.88:0/2860457850 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:23:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.673+0000 7fe6c8e4b700 1 --1- 172.21.15.88:0/2860457850 >> v1:172.21.15.52:6789/0 conn(0x7fe6c4131280 0x7fe6c41316f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37702/0 (socket says 172.21.15.88:37702) 2020-02-11T16:23:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.674+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:23:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.674+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:23:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.674+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:23:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.674+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:23:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.874+0000 7fe6c3fff700 1 -- 172.21.15.88:0/2860457850 >> v1:172.21.15.88:6789/0 conn(0x7fe6c40a2fa0 legacy=0x7fe6c40a5410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:23:08.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.875+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:08.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.875+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:23:08.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.875+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:23:08.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.875+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:23:08.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:08.875+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:23:09.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:09.275+0000 7fe6c3fff700 1 -- 172.21.15.88:0/2860457850 >> v1:172.21.15.88:6789/0 conn(0x7fe6c40a2fa0 legacy=0x7fe6c40a5410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:23:09.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:09.276+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:09.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:09.276+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:23:09.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:09.276+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:23:09.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:09.276+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:23:09.279 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:09.276+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:23:10.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:10.076+0000 7fe6c3fff700 1 -- 172.21.15.88:0/2860457850 >> v1:172.21.15.88:6789/0 conn(0x7fe6c40a2fa0 legacy=0x7fe6c40a5410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:23:10.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:10.077+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:10.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:10.077+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:23:10.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:10.077+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:23:10.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:10.077+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:23:10.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:10.077+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:23:11.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:11.677+0000 7fe6c3fff700 1 -- 172.21.15.88:0/2860457850 >> v1:172.21.15.88:6789/0 conn(0x7fe6c40a2fa0 legacy=0x7fe6c40a5410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:23:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:11.679+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:11.679+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:23:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:11.679+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:23:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:11.679+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:23:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:11.679+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:23:13.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.557+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557773415 0 0) 0x7fe6c40a4350 con 0x7fe6c4131280 2020-02-11T16:23:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.557+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b0003230 con 0x7fe6c4131280 2020-02-11T16:23:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.559+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1209104050 0 0) 0x7fe6b0003230 con 0x7fe6c4131280 2020-02-11T16:23:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.559+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 msgr2=0x7fe6c40a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:23:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 --2- 172.21.15.88:0/2860457850 >> v2:172.21.15.52:3300/0 conn(0x7fe6c40a5b20 0x7fe6c40a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 >> v1:172.21.15.88:6789/0 conn(0x7fe6c40a2fa0 legacy=0x7fe6c40a5410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:23:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c40a3ce0 con 0x7fe6c4131280 2020-02-11T16:23:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe6bc001a30 con 0x7fe6c4131280 2020-02-11T16:23:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 >> v1:172.21.15.52:6789/0 conn(0x7fe6c4131280 legacy=0x7fe6c41316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6b0003720 0x7fe6b0003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 0x7fe6b00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6b0004a20 0x7fe6b0004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c40a1e60 con 0x7fe6b0003fa0 2020-02-11T16:23:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b000b7b0 con 0x7fe6b0004a20 2020-02-11T16:23:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b000b970 con 0x7fe6b0003720 2020-02-11T16:23:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c8e4b700 1 -- 172.21.15.88:0/2860457850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6b0004a20 msgr2=0x7fe6b0004ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:23:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6b0004a20 0x7fe6b0004ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:23:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c3fff700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6b0003720 0x7fe6b0003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 0x7fe6b00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6b0003720 msgr2=0x7fe6b0003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:23:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6b0003720 0x7fe6b0003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6b0004a20 msgr2=0x7fe6b0004ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:23:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6b0004a20 0x7fe6b0004ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c8e4b700 1 -- 172.21.15.88:0/2860457850 reap_dead start 2020-02-11T16:23:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c37fe700 1 -- 172.21.15.88:0/2860457850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b0003230 con 0x7fe6b0003fa0 2020-02-11T16:23:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c3fff700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6b0003720 0x7fe6b0003b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:23:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 0x7fe6b00044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe6b8002f30 tx=0x7fe6b8010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.560+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 0x7fe6b00044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe6b8002f30 tx=0x7fe6b8010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.561+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 0x7fe6b00044d0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fe6b8002f30 tx=0x7fe6b8010090).ready entity=mon.0 client_cookie=ca36a7cd6bae09d0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:13.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.561+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 0x7fe6b00044d0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fe6b8002f30 tx=0x7fe6b8010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.561+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6b8010980 con 0x7fe6b0003fa0 2020-02-11T16:23:13.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.561+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 0x7fe6b00044d0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fe6b8002f30 tx=0x7fe6b8010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.561+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b8010ae0 con 0x7fe6b0003fa0 2020-02-11T16:23:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.561+0000 7fe6c37fe700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 0x7fe6b00044d0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fe6b8002f30 tx=0x7fe6b8010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.561+0000 7fe6c2ffd700 1 -- 172.21.15.88:0/2860457850 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6b8010e40 con 0x7fe6b0003fa0 2020-02-11T16:23:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.561+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 msgr2=0x7fe6b00044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.561+0000 7fe6ca8ae700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 0x7fe6b00044d0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fe6b8002f30 tx=0x7fe6b8010090).stop 2020-02-11T16:23:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.562+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/2860457850 shutdown_connections 2020-02-11T16:23:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.562+0000 7fe6ca8ae700 1 --2- 172.21.15.88:0/2860457850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6b0003fa0 0x7fe6b00044d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.562+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/2860457850 >> 172.21.15.88:0/2860457850 conn(0x7fe6c409d110 msgr2=0x7fe6c409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.562+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/2860457850 shutdown_connections 2020-02-11T16:23:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.562+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/2860457850 wait complete. 2020-02-11T16:23:13.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.563+0000 7fe6ca8ae700 1 Processor -- start 2020-02-11T16:23:13.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.563+0000 7fe6ca8ae700 1 -- start start 2020-02-11T16:23:13.578 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6ca8ae700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6c40a0480 0x7fe6c4130a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:13.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6ca8ae700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6c4061630 0x7fe6c4063d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:13.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6ca8ae700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c4064590 con 0x7fe6b0003fa0 2020-02-11T16:23:13.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6ca8ae700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c40642f0 con 0x7fe6c4061630 2020-02-11T16:23:13.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6ca8ae700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c4061190 con 0x7fe6c40a0480 2020-02-11T16:23:13.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c3fff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fe6b0003fa0 legacy=0x7fe6c4130300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:23:13.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c37fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fe6c40a0480 msgr2=0x7fe6c4130a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:23:13.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6c40a0480 0x7fe6c4130a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:23:13.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c8e4b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6c4061630 0x7fe6c4063d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:13.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c8e4b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6c4061630 0x7fe6c4063d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44308/0 (socket says 172.21.15.88:44308) 2020-02-11T16:23:13.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c8e4b700 1 -- 172.21.15.88:0/1709584921 learned_addr learned my addr 172.21.15.88:0/1709584921 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:23:13.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c8e4b700 1 -- 172.21.15.88:0/1709584921 >> v2:172.21.15.88:3300/0 conn(0x7fe6c40a0480 msgr2=0x7fe6c4130a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:23:13.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> v2:172.21.15.88:3300/0 conn(0x7fe6c40a0480 0x7fe6c4130a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c8e4b700 1 -- 172.21.15.88:0/1709584921 >> v1:172.21.15.88:6789/0 conn(0x7fe6b0003fa0 legacy=0x7fe6c4130300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:23:13.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c8e4b700 1 -- 172.21.15.88:0/1709584921 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c4067140 con 0x7fe6c4061630 2020-02-11T16:23:13.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> v2:172.21.15.52:3300/0 conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> v2:172.21.15.52:3300/0 conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.564+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:13.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.565+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.565+0000 7fe6c17fa700 1 -- 172.21.15.88:0/1709584921 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6bc004c50 con 0x7fe6c4061630 2020-02-11T16:23:13.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.565+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/1709584921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c40a0950 con 0x7fe6c4061630 2020-02-11T16:23:13.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.565+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/1709584921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c4061d80 con 0x7fe6c4061630 2020-02-11T16:23:13.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.565+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.565+0000 7fe6c17fa700 1 -- 172.21.15.88:0/1709584921 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc001550 con 0x7fe6c4061630 2020-02-11T16:23:13.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.565+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.565+0000 7fe6c17fa700 1 -- 172.21.15.88:0/1709584921 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6bc004db0 con 0x7fe6c4061630 2020-02-11T16:23:13.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.566+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.566+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/1709584921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a0003340 con 0x7fe6c4061630 2020-02-11T16:23:13.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.566+0000 7fe6c17fa700 1 -- 172.21.15.88:0/1709584921 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe6bc012420 con 0x7fe6c4061630 2020-02-11T16:23:13.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.566+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.566+0000 7fe6c17fa700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6a4039bf0 0x7fe6a403c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:13.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.566+0000 7fe6c17fa700 1 -- 172.21.15.88:0/1709584921 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe6bc049590 con 0x7fe6c4061630 2020-02-11T16:23:13.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.566+0000 7fe6c3fff700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6a4039bf0 0x7fe6a403c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:13.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.567+0000 7fe6c3fff700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6a4039bf0 0x7fe6a403c0b0 crc :-1 s=READY pgs=416 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:13.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.570+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.570+0000 7fe6c17fa700 1 -- 172.21.15.88:0/1709584921 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe6bc02ebb0 con 0x7fe6c4061630 2020-02-11T16:23:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.829+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/1709584921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe6a00036e0 con 0x7fe6c4061630 2020-02-11T16:23:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.830+0000 7fe6c8e4b700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.830+0000 7fe6c17fa700 1 -- 172.21.15.88:0/1709584921 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fe6bc0316c0 con 0x7fe6c4061630 2020-02-11T16:23:13.834 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":144,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:23:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.831+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6a4039bf0 msgr2=0x7fe6a403c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.831+0000 7fe6ca8ae700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6a4039bf0 0x7fe6a403c0b0 crc :-1 s=READY pgs=416 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.831+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 msgr2=0x7fe6c4063d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.831+0000 7fe6ca8ae700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 0x7fe6c4063d00 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fe6c4061510 tx=0x7fe6bc010b40).stop 2020-02-11T16:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.832+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/1709584921 shutdown_connections 2020-02-11T16:23:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.832+0000 7fe6ca8ae700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6a4039bf0 0x7fe6a403c0b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.832+0000 7fe6ca8ae700 1 --2- 172.21.15.88:0/1709584921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c4061630 0x7fe6c4063d00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.832+0000 7fe6ca8ae700 1 --2- 172.21.15.88:0/1709584921 >> v2:172.21.15.88:3300/0 conn(0x7fe6c40a0480 0x7fe6c4130a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.832+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/1709584921 >> 172.21.15.88:0/1709584921 conn(0x7fe6c409d110 msgr2=0x7fe6c4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:13.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.832+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/1709584921 shutdown_connections 2020-02-11T16:23:13.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.832+0000 7fe6ca8ae700 1 -- 172.21.15.88:0/1709584921 wait complete. 2020-02-11T16:23:13.845 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":144,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:23:13.845 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:23:13.845 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:23:13.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.956+0000 7f79fe447700 1 Processor -- start 2020-02-11T16:23:13.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.956+0000 7f79fe447700 1 -- start start 2020-02-11T16:23:13.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.957+0000 7f79fe447700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 0x7f79f80a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:13.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.957+0000 7f79fe447700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 0x7f79f80a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:13.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.957+0000 7f79fe447700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f80a4350 con 0x7f79f8131280 2020-02-11T16:23:13.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.957+0000 7f79fe447700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f80a1e60 con 0x7f79f80a5410 2020-02-11T16:23:13.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.957+0000 7f79fe447700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80a3450 con 0x7f79f80a2fa0 2020-02-11T16:23:13.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.957+0000 7f79effff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 msgr2=0x7f79f80a5890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:23:13.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.957+0000 7f79effff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 0x7f79f80a5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:23:13.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.957+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 0x7f79f80a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:13.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.957+0000 7f79fc9e4700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f79f8131280 0x7f79f81316f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37738/0 (socket says 172.21.15.88:37738) 2020-02-11T16:23:13.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.957+0000 7f79fc9e4700 1 -- 172.21.15.88:0/657335082 learned_addr learned my addr 172.21.15.88:0/657335082 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:23:13.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f77fe700 1 -- 172.21.15.88:0/657335082 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017948526 0 0) 0x7f79f80a4350 con 0x7f79f8131280 2020-02-11T16:23:13.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f7fff700 1 -- 172.21.15.88:0/657335082 >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 msgr2=0x7f79f80a5890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:23:13.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f7fff700 1 --2- 172.21.15.88:0/657335082 >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 0x7f79f80a5890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:13.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f7fff700 1 -- 172.21.15.88:0/657335082 >> v1:172.21.15.52:6789/0 conn(0x7f79f8131280 legacy=0x7f79f81316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:13.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f7fff700 1 -- 172.21.15.88:0/657335082 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f80a3a40 con 0x7f79f80a2fa0 2020-02-11T16:23:13.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f7fff700 1 --2- 172.21.15.88:0/657335082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 0x7f79f80a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79e8002f30 tx=0x7f79e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f7fff700 1 --2- 172.21.15.88:0/657335082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 0x7f79f80a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79e8002f30 tx=0x7f79e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f7fff700 1 --2- 172.21.15.88:0/657335082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 0x7f79f80a1520 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e80088e0).ready entity=mon.2 client_cookie=70f0e8ebecd5d450 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:13.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f7fff700 1 --2- 172.21.15.88:0/657335082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 0x7f79f80a1520 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f7fff700 1 --2- 172.21.15.88:0/657335082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 0x7f79f80a1520 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f77fe700 1 -- 172.21.15.88:0/657335082 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e8008d30 con 0x7f79f80a2fa0 2020-02-11T16:23:13.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f7fff700 1 --2- 172.21.15.88:0/657335082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 0x7f79f80a1520 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f77fe700 1 -- 172.21.15.88:0/657335082 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e8008e90 con 0x7f79f80a2fa0 2020-02-11T16:23:13.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79f77fe700 1 -- 172.21.15.88:0/657335082 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e80138b0 con 0x7f79f80a2fa0 2020-02-11T16:23:13.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79fe447700 1 -- 172.21.15.88:0/657335082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 msgr2=0x7f79f80a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:13.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.958+0000 7f79fe447700 1 --2- 172.21.15.88:0/657335082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 0x7f79f80a1520 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e80088e0).stop 2020-02-11T16:23:13.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.959+0000 7f79fe447700 1 -- 172.21.15.88:0/657335082 shutdown_connections 2020-02-11T16:23:13.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.959+0000 7f79fe447700 1 --2- 172.21.15.88:0/657335082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79f80a2fa0 0x7f79f80a1520 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.959+0000 7f79fe447700 1 --2- 172.21.15.88:0/657335082 >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 0x7f79f80a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:13.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.959+0000 7f79fe447700 1 -- 172.21.15.88:0/657335082 >> 172.21.15.88:0/657335082 conn(0x7f79f809d110 msgr2=0x7f79f809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:13.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.959+0000 7f79fe447700 1 -- 172.21.15.88:0/657335082 shutdown_connections 2020-02-11T16:23:13.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.959+0000 7f79fe447700 1 -- 172.21.15.88:0/657335082 wait complete. 2020-02-11T16:23:13.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79fe447700 1 Processor -- start 2020-02-11T16:23:13.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79fe447700 1 -- start start 2020-02-11T16:23:13.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79fe447700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 0x7f79f80a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:13.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79fe447700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79f8131280 0x7f79f8140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:13.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79fe447700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f8135330 con 0x7f79f80a2fa0 2020-02-11T16:23:13.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79fe447700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f80a9300 con 0x7f79f8131280 2020-02-11T16:23:13.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79fe447700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f8130a40 con 0x7f79f80a5410 2020-02-11T16:23:13.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79f7fff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f79f80a2fa0 legacy=0x7f79f812ff10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:23:13.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79effff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 msgr2=0x7f79f80a8ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:23:13.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79effff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 0x7f79f80a8ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:23:13.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79fc9e4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79f8131280 0x7f79f8140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:13.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79fc9e4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79f8131280 0x7f79f8140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44322/0 (socket says 172.21.15.88:44322) 2020-02-11T16:23:13.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.960+0000 7f79fc9e4700 1 -- 172.21.15.88:0/1340589627 learned_addr learned my addr 172.21.15.88:0/1340589627 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:23:13.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fc9e4700 1 -- 172.21.15.88:0/1340589627 >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 msgr2=0x7f79f80a8ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:23:13.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fc9e4700 1 --2- 172.21.15.88:0/1340589627 >> v2:172.21.15.88:3300/0 conn(0x7f79f80a5410 0x7f79f80a8ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fc9e4700 1 -- 172.21.15.88:0/1340589627 >> v1:172.21.15.88:6789/0 conn(0x7f79f80a2fa0 legacy=0x7f79f812ff10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:23:13.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fc9e4700 1 -- 172.21.15.88:0/1340589627 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f80aadf0 con 0x7f79f8131280 2020-02-11T16:23:13.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fc9e4700 1 --2- 172.21.15.88:0/1340589627 >> v2:172.21.15.52:3300/0 conn(0x7f79f8131280 0x7f79f8140b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79f80a37d0 tx=0x7f79f0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fc9e4700 1 --2- 172.21.15.88:0/1340589627 >> v2:172.21.15.52:3300/0 conn(0x7f79f8131280 0x7f79f8140b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79f80a37d0 tx=0x7f79f0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fc9e4700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8131280 0x7f79f8140b50 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f79f80a37d0 tx=0x7f79f0010d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:13.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fc9e4700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8131280 0x7f79f8140b50 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f79f80a37d0 tx=0x7f79f0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f0005e30 con 0x7f79f8131280 2020-02-11T16:23:13.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fc9e4700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8131280 0x7f79f8140b50 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f79f80a37d0 tx=0x7f79f0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fc9e4700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8131280 0x7f79f8140b50 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f79f80a37d0 tx=0x7f79f0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f00125a0 con 0x7f79f8131280 2020-02-11T16:23:13.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fe447700 1 -- 172.21.15.88:0/1340589627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f80a8760 con 0x7f79f8131280 2020-02-11T16:23:13.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f0012980 con 0x7f79f8131280 2020-02-11T16:23:13.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.961+0000 7f79fe447700 1 -- 172.21.15.88:0/1340589627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f8140fb0 con 0x7f79f8131280 2020-02-11T16:23:13.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.962+0000 7f79fc9e4700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8131280 0x7f79f8140b50 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f79f80a37d0 tx=0x7f79f0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.962+0000 7f79fe447700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 0x7f79f805adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:13.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.962+0000 7f79fe447700 1 -- 172.21.15.88:0/1340589627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f805e2f0 con 0x7f79f80a0c10 2020-02-11T16:23:13.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.962+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f79f0012bf0 con 0x7f79f8131280 2020-02-11T16:23:13.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.962+0000 7f79fc9e4700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8131280 0x7f79f8140b50 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f79f80a37d0 tx=0x7f79f0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.962+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 0x7f79f805adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:13.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.962+0000 7f79f5ffb700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039b90 0x7f79dc03c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:13.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.962+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f79f004a110 con 0x7f79f8131280 2020-02-11T16:23:13.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79effff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039b90 0x7f79dc03c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:13.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f7fff700 1 -- 172.21.15.88:0/1340589627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79f80aa2c0 con 0x7f79f80a0c10 2020-02-11T16:23:13.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 0x7f79f805adc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 0x7f79f805adc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 0x7f79f805adc0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:13.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79effff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039b90 0x7f79dc03c050 crc :-1 s=READY pgs=417 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:13.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 0x7f79f805adc0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e800d5d0 con 0x7f79f80a0c10 2020-02-11T16:23:13.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 0x7f79f805adc0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f79e800d730 con 0x7f79f80a0c10 2020-02-11T16:23:13.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 msgr2=0x7f79f805adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f5ffb700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 0x7f79f805adc0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).stop 2020-02-11T16:23:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 msgr2=0x7f79f805adc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:23:13.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.963+0000 7f79f5ffb700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f80a0c10 0x7f79f805adc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.971+0000 7f79fe447700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 0x7f79f8136ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:13.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.971+0000 7f79fe447700 1 -- 172.21.15.88:0/1340589627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f81307e0 con 0x7f79f8136900 2020-02-11T16:23:13.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.971+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 0x7f79f8136ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:13.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f7fff700 1 -- 172.21.15.88:0/1340589627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f79f80a8bc0 con 0x7f79f8136900 2020-02-11T16:23:13.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 0x7f79f8136ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 0x7f79f8136ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 0x7f79f8136ce0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:13.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 0x7f79f8136ce0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e8011160 con 0x7f79f8136900 2020-02-11T16:23:13.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f7fff700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 0x7f79f8136ce0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:13.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4011 (secure 0 0 0) 0x7f79e80112c0 con 0x7f79f8136900 2020-02-11T16:23:13.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 msgr2=0x7f79f8136ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:13.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f5ffb700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 0x7f79f8136ce0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).stop 2020-02-11T16:23:13.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f5ffb700 1 -- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 msgr2=0x7f79f8136ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:23:13.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.972+0000 7f79f5ffb700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8136900 0x7f79f8136ce0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0x7f79e8007ed0 tx=0x7f79f8067410).stop 2020-02-11T16:23:13.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fe447700 1 -- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039b90 msgr2=0x7f79dc03c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:13.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fe447700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039b90 0x7f79dc03c050 crc :-1 s=READY pgs=417 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fe447700 1 -- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8131280 msgr2=0x7f79f8140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:13.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fe447700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8131280 0x7f79f8140b50 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f79f80a37d0 tx=0x7f79f0010d50).stop 2020-02-11T16:23:13.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fc9e4700 1 -- 172.21.15.88:0/1340589627 reap_dead start 2020-02-11T16:23:13.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fc9e4700 1 -- 172.21.15.88:0/1340589627 reap_dead start 2020-02-11T16:23:13.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fe447700 1 -- 172.21.15.88:0/1340589627 shutdown_connections 2020-02-11T16:23:13.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fe447700 1 --2- 172.21.15.88:0/1340589627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79f8131280 0x7f79f8140b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:13.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fe447700 1 -- 172.21.15.88:0/1340589627 >> 172.21.15.88:0/1340589627 conn(0x7f79f809d110 msgr2=0x7f79f8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:13.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fe447700 1 -- 172.21.15.88:0/1340589627 shutdown_connections 2020-02-11T16:23:13.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:13.973+0000 7f79fe447700 1 -- 172.21.15.88:0/1340589627 wait complete. 2020-02-11T16:23:13.992 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:23:13.992 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:23:13.992 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:23:13.993 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:23:13.993 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 144, 2020-02-11T16:23:13.993 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:23:13.993 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:23:13.994 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:23:13.995 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:13.995 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:23:13.995 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:23:13.995 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:23:13.995 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:23:13.996 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:13.996 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:13.996 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:13.996 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:13.996 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:13.997 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:13.997 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:13.997 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:23:13.997 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:23:13.998 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:13.998 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:13.998 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:13.998 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:13.999 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:13.999 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:13.999 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:13.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:13.999 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:23:14.000 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:23:14.000 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:23:14.000 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:23:14.000 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:23:14.001 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:23:14.001 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:23:14.001 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:23:14.001 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:23:14.001 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:23:14.002 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:23:14.002 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:23:14.002 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:14.002 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:14.003 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:14.003 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:14.003 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:14.003 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:14.003 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:14.003 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:23:14.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.004 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:23:14.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.004 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:23:14.005 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:23:14.005 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:14.005 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:14.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.005 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:14.006 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:23:14.006 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.007 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:14.007 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:23:14.007 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.007 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.008 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.008 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:23:14.009 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:23:14.009 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:14.009 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:14.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.010 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:23:14.010 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:23:14.010 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:14.010 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:14.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.011 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:14.011 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:23:14.011 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.012 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:14.012 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:23:14.013 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.013 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.013 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.014 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:23:14.014 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:23:14.014 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:14.014 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:14.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.015 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:23:14.015 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:23:14.015 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:14.016 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:14.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.016 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:14.016 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:23:14.017 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.017 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:14.017 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:23:14.018 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.018 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.018 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.019 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:23:14.019 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:23:14.019 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:14.019 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:14.020 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.020 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.020 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:23:14.020 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:23:14.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.021 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:14.021 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:14.021 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:23:14.022 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.022 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:14.022 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:23:14.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.023 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:14.023 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:14.023 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:23:14.023 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.023 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:14.024 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:23:14.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.024 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:14.024 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:14.025 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:23:14.025 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.025 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.025 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.026 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:23:14.026 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:23:14.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.146+0000 7f55713e2700 1 Processor -- start 2020-02-11T16:23:14.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.146+0000 7f55713e2700 1 -- start start 2020-02-11T16:23:14.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f55713e2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f556c0a2fa0 0x7f556c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:14.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f55713e2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:14.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f55713e2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c0a4350 con 0x7f556c131280 2020-02-11T16:23:14.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f55713e2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556c0a1e60 con 0x7f556c0a2fa0 2020-02-11T16:23:14.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f55713e2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0a3450 con 0x7f556c0a5410 2020-02-11T16:23:14.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556affd700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f556c0a2fa0 msgr2=0x7f556c0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:23:14.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556b7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f556c131280 legacy=0x7f556c1316f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:23:14.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f556c0a2fa0 0x7f556c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:23:14.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556a7fc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:14.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556a7fc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52670/0 (socket says 172.21.15.88:52670) 2020-02-11T16:23:14.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556a7fc700 1 -- 172.21.15.88:0/865292430 learned_addr learned my addr 172.21.15.88:0/865292430 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:23:14.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556a7fc700 1 -- 172.21.15.88:0/865292430 >> v2:172.21.15.88:3300/0 conn(0x7f556c0a2fa0 msgr2=0x7f556c0a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:23:14.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556a7fc700 1 --2- 172.21.15.88:0/865292430 >> v2:172.21.15.88:3300/0 conn(0x7f556c0a2fa0 0x7f556c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:14.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556a7fc700 1 -- 172.21.15.88:0/865292430 >> v1:172.21.15.88:6789/0 conn(0x7f556c131280 legacy=0x7f556c1316f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:23:14.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556a7fc700 1 -- 172.21.15.88:0/865292430 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c0a3a40 con 0x7f556c0a5410 2020-02-11T16:23:14.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556a7fc700 1 --2- 172.21.15.88:0/865292430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f556c0a52f0 tx=0x7f55600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556a7fc700 1 --2- 172.21.15.88:0/865292430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f556c0a52f0 tx=0x7f55600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.147+0000 7f556a7fc700 1 --2- 172.21.15.88:0/865292430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f556c0a52f0 tx=0x7f55600088e0).ready entity=mon.2 client_cookie=6db2390568b404db server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:14.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f556a7fc700 1 --2- 172.21.15.88:0/865292430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f556c0a52f0 tx=0x7f55600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f556a7fc700 1 --2- 172.21.15.88:0/865292430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f556c0a52f0 tx=0x7f55600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f5569ffb700 1 -- 172.21.15.88:0/865292430 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5560008e20 con 0x7f556c0a5410 2020-02-11T16:23:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f556a7fc700 1 --2- 172.21.15.88:0/865292430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f556c0a52f0 tx=0x7f55600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f5569ffb700 1 -- 172.21.15.88:0/865292430 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5560011910 con 0x7f556c0a5410 2020-02-11T16:23:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f5569ffb700 1 -- 172.21.15.88:0/865292430 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5560011cb0 con 0x7f556c0a5410 2020-02-11T16:23:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f55713e2700 1 -- 172.21.15.88:0/865292430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 msgr2=0x7f556c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f55713e2700 1 --2- 172.21.15.88:0/865292430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f556c0a52f0 tx=0x7f55600088e0).stop 2020-02-11T16:23:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f55713e2700 1 -- 172.21.15.88:0/865292430 shutdown_connections 2020-02-11T16:23:14.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f55713e2700 1 --2- 172.21.15.88:0/865292430 >> v2:172.21.15.88:3300/0 conn(0x7f556c0a2fa0 0x7f556c0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:14.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f55713e2700 1 --2- 172.21.15.88:0/865292430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f556c0a5410 0x7f556c0a5870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f55713e2700 1 -- 172.21.15.88:0/865292430 >> 172.21.15.88:0/865292430 conn(0x7f556c09d110 msgr2=0x7f556c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:14.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f55713e2700 1 -- 172.21.15.88:0/865292430 shutdown_connections 2020-02-11T16:23:14.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.148+0000 7f55713e2700 1 -- 172.21.15.88:0/865292430 wait complete. 2020-02-11T16:23:14.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.149+0000 7f55713e2700 1 Processor -- start 2020-02-11T16:23:14.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.149+0000 7f55713e2700 1 -- start start 2020-02-11T16:23:14.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f55713e2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f556c131280 0x7f556c066c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:14.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f55713e2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c135330 con 0x7f556c0a2fa0 2020-02-11T16:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f55713e2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c0a0020 con 0x7f556c0a5410 2020-02-11T16:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f55713e2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556c12ff30 con 0x7f556c131280 2020-02-11T16:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f556a7fc700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f556c0a5410 legacy=0x7f556c12f820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f556b7fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f556c131280 msgr2=0x7f556c066c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f556b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f556c131280 0x7f556c066c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f556affd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f556c0a2fa0 0x7f556c12f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37758/0 (socket says 172.21.15.88:37758) 2020-02-11T16:23:14.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f556affd700 1 -- 172.21.15.88:0/4051144384 learned_addr learned my addr 172.21.15.88:0/4051144384 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:23:14.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060193530 0 0) 0x7f556c135330 con 0x7f556c0a2fa0 2020-02-11T16:23:14.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.150+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5548002fe0 con 0x7f556c0a2fa0 2020-02-11T16:23:14.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 338869009 0 0) 0x7f5548002fe0 con 0x7f556c0a2fa0 2020-02-11T16:23:14.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f556c135330 con 0x7f556c0a2fa0 2020-02-11T16:23:14.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f555c004000 con 0x7f556c0a2fa0 2020-02-11T16:23:14.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 >> v2:172.21.15.88:3300/0 conn(0x7f556c131280 msgr2=0x7f556c066c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:23:14.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 --2- 172.21.15.88:0/4051144384 >> v2:172.21.15.88:3300/0 conn(0x7f556c131280 0x7f556c066c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 >> v1:172.21.15.88:6789/0 conn(0x7f556c0a5410 legacy=0x7f556c12f820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:23:14.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 >> v1:172.21.15.52:6789/0 conn(0x7f556c0a2fa0 legacy=0x7f556c12f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:14.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55480049b0 0x7f5548004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:14.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:14.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5548003ef0 0x7f5548004370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:14.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556affd700 1 -- 172.21.15.88:0/4051144384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55480049b0 msgr2=0x7f5548004d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:23:14.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c12ff30 con 0x7f5548005260 2020-02-11T16:23:14.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554800b860 con 0x7f55480049b0 2020-02-11T16:23:14.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55480049b0 0x7f5548004d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:23:14.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554800ba20 con 0x7f5548003ef0 2020-02-11T16:23:14.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:14.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556b7fe700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5548003ef0 0x7f5548004370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556a7fc700 1 -- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5548003ef0 msgr2=0x7f5548004370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5548003ef0 0x7f5548004370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556a7fc700 1 -- 172.21.15.88:0/4051144384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55480049b0 msgr2=0x7f5548004d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55480049b0 0x7f5548004d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556a7fc700 1 -- 172.21.15.88:0/4051144384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c09f9c0 con 0x7f5548005260 2020-02-11T16:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556b7fe700 1 -- 172.21.15.88:0/4051144384 reap_dead start 2020-02-11T16:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f55713e2700 1 -- 172.21.15.88:0/4051144384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556c067130 con 0x7f5548005260 2020-02-11T16:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55600084c0 tx=0x7f556c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f55713e2700 1 -- 172.21.15.88:0/4051144384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c0a0ee0 con 0x7f5548005260 2020-02-11T16:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55600084c0 tx=0x7f556c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.151+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f55600084c0 tx=0x7f556c067410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f55600084c0 tx=0x7f556c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5560007150 con 0x7f5548005260 2020-02-11T16:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f55600084c0 tx=0x7f556c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f55600084c0 tx=0x7f556c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55600072b0 con 0x7f5548005260 2020-02-11T16:23:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55600056c0 con 0x7f5548005260 2020-02-11T16:23:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f55600084c0 tx=0x7f556c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f55713e2700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 0x7f554c0058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f55713e2700 1 -- 172.21.15.88:0/4051144384 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c005ea0 con 0x7f554c003420 2020-02-11T16:23:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 0x7f554c0058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5560005820 con 0x7f5548005260 2020-02-11T16:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.152+0000 7f556a7fc700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f55600084c0 tx=0x7f556c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f556affd700 1 -- 172.21.15.88:0/4051144384 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f554c006060 con 0x7f554c003420 2020-02-11T16:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f555bfff700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f554803dc20 0x7f55480400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 0x7f554c0058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f556004a0a0 con 0x7f5548005260 2020-02-11T16:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 0x7f554c0058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 0x7f554c0058e0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:14.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f556b7fe700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f554803dc20 0x7f55480400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:14.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 0x7f554c0058e0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f555c00a390 con 0x7f554c003420 2020-02-11T16:23:14.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f556b7fe700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f554803dc20 0x7f55480400e0 crc :-1 s=READY pgs=418 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:14.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 0x7f554c0058e0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f555c010930 con 0x7f554c003420 2020-02-11T16:23:14.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 msgr2=0x7f554c0058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:14.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f555bfff700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 0x7f554c0058e0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).stop 2020-02-11T16:23:14.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 msgr2=0x7f554c0058e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:23:14.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.153+0000 7f555bfff700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 0x7f554c0058e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.162+0000 7f55713e2700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 0x7f554c0068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.162+0000 7f55713e2700 1 -- 172.21.15.88:0/4051144384 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c006d80 con 0x7f554c006440 2020-02-11T16:23:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.163+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 0x7f554c0068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.163+0000 7f556affd700 1 -- 172.21.15.88:0/4051144384 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f554c006f40 con 0x7f554c006440 2020-02-11T16:23:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.163+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 0x7f554c0068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.163+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 0x7f554c0068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.163+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 0x7f554c0068f0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:14.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.163+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 0x7f554c0068f0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.163+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f555c00ae30 con 0x7f554c006440 2020-02-11T16:23:14.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f556affd700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 0x7f554c0068f0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:14.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f555c010160 con 0x7f554c006440 2020-02-11T16:23:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 msgr2=0x7f554c0068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f555bfff700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 0x7f554c0068f0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f555c003760 tx=0x7f555c0113a0).stop 2020-02-11T16:23:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f555bfff700 1 -- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 msgr2=0x7f554c0068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:23:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f555bfff700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 0x7f554c0068f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 -- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f554803dc20 msgr2=0x7f55480400e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f554803dc20 0x7f55480400e0 crc :-1 s=READY pgs=418 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 -- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 msgr2=0x7f5548003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f55600084c0 tx=0x7f556c067410).stop 2020-02-11T16:23:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 -- 172.21.15.88:0/4051144384 shutdown_connections 2020-02-11T16:23:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f554803dc20 0x7f55480400e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5548005260 0x7f5548003980 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c003420 0x7f554c0058e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 --2- 172.21.15.88:0/4051144384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f554c006440 0x7f554c0068f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 -- 172.21.15.88:0/4051144384 >> 172.21.15.88:0/4051144384 conn(0x7f556c09d110 msgr2=0x7f556c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 -- 172.21.15.88:0/4051144384 shutdown_connections 2020-02-11T16:23:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:14.164+0000 7f55713e2700 1 -- 172.21.15.88:0/4051144384 wait complete. 2020-02-11T16:23:14.180 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:23:14.180 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:23:14.181 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:23:14.181 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:23:14.181 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 144, 2020-02-11T16:23:14.181 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:23:14.181 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:23:14.182 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:23:14.182 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:14.182 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:23:14.182 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:23:14.182 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:23:14.182 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:23:14.182 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:14.183 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:14.183 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:14.183 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:14.183 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:14.183 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:14.184 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:14.184 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:23:14.184 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:23:14.184 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:14.184 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:14.184 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:14.184 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:14.184 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:14.185 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:14.185 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.185 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:23:14.185 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:23:14.185 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:23:14.185 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:23:14.186 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:23:14.186 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:23:14.186 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:23:14.186 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:23:14.186 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:23:14.186 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:23:14.186 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:23:14.187 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:23:14.187 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:14.187 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:14.187 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:14.187 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:14.187 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:14.187 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:14.187 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:14.188 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:23:14.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:23:14.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.188 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:23:14.188 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:23:14.188 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:14.189 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:14.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.189 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:14.189 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:23:14.189 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.190 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:14.190 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:23:14.190 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.190 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.190 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.190 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:23:14.190 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:23:14.191 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:14.191 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:14.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.191 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:23:14.191 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:23:14.191 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:14.192 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:14.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.192 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:14.192 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:23:14.192 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.192 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:14.193 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:23:14.193 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.193 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.193 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.194 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:23:14.194 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:23:14.194 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:14.194 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:14.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.194 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:23:14.195 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:23:14.195 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:14.195 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:14.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.195 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:14.195 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:23:14.195 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.196 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:14.196 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:23:14.196 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:14.196 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.196 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.197 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:23:14.197 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:23:14.197 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:14.197 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:14.197 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.197 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:14.198 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:23:14.198 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:23:14.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.198 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:14.198 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:14.198 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:23:14.199 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.199 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:14.199 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:23:14.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.199 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:14.199 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:14.199 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:23:14.200 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.200 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:14.200 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:23:14.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.200 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:14.200 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:14.200 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:23:14.201 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.201 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:14.201 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:23:14.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.201 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:14.201 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:14.202 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:23:14.202 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.202 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:14.203 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:23:14.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:14.203 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:14.203 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:14.203 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:23:14.203 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.203 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:14.204 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:14.204 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:23:14.205 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:23:14.790 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:23:14.793 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:23:34.207 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:23:34.207 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:23:34.207 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:23:34.207 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:23:34.209 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:23:34.209 INFO:tasks.mon_thrash:Sending STOP to mon b 2020-02-11T16:23:34.210 INFO:tasks.ceph.mon.b:Sent signal 19 2020-02-11T16:23:34.210 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2020-02-11T16:23:44.863 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:23:44.865 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:23:49.213 INFO:tasks.mon_thrash:Sending CONT to mon b 2020-02-11T16:23:49.214 INFO:tasks.ceph.mon.b:Sent signal 18 2020-02-11T16:23:49.214 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:23:49.214 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:23:49.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.336+0000 7fbbb37fa700 1 Processor -- start 2020-02-11T16:23:49.339 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.336+0000 7fbbb37fa700 1 -- start start 2020-02-11T16:23:49.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb37fa700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:49.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb37fa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac0adb40 con 0x7fbbac0ad380 2020-02-11T16:23:49.340 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb37fa700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac137de0 con 0x7fbbac131920 2020-02-11T16:23:49.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb37fa700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac137bf0 con 0x7fbbac0a9130 2020-02-11T16:23:49.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb1d97700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbbac131920 0x7fbbac131d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46018/0 (socket says 172.21.15.88:46018) 2020-02-11T16:23:49.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb1d97700 1 -- 172.21.15.88:0/3577064254 learned_addr learned my addr 172.21.15.88:0/3577064254 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:23:49.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:49.341 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:23:49.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:23:49.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:23:49.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.337+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:23:49.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.538+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:49.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.538+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:23:49.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.538+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:23:49.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.538+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:23:49.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.538+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:23:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.939+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.939+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:23:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.939+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:23:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.939+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:23:49.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:49.939+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:23:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:50.740+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:50.740+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:23:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:50.740+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:23:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:50.740+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:23:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:50.740+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:23:52.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:52.342+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:52.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:52.342+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:23:52.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:52.342+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:23:52.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:52.342+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:23:52.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:52.342+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:23:54.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.222+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787204266 0 0) 0x7fbbac0adb40 con 0x7fbbac0ad380 2020-02-11T16:23:54.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.222+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb94003230 con 0x7fbbac0ad380 2020-02-11T16:23:54.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.244+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1810529012 0 0) 0x7fbb94003230 con 0x7fbbac0ad380 2020-02-11T16:23:54.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.244+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbbac1314c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:23:54.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.244+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbbac1314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:54.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 >> v1:172.21.15.88:6789/0 conn(0x7fbbac131920 legacy=0x7fbbac131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac0a8e70 con 0x7fbbac0ad380 2020-02-11T16:23:54.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fbba80016d0 con 0x7fbbac0ad380 2020-02-11T16:23:54.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 >> v1:172.21.15.52:6789/0 conn(0x7fbbac0ad380 legacy=0x7fbbac138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb94003750 0x7fbb94003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:54.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:54.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbb94004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:54.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94004200 con 0x7fbb94003750 2020-02-11T16:23:54.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94005210 con 0x7fbb940044d0 2020-02-11T16:23:54.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9400b720 con 0x7fbbac0a9130 2020-02-11T16:23:54.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb1596700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb94003750 0x7fbb94003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb1d97700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbb94004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 msgr2=0x7fbb94004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:23:54.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbac0a9130 0x7fbb94004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:54.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb94003750 msgr2=0x7fbb94003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:23:54.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb94003750 0x7fbb94003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:54.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 -- 172.21.15.88:0/3577064254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94003230 con 0x7fbb940044d0 2020-02-11T16:23:54.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb9c002f30 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb9c002f30 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fbb9c002f30 tx=0x7fbb9c00bbd0).ready entity=mon.1 client_cookie=1701e4471e5caac6 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fbb9c002f30 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fbb9c002f30 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9c00eb60 con 0x7fbb940044d0 2020-02-11T16:23:54.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fbb9c002f30 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c00ecc0 con 0x7fbb940044d0 2020-02-11T16:23:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3577064254 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9c00ee30 con 0x7fbb940044d0 2020-02-11T16:23:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb37fa700 1 -- 172.21.15.88:0/3577064254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940044d0 msgr2=0x7fbb94004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb37fa700 1 --2- 172.21.15.88:0/3577064254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fbb9c002f30 tx=0x7fbb9c00bbd0).stop 2020-02-11T16:23:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.245+0000 7fbbb1d97700 1 -- 172.21.15.88:0/3577064254 reap_dead start 2020-02-11T16:23:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.246+0000 7fbbb37fa700 1 -- 172.21.15.88:0/3577064254 shutdown_connections 2020-02-11T16:23:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.246+0000 7fbbb37fa700 1 -- 172.21.15.88:0/3577064254 >> 172.21.15.88:0/3577064254 conn(0x7fbbac05ac70 msgr2=0x7fbbac0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.246+0000 7fbbb37fa700 1 -- 172.21.15.88:0/3577064254 shutdown_connections 2020-02-11T16:23:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.246+0000 7fbbb37fa700 1 -- 172.21.15.88:0/3577064254 wait complete. 2020-02-11T16:23:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.247+0000 7fbbb37fa700 1 Processor -- start 2020-02-11T16:23:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.247+0000 7fbbb37fa700 1 -- start start 2020-02-11T16:23:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb37fa700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbac0a6ad0 0x7fbbac128360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb37fa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac12a810 con 0x7fbbac0a7ed0 2020-02-11T16:23:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb37fa700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac12aab0 con 0x7fbbac130ac0 2020-02-11T16:23:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb37fa700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac0ac3d0 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb1596700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbbac130ac0 0x7fbbac0a77c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46034/0 (socket says 172.21.15.88:46034) 2020-02-11T16:23:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb1596700 1 -- 172.21.15.88:0/142423311 learned_addr learned my addr 172.21.15.88:0/142423311 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:23:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> v2:172.21.15.52:3300/0 conn(0x7fbbac0a6ad0 0x7fbbac128360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb0d95700 1 -- 172.21.15.88:0/142423311 >> v1:172.21.15.88:6789/0 conn(0x7fbbac130ac0 legacy=0x7fbbac0a77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb0d95700 1 -- 172.21.15.88:0/142423311 >> v1:172.21.15.52:6789/0 conn(0x7fbbac0a7ed0 legacy=0x7fbbac1287c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb0d95700 1 -- 172.21.15.88:0/142423311 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac0a5a70 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.248+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> v2:172.21.15.52:3300/0 conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.249+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> v2:172.21.15.52:3300/0 conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.249+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.250+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.250+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/142423311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9c0058b0 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.250+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.250+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/142423311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c005a10 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.250+0000 7fbbb37fa700 1 -- 172.21.15.88:0/142423311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac12a420 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.250+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.250+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/142423311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9c005df0 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.250+0000 7fbbb37fa700 1 -- 172.21.15.88:0/142423311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac129110 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.251+0000 7fbbb37fa700 1 -- 172.21.15.88:0/142423311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac0a7500 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.252+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.253+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/142423311 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fbb9c010560 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.253+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.253+0000 7fbb9a7fc700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb8c039ab0 0x7fbb8c03bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.253+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/142423311 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fbb9c049d80 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.253+0000 7fbbb1596700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb8c039ab0 0x7fbb8c03bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.254+0000 7fbbb1596700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb8c039ab0 0x7fbb8c03bf70 crc :-1 s=READY pgs=420 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.256+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.256+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/142423311 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbb9c031f10 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.479+0000 7fbbb37fa700 1 -- 172.21.15.88:0/142423311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbbac0a7500 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.479+0000 7fbbb0d95700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.479+0000 7fbb9a7fc700 1 -- 172.21.15.88:0/142423311 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fbb9c00a510 con 0x7fbbac0a6ad0 2020-02-11T16:23:54.482 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:23:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.481+0000 7fbbb37fa700 1 -- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb8c039ab0 msgr2=0x7fbb8c03bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.481+0000 7fbbb37fa700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb8c039ab0 0x7fbb8c03bf70 crc :-1 s=READY pgs=420 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.481+0000 7fbbb37fa700 1 -- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 msgr2=0x7fbbac128360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.481+0000 7fbbb37fa700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 0x7fbbac128360 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fbbac129440 tx=0x7fbb9c00bbd0).stop 2020-02-11T16:23:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.481+0000 7fbbb37fa700 1 -- 172.21.15.88:0/142423311 shutdown_connections 2020-02-11T16:23:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.481+0000 7fbbb37fa700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbb8c039ab0 0x7fbb8c03bf70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.481+0000 7fbbb37fa700 1 --2- 172.21.15.88:0/142423311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbac0a6ad0 0x7fbbac128360 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.481+0000 7fbbb37fa700 1 -- 172.21.15.88:0/142423311 >> 172.21.15.88:0/142423311 conn(0x7fbbac05ac70 msgr2=0x7fbbac069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.481+0000 7fbbb37fa700 1 -- 172.21.15.88:0/142423311 shutdown_connections 2020-02-11T16:23:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.481+0000 7fbbb37fa700 1 -- 172.21.15.88:0/142423311 wait complete. 2020-02-11T16:23:54.495 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":150,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:23:54.495 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:23:54.495 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:23:54.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.609+0000 7fc9e007b700 1 Processor -- start 2020-02-11T16:23:54.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.609+0000 7fc9e007b700 1 -- start start 2020-02-11T16:23:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.610+0000 7fc9e007b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9d813b6f0 0x7fc9d8143640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.610+0000 7fc9e007b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d8138360 con 0x7fc9d813b290 2020-02-11T16:23:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.610+0000 7fc9e007b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d8138600 con 0x7fc9d8131f50 2020-02-11T16:23:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.610+0000 7fc9e007b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d8138180 con 0x7fc9d813b6f0 2020-02-11T16:23:54.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.610+0000 7fc9de618700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9d813b6f0 0x7fc9d8143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.610+0000 7fc9de618700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9d813b6f0 0x7fc9d8143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58420/0 (socket says 172.21.15.88:58420) 2020-02-11T16:23:54.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.610+0000 7fc9de618700 1 -- 172.21.15.88:0/1610316092 learned_addr learned my addr 172.21.15.88:0/1610316092 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:23:54.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.610+0000 7fc9dde17700 1 --1- 172.21.15.88:0/1610316092 >> v1:172.21.15.88:6789/0 conn(0x7fc9d8131f50 0x7fc9d805f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46042/0 (socket says 172.21.15.88:46042) 2020-02-11T16:23:54.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9de618700 1 -- 172.21.15.88:0/1610316092 >> v1:172.21.15.88:6789/0 conn(0x7fc9d8131f50 legacy=0x7fc9d805f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9de618700 1 -- 172.21.15.88:0/1610316092 >> v1:172.21.15.52:6789/0 conn(0x7fc9d813b290 legacy=0x7fc9d809d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9dce15700 1 -- 172.21.15.88:0/1610316092 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877499821 0 0) 0x7fc9d8138360 con 0x7fc9d813b290 2020-02-11T16:23:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9de618700 1 -- 172.21.15.88:0/1610316092 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d809d8b0 con 0x7fc9d813b6f0 2020-02-11T16:23:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9de618700 1 --2- 172.21.15.88:0/1610316092 >> v2:172.21.15.88:3300/0 conn(0x7fc9d813b6f0 0x7fc9d8143640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9d00032b0 tx=0x7fc9d0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9de618700 1 --2- 172.21.15.88:0/1610316092 >> v2:172.21.15.88:3300/0 conn(0x7fc9d813b6f0 0x7fc9d8143640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9d00032b0 tx=0x7fc9d0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9de618700 1 --2- 172.21.15.88:0/1610316092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d8143640 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d0008c60).ready entity=mon.1 client_cookie=205d6f2a2ae544a3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9de618700 1 --2- 172.21.15.88:0/1610316092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d8143640 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9dce15700 1 -- 172.21.15.88:0/1610316092 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d000a160 con 0x7fc9d813b6f0 2020-02-11T16:23:54.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9de618700 1 --2- 172.21.15.88:0/1610316092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d8143640 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9de618700 1 --2- 172.21.15.88:0/1610316092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d8143640 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9dce15700 1 -- 172.21.15.88:0/1610316092 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d000a2c0 con 0x7fc9d813b6f0 2020-02-11T16:23:54.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9dce15700 1 -- 172.21.15.88:0/1610316092 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d000a6a0 con 0x7fc9d813b6f0 2020-02-11T16:23:54.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9e007b700 1 -- 172.21.15.88:0/1610316092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 msgr2=0x7fc9d8143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9e007b700 1 --2- 172.21.15.88:0/1610316092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d8143640 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d0008c60).stop 2020-02-11T16:23:54.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9e007b700 1 -- 172.21.15.88:0/1610316092 shutdown_connections 2020-02-11T16:23:54.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9e007b700 1 --2- 172.21.15.88:0/1610316092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d8143640 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.611+0000 7fc9e007b700 1 -- 172.21.15.88:0/1610316092 >> 172.21.15.88:0/1610316092 conn(0x7fc9d80a7bb0 msgr2=0x7fc9d80a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:54.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.612+0000 7fc9e007b700 1 -- 172.21.15.88:0/1610316092 shutdown_connections 2020-02-11T16:23:54.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.612+0000 7fc9e007b700 1 -- 172.21.15.88:0/1610316092 wait complete. 2020-02-11T16:23:54.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.612+0000 7fc9e007b700 1 Processor -- start 2020-02-11T16:23:54.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.612+0000 7fc9e007b700 1 -- start start 2020-02-11T16:23:54.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9e007b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9d8131f50 0x7fc9d8144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9e007b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc9d813ac20 0x7fc9d8134c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9e007b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d8133750 con 0x7fc9d813b290 2020-02-11T16:23:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9e007b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d8145770 con 0x7fc9d813ac20 2020-02-11T16:23:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9e007b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d8145a10 con 0x7fc9d8131f50 2020-02-11T16:23:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9dde17700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9d8131f50 0x7fc9d8144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9dde17700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9d8131f50 0x7fc9d8144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58422/0 (socket says 172.21.15.88:58422) 2020-02-11T16:23:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9dde17700 1 -- 172.21.15.88:0/2571454764 learned_addr learned my addr 172.21.15.88:0/2571454764 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:23:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> v2:172.21.15.52:3300/0 conn(0x7fc9d813ac20 0x7fc9d8134c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9dde17700 1 -- 172.21.15.88:0/2571454764 >> v2:172.21.15.52:3300/0 conn(0x7fc9d813ac20 msgr2=0x7fc9d8134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9dde17700 1 --2- 172.21.15.88:0/2571454764 >> v2:172.21.15.52:3300/0 conn(0x7fc9d813ac20 0x7fc9d8134c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9dde17700 1 -- 172.21.15.88:0/2571454764 >> v1:172.21.15.88:6789/0 conn(0x7fc9d813b290 legacy=0x7fc9d80a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9dde17700 1 -- 172.21.15.88:0/2571454764 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8145cb0 con 0x7fc9d8131f50 2020-02-11T16:23:54.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.613+0000 7fc9dde17700 1 --2- 172.21.15.88:0/2571454764 >> v2:172.21.15.88:3300/0 conn(0x7fc9d8131f50 0x7fc9d8144ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9d8132b80 tx=0x7fc9d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9dde17700 1 --2- 172.21.15.88:0/2571454764 >> v2:172.21.15.88:3300/0 conn(0x7fc9d8131f50 0x7fc9d8144ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9d8132b80 tx=0x7fc9d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9dde17700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d8131f50 0x7fc9d8144ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fc9d8132b80 tx=0x7fc9d40109d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9dde17700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d8131f50 0x7fc9d8144ed0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fc9d8132b80 tx=0x7fc9d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9dde17700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d8131f50 0x7fc9d8144ed0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fc9d8132b80 tx=0x7fc9d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9dde17700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d8131f50 0x7fc9d8144ed0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fc9d8132b80 tx=0x7fc9d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d40048d0 con 0x7fc9d8131f50 2020-02-11T16:23:54.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d4004a30 con 0x7fc9d8131f50 2020-02-11T16:23:54.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d4004e50 con 0x7fc9d8131f50 2020-02-11T16:23:54.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9e007b700 1 -- 172.21.15.88:0/2571454764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d8145330 con 0x7fc9d8131f50 2020-02-11T16:23:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9e007b700 1 -- 172.21.15.88:0/2571454764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d80a2f00 con 0x7fc9d8131f50 2020-02-11T16:23:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.614+0000 7fc9dde17700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d8131f50 0x7fc9d8144ed0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fc9d8132b80 tx=0x7fc9d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc9d4012330 con 0x7fc9d8131f50 2020-02-11T16:23:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9dde17700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d8131f50 0x7fc9d8144ed0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fc9d8132b80 tx=0x7fc9d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9c6ffd700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc9b8039b90 0x7fc9b803c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc9d4049990 con 0x7fc9d8131f50 2020-02-11T16:23:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9e007b700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d813a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9e007b700 1 -- 172.21.15.88:0/2571454764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d805e2f0 con 0x7fc9d813b6f0 2020-02-11T16:23:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d813a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9dd616700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc9b8039b90 0x7fc9b803c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9de618700 1 -- 172.21.15.88:0/2571454764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9d80565b0 con 0x7fc9d813b6f0 2020-02-11T16:23:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d813a0d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d813a0d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d813a0d0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9dd616700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc9b8039b90 0x7fc9b803c050 crc :-1 s=READY pgs=421 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d813a0d0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.615+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d000a770 con 0x7fc9d813b6f0 2020-02-11T16:23:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.616+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d813a0d0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.616+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fc9d0005c30 con 0x7fc9d813b6f0 2020-02-11T16:23:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.616+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 msgr2=0x7fc9d813a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.616+0000 7fc9c6ffd700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d813a0d0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).stop 2020-02-11T16:23:54.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.616+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 msgr2=0x7fc9d813a0d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:23:54.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.616+0000 7fc9c6ffd700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d813b6f0 0x7fc9d813a0d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.624+0000 7fc9e007b700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 0x7fc9d8135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.624+0000 7fc9e007b700 1 -- 172.21.15.88:0/2571454764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80a2460 con 0x7fc9d81353e0 2020-02-11T16:23:54.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.624+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 0x7fc9d8135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.624+0000 7fc9de618700 1 -- 172.21.15.88:0/2571454764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc9d805cb20 con 0x7fc9d81353e0 2020-02-11T16:23:54.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.624+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 0x7fc9d8135cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.624+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 0x7fc9d8135cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.624+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 0x7fc9d8135cb0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.624+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 0x7fc9d8135cb0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.624+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d00078b0 con 0x7fc9d81353e0 2020-02-11T16:23:54.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9de618700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 0x7fc9d8135cb0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7fc9d000d3d0 con 0x7fc9d81353e0 2020-02-11T16:23:54.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 msgr2=0x7fc9d8135cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9c6ffd700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 0x7fc9d8135cb0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).stop 2020-02-11T16:23:54.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9c6ffd700 1 -- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 msgr2=0x7fc9d8135cb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:23:54.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9c6ffd700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d81353e0 0x7fc9d8135cb0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0x7fc9d00032b0 tx=0x7fc9d80600c0).stop 2020-02-11T16:23:54.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9e007b700 1 -- 172.21.15.88:0/2571454764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc9b8039b90 msgr2=0x7fc9b803c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9e007b700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc9b8039b90 0x7fc9b803c050 crc :-1 s=READY pgs=421 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9e007b700 1 -- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d8131f50 msgr2=0x7fc9d8144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9e007b700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d8131f50 0x7fc9d8144ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fc9d8132b80 tx=0x7fc9d40109d0).stop 2020-02-11T16:23:54.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9de618700 1 -- 172.21.15.88:0/2571454764 reap_dead start 2020-02-11T16:23:54.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9e007b700 1 -- 172.21.15.88:0/2571454764 shutdown_connections 2020-02-11T16:23:54.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9e007b700 1 --2- 172.21.15.88:0/2571454764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d8131f50 0x7fc9d8144ed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9e007b700 1 -- 172.21.15.88:0/2571454764 >> 172.21.15.88:0/2571454764 conn(0x7fc9d80a7bb0 msgr2=0x7fc9d8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:54.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9e007b700 1 -- 172.21.15.88:0/2571454764 shutdown_connections 2020-02-11T16:23:54.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.625+0000 7fc9e007b700 1 -- 172.21.15.88:0/2571454764 wait complete. 2020-02-11T16:23:54.636 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:23:54.636 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:23:54.636 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:23:54.636 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:23:54.636 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 150, 2020-02-11T16:23:54.637 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:23:54.637 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:23:54.637 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:23:54.637 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:23:54.637 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:54.637 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:23:54.638 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:23:54.638 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:23:54.638 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:23:54.638 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:54.638 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:54.638 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:54.638 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:54.638 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:54.639 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:54.639 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:54.639 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:23:54.639 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:23:54.639 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:54.639 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:54.639 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:54.640 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:54.640 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:54.640 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:54.640 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.640 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:23:54.640 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:23:54.641 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:23:54.641 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:23:54.641 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:23:54.641 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:23:54.641 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:23:54.641 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:23:54.641 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:23:54.642 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:23:54.642 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:23:54.642 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:23:54.642 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:54.642 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:54.642 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:54.642 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:54.642 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:54.643 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:54.643 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:54.643 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:23:54.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.647 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:23:54.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.648 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:23:54.648 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:23:54.648 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:54.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:54.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.648 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:54.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:23:54.649 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.649 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:54.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:23:54.649 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.650 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.650 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:23:54.650 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:23:54.650 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:54.650 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:54.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.651 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:23:54.651 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:23:54.651 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:54.651 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:54.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.652 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:54.652 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:23:54.652 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.652 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:54.652 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:23:54.652 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.653 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.653 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.653 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:23:54.653 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:23:54.653 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:54.653 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:54.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.654 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:23:54.654 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:23:54.654 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:54.654 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:54.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.657 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:54.657 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:23:54.657 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.658 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:54.658 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:23:54.659 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.659 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.659 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:23:54.659 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:23:54.659 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:54.660 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:54.660 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.660 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.660 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:23:54.660 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:23:54.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.661 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:54.661 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:54.661 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:23:54.661 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.661 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:54.661 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:23:54.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.662 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:54.662 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:54.662 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:23:54.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.662 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.662 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:23:54.664 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:23:54.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.791+0000 7fc1c872e700 1 Processor -- start 2020-02-11T16:23:54.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.791+0000 7fc1c872e700 1 -- start start 2020-02-11T16:23:54.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c872e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 0x7fc1c00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:54.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c872e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c00a31b0 con 0x7fc1c00a6260 2020-02-11T16:23:54.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c872e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c00a3570 con 0x7fc1c00a5de0 2020-02-11T16:23:54.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c872e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00a3810 con 0x7fc1c00a18a0 2020-02-11T16:23:54.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c5cc9700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc1c00a5de0 0x7fc1c012e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46062/0 (socket says 172.21.15.88:46062) 2020-02-11T16:23:54.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c5cc9700 1 -- 172.21.15.88:0/3767606580 learned_addr learned my addr 172.21.15.88:0/3767606580 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:23:54.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3767606580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 0x7fc1c00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c54c8700 1 -- 172.21.15.88:0/3767606580 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533733598 0 0) 0x7fc1c00a3570 con 0x7fc1c00a5de0 2020-02-11T16:23:54.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c54c8700 1 -- 172.21.15.88:0/3767606580 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a8003230 con 0x7fc1c00a5de0 2020-02-11T16:23:54.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c54c8700 1 -- 172.21.15.88:0/3767606580 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736993030 0 0) 0x7fc1c00a31b0 con 0x7fc1c00a6260 2020-02-11T16:23:54.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.792+0000 7fc1c54c8700 1 -- 172.21.15.88:0/3767606580 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1c00a3570 con 0x7fc1c00a6260 2020-02-11T16:23:54.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c64ca700 1 -- 172.21.15.88:0/3767606580 >> v1:172.21.15.88:6789/0 conn(0x7fc1c00a5de0 legacy=0x7fc1c012e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c54c8700 1 -- 172.21.15.88:0/3767606580 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2886819254 0 0) 0x7fc1a8003230 con 0x7fc1c00a5de0 2020-02-11T16:23:54.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c64ca700 1 -- 172.21.15.88:0/3767606580 >> v1:172.21.15.52:6789/0 conn(0x7fc1c00a6260 legacy=0x7fc1c012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c64ca700 1 -- 172.21.15.88:0/3767606580 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c00a3ab0 con 0x7fc1c00a18a0 2020-02-11T16:23:54.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3767606580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 0x7fc1c00a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc1b00010d0 tx=0x7fc1bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3767606580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 0x7fc1c00a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc1b00010d0 tx=0x7fc1bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3767606580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 0x7fc1c00a6dd0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fc1b00010d0 tx=0x7fc1bc0088e0).ready entity=mon.2 client_cookie=e94df087d2a09f1d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3767606580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 0x7fc1c00a6dd0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fc1b00010d0 tx=0x7fc1bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c54c8700 1 -- 172.21.15.88:0/3767606580 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1b00016d0 con 0x7fc1c00a18a0 2020-02-11T16:23:54.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3767606580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 0x7fc1c00a6dd0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fc1b00010d0 tx=0x7fc1bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3767606580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 0x7fc1c00a6dd0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fc1b00010d0 tx=0x7fc1bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c54c8700 1 -- 172.21.15.88:0/3767606580 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc011210 con 0x7fc1c00a18a0 2020-02-11T16:23:54.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c54c8700 1 -- 172.21.15.88:0/3767606580 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1bc011570 con 0x7fc1c00a18a0 2020-02-11T16:23:54.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c872e700 1 -- 172.21.15.88:0/3767606580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 msgr2=0x7fc1c00a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.793+0000 7fc1c872e700 1 --2- 172.21.15.88:0/3767606580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 0x7fc1c00a6dd0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fc1b00010d0 tx=0x7fc1bc0088e0).stop 2020-02-11T16:23:54.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.794+0000 7fc1c872e700 1 -- 172.21.15.88:0/3767606580 shutdown_connections 2020-02-11T16:23:54.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.794+0000 7fc1c872e700 1 --2- 172.21.15.88:0/3767606580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1c00a18a0 0x7fc1c00a6dd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.794+0000 7fc1c872e700 1 -- 172.21.15.88:0/3767606580 >> 172.21.15.88:0/3767606580 conn(0x7fc1c009d110 msgr2=0x7fc1c009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:54.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.794+0000 7fc1c872e700 1 -- 172.21.15.88:0/3767606580 shutdown_connections 2020-02-11T16:23:54.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.794+0000 7fc1c872e700 1 -- 172.21.15.88:0/3767606580 wait complete. 2020-02-11T16:23:54.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.794+0000 7fc1c872e700 1 Processor -- start 2020-02-11T16:23:54.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.795+0000 7fc1c872e700 1 -- start start 2020-02-11T16:23:54.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.795+0000 7fc1c872e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1c00a6260 0x7fc1c0126970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.795+0000 7fc1c872e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c012eab0 con 0x7fc1c00a18a0 2020-02-11T16:23:54.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.795+0000 7fc1c872e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c012ed50 con 0x7fc1c00a5de0 2020-02-11T16:23:54.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.795+0000 7fc1c872e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c012f620 con 0x7fc1c00a6260 2020-02-11T16:23:54.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.795+0000 7fc1c5cc9700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc1c00a5de0 0x7fc1c0126260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46068/0 (socket says 172.21.15.88:46068) 2020-02-11T16:23:54.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.795+0000 7fc1c5cc9700 1 -- 172.21.15.88:0/3260333875 learned_addr learned my addr 172.21.15.88:0/3260333875 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:23:54.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.795+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> v2:172.21.15.52:3300/0 conn(0x7fc1c00a6260 0x7fc1c0126970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.795+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334931772 0 0) 0x7fc1c012ed50 con 0x7fc1c00a5de0 2020-02-11T16:23:54.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.795+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a0002fe0 con 0x7fc1c00a5de0 2020-02-11T16:23:54.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1920348350 0 0) 0x7fc1a0002fe0 con 0x7fc1c00a5de0 2020-02-11T16:23:54.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc1c012ed50 con 0x7fc1c00a5de0 2020-02-11T16:23:54.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fc1b00044f0 con 0x7fc1c00a5de0 2020-02-11T16:23:54.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 >> v2:172.21.15.52:3300/0 conn(0x7fc1c00a6260 msgr2=0x7fc1c0126970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 --2- 172.21.15.88:0/3260333875 >> v2:172.21.15.52:3300/0 conn(0x7fc1c00a6260 0x7fc1c0126970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 >> v1:172.21.15.88:6789/0 conn(0x7fc1c00a5de0 legacy=0x7fc1c0126260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 >> v1:172.21.15.52:6789/0 conn(0x7fc1c00a18a0 legacy=0x7fc1c012fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1a0003920 0x7fc1a0005d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a00062c0 0x7fc1a00089e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c012f620 con 0x7fc1a00062c0 2020-02-11T16:23:54.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a000b870 con 0x7fc1a0008e40 2020-02-11T16:23:54.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a000ba30 con 0x7fc1a0003920 2020-02-11T16:23:54.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1a0003920 0x7fc1a0005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c5cc9700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a00062c0 0x7fc1a00089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 -- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1a0003920 msgr2=0x7fc1a0005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1a0003920 0x7fc1a0005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 -- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a00062c0 msgr2=0x7fc1a00089e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a00062c0 0x7fc1a00089e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 -- 172.21.15.88:0/3260333875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c012eff0 con 0x7fc1a0008e40 2020-02-11T16:23:54.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c872e700 1 -- 172.21.15.88:0/3260333875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c006a280 con 0x7fc1a0008e40 2020-02-11T16:23:54.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1a0003920 0x7fc1a0005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:23:54.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1b8001450 tx=0x7fc1b8011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 -- 172.21.15.88:0/3260333875 reap_dead start 2020-02-11T16:23:54.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c872e700 1 -- 172.21.15.88:0/3260333875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c0131410 con 0x7fc1a0008e40 2020-02-11T16:23:54.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1b8001450 tx=0x7fc1b8011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fc1b8001450 tx=0x7fc1b8011020).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fc1b8001450 tx=0x7fc1b8011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.796+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1b8006c40 con 0x7fc1a0008e40 2020-02-11T16:23:54.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.797+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fc1b8001450 tx=0x7fc1b8011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.797+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b8006da0 con 0x7fc1a0008e40 2020-02-11T16:23:54.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.797+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fc1b8001450 tx=0x7fc1b8011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.797+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1b8011840 con 0x7fc1a0008e40 2020-02-11T16:23:54.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.797+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fc1b8001450 tx=0x7fc1b8011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.797+0000 7fc1c872e700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 0x7fc19c0058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.797+0000 7fc1c872e700 1 -- 172.21.15.88:0/3260333875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c005ea0 con 0x7fc19c003420 2020-02-11T16:23:54.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.797+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc1b80119a0 con 0x7fc1a0008e40 2020-02-11T16:23:54.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.797+0000 7fc1c6ccb700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fc1b8001450 tx=0x7fc1b8011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 0x7fc19c0058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1af7fe700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1a003dc10 0x7fc1a00400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc1b8049610 con 0x7fc1a0008e40 2020-02-11T16:23:54.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1c5cc9700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1a003dc10 0x7fc1a00400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1c64ca700 1 -- 172.21.15.88:0/3260333875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc19c006060 con 0x7fc19c003420 2020-02-11T16:23:54.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 0x7fc19c0058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 0x7fc19c0058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 0x7fc19c0058e0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1c5cc9700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1a003dc10 0x7fc1a00400d0 crc :-1 s=READY pgs=422 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 0x7fc19c0058e0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.798+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1bc008e90 con 0x7fc19c003420 2020-02-11T16:23:54.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.799+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 0x7fc19c0058e0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.799+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fc1bc00f810 con 0x7fc19c003420 2020-02-11T16:23:54.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.799+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 msgr2=0x7fc19c0058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.799+0000 7fc1af7fe700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 0x7fc19c0058e0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).stop 2020-02-11T16:23:54.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.799+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 msgr2=0x7fc19c0058e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:23:54.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.799+0000 7fc1af7fe700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 0x7fc19c0058e0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).stop 2020-02-11T16:23:54.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.807+0000 7fc1c872e700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 0x7fc19c0068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.807+0000 7fc1c872e700 1 -- 172.21.15.88:0/3260333875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c006d80 con 0x7fc19c006440 2020-02-11T16:23:54.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.808+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 0x7fc19c0068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.808+0000 7fc1c64ca700 1 -- 172.21.15.88:0/3260333875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc19c006f40 con 0x7fc19c006440 2020-02-11T16:23:54.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.808+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 0x7fc19c0068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.808+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 0x7fc19c0068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.808+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 0x7fc19c0068f0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.808+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 0x7fc19c0068f0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.808+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1bc005cc0 con 0x7fc19c006440 2020-02-11T16:23:54.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c64ca700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 0x7fc19c0068f0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4022 (secure 0 0 0) 0x7fc1bc005e20 con 0x7fc19c006440 2020-02-11T16:23:54.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 msgr2=0x7fc19c0068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1af7fe700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 0x7fc19c0068f0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).stop 2020-02-11T16:23:54.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1af7fe700 1 -- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 msgr2=0x7fc19c0068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:23:54.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1af7fe700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 0x7fc19c0068f0 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0x7fc1c00a4630 tx=0x7fc1c00a1c80).stop 2020-02-11T16:23:54.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 -- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1a003dc10 msgr2=0x7fc1a00400d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1a003dc10 0x7fc1a00400d0 crc :-1 s=READY pgs=422 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 -- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 msgr2=0x7fc1a000b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fc1b8001450 tx=0x7fc1b8011020).stop 2020-02-11T16:23:54.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 -- 172.21.15.88:0/3260333875 shutdown_connections 2020-02-11T16:23:54.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1a003dc10 0x7fc1a00400d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1a0008e40 0x7fc1a000b230 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c003420 0x7fc19c0058e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 --2- 172.21.15.88:0/3260333875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc19c006440 0x7fc19c0068f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 -- 172.21.15.88:0/3260333875 >> 172.21.15.88:0/3260333875 conn(0x7fc1c009d110 msgr2=0x7fc1c0128490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:54.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 -- 172.21.15.88:0/3260333875 shutdown_connections 2020-02-11T16:23:54.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.809+0000 7fc1c872e700 1 -- 172.21.15.88:0/3260333875 wait complete. 2020-02-11T16:23:54.823 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:23:54.823 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:23:54.823 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:23:54.823 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:23:54.823 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 150, 2020-02-11T16:23:54.823 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:23:54.823 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:23:54.824 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:23:54.824 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:23:54.824 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:54.824 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:23:54.824 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:23:54.824 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:23:54.824 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:23:54.825 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:54.825 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:54.825 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:54.825 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:54.825 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:54.825 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:54.825 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:54.826 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:23:54.826 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:23:54.826 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:54.826 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:54.826 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:54.826 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:54.826 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:54.827 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:54.827 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.827 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:23:54.827 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:23:54.827 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:23:54.827 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:23:54.828 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:23:54.828 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:23:54.828 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:23:54.828 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:23:54.828 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:23:54.828 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:23:54.828 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:23:54.828 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:23:54.829 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:54.829 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:54.829 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:54.829 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:54.829 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:54.829 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:54.830 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:54.830 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:23:54.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.830 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:23:54.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.830 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:23:54.830 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:23:54.831 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:54.831 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:54.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.831 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:54.831 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:23:54.831 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.832 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:54.832 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:23:54.832 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.832 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.832 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.833 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:23:54.833 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:23:54.833 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:54.833 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:54.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.834 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:23:54.834 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:23:54.834 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:54.834 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:54.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.834 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:54.834 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:23:54.835 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.835 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:54.835 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:23:54.835 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.835 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.835 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.836 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:23:54.836 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:23:54.836 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:54.836 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:54.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.837 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:23:54.837 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:23:54.837 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:54.837 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:54.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.837 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:54.837 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:23:54.838 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.838 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:54.838 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:23:54.838 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:54.838 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.839 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.839 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:23:54.839 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:23:54.839 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:54.839 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:54.839 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.840 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:54.840 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:23:54.840 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:23:54.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.840 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:54.840 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:54.841 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:23:54.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.841 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:54.841 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:23:54.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.841 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:54.841 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:54.842 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:23:54.842 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.842 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:54.842 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:23:54.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:54.842 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:54.842 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:54.843 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:23:54.843 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.843 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:54.843 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:54.843 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:23:54.844 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:23:54.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.965+0000 7fe5e8b9d700 1 Processor -- start 2020-02-11T16:23:54.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.965+0000 7fe5e8b9d700 1 -- start start 2020-02-11T16:23:54.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5e8b9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5e40a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:54.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5e8b9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5e40a3d10 0x7fe5e40a7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:54.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5e8b9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe5e40a7eb0 0x7fe5e4139250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:54.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5e8b9d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40a41c0 con 0x7fe5e40a7eb0 2020-02-11T16:23:54.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5e8b9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40a5460 con 0x7fe5e40a3d10 2020-02-11T16:23:54.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5e8b9d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40a8330 con 0x7fe5e40a6240 2020-02-11T16:23:54.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5dbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5e40a3d10 0x7fe5e40a7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5dbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5e40a3d10 0x7fe5e40a7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58462/0 (socket says 172.21.15.88:58462) 2020-02-11T16:23:54.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5dbfff700 1 -- 172.21.15.88:0/652831776 learned_addr learned my addr 172.21.15.88:0/652831776 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:23:54.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5e3fff700 1 --2- 172.21.15.88:0/652831776 >> v2:172.21.15.52:3300/0 conn(0x7fe5e40a7eb0 0x7fe5e4139250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.966+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/652831776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5e40a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 -- 172.21.15.88:0/652831776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 msgr2=0x7fe5e40a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:23:54.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/652831776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5e40a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:54.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 -- 172.21.15.88:0/652831776 >> v2:172.21.15.52:3300/0 conn(0x7fe5e40a7eb0 msgr2=0x7fe5e4139250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:23:54.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/652831776 >> v2:172.21.15.52:3300/0 conn(0x7fe5e40a7eb0 0x7fe5e4139250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:54.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 -- 172.21.15.88:0/652831776 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40a5030 con 0x7fe5e40a3d10 2020-02-11T16:23:54.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/652831776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5e40a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:23:54.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e3fff700 1 --2- 172.21.15.88:0/652831776 >> v2:172.21.15.52:3300/0 conn(0x7fe5e40a7eb0 0x7fe5e4139250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:23:54.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/652831776 >> v2:172.21.15.88:3300/0 conn(0x7fe5e40a3d10 0x7fe5e40a7a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/652831776 >> v2:172.21.15.88:3300/0 conn(0x7fe5e40a3d10 0x7fe5e40a7a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/652831776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e40a3d10 0x7fe5e40a7a50 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).ready entity=mon.1 client_cookie=28d07917fa3af61a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/652831776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e40a3d10 0x7fe5e40a7a50 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/652831776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e40a3d10 0x7fe5e40a7a50 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e2ffd700 1 -- 172.21.15.88:0/652831776 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc011720 con 0x7fe5e40a3d10 2020-02-11T16:23:54.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/652831776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e40a3d10 0x7fe5e40a7a50 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e2ffd700 1 -- 172.21.15.88:0/652831776 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc011880 con 0x7fe5e40a3d10 2020-02-11T16:23:54.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e2ffd700 1 -- 172.21.15.88:0/652831776 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc011c20 con 0x7fe5e40a3d10 2020-02-11T16:23:54.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/652831776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e40a3d10 msgr2=0x7fe5e40a7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/652831776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e40a3d10 0x7fe5e40a7a50 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).stop 2020-02-11T16:23:54.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/652831776 shutdown_connections 2020-02-11T16:23:54.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/652831776 >> v2:172.21.15.52:3300/0 conn(0x7fe5e40a7eb0 0x7fe5e4139250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:54.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/652831776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5e40a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:54.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/652831776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e40a3d10 0x7fe5e40a7a50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/652831776 >> 172.21.15.88:0/652831776 conn(0x7fe5e40ac1c0 msgr2=0x7fe5e40ac5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:54.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.967+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/652831776 shutdown_connections 2020-02-11T16:23:54.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.968+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/652831776 wait complete. 2020-02-11T16:23:54.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.968+0000 7fe5e8b9d700 1 Processor -- start 2020-02-11T16:23:54.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.968+0000 7fe5e8b9d700 1 -- start start 2020-02-11T16:23:54.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.969+0000 7fe5e8b9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5e4064cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.969+0000 7fe5e8b9d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e4065150 con 0x7fe5e40a7eb0 2020-02-11T16:23:54.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.969+0000 7fe5e8b9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e40a9970 con 0x7fe5e40a3d10 2020-02-11T16:23:54.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.969+0000 7fe5e8b9d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e4063ea0 con 0x7fe5e40a6240 2020-02-11T16:23:54.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.969+0000 7fe5e37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe5e40a3d10 0x7fe5e4142f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46090/0 (socket says 172.21.15.88:46090) 2020-02-11T16:23:54.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.969+0000 7fe5e37fe700 1 -- 172.21.15.88:0/2527201277 learned_addr learned my addr 172.21.15.88:0/2527201277 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:23:54.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.969+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5e4064cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.969+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432895247 0 0) 0x7fe5e40a9970 con 0x7fe5e40a3d10 2020-02-11T16:23:54.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.969+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c8002fe0 con 0x7fe5e40a3d10 2020-02-11T16:23:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.969+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1701093762 0 0) 0x7fe5c8002fe0 con 0x7fe5e40a3d10 2020-02-11T16:23:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe5e40a9970 con 0x7fe5e40a3d10 2020-02-11T16:23:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe5d4002500 con 0x7fe5e40a3d10 2020-02-11T16:23:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 msgr2=0x7fe5e4064cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5e4064cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 >> v1:172.21.15.88:6789/0 conn(0x7fe5e40a3d10 legacy=0x7fe5e4142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 >> v1:172.21.15.52:6789/0 conn(0x7fe5e40a7eb0 legacy=0x7fe5e413ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5c80049b0 0x7fe5c8004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5c8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e4063ea0 con 0x7fe5c80049b0 2020-02-11T16:23:54.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c8004430 con 0x7fe5c8005260 2020-02-11T16:23:54.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80045f0 con 0x7fe5e40a6240 2020-02-11T16:23:54.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5c80049b0 0x7fe5c8004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e3fff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5c8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 -- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 msgr2=0x7fe5c8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5e40a6240 0x7fe5c8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 -- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5c80049b0 msgr2=0x7fe5c8004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5c80049b0 0x7fe5c8004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 -- 172.21.15.88:0/2527201277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4064140 con 0x7fe5c8005260 2020-02-11T16:23:54.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/2527201277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e40643e0 con 0x7fe5c8005260 2020-02-11T16:23:54.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/2527201277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e4143690 con 0x7fe5c8005260 2020-02-11T16:23:54.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc007340 con 0x7fe5c8005260 2020-02-11T16:23:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc0074a0 con 0x7fe5c8005260 2020-02-11T16:23:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.970+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc0058b0 con 0x7fe5c8005260 2020-02-11T16:23:54.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.971+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.971+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 0x7fe5bc0058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.971+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/2527201277 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc005ea0 con 0x7fe5bc003420 2020-02-11T16:23:54.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.971+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe5cc005a10 con 0x7fe5c8005260 2020-02-11T16:23:54.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.971+0000 7fe5dbfff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.971+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 0x7fe5bc0058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.971+0000 7fe5e17fa700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5c804a860 0x7fe5c804cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.971+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe5cc049f00 con 0x7fe5c8005260 2020-02-11T16:23:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e3fff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5c804a860 0x7fe5c804cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e37fe700 1 -- 172.21.15.88:0/2527201277 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5bc006060 con 0x7fe5bc003420 2020-02-11T16:23:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 0x7fe5bc0058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 0x7fe5bc0058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 0x7fe5bc0058e0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e3fff700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5c804a860 0x7fe5c804cd20 crc :-1 s=READY pgs=423 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 0x7fe5bc0058e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5d4001660 con 0x7fe5bc003420 2020-02-11T16:23:54.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 0x7fe5bc0058e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fe5d4007520 con 0x7fe5bc003420 2020-02-11T16:23:54.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 msgr2=0x7fe5bc0058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e17fa700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 0x7fe5bc0058e0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).stop 2020-02-11T16:23:54.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 msgr2=0x7fe5bc0058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:23:54.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e17fa700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc003420 0x7fe5bc0058e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.972+0000 7fe5e3fff700 1 -- 172.21.15.88:0/2527201277 reap_dead start 2020-02-11T16:23:54.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.982+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 0x7fe5bc0068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:54.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.982+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/2527201277 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc006dd0 con 0x7fe5bc006440 2020-02-11T16:23:54.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.982+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 0x7fe5bc0068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:54.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.982+0000 7fe5e37fe700 1 -- 172.21.15.88:0/2527201277 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe5bc006f90 con 0x7fe5bc006440 2020-02-11T16:23:54.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.982+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 0x7fe5bc0068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 0x7fe5bc0068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 0x7fe5bc0068f0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:54.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 0x7fe5bc0068f0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5d4007160 con 0x7fe5bc006440 2020-02-11T16:23:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e37fe700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 0x7fe5bc0068f0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7fe5d40072c0 con 0x7fe5bc006440 2020-02-11T16:23:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 msgr2=0x7fe5bc0068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e17fa700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 0x7fe5bc0068f0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).stop 2020-02-11T16:23:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e17fa700 1 -- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 msgr2=0x7fe5bc0068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:23:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e17fa700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 0x7fe5bc0068f0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0x7fe5d4007a40 tx=0x7fe5d40118a0).stop 2020-02-11T16:23:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5c804a860 msgr2=0x7fe5c804cd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5c804a860 0x7fe5c804cd20 crc :-1 s=READY pgs=423 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 msgr2=0x7fe5c8003960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fe5cc002f30 tx=0x7fe5cc007a40).stop 2020-02-11T16:23:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/2527201277 shutdown_connections 2020-02-11T16:23:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe5c804a860 0x7fe5c804cd20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c8005260 0x7fe5c8003960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e8b9d700 1 --2- 172.21.15.88:0/2527201277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5bc006440 0x7fe5bc0068f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:54.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.983+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/2527201277 >> 172.21.15.88:0/2527201277 conn(0x7fe5e40ac1c0 msgr2=0x7fe5e40ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:54.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.984+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/2527201277 shutdown_connections 2020-02-11T16:23:54.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:54.984+0000 7fe5e8b9d700 1 -- 172.21.15.88:0/2527201277 wait complete. 2020-02-11T16:23:54.998 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:23:54.998 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:23:54.998 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:23:54.998 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:23:54.999 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 150, 2020-02-11T16:23:54.999 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:23:54.999 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:23:54.999 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:23:54.999 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:23:54.999 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:54.999 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:23:55.000 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:23:55.000 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:23:55.000 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:23:55.000 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:55.000 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:55.000 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:55.000 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:55.001 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:55.001 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:55.001 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:55.001 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:23:55.001 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:23:55.001 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:55.001 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:55.002 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:55.002 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:55.002 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:55.002 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:55.002 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:55.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.002 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:23:55.003 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:23:55.003 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:23:55.003 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:23:55.003 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:23:55.003 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:23:55.003 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:23:55.003 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:23:55.004 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:23:55.004 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:23:55.004 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:23:55.004 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:23:55.004 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:23:55.004 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:23:55.004 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:23:55.004 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:23:55.005 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:23:55.005 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:23:55.005 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:55.005 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:23:55.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.005 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:23:55.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.006 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:23:55.006 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:23:55.006 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:55.006 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:55.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.006 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:55.006 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:23:55.007 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:55.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.007 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:55.007 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:23:55.008 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:55.008 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:55.008 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:55.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.008 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:23:55.008 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:23:55.008 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:55.009 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:55.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.009 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:23:55.009 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:23:55.009 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:55.009 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:55.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.010 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:55.010 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:23:55.010 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:55.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.010 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:55.011 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:23:55.011 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:55.011 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:55.011 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:55.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.011 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:23:55.011 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:23:55.012 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:55.012 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:55.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.012 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:23:55.012 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:23:55.012 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:23:55.013 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:23:55.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.013 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:23:55.013 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:23:55.013 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:55.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.014 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:23:55.014 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:23:55.014 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:23:55.014 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:55.014 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:55.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.014 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:23:55.014 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:23:55.015 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:23:55.015 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:23:55.015 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:55.015 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:55.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:23:55.015 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:23:55.015 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:23:55.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.016 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:55.016 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:55.016 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:23:55.016 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:55.016 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:55.016 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:23:55.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.017 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:55.017 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:55.017 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:23:55.017 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:55.017 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:55.017 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:23:55.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.018 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:55.018 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:55.018 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:23:55.018 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:55.018 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:55.018 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:23:55.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.019 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:55.020 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:55.020 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:23:55.021 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:55.021 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:23:55.021 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:23:55.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:23:55.021 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:23:55.021 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:23:55.021 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:23:55.022 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:55.022 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:23:55.022 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:23:55.022 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:23:55.023 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:23:55.024 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:23:55.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.144+0000 7f574d354700 1 Processor -- start 2020-02-11T16:23:55.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.144+0000 7f574d354700 1 -- start start 2020-02-11T16:23:55.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f574d354700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57480a75a0 0x7f57480a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:55.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f574d354700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57480a2e80 0x7f57480a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:23:55.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f574d354700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574805c200 con 0x7f57480a6120 2020-02-11T16:23:55.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f574d354700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574809d3b0 con 0x7f57480a2e80 2020-02-11T16:23:55.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f574d354700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574809d650 con 0x7f57480a75a0 2020-02-11T16:23:55.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f5746ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57480a75a0 0x7f57480a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:55.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f5746ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57480a75a0 0x7f57480a2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58482/0 (socket says 172.21.15.88:58482) 2020-02-11T16:23:55.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f5746ffd700 1 -- 172.21.15.88:0/1222783914 learned_addr learned my addr 172.21.15.88:0/1222783914 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:23:55.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f57477fe700 1 --1- 172.21.15.88:0/1222783914 >> v1:172.21.15.88:6789/0 conn(0x7f57480a6120 0x7f5748137d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46112/0 (socket says 172.21.15.88:46112) 2020-02-11T16:23:55.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f57467fc700 1 --2- 172.21.15.88:0/1222783914 >> v2:172.21.15.52:3300/0 conn(0x7f57480a2e80 0x7f57480a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:55.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f5746ffd700 1 -- 172.21.15.88:0/1222783914 >> v2:172.21.15.52:3300/0 conn(0x7f57480a2e80 msgr2=0x7f57480a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:23:55.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f5746ffd700 1 --2- 172.21.15.88:0/1222783914 >> v2:172.21.15.52:3300/0 conn(0x7f57480a2e80 0x7f57480a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:55.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f5746ffd700 1 -- 172.21.15.88:0/1222783914 >> v1:172.21.15.88:6789/0 conn(0x7f57480a6120 legacy=0x7f5748137d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:55.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f5746ffd700 1 -- 172.21.15.88:0/1222783914 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574809d8f0 con 0x7f57480a75a0 2020-02-11T16:23:55.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f57467fc700 1 --2- 172.21.15.88:0/1222783914 >> v2:172.21.15.52:3300/0 conn(0x7f57480a2e80 0x7f57480a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:23:55.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f5746ffd700 1 --2- 172.21.15.88:0/1222783914 >> v2:172.21.15.88:3300/0 conn(0x7f57480a75a0 0x7f57480a2a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5738002f30 tx=0x7f5738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f5746ffd700 1 --2- 172.21.15.88:0/1222783914 >> v2:172.21.15.88:3300/0 conn(0x7f57480a75a0 0x7f57480a2a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5738002f30 tx=0x7f5738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.145+0000 7f5746ffd700 1 --2- 172.21.15.88:0/1222783914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57480a75a0 0x7f57480a2a20 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f5738002f30 tx=0x7f5738007a40).ready entity=mon.1 client_cookie=7d5aeca24361574d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:55.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f5746ffd700 1 --2- 172.21.15.88:0/1222783914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57480a75a0 0x7f57480a2a20 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f5738002f30 tx=0x7f5738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f5745ffb700 1 -- 172.21.15.88:0/1222783914 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5738011720 con 0x7f57480a75a0 2020-02-11T16:23:55.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f5746ffd700 1 --2- 172.21.15.88:0/1222783914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57480a75a0 0x7f57480a2a20 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f5738002f30 tx=0x7f5738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f5745ffb700 1 -- 172.21.15.88:0/1222783914 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5738011880 con 0x7f57480a75a0 2020-02-11T16:23:55.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f5746ffd700 1 --2- 172.21.15.88:0/1222783914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57480a75a0 0x7f57480a2a20 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f5738002f30 tx=0x7f5738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f574d354700 1 -- 172.21.15.88:0/1222783914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57480a75a0 msgr2=0x7f57480a2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:55.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f574d354700 1 --2- 172.21.15.88:0/1222783914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57480a75a0 0x7f57480a2a20 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f5738002f30 tx=0x7f5738007a40).stop 2020-02-11T16:23:55.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f5745ffb700 1 -- 172.21.15.88:0/1222783914 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5738011c60 con 0x7f57480a75a0 2020-02-11T16:23:55.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f574d354700 1 -- 172.21.15.88:0/1222783914 shutdown_connections 2020-02-11T16:23:55.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f574d354700 1 --2- 172.21.15.88:0/1222783914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57480a75a0 0x7f57480a2a20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:55.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f574d354700 1 --2- 172.21.15.88:0/1222783914 >> v2:172.21.15.52:3300/0 conn(0x7f57480a2e80 0x7f57480a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:23:55.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f574d354700 1 -- 172.21.15.88:0/1222783914 >> 172.21.15.88:0/1222783914 conn(0x7f57480aa950 msgr2=0x7f57480a6920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:55.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f574d354700 1 -- 172.21.15.88:0/1222783914 shutdown_connections 2020-02-11T16:23:55.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.146+0000 7f574d354700 1 -- 172.21.15.88:0/1222783914 wait complete. 2020-02-11T16:23:55.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.147+0000 7f574d354700 1 Processor -- start 2020-02-11T16:23:55.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.147+0000 7f574d354700 1 -- start start 2020-02-11T16:23:55.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f574d354700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f57480a2e80 0x7f5748148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:55.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f574d354700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5748127ee0 con 0x7f57480a6120 2020-02-11T16:23:55.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f574d354700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5748128180 con 0x7f57480a75a0 2020-02-11T16:23:55.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f574d354700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57481487d0 con 0x7f57480a2e80 2020-02-11T16:23:55.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f57477fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f57480a75a0 0x7f574814f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46116/0 (socket says 172.21.15.88:46116) 2020-02-11T16:23:55.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f57477fe700 1 -- 172.21.15.88:0/2150093405 learned_addr learned my addr 172.21.15.88:0/2150093405 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:23:55.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5746ffd700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f57480a2e80 0x7f5748148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:55.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661472744 0 0) 0x7f5748128180 con 0x7f57480a75a0 2020-02-11T16:23:55.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5724002fe0 con 0x7f57480a75a0 2020-02-11T16:23:55.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932174351 0 0) 0x7f5748127ee0 con 0x7f57480a6120 2020-02-11T16:23:55.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5748128180 con 0x7f57480a6120 2020-02-11T16:23:55.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 369957566 0 0) 0x7f5724002fe0 con 0x7f57480a75a0 2020-02-11T16:23:55.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5748127ee0 con 0x7f57480a75a0 2020-02-11T16:23:55.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f5740001bb0 con 0x7f57480a75a0 2020-02-11T16:23:55.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f57480a2e80 msgr2=0x7f5748148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:55.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f57480a2e80 0x7f5748148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:55.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 >> v1:172.21.15.88:6789/0 conn(0x7f57480a75a0 legacy=0x7f574814f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:55.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 >> v1:172.21.15.52:6789/0 conn(0x7f57480a6120 legacy=0x7f574812d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:55.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5724004b20 0x7f5724004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:55.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724003800 0x7f5724003c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:55.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:55.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5724004650 con 0x7f5724003800 2020-02-11T16:23:55.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572400bbb0 con 0x7f57240040e0 2020-02-11T16:23:55.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.148+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572400bd20 con 0x7f5724004b20 2020-02-11T16:23:55.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f5746ffd700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f57480a2e80 0x7f5748148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:23:55.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:55.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57467fc700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724003800 0x7f5724003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:55.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f5746ffd700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5724004b20 0x7f5724004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:55.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 -- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5724004b20 msgr2=0x7f5724004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:55.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5724004b20 0x7f5724004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:55.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 -- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724003800 msgr2=0x7f5724003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:55.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724003800 0x7f5724003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:55.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 -- 172.21.15.88:0/2150093405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57480662d0 con 0x7f57240040e0 2020-02-11T16:23:55.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f574d354700 1 -- 172.21.15.88:0/2150093405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5748065f00 con 0x7f57240040e0 2020-02-11T16:23:55.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f574d354700 1 -- 172.21.15.88:0/2150093405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5748065480 con 0x7f57240040e0 2020-02-11T16:23:55.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:55.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574000ce30 con 0x7f57240040e0 2020-02-11T16:23:55.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5740005c80 con 0x7f57240040e0 2020-02-11T16:23:55.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.149+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5740005df0 con 0x7f57240040e0 2020-02-11T16:23:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.150+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.150+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f574000e350 con 0x7f57240040e0 2020-02-11T16:23:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.150+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.150+0000 7f574d354700 1 -- 172.21.15.88:0/2150093405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5728003340 con 0x7f57240040e0 2020-02-11T16:23:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.150+0000 7f5737fff700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5724042900 0x7f5724044dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:23:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.150+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f574004a6f0 con 0x7f57240040e0 2020-02-11T16:23:55.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.150+0000 7f5746ffd700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5724042900 0x7f5724044dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:23:55.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.151+0000 7f5746ffd700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5724042900 0x7f5724044dc0 crc :-1 s=READY pgs=424 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:23:55.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.154+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.154+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f574002fd50 con 0x7f57240040e0 2020-02-11T16:23:55.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.371+0000 7f574d354700 1 -- 172.21.15.88:0/2150093405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f57280036f0 con 0x7f57240040e0 2020-02-11T16:23:55.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.372+0000 7f57477fe700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:23:55.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.372+0000 7f5737fff700 1 -- 172.21.15.88:0/2150093405 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f5740032820 con 0x7f57240040e0 2020-02-11T16:23:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.374+0000 7f574d354700 1 -- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5724042900 msgr2=0x7f5724044dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.374+0000 7f574d354700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5724042900 0x7f5724044dc0 crc :-1 s=READY pgs=424 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:55.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.374+0000 7f574d354700 1 -- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 msgr2=0x7f572400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:23:55.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.374+0000 7f574d354700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f5740001980 tx=0x7f57400115a0).stop 2020-02-11T16:23:55.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.374+0000 7f57477fe700 1 -- 172.21.15.88:0/2150093405 reap_dead start 2020-02-11T16:23:55.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.374+0000 7f574d354700 1 -- 172.21.15.88:0/2150093405 shutdown_connections 2020-02-11T16:23:55.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.374+0000 7f574d354700 1 --2- 172.21.15.88:0/2150093405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57240040e0 0x7f572400b750 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:23:55.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.374+0000 7f574d354700 1 -- 172.21.15.88:0/2150093405 >> 172.21.15.88:0/2150093405 conn(0x7f57480aa950 msgr2=0x7f5748069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:23:55.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.374+0000 7f574d354700 1 -- 172.21.15.88:0/2150093405 shutdown_connections 2020-02-11T16:23:55.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:23:55.374+0000 7f574d354700 1 -- 172.21.15.88:0/2150093405 wait complete. 2020-02-11T16:23:55.389 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:24:05.390 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:24:05.390 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:24:05.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.515+0000 7f55acd8a700 1 Processor -- start 2020-02-11T16:24:05.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.515+0000 7f55acd8a700 1 -- start start 2020-02-11T16:24:05.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.515+0000 7f55acd8a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a80a5490 0x7f55a8065c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:05.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.515+0000 7f55acd8a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55a813baa0 0x7f55a813bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:05.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.515+0000 7f55acd8a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a80a6560 con 0x7f55a805b270 2020-02-11T16:24:05.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.515+0000 7f55acd8a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a80a6800 con 0x7f55a813baa0 2020-02-11T16:24:05.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.515+0000 7f55acd8a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a809ad80 con 0x7f55a80a5490 2020-02-11T16:24:05.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55a813baa0 0x7f55a813bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:05.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55a813baa0 0x7f55a813bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58508/0 (socket says 172.21.15.88:58508) 2020-02-11T16:24:05.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 -- 172.21.15.88:0/4269460647 learned_addr learned my addr 172.21.15.88:0/4269460647 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:05.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a77fe700 1 --2- 172.21.15.88:0/4269460647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a80a5490 0x7f55a8065c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:05.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 -- 172.21.15.88:0/4269460647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a80a5490 msgr2=0x7f55a8065c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:05.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 --2- 172.21.15.88:0/4269460647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a80a5490 0x7f55a8065c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:05.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 -- 172.21.15.88:0/4269460647 >> v1:172.21.15.88:6789/0 conn(0x7f55a805b270 legacy=0x7f55a813b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 -- 172.21.15.88:0/4269460647 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a80a4970 con 0x7f55a813baa0 2020-02-11T16:24:05.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 --2- 172.21.15.88:0/4269460647 >> v2:172.21.15.88:3300/0 conn(0x7f55a813baa0 0x7f55a813bec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55a00032b0 tx=0x7f55a0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.521 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 --2- 172.21.15.88:0/4269460647 >> v2:172.21.15.88:3300/0 conn(0x7f55a813baa0 0x7f55a813bec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55a00032b0 tx=0x7f55a0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 --2- 172.21.15.88:0/4269460647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a813baa0 0x7f55a813bec0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f55a00032b0 tx=0x7f55a0008c60).ready entity=mon.1 client_cookie=118998747aca02d1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:05.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 --2- 172.21.15.88:0/4269460647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a813baa0 0x7f55a813bec0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f55a00032b0 tx=0x7f55a0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 --2- 172.21.15.88:0/4269460647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a813baa0 0x7f55a813bec0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f55a00032b0 tx=0x7f55a0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a7fff700 1 --2- 172.21.15.88:0/4269460647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a813baa0 0x7f55a813bec0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f55a00032b0 tx=0x7f55a0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a67fc700 1 -- 172.21.15.88:0/4269460647 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a000a160 con 0x7f55a813baa0 2020-02-11T16:24:05.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a67fc700 1 -- 172.21.15.88:0/4269460647 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a000a2c0 con 0x7f55a813baa0 2020-02-11T16:24:05.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55a67fc700 1 -- 172.21.15.88:0/4269460647 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a000a6a0 con 0x7f55a813baa0 2020-02-11T16:24:05.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55acd8a700 1 -- 172.21.15.88:0/4269460647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a813baa0 msgr2=0x7f55a813bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.516+0000 7f55acd8a700 1 --2- 172.21.15.88:0/4269460647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a813baa0 0x7f55a813bec0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f55a00032b0 tx=0x7f55a0008c60).stop 2020-02-11T16:24:05.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.517+0000 7f55acd8a700 1 -- 172.21.15.88:0/4269460647 shutdown_connections 2020-02-11T16:24:05.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.517+0000 7f55acd8a700 1 --2- 172.21.15.88:0/4269460647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a813baa0 0x7f55a813bec0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:05.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.517+0000 7f55acd8a700 1 --2- 172.21.15.88:0/4269460647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a80a5490 0x7f55a8065c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:05.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.517+0000 7f55acd8a700 1 -- 172.21.15.88:0/4269460647 >> 172.21.15.88:0/4269460647 conn(0x7f55a80aa840 msgr2=0x7f55a80aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:05.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.517+0000 7f55acd8a700 1 -- 172.21.15.88:0/4269460647 shutdown_connections 2020-02-11T16:24:05.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.517+0000 7f55acd8a700 1 -- 172.21.15.88:0/4269460647 wait complete. 2020-02-11T16:24:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.518+0000 7f55acd8a700 1 Processor -- start 2020-02-11T16:24:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.518+0000 7f55acd8a700 1 -- start start 2020-02-11T16:24:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.518+0000 7f55acd8a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.518+0000 7f55acd8a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a8138370 con 0x7f55a813baa0 2020-02-11T16:24:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.518+0000 7f55acd8a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a8139080 con 0x7f55a80a5490 2020-02-11T16:24:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.518+0000 7f55acd8a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a80a1100 con 0x7f55a805b270 2020-02-11T16:24:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a6ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f55a80a5490 0x7f55a80a0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46138/0 (socket says 172.21.15.88:46138) 2020-02-11T16:24:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a6ffd700 1 -- 172.21.15.88:0/3668301852 learned_addr learned my addr 172.21.15.88:0/3668301852 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118963856 0 0) 0x7f55a8139080 con 0x7f55a80a5490 2020-02-11T16:24:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5588002fe0 con 0x7f55a80a5490 2020-02-11T16:24:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059100261 0 0) 0x7f55a8138370 con 0x7f55a813baa0 2020-02-11T16:24:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55a8139080 con 0x7f55a813baa0 2020-02-11T16:24:05.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1234461795 0 0) 0x7f5588002fe0 con 0x7f55a80a5490 2020-02-11T16:24:05.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a77fe700 1 -- 172.21.15.88:0/3668301852 >> v1:172.21.15.88:6789/0 conn(0x7f55a80a5490 legacy=0x7f55a80a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a77fe700 1 -- 172.21.15.88:0/3668301852 >> v1:172.21.15.52:6789/0 conn(0x7f55a813baa0 legacy=0x7f55a8133380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a77fe700 1 -- 172.21.15.88:0/3668301852 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a80a13a0 con 0x7f55a805b270 2020-02-11T16:24:05.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:05.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559c001930 con 0x7f55a805b270 2020-02-11T16:24:05.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5598007340 con 0x7f55a805b270 2020-02-11T16:24:05.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55980056c0 con 0x7f55a805b270 2020-02-11T16:24:05.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55acd8a700 1 -- 172.21.15.88:0/3668301852 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a80a1640 con 0x7f55a805b270 2020-02-11T16:24:05.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.519+0000 7f55acd8a700 1 -- 172.21.15.88:0/3668301852 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a81370e0 con 0x7f55a805b270 2020-02-11T16:24:05.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.520+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.520+0000 7f55acd8a700 1 -- 172.21.15.88:0/3668301852 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a80565b0 con 0x7f55a805b270 2020-02-11T16:24:05.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.520+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f55980058c0 con 0x7f55a805b270 2020-02-11T16:24:05.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.520+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.521+0000 7f55a4ff9700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f558803a030 0x7f558803c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:05.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.521+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f559800d0c0 con 0x7f55a805b270 2020-02-11T16:24:05.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.521+0000 7f55a6ffd700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f558803a030 0x7f558803c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:05.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.521+0000 7f55a6ffd700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f558803a030 0x7f558803c4f0 crc :-1 s=READY pgs=425 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:05.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.525+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.525+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f559802ead0 con 0x7f55a805b270 2020-02-11T16:24:05.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.732+0000 7f55acd8a700 1 -- 172.21.15.88:0/3668301852 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f55a80a5d30 con 0x7f55a805b270 2020-02-11T16:24:05.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.733+0000 7f55a77fe700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.733+0000 7f55a4ff9700 1 -- 172.21.15.88:0/3668301852 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f55980315c0 con 0x7f55a805b270 2020-02-11T16:24:05.736 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:05.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.734+0000 7f55acd8a700 1 -- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f558803a030 msgr2=0x7f558803c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.734+0000 7f55acd8a700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f558803a030 0x7f558803c4f0 crc :-1 s=READY pgs=425 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.734+0000 7f55acd8a700 1 -- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 msgr2=0x7f55a809e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.734+0000 7f55acd8a700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f559c0010d0 tx=0x7f5598010b70).stop 2020-02-11T16:24:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.735+0000 7f55acd8a700 1 -- 172.21.15.88:0/3668301852 shutdown_connections 2020-02-11T16:24:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.735+0000 7f55acd8a700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f558803a030 0x7f558803c4f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.735+0000 7f55acd8a700 1 --2- 172.21.15.88:0/3668301852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f55a805b270 0x7f55a809e860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.735+0000 7f55acd8a700 1 -- 172.21.15.88:0/3668301852 >> 172.21.15.88:0/3668301852 conn(0x7f55a80aa840 msgr2=0x7f55a8138580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.735+0000 7f55acd8a700 1 -- 172.21.15.88:0/3668301852 shutdown_connections 2020-02-11T16:24:05.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.735+0000 7f55acd8a700 1 -- 172.21.15.88:0/3668301852 wait complete. 2020-02-11T16:24:05.748 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":150,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:05.748 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:24:05.748 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:24:05.749 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:24:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.863+0000 7f8471d48700 1 Processor -- start 2020-02-11T16:24:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.863+0000 7f8471d48700 1 -- start start 2020-02-11T16:24:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f8471d48700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f846c136070 0x7f846c1364d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:05.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f8471d48700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f846c136930 0x7f846c140870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:05.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f8471d48700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c09a8a0 con 0x7f846c0a4230 2020-02-11T16:24:05.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f8471d48700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c09ab40 con 0x7f846c136070 2020-02-11T16:24:05.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f8471d48700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c09ade0 con 0x7f846c136930 2020-02-11T16:24:05.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f846bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f846c136070 0x7f846c1364d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:05.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f846bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f846c136070 0x7f846c1364d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58520/0 (socket says 172.21.15.88:58520) 2020-02-11T16:24:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f846bfff700 1 -- 172.21.15.88:0/44156784 learned_addr learned my addr 172.21.15.88:0/44156784 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f8470d46700 1 --1- 172.21.15.88:0/44156784 >> v1:172.21.15.88:6789/0 conn(0x7f846c0a4230 0x7f846c09ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46144/0 (socket says 172.21.15.88:46144) 2020-02-11T16:24:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f8471547700 1 --2- 172.21.15.88:0/44156784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f846c136930 0x7f846c140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f846bfff700 1 -- 172.21.15.88:0/44156784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f846c136930 msgr2=0x7f846c140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f846bfff700 1 --2- 172.21.15.88:0/44156784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f846c136930 0x7f846c140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f846bfff700 1 -- 172.21.15.88:0/44156784 >> v1:172.21.15.88:6789/0 conn(0x7f846c0a4230 legacy=0x7f846c09ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f846bfff700 1 -- 172.21.15.88:0/44156784 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c060b00 con 0x7f846c136070 2020-02-11T16:24:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f846bfff700 1 --2- 172.21.15.88:0/44156784 >> v2:172.21.15.88:3300/0 conn(0x7f846c136070 0x7f846c1364d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8458002f30 tx=0x7f84580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f846bfff700 1 --2- 172.21.15.88:0/44156784 >> v2:172.21.15.88:3300/0 conn(0x7f846c136070 0x7f846c1364d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8458002f30 tx=0x7f84580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.864+0000 7f846bfff700 1 --2- 172.21.15.88:0/44156784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c136070 0x7f846c1364d0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f8458002f30 tx=0x7f84580088e0).ready entity=mon.1 client_cookie=ccf63d2dc07f5a61 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f846bfff700 1 --2- 172.21.15.88:0/44156784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c136070 0x7f846c1364d0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f8458002f30 tx=0x7f84580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f846bfff700 1 --2- 172.21.15.88:0/44156784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c136070 0x7f846c1364d0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f8458002f30 tx=0x7f84580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f846bfff700 1 --2- 172.21.15.88:0/44156784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c136070 0x7f846c1364d0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f8458002f30 tx=0x7f84580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f846b7fe700 1 -- 172.21.15.88:0/44156784 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8458011760 con 0x7f846c136070 2020-02-11T16:24:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f846b7fe700 1 -- 172.21.15.88:0/44156784 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84580118c0 con 0x7f846c136070 2020-02-11T16:24:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f846b7fe700 1 -- 172.21.15.88:0/44156784 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8458011ca0 con 0x7f846c136070 2020-02-11T16:24:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f8471d48700 1 -- 172.21.15.88:0/44156784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c136070 msgr2=0x7f846c1364d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f8471d48700 1 --2- 172.21.15.88:0/44156784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c136070 0x7f846c1364d0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f8458002f30 tx=0x7f84580088e0).stop 2020-02-11T16:24:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f8471d48700 1 -- 172.21.15.88:0/44156784 shutdown_connections 2020-02-11T16:24:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f8471d48700 1 --2- 172.21.15.88:0/44156784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f846c136930 0x7f846c140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f8471d48700 1 --2- 172.21.15.88:0/44156784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c136070 0x7f846c1364d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f8471d48700 1 -- 172.21.15.88:0/44156784 >> 172.21.15.88:0/44156784 conn(0x7f846c0aa860 msgr2=0x7f846c0aac70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f8471d48700 1 -- 172.21.15.88:0/44156784 shutdown_connections 2020-02-11T16:24:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.865+0000 7f8471d48700 1 -- 172.21.15.88:0/44156784 wait complete. 2020-02-11T16:24:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.866+0000 7f8471d48700 1 Processor -- start 2020-02-11T16:24:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.866+0000 7f8471d48700 1 -- start start 2020-02-11T16:24:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f8471d48700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f846c136930 0x7f846c133bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f8471d48700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c066470 con 0x7f846c0a4230 2020-02-11T16:24:05.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f8471d48700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c066710 con 0x7f846c136070 2020-02-11T16:24:05.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f8471d48700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c0669b0 con 0x7f846c136930 2020-02-11T16:24:05.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f846bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f846c136070 0x7f846c1334a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46152/0 (socket says 172.21.15.88:46152) 2020-02-11T16:24:05.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f846bfff700 1 -- 172.21.15.88:0/63953651 learned_addr learned my addr 172.21.15.88:0/63953651 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:05.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236675247 0 0) 0x7f846c066710 con 0x7f846c136070 2020-02-11T16:24:05.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f8471547700 1 --2- 172.21.15.88:0/63953651 >> v2:172.21.15.52:3300/0 conn(0x7f846c136930 0x7f846c133bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:05.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8454002fe0 con 0x7f846c136070 2020-02-11T16:24:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2267097869 0 0) 0x7f8454002fe0 con 0x7f846c136070 2020-02-11T16:24:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f846c066710 con 0x7f846c136070 2020-02-11T16:24:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.867+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f84580085c0 con 0x7f846c136070 2020-02-11T16:24:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471547700 1 -- 172.21.15.88:0/63953651 >> v1:172.21.15.88:6789/0 conn(0x7f846c136070 legacy=0x7f846c1334a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471547700 1 -- 172.21.15.88:0/63953651 >> v1:172.21.15.52:6789/0 conn(0x7f846c0a4230 legacy=0x7f846c0a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471547700 1 -- 172.21.15.88:0/63953651 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c0a93b0 con 0x7f846c136930 2020-02-11T16:24:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471547700 1 --2- 172.21.15.88:0/63953651 >> v2:172.21.15.52:3300/0 conn(0x7f846c136930 0x7f846c133bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f846c0a3d90 tx=0x7f8464010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471547700 1 --2- 172.21.15.88:0/63953651 >> v2:172.21.15.52:3300/0 conn(0x7f846c136930 0x7f846c133bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f846c0a3d90 tx=0x7f8464010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471547700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f846c136930 0x7f846c133bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f846c0a3d90 tx=0x7f8464010e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471547700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f846c136930 0x7f846c133bb0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f846c0a3d90 tx=0x7f8464010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8464005e20 con 0x7f846c136930 2020-02-11T16:24:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471547700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f846c136930 0x7f846c133bb0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f846c0a3d90 tx=0x7f8464010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471d48700 1 -- 172.21.15.88:0/63953651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c0a9660 con 0x7f846c136930 2020-02-11T16:24:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8464007150 con 0x7f846c136930 2020-02-11T16:24:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471547700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f846c136930 0x7f846c133bb0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f846c0a3d90 tx=0x7f8464010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84640074d0 con 0x7f846c136930 2020-02-11T16:24:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471d48700 1 -- 172.21.15.88:0/63953651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c0a2890 con 0x7f846c136930 2020-02-11T16:24:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.868+0000 7f8471547700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f846c136930 0x7f846c133bb0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f846c0a3d90 tx=0x7f8464010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8471d48700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 0x7f846c139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8471d48700 1 -- 172.21.15.88:0/63953651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c05c630 con 0x7f846c065e40 2020-02-11T16:24:05.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 0x7f846c139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:05.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f84640076d0 con 0x7f846c136930 2020-02-11T16:24:05.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8471547700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f846c136930 0x7f846c133bb0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f846c0a3d90 tx=0x7f8464010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8469ffb700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f845403a1a0 0x7f845403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:05.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8470d46700 1 -- 172.21.15.88:0/63953651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f846c0a53c0 con 0x7f846c065e40 2020-02-11T16:24:05.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f84640498f0 con 0x7f846c136930 2020-02-11T16:24:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 0x7f846c139be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 0x7f846c139be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 0x7f846c139be0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f846bfff700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f845403a1a0 0x7f845403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 0x7f846c139be0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.869+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8460005c00 con 0x7f846c065e40 2020-02-11T16:24:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.870+0000 7f846bfff700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f845403a1a0 0x7f845403c660 crc :-1 s=READY pgs=426 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.870+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 0x7f846c139be0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.870+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8460005d60 con 0x7f846c065e40 2020-02-11T16:24:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.870+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 msgr2=0x7f846c139be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.870+0000 7f8469ffb700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 0x7f846c139be0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).stop 2020-02-11T16:24:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.870+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 msgr2=0x7f846c139be0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.870+0000 7f8469ffb700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c065e40 0x7f846c139be0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).stop 2020-02-11T16:24:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.878+0000 7f8471d48700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 0x7f846c05a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.878+0000 7f8471d48700 1 -- 172.21.15.88:0/63953651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0a1ca0 con 0x7f846c05a5d0 2020-02-11T16:24:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.878+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 0x7f846c05a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.878+0000 7f8470d46700 1 -- 172.21.15.88:0/63953651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f846c0565b0 con 0x7f846c05a5d0 2020-02-11T16:24:05.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.878+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 0x7f846c05a9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.878+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 0x7f846c05a9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.878+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 0x7f846c05a9b0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:05.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.878+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 0x7f846c05a9b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.878+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8460008650 con 0x7f846c05a5d0 2020-02-11T16:24:05.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.878+0000 7f8470d46700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 0x7f846c05a9b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:05.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7f84600087b0 con 0x7f846c05a5d0 2020-02-11T16:24:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 msgr2=0x7f846c05a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8469ffb700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 0x7f846c05a9b0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).stop 2020-02-11T16:24:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8469ffb700 1 -- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 msgr2=0x7f846c05a9b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8469ffb700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f846c05a5d0 0x7f846c05a9b0 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0x7f846c0a2f90 tx=0x7f8460010830).stop 2020-02-11T16:24:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8471d48700 1 -- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f845403a1a0 msgr2=0x7f845403c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8471d48700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f845403a1a0 0x7f845403c660 crc :-1 s=READY pgs=426 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8471d48700 1 -- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f846c136930 msgr2=0x7f846c133bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8471d48700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f846c136930 0x7f846c133bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f846c0a3d90 tx=0x7f8464010e50).stop 2020-02-11T16:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8471547700 1 -- 172.21.15.88:0/63953651 reap_dead start 2020-02-11T16:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8471d48700 1 -- 172.21.15.88:0/63953651 shutdown_connections 2020-02-11T16:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8471d48700 1 --2- 172.21.15.88:0/63953651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f846c136930 0x7f846c133bb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8471d48700 1 -- 172.21.15.88:0/63953651 >> 172.21.15.88:0/63953651 conn(0x7f846c0aa860 msgr2=0x7f846c0aac40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8471d48700 1 -- 172.21.15.88:0/63953651 shutdown_connections 2020-02-11T16:24:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:05.879+0000 7f8471d48700 1 -- 172.21.15.88:0/63953651 wait complete. 2020-02-11T16:24:05.896 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:05.896 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:05.896 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:05.896 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:24:05.896 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 150, 2020-02-11T16:24:05.897 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:05.897 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:05.897 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:24:05.897 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:05.897 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:05.897 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:24:05.897 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:05.898 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:05.898 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:05.898 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:05.898 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:05.899 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:05.899 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:05.899 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:05.899 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:05.899 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:05.899 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:05.900 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:05.900 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:05.900 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:05.900 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:05.900 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:05.900 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:05.900 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:05.900 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:05.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.901 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:05.901 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:05.901 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:05.901 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:05.901 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:05.901 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:05.902 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:05.902 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:05.902 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:05.902 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:05.902 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:05.902 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:05.903 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:05.903 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:05.903 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:05.903 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:05.903 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:05.903 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:05.903 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:05.904 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:05.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.904 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:05.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.904 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:05.904 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:05.904 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:05.905 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:05.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.905 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:05.905 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:05.905 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:05.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.906 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:05.906 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:05.906 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:05.906 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:05.906 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:05.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.906 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:05.907 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:05.907 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:05.907 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:05.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.907 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:05.907 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:05.907 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:05.908 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:05.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.908 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:05.908 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:05.908 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:05.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.909 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:05.909 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:05.909 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:05.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:05.909 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:05.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.909 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:05.910 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:05.910 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:05.910 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:05.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.911 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:05.911 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:05.911 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:05.911 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:05.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.913 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:05.913 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:05.914 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:05.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.914 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:05.914 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:05.914 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:05.915 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:05.915 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:05.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.915 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:05.915 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:05.915 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:05.915 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:05.916 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:05.916 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:05.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:05.916 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:05.916 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:05.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.916 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:05.916 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:05.917 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:05.917 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:05.917 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:05.918 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:05.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:05.918 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:05.918 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:05.918 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:05.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:05.919 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:05.919 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:05.919 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:05.920 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:24:06.044 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.041+0000 7ff0165ca700 1 Processor -- start 2020-02-11T16:24:06.045 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.042+0000 7ff0165ca700 1 -- start start 2020-02-11T16:24:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.042+0000 7ff0165ca700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0100a7e40 0x7ff01005ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.042+0000 7ff0165ca700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff01005ace0 0x7ff010142a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.042+0000 7ff0165ca700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0100a8a70 con 0x7ff0100a37f0 2020-02-11T16:24:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.042+0000 7ff0165ca700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0100a7a50 con 0x7ff01005ace0 2020-02-11T16:24:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.042+0000 7ff0165ca700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff010060080 con 0x7ff0100a7e40 2020-02-11T16:24:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.042+0000 7ff014dc7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0100a7e40 0x7ff01005ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.042+0000 7ff014dc7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0100a7e40 0x7ff01005ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58536/0 (socket says 172.21.15.88:58536) 2020-02-11T16:24:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.042+0000 7ff014dc7700 1 -- 172.21.15.88:0/3863121035 learned_addr learned my addr 172.21.15.88:0/3863121035 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.042+0000 7ff0155c8700 1 --1- 172.21.15.88:0/3863121035 >> v1:172.21.15.88:6789/0 conn(0x7ff0100a37f0 0x7ff01005a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46162/0 (socket says 172.21.15.88:46162) 2020-02-11T16:24:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff015dc9700 1 --2- 172.21.15.88:0/3863121035 >> v2:172.21.15.52:3300/0 conn(0x7ff01005ace0 0x7ff010142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff014dc7700 1 -- 172.21.15.88:0/3863121035 >> v2:172.21.15.52:3300/0 conn(0x7ff01005ace0 msgr2=0x7ff010142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3863121035 >> v2:172.21.15.52:3300/0 conn(0x7ff01005ace0 0x7ff010142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff014dc7700 1 -- 172.21.15.88:0/3863121035 >> v1:172.21.15.88:6789/0 conn(0x7ff0100a37f0 legacy=0x7ff01005a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff014dc7700 1 -- 172.21.15.88:0/3863121035 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010060320 con 0x7ff0100a7e40 2020-02-11T16:24:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3863121035 >> v2:172.21.15.88:3300/0 conn(0x7ff0100a7e40 0x7ff01005ec50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff0100a7680 tx=0x7ff0000088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3863121035 >> v2:172.21.15.88:3300/0 conn(0x7ff0100a7e40 0x7ff01005ec50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff0100a7680 tx=0x7ff0000088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3863121035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0100a7e40 0x7ff01005ec50 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7ff0100a7680 tx=0x7ff0000088e0).ready entity=mon.1 client_cookie=2e70382b592f3202 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3863121035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0100a7e40 0x7ff01005ec50 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7ff0100a7680 tx=0x7ff0000088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7feffffff700 1 -- 172.21.15.88:0/3863121035 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff000011720 con 0x7ff0100a7e40 2020-02-11T16:24:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3863121035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0100a7e40 0x7ff01005ec50 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7ff0100a7680 tx=0x7ff0000088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7feffffff700 1 -- 172.21.15.88:0/3863121035 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000011880 con 0x7ff0100a7e40 2020-02-11T16:24:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3863121035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0100a7e40 0x7ff01005ec50 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7ff0100a7680 tx=0x7ff0000088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7feffffff700 1 -- 172.21.15.88:0/3863121035 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff000011c60 con 0x7ff0100a7e40 2020-02-11T16:24:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff0165ca700 1 -- 172.21.15.88:0/3863121035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0100a7e40 msgr2=0x7ff01005ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.043+0000 7ff0165ca700 1 --2- 172.21.15.88:0/3863121035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0100a7e40 0x7ff01005ec50 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7ff0100a7680 tx=0x7ff0000088e0).stop 2020-02-11T16:24:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.044+0000 7ff0165ca700 1 -- 172.21.15.88:0/3863121035 shutdown_connections 2020-02-11T16:24:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.044+0000 7ff0165ca700 1 --2- 172.21.15.88:0/3863121035 >> v2:172.21.15.52:3300/0 conn(0x7ff01005ace0 0x7ff010142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.044+0000 7ff0165ca700 1 --2- 172.21.15.88:0/3863121035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0100a7e40 0x7ff01005ec50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.044+0000 7ff0165ca700 1 -- 172.21.15.88:0/3863121035 >> 172.21.15.88:0/3863121035 conn(0x7ff0100ac1c0 msgr2=0x7ff0100ac5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.044+0000 7ff0165ca700 1 -- 172.21.15.88:0/3863121035 shutdown_connections 2020-02-11T16:24:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.044+0000 7ff0165ca700 1 -- 172.21.15.88:0/3863121035 wait complete. 2020-02-11T16:24:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7ff0165ca700 1 Processor -- start 2020-02-11T16:24:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7ff0165ca700 1 -- start start 2020-02-11T16:24:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7ff0165ca700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff01005ace0 0x7ff0100a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7ff0165ca700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01009c2a0 con 0x7ff0100a37f0 2020-02-11T16:24:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7ff0165ca700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01009bd50 con 0x7ff0100a7e40 2020-02-11T16:24:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7ff0165ca700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0100a0720 con 0x7ff01005ace0 2020-02-11T16:24:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7ff015dc9700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff0100a7e40 0x7ff01013af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46172/0 (socket says 172.21.15.88:46172) 2020-02-11T16:24:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7ff015dc9700 1 -- 172.21.15.88:0/3748111165 learned_addr learned my addr 172.21.15.88:0/3748111165 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7ff0155c8700 1 --2- 172.21.15.88:0/3748111165 >> v2:172.21.15.52:3300/0 conn(0x7ff01005ace0 0x7ff0100a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739785918 0 0) 0x7ff01009bd50 con 0x7ff0100a7e40 2020-02-11T16:24:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.045+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff0002fe0 con 0x7ff0100a7e40 2020-02-11T16:24:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0155c8700 1 -- 172.21.15.88:0/3748111165 >> v1:172.21.15.88:6789/0 conn(0x7ff0100a7e40 legacy=0x7ff01013af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0155c8700 1 -- 172.21.15.88:0/3748111165 >> v1:172.21.15.52:6789/0 conn(0x7ff0100a37f0 legacy=0x7ff0100a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0155c8700 1 -- 172.21.15.88:0/3748111165 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100639b0 con 0x7ff01005ace0 2020-02-11T16:24:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0155c8700 1 --2- 172.21.15.88:0/3748111165 >> v2:172.21.15.52:3300/0 conn(0x7ff01005ace0 0x7ff0100a1e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff010060660 tx=0x7ff00c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0155c8700 1 --2- 172.21.15.88:0/3748111165 >> v2:172.21.15.52:3300/0 conn(0x7ff01005ace0 0x7ff0100a1e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff010060660 tx=0x7ff00c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0155c8700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01005ace0 0x7ff0100a1e50 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7ff010060660 tx=0x7ff00c0108a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0155c8700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01005ace0 0x7ff0100a1e50 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff010060660 tx=0x7ff00c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00c0115b0 con 0x7ff01005ace0 2020-02-11T16:24:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0155c8700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01005ace0 0x7ff0100a1e50 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff010060660 tx=0x7ff00c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c011710 con 0x7ff01005ace0 2020-02-11T16:24:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0165ca700 1 -- 172.21.15.88:0/3748111165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0100a25f0 con 0x7ff01005ace0 2020-02-11T16:24:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0155c8700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01005ace0 0x7ff0100a1e50 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff010060660 tx=0x7ff00c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00c011af0 con 0x7ff01005ace0 2020-02-11T16:24:06.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.046+0000 7ff0165ca700 1 -- 172.21.15.88:0/3748111165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff010064320 con 0x7ff01005ace0 2020-02-11T16:24:06.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.047+0000 7ff0155c8700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01005ace0 0x7ff0100a1e50 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff010060660 tx=0x7ff00c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.047+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff00c00b0a0 con 0x7ff01005ace0 2020-02-11T16:24:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.047+0000 7ff0155c8700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01005ace0 0x7ff0100a1e50 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff010060660 tx=0x7ff00c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.047+0000 7ff0165ca700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 0x7ff01013baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.047+0000 7ff0165ca700 1 -- 172.21.15.88:0/3748111165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100a23b0 con 0x7ff01009ef90 2020-02-11T16:24:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.047+0000 7feffe7fc700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feff0039ef0 0x7feff003c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.047+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff00c049970 con 0x7ff01005ace0 2020-02-11T16:24:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.047+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 0x7ff01013baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.047+0000 7ff015dc9700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feff0039ef0 0x7feff003c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7ff015dc9700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feff0039ef0 0x7feff003c3b0 crc :-1 s=READY pgs=427 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7ff014dc7700 1 -- 172.21.15.88:0/3748111165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0100ac000 con 0x7ff01009ef90 2020-02-11T16:24:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 0x7ff01013baf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0100ad1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 0x7ff01013baf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0100ad1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 0x7ff01013baf0 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0100ad1b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 0x7ff01013baf0 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0100ad1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff000011d10 con 0x7ff01009ef90 2020-02-11T16:24:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 0x7ff01013baf0 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0100ad1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff000015e00 con 0x7ff01009ef90 2020-02-11T16:24:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 msgr2=0x7ff01013baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7feffe7fc700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 0x7ff01013baf0 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0100ad1b0).stop 2020-02-11T16:24:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 msgr2=0x7ff01013baf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.048+0000 7feffe7fc700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009ef90 0x7ff01013baf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.058+0000 7ff0165ca700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 0x7ff01009cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.058+0000 7ff0165ca700 1 -- 172.21.15.88:0/3748111165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100a27f0 con 0x7ff01009cae0 2020-02-11T16:24:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.058+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 0x7ff01009cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7ff014dc7700 1 -- 172.21.15.88:0/3748111165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff0100645a0 con 0x7ff01009cae0 2020-02-11T16:24:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 0x7ff01009cec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0000102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 0x7ff01009cec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0000102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 0x7ff01009cec0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0000102e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 0x7ff01009cec0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0000102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0000154c0 con 0x7ff01009cae0 2020-02-11T16:24:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7ff014dc7700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 0x7ff01009cec0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0000102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4023 (secure 0 0 0) 0x7ff0000140c0 con 0x7ff01009cae0 2020-02-11T16:24:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 msgr2=0x7ff01009cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7feffe7fc700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 0x7ff01009cec0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0000102e0).stop 2020-02-11T16:24:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7feffe7fc700 1 -- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 msgr2=0x7ff01009cec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.059+0000 7feffe7fc700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01009cae0 0x7ff01009cec0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0x7ff01006a2f0 tx=0x7ff0000102e0).stop 2020-02-11T16:24:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.060+0000 7ff0165ca700 1 -- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feff0039ef0 msgr2=0x7feff003c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.060+0000 7ff0165ca700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feff0039ef0 0x7feff003c3b0 crc :-1 s=READY pgs=427 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.060+0000 7ff0165ca700 1 -- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01005ace0 msgr2=0x7ff0100a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.060+0000 7ff0165ca700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01005ace0 0x7ff0100a1e50 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7ff010060660 tx=0x7ff00c0108a0).stop 2020-02-11T16:24:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.060+0000 7ff015dc9700 1 -- 172.21.15.88:0/3748111165 reap_dead start 2020-02-11T16:24:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.060+0000 7ff0165ca700 1 -- 172.21.15.88:0/3748111165 shutdown_connections 2020-02-11T16:24:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.060+0000 7ff0165ca700 1 --2- 172.21.15.88:0/3748111165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff01005ace0 0x7ff0100a1e50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.060+0000 7ff0165ca700 1 -- 172.21.15.88:0/3748111165 >> 172.21.15.88:0/3748111165 conn(0x7ff0100ac1c0 msgr2=0x7ff0100ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.060+0000 7ff0165ca700 1 -- 172.21.15.88:0/3748111165 shutdown_connections 2020-02-11T16:24:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.060+0000 7ff0165ca700 1 -- 172.21.15.88:0/3748111165 wait complete. 2020-02-11T16:24:06.070 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:06.071 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:06.071 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:06.071 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:24:06.071 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 150, 2020-02-11T16:24:06.071 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:06.071 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:06.071 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:24:06.072 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:06.072 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.073 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:24:06.073 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:06.073 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:06.073 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:06.073 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:06.073 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:06.074 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:06.074 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:06.074 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:06.074 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:06.074 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.074 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:06.074 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:06.075 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:06.075 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:06.075 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:06.075 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:06.075 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:06.075 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:06.075 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.076 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.076 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:06.076 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:06.076 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:06.076 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:06.076 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:06.076 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:06.076 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:06.077 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:06.077 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:06.077 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:06.077 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:06.077 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:06.077 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:06.078 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:06.078 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:06.078 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:06.078 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:06.078 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:06.078 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.078 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:06.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.079 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:06.079 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.079 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:06.079 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:06.079 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:06.079 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:06.079 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:06.081 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.081 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.081 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.081 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.081 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:06.081 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:06.081 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:06.082 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:06.082 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.082 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.082 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:06.082 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:06.082 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:06.082 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:06.083 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.083 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:06.083 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:06.083 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.083 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.083 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.083 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:06.084 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:06.084 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.084 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.084 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.084 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.084 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:06.084 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:06.084 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:06.086 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:06.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.086 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.086 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:06.086 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:06.086 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:06.087 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:06.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.087 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:06.087 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:06.087 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.088 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:06.088 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:06.088 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.088 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.088 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.089 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:06.089 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:06.089 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:06.089 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:06.089 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.097 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.097 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.097 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:06.097 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:06.097 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.098 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:06.098 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:06.098 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:06.098 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.098 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.098 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:24:06.099 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.099 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:06.099 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:06.099 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:24:06.099 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.100 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.100 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:06.100 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.100 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:06.101 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:06.101 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:24:06.101 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.101 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.102 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.102 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:06.104 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:24:06.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.222+0000 7efeb47e7700 1 Processor -- start 2020-02-11T16:24:06.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.222+0000 7efeb47e7700 1 -- start start 2020-02-11T16:24:06.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.223+0000 7efeb47e7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efeac131f50 0x7efeac05f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:06.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.223+0000 7efeb47e7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b290 0x7efeac09d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:06.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.223+0000 7efeb47e7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac138360 con 0x7efeac13b6f0 2020-02-11T16:24:06.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.223+0000 7efeb47e7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac138150 con 0x7efeac131f50 2020-02-11T16:24:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.223+0000 7efeb47e7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac138600 con 0x7efeac13b290 2020-02-11T16:24:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.223+0000 7efeb2583700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efeac131f50 0x7efeac05f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.223+0000 7efeb2583700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efeac131f50 0x7efeac05f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58554/0 (socket says 172.21.15.88:58554) 2020-02-11T16:24:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.223+0000 7efeb2d84700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efeac13b6f0 0x7efeac05ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46184/0 (socket says 172.21.15.88:46184) 2020-02-11T16:24:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.223+0000 7efeb2583700 1 -- 172.21.15.88:0/2940605427 learned_addr learned my addr 172.21.15.88:0/2940605427 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.223+0000 7efeb1d82700 1 --2- 172.21.15.88:0/2940605427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b290 0x7efeac09d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb2583700 1 -- 172.21.15.88:0/2940605427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b290 msgr2=0x7efeac09d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb2583700 1 --2- 172.21.15.88:0/2940605427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b290 0x7efeac09d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb2583700 1 -- 172.21.15.88:0/2940605427 >> v1:172.21.15.88:6789/0 conn(0x7efeac13b6f0 legacy=0x7efeac05ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb1581700 1 -- 172.21.15.88:0/2940605427 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000807158 0 0) 0x7efeac138360 con 0x7efeac13b6f0 2020-02-11T16:24:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb2583700 1 -- 172.21.15.88:0/2940605427 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac137d40 con 0x7efeac131f50 2020-02-11T16:24:06.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb1d82700 1 --2- 172.21.15.88:0/2940605427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b290 0x7efeac09d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:24:06.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb2583700 1 --2- 172.21.15.88:0/2940605427 >> v2:172.21.15.88:3300/0 conn(0x7efeac131f50 0x7efeac05f900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efea8002f30 tx=0x7efea80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb2583700 1 --2- 172.21.15.88:0/2940605427 >> v2:172.21.15.88:3300/0 conn(0x7efeac131f50 0x7efeac05f900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efea8002f30 tx=0x7efea80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb2583700 1 --2- 172.21.15.88:0/2940605427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac131f50 0x7efeac05f900 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea80088e0).ready entity=mon.1 client_cookie=78509ed608972f84 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb2583700 1 --2- 172.21.15.88:0/2940605427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac131f50 0x7efeac05f900 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb1581700 1 -- 172.21.15.88:0/2940605427 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea8011760 con 0x7efeac131f50 2020-02-11T16:24:06.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb2583700 1 --2- 172.21.15.88:0/2940605427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac131f50 0x7efeac05f900 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb2583700 1 --2- 172.21.15.88:0/2940605427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac131f50 0x7efeac05f900 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb1581700 1 -- 172.21.15.88:0/2940605427 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea80118c0 con 0x7efeac131f50 2020-02-11T16:24:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb1581700 1 -- 172.21.15.88:0/2940605427 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea8011c60 con 0x7efeac131f50 2020-02-11T16:24:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb47e7700 1 -- 172.21.15.88:0/2940605427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac131f50 msgr2=0x7efeac05f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.224+0000 7efeb47e7700 1 --2- 172.21.15.88:0/2940605427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac131f50 0x7efeac05f900 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7efea8002f30 tx=0x7efea80088e0).stop 2020-02-11T16:24:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.225+0000 7efeb47e7700 1 -- 172.21.15.88:0/2940605427 shutdown_connections 2020-02-11T16:24:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.225+0000 7efeb47e7700 1 --2- 172.21.15.88:0/2940605427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac131f50 0x7efeac05f900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.225+0000 7efeb47e7700 1 --2- 172.21.15.88:0/2940605427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b290 0x7efeac09d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.225+0000 7efeb47e7700 1 -- 172.21.15.88:0/2940605427 >> 172.21.15.88:0/2940605427 conn(0x7efeac0a7bb0 msgr2=0x7efeac0a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.225+0000 7efeb47e7700 1 -- 172.21.15.88:0/2940605427 shutdown_connections 2020-02-11T16:24:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.225+0000 7efeb47e7700 1 -- 172.21.15.88:0/2940605427 wait complete. 2020-02-11T16:24:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.225+0000 7efeb47e7700 1 Processor -- start 2020-02-11T16:24:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.225+0000 7efeb47e7700 1 -- start start 2020-02-11T16:24:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb47e7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efeac13b290 0x7efeac151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb47e7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac0a2460 0x7efeac1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb47e7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac12ce80 con 0x7efeac131f50 2020-02-11T16:24:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb47e7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac12f670 con 0x7efeac13b290 2020-02-11T16:24:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb47e7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac12e210 con 0x7efeac0a2460 2020-02-11T16:24:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb2583700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efeac131f50 0x7efeac12ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46186/0 (socket says 172.21.15.88:46186) 2020-02-11T16:24:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb2583700 1 -- 172.21.15.88:0/3924657379 learned_addr learned my addr 172.21.15.88:0/3924657379 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb1d82700 1 --2- 172.21.15.88:0/3924657379 >> v2:172.21.15.88:3300/0 conn(0x7efeac13b290 0x7efeac151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac0a2460 0x7efeac1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb1d82700 1 -- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac0a2460 msgr2=0x7efeac1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb1d82700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac0a2460 0x7efeac1538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efeb1d82700 1 -- 172.21.15.88:0/3924657379 >> v1:172.21.15.88:6789/0 conn(0x7efeac131f50 legacy=0x7efeac12ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.226+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660942094 0 0) 0x7efeac12ce80 con 0x7efeac131f50 2020-02-11T16:24:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efeb1d82700 1 -- 172.21.15.88:0/3924657379 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac130490 con 0x7efeac13b290 2020-02-11T16:24:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efeb1d82700 1 --2- 172.21.15.88:0/3924657379 >> v2:172.21.15.88:3300/0 conn(0x7efeac13b290 0x7efeac151480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe9c002f30 tx=0x7efe9c010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efeb1d82700 1 --2- 172.21.15.88:0/3924657379 >> v2:172.21.15.88:3300/0 conn(0x7efeac13b290 0x7efeac151480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe9c002f30 tx=0x7efe9c010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efeb1d82700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac13b290 0x7efeac151480 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7efe9c002f30 tx=0x7efe9c010b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efeb1d82700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac13b290 0x7efeac151480 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7efe9c002f30 tx=0x7efe9c010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efeb1d82700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac13b290 0x7efeac151480 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7efe9c002f30 tx=0x7efe9c010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe9c005e90 con 0x7efeac13b290 2020-02-11T16:24:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efeb1d82700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac13b290 0x7efeac151480 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7efe9c002f30 tx=0x7efe9c010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c007160 con 0x7efeac13b290 2020-02-11T16:24:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efeb47e7700 1 -- 172.21.15.88:0/3924657379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac13ad50 con 0x7efeac13b290 2020-02-11T16:24:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe9c007540 con 0x7efeac13b290 2020-02-11T16:24:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efeb47e7700 1 -- 172.21.15.88:0/3924657379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac12e820 con 0x7efeac13b290 2020-02-11T16:24:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.227+0000 7efeb1d82700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac13b290 0x7efeac151480 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7efe9c002f30 tx=0x7efe9c010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.228+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7efe9c0121d0 con 0x7efeac13b290 2020-02-11T16:24:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.228+0000 7efeb1d82700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac13b290 0x7efeac151480 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7efe9c002f30 tx=0x7efe9c010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.228+0000 7efe9b7fe700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039af0 0x7efe8c03bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.228+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7efe9c007e40 con 0x7efeac13b290 2020-02-11T16:24:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.228+0000 7efeb47e7700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 0x7efeac12d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.228+0000 7efeb47e7700 1 -- 172.21.15.88:0/3924657379 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac05e2f0 con 0x7efeac13b6f0 2020-02-11T16:24:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.228+0000 7efeb2583700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039af0 0x7efe8c03bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.228+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 0x7efeac12d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.228+0000 7efeb2583700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039af0 0x7efe8c03bfb0 crc :-1 s=READY pgs=428 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efeb2d84700 1 -- 172.21.15.88:0/3924657379 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efeac0565b0 con 0x7efeac13b6f0 2020-02-11T16:24:06.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 0x7efeac12d330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 0x7efeac12d330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 0x7efeac12d330 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 0x7efeac12d330 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea400cd70 con 0x7efeac13b6f0 2020-02-11T16:24:06.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 0x7efeac12d330 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7efea4004870 con 0x7efeac13b6f0 2020-02-11T16:24:06.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 msgr2=0x7efeac12d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efe9b7fe700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 0x7efeac12d330 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).stop 2020-02-11T16:24:06.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 msgr2=0x7efeac12d330 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.229+0000 7efe9b7fe700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac13b6f0 0x7efeac12d330 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).stop 2020-02-11T16:24:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.238+0000 7efeb47e7700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 0x7efeac05e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.238+0000 7efeb47e7700 1 -- 172.21.15.88:0/3924657379 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0a64b0 con 0x7efeac136fc0 2020-02-11T16:24:06.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.239+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 0x7efeac05e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.239+0000 7efeb2d84700 1 -- 172.21.15.88:0/3924657379 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efeac12ec10 con 0x7efeac136fc0 2020-02-11T16:24:06.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.239+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 0x7efeac05e8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.239+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 0x7efeac05e8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.239+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 0x7efeac05e8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.239+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 0x7efeac05e8f0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.239+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea4010750 con 0x7efeac136fc0 2020-02-11T16:24:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb2d84700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 0x7efeac05e8f0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7efea40073a0 con 0x7efeac136fc0 2020-02-11T16:24:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 msgr2=0x7efeac05e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efe9b7fe700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 0x7efeac05e8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).stop 2020-02-11T16:24:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efe9b7fe700 1 -- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 msgr2=0x7efeac05e8f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efe9b7fe700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efeac136fc0 0x7efeac05e8f0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0x7efea4001210 tx=0x7efea4010e20).stop 2020-02-11T16:24:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb47e7700 1 -- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039af0 msgr2=0x7efe8c03bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb47e7700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe8c039af0 0x7efe8c03bfb0 crc :-1 s=READY pgs=428 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb47e7700 1 -- 172.21.15.88:0/3924657379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac13b290 msgr2=0x7efeac151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb47e7700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac13b290 0x7efeac151480 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7efe9c002f30 tx=0x7efe9c010b30).stop 2020-02-11T16:24:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb2d84700 1 -- 172.21.15.88:0/3924657379 reap_dead start 2020-02-11T16:24:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb2d84700 1 -- 172.21.15.88:0/3924657379 reap_dead start 2020-02-11T16:24:06.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb47e7700 1 -- 172.21.15.88:0/3924657379 shutdown_connections 2020-02-11T16:24:06.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb47e7700 1 --2- 172.21.15.88:0/3924657379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efeac13b290 0x7efeac151480 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb47e7700 1 -- 172.21.15.88:0/3924657379 >> 172.21.15.88:0/3924657379 conn(0x7efeac0a7bb0 msgr2=0x7efeac069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:06.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb47e7700 1 -- 172.21.15.88:0/3924657379 shutdown_connections 2020-02-11T16:24:06.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.240+0000 7efeb47e7700 1 -- 172.21.15.88:0/3924657379 wait complete. 2020-02-11T16:24:06.257 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:06.258 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:06.258 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:06.258 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:24:06.258 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 150, 2020-02-11T16:24:06.258 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:06.258 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:06.258 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:24:06.259 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:06.259 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.259 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:24:06.259 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:06.259 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:06.259 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:06.259 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:06.260 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:06.260 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:06.260 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:06.260 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:06.260 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:06.260 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.261 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:06.261 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:06.261 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:06.261 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:06.261 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:06.262 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:06.262 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:06.262 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:06.262 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.263 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:06.263 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:06.263 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:06.263 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:06.263 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:06.263 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:06.263 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:06.264 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:06.264 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:06.264 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:06.264 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:06.264 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:06.264 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:06.265 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:06.265 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:06.265 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:06.265 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:06.265 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:06.265 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.265 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:06.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.266 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:06.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.266 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:06.266 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:06.266 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:06.266 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:06.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.267 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:06.267 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:06.268 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.268 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:06.268 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:06.268 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.268 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.269 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.269 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:06.269 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:06.269 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:06.269 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:06.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.270 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:06.270 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:06.270 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:06.270 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:06.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.271 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:06.271 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:06.271 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.271 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:06.272 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:06.272 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.272 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.272 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.273 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:06.273 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:06.273 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:06.273 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:06.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.274 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:06.274 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:06.274 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:06.275 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:06.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.275 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:06.275 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:06.276 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.276 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:06.277 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:06.277 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:06.277 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.277 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.282 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:06.282 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:06.282 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:06.282 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:06.283 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.283 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:06.283 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:06.284 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:06.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.284 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:06.284 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:24:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:06.286 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:06.286 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:06.286 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.286 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.286 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:24:06.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.286 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:06.287 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:06.287 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:24:06.287 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.287 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.287 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:06.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.288 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:06.288 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:06.288 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:06.288 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.288 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:06.288 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:24:06.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:06.289 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:06.289 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:06.289 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:06.289 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.289 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:06.289 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:06.290 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:06.290 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:24:06.290 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:24:06.291 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:24:06.291 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:24:06.291 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:24:06.291 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:24:06.301 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:24:06.301 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:24:06.302 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:24:06.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.458+0000 7fa73b59e700 1 Processor -- start 2020-02-11T16:24:06.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.458+0000 7fa73b59e700 1 -- start start 2020-02-11T16:24:06.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.459+0000 7fa73b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa73c134d10 0x7fa73c0a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:06.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.459+0000 7fa73b59e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0a6840 con 0x7fa73c0a5c60 2020-02-11T16:24:06.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.459+0000 7fa73b59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0a60a0 con 0x7fa73c05b1e0 2020-02-11T16:24:06.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.459+0000 7fa73b59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0a6300 con 0x7fa73c134d10 2020-02-11T16:24:06.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.459+0000 7fa73a59c700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa73c05b1e0 legacy=0x7fa73c134600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:06.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.459+0000 7fa733fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa73c134d10 0x7fa73c0a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.459+0000 7fa733fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa73c134d10 0x7fa73c0a3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44558/0 (socket says 172.21.15.88:44558) 2020-02-11T16:24:06.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.459+0000 7fa73ad9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa73c0a5c60 0x7fa73c12dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:37984/0 (socket says 172.21.15.88:37984) 2020-02-11T16:24:06.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.459+0000 7fa733fff700 1 -- 172.21.15.88:0/1434387247 learned_addr learned my addr 172.21.15.88:0/1434387247 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:06.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa733fff700 1 -- 172.21.15.88:0/1434387247 >> v1:172.21.15.88:6789/0 conn(0x7fa73c05b1e0 legacy=0x7fa73c134600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:06.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa733fff700 1 -- 172.21.15.88:0/1434387247 >> v1:172.21.15.52:6789/0 conn(0x7fa73c0a5c60 legacy=0x7fa73c12dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa739d9b700 1 -- 172.21.15.88:0/1434387247 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271307041 0 0) 0x7fa73c0a6840 con 0x7fa73c0a5c60 2020-02-11T16:24:06.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa733fff700 1 -- 172.21.15.88:0/1434387247 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0a65a0 con 0x7fa73c134d10 2020-02-11T16:24:06.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa733fff700 1 --2- 172.21.15.88:0/1434387247 >> v2:172.21.15.52:3300/0 conn(0x7fa73c134d10 0x7fa73c0a3ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa73c05eb90 tx=0x7fa7240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa733fff700 1 --2- 172.21.15.88:0/1434387247 >> v2:172.21.15.52:3300/0 conn(0x7fa73c134d10 0x7fa73c0a3ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa73c05eb90 tx=0x7fa7240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa733fff700 1 --2- 172.21.15.88:0/1434387247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa73c134d10 0x7fa73c0a3ba0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7fa73c05eb90 tx=0x7fa7240088e0).ready entity=mon.0 client_cookie=260fddd31f19c255 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa733fff700 1 --2- 172.21.15.88:0/1434387247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa73c134d10 0x7fa73c0a3ba0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa73c05eb90 tx=0x7fa7240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa739d9b700 1 -- 172.21.15.88:0/1434387247 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa724009e40 con 0x7fa73c134d10 2020-02-11T16:24:06.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa733fff700 1 --2- 172.21.15.88:0/1434387247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa73c134d10 0x7fa73c0a3ba0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa73c05eb90 tx=0x7fa7240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa733fff700 1 --2- 172.21.15.88:0/1434387247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa73c134d10 0x7fa73c0a3ba0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa73c05eb90 tx=0x7fa7240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa739d9b700 1 -- 172.21.15.88:0/1434387247 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa724012a20 con 0x7fa73c134d10 2020-02-11T16:24:06.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa739d9b700 1 -- 172.21.15.88:0/1434387247 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa724012dc0 con 0x7fa73c134d10 2020-02-11T16:24:06.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa73b59e700 1 -- 172.21.15.88:0/1434387247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa73c134d10 msgr2=0x7fa73c0a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa73b59e700 1 --2- 172.21.15.88:0/1434387247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa73c134d10 0x7fa73c0a3ba0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7fa73c05eb90 tx=0x7fa7240088e0).stop 2020-02-11T16:24:06.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa73b59e700 1 -- 172.21.15.88:0/1434387247 shutdown_connections 2020-02-11T16:24:06.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa73b59e700 1 --2- 172.21.15.88:0/1434387247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa73c134d10 0x7fa73c0a3ba0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa73b59e700 1 -- 172.21.15.88:0/1434387247 >> 172.21.15.88:0/1434387247 conn(0x7fa73c0a9f90 msgr2=0x7fa73c0aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:06.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa73b59e700 1 -- 172.21.15.88:0/1434387247 shutdown_connections 2020-02-11T16:24:06.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.460+0000 7fa73b59e700 1 -- 172.21.15.88:0/1434387247 wait complete. 2020-02-11T16:24:06.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.461+0000 7fa73b59e700 1 Processor -- start 2020-02-11T16:24:06.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.461+0000 7fa73b59e700 1 -- start start 2020-02-11T16:24:06.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa73b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa73c05b1e0 0x7fa73c09d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa73b59e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa73b59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c142ec0 con 0x7fa73c134d10 2020-02-11T16:24:06.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa73b59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c130030 con 0x7fa73c05b1e0 2020-02-11T16:24:06.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa73b59e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c143160 con 0x7fa73c0a5c60 2020-02-11T16:24:06.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa73ad9d700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa73c134d10 legacy=0x7fa73c12db10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:06.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa73a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa73c05b1e0 0x7fa73c09d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa733fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa733fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52904/0 (socket says 172.21.15.88:52904) 2020-02-11T16:24:06.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa733fff700 1 -- 172.21.15.88:0/1310444270 learned_addr learned my addr 172.21.15.88:0/1310444270 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:06.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa73a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa73c05b1e0 0x7fa73c09d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44564/0 (socket says 172.21.15.88:44564) 2020-02-11T16:24:06.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa733fff700 1 -- 172.21.15.88:0/1310444270 >> v2:172.21.15.52:3300/0 conn(0x7fa73c05b1e0 msgr2=0x7fa73c09d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> v2:172.21.15.52:3300/0 conn(0x7fa73c05b1e0 0x7fa73c09d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa733fff700 1 -- 172.21.15.88:0/1310444270 >> v1:172.21.15.88:6789/0 conn(0x7fa73c134d10 legacy=0x7fa73c12db10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:24:06.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa733fff700 1 -- 172.21.15.88:0/1310444270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c131ac0 con 0x7fa73c0a5c60 2020-02-11T16:24:06.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.462+0000 7fa73a59c700 1 --2- 172.21.15.88:0/1310444270 >> v2:172.21.15.52:3300/0 conn(0x7fa73c05b1e0 0x7fa73c09d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:06.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa7337fe700 1 -- 172.21.15.88:0/1310444270 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa724007340 con 0x7fa73c0a5c60 2020-02-11T16:24:06.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa7337fe700 1 -- 172.21.15.88:0/1310444270 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7240074a0 con 0x7fa73c0a5c60 2020-02-11T16:24:06.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa73b59e700 1 -- 172.21.15.88:0/1310444270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c12fcc0 con 0x7fa73c0a5c60 2020-02-11T16:24:06.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa7337fe700 1 -- 172.21.15.88:0/1310444270 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7240058b0 con 0x7fa73c0a5c60 2020-02-11T16:24:06.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa73b59e700 1 -- 172.21.15.88:0/1310444270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c1301c0 con 0x7fa73c0a5c60 2020-02-11T16:24:06.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.463+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.464+0000 7fa7337fe700 1 -- 172.21.15.88:0/1310444270 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa72400f0c0 con 0x7fa73c0a5c60 2020-02-11T16:24:06.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.464+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.464+0000 7fa7337fe700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa720039e30 0x7fa72003c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:06.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.464+0000 7fa7337fe700 1 -- 172.21.15.88:0/1310444270 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa72404a180 con 0x7fa73c0a5c60 2020-02-11T16:24:06.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.464+0000 7fa73a59c700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa720039e30 0x7fa72003c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:06.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.464+0000 7fa73b59e700 1 -- 172.21.15.88:0/1310444270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c0565b0 con 0x7fa73c0a5c60 2020-02-11T16:24:06.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.464+0000 7fa73a59c700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa720039e30 0x7fa72003c2f0 crc :-1 s=READY pgs=429 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:06.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.468+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.468+0000 7fa7337fe700 1 -- 172.21.15.88:0/1310444270 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fa72402f820 con 0x7fa73c0a5c60 2020-02-11T16:24:06.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.684+0000 7fa73b59e700 1 -- 172.21.15.88:0/1310444270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa73c0565b0 con 0x7fa73c0a5c60 2020-02-11T16:24:06.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.685+0000 7fa733fff700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:06.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.685+0000 7fa7337fe700 1 -- 172.21.15.88:0/1310444270 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fa724032330 con 0x7fa73c0a5c60 2020-02-11T16:24:06.688 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:06.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 -- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa720039e30 msgr2=0x7fa72003c2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa720039e30 0x7fa72003c2f0 crc :-1 s=READY pgs=429 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 -- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 msgr2=0x7fa73c143600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:06.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7fa73c0a3ba0 tx=0x7fa724012fa0).stop 2020-02-11T16:24:06.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 -- 172.21.15.88:0/1310444270 shutdown_connections 2020-02-11T16:24:06.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa720039e30 0x7fa72003c2f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 --2- 172.21.15.88:0/1310444270 >> v2:172.21.15.52:3300/0 conn(0x7fa73c05b1e0 0x7fa73c09d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 --2- 172.21.15.88:0/1310444270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa73c0a5c60 0x7fa73c143600 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:06.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 -- 172.21.15.88:0/1310444270 >> 172.21.15.88:0/1310444270 conn(0x7fa73c0a9f90 msgr2=0x7fa73c1328d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:06.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 -- 172.21.15.88:0/1310444270 shutdown_connections 2020-02-11T16:24:06.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:06.687+0000 7fa73b59e700 1 -- 172.21.15.88:0/1310444270 wait complete. 2020-02-11T16:24:06.702 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":150,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:09.702 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:24:09.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.819+0000 7fb5d9d9c700 1 Processor -- start 2020-02-11T16:24:09.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.819+0000 7fb5d9d9c700 1 -- start start 2020-02-11T16:24:09.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.820+0000 7fb5d9d9c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d4134d10 0x7fb5d40a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:09.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.820+0000 7fb5d9d9c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5d40a5c60 0x7fb5d412dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:09.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.820+0000 7fb5d9d9c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d40a6840 con 0x7fb5d405b1e0 2020-02-11T16:24:09.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.820+0000 7fb5d9d9c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d40a60c0 con 0x7fb5d40a5c60 2020-02-11T16:24:09.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.820+0000 7fb5d9d9c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40a6300 con 0x7fb5d4134d10 2020-02-11T16:24:09.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.820+0000 7fb5d3fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d4134d10 0x7fb5d40a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:09.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.820+0000 7fb5d959b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5d40a5c60 0x7fb5d412dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:09.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.820+0000 7fb5d959b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5d40a5c60 0x7fb5d412dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44576/0 (socket says 172.21.15.88:44576) 2020-02-11T16:24:09.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.820+0000 7fb5d3fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d4134d10 0x7fb5d40a3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52910/0 (socket says 172.21.15.88:52910) 2020-02-11T16:24:09.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.820+0000 7fb5d959b700 1 -- 172.21.15.88:0/2518810459 learned_addr learned my addr 172.21.15.88:0/2518810459 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:09.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d959b700 1 -- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d4134d10 msgr2=0x7fb5d40a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:09.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d959b700 1 --2- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d4134d10 0x7fb5d40a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:09.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d959b700 1 -- 172.21.15.88:0/2518810459 >> v1:172.21.15.52:6789/0 conn(0x7fb5d405b1e0 legacy=0x7fb5d4134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:09.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d959b700 1 -- 172.21.15.88:0/2518810459 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d40a65a0 con 0x7fb5d40a5c60 2020-02-11T16:24:09.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d3fff700 1 --2- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d4134d10 0x7fb5d40a3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:09.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d959b700 1 --2- 172.21.15.88:0/2518810459 >> v2:172.21.15.52:3300/0 conn(0x7fb5d40a5c60 0x7fb5d412dc10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb5cc0032b0 tx=0x7fb5cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d959b700 1 --2- 172.21.15.88:0/2518810459 >> v2:172.21.15.52:3300/0 conn(0x7fb5d40a5c60 0x7fb5d412dc10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb5cc0032b0 tx=0x7fb5cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d959b700 1 --2- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d40a5c60 0x7fb5d412dc10 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5cc008c60).ready entity=mon.0 client_cookie=1b6eeaf4b04ba79d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:09.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d959b700 1 --2- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d40a5c60 0x7fb5d412dc10 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d37fe700 1 -- 172.21.15.88:0/2518810459 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5cc00a160 con 0x7fb5d40a5c60 2020-02-11T16:24:09.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d959b700 1 --2- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d40a5c60 0x7fb5d412dc10 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d37fe700 1 -- 172.21.15.88:0/2518810459 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc00a2c0 con 0x7fb5d40a5c60 2020-02-11T16:24:09.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d959b700 1 --2- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d40a5c60 0x7fb5d412dc10 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d37fe700 1 -- 172.21.15.88:0/2518810459 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5cc00a6a0 con 0x7fb5d40a5c60 2020-02-11T16:24:09.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d40a5c60 msgr2=0x7fb5d412dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:09.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.821+0000 7fb5d9d9c700 1 --2- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d40a5c60 0x7fb5d412dc10 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5cc008c60).stop 2020-02-11T16:24:09.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.822+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/2518810459 shutdown_connections 2020-02-11T16:24:09.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.822+0000 7fb5d9d9c700 1 --2- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d40a5c60 0x7fb5d412dc10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:09.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.822+0000 7fb5d9d9c700 1 --2- 172.21.15.88:0/2518810459 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d4134d10 0x7fb5d40a3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:09.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.822+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/2518810459 >> 172.21.15.88:0/2518810459 conn(0x7fb5d40a9f90 msgr2=0x7fb5d40aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:09.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.822+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/2518810459 shutdown_connections 2020-02-11T16:24:09.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.822+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/2518810459 wait complete. 2020-02-11T16:24:09.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.823+0000 7fb5d9d9c700 1 Processor -- start 2020-02-11T16:24:09.830 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.823+0000 7fb5d9d9c700 1 -- start start 2020-02-11T16:24:09.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.823+0000 7fb5d9d9c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d40a5c60 0x7fb5d4135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:09.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.823+0000 7fb5d9d9c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5d4134d10 0x7fb5d4137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:09.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.823+0000 7fb5d9d9c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d4138120 con 0x7fb5d405b1e0 2020-02-11T16:24:09.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.823+0000 7fb5d9d9c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d40a75f0 con 0x7fb5d4134d10 2020-02-11T16:24:09.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.823+0000 7fb5d9d9c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d4137200 con 0x7fb5d40a5c60 2020-02-11T16:24:09.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d3fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d40a5c60 0x7fb5d4135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:09.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d959b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5d4134d10 0x7fb5d4137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:09.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d3fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d40a5c60 0x7fb5d4135bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52918/0 (socket says 172.21.15.88:52918) 2020-02-11T16:24:09.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d959b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5d4134d10 0x7fb5d4137cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44582/0 (socket says 172.21.15.88:44582) 2020-02-11T16:24:09.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d3fff700 1 -- 172.21.15.88:0/1953574226 learned_addr learned my addr 172.21.15.88:0/1953574226 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:09.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d959b700 1 -- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d40a5c60 msgr2=0x7fb5d4135bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:09.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d40a5c60 0x7fb5d4135bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:09.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d959b700 1 -- 172.21.15.88:0/1953574226 >> v1:172.21.15.52:6789/0 conn(0x7fb5d405b1e0 legacy=0x7fb5d4144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:09.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d959b700 1 -- 172.21.15.88:0/1953574226 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d41374a0 con 0x7fb5d4134d10 2020-02-11T16:24:09.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d3fff700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d40a5c60 0x7fb5d4135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:09.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> v2:172.21.15.52:3300/0 conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> v2:172.21.15.52:3300/0 conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.824+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:09.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.825+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.825+0000 7fb5d1ffb700 1 -- 172.21.15.88:0/1953574226 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5cc005c30 con 0x7fb5d4134d10 2020-02-11T16:24:09.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.825+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.825+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.825+0000 7fb5d1ffb700 1 -- 172.21.15.88:0/1953574226 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc005d90 con 0x7fb5d4134d10 2020-02-11T16:24:09.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.825+0000 7fb5d1ffb700 1 -- 172.21.15.88:0/1953574226 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5cc00f760 con 0x7fb5d4134d10 2020-02-11T16:24:09.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.825+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/1953574226 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d41364b0 con 0x7fb5d4134d10 2020-02-11T16:24:09.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.825+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/1953574226 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d4135730 con 0x7fb5d4134d10 2020-02-11T16:24:09.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.825+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.826+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/1953574226 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d40565b0 con 0x7fb5d4134d10 2020-02-11T16:24:09.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.826+0000 7fb5d1ffb700 1 -- 172.21.15.88:0/1953574226 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb5cc008420 con 0x7fb5d4134d10 2020-02-11T16:24:09.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.826+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.826+0000 7fb5d1ffb700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb5bc039db0 0x7fb5bc03c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:09.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.826+0000 7fb5d1ffb700 1 -- 172.21.15.88:0/1953574226 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb5cc04a730 con 0x7fb5d4134d10 2020-02-11T16:24:09.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.826+0000 7fb5d8d9a700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb5bc039db0 0x7fb5bc03c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:09.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.827+0000 7fb5d8d9a700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb5bc039db0 0x7fb5bc03c270 crc :-1 s=READY pgs=430 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.830+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:09.830+0000 7fb5d1ffb700 1 -- 172.21.15.88:0/1953574226 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb5cc032d00 con 0x7fb5d4134d10 2020-02-11T16:24:10.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.057+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/1953574226 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb5d4131c70 con 0x7fb5d4134d10 2020-02-11T16:24:10.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.057+0000 7fb5d959b700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:10.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.057+0000 7fb5d1ffb700 1 -- 172.21.15.88:0/1953574226 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fb5cc0328c0 con 0x7fb5d4134d10 2020-02-11T16:24:10.060 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:10.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb5bc039db0 msgr2=0x7fb5bc03c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:10.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb5bc039db0 0x7fb5bc03c270 crc :-1 s=READY pgs=430 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:10.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 msgr2=0x7fb5d4137cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:10.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 0x7fb5d4137cc0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fb5cc0032b0 tx=0x7fb5d40a6200).stop 2020-02-11T16:24:10.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/1953574226 shutdown_connections 2020-02-11T16:24:10.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb5bc039db0 0x7fb5bc03c270 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:10.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d4134d10 0x7fb5d4137cc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:10.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 --2- 172.21.15.88:0/1953574226 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d40a5c60 0x7fb5d4135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:10.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/1953574226 >> 172.21.15.88:0/1953574226 conn(0x7fb5d40a9f90 msgr2=0x7fb5d4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:10.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/1953574226 shutdown_connections 2020-02-11T16:24:10.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:10.059+0000 7fb5d9d9c700 1 -- 172.21.15.88:0/1953574226 wait complete. 2020-02-11T16:24:10.073 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":150,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:13.083 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:24:13.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.194+0000 7f28f4df3700 1 Processor -- start 2020-02-11T16:24:13.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.194+0000 7f28f4df3700 1 -- start start 2020-02-11T16:24:13.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.195+0000 7f28f4df3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28f00a2870 0x7f28f0143590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.195+0000 7f28f4df3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f013c000 con 0x7f28f00a73d0 2020-02-11T16:24:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.195+0000 7f28f4df3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f00a30c0 con 0x7f28f00a6ff0 2020-02-11T16:24:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.195+0000 7f28f4df3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f0132460 con 0x7f28f00a2870 2020-02-11T16:24:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.195+0000 7f28ee59c700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f28f00a6ff0 legacy=0x7f28f013b1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28f00a2870 0x7f28f0143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:13.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28f00a2870 0x7f28f0143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44590/0 (socket says 172.21.15.88:44590) 2020-02-11T16:24:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 -- 172.21.15.88:0/3353442726 learned_addr learned my addr 172.21.15.88:0/3353442726 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 -- 172.21.15.88:0/3353442726 >> v1:172.21.15.88:6789/0 conn(0x7f28f00a6ff0 legacy=0x7f28f013b1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 -- 172.21.15.88:0/3353442726 >> v1:172.21.15.52:6789/0 conn(0x7f28f00a73d0 legacy=0x7f28f013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 -- 172.21.15.88:0/3353442726 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00a2130 con 0x7f28f00a2870 2020-02-11T16:24:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 --2- 172.21.15.88:0/3353442726 >> v2:172.21.15.52:3300/0 conn(0x7f28f00a2870 0x7f28f0143590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f28f00ad0c0 tx=0x7f28e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 --2- 172.21.15.88:0/3353442726 >> v2:172.21.15.52:3300/0 conn(0x7f28f00a2870 0x7f28f0143590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f28f00ad0c0 tx=0x7f28e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 --2- 172.21.15.88:0/3353442726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a2870 0x7f28f0143590 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f28f00ad0c0 tx=0x7f28e8008c60).ready entity=mon.0 client_cookie=ac9fb8f321d28d80 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 --2- 172.21.15.88:0/3353442726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a2870 0x7f28f0143590 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f28f00ad0c0 tx=0x7f28e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28ed59a700 1 -- 172.21.15.88:0/3353442726 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e800a160 con 0x7f28f00a2870 2020-02-11T16:24:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 --2- 172.21.15.88:0/3353442726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a2870 0x7f28f0143590 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f28f00ad0c0 tx=0x7f28e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28ed59a700 1 -- 172.21.15.88:0/3353442726 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e800a2c0 con 0x7f28f00a2870 2020-02-11T16:24:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28f4df3700 1 -- 172.21.15.88:0/3353442726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a2870 msgr2=0x7f28f0143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28eed9d700 1 --2- 172.21.15.88:0/3353442726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a2870 0x7f28f0143590 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f28f00ad0c0 tx=0x7f28e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28ed59a700 1 -- 172.21.15.88:0/3353442726 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e800a660 con 0x7f28f00a2870 2020-02-11T16:24:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.196+0000 7f28f4df3700 1 --2- 172.21.15.88:0/3353442726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a2870 0x7f28f0143590 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f28f00ad0c0 tx=0x7f28e8008c60).stop 2020-02-11T16:24:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.197+0000 7f28f4df3700 1 -- 172.21.15.88:0/3353442726 shutdown_connections 2020-02-11T16:24:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.197+0000 7f28f4df3700 1 --2- 172.21.15.88:0/3353442726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a2870 0x7f28f0143590 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.197+0000 7f28f4df3700 1 -- 172.21.15.88:0/3353442726 >> 172.21.15.88:0/3353442726 conn(0x7f28f00ac2d0 msgr2=0x7f28f00ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.197+0000 7f28f4df3700 1 -- 172.21.15.88:0/3353442726 shutdown_connections 2020-02-11T16:24:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.197+0000 7f28f4df3700 1 -- 172.21.15.88:0/3353442726 wait complete. 2020-02-11T16:24:13.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.198+0000 7f28f4df3700 1 Processor -- start 2020-02-11T16:24:13.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.198+0000 7f28f4df3700 1 -- start start 2020-02-11T16:24:13.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.198+0000 7f28f4df3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28f00a2870 0x7f28f00a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:13.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.198+0000 7f28f4df3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28f00a6ff0 0x7f28f00a5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.198+0000 7f28f4df3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f0131ac0 con 0x7f28f00a73d0 2020-02-11T16:24:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.198+0000 7f28f4df3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f0131800 con 0x7f28f00a6ff0 2020-02-11T16:24:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.198+0000 7f28f4df3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f00a5280 con 0x7f28f00a2870 2020-02-11T16:24:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.198+0000 7f28ee59c700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f28f00a2870 msgr2=0x7f28f00a4e20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:24:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.198+0000 7f28ee59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28f00a2870 0x7f28f00a4e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.198+0000 7f28eed9d700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f28f00a73d0 legacy=0x7f28f01310f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28f00a6ff0 0x7f28f00a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28f00a6ff0 0x7f28f00a5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44594/0 (socket says 172.21.15.88:44594) 2020-02-11T16:24:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 -- 172.21.15.88:0/2523303086 learned_addr learned my addr 172.21.15.88:0/2523303086 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 -- 172.21.15.88:0/2523303086 >> v2:172.21.15.88:3300/0 conn(0x7f28f00a2870 msgr2=0x7f28f00a4e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:24:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> v2:172.21.15.88:3300/0 conn(0x7f28f00a2870 0x7f28f00a4e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 -- 172.21.15.88:0/2523303086 >> v1:172.21.15.88:6789/0 conn(0x7f28f00a73d0 legacy=0x7f28f01310f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:24:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 -- 172.21.15.88:0/2523303086 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f0134220 con 0x7f28f00a6ff0 2020-02-11T16:24:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> v2:172.21.15.52:3300/0 conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> v2:172.21.15.52:3300/0 conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28df7fe700 1 -- 172.21.15.88:0/2523303086 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e4001ea0 con 0x7f28f00a6ff0 2020-02-11T16:24:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28f4df3700 1 -- 172.21.15.88:0/2523303086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f0134690 con 0x7f28f00a6ff0 2020-02-11T16:24:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28df7fe700 1 -- 172.21.15.88:0/2523303086 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400cc20 con 0x7f28f00a6ff0 2020-02-11T16:24:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28df7fe700 1 -- 172.21.15.88:0/2523303086 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e400cd90 con 0x7f28f00a6ff0 2020-02-11T16:24:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.199+0000 7f28f4df3700 1 -- 172.21.15.88:0/2523303086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f013bb80 con 0x7f28f00a6ff0 2020-02-11T16:24:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.200+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.200+0000 7f28df7fe700 1 -- 172.21.15.88:0/2523303086 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f28e40064e0 con 0x7f28f00a6ff0 2020-02-11T16:24:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.200+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.200+0000 7f28df7fe700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f28cc039bc0 0x7f28cc03c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.200+0000 7f28df7fe700 1 -- 172.21.15.88:0/2523303086 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f28e40495b0 con 0x7f28f00a6ff0 2020-02-11T16:24:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.201+0000 7f28f4df3700 1 -- 172.21.15.88:0/2523303086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f0135510 con 0x7f28f00a6ff0 2020-02-11T16:24:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.201+0000 7f28ee59c700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f28cc039bc0 0x7f28cc03c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:13.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.201+0000 7f28ee59c700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f28cc039bc0 0x7f28cc03c080 crc :-1 s=READY pgs=431 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:13.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.204+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.212 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.204+0000 7f28df7fe700 1 -- 172.21.15.88:0/2523303086 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f28e402eb10 con 0x7f28f00a6ff0 2020-02-11T16:24:13.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.425+0000 7f28f4df3700 1 -- 172.21.15.88:0/2523303086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f28f00565b0 con 0x7f28f00a6ff0 2020-02-11T16:24:13.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.426+0000 7f28edd9b700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:13.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.426+0000 7f28df7fe700 1 -- 172.21.15.88:0/2523303086 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f28e4031620 con 0x7f28f00a6ff0 2020-02-11T16:24:13.428 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:13.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.427+0000 7f28f4df3700 1 -- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f28cc039bc0 msgr2=0x7f28cc03c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:13.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.427+0000 7f28f4df3700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f28cc039bc0 0x7f28cc03c080 crc :-1 s=READY pgs=431 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:13.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.427+0000 7f28f4df3700 1 -- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 msgr2=0x7f28f00a5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:13.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.427+0000 7f28f4df3700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 0x7f28f00a5630 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f28f00a4b00 tx=0x7f28e4010a10).stop 2020-02-11T16:24:13.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.428+0000 7f28f4df3700 1 -- 172.21.15.88:0/2523303086 shutdown_connections 2020-02-11T16:24:13.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.428+0000 7f28f4df3700 1 --2- 172.21.15.88:0/2523303086 >> v2:172.21.15.88:3300/0 conn(0x7f28f00a2870 0x7f28f00a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:13.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.428+0000 7f28f4df3700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f28cc039bc0 0x7f28cc03c080 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:13.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.428+0000 7f28f4df3700 1 --2- 172.21.15.88:0/2523303086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28f00a6ff0 0x7f28f00a5630 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:13.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.428+0000 7f28f4df3700 1 -- 172.21.15.88:0/2523303086 >> 172.21.15.88:0/2523303086 conn(0x7f28f00ac2d0 msgr2=0x7f28f005a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.428+0000 7f28f4df3700 1 -- 172.21.15.88:0/2523303086 shutdown_connections 2020-02-11T16:24:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:13.428+0000 7f28f4df3700 1 -- 172.21.15.88:0/2523303086 wait complete. 2020-02-11T16:24:13.440 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":150,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:14.939 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:24:14.942 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:24:16.441 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:24:16.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.557+0000 7f75d564f700 1 Processor -- start 2020-02-11T16:24:16.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.557+0000 7f75d564f700 1 -- start start 2020-02-11T16:24:16.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.558+0000 7f75d564f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:16.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.558+0000 7f75d564f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d00a6840 con 0x7f75d0134d10 2020-02-11T16:24:16.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.558+0000 7f75d564f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d00a6300 con 0x7f75d00a5c60 2020-02-11T16:24:16.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.558+0000 7f75d564f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d00a60f0 con 0x7f75d005b1e0 2020-02-11T16:24:16.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.558+0000 7f75c7fff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f75d00a5c60 legacy=0x7f75d0134600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:16.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.558+0000 7f75cffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:16.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.558+0000 7f75cffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44600/0 (socket says 172.21.15.88:44600) 2020-02-11T16:24:16.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.558+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 learned_addr learned my addr 172.21.15.88:0/3161258539 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:16.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.559+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:24:16.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.559+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:24:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.559+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:24:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.559+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:16.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.759+0000 7f75c7fff700 1 -- 172.21.15.88:0/3161258539 >> v1:172.21.15.88:6789/0 conn(0x7f75d00a5c60 legacy=0x7f75d0134600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:16.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.760+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:16.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.760+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:24:16.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.760+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:24:16.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.760+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:24:16.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:16.760+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:24:17.161 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.160+0000 7f75c7fff700 1 -- 172.21.15.88:0/3161258539 >> v1:172.21.15.88:6789/0 conn(0x7f75d00a5c60 legacy=0x7f75d0134600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:17.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.161+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:17.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.161+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:24:17.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.161+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:24:17.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.161+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:24:17.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.161+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:24:17.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.961+0000 7f75c7fff700 1 -- 172.21.15.88:0/3161258539 >> v1:172.21.15.88:6789/0 conn(0x7f75d00a5c60 legacy=0x7f75d0134600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:17.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.962+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:17.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.962+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:24:17.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.962+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:24:17.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.962+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:24:17.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:17.962+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:24:19.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:19.562+0000 7f75c7fff700 1 -- 172.21.15.88:0/3161258539 >> v1:172.21.15.88:6789/0 conn(0x7f75d00a5c60 legacy=0x7f75d0134600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:19.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:19.564+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:19.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:19.564+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:24:19.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:19.564+0000 7f75cffff700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:24:19.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:19.564+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:24:19.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:19.564+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:24:21.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.228+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695188016 0 0) 0x7f75d00a6840 con 0x7f75d0134d10 2020-02-11T16:24:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.228+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b0003230 con 0x7f75d0134d10 2020-02-11T16:24:21.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1930401410 0 0) 0x7f75b0003230 con 0x7f75d0134d10 2020-02-11T16:24:21.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 msgr2=0x7f75d00a3ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:21.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 --2- 172.21.15.88:0/3161258539 >> v2:172.21.15.52:3300/0 conn(0x7f75d005b1e0 0x7f75d00a3ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:21.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 >> v1:172.21.15.88:6789/0 conn(0x7f75d00a5c60 legacy=0x7f75d0134600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:21.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d00a65a0 con 0x7f75d0134d10 2020-02-11T16:24:21.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f75c8001a30 con 0x7f75d0134d10 2020-02-11T16:24:21.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 >> v1:172.21.15.52:6789/0 conn(0x7f75d0134d10 legacy=0x7f75d012dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75b0003720 0x7f75b0003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75b0003fa0 0x7f75b00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 0x7f75b0004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00a60f0 con 0x7f75b0003720 2020-02-11T16:24:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b000b7b0 con 0x7f75b0003fa0 2020-02-11T16:24:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b000b970 con 0x7f75b0004a20 2020-02-11T16:24:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75c7fff700 1 -- 172.21.15.88:0/3161258539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75b0003fa0 msgr2=0x7f75b00044d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:24:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75b0003fa0 0x7f75b00044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75d4e4e700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 0x7f75b0004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75b0003720 0x7f75b0003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75d4e4e700 1 -- 172.21.15.88:0/3161258539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75b0003fa0 msgr2=0x7f75b00044d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75d4e4e700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75b0003fa0 0x7f75b00044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75d4e4e700 1 -- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75b0003720 msgr2=0x7f75b0003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:21.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75d4e4e700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75b0003720 0x7f75b0003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:21.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75d4e4e700 1 -- 172.21.15.88:0/3161258539 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0003230 con 0x7f75b0004a20 2020-02-11T16:24:21.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75cffff700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75b0003720 0x7f75b0003b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:21.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75d4e4e700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 0x7f75b0004ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f75b0004440 tx=0x7f75c800c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75d4e4e700 1 -- 172.21.15.88:0/3161258539 reap_dead start 2020-02-11T16:24:21.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75d4e4e700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 0x7f75b0004ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f75b0004440 tx=0x7f75c800c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.229+0000 7f75d4e4e700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 0x7f75b0004ed0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f75b0004440 tx=0x7f75c800c4b0).ready entity=mon.2 client_cookie=e6b56b07063943cf server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.230+0000 7f75d4e4e700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 0x7f75b0004ed0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f75b0004440 tx=0x7f75c800c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.230+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c800cd50 con 0x7f75b0004a20 2020-02-11T16:24:21.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.230+0000 7f75d4e4e700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 0x7f75b0004ed0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f75b0004440 tx=0x7f75c800c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.230+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c8010160 con 0x7f75b0004a20 2020-02-11T16:24:21.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.230+0000 7f75d4e4e700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 0x7f75b0004ed0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f75b0004440 tx=0x7f75c800c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.230+0000 7f75cf7fe700 1 -- 172.21.15.88:0/3161258539 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c80104c0 con 0x7f75b0004a20 2020-02-11T16:24:21.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.230+0000 7f75d564f700 1 -- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 msgr2=0x7f75b0004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.230+0000 7f75d564f700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 0x7f75b0004ed0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f75b0004440 tx=0x7f75c800c4b0).stop 2020-02-11T16:24:21.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.231+0000 7f75d564f700 1 -- 172.21.15.88:0/3161258539 shutdown_connections 2020-02-11T16:24:21.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.231+0000 7f75d564f700 1 --2- 172.21.15.88:0/3161258539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f75b0004a20 0x7f75b0004ed0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.231+0000 7f75d564f700 1 -- 172.21.15.88:0/3161258539 >> 172.21.15.88:0/3161258539 conn(0x7f75d00a9f90 msgr2=0x7f75d00aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:21.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.231+0000 7f75d564f700 1 -- 172.21.15.88:0/3161258539 shutdown_connections 2020-02-11T16:24:21.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.231+0000 7f75d564f700 1 -- 172.21.15.88:0/3161258539 wait complete. 2020-02-11T16:24:21.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.231+0000 7f75d564f700 1 Processor -- start 2020-02-11T16:24:21.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75d564f700 1 -- start start 2020-02-11T16:24:21.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75d564f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75d009f210 0x7f75d012da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75d564f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75d00a55f0 0x7f75d012dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75d564f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d0066cf0 con 0x7f75b0004a20 2020-02-11T16:24:21.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75d564f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d0066f90 con 0x7f75d009f210 2020-02-11T16:24:21.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75d564f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d0067230 con 0x7f75d00a55f0 2020-02-11T16:24:21.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75d4e4e700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f75d00a55f0 msgr2=0x7f75d012dee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:24:21.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75d4e4e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75d00a55f0 0x7f75d012dee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:21.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75c7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75d009f210 0x7f75d012da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75c7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75d009f210 0x7f75d012da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44630/0 (socket says 172.21.15.88:44630) 2020-02-11T16:24:21.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.232+0000 7f75c7fff700 1 -- 172.21.15.88:0/3513453013 learned_addr learned my addr 172.21.15.88:0/3513453013 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:21.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.233+0000 7f75c7fff700 1 -- 172.21.15.88:0/3513453013 >> v2:172.21.15.88:3300/0 conn(0x7f75d00a55f0 msgr2=0x7f75d012dee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:24:21.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.233+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> v2:172.21.15.88:3300/0 conn(0x7f75d00a55f0 0x7f75d012dee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.233+0000 7f75c7fff700 1 -- 172.21.15.88:0/3513453013 >> v1:172.21.15.52:6789/0 conn(0x7f75b0004a20 legacy=0x7f75d012efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.233+0000 7f75c7fff700 1 -- 172.21.15.88:0/3513453013 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d01385b0 con 0x7f75d009f210 2020-02-11T16:24:21.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.233+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> v2:172.21.15.52:3300/0 conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.233+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> v2:172.21.15.52:3300/0 conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.233+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.234+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.234+0000 7f75cdffb700 1 -- 172.21.15.88:0/3513453013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b800e9a0 con 0x7f75d009f210 2020-02-11T16:24:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.234+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.234+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.234+0000 7f75cdffb700 1 -- 172.21.15.88:0/3513453013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b800eb00 con 0x7f75d009f210 2020-02-11T16:24:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.234+0000 7f75d564f700 1 -- 172.21.15.88:0/3513453013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d009f780 con 0x7f75d009f210 2020-02-11T16:24:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.234+0000 7f75cdffb700 1 -- 172.21.15.88:0/3513453013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b8012180 con 0x7f75d009f210 2020-02-11T16:24:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.235+0000 7f75d564f700 1 -- 172.21.15.88:0/3513453013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d009d6b0 con 0x7f75d009f210 2020-02-11T16:24:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.235+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.235+0000 7f75cdffb700 1 -- 172.21.15.88:0/3513453013 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f75b8012440 con 0x7f75d009f210 2020-02-11T16:24:21.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.235+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.235+0000 7f75d564f700 1 -- 172.21.15.88:0/3513453013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d00a0070 con 0x7f75d009f210 2020-02-11T16:24:21.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.236+0000 7f75cdffb700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b4039d60 0x7f75b403c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.236+0000 7f75cdffb700 1 -- 172.21.15.88:0/3513453013 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f75b804a080 con 0x7f75d009f210 2020-02-11T16:24:21.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.236+0000 7f75cffff700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b4039d60 0x7f75b403c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.236+0000 7f75cffff700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b4039d60 0x7f75b403c220 crc :-1 s=READY pgs=432 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.239+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.239+0000 7f75cdffb700 1 -- 172.21.15.88:0/3513453013 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f75b802f490 con 0x7f75d009f210 2020-02-11T16:24:21.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.463+0000 7f75d564f700 1 -- 172.21.15.88:0/3513453013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f75d00565b0 con 0x7f75d009f210 2020-02-11T16:24:21.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.463+0000 7f75c7fff700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.463+0000 7f75cdffb700 1 -- 172.21.15.88:0/3513453013 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f75b8032150 con 0x7f75d009f210 2020-02-11T16:24:21.465 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":154,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:21.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 -- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b4039d60 msgr2=0x7f75b403c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b4039d60 0x7f75b403c220 crc :-1 s=READY pgs=432 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 -- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 msgr2=0x7f75d012da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 0x7f75d012da80 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f75b8000b20 tx=0x7f75b8010ba0).stop 2020-02-11T16:24:21.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 -- 172.21.15.88:0/3513453013 shutdown_connections 2020-02-11T16:24:21.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 --2- 172.21.15.88:0/3513453013 >> v2:172.21.15.88:3300/0 conn(0x7f75d00a55f0 0x7f75d012dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f75b4039d60 0x7f75b403c220 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 --2- 172.21.15.88:0/3513453013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d009f210 0x7f75d012da80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 -- 172.21.15.88:0/3513453013 >> 172.21.15.88:0/3513453013 conn(0x7f75d00a9f90 msgr2=0x7f75d0133a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:21.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 -- 172.21.15.88:0/3513453013 shutdown_connections 2020-02-11T16:24:21.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.465+0000 7f75d564f700 1 -- 172.21.15.88:0/3513453013 wait complete. 2020-02-11T16:24:21.477 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":154,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:21.477 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:24:21.477 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:24:21.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.595+0000 7fcf9c84c700 1 Processor -- start 2020-02-11T16:24:21.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.596+0000 7fcf9c84c700 1 -- start start 2020-02-11T16:24:21.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.596+0000 7fcf9c84c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf98137cf0 0x7fcf980a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:21.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.596+0000 7fcf9c84c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 0x7fcf981352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:21.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.596+0000 7fcf9c84c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf981382e0 con 0x7fcf9805c1f0 2020-02-11T16:24:21.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.596+0000 7fcf9c84c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf98138580 con 0x7fcf98137cf0 2020-02-11T16:24:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.596+0000 7fcf9c84c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf98138820 con 0x7fcf98134e30 2020-02-11T16:24:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.596+0000 7fcf95d9b700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fcf98137cf0 msgr2=0x7fcf980a1e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:24:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.596+0000 7fcf95d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf98137cf0 0x7fcf980a1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 0x7fcf981352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf9659c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcf9805c1f0 0x7fcf980a3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:38058/0 (socket says 172.21.15.88:38058) 2020-02-11T16:24:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf9659c700 1 -- 172.21.15.88:0/1909298947 learned_addr learned my addr 172.21.15.88:0/1909298947 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:21.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf9559a700 1 -- 172.21.15.88:0/1909298947 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52763372 0 0) 0x7fcf981382e0 con 0x7fcf9805c1f0 2020-02-11T16:24:21.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf9559a700 1 -- 172.21.15.88:0/1909298947 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf7c003230 con 0x7fcf9805c1f0 2020-02-11T16:24:21.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 -- 172.21.15.88:0/1909298947 >> v2:172.21.15.88:3300/0 conn(0x7fcf98137cf0 msgr2=0x7fcf980a1e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:21.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/1909298947 >> v2:172.21.15.88:3300/0 conn(0x7fcf98137cf0 0x7fcf980a1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:21.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 -- 172.21.15.88:0/1909298947 >> v1:172.21.15.52:6789/0 conn(0x7fcf9805c1f0 legacy=0x7fcf980a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 -- 172.21.15.88:0/1909298947 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98135720 con 0x7fcf98134e30 2020-02-11T16:24:21.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/1909298947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 0x7fcf981352c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcf900032b0 tx=0x7fcf90008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/1909298947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 0x7fcf981352c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcf900032b0 tx=0x7fcf90008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/1909298947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 0x7fcf981352c0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fcf900032b0 tx=0x7fcf90008c60).ready entity=mon.2 client_cookie=6f4f8d28623c41a1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/1909298947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 0x7fcf981352c0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fcf900032b0 tx=0x7fcf90008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf9559a700 1 -- 172.21.15.88:0/1909298947 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf9000a160 con 0x7fcf98134e30 2020-02-11T16:24:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/1909298947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 0x7fcf981352c0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fcf900032b0 tx=0x7fcf90008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf9559a700 1 -- 172.21.15.88:0/1909298947 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9000a2c0 con 0x7fcf98134e30 2020-02-11T16:24:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.597+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/1909298947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 0x7fcf981352c0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fcf900032b0 tx=0x7fcf90008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.598+0000 7fcf9559a700 1 -- 172.21.15.88:0/1909298947 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf9000a620 con 0x7fcf98134e30 2020-02-11T16:24:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.598+0000 7fcf9c84c700 1 -- 172.21.15.88:0/1909298947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 msgr2=0x7fcf981352c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.598+0000 7fcf9c84c700 1 --2- 172.21.15.88:0/1909298947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 0x7fcf981352c0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fcf900032b0 tx=0x7fcf90008c60).stop 2020-02-11T16:24:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.598+0000 7fcf9c84c700 1 -- 172.21.15.88:0/1909298947 shutdown_connections 2020-02-11T16:24:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.598+0000 7fcf9c84c700 1 --2- 172.21.15.88:0/1909298947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98134e30 0x7fcf981352c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.598+0000 7fcf9c84c700 1 --2- 172.21.15.88:0/1909298947 >> v2:172.21.15.88:3300/0 conn(0x7fcf98137cf0 0x7fcf980a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.598+0000 7fcf9c84c700 1 -- 172.21.15.88:0/1909298947 >> 172.21.15.88:0/1909298947 conn(0x7fcf980ab400 msgr2=0x7fcf980a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:21.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.598+0000 7fcf9c84c700 1 -- 172.21.15.88:0/1909298947 shutdown_connections 2020-02-11T16:24:21.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.598+0000 7fcf9c84c700 1 -- 172.21.15.88:0/1909298947 wait complete. 2020-02-11T16:24:21.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.599+0000 7fcf9c84c700 1 Processor -- start 2020-02-11T16:24:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.599+0000 7fcf9c84c700 1 -- start start 2020-02-11T16:24:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf9c84c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf98134e30 0x7fcf98132c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf9c84c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf9c84c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf980a79b0 con 0x7fcf9805c1f0 2020-02-11T16:24:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf9c84c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9813a220 con 0x7fcf98134e30 2020-02-11T16:24:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf9c84c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9813a480 con 0x7fcf98137cf0 2020-02-11T16:24:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf9659c700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fcf9805c1f0 legacy=0x7fcf9812ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf95d9b700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fcf98134e30 msgr2=0x7fcf98132c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:24:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf95d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf98134e30 0x7fcf98132c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf96d9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf96d9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:52984/0 (socket says 172.21.15.88:52984) 2020-02-11T16:24:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.600+0000 7fcf96d9d700 1 -- 172.21.15.88:0/2997125115 learned_addr learned my addr 172.21.15.88:0/2997125115 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 -- 172.21.15.88:0/2997125115 >> v2:172.21.15.88:3300/0 conn(0x7fcf98134e30 msgr2=0x7fcf98132c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:24:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/2997125115 >> v2:172.21.15.88:3300/0 conn(0x7fcf98134e30 0x7fcf98132c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 -- 172.21.15.88:0/2997125115 >> v1:172.21.15.88:6789/0 conn(0x7fcf9805c1f0 legacy=0x7fcf9812ac30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:24:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 -- 172.21.15.88:0/2997125115 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9813a720 con 0x7fcf98137cf0 2020-02-11T16:24:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf9805a5d0 tx=0x7fcf9805c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf9805a5d0 tx=0x7fcf9805c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fcf9805a5d0 tx=0x7fcf9805c5d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fcf9805a5d0 tx=0x7fcf9805c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf9000ae30 con 0x7fcf98137cf0 2020-02-11T16:24:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fcf9805a5d0 tx=0x7fcf9805c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf90005c30 con 0x7fcf98137cf0 2020-02-11T16:24:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fcf9805a5d0 tx=0x7fcf9805c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf9c84c700 1 -- 172.21.15.88:0/2997125115 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf981330d0 con 0x7fcf98137cf0 2020-02-11T16:24:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf90005da0 con 0x7fcf98137cf0 2020-02-11T16:24:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf9c84c700 1 -- 172.21.15.88:0/2997125115 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9812b340 con 0x7fcf98137cf0 2020-02-11T16:24:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.601+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fcf9805a5d0 tx=0x7fcf9805c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.602+0000 7fcf9c84c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 0x7fcf980a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.602+0000 7fcf9c84c700 1 -- 172.21.15.88:0/2997125115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9805c630 con 0x7fcf98145240 2020-02-11T16:24:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.602+0000 7fcf96d9d700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fcf9805a5d0 tx=0x7fcf9805c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.602+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fcf9000f760 con 0x7fcf98137cf0 2020-02-11T16:24:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.602+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 0x7fcf980a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.602+0000 7fcf877fe700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf74039d50 0x7fcf7403c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.602+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fcf9004a9b0 con 0x7fcf98137cf0 2020-02-11T16:24:21.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.602+0000 7fcf95d9b700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf74039d50 0x7fcf7403c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.602+0000 7fcf9659c700 1 -- 172.21.15.88:0/2997125115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf980565b0 con 0x7fcf98145240 2020-02-11T16:24:21.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.602+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 0x7fcf980a5e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 0x7fcf980a5e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 0x7fcf980a5e70 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf95d9b700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf74039d50 0x7fcf7403c210 crc :-1 s=READY pgs=433 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 0x7fcf980a5e70 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf880104e0 con 0x7fcf98145240 2020-02-11T16:24:21.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 0x7fcf980a5e70 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fcf8800cb40 con 0x7fcf98145240 2020-02-11T16:24:21.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 msgr2=0x7fcf980a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf877fe700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 0x7fcf980a5e70 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).stop 2020-02-11T16:24:21.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 msgr2=0x7fcf980a5e70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.603+0000 7fcf877fe700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98145240 0x7fcf980a5e70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.612+0000 7fcf9c84c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 0x7fcf981304c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.612+0000 7fcf9c84c700 1 -- 172.21.15.88:0/2997125115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9813a5c0 con 0x7fcf981300e0 2020-02-11T16:24:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.612+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 0x7fcf981304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.612+0000 7fcf9659c700 1 -- 172.21.15.88:0/2997125115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcf9813a8b0 con 0x7fcf981300e0 2020-02-11T16:24:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.612+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 0x7fcf981304c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.612+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 0x7fcf981304c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.612+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 0x7fcf981304c0 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 0x7fcf981304c0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf8800d2d0 con 0x7fcf981300e0 2020-02-11T16:24:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf9659c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 0x7fcf981304c0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4011 (secure 0 0 0) 0x7fcf8800d430 con 0x7fcf981300e0 2020-02-11T16:24:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 msgr2=0x7fcf981304c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf877fe700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 0x7fcf981304c0 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).stop 2020-02-11T16:24:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf877fe700 1 -- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 msgr2=0x7fcf981304c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf877fe700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf981300e0 0x7fcf981304c0 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0x7fcf88000f10 tx=0x7fcf88001e60).stop 2020-02-11T16:24:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf9c84c700 1 -- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf74039d50 msgr2=0x7fcf7403c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf9c84c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf74039d50 0x7fcf7403c210 crc :-1 s=READY pgs=433 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf9c84c700 1 -- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 msgr2=0x7fcf98144de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf9c84c700 1 --2- 172.21.15.88:0/2997125115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf98137cf0 0x7fcf98144de0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fcf9805a5d0 tx=0x7fcf9805c5d0).stop 2020-02-11T16:24:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf96d9d700 1 -- 172.21.15.88:0/2997125115 reap_dead start 2020-02-11T16:24:21.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf96d9d700 1 -- 172.21.15.88:0/2997125115 reap_dead start 2020-02-11T16:24:21.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf9c84c700 1 -- 172.21.15.88:0/2997125115 shutdown_connections 2020-02-11T16:24:21.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.613+0000 7fcf9c84c700 1 -- 172.21.15.88:0/2997125115 >> 172.21.15.88:0/2997125115 conn(0x7fcf980ab400 msgr2=0x7fcf98134100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:21.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.614+0000 7fcf9c84c700 1 -- 172.21.15.88:0/2997125115 shutdown_connections 2020-02-11T16:24:21.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.614+0000 7fcf9c84c700 1 -- 172.21.15.88:0/2997125115 wait complete. 2020-02-11T16:24:21.623 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:21.624 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:21.624 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:21.624 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:24:21.624 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 154, 2020-02-11T16:24:21.624 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:21.624 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:21.625 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:21.625 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.625 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:24:21.625 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:21.625 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:21.625 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:21.625 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:21.626 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:21.626 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:21.626 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:21.626 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:21.626 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:21.626 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.626 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:21.627 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:21.627 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:21.627 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:21.627 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:21.628 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:21.628 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:21.628 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:21.628 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.628 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:21.629 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:21.629 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:21.629 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:21.629 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:21.629 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:21.629 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:21.629 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:21.629 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:21.630 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:21.630 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:21.630 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:21.630 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:21.630 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:21.630 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:21.630 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:21.631 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:21.631 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:21.631 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.631 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:21.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.631 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:21.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.632 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:21.632 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:21.632 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:21.632 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:21.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.632 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:21.632 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:21.633 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.633 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:21.633 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:21.633 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.633 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.634 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.634 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:21.634 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:21.634 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:21.634 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:21.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.635 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:21.635 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:21.635 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:21.635 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:21.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.635 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:21.636 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:21.636 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.636 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:21.636 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:21.636 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.637 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.637 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.637 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:21.637 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:21.637 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:21.637 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:21.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.638 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:21.638 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:21.639 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:21.639 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:21.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.639 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:21.639 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:21.639 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:24:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:24:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:24:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.648 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:21.651 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:24:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.769+0000 7f4d5ecaa700 1 Processor -- start 2020-02-11T16:24:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.769+0000 7f4d5ecaa700 1 -- start start 2020-02-11T16:24:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.770+0000 7f4d5ecaa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d5805b270 0x7f4d580a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.770+0000 7f4d5ecaa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d58065de0 con 0x7f4d580a54b0 2020-02-11T16:24:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.770+0000 7f4d5ecaa700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d580a6860 con 0x7f4d58066bf0 2020-02-11T16:24:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.770+0000 7f4d5ecaa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d580a5a70 con 0x7f4d5805b270 2020-02-11T16:24:21.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.770+0000 7f4d5d4a7700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f4d5805b270 msgr2=0x7f4d580a6c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:24:21.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.770+0000 7f4d5e4a9700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f4d58066bf0 legacy=0x7f4d580a4170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:21.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.770+0000 7f4d5d4a7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d5805b270 0x7f4d580a6c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:21.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.770+0000 7f4d5dca8700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4d580a54b0 0x7f4d580664e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:38076/0 (socket says 172.21.15.88:38076) 2020-02-11T16:24:21.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.770+0000 7f4d5dca8700 1 -- 172.21.15.88:0/3457329674 learned_addr learned my addr 172.21.15.88:0/3457329674 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:21.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533873765 0 0) 0x7f4d58065de0 con 0x7f4d580a54b0 2020-02-11T16:24:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d40003230 con 0x7f4d580a54b0 2020-02-11T16:24:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2575434390 0 0) 0x7f4d40003230 con 0x7f4d580a54b0 2020-02-11T16:24:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 >> v2:172.21.15.88:3300/0 conn(0x7f4d5805b270 msgr2=0x7f4d580a6c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 --2- 172.21.15.88:0/3457329674 >> v2:172.21.15.88:3300/0 conn(0x7f4d5805b270 0x7f4d580a6c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 >> v1:172.21.15.88:6789/0 conn(0x7f4d58066bf0 legacy=0x7f4d580a4170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d58066040 con 0x7f4d580a54b0 2020-02-11T16:24:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f4d540016d0 con 0x7f4d580a54b0 2020-02-11T16:24:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 >> v1:172.21.15.52:6789/0 conn(0x7f4d580a54b0 legacy=0x7f4d580664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 0x7f4d40003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d40003ff0 0x7f4d400044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d40004a40 0x7f4d40004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d580a5a70 con 0x7f4d40003720 2020-02-11T16:24:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4000b810 con 0x7f4d40003ff0 2020-02-11T16:24:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4000b9d0 con 0x7f4d40004a40 2020-02-11T16:24:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5d4a7700 1 -- 172.21.15.88:0/3457329674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d40003ff0 msgr2=0x7f4d400044d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:24:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d40003ff0 0x7f4d400044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:21.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 0x7f4d40003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5e4a9700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d40004a40 0x7f4d40004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5dca8700 1 -- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d40004a40 msgr2=0x7f4d40004ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:21.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d40004a40 0x7f4d40004ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:21.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5dca8700 1 -- 172.21.15.88:0/3457329674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d40003ff0 msgr2=0x7f4d400044d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:21.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d40003ff0 0x7f4d400044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:21.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.771+0000 7f4d5dca8700 1 -- 172.21.15.88:0/3457329674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40003230 con 0x7f4d40003720 2020-02-11T16:24:21.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5e4a9700 1 -- 172.21.15.88:0/3457329674 reap_dead start 2020-02-11T16:24:21.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 0x7f4d40003b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d540010d0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 0x7f4d40003b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d540010d0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 0x7f4d40003b20 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f4d540010d0 tx=0x7f4d580ab530).ready entity=mon.0 client_cookie=c8ee25bbf228f7b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 0x7f4d40003b20 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f4d540010d0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d5400ce80 con 0x7f4d40003720 2020-02-11T16:24:21.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 0x7f4d40003b20 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f4d540010d0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 0x7f4d40003b20 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f4d540010d0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5400e350 con 0x7f4d40003720 2020-02-11T16:24:21.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5cca6700 1 -- 172.21.15.88:0/3457329674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d5400e6b0 con 0x7f4d40003720 2020-02-11T16:24:21.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 msgr2=0x7f4d40003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5ecaa700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 0x7f4d40003b20 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f4d540010d0 tx=0x7f4d580ab530).stop 2020-02-11T16:24:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3457329674 shutdown_connections 2020-02-11T16:24:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5ecaa700 1 --2- 172.21.15.88:0/3457329674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d40003720 0x7f4d40003b20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3457329674 >> 172.21.15.88:0/3457329674 conn(0x7f4d580aa860 msgr2=0x7f4d580aac70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3457329674 shutdown_connections 2020-02-11T16:24:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.772+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3457329674 wait complete. 2020-02-11T16:24:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.773+0000 7f4d5ecaa700 1 Processor -- start 2020-02-11T16:24:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.773+0000 7f4d5ecaa700 1 -- start start 2020-02-11T16:24:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d5ecaa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d580a3460 0x7f4d5809c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d5ecaa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5809f940 con 0x7f4d40003720 2020-02-11T16:24:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d5ecaa700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5809fbe0 con 0x7f4d5809c480 2020-02-11T16:24:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d5ecaa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5809fe80 con 0x7f4d580a3460 2020-02-11T16:24:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d5d4a7700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f4d580a3460 msgr2=0x7f4d5809c020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:24:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d5d4a7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d580a3460 0x7f4d5809c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:21.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d5e4a9700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f4d5809c480 legacy=0x7f4d58136460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:24:21.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d5dca8700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4d40003720 0x7f4d5809cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:38088/0 (socket says 172.21.15.88:38088) 2020-02-11T16:24:21.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d5dca8700 1 -- 172.21.15.88:0/3749524814 learned_addr learned my addr 172.21.15.88:0/3749524814 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:21.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075113402 0 0) 0x7f4d5809f940 con 0x7f4d40003720 2020-02-11T16:24:21.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.774+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d38002fe0 con 0x7f4d40003720 2020-02-11T16:24:21.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3840651563 0 0) 0x7f4d38002fe0 con 0x7f4d40003720 2020-02-11T16:24:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4d5809f940 con 0x7f4d40003720 2020-02-11T16:24:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f4d5400ce80 con 0x7f4d40003720 2020-02-11T16:24:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 >> v2:172.21.15.88:3300/0 conn(0x7f4d580a3460 msgr2=0x7f4d5809c020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:24:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 --2- 172.21.15.88:0/3749524814 >> v2:172.21.15.88:3300/0 conn(0x7f4d580a3460 0x7f4d5809c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 >> v1:172.21.15.88:6789/0 conn(0x7f4d5809c480 legacy=0x7f4d58136460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:24:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 >> v1:172.21.15.52:6789/0 conn(0x7f4d40003720 legacy=0x7f4d5809cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d380049b0 0x7f4d38004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d38003ed0 0x7f4d38004350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5809fe80 con 0x7f4d380049b0 2020-02-11T16:24:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3800b840 con 0x7f4d38003ed0 2020-02-11T16:24:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3800ba00 con 0x7f4d38005230 2020-02-11T16:24:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5e4a9700 1 -- 172.21.15.88:0/3749524814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d38003ed0 msgr2=0x7f4d38004350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:24:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5e4a9700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d38003ed0 0x7f4d38004350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d380049b0 0x7f4d38004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5d4a7700 1 -- 172.21.15.88:0/3749524814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d38003ed0 msgr2=0x7f4d38004350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:24:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d38003ed0 0x7f4d38004350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5d4a7700 1 -- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d380049b0 msgr2=0x7f4d38004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d380049b0 0x7f4d38004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5e4a9700 1 -- 172.21.15.88:0/3749524814 reap_dead start 2020-02-11T16:24:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5d4a7700 1 -- 172.21.15.88:0/3749524814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5809c8d0 con 0x7f4d38005230 2020-02-11T16:24:21.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3749524814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d580a3b70 con 0x7f4d38005230 2020-02-11T16:24:21.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d48003610 tx=0x7f4d480037e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d380049b0 0x7f4d38004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:21.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3749524814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5809c260 con 0x7f4d38005230 2020-02-11T16:24:21.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d48003610 tx=0x7f4d480037e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.775+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f4d48003610 tx=0x7f4d480037e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f4d48003610 tx=0x7f4d480037e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d48011630 con 0x7f4d38005230 2020-02-11T16:24:21.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f4d48003610 tx=0x7f4d480037e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f4d48003610 tx=0x7f4d480037e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d48011790 con 0x7f4d38005230 2020-02-11T16:24:21.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d48011bb0 con 0x7f4d38005230 2020-02-11T16:24:21.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f4d48003610 tx=0x7f4d480037e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d5ecaa700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 0x7f4d340058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3749524814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34005ea0 con 0x7f4d34003420 2020-02-11T16:24:21.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4d4800b180 con 0x7f4d38005230 2020-02-11T16:24:21.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.776+0000 7f4d5d4a7700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f4d48003610 tx=0x7f4d480037e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 0x7f4d340058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d46ffd700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d3803d700 0x7f4d3803fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4d480493a0 con 0x7f4d38005230 2020-02-11T16:24:21.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d5e4a9700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d3803d700 0x7f4d3803fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d5dca8700 1 -- 172.21.15.88:0/3749524814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d34006060 con 0x7f4d34003420 2020-02-11T16:24:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 0x7f4d340058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 0x7f4d340058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 0x7f4d340058e0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d5e4a9700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d3803d700 0x7f4d3803fbc0 crc :-1 s=READY pgs=434 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 0x7f4d340058e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d540106a0 con 0x7f4d34003420 2020-02-11T16:24:21.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 0x7f4d340058e0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f4d54010800 con 0x7f4d34003420 2020-02-11T16:24:21.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 msgr2=0x7f4d340058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d46ffd700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 0x7f4d340058e0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).stop 2020-02-11T16:24:21.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 msgr2=0x7f4d340058e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:21.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.777+0000 7f4d46ffd700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 0x7f4d340058e0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).stop 2020-02-11T16:24:21.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.786+0000 7f4d5ecaa700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 0x7f4d340068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:21.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.787+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3749524814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34006d80 con 0x7f4d34006440 2020-02-11T16:24:21.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.787+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 0x7f4d340068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:21.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.787+0000 7f4d5dca8700 1 -- 172.21.15.88:0/3749524814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4d34006f40 con 0x7f4d34006440 2020-02-11T16:24:21.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.787+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 0x7f4d340068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.787+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 0x7f4d340068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.787+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 0x7f4d340068f0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:21.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 0x7f4d340068f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d5400b560 con 0x7f4d34006440 2020-02-11T16:24:21.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5dca8700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 0x7f4d340068f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:21.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f4d540072c0 con 0x7f4d34006440 2020-02-11T16:24:21.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 msgr2=0x7f4d340068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d46ffd700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 0x7f4d340068f0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f4d5400b9c0 tx=0x7f4d580ab530).stop 2020-02-11T16:24:21.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d46ffd700 1 -- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 msgr2=0x7f4d340068f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:21.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d46ffd700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 0x7f4d340068f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d3803d700 msgr2=0x7f4d3803fbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d3803d700 0x7f4d3803fbc0 crc :-1 s=READY pgs=434 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 msgr2=0x7f4d38003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:21.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f4d48003610 tx=0x7f4d480037e0).stop 2020-02-11T16:24:21.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3749524814 shutdown_connections 2020-02-11T16:24:21.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4d3803d700 0x7f4d3803fbc0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d38005230 0x7f4d38003920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34003420 0x7f4d340058e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 --2- 172.21.15.88:0/3749524814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d34006440 0x7f4d340068f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:21.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3749524814 >> 172.21.15.88:0/3749524814 conn(0x7f4d580aa860 msgr2=0x7f4d58069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:21.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3749524814 shutdown_connections 2020-02-11T16:24:21.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:21.788+0000 7f4d5ecaa700 1 -- 172.21.15.88:0/3749524814 wait complete. 2020-02-11T16:24:21.809 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:21.809 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:21.809 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:21.809 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:24:21.810 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 154, 2020-02-11T16:24:21.810 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:21.810 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:21.810 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:21.810 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.810 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:24:21.810 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:21.811 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:21.811 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:21.811 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:21.811 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:21.811 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:21.811 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:21.812 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:21.812 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:21.812 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.812 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:21.812 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:21.812 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:21.812 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:21.813 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:21.813 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:21.813 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:21.813 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:21.813 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.814 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:21.814 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:21.814 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:21.814 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:21.814 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:21.814 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:21.815 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:21.815 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:21.815 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:21.815 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:21.815 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:21.815 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:21.815 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:21.816 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:21.816 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:21.816 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:21.816 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:21.816 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:21.816 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.816 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:21.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.817 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:21.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.817 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:21.818 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:21.818 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:21.818 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:21.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.818 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:21.818 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:21.819 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.819 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:21.819 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:21.819 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.819 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.820 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.820 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:21.820 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:21.820 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:21.820 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:21.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.821 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:21.821 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:21.821 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:21.821 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:21.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.822 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:21.822 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:21.822 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.822 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:21.822 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:21.823 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.823 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.823 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:21.823 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:21.823 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:21.824 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:21.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.824 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:21.824 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:21.824 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:21.824 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:21.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.825 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:21.825 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:21.825 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.826 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:21.826 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:21.826 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:21.826 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.826 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.827 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:21.827 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:21.827 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:21.827 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:21.827 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.828 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:21.828 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:21.828 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:21.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.828 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:21.829 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:21.829 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:21.829 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.829 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.829 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:24:21.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.830 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:21.830 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:21.830 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:21.830 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.830 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.830 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:24:21.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.830 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:21.831 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:21.831 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:24:21.831 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.831 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.831 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:21.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.831 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:21.832 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:21.832 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:24:21.832 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.832 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:21.832 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:24:21.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:21.832 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:21.833 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:21.833 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:21.833 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.833 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:21.833 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:21.833 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:21.834 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:24:41.834 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:24:41.835 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:24:41.835 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:24:41.835 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:24:41.837 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:24:41.837 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:24:41.838 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:24:41.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.963+0000 7fc48597b700 1 Processor -- start 2020-02-11T16:24:41.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.963+0000 7fc48597b700 1 -- start start 2020-02-11T16:24:41.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc48597b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4800a18a0 0x7fc4800a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:41.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc48597b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 0x7fc4800a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:41.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc48597b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800a31b0 con 0x7fc48012e3a0 2020-02-11T16:24:41.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc48597b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800a3570 con 0x7fc4800a18a0 2020-02-11T16:24:41.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc48597b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800a3810 con 0x7fc4800a5de0 2020-02-11T16:24:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4800a18a0 0x7fc4800a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4800a18a0 0x7fc4800a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58704/0 (socket says 172.21.15.88:58704) 2020-02-11T16:24:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47effd700 1 -- 172.21.15.88:0/324224989 learned_addr learned my addr 172.21.15.88:0/324224989 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47effd700 1 -- 172.21.15.88:0/324224989 >> v2:172.21.15.88:3300/0 conn(0x7fc4800a18a0 msgr2=0x7fc4800a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:24:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47effd700 1 -- 172.21.15.88:0/324224989 >> v2:172.21.15.88:3300/0 conn(0x7fc4800a18a0 msgr2=0x7fc4800a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:24:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47effd700 1 --2- 172.21.15.88:0/324224989 >> v2:172.21.15.88:3300/0 conn(0x7fc4800a18a0 0x7fc4800a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:24:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/324224989 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 0x7fc4800a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47effd700 1 --2- 172.21.15.88:0/324224989 >> v2:172.21.15.88:3300/0 conn(0x7fc4800a18a0 0x7fc4800a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47dffb700 1 -- 172.21.15.88:0/324224989 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367436145 0 0) 0x7fc4800a31b0 con 0x7fc48012e3a0 2020-02-11T16:24:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47dffb700 1 -- 172.21.15.88:0/324224989 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc464003230 con 0x7fc48012e3a0 2020-02-11T16:24:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47e7fc700 1 -- 172.21.15.88:0/324224989 >> v2:172.21.15.88:3300/0 conn(0x7fc4800a18a0 msgr2=0x7fc4800a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/324224989 >> v2:172.21.15.88:3300/0 conn(0x7fc4800a18a0 0x7fc4800a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47e7fc700 1 -- 172.21.15.88:0/324224989 >> v1:172.21.15.52:6789/0 conn(0x7fc48012e3a0 legacy=0x7fc48012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47e7fc700 1 -- 172.21.15.88:0/324224989 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800a3ab0 con 0x7fc4800a5de0 2020-02-11T16:24:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.964+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/324224989 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 0x7fc4800a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc474002f30 tx=0x7fc4740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/324224989 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 0x7fc4800a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc474002f30 tx=0x7fc4740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/324224989 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 0x7fc4800a6260 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4740088e0).ready entity=mon.2 client_cookie=ca36238ea7db9299 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/324224989 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 0x7fc4800a6260 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc47dffb700 1 -- 172.21.15.88:0/324224989 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc474008e40 con 0x7fc4800a5de0 2020-02-11T16:24:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/324224989 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 0x7fc4800a6260 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc47dffb700 1 -- 172.21.15.88:0/324224989 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740115f0 con 0x7fc4800a5de0 2020-02-11T16:24:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/324224989 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 0x7fc4800a6260 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc47dffb700 1 -- 172.21.15.88:0/324224989 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc474011990 con 0x7fc4800a5de0 2020-02-11T16:24:41.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc48597b700 1 -- 172.21.15.88:0/324224989 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 msgr2=0x7fc4800a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:41.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc48597b700 1 --2- 172.21.15.88:0/324224989 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 0x7fc4800a6260 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4740088e0).stop 2020-02-11T16:24:41.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc48597b700 1 -- 172.21.15.88:0/324224989 shutdown_connections 2020-02-11T16:24:41.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc48597b700 1 --2- 172.21.15.88:0/324224989 >> v2:172.21.15.88:3300/0 conn(0x7fc4800a18a0 0x7fc4800a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:41.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc48597b700 1 --2- 172.21.15.88:0/324224989 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4800a5de0 0x7fc4800a6260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:41.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc48597b700 1 -- 172.21.15.88:0/324224989 >> 172.21.15.88:0/324224989 conn(0x7fc48009d110 msgr2=0x7fc48009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:41.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc48597b700 1 -- 172.21.15.88:0/324224989 shutdown_connections 2020-02-11T16:24:41.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.965+0000 7fc48597b700 1 -- 172.21.15.88:0/324224989 wait complete. 2020-02-11T16:24:41.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.966+0000 7fc48597b700 1 Processor -- start 2020-02-11T16:24:41.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.967+0000 7fc48597b700 1 -- start start 2020-02-11T16:24:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.967+0000 7fc48597b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc4800a5de0 0x7fc48009ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.967+0000 7fc48597b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48009f380 con 0x7fc48012e3a0 2020-02-11T16:24:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.967+0000 7fc48597b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48009f620 con 0x7fc4800a18a0 2020-02-11T16:24:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.967+0000 7fc48597b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800654f0 con 0x7fc4800a5de0 2020-02-11T16:24:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.967+0000 7fc47effd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc4800a18a0 0x7fc480065990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46336/0 (socket says 172.21.15.88:46336) 2020-02-11T16:24:41.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.967+0000 7fc47effd700 1 -- 172.21.15.88:0/3760779536 learned_addr learned my addr 172.21.15.88:0/3760779536 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:41.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.967+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> v2:172.21.15.52:3300/0 conn(0x7fc4800a5de0 0x7fc48009ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:41.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc47e7fc700 1 -- 172.21.15.88:0/3760779536 >> v1:172.21.15.88:6789/0 conn(0x7fc4800a18a0 legacy=0x7fc480065990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:41.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc47e7fc700 1 -- 172.21.15.88:0/3760779536 >> v1:172.21.15.52:6789/0 conn(0x7fc48012e3a0 legacy=0x7fc4800669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:41.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc47e7fc700 1 -- 172.21.15.88:0/3760779536 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc480148510 con 0x7fc4800a5de0 2020-02-11T16:24:41.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> v2:172.21.15.52:3300/0 conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> v2:172.21.15.52:3300/0 conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc46ffff700 1 -- 172.21.15.88:0/3760779536 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc474007150 con 0x7fc4800a5de0 2020-02-11T16:24:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc46ffff700 1 -- 172.21.15.88:0/3760779536 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740072b0 con 0x7fc4800a5de0 2020-02-11T16:24:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc48597b700 1 -- 172.21.15.88:0/3760779536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc480134e50 con 0x7fc4800a5de0 2020-02-11T16:24:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc46ffff700 1 -- 172.21.15.88:0/3760779536 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4740056c0 con 0x7fc4800a5de0 2020-02-11T16:24:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.968+0000 7fc48597b700 1 -- 172.21.15.88:0/3760779536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc480148c80 con 0x7fc4800a5de0 2020-02-11T16:24:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.969+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.969+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.969+0000 7fc46ffff700 1 -- 172.21.15.88:0/3760779536 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc474005980 con 0x7fc4800a5de0 2020-02-11T16:24:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.969+0000 7fc46ffff700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039bf0 0x7fc45c03c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.969+0000 7fc46ffff700 1 -- 172.21.15.88:0/3760779536 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc47404a290 con 0x7fc4800a5de0 2020-02-11T16:24:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.969+0000 7fc48597b700 1 -- 172.21.15.88:0/3760779536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc480148700 con 0x7fc4800a5de0 2020-02-11T16:24:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.970+0000 7fc47effd700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039bf0 0x7fc45c03c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.970+0000 7fc47effd700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039bf0 0x7fc45c03c0b0 crc :-1 s=READY pgs=436 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.974+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:41.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:41.974+0000 7fc46ffff700 1 -- 172.21.15.88:0/3760779536 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc4740327c0 con 0x7fc4800a5de0 2020-02-11T16:24:42.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.258+0000 7fc48597b700 1 -- 172.21.15.88:0/3760779536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc4800565b0 con 0x7fc4800a5de0 2020-02-11T16:24:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.258+0000 7fc47e7fc700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:42.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.258+0000 7fc46ffff700 1 -- 172.21.15.88:0/3760779536 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7fc4740323a0 con 0x7fc4800a5de0 2020-02-11T16:24:42.261 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":154,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.260+0000 7fc48597b700 1 -- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039bf0 msgr2=0x7fc45c03c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.260+0000 7fc48597b700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039bf0 0x7fc45c03c0b0 crc :-1 s=READY pgs=436 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.260+0000 7fc48597b700 1 -- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 msgr2=0x7fc48009ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.260+0000 7fc48597b700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 0x7fc48009ee40 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fc474002f30 tx=0x7fc4800a1c80).stop 2020-02-11T16:24:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.260+0000 7fc48597b700 1 -- 172.21.15.88:0/3760779536 shutdown_connections 2020-02-11T16:24:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.260+0000 7fc48597b700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc45c039bf0 0x7fc45c03c0b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.260+0000 7fc48597b700 1 --2- 172.21.15.88:0/3760779536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4800a5de0 0x7fc48009ee40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.260+0000 7fc48597b700 1 -- 172.21.15.88:0/3760779536 >> 172.21.15.88:0/3760779536 conn(0x7fc48009d110 msgr2=0x7fc4800a6220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.260+0000 7fc48597b700 1 -- 172.21.15.88:0/3760779536 shutdown_connections 2020-02-11T16:24:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:42.260+0000 7fc48597b700 1 -- 172.21.15.88:0/3760779536 wait complete. 2020-02-11T16:24:42.273 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":154,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:45.024 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:24:45.027 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:24:45.274 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:24:45.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.384+0000 7f91cbdc8700 1 Processor -- start 2020-02-11T16:24:45.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.384+0000 7f91cbdc8700 1 -- start start 2020-02-11T16:24:45.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91cbdc8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 0x7f91c4131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:45.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91cbdc8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c40a4350 con 0x7f91c40a2fa0 2020-02-11T16:24:45.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91cbdc8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c40a3a40 con 0x7f91c40a5b20 2020-02-11T16:24:45.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91cbdc8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40a1e60 con 0x7f91c40a1520 2020-02-11T16:24:45.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91c9363700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f91c40a5b20 0x7f91c4131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46362/0 (socket says 172.21.15.88:46362) 2020-02-11T16:24:45.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91c9363700 1 -- 172.21.15.88:0/2362453592 learned_addr learned my addr 172.21.15.88:0/2362453592 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:45.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91ca365700 1 --2- 172.21.15.88:0/2362453592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 0x7f91c4131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91ca365700 1 -- 172.21.15.88:0/2362453592 >> v1:172.21.15.88:6789/0 conn(0x7f91c40a5b20 legacy=0x7f91c4131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91ca365700 1 -- 172.21.15.88:0/2362453592 >> v1:172.21.15.52:6789/0 conn(0x7f91c40a2fa0 legacy=0x7f91c40a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91ca365700 1 -- 172.21.15.88:0/2362453592 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c40a3ce0 con 0x7f91c40a1520 2020-02-11T16:24:45.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.385+0000 7f91ca365700 1 --2- 172.21.15.88:0/2362453592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 0x7f91c4131990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f91bc0032b0 tx=0x7f91bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91ca365700 1 --2- 172.21.15.88:0/2362453592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 0x7f91c4131990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f91bc0032b0 tx=0x7f91bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91ca365700 1 --2- 172.21.15.88:0/2362453592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 0x7f91c4131990 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f91bc0032b0 tx=0x7f91bc008c60).ready entity=mon.2 client_cookie=38605f341c93de28 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91ca365700 1 --2- 172.21.15.88:0/2362453592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 0x7f91c4131990 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f91bc0032b0 tx=0x7f91bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91c8b62700 1 -- 172.21.15.88:0/2362453592 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91bc00a160 con 0x7f91c40a1520 2020-02-11T16:24:45.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91ca365700 1 --2- 172.21.15.88:0/2362453592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 0x7f91c4131990 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f91bc0032b0 tx=0x7f91bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91c8b62700 1 -- 172.21.15.88:0/2362453592 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc00a2c0 con 0x7f91c40a1520 2020-02-11T16:24:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91ca365700 1 --2- 172.21.15.88:0/2362453592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 0x7f91c4131990 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f91bc0032b0 tx=0x7f91bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91c8b62700 1 -- 172.21.15.88:0/2362453592 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91bc00a660 con 0x7f91c40a1520 2020-02-11T16:24:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91cbdc8700 1 -- 172.21.15.88:0/2362453592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 msgr2=0x7f91c4131990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91cbdc8700 1 --2- 172.21.15.88:0/2362453592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 0x7f91c4131990 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f91bc0032b0 tx=0x7f91bc008c60).stop 2020-02-11T16:24:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91cbdc8700 1 -- 172.21.15.88:0/2362453592 shutdown_connections 2020-02-11T16:24:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91cbdc8700 1 --2- 172.21.15.88:0/2362453592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91c40a1520 0x7f91c4131990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91cbdc8700 1 -- 172.21.15.88:0/2362453592 >> 172.21.15.88:0/2362453592 conn(0x7f91c409d110 msgr2=0x7f91c409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:45.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91cbdc8700 1 -- 172.21.15.88:0/2362453592 shutdown_connections 2020-02-11T16:24:45.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.386+0000 7f91cbdc8700 1 -- 172.21.15.88:0/2362453592 wait complete. 2020-02-11T16:24:45.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.387+0000 7f91cbdc8700 1 Processor -- start 2020-02-11T16:24:45.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.387+0000 7f91cbdc8700 1 -- start start 2020-02-11T16:24:45.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.388+0000 7f91cbdc8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f91c40a1520 0x7f91c4061dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.388+0000 7f91cbdc8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c4066b30 con 0x7f91c40a5b20 2020-02-11T16:24:45.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.388+0000 7f91cbdc8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c40a0c80 con 0x7f91c40a2fa0 2020-02-11T16:24:45.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.388+0000 7f91cbdc8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c4131df0 con 0x7f91c40a1520 2020-02-11T16:24:45.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.388+0000 7f91c9b64700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f91c40a1520 0x7f91c4061dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.388+0000 7f91c9363700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f91c40a2fa0 0x7f91c409def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46368/0 (socket says 172.21.15.88:46368) 2020-02-11T16:24:45.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.388+0000 7f91c9363700 1 -- 172.21.15.88:0/4290501284 learned_addr learned my addr 172.21.15.88:0/4290501284 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:45.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.388+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857387413 0 0) 0x7f91c40a0c80 con 0x7f91c40a2fa0 2020-02-11T16:24:45.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.388+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a4002fe0 con 0x7f91c40a2fa0 2020-02-11T16:24:45.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.388+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693568531 0 0) 0x7f91c4066b30 con 0x7f91c40a5b20 2020-02-11T16:24:45.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c40a0c80 con 0x7f91c40a5b20 2020-02-11T16:24:45.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91c9b64700 1 -- 172.21.15.88:0/4290501284 >> v1:172.21.15.88:6789/0 conn(0x7f91c40a2fa0 legacy=0x7f91c409def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91c9b64700 1 -- 172.21.15.88:0/4290501284 >> v1:172.21.15.52:6789/0 conn(0x7f91c40a5b20 legacy=0x7f91c409e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91c9b64700 1 -- 172.21.15.88:0/4290501284 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c40a09f0 con 0x7f91c40a1520 2020-02-11T16:24:45.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91c9b64700 1 --2- 172.21.15.88:0/4290501284 >> v2:172.21.15.88:3300/0 conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91c9b64700 1 --2- 172.21.15.88:0/4290501284 >> v2:172.21.15.88:3300/0 conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91c9b64700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91c9b64700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91c0011ea0 con 0x7f91c40a1520 2020-02-11T16:24:45.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91c9b64700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91c9b64700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0006bc0 con 0x7f91c40a1520 2020-02-11T16:24:45.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91cbdc8700 1 -- 172.21.15.88:0/4290501284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c40619a0 con 0x7f91c40a1520 2020-02-11T16:24:45.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91c0010e30 con 0x7f91c40a1520 2020-02-11T16:24:45.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91cbdc8700 1 -- 172.21.15.88:0/4290501284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c4135330 con 0x7f91c40a1520 2020-02-11T16:24:45.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.389+0000 7f91c9b64700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.390+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f91c000b290 con 0x7f91c40a1520 2020-02-11T16:24:45.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.390+0000 7f91c9b64700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.390+0000 7f91b2ffd700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f91a403a0d0 0x7f91a403c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.390+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f91c00497a0 con 0x7f91c40a1520 2020-02-11T16:24:45.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.390+0000 7f91c9363700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f91a403a0d0 0x7f91a403c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.390+0000 7f91cbdc8700 1 -- 172.21.15.88:0/4290501284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c40a0390 con 0x7f91c40a1520 2020-02-11T16:24:45.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.390+0000 7f91c9363700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f91a403a0d0 0x7f91a403c590 crc :-1 s=READY pgs=437 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.394+0000 7f91c9b64700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.394+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f91c002ee00 con 0x7f91c40a1520 2020-02-11T16:24:45.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.598+0000 7f91cbdc8700 1 -- 172.21.15.88:0/4290501284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f91c40623f0 con 0x7f91c40a1520 2020-02-11T16:24:45.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.599+0000 7f91c9b64700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.599+0000 7f91b2ffd700 1 -- 172.21.15.88:0/4290501284 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f91c00318f0 con 0x7f91c40a1520 2020-02-11T16:24:45.602 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:45.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.600+0000 7f91cbdc8700 1 -- 172.21.15.88:0/4290501284 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f91a403a0d0 msgr2=0x7f91a403c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.600+0000 7f91cbdc8700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f91a403a0d0 0x7f91a403c590 crc :-1 s=READY pgs=437 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.600+0000 7f91cbdc8700 1 -- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 msgr2=0x7f91c4061dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.600+0000 7f91cbdc8700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 0x7f91c4061dd0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f91c405ef00 tx=0x7f91c00108b0).stop 2020-02-11T16:24:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.600+0000 7f91cbdc8700 1 -- 172.21.15.88:0/4290501284 shutdown_connections 2020-02-11T16:24:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.600+0000 7f91cbdc8700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f91a403a0d0 0x7f91a403c590 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.600+0000 7f91cbdc8700 1 --2- 172.21.15.88:0/4290501284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c40a1520 0x7f91c4061dd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.601+0000 7f91cbdc8700 1 -- 172.21.15.88:0/4290501284 >> 172.21.15.88:0/4290501284 conn(0x7f91c409d110 msgr2=0x7f91c4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.601+0000 7f91cbdc8700 1 -- 172.21.15.88:0/4290501284 shutdown_connections 2020-02-11T16:24:45.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.601+0000 7f91cbdc8700 1 -- 172.21.15.88:0/4290501284 wait complete. 2020-02-11T16:24:45.613 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":156,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:45.613 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:24:45.614 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:24:45.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.728+0000 7f3e78b03700 1 Processor -- start 2020-02-11T16:24:45.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.728+0000 7f3e78b03700 1 -- start start 2020-02-11T16:24:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e78b03700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e740a1520 0x7f3e74131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e78b03700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e740a4350 con 0x7f3e740a2fa0 2020-02-11T16:24:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e78b03700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e740a3a40 con 0x7f3e740a5b20 2020-02-11T16:24:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e78b03700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740a1e60 con 0x7f3e740a1520 2020-02-11T16:24:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e71d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3e740a5b20 0x7f3e74131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46376/0 (socket says 172.21.15.88:46376) 2020-02-11T16:24:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e71d9b700 1 -- 172.21.15.88:0/1028725300 learned_addr learned my addr 172.21.15.88:0/1028725300 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e72d9d700 1 --2- 172.21.15.88:0/1028725300 >> v2:172.21.15.52:3300/0 conn(0x7f3e740a1520 0x7f3e74131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343642694 0 0) 0x7f3e740a3a40 con 0x7f3e740a5b20 2020-02-11T16:24:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e58005440 con 0x7f3e740a5b20 2020-02-11T16:24:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2819662506 0 0) 0x7f3e58005440 con 0x7f3e740a5b20 2020-02-11T16:24:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 >> v2:172.21.15.52:3300/0 conn(0x7f3e740a1520 msgr2=0x7f3e74131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e7159a700 1 --2- 172.21.15.88:0/1028725300 >> v2:172.21.15.52:3300/0 conn(0x7f3e740a1520 0x7f3e74131990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 >> v1:172.21.15.52:6789/0 conn(0x7f3e740a2fa0 legacy=0x7f3e740a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.729+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e740a3ce0 con 0x7f3e740a5b20 2020-02-11T16:24:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f3e680016d0 con 0x7f3e740a5b20 2020-02-11T16:24:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 >> v1:172.21.15.88:6789/0 conn(0x7f3e740a5b20 legacy=0x7f3e74131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58005930 0x7f3e58005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e58006b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e58006fc0 0x7f3e5800d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740a1e60 con 0x7f3e58005930 2020-02-11T16:24:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580063d0 con 0x7f3e580066e0 2020-02-11T16:24:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5800dd90 con 0x7f3e58006fc0 2020-02-11T16:24:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e72d9d700 1 --2- 172.21.15.88:0/1028725300 >> v2:172.21.15.52:3300/0 conn(0x7f3e740a1520 0x7f3e74131990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7259c700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58005930 0x7f3e58005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e58006b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e72d9d700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e58006fc0 0x7f3e5800d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 -- 172.21.15.88:0/1028725300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e58006fc0 msgr2=0x7f3e5800d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e58006fc0 0x7f3e5800d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 -- 172.21.15.88:0/1028725300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58005930 msgr2=0x7f3e58005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58005930 0x7f3e58005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 -- 172.21.15.88:0/1028725300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e58005440 con 0x7f3e580066e0 2020-02-11T16:24:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e72d9d700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e58006fc0 0x7f3e5800d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:24:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7259c700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58005930 0x7f3e58005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e72d9d700 1 -- 172.21.15.88:0/1028725300 reap_dead start 2020-02-11T16:24:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e58006b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e58006b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e58006b60 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).ready entity=mon.1 client_cookie=562aa5763b00d6bd server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e58006b60 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e58006b60 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e6800ce70 con 0x7f3e580066e0 2020-02-11T16:24:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e58006b60 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6800e350 con 0x7f3e580066e0 2020-02-11T16:24:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e7159a700 1 -- 172.21.15.88:0/1028725300 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e6800e730 con 0x7f3e580066e0 2020-02-11T16:24:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e78b03700 1 -- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 msgr2=0x7f3e58006b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.730+0000 7f3e78b03700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e58006b60 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).stop 2020-02-11T16:24:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.731+0000 7f3e78b03700 1 -- 172.21.15.88:0/1028725300 shutdown_connections 2020-02-11T16:24:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.731+0000 7f3e78b03700 1 --2- 172.21.15.88:0/1028725300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e58006b60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.731+0000 7f3e78b03700 1 -- 172.21.15.88:0/1028725300 >> 172.21.15.88:0/1028725300 conn(0x7f3e7409d110 msgr2=0x7f3e7409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.731+0000 7f3e78b03700 1 -- 172.21.15.88:0/1028725300 shutdown_connections 2020-02-11T16:24:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.731+0000 7f3e78b03700 1 -- 172.21.15.88:0/1028725300 wait complete. 2020-02-11T16:24:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.732+0000 7f3e78b03700 1 Processor -- start 2020-02-11T16:24:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.732+0000 7f3e78b03700 1 -- start start 2020-02-11T16:24:45.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e78b03700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e580066e0 0x7f3e741442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e78b03700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e7409eb00 0x7f3e74144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e78b03700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e74144b70 con 0x7f3e7412aa00 2020-02-11T16:24:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e78b03700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e74131df0 con 0x7f3e580066e0 2020-02-11T16:24:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e78b03700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740a7840 con 0x7f3e7409eb00 2020-02-11T16:24:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e580066e0 0x7f3e741442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e72d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3e7412aa00 0x7f3e7412ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46390/0 (socket says 172.21.15.88:46390) 2020-02-11T16:24:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e580066e0 0x7f3e741442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58760/0 (socket says 172.21.15.88:58760) 2020-02-11T16:24:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e72d9d700 1 -- 172.21.15.88:0/478996843 learned_addr learned my addr 172.21.15.88:0/478996843 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e7409eb00 0x7f3e74144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 -- 172.21.15.88:0/478996843 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e7409eb00 msgr2=0x7f3e74144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e7409eb00 0x7f3e74144710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 -- 172.21.15.88:0/478996843 >> v1:172.21.15.88:6789/0 conn(0x7f3e7412aa00 legacy=0x7f3e7412ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584706458 0 0) 0x7f3e74144b70 con 0x7f3e7412aa00 2020-02-11T16:24:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 -- 172.21.15.88:0/478996843 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7405a7d0 con 0x7f3e580066e0 2020-02-11T16:24:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 --2- 172.21.15.88:0/478996843 >> v2:172.21.15.88:3300/0 conn(0x7f3e580066e0 0x7f3e741442b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e7405ef00 tx=0x7f3e64010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 --2- 172.21.15.88:0/478996843 >> v2:172.21.15.88:3300/0 conn(0x7f3e580066e0 0x7f3e741442b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e7405ef00 tx=0x7f3e64010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e741442b0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f3e7405ef00 tx=0x7f3e64010d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e741442b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3e7405ef00 tx=0x7f3e64010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e741442b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3e7405ef00 tx=0x7f3e64010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e7259c700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e741442b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3e7405ef00 tx=0x7f3e64010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e6400cd10 con 0x7f3e580066e0 2020-02-11T16:24:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6400ce70 con 0x7f3e580066e0 2020-02-11T16:24:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e64012580 con 0x7f3e580066e0 2020-02-11T16:24:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e78b03700 1 -- 172.21.15.88:0/478996843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e740a04c0 con 0x7f3e580066e0 2020-02-11T16:24:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.733+0000 7f3e78b03700 1 -- 172.21.15.88:0/478996843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e740a0a00 con 0x7f3e580066e0 2020-02-11T16:24:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.734+0000 7f3e7259c700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e741442b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3e7405ef00 tx=0x7f3e64010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.734+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3e640126e0 con 0x7f3e580066e0 2020-02-11T16:24:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.734+0000 7f3e7259c700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e741442b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3e7405ef00 tx=0x7f3e64010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e78b03700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 0x7f3e740a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e78b03700 1 -- 172.21.15.88:0/478996843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7405e2f0 con 0x7f3e741302f0 2020-02-11T16:24:45.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e637fe700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e50039b90 0x7f3e5003c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3e64049c60 con 0x7f3e580066e0 2020-02-11T16:24:45.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 0x7f3e740a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e72d9d700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e50039b90 0x7f3e5003c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e71d9b700 1 -- 172.21.15.88:0/478996843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e740a0bc0 con 0x7f3e741302f0 2020-02-11T16:24:45.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 0x7f3e740a84b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 0x7f3e740a84b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 0x7f3e740a84b0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e72d9d700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e50039b90 0x7f3e5003c050 crc :-1 s=READY pgs=438 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 0x7f3e740a84b0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e68001770 con 0x7f3e741302f0 2020-02-11T16:24:45.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 0x7f3e740a84b0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f3e6800e350 con 0x7f3e741302f0 2020-02-11T16:24:45.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 msgr2=0x7f3e740a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e637fe700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 0x7f3e740a84b0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).stop 2020-02-11T16:24:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 msgr2=0x7f3e740a84b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.735+0000 7f3e637fe700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e741302f0 0x7f3e740a84b0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).stop 2020-02-11T16:24:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.745+0000 7f3e78b03700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 0x7f3e740a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.745+0000 7f3e78b03700 1 -- 172.21.15.88:0/478996843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740565b0 con 0x7f3e740a8910 2020-02-11T16:24:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.745+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 0x7f3e740a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.745+0000 7f3e71d9b700 1 -- 172.21.15.88:0/478996843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3e740008d0 con 0x7f3e740a8910 2020-02-11T16:24:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.745+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 0x7f3e740a8d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 0x7f3e740a8d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 0x7f3e740a8d20 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 0x7f3e740a8d20 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e68004e80 con 0x7f3e740a8910 2020-02-11T16:24:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e71d9b700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 0x7f3e740a8d20 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f3e680100b0 con 0x7f3e740a8910 2020-02-11T16:24:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 msgr2=0x7f3e740a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e637fe700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 0x7f3e740a8d20 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).stop 2020-02-11T16:24:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e637fe700 1 -- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 msgr2=0x7f3e740a8d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e637fe700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e740a8910 0x7f3e740a8d20 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0x7f3e580076b0 tx=0x7f3e6800c340).stop 2020-02-11T16:24:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e78b03700 1 -- 172.21.15.88:0/478996843 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e50039b90 msgr2=0x7f3e5003c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e78b03700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3e50039b90 0x7f3e5003c050 crc :-1 s=READY pgs=438 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e78b03700 1 -- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 msgr2=0x7f3e741442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e78b03700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e741442b0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f3e7405ef00 tx=0x7f3e64010d30).stop 2020-02-11T16:24:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e72d9d700 1 -- 172.21.15.88:0/478996843 reap_dead start 2020-02-11T16:24:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.746+0000 7f3e72d9d700 1 -- 172.21.15.88:0/478996843 reap_dead start 2020-02-11T16:24:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.747+0000 7f3e78b03700 1 -- 172.21.15.88:0/478996843 shutdown_connections 2020-02-11T16:24:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.747+0000 7f3e78b03700 1 --2- 172.21.15.88:0/478996843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e580066e0 0x7f3e741442b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.747+0000 7f3e78b03700 1 -- 172.21.15.88:0/478996843 >> 172.21.15.88:0/478996843 conn(0x7f3e7409d110 msgr2=0x7f3e74069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.747+0000 7f3e78b03700 1 -- 172.21.15.88:0/478996843 shutdown_connections 2020-02-11T16:24:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.747+0000 7f3e78b03700 1 -- 172.21.15.88:0/478996843 wait complete. 2020-02-11T16:24:45.758 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:24:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 156, 2020-02-11T16:24:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:45.759 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:24:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:24:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:45.760 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:45.761 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:45.762 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:45.763 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:45.764 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:45.765 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:45.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:45.767 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:45.768 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:45.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:45.770 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:45.771 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:45.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:45.773 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:45.774 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.775 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:45.776 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.777 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.777 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:45.778 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:24:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.897+0000 7f7d66946700 1 Processor -- start 2020-02-11T16:24:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.897+0000 7f7d66946700 1 -- start start 2020-02-11T16:24:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.897+0000 7f7d66946700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d600ad380 0x7f7d600a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.897+0000 7f7d66946700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d60138280 0x7f7d601386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.897+0000 7f7d66946700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d600adb40 con 0x7f7d6013b1c0 2020-02-11T16:24:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.897+0000 7f7d66946700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d60137bf0 con 0x7f7d60138280 2020-02-11T16:24:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.897+0000 7f7d66946700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d60138b40 con 0x7f7d600ad380 2020-02-11T16:24:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5ffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d600ad380 0x7f7d600a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d60138280 0x7f7d601386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d60138280 0x7f7d601386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44758/0 (socket says 172.21.15.88:44758) 2020-02-11T16:24:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 -- 172.21.15.88:0/2677577988 learned_addr learned my addr 172.21.15.88:0/2677577988 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 -- 172.21.15.88:0/2677577988 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d600ad380 msgr2=0x7f7d600a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 --2- 172.21.15.88:0/2677577988 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d600ad380 0x7f7d600a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 -- 172.21.15.88:0/2677577988 >> v1:172.21.15.52:6789/0 conn(0x7f7d6013b1c0 legacy=0x7f7d6013b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 -- 172.21.15.88:0/2677577988 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60137de0 con 0x7f7d60138280 2020-02-11T16:24:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 --2- 172.21.15.88:0/2677577988 >> v2:172.21.15.52:3300/0 conn(0x7f7d60138280 0x7f7d601386e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d54002f30 tx=0x7f7d540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 --2- 172.21.15.88:0/2677577988 >> v2:172.21.15.52:3300/0 conn(0x7f7d60138280 0x7f7d601386e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d54002f30 tx=0x7f7d540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 --2- 172.21.15.88:0/2677577988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d60138280 0x7f7d601386e0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f7d54002f30 tx=0x7f7d540088e0).ready entity=mon.0 client_cookie=dd3fe8742870429d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 --2- 172.21.15.88:0/2677577988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d60138280 0x7f7d601386e0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f7d54002f30 tx=0x7f7d540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 --2- 172.21.15.88:0/2677577988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d60138280 0x7f7d601386e0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f7d54002f30 tx=0x7f7d540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5effd700 1 -- 172.21.15.88:0/2677577988 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d540116b0 con 0x7f7d60138280 2020-02-11T16:24:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5f7fe700 1 --2- 172.21.15.88:0/2677577988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d60138280 0x7f7d601386e0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f7d54002f30 tx=0x7f7d540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5effd700 1 -- 172.21.15.88:0/2677577988 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d54011810 con 0x7f7d60138280 2020-02-11T16:24:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d5effd700 1 -- 172.21.15.88:0/2677577988 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d54011bf0 con 0x7f7d60138280 2020-02-11T16:24:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d66946700 1 -- 172.21.15.88:0/2677577988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d60138280 msgr2=0x7f7d601386e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.898+0000 7f7d66946700 1 --2- 172.21.15.88:0/2677577988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d60138280 0x7f7d601386e0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f7d54002f30 tx=0x7f7d540088e0).stop 2020-02-11T16:24:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.899+0000 7f7d66946700 1 -- 172.21.15.88:0/2677577988 shutdown_connections 2020-02-11T16:24:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.899+0000 7f7d66946700 1 --2- 172.21.15.88:0/2677577988 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d600ad380 0x7f7d600a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.899+0000 7f7d66946700 1 --2- 172.21.15.88:0/2677577988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d60138280 0x7f7d601386e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.899+0000 7f7d66946700 1 -- 172.21.15.88:0/2677577988 >> 172.21.15.88:0/2677577988 conn(0x7f7d6005ac70 msgr2=0x7f7d600ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.899+0000 7f7d66946700 1 -- 172.21.15.88:0/2677577988 shutdown_connections 2020-02-11T16:24:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.899+0000 7f7d66946700 1 -- 172.21.15.88:0/2677577988 wait complete. 2020-02-11T16:24:45.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.900+0000 7f7d66946700 1 Processor -- start 2020-02-11T16:24:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.900+0000 7f7d66946700 1 -- start start 2020-02-11T16:24:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d66946700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d600ad380 0x7f7d6012b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d66946700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d60138280 0x7f7d6012bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d66946700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d6013b1c0 0x7f7d60148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d66946700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6012c0c0 con 0x7f7d60138280 2020-02-11T16:24:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d66946700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d60132df0 con 0x7f7d6013b1c0 2020-02-11T16:24:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d66946700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d60133090 con 0x7f7d600ad380 2020-02-11T16:24:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d64ee3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d6013b1c0 0x7f7d60148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d64ee3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d6013b1c0 0x7f7d60148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58782/0 (socket says 172.21.15.88:58782) 2020-02-11T16:24:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d5f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d60138280 0x7f7d6012bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d5ffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d600ad380 0x7f7d6012b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d64ee3700 1 -- 172.21.15.88:0/2272580691 learned_addr learned my addr 172.21.15.88:0/2272580691 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d64ee3700 1 -- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d600ad380 msgr2=0x7f7d6012b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d64ee3700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d600ad380 0x7f7d6012b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d64ee3700 1 -- 172.21.15.88:0/2272580691 >> v2:172.21.15.52:3300/0 conn(0x7f7d60138280 msgr2=0x7f7d6012bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d64ee3700 1 --2- 172.21.15.88:0/2272580691 >> v2:172.21.15.52:3300/0 conn(0x7f7d60138280 0x7f7d6012bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d64ee3700 1 -- 172.21.15.88:0/2272580691 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60133330 con 0x7f7d6013b1c0 2020-02-11T16:24:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d5f7fe700 1 --2- 172.21.15.88:0/2272580691 >> v2:172.21.15.52:3300/0 conn(0x7f7d60138280 0x7f7d6012bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.901+0000 7f7d64ee3700 1 --2- 172.21.15.88:0/2272580691 >> v2:172.21.15.88:3300/0 conn(0x7f7d6013b1c0 0x7f7d60148720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d600af2b0 tx=0x7f7d5800c760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d64ee3700 1 --2- 172.21.15.88:0/2272580691 >> v2:172.21.15.88:3300/0 conn(0x7f7d6013b1c0 0x7f7d60148720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d600af2b0 tx=0x7f7d5800c760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d64ee3700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d6013b1c0 0x7f7d60148720 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f7d600af2b0 tx=0x7f7d5800c760).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d64ee3700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d6013b1c0 0x7f7d60148720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f7d600af2b0 tx=0x7f7d5800c760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d580101c0 con 0x7f7d6013b1c0 2020-02-11T16:24:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d64ee3700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d6013b1c0 0x7f7d60148720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f7d600af2b0 tx=0x7f7d5800c760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d64ee3700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d6013b1c0 0x7f7d60148720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f7d600af2b0 tx=0x7f7d5800c760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d58010320 con 0x7f7d6013b1c0 2020-02-11T16:24:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d58010700 con 0x7f7d6013b1c0 2020-02-11T16:24:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d66946700 1 -- 172.21.15.88:0/2272580691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6013ae50 con 0x7f7d6013b1c0 2020-02-11T16:24:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d66946700 1 -- 172.21.15.88:0/2272580691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6012e3f0 con 0x7f7d6013b1c0 2020-02-11T16:24:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.902+0000 7f7d64ee3700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d6013b1c0 0x7f7d60148720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f7d600af2b0 tx=0x7f7d5800c760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7d58006860 con 0x7f7d6013b1c0 2020-02-11T16:24:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d64ee3700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d6013b1c0 0x7f7d60148720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f7d600af2b0 tx=0x7f7d5800c760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d66946700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 0x7f7d60148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d66946700 1 -- 172.21.15.88:0/2272580691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6005e2f0 con 0x7f7d6012dcd0 2020-02-11T16:24:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5d7fa700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7d40039cd0 0x7f7d4003c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7d58049b40 con 0x7f7d6013b1c0 2020-02-11T16:24:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 0x7f7d60148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5f7fe700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7d40039cd0 0x7f7d4003c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5f7fe700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7d40039cd0 0x7f7d4003c190 crc :-1 s=READY pgs=439 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5ffff700 1 -- 172.21.15.88:0/2272580691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d60148480 con 0x7f7d6012dcd0 2020-02-11T16:24:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 0x7f7d60148b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 0x7f7d60148b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 0x7f7d60148b80 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 0x7f7d60148b80 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.903+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d50005a10 con 0x7f7d6012dcd0 2020-02-11T16:24:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.904+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 0x7f7d60148b80 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.904+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f7d50005b70 con 0x7f7d6012dcd0 2020-02-11T16:24:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.904+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 msgr2=0x7f7d60148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.904+0000 7f7d5d7fa700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 0x7f7d60148b80 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).stop 2020-02-11T16:24:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.904+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 msgr2=0x7f7d60148b80 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.904+0000 7f7d5d7fa700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d6012dcd0 0x7f7d60148b80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.917+0000 7f7d66946700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 0x7f7d6012ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.917+0000 7f7d66946700 1 -- 172.21.15.88:0/2272580691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d60132f30 con 0x7f7d601317e0 2020-02-11T16:24:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.917+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 0x7f7d6012ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:45.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.917+0000 7f7d5ffff700 1 -- 172.21.15.88:0/2272580691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7d6013afe0 con 0x7f7d601317e0 2020-02-11T16:24:45.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.917+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 0x7f7d6012ef50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.917+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 0x7f7d6012ef50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.917+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 0x7f7d6012ef50 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:45.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.917+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 0x7f7d6012ef50 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d5000b6a0 con 0x7f7d601317e0 2020-02-11T16:24:45.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d5ffff700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 0x7f7d6012ef50 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:45.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4022 (secure 0 0 0) 0x7f7d5000b800 con 0x7f7d601317e0 2020-02-11T16:24:45.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 msgr2=0x7f7d6012ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d5d7fa700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 0x7f7d6012ef50 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).stop 2020-02-11T16:24:45.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d5d7fa700 1 -- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 msgr2=0x7f7d6012ef50 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:45.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d5d7fa700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d601317e0 0x7f7d6012ef50 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0x7f7d50002f30 tx=0x7f7d50010e30).stop 2020-02-11T16:24:45.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d66946700 1 -- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7d40039cd0 msgr2=0x7f7d4003c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d66946700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7d40039cd0 0x7f7d4003c190 crc :-1 s=READY pgs=439 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d66946700 1 -- 172.21.15.88:0/2272580691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d6013b1c0 msgr2=0x7f7d60148720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:45.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d66946700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d6013b1c0 0x7f7d60148720 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f7d600af2b0 tx=0x7f7d5800c760).stop 2020-02-11T16:24:45.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d64ee3700 1 -- 172.21.15.88:0/2272580691 reap_dead start 2020-02-11T16:24:45.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d64ee3700 1 -- 172.21.15.88:0/2272580691 reap_dead start 2020-02-11T16:24:45.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d66946700 1 -- 172.21.15.88:0/2272580691 shutdown_connections 2020-02-11T16:24:45.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d66946700 1 --2- 172.21.15.88:0/2272580691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d6013b1c0 0x7f7d60148720 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:45.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d66946700 1 -- 172.21.15.88:0/2272580691 >> 172.21.15.88:0/2272580691 conn(0x7f7d6005ac70 msgr2=0x7f7d600aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:45.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d66946700 1 -- 172.21.15.88:0/2272580691 shutdown_connections 2020-02-11T16:24:45.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:45.918+0000 7f7d66946700 1 -- 172.21.15.88:0/2272580691 wait complete. 2020-02-11T16:24:45.925 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:24:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 156, 2020-02-11T16:24:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:45.926 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:24:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:24:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:45.927 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:45.928 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:45.929 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:45.930 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:45.931 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:45.932 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:45.932 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:45.932 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:45.932 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:45.932 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:45.932 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:45.932 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:45.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:45.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:45.936 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:45.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.936 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:45.936 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:45.936 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:45.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:45.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.937 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:45.937 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:45.937 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.938 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:45.938 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:45.938 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.938 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.938 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:45.938 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:45.939 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:45.939 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:45.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.939 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:45.939 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:45.939 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:45.940 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:45.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.940 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:45.940 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:45.940 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.940 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:45.941 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:45.941 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:45.941 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.941 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.941 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:45.941 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:45.942 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:45.942 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:45.942 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.942 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:45.942 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:45.942 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:45.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.943 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:45.943 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:45.943 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:45.943 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.943 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:45.943 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:24:45.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.944 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:45.944 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:45.944 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:24:45.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.944 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:45.944 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:45.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:45.945 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:45.945 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:45.945 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:24:45.945 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.945 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:45.945 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:45.946 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:45.947 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:24:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.059+0000 7fa10c2af700 1 Processor -- start 2020-02-11T16:24:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.059+0000 7fa10c2af700 1 -- start start 2020-02-11T16:24:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.060+0000 7fa10c2af700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 0x7fa1040a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.060+0000 7fa10c2af700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.060+0000 7fa10c2af700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10409d6b0 con 0x7fa10405c250 2020-02-11T16:24:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.060+0000 7fa10c2af700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1040a3f20 con 0x7fa10405be70 2020-02-11T16:24:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.060+0000 7fa10c2af700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10412f050 con 0x7fa104137f10 2020-02-11T16:24:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.060+0000 7fa10a84c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.060+0000 7fa10a04b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 0x7fa1040a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.060+0000 7fa10a04b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 0x7fa1040a31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:44776/0 (socket says 172.21.15.88:44776) 2020-02-11T16:24:46.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.060+0000 7fa10a84c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:53118/0 (socket says 172.21.15.88:53118) 2020-02-11T16:24:46.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.060+0000 7fa10a04b700 1 -- 172.21.15.88:0/1719263685 learned_addr learned my addr 172.21.15.88:0/1719263685 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:46.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a84c700 1 -- 172.21.15.88:0/1719263685 >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 msgr2=0x7fa1040a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:46.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a84c700 1 --2- 172.21.15.88:0/1719263685 >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 0x7fa1040a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:46.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a84c700 1 -- 172.21.15.88:0/1719263685 >> v1:172.21.15.52:6789/0 conn(0x7fa10405c250 legacy=0x7fa1040a6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a84c700 1 -- 172.21.15.88:0/1719263685 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1040a6560 con 0x7fa104137f10 2020-02-11T16:24:46.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a04b700 1 --2- 172.21.15.88:0/1719263685 >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 0x7fa1040a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:46.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a84c700 1 --2- 172.21.15.88:0/1719263685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa0fc0032b0 tx=0x7fa0fc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a84c700 1 --2- 172.21.15.88:0/1719263685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa0fc0032b0 tx=0x7fa0fc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a84c700 1 --2- 172.21.15.88:0/1719263685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fa0fc0032b0 tx=0x7fa0fc008c60).ready entity=mon.2 client_cookie=c9b34c0b0dc0fb90 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:46.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a84c700 1 --2- 172.21.15.88:0/1719263685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fa0fc0032b0 tx=0x7fa0fc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa109049700 1 -- 172.21.15.88:0/1719263685 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0fc013e80 con 0x7fa104137f10 2020-02-11T16:24:46.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a84c700 1 --2- 172.21.15.88:0/1719263685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fa0fc0032b0 tx=0x7fa0fc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10a84c700 1 --2- 172.21.15.88:0/1719263685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fa0fc0032b0 tx=0x7fa0fc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa109049700 1 -- 172.21.15.88:0/1719263685 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc00a350 con 0x7fa104137f10 2020-02-11T16:24:46.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa109049700 1 -- 172.21.15.88:0/1719263685 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0fc00a730 con 0x7fa104137f10 2020-02-11T16:24:46.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10c2af700 1 -- 172.21.15.88:0/1719263685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 msgr2=0x7fa10412e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.061+0000 7fa10c2af700 1 --2- 172.21.15.88:0/1719263685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fa0fc0032b0 tx=0x7fa0fc008c60).stop 2020-02-11T16:24:46.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.062+0000 7fa10c2af700 1 -- 172.21.15.88:0/1719263685 shutdown_connections 2020-02-11T16:24:46.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.062+0000 7fa10c2af700 1 --2- 172.21.15.88:0/1719263685 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104137f10 0x7fa10412e740 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.062+0000 7fa10c2af700 1 --2- 172.21.15.88:0/1719263685 >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 0x7fa1040a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.062+0000 7fa10c2af700 1 -- 172.21.15.88:0/1719263685 >> 172.21.15.88:0/1719263685 conn(0x7fa1040ab400 msgr2=0x7fa1040a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.062+0000 7fa10c2af700 1 -- 172.21.15.88:0/1719263685 shutdown_connections 2020-02-11T16:24:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.062+0000 7fa10c2af700 1 -- 172.21.15.88:0/1719263685 wait complete. 2020-02-11T16:24:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10c2af700 1 Processor -- start 2020-02-11T16:24:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10c2af700 1 -- start start 2020-02-11T16:24:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10c2af700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 0x7fa104143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10c2af700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa104137f10 0x7fa10412f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10c2af700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa104131d10 con 0x7fa10405c250 2020-02-11T16:24:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10c2af700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa104144760 con 0x7fa10405be70 2020-02-11T16:24:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10c2af700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa104144a00 con 0x7fa104137f10 2020-02-11T16:24:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10a84c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa104137f10 0x7fa10412f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10a04b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 0x7fa104143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10a84c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa104137f10 0x7fa10412f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58800/0 (socket says 172.21.15.88:58800) 2020-02-11T16:24:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.063+0000 7fa10a84c700 1 -- 172.21.15.88:0/2381587686 learned_addr learned my addr 172.21.15.88:0/2381587686 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 -- 172.21.15.88:0/2381587686 >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 msgr2=0x7fa104143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 --2- 172.21.15.88:0/2381587686 >> v2:172.21.15.52:3300/0 conn(0x7fa10405be70 0x7fa104143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 -- 172.21.15.88:0/2381587686 >> v1:172.21.15.52:6789/0 conn(0x7fa10405c250 legacy=0x7fa1040a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 -- 172.21.15.88:0/2381587686 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa104144ca0 con 0x7fa104137f10 2020-02-11T16:24:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 --2- 172.21.15.88:0/2381587686 >> v2:172.21.15.88:3300/0 conn(0x7fa104137f10 0x7fa10412f410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa10409e7c0 tx=0x7fa10412f1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 --2- 172.21.15.88:0/2381587686 >> v2:172.21.15.88:3300/0 conn(0x7fa104137f10 0x7fa10412f410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa10409e7c0 tx=0x7fa10412f1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa104137f10 0x7fa10412f410 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fa10409e7c0 tx=0x7fa10412f1c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa104137f10 0x7fa10412f410 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa10409e7c0 tx=0x7fa10412f1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa104137f10 0x7fa10412f410 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa10409e7c0 tx=0x7fa10412f1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0fc005a40 con 0x7fa104137f10 2020-02-11T16:24:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa104137f10 0x7fa10412f410 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa10409e7c0 tx=0x7fa10412f1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc005ba0 con 0x7fa104137f10 2020-02-11T16:24:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10c2af700 1 -- 172.21.15.88:0/2381587686 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1040a16b0 con 0x7fa104137f10 2020-02-11T16:24:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0fc00f570 con 0x7fa104137f10 2020-02-11T16:24:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10c2af700 1 -- 172.21.15.88:0/2381587686 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1040a1160 con 0x7fa104137f10 2020-02-11T16:24:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.064+0000 7fa10a84c700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa104137f10 0x7fa10412f410 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa10409e7c0 tx=0x7fa10412f1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.065+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa0fc00f7e0 con 0x7fa104137f10 2020-02-11T16:24:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.065+0000 7fa10a84c700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa104137f10 0x7fa10412f410 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa10409e7c0 tx=0x7fa10412f1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.065+0000 7fa0f37fe700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa0e4039ca0 0x7fa0e403c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.065+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa0fc04c8e0 con 0x7fa104137f10 2020-02-11T16:24:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.065+0000 7fa10c2af700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 0x7fa1040a2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.065+0000 7fa10c2af700 1 -- 172.21.15.88:0/2381587686 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10405c630 con 0x7fa10412f870 2020-02-11T16:24:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.065+0000 7fa10a04b700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa0e4039ca0 0x7fa0e403c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.065+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 0x7fa1040a2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa10a04b700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa0e4039ca0 0x7fa0e403c160 crc :-1 s=READY pgs=440 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa10984a700 1 -- 172.21.15.88:0/2381587686 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa104144e30 con 0x7fa10412f870 2020-02-11T16:24:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 0x7fa1040a2800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 0x7fa1040a2800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 0x7fa1040a2800 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4002e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 0x7fa1040a2800 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0f400cc20 con 0x7fa10412f870 2020-02-11T16:24:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 0x7fa1040a2800 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa0f400cd80 con 0x7fa10412f870 2020-02-11T16:24:46.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 msgr2=0x7fa1040a2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa0f37fe700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 0x7fa1040a2800 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4002e60).stop 2020-02-11T16:24:46.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 msgr2=0x7fa1040a2800 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:46.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.066+0000 7fa0f37fe700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa10412f870 0x7fa1040a2800 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4002e60).stop 2020-02-11T16:24:46.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.076+0000 7fa10c2af700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 0x7fa104132c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:46.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.076+0000 7fa10c2af700 1 -- 172.21.15.88:0/2381587686 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1041448a0 con 0x7fa104132850 2020-02-11T16:24:46.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.076+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 0x7fa104132c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa10984a700 1 -- 172.21.15.88:0/2381587686 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa1041445d0 con 0x7fa104132850 2020-02-11T16:24:46.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 0x7fa104132c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 0x7fa104132c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 0x7fa104132c60 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4011f20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:46.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 0x7fa104132c60 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0f400ee20 con 0x7fa104132850 2020-02-11T16:24:46.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa10984a700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 0x7fa104132c60 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7fa0f400f640 con 0x7fa104132850 2020-02-11T16:24:46.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 msgr2=0x7fa104132c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa0f37fe700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 0x7fa104132c60 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4011f20).stop 2020-02-11T16:24:46.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa0f37fe700 1 -- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 msgr2=0x7fa104132c60 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:46.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.077+0000 7fa0f37fe700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa104132850 0x7fa104132c60 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0x7fa1041419c0 tx=0x7fa0f4011f20).stop 2020-02-11T16:24:46.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10c2af700 1 -- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa0e4039ca0 msgr2=0x7fa0e403c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10c2af700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa0e4039ca0 0x7fa0e403c160 crc :-1 s=READY pgs=440 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:46.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10c2af700 1 -- 172.21.15.88:0/2381587686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa104137f10 msgr2=0x7fa10412f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10c2af700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa104137f10 0x7fa10412f410 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fa10409e7c0 tx=0x7fa10412f1c0).stop 2020-02-11T16:24:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10a84c700 1 -- 172.21.15.88:0/2381587686 reap_dead start 2020-02-11T16:24:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10a84c700 1 -- 172.21.15.88:0/2381587686 reap_dead start 2020-02-11T16:24:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10c2af700 1 -- 172.21.15.88:0/2381587686 shutdown_connections 2020-02-11T16:24:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10c2af700 1 --2- 172.21.15.88:0/2381587686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa104137f10 0x7fa10412f410 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10c2af700 1 -- 172.21.15.88:0/2381587686 >> 172.21.15.88:0/2381587686 conn(0x7fa1040ab400 msgr2=0x7fa104069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10c2af700 1 -- 172.21.15.88:0/2381587686 shutdown_connections 2020-02-11T16:24:46.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.078+0000 7fa10c2af700 1 -- 172.21.15.88:0/2381587686 wait complete. 2020-02-11T16:24:46.088 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:46.088 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:46.088 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:46.088 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:24:46.088 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 156, 2020-02-11T16:24:46.089 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:46.089 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:46.089 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:24:46.089 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:46.089 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:46.089 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:24:46.089 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:46.090 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:46.090 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:46.090 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:46.090 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:46.090 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:46.090 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:46.090 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:46.091 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:46.091 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:46.091 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:46.091 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:46.091 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:46.091 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:46.091 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:46.091 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:46.092 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:46.092 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:46.092 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:46.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.092 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:46.092 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:46.092 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:46.093 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:46.093 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:46.093 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:46.093 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:46.093 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:46.093 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:46.093 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:46.094 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:46.094 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:46.094 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:46.094 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:46.094 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:46.094 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:46.095 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:46.095 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:46.095 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:46.095 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:46.095 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.095 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:46.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.096 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:46.096 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:46.096 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:46.096 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:46.096 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.096 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:46.096 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:46.097 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:46.097 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.097 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.097 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:46.097 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:46.097 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:46.097 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.102 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:46.102 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:46.102 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:46.102 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:46.103 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:46.103 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.103 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:46.103 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:46.104 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:46.104 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:46.104 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.104 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:46.104 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:46.104 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:46.104 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:46.105 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.105 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:46.105 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:46.105 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:46.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.105 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.105 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:46.106 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:46.106 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:46.106 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:46.106 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:46.106 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.106 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:46.106 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:46.107 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:46.107 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:46.107 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:46.107 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:46.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:46.107 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:46.108 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:46.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.108 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:46.108 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:46.108 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:46.108 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:46.109 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:46.109 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:24:46.109 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.109 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:46.109 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:46.109 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:46.109 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:46.110 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:46.110 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:24:46.110 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.110 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:46.110 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:46.110 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:24:46.110 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:46.111 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:46.111 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:46.111 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.111 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:46.111 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:46.111 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:46.111 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:46.112 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:46.112 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:24:46.112 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:46.112 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:46.112 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:46.112 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:46.112 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:46.113 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:46.113 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:46.113 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:46.114 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:24:46.114 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:24:46.230 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.228+0000 7f2cf6826700 1 Processor -- start 2020-02-11T16:24:46.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.228+0000 7f2cf6826700 1 -- start start 2020-02-11T16:24:46.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2cf6826700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 0x7f2cf00a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:46.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2cf6826700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2cf0131990 0x7f2cf00a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:46.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2cf6826700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf00a4350 con 0x7f2cf00a5410 2020-02-11T16:24:46.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2cf6826700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00a1e60 con 0x7f2cf0131990 2020-02-11T16:24:46.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2cf6826700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00a3450 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2cef7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2cf00a5410 0x7f2cf0131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46436/0 (socket says 172.21.15.88:46436) 2020-02-11T16:24:46.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2cef7fe700 1 -- 172.21.15.88:0/2164270802 learned_addr learned my addr 172.21.15.88:0/2164270802 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:46.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceffff700 1 --2- 172.21.15.88:0/2164270802 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 0x7f2cf00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceeffd700 1 -- 172.21.15.88:0/2164270802 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039023160 0 0) 0x7f2cf00a4350 con 0x7f2cf00a5410 2020-02-11T16:24:46.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceeffd700 1 -- 172.21.15.88:0/2164270802 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cdc004340 con 0x7f2cf00a5410 2020-02-11T16:24:46.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2cf4dc3700 1 --2- 172.21.15.88:0/2164270802 >> v2:172.21.15.52:3300/0 conn(0x7f2cf0131990 0x7f2cf00a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceffff700 1 -- 172.21.15.88:0/2164270802 >> v2:172.21.15.52:3300/0 conn(0x7f2cf0131990 msgr2=0x7f2cf00a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:46.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceffff700 1 --2- 172.21.15.88:0/2164270802 >> v2:172.21.15.52:3300/0 conn(0x7f2cf0131990 0x7f2cf00a5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:46.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceffff700 1 -- 172.21.15.88:0/2164270802 >> v1:172.21.15.88:6789/0 conn(0x7f2cf00a5410 legacy=0x7f2cf0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceffff700 1 -- 172.21.15.88:0/2164270802 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00a3a40 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceffff700 1 --2- 172.21.15.88:0/2164270802 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 0x7f2cf00a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ce0002f30 tx=0x7f2ce00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceffff700 1 --2- 172.21.15.88:0/2164270802 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 0x7f2cf00a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ce0002f30 tx=0x7f2ce00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceffff700 1 --2- 172.21.15.88:0/2164270802 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 0x7f2cf00a1520 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2ce00088e0).ready entity=mon.2 client_cookie=ba599f60ba798161 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:46.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceffff700 1 --2- 172.21.15.88:0/2164270802 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 0x7f2cf00a1520 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2ce00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.229+0000 7f2ceeffd700 1 -- 172.21.15.88:0/2164270802 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce0008e40 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2ceffff700 1 --2- 172.21.15.88:0/2164270802 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 0x7f2cf00a1520 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2ce00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2ceffff700 1 --2- 172.21.15.88:0/2164270802 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 0x7f2cf00a1520 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2ce00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2ceeffd700 1 -- 172.21.15.88:0/2164270802 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce00115f0 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2ceeffd700 1 -- 172.21.15.88:0/2164270802 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce00119d0 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2cf6826700 1 -- 172.21.15.88:0/2164270802 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 msgr2=0x7f2cf00a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2cf6826700 1 --2- 172.21.15.88:0/2164270802 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 0x7f2cf00a1520 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2ce00088e0).stop 2020-02-11T16:24:46.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2cf6826700 1 -- 172.21.15.88:0/2164270802 shutdown_connections 2020-02-11T16:24:46.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2cf6826700 1 --2- 172.21.15.88:0/2164270802 >> v2:172.21.15.52:3300/0 conn(0x7f2cf0131990 0x7f2cf00a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:46.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2cf6826700 1 --2- 172.21.15.88:0/2164270802 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a2fa0 0x7f2cf00a1520 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:46.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2cf6826700 1 -- 172.21.15.88:0/2164270802 >> 172.21.15.88:0/2164270802 conn(0x7f2cf009d110 msgr2=0x7f2cf009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:46.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2cf6826700 1 -- 172.21.15.88:0/2164270802 shutdown_connections 2020-02-11T16:24:46.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.230+0000 7f2cf6826700 1 -- 172.21.15.88:0/2164270802 wait complete. 2020-02-11T16:24:46.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.231+0000 7f2cf6826700 1 Processor -- start 2020-02-11T16:24:46.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.231+0000 7f2cf6826700 1 -- start start 2020-02-11T16:24:46.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2cf6826700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:46.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2cf6826700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a5410 0x7f2cf00627b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:46.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2cf6826700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf0135330 con 0x7f2cf0131990 2020-02-11T16:24:46.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2cf6826700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00a0720 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2cf6826700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0061040 con 0x7f2cf00a5410 2020-02-11T16:24:46.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2ceffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2ceffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58814/0 (socket says 172.21.15.88:58814) 2020-02-11T16:24:46.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2cf4dc3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2cf0131990 0x7f2cf012ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46444/0 (socket says 172.21.15.88:46444) 2020-02-11T16:24:46.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2ceffff700 1 -- 172.21.15.88:0/324919261 learned_addr learned my addr 172.21.15.88:0/324919261 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2cef7fe700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a5410 0x7f2cf00627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2ceffff700 1 -- 172.21.15.88:0/324919261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a5410 msgr2=0x7f2cf00627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a5410 0x7f2cf00627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2ceffff700 1 -- 172.21.15.88:0/324919261 >> v1:172.21.15.88:6789/0 conn(0x7f2cf0131990 legacy=0x7f2cf012ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2ced7fa700 1 -- 172.21.15.88:0/324919261 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140695585 0 0) 0x7f2cf0135330 con 0x7f2cf0131990 2020-02-11T16:24:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2ceffff700 1 -- 172.21.15.88:0/324919261 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0134770 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.232+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> v2:172.21.15.88:3300/0 conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> v2:172.21.15.88:3300/0 conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ced7fa700 1 -- 172.21.15.88:0/324919261 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce0007340 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ced7fa700 1 -- 172.21.15.88:0/324919261 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce00074a0 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2cf6826700 1 -- 172.21.15.88:0/324919261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf0130ac0 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ced7fa700 1 -- 172.21.15.88:0/324919261 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce00058b0 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2cf6826700 1 -- 172.21.15.88:0/324919261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf00612a0 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ced7fa700 1 -- 172.21.15.88:0/324919261 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2ce0005b20 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.233+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.234+0000 7f2ced7fa700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cd0039b70 0x7f2cd003c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:46.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.234+0000 7f2ced7fa700 1 -- 172.21.15.88:0/324919261 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f2ce004e240 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.234+0000 7f2cef7fe700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cd0039b70 0x7f2cd003c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:46.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.234+0000 7f2cf6826700 1 -- 172.21.15.88:0/324919261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf0062460 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.234+0000 7f2cef7fe700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cd0039b70 0x7f2cd003c030 crc :-1 s=READY pgs=441 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:46.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.238+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.238+0000 7f2ced7fa700 1 -- 172.21.15.88:0/324919261 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f2ce0033940 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.445+0000 7f2cf6826700 1 -- 172.21.15.88:0/324919261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f2cf01307e0 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.447+0000 7f2ceffff700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:46.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.447+0000 7f2ced7fa700 1 -- 172.21.15.88:0/324919261 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f2ce00363f0 con 0x7f2cf00a2fa0 2020-02-11T16:24:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 -- 172.21.15.88:0/324919261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cd0039b70 msgr2=0x7f2cd003c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cd0039b70 0x7f2cd003c030 crc :-1 s=READY pgs=441 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 -- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 msgr2=0x7f2cf00a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f2ce0002f30 tx=0x7f2cf0067410).stop 2020-02-11T16:24:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 -- 172.21.15.88:0/324919261 shutdown_connections 2020-02-11T16:24:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cd0039b70 0x7f2cd003c030 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf00a2fa0 0x7f2cf00a02c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 --2- 172.21.15.88:0/324919261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cf00a5410 0x7f2cf00627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 -- 172.21.15.88:0/324919261 >> 172.21.15.88:0/324919261 conn(0x7f2cf009d110 msgr2=0x7f2cf0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 -- 172.21.15.88:0/324919261 shutdown_connections 2020-02-11T16:24:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:46.448+0000 7f2cf6826700 1 -- 172.21.15.88:0/324919261 wait complete. 2020-02-11T16:24:46.464 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:24:56.465 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:24:56.465 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:24:56.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.593+0000 7fe3789cb700 1 Processor -- start 2020-02-11T16:24:56.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.593+0000 7fe3789cb700 1 -- start start 2020-02-11T16:24:56.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe3789cb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe37409df50 0x7fe374139760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:56.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe3789cb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37409e7e0 con 0x7fe3740a6bf0 2020-02-11T16:24:56.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe3789cb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3740a4cd0 con 0x7fe37405c1f0 2020-02-11T16:24:56.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe3789cb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37409e540 con 0x7fe37409df50 2020-02-11T16:24:56.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe372d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe37409df50 0x7fe374139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:56.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe37259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe37405c1f0 0x7fe3740a45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46450/0 (socket says 172.21.15.88:46450) 2020-02-11T16:24:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe37259c700 1 -- 172.21.15.88:0/1143988743 learned_addr learned my addr 172.21.15.88:0/1143988743 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe372d9d700 1 -- 172.21.15.88:0/1143988743 >> v1:172.21.15.88:6789/0 conn(0x7fe37405c1f0 legacy=0x7fe3740a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe372d9d700 1 -- 172.21.15.88:0/1143988743 >> v1:172.21.15.52:6789/0 conn(0x7fe3740a6bf0 legacy=0x7fe374139050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe37159a700 1 -- 172.21.15.88:0/1143988743 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917393371 0 0) 0x7fe3740a4cd0 con 0x7fe37405c1f0 2020-02-11T16:24:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.594+0000 7fe372d9d700 1 -- 172.21.15.88:0/1143988743 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3740a4120 con 0x7fe37409df50 2020-02-11T16:24:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe372d9d700 1 --2- 172.21.15.88:0/1143988743 >> v2:172.21.15.88:3300/0 conn(0x7fe37409df50 0x7fe374139760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe37405a7b0 tx=0x7fe36c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe372d9d700 1 --2- 172.21.15.88:0/1143988743 >> v2:172.21.15.88:3300/0 conn(0x7fe37409df50 0x7fe374139760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe37405a7b0 tx=0x7fe36c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe372d9d700 1 --2- 172.21.15.88:0/1143988743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374139760 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fe37405a7b0 tx=0x7fe36c008c60).ready entity=mon.1 client_cookie=46b6fef4155ee45 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:56.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe372d9d700 1 --2- 172.21.15.88:0/1143988743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374139760 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fe37405a7b0 tx=0x7fe36c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe37159a700 1 -- 172.21.15.88:0/1143988743 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36c00a160 con 0x7fe37409df50 2020-02-11T16:24:56.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe372d9d700 1 --2- 172.21.15.88:0/1143988743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374139760 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fe37405a7b0 tx=0x7fe36c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe37159a700 1 -- 172.21.15.88:0/1143988743 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c00a2c0 con 0x7fe37409df50 2020-02-11T16:24:56.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe372d9d700 1 --2- 172.21.15.88:0/1143988743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374139760 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fe37405a7b0 tx=0x7fe36c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe3789cb700 1 -- 172.21.15.88:0/1143988743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 msgr2=0x7fe374139760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe37159a700 1 -- 172.21.15.88:0/1143988743 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36c00a660 con 0x7fe37409df50 2020-02-11T16:24:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe3789cb700 1 --2- 172.21.15.88:0/1143988743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374139760 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fe37405a7b0 tx=0x7fe36c008c60).stop 2020-02-11T16:24:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe3789cb700 1 -- 172.21.15.88:0/1143988743 shutdown_connections 2020-02-11T16:24:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe3789cb700 1 --2- 172.21.15.88:0/1143988743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374139760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe3789cb700 1 -- 172.21.15.88:0/1143988743 >> 172.21.15.88:0/1143988743 conn(0x7fe3740ab400 msgr2=0x7fe3740a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:56.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.595+0000 7fe3789cb700 1 -- 172.21.15.88:0/1143988743 shutdown_connections 2020-02-11T16:24:56.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.596+0000 7fe3789cb700 1 -- 172.21.15.88:0/1143988743 wait complete. 2020-02-11T16:24:56.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.596+0000 7fe3789cb700 1 Processor -- start 2020-02-11T16:24:56.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.596+0000 7fe3789cb700 1 -- start start 2020-02-11T16:24:56.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe3789cb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe37409df50 0x7fe374145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:56.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe3789cb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe374131c30 con 0x7fe3740a6bf0 2020-02-11T16:24:56.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe3789cb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe374131ed0 con 0x7fe37405c1f0 2020-02-11T16:24:56.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe3789cb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe374066af0 con 0x7fe37409df50 2020-02-11T16:24:56.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe371d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe37409df50 0x7fe374145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe37259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe37405c1f0 0x7fe3740a01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46454/0 (socket says 172.21.15.88:46454) 2020-02-11T16:24:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe37259c700 1 -- 172.21.15.88:0/3119797258 learned_addr learned my addr 172.21.15.88:0/3119797258 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe371d9b700 1 -- 172.21.15.88:0/3119797258 >> v1:172.21.15.88:6789/0 conn(0x7fe37405c1f0 legacy=0x7fe3740a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe371d9b700 1 -- 172.21.15.88:0/3119797258 >> v1:172.21.15.52:6789/0 conn(0x7fe3740a6bf0 legacy=0x7fe37414fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe371d9b700 1 -- 172.21.15.88:0/3119797258 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374132170 con 0x7fe37409df50 2020-02-11T16:24:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe3637fe700 1 -- 172.21.15.88:0/3119797258 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631647523 0 0) 0x7fe374131ed0 con 0x7fe37405c1f0 2020-02-11T16:24:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe371d9b700 1 --2- 172.21.15.88:0/3119797258 >> v2:172.21.15.88:3300/0 conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe371d9b700 1 --2- 172.21.15.88:0/3119797258 >> v2:172.21.15.88:3300/0 conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.597+0000 7fe371d9b700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:56.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.598+0000 7fe371d9b700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.598+0000 7fe3637fe700 1 -- 172.21.15.88:0/3119797258 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe368006bc0 con 0x7fe37409df50 2020-02-11T16:24:56.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.598+0000 7fe371d9b700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.598+0000 7fe371d9b700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.598+0000 7fe3637fe700 1 -- 172.21.15.88:0/3119797258 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368006d20 con 0x7fe37409df50 2020-02-11T16:24:56.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.598+0000 7fe3637fe700 1 -- 172.21.15.88:0/3119797258 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe368008350 con 0x7fe37409df50 2020-02-11T16:24:56.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.598+0000 7fe3789cb700 1 -- 172.21.15.88:0/3119797258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3740a1d70 con 0x7fe37409df50 2020-02-11T16:24:56.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.598+0000 7fe3789cb700 1 -- 172.21.15.88:0/3119797258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3741328e0 con 0x7fe37409df50 2020-02-11T16:24:56.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.598+0000 7fe371d9b700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.599+0000 7fe3637fe700 1 -- 172.21.15.88:0/3119797258 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe3680085c0 con 0x7fe37409df50 2020-02-11T16:24:56.608 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.599+0000 7fe371d9b700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.599+0000 7fe3637fe700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe350039b30 0x7fe35003bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:56.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.599+0000 7fe3637fe700 1 -- 172.21.15.88:0/3119797258 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe368049b30 con 0x7fe37409df50 2020-02-11T16:24:56.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.599+0000 7fe3789cb700 1 -- 172.21.15.88:0/3119797258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3740565b0 con 0x7fe37409df50 2020-02-11T16:24:56.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.599+0000 7fe37259c700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe350039b30 0x7fe35003bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:56.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.599+0000 7fe37259c700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe350039b30 0x7fe35003bff0 crc :-1 s=READY pgs=442 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:56.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.603+0000 7fe371d9b700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.603+0000 7fe3637fe700 1 -- 172.21.15.88:0/3119797258 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe36802f210 con 0x7fe37409df50 2020-02-11T16:24:56.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.834+0000 7fe3789cb700 1 -- 172.21.15.88:0/3119797258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe3740aa470 con 0x7fe37409df50 2020-02-11T16:24:56.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.834+0000 7fe371d9b700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.834+0000 7fe3637fe700 1 -- 172.21.15.88:0/3119797258 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fe368031c80 con 0x7fe37409df50 2020-02-11T16:24:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:56.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.836+0000 7fe3789cb700 1 -- 172.21.15.88:0/3119797258 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe350039b30 msgr2=0x7fe35003bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.836+0000 7fe3789cb700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe350039b30 0x7fe35003bff0 crc :-1 s=READY pgs=442 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:56.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.836+0000 7fe3789cb700 1 -- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 msgr2=0x7fe374145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.836+0000 7fe3789cb700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374145610 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fe368001f50 tx=0x7fe368010930).stop 2020-02-11T16:24:56.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.836+0000 7fe3789cb700 1 -- 172.21.15.88:0/3119797258 shutdown_connections 2020-02-11T16:24:56.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.836+0000 7fe3789cb700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe350039b30 0x7fe35003bff0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:56.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.836+0000 7fe3789cb700 1 --2- 172.21.15.88:0/3119797258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe37409df50 0x7fe374145610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:56.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.836+0000 7fe3789cb700 1 -- 172.21.15.88:0/3119797258 >> 172.21.15.88:0/3119797258 conn(0x7fe3740ab400 msgr2=0x7fe374135b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:56.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.836+0000 7fe3789cb700 1 -- 172.21.15.88:0/3119797258 shutdown_connections 2020-02-11T16:24:56.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.836+0000 7fe3789cb700 1 -- 172.21.15.88:0/3119797258 wait complete. 2020-02-11T16:24:56.848 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":156,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:56.848 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:24:56.848 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:24:56.849 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:24:56.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.962+0000 7efe8de7f700 1 Processor -- start 2020-02-11T16:24:56.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.962+0000 7efe8de7f700 1 -- start start 2020-02-11T16:24:56.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe8de7f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe880a6dd0 0x7efe880a6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:56.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe8de7f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe880a71b0 0x7efe880a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:56.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe8de7f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe880a40e0 0x7efe88137320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:56.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe8de7f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880a4a20 con 0x7efe880a71b0 2020-02-11T16:24:56.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe8de7f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880a5270 con 0x7efe880a40e0 2020-02-11T16:24:56.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe8de7f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe880a5510 con 0x7efe880a6dd0 2020-02-11T16:24:56.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe87fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe880a40e0 0x7efe88137320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:56.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe87fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe880a40e0 0x7efe88137320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58840/0 (socket says 172.21.15.88:58840) 2020-02-11T16:24:56.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe87fff700 1 -- 172.21.15.88:0/2568043199 learned_addr learned my addr 172.21.15.88:0/2568043199 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:56.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe7ffff700 1 --2- 172.21.15.88:0/2568043199 >> v2:172.21.15.52:3300/0 conn(0x7efe880a71b0 0x7efe880a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:56.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.963+0000 7efe877fe700 1 --2- 172.21.15.88:0/2568043199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe880a6dd0 0x7efe880a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:56.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 -- 172.21.15.88:0/2568043199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe880a6dd0 msgr2=0x7efe880a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:56.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 --2- 172.21.15.88:0/2568043199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe880a6dd0 0x7efe880a6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:56.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 -- 172.21.15.88:0/2568043199 >> v2:172.21.15.52:3300/0 conn(0x7efe880a71b0 msgr2=0x7efe880a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:56.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 --2- 172.21.15.88:0/2568043199 >> v2:172.21.15.52:3300/0 conn(0x7efe880a71b0 0x7efe880a3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:56.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 -- 172.21.15.88:0/2568043199 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880a57b0 con 0x7efe880a40e0 2020-02-11T16:24:56.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe7ffff700 1 --2- 172.21.15.88:0/2568043199 >> v2:172.21.15.52:3300/0 conn(0x7efe880a71b0 0x7efe880a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:24:56.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 --2- 172.21.15.88:0/2568043199 >> v2:172.21.15.88:3300/0 conn(0x7efe880a40e0 0x7efe88137320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 --2- 172.21.15.88:0/2568043199 >> v2:172.21.15.88:3300/0 conn(0x7efe880a40e0 0x7efe88137320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 --2- 172.21.15.88:0/2568043199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a40e0 0x7efe88137320 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).ready entity=mon.1 client_cookie=61098ee270e29f1b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:56.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 --2- 172.21.15.88:0/2568043199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a40e0 0x7efe88137320 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 --2- 172.21.15.88:0/2568043199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a40e0 0x7efe88137320 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe86ffd700 1 -- 172.21.15.88:0/2568043199 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe80009c20 con 0x7efe880a40e0 2020-02-11T16:24:56.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe87fff700 1 --2- 172.21.15.88:0/2568043199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a40e0 0x7efe88137320 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe86ffd700 1 -- 172.21.15.88:0/2568043199 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe80009d80 con 0x7efe880a40e0 2020-02-11T16:24:56.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe86ffd700 1 -- 172.21.15.88:0/2568043199 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe80014730 con 0x7efe880a40e0 2020-02-11T16:24:56.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe8de7f700 1 -- 172.21.15.88:0/2568043199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a40e0 msgr2=0x7efe88137320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe8de7f700 1 --2- 172.21.15.88:0/2568043199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a40e0 0x7efe88137320 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).stop 2020-02-11T16:24:56.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe8de7f700 1 -- 172.21.15.88:0/2568043199 shutdown_connections 2020-02-11T16:24:56.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe8de7f700 1 --2- 172.21.15.88:0/2568043199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a40e0 0x7efe88137320 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:56.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe8de7f700 1 --2- 172.21.15.88:0/2568043199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe880a6dd0 0x7efe880a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:56.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe8de7f700 1 --2- 172.21.15.88:0/2568043199 >> v2:172.21.15.52:3300/0 conn(0x7efe880a71b0 0x7efe880a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:56.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.964+0000 7efe8de7f700 1 -- 172.21.15.88:0/2568043199 >> 172.21.15.88:0/2568043199 conn(0x7efe8809d110 msgr2=0x7efe8809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:56.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.965+0000 7efe8de7f700 1 -- 172.21.15.88:0/2568043199 shutdown_connections 2020-02-11T16:24:56.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.965+0000 7efe8de7f700 1 -- 172.21.15.88:0/2568043199 wait complete. 2020-02-11T16:24:56.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.965+0000 7efe8de7f700 1 Processor -- start 2020-02-11T16:24:56.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.965+0000 7efe8de7f700 1 -- start start 2020-02-11T16:24:56.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.966+0000 7efe8de7f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe880a71b0 0x7efe8809f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:56.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.966+0000 7efe8de7f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe88141c50 con 0x7efe880a40e0 2020-02-11T16:24:56.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.966+0000 7efe8de7f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe88136160 con 0x7efe880a6dd0 2020-02-11T16:24:56.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.966+0000 7efe8de7f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe88136400 con 0x7efe880a71b0 2020-02-11T16:24:56.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.966+0000 7efe87fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe880a71b0 0x7efe8809f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:56.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.966+0000 7efe87fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe880a71b0 0x7efe8809f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58846/0 (socket says 172.21.15.88:58846) 2020-02-11T16:24:56.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.966+0000 7efe7ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efe880a6dd0 0x7efe881368a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46470/0 (socket says 172.21.15.88:46470) 2020-02-11T16:24:56.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.966+0000 7efe87fff700 1 -- 172.21.15.88:0/456736109 learned_addr learned my addr 172.21.15.88:0/456736109 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:56.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.966+0000 7efe87fff700 1 -- 172.21.15.88:0/456736109 >> v1:172.21.15.88:6789/0 conn(0x7efe880a6dd0 legacy=0x7efe881368a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe87fff700 1 -- 172.21.15.88:0/456736109 >> v1:172.21.15.52:6789/0 conn(0x7efe880a40e0 legacy=0x7efe881412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe87fff700 1 -- 172.21.15.88:0/456736109 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe88137b20 con 0x7efe880a71b0 2020-02-11T16:24:56.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053950645 0 0) 0x7efe88136160 con 0x7efe880a6dd0 2020-02-11T16:24:56.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe87fff700 1 --2- 172.21.15.88:0/456736109 >> v2:172.21.15.88:3300/0 conn(0x7efe880a71b0 0x7efe8809f650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe87fff700 1 --2- 172.21.15.88:0/456736109 >> v2:172.21.15.88:3300/0 conn(0x7efe880a71b0 0x7efe8809f650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe87fff700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a71b0 0x7efe8809f650 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:56.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe87fff700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a71b0 0x7efe8809f650 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe800147f0 con 0x7efe880a71b0 2020-02-11T16:24:56.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe87fff700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a71b0 0x7efe8809f650 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe87fff700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a71b0 0x7efe8809f650 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe80005c30 con 0x7efe880a71b0 2020-02-11T16:24:56.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe8de7f700 1 -- 172.21.15.88:0/456736109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8812ec70 con 0x7efe880a71b0 2020-02-11T16:24:56.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe80005e20 con 0x7efe880a71b0 2020-02-11T16:24:56.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe8de7f700 1 -- 172.21.15.88:0/456736109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe881371f0 con 0x7efe880a71b0 2020-02-11T16:24:56.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.967+0000 7efe87fff700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a71b0 0x7efe8809f650 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe8de7f700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 0x7efe88131cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:56.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe8de7f700 1 -- 172.21.15.88:0/456736109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8805e2f0 con 0x7efe8809fe30 2020-02-11T16:24:56.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7efe80010680 con 0x7efe880a71b0 2020-02-11T16:24:56.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 0x7efe88131cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:56.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe87fff700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a71b0 0x7efe8809f650 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe857fa700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe6c039ab0 0x7efe6c03bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:56.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7efe800100c0 con 0x7efe880a71b0 2020-02-11T16:24:56.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe877fe700 1 -- 172.21.15.88:0/456736109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe880565b0 con 0x7efe8809fe30 2020-02-11T16:24:56.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 0x7efe88131cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe7ffff700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe6c039ab0 0x7efe6c03bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:56.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 0x7efe88131cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 0x7efe88131cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:56.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 0x7efe88131cc0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe78007530 con 0x7efe8809fe30 2020-02-11T16:24:56.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.968+0000 7efe7ffff700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe6c039ab0 0x7efe6c03bf70 crc :-1 s=READY pgs=443 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:56.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.969+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 0x7efe88131cc0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.969+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7efe7800aed0 con 0x7efe8809fe30 2020-02-11T16:24:56.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.969+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 msgr2=0x7efe88131cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.969+0000 7efe857fa700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 0x7efe88131cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).stop 2020-02-11T16:24:56.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.969+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 msgr2=0x7efe88131cc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:56.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.969+0000 7efe857fa700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8809fe30 0x7efe88131cc0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).stop 2020-02-11T16:24:56.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.980+0000 7efe8de7f700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 0x7efe88132500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:56.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.980+0000 7efe8de7f700 1 -- 172.21.15.88:0/456736109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8812ee00 con 0x7efe88132120 2020-02-11T16:24:56.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.980+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 0x7efe88132500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:56.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.980+0000 7efe877fe700 1 -- 172.21.15.88:0/456736109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efe8805baa0 con 0x7efe88132120 2020-02-11T16:24:56.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.980+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 0x7efe88132500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 0x7efe88132500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 0x7efe88132500 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:56.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 0x7efe88132500 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe78012ce0 con 0x7efe88132120 2020-02-11T16:24:56.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe877fe700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 0x7efe88132500 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:56.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7efe7800a0a0 con 0x7efe88132120 2020-02-11T16:24:56.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 msgr2=0x7efe88132500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe857fa700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 0x7efe88132500 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7efe880a04c0 tx=0x7efe78010b40).stop 2020-02-11T16:24:56.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe857fa700 1 -- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 msgr2=0x7efe88132500 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:56.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe857fa700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe88132120 0x7efe88132500 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:56.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe8de7f700 1 -- 172.21.15.88:0/456736109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe6c039ab0 msgr2=0x7efe6c03bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe8de7f700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efe6c039ab0 0x7efe6c03bf70 crc :-1 s=READY pgs=443 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:56.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe8de7f700 1 -- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a71b0 msgr2=0x7efe8809f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:56.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe8de7f700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a71b0 0x7efe8809f650 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7efe800032b0 tx=0x7efe80007dc0).stop 2020-02-11T16:24:56.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe87fff700 1 -- 172.21.15.88:0/456736109 reap_dead start 2020-02-11T16:24:56.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe87fff700 1 -- 172.21.15.88:0/456736109 reap_dead start 2020-02-11T16:24:56.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe8de7f700 1 -- 172.21.15.88:0/456736109 shutdown_connections 2020-02-11T16:24:56.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe8de7f700 1 --2- 172.21.15.88:0/456736109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe880a71b0 0x7efe8809f650 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:56.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe8de7f700 1 -- 172.21.15.88:0/456736109 >> 172.21.15.88:0/456736109 conn(0x7efe8809d110 msgr2=0x7efe88134760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:56.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe8de7f700 1 -- 172.21.15.88:0/456736109 shutdown_connections 2020-02-11T16:24:56.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:56.981+0000 7efe8de7f700 1 -- 172.21.15.88:0/456736109 wait complete. 2020-02-11T16:24:56.988 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:56.989 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:56.989 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:56.989 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:24:56.989 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 156, 2020-02-11T16:24:56.989 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:56.989 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:56.989 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:24:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:24:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:56.991 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:56.991 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:56.991 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:56.991 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:56.991 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:56.991 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:56.991 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:56.992 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:56.992 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:56.992 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:56.992 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:56.992 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:56.992 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:56.992 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:56.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:56.993 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:56.993 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:56.993 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:56.993 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:56.993 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:56.993 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:56.994 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:56.994 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:56.994 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:56.994 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:56.994 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:56.994 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:56.994 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:56.994 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:56.995 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:56.995 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:56.995 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:56.995 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:56.995 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:56.995 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:56.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:56.996 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:56.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:56.996 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:56.996 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:56.996 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:56.996 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:56.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:56.996 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:56.997 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:56.997 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:56.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:56.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:56.997 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:56.998 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:56.998 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:56.998 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:56.998 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:56.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:56.998 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:56.998 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:56.998 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:56.999 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:56.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:56.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:56.999 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:56.999 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:56.999 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:56.999 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:56.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.000 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:57.000 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:57.000 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.000 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:57.000 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:57.001 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.001 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.001 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.001 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:57.001 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:57.002 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:57.002 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:57.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.002 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:57.002 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:57.002 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:57.002 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:57.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.003 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:57.003 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:57.003 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.003 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:57.004 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:57.004 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.004 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.004 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.004 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:57.004 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:57.005 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:57.005 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:57.005 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.005 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.005 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:57.005 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:57.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.006 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:57.006 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:57.006 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:57.006 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.006 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.007 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:57.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.007 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:57.007 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:57.007 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:57.007 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.007 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.008 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.008 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:57.009 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:24:57.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.126+0000 7f11f510d700 1 Processor -- start 2020-02-11T16:24:57.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.126+0000 7f11f510d700 1 -- start start 2020-02-11T16:24:57.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11f510d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f11f0137cf0 0x7f11f00a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:57.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11f510d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:57.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11f510d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f01382e0 con 0x7f11f005c1f0 2020-02-11T16:24:57.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11f510d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f0138580 con 0x7f11f0137cf0 2020-02-11T16:24:57.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11f510d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f0138820 con 0x7f11f0134e30 2020-02-11T16:24:57.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11ef59e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11ef59e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:53182/0 (socket says 172.21.15.88:53182) 2020-02-11T16:24:57.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11ee59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f11f0137cf0 0x7f11f00a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11ef59e700 1 -- 172.21.15.88:0/2393831423 learned_addr learned my addr 172.21.15.88:0/2393831423 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:57.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11ef59e700 1 -- 172.21.15.88:0/2393831423 >> v2:172.21.15.52:3300/0 conn(0x7f11f0137cf0 msgr2=0x7f11f00a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:57.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2393831423 >> v2:172.21.15.52:3300/0 conn(0x7f11f0137cf0 0x7f11f00a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:57.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11ef59e700 1 -- 172.21.15.88:0/2393831423 >> v1:172.21.15.52:6789/0 conn(0x7f11f005c1f0 legacy=0x7f11f00a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.127+0000 7f11ef59e700 1 -- 172.21.15.88:0/2393831423 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0135720 con 0x7f11f0134e30 2020-02-11T16:24:57.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2393831423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f11e80032b0 tx=0x7f11e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2393831423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f11e80032b0 tx=0x7f11e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2393831423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f11e80032b0 tx=0x7f11e8008c60).ready entity=mon.2 client_cookie=f5a0923d2b438c5e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2393831423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f11e80032b0 tx=0x7f11e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11edd9b700 1 -- 172.21.15.88:0/2393831423 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11e800a160 con 0x7f11f0134e30 2020-02-11T16:24:57.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2393831423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f11e80032b0 tx=0x7f11e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11edd9b700 1 -- 172.21.15.88:0/2393831423 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e800a2c0 con 0x7f11f0134e30 2020-02-11T16:24:57.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2393831423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f11e80032b0 tx=0x7f11e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11f510d700 1 -- 172.21.15.88:0/2393831423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 msgr2=0x7f11f01352c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11f510d700 1 --2- 172.21.15.88:0/2393831423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f11e80032b0 tx=0x7f11e8008c60).stop 2020-02-11T16:24:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11edd9b700 1 -- 172.21.15.88:0/2393831423 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11e800a6a0 con 0x7f11f0134e30 2020-02-11T16:24:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11f510d700 1 -- 172.21.15.88:0/2393831423 shutdown_connections 2020-02-11T16:24:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11f510d700 1 --2- 172.21.15.88:0/2393831423 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0134e30 0x7f11f01352c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11f510d700 1 --2- 172.21.15.88:0/2393831423 >> v2:172.21.15.52:3300/0 conn(0x7f11f0137cf0 0x7f11f00a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11f510d700 1 -- 172.21.15.88:0/2393831423 >> 172.21.15.88:0/2393831423 conn(0x7f11f00ab400 msgr2=0x7f11f00a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:57.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11f510d700 1 -- 172.21.15.88:0/2393831423 shutdown_connections 2020-02-11T16:24:57.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.128+0000 7f11f510d700 1 -- 172.21.15.88:0/2393831423 wait complete. 2020-02-11T16:24:57.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.129+0000 7f11f510d700 1 Processor -- start 2020-02-11T16:24:57.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.129+0000 7f11f510d700 1 -- start start 2020-02-11T16:24:57.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.130+0000 7f11f510d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11f0134e30 0x7f11f0132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.130+0000 7f11f510d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0137cf0 0x7f11f012ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.130+0000 7f11f510d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f013adf0 con 0x7f11f005c1f0 2020-02-11T16:24:57.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.130+0000 7f11f510d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f013a770 con 0x7f11f0134e30 2020-02-11T16:24:57.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.130+0000 7f11f510d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f013a000 con 0x7f11f0137cf0 2020-02-11T16:24:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.130+0000 7f11ee59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11f0134e30 0x7f11f0132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.130+0000 7f11ee59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11f0134e30 0x7f11f0132bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58862/0 (socket says 172.21.15.88:58862) 2020-02-11T16:24:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.130+0000 7f11ee59c700 1 -- 172.21.15.88:0/2936195605 learned_addr learned my addr 172.21.15.88:0/2936195605 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.130+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0137cf0 0x7f11f012ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136202331 0 0) 0x7f11f013adf0 con 0x7f11f005c1f0 2020-02-11T16:24:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ee59c700 1 -- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0137cf0 msgr2=0x7f11f012ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ee59c700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0137cf0 0x7f11f012ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ee59c700 1 -- 172.21.15.88:0/2936195605 >> v1:172.21.15.52:6789/0 conn(0x7f11f005c1f0 legacy=0x7f11f013b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ee59c700 1 -- 172.21.15.88:0/2936195605 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0138f60 con 0x7f11f0134e30 2020-02-11T16:24:57.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11f0137cf0 0x7f11f012ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:57.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ee59c700 1 --2- 172.21.15.88:0/2936195605 >> v2:172.21.15.88:3300/0 conn(0x7f11f0134e30 0x7f11f0132bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11e4003070 tx=0x7f11e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ee59c700 1 --2- 172.21.15.88:0/2936195605 >> v2:172.21.15.88:3300/0 conn(0x7f11f0134e30 0x7f11f0132bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11e4003070 tx=0x7f11e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ee59c700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11f0134e30 0x7f11f0132bd0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f11e4003070 tx=0x7f11e4010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ee59c700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11f0134e30 0x7f11f0132bd0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f11e4003070 tx=0x7f11e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11e4005e90 con 0x7f11f0134e30 2020-02-11T16:24:57.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ee59c700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11f0134e30 0x7f11f0132bd0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f11e4003070 tx=0x7f11e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11ee59c700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11f0134e30 0x7f11f0132bd0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f11e4003070 tx=0x7f11e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e4007160 con 0x7f11f0134e30 2020-02-11T16:24:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11e4007540 con 0x7f11f0134e30 2020-02-11T16:24:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11f510d700 1 -- 172.21.15.88:0/2936195605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f0139200 con 0x7f11f0134e30 2020-02-11T16:24:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.131+0000 7f11f510d700 1 -- 172.21.15.88:0/2936195605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f0133030 con 0x7f11f0134e30 2020-02-11T16:24:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.132+0000 7f11ee59c700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11f0134e30 0x7f11f0132bd0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f11e4003070 tx=0x7f11e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.132+0000 7f11f510d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 0x7f11f00a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.132+0000 7f11f510d700 1 -- 172.21.15.88:0/2936195605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f005c630 con 0x7f11f012f0d0 2020-02-11T16:24:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.132+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f11e4012400 con 0x7f11f0134e30 2020-02-11T16:24:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.132+0000 7f11ee59c700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11f0134e30 0x7f11f0132bd0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f11e4003070 tx=0x7f11e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.132+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 0x7f11f00a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.132+0000 7f11dffff700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f11cc039be0 0x7f11cc03c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.132+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f11e4049fb0 con 0x7f11f0134e30 2020-02-11T16:24:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.132+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f11cc039be0 0x7f11cc03c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11eed9d700 1 -- 172.21.15.88:0/2936195605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11f0139400 con 0x7f11f012f0d0 2020-02-11T16:24:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 0x7f11f00a5d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11ef59e700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f11cc039be0 0x7f11cc03c0a0 crc :-1 s=READY pgs=444 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 0x7f11f00a5d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 0x7f11f00a5d10 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 0x7f11f00a5d10 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11e000ccc0 con 0x7f11f012f0d0 2020-02-11T16:24:57.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 0x7f11f00a5d10 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f11e000ce20 con 0x7f11f012f0d0 2020-02-11T16:24:57.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 msgr2=0x7f11f00a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11dffff700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 0x7f11f00a5d10 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).stop 2020-02-11T16:24:57.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 msgr2=0x7f11f00a5d10 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:57.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.133+0000 7f11dffff700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f012f0d0 0x7f11f00a5d10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.143+0000 7f11f510d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 0x7f11f005af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.143+0000 7f11f510d700 1 -- 172.21.15.88:0/2936195605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f013ac30 con 0x7f11f005ab20 2020-02-11T16:24:57.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.144+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 0x7f11f005af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.144+0000 7f11eed9d700 1 -- 172.21.15.88:0/2936195605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f11f013b930 con 0x7f11f005ab20 2020-02-11T16:24:57.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.144+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 0x7f11f005af30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.144+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 0x7f11f005af30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.144+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 0x7f11f005af30 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.144+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 0x7f11f005af30 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.144+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11e000ee20 con 0x7f11f005ab20 2020-02-11T16:24:57.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11eed9d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 0x7f11f005af30 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4023 (secure 0 0 0) 0x7f11e0014070 con 0x7f11f005ab20 2020-02-11T16:24:57.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 msgr2=0x7f11f005af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11dffff700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 0x7f11f005af30 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).stop 2020-02-11T16:24:57.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11dffff700 1 -- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 msgr2=0x7f11f005af30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:57.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11dffff700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11f005ab20 0x7f11f005af30 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0x7f11e0002170 tx=0x7f11e0002e70).stop 2020-02-11T16:24:57.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11f510d700 1 -- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f11cc039be0 msgr2=0x7f11cc03c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11f510d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f11cc039be0 0x7f11cc03c0a0 crc :-1 s=READY pgs=444 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11f510d700 1 -- 172.21.15.88:0/2936195605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11f0134e30 msgr2=0x7f11f0132bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11f510d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11f0134e30 0x7f11f0132bd0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f11e4003070 tx=0x7f11e4010cd0).stop 2020-02-11T16:24:57.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11ef59e700 1 -- 172.21.15.88:0/2936195605 reap_dead start 2020-02-11T16:24:57.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11ef59e700 1 -- 172.21.15.88:0/2936195605 reap_dead start 2020-02-11T16:24:57.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11f510d700 1 -- 172.21.15.88:0/2936195605 shutdown_connections 2020-02-11T16:24:57.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11f510d700 1 --2- 172.21.15.88:0/2936195605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11f0134e30 0x7f11f0132bd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11f510d700 1 -- 172.21.15.88:0/2936195605 >> 172.21.15.88:0/2936195605 conn(0x7f11f00ab400 msgr2=0x7f11f0130ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:57.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11f510d700 1 -- 172.21.15.88:0/2936195605 shutdown_connections 2020-02-11T16:24:57.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.145+0000 7f11f510d700 1 -- 172.21.15.88:0/2936195605 wait complete. 2020-02-11T16:24:57.152 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:57.153 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:57.153 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:57.153 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:24:57.153 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 156, 2020-02-11T16:24:57.153 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:57.153 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:57.154 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:24:57.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:57.154 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.154 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:24:57.154 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:57.154 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:57.154 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:57.154 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:57.155 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:57.155 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:57.155 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:57.155 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:57.155 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:57.155 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.156 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:57.156 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:57.156 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:57.156 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:57.156 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:57.156 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:57.156 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:57.156 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:57.157 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.157 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:57.157 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:57.157 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:57.157 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:57.157 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:57.158 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:57.158 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:57.158 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:57.158 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:57.158 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:57.158 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:57.159 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:57.159 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:57.159 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:57.159 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:57.159 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:57.159 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:57.159 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:57.159 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.160 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:57.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.160 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:57.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.160 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:57.160 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:57.160 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:57.161 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:57.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.161 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:57.161 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:57.161 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.162 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:57.162 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:57.162 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.162 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.162 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:57.163 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:57.163 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:57.163 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:57.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.163 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:57.163 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:57.164 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:57.164 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:57.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.164 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:57.164 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:57.164 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.165 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:57.165 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:57.165 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.165 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.165 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.166 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:57.166 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:57.166 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:57.166 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:57.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.167 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:57.167 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:57.167 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:57.167 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:57.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.167 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:57.167 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:57.168 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.168 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:57.168 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:57.168 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.168 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.169 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.169 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:57.169 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:57.169 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:57.169 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:57.169 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.170 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.170 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:57.170 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:57.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.170 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:57.170 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:57.171 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:57.171 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.171 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.171 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:24:57.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.171 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:57.171 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:57.172 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:24:57.172 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.172 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.172 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:57.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.172 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:57.172 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:57.173 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:24:57.173 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.173 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.173 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.173 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:57.174 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:24:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.293+0000 7f270c990700 1 Processor -- start 2020-02-11T16:24:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.293+0000 7f270c990700 1 -- start start 2020-02-11T16:24:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f270c990700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27080a3a90 0x7f27080a8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f270c990700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27080a7c00 0x7f27080a8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f270c990700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080a4af0 con 0x7f2708136040 2020-02-11T16:24:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f270c990700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27081302a0 con 0x7f27080a3a90 2020-02-11T16:24:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f270c990700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2708135a20 con 0x7f27080a7c00 2020-02-11T16:24:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2706d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2708136040 0x7f2708138fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46502/0 (socket says 172.21.15.88:46502) 2020-02-11T16:24:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2706d9d700 1 -- 172.21.15.88:0/1547561637 learned_addr learned my addr 172.21.15.88:0/1547561637 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f270659c700 1 --2- 172.21.15.88:0/1547561637 >> v2:172.21.15.52:3300/0 conn(0x7f27080a3a90 0x7f27080a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f26fffff700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27080a7c00 0x7f27080a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539815474 0 0) 0x7f27080a4af0 con 0x7f2708136040 2020-02-11T16:24:57.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26ec003230 con 0x7f2708136040 2020-02-11T16:24:57.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1362650241 0 0) 0x7f26ec003230 con 0x7f2708136040 2020-02-11T16:24:57.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27080a7c00 msgr2=0x7f27080a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:57.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27080a7c00 0x7f27080a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:57.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 >> v2:172.21.15.52:3300/0 conn(0x7f27080a3a90 msgr2=0x7f27080a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 --2- 172.21.15.88:0/1547561637 >> v2:172.21.15.52:3300/0 conn(0x7f27080a3a90 0x7f27080a8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080a4d90 con 0x7f2708136040 2020-02-11T16:24:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f2700001a50 con 0x7f2708136040 2020-02-11T16:24:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 >> v1:172.21.15.88:6789/0 conn(0x7f2708136040 legacy=0x7f2708138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26ec003720 0x7f26ec003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ec004010 0x7f26ec0044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec004a60 0x7f26ec004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:57.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27081302a0 con 0x7f26ec004010 2020-02-11T16:24:57.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec00b810 con 0x7f26ec004a60 2020-02-11T16:24:57.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec00b9d0 con 0x7f26ec003720 2020-02-11T16:24:57.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f26fffff700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27080a7c00 0x7f27080a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:57.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.294+0000 7f270659c700 1 --2- 172.21.15.88:0/1547561637 >> v2:172.21.15.52:3300/0 conn(0x7f27080a3a90 0x7f27080a8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:24:57.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec004a60 0x7f26ec004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f270659c700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26ec003720 0x7f26ec003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f26fffff700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ec004010 0x7f26ec0044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 -- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26ec003720 msgr2=0x7f26ec003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:57.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26ec003720 0x7f26ec003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:57.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 -- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ec004010 msgr2=0x7f26ec0044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:57.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ec004010 0x7f26ec0044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:57.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 -- 172.21.15.88:0/1547561637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec003230 con 0x7f26ec004a60 2020-02-11T16:24:57.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec004a60 0x7f26ec004ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2700001760 tx=0x7f2708062740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec004a60 0x7f26ec004ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2700001760 tx=0x7f2708062740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec004a60 0x7f26ec004ee0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f2700001760 tx=0x7f2708062740).ready entity=mon.1 client_cookie=7e7ea9e9e191a5a3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec004a60 0x7f26ec004ee0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f2700001760 tx=0x7f2708062740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2700005d40 con 0x7f26ec004a60 2020-02-11T16:24:57.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec004a60 0x7f26ec004ee0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f2700001760 tx=0x7f2708062740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec004a60 0x7f26ec004ee0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f2700001760 tx=0x7f2708062740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270000e160 con 0x7f26ec004a60 2020-02-11T16:24:57.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2705d9b700 1 -- 172.21.15.88:0/1547561637 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2700005ea0 con 0x7f26ec004a60 2020-02-11T16:24:57.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f270c990700 1 -- 172.21.15.88:0/1547561637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec004a60 msgr2=0x7f26ec004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f270c990700 1 --2- 172.21.15.88:0/1547561637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec004a60 0x7f26ec004ee0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f2700001760 tx=0x7f2708062740).stop 2020-02-11T16:24:57.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.295+0000 7f2706d9d700 1 -- 172.21.15.88:0/1547561637 reap_dead start 2020-02-11T16:24:57.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.296+0000 7f270c990700 1 -- 172.21.15.88:0/1547561637 shutdown_connections 2020-02-11T16:24:57.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.296+0000 7f270c990700 1 -- 172.21.15.88:0/1547561637 >> 172.21.15.88:0/1547561637 conn(0x7f27080ac2d0 msgr2=0x7f27080ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:57.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.296+0000 7f270c990700 1 -- 172.21.15.88:0/1547561637 shutdown_connections 2020-02-11T16:24:57.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.296+0000 7f270c990700 1 -- 172.21.15.88:0/1547561637 wait complete. 2020-02-11T16:24:57.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f270c990700 1 Processor -- start 2020-02-11T16:24:57.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f270c990700 1 -- start start 2020-02-11T16:24:57.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f270c990700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2708145b20 0x7f2708151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f270c990700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270805f210 con 0x7f27081352c0 2020-02-11T16:24:57.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f270c990700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080a2f60 con 0x7f2708145670 2020-02-11T16:24:57.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f270c990700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2708060440 con 0x7f2708145b20 2020-02-11T16:24:57.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f26fffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2708145670 0x7f270814da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46512/0 (socket says 172.21.15.88:46512) 2020-02-11T16:24:57.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f26fffff700 1 -- 172.21.15.88:0/3262433253 learned_addr learned my addr 172.21.15.88:0/3262433253 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:24:57.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384816343 0 0) 0x7f27080a2f60 con 0x7f2708145670 2020-02-11T16:24:57.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e0002fe0 con 0x7f2708145670 2020-02-11T16:24:57.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.297+0000 7f2706d9d700 1 --2- 172.21.15.88:0/3262433253 >> v2:172.21.15.52:3300/0 conn(0x7f2708145b20 0x7f2708151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2959668587 0 0) 0x7f26e0002fe0 con 0x7f2708145670 2020-02-11T16:24:57.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f27080a2f60 con 0x7f2708145670 2020-02-11T16:24:57.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f26f00012a0 con 0x7f2708145670 2020-02-11T16:24:57.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 >> v2:172.21.15.52:3300/0 conn(0x7f2708145b20 msgr2=0x7f2708151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 --2- 172.21.15.88:0/3262433253 >> v2:172.21.15.52:3300/0 conn(0x7f2708145b20 0x7f2708151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 >> v1:172.21.15.88:6789/0 conn(0x7f2708145670 legacy=0x7f270814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 >> v1:172.21.15.52:6789/0 conn(0x7f27081352c0 legacy=0x7f270805f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00049b0 0x7f26e0004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00041e0 0x7f26e000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708060440 con 0x7f26e00041e0 2020-02-11T16:24:57.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00047f0 con 0x7f26e0003920 2020-02-11T16:24:57.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e000bc00 con 0x7f26e00049b0 2020-02-11T16:24:57.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00049b0 0x7f26e0004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f2706d9d700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00041e0 0x7f26e000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26fffff700 1 -- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00049b0 msgr2=0x7f26e0004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00049b0 0x7f26e0004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26fffff700 1 -- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00041e0 msgr2=0x7f26e000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00041e0 0x7f26e000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26fffff700 1 -- 172.21.15.88:0/3262433253 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270805f470 con 0x7f26e0003920 2020-02-11T16:24:57.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f2706d9d700 1 -- 172.21.15.88:0/3262433253 reap_dead start 2020-02-11T16:24:57.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f270c990700 1 -- 172.21.15.88:0/3262433253 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27080a6c70 con 0x7f26e0003920 2020-02-11T16:24:57.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26f000f4c0 tx=0x7f26f0011670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f270c990700 1 -- 172.21.15.88:0/3262433253 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2708145f90 con 0x7f26e0003920 2020-02-11T16:24:57.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26f000f4c0 tx=0x7f26f0011670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.298+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f26f000f4c0 tx=0x7f26f0011670).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f26f000f4c0 tx=0x7f26f0011670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f26f000f4c0 tx=0x7f26f0011670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f0007350 con 0x7f26e0003920 2020-02-11T16:24:57.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f26f000f4c0 tx=0x7f26f0011670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f00074b0 con 0x7f26e0003920 2020-02-11T16:24:57.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f0005bb0 con 0x7f26e0003920 2020-02-11T16:24:57.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f26f000f4c0 tx=0x7f26f0011670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f270c990700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 0x7f270805f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f270c990700 1 -- 172.21.15.88:0/3262433253 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270805e2f0 con 0x7f270812f8b0 2020-02-11T16:24:57.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f26f0005d10 con 0x7f26e0003920 2020-02-11T16:24:57.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f26fffff700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f26f000f4c0 tx=0x7f26f0011670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.299+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 0x7f270805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f26ff7fe700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f26e003d5d0 0x7f26e003fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f26f004a4c0 con 0x7f26e0003920 2020-02-11T16:24:57.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f270659c700 1 -- 172.21.15.88:0/3262433253 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2708145280 con 0x7f270812f8b0 2020-02-11T16:24:57.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f2706d9d700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f26e003d5d0 0x7f26e003fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 0x7f270805f670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 0x7f270805f670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 0x7f270805f670 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f2706d9d700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f26e003d5d0 0x7f26e003fa90 crc :-1 s=READY pgs=445 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 0x7f270805f670 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f8005e90 con 0x7f270812f8b0 2020-02-11T16:24:57.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 0x7f270805f670 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f26f8007160 con 0x7f270812f8b0 2020-02-11T16:24:57.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 msgr2=0x7f270805f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f26ff7fe700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 0x7f270805f670 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).stop 2020-02-11T16:24:57.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 msgr2=0x7f270805f670 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:57.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.300+0000 7f26ff7fe700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 0x7f270805f670 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).stop 2020-02-11T16:24:57.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.313+0000 7f270c990700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 0x7f270805fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.313+0000 7f270c990700 1 -- 172.21.15.88:0/3262433253 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27080565b0 con 0x7f270812fc90 2020-02-11T16:24:57.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 0x7f270805fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f270659c700 1 -- 172.21.15.88:0/3262433253 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2708060580 con 0x7f270812fc90 2020-02-11T16:24:57.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 0x7f270805fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 0x7f270805fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 0x7f270805fad0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 0x7f270805fad0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f800a660 con 0x7f270812fc90 2020-02-11T16:24:57.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f270659c700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 0x7f270805fad0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f26f800f1f0 con 0x7f270812fc90 2020-02-11T16:24:57.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 msgr2=0x7f270805fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f26ff7fe700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 0x7f270805fad0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).stop 2020-02-11T16:24:57.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f26ff7fe700 1 -- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 msgr2=0x7f270805fad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:24:57.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.314+0000 7f26ff7fe700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 0x7f270805fad0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0x7f27081341a0 tx=0x7f26f8010d80).stop 2020-02-11T16:24:57.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 -- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f26e003d5d0 msgr2=0x7f26e003fa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f26e003d5d0 0x7f26e003fa90 crc :-1 s=READY pgs=445 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 -- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 msgr2=0x7f26e0003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f26f000f4c0 tx=0x7f26f0011670).stop 2020-02-11T16:24:57.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 -- 172.21.15.88:0/3262433253 shutdown_connections 2020-02-11T16:24:57.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f26e003d5d0 0x7f26e003fa90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e0003920 0x7f26e0003d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812f8b0 0x7f270805f670 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 --2- 172.21.15.88:0/3262433253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f270812fc90 0x7f270805fad0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 -- 172.21.15.88:0/3262433253 >> 172.21.15.88:0/3262433253 conn(0x7f27080ac2d0 msgr2=0x7f2708069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:57.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 -- 172.21.15.88:0/3262433253 shutdown_connections 2020-02-11T16:24:57.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.315+0000 7f270c990700 1 -- 172.21.15.88:0/3262433253 wait complete. 2020-02-11T16:24:57.327 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:24:57.327 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:57.327 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:57.328 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:24:57.328 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 156, 2020-02-11T16:24:57.328 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:24:57.328 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:24:57.328 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:24:57.328 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:24:57.328 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.329 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:24:57.329 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:57.329 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:24:57.329 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:24:57.329 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:57.329 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:57.329 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:57.330 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:57.330 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:57.330 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:57.330 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.330 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:24:57.330 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:24:57.330 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:57.331 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:57.331 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:57.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:57.331 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:57.331 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:57.331 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.332 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:24:57.332 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:24:57.332 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:24:57.332 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:24:57.332 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:24:57.332 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:24:57.332 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:57.333 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:24:57.333 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:24:57.333 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:24:57.333 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:24:57.333 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:24:57.333 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:24:57.334 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:24:57.334 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:24:57.334 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:24:57.334 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:24:57.334 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:24:57.334 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.334 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:24:57.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.335 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:24:57.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.335 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:24:57.335 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:24:57.335 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:57.335 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:57.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.336 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:57.336 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:24:57.336 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.337 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:57.337 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:24:57.337 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.337 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.337 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.337 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:24:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:24:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:24:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:24:57.339 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:57.339 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:57.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.339 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:57.339 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:24:57.339 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.340 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:57.340 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:24:57.340 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.340 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.340 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.341 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:24:57.341 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:24:57.341 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:57.341 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:57.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.342 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:24:57.342 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:24:57.342 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:24:57.342 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:24:57.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.343 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:24:57.343 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:24:57.343 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.343 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:24:57.343 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:24:57.344 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:24:57.344 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.344 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.344 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:24:57.344 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:24:57.345 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:24:57.345 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:24:57.345 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.345 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:24:57.345 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:24:57.346 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:24:57.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.346 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:57.346 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:57.346 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:24:57.346 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.346 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.347 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:24:57.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.347 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:57.347 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:57.347 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:57.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.347 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.348 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:24:57.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.348 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:57.348 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:57.348 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:24:57.348 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.349 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.349 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:24:57.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.349 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:57.349 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:57.349 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:57.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.349 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:24:57.350 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:24:57.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:24:57.350 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:24:57.350 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:24:57.350 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:24:57.350 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.350 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:24:57.351 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:24:57.351 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:24:57.352 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2020-02-11T16:24:57.352 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:24:57.352 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2020-02-11T16:24:57.352 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:24:57.352 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-02-11T16:24:57.353 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:24:57.366 INFO:tasks.ceph.mon.c:Stopped 2020-02-11T16:24:57.366 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:24:57.367 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:24:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.483+0000 7fc551eea700 1 Processor -- start 2020-02-11T16:24:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.483+0000 7fc551eea700 1 -- start start 2020-02-11T16:24:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc551eea700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc54c0a5490 0x7fc54c065c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc551eea700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc54c05b270 0x7fc54c13b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc551eea700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c13b7f0 0x7fc54c13bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:24:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc551eea700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c0a6560 con 0x7fc54c0a5490 2020-02-11T16:24:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc551eea700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c0a6800 con 0x7fc54c05b270 2020-02-11T16:24:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc551eea700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c09ad80 con 0x7fc54c13b7f0 2020-02-11T16:24:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc54c05b270 0x7fc54c13b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc5516e9700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c13b7f0 msgr2=0x7fc54c13bca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:24:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc54c05b270 0x7fc54c13b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58946/0 (socket says 172.21.15.88:58946) 2020-02-11T16:24:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 -- 172.21.15.88:0/1069525059 learned_addr learned my addr 172.21.15.88:0/1069525059 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc5516e9700 1 --2- 172.21.15.88:0/1069525059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c13b7f0 0x7fc54c13bca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc550ee8700 1 --2- 172.21.15.88:0/1069525059 >> v2:172.21.15.52:3300/0 conn(0x7fc54c0a5490 0x7fc54c065c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 -- 172.21.15.88:0/1069525059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c13b7f0 msgr2=0x7fc54c13bca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:24:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1069525059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c13b7f0 0x7fc54c13bca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 -- 172.21.15.88:0/1069525059 >> v2:172.21.15.52:3300/0 conn(0x7fc54c0a5490 msgr2=0x7fc54c065c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:24:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1069525059 >> v2:172.21.15.52:3300/0 conn(0x7fc54c0a5490 0x7fc54c065c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 -- 172.21.15.88:0/1069525059 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c13c100 con 0x7fc54c05b270 2020-02-11T16:24:57.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1069525059 >> v2:172.21.15.88:3300/0 conn(0x7fc54c05b270 0x7fc54c13b390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1069525059 >> v2:172.21.15.88:3300/0 conn(0x7fc54c05b270 0x7fc54c13b390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1069525059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c05b270 0x7fc54c13b390 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).ready entity=mon.1 client_cookie=f8df17d619b33746 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1069525059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c05b270 0x7fc54c13b390 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.484+0000 7fc54b7fe700 1 -- 172.21.15.88:0/1069525059 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc538008e20 con 0x7fc54c05b270 2020-02-11T16:24:57.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1069525059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c05b270 0x7fc54c13b390 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.494 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc54b7fe700 1 -- 172.21.15.88:0/1069525059 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc538011860 con 0x7fc54c05b270 2020-02-11T16:24:57.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1069525059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c05b270 0x7fc54c13b390 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc54b7fe700 1 -- 172.21.15.88:0/1069525059 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc538011c40 con 0x7fc54c05b270 2020-02-11T16:24:57.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc551eea700 1 -- 172.21.15.88:0/1069525059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c05b270 msgr2=0x7fc54c13b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc551eea700 1 --2- 172.21.15.88:0/1069525059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c05b270 0x7fc54c13b390 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).stop 2020-02-11T16:24:57.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc551eea700 1 -- 172.21.15.88:0/1069525059 shutdown_connections 2020-02-11T16:24:57.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc551eea700 1 --2- 172.21.15.88:0/1069525059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c13b7f0 0x7fc54c13bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:57.495 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc551eea700 1 --2- 172.21.15.88:0/1069525059 >> v2:172.21.15.52:3300/0 conn(0x7fc54c0a5490 0x7fc54c065c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:24:57.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc551eea700 1 --2- 172.21.15.88:0/1069525059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c05b270 0x7fc54c13b390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc551eea700 1 -- 172.21.15.88:0/1069525059 >> 172.21.15.88:0/1069525059 conn(0x7fc54c0aa840 msgr2=0x7fc54c0aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:57.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc551eea700 1 -- 172.21.15.88:0/1069525059 shutdown_connections 2020-02-11T16:24:57.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.485+0000 7fc551eea700 1 -- 172.21.15.88:0/1069525059 wait complete. 2020-02-11T16:24:57.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.486+0000 7fc551eea700 1 Processor -- start 2020-02-11T16:24:57.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.486+0000 7fc551eea700 1 -- start start 2020-02-11T16:24:57.496 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc551eea700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c05b270 0x7fc54c148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc551eea700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc54c0a5490 0x7fc54c148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc551eea700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc54c13b7f0 0x7fc54c133380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc551eea700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c09f100 con 0x7fc54c13b7f0 2020-02-11T16:24:57.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc551eea700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c0a9ea0 con 0x7fc54c0a5490 2020-02-11T16:24:57.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc551eea700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c09e350 con 0x7fc54c05b270 2020-02-11T16:24:57.497 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc550ee8700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c05b270 msgr2=0x7fc54c148b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:24:57.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc550ee8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c05b270 0x7fc54c148b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:24:57.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc54c0a5490 0x7fc54c148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc54c0a5490 0x7fc54c148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58952/0 (socket says 172.21.15.88:58952) 2020-02-11T16:24:57.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 -- 172.21.15.88:0/1099768619 learned_addr learned my addr 172.21.15.88:0/1099768619 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:24:57.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc5516e9700 1 --2- 172.21.15.88:0/1099768619 >> v2:172.21.15.52:3300/0 conn(0x7fc54c13b7f0 0x7fc54c133380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.498 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 -- 172.21.15.88:0/1099768619 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c05b270 msgr2=0x7fc54c148b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:24:57.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c05b270 0x7fc54c148b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 -- 172.21.15.88:0/1099768619 >> v2:172.21.15.52:3300/0 conn(0x7fc54c13b7f0 msgr2=0x7fc54c133380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> v2:172.21.15.52:3300/0 conn(0x7fc54c13b7f0 0x7fc54c133380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 -- 172.21.15.88:0/1099768619 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c0a9960 con 0x7fc54c0a5490 2020-02-11T16:24:57.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc5516e9700 1 --2- 172.21.15.88:0/1099768619 >> v2:172.21.15.52:3300/0 conn(0x7fc54c13b7f0 0x7fc54c133380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:24:57.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> v2:172.21.15.88:3300/0 conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> v2:172.21.15.88:3300/0 conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.487+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.488+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.488+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.488+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.488+0000 7fc549ffb700 1 -- 172.21.15.88:0/1099768619 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc538011e70 con 0x7fc54c0a5490 2020-02-11T16:24:57.500 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.488+0000 7fc549ffb700 1 -- 172.21.15.88:0/1099768619 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc538008e20 con 0x7fc54c0a5490 2020-02-11T16:24:57.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.488+0000 7fc549ffb700 1 -- 172.21.15.88:0/1099768619 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc538007530 con 0x7fc54c0a5490 2020-02-11T16:24:57.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.488+0000 7fc551eea700 1 -- 172.21.15.88:0/1099768619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54c0a9c00 con 0x7fc54c0a5490 2020-02-11T16:24:57.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.488+0000 7fc551eea700 1 -- 172.21.15.88:0/1099768619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c1493c0 con 0x7fc54c0a5490 2020-02-11T16:24:57.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.488+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.489+0000 7fc549ffb700 1 -- 172.21.15.88:0/1099768619 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc5380056c0 con 0x7fc54c0a5490 2020-02-11T16:24:57.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.489+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.489+0000 7fc551eea700 1 -- 172.21.15.88:0/1099768619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c0a97a0 con 0x7fc54c0a5490 2020-02-11T16:24:57.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.489+0000 7fc549ffb700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc534039bf0 0x7fc53403c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:24:57.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.489+0000 7fc549ffb700 1 -- 172.21.15.88:0/1099768619 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc53804a1d0 con 0x7fc54c0a5490 2020-02-11T16:24:57.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.489+0000 7fc550ee8700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc534039bf0 0x7fc53403c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:24:57.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.490+0000 7fc550ee8700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc534039bf0 0x7fc53403c0b0 crc :-1 s=READY pgs=446 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:24:57.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.493+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.493+0000 7fc549ffb700 1 -- 172.21.15.88:0/1099768619 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc5380327c0 con 0x7fc54c0a5490 2020-02-11T16:24:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.714+0000 7fc551eea700 1 -- 172.21.15.88:0/1099768619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc54c0565b0 con 0x7fc54c0a5490 2020-02-11T16:24:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.714+0000 7fc54bfff700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:24:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.714+0000 7fc549ffb700 1 -- 172.21.15.88:0/1099768619 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fc538032380 con 0x7fc54c0a5490 2020-02-11T16:24:57.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 -- 172.21.15.88:0/1099768619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc534039bf0 msgr2=0x7fc53403c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc534039bf0 0x7fc53403c0b0 crc :-1 s=READY pgs=446 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 -- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 msgr2=0x7fc54c148f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:24:57.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 0x7fc54c148f60 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fc538002f30 tx=0x7fc538007a40).stop 2020-02-11T16:24:57.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 -- 172.21.15.88:0/1099768619 shutdown_connections 2020-02-11T16:24:57.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc534039bf0 0x7fc53403c0b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 --2- 172.21.15.88:0/1099768619 >> v2:172.21.15.52:3300/0 conn(0x7fc54c13b7f0 0x7fc54c133380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54c05b270 0x7fc54c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 --2- 172.21.15.88:0/1099768619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc54c0a5490 0x7fc54c148f60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:24:57.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 -- 172.21.15.88:0/1099768619 >> 172.21.15.88:0/1099768619 conn(0x7fc54c0aa840 msgr2=0x7fc54c0a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:24:57.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 -- 172.21.15.88:0/1099768619 shutdown_connections 2020-02-11T16:24:57.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:24:57.716+0000 7fc551eea700 1 -- 172.21.15.88:0/1099768619 wait complete. 2020-02-11T16:24:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:24:57.729 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":156,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:00.730 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:25:00.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.846+0000 7f3a56dce700 1 Processor -- start 2020-02-11T16:25:00.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.846+0000 7f3a56dce700 1 -- start start 2020-02-11T16:25:00.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.846+0000 7f3a56dce700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a5005c1f0 0x7f3a500a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:00.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.846+0000 7f3a56dce700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a5012d990 0x7f3a5012de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:00.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.846+0000 7f3a56dce700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a500a1e80 con 0x7f3a500a6fa0 2020-02-11T16:25:00.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a56dce700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500a25c0 con 0x7f3a5012d990 2020-02-11T16:25:00.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a56dce700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500a2120 con 0x7f3a5005c1f0 2020-02-11T16:25:00.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a5012d990 0x7f3a5012de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:00.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a4ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3a500a6fa0 0x7f3a500a2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46584/0 (socket says 172.21.15.88:46584) 2020-02-11T16:25:00.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a5012d990 0x7f3a5012de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58960/0 (socket says 172.21.15.88:58960) 2020-02-11T16:25:00.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a54b6a700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a5005c1f0 msgr2=0x7f3a500a43e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:25:00.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a4ffff700 1 -- 172.21.15.88:0/3150768580 learned_addr learned my addr 172.21.15.88:0/3150768580 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:00.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a54b6a700 1 --2- 172.21.15.88:0/3150768580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a5005c1f0 0x7f3a500a43e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:00.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 -- 172.21.15.88:0/3150768580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a5005c1f0 msgr2=0x7f3a500a43e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:25:00.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 --2- 172.21.15.88:0/3150768580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a5005c1f0 0x7f3a500a43e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:00.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 -- 172.21.15.88:0/3150768580 >> v1:172.21.15.88:6789/0 conn(0x7f3a500a6fa0 legacy=0x7f3a500a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:00.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 -- 172.21.15.88:0/3150768580 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500a2e90 con 0x7f3a5012d990 2020-02-11T16:25:00.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 --2- 172.21.15.88:0/3150768580 >> v2:172.21.15.88:3300/0 conn(0x7f3a5012d990 0x7f3a5012de10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a480032b0 tx=0x7f3a48008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 --2- 172.21.15.88:0/3150768580 >> v2:172.21.15.88:3300/0 conn(0x7f3a5012d990 0x7f3a5012de10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a480032b0 tx=0x7f3a48008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 --2- 172.21.15.88:0/3150768580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a5012de10 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f3a480032b0 tx=0x7f3a48008c60).ready entity=mon.1 client_cookie=c04e1e73902d3da2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:00.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 --2- 172.21.15.88:0/3150768580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a5012de10 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f3a480032b0 tx=0x7f3a48008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a4f7fe700 1 -- 172.21.15.88:0/3150768580 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a4800a160 con 0x7f3a5012d990 2020-02-11T16:25:00.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 --2- 172.21.15.88:0/3150768580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a5012de10 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f3a480032b0 tx=0x7f3a48008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a4f7fe700 1 -- 172.21.15.88:0/3150768580 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4800a2c0 con 0x7f3a5012d990 2020-02-11T16:25:00.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a5536b700 1 --2- 172.21.15.88:0/3150768580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a5012de10 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f3a480032b0 tx=0x7f3a48008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a4f7fe700 1 -- 172.21.15.88:0/3150768580 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a4800a6a0 con 0x7f3a5012d990 2020-02-11T16:25:00.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a56dce700 1 -- 172.21.15.88:0/3150768580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 msgr2=0x7f3a5012de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:00.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.847+0000 7f3a56dce700 1 --2- 172.21.15.88:0/3150768580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a5012de10 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f3a480032b0 tx=0x7f3a48008c60).stop 2020-02-11T16:25:00.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.848+0000 7f3a56dce700 1 -- 172.21.15.88:0/3150768580 shutdown_connections 2020-02-11T16:25:00.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.848+0000 7f3a56dce700 1 --2- 172.21.15.88:0/3150768580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a5012de10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:00.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.848+0000 7f3a56dce700 1 --2- 172.21.15.88:0/3150768580 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a5005c1f0 0x7f3a500a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:00.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.848+0000 7f3a56dce700 1 -- 172.21.15.88:0/3150768580 >> 172.21.15.88:0/3150768580 conn(0x7f3a500ab400 msgr2=0x7f3a500a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:00.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.848+0000 7f3a56dce700 1 -- 172.21.15.88:0/3150768580 shutdown_connections 2020-02-11T16:25:00.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.848+0000 7f3a56dce700 1 -- 172.21.15.88:0/3150768580 wait complete. 2020-02-11T16:25:00.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.849+0000 7f3a56dce700 1 Processor -- start 2020-02-11T16:25:00.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.849+0000 7f3a56dce700 1 -- start start 2020-02-11T16:25:00.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.850+0000 7f3a56dce700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a5012d990 0x7f3a50136f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:00.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.850+0000 7f3a56dce700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a50137e80 con 0x7f3a5005c1f0 2020-02-11T16:25:00.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.850+0000 7f3a56dce700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a50138180 con 0x7f3a500a6fa0 2020-02-11T16:25:00.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.850+0000 7f3a56dce700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a501352e0 con 0x7f3a5012d990 2020-02-11T16:25:00.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.850+0000 7f3a4ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3a500a6fa0 0x7f3a50149470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46590/0 (socket says 172.21.15.88:46590) 2020-02-11T16:25:00.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.850+0000 7f3a5536b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a5012d990 0x7f3a50136f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:00.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.850+0000 7f3a4ffff700 1 -- 172.21.15.88:0/1218455369 learned_addr learned my addr 172.21.15.88:0/1218455369 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:00.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.850+0000 7f3a5536b700 1 -- 172.21.15.88:0/1218455369 >> v1:172.21.15.88:6789/0 conn(0x7f3a500a6fa0 legacy=0x7f3a50149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:00.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.850+0000 7f3a5536b700 1 -- 172.21.15.88:0/1218455369 >> v1:172.21.15.52:6789/0 conn(0x7f3a5005c1f0 legacy=0x7f3a50136810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:00.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.850+0000 7f3a5536b700 1 -- 172.21.15.88:0/1218455369 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50140d00 con 0x7f3a5012d990 2020-02-11T16:25:00.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a5536b700 1 --2- 172.21.15.88:0/1218455369 >> v2:172.21.15.88:3300/0 conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a5536b700 1 --2- 172.21.15.88:0/1218455369 >> v2:172.21.15.88:3300/0 conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a5536b700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:00.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a5536b700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a4dffb700 1 -- 172.21.15.88:0/1218455369 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a48005c30 con 0x7f3a5012d990 2020-02-11T16:25:00.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a5536b700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a56dce700 1 -- 172.21.15.88:0/1218455369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a50141000 con 0x7f3a5012d990 2020-02-11T16:25:00.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a4dffb700 1 -- 172.21.15.88:0/1218455369 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a48005d90 con 0x7f3a5012d990 2020-02-11T16:25:00.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a5536b700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a4dffb700 1 -- 172.21.15.88:0/1218455369 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a4800f760 con 0x7f3a5012d990 2020-02-11T16:25:00.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a56dce700 1 -- 172.21.15.88:0/1218455369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a50134df0 con 0x7f3a5012d990 2020-02-11T16:25:00.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.851+0000 7f3a5536b700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.852+0000 7f3a4dffb700 1 -- 172.21.15.88:0/1218455369 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3a4800f9a0 con 0x7f3a5012d990 2020-02-11T16:25:00.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.852+0000 7f3a5536b700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.852+0000 7f3a4dffb700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a38039bf0 0x7f3a3803c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:00.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.852+0000 7f3a4dffb700 1 -- 172.21.15.88:0/1218455369 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3a4804aa90 con 0x7f3a5012d990 2020-02-11T16:25:00.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.852+0000 7f3a56dce700 1 -- 172.21.15.88:0/1218455369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a50141420 con 0x7f3a5012d990 2020-02-11T16:25:00.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.852+0000 7f3a54b6a700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a38039bf0 0x7f3a3803c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:00.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.852+0000 7f3a54b6a700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a38039bf0 0x7f3a3803c0b0 crc :-1 s=READY pgs=447 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:00.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.856+0000 7f3a5536b700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:00.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:00.856+0000 7f3a4dffb700 1 -- 172.21.15.88:0/1218455369 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3a50141420 con 0x7f3a5012d990 2020-02-11T16:25:01.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.079+0000 7f3a56dce700 1 -- 172.21.15.88:0/1218455369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3a50141420 con 0x7f3a5012d990 2020-02-11T16:25:01.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.079+0000 7f3a5536b700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:01.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.079+0000 7f3a4dffb700 1 -- 172.21.15.88:0/1218455369 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f3a50141420 con 0x7f3a5012d990 2020-02-11T16:25:01.081 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:01.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.081+0000 7f3a56dce700 1 -- 172.21.15.88:0/1218455369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a38039bf0 msgr2=0x7f3a3803c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:01.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.081+0000 7f3a56dce700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a38039bf0 0x7f3a3803c0b0 crc :-1 s=READY pgs=447 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:01.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.081+0000 7f3a56dce700 1 -- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 msgr2=0x7f3a50136f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:01.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.081+0000 7f3a56dce700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a50136f20 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f3a50133060 tx=0x7f3a500a3080).stop 2020-02-11T16:25:01.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.081+0000 7f3a56dce700 1 -- 172.21.15.88:0/1218455369 shutdown_connections 2020-02-11T16:25:01.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.081+0000 7f3a56dce700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3a38039bf0 0x7f3a3803c0b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:01.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.081+0000 7f3a56dce700 1 --2- 172.21.15.88:0/1218455369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a5012d990 0x7f3a50136f20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:01.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.081+0000 7f3a56dce700 1 -- 172.21.15.88:0/1218455369 >> 172.21.15.88:0/1218455369 conn(0x7f3a500ab400 msgr2=0x7f3a50069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:01.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.081+0000 7f3a56dce700 1 -- 172.21.15.88:0/1218455369 shutdown_connections 2020-02-11T16:25:01.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:01.081+0000 7f3a56dce700 1 -- 172.21.15.88:0/1218455369 wait complete. 2020-02-11T16:25:01.098 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":156,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:04.099 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:25:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.211+0000 7fcf6001d700 1 Processor -- start 2020-02-11T16:25:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf6001d700 1 -- start start 2020-02-11T16:25:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf6001d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 0x7fcf580a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf6001d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf58131280 0x7fcf58131710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf6001d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf580a4350 con 0x7fcf580a2fa0 2020-02-11T16:25:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf6001d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf580a1e60 con 0x7fcf58131280 2020-02-11T16:25:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf6001d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580a3450 con 0x7fcf580a5b20 2020-02-11T16:25:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf5e5ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf58131280 0x7fcf58131710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:04.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf5d5b8700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 msgr2=0x7fcf580a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:25:04.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf5d5b8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 0x7fcf580a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:04.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf5e5ba700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf58131280 0x7fcf58131710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58974/0 (socket says 172.21.15.88:58974) 2020-02-11T16:25:04.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.212+0000 7fcf5e5ba700 1 -- 172.21.15.88:0/1133856000 learned_addr learned my addr 172.21.15.88:0/1133856000 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:04.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5e5ba700 1 -- 172.21.15.88:0/1133856000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 msgr2=0x7fcf580a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:25:04.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/1133856000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 0x7fcf580a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:04.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5e5ba700 1 -- 172.21.15.88:0/1133856000 >> v1:172.21.15.88:6789/0 conn(0x7fcf580a2fa0 legacy=0x7fcf580a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:04.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5e5ba700 1 -- 172.21.15.88:0/1133856000 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580a3a40 con 0x7fcf58131280 2020-02-11T16:25:04.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/1133856000 >> v2:172.21.15.88:3300/0 conn(0x7fcf58131280 0x7fcf58131710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcf500032b0 tx=0x7fcf50008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/1133856000 >> v2:172.21.15.88:3300/0 conn(0x7fcf58131280 0x7fcf58131710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcf500032b0 tx=0x7fcf50008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.218 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/1133856000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf58131280 0x7fcf58131710 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf50008c60).ready entity=mon.1 client_cookie=278092673615b297 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:04.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/1133856000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf58131280 0x7fcf58131710 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf50008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/1133856000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf58131280 0x7fcf58131710 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf50008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5cdb7700 1 -- 172.21.15.88:0/1133856000 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5000a350 con 0x7fcf58131280 2020-02-11T16:25:04.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/1133856000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf58131280 0x7fcf58131710 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf50008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5cdb7700 1 -- 172.21.15.88:0/1133856000 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5000a4b0 con 0x7fcf58131280 2020-02-11T16:25:04.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf5cdb7700 1 -- 172.21.15.88:0/1133856000 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5000a890 con 0x7fcf58131280 2020-02-11T16:25:04.219 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf6001d700 1 -- 172.21.15.88:0/1133856000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf58131280 msgr2=0x7fcf58131710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:04.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf6001d700 1 --2- 172.21.15.88:0/1133856000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf58131280 0x7fcf58131710 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf50008c60).stop 2020-02-11T16:25:04.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf6001d700 1 -- 172.21.15.88:0/1133856000 shutdown_connections 2020-02-11T16:25:04.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf6001d700 1 --2- 172.21.15.88:0/1133856000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf58131280 0x7fcf58131710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:04.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf6001d700 1 --2- 172.21.15.88:0/1133856000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 0x7fcf580a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:04.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.213+0000 7fcf6001d700 1 -- 172.21.15.88:0/1133856000 >> 172.21.15.88:0/1133856000 conn(0x7fcf5809d110 msgr2=0x7fcf5809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:04.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.214+0000 7fcf6001d700 1 -- 172.21.15.88:0/1133856000 shutdown_connections 2020-02-11T16:25:04.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.214+0000 7fcf6001d700 1 -- 172.21.15.88:0/1133856000 wait complete. 2020-02-11T16:25:04.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.214+0000 7fcf6001d700 1 Processor -- start 2020-02-11T16:25:04.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.214+0000 7fcf6001d700 1 -- start start 2020-02-11T16:25:04.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.215+0000 7fcf6001d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 0x7fcf5812fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:04.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.215+0000 7fcf6001d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcf58131280 0x7fcf581302f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:04.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.215+0000 7fcf6001d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5809f430 con 0x7fcf580a2fa0 2020-02-11T16:25:04.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.215+0000 7fcf6001d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5809f8a0 con 0x7fcf58131280 2020-02-11T16:25:04.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.215+0000 7fcf6001d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580a0490 con 0x7fcf580a5b20 2020-02-11T16:25:04.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.215+0000 7fcf5ddb9700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcf580a2fa0 0x7fcf580a0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46602/0 (socket says 172.21.15.88:46602) 2020-02-11T16:25:04.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.215+0000 7fcf5ddb9700 1 -- 172.21.15.88:0/3059616558 learned_addr learned my addr 172.21.15.88:0/3059616558 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:04.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.215+0000 7fcf5d5b8700 1 -- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 msgr2=0x7fcf5812fe90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:25:04.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.215+0000 7fcf5d5b8700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 0x7fcf5812fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:04.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.215+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> v2:172.21.15.52:3300/0 conn(0x7fcf58131280 0x7fcf581302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:04.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf5e5ba700 1 -- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 msgr2=0x7fcf5812fe90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:25:04.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 0x7fcf5812fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:04.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf5e5ba700 1 -- 172.21.15.88:0/3059616558 >> v1:172.21.15.88:6789/0 conn(0x7fcf580a2fa0 legacy=0x7fcf580a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:04.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf5e5ba700 1 -- 172.21.15.88:0/3059616558 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf58130a40 con 0x7fcf58131280 2020-02-11T16:25:04.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> v2:172.21.15.52:3300/0 conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> v2:172.21.15.52:3300/0 conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:04.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf46ffd700 1 -- 172.21.15.88:0/3059616558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf50010660 con 0x7fcf58131280 2020-02-11T16:25:04.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf46ffd700 1 -- 172.21.15.88:0/3059616558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf50005c30 con 0x7fcf58131280 2020-02-11T16:25:04.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf6001d700 1 -- 172.21.15.88:0/3059616558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5809e2e0 con 0x7fcf58131280 2020-02-11T16:25:04.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf46ffd700 1 -- 172.21.15.88:0/3059616558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf50005e20 con 0x7fcf58131280 2020-02-11T16:25:04.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.216+0000 7fcf6001d700 1 -- 172.21.15.88:0/3059616558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf58135330 con 0x7fcf58131280 2020-02-11T16:25:04.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.217+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.217+0000 7fcf46ffd700 1 -- 172.21.15.88:0/3059616558 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fcf5000f760 con 0x7fcf58131280 2020-02-11T16:25:04.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.217+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.217+0000 7fcf46ffd700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf38039c60 0x7fcf3803c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:04.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.217+0000 7fcf6001d700 1 -- 172.21.15.88:0/3059616558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf580565b0 con 0x7fcf58131280 2020-02-11T16:25:04.231 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.217+0000 7fcf46ffd700 1 -- 172.21.15.88:0/3059616558 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fcf5004aa60 con 0x7fcf58131280 2020-02-11T16:25:04.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.218+0000 7fcf5ddb9700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf38039c60 0x7fcf3803c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:04.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.218+0000 7fcf5ddb9700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf38039c60 0x7fcf3803c120 crc :-1 s=READY pgs=448 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:04.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.221+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.222+0000 7fcf46ffd700 1 -- 172.21.15.88:0/3059616558 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fcf50033050 con 0x7fcf58131280 2020-02-11T16:25:04.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.435+0000 7fcf6001d700 1 -- 172.21.15.88:0/3059616558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcf5805ccb0 con 0x7fcf58131280 2020-02-11T16:25:04.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.435+0000 7fcf5e5ba700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:04.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.435+0000 7fcf46ffd700 1 -- 172.21.15.88:0/3059616558 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fcf50032c10 con 0x7fcf58131280 2020-02-11T16:25:04.437 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:04.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 -- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf38039c60 msgr2=0x7fcf3803c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf38039c60 0x7fcf3803c120 crc :-1 s=READY pgs=448 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 -- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 msgr2=0x7fcf581302f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 0x7fcf581302f0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7fcf500032b0 tx=0x7fcf58067410).stop 2020-02-11T16:25:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 -- 172.21.15.88:0/3059616558 shutdown_connections 2020-02-11T16:25:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcf38039c60 0x7fcf3803c120 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf58131280 0x7fcf581302f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:04.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 --2- 172.21.15.88:0/3059616558 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf580a5b20 0x7fcf5812fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:04.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 -- 172.21.15.88:0/3059616558 >> 172.21.15.88:0/3059616558 conn(0x7fcf5809d110 msgr2=0x7fcf58069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:04.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 -- 172.21.15.88:0/3059616558 shutdown_connections 2020-02-11T16:25:04.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:04.437+0000 7fcf6001d700 1 -- 172.21.15.88:0/3059616558 wait complete. 2020-02-11T16:25:04.449 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":156,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:07.450 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:25:07.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.567+0000 7f18e29fe700 1 Processor -- start 2020-02-11T16:25:07.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.567+0000 7f18e29fe700 1 -- start start 2020-02-11T16:25:07.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.567+0000 7f18e29fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:07.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.567+0000 7f18e29fe700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc13c1a0 con 0x7f18dc0a9730 2020-02-11T16:25:07.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.567+0000 7f18e29fe700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc0a61d0 con 0x7f18dc0a5610 2020-02-11T16:25:07.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.567+0000 7f18e29fe700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc13b3a0 con 0x7f18dc05e8f0 2020-02-11T16:25:07.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.568+0000 7f18e21fd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f18dc0a5610 0x7f18dc0a5ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46620/0 (socket says 172.21.15.88:46620) 2020-02-11T16:25:07.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.568+0000 7f18e21fd700 1 -- 172.21.15.88:0/2167058779 learned_addr learned my addr 172.21.15.88:0/2167058779 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:07.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.568+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:07.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.568+0000 7f18e11fb700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:25:07.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.568+0000 7f18e11fb700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:25:07.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.568+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:07.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.568+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:07.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.769+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.769+0000 7f18e11fb700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:25:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.769+0000 7f18e11fb700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:25:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.769+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:07.769+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:25:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:08.170+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:08.170+0000 7f18e11fb700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:25:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:08.170+0000 7f18e11fb700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:25:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:08.170+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:08.170+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:25:08.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:08.971+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:08.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:08.971+0000 7f18e11fb700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:25:08.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:08.971+0000 7f18e11fb700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:25:08.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:08.971+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:08.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:08.971+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:25:10.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:10.573+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:10.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:10.573+0000 7f18e11fb700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:25:10.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:10.573+0000 7f18e11fb700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:25:10.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:10.573+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:10.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:10.573+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:25:11.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.907+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727888281 0 0) 0x7f18d4001450 con 0x7f18dc0a5610 2020-02-11T16:25:11.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.907+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c4003230 con 0x7f18dc0a5610 2020-02-11T16:25:11.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3476854236 0 0) 0x7f18c4003230 con 0x7f18dc0a5610 2020-02-11T16:25:11.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 msgr2=0x7f18dc13bd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:25:11.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 --2- 172.21.15.88:0/2167058779 >> v2:172.21.15.52:3300/0 conn(0x7f18dc05e8f0 0x7f18dc13bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:11.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 >> v1:172.21.15.52:6789/0 conn(0x7f18dc0a9730 legacy=0x7f18dc066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:11.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc13b600 con 0x7f18dc0a5610 2020-02-11T16:25:11.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f18d4001be0 con 0x7f18dc0a5610 2020-02-11T16:25:11.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 >> v1:172.21.15.88:6789/0 conn(0x7f18dc0a5610 legacy=0x7f18dc0a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:11.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18c4003720 0x7f18c4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:11.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18c40044d0 0x7f18c4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:11.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18c400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:11.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc13b3a0 con 0x7f18c40044d0 2020-02-11T16:25:11.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c40041c0 con 0x7f18c4004db0 2020-02-11T16:25:11.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c400bb80 con 0x7f18c4003720 2020-02-11T16:25:11.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e19fc700 1 -- 172.21.15.88:0/2167058779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18c4003720 msgr2=0x7f18c4003b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:25:11.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18c4003720 0x7f18c4003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:11.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18c400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:11.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 -- 172.21.15.88:0/2167058779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18c4003720 msgr2=0x7f18c4003b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:25:11.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18c4003720 0x7f18c4003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:11.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 -- 172.21.15.88:0/2167058779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18c40044d0 msgr2=0x7f18c4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:25:11.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18c40044d0 0x7f18c4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:11.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 -- 172.21.15.88:0/2167058779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4003230 con 0x7f18c4004db0 2020-02-11T16:25:11.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18c400b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f18c40054a0 tx=0x7f18d400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 -- 172.21.15.88:0/2167058779 reap_dead start 2020-02-11T16:25:11.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18c400b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f18c40054a0 tx=0x7f18d400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18c400b720 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f18c40054a0 tx=0x7f18d400c880).ready entity=mon.1 client_cookie=b1422331952343d2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:11.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18c400b720 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f18c40054a0 tx=0x7f18d400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e21fd700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18c400b720 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f18c40054a0 tx=0x7f18d400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.908+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d4005de0 con 0x7f18c4004db0 2020-02-11T16:25:11.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.909+0000 7f18e21fd700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18c400b720 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f18c40054a0 tx=0x7f18d400c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.909+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4012340 con 0x7f18c4004db0 2020-02-11T16:25:11.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.909+0000 7f18e09fa700 1 -- 172.21.15.88:0/2167058779 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d40126c0 con 0x7f18c4004db0 2020-02-11T16:25:11.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.909+0000 7f18e29fe700 1 -- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 msgr2=0x7f18c400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.909+0000 7f18e29fe700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18c400b720 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f18c40054a0 tx=0x7f18d400c880).stop 2020-02-11T16:25:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.909+0000 7f18e29fe700 1 -- 172.21.15.88:0/2167058779 shutdown_connections 2020-02-11T16:25:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.909+0000 7f18e29fe700 1 --2- 172.21.15.88:0/2167058779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18c400b720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.909+0000 7f18e29fe700 1 -- 172.21.15.88:0/2167058779 >> 172.21.15.88:0/2167058779 conn(0x7f18dc0ae440 msgr2=0x7f18dc0ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.909+0000 7f18e29fe700 1 -- 172.21.15.88:0/2167058779 shutdown_connections 2020-02-11T16:25:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.909+0000 7f18e29fe700 1 -- 172.21.15.88:0/2167058779 wait complete. 2020-02-11T16:25:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.910+0000 7f18e29fe700 1 Processor -- start 2020-02-11T16:25:11.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.910+0000 7f18e29fe700 1 -- start start 2020-02-11T16:25:11.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e29fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18c4004db0 0x7f18dc145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:11.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e29fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18dc1343d0 0x7f18dc145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:11.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e29fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f18dc13a070 0x7f18dc148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:11.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e29fe700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc135bf0 con 0x7f18dc13a070 2020-02-11T16:25:11.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e29fe700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc134870 con 0x7f18c4004db0 2020-02-11T16:25:11.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e29fe700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc134b10 con 0x7f18dc1343d0 2020-02-11T16:25:11.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e11fb700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18dc1343d0 msgr2=0x7f18dc145e70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:25:11.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e11fb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18dc1343d0 0x7f18dc145e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:11.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e19fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18c4004db0 0x7f18dc145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:11.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e19fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18c4004db0 0x7f18dc145a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59014/0 (socket says 172.21.15.88:59014) 2020-02-11T16:25:11.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e19fc700 1 -- 172.21.15.88:0/2160604756 learned_addr learned my addr 172.21.15.88:0/2160604756 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:11.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.911+0000 7f18e21fd700 1 --2- 172.21.15.88:0/2160604756 >> v2:172.21.15.52:3300/0 conn(0x7f18dc13a070 0x7f18dc148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:11.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.912+0000 7f18e19fc700 1 -- 172.21.15.88:0/2160604756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18dc1343d0 msgr2=0x7f18dc145e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:25:11.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.912+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18dc1343d0 0x7f18dc145e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:11.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.912+0000 7f18e19fc700 1 -- 172.21.15.88:0/2160604756 >> v2:172.21.15.52:3300/0 conn(0x7f18dc13a070 msgr2=0x7f18dc148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.912+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> v2:172.21.15.52:3300/0 conn(0x7f18dc13a070 0x7f18dc148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.912+0000 7f18e19fc700 1 -- 172.21.15.88:0/2160604756 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc145500 con 0x7f18c4004db0 2020-02-11T16:25:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.912+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> v2:172.21.15.88:3300/0 conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.912+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> v2:172.21.15.88:3300/0 conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.912+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.913+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.913+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.913+0000 7f18caffd700 1 -- 172.21.15.88:0/2160604756 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d800ca30 con 0x7f18c4004db0 2020-02-11T16:25:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.913+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.913+0000 7f18caffd700 1 -- 172.21.15.88:0/2160604756 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800cbd0 con 0x7f18c4004db0 2020-02-11T16:25:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.913+0000 7f18caffd700 1 -- 172.21.15.88:0/2160604756 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d800d0c0 con 0x7f18c4004db0 2020-02-11T16:25:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.913+0000 7f18e29fe700 1 -- 172.21.15.88:0/2160604756 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc1462d0 con 0x7f18c4004db0 2020-02-11T16:25:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.913+0000 7f18e29fe700 1 -- 172.21.15.88:0/2160604756 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc0a81c0 con 0x7f18c4004db0 2020-02-11T16:25:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.913+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.914+0000 7f18caffd700 1 -- 172.21.15.88:0/2160604756 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f18d80054d0 con 0x7f18c4004db0 2020-02-11T16:25:11.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.914+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.914+0000 7f18caffd700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18bc039c40 0x7f18bc03c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:11.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.914+0000 7f18caffd700 1 -- 172.21.15.88:0/2160604756 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f18d8049410 con 0x7f18c4004db0 2020-02-11T16:25:11.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.914+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18bc039c40 0x7f18bc03c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:11.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.914+0000 7f18e29fe700 1 -- 172.21.15.88:0/2160604756 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc1456f0 con 0x7f18c4004db0 2020-02-11T16:25:11.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.914+0000 7f18e11fb700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18bc039c40 0x7f18bc03c100 crc :-1 s=READY pgs=449 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:11.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.919+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:11.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:11.919+0000 7f18caffd700 1 -- 172.21.15.88:0/2160604756 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f18d802eab0 con 0x7f18c4004db0 2020-02-11T16:25:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.130+0000 7f18e29fe700 1 -- 172.21.15.88:0/2160604756 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f18dc0565b0 con 0x7f18c4004db0 2020-02-11T16:25:12.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.130+0000 7f18e19fc700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.130+0000 7f18caffd700 1 -- 172.21.15.88:0/2160604756 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f18d80080c0 con 0x7f18c4004db0 2020-02-11T16:25:12.132 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":160,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:12.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 -- 172.21.15.88:0/2160604756 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18bc039c40 msgr2=0x7f18bc03c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18bc039c40 0x7f18bc03c100 crc :-1 s=READY pgs=449 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 -- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 msgr2=0x7f18dc145a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18dc145a10 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f18d8000b20 tx=0x7f18d800c490).stop 2020-02-11T16:25:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 -- 172.21.15.88:0/2160604756 shutdown_connections 2020-02-11T16:25:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f18bc039c40 0x7f18bc03c100 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 --2- 172.21.15.88:0/2160604756 >> v2:172.21.15.52:3300/0 conn(0x7f18dc13a070 0x7f18dc148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c4004db0 0x7f18dc145a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 --2- 172.21.15.88:0/2160604756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18dc1343d0 0x7f18dc145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 -- 172.21.15.88:0/2160604756 >> 172.21.15.88:0/2160604756 conn(0x7f18dc0ae440 msgr2=0x7f18dc0ab610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 -- 172.21.15.88:0/2160604756 shutdown_connections 2020-02-11T16:25:12.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.132+0000 7f18e29fe700 1 -- 172.21.15.88:0/2160604756 wait complete. 2020-02-11T16:25:12.144 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":160,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:12.144 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:25:12.145 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:25:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.263+0000 7f49ef31b700 1 Processor -- start 2020-02-11T16:25:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.264+0000 7f49ef31b700 1 -- start start 2020-02-11T16:25:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.264+0000 7f49ef31b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49e805c1f0 0x7f49e80a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.264+0000 7f49ef31b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e812d990 0x7f49e812de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.264+0000 7f49ef31b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e80a1e80 con 0x7f49e80a6fa0 2020-02-11T16:25:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.264+0000 7f49ef31b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e80a25c0 con 0x7f49e805c1f0 2020-02-11T16:25:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.264+0000 7f49ef31b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80a2120 con 0x7f49e812d990 2020-02-11T16:25:12.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.264+0000 7f49ed8b8700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e812d990 msgr2=0x7f49e812de20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:25:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.264+0000 7f49ed8b8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e812d990 0x7f49e812de20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.264+0000 7f49ed0b7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49e805c1f0 0x7f49e80a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49e805c1f0 0x7f49e80a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45008/0 (socket says 172.21.15.88:45008) 2020-02-11T16:25:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ec8b6700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f49e80a6fa0 0x7f49e80a2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:38432/0 (socket says 172.21.15.88:38432) 2020-02-11T16:25:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 -- 172.21.15.88:0/1520557393 learned_addr learned my addr 172.21.15.88:0/1520557393 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:12.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 -- 172.21.15.88:0/1520557393 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e812d990 msgr2=0x7f49e812de20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:25:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/1520557393 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e812d990 0x7f49e812de20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 -- 172.21.15.88:0/1520557393 >> v1:172.21.15.52:6789/0 conn(0x7f49e80a6fa0 legacy=0x7f49e80a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 -- 172.21.15.88:0/1520557393 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80a2e90 con 0x7f49e805c1f0 2020-02-11T16:25:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/1520557393 >> v2:172.21.15.52:3300/0 conn(0x7f49e805c1f0 0x7f49e80a43e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49e4002f30 tx=0x7f49e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/1520557393 >> v2:172.21.15.52:3300/0 conn(0x7f49e805c1f0 0x7f49e80a43e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49e4002f30 tx=0x7f49e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/1520557393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e80a43e0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e40088e0).ready entity=mon.0 client_cookie=3fb7c40ef4731dfe server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:12.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/1520557393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e80a43e0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49d7fff700 1 -- 172.21.15.88:0/1520557393 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e4008e20 con 0x7f49e805c1f0 2020-02-11T16:25:12.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/1520557393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e80a43e0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49d7fff700 1 -- 172.21.15.88:0/1520557393 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4011950 con 0x7f49e805c1f0 2020-02-11T16:25:12.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/1520557393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e80a43e0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49d7fff700 1 -- 172.21.15.88:0/1520557393 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e4011d30 con 0x7f49e805c1f0 2020-02-11T16:25:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ef31b700 1 -- 172.21.15.88:0/1520557393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 msgr2=0x7f49e80a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.265+0000 7f49ef31b700 1 --2- 172.21.15.88:0/1520557393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e80a43e0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e40088e0).stop 2020-02-11T16:25:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.266+0000 7f49ef31b700 1 -- 172.21.15.88:0/1520557393 shutdown_connections 2020-02-11T16:25:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.266+0000 7f49ef31b700 1 --2- 172.21.15.88:0/1520557393 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e812d990 0x7f49e812de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:12.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.266+0000 7f49ef31b700 1 --2- 172.21.15.88:0/1520557393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e80a43e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.266+0000 7f49ef31b700 1 -- 172.21.15.88:0/1520557393 >> 172.21.15.88:0/1520557393 conn(0x7f49e80ab400 msgr2=0x7f49e80a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:12.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.266+0000 7f49ef31b700 1 -- 172.21.15.88:0/1520557393 shutdown_connections 2020-02-11T16:25:12.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.266+0000 7f49ef31b700 1 -- 172.21.15.88:0/1520557393 wait complete. 2020-02-11T16:25:12.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.267+0000 7f49ef31b700 1 Processor -- start 2020-02-11T16:25:12.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.267+0000 7f49ef31b700 1 -- start start 2020-02-11T16:25:12.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.267+0000 7f49ef31b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49e805c1f0 0x7f49e81310c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:12.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.267+0000 7f49ef31b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e80a6fa0 0x7f49e81330e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:12.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.267+0000 7f49ef31b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e81306e0 con 0x7f49e812d990 2020-02-11T16:25:12.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.267+0000 7f49ef31b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e8130980 con 0x7f49e805c1f0 2020-02-11T16:25:12.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.267+0000 7f49ef31b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8130c20 con 0x7f49e80a6fa0 2020-02-11T16:25:12.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.267+0000 7f49ec8b6700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e80a6fa0 msgr2=0x7f49e81330e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:25:12.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.267+0000 7f49ec8b6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e80a6fa0 0x7f49e81330e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:12.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49e805c1f0 0x7f49e81310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49e805c1f0 0x7f49e81310c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45014/0 (socket says 172.21.15.88:45014) 2020-02-11T16:25:12.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 -- 172.21.15.88:0/3408032497 learned_addr learned my addr 172.21.15.88:0/3408032497 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:12.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 -- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e80a6fa0 msgr2=0x7f49e81330e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:25:12.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f49e80a6fa0 0x7f49e81330e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 -- 172.21.15.88:0/3408032497 >> v1:172.21.15.52:6789/0 conn(0x7f49e812d990 legacy=0x7f49e8141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 -- 172.21.15.88:0/3408032497 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80a1360 con 0x7f49e805c1f0 2020-02-11T16:25:12.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/3408032497 >> v2:172.21.15.52:3300/0 conn(0x7f49e805c1f0 0x7f49e81310c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e80a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/3408032497 >> v2:172.21.15.52:3300/0 conn(0x7f49e805c1f0 0x7f49e81310c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e80a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e81310c0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e80a3080).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e81310c0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e80a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e4008ea0 con 0x7f49e805c1f0 2020-02-11T16:25:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e81310c0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e80a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e81310c0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e80a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e400f8d0 con 0x7f49e805c1f0 2020-02-11T16:25:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49ef31b700 1 -- 172.21.15.88:0/3408032497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e81376f0 con 0x7f49e805c1f0 2020-02-11T16:25:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.268+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e4007530 con 0x7f49e805c1f0 2020-02-11T16:25:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.269+0000 7f49ef31b700 1 -- 172.21.15.88:0/3408032497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e80a5c30 con 0x7f49e805c1f0 2020-02-11T16:25:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.269+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e81310c0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e80a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.269+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f49e40056c0 con 0x7f49e805c1f0 2020-02-11T16:25:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.269+0000 7f49ed0b7700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e81310c0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e80a3080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.269+0000 7f49d67fc700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f49c8039bf0 0x7f49c803c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.269+0000 7f49ef31b700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 0x7f49e8138520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.269+0000 7f49ef31b700 1 -- 172.21.15.88:0/3408032497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e805c630 con 0x7f49e8134bd0 2020-02-11T16:25:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.269+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f49e404a220 con 0x7f49e805c1f0 2020-02-11T16:25:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 0x7f49e8138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49ec8b6700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f49c8039bf0 0x7f49c803c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49ed8b8700 1 -- 172.21.15.88:0/3408032497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49e805bad0 con 0x7f49e8134bd0 2020-02-11T16:25:12.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49ec8b6700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f49c8039bf0 0x7f49c803c0b0 crc :-1 s=READY pgs=450 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 0x7f49e8138520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 0x7f49e8138520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 0x7f49e8138520 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 0x7f49e8138520 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e0003c30 con 0x7f49e8134bd0 2020-02-11T16:25:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 0x7f49e8138520 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f49e0003d90 con 0x7f49e8134bd0 2020-02-11T16:25:12.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 msgr2=0x7f49e8138520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49d67fc700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 0x7f49e8138520 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).stop 2020-02-11T16:25:12.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 msgr2=0x7f49e8138520 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:12.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.270+0000 7f49d67fc700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8134bd0 0x7f49e8138520 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).stop 2020-02-11T16:25:12.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.280+0000 7f49ef31b700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 0x7f49e8135890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:12.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.280+0000 7f49ef31b700 1 -- 172.21.15.88:0/3408032497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8130ac0 con 0x7f49e8135480 2020-02-11T16:25:12.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 0x7f49e8135890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49ed8b8700 1 -- 172.21.15.88:0/3408032497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f49e8134fe0 con 0x7f49e8135480 2020-02-11T16:25:12.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 0x7f49e8135890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 0x7f49e8135890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 0x7f49e8135890 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:12.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 0x7f49e8135890 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e00078c0 con 0x7f49e8135480 2020-02-11T16:25:12.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49ed8b8700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 0x7f49e8135890 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f49e000b3a0 con 0x7f49e8135480 2020-02-11T16:25:12.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 msgr2=0x7f49e8135890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49d67fc700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 0x7f49e8135890 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).stop 2020-02-11T16:25:12.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49d67fc700 1 -- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 msgr2=0x7f49e8135890 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:12.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.281+0000 7f49d67fc700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e8135480 0x7f49e8135890 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0x7f49e8137620 tx=0x7f49e0010b20).stop 2020-02-11T16:25:12.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.282+0000 7f49ef31b700 1 -- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f49c8039bf0 msgr2=0x7f49c803c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.282+0000 7f49ef31b700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f49c8039bf0 0x7f49c803c0b0 crc :-1 s=READY pgs=450 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.282+0000 7f49ef31b700 1 -- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 msgr2=0x7f49e81310c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.282+0000 7f49ef31b700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e81310c0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e80a3080).stop 2020-02-11T16:25:12.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.282+0000 7f49ed8b8700 1 -- 172.21.15.88:0/3408032497 reap_dead start 2020-02-11T16:25:12.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.282+0000 7f49ef31b700 1 -- 172.21.15.88:0/3408032497 shutdown_connections 2020-02-11T16:25:12.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.282+0000 7f49ef31b700 1 --2- 172.21.15.88:0/3408032497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49e805c1f0 0x7f49e81310c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.282+0000 7f49ef31b700 1 -- 172.21.15.88:0/3408032497 >> 172.21.15.88:0/3408032497 conn(0x7f49e80ab400 msgr2=0x7f49e8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:12.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.282+0000 7f49ef31b700 1 -- 172.21.15.88:0/3408032497 shutdown_connections 2020-02-11T16:25:12.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.282+0000 7f49ef31b700 1 -- 172.21.15.88:0/3408032497 wait complete. 2020-02-11T16:25:12.306 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:25:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:25:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 160, 2020-02-11T16:25:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:25:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:25:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:25:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:25:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:25:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:25:12.308 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.309 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:25:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:25:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:12.310 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:25:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:25:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:25:12.311 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:25:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:25:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:25:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:25:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:25:12.312 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:25:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:12.313 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:25:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:25:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:12.314 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:12.315 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:12.315 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:12.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.315 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:12.315 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:25:12.316 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.316 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:12.316 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:25:12.316 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.316 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.316 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:25:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:25:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.318 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:25:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:12.319 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:25:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.320 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:25:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:25:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:25:12.321 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:25:12.322 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:12.322 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:12.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.322 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:12.322 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:25:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:25:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:25:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:25:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:12.324 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.325 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.325 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:25:12.325 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:25:12.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.325 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:12.325 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:25:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:25:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:12.326 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:25:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:25:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.327 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:25:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:25:12.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:25:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:25:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.330 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:12.330 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:12.330 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:25:12.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.330 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.331 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:25:12.332 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:25:12.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.444+0000 7f2b63da9700 1 Processor -- start 2020-02-11T16:25:12.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.444+0000 7f2b63da9700 1 -- start start 2020-02-11T16:25:12.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.445+0000 7f2b63da9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b5c0ad380 0x7f2b5c0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.445+0000 7f2b63da9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c13bfe0 con 0x7f2b5c138280 2020-02-11T16:25:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.445+0000 7f2b63da9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c0adb40 con 0x7f2b5c138710 2020-02-11T16:25:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.445+0000 7f2b63da9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c137bf0 con 0x7f2b5c0ad380 2020-02-11T16:25:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.445+0000 7f2b61b45700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b5c0ad380 0x7f2b5c0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.445+0000 7f2b62346700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2b5c138710 0x7f2b5c13b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46670/0 (socket says 172.21.15.88:46670) 2020-02-11T16:25:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.445+0000 7f2b62346700 1 -- 172.21.15.88:0/2239573275 learned_addr learned my addr 172.21.15.88:0/2239573275 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b61b45700 1 -- 172.21.15.88:0/2239573275 >> v1:172.21.15.88:6789/0 conn(0x7f2b5c138710 legacy=0x7f2b5c13b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b61b45700 1 -- 172.21.15.88:0/2239573275 >> v1:172.21.15.52:6789/0 conn(0x7f2b5c138280 legacy=0x7f2b5c13b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b61b45700 1 -- 172.21.15.88:0/2239573275 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c137de0 con 0x7f2b5c0ad380 2020-02-11T16:25:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b61b45700 1 --2- 172.21.15.88:0/2239573275 >> v2:172.21.15.88:3300/0 conn(0x7f2b5c0ad380 0x7f2b5c0a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b58002f30 tx=0x7f2b580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b61b45700 1 --2- 172.21.15.88:0/2239573275 >> v2:172.21.15.88:3300/0 conn(0x7f2b5c0ad380 0x7f2b5c0a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b58002f30 tx=0x7f2b580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b61b45700 1 --2- 172.21.15.88:0/2239573275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c0ad380 0x7f2b5c0a9130 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580088e0).ready entity=mon.1 client_cookie=c236a2a21907c3e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b61b45700 1 --2- 172.21.15.88:0/2239573275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c0ad380 0x7f2b5c0a9130 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b60b43700 1 -- 172.21.15.88:0/2239573275 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b58008e40 con 0x7f2b5c0ad380 2020-02-11T16:25:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b61b45700 1 --2- 172.21.15.88:0/2239573275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c0ad380 0x7f2b5c0a9130 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b60b43700 1 -- 172.21.15.88:0/2239573275 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b580116a0 con 0x7f2b5c0ad380 2020-02-11T16:25:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b61b45700 1 --2- 172.21.15.88:0/2239573275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c0ad380 0x7f2b5c0a9130 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b60b43700 1 -- 172.21.15.88:0/2239573275 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b58011a80 con 0x7f2b5c0ad380 2020-02-11T16:25:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b63da9700 1 -- 172.21.15.88:0/2239573275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c0ad380 msgr2=0x7f2b5c0a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b63da9700 1 --2- 172.21.15.88:0/2239573275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c0ad380 0x7f2b5c0a9130 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580088e0).stop 2020-02-11T16:25:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b63da9700 1 -- 172.21.15.88:0/2239573275 shutdown_connections 2020-02-11T16:25:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b63da9700 1 --2- 172.21.15.88:0/2239573275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c0ad380 0x7f2b5c0a9130 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b63da9700 1 -- 172.21.15.88:0/2239573275 >> 172.21.15.88:0/2239573275 conn(0x7f2b5c05ac70 msgr2=0x7f2b5c0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b63da9700 1 -- 172.21.15.88:0/2239573275 shutdown_connections 2020-02-11T16:25:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.446+0000 7f2b63da9700 1 -- 172.21.15.88:0/2239573275 wait complete. 2020-02-11T16:25:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.447+0000 7f2b63da9700 1 Processor -- start 2020-02-11T16:25:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.447+0000 7f2b63da9700 1 -- start start 2020-02-11T16:25:12.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b63da9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b5c138280 0x7f2b5c144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:12.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b63da9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b5c138710 0x7f2b5c1338d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:12.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b63da9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c1325e0 con 0x7f2b5c0ad380 2020-02-11T16:25:12.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b63da9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c134e80 con 0x7f2b5c138280 2020-02-11T16:25:12.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b63da9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c145490 con 0x7f2b5c138710 2020-02-11T16:25:12.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b62346700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b5c138710 0x7f2b5c1338d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b62346700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b5c138710 0x7f2b5c1338d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59050/0 (socket says 172.21.15.88:59050) 2020-02-11T16:25:12.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b62346700 1 -- 172.21.15.88:0/1506848303 learned_addr learned my addr 172.21.15.88:0/1506848303 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:12.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b61344700 1 --2- 172.21.15.88:0/1506848303 >> v2:172.21.15.52:3300/0 conn(0x7f2b5c138280 0x7f2b5c144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b62346700 1 -- 172.21.15.88:0/1506848303 >> v2:172.21.15.52:3300/0 conn(0x7f2b5c138280 msgr2=0x7f2b5c144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b62346700 1 --2- 172.21.15.88:0/1506848303 >> v2:172.21.15.52:3300/0 conn(0x7f2b5c138280 0x7f2b5c144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b62346700 1 -- 172.21.15.88:0/1506848303 >> v1:172.21.15.52:6789/0 conn(0x7f2b5c0ad380 legacy=0x7f2b5c132c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b62346700 1 -- 172.21.15.88:0/1506848303 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c145730 con 0x7f2b5c138710 2020-02-11T16:25:12.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b62346700 1 --2- 172.21.15.88:0/1506848303 >> v2:172.21.15.88:3300/0 conn(0x7f2b5c138710 0x7f2b5c1338d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b5c134a60 tx=0x7f2b54010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b62346700 1 --2- 172.21.15.88:0/1506848303 >> v2:172.21.15.88:3300/0 conn(0x7f2b5c138710 0x7f2b5c1338d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b5c134a60 tx=0x7f2b54010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.448+0000 7f2b62346700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c138710 0x7f2b5c1338d0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f2b5c134a60 tx=0x7f2b54010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:12.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.449+0000 7f2b62346700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c138710 0x7f2b5c1338d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2b5c134a60 tx=0x7f2b54010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.449+0000 7f2b62346700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c138710 0x7f2b5c1338d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2b5c134a60 tx=0x7f2b54010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.449+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b54005ce0 con 0x7f2b5c138710 2020-02-11T16:25:12.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.449+0000 7f2b62346700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c138710 0x7f2b5c1338d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2b5c134a60 tx=0x7f2b54010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.449+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54005e40 con 0x7f2b5c138710 2020-02-11T16:25:12.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.449+0000 7f2b63da9700 1 -- 172.21.15.88:0/1506848303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c1459d0 con 0x7f2b5c138710 2020-02-11T16:25:12.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.449+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b540128b0 con 0x7f2b5c138710 2020-02-11T16:25:12.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.449+0000 7f2b63da9700 1 -- 172.21.15.88:0/1506848303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c133360 con 0x7f2b5c138710 2020-02-11T16:25:12.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.449+0000 7f2b62346700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c138710 0x7f2b5c1338d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2b5c134a60 tx=0x7f2b54010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2b54012b20 con 0x7f2b5c138710 2020-02-11T16:25:12.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b62346700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c138710 0x7f2b5c1338d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2b5c134a60 tx=0x7f2b54010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b63da9700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 0x7f2b5c05ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:12.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b63da9700 1 -- 172.21.15.88:0/1506848303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c05e2f0 con 0x7f2b5c133d30 2020-02-11T16:25:12.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b4affd700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039c70 0x7f2b3c03c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:12.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 0x7f2b5c05ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f2b5404a020 con 0x7f2b5c138710 2020-02-11T16:25:12.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b61344700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039c70 0x7f2b3c03c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b61b45700 1 -- 172.21.15.88:0/1506848303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b5c0565b0 con 0x7f2b5c133d30 2020-02-11T16:25:12.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b61344700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039c70 0x7f2b3c03c130 crc :-1 s=READY pgs=451 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:12.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 0x7f2b5c05ebb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b58011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 0x7f2b5c05ebb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b58011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.450+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 0x7f2b5c05ebb0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b58011450).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:12.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.451+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 0x7f2b5c05ebb0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b58011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.451+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b58011930 con 0x7f2b5c133d30 2020-02-11T16:25:12.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.451+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 0x7f2b5c05ebb0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b58011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.451+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f2b58011a90 con 0x7f2b5c133d30 2020-02-11T16:25:12.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.451+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 msgr2=0x7f2b5c05ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.451+0000 7f2b4affd700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 0x7f2b5c05ebb0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b58011450).stop 2020-02-11T16:25:12.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.451+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 msgr2=0x7f2b5c05ebb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:12.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.451+0000 7f2b4affd700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c133d30 0x7f2b5c05ebb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.459+0000 7f2b63da9700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 0x7f2b5c135f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.459+0000 7f2b63da9700 1 -- 172.21.15.88:0/1506848303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c1455d0 con 0x7f2b5c135b40 2020-02-11T16:25:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 0x7f2b5c135f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b61b45700 1 -- 172.21.15.88:0/1506848303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2b5c05ccb0 con 0x7f2b5c135b40 2020-02-11T16:25:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 0x7f2b5c135f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580084a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 0x7f2b5c135f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580084a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 0x7f2b5c135f50 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580084a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 0x7f2b5c135f50 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580084a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b58005ea0 con 0x7f2b5c135b40 2020-02-11T16:25:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b61b45700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 0x7f2b5c135f50 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580084a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4011 (secure 0 0 0) 0x7f2b5800c730 con 0x7f2b5c135b40 2020-02-11T16:25:12.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 msgr2=0x7f2b5c135f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b4affd700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 0x7f2b5c135f50 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f2b58002f30 tx=0x7f2b580084a0).stop 2020-02-11T16:25:12.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b4affd700 1 -- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 msgr2=0x7f2b5c135f50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:12.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.460+0000 7f2b4affd700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b5c135b40 0x7f2b5c135f50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b63da9700 1 -- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039c70 msgr2=0x7f2b3c03c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b63da9700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b3c039c70 0x7f2b3c03c130 crc :-1 s=READY pgs=451 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b63da9700 1 -- 172.21.15.88:0/1506848303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c138710 msgr2=0x7f2b5c1338d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:12.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b63da9700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c138710 0x7f2b5c1338d0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f2b5c134a60 tx=0x7f2b54010ce0).stop 2020-02-11T16:25:12.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b62346700 1 -- 172.21.15.88:0/1506848303 reap_dead start 2020-02-11T16:25:12.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b62346700 1 -- 172.21.15.88:0/1506848303 reap_dead start 2020-02-11T16:25:12.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b63da9700 1 -- 172.21.15.88:0/1506848303 shutdown_connections 2020-02-11T16:25:12.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b63da9700 1 --2- 172.21.15.88:0/1506848303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b5c138710 0x7f2b5c1338d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:12.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b63da9700 1 -- 172.21.15.88:0/1506848303 >> 172.21.15.88:0/1506848303 conn(0x7f2b5c05ac70 msgr2=0x7f2b5c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:12.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b63da9700 1 -- 172.21.15.88:0/1506848303 shutdown_connections 2020-02-11T16:25:12.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:12.461+0000 7f2b63da9700 1 -- 172.21.15.88:0/1506848303 wait complete. 2020-02-11T16:25:12.469 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:25:12.469 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:12.469 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:12.469 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:25:12.469 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 160, 2020-02-11T16:25:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:25:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:25:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:25:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:25:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:25:12.470 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:25:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:12.471 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:25:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:25:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:12.472 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:25:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:25:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:25:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:25:12.473 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:25:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:25:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:25:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:25:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:12.474 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:25:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.475 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:25:12.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.476 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:25:12.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.476 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:12.476 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:12.476 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:12.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:25:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.477 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:25:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:25:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:25:12.478 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:12.479 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:12.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.479 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:12.479 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:12.479 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:12.479 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:12.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.480 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:12.480 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:25:12.480 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.480 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:12.481 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:25:12.481 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.481 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.481 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.481 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:25:12.481 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:25:12.482 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:12.482 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:12.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.482 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:25:12.482 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:25:12.482 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:12.482 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:12.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.483 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:12.483 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:25:12.483 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.483 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:12.484 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:25:12.484 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:12.484 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.484 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.484 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:25:12.484 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:25:12.484 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:12.485 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:12.485 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.485 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:12.485 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:25:12.485 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:25:12.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.486 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:12.486 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:12.486 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:25:12.486 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.486 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.486 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:25:12.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.487 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:12.487 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:12.487 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:25:12.487 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.487 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:12.487 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:25:12.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:12.487 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:12.488 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:12.488 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:25:12.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.488 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:12.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:12.488 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:25:12.489 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:25:15.675 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:25:15.678 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:25:32.490 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:25:32.490 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2020-02-11T16:25:32.490 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-11T16:25:32.490 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-11T16:25:32.493 INFO:tasks.ceph.mon.c:Started 2020-02-11T16:25:32.493 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:25:32.494 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:25:32.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.610+0000 7fcd58d9e700 1 Processor -- start 2020-02-11T16:25:32.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.610+0000 7fcd58d9e700 1 -- start start 2020-02-11T16:25:32.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd58d9e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcd5413b290 0x7fcd5409d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:32.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd58d9e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcd5413b6f0 0x7fcd5409d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:32.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd58d9e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd541380c0 con 0x7fcd54131f50 2020-02-11T16:25:32.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd58d9e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd54138360 con 0x7fcd5413b290 2020-02-11T16:25:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd58d9e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd54138600 con 0x7fcd5413b6f0 2020-02-11T16:25:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd52d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcd5413b6f0 0x7fcd5409d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd52d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcd5413b6f0 0x7fcd5409d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59068/0 (socket says 172.21.15.88:59068) 2020-02-11T16:25:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd52d9d700 1 -- 172.21.15.88:0/2269539903 learned_addr learned my addr 172.21.15.88:0/2269539903 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd5259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcd54131f50 0x7fcd5405f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46690/0 (socket says 172.21.15.88:46690) 2020-02-11T16:25:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/2269539903 >> v2:172.21.15.52:3300/0 conn(0x7fcd5413b290 0x7fcd5409d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd52d9d700 1 -- 172.21.15.88:0/2269539903 >> v2:172.21.15.52:3300/0 conn(0x7fcd5413b290 msgr2=0x7fcd5409d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:25:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd52d9d700 1 --2- 172.21.15.88:0/2269539903 >> v2:172.21.15.52:3300/0 conn(0x7fcd5413b290 0x7fcd5409d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd52d9d700 1 -- 172.21.15.88:0/2269539903 >> v1:172.21.15.88:6789/0 conn(0x7fcd54131f50 legacy=0x7fcd5405f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd52d9d700 1 -- 172.21.15.88:0/2269539903 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd54137d40 con 0x7fcd5413b6f0 2020-02-11T16:25:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.611+0000 7fcd5159a700 1 -- 172.21.15.88:0/2269539903 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253359233 0 0) 0x7fcd541380c0 con 0x7fcd54131f50 2020-02-11T16:25:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd52d9d700 1 --2- 172.21.15.88:0/2269539903 >> v2:172.21.15.88:3300/0 conn(0x7fcd5413b6f0 0x7fcd5409d600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd4c0032b0 tx=0x7fcd4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd52d9d700 1 --2- 172.21.15.88:0/2269539903 >> v2:172.21.15.88:3300/0 conn(0x7fcd5413b6f0 0x7fcd5409d600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd4c0032b0 tx=0x7fcd4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd52d9d700 1 --2- 172.21.15.88:0/2269539903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b6f0 0x7fcd5409d600 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fcd4c0032b0 tx=0x7fcd4c007dc0).ready entity=mon.1 client_cookie=a9e73fd7f286b7e8 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:32.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd52d9d700 1 --2- 172.21.15.88:0/2269539903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b6f0 0x7fcd5409d600 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fcd4c0032b0 tx=0x7fcd4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd5159a700 1 -- 172.21.15.88:0/2269539903 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd4c00a160 con 0x7fcd5413b6f0 2020-02-11T16:25:32.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd52d9d700 1 --2- 172.21.15.88:0/2269539903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b6f0 0x7fcd5409d600 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fcd4c0032b0 tx=0x7fcd4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd52d9d700 1 --2- 172.21.15.88:0/2269539903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b6f0 0x7fcd5409d600 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fcd4c0032b0 tx=0x7fcd4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd5159a700 1 -- 172.21.15.88:0/2269539903 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c00a2c0 con 0x7fcd5413b6f0 2020-02-11T16:25:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd5159a700 1 -- 172.21.15.88:0/2269539903 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd4c00a660 con 0x7fcd5413b6f0 2020-02-11T16:25:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd58d9e700 1 -- 172.21.15.88:0/2269539903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b6f0 msgr2=0x7fcd5409d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd58d9e700 1 --2- 172.21.15.88:0/2269539903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b6f0 0x7fcd5409d600 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fcd4c0032b0 tx=0x7fcd4c007dc0).stop 2020-02-11T16:25:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd58d9e700 1 -- 172.21.15.88:0/2269539903 shutdown_connections 2020-02-11T16:25:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd58d9e700 1 --2- 172.21.15.88:0/2269539903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b6f0 0x7fcd5409d600 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd58d9e700 1 --2- 172.21.15.88:0/2269539903 >> v2:172.21.15.52:3300/0 conn(0x7fcd5413b290 0x7fcd5409d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd58d9e700 1 -- 172.21.15.88:0/2269539903 >> 172.21.15.88:0/2269539903 conn(0x7fcd540a7bb0 msgr2=0x7fcd540a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:32.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd58d9e700 1 -- 172.21.15.88:0/2269539903 shutdown_connections 2020-02-11T16:25:32.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.612+0000 7fcd58d9e700 1 -- 172.21.15.88:0/2269539903 wait complete. 2020-02-11T16:25:32.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.614+0000 7fcd58d9e700 1 Processor -- start 2020-02-11T16:25:32.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.614+0000 7fcd58d9e700 1 -- start start 2020-02-11T16:25:32.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.614+0000 7fcd58d9e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcd54131f50 0x7fcd54148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:32.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.614+0000 7fcd58d9e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcd5413b290 0x7fcd5412e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.614+0000 7fcd58d9e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcd54149200 0x7fcd5412ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.614+0000 7fcd58d9e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd540a3690 con 0x7fcd54149200 2020-02-11T16:25:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.614+0000 7fcd58d9e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd540aaa40 con 0x7fcd5413b290 2020-02-11T16:25:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.614+0000 7fcd58d9e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd54138eb0 con 0x7fcd54131f50 2020-02-11T16:25:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.614+0000 7fcd51d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcd5413b290 0x7fcd5412e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcd5413b290 0x7fcd5412e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59072/0 (socket says 172.21.15.88:59072) 2020-02-11T16:25:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 -- 172.21.15.88:0/278289870 learned_addr learned my addr 172.21.15.88:0/278289870 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd52d9d700 1 --2- 172.21.15.88:0/278289870 >> v2:172.21.15.52:3300/0 conn(0x7fcd54149200 0x7fcd5412ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd5259c700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcd54131f50 0x7fcd54148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 -- 172.21.15.88:0/278289870 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcd54131f50 msgr2=0x7fcd54148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcd54131f50 0x7fcd54148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 -- 172.21.15.88:0/278289870 >> v2:172.21.15.52:3300/0 conn(0x7fcd54149200 msgr2=0x7fcd5412ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> v2:172.21.15.52:3300/0 conn(0x7fcd54149200 0x7fcd5412ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 -- 172.21.15.88:0/278289870 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd540a38c0 con 0x7fcd5413b290 2020-02-11T16:25:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> v2:172.21.15.88:3300/0 conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> v2:172.21.15.88:3300/0 conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd437fe700 1 -- 172.21.15.88:0/278289870 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd48005e90 con 0x7fcd5413b290 2020-02-11T16:25:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd58d9e700 1 -- 172.21.15.88:0/278289870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd540a8f20 con 0x7fcd5413b290 2020-02-11T16:25:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd437fe700 1 -- 172.21.15.88:0/278289870 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd48007160 con 0x7fcd5413b290 2020-02-11T16:25:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd437fe700 1 -- 172.21.15.88:0/278289870 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd48007580 con 0x7fcd5413b290 2020-02-11T16:25:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.615+0000 7fcd58d9e700 1 -- 172.21.15.88:0/278289870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd54148900 con 0x7fcd5413b290 2020-02-11T16:25:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.616+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.616+0000 7fcd437fe700 1 -- 172.21.15.88:0/278289870 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fcd480124c0 con 0x7fcd5413b290 2020-02-11T16:25:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.616+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.616+0000 7fcd437fe700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcd30039c80 0x7fcd3003c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.616+0000 7fcd437fe700 1 -- 172.21.15.88:0/278289870 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fcd48049f90 con 0x7fcd5413b290 2020-02-11T16:25:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.616+0000 7fcd58d9e700 1 -- 172.21.15.88:0/278289870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd540aab80 con 0x7fcd5413b290 2020-02-11T16:25:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.616+0000 7fcd5259c700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcd30039c80 0x7fcd3003c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.617+0000 7fcd5259c700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcd30039c80 0x7fcd3003c140 crc :-1 s=READY pgs=453 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:32.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.620+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.620+0000 7fcd437fe700 1 -- 172.21.15.88:0/278289870 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fcd4802f4f0 con 0x7fcd5413b290 2020-02-11T16:25:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.831+0000 7fcd58d9e700 1 -- 172.21.15.88:0/278289870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcd54148ac0 con 0x7fcd5413b290 2020-02-11T16:25:32.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.831+0000 7fcd51d9b700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:32.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.831+0000 7fcd437fe700 1 -- 172.21.15.88:0/278289870 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7fcd48032000 con 0x7fcd5413b290 2020-02-11T16:25:32.835 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":160,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 -- 172.21.15.88:0/278289870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcd30039c80 msgr2=0x7fcd3003c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcd30039c80 0x7fcd3003c140 crc :-1 s=READY pgs=453 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 -- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 msgr2=0x7fcd5412e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 0x7fcd5412e5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fcd48003070 tx=0x7fcd48010dc0).stop 2020-02-11T16:25:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 -- 172.21.15.88:0/278289870 shutdown_connections 2020-02-11T16:25:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcd30039c80 0x7fcd3003c140 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 --2- 172.21.15.88:0/278289870 >> v2:172.21.15.52:3300/0 conn(0x7fcd54149200 0x7fcd5412ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcd54131f50 0x7fcd54148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 --2- 172.21.15.88:0/278289870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd5413b290 0x7fcd5412e5a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 -- 172.21.15.88:0/278289870 >> 172.21.15.88:0/278289870 conn(0x7fcd540a7bb0 msgr2=0x7fcd54069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 -- 172.21.15.88:0/278289870 shutdown_connections 2020-02-11T16:25:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:32.833+0000 7fcd58d9e700 1 -- 172.21.15.88:0/278289870 wait complete. 2020-02-11T16:25:32.846 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":160,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:35.847 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:25:35.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.959+0000 7f7f69513700 1 Processor -- start 2020-02-11T16:25:35.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.959+0000 7f7f69513700 1 -- start start 2020-02-11T16:25:35.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f69513700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f640a18a0 0x7f7f640a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:35.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f69513700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f640a5de0 0x7f7f640a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:35.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f69513700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f640a31b0 con 0x7f7f6412e3a0 2020-02-11T16:25:35.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f69513700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f640a3570 con 0x7f7f640a5de0 2020-02-11T16:25:35.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f69513700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f640a3810 con 0x7f7f640a18a0 2020-02-11T16:25:35.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f637fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7f6412e3a0 0x7f7f6412e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46706/0 (socket says 172.21.15.88:46706) 2020-02-11T16:25:35.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f637fe700 1 -- 172.21.15.88:0/3149116563 learned_addr learned my addr 172.21.15.88:0/3149116563 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:35.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f62ffd700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f640a18a0 0x7f7f640a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:35.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3149116563 >> v2:172.21.15.52:3300/0 conn(0x7f7f640a5de0 0x7f7f640a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:35.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f627fc700 1 -- 172.21.15.88:0/3149116563 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599782165 0 0) 0x7f7f640a31b0 con 0x7f7f6412e3a0 2020-02-11T16:25:35.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f627fc700 1 -- 172.21.15.88:0/3149116563 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f44003230 con 0x7f7f6412e3a0 2020-02-11T16:25:35.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f62ffd700 1 -- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f640a18a0 msgr2=0x7f7f640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:25:35.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f62ffd700 1 -- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f640a18a0 msgr2=0x7f7f640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:25:35.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f62ffd700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f640a18a0 0x7f7f640a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:35.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f62ffd700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f640a18a0 0x7f7f640a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:35.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f627fc700 1 -- 172.21.15.88:0/3149116563 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1493289697 0 0) 0x7f7f44003230 con 0x7f7f6412e3a0 2020-02-11T16:25:35.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f5bfff700 1 -- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f640a18a0 msgr2=0x7f7f640a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:25:35.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f640a18a0 0x7f7f640a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:35.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f5bfff700 1 -- 172.21.15.88:0/3149116563 >> v1:172.21.15.88:6789/0 conn(0x7f7f6412e3a0 legacy=0x7f7f6412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:35.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.960+0000 7f7f5bfff700 1 -- 172.21.15.88:0/3149116563 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f640a3ab0 con 0x7f7f640a5de0 2020-02-11T16:25:35.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3149116563 >> v2:172.21.15.52:3300/0 conn(0x7f7f640a5de0 0x7f7f640a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7f5c001bf0 tx=0x7f7f4c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3149116563 >> v2:172.21.15.52:3300/0 conn(0x7f7f640a5de0 0x7f7f640a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7f5c001bf0 tx=0x7f7f4c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f640a5de0 0x7f7f640a6260 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f7f5c001bf0 tx=0x7f7f4c0088e0).ready entity=mon.0 client_cookie=feb4728ef6cc21bc server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:35.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f640a5de0 0x7f7f640a6260 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f7f5c001bf0 tx=0x7f7f4c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f627fc700 1 -- 172.21.15.88:0/3149116563 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f5c001a50 con 0x7f7f640a5de0 2020-02-11T16:25:35.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f640a5de0 0x7f7f640a6260 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f7f5c001bf0 tx=0x7f7f4c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f627fc700 1 -- 172.21.15.88:0/3149116563 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c008e40 con 0x7f7f640a5de0 2020-02-11T16:25:35.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f640a5de0 0x7f7f640a6260 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f7f5c001bf0 tx=0x7f7f4c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f627fc700 1 -- 172.21.15.88:0/3149116563 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f4c0114b0 con 0x7f7f640a5de0 2020-02-11T16:25:35.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f69513700 1 -- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f640a5de0 msgr2=0x7f7f640a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:35.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f69513700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f640a5de0 0x7f7f640a6260 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f7f5c001bf0 tx=0x7f7f4c0088e0).stop 2020-02-11T16:25:35.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f69513700 1 -- 172.21.15.88:0/3149116563 shutdown_connections 2020-02-11T16:25:35.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f69513700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f640a18a0 0x7f7f640a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:35.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f69513700 1 --2- 172.21.15.88:0/3149116563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f640a5de0 0x7f7f640a6260 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:35.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f69513700 1 -- 172.21.15.88:0/3149116563 >> 172.21.15.88:0/3149116563 conn(0x7f7f6409d110 msgr2=0x7f7f6409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:35.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f69513700 1 -- 172.21.15.88:0/3149116563 shutdown_connections 2020-02-11T16:25:35.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.961+0000 7f7f69513700 1 -- 172.21.15.88:0/3149116563 wait complete. 2020-02-11T16:25:35.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.962+0000 7f7f69513700 1 Processor -- start 2020-02-11T16:25:35.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.962+0000 7f7f69513700 1 -- start start 2020-02-11T16:25:35.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f69513700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f640a18a0 0x7f7f64134e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:35.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f69513700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f6412e3a0 0x7f7f64130d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:35.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f69513700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f641353a0 con 0x7f7f640a5de0 2020-02-11T16:25:35.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f69513700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f64135640 con 0x7f7f640a18a0 2020-02-11T16:25:35.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f69513700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6412f2f0 con 0x7f7f6412e3a0 2020-02-11T16:25:35.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f5bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7f640a5de0 0x7f7f6405a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46710/0 (socket says 172.21.15.88:46710) 2020-02-11T16:25:35.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f5bfff700 1 -- 172.21.15.88:0/4039955373 learned_addr learned my addr 172.21.15.88:0/4039955373 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:35.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> v2:172.21.15.88:3300/0 conn(0x7f7f6412e3a0 0x7f7f64130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:35.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f62ffd700 1 --2- 172.21.15.88:0/4039955373 >> v2:172.21.15.52:3300/0 conn(0x7f7f640a18a0 0x7f7f64134e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:35.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f60ff9700 1 -- 172.21.15.88:0/4039955373 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771599562 0 0) 0x7f7f641353a0 con 0x7f7f640a5de0 2020-02-11T16:25:35.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f60ff9700 1 -- 172.21.15.88:0/4039955373 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f48002fe0 con 0x7f7f640a5de0 2020-02-11T16:25:35.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f637fe700 1 -- 172.21.15.88:0/4039955373 >> v2:172.21.15.52:3300/0 conn(0x7f7f640a18a0 msgr2=0x7f7f64134e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:35.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> v2:172.21.15.52:3300/0 conn(0x7f7f640a18a0 0x7f7f64134e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:35.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f637fe700 1 -- 172.21.15.88:0/4039955373 >> v1:172.21.15.88:6789/0 conn(0x7f7f640a5de0 legacy=0x7f7f6405a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:35.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f637fe700 1 -- 172.21.15.88:0/4039955373 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64138360 con 0x7f7f6412e3a0 2020-02-11T16:25:35.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> v2:172.21.15.88:3300/0 conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> v2:172.21.15.88:3300/0 conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.963+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:35.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.964+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.964+0000 7f7f60ff9700 1 -- 172.21.15.88:0/4039955373 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f5c00ccd0 con 0x7f7f6412e3a0 2020-02-11T16:25:35.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.964+0000 7f7f69513700 1 -- 172.21.15.88:0/4039955373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f64138610 con 0x7f7f6412e3a0 2020-02-11T16:25:35.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.964+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.964+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.964+0000 7f7f60ff9700 1 -- 172.21.15.88:0/4039955373 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c00ce30 con 0x7f7f6412e3a0 2020-02-11T16:25:35.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.964+0000 7f7f60ff9700 1 -- 172.21.15.88:0/4039955373 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f5c004a60 con 0x7f7f6412e3a0 2020-02-11T16:25:35.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.964+0000 7f7f69513700 1 -- 172.21.15.88:0/4039955373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6405b230 con 0x7f7f6412e3a0 2020-02-11T16:25:35.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.964+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.965+0000 7f7f60ff9700 1 -- 172.21.15.88:0/4039955373 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7f5c004ca0 con 0x7f7f6412e3a0 2020-02-11T16:25:35.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.965+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.965+0000 7f7f69513700 1 -- 172.21.15.88:0/4039955373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6405a5d0 con 0x7f7f6412e3a0 2020-02-11T16:25:35.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.965+0000 7f7f60ff9700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7f48039fa0 0x7f7f4803c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:35.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.965+0000 7f7f60ff9700 1 -- 172.21.15.88:0/4039955373 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7f5c0499e0 con 0x7f7f6412e3a0 2020-02-11T16:25:35.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.965+0000 7f7f62ffd700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7f48039fa0 0x7f7f4803c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:35.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.965+0000 7f7f62ffd700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7f48039fa0 0x7f7f4803c460 crc :-1 s=READY pgs=454 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:35.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.968+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:35.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:35.968+0000 7f7f60ff9700 1 -- 172.21.15.88:0/4039955373 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f7f5c02efa0 con 0x7f7f6412e3a0 2020-02-11T16:25:36.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.179+0000 7f7f69513700 1 -- 172.21.15.88:0/4039955373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7f640565b0 con 0x7f7f6412e3a0 2020-02-11T16:25:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.179+0000 7f7f637fe700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.179+0000 7f7f60ff9700 1 -- 172.21.15.88:0/4039955373 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f7f5c031ab0 con 0x7f7f6412e3a0 2020-02-11T16:25:36.182 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":160,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:36.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 -- 172.21.15.88:0/4039955373 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7f48039fa0 msgr2=0x7f7f4803c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:36.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7f48039fa0 0x7f7f4803c460 crc :-1 s=READY pgs=454 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 -- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 msgr2=0x7f7f64130d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 0x7f7f64130d00 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f7f5c001cb0 tx=0x7f7f5c00c890).stop 2020-02-11T16:25:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 -- 172.21.15.88:0/4039955373 shutdown_connections 2020-02-11T16:25:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f6412e3a0 0x7f7f64130d00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 --2- 172.21.15.88:0/4039955373 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7f48039fa0 0x7f7f4803c460 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 --2- 172.21.15.88:0/4039955373 >> v2:172.21.15.52:3300/0 conn(0x7f7f640a18a0 0x7f7f64134e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 -- 172.21.15.88:0/4039955373 >> 172.21.15.88:0/4039955373 conn(0x7f7f6409d110 msgr2=0x7f7f640a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:36.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 -- 172.21.15.88:0/4039955373 shutdown_connections 2020-02-11T16:25:36.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:36.181+0000 7f7f69513700 1 -- 172.21.15.88:0/4039955373 wait complete. 2020-02-11T16:25:36.193 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":160,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:39.195 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:25:39.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.309+0000 7f4f19c7d700 1 Processor -- start 2020-02-11T16:25:39.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.309+0000 7f4f19c7d700 1 -- start start 2020-02-11T16:25:39.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.310+0000 7f4f19c7d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4f1413b6f0 0x7f4f14143640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:39.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.310+0000 7f4f19c7d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f14138360 con 0x7f4f14131f50 2020-02-11T16:25:39.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.310+0000 7f4f19c7d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f14138600 con 0x7f4f1413b290 2020-02-11T16:25:39.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.310+0000 7f4f19c7d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f14138180 con 0x7f4f1413b6f0 2020-02-11T16:25:39.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.310+0000 7f4f12ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4f1413b290 0x7f4f1409d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46718/0 (socket says 172.21.15.88:46718) 2020-02-11T16:25:39.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.310+0000 7f4f12ffd700 1 -- 172.21.15.88:0/1683923582 learned_addr learned my addr 172.21.15.88:0/1683923582 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:39.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f13fff700 1 --2- 172.21.15.88:0/1683923582 >> v2:172.21.15.52:3300/0 conn(0x7f4f1413b6f0 0x7f4f14143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f127fc700 1 -- 172.21.15.88:0/1683923582 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738428779 0 0) 0x7f4f14138600 con 0x7f4f1413b290 2020-02-11T16:25:39.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f127fc700 1 -- 172.21.15.88:0/1683923582 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f00003230 con 0x7f4f1413b290 2020-02-11T16:25:39.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f127fc700 1 -- 172.21.15.88:0/1683923582 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3201096558 0 0) 0x7f4f00003230 con 0x7f4f1413b290 2020-02-11T16:25:39.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f13fff700 1 -- 172.21.15.88:0/1683923582 >> v1:172.21.15.88:6789/0 conn(0x7f4f1413b290 legacy=0x7f4f1409d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f13fff700 1 -- 172.21.15.88:0/1683923582 >> v1:172.21.15.52:6789/0 conn(0x7f4f14131f50 legacy=0x7f4f1405f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f13fff700 1 -- 172.21.15.88:0/1683923582 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1409d8b0 con 0x7f4f1413b6f0 2020-02-11T16:25:39.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f13fff700 1 --2- 172.21.15.88:0/1683923582 >> v2:172.21.15.52:3300/0 conn(0x7f4f1413b6f0 0x7f4f14143640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f040010d0 tx=0x7f4f0c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f13fff700 1 --2- 172.21.15.88:0/1683923582 >> v2:172.21.15.52:3300/0 conn(0x7f4f1413b6f0 0x7f4f14143640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f040010d0 tx=0x7f4f0c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f13fff700 1 --2- 172.21.15.88:0/1683923582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1413b6f0 0x7f4f14143640 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f4f040010d0 tx=0x7f4f0c008c60).ready entity=mon.0 client_cookie=5807be5de8a88211 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f13fff700 1 --2- 172.21.15.88:0/1683923582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1413b6f0 0x7f4f14143640 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f4f040010d0 tx=0x7f4f0c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f127fc700 1 -- 172.21.15.88:0/1683923582 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f080016d0 con 0x7f4f1413b6f0 2020-02-11T16:25:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f13fff700 1 --2- 172.21.15.88:0/1683923582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1413b6f0 0x7f4f14143640 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f4f040010d0 tx=0x7f4f0c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f13fff700 1 --2- 172.21.15.88:0/1683923582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1413b6f0 0x7f4f14143640 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f4f040010d0 tx=0x7f4f0c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f127fc700 1 -- 172.21.15.88:0/1683923582 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c010b30 con 0x7f4f1413b6f0 2020-02-11T16:25:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f127fc700 1 -- 172.21.15.88:0/1683923582 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f0c010e90 con 0x7f4f1413b6f0 2020-02-11T16:25:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f19c7d700 1 -- 172.21.15.88:0/1683923582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1413b6f0 msgr2=0x7f4f14143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.311+0000 7f4f19c7d700 1 --2- 172.21.15.88:0/1683923582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1413b6f0 0x7f4f14143640 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f4f040010d0 tx=0x7f4f0c008c60).stop 2020-02-11T16:25:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.312+0000 7f4f19c7d700 1 -- 172.21.15.88:0/1683923582 shutdown_connections 2020-02-11T16:25:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.312+0000 7f4f19c7d700 1 --2- 172.21.15.88:0/1683923582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1413b6f0 0x7f4f14143640 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.312+0000 7f4f19c7d700 1 -- 172.21.15.88:0/1683923582 >> 172.21.15.88:0/1683923582 conn(0x7f4f140a7bb0 msgr2=0x7f4f140a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.312+0000 7f4f19c7d700 1 -- 172.21.15.88:0/1683923582 shutdown_connections 2020-02-11T16:25:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.312+0000 7f4f19c7d700 1 -- 172.21.15.88:0/1683923582 wait complete. 2020-02-11T16:25:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.313+0000 7f4f19c7d700 1 Processor -- start 2020-02-11T16:25:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.313+0000 7f4f19c7d700 1 -- start start 2020-02-11T16:25:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.313+0000 7f4f19c7d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4f14131f50 0x7f4f140a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.313+0000 7f4f19c7d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f14144e70 0x7f4f140a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.313+0000 7f4f19c7d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f140a5460 con 0x7f4f1413b290 2020-02-11T16:25:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.313+0000 7f4f19c7d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f140a0c80 con 0x7f4f14131f50 2020-02-11T16:25:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.313+0000 7f4f19c7d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1405baf0 con 0x7f4f14144e70 2020-02-11T16:25:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.313+0000 7f4f137fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4f14131f50 0x7f4f140a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4f14131f50 0x7f4f140a4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59096/0 (socket says 172.21.15.88:59096) 2020-02-11T16:25:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 -- 172.21.15.88:0/2470572444 learned_addr learned my addr 172.21.15.88:0/2470572444 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f13fff700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f14144e70 0x7f4f140a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 -- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f14144e70 msgr2=0x7f4f140a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f14144e70 0x7f4f140a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 -- 172.21.15.88:0/2470572444 >> v1:172.21.15.52:6789/0 conn(0x7f4f1413b290 legacy=0x7f4f140a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 -- 172.21.15.88:0/2470572444 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f140a3ed0 con 0x7f4f14131f50 2020-02-11T16:25:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f13fff700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f14144e70 0x7f4f140a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:25:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> v2:172.21.15.88:3300/0 conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> v2:172.21.15.88:3300/0 conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f10ff9700 1 -- 172.21.15.88:0/2470572444 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f0400cc20 con 0x7f4f14131f50 2020-02-11T16:25:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f10ff9700 1 -- 172.21.15.88:0/2470572444 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400cd80 con 0x7f4f14131f50 2020-02-11T16:25:39.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f19c7d700 1 -- 172.21.15.88:0/2470572444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f140a4170 con 0x7f4f14131f50 2020-02-11T16:25:39.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f10ff9700 1 -- 172.21.15.88:0/2470572444 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f040123f0 con 0x7f4f14131f50 2020-02-11T16:25:39.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.314+0000 7f4f19c7d700 1 -- 172.21.15.88:0/2470572444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f14145540 con 0x7f4f14131f50 2020-02-11T16:25:39.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.315+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.315+0000 7f4f10ff9700 1 -- 172.21.15.88:0/2470572444 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4f04012670 con 0x7f4f14131f50 2020-02-11T16:25:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.315+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.315+0000 7f4f19c7d700 1 -- 172.21.15.88:0/2470572444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f140565b0 con 0x7f4f14131f50 2020-02-11T16:25:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.316+0000 7f4f10ff9700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ef4039c80 0x7f4ef403c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.316+0000 7f4f10ff9700 1 -- 172.21.15.88:0/2470572444 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4f04049ab0 con 0x7f4f14131f50 2020-02-11T16:25:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.316+0000 7f4f12ffd700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ef4039c80 0x7f4ef403c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.316+0000 7f4f12ffd700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ef4039c80 0x7f4ef403c140 crc :-1 s=READY pgs=455 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.319+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.319+0000 7f4f10ff9700 1 -- 172.21.15.88:0/2470572444 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4f0402f070 con 0x7f4f14131f50 2020-02-11T16:25:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.541+0000 7f4f19c7d700 1 -- 172.21.15.88:0/2470572444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4f140a4300 con 0x7f4f14131f50 2020-02-11T16:25:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.541+0000 7f4f137fe700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.541+0000 7f4f10ff9700 1 -- 172.21.15.88:0/2470572444 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f4f04031b80 con 0x7f4f14131f50 2020-02-11T16:25:39.544 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":162,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 -- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ef4039c80 msgr2=0x7f4ef403c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ef4039c80 0x7f4ef403c140 crc :-1 s=READY pgs=455 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 -- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 msgr2=0x7f4f140a4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 0x7f4f140a4f50 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f4f1406a280 tx=0x7f4f04010ba0).stop 2020-02-11T16:25:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 -- 172.21.15.88:0/2470572444 shutdown_connections 2020-02-11T16:25:39.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ef4039c80 0x7f4ef403c140 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f14144e70 0x7f4f140a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 --2- 172.21.15.88:0/2470572444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14131f50 0x7f4f140a4f50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 -- 172.21.15.88:0/2470572444 >> 172.21.15.88:0/2470572444 conn(0x7f4f140a7bb0 msgr2=0x7f4f14065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:39.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 -- 172.21.15.88:0/2470572444 shutdown_connections 2020-02-11T16:25:39.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.543+0000 7f4f19c7d700 1 -- 172.21.15.88:0/2470572444 wait complete. 2020-02-11T16:25:39.556 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":162,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:39.556 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:25:39.557 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:25:39.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.670+0000 7f13563a1700 1 Processor -- start 2020-02-11T16:25:39.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.670+0000 7f13563a1700 1 -- start start 2020-02-11T16:25:39.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.671+0000 7f13563a1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13500a3490 0x7f13501384f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:39.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.671+0000 7f13563a1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13500a45c0 con 0x7f13500a4050 2020-02-11T16:25:39.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.671+0000 7f13563a1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135013c090 con 0x7f1350138950 2020-02-11T16:25:39.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.671+0000 7f13563a1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13500a47f0 con 0x7f13500a3490 2020-02-11T16:25:39.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.671+0000 7f134ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13500a3490 0x7f13501384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.671+0000 7f134ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13500a3490 0x7f13501384f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59104/0 (socket says 172.21.15.88:59104) 2020-02-11T16:25:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.671+0000 7f134ffff700 1 -- 172.21.15.88:0/834724398 learned_addr learned my addr 172.21.15.88:0/834724398 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.671+0000 7f135493e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1350138950 0x7f135013b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46734/0 (socket says 172.21.15.88:46734) 2020-02-11T16:25:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134ffff700 1 -- 172.21.15.88:0/834724398 >> v1:172.21.15.88:6789/0 conn(0x7f1350138950 legacy=0x7f135013b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134ffff700 1 -- 172.21.15.88:0/834724398 >> v1:172.21.15.52:6789/0 conn(0x7f13500a4050 legacy=0x7f135013b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134ffff700 1 -- 172.21.15.88:0/834724398 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350137db0 con 0x7f13500a3490 2020-02-11T16:25:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134ffff700 1 --2- 172.21.15.88:0/834724398 >> v2:172.21.15.88:3300/0 conn(0x7f13500a3490 0x7f13501384f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1340002f30 tx=0x7f13400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134ffff700 1 --2- 172.21.15.88:0/834724398 >> v2:172.21.15.88:3300/0 conn(0x7f13500a3490 0x7f13501384f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1340002f30 tx=0x7f13400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134ffff700 1 --2- 172.21.15.88:0/834724398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13500a3490 0x7f13501384f0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f1340002f30 tx=0x7f13400088e0).ready entity=mon.1 client_cookie=38e24c413e704d15 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134ffff700 1 --2- 172.21.15.88:0/834724398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13500a3490 0x7f13501384f0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f1340002f30 tx=0x7f13400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134ffff700 1 --2- 172.21.15.88:0/834724398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13500a3490 0x7f13501384f0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f1340002f30 tx=0x7f13400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134effd700 1 -- 172.21.15.88:0/834724398 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1340008e10 con 0x7f13500a3490 2020-02-11T16:25:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134ffff700 1 --2- 172.21.15.88:0/834724398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13500a3490 0x7f13501384f0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f1340002f30 tx=0x7f13400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134effd700 1 -- 172.21.15.88:0/834724398 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1340010800 con 0x7f13500a3490 2020-02-11T16:25:39.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f134effd700 1 -- 172.21.15.88:0/834724398 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1340010be0 con 0x7f13500a3490 2020-02-11T16:25:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f13563a1700 1 -- 172.21.15.88:0/834724398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13500a3490 msgr2=0x7f13501384f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.672+0000 7f13563a1700 1 --2- 172.21.15.88:0/834724398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13500a3490 0x7f13501384f0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f1340002f30 tx=0x7f13400088e0).stop 2020-02-11T16:25:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.673+0000 7f13563a1700 1 -- 172.21.15.88:0/834724398 shutdown_connections 2020-02-11T16:25:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.673+0000 7f13563a1700 1 --2- 172.21.15.88:0/834724398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13500a3490 0x7f13501384f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.673+0000 7f13563a1700 1 -- 172.21.15.88:0/834724398 >> 172.21.15.88:0/834724398 conn(0x7f13500aa480 msgr2=0x7f13500aa890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.673+0000 7f13563a1700 1 -- 172.21.15.88:0/834724398 shutdown_connections 2020-02-11T16:25:39.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.673+0000 7f13563a1700 1 -- 172.21.15.88:0/834724398 wait complete. 2020-02-11T16:25:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.673+0000 7f13563a1700 1 Processor -- start 2020-02-11T16:25:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.673+0000 7f13563a1700 1 -- start start 2020-02-11T16:25:39.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.674+0000 7f13563a1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 0x7f1350134c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.674+0000 7f13563a1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1350135560 con 0x7f13500a3490 2020-02-11T16:25:39.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.674+0000 7f13563a1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1350133050 con 0x7f13500a4050 2020-02-11T16:25:39.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.674+0000 7f13563a1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13501345d0 con 0x7f1350138950 2020-02-11T16:25:39.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.674+0000 7f134f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f13500a4050 0x7f1350136fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46738/0 (socket says 172.21.15.88:46738) 2020-02-11T16:25:39.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.674+0000 7f134f7fe700 1 -- 172.21.15.88:0/4068187121 learned_addr learned my addr 172.21.15.88:0/4068187121 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:39.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f135493e700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 0x7f1350134c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312061602 0 0) 0x7f1350133050 con 0x7f13500a4050 2020-02-11T16:25:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1330002fe0 con 0x7f13500a4050 2020-02-11T16:25:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f135493e700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 msgr2=0x7f1350134c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:25:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f135493e700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 msgr2=0x7f1350134c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:25:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f135493e700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 0x7f1350134c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f135493e700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 0x7f1350134c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2438057303 0 0) 0x7f1330002fe0 con 0x7f13500a4050 2020-02-11T16:25:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1350133050 con 0x7f13500a4050 2020-02-11T16:25:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170163218 0 0) 0x7f1350135560 con 0x7f13500a3490 2020-02-11T16:25:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1330002fe0 con 0x7f13500a3490 2020-02-11T16:25:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f13440019c0 con 0x7f13500a4050 2020-02-11T16:25:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 msgr2=0x7f1350134c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:25:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 0x7f1350134c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 >> v1:172.21.15.88:6789/0 conn(0x7f13500a4050 legacy=0x7f1350136fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 >> v1:172.21.15.52:6789/0 conn(0x7f13500a3490 legacy=0x7f1350144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1330004b60 0x7f1330004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 0x7f13300041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330004640 con 0x7f1330004b60 2020-02-11T16:25:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13300047b0 con 0x7f1330003920 2020-02-11T16:25:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133000b750 con 0x7f1350138950 2020-02-11T16:25:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1330004b60 0x7f1330004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f135493e700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 0x7f13300041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f135493e700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 msgr2=0x7f13300041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:25:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f135493e700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 msgr2=0x7f13300041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:25:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f135493e700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 0x7f13300041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f135493e700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 0x7f13300041e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:39.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134f7fe700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 msgr2=0x7f13300041e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:25:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1350138950 0x7f13300041e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134f7fe700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1330004b60 msgr2=0x7f1330004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1330004b60 0x7f1330004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f134f7fe700 1 -- 172.21.15.88:0/4068187121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13501347c0 con 0x7f1330003920 2020-02-11T16:25:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.675+0000 7f13563a1700 1 -- 172.21.15.88:0/4068187121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135013a5c0 con 0x7f1330003920 2020-02-11T16:25:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13440016d0 tx=0x7f13440113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f13563a1700 1 -- 172.21.15.88:0/4068187121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1350132d70 con 0x7f1330003920 2020-02-11T16:25:39.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13440016d0 tx=0x7f13440113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f13440016d0 tx=0x7f13440113d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f13440016d0 tx=0x7f13440113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f13440016d0 tx=0x7f13440113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f13440016d0 tx=0x7f13440113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f13440016d0 tx=0x7f13440113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f134400eea0 con 0x7f1330003920 2020-02-11T16:25:39.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344011de0 con 0x7f1330003920 2020-02-11T16:25:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1344010390 con 0x7f1330003920 2020-02-11T16:25:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f13563a1700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 0x7f1350134b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.676+0000 7f13563a1700 1 -- 172.21.15.88:0/4068187121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135005e2f0 con 0x7f135013b9a0 2020-02-11T16:25:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 0x7f1350134b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134f7fe700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f13440016d0 tx=0x7f13440113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f13440105b0 con 0x7f1330003920 2020-02-11T16:25:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134d7fa700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1330042270 0x7f1330044730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134ffff700 1 -- 172.21.15.88:0/4068187121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13500565b0 con 0x7f135013b9a0 2020-02-11T16:25:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f1344049cc0 con 0x7f1330003920 2020-02-11T16:25:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 0x7f1350134b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 0x7f1350134b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f135493e700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1330042270 0x7f1330044730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 0x7f1350134b80 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 0x7f1350134b80 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f134000f940 con 0x7f135013b9a0 2020-02-11T16:25:39.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f135493e700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1330042270 0x7f1330044730 crc :-1 s=READY pgs=456 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 0x7f1350134b80 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f1340007350 con 0x7f135013b9a0 2020-02-11T16:25:39.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 msgr2=0x7f1350134b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134d7fa700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 0x7f1350134b80 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).stop 2020-02-11T16:25:39.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 msgr2=0x7f1350134b80 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:39.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f134d7fa700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f135013b9a0 0x7f1350134b80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.677+0000 7f135493e700 1 -- 172.21.15.88:0/4068187121 reap_dead start 2020-02-11T16:25:39.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.690+0000 7f13563a1700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 0x7f1350136fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.690+0000 7f13563a1700 1 -- 172.21.15.88:0/4068187121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135013a750 con 0x7f1350144f60 2020-02-11T16:25:39.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.690+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 0x7f1350136fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.690+0000 7f134ffff700 1 -- 172.21.15.88:0/4068187121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1350134950 con 0x7f1350144f60 2020-02-11T16:25:39.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.690+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 0x7f1350136fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 0x7f1350136fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 0x7f1350136fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 0x7f1350136fb0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f134000f020 con 0x7f1350144f60 2020-02-11T16:25:39.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f134ffff700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 0x7f1350136fb0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f1340015640 con 0x7f1350144f60 2020-02-11T16:25:39.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 msgr2=0x7f1350136fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f134d7fa700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 0x7f1350136fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).stop 2020-02-11T16:25:39.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f134d7fa700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 msgr2=0x7f1350136fb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:39.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f134d7fa700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 0x7f1350136fb0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0x7f135013a4f0 tx=0x7f135013c220).stop 2020-02-11T16:25:39.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1330042270 msgr2=0x7f1330044730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1330042270 0x7f1330044730 crc :-1 s=READY pgs=456 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 -- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 msgr2=0x7f1330003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f13440016d0 tx=0x7f13440113d0).stop 2020-02-11T16:25:39.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 -- 172.21.15.88:0/4068187121 shutdown_connections 2020-02-11T16:25:39.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1330042270 0x7f1330044730 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1330003920 0x7f1330003d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 --2- 172.21.15.88:0/4068187121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1350144f60 0x7f1350136fb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 -- 172.21.15.88:0/4068187121 >> 172.21.15.88:0/4068187121 conn(0x7f13500aa480 msgr2=0x7f13500a3870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:39.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 -- 172.21.15.88:0/4068187121 shutdown_connections 2020-02-11T16:25:39.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.691+0000 7f13563a1700 1 -- 172.21.15.88:0/4068187121 wait complete. 2020-02-11T16:25:39.700 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:25:39.700 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:39.701 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:39.701 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:25:39.701 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 162, 2020-02-11T16:25:39.701 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:25:39.701 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:25:39.701 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:25:39.702 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:25:39.702 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.702 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:25:39.702 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:39.702 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:25:39.702 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:25:39.702 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:39.702 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:39.703 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:39.703 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:39.703 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:39.703 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:39.703 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.703 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:25:39.703 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:25:39.704 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:39.704 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:39.704 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:39.704 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:39.704 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:39.704 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:39.704 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.705 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:25:39.705 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:25:39.705 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:25:39.705 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:25:39.705 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:25:39.705 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:25:39.705 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:39.705 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:39.706 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:25:39.706 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:25:39.706 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:39.706 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:25:39.706 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:39.706 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:39.706 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:39.707 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:39.707 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:39.707 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:39.707 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.707 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:25:39.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.707 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:25:39.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.708 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:39.708 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:39.708 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:39.708 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:39.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.708 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:39.708 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:25:39.708 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.709 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:39.709 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:25:39.709 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.709 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.709 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.710 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:25:39.710 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:25:39.710 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:39.710 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:39.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.710 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:39.710 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:39.711 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:39.711 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:39.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.711 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:39.711 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:25:39.711 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.712 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:39.712 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:25:39.712 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.712 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.712 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.712 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:25:39.712 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:25:39.713 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:39.713 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:39.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.713 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:25:39.713 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:25:39.715 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:39.715 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:39.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.715 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:39.716 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:25:39.716 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.716 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:39.716 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:25:39.716 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.716 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.717 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.717 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:25:39.717 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:25:39.717 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:39.717 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:39.717 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.718 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.718 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:25:39.718 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:25:39.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.718 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:39.718 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:39.718 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:25:39.719 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.719 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.719 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:25:39.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.719 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:39.719 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:39.719 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:25:39.720 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.720 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.720 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:25:39.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.720 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:39.720 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:39.720 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:25:39.720 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.721 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.721 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:25:39.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.721 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:39.721 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:39.721 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:25:39.721 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.721 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.722 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:25:39.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.722 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:39.722 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:39.722 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:25:39.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.722 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.723 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:25:39.724 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:25:39.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.839+0000 7fd6ba514700 1 Processor -- start 2020-02-11T16:25:39.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.839+0000 7fd6ba514700 1 -- start start 2020-02-11T16:25:39.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6ba514700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a9130 0x7fd6b41314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:39.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6ba514700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd6b4131920 0x7fd6b4131d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:39.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6ba514700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b40adb40 con 0x7fd6b40ad380 2020-02-11T16:25:39.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6ba514700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b4137bf0 con 0x7fd6b4131920 2020-02-11T16:25:39.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6ba514700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4137de0 con 0x7fd6b40a9130 2020-02-11T16:25:39.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b3fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd6b40ad380 0x7fd6b4138280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46754/0 (socket says 172.21.15.88:46754) 2020-02-11T16:25:39.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b3fff700 1 -- 172.21.15.88:0/2296530633 learned_addr learned my addr 172.21.15.88:0/2296530633 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:39.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a9130 0x7fd6b41314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/2296530633 >> v2:172.21.15.52:3300/0 conn(0x7fd6b4131920 0x7fd6b4131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b37fe700 1 -- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a9130 msgr2=0x7fd6b41314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:25:39.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b37fe700 1 -- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a9130 msgr2=0x7fd6b41314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:25:39.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a9130 0x7fd6b41314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:39.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b2ffd700 1 -- 172.21.15.88:0/2296530633 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507237693 0 0) 0x7fd6b40adb40 con 0x7fd6b40ad380 2020-02-11T16:25:39.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a9130 0x7fd6b41314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b2ffd700 1 -- 172.21.15.88:0/2296530633 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6a0003230 con 0x7fd6b40ad380 2020-02-11T16:25:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b8ab1700 1 -- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a9130 msgr2=0x7fd6b41314c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:25:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a9130 0x7fd6b41314c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b8ab1700 1 -- 172.21.15.88:0/2296530633 >> v1:172.21.15.88:6789/0 conn(0x7fd6b40ad380 legacy=0x7fd6b4138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b8ab1700 1 -- 172.21.15.88:0/2296530633 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40a8e70 con 0x7fd6b4131920 2020-02-11T16:25:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/2296530633 >> v2:172.21.15.52:3300/0 conn(0x7fd6b4131920 0x7fd6b4131d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd6ac0032b0 tx=0x7fd6ac008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/2296530633 >> v2:172.21.15.52:3300/0 conn(0x7fd6b4131920 0x7fd6b4131d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd6ac0032b0 tx=0x7fd6ac008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.840+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131920 0x7fd6b4131d60 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fd6ac0032b0 tx=0x7fd6ac008c60).ready entity=mon.0 client_cookie=f447a913483fa6d8 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131920 0x7fd6b4131d60 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd6ac0032b0 tx=0x7fd6ac008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6b2ffd700 1 -- 172.21.15.88:0/2296530633 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ac011e60 con 0x7fd6b4131920 2020-02-11T16:25:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131920 0x7fd6b4131d60 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd6ac0032b0 tx=0x7fd6ac008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6b2ffd700 1 -- 172.21.15.88:0/2296530633 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac00a160 con 0x7fd6b4131920 2020-02-11T16:25:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131920 0x7fd6b4131d60 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd6ac0032b0 tx=0x7fd6ac008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6b2ffd700 1 -- 172.21.15.88:0/2296530633 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ac00a500 con 0x7fd6b4131920 2020-02-11T16:25:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6ba514700 1 -- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131920 msgr2=0x7fd6b4131d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6ba514700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131920 0x7fd6b4131d60 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fd6ac0032b0 tx=0x7fd6ac008c60).stop 2020-02-11T16:25:39.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6ba514700 1 -- 172.21.15.88:0/2296530633 shutdown_connections 2020-02-11T16:25:39.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6ba514700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131920 0x7fd6b4131d60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6ba514700 1 --2- 172.21.15.88:0/2296530633 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b40a9130 0x7fd6b41314c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:39.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6ba514700 1 -- 172.21.15.88:0/2296530633 >> 172.21.15.88:0/2296530633 conn(0x7fd6b405ac70 msgr2=0x7fd6b40ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:39.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6ba514700 1 -- 172.21.15.88:0/2296530633 shutdown_connections 2020-02-11T16:25:39.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.841+0000 7fd6ba514700 1 -- 172.21.15.88:0/2296530633 wait complete. 2020-02-11T16:25:39.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.842+0000 7fd6ba514700 1 Processor -- start 2020-02-11T16:25:39.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.842+0000 7fd6ba514700 1 -- start start 2020-02-11T16:25:39.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6ba514700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd6b40a9130 0x7fd6b4145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6ba514700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b4131920 0x7fd6b40a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6ba514700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b412f830 con 0x7fd6b40ad380 2020-02-11T16:25:39.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6ba514700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b40a5fd0 con 0x7fd6b40a9130 2020-02-11T16:25:39.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6ba514700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b412fad0 con 0x7fd6b4131920 2020-02-11T16:25:39.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6b37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd6b40ad380 0x7fd6b4144b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46762/0 (socket says 172.21.15.88:46762) 2020-02-11T16:25:39.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6b37fe700 1 -- 172.21.15.88:0/3461556038 learned_addr learned my addr 172.21.15.88:0/3461556038 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:39.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6b3fff700 1 --2- 172.21.15.88:0/3461556038 >> v2:172.21.15.52:3300/0 conn(0x7fd6b40a9130 0x7fd6b4145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455346690 0 0) 0x7fd6b412f830 con 0x7fd6b40ad380 2020-02-11T16:25:39.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b4131920 0x7fd6b40a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.843+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd694002fe0 con 0x7fd6b40ad380 2020-02-11T16:25:39.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b8ab1700 1 -- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b4131920 msgr2=0x7fd6b40a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:25:39.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b8ab1700 1 -- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b4131920 msgr2=0x7fd6b40a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:25:39.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b4131920 0x7fd6b40a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:39.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b4131920 0x7fd6b40a6a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:39.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2507172539 0 0) 0x7fd694002fe0 con 0x7fd6b40ad380 2020-02-11T16:25:39.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd6b412f830 con 0x7fd6b40ad380 2020-02-11T16:25:39.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fd6a80015a0 con 0x7fd6b40ad380 2020-02-11T16:25:39.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b3fff700 1 -- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b4131920 msgr2=0x7fd6b40a6a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:25:39.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b3fff700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6b4131920 0x7fd6b40a6a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b3fff700 1 -- 172.21.15.88:0/3461556038 >> v1:172.21.15.88:6789/0 conn(0x7fd6b40ad380 legacy=0x7fd6b4144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b3fff700 1 -- 172.21.15.88:0/3461556038 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b412fd70 con 0x7fd6b40a9130 2020-02-11T16:25:39.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b3fff700 1 --2- 172.21.15.88:0/3461556038 >> v2:172.21.15.52:3300/0 conn(0x7fd6b40a9130 0x7fd6b4145720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6a40010d0 tx=0x7fd6a40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b3fff700 1 --2- 172.21.15.88:0/3461556038 >> v2:172.21.15.52:3300/0 conn(0x7fd6b40a9130 0x7fd6b4145720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6a40010d0 tx=0x7fd6a40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b3fff700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b40a9130 0x7fd6b4145720 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7fd6a40010d0 tx=0x7fd6a40108e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b3fff700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b40a9130 0x7fd6b4145720 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fd6a40010d0 tx=0x7fd6a40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a4005ab0 con 0x7fd6b40a9130 2020-02-11T16:25:39.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b3fff700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b40a9130 0x7fd6b4145720 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fd6a40010d0 tx=0x7fd6a40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6ba514700 1 -- 172.21.15.88:0/3461556038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b412e010 con 0x7fd6b40a9130 2020-02-11T16:25:39.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a4005c10 con 0x7fd6b40a9130 2020-02-11T16:25:39.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b3fff700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b40a9130 0x7fd6b4145720 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fd6a40010d0 tx=0x7fd6a40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a40060c0 con 0x7fd6b40a9130 2020-02-11T16:25:39.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.844+0000 7fd6ba514700 1 -- 172.21.15.88:0/3461556038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b41303d0 con 0x7fd6b40a9130 2020-02-11T16:25:39.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.845+0000 7fd6b3fff700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b40a9130 0x7fd6b4145720 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fd6a40010d0 tx=0x7fd6a40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.845+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd6a400a320 con 0x7fd6b40a9130 2020-02-11T16:25:39.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.845+0000 7fd6ba514700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 0x7fd6b4130b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.845+0000 7fd6ba514700 1 -- 172.21.15.88:0/3461556038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b405e2f0 con 0x7fd6b4131d00 2020-02-11T16:25:39.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.845+0000 7fd6b3fff700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b40a9130 0x7fd6b4145720 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fd6a40010d0 tx=0x7fd6a40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.845+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 0x7fd6b4130b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.845+0000 7fd6b17fa700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69403a1f0 0x7fd69403c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.845+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fd6a4049660 con 0x7fd6b40a9130 2020-02-11T16:25:39.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.845+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69403a1f0 0x7fd69403c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b8ab1700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69403a1f0 0x7fd69403c6b0 crc :-1 s=READY pgs=457 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b37fe700 1 -- 172.21.15.88:0/3461556038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6b412ff00 con 0x7fd6b4131d00 2020-02-11T16:25:39.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 0x7fd6b4130b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a800ccf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 0x7fd6b4130b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a800ccf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 0x7fd6b4130b30 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a800ccf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 0x7fd6b4130b30 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a800ccf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a800e540 con 0x7fd6b4131d00 2020-02-11T16:25:39.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 0x7fd6b4130b30 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a800ccf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fd6a800e6a0 con 0x7fd6b4131d00 2020-02-11T16:25:39.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 msgr2=0x7fd6b4130b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b17fa700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 0x7fd6b4130b30 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a800ccf0).stop 2020-02-11T16:25:39.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 msgr2=0x7fd6b4130b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:39.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.846+0000 7fd6b17fa700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4131d00 0x7fd6b4130b30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.855+0000 7fd6ba514700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 0x7fd6b4135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:39.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.855+0000 7fd6ba514700 1 -- 172.21.15.88:0/3461556038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40565b0 con 0x7fd6b4130f90 2020-02-11T16:25:39.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.855+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 0x7fd6b4135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:39.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b37fe700 1 -- 172.21.15.88:0/3461556038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd6b405ccb0 con 0x7fd6b4130f90 2020-02-11T16:25:39.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 0x7fd6b4135b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a8012d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 0x7fd6b4135b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a8012d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 0x7fd6b4135b60 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a8012d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:39.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 0x7fd6b4135b60 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a8012d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a8007350 con 0x7fd6b4130f90 2020-02-11T16:25:39.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b37fe700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 0x7fd6b4135b60 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a8012d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:39.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4022 (secure 0 0 0) 0x7fd6a80074b0 con 0x7fd6b4130f90 2020-02-11T16:25:39.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 msgr2=0x7fd6b4135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b17fa700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 0x7fd6b4135b60 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a8012d10).stop 2020-02-11T16:25:39.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b17fa700 1 -- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 msgr2=0x7fd6b4135b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:39.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6b17fa700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b4130f90 0x7fd6b4135b60 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0x7fd6a8007a80 tx=0x7fd6a8012d10).stop 2020-02-11T16:25:39.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.856+0000 7fd6ba514700 1 -- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69403a1f0 msgr2=0x7fd69403c6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.857+0000 7fd6ba514700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd69403a1f0 0x7fd69403c6b0 crc :-1 s=READY pgs=457 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.857+0000 7fd6ba514700 1 -- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b40a9130 msgr2=0x7fd6b4145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.857+0000 7fd6ba514700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b40a9130 0x7fd6b4145720 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7fd6a40010d0 tx=0x7fd6a40108e0).stop 2020-02-11T16:25:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.857+0000 7fd6b8ab1700 1 -- 172.21.15.88:0/3461556038 reap_dead start 2020-02-11T16:25:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.857+0000 7fd6b8ab1700 1 -- 172.21.15.88:0/3461556038 reap_dead start 2020-02-11T16:25:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.857+0000 7fd6ba514700 1 -- 172.21.15.88:0/3461556038 shutdown_connections 2020-02-11T16:25:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.857+0000 7fd6ba514700 1 --2- 172.21.15.88:0/3461556038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6b40a9130 0x7fd6b4145720 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.857+0000 7fd6ba514700 1 -- 172.21.15.88:0/3461556038 >> 172.21.15.88:0/3461556038 conn(0x7fd6b405ac70 msgr2=0x7fd6b412bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.857+0000 7fd6ba514700 1 -- 172.21.15.88:0/3461556038 shutdown_connections 2020-02-11T16:25:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:39.857+0000 7fd6ba514700 1 -- 172.21.15.88:0/3461556038 wait complete. 2020-02-11T16:25:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:25:39.868 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:39.868 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:39.869 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:25:39.869 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 162, 2020-02-11T16:25:39.869 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:25:39.869 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:25:39.869 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:25:39.869 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:25:39.869 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.870 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:25:39.870 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:39.870 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:25:39.870 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:25:39.870 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:39.870 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:39.870 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:39.871 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:39.871 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:39.871 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:39.871 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.871 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:25:39.871 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:25:39.871 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:39.872 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:39.872 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:39.872 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:39.872 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:39.872 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:39.872 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.872 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:25:39.873 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:25:39.873 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:25:39.873 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:25:39.873 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:25:39.873 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:25:39.873 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:39.873 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:39.874 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:25:39.874 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:25:39.874 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:39.874 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:25:39.874 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:39.874 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:39.874 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:39.875 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:39.875 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:39.875 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:39.875 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.875 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:25:39.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.875 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:25:39.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.876 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:39.876 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:39.876 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:39.876 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:39.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.876 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:39.876 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:25:39.877 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.877 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:39.877 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:25:39.877 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.877 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.878 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.878 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:25:39.878 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:25:39.878 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:39.878 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:39.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:25:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:25:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.881 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:25:39.881 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:25:39.881 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:39.881 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:39.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.881 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:25:39.882 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:25:39.882 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:39.882 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:39.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.882 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:39.882 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:25:39.882 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.883 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:39.883 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:25:39.883 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:39.883 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.883 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.884 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:25:39.884 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:25:39.884 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:39.884 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:39.884 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.884 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:39.885 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:25:39.885 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:25:39.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.885 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:39.885 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:39.885 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:25:39.885 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.886 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.886 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:25:39.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.886 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:39.886 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:39.886 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:25:39.886 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.886 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:39.887 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:25:39.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:39.887 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:39.887 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:39.887 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:25:39.887 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.887 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:39.888 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:25:39.889 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:25:40.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.001+0000 7f512ef1a700 1 Processor -- start 2020-02-11T16:25:40.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.002+0000 7f512ef1a700 1 -- start start 2020-02-11T16:25:40.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.002+0000 7f512ef1a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5128131bd0 0x7f5128132010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:40.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.002+0000 7f512ef1a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51280adb40 con 0x7f51280a9130 2020-02-11T16:25:40.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.002+0000 7f512ef1a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5128137de0 con 0x7f51280ad380 2020-02-11T16:25:40.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.002+0000 7f512ef1a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5128137bf0 con 0x7f5128131bd0 2020-02-11T16:25:40.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5128131bd0 0x7f5128132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:40.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512ccb6700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f51280ad380 0x7f5128138280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46772/0 (socket says 172.21.15.88:46772) 2020-02-11T16:25:40.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5128131bd0 0x7f5128132010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59150/0 (socket says 172.21.15.88:59150) 2020-02-11T16:25:40.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 -- 172.21.15.88:0/3712805209 learned_addr learned my addr 172.21.15.88:0/3712805209 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:40.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 -- 172.21.15.88:0/3712805209 >> v1:172.21.15.88:6789/0 conn(0x7f51280ad380 legacy=0x7f5128138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:40.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 -- 172.21.15.88:0/3712805209 >> v1:172.21.15.52:6789/0 conn(0x7f51280a9130 legacy=0x7f51281314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:40.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 -- 172.21.15.88:0/3712805209 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280a95c0 con 0x7f5128131bd0 2020-02-11T16:25:40.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f51277fe700 1 -- 172.21.15.88:0/3712805209 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736250416 0 0) 0x7f51280adb40 con 0x7f51280a9130 2020-02-11T16:25:40.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3712805209 >> v2:172.21.15.88:3300/0 conn(0x7f5128131bd0 0x7f5128132010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51180010d0 tx=0x7f5120008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3712805209 >> v2:172.21.15.88:3300/0 conn(0x7f5128131bd0 0x7f5128132010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51180010d0 tx=0x7f5120008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3712805209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5128131bd0 0x7f5128132010 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f51180010d0 tx=0x7f5120008c60).ready entity=mon.1 client_cookie=58c4ed78ee72f1a1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:40.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3712805209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5128131bd0 0x7f5128132010 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f51180010d0 tx=0x7f5120008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f51277fe700 1 -- 172.21.15.88:0/3712805209 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5120010ea0 con 0x7f5128131bd0 2020-02-11T16:25:40.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3712805209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5128131bd0 0x7f5128132010 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f51180010d0 tx=0x7f5120008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3712805209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5128131bd0 0x7f5128132010 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f51180010d0 tx=0x7f5120008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f51277fe700 1 -- 172.21.15.88:0/3712805209 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51200110c0 con 0x7f5128131bd0 2020-02-11T16:25:40.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f51277fe700 1 -- 172.21.15.88:0/3712805209 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5120011420 con 0x7f5128131bd0 2020-02-11T16:25:40.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512ef1a700 1 -- 172.21.15.88:0/3712805209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5128131bd0 msgr2=0x7f5128132010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:40.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.003+0000 7f512ef1a700 1 --2- 172.21.15.88:0/3712805209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5128131bd0 0x7f5128132010 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f51180010d0 tx=0x7f5120008c60).stop 2020-02-11T16:25:40.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.004+0000 7f512ef1a700 1 -- 172.21.15.88:0/3712805209 shutdown_connections 2020-02-11T16:25:40.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.004+0000 7f512ef1a700 1 --2- 172.21.15.88:0/3712805209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5128131bd0 0x7f5128132010 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:40.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.004+0000 7f512ef1a700 1 -- 172.21.15.88:0/3712805209 >> 172.21.15.88:0/3712805209 conn(0x7f512805ac70 msgr2=0x7f51280ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:40.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.004+0000 7f512ef1a700 1 -- 172.21.15.88:0/3712805209 shutdown_connections 2020-02-11T16:25:40.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.004+0000 7f512ef1a700 1 -- 172.21.15.88:0/3712805209 wait complete. 2020-02-11T16:25:40.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.005+0000 7f512ef1a700 1 Processor -- start 2020-02-11T16:25:40.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.005+0000 7f512ef1a700 1 -- start start 2020-02-11T16:25:40.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.005+0000 7f512ef1a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51280a9130 0x7f5128135bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:40.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.005+0000 7f512ef1a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128131bd0 0x7f5128126580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:40.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.005+0000 7f512ef1a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51281367d0 con 0x7f51280ad380 2020-02-11T16:25:40.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.005+0000 7f512ef1a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5128136f90 con 0x7f51280a9130 2020-02-11T16:25:40.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.005+0000 7f512ef1a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5128136cf0 con 0x7f5128131bd0 2020-02-11T16:25:40.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51280a9130 0x7f5128135bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:40.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51280a9130 0x7f5128135bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59152/0 (socket says 172.21.15.88:59152) 2020-02-11T16:25:40.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 -- 172.21.15.88:0/3543648359 learned_addr learned my addr 172.21.15.88:0/3543648359 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:40.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128131bd0 0x7f5128126580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:40.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128131bd0 msgr2=0x7f5128126580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:40.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512d4b7700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128131bd0 msgr2=0x7f5128126580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:25:40.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512d4b7700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128131bd0 msgr2=0x7f5128126580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:25:40.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128131bd0 0x7f5128126580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:40.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128131bd0 0x7f5128126580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:40.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128131bd0 0x7f5128126580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:40.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 -- 172.21.15.88:0/3543648359 >> v1:172.21.15.52:6789/0 conn(0x7f51280ad380 legacy=0x7f51281360c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:40.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 -- 172.21.15.88:0/3543648359 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5128066e50 con 0x7f51280a9130 2020-02-11T16:25:40.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 --2- 172.21.15.88:0/3543648359 >> v2:172.21.15.88:3300/0 conn(0x7f51280a9130 0x7f5128135bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5118000b80 tx=0x7f511800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 --2- 172.21.15.88:0/3543648359 >> v2:172.21.15.88:3300/0 conn(0x7f51280a9130 0x7f5128135bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5118000b80 tx=0x7f511800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51280a9130 0x7f5128135bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f5118000b80 tx=0x7f511800c530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:40.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51280a9130 0x7f5128135bf0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5118000b80 tx=0x7f511800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51280a9130 0x7f5128135bf0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5118000b80 tx=0x7f511800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511800c970 con 0x7f51280a9130 2020-02-11T16:25:40.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ccb6700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51280a9130 0x7f5128135bf0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5118000b80 tx=0x7f511800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511800cb10 con 0x7f51280a9130 2020-02-11T16:25:40.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ef1a700 1 -- 172.21.15.88:0/3543648359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5128136a20 con 0x7f51280a9130 2020-02-11T16:25:40.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51180044f0 con 0x7f51280a9130 2020-02-11T16:25:40.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.006+0000 7f512ef1a700 1 -- 172.21.15.88:0/3543648359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5128130fb0 con 0x7f51280a9130 2020-02-11T16:25:40.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.007+0000 7f512ccb6700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51280a9130 0x7f5128135bf0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5118000b80 tx=0x7f511800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.007+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5118004760 con 0x7f51280a9130 2020-02-11T16:25:40.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.007+0000 7f512ccb6700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51280a9130 0x7f5128135bf0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5118000b80 tx=0x7f511800c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:40.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.007+0000 7f512ef1a700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:40.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.007+0000 7f512ef1a700 1 -- 172.21.15.88:0/3543648359 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512805e2f0 con 0x7f512812a930 2020-02-11T16:25:40.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.007+0000 7f5125ffb700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5108039c40 0x7f510803c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:40.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.007+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f51180498b0 con 0x7f51280a9130 2020-02-11T16:25:40.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.007+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:40.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.008+0000 7f5127fff700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 msgr2=0x7f51281269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:25:40.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.008+0000 7f5127fff700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 msgr2=0x7f51281269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:25:40.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.008+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:40.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.008+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:40.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.008+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5108039c40 0x7f510803c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:40.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.008+0000 7f512d4b7700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5108039c40 0x7f510803c100 crc :-1 s=READY pgs=458 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:40.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.209+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:40.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.209+0000 7f5127fff700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 msgr2=0x7f51281269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:25:40.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.209+0000 7f5127fff700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 msgr2=0x7f51281269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:25:40.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.209+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:40.211 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.209+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:25:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.610+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.610+0000 7f5127fff700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 msgr2=0x7f51281269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:25:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.610+0000 7f5127fff700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 msgr2=0x7f51281269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:25:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.610+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:40.610+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:25:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:41.411+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:41.411+0000 7f5127fff700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 msgr2=0x7f51281269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:25:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:41.411+0000 7f5127fff700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 msgr2=0x7f51281269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:25:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:41.411+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:25:41.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:41.411+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:25:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.013+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.013+0000 7f5127fff700 1 -- 172.21.15.88:0/3543648359 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5128066fe0 con 0x7f512812a930 2020-02-11T16:25:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.013+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.013+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.013+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.014+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.014+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511c002790 con 0x7f512812a930 2020-02-11T16:25:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.014+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.014+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f511c0028f0 con 0x7f512812a930 2020-02-11T16:25:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.014+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 msgr2=0x7f51281269e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.014+0000 7f5125ffb700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).stop 2020-02-11T16:25:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.014+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 msgr2=0x7f51281269e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.014+0000 7f5125ffb700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f512812a930 0x7f51281269e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:43.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.023+0000 7f512ef1a700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 0x7f512812f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:43.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.023+0000 7f512ef1a700 1 -- 172.21.15.88:0/3543648359 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5128136bb0 con 0x7f5128126e40 2020-02-11T16:25:43.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.023+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 0x7f512812f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5127fff700 1 -- 172.21.15.88:0/3543648359 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f51280565b0 con 0x7f5128126e40 2020-02-11T16:25:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 0x7f512812f500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 0x7f512812f500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 0x7f512812f500 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 0x7f512812f500 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511c00ce90 con 0x7f5128126e40 2020-02-11T16:25:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5127fff700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 0x7f512812f500 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f511c017180 con 0x7f5128126e40 2020-02-11T16:25:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 msgr2=0x7f512812f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5125ffb700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 0x7f512812f500 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).stop 2020-02-11T16:25:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5125ffb700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 msgr2=0x7f512812f500 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f5125ffb700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5128126e40 0x7f512812f500 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0x7f5128130ee0 tx=0x7f511c00c490).stop 2020-02-11T16:25:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.024+0000 7f512ef1a700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5108039c40 msgr2=0x7f510803c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.025+0000 7f512ef1a700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5108039c40 0x7f510803c100 crc :-1 s=READY pgs=458 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.025+0000 7f512ef1a700 1 -- 172.21.15.88:0/3543648359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51280a9130 msgr2=0x7f5128135bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.025+0000 7f512ef1a700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51280a9130 0x7f5128135bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f5118000b80 tx=0x7f511800c530).stop 2020-02-11T16:25:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.025+0000 7f512d4b7700 1 -- 172.21.15.88:0/3543648359 reap_dead start 2020-02-11T16:25:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.025+0000 7f512ef1a700 1 -- 172.21.15.88:0/3543648359 shutdown_connections 2020-02-11T16:25:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.025+0000 7f512ef1a700 1 --2- 172.21.15.88:0/3543648359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51280a9130 0x7f5128135bf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.025+0000 7f512ef1a700 1 -- 172.21.15.88:0/3543648359 >> 172.21.15.88:0/3543648359 conn(0x7f512805ac70 msgr2=0x7f5128069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.025+0000 7f512ef1a700 1 -- 172.21.15.88:0/3543648359 shutdown_connections 2020-02-11T16:25:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.025+0000 7f512ef1a700 1 -- 172.21.15.88:0/3543648359 wait complete. 2020-02-11T16:25:43.030 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:25:43.030 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:25:43.030 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:25:43.031 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:25:43.031 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 162, 2020-02-11T16:25:43.031 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:25:43.031 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:25:43.031 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:25:43.032 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:25:43.032 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:43.032 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 4, 2020-02-11T16:25:43.032 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:43.032 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:25:43.032 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:25:43.032 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:43.033 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:43.033 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:43.033 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:43.033 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:43.033 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:43.033 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:43.033 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:25:43.034 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:25:43.034 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:43.034 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:43.034 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:43.034 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:43.034 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:43.034 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:43.035 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:43.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.035 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:25:43.035 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:25:43.035 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:25:43.035 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:25:43.035 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:25:43.036 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:25:43.036 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:43.036 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:43.036 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:25:43.036 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:25:43.036 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:43.036 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:25:43.037 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:43.037 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:43.037 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:43.037 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:43.037 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:43.037 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:43.037 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:43.038 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:25:43.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.038 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:25:43.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.038 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:43.038 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:43.038 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:43.039 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:43.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.039 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:43.039 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:25:43.039 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:43.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.040 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:43.040 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:25:43.040 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:43.040 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:43.040 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:43.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.040 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:25:43.040 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:25:43.041 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:43.041 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:43.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.041 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:43.041 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:43.042 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:43.042 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:43.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.042 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:43.042 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:25:43.042 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:43.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.043 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:43.043 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:25:43.043 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:43.043 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:43.043 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:43.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.044 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:25:43.044 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:25:43.044 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:43.044 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:43.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.044 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.045 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:25:43.045 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:25:43.045 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:43.045 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:43.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.045 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:43.045 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:25:43.046 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:43.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.046 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:43.046 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:25:43.046 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:43.046 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:43.047 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:43.047 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.047 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:25:43.047 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:25:43.047 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:43.047 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:43.047 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:43.048 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:43.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:43.048 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:25:43.048 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:25:43.048 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.048 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:43.048 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:43.049 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:25:43.049 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:43.049 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:43.049 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:25:43.049 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:43.049 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:43.049 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:43.050 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:25:43.050 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:43.050 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:43.050 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:43.050 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:25:43.051 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:25:43.051 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:25:43.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.170+0000 7ff606815700 1 Processor -- start 2020-02-11T16:25:43.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.170+0000 7ff606815700 1 -- start start 2020-02-11T16:25:43.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff606815700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6000a6260 0x7ff600135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:43.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff606815700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6000a31b0 con 0x7ff6000a18a0 2020-02-11T16:25:43.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff606815700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6000a3570 con 0x7ff6000a5de0 2020-02-11T16:25:43.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff606815700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6000a3810 con 0x7ff6000a6260 2020-02-11T16:25:43.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff604db2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6000a6260 0x7ff600135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:43.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff604db2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6000a6260 0x7ff600135160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59176/0 (socket says 172.21.15.88:59176) 2020-02-11T16:25:43.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff604db2700 1 -- 172.21.15.88:0/3887415581 learned_addr learned my addr 172.21.15.88:0/3887415581 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:43.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff5f7fff700 1 --1- 172.21.15.88:0/3887415581 >> v1:172.21.15.88:6789/0 conn(0x7ff6000a5de0 0x7ff600134a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46800/0 (socket says 172.21.15.88:46800) 2020-02-11T16:25:43.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff604db2700 1 -- 172.21.15.88:0/3887415581 >> v1:172.21.15.88:6789/0 conn(0x7ff6000a5de0 legacy=0x7ff600134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff604db2700 1 -- 172.21.15.88:0/3887415581 >> v1:172.21.15.52:6789/0 conn(0x7ff6000a18a0 legacy=0x7ff6000a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff604db2700 1 -- 172.21.15.88:0/3887415581 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6000a3ab0 con 0x7ff6000a6260 2020-02-11T16:25:43.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff604db2700 1 --2- 172.21.15.88:0/3887415581 >> v2:172.21.15.88:3300/0 conn(0x7ff6000a6260 0x7ff600135160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5f80032b0 tx=0x7ff5f8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff604db2700 1 --2- 172.21.15.88:0/3887415581 >> v2:172.21.15.88:3300/0 conn(0x7ff6000a6260 0x7ff600135160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5f80032b0 tx=0x7ff5f8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.171+0000 7ff604db2700 1 --2- 172.21.15.88:0/3887415581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a6260 0x7ff600135160 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7ff5f80032b0 tx=0x7ff5f8008c60).ready entity=mon.1 client_cookie=9306d6467fa2663c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:43.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff604db2700 1 --2- 172.21.15.88:0/3887415581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a6260 0x7ff600135160 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7ff5f80032b0 tx=0x7ff5f8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff5ff7fe700 1 -- 172.21.15.88:0/3887415581 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f800a350 con 0x7ff6000a6260 2020-02-11T16:25:43.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff604db2700 1 --2- 172.21.15.88:0/3887415581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a6260 0x7ff600135160 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7ff5f80032b0 tx=0x7ff5f8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff5ff7fe700 1 -- 172.21.15.88:0/3887415581 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800a4b0 con 0x7ff6000a6260 2020-02-11T16:25:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff604db2700 1 --2- 172.21.15.88:0/3887415581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a6260 0x7ff600135160 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7ff5f80032b0 tx=0x7ff5f8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff5ff7fe700 1 -- 172.21.15.88:0/3887415581 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f800a890 con 0x7ff6000a6260 2020-02-11T16:25:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff606815700 1 -- 172.21.15.88:0/3887415581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a6260 msgr2=0x7ff600135160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff606815700 1 --2- 172.21.15.88:0/3887415581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a6260 0x7ff600135160 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7ff5f80032b0 tx=0x7ff5f8008c60).stop 2020-02-11T16:25:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff606815700 1 -- 172.21.15.88:0/3887415581 shutdown_connections 2020-02-11T16:25:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff606815700 1 --2- 172.21.15.88:0/3887415581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a6260 0x7ff600135160 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff606815700 1 -- 172.21.15.88:0/3887415581 >> 172.21.15.88:0/3887415581 conn(0x7ff60009d110 msgr2=0x7ff60009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff606815700 1 -- 172.21.15.88:0/3887415581 shutdown_connections 2020-02-11T16:25:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.172+0000 7ff606815700 1 -- 172.21.15.88:0/3887415581 wait complete. 2020-02-11T16:25:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.173+0000 7ff606815700 1 Processor -- start 2020-02-11T16:25:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.173+0000 7ff606815700 1 -- start start 2020-02-11T16:25:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff606815700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6000a18a0 0x7ff600133e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff606815700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6000a6260 0x7ff6001239b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:43.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff606815700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60012b1c0 con 0x7ff6000a5de0 2020-02-11T16:25:43.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff606815700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff600137ed0 con 0x7ff6000a18a0 2020-02-11T16:25:43.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff606815700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff600137220 con 0x7ff6000a6260 2020-02-11T16:25:43.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6000a18a0 0x7ff600133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:43.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5f7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff6000a5de0 0x7ff6001232a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46806/0 (socket says 172.21.15.88:46806) 2020-02-11T16:25:43.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5f7fff700 1 -- 172.21.15.88:0/592359205 learned_addr learned my addr 172.21.15.88:0/592359205 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:43.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff604db2700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6000a6260 0x7ff6001239b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:43.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 -- 172.21.15.88:0/592359205 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6000a6260 msgr2=0x7ff6001239b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6000a6260 0x7ff6001239b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:43.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 -- 172.21.15.88:0/592359205 >> v1:172.21.15.88:6789/0 conn(0x7ff6000a5de0 legacy=0x7ff6001232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fdffb700 1 -- 172.21.15.88:0/592359205 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323432820 0 0) 0x7ff60012b1c0 con 0x7ff6000a5de0 2020-02-11T16:25:43.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 -- 172.21.15.88:0/592359205 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600137c30 con 0x7ff6000a18a0 2020-02-11T16:25:43.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> v2:172.21.15.88:3300/0 conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> v2:172.21.15.88:3300/0 conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:43.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fdffb700 1 -- 172.21.15.88:0/592359205 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f0006bc0 con 0x7ff6000a18a0 2020-02-11T16:25:43.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.174+0000 7ff5fdffb700 1 -- 172.21.15.88:0/592359205 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0006d60 con 0x7ff6000a18a0 2020-02-11T16:25:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.175+0000 7ff606815700 1 -- 172.21.15.88:0/592359205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff600133a30 con 0x7ff6000a18a0 2020-02-11T16:25:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.175+0000 7ff5fdffb700 1 -- 172.21.15.88:0/592359205 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f00110d0 con 0x7ff6000a18a0 2020-02-11T16:25:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.175+0000 7ff606815700 1 -- 172.21.15.88:0/592359205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60012ac10 con 0x7ff6000a18a0 2020-02-11T16:25:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.175+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.175+0000 7ff5fdffb700 1 -- 172.21.15.88:0/592359205 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff5f0011340 con 0x7ff6000a18a0 2020-02-11T16:25:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.175+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.176+0000 7ff5fdffb700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5e403be10 0x7ff5e403e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.176+0000 7ff606815700 1 -- 172.21.15.88:0/592359205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6000565b0 con 0x7ff6000a18a0 2020-02-11T16:25:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.176+0000 7ff5fdffb700 1 -- 172.21.15.88:0/592359205 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff5f0049790 con 0x7ff6000a18a0 2020-02-11T16:25:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.176+0000 7ff5f7fff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5e403be10 0x7ff5e403e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:43.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.176+0000 7ff5f7fff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5e403be10 0x7ff5e403e2d0 crc :-1 s=READY pgs=459 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:43.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.180+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.187 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.180+0000 7ff5fdffb700 1 -- 172.21.15.88:0/592359205 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff5f002eba0 con 0x7ff6000a18a0 2020-02-11T16:25:43.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.406+0000 7ff606815700 1 -- 172.21.15.88:0/592359205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7ff60005ccb0 con 0x7ff6000a18a0 2020-02-11T16:25:43.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.407+0000 7ff5fffff700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:43.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.407+0000 7ff5fdffb700 1 -- 172.21.15.88:0/592359205 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7ff5f0031880 con 0x7ff6000a18a0 2020-02-11T16:25:43.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 -- 172.21.15.88:0/592359205 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5e403be10 msgr2=0x7ff5e403e2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5e403be10 0x7ff5e403e2d0 crc :-1 s=READY pgs=459 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:43.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 -- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 msgr2=0x7ff600133e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:43.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 0x7ff600133e70 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7ff60005bbc0 tx=0x7ff5f00108b0).stop 2020-02-11T16:25:43.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 -- 172.21.15.88:0/592359205 shutdown_connections 2020-02-11T16:25:43.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5e403be10 0x7ff5e403e2d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:43.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6000a6260 0x7ff6001239b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:43.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 --2- 172.21.15.88:0/592359205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6000a18a0 0x7ff600133e70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:43.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 -- 172.21.15.88:0/592359205 >> 172.21.15.88:0/592359205 conn(0x7ff60009d110 msgr2=0x7ff600069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:43.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 -- 172.21.15.88:0/592359205 shutdown_connections 2020-02-11T16:25:43.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:43.409+0000 7ff606815700 1 -- 172.21.15.88:0/592359205 wait complete. 2020-02-11T16:25:43.422 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:25:45.753 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:25:45.756 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:25:53.422 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:25:53.422 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:25:53.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.532+0000 7f712b59e700 1 Processor -- start 2020-02-11T16:25:53.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.532+0000 7f712b59e700 1 -- start start 2020-02-11T16:25:53.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f712b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f712c05e8f0 0x7f712c13bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:53.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f712b59e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f712c0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:53.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f712b59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c13c1a0 con 0x7f712c0a9730 2020-02-11T16:25:53.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f712b59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c13b3a0 con 0x7f712c05e8f0 2020-02-11T16:25:53.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f712b59e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c13b600 con 0x7f712c0a5610 2020-02-11T16:25:53.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f712a59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f712c0a9730 0x7f712c066890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46814/0 (socket says 172.21.15.88:46814) 2020-02-11T16:25:53.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f712a59c700 1 -- 172.21.15.88:0/17435899 learned_addr learned my addr 172.21.15.88:0/17435899 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:53.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f7129d9b700 1 --2- 172.21.15.88:0/17435899 >> v2:172.21.15.52:3300/0 conn(0x7f712c05e8f0 0x7f712c13bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303057855 0 0) 0x7f712c13c1a0 con 0x7f712c0a9730 2020-02-11T16:25:53.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7110003230 con 0x7f712c0a9730 2020-02-11T16:25:53.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.533+0000 7f712ad9d700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f712c0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2270196298 0 0) 0x7f7110003230 con 0x7f712c0a9730 2020-02-11T16:25:53.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 msgr2=0x7f712c0a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:25:53.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f712c0a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:53.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 >> v2:172.21.15.52:3300/0 conn(0x7f712c05e8f0 msgr2=0x7f712c13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:25:53.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 --2- 172.21.15.88:0/17435899 >> v2:172.21.15.52:3300/0 conn(0x7f712c05e8f0 0x7f712c13bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:53.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c13b8a0 con 0x7f712c0a9730 2020-02-11T16:25:53.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f711c0016d0 con 0x7f712c0a9730 2020-02-11T16:25:53.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 >> v1:172.21.15.88:6789/0 conn(0x7f712c0a9730 legacy=0x7f712c066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f7110003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:53.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110003b80 0x7f7110003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:53.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71100045c0 0x7f7110004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:53.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c13b3a0 con 0x7f71100045c0 2020-02-11T16:25:53.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c13b600 con 0x7f7110003b80 2020-02-11T16:25:53.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7110005050 con 0x7f712c0a5610 2020-02-11T16:25:53.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f7129d9b700 1 --2- 172.21.15.88:0/17435899 >> v2:172.21.15.52:3300/0 conn(0x7f712c05e8f0 0x7f712c13bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:25:53.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712a59c700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f7110003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f7129d9b700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110003b80 0x7f7110003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712ad9d700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71100045c0 0x7f7110004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712a59c700 1 -- 172.21.15.88:0/17435899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110003b80 msgr2=0x7f7110003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:25:53.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712a59c700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110003b80 0x7f7110003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:53.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712a59c700 1 -- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71100045c0 msgr2=0x7f7110004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:25:53.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712a59c700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71100045c0 0x7f7110004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:53.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712a59c700 1 -- 172.21.15.88:0/17435899 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110003230 con 0x7f712c0a5610 2020-02-11T16:25:53.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f7129d9b700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110003b80 0x7f7110003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:25:53.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712a59c700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f7110003720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f711c0013e0 tx=0x7f711c001d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712a59c700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f7110003720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f711c0013e0 tx=0x7f711c001d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712a59c700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f7110003720 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f711c0013e0 tx=0x7f711c001d00).ready entity=mon.2 client_cookie=b6569a82861c3972 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:53.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.534+0000 7f712a59c700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f7110003720 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f711c0013e0 tx=0x7f711c001d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f711c00e160 con 0x7f712c0a5610 2020-02-11T16:25:53.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712a59c700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f7110003720 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f711c0013e0 tx=0x7f711c001d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c00e2c0 con 0x7f712c0a5610 2020-02-11T16:25:53.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712a59c700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f7110003720 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f711c0013e0 tx=0x7f711c001d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712959a700 1 -- 172.21.15.88:0/17435899 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f711c00e620 con 0x7f712c0a5610 2020-02-11T16:25:53.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712b59e700 1 -- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 msgr2=0x7f7110003720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712b59e700 1 --2- 172.21.15.88:0/17435899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c0a5610 0x7f7110003720 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f711c0013e0 tx=0x7f711c001d00).stop 2020-02-11T16:25:53.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712ad9d700 1 -- 172.21.15.88:0/17435899 reap_dead start 2020-02-11T16:25:53.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712b59e700 1 -- 172.21.15.88:0/17435899 shutdown_connections 2020-02-11T16:25:53.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712b59e700 1 -- 172.21.15.88:0/17435899 >> 172.21.15.88:0/17435899 conn(0x7f712c0ae440 msgr2=0x7f712c0ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:53.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712b59e700 1 -- 172.21.15.88:0/17435899 shutdown_connections 2020-02-11T16:25:53.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.535+0000 7f712b59e700 1 -- 172.21.15.88:0/17435899 wait complete. 2020-02-11T16:25:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.536+0000 7f712b59e700 1 Processor -- start 2020-02-11T16:25:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.536+0000 7f712b59e700 1 -- start start 2020-02-11T16:25:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f712b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f712c09e640 0x7f712c0a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f712b59e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c1311e0 0x7f712c131650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f712b59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c134ed0 con 0x7f712c0a4060 2020-02-11T16:25:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f712b59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c0a4d20 con 0x7f712c09e640 2020-02-11T16:25:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f712b59e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c135100 con 0x7f712c1311e0 2020-02-11T16:25:53.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f712a59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f712c0a4060 0x7f712c1337d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46826/0 (socket says 172.21.15.88:46826) 2020-02-11T16:25:53.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f712a59c700 1 -- 172.21.15.88:0/3372503707 learned_addr learned my addr 172.21.15.88:0/3372503707 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:53.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> v2:172.21.15.52:3300/0 conn(0x7f712c09e640 0x7f712c0a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f712ad9d700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c1311e0 0x7f712c131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f711b7fe700 1 -- 172.21.15.88:0/3372503707 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247522938 0 0) 0x7f712c134ed0 con 0x7f712c0a4060 2020-02-11T16:25:53.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f711b7fe700 1 -- 172.21.15.88:0/3372503707 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7108002fe0 con 0x7f712c0a4060 2020-02-11T16:25:53.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f7129d9b700 1 -- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c1311e0 msgr2=0x7f712c131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c1311e0 0x7f712c131650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f7129d9b700 1 -- 172.21.15.88:0/3372503707 >> v1:172.21.15.88:6789/0 conn(0x7f712c0a4060 legacy=0x7f712c1337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f7129d9b700 1 -- 172.21.15.88:0/3372503707 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c1353a0 con 0x7f712c09e640 2020-02-11T16:25:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> v2:172.21.15.52:3300/0 conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> v2:172.21.15.52:3300/0 conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.537+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.538+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.538+0000 7f711b7fe700 1 -- 172.21.15.88:0/3372503707 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f712000e930 con 0x7f712c09e640 2020-02-11T16:25:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.538+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.538+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.538+0000 7f711b7fe700 1 -- 172.21.15.88:0/3372503707 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712000ea90 con 0x7f712c09e640 2020-02-11T16:25:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.538+0000 7f711b7fe700 1 -- 172.21.15.88:0/3372503707 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f712000ee30 con 0x7f712c09e640 2020-02-11T16:25:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.538+0000 7f712b59e700 1 -- 172.21.15.88:0/3372503707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c09e1a0 con 0x7f712c09e640 2020-02-11T16:25:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.538+0000 7f712b59e700 1 -- 172.21.15.88:0/3372503707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c131ab0 con 0x7f712c09e640 2020-02-11T16:25:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.538+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.539+0000 7f711b7fe700 1 -- 172.21.15.88:0/3372503707 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f712000e180 con 0x7f712c09e640 2020-02-11T16:25:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.539+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.539+0000 7f711b7fe700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7108039f90 0x7f710803c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:53.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.539+0000 7f711b7fe700 1 -- 172.21.15.88:0/3372503707 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f71200499a0 con 0x7f712c09e640 2020-02-11T16:25:53.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.539+0000 7f712b59e700 1 -- 172.21.15.88:0/3372503707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c0565b0 con 0x7f712c09e640 2020-02-11T16:25:53.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.539+0000 7f712a59c700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7108039f90 0x7f710803c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.539+0000 7f712a59c700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7108039f90 0x7f710803c450 crc :-1 s=READY pgs=460 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:53.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.543+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.543+0000 7f711b7fe700 1 -- 172.21.15.88:0/3372503707 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f712002efe0 con 0x7f712c09e640 2020-02-11T16:25:53.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.761+0000 7f712b59e700 1 -- 172.21.15.88:0/3372503707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f712c0a88e0 con 0x7f712c09e640 2020-02-11T16:25:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.762+0000 7f7129d9b700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.762+0000 7f711b7fe700 1 -- 172.21.15.88:0/3372503707 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f7120031a90 con 0x7f712c09e640 2020-02-11T16:25:53.764 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":162,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.763+0000 7f712b59e700 1 -- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7108039f90 msgr2=0x7f710803c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.763+0000 7f712b59e700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7108039f90 0x7f710803c450 crc :-1 s=READY pgs=460 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.763+0000 7f712b59e700 1 -- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 msgr2=0x7f712c0a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.763+0000 7f712b59e700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 0x7f712c0a1da0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f7120002f30 tx=0x7f7120010ea0).stop 2020-02-11T16:25:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.763+0000 7f712b59e700 1 -- 172.21.15.88:0/3372503707 shutdown_connections 2020-02-11T16:25:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.763+0000 7f712b59e700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f712c1311e0 0x7f712c131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.763+0000 7f712b59e700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7108039f90 0x7f710803c450 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.763+0000 7f712b59e700 1 --2- 172.21.15.88:0/3372503707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c09e640 0x7f712c0a1da0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.764+0000 7f712b59e700 1 -- 172.21.15.88:0/3372503707 >> 172.21.15.88:0/3372503707 conn(0x7f712c0ae440 msgr2=0x7f712c065d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.764+0000 7f712b59e700 1 -- 172.21.15.88:0/3372503707 shutdown_connections 2020-02-11T16:25:53.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.764+0000 7f712b59e700 1 -- 172.21.15.88:0/3372503707 wait complete. 2020-02-11T16:25:53.775 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":162,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:53.775 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:25:53.775 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:25:53.776 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:25:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.896+0000 7f5d35d80700 1 Processor -- start 2020-02-11T16:25:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.896+0000 7f5d35d80700 1 -- start start 2020-02-11T16:25:53.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d35d80700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d300a2fa0 0x7f5d300a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:53.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d35d80700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d300a5410 0x7f5d300a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:53.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d35d80700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d300a6da0 0x7f5d30131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:53.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d35d80700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d300a1e60 con 0x7f5d300a5410 2020-02-11T16:25:53.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d35d80700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d300a3450 con 0x7f5d300a6da0 2020-02-11T16:25:53.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d35d80700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d300a4350 con 0x7f5d300a2fa0 2020-02-11T16:25:53.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d2ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d300a6da0 0x7f5d30131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d2ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d300a6da0 0x7f5d30131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59212/0 (socket says 172.21.15.88:59212) 2020-02-11T16:25:53.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d2ffff700 1 -- 172.21.15.88:0/2550095858 learned_addr learned my addr 172.21.15.88:0/2550095858 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:53.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d2effd700 1 --2- 172.21.15.88:0/2550095858 >> v2:172.21.15.52:3300/0 conn(0x7f5d300a5410 0x7f5d300a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.897+0000 7f5d2f7fe700 1 --2- 172.21.15.88:0/2550095858 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d300a2fa0 0x7f5d300a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 -- 172.21.15.88:0/2550095858 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d300a2fa0 msgr2=0x7f5d300a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:25:53.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/2550095858 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d300a2fa0 0x7f5d300a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:53.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 -- 172.21.15.88:0/2550095858 >> v2:172.21.15.52:3300/0 conn(0x7f5d300a5410 msgr2=0x7f5d300a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:25:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/2550095858 >> v2:172.21.15.52:3300/0 conn(0x7f5d300a5410 0x7f5d300a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 -- 172.21.15.88:0/2550095858 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d300a3a40 con 0x7f5d300a6da0 2020-02-11T16:25:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2effd700 1 --2- 172.21.15.88:0/2550095858 >> v2:172.21.15.52:3300/0 conn(0x7f5d300a5410 0x7f5d300a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:25:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/2550095858 >> v2:172.21.15.88:3300/0 conn(0x7f5d300a6da0 0x7f5d30131280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5d280032b0 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/2550095858 >> v2:172.21.15.88:3300/0 conn(0x7f5d300a6da0 0x7f5d30131280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5d280032b0 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/2550095858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d30131280 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f5d280032b0 tx=0x7f5d28007dc0).ready entity=mon.1 client_cookie=a4309a8dd525cb02 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/2550095858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d30131280 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f5d280032b0 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/2550095858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d30131280 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f5d280032b0 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2e7fc700 1 -- 172.21.15.88:0/2550095858 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d2800a160 con 0x7f5d300a6da0 2020-02-11T16:25:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/2550095858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d30131280 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f5d280032b0 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2e7fc700 1 -- 172.21.15.88:0/2550095858 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800a2c0 con 0x7f5d300a6da0 2020-02-11T16:25:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d2e7fc700 1 -- 172.21.15.88:0/2550095858 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d2800a660 con 0x7f5d300a6da0 2020-02-11T16:25:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d35d80700 1 -- 172.21.15.88:0/2550095858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 msgr2=0x7f5d30131280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d35d80700 1 --2- 172.21.15.88:0/2550095858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d30131280 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f5d280032b0 tx=0x7f5d28007dc0).stop 2020-02-11T16:25:53.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d35d80700 1 -- 172.21.15.88:0/2550095858 shutdown_connections 2020-02-11T16:25:53.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d35d80700 1 --2- 172.21.15.88:0/2550095858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d30131280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:53.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d35d80700 1 --2- 172.21.15.88:0/2550095858 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d300a2fa0 0x7f5d300a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:53.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d35d80700 1 --2- 172.21.15.88:0/2550095858 >> v2:172.21.15.52:3300/0 conn(0x7f5d300a5410 0x7f5d300a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:53.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.898+0000 7f5d35d80700 1 -- 172.21.15.88:0/2550095858 >> 172.21.15.88:0/2550095858 conn(0x7f5d3009d110 msgr2=0x7f5d3009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:53.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.899+0000 7f5d35d80700 1 -- 172.21.15.88:0/2550095858 shutdown_connections 2020-02-11T16:25:53.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.899+0000 7f5d35d80700 1 -- 172.21.15.88:0/2550095858 wait complete. 2020-02-11T16:25:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.899+0000 7f5d35d80700 1 Processor -- start 2020-02-11T16:25:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d35d80700 1 -- start start 2020-02-11T16:25:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d35d80700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d300a5410 0x7f5d30063f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d35d80700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d300a6da0 0x7f5d300667e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d35d80700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d301433e0 con 0x7f5d300a2fa0 2020-02-11T16:25:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d35d80700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d30064380 con 0x7f5d300a6da0 2020-02-11T16:25:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d35d80700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30135330 con 0x7f5d300a5410 2020-02-11T16:25:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d2ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d300a6da0 0x7f5d300667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d2ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d300a6da0 0x7f5d300667e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59218/0 (socket says 172.21.15.88:59218) 2020-02-11T16:25:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d2ffff700 1 -- 172.21.15.88:0/167997365 learned_addr learned my addr 172.21.15.88:0/167997365 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d300a5410 0x7f5d30063f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.900+0000 7f5d2ffff700 1 -- 172.21.15.88:0/167997365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d300a5410 msgr2=0x7f5d30063f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d300a5410 0x7f5d30063f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2ffff700 1 -- 172.21.15.88:0/167997365 >> v1:172.21.15.52:6789/0 conn(0x7f5d300a2fa0 legacy=0x7f5d30142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2ffff700 1 -- 172.21.15.88:0/167997365 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d30061d90 con 0x7f5d300a6da0 2020-02-11T16:25:53.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/167997365 >> v2:172.21.15.88:3300/0 conn(0x7f5d300a6da0 0x7f5d300667e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d30063a40 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/167997365 >> v2:172.21.15.88:3300/0 conn(0x7f5d300a6da0 0x7f5d300667e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d30063a40 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d300667e0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f5d30063a40 tx=0x7f5d28007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:53.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d300667e0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5d30063a40 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d28010640 con 0x7f5d300a6da0 2020-02-11T16:25:53.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d300667e0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5d30063a40 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d35d80700 1 -- 172.21.15.88:0/167997365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d30061040 con 0x7f5d300a6da0 2020-02-11T16:25:53.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28005c30 con 0x7f5d300a6da0 2020-02-11T16:25:53.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d300667e0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5d30063a40 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d28007150 con 0x7f5d300a6da0 2020-02-11T16:25:53.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d35d80700 1 -- 172.21.15.88:0/167997365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3005b910 con 0x7f5d300a6da0 2020-02-11T16:25:53.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.901+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d300667e0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5d30063a40 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5d28007390 con 0x7f5d300a6da0 2020-02-11T16:25:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2ffff700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d300667e0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f5d30063a40 tx=0x7f5d28007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2cff9700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d10039c20 0x7f5d1003c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5d2804a610 con 0x7f5d300a6da0 2020-02-11T16:25:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d35d80700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 0x7f5d3009e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d35d80700 1 -- 172.21.15.88:0/167997365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30063860 con 0x7f5d30066c40 2020-02-11T16:25:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2f7fe700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d10039c20 0x7f5d1003c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 0x7f5d3009e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2f7fe700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d10039c20 0x7f5d1003c0e0 crc :-1 s=READY pgs=461 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:53.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2effd700 1 -- 172.21.15.88:0/167997365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d30067020 con 0x7f5d30066c40 2020-02-11T16:25:53.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 0x7f5d3009e740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 0x7f5d3009e740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.902+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 0x7f5d3009e740 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:53.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.903+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 0x7f5d3009e740 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.903+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d24006450 con 0x7f5d30066c40 2020-02-11T16:25:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.903+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 0x7f5d3009e740 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.903+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5d240065b0 con 0x7f5d30066c40 2020-02-11T16:25:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.903+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 msgr2=0x7f5d3009e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.903+0000 7f5d2cff9700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 0x7f5d3009e740 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).stop 2020-02-11T16:25:53.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.903+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 msgr2=0x7f5d3009e740 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:53.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.903+0000 7f5d2cff9700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30066c40 0x7f5d3009e740 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).stop 2020-02-11T16:25:53.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.912+0000 7f5d35d80700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 0x7f5d30131430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:53.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.912+0000 7f5d35d80700 1 -- 172.21.15.88:0/167997365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30061940 con 0x7f5d30131050 2020-02-11T16:25:53.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.912+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 0x7f5d30131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:53.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.912+0000 7f5d2effd700 1 -- 172.21.15.88:0/167997365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5d300565b0 con 0x7f5d30131050 2020-02-11T16:25:53.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.912+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 0x7f5d30131430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.913+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 0x7f5d30131430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.913+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 0x7f5d30131430 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:53.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.913+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 0x7f5d30131430 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.913+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d2400a690 con 0x7f5d30131050 2020-02-11T16:25:53.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.913+0000 7f5d2effd700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 0x7f5d30131430 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:53.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.913+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f5d24017120 con 0x7f5d30131050 2020-02-11T16:25:53.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.913+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 msgr2=0x7f5d30131430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.913+0000 7f5d2cff9700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 0x7f5d30131430 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f5d24002f30 tx=0x7f5d24010d00).stop 2020-02-11T16:25:53.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.913+0000 7f5d2cff9700 1 -- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 msgr2=0x7f5d30131430 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:53.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.913+0000 7f5d2cff9700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d30131050 0x7f5d30131430 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:53.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d35d80700 1 -- 172.21.15.88:0/167997365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d10039c20 msgr2=0x7f5d1003c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d35d80700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5d10039c20 0x7f5d1003c0e0 crc :-1 s=READY pgs=461 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:53.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d35d80700 1 -- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 msgr2=0x7f5d300667e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:53.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d35d80700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d300667e0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f5d30063a40 tx=0x7f5d28007dc0).stop 2020-02-11T16:25:53.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d2ffff700 1 -- 172.21.15.88:0/167997365 reap_dead start 2020-02-11T16:25:53.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d2ffff700 1 -- 172.21.15.88:0/167997365 reap_dead start 2020-02-11T16:25:53.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d35d80700 1 -- 172.21.15.88:0/167997365 shutdown_connections 2020-02-11T16:25:53.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d35d80700 1 --2- 172.21.15.88:0/167997365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d300a6da0 0x7f5d300667e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:53.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d35d80700 1 -- 172.21.15.88:0/167997365 >> 172.21.15.88:0/167997365 conn(0x7f5d3009d110 msgr2=0x7f5d30137f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:53.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d35d80700 1 -- 172.21.15.88:0/167997365 shutdown_connections 2020-02-11T16:25:53.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:53.914+0000 7f5d35d80700 1 -- 172.21.15.88:0/167997365 wait complete. 2020-02-11T16:25:53.923 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:25:53.923 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:53.923 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:53.923 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:25:53.924 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 162, 2020-02-11T16:25:53.924 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:25:53.924 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:25:53.924 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:25:53.924 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:25:53.924 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:53.924 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:25:53.925 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:53.925 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:25:53.925 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:25:53.925 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:53.925 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:53.925 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:53.925 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:53.925 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:53.926 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:53.926 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:53.926 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:25:53.926 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:25:53.926 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:53.926 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:53.926 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:53.927 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:53.927 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:53.927 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:53.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:53.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.927 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:25:53.927 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:25:53.928 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:25:53.928 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:25:53.928 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:25:53.928 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:25:53.928 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:53.928 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:53.928 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:25:53.928 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:25:53.929 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:53.929 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:25:53.929 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:53.929 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:53.929 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:53.929 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:53.929 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:53.930 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:53.930 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:53.930 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:25:53.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.930 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:25:53.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.930 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:53.931 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:53.931 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:53.931 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:53.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.931 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:53.931 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:25:53.931 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:53.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.932 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:53.932 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:25:53.932 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:53.932 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:53.932 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:53.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:25:53.933 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:25:53.933 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:53.933 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:53.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.934 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:53.934 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:53.934 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:53.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:53.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.934 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:53.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:25:53.935 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:53.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:53.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:25:53.935 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:53.936 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:53.936 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:53.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:25:53.936 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:25:53.936 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:53.936 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:53.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.937 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:25:53.937 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:25:53.937 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:53.937 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:53.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.938 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:53.938 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:25:53.938 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:53.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.938 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:53.938 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:25:53.938 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:53.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:53.939 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:53.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.939 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:25:53.939 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:25:53.939 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:53.939 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:53.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:53.940 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:53.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:53.940 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:25:53.940 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:25:53.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.940 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:53.941 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:53.941 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:25:53.941 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:53.941 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:53.941 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:25:53.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.941 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:53.942 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:53.942 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:25:53.942 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:53.942 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:53.942 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:25:53.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.942 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:53.942 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:53.943 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:25:53.943 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:53.943 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:53.943 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:25:53.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.943 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:53.943 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:53.944 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:25:53.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:53.944 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:53.944 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:25:53.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:53.944 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:53.944 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:53.944 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:25:53.945 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:53.945 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:53.945 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:53.945 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:25:53.947 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:25:54.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.075+0000 7fdba2c75700 1 Processor -- start 2020-02-11T16:25:54.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.075+0000 7fdba2c75700 1 -- start start 2020-02-11T16:25:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba2c75700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb9c09e840 0x7fdb9c0a4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba2c75700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c066af0 con 0x7fdb9c0a4ce0 2020-02-11T16:25:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba2c75700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c0a5180 con 0x7fdb9c05fc80 2020-02-11T16:25:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba2c75700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c0a5a30 con 0x7fdb9c09e840 2020-02-11T16:25:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba0a11700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdb9c05fc80 0x7fdb9c0a68b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46852/0 (socket says 172.21.15.88:46852) 2020-02-11T16:25:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba0a11700 1 -- 172.21.15.88:0/2881728326 learned_addr learned my addr 172.21.15.88:0/2881728326 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba1212700 1 --2- 172.21.15.88:0/2881728326 >> v2:172.21.15.52:3300/0 conn(0x7fdb9c09e840 0x7fdb9c0a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdb9b7fe700 1 -- 172.21.15.88:0/2881728326 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327980904 0 0) 0x7fdb9c0a5180 con 0x7fdb9c05fc80 2020-02-11T16:25:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdb9b7fe700 1 -- 172.21.15.88:0/2881728326 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb80003230 con 0x7fdb9c05fc80 2020-02-11T16:25:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba1212700 1 -- 172.21.15.88:0/2881728326 >> v1:172.21.15.88:6789/0 conn(0x7fdb9c05fc80 legacy=0x7fdb9c0a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdb9b7fe700 1 -- 172.21.15.88:0/2881728326 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3149520784 0 0) 0x7fdb80003230 con 0x7fdb9c05fc80 2020-02-11T16:25:54.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba1212700 1 -- 172.21.15.88:0/2881728326 >> v1:172.21.15.52:6789/0 conn(0x7fdb9c0a4ce0 legacy=0x7fdb9c0a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba1212700 1 -- 172.21.15.88:0/2881728326 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0a5420 con 0x7fdb9c09e840 2020-02-11T16:25:54.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.076+0000 7fdba1212700 1 --2- 172.21.15.88:0/2881728326 >> v2:172.21.15.52:3300/0 conn(0x7fdb9c09e840 0x7fdb9c0a4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdb900018b0 tx=0x7fdb94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba1212700 1 --2- 172.21.15.88:0/2881728326 >> v2:172.21.15.52:3300/0 conn(0x7fdb9c09e840 0x7fdb9c0a4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdb900018b0 tx=0x7fdb94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba1212700 1 --2- 172.21.15.88:0/2881728326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c09e840 0x7fdb9c0a4760 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fdb900018b0 tx=0x7fdb94008c60).ready entity=mon.0 client_cookie=7079130cf7c0e45f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba1212700 1 --2- 172.21.15.88:0/2881728326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c09e840 0x7fdb9c0a4760 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fdb900018b0 tx=0x7fdb94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdb9b7fe700 1 -- 172.21.15.88:0/2881728326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb90001710 con 0x7fdb9c09e840 2020-02-11T16:25:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba1212700 1 --2- 172.21.15.88:0/2881728326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c09e840 0x7fdb9c0a4760 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fdb900018b0 tx=0x7fdb94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba1212700 1 --2- 172.21.15.88:0/2881728326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c09e840 0x7fdb9c0a4760 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fdb900018b0 tx=0x7fdb94008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdb9b7fe700 1 -- 172.21.15.88:0/2881728326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb94011c20 con 0x7fdb9c09e840 2020-02-11T16:25:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdb9b7fe700 1 -- 172.21.15.88:0/2881728326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb9400a160 con 0x7fdb9c09e840 2020-02-11T16:25:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba2c75700 1 -- 172.21.15.88:0/2881728326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c09e840 msgr2=0x7fdb9c0a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba2c75700 1 --2- 172.21.15.88:0/2881728326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c09e840 0x7fdb9c0a4760 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fdb900018b0 tx=0x7fdb94008c60).stop 2020-02-11T16:25:54.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba2c75700 1 -- 172.21.15.88:0/2881728326 shutdown_connections 2020-02-11T16:25:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba2c75700 1 --2- 172.21.15.88:0/2881728326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c09e840 0x7fdb9c0a4760 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba2c75700 1 -- 172.21.15.88:0/2881728326 >> 172.21.15.88:0/2881728326 conn(0x7fdb9c0a7bb0 msgr2=0x7fdb9c0a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba2c75700 1 -- 172.21.15.88:0/2881728326 shutdown_connections 2020-02-11T16:25:54.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.077+0000 7fdba2c75700 1 -- 172.21.15.88:0/2881728326 wait complete. 2020-02-11T16:25:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.078+0000 7fdba2c75700 1 Processor -- start 2020-02-11T16:25:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.078+0000 7fdba2c75700 1 -- start start 2020-02-11T16:25:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.079+0000 7fdba2c75700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.079+0000 7fdba2c75700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb9c09e840 0x7fdb9c0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.079+0000 7fdba2c75700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c1462b0 con 0x7fdb9c0a4ce0 2020-02-11T16:25:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.079+0000 7fdba2c75700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c0a1790 con 0x7fdb9c09e840 2020-02-11T16:25:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.079+0000 7fdba2c75700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c12d620 con 0x7fdb9c05fc80 2020-02-11T16:25:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.079+0000 7fdba0a11700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.079+0000 7fdb9bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb9c09e840 0x7fdb9c0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.079+0000 7fdba0a11700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:53556/0 (socket says 172.21.15.88:53556) 2020-02-11T16:25:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.079+0000 7fdb9bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb9c09e840 0x7fdb9c0aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45220/0 (socket says 172.21.15.88:45220) 2020-02-11T16:25:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.079+0000 7fdba0a11700 1 -- 172.21.15.88:0/4249800954 learned_addr learned my addr 172.21.15.88:0/4249800954 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:54.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba0a11700 1 -- 172.21.15.88:0/4249800954 >> v2:172.21.15.52:3300/0 conn(0x7fdb9c09e840 msgr2=0x7fdb9c0aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba0a11700 1 --2- 172.21.15.88:0/4249800954 >> v2:172.21.15.52:3300/0 conn(0x7fdb9c09e840 0x7fdb9c0aaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba0a11700 1 -- 172.21.15.88:0/4249800954 >> v1:172.21.15.52:6789/0 conn(0x7fdb9c0a4ce0 legacy=0x7fdb9c05b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba0a11700 1 -- 172.21.15.88:0/4249800954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c12d8c0 con 0x7fdb9c05fc80 2020-02-11T16:25:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> v2:172.21.15.52:3300/0 conn(0x7fdb9c09e840 0x7fdb9c0aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:25:54.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba0a11700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb90001100 tx=0x7fdb90010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba0a11700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb90001100 tx=0x7fdb90010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba0a11700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fdb90001100 tx=0x7fdb90010c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba0a11700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fdb90001100 tx=0x7fdb90010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb9000cc30 con 0x7fdb9c05fc80 2020-02-11T16:25:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba0a11700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fdb90001100 tx=0x7fdb90010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9000cd90 con 0x7fdb9c05fc80 2020-02-11T16:25:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba0a11700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fdb90001100 tx=0x7fdb90010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba2c75700 1 -- 172.21.15.88:0/4249800954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c12db60 con 0x7fdb9c05fc80 2020-02-11T16:25:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb900046e0 con 0x7fdb9c05fc80 2020-02-11T16:25:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.080+0000 7fdba2c75700 1 -- 172.21.15.88:0/4249800954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c0a11e0 con 0x7fdb9c05fc80 2020-02-11T16:25:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.081+0000 7fdba0a11700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fdb90001100 tx=0x7fdb90010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.081+0000 7fdba2c75700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 0x7fdb9c0a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.081+0000 7fdba2c75700 1 -- 172.21.15.88:0/4249800954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c05e2f0 con 0x7fdb9c146c80 2020-02-11T16:25:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.081+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdb90004920 con 0x7fdb9c05fc80 2020-02-11T16:25:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.081+0000 7fdba0a11700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fdb90001100 tx=0x7fdb90010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.081+0000 7fdb99ffb700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb84039c20 0x7fdb8403c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.081+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 0x7fdb9c0a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.081+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdb90049bd0 con 0x7fdb9c05fc80 2020-02-11T16:25:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdba1212700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb84039c20 0x7fdb8403c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb9bfff700 1 -- 172.21.15.88:0/4249800954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb9c0565b0 con 0x7fdb9c146c80 2020-02-11T16:25:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 0x7fdb9c0a2d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb8800c550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdba1212700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb84039c20 0x7fdb8403c0e0 crc :-1 s=READY pgs=462 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 0x7fdb9c0a2d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb8800c550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 0x7fdb9c0a2d30 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb8800c550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 0x7fdb9c0a2d30 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb8800c550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8800e540 con 0x7fdb9c146c80 2020-02-11T16:25:54.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 0x7fdb9c0a2d30 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb8800c550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fdb88003d20 con 0x7fdb9c146c80 2020-02-11T16:25:54.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 msgr2=0x7fdb9c0a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb99ffb700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 0x7fdb9c0a2d30 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb8800c550).stop 2020-02-11T16:25:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 msgr2=0x7fdb9c0a2d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.082+0000 7fdb99ffb700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c146c80 0x7fdb9c0a2d30 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb8800c550).stop 2020-02-11T16:25:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.091+0000 7fdba2c75700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 0x7fdb9c0a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.091+0000 7fdba2c75700 1 -- 172.21.15.88:0/4249800954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c12d760 con 0x7fdb9c0a8ff0 2020-02-11T16:25:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.091+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 0x7fdb9c0a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.091+0000 7fdb9bfff700 1 -- 172.21.15.88:0/4249800954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdb9c12dcf0 con 0x7fdb9c0a8ff0 2020-02-11T16:25:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.091+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 0x7fdb9c0a9400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb88012580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.091+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 0x7fdb9c0a9400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb88012580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.091+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 0x7fdb9c0a9400 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb88012580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 0x7fdb9c0a9400 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb88012580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb88001ea0 con 0x7fdb9c0a8ff0 2020-02-11T16:25:54.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdb9bfff700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 0x7fdb9c0a9400 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb88012580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4023 (secure 0 0 0) 0x7fdb88010710 con 0x7fdb9c0a8ff0 2020-02-11T16:25:54.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 msgr2=0x7fdb9c0a9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdb99ffb700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 0x7fdb9c0a9400 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb88012580).stop 2020-02-11T16:25:54.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdb99ffb700 1 -- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 msgr2=0x7fdb9c0a9400 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:54.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdb99ffb700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c0a8ff0 0x7fdb9c0a9400 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0x7fdb9c060230 tx=0x7fdb88012580).stop 2020-02-11T16:25:54.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdba2c75700 1 -- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb84039c20 msgr2=0x7fdb8403c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdba2c75700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdb84039c20 0x7fdb8403c0e0 crc :-1 s=READY pgs=462 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdba2c75700 1 -- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 msgr2=0x7fdb9c0aa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdba2c75700 1 --2- 172.21.15.88:0/4249800954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c05fc80 0x7fdb9c0aa740 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fdb90001100 tx=0x7fdb90010c50).stop 2020-02-11T16:25:54.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdba1212700 1 -- 172.21.15.88:0/4249800954 reap_dead start 2020-02-11T16:25:54.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdba1212700 1 -- 172.21.15.88:0/4249800954 reap_dead start 2020-02-11T16:25:54.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdba2c75700 1 -- 172.21.15.88:0/4249800954 shutdown_connections 2020-02-11T16:25:54.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdba2c75700 1 -- 172.21.15.88:0/4249800954 >> 172.21.15.88:0/4249800954 conn(0x7fdb9c0a7bb0 msgr2=0x7fdb9c138180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:54.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdba2c75700 1 -- 172.21.15.88:0/4249800954 shutdown_connections 2020-02-11T16:25:54.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.092+0000 7fdba2c75700 1 -- 172.21.15.88:0/4249800954 wait complete. 2020-02-11T16:25:54.111 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:25:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:25:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 162, 2020-02-11T16:25:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:25:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:25:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:25:54.112 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:25:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:25:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:25:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:25:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:25:54.114 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:25:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:25:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:25:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:25:54.116 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:25:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:25:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:25:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:54.117 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:25:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:25:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:25:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:54.118 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:25:54.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.121 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:25:54.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.121 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:54.121 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:54.121 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:25:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:25:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:25:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:25:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:54.124 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:25:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.126 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:54.126 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:25:54.126 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.126 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.126 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.126 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:25:54.127 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:25:54.127 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:54.127 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:54.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.128 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:25:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:25:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.129 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:25:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:25:54.130 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:25:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:25:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:54.131 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:25:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:25:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:54.132 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:25:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:25:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:54.133 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:54.134 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:25:54.134 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.134 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:54.134 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:25:54.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.134 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:54.134 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:54.135 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:25:54.135 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.135 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.135 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.135 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:25:54.136 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:25:54.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.251+0000 7fa3127bc700 1 Processor -- start 2020-02-11T16:25:54.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.251+0000 7fa3127bc700 1 -- start start 2020-02-11T16:25:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.251+0000 7fa3127bc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c05c1f0 0x7fa30c09df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.251+0000 7fa3127bc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa30c139050 0x7fa30c139490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.251+0000 7fa3127bc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c09e7e0 con 0x7fa30c0a6bf0 2020-02-11T16:25:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.251+0000 7fa3127bc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c0a4cd0 con 0x7fa30c139050 2020-02-11T16:25:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.251+0000 7fa3127bc700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c09e540 con 0x7fa30c05c1f0 2020-02-11T16:25:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c05c1f0 0x7fa30c09df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa30c139050 0x7fa30c139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c05c1f0 0x7fa30c09df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:53568/0 (socket says 172.21.15.88:53568) 2020-02-11T16:25:54.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa30c139050 0x7fa30c139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45232/0 (socket says 172.21.15.88:45232) 2020-02-11T16:25:54.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa30bfff700 1 -- 172.21.15.88:0/1377467755 learned_addr learned my addr 172.21.15.88:0/1377467755 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:54.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 -- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c05c1f0 msgr2=0x7fa30c09df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:25:54.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 --2- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c05c1f0 0x7fa30c09df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:54.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 -- 172.21.15.88:0/1377467755 >> v1:172.21.15.52:6789/0 conn(0x7fa30c0a6bf0 legacy=0x7fa30c0a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 -- 172.21.15.88:0/1377467755 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0a4120 con 0x7fa30c139050 2020-02-11T16:25:54.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa30affd700 1 -- 172.21.15.88:0/1377467755 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928079813 0 0) 0x7fa30c09e7e0 con 0x7fa30c0a6bf0 2020-02-11T16:25:54.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa30bfff700 1 --2- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c05c1f0 0x7fa30c09df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:25:54.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 --2- 172.21.15.88:0/1377467755 >> v2:172.21.15.52:3300/0 conn(0x7fa30c139050 0x7fa30c139490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa3040032b0 tx=0x7fa304008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 --2- 172.21.15.88:0/1377467755 >> v2:172.21.15.52:3300/0 conn(0x7fa30c139050 0x7fa30c139490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa3040032b0 tx=0x7fa304008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 --2- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa30c139050 0x7fa30c139490 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7fa3040032b0 tx=0x7fa304008c60).ready entity=mon.0 client_cookie=4ccdbafb7a281494 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 --2- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa30c139050 0x7fa30c139490 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fa3040032b0 tx=0x7fa304008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa30affd700 1 -- 172.21.15.88:0/1377467755 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa304011e60 con 0x7fa30c139050 2020-02-11T16:25:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 --2- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa30c139050 0x7fa30c139490 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fa3040032b0 tx=0x7fa304008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa310d59700 1 --2- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa30c139050 0x7fa30c139490 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fa3040032b0 tx=0x7fa304008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa30affd700 1 -- 172.21.15.88:0/1377467755 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30400a160 con 0x7fa30c139050 2020-02-11T16:25:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.252+0000 7fa30affd700 1 -- 172.21.15.88:0/1377467755 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30400a4c0 con 0x7fa30c139050 2020-02-11T16:25:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.253+0000 7fa3127bc700 1 -- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa30c139050 msgr2=0x7fa30c139490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.253+0000 7fa3127bc700 1 --2- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa30c139050 0x7fa30c139490 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7fa3040032b0 tx=0x7fa304008c60).stop 2020-02-11T16:25:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.253+0000 7fa3127bc700 1 -- 172.21.15.88:0/1377467755 shutdown_connections 2020-02-11T16:25:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.253+0000 7fa3127bc700 1 --2- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa30c139050 0x7fa30c139490 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.253+0000 7fa3127bc700 1 --2- 172.21.15.88:0/1377467755 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c05c1f0 0x7fa30c09df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.253+0000 7fa3127bc700 1 -- 172.21.15.88:0/1377467755 >> 172.21.15.88:0/1377467755 conn(0x7fa30c0ab400 msgr2=0x7fa30c0a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.253+0000 7fa3127bc700 1 -- 172.21.15.88:0/1377467755 shutdown_connections 2020-02-11T16:25:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.253+0000 7fa3127bc700 1 -- 172.21.15.88:0/1377467755 wait complete. 2020-02-11T16:25:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.254+0000 7fa3127bc700 1 Processor -- start 2020-02-11T16:25:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.254+0000 7fa3127bc700 1 -- start start 2020-02-11T16:25:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa3127bc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa30c05c1f0 0x7fa30c143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa3127bc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a6bf0 0x7fa30c137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa3127bc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c143a50 con 0x7fa30c139050 2020-02-11T16:25:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa3127bc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c143cf0 con 0x7fa30c05c1f0 2020-02-11T16:25:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa3127bc700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c136c70 con 0x7fa30c0a6bf0 2020-02-11T16:25:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa30c05c1f0 0x7fa30c143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa30c05c1f0 0x7fa30c143420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59248/0 (socket says 172.21.15.88:59248) 2020-02-11T16:25:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa310d59700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa30c139050 0x7fa30c0a0030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46878/0 (socket says 172.21.15.88:46878) 2020-02-11T16:25:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30bfff700 1 -- 172.21.15.88:0/3131897155 learned_addr learned my addr 172.21.15.88:0/3131897155 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a6bf0 0x7fa30c137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30bfff700 1 -- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a6bf0 msgr2=0x7fa30c137110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30bfff700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a6bf0 0x7fa30c137110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30bfff700 1 -- 172.21.15.88:0/3131897155 >> v1:172.21.15.88:6789/0 conn(0x7fa30c139050 legacy=0x7fa30c0a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022462491 0 0) 0x7fa30c143a50 con 0x7fa30c139050 2020-02-11T16:25:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30bfff700 1 -- 172.21.15.88:0/3131897155 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c138b40 con 0x7fa30c05c1f0 2020-02-11T16:25:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30bfff700 1 --2- 172.21.15.88:0/3131897155 >> v2:172.21.15.88:3300/0 conn(0x7fa30c05c1f0 0x7fa30c143420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2fc002ef0 tx=0x7fa2fc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30bfff700 1 --2- 172.21.15.88:0/3131897155 >> v2:172.21.15.88:3300/0 conn(0x7fa30c05c1f0 0x7fa30c143420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2fc002ef0 tx=0x7fa2fc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.255+0000 7fa30bfff700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa30c05c1f0 0x7fa30c143420 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fa2fc002ef0 tx=0x7fa2fc010eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa30bfff700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa30c05c1f0 0x7fa30c143420 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa2fc002ef0 tx=0x7fa2fc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2fc007540 con 0x7fa30c05c1f0 2020-02-11T16:25:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa3127bc700 1 -- 172.21.15.88:0/3131897155 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c066f40 con 0x7fa30c05c1f0 2020-02-11T16:25:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa30bfff700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa30c05c1f0 0x7fa30c143420 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa2fc002ef0 tx=0x7fa2fc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa30bfff700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa30c05c1f0 0x7fa30c143420 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa2fc002ef0 tx=0x7fa2fc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc005a10 con 0x7fa30c05c1f0 2020-02-11T16:25:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2fc005df0 con 0x7fa30c05c1f0 2020-02-11T16:25:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa3127bc700 1 -- 172.21.15.88:0/3131897155 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c0625f0 con 0x7fa30c05c1f0 2020-02-11T16:25:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa30bfff700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa30c05c1f0 0x7fa30c143420 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa2fc002ef0 tx=0x7fa2fc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa2fc010180 con 0x7fa30c05c1f0 2020-02-11T16:25:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.256+0000 7fa30bfff700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa30c05c1f0 0x7fa30c143420 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa2fc002ef0 tx=0x7fa2fc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa3127bc700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 0x7fa30c130ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa3127bc700 1 -- 172.21.15.88:0/3131897155 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0a0ac0 con 0x7fa30c137570 2020-02-11T16:25:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa3097fa700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2ec039b30 0x7fa2ec03bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa2fc049c40 con 0x7fa30c05c1f0 2020-02-11T16:25:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 0x7fa30c130ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa310d59700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2ec039b30 0x7fa2ec03bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa30b7fe700 1 -- 172.21.15.88:0/3131897155 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa30c136e70 con 0x7fa30c137570 2020-02-11T16:25:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 0x7fa30c130ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa310d59700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2ec039b30 0x7fa2ec03bff0 crc :-1 s=READY pgs=463 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 0x7fa30c130ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 0x7fa30c130ec0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 0x7fa30c130ec0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.257+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa300001dc0 con 0x7fa30c137570 2020-02-11T16:25:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.258+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 0x7fa30c130ec0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.258+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa300003460 con 0x7fa30c137570 2020-02-11T16:25:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.258+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 msgr2=0x7fa30c130ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.258+0000 7fa3097fa700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 0x7fa30c130ec0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).stop 2020-02-11T16:25:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.258+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 msgr2=0x7fa30c130ec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.258+0000 7fa3097fa700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c137570 0x7fa30c130ec0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).stop 2020-02-11T16:25:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.270+0000 7fa3127bc700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 0x7fa30c0a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.270+0000 7fa3127bc700 1 -- 172.21.15.88:0/3131897155 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c05c630 con 0x7fa30c0a8810 2020-02-11T16:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.271+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 0x7fa30c0a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.271+0000 7fa30b7fe700 1 -- 172.21.15.88:0/3131897155 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa30c1438b0 con 0x7fa30c0a8810 2020-02-11T16:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.271+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 0x7fa30c0a8c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.271+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 0x7fa30c0a8c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.271+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 0x7fa30c0a8c20 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.271+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 0x7fa30c0a8c20 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.271+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa300003950 con 0x7fa30c0a8810 2020-02-11T16:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa30b7fe700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 0x7fa30c0a8c20 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7fa30000e350 con 0x7fa30c0a8810 2020-02-11T16:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 msgr2=0x7fa30c0a8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3097fa700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 0x7fa30c0a8c20 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fa300000b80 tx=0x7fa30000c4b0).stop 2020-02-11T16:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3097fa700 1 -- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 msgr2=0x7fa30c0a8c20 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:25:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3097fa700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa30c0a8810 0x7fa30c0a8c20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3127bc700 1 -- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2ec039b30 msgr2=0x7fa2ec03bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3127bc700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2ec039b30 0x7fa2ec03bff0 crc :-1 s=READY pgs=463 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3127bc700 1 -- 172.21.15.88:0/3131897155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa30c05c1f0 msgr2=0x7fa30c143420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3127bc700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa30c05c1f0 0x7fa30c143420 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fa2fc002ef0 tx=0x7fa2fc010eb0).stop 2020-02-11T16:25:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa310d59700 1 -- 172.21.15.88:0/3131897155 reap_dead start 2020-02-11T16:25:54.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3127bc700 1 -- 172.21.15.88:0/3131897155 shutdown_connections 2020-02-11T16:25:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3127bc700 1 --2- 172.21.15.88:0/3131897155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa30c05c1f0 0x7fa30c143420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3127bc700 1 -- 172.21.15.88:0/3131897155 >> 172.21.15.88:0/3131897155 conn(0x7fa30c0ab400 msgr2=0x7fa30c136510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3127bc700 1 -- 172.21.15.88:0/3131897155 shutdown_connections 2020-02-11T16:25:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.272+0000 7fa3127bc700 1 -- 172.21.15.88:0/3131897155 wait complete. 2020-02-11T16:25:54.278 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:25:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:25:54.278 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:25:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:25:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 162, 2020-02-11T16:25:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:25:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:25:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:25:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:25:54.279 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:25:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:25:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:25:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:54.280 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:25:54.281 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:25:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:54.282 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:25:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:25:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:25:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:25:54.284 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:25:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:25:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:25:54.285 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:25:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:25:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:25:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:25:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:25:54.286 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:25:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:25:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:25:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:25:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:25:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:25:54.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:25:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:25:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:25:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:54.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:25:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:54.289 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:25:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:25:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:25:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:54.290 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:25:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:25:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:54.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:25:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:54.292 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:25:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:25:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:25:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:54.293 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:25:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:25:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:25:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:25:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:25:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:25:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:25:54.295 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:25:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:25:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:25:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:25:54.296 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:25:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:25:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:25:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:25:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:25:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:25:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:25:54.299 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:25:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:25:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:25:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:25:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:25:54.300 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:25:54.301 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:25:54.301 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:25:54.302 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:25:54.302 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:25:54.302 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:25:54.302 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:25:54.303 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:25:54.303 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:25:54.312 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:25:54.313 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:25:54.313 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:25:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.470+0000 7f61f2e07700 1 Processor -- start 2020-02-11T16:25:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.471+0000 7f61f2e07700 1 -- start start 2020-02-11T16:25:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.471+0000 7f61f2e07700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61ec05e8f0 0x7f61ec13bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.471+0000 7f61f2e07700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a5610 0x7f61ec0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.471+0000 7f61f2e07700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec13c1a0 con 0x7f61ec0a9730 2020-02-11T16:25:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.471+0000 7f61f2e07700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec13b3a0 con 0x7f61ec0a5610 2020-02-11T16:25:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.471+0000 7f61f2e07700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec13b600 con 0x7f61ec05e8f0 2020-02-11T16:25:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.471+0000 7f61f1604700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f61ec05e8f0 msgr2=0x7f61ec13bd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:25:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.471+0000 7f61f1604700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61ec05e8f0 0x7f61ec13bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.471+0000 7f61f2606700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a5610 0x7f61ec0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a5610 0x7f61ec0a5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45272/0 (socket says 172.21.15.88:45272) 2020-02-11T16:25:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 -- 172.21.15.88:0/2035647804 learned_addr learned my addr 172.21.15.88:0/2035647804 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 -- 172.21.15.88:0/2035647804 >> v2:172.21.15.88:3300/0 conn(0x7f61ec05e8f0 msgr2=0x7f61ec13bd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:25:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 --2- 172.21.15.88:0/2035647804 >> v2:172.21.15.88:3300/0 conn(0x7f61ec05e8f0 0x7f61ec13bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 -- 172.21.15.88:0/2035647804 >> v1:172.21.15.52:6789/0 conn(0x7f61ec0a9730 legacy=0x7f61ec066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 -- 172.21.15.88:0/2035647804 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec13b8a0 con 0x7f61ec0a5610 2020-02-11T16:25:54.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 --2- 172.21.15.88:0/2035647804 >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a5610 0x7f61ec0a5ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f61e40032b0 tx=0x7f61e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 --2- 172.21.15.88:0/2035647804 >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a5610 0x7f61ec0a5ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f61e40032b0 tx=0x7f61e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 --2- 172.21.15.88:0/2035647804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61ec0a5610 0x7f61ec0a5ac0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f61e40032b0 tx=0x7f61e4007dc0).ready entity=mon.0 client_cookie=53e60501f50ed53c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 --2- 172.21.15.88:0/2035647804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61ec0a5610 0x7f61ec0a5ac0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f61e40032b0 tx=0x7f61e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f0e03700 1 -- 172.21.15.88:0/2035647804 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61e4011e90 con 0x7f61ec0a5610 2020-02-11T16:25:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 --2- 172.21.15.88:0/2035647804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61ec0a5610 0x7f61ec0a5ac0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f61e40032b0 tx=0x7f61e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f0e03700 1 -- 172.21.15.88:0/2035647804 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e400a350 con 0x7f61ec0a5610 2020-02-11T16:25:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2606700 1 --2- 172.21.15.88:0/2035647804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61ec0a5610 0x7f61ec0a5ac0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f61e40032b0 tx=0x7f61e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f0e03700 1 -- 172.21.15.88:0/2035647804 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61e400a730 con 0x7f61ec0a5610 2020-02-11T16:25:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2e07700 1 -- 172.21.15.88:0/2035647804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61ec0a5610 msgr2=0x7f61ec0a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.472+0000 7f61f2e07700 1 --2- 172.21.15.88:0/2035647804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61ec0a5610 0x7f61ec0a5ac0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f61e40032b0 tx=0x7f61e4007dc0).stop 2020-02-11T16:25:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.473+0000 7f61f2e07700 1 -- 172.21.15.88:0/2035647804 shutdown_connections 2020-02-11T16:25:54.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.473+0000 7f61f2e07700 1 --2- 172.21.15.88:0/2035647804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61ec0a5610 0x7f61ec0a5ac0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.473+0000 7f61f2e07700 1 --2- 172.21.15.88:0/2035647804 >> v2:172.21.15.88:3300/0 conn(0x7f61ec05e8f0 0x7f61ec13bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:25:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.473+0000 7f61f2e07700 1 -- 172.21.15.88:0/2035647804 >> 172.21.15.88:0/2035647804 conn(0x7f61ec0ae440 msgr2=0x7f61ec0ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.473+0000 7f61f2e07700 1 -- 172.21.15.88:0/2035647804 shutdown_connections 2020-02-11T16:25:54.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.473+0000 7f61f2e07700 1 -- 172.21.15.88:0/2035647804 wait complete. 2020-02-11T16:25:54.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.474+0000 7f61f2e07700 1 Processor -- start 2020-02-11T16:25:54.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.474+0000 7f61f2e07700 1 -- start start 2020-02-11T16:25:54.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.474+0000 7f61f2e07700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.474+0000 7f61f2e07700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a9730 0x7f61ec138610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.474+0000 7f61f2e07700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec0a7660 con 0x7f61ec05e8f0 2020-02-11T16:25:54.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.474+0000 7f61f2e07700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec135b80 con 0x7f61ec0a9730 2020-02-11T16:25:54.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f2e07700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec135e20 con 0x7f61ec0a5610 2020-02-11T16:25:54.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f2606700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a9730 0x7f61ec138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f1604700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f2606700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a9730 0x7f61ec138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45280/0 (socket says 172.21.15.88:45280) 2020-02-11T16:25:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f1604700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:53616/0 (socket says 172.21.15.88:53616) 2020-02-11T16:25:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f2606700 1 -- 172.21.15.88:0/512297992 learned_addr learned my addr 172.21.15.88:0/512297992 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f1604700 1 -- 172.21.15.88:0/512297992 >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a9730 msgr2=0x7f61ec138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a9730 0x7f61ec138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f1604700 1 -- 172.21.15.88:0/512297992 >> v1:172.21.15.52:6789/0 conn(0x7f61ec05e8f0 legacy=0x7f61ec137770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f1604700 1 -- 172.21.15.88:0/512297992 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec1360c0 con 0x7f61ec0a5610 2020-02-11T16:25:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f2606700 1 --2- 172.21.15.88:0/512297992 >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a9730 0x7f61ec138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:25:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.475+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.476+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.476+0000 7f61daffd700 1 -- 172.21.15.88:0/512297992 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61dc009c80 con 0x7f61ec0a5610 2020-02-11T16:25:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.476+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.476+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.476+0000 7f61daffd700 1 -- 172.21.15.88:0/512297992 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc009e20 con 0x7f61ec0a5610 2020-02-11T16:25:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.476+0000 7f61daffd700 1 -- 172.21.15.88:0/512297992 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61dc009580 con 0x7f61ec0a5610 2020-02-11T16:25:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.476+0000 7f61f2e07700 1 -- 172.21.15.88:0/512297992 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ec137e80 con 0x7f61ec0a5610 2020-02-11T16:25:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.476+0000 7f61f2e07700 1 -- 172.21.15.88:0/512297992 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ec12fb10 con 0x7f61ec0a5610 2020-02-11T16:25:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.476+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.477+0000 7f61daffd700 1 -- 172.21.15.88:0/512297992 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f61dc00a070 con 0x7f61ec0a5610 2020-02-11T16:25:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.477+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.477+0000 7f61daffd700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61cc039ca0 0x7f61cc03c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.477+0000 7f61f2e07700 1 -- 172.21.15.88:0/512297992 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ec0565b0 con 0x7f61ec0a5610 2020-02-11T16:25:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.477+0000 7f61daffd700 1 -- 172.21.15.88:0/512297992 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f61dc049650 con 0x7f61ec0a5610 2020-02-11T16:25:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.477+0000 7f61f1e05700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61cc039ca0 0x7f61cc03c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:54.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.478+0000 7f61f1e05700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61cc039ca0 0x7f61cc03c160 crc :-1 s=READY pgs=464 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:54.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.482+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.482+0000 7f61daffd700 1 -- 172.21.15.88:0/512297992 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f61dc02ec10 con 0x7f61ec0a5610 2020-02-11T16:25:54.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.693+0000 7f61f2e07700 1 -- 172.21.15.88:0/512297992 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f61ec0a88e0 con 0x7f61ec0a5610 2020-02-11T16:25:54.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.693+0000 7f61f1604700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:54.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.693+0000 7f61daffd700 1 -- 172.21.15.88:0/512297992 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f61dc0316e0 con 0x7f61ec0a5610 2020-02-11T16:25:54.695 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":162,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:54.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 -- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61cc039ca0 msgr2=0x7f61cc03c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61cc039ca0 0x7f61cc03c160 crc :-1 s=READY pgs=464 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 -- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 msgr2=0x7f61ec1381b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:54.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f61dc000b20 tx=0x7f61dc0108f0).stop 2020-02-11T16:25:54.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 -- 172.21.15.88:0/512297992 shutdown_connections 2020-02-11T16:25:54.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f61cc039ca0 0x7f61cc03c160 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 --2- 172.21.15.88:0/512297992 >> v2:172.21.15.52:3300/0 conn(0x7f61ec0a9730 0x7f61ec138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 --2- 172.21.15.88:0/512297992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f61ec0a5610 0x7f61ec1381b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 -- 172.21.15.88:0/512297992 >> 172.21.15.88:0/512297992 conn(0x7f61ec0ae440 msgr2=0x7f61ec130c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 -- 172.21.15.88:0/512297992 shutdown_connections 2020-02-11T16:25:54.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:54.695+0000 7f61f2e07700 1 -- 172.21.15.88:0/512297992 wait complete. 2020-02-11T16:25:54.707 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":162,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:57.708 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:25:57.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.829+0000 7f4826a33700 1 Processor -- start 2020-02-11T16:25:57.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.830+0000 7f4826a33700 1 -- start start 2020-02-11T16:25:57.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.830+0000 7f4826a33700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f482005c250 0x7f48200a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:25:57.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.830+0000 7f4826a33700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482009d6b0 con 0x7f4820137f10 2020-02-11T16:25:57.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.830+0000 7f4826a33700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482012ee50 con 0x7f482005be70 2020-02-11T16:25:57.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.830+0000 7f4826a33700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48200a3f20 con 0x7f482005c250 2020-02-11T16:25:57.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.830+0000 7f481ffff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f482005be70 legacy=0x7f48200a6ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:25:57.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f482005c250 0x7f48200a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:57.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f482005c250 0x7f48200a31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45286/0 (socket says 172.21.15.88:45286) 2020-02-11T16:25:57.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481f7fe700 1 -- 172.21.15.88:0/3141078988 learned_addr learned my addr 172.21.15.88:0/3141078988 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:25:57.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481f7fe700 1 -- 172.21.15.88:0/3141078988 >> v1:172.21.15.88:6789/0 conn(0x7f482005be70 legacy=0x7f48200a6ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:25:57.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481f7fe700 1 -- 172.21.15.88:0/3141078988 >> v1:172.21.15.52:6789/0 conn(0x7f4820137f10 legacy=0x7f482012e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:57.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481effd700 1 -- 172.21.15.88:0/3141078988 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251581641 0 0) 0x7f482009d6b0 con 0x7f4820137f10 2020-02-11T16:25:57.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481f7fe700 1 -- 172.21.15.88:0/3141078988 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482012f050 con 0x7f482005c250 2020-02-11T16:25:57.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481f7fe700 1 --2- 172.21.15.88:0/3141078988 >> v2:172.21.15.52:3300/0 conn(0x7f482005c250 0x7f48200a31c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f48200a4b60 tx=0x7f48140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481f7fe700 1 --2- 172.21.15.88:0/3141078988 >> v2:172.21.15.52:3300/0 conn(0x7f482005c250 0x7f48200a31c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f48200a4b60 tx=0x7f48140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481f7fe700 1 --2- 172.21.15.88:0/3141078988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482005c250 0x7f48200a31c0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f48200a4b60 tx=0x7f48140088e0).ready entity=mon.0 client_cookie=290d913c4f3e5cc0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:57.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481f7fe700 1 --2- 172.21.15.88:0/3141078988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482005c250 0x7f48200a31c0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f48200a4b60 tx=0x7f48140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.831+0000 7f481effd700 1 -- 172.21.15.88:0/3141078988 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4814011720 con 0x7f482005c250 2020-02-11T16:25:57.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f481f7fe700 1 --2- 172.21.15.88:0/3141078988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482005c250 0x7f48200a31c0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f48200a4b60 tx=0x7f48140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f481effd700 1 -- 172.21.15.88:0/3141078988 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4814011880 con 0x7f482005c250 2020-02-11T16:25:57.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f481f7fe700 1 --2- 172.21.15.88:0/3141078988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482005c250 0x7f48200a31c0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f48200a4b60 tx=0x7f48140088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f481effd700 1 -- 172.21.15.88:0/3141078988 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4814011c20 con 0x7f482005c250 2020-02-11T16:25:57.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f4826a33700 1 -- 172.21.15.88:0/3141078988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482005c250 msgr2=0x7f48200a31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:57.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f4826a33700 1 --2- 172.21.15.88:0/3141078988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482005c250 0x7f48200a31c0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f48200a4b60 tx=0x7f48140088e0).stop 2020-02-11T16:25:57.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f4826a33700 1 -- 172.21.15.88:0/3141078988 shutdown_connections 2020-02-11T16:25:57.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f4826a33700 1 --2- 172.21.15.88:0/3141078988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482005c250 0x7f48200a31c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:57.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f4826a33700 1 -- 172.21.15.88:0/3141078988 >> 172.21.15.88:0/3141078988 conn(0x7f48200ab400 msgr2=0x7f48200a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:57.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f4826a33700 1 -- 172.21.15.88:0/3141078988 shutdown_connections 2020-02-11T16:25:57.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.832+0000 7f4826a33700 1 -- 172.21.15.88:0/3141078988 wait complete. 2020-02-11T16:25:57.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.833+0000 7f4826a33700 1 Processor -- start 2020-02-11T16:25:57.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.833+0000 7f4826a33700 1 -- start start 2020-02-11T16:25:57.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f4826a33700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f482005c250 0x7f48201374d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:57.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f4826a33700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:57.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f4826a33700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4820137cb0 con 0x7f482005be70 2020-02-11T16:25:57.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f4826a33700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4820141950 con 0x7f482005c250 2020-02-11T16:25:57.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f4826a33700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48201410b0 con 0x7f4820137f10 2020-02-11T16:25:57.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f481f7fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f482005c250 msgr2=0x7f48201374d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:25:57.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f481f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f482005c250 0x7f48201374d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:25:57.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f481ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f482005be70 0x7f48201409a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:38712/0 (socket says 172.21.15.88:38712) 2020-02-11T16:25:57.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f481ffff700 1 -- 172.21.15.88:0/979532503 learned_addr learned my addr 172.21.15.88:0/979532503 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:25:57.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:57.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f481d7fa700 1 -- 172.21.15.88:0/979532503 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936465426 0 0) 0x7f4820137cb0 con 0x7f482005be70 2020-02-11T16:25:57.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f481d7fa700 1 -- 172.21.15.88:0/979532503 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4800002fe0 con 0x7f482005be70 2020-02-11T16:25:57.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f4824fd0700 1 -- 172.21.15.88:0/979532503 >> v2:172.21.15.88:3300/0 conn(0x7f482005c250 msgr2=0x7f48201374d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:25:57.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.834+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> v2:172.21.15.88:3300/0 conn(0x7f482005c250 0x7f48201374d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:57.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f4824fd0700 1 -- 172.21.15.88:0/979532503 >> v1:172.21.15.52:6789/0 conn(0x7f482005be70 legacy=0x7f48201409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:57.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f4824fd0700 1 -- 172.21.15.88:0/979532503 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4820144590 con 0x7f4820137f10 2020-02-11T16:25:57.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:57.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f481d7fa700 1 -- 172.21.15.88:0/979532503 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4818012290 con 0x7f4820137f10 2020-02-11T16:25:57.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f481d7fa700 1 -- 172.21.15.88:0/979532503 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4818012430 con 0x7f4820137f10 2020-02-11T16:25:57.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f4826a33700 1 -- 172.21.15.88:0/979532503 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4820144830 con 0x7f4820137f10 2020-02-11T16:25:57.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f481d7fa700 1 -- 172.21.15.88:0/979532503 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4818012810 con 0x7f4820137f10 2020-02-11T16:25:57.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.835+0000 7f4826a33700 1 -- 172.21.15.88:0/979532503 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4820135b10 con 0x7f4820137f10 2020-02-11T16:25:57.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.836+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.836+0000 7f481d7fa700 1 -- 172.21.15.88:0/979532503 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4818012a90 con 0x7f4820137f10 2020-02-11T16:25:57.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.836+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.836+0000 7f481d7fa700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4800039f10 0x7f480003c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:25:57.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.836+0000 7f4826a33700 1 -- 172.21.15.88:0/979532503 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4820144a30 con 0x7f4820137f10 2020-02-11T16:25:57.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.836+0000 7f481d7fa700 1 -- 172.21.15.88:0/979532503 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f481804a0f0 con 0x7f4820137f10 2020-02-11T16:25:57.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.836+0000 7f481ffff700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4800039f10 0x7f480003c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:25:57.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.836+0000 7f481ffff700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4800039f10 0x7f480003c3d0 crc :-1 s=READY pgs=465 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:25:57.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.840+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:57.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:57.840+0000 7f481d7fa700 1 -- 172.21.15.88:0/979532503 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4820144a30 con 0x7f4820137f10 2020-02-11T16:25:58.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.061+0000 7f4826a33700 1 -- 172.21.15.88:0/979532503 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4820144a30 con 0x7f4820137f10 2020-02-11T16:25:58.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.062+0000 7f4824fd0700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:25:58.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.062+0000 7f481d7fa700 1 -- 172.21.15.88:0/979532503 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f4820144a30 con 0x7f4820137f10 2020-02-11T16:25:58.064 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":162,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:25:58.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 -- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4800039f10 msgr2=0x7f480003c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:58.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4800039f10 0x7f480003c3d0 crc :-1 s=READY pgs=465 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:58.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 -- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 msgr2=0x7f48201318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:25:58.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f4818001210 tx=0x7f4818010bf0).stop 2020-02-11T16:25:58.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 -- 172.21.15.88:0/979532503 shutdown_connections 2020-02-11T16:25:58.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4800039f10 0x7f480003c3d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:58.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 --2- 172.21.15.88:0/979532503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4820137f10 0x7f48201318b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:58.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 --2- 172.21.15.88:0/979532503 >> v2:172.21.15.88:3300/0 conn(0x7f482005c250 0x7f48201374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:25:58.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 -- 172.21.15.88:0/979532503 >> 172.21.15.88:0/979532503 conn(0x7f48200ab400 msgr2=0x7f4820069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:25:58.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 -- 172.21.15.88:0/979532503 shutdown_connections 2020-02-11T16:25:58.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:25:58.064+0000 7f4826a33700 1 -- 172.21.15.88:0/979532503 wait complete. 2020-02-11T16:25:58.076 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":162,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:01.077 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:26:01.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.190+0000 7fd7af961700 1 Processor -- start 2020-02-11T16:26:01.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.190+0000 7fd7af961700 1 -- start start 2020-02-11T16:26:01.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.191+0000 7fd7af961700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:01.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.191+0000 7fd7af961700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7a80a6260 0x7fd7a812eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:01.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.191+0000 7fd7af961700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a80a3570 con 0x7fd7a80a5de0 2020-02-11T16:26:01.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.191+0000 7fd7af961700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a80a3810 con 0x7fd7a80a18a0 2020-02-11T16:26:01.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.191+0000 7fd7af961700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a80a3ab0 con 0x7fd7a80a6260 2020-02-11T16:26:01.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.191+0000 7fd7adefe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fd7a80a6260 msgr2=0x7fd7a812eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:01.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.191+0000 7fd7adefe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7a80a6260 0x7fd7a812eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:01.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:01.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45298/0 (socket says 172.21.15.88:45298) 2020-02-11T16:26:01.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 -- 172.21.15.88:0/1088565814 learned_addr learned my addr 172.21.15.88:0/1088565814 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:01.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 -- 172.21.15.88:0/1088565814 >> v2:172.21.15.88:3300/0 conn(0x7fd7a80a6260 msgr2=0x7fd7a812eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:01.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/1088565814 >> v2:172.21.15.88:3300/0 conn(0x7fd7a80a6260 0x7fd7a812eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:01.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 -- 172.21.15.88:0/1088565814 >> v1:172.21.15.52:6789/0 conn(0x7fd7a80a5de0 legacy=0x7fd7a812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:01.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 -- 172.21.15.88:0/1088565814 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a80a3d50 con 0x7fd7a80a18a0 2020-02-11T16:26:01.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/1088565814 >> v2:172.21.15.52:3300/0 conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd7a4002f30 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/1088565814 >> v2:172.21.15.52:3300/0 conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd7a4002f30 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/1088565814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7fd7a4002f30 tx=0x7fd7a4007a40).ready entity=mon.0 client_cookie=511b48a2680f8044 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/1088565814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7fd7a4002f30 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd797fff700 1 -- 172.21.15.88:0/1088565814 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a4008e20 con 0x7fd7a80a18a0 2020-02-11T16:26:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/1088565814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7fd7a4002f30 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/1088565814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7fd7a4002f30 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd797fff700 1 -- 172.21.15.88:0/1088565814 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4011910 con 0x7fd7a80a18a0 2020-02-11T16:26:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd797fff700 1 -- 172.21.15.88:0/1088565814 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a4011cf0 con 0x7fd7a80a18a0 2020-02-11T16:26:01.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7af961700 1 -- 172.21.15.88:0/1088565814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 msgr2=0x7fd7a80a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.192+0000 7fd7af961700 1 --2- 172.21.15.88:0/1088565814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7fd7a4002f30 tx=0x7fd7a4007a40).stop 2020-02-11T16:26:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.193+0000 7fd7af961700 1 -- 172.21.15.88:0/1088565814 shutdown_connections 2020-02-11T16:26:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.193+0000 7fd7af961700 1 --2- 172.21.15.88:0/1088565814 >> v2:172.21.15.88:3300/0 conn(0x7fd7a80a6260 0x7fd7a812eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.193+0000 7fd7af961700 1 --2- 172.21.15.88:0/1088565814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a80a6dd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.193+0000 7fd7af961700 1 -- 172.21.15.88:0/1088565814 >> 172.21.15.88:0/1088565814 conn(0x7fd7a809d110 msgr2=0x7fd7a809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.193+0000 7fd7af961700 1 -- 172.21.15.88:0/1088565814 shutdown_connections 2020-02-11T16:26:01.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.193+0000 7fd7af961700 1 -- 172.21.15.88:0/1088565814 wait complete. 2020-02-11T16:26:01.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.194+0000 7fd7af961700 1 Processor -- start 2020-02-11T16:26:01.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.194+0000 7fd7af961700 1 -- start start 2020-02-11T16:26:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7af961700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7a80a18a0 0x7fd7a809eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7af961700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a809df60 con 0x7fd7a80a5de0 2020-02-11T16:26:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7af961700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a809e430 con 0x7fd7a80a6260 2020-02-11T16:26:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7af961700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a8138870 con 0x7fd7a80a18a0 2020-02-11T16:26:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7adefe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fd7a80a6260 legacy=0x7fd7a814fa60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7ad6fd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7a80a18a0 0x7fd7a809eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:01.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7ad6fd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7a80a18a0 0x7fd7a809eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45304/0 (socket says 172.21.15.88:45304) 2020-02-11T16:26:01.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7ad6fd700 1 -- 172.21.15.88:0/3448149282 learned_addr learned my addr 172.21.15.88:0/3448149282 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:01.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7ad6fd700 1 -- 172.21.15.88:0/3448149282 >> v1:172.21.15.88:6789/0 conn(0x7fd7a80a6260 legacy=0x7fd7a814fa60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:01.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7ad6fd700 1 -- 172.21.15.88:0/3448149282 >> v1:172.21.15.52:6789/0 conn(0x7fd7a80a5de0 legacy=0x7fd7a812b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:01.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7ad6fd700 1 -- 172.21.15.88:0/3448149282 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a81353a0 con 0x7fd7a80a18a0 2020-02-11T16:26:01.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/3448149282 >> v2:172.21.15.52:3300/0 conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/3448149282 >> v2:172.21.15.52:3300/0 conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.195+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:01.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.196+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.196+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.196+0000 7fd7967fc700 1 -- 172.21.15.88:0/3448149282 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a4008ea0 con 0x7fd7a80a18a0 2020-02-11T16:26:01.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.196+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.196+0000 7fd7967fc700 1 -- 172.21.15.88:0/3448149282 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4007ed0 con 0x7fd7a80a18a0 2020-02-11T16:26:01.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.196+0000 7fd7af961700 1 -- 172.21.15.88:0/3448149282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a809e190 con 0x7fd7a80a18a0 2020-02-11T16:26:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.196+0000 7fd7967fc700 1 -- 172.21.15.88:0/3448149282 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a4007530 con 0x7fd7a80a18a0 2020-02-11T16:26:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.196+0000 7fd7af961700 1 -- 172.21.15.88:0/3448149282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a8132730 con 0x7fd7a80a18a0 2020-02-11T16:26:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.196+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.197+0000 7fd7967fc700 1 -- 172.21.15.88:0/3448149282 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd7a40056c0 con 0x7fd7a80a18a0 2020-02-11T16:26:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.197+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.197+0000 7fd7967fc700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd788039bd0 0x7fd78803c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.197+0000 7fd7967fc700 1 -- 172.21.15.88:0/3448149282 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fd7a404a1e0 con 0x7fd7a80a18a0 2020-02-11T16:26:01.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.197+0000 7fd7af961700 1 -- 172.21.15.88:0/3448149282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a809e880 con 0x7fd7a80a18a0 2020-02-11T16:26:01.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.197+0000 7fd7acefc700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd788039bd0 0x7fd78803c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:01.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.197+0000 7fd7acefc700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd788039bd0 0x7fd78803c090 crc :-1 s=READY pgs=466 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:01.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.201+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.208 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.201+0000 7fd7967fc700 1 -- 172.21.15.88:0/3448149282 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd7a809e880 con 0x7fd7a80a18a0 2020-02-11T16:26:01.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.422+0000 7fd7af961700 1 -- 172.21.15.88:0/3448149282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd7a809e880 con 0x7fd7a80a18a0 2020-02-11T16:26:01.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.422+0000 7fd7ad6fd700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:01.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.423+0000 7fd7967fc700 1 -- 172.21.15.88:0/3448149282 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fd7a809e880 con 0x7fd7a80a18a0 2020-02-11T16:26:01.425 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":162,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:01.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.424+0000 7fd7af961700 1 -- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd788039bd0 msgr2=0x7fd78803c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:01.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.424+0000 7fd7af961700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd788039bd0 0x7fd78803c090 crc :-1 s=READY pgs=466 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:01.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.424+0000 7fd7af961700 1 -- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 msgr2=0x7fd7a809eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:01.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.424+0000 7fd7af961700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a809eb20 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fd7a809e810 tx=0x7fd7a4007a40).stop 2020-02-11T16:26:01.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.424+0000 7fd7af961700 1 -- 172.21.15.88:0/3448149282 shutdown_connections 2020-02-11T16:26:01.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.424+0000 7fd7af961700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd788039bd0 0x7fd78803c090 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:01.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.424+0000 7fd7af961700 1 --2- 172.21.15.88:0/3448149282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a80a18a0 0x7fd7a809eb20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:01.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.424+0000 7fd7af961700 1 -- 172.21.15.88:0/3448149282 >> 172.21.15.88:0/3448149282 conn(0x7fd7a809d110 msgr2=0x7fd7a80a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:01.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.424+0000 7fd7af961700 1 -- 172.21.15.88:0/3448149282 shutdown_connections 2020-02-11T16:26:01.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:01.424+0000 7fd7af961700 1 -- 172.21.15.88:0/3448149282 wait complete. 2020-02-11T16:26:01.437 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":162,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:04.438 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:26:04.556 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.554+0000 7f0ed4615700 1 Processor -- start 2020-02-11T16:26:04.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.554+0000 7f0ed4615700 1 -- start start 2020-02-11T16:26:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.555+0000 7f0ed4615700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 0x7f0ecc0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.555+0000 7f0ed4615700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc0a4350 con 0x7f0ecc131990 2020-02-11T16:26:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.555+0000 7f0ed4615700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc0a3a40 con 0x7f0ecc0a5410 2020-02-11T16:26:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.555+0000 7f0ed4615700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ecc0a1e60 con 0x7f0ecc0a2fa0 2020-02-11T16:26:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.555+0000 7f0ed23b1700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 msgr2=0x7f0ecc0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.555+0000 7f0ed1bb0700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f0ecc0a5410 legacy=0x7f0ecc131280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:04.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.555+0000 7f0ed23b1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 0x7f0ecc0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:04.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.555+0000 7f0ed2bb2700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0ecc131990 0x7f0ecc13ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:38736/0 (socket says 172.21.15.88:38736) 2020-02-11T16:26:04.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.555+0000 7f0ed2bb2700 1 -- 172.21.15.88:0/3856391480 learned_addr learned my addr 172.21.15.88:0/3856391480 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:04.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.756+0000 7f0ed23b1700 1 -- 172.21.15.88:0/3856391480 >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 msgr2=0x7f0ecc0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:04.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.756+0000 7f0ed1bb0700 1 -- 172.21.15.88:0/3856391480 >> v1:172.21.15.88:6789/0 conn(0x7f0ecc0a5410 legacy=0x7f0ecc131280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:04.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:04.756+0000 7f0ed23b1700 1 --2- 172.21.15.88:0/3856391480 >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 0x7f0ecc0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:26:05.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:05.157+0000 7f0ed23b1700 1 -- 172.21.15.88:0/3856391480 >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 msgr2=0x7f0ecc0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:05.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:05.157+0000 7f0ed1bb0700 1 -- 172.21.15.88:0/3856391480 >> v1:172.21.15.88:6789/0 conn(0x7f0ecc0a5410 legacy=0x7f0ecc131280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:05.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:05.157+0000 7f0ed23b1700 1 --2- 172.21.15.88:0/3856391480 >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 0x7f0ecc0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:26:05.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:05.958+0000 7f0ed1bb0700 1 -- 172.21.15.88:0/3856391480 >> v1:172.21.15.88:6789/0 conn(0x7f0ecc0a5410 legacy=0x7f0ecc131280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:05.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:05.958+0000 7f0ed23b1700 1 -- 172.21.15.88:0/3856391480 >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 msgr2=0x7f0ecc0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:05.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:05.958+0000 7f0ed23b1700 1 --2- 172.21.15.88:0/3856391480 >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 0x7f0ecc0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:26:07.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:07.559+0000 7f0ed1bb0700 1 -- 172.21.15.88:0/3856391480 >> v1:172.21.15.88:6789/0 conn(0x7f0ecc0a5410 legacy=0x7f0ecc131280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:07.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:07.559+0000 7f0ed23b1700 1 -- 172.21.15.88:0/3856391480 >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 msgr2=0x7f0ecc0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:07.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:07.559+0000 7f0ed23b1700 1 --2- 172.21.15.88:0/3856391480 >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 0x7f0ecc0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:26:09.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.286+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963199482 0 0) 0x7f0ecc0a4350 con 0x7f0ecc131990 2020-02-11T16:26:09.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.286+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb4003230 con 0x7f0ecc131990 2020-02-11T16:26:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 642623584 0 0) 0x7f0eb4003230 con 0x7f0ecc131990 2020-02-11T16:26:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 msgr2=0x7f0ecc0a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 --2- 172.21.15.88:0/3856391480 >> v2:172.21.15.88:3300/0 conn(0x7f0ecc0a2fa0 0x7f0ecc0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 >> v1:172.21.15.88:6789/0 conn(0x7f0ecc0a5410 legacy=0x7f0ecc131280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc0a3ce0 con 0x7f0ecc131990 2020-02-11T16:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f0ec4001930 con 0x7f0ecc131990 2020-02-11T16:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 >> v1:172.21.15.52:6789/0 conn(0x7f0ecc131990 legacy=0x7f0ecc13ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb4003720 0x7f0eb4003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 0x7f0eb40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb4004a20 0x7f0eb4004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:09.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc0a1e60 con 0x7f0eb4003fa0 2020-02-11T16:26:09.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb400b7b0 con 0x7f0eb4004a20 2020-02-11T16:26:09.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.287+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb400ca80 con 0x7f0eb4003720 2020-02-11T16:26:09.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed2bb2700 1 -- 172.21.15.88:0/3856391480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb4004a20 msgr2=0x7f0eb4004ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:09.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed2bb2700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb4004a20 0x7f0eb4004ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:09.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 0x7f0eb40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed23b1700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb4003720 0x7f0eb4003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed1bb0700 1 -- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb4003720 msgr2=0x7f0eb4003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:09.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb4003720 0x7f0eb4003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:09.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed1bb0700 1 -- 172.21.15.88:0/3856391480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb4004a20 msgr2=0x7f0eb4004ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:09.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb4004a20 0x7f0eb4004ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:09.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed1bb0700 1 -- 172.21.15.88:0/3856391480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4003230 con 0x7f0eb4003fa0 2020-02-11T16:26:09.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed2bb2700 1 -- 172.21.15.88:0/3856391480 reap_dead start 2020-02-11T16:26:09.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 0x7f0eb40044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 0x7f0eb40044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.288+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 0x7f0eb40044d0 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).ready entity=mon.0 client_cookie=f618c924d21be244 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.289+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 0x7f0eb40044d0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.289+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ebc00d4a0 con 0x7f0eb4003fa0 2020-02-11T16:26:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.289+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 0x7f0eb40044d0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.289+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc00d600 con 0x7f0eb4003fa0 2020-02-11T16:26:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.289+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 0x7f0eb40044d0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.289+0000 7f0ed13af700 1 -- 172.21.15.88:0/3856391480 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ebc00d9a0 con 0x7f0eb4003fa0 2020-02-11T16:26:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.289+0000 7f0ed4615700 1 -- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 msgr2=0x7f0eb40044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.289+0000 7f0ed4615700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 0x7f0eb40044d0 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).stop 2020-02-11T16:26:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.290+0000 7f0ed4615700 1 -- 172.21.15.88:0/3856391480 shutdown_connections 2020-02-11T16:26:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.290+0000 7f0ed4615700 1 --2- 172.21.15.88:0/3856391480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb4003fa0 0x7f0eb40044d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.290+0000 7f0ed4615700 1 -- 172.21.15.88:0/3856391480 >> 172.21.15.88:0/3856391480 conn(0x7f0ecc09d110 msgr2=0x7f0ecc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.290+0000 7f0ed4615700 1 -- 172.21.15.88:0/3856391480 shutdown_connections 2020-02-11T16:26:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.290+0000 7f0ed4615700 1 -- 172.21.15.88:0/3856391480 wait complete. 2020-02-11T16:26:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.291+0000 7f0ed4615700 1 Processor -- start 2020-02-11T16:26:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.291+0000 7f0ed4615700 1 -- start start 2020-02-11T16:26:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed4615700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0eb4003fa0 0x7f0ecc137d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed4615700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed4615700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc136280 con 0x7f0ecc12fe20 2020-02-11T16:26:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed23b1700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f0eb4003fa0 msgr2=0x7f0ecc137d10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed4615700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ecc135290 con 0x7f0eb4003fa0 2020-02-11T16:26:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed4615700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc130a40 con 0x7f0ecc1393c0 2020-02-11T16:26:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed23b1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0eb4003fa0 0x7f0ecc137d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed2bb2700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0ecc12fe20 0x7f0ecc09ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:38764/0 (socket says 172.21.15.88:38764) 2020-02-11T16:26:09.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed1bb0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed2bb2700 1 -- 172.21.15.88:0/4242721081 learned_addr learned my addr 172.21.15.88:0/4242721081 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:09.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ebb7fe700 1 -- 172.21.15.88:0/4242721081 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984716475 0 0) 0x7f0ecc136280 con 0x7f0ecc12fe20 2020-02-11T16:26:09.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ebb7fe700 1 -- 172.21.15.88:0/4242721081 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eac002fe0 con 0x7f0ecc12fe20 2020-02-11T16:26:09.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed1bb0700 1 -- 172.21.15.88:0/4242721081 >> v2:172.21.15.88:3300/0 conn(0x7f0eb4003fa0 msgr2=0x7f0ecc137d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:09.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> v2:172.21.15.88:3300/0 conn(0x7f0eb4003fa0 0x7f0ecc137d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed1bb0700 1 -- 172.21.15.88:0/4242721081 >> v1:172.21.15.52:6789/0 conn(0x7f0ecc12fe20 legacy=0x7f0ecc09ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed1bb0700 1 -- 172.21.15.88:0/4242721081 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc135cf0 con 0x7f0ecc1393c0 2020-02-11T16:26:09.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.292+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ebb7fe700 1 -- 172.21.15.88:0/4242721081 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ebc016120 con 0x7f0ecc1393c0 2020-02-11T16:26:09.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ebb7fe700 1 -- 172.21.15.88:0/4242721081 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc003de0 con 0x7f0ecc1393c0 2020-02-11T16:26:09.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ed4615700 1 -- 172.21.15.88:0/4242721081 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc136830 con 0x7f0ecc1393c0 2020-02-11T16:26:09.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ebb7fe700 1 -- 172.21.15.88:0/4242721081 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ebc00f4e0 con 0x7f0ecc1393c0 2020-02-11T16:26:09.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ed4615700 1 -- 172.21.15.88:0/4242721081 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc0a01d0 con 0x7f0ecc1393c0 2020-02-11T16:26:09.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ebb7fe700 1 -- 172.21.15.88:0/4242721081 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0ebc00f760 con 0x7f0ecc1393c0 2020-02-11T16:26:09.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.293+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.294+0000 7f0ebb7fe700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0eac039ef0 0x7f0eac03c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.294+0000 7f0ebb7fe700 1 -- 172.21.15.88:0/4242721081 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f0ebc0060a0 con 0x7f0ecc1393c0 2020-02-11T16:26:09.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.294+0000 7f0ed4615700 1 -- 172.21.15.88:0/4242721081 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ecc0565b0 con 0x7f0ecc1393c0 2020-02-11T16:26:09.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.294+0000 7f0ed23b1700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0eac039ef0 0x7f0eac03c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.294+0000 7f0ed23b1700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0eac039ef0 0x7f0eac03c3b0 crc :-1 s=READY pgs=467 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.298+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.298+0000 7f0ebb7fe700 1 -- 172.21.15.88:0/4242721081 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f0ebc036ae0 con 0x7f0ecc1393c0 2020-02-11T16:26:09.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.530+0000 7f0ed4615700 1 -- 172.21.15.88:0/4242721081 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0ecc135e80 con 0x7f0ecc1393c0 2020-02-11T16:26:09.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.531+0000 7f0ed1bb0700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.531+0000 7f0ebb7fe700 1 -- 172.21.15.88:0/4242721081 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f0ebc007b70 con 0x7f0ecc1393c0 2020-02-11T16:26:09.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 -- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0eac039ef0 msgr2=0x7f0eac03c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0eac039ef0 0x7f0eac03c3b0 crc :-1 s=READY pgs=467 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 -- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 msgr2=0x7f0ecc138170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f0ebc0037b0 tx=0x7f0ebc00ff30).stop 2020-02-11T16:26:09.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 -- 172.21.15.88:0/4242721081 shutdown_connections 2020-02-11T16:26:09.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0eac039ef0 0x7f0eac03c3b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 --2- 172.21.15.88:0/4242721081 >> v2:172.21.15.88:3300/0 conn(0x7f0eb4003fa0 0x7f0ecc137d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 --2- 172.21.15.88:0/4242721081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ecc1393c0 0x7f0ecc138170 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 -- 172.21.15.88:0/4242721081 >> 172.21.15.88:0/4242721081 conn(0x7f0ecc09d110 msgr2=0x7f0ecc05b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:09.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 -- 172.21.15.88:0/4242721081 shutdown_connections 2020-02-11T16:26:09.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.532+0000 7f0ed4615700 1 -- 172.21.15.88:0/4242721081 wait complete. 2020-02-11T16:26:09.537 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":166,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:09.545 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":166,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:09.545 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:26:09.545 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:26:09.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.665+0000 7fb2a7974700 1 Processor -- start 2020-02-11T16:26:09.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.666+0000 7fb2a7974700 1 -- start start 2020-02-11T16:26:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.666+0000 7fb2a7974700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.666+0000 7fb2a7974700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a00a31b0 con 0x7fb2a00a5de0 2020-02-11T16:26:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.666+0000 7fb2a7974700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a00a3570 con 0x7fb2a00a6260 2020-02-11T16:26:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.666+0000 7fb2a7974700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00a3810 con 0x7fb2a00a18a0 2020-02-11T16:26:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.666+0000 7fb2a5f11700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fb2a00a6260 legacy=0x7fb2a012eab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb2a5710700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb2a5710700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45346/0 (socket says 172.21.15.88:45346) 2020-02-11T16:26:09.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb2a5710700 1 -- 172.21.15.88:0/4256289018 learned_addr learned my addr 172.21.15.88:0/4256289018 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:09.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb2a5710700 1 -- 172.21.15.88:0/4256289018 >> v1:172.21.15.88:6789/0 conn(0x7fb2a00a6260 legacy=0x7fb2a012eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:09.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb2a5710700 1 -- 172.21.15.88:0/4256289018 >> v1:172.21.15.52:6789/0 conn(0x7fb2a00a5de0 legacy=0x7fb2a012e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb2a5710700 1 -- 172.21.15.88:0/4256289018 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a00a3ab0 con 0x7fb2a00a18a0 2020-02-11T16:26:09.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb2a5710700 1 --2- 172.21.15.88:0/4256289018 >> v2:172.21.15.52:3300/0 conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb2a00a5cc0 tx=0x7fb29c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb2a5710700 1 --2- 172.21.15.88:0/4256289018 >> v2:172.21.15.52:3300/0 conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb2a00a5cc0 tx=0x7fb29c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb2a5710700 1 --2- 172.21.15.88:0/4256289018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fb2a00a5cc0 tx=0x7fb29c0088e0).ready entity=mon.0 client_cookie=21f3dcea1a8a3fc4 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb2a5710700 1 --2- 172.21.15.88:0/4256289018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fb2a00a5cc0 tx=0x7fb29c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.667+0000 7fb28ffff700 1 -- 172.21.15.88:0/4256289018 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb29c011720 con 0x7fb2a00a18a0 2020-02-11T16:26:09.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb2a5710700 1 --2- 172.21.15.88:0/4256289018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fb2a00a5cc0 tx=0x7fb29c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb2a5710700 1 --2- 172.21.15.88:0/4256289018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fb2a00a5cc0 tx=0x7fb29c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb28ffff700 1 -- 172.21.15.88:0/4256289018 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c011880 con 0x7fb2a00a18a0 2020-02-11T16:26:09.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb28ffff700 1 -- 172.21.15.88:0/4256289018 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb29c011c20 con 0x7fb2a00a18a0 2020-02-11T16:26:09.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb2a7974700 1 -- 172.21.15.88:0/4256289018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a18a0 msgr2=0x7fb2a00a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb2a7974700 1 --2- 172.21.15.88:0/4256289018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fb2a00a5cc0 tx=0x7fb29c0088e0).stop 2020-02-11T16:26:09.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb2a7974700 1 -- 172.21.15.88:0/4256289018 shutdown_connections 2020-02-11T16:26:09.675 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb2a7974700 1 --2- 172.21.15.88:0/4256289018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a18a0 0x7fb2a00a6dd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb2a7974700 1 -- 172.21.15.88:0/4256289018 >> 172.21.15.88:0/4256289018 conn(0x7fb2a009d110 msgr2=0x7fb2a009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:09.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb2a7974700 1 -- 172.21.15.88:0/4256289018 shutdown_connections 2020-02-11T16:26:09.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.668+0000 7fb2a7974700 1 -- 172.21.15.88:0/4256289018 wait complete. 2020-02-11T16:26:09.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.669+0000 7fb2a7974700 1 Processor -- start 2020-02-11T16:26:09.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.669+0000 7fb2a7974700 1 -- start start 2020-02-11T16:26:09.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a7974700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a7974700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2a00a5de0 0x7fb2a0128910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a7974700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a0145620 con 0x7fb2a00a6260 2020-02-11T16:26:09.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a7974700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00a9c70 con 0x7fb2a00a5de0 2020-02-11T16:26:09.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a7974700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0128d70 con 0x7fb2a00a18a0 2020-02-11T16:26:09.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a4f0f700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fb2a00a5de0 msgr2=0x7fb2a0128910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:09.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5f11700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fb2a00a6260 legacy=0x7fb2a0145a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:09.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a4f0f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2a00a5de0 0x7fb2a0128910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:09.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5710700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5710700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:53690/0 (socket says 172.21.15.88:53690) 2020-02-11T16:26:09.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5710700 1 -- 172.21.15.88:0/3198490140 learned_addr learned my addr 172.21.15.88:0/3198490140 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:09.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5710700 1 -- 172.21.15.88:0/3198490140 >> v2:172.21.15.88:3300/0 conn(0x7fb2a00a5de0 msgr2=0x7fb2a0128910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:09.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5710700 1 --2- 172.21.15.88:0/3198490140 >> v2:172.21.15.88:3300/0 conn(0x7fb2a00a5de0 0x7fb2a0128910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5710700 1 -- 172.21.15.88:0/3198490140 >> v1:172.21.15.88:6789/0 conn(0x7fb2a00a6260 legacy=0x7fb2a0145a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5710700 1 -- 172.21.15.88:0/3198490140 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a00a0730 con 0x7fb2a00a18a0 2020-02-11T16:26:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5710700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb2a00a9b30 tx=0x7fb29c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5710700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb2a00a9b30 tx=0x7fb29c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.670+0000 7fb2a5710700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fb2a00a9b30 tx=0x7fb29c0114d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb2a5710700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fb2a00a9b30 tx=0x7fb29c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb29c007340 con 0x7fb2a00a18a0 2020-02-11T16:26:09.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb2a5710700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fb2a00a9b30 tx=0x7fb29c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb2a5710700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fb2a00a9b30 tx=0x7fb29c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c0074a0 con 0x7fb2a00a18a0 2020-02-11T16:26:09.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb2a7974700 1 -- 172.21.15.88:0/3198490140 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a0132010 con 0x7fb2a00a18a0 2020-02-11T16:26:09.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb29c0058b0 con 0x7fb2a00a18a0 2020-02-11T16:26:09.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb2a7974700 1 -- 172.21.15.88:0/3198490140 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a0135790 con 0x7fb2a00a18a0 2020-02-11T16:26:09.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb2a5710700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fb2a00a9b30 tx=0x7fb29c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb29c005b20 con 0x7fb2a00a18a0 2020-02-11T16:26:09.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.671+0000 7fb2a5710700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fb2a00a9b30 tx=0x7fb29c0114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb28e7fc700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb280039c50 0x7fb28003c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb29c04a2d0 con 0x7fb2a00a18a0 2020-02-11T16:26:09.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb2a7974700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 0x7fb2a00a8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb2a7974700 1 -- 172.21.15.88:0/3198490140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a005e2f0 con 0x7fb2a00a94e0 2020-02-11T16:26:09.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb2a4f0f700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb280039c50 0x7fb28003c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 0x7fb2a00a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb2a4f0f700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb280039c50 0x7fb28003c110 crc :-1 s=READY pgs=468 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb2a5f11700 1 -- 172.21.15.88:0/3198490140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2a01457b0 con 0x7fb2a00a94e0 2020-02-11T16:26:09.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 0x7fb2a00a8990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 0x7fb2a00a8990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.672+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 0x7fb2a00a8990 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.673+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 0x7fb2a00a8990 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.673+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb298008e60 con 0x7fb2a00a94e0 2020-02-11T16:26:09.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.673+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 0x7fb2a00a8990 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.673+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fb298003c80 con 0x7fb2a00a94e0 2020-02-11T16:26:09.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.673+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 msgr2=0x7fb2a00a8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.673+0000 7fb28e7fc700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 0x7fb2a00a8990 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).stop 2020-02-11T16:26:09.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.673+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 msgr2=0x7fb2a00a8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:09.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.673+0000 7fb28e7fc700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a00a94e0 0x7fb2a00a8990 secure :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).stop 2020-02-11T16:26:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.683+0000 7fb2a7974700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 0x7fb2a0129290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.683+0000 7fb2a7974700 1 -- 172.21.15.88:0/3198490140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a01354b0 con 0x7fb2a0146160 2020-02-11T16:26:09.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.683+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 0x7fb2a0129290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.683+0000 7fb2a5f11700 1 -- 172.21.15.88:0/3198490140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb2a0131e50 con 0x7fb2a0146160 2020-02-11T16:26:09.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.683+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 0x7fb2a0129290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 0x7fb2a0129290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 0x7fb2a0129290 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 0x7fb2a0129290 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb298012ea0 con 0x7fb2a0146160 2020-02-11T16:26:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a5f11700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 0x7fb2a0129290 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4351 (secure 0 0 0) 0x7fb298007950 con 0x7fb2a0146160 2020-02-11T16:26:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 msgr2=0x7fb2a0129290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb28e7fc700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 0x7fb2a0129290 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).stop 2020-02-11T16:26:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb28e7fc700 1 -- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 msgr2=0x7fb2a0129290 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb28e7fc700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a0146160 0x7fb2a0129290 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0x7fb298003800 tx=0x7fb298010b70).stop 2020-02-11T16:26:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a7974700 1 -- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb280039c50 msgr2=0x7fb28003c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a7974700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb280039c50 0x7fb28003c110 crc :-1 s=READY pgs=468 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a7974700 1 -- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 msgr2=0x7fb2a01284b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a7974700 1 --2- 172.21.15.88:0/3198490140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2a00a18a0 0x7fb2a01284b0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fb2a00a9b30 tx=0x7fb29c0114d0).stop 2020-02-11T16:26:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a5f11700 1 -- 172.21.15.88:0/3198490140 reap_dead start 2020-02-11T16:26:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a5f11700 1 -- 172.21.15.88:0/3198490140 reap_dead start 2020-02-11T16:26:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a7974700 1 -- 172.21.15.88:0/3198490140 shutdown_connections 2020-02-11T16:26:09.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.684+0000 7fb2a7974700 1 -- 172.21.15.88:0/3198490140 >> 172.21.15.88:0/3198490140 conn(0x7fb2a009d110 msgr2=0x7fb2a00a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:09.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.685+0000 7fb2a7974700 1 -- 172.21.15.88:0/3198490140 shutdown_connections 2020-02-11T16:26:09.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.685+0000 7fb2a7974700 1 -- 172.21.15.88:0/3198490140 wait complete. 2020-02-11T16:26:09.697 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:26:09.697 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:09.698 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:09.698 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:26:09.698 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 166, 2020-02-11T16:26:09.698 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:26:09.699 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:26:09.699 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:26:09.699 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.699 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:26:09.699 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:09.699 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:26:09.700 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:26:09.700 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:09.700 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:09.700 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:09.700 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:09.700 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:09.700 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:09.701 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.701 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:26:09.701 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:26:09.701 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:09.701 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:09.701 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:09.701 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:09.701 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:09.702 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:09.702 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.702 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:26:09.702 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:26:09.702 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:26:09.703 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:26:09.703 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:26:09.703 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:26:09.703 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:09.703 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:09.703 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:26:09.704 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:26:09.704 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:09.704 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:26:09.704 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:09.704 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:09.704 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:09.705 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:09.705 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:09.705 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:09.705 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.705 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:26:09.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.706 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:26:09.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.706 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:09.706 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:09.706 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:09.706 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:09.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.707 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:09.707 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:26:09.707 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.707 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:09.708 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:26:09.708 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.708 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.708 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.708 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:26:09.708 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:26:09.709 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:09.709 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:09.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.709 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:26:09.710 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:26:09.710 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:09.710 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:09.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.710 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:09.710 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:26:09.710 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.711 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:09.711 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:26:09.711 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.711 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.712 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.712 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:26:09.712 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:26:09.712 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:09.712 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:09.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.713 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:09.713 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:09.713 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:09.713 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:09.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.713 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:09.714 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:26:09.714 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.714 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:09.714 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:26:09.715 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.715 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.715 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.715 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:26:09.715 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:26:09.715 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:09.716 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:09.716 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.716 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.716 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:26:09.716 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:26:09.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.717 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:09.717 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:09.717 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:09.717 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.717 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.717 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:26:09.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.718 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:09.718 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:09.718 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:09.718 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.718 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.718 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:26:09.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.719 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:09.719 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:09.719 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:26:09.719 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.719 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.719 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:26:09.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.720 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:09.720 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:09.720 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:26:09.720 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.720 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.720 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:26:09.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.721 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:09.721 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:09.721 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:09.721 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.721 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.721 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.722 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:26:09.723 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:26:09.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.841+0000 7f257bddb700 1 Processor -- start 2020-02-11T16:26:09.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.842+0000 7f257bddb700 1 -- start start 2020-02-11T16:26:09.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.842+0000 7f257bddb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25740ad380 0x7f25740a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:09.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.842+0000 7f257bddb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574138710 0x7f257413b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:09.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.842+0000 7f257bddb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25740adb40 con 0x7f2574138280 2020-02-11T16:26:09.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.842+0000 7f257bddb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2574137bf0 con 0x7f25740ad380 2020-02-11T16:26:09.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.842+0000 7f257bddb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2574138b50 con 0x7f2574138710 2020-02-11T16:26:09.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.842+0000 7f2579376700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f2574138280 legacy=0x7f257413b1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:09.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25740ad380 0x7f25740a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f257a378700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574138710 0x7f257413b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25740ad380 0x7f25740a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45364/0 (socket says 172.21.15.88:45364) 2020-02-11T16:26:09.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 -- 172.21.15.88:0/724452074 learned_addr learned my addr 172.21.15.88:0/724452074 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:09.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 -- 172.21.15.88:0/724452074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574138710 msgr2=0x7f257413b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:09.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 --2- 172.21.15.88:0/724452074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574138710 0x7f257413b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:09.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 -- 172.21.15.88:0/724452074 >> v1:172.21.15.88:6789/0 conn(0x7f2574138280 legacy=0x7f257413b1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:09.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 -- 172.21.15.88:0/724452074 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574137de0 con 0x7f25740ad380 2020-02-11T16:26:09.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 --2- 172.21.15.88:0/724452074 >> v2:172.21.15.52:3300/0 conn(0x7f25740ad380 0x7f25740a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f25740af2b0 tx=0x7f25700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 --2- 172.21.15.88:0/724452074 >> v2:172.21.15.52:3300/0 conn(0x7f25740ad380 0x7f25740a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f25740af2b0 tx=0x7f25700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 --2- 172.21.15.88:0/724452074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740ad380 0x7f25740a9130 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7f25740af2b0 tx=0x7f25700088e0).ready entity=mon.0 client_cookie=bd28895e6c05e009 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 --2- 172.21.15.88:0/724452074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740ad380 0x7f25740a9130 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f25740af2b0 tx=0x7f25700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 --2- 172.21.15.88:0/724452074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740ad380 0x7f25740a9130 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f25740af2b0 tx=0x7f25700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2578b75700 1 -- 172.21.15.88:0/724452074 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2570011670 con 0x7f25740ad380 2020-02-11T16:26:09.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2579b77700 1 --2- 172.21.15.88:0/724452074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740ad380 0x7f25740a9130 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f25740af2b0 tx=0x7f25700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2578b75700 1 -- 172.21.15.88:0/724452074 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25700117d0 con 0x7f25740ad380 2020-02-11T16:26:09.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f2578b75700 1 -- 172.21.15.88:0/724452074 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2570011b70 con 0x7f25740ad380 2020-02-11T16:26:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f257bddb700 1 -- 172.21.15.88:0/724452074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740ad380 msgr2=0x7f25740a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.843+0000 7f257bddb700 1 --2- 172.21.15.88:0/724452074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740ad380 0x7f25740a9130 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7f25740af2b0 tx=0x7f25700088e0).stop 2020-02-11T16:26:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.844+0000 7f257bddb700 1 -- 172.21.15.88:0/724452074 shutdown_connections 2020-02-11T16:26:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.844+0000 7f257bddb700 1 --2- 172.21.15.88:0/724452074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574138710 0x7f257413b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.844+0000 7f257bddb700 1 --2- 172.21.15.88:0/724452074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740ad380 0x7f25740a9130 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.844+0000 7f257bddb700 1 -- 172.21.15.88:0/724452074 >> 172.21.15.88:0/724452074 conn(0x7f257405ac70 msgr2=0x7f25740ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.844+0000 7f257bddb700 1 -- 172.21.15.88:0/724452074 shutdown_connections 2020-02-11T16:26:09.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.844+0000 7f257bddb700 1 -- 172.21.15.88:0/724452074 wait complete. 2020-02-11T16:26:09.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.845+0000 7f257bddb700 1 Processor -- start 2020-02-11T16:26:09.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.845+0000 7f257bddb700 1 -- start start 2020-02-11T16:26:09.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.845+0000 7f257bddb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2574138280 0x7f2574134c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.845+0000 7f257bddb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2574138710 0x7f25741454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.845+0000 7f257bddb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2574139460 con 0x7f25740ad380 2020-02-11T16:26:09.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.845+0000 7f257bddb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257413be00 con 0x7f2574138710 2020-02-11T16:26:09.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.845+0000 7f257bddb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2574139700 con 0x7f2574138280 2020-02-11T16:26:09.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.845+0000 7f2579b77700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f25740ad380 legacy=0x7f2574139ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:09.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.845+0000 7f2579376700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f2574138280 msgr2=0x7f2574134c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:09.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.845+0000 7f2579376700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2574138280 0x7f2574134c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:09.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2574138710 0x7f25741454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2574138710 0x7f25741454d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45374/0 (socket says 172.21.15.88:45374) 2020-02-11T16:26:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 -- 172.21.15.88:0/660547189 learned_addr learned my addr 172.21.15.88:0/660547189 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 -- 172.21.15.88:0/660547189 >> v2:172.21.15.88:3300/0 conn(0x7f2574138280 msgr2=0x7f2574134c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 --2- 172.21.15.88:0/660547189 >> v2:172.21.15.88:3300/0 conn(0x7f2574138280 0x7f2574134c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 -- 172.21.15.88:0/660547189 >> v1:172.21.15.88:6789/0 conn(0x7f25740ad380 legacy=0x7f2574139ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 -- 172.21.15.88:0/660547189 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25741353e0 con 0x7f2574138710 2020-02-11T16:26:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 --2- 172.21.15.88:0/660547189 >> v2:172.21.15.52:3300/0 conn(0x7f2574138710 0x7f25741454d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2574134a20 tx=0x7f256c011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 --2- 172.21.15.88:0/660547189 >> v2:172.21.15.52:3300/0 conn(0x7f2574138710 0x7f25741454d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2574134a20 tx=0x7f256c011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2574138710 0x7f25741454d0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f2574134a20 tx=0x7f256c011050).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2574138710 0x7f25741454d0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f2574134a20 tx=0x7f256c011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2574138710 0x7f25741454d0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f2574134a20 tx=0x7f256c011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256c00e350 con 0x7f2574138710 2020-02-11T16:26:09.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257a378700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2574138710 0x7f25741454d0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f2574134a20 tx=0x7f256c011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c005c30 con 0x7f2574138710 2020-02-11T16:26:09.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f257bddb700 1 -- 172.21.15.88:0/660547189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25741350c0 con 0x7f2574138710 2020-02-11T16:26:09.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.846+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256c012a20 con 0x7f2574138710 2020-02-11T16:26:09.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.847+0000 7f257bddb700 1 -- 172.21.15.88:0/660547189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2574144db0 con 0x7f2574138710 2020-02-11T16:26:09.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.847+0000 7f257a378700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2574138710 0x7f25741454d0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f2574134a20 tx=0x7f256c011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.847+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f256c012c90 con 0x7f2574138710 2020-02-11T16:26:09.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f257a378700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2574138710 0x7f25741454d0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f2574134a20 tx=0x7f256c011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f257bddb700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 0x7f25740664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f257bddb700 1 -- 172.21.15.88:0/660547189 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257405e2f0 con 0x7f2574145930 2020-02-11T16:26:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2562ffd700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2554039c10 0x7f255403c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 0x7f25740664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f256c049a10 con 0x7f2574138710 2020-02-11T16:26:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2579376700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2554039c10 0x7f255403c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2579b77700 1 -- 172.21.15.88:0/660547189 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2574145d40 con 0x7f2574145930 2020-02-11T16:26:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 0x7f25740664d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 0x7f25740664d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2579376700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2554039c10 0x7f255403c0d0 crc :-1 s=READY pgs=469 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 0x7f25740664d0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 0x7f25740664d0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.848+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2570007340 con 0x7f2574145930 2020-02-11T16:26:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.849+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 0x7f25740664d0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.849+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f25700074a0 con 0x7f2574145930 2020-02-11T16:26:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.849+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 msgr2=0x7f25740664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.849+0000 7f2562ffd700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 0x7f25740664d0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).stop 2020-02-11T16:26:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.849+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 msgr2=0x7f25740664d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.849+0000 7f2562ffd700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2574145930 0x7f25740664d0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).stop 2020-02-11T16:26:09.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.857+0000 7f257bddb700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 0x7f257412f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:09.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.857+0000 7f257bddb700 1 -- 172.21.15.88:0/660547189 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25740565b0 con 0x7f257412f4a0 2020-02-11T16:26:09.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.857+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 0x7f257412f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:09.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.857+0000 7f2579b77700 1 -- 172.21.15.88:0/660547189 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f257405ccb0 con 0x7f257412f4a0 2020-02-11T16:26:09.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.857+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 0x7f257412f8b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.857+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 0x7f257412f8b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.857+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 0x7f257412f8b0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:09.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 0x7f257412f8b0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2570005e60 con 0x7f257412f4a0 2020-02-11T16:26:09.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f2579b77700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 0x7f257412f8b0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:09.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f257000d610 con 0x7f257412f4a0 2020-02-11T16:26:09.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 msgr2=0x7f257412f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f2562ffd700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 0x7f257412f8b0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).stop 2020-02-11T16:26:09.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f2562ffd700 1 -- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 msgr2=0x7f257412f8b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:09.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f2562ffd700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f257412f4a0 0x7f257412f8b0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0x7f25700084c0 tx=0x7f2570011420).stop 2020-02-11T16:26:09.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257bddb700 1 -- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2554039c10 msgr2=0x7f255403c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257bddb700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2554039c10 0x7f255403c0d0 crc :-1 s=READY pgs=469 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257bddb700 1 -- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2574138710 msgr2=0x7f25741454d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257bddb700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2574138710 0x7f25741454d0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f2574134a20 tx=0x7f256c011050).stop 2020-02-11T16:26:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257a378700 1 -- 172.21.15.88:0/660547189 reap_dead start 2020-02-11T16:26:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257a378700 1 -- 172.21.15.88:0/660547189 reap_dead start 2020-02-11T16:26:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257bddb700 1 -- 172.21.15.88:0/660547189 shutdown_connections 2020-02-11T16:26:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257bddb700 1 --2- 172.21.15.88:0/660547189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2574138710 0x7f25741454d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257bddb700 1 -- 172.21.15.88:0/660547189 >> 172.21.15.88:0/660547189 conn(0x7f257405ac70 msgr2=0x7f2574069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257bddb700 1 -- 172.21.15.88:0/660547189 shutdown_connections 2020-02-11T16:26:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:09.858+0000 7f257bddb700 1 -- 172.21.15.88:0/660547189 wait complete. 2020-02-11T16:26:09.873 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:26:09.873 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:09.873 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:09.874 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:26:09.874 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 166, 2020-02-11T16:26:09.874 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:26:09.874 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:26:09.874 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:26:09.874 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.874 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:26:09.875 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:09.875 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:26:09.875 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:26:09.875 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:09.875 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:09.875 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:09.876 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:09.876 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:09.876 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:09.876 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.876 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:26:09.876 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:26:09.876 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:09.877 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:09.877 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:09.877 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:09.877 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:09.877 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:09.877 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.878 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:26:09.878 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:26:09.878 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:26:09.878 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:26:09.878 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:26:09.878 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:26:09.878 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:09.879 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:09.879 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:26:09.879 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:26:09.879 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:09.879 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:26:09.879 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:09.879 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:09.880 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:09.880 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:09.880 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:09.880 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:09.880 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.880 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:26:09.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.881 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:26:09.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.881 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:09.881 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:09.881 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:09.881 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:09.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.882 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:09.882 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:26:09.882 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.883 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:09.883 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:26:09.883 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.883 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.883 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.883 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:26:09.884 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:26:09.884 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:09.884 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:09.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.884 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:26:09.884 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:26:09.885 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:09.885 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:09.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.885 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:09.885 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:26:09.885 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:26:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.887 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:26:09.887 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:26:09.887 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:09.887 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:09.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.887 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:09.888 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:09.888 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:09.888 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:09.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.888 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:09.888 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:26:09.888 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.889 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:09.889 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:26:09.889 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:09.889 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.890 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.890 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:26:09.890 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:26:09.890 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:09.891 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:09.891 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.891 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:09.892 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:26:09.892 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:26:09.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.892 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:09.892 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:09.892 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:09.893 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.893 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.893 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:26:09.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.893 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:09.893 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:09.894 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:09.894 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.894 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.894 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:26:09.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.894 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:09.894 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:09.895 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:26:09.895 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.895 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.895 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:26:09.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.895 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:09.895 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:09.896 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:26:09.896 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.896 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:09.896 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:26:09.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:09.896 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:09.896 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:09.896 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:09.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.897 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:09.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:09.897 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:26:09.898 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:26:15.851 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:26:15.854 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:26:29.899 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:26:29.899 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:26:29.899 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:26:29.899 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:26:29.902 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:26:29.902 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:26:29.902 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:26:30.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.018+0000 7efeef4e4700 1 Processor -- start 2020-02-11T16:26:30.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.018+0000 7efeef4e4700 1 -- start start 2020-02-11T16:26:30.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeef4e4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efee80a9130 0x7efee81314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:30.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeef4e4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efee8131920 0x7efee8131d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:30.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeef4e4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee80adb40 con 0x7efee80ad380 2020-02-11T16:26:30.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeef4e4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee8137bf0 con 0x7efee80a9130 2020-02-11T16:26:30.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeef4e4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee8137de0 con 0x7efee8131920 2020-02-11T16:26:30.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeda81700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efee8131920 0x7efee8131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:30.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeda81700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efee8131920 0x7efee8131d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59406/0 (socket says 172.21.15.88:59406) 2020-02-11T16:26:30.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeda81700 1 -- 172.21.15.88:0/1652790082 learned_addr learned my addr 172.21.15.88:0/1652790082 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:30.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeda81700 1 -- 172.21.15.88:0/1652790082 >> v2:172.21.15.88:3300/0 conn(0x7efee8131920 msgr2=0x7efee8131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:26:30.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeda81700 1 -- 172.21.15.88:0/1652790082 >> v2:172.21.15.88:3300/0 conn(0x7efee8131920 msgr2=0x7efee8131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:26:30.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeda81700 1 --2- 172.21.15.88:0/1652790082 >> v2:172.21.15.88:3300/0 conn(0x7efee8131920 0x7efee8131d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:26:30.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeda81700 1 --2- 172.21.15.88:0/1652790082 >> v2:172.21.15.88:3300/0 conn(0x7efee8131920 0x7efee8131d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:30.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1652790082 >> v2:172.21.15.52:3300/0 conn(0x7efee80a9130 0x7efee81314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:30.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeca7f700 1 -- 172.21.15.88:0/1652790082 >> v2:172.21.15.88:3300/0 conn(0x7efee8131920 msgr2=0x7efee8131d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:30.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1652790082 >> v2:172.21.15.88:3300/0 conn(0x7efee8131920 0x7efee8131d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:30.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeca7f700 1 -- 172.21.15.88:0/1652790082 >> v1:172.21.15.52:6789/0 conn(0x7efee80ad380 legacy=0x7efee8138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:30.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efed7fff700 1 -- 172.21.15.88:0/1652790082 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051809521 0 0) 0x7efee80adb40 con 0x7efee80ad380 2020-02-11T16:26:30.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeca7f700 1 -- 172.21.15.88:0/1652790082 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee80a95c0 con 0x7efee80a9130 2020-02-11T16:26:30.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.019+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1652790082 >> v2:172.21.15.52:3300/0 conn(0x7efee80a9130 0x7efee81314c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efed8002f30 tx=0x7efed8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1652790082 >> v2:172.21.15.52:3300/0 conn(0x7efee80a9130 0x7efee81314c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efed8002f30 tx=0x7efed8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1652790082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efee80a9130 0x7efee81314c0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7efed8002f30 tx=0x7efed8007a40).ready entity=mon.0 client_cookie=21847c23fbd2f416 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:30.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1652790082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efee80a9130 0x7efee81314c0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7efed8002f30 tx=0x7efed8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efed7fff700 1 -- 172.21.15.88:0/1652790082 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efed8011470 con 0x7efee80a9130 2020-02-11T16:26:30.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1652790082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efee80a9130 0x7efee81314c0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7efed8002f30 tx=0x7efed8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efed7fff700 1 -- 172.21.15.88:0/1652790082 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed80115d0 con 0x7efee80a9130 2020-02-11T16:26:30.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1652790082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efee80a9130 0x7efee81314c0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7efed8002f30 tx=0x7efed8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efed7fff700 1 -- 172.21.15.88:0/1652790082 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efed8011970 con 0x7efee80a9130 2020-02-11T16:26:30.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeef4e4700 1 -- 172.21.15.88:0/1652790082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efee80a9130 msgr2=0x7efee81314c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:30.026 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeef4e4700 1 --2- 172.21.15.88:0/1652790082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efee80a9130 0x7efee81314c0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7efed8002f30 tx=0x7efed8007a40).stop 2020-02-11T16:26:30.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeef4e4700 1 -- 172.21.15.88:0/1652790082 shutdown_connections 2020-02-11T16:26:30.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeef4e4700 1 --2- 172.21.15.88:0/1652790082 >> v2:172.21.15.88:3300/0 conn(0x7efee8131920 0x7efee8131d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:30.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeef4e4700 1 --2- 172.21.15.88:0/1652790082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efee80a9130 0x7efee81314c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:30.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeef4e4700 1 -- 172.21.15.88:0/1652790082 >> 172.21.15.88:0/1652790082 conn(0x7efee805ac70 msgr2=0x7efee80ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:30.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeef4e4700 1 -- 172.21.15.88:0/1652790082 shutdown_connections 2020-02-11T16:26:30.027 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.020+0000 7efeef4e4700 1 -- 172.21.15.88:0/1652790082 wait complete. 2020-02-11T16:26:30.032 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.021+0000 7efeef4e4700 1 Processor -- start 2020-02-11T16:26:30.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.021+0000 7efeef4e4700 1 -- start start 2020-02-11T16:26:30.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeef4e4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efee80ad380 0x7efee8126dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:30.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeef4e4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee813b0b0 con 0x7efee8131920 2020-02-11T16:26:30.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeef4e4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee813a5e0 con 0x7efee80a9130 2020-02-11T16:26:30.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeef4e4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee8139520 con 0x7efee80ad380 2020-02-11T16:26:30.033 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeeca7f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efee80ad380 0x7efee8126dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:30.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeeca7f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efee80ad380 0x7efee8126dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59410/0 (socket says 172.21.15.88:59410) 2020-02-11T16:26:30.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeeca7f700 1 -- 172.21.15.88:0/1449036208 learned_addr learned my addr 172.21.15.88:0/1449036208 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:30.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeed280700 1 --1- 172.21.15.88:0/1449036208 >> v1:172.21.15.88:6789/0 conn(0x7efee80a9130 0x7efee81266c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47034/0 (socket says 172.21.15.88:47034) 2020-02-11T16:26:30.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeeca7f700 1 -- 172.21.15.88:0/1449036208 >> v2:172.21.15.88:3300/0 conn(0x7efee80ad380 msgr2=0x7efee8126dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:26:30.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeeca7f700 1 -- 172.21.15.88:0/1449036208 >> v2:172.21.15.88:3300/0 conn(0x7efee80ad380 msgr2=0x7efee8126dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:26:30.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1449036208 >> v2:172.21.15.88:3300/0 conn(0x7efee80ad380 0x7efee8126dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:26:30.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1449036208 >> v2:172.21.15.88:3300/0 conn(0x7efee80ad380 0x7efee8126dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:30.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063370808 0 0) 0x7efee813b0b0 con 0x7efee8131920 2020-02-11T16:26:30.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.022+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec8002fe0 con 0x7efee8131920 2020-02-11T16:26:30.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2496687289 0 0) 0x7efec8002fe0 con 0x7efee8131920 2020-02-11T16:26:30.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efee813b0b0 con 0x7efee8131920 2020-02-11T16:26:30.035 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7efee0001890 con 0x7efee8131920 2020-02-11T16:26:30.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 >> v2:172.21.15.88:3300/0 conn(0x7efee80ad380 msgr2=0x7efee8126dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:30.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 --2- 172.21.15.88:0/1449036208 >> v2:172.21.15.88:3300/0 conn(0x7efee80ad380 0x7efee8126dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:30.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 >> v1:172.21.15.88:6789/0 conn(0x7efee80a9130 legacy=0x7efee81266c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:30.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 >> v1:172.21.15.52:6789/0 conn(0x7efee8131920 legacy=0x7efee814f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:30.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efec80049b0 0x7efec8004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:30.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efec8003920 0x7efec8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:30.036 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:30.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee8139520 con 0x7efec80041c0 2020-02-11T16:26:30.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec80047d0 con 0x7efec8003920 2020-02-11T16:26:30.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec800bc00 con 0x7efec80049b0 2020-02-11T16:26:30.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efec8003920 0x7efec8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:30.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:30.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeed280700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efec80049b0 0x7efec8004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:30.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeca7f700 1 -- 172.21.15.88:0/1449036208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efec8003920 msgr2=0x7efec8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:26:30.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeca7f700 1 -- 172.21.15.88:0/1449036208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efec8003920 msgr2=0x7efec8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:26:30.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efec8003920 0x7efec8003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:26:30.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeca7f700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efec8003920 0x7efec8003d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:30.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeda81700 1 -- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efec80049b0 msgr2=0x7efec8004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:30.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efec80049b0 0x7efec8004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:30.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeda81700 1 -- 172.21.15.88:0/1449036208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efec8003920 msgr2=0x7efec8003d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:30.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efec8003920 0x7efec8003d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:30.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeda81700 1 -- 172.21.15.88:0/1449036208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee813b350 con 0x7efec80041c0 2020-02-11T16:26:30.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeef4e4700 1 -- 172.21.15.88:0/1449036208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee812dca0 con 0x7efec80041c0 2020-02-11T16:26:30.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.023+0000 7efeeda81700 1 -- 172.21.15.88:0/1449036208 reap_dead start 2020-02-11T16:26:30.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.024+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.024+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:30.039 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.024+0000 7efeef4e4700 1 -- 172.21.15.88:0/1449036208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee812e060 con 0x7efec80041c0 2020-02-11T16:26:30.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.024+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.024+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efee0007350 con 0x7efec80041c0 2020-02-11T16:26:30.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.024+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.024+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.024+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee00074b0 con 0x7efec80041c0 2020-02-11T16:26:30.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.024+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efee0007810 con 0x7efec80041c0 2020-02-11T16:26:30.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.024+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.025+0000 7efeef4e4700 1 -- 172.21.15.88:0/1449036208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec4003340 con 0x7efec80041c0 2020-02-11T16:26:30.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.025+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7efee0009160 con 0x7efec80041c0 2020-02-11T16:26:30.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.025+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.025+0000 7efed67fc700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efec803dd60 0x7efec8040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:30.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.025+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7efee004a190 con 0x7efec80041c0 2020-02-11T16:26:30.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.025+0000 7efeed280700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efec803dd60 0x7efec8040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:30.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.025+0000 7efeed280700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efec803dd60 0x7efec8040220 crc :-1 s=READY pgs=471 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:30.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.028+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.042 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.028+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7efee0032700 con 0x7efec80041c0 2020-02-11T16:26:30.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.262+0000 7efeef4e4700 1 -- 172.21.15.88:0/1449036208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7efec40036e0 con 0x7efec80041c0 2020-02-11T16:26:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.263+0000 7efeeda81700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.263+0000 7efed67fc700 1 -- 172.21.15.88:0/1449036208 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7efee00322c0 con 0x7efec80041c0 2020-02-11T16:26:30.264 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":166,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:30.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.264+0000 7efeef4e4700 1 -- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efec803dd60 msgr2=0x7efec8040220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:30.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.264+0000 7efeef4e4700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efec803dd60 0x7efec8040220 crc :-1 s=READY pgs=471 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:30.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.264+0000 7efeef4e4700 1 -- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 msgr2=0x7efec800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:30.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.264+0000 7efeef4e4700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7efec8005650 tx=0x7efee0011930).stop 2020-02-11T16:26:30.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.264+0000 7efeef4e4700 1 -- 172.21.15.88:0/1449036208 shutdown_connections 2020-02-11T16:26:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.264+0000 7efeef4e4700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efec803dd60 0x7efec8040220 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.264+0000 7efeef4e4700 1 --2- 172.21.15.88:0/1449036208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efec80041c0 0x7efec800b750 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.264+0000 7efeef4e4700 1 -- 172.21.15.88:0/1449036208 >> 172.21.15.88:0/1449036208 conn(0x7efee805ac70 msgr2=0x7efee8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.264+0000 7efeef4e4700 1 -- 172.21.15.88:0/1449036208 shutdown_connections 2020-02-11T16:26:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:30.264+0000 7efeef4e4700 1 -- 172.21.15.88:0/1449036208 wait complete. 2020-02-11T16:26:30.278 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":166,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:33.279 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:26:33.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.393+0000 7f6116181700 1 Processor -- start 2020-02-11T16:26:33.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.393+0000 7f6116181700 1 -- start start 2020-02-11T16:26:33.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.394+0000 7f6116181700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6110136750 0x7f6110141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:33.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.394+0000 7f6116181700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61100a4af0 con 0x7f61100a8690 2020-02-11T16:26:33.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.394+0000 7f6116181700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61100a4d90 con 0x7f61100a3a90 2020-02-11T16:26:33.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.394+0000 7f6116181700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61101302a0 con 0x7f6110136750 2020-02-11T16:26:33.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.394+0000 7f610f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f61100a3a90 0x7f61100a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47064/0 (socket says 172.21.15.88:47064) 2020-02-11T16:26:33.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.394+0000 7f610f7fe700 1 -- 172.21.15.88:0/2718598062 learned_addr learned my addr 172.21.15.88:0/2718598062 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:33.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.394+0000 7f610ffff700 1 --2- 172.21.15.88:0/2718598062 >> v2:172.21.15.52:3300/0 conn(0x7f6110136750 0x7f6110141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.395+0000 7f610ffff700 1 -- 172.21.15.88:0/2718598062 >> v1:172.21.15.88:6789/0 conn(0x7f61100a3a90 legacy=0x7f61100a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.395+0000 7f610ffff700 1 -- 172.21.15.88:0/2718598062 >> v1:172.21.15.52:6789/0 conn(0x7f61100a8690 legacy=0x7f6110136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.395+0000 7f610ffff700 1 -- 172.21.15.88:0/2718598062 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61100a5540 con 0x7f6110136750 2020-02-11T16:26:33.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.395+0000 7f610ffff700 1 --2- 172.21.15.88:0/2718598062 >> v2:172.21.15.52:3300/0 conn(0x7f6110136750 0x7f6110141380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f61080032b0 tx=0x7f6108008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.395+0000 7f610ffff700 1 --2- 172.21.15.88:0/2718598062 >> v2:172.21.15.52:3300/0 conn(0x7f6110136750 0x7f6110141380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f61080032b0 tx=0x7f6108008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.395+0000 7f610ffff700 1 --2- 172.21.15.88:0/2718598062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6110136750 0x7f6110141380 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7f61080032b0 tx=0x7f6108008c60).ready entity=mon.0 client_cookie=c0e071051ab990c7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.395+0000 7f610ffff700 1 --2- 172.21.15.88:0/2718598062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6110136750 0x7f6110141380 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f61080032b0 tx=0x7f6108008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.395+0000 7f610e7fc700 1 -- 172.21.15.88:0/2718598062 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f610800a160 con 0x7f6110136750 2020-02-11T16:26:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.396+0000 7f610ffff700 1 --2- 172.21.15.88:0/2718598062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6110136750 0x7f6110141380 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f61080032b0 tx=0x7f6108008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.396+0000 7f610ffff700 1 --2- 172.21.15.88:0/2718598062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6110136750 0x7f6110141380 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f61080032b0 tx=0x7f6108008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.396+0000 7f610e7fc700 1 -- 172.21.15.88:0/2718598062 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610800a2c0 con 0x7f6110136750 2020-02-11T16:26:33.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.396+0000 7f610e7fc700 1 -- 172.21.15.88:0/2718598062 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f610800a6a0 con 0x7f6110136750 2020-02-11T16:26:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.396+0000 7f6116181700 1 -- 172.21.15.88:0/2718598062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6110136750 msgr2=0x7f6110141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.396+0000 7f6116181700 1 --2- 172.21.15.88:0/2718598062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6110136750 0x7f6110141380 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7f61080032b0 tx=0x7f6108008c60).stop 2020-02-11T16:26:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.396+0000 7f6116181700 1 -- 172.21.15.88:0/2718598062 shutdown_connections 2020-02-11T16:26:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.396+0000 7f6116181700 1 --2- 172.21.15.88:0/2718598062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6110136750 0x7f6110141380 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.396+0000 7f6116181700 1 -- 172.21.15.88:0/2718598062 >> 172.21.15.88:0/2718598062 conn(0x7f61100ac2d0 msgr2=0x7f61100ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.397+0000 7f6116181700 1 -- 172.21.15.88:0/2718598062 shutdown_connections 2020-02-11T16:26:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.397+0000 7f6116181700 1 -- 172.21.15.88:0/2718598062 wait complete. 2020-02-11T16:26:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.397+0000 7f6116181700 1 Processor -- start 2020-02-11T16:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.398+0000 7f6116181700 1 -- start start 2020-02-11T16:26:33.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.398+0000 7f6116181700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61100a8690 0x7f6110131ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.398+0000 7f6116181700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6110131680 con 0x7f61100a3a90 2020-02-11T16:26:33.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.398+0000 7f6116181700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6110132450 con 0x7f6110136750 2020-02-11T16:26:33.406 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.398+0000 7f6116181700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61101318b0 con 0x7f61100a8690 2020-02-11T16:26:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.398+0000 7f610ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6110136750 0x7f6110142d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47074/0 (socket says 172.21.15.88:47074) 2020-02-11T16:26:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.398+0000 7f610ffff700 1 -- 172.21.15.88:0/4124950312 learned_addr learned my addr 172.21.15.88:0/4124950312 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.398+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> v2:172.21.15.52:3300/0 conn(0x7f61100a8690 0x7f6110131ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.398+0000 7f610cff9700 1 -- 172.21.15.88:0/4124950312 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917964186 0 0) 0x7f6110132450 con 0x7f6110136750 2020-02-11T16:26:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610cff9700 1 -- 172.21.15.88:0/4124950312 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f0002fe0 con 0x7f6110136750 2020-02-11T16:26:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610effd700 1 -- 172.21.15.88:0/4124950312 >> v1:172.21.15.88:6789/0 conn(0x7f6110136750 legacy=0x7f6110142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610effd700 1 -- 172.21.15.88:0/4124950312 >> v1:172.21.15.52:6789/0 conn(0x7f61100a3a90 legacy=0x7f6110130cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610cff9700 1 -- 172.21.15.88:0/4124950312 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078087246 0 0) 0x7f6110131680 con 0x7f61100a3a90 2020-02-11T16:26:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610effd700 1 -- 172.21.15.88:0/4124950312 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110131b50 con 0x7f61100a8690 2020-02-11T16:26:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> v2:172.21.15.52:3300/0 conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> v2:172.21.15.52:3300/0 conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610cff9700 1 -- 172.21.15.88:0/4124950312 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f610400cbb0 con 0x7f61100a8690 2020-02-11T16:26:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610cff9700 1 -- 172.21.15.88:0/4124950312 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610400cd10 con 0x7f61100a8690 2020-02-11T16:26:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f6116181700 1 -- 172.21.15.88:0/4124950312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611012dc80 con 0x7f61100a8690 2020-02-11T16:26:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f610cff9700 1 -- 172.21.15.88:0/4124950312 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61040110f0 con 0x7f61100a8690 2020-02-11T16:26:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.399+0000 7f6116181700 1 -- 172.21.15.88:0/4124950312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61101375b0 con 0x7f61100a8690 2020-02-11T16:26:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.400+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.400+0000 7f610cff9700 1 -- 172.21.15.88:0/4124950312 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f61040064e0 con 0x7f61100a8690 2020-02-11T16:26:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.400+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.400+0000 7f610cff9700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f60f0039f30 0x7f60f003c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.400+0000 7f610cff9700 1 -- 172.21.15.88:0/4124950312 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6104049470 con 0x7f61100a8690 2020-02-11T16:26:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.400+0000 7f6116181700 1 -- 172.21.15.88:0/4124950312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6110131480 con 0x7f61100a8690 2020-02-11T16:26:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.400+0000 7f610f7fe700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f60f0039f30 0x7f60f003c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.401+0000 7f610f7fe700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f60f0039f30 0x7f60f003c3f0 crc :-1 s=READY pgs=472 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.404+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.404+0000 7f610cff9700 1 -- 172.21.15.88:0/4124950312 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f610402eab0 con 0x7f61100a8690 2020-02-11T16:26:33.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.628+0000 7f6116181700 1 -- 172.21.15.88:0/4124950312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f61100565b0 con 0x7f61100a8690 2020-02-11T16:26:33.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.629+0000 7f610effd700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.629+0000 7f610cff9700 1 -- 172.21.15.88:0/4124950312 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f61040315c0 con 0x7f61100a8690 2020-02-11T16:26:33.631 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":168,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.630+0000 7f6116181700 1 -- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f60f0039f30 msgr2=0x7f60f003c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.630+0000 7f6116181700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f60f0039f30 0x7f60f003c3f0 crc :-1 s=READY pgs=472 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.630+0000 7f6116181700 1 -- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 msgr2=0x7f6110131ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.630+0000 7f6116181700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 0x7f6110131ff0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7f61040013f0 tx=0x7f6104010910).stop 2020-02-11T16:26:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.630+0000 7f6116181700 1 -- 172.21.15.88:0/4124950312 shutdown_connections 2020-02-11T16:26:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.630+0000 7f6116181700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f60f0039f30 0x7f60f003c3f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.630+0000 7f6116181700 1 --2- 172.21.15.88:0/4124950312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61100a8690 0x7f6110131ff0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.630+0000 7f6116181700 1 -- 172.21.15.88:0/4124950312 >> 172.21.15.88:0/4124950312 conn(0x7f61100ac2d0 msgr2=0x7f6110135fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.631+0000 7f6116181700 1 -- 172.21.15.88:0/4124950312 shutdown_connections 2020-02-11T16:26:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.631+0000 7f6116181700 1 -- 172.21.15.88:0/4124950312 wait complete. 2020-02-11T16:26:33.642 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":168,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:33.643 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:26:33.643 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:26:33.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.760+0000 7f0472b9d700 1 Processor -- start 2020-02-11T16:26:33.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.760+0000 7f0472b9d700 1 -- start start 2020-02-11T16:26:33.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.760+0000 7f0472b9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f046c139c60 0x7f046c0a5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:33.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.760+0000 7f0472b9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f046c135f90 0x7f046c136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:33.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.760+0000 7f0472b9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046c09dba0 con 0x7f046c05fac0 2020-02-11T16:26:33.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.760+0000 7f0472b9d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046c0a5ed0 con 0x7f046c139c60 2020-02-11T16:26:33.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.760+0000 7f0472b9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046c09ddd0 con 0x7f046c135f90 2020-02-11T16:26:33.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.760+0000 7f0470939700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f046c05fac0 0x7f046c139550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47078/0 (socket says 172.21.15.88:47078) 2020-02-11T16:26:33.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.760+0000 7f0470939700 1 -- 172.21.15.88:0/641772572 learned_addr learned my addr 172.21.15.88:0/641772572 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:33.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.760+0000 7f047113a700 1 --2- 172.21.15.88:0/641772572 >> v2:172.21.15.88:3300/0 conn(0x7f046c135f90 0x7f046c136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f0463fff700 1 --2- 172.21.15.88:0/641772572 >> v2:172.21.15.52:3300/0 conn(0x7f046c139c60 0x7f046c0a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f047113a700 1 -- 172.21.15.88:0/641772572 >> v2:172.21.15.52:3300/0 conn(0x7f046c139c60 msgr2=0x7f046c0a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:33.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f047113a700 1 --2- 172.21.15.88:0/641772572 >> v2:172.21.15.52:3300/0 conn(0x7f046c139c60 0x7f046c0a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:33.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f047113a700 1 -- 172.21.15.88:0/641772572 >> v1:172.21.15.88:6789/0 conn(0x7f046c05fac0 legacy=0x7f046c139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f047113a700 1 -- 172.21.15.88:0/641772572 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c09e070 con 0x7f046c135f90 2020-02-11T16:26:33.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f0463fff700 1 --2- 172.21.15.88:0/641772572 >> v2:172.21.15.52:3300/0 conn(0x7f046c139c60 0x7f046c0a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:26:33.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f047113a700 1 --2- 172.21.15.88:0/641772572 >> v2:172.21.15.88:3300/0 conn(0x7f046c135f90 0x7f046c136400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f047113a700 1 --2- 172.21.15.88:0/641772572 >> v2:172.21.15.88:3300/0 conn(0x7f046c135f90 0x7f046c136400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f047113a700 1 --2- 172.21.15.88:0/641772572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c135f90 0x7f046c136400 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).ready entity=mon.1 client_cookie=f883ca09467f144c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f047113a700 1 --2- 172.21.15.88:0/641772572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c135f90 0x7f046c136400 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f047113a700 1 --2- 172.21.15.88:0/641772572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c135f90 0x7f046c136400 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f04637fe700 1 -- 172.21.15.88:0/641772572 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046400a160 con 0x7f046c135f90 2020-02-11T16:26:33.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f047113a700 1 --2- 172.21.15.88:0/641772572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c135f90 0x7f046c136400 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f04637fe700 1 -- 172.21.15.88:0/641772572 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046400a2c0 con 0x7f046c135f90 2020-02-11T16:26:33.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f04637fe700 1 -- 172.21.15.88:0/641772572 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046400a660 con 0x7f046c135f90 2020-02-11T16:26:33.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f0472b9d700 1 -- 172.21.15.88:0/641772572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c135f90 msgr2=0x7f046c136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.761+0000 7f0472b9d700 1 --2- 172.21.15.88:0/641772572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c135f90 0x7f046c136400 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).stop 2020-02-11T16:26:33.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.762+0000 7f0472b9d700 1 -- 172.21.15.88:0/641772572 shutdown_connections 2020-02-11T16:26:33.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.762+0000 7f0472b9d700 1 --2- 172.21.15.88:0/641772572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c135f90 0x7f046c136400 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.762+0000 7f0472b9d700 1 --2- 172.21.15.88:0/641772572 >> v2:172.21.15.52:3300/0 conn(0x7f046c139c60 0x7f046c0a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:33.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.762+0000 7f0472b9d700 1 -- 172.21.15.88:0/641772572 >> 172.21.15.88:0/641772572 conn(0x7f046c0a7bb0 msgr2=0x7f046c0a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:33.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.762+0000 7f0472b9d700 1 -- 172.21.15.88:0/641772572 shutdown_connections 2020-02-11T16:26:33.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.762+0000 7f0472b9d700 1 -- 172.21.15.88:0/641772572 wait complete. 2020-02-11T16:26:33.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.762+0000 7f0472b9d700 1 Processor -- start 2020-02-11T16:26:33.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.762+0000 7f0472b9d700 1 -- start start 2020-02-11T16:26:33.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.763+0000 7f0472b9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f046c139c60 0x7f046c134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.763+0000 7f0472b9d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046c065ee0 con 0x7f046c05fac0 2020-02-11T16:26:33.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.763+0000 7f0472b9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046c0a40e0 con 0x7f046c135f90 2020-02-11T16:26:33.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.763+0000 7f0472b9d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046c1347f0 con 0x7f046c139c60 2020-02-11T16:26:33.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.763+0000 7f0463fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f046c135f90 0x7f046c14d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47086/0 (socket says 172.21.15.88:47086) 2020-02-11T16:26:33.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.763+0000 7f0463fff700 1 -- 172.21.15.88:0/3191036015 learned_addr learned my addr 172.21.15.88:0/3191036015 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:33.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.763+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f046c139c60 0x7f046c134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.763+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774485660 0 0) 0x7f046c0a40e0 con 0x7f046c135f90 2020-02-11T16:26:33.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f044c002fe0 con 0x7f046c135f90 2020-02-11T16:26:33.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036164985 0 0) 0x7f046c065ee0 con 0x7f046c05fac0 2020-02-11T16:26:33.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f046c0a40e0 con 0x7f046c05fac0 2020-02-11T16:26:33.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2084906559 0 0) 0x7f044c002fe0 con 0x7f046c135f90 2020-02-11T16:26:33.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f046c065ee0 con 0x7f046c135f90 2020-02-11T16:26:33.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f045c002500 con 0x7f046c135f90 2020-02-11T16:26:33.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f046c139c60 msgr2=0x7f046c134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f046c139c60 0x7f046c134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 >> v1:172.21.15.88:6789/0 conn(0x7f046c135f90 legacy=0x7f046c14d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 >> v1:172.21.15.52:6789/0 conn(0x7f046c05fac0 legacy=0x7f046c12d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f044c004b20 0x7f044c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f044c003800 0x7f044c003c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c004560 con 0x7f044c003800 2020-02-11T16:26:33.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c0046d0 con 0x7f044c0040e0 2020-02-11T16:26:33.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c00bc30 con 0x7f044c004b20 2020-02-11T16:26:33.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f046c139c60 0x7f046c134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:26:33.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0463fff700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f044c003800 0x7f044c003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f044c004b20 0x7f044c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f047113a700 1 -- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f044c004b20 msgr2=0x7f044c004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f044c004b20 0x7f044c004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f047113a700 1 -- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f044c003800 msgr2=0x7f044c003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f044c003800 0x7f044c003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f047113a700 1 -- 172.21.15.88:0/3191036015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c13f690 con 0x7f044c0040e0 2020-02-11T16:26:33.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0472b9d700 1 -- 172.21.15.88:0/3191036015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046c0aada0 con 0x7f044c0040e0 2020-02-11T16:26:33.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f0463fff700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f044c003800 0x7f044c003c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:26:33.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.764+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f0472b9d700 1 -- 172.21.15.88:0/3191036015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046c134ef0 con 0x7f044c0040e0 2020-02-11T16:26:33.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0464005a40 con 0x7f044c0040e0 2020-02-11T16:26:33.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0464005ba0 con 0x7f044c0040e0 2020-02-11T16:26:33.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046400f570 con 0x7f044c0040e0 2020-02-11T16:26:33.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f0472b9d700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 0x7f04480058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.765+0000 7f0472b9d700 1 -- 172.21.15.88:0/3191036015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448005ea0 con 0x7f0448003420 2020-02-11T16:26:33.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f046400f6d0 con 0x7f044c0040e0 2020-02-11T16:26:33.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 0x7f04480058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f047113a700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0461ffb700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f044c042760 0x7f044c044c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0470939700 1 -- 172.21.15.88:0/3191036015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0448006060 con 0x7f0448003420 2020-02-11T16:26:33.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f046404a6c0 con 0x7f044c0040e0 2020-02-11T16:26:33.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 0x7f04480058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f046800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 0x7f04480058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f046800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 0x7f04480058e0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f046800c5d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0463fff700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f044c042760 0x7f044c044c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 0x7f04480058e0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f046800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046800c930 con 0x7f0448003420 2020-02-11T16:26:33.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0463fff700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f044c042760 0x7f044c044c20 crc :-1 s=READY pgs=473 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.766+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 0x7f04480058e0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f046800c5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.767+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f046800ca90 con 0x7f0448003420 2020-02-11T16:26:33.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.767+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 msgr2=0x7f04480058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.767+0000 7f0461ffb700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 0x7f04480058e0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f046800c5d0).stop 2020-02-11T16:26:33.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.767+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 msgr2=0x7f04480058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:33.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.767+0000 7f0461ffb700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448003420 0x7f04480058e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.767+0000 7f047113a700 1 -- 172.21.15.88:0/3191036015 reap_dead start 2020-02-11T16:26:33.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.775+0000 7f0472b9d700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 0x7f04480068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.775+0000 7f0472b9d700 1 -- 172.21.15.88:0/3191036015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448006dd0 con 0x7f0448006440 2020-02-11T16:26:33.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.775+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 0x7f04480068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.775+0000 7f0470939700 1 -- 172.21.15.88:0/3191036015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0448006f90 con 0x7f0448006440 2020-02-11T16:26:33.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.775+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 0x7f04480068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f0468001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.775+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 0x7f04480068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f0468001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.775+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 0x7f04480068f0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f0468001b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 0x7f04480068f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f0468001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0468013840 con 0x7f0448006440 2020-02-11T16:26:33.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0470939700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 0x7f04480068f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f0468001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f04680139a0 con 0x7f0448006440 2020-02-11T16:26:33.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 msgr2=0x7f04480068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0461ffb700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 0x7f04480068f0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f0468000fe0 tx=0x7f0468001b90).stop 2020-02-11T16:26:33.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0461ffb700 1 -- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 msgr2=0x7f04480068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:33.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0461ffb700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 0x7f04480068f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0472b9d700 1 -- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f044c042760 msgr2=0x7f044c044c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0472b9d700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f044c042760 0x7f044c044c20 crc :-1 s=READY pgs=473 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0472b9d700 1 -- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 msgr2=0x7f044c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0472b9d700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f04640032b0 tx=0x7f0464007dc0).stop 2020-02-11T16:26:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0472b9d700 1 -- 172.21.15.88:0/3191036015 shutdown_connections 2020-02-11T16:26:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0472b9d700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f044c042760 0x7f044c044c20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0472b9d700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0040e0 0x7f044c00b750 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0472b9d700 1 --2- 172.21.15.88:0/3191036015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0448006440 0x7f04480068f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.776+0000 7f0472b9d700 1 -- 172.21.15.88:0/3191036015 >> 172.21.15.88:0/3191036015 conn(0x7f046c0a7bb0 msgr2=0x7f046c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:33.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.777+0000 7f0472b9d700 1 -- 172.21.15.88:0/3191036015 shutdown_connections 2020-02-11T16:26:33.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.777+0000 7f0472b9d700 1 -- 172.21.15.88:0/3191036015 wait complete. 2020-02-11T16:26:33.793 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:26:33.793 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:26:33.793 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:26:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:26:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 168, 2020-02-11T16:26:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:26:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:26:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:26:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:26:33.794 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.795 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:26:33.795 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:33.795 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:26:33.795 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:26:33.795 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:33.795 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:33.795 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:33.796 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:33.796 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:33.796 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:33.796 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.796 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:26:33.796 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:26:33.796 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:33.796 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:33.797 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:33.797 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:33.797 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:33.797 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:33.797 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.797 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:26:33.798 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:26:33.798 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:26:33.798 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:26:33.798 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:26:33.798 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:26:33.798 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:33.798 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:33.799 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:26:33.799 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:26:33.799 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:33.799 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:26:33.799 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:33.799 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:33.800 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:33.800 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:33.800 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:33.800 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:33.800 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.800 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:26:33.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.801 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:26:33.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.801 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:33.801 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:33.801 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:33.801 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:33.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.802 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:33.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:26:33.802 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.802 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:33.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:26:33.803 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.803 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.803 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:26:33.803 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:26:33.803 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:33.804 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:33.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.804 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:26:33.804 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:26:33.805 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:33.805 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:33.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.805 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:33.805 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:26:33.805 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.806 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:33.806 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:26:33.806 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.806 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.806 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.807 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:26:33.807 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:26:33.807 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:33.807 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:33.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.808 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:33.808 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:33.808 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:33.808 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:33.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.808 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:33.808 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:26:33.809 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.809 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:33.809 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:26:33.809 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.809 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.810 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.810 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:26:33.810 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:26:33.810 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:33.810 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:33.810 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.811 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.811 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:26:33.811 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:26:33.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.811 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:33.812 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:33.812 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:33.812 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.812 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.812 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:26:33.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.813 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:33.813 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:33.813 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:26:33.814 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.814 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.814 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.814 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:26:33.815 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:26:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.930+0000 7fd4548c5700 1 Processor -- start 2020-02-11T16:26:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.930+0000 7fd4548c5700 1 -- start start 2020-02-11T16:26:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.930+0000 7fd4548c5700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd45005fac0 0x7fd4500a5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.930+0000 7fd4548c5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd450139550 0x7fd4501399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.930+0000 7fd4548c5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd45005ae60 0x7fd45005b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.930+0000 7fd4548c5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45009dba0 con 0x7fd450139550 2020-02-11T16:26:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.930+0000 7fd4548c5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4500a5ed0 con 0x7fd45005ae60 2020-02-11T16:26:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd4548c5700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45009ddd0 con 0x7fd45005fac0 2020-02-11T16:26:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd45005ae60 0x7fd45005b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd45005ae60 0x7fd45005b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59478/0 (socket says 172.21.15.88:59478) 2020-02-11T16:26:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 -- 172.21.15.88:0/969833664 learned_addr learned my addr 172.21.15.88:0/969833664 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44dd9b700 1 --2- 172.21.15.88:0/969833664 >> v2:172.21.15.52:3300/0 conn(0x7fd450139550 0x7fd4501399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44e59c700 1 --2- 172.21.15.88:0/969833664 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd45005fac0 0x7fd4500a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 -- 172.21.15.88:0/969833664 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd45005fac0 msgr2=0x7fd4500a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/969833664 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd45005fac0 0x7fd4500a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 -- 172.21.15.88:0/969833664 >> v2:172.21.15.52:3300/0 conn(0x7fd450139550 msgr2=0x7fd4501399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/969833664 >> v2:172.21.15.52:3300/0 conn(0x7fd450139550 0x7fd4501399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 -- 172.21.15.88:0/969833664 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45009e070 con 0x7fd45005ae60 2020-02-11T16:26:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/969833664 >> v2:172.21.15.88:3300/0 conn(0x7fd45005ae60 0x7fd45005b2a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/969833664 >> v2:172.21.15.88:3300/0 conn(0x7fd45005ae60 0x7fd45005b2a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/969833664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45005ae60 0x7fd45005b2a0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).ready entity=mon.1 client_cookie=799bcb55e0178dd8 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/969833664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45005ae60 0x7fd45005b2a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/969833664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45005ae60 0x7fd45005b2a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/969833664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45005ae60 0x7fd45005b2a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44d59a700 1 -- 172.21.15.88:0/969833664 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd448011e30 con 0x7fd45005ae60 2020-02-11T16:26:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44d59a700 1 -- 172.21.15.88:0/969833664 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44800a160 con 0x7fd45005ae60 2020-02-11T16:26:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd44d59a700 1 -- 172.21.15.88:0/969833664 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd44800a540 con 0x7fd45005ae60 2020-02-11T16:26:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd4548c5700 1 -- 172.21.15.88:0/969833664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45005ae60 msgr2=0x7fd45005b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.931+0000 7fd4548c5700 1 --2- 172.21.15.88:0/969833664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45005ae60 0x7fd45005b2a0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).stop 2020-02-11T16:26:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.932+0000 7fd4548c5700 1 -- 172.21.15.88:0/969833664 shutdown_connections 2020-02-11T16:26:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.932+0000 7fd4548c5700 1 --2- 172.21.15.88:0/969833664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45005ae60 0x7fd45005b2a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.932+0000 7fd4548c5700 1 --2- 172.21.15.88:0/969833664 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd45005fac0 0x7fd4500a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.932+0000 7fd4548c5700 1 --2- 172.21.15.88:0/969833664 >> v2:172.21.15.52:3300/0 conn(0x7fd450139550 0x7fd4501399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.932+0000 7fd4548c5700 1 -- 172.21.15.88:0/969833664 >> 172.21.15.88:0/969833664 conn(0x7fd4500a7bb0 msgr2=0x7fd4500a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.932+0000 7fd4548c5700 1 -- 172.21.15.88:0/969833664 shutdown_connections 2020-02-11T16:26:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.932+0000 7fd4548c5700 1 -- 172.21.15.88:0/969833664 wait complete. 2020-02-11T16:26:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.933+0000 7fd4548c5700 1 Processor -- start 2020-02-11T16:26:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.933+0000 7fd4548c5700 1 -- start start 2020-02-11T16:26:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.933+0000 7fd4548c5700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd45005ae60 0x7fd4500a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.933+0000 7fd4548c5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd450139550 0x7fd450148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.933+0000 7fd4548c5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd450066100 con 0x7fd45005fac0 2020-02-11T16:26:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.933+0000 7fd4548c5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd450065ef0 con 0x7fd450139550 2020-02-11T16:26:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.933+0000 7fd4548c5700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500663a0 con 0x7fd45005ae60 2020-02-11T16:26:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd450139550 0x7fd450148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd450139550 0x7fd450148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45470/0 (socket says 172.21.15.88:45470) 2020-02-11T16:26:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 -- 172.21.15.88:0/1301925655 learned_addr learned my addr 172.21.15.88:0/1301925655 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 -- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd45005ae60 msgr2=0x7fd4500a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd45005ae60 0x7fd4500a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd45005ae60 0x7fd4500a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 -- 172.21.15.88:0/1301925655 >> v1:172.21.15.52:6789/0 conn(0x7fd45005fac0 legacy=0x7fd450133420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 -- 172.21.15.88:0/1301925655 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450136da0 con 0x7fd450139550 2020-02-11T16:26:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd45005ae60 0x7fd4500a3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:26:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/1301925655 >> v2:172.21.15.52:3300/0 conn(0x7fd450139550 0x7fd450148580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/1301925655 >> v2:172.21.15.52:3300/0 conn(0x7fd450139550 0x7fd450148580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd450139550 0x7fd450148580 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd450139550 0x7fd450148580 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd448005c30 con 0x7fd450139550 2020-02-11T16:26:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd450139550 0x7fd450148580 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd448005d90 con 0x7fd450139550 2020-02-11T16:26:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd450139550 0x7fd450148580 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd4548c5700 1 -- 172.21.15.88:0/1301925655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd450065a30 con 0x7fd450139550 2020-02-11T16:26:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd448007340 con 0x7fd450139550 2020-02-11T16:26:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.934+0000 7fd4548c5700 1 -- 172.21.15.88:0/1301925655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4500a41c0 con 0x7fd450139550 2020-02-11T16:26:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.935+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd450139550 0x7fd450148580 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.935+0000 7fd4548c5700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 0x7fd450135650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.935+0000 7fd4548c5700 1 -- 172.21.15.88:0/1301925655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45005e2f0 con 0x7fd4501489e0 2020-02-11T16:26:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd448007540 con 0x7fd450139550 2020-02-11T16:26:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd44ed9d700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd450139550 0x7fd450148580 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 0x7fd450135650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd43f7fe700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd42c039c50 0x7fd42c03c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fd44804a4f0 con 0x7fd450139550 2020-02-11T16:26:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd44dd9b700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd42c039c50 0x7fd42c03c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd44e59c700 1 -- 172.21.15.88:0/1301925655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd450136f90 con 0x7fd4501489e0 2020-02-11T16:26:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 0x7fd450135650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd44dd9b700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd42c039c50 0x7fd42c03c110 crc :-1 s=READY pgs=474 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 0x7fd450135650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 0x7fd450135650 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 0x7fd450135650 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.936+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd440007530 con 0x7fd4501489e0 2020-02-11T16:26:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.937+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 0x7fd450135650 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.937+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fd44000ae90 con 0x7fd4501489e0 2020-02-11T16:26:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.937+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 msgr2=0x7fd450135650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.937+0000 7fd43f7fe700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 0x7fd450135650 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).stop 2020-02-11T16:26:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.937+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 msgr2=0x7fd450135650 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.937+0000 7fd43f7fe700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501489e0 0x7fd450135650 secure :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).stop 2020-02-11T16:26:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.945+0000 7fd4548c5700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 0x7fd4501375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.945+0000 7fd4548c5700 1 -- 172.21.15.88:0/1301925655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500565b0 con 0x7fd4501371b0 2020-02-11T16:26:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.945+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 0x7fd4501375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.945+0000 7fd44e59c700 1 -- 172.21.15.88:0/1301925655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd45005fea0 con 0x7fd4501371b0 2020-02-11T16:26:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 0x7fd4501375c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 0x7fd4501375c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 0x7fd4501375c0 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 0x7fd4501375c0 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd440005e60 con 0x7fd4501371b0 2020-02-11T16:26:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd44e59c700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 0x7fd4501375c0 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4362 (secure 0 0 0) 0x7fd44000a1d0 con 0x7fd4501371b0 2020-02-11T16:26:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 msgr2=0x7fd4501375c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd43f7fe700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 0x7fd4501375c0 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).stop 2020-02-11T16:26:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd43f7fe700 1 -- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 msgr2=0x7fd4501375c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd43f7fe700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4501371b0 0x7fd4501375c0 secure :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0x7fd440002f30 tx=0x7fd440010bf0).stop 2020-02-11T16:26:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd4548c5700 1 -- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd42c039c50 msgr2=0x7fd42c03c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.946+0000 7fd4548c5700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd42c039c50 0x7fd42c03c110 crc :-1 s=READY pgs=474 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.947+0000 7fd4548c5700 1 -- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd450139550 msgr2=0x7fd450148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.947+0000 7fd4548c5700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd450139550 0x7fd450148580 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fd4480032b0 tx=0x7fd448007dc0).stop 2020-02-11T16:26:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.947+0000 7fd44ed9d700 1 -- 172.21.15.88:0/1301925655 reap_dead start 2020-02-11T16:26:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.947+0000 7fd44ed9d700 1 -- 172.21.15.88:0/1301925655 reap_dead start 2020-02-11T16:26:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.947+0000 7fd4548c5700 1 -- 172.21.15.88:0/1301925655 shutdown_connections 2020-02-11T16:26:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.947+0000 7fd4548c5700 1 --2- 172.21.15.88:0/1301925655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd450139550 0x7fd450148580 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.947+0000 7fd4548c5700 1 -- 172.21.15.88:0/1301925655 >> 172.21.15.88:0/1301925655 conn(0x7fd4500a7bb0 msgr2=0x7fd4501399b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.947+0000 7fd4548c5700 1 -- 172.21.15.88:0/1301925655 shutdown_connections 2020-02-11T16:26:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:33.947+0000 7fd4548c5700 1 -- 172.21.15.88:0/1301925655 wait complete. 2020-02-11T16:26:33.968 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:26:33.968 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:33.968 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:33.968 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:26:33.968 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 168, 2020-02-11T16:26:33.969 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:26:33.969 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:26:33.969 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:26:33.969 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:26:33.969 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.969 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:26:33.969 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:33.969 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:26:33.970 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:26:33.970 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:33.970 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:33.970 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:33.970 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:33.970 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:33.970 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:33.971 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.971 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:26:33.971 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:26:33.971 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:33.971 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:33.971 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:33.971 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:33.972 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:33.972 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:33.972 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.972 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:26:33.972 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:26:33.972 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:26:33.973 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:26:33.973 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:26:33.973 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:26:33.973 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:33.973 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:33.973 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:26:33.974 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:26:33.974 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:33.974 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:26:33.974 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:33.974 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:33.974 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:33.974 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:33.975 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:33.975 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:33.975 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.975 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:26:33.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.976 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:26:33.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.976 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:33.976 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:33.976 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:33.976 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:33.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.977 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:33.977 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:26:33.977 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.978 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:33.978 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:26:33.978 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.978 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.978 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.979 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:26:33.979 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:26:33.979 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:33.979 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:33.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.980 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:26:33.980 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:26:33.980 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:33.980 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:33.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.981 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:33.981 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:26:33.981 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.982 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:33.982 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:26:33.982 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.982 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.982 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.983 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:26:33.983 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:26:33.983 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:33.983 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:33.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.984 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:33.984 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:33.984 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:33.984 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:33.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.984 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:33.984 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:26:33.985 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.985 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:33.985 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:26:33.985 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:33.985 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.986 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.986 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:26:33.986 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:26:33.986 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:33.986 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:33.986 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.987 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:33.987 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:26:33.987 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:26:33.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.987 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:33.987 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:33.987 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:33.988 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.988 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.988 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:26:33.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.988 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:33.988 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:33.988 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:33.989 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.989 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.989 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:26:33.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.989 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:33.989 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:33.989 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:26:33.990 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.990 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.990 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:26:33.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.990 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:33.990 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:33.990 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:26:33.991 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.991 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:33.991 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:26:33.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:33.991 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:33.991 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:33.991 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:33.992 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.992 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:33.992 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:33.992 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:26:33.992 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:26:34.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.104+0000 7ff5fc630700 1 Processor -- start 2020-02-11T16:26:34.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.104+0000 7ff5fc630700 1 -- start start 2020-02-11T16:26:34.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.104+0000 7ff5fc630700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5f4131f50 0x7ff5f405f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:34.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.104+0000 7ff5fc630700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff5f413b290 0x7ff5f409d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:34.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.104+0000 7ff5fc630700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f4138360 con 0x7ff5f413b6f0 2020-02-11T16:26:34.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.104+0000 7ff5fc630700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f4138600 con 0x7ff5f413b290 2020-02-11T16:26:34.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.104+0000 7ff5fc630700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f4137d40 con 0x7ff5f4131f50 2020-02-11T16:26:34.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5f4131f50 0x7ff5f405f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5f4131f50 0x7ff5f405f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59492/0 (socket says 172.21.15.88:59492) 2020-02-11T16:26:34.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fabcd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff5f413b6f0 0x7ff5f405ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47122/0 (socket says 172.21.15.88:47122) 2020-02-11T16:26:34.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 -- 172.21.15.88:0/925270305 learned_addr learned my addr 172.21.15.88:0/925270305 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:34.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5f9bcb700 1 --2- 172.21.15.88:0/925270305 >> v2:172.21.15.52:3300/0 conn(0x7ff5f413b290 0x7ff5f409d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 -- 172.21.15.88:0/925270305 >> v2:172.21.15.52:3300/0 conn(0x7ff5f413b290 msgr2=0x7ff5f409d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:34.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/925270305 >> v2:172.21.15.52:3300/0 conn(0x7ff5f413b290 0x7ff5f409d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:34.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 -- 172.21.15.88:0/925270305 >> v1:172.21.15.88:6789/0 conn(0x7ff5f413b6f0 legacy=0x7ff5f405ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5f93ca700 1 -- 172.21.15.88:0/925270305 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017175705 0 0) 0x7ff5f4138360 con 0x7ff5f413b6f0 2020-02-11T16:26:34.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 -- 172.21.15.88:0/925270305 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f4138aa0 con 0x7ff5f4131f50 2020-02-11T16:26:34.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/925270305 >> v2:172.21.15.88:3300/0 conn(0x7ff5f4131f50 0x7ff5f405f900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5f0002f30 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/925270305 >> v2:172.21.15.88:3300/0 conn(0x7ff5f4131f50 0x7ff5f405f900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5f0002f30 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/925270305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f4131f50 0x7ff5f405f900 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7ff5f0002f30 tx=0x7ff5f0007a40).ready entity=mon.1 client_cookie=777f3c1526882189 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:34.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/925270305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f4131f50 0x7ff5f405f900 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7ff5f0002f30 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5f93ca700 1 -- 172.21.15.88:0/925270305 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f0011670 con 0x7ff5f4131f50 2020-02-11T16:26:34.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/925270305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f4131f50 0x7ff5f405f900 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7ff5f0002f30 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/925270305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f4131f50 0x7ff5f405f900 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7ff5f0002f30 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5f93ca700 1 -- 172.21.15.88:0/925270305 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f00117d0 con 0x7ff5f4131f50 2020-02-11T16:26:34.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5f93ca700 1 -- 172.21.15.88:0/925270305 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f0011b70 con 0x7ff5f4131f50 2020-02-11T16:26:34.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fc630700 1 -- 172.21.15.88:0/925270305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f4131f50 msgr2=0x7ff5f405f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.105+0000 7ff5fc630700 1 --2- 172.21.15.88:0/925270305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f4131f50 0x7ff5f405f900 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7ff5f0002f30 tx=0x7ff5f0007a40).stop 2020-02-11T16:26:34.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.106+0000 7ff5fc630700 1 -- 172.21.15.88:0/925270305 shutdown_connections 2020-02-11T16:26:34.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.106+0000 7ff5fc630700 1 --2- 172.21.15.88:0/925270305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f4131f50 0x7ff5f405f900 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:34.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.106+0000 7ff5fc630700 1 --2- 172.21.15.88:0/925270305 >> v2:172.21.15.52:3300/0 conn(0x7ff5f413b290 0x7ff5f409d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:34.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.106+0000 7ff5fc630700 1 -- 172.21.15.88:0/925270305 >> 172.21.15.88:0/925270305 conn(0x7ff5f40a7bb0 msgr2=0x7ff5f40a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:34.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.106+0000 7ff5fc630700 1 -- 172.21.15.88:0/925270305 shutdown_connections 2020-02-11T16:26:34.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.106+0000 7ff5fc630700 1 -- 172.21.15.88:0/925270305 wait complete. 2020-02-11T16:26:34.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.107+0000 7ff5fc630700 1 Processor -- start 2020-02-11T16:26:34.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.107+0000 7ff5fc630700 1 -- start start 2020-02-11T16:26:34.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.107+0000 7ff5fc630700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5f413b290 0x7ff5f4129220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:34.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.107+0000 7ff5fc630700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f413a570 con 0x7ff5f40a1db0 2020-02-11T16:26:34.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.107+0000 7ff5fc630700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f40aa7e0 con 0x7ff5f4131f50 2020-02-11T16:26:34.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.107+0000 7ff5fc630700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f4129d90 con 0x7ff5f413b290 2020-02-11T16:26:34.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5f413b290 0x7ff5f4129220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5f413b290 0x7ff5f4129220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59500/0 (socket says 172.21.15.88:59500) 2020-02-11T16:26:34.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5fa3cc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff5f4131f50 0x7ff5f4139790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47124/0 (socket says 172.21.15.88:47124) 2020-02-11T16:26:34.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 -- 172.21.15.88:0/748499313 learned_addr learned my addr 172.21.15.88:0/748499313 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:34.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 -- 172.21.15.88:0/748499313 >> v1:172.21.15.88:6789/0 conn(0x7ff5f4131f50 legacy=0x7ff5f4139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 -- 172.21.15.88:0/748499313 >> v1:172.21.15.52:6789/0 conn(0x7ff5f40a1db0 legacy=0x7ff5f4129680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 -- 172.21.15.88:0/748499313 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f40aaa80 con 0x7ff5f413b290 2020-02-11T16:26:34.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823497198 0 0) 0x7ff5f40aa7e0 con 0x7ff5f4131f50 2020-02-11T16:26:34.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 --2- 172.21.15.88:0/748499313 >> v2:172.21.15.88:3300/0 conn(0x7ff5f413b290 0x7ff5f4129220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5e4003070 tx=0x7ff5e4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 --2- 172.21.15.88:0/748499313 >> v2:172.21.15.88:3300/0 conn(0x7ff5f413b290 0x7ff5f4129220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5e4003070 tx=0x7ff5e4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f413b290 0x7ff5f4129220 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7ff5e4003070 tx=0x7ff5e4010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:34.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f413b290 0x7ff5f4129220 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff5e4003070 tx=0x7ff5e4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e4005e90 con 0x7ff5f413b290 2020-02-11T16:26:34.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f413b290 0x7ff5f4129220 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff5e4003070 tx=0x7ff5e4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5f9bcb700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f413b290 0x7ff5f4129220 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff5e4003070 tx=0x7ff5e4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4007160 con 0x7ff5f413b290 2020-02-11T16:26:34.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e4007580 con 0x7ff5f413b290 2020-02-11T16:26:34.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5fc630700 1 -- 172.21.15.88:0/748499313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f4139ea0 con 0x7ff5f413b290 2020-02-11T16:26:34.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.108+0000 7ff5fc630700 1 -- 172.21.15.88:0/748499313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f4138eb0 con 0x7ff5f413b290 2020-02-11T16:26:34.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.109+0000 7ff5f9bcb700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f413b290 0x7ff5f4129220 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff5e4003070 tx=0x7ff5e4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.109+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff5e4012460 con 0x7ff5f413b290 2020-02-11T16:26:34.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.109+0000 7ff5f9bcb700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f413b290 0x7ff5f4129220 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ff5e4003070 tx=0x7ff5e4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.109+0000 7ff5fc630700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 0x7ff5f40a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.109+0000 7ff5fc630700 1 -- 172.21.15.88:0/748499313 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40aae40 con 0x7ff5f413b6f0 2020-02-11T16:26:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.109+0000 7ff5e37fe700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5d4039a40 0x7ff5d403bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.109+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff5e404a1c0 con 0x7ff5f413b290 2020-02-11T16:26:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.109+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 0x7ff5f40a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5fabcd700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5d4039a40 0x7ff5d403bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5fa3cc700 1 -- 172.21.15.88:0/748499313 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5f413a390 con 0x7ff5f413b6f0 2020-02-11T16:26:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 0x7ff5f40a62c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5fabcd700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5d4039a40 0x7ff5d403bf00 crc :-1 s=READY pgs=475 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 0x7ff5f40a62c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 0x7ff5f40a62c0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 0x7ff5f40a62c0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f0007340 con 0x7ff5f413b6f0 2020-02-11T16:26:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 0x7ff5f40a62c0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff5f00074a0 con 0x7ff5f413b6f0 2020-02-11T16:26:34.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 msgr2=0x7ff5f40a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5e37fe700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 0x7ff5f40a62c0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).stop 2020-02-11T16:26:34.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 msgr2=0x7ff5f40a62c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:34.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.110+0000 7ff5e37fe700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f413b6f0 0x7ff5f40a62c0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).stop 2020-02-11T16:26:34.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.119+0000 7ff5fc630700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 0x7ff5f405ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:34.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.119+0000 7ff5fc630700 1 -- 172.21.15.88:0/748499313 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f413a030 con 0x7ff5f405e8f0 2020-02-11T16:26:34.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.119+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 0x7ff5f405ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5fa3cc700 1 -- 172.21.15.88:0/748499313 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff5f40565b0 con 0x7ff5f405e8f0 2020-02-11T16:26:34.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 0x7ff5f405ed00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 0x7ff5f405ed00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 0x7ff5f405ed00 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:34.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 0x7ff5f405ed00 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f000c730 con 0x7ff5f405e8f0 2020-02-11T16:26:34.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5fa3cc700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 0x7ff5f405ed00 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7ff5f000c890 con 0x7ff5f405e8f0 2020-02-11T16:26:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 msgr2=0x7ff5f405ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5e37fe700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 0x7ff5f405ed00 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).stop 2020-02-11T16:26:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5e37fe700 1 -- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 msgr2=0x7ff5f405ed00 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.120+0000 7ff5e37fe700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5f405e8f0 0x7ff5f405ed00 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0x7ff5f0002ed0 tx=0x7ff5f0007a40).stop 2020-02-11T16:26:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fc630700 1 -- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5d4039a40 msgr2=0x7ff5d403bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fc630700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff5d4039a40 0x7ff5d403bf00 crc :-1 s=READY pgs=475 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fc630700 1 -- 172.21.15.88:0/748499313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f413b290 msgr2=0x7ff5f4129220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fc630700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f413b290 0x7ff5f4129220 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7ff5e4003070 tx=0x7ff5e4010d70).stop 2020-02-11T16:26:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fabcd700 1 -- 172.21.15.88:0/748499313 reap_dead start 2020-02-11T16:26:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fabcd700 1 -- 172.21.15.88:0/748499313 reap_dead start 2020-02-11T16:26:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fc630700 1 -- 172.21.15.88:0/748499313 shutdown_connections 2020-02-11T16:26:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fc630700 1 --2- 172.21.15.88:0/748499313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5f413b290 0x7ff5f4129220 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fc630700 1 -- 172.21.15.88:0/748499313 >> 172.21.15.88:0/748499313 conn(0x7ff5f40a7bb0 msgr2=0x7ff5f4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:34.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fc630700 1 -- 172.21.15.88:0/748499313 shutdown_connections 2020-02-11T16:26:34.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.121+0000 7ff5fc630700 1 -- 172.21.15.88:0/748499313 wait complete. 2020-02-11T16:26:34.149 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:26:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:26:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 168, 2020-02-11T16:26:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:26:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:26:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:26:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:26:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:26:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:26:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:26:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:26:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:26:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:26:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:26:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:26:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:26:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:26:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:26:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:26:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:26:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:26:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:26:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:26:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:26:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:26:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:26:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:26:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:26:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:26:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:26:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:26:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:26:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:26:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:26:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:26:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:26:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:26:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:26:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:26:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:26:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:26:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:26:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:26:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:26:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:26:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:34.179 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:26:34.179 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:26:34.180 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:26:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.299+0000 7f9f6b59e700 1 Processor -- start 2020-02-11T16:26:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.299+0000 7f9f6b59e700 1 -- start start 2020-02-11T16:26:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.300+0000 7f9f6b59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f6c05fc80 0x7f9f6c13bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.300+0000 7f9f6b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f6c0a9750 0x7f9f6c09d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.300+0000 7f9f6b59e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c0669e0 0x7f9f6c066e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.300+0000 7f9f6b59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6c1325d0 con 0x7f9f6c0a9750 2020-02-11T16:26:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.300+0000 7f9f6b59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6c13b2f0 con 0x7f9f6c05fc80 2020-02-11T16:26:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.300+0000 7f9f6b59e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0a9bb0 con 0x7f9f6c0669e0 2020-02-11T16:26:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f6c05fc80 0x7f9f6c13bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f6c05fc80 0x7f9f6c13bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59514/0 (socket says 172.21.15.88:59514) 2020-02-11T16:26:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 -- 172.21.15.88:0/1075840342 learned_addr learned my addr 172.21.15.88:0/1075840342 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6ad9d700 1 --2- 172.21.15.88:0/1075840342 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c0669e0 0x7f9f6c066e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/1075840342 >> v2:172.21.15.52:3300/0 conn(0x7f9f6c0a9750 0x7f9f6c09d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 -- 172.21.15.88:0/1075840342 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c0669e0 msgr2=0x7f9f6c066e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/1075840342 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c0669e0 0x7f9f6c066e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 -- 172.21.15.88:0/1075840342 >> v2:172.21.15.52:3300/0 conn(0x7f9f6c0a9750 msgr2=0x7f9f6c09d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/1075840342 >> v2:172.21.15.52:3300/0 conn(0x7f9f6c0a9750 0x7f9f6c09d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 -- 172.21.15.88:0/1075840342 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c05c1a0 con 0x7f9f6c05fc80 2020-02-11T16:26:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6ad9d700 1 --2- 172.21.15.88:0/1075840342 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c0669e0 0x7f9f6c066e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:26:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/1075840342 >> v2:172.21.15.88:3300/0 conn(0x7f9f6c05fc80 0x7f9f6c13bf00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f5c002f30 tx=0x7f9f5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/1075840342 >> v2:172.21.15.88:3300/0 conn(0x7f9f6c05fc80 0x7f9f6c13bf00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f5c002f30 tx=0x7f9f5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/1075840342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c05fc80 0x7f9f6c13bf00 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f9f5c002f30 tx=0x7f9f5c007a40).ready entity=mon.1 client_cookie=e434206123a6bb41 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/1075840342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c05fc80 0x7f9f6c13bf00 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9f5c002f30 tx=0x7f9f5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/1075840342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c05fc80 0x7f9f6c13bf00 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9f5c002f30 tx=0x7f9f5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/1075840342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c05fc80 0x7f9f6c13bf00 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9f5c002f30 tx=0x7f9f5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6959a700 1 -- 172.21.15.88:0/1075840342 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5c011670 con 0x7f9f6c05fc80 2020-02-11T16:26:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6959a700 1 -- 172.21.15.88:0/1075840342 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c0117d0 con 0x7f9f6c05fc80 2020-02-11T16:26:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6959a700 1 -- 172.21.15.88:0/1075840342 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5c011b70 con 0x7f9f6c05fc80 2020-02-11T16:26:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6b59e700 1 -- 172.21.15.88:0/1075840342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c05fc80 msgr2=0x7f9f6c13bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.301+0000 7f9f6b59e700 1 --2- 172.21.15.88:0/1075840342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c05fc80 0x7f9f6c13bf00 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f9f5c002f30 tx=0x7f9f5c007a40).stop 2020-02-11T16:26:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.302+0000 7f9f6b59e700 1 -- 172.21.15.88:0/1075840342 shutdown_connections 2020-02-11T16:26:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.302+0000 7f9f6b59e700 1 --2- 172.21.15.88:0/1075840342 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c0669e0 0x7f9f6c066e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.302+0000 7f9f6b59e700 1 --2- 172.21.15.88:0/1075840342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c05fc80 0x7f9f6c13bf00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.302+0000 7f9f6b59e700 1 --2- 172.21.15.88:0/1075840342 >> v2:172.21.15.52:3300/0 conn(0x7f9f6c0a9750 0x7f9f6c09d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.302+0000 7f9f6b59e700 1 -- 172.21.15.88:0/1075840342 >> 172.21.15.88:0/1075840342 conn(0x7f9f6c0aeea0 msgr2=0x7f9f6c0aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.302+0000 7f9f6b59e700 1 -- 172.21.15.88:0/1075840342 shutdown_connections 2020-02-11T16:26:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.302+0000 7f9f6b59e700 1 -- 172.21.15.88:0/1075840342 wait complete. 2020-02-11T16:26:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.303+0000 7f9f6b59e700 1 Processor -- start 2020-02-11T16:26:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.303+0000 7f9f6b59e700 1 -- start start 2020-02-11T16:26:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.303+0000 7f9f6b59e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c05fc80 0x7f9f6c13a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.303+0000 7f9f6b59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f6c0669e0 0x7f9f6c0ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.303+0000 7f9f6b59e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6c13ab40 con 0x7f9f6c0a9750 2020-02-11T16:26:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.303+0000 7f9f6b59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6c144eb0 con 0x7f9f6c0669e0 2020-02-11T16:26:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.303+0000 7f9f6b59e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c13ade0 con 0x7f9f6c05fc80 2020-02-11T16:26:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.303+0000 7f9f69d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f6c0669e0 0x7f9f6c0ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f6c0669e0 0x7f9f6c0ad620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59518/0 (socket says 172.21.15.88:59518) 2020-02-11T16:26:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 -- 172.21.15.88:0/3103461782 learned_addr learned my addr 172.21.15.88:0/3103461782 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c05fc80 0x7f9f6c13a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 -- 172.21.15.88:0/3103461782 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c05fc80 msgr2=0x7f9f6c13a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c05fc80 0x7f9f6c13a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 -- 172.21.15.88:0/3103461782 >> v1:172.21.15.52:6789/0 conn(0x7f9f6c0a9750 legacy=0x7f9f6c12b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 -- 172.21.15.88:0/3103461782 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c0ada80 con 0x7f9f6c0669e0 2020-02-11T16:26:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> v2:172.21.15.88:3300/0 conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> v2:172.21.15.88:3300/0 conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f5b7fe700 1 -- 172.21.15.88:0/3103461782 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f60005e90 con 0x7f9f6c0669e0 2020-02-11T16:26:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f5b7fe700 1 -- 172.21.15.88:0/3103461782 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f60007160 con 0x7f9f6c0669e0 2020-02-11T16:26:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f6b59e700 1 -- 172.21.15.88:0/3103461782 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c12be10 con 0x7f9f6c0669e0 2020-02-11T16:26:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f5b7fe700 1 -- 172.21.15.88:0/3103461782 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f60007500 con 0x7f9f6c0669e0 2020-02-11T16:26:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.304+0000 7f9f6b59e700 1 -- 172.21.15.88:0/3103461782 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c0a0320 con 0x7f9f6c0669e0 2020-02-11T16:26:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.305+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.305+0000 7f9f5b7fe700 1 -- 172.21.15.88:0/3103461782 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f9f60010170 con 0x7f9f6c0669e0 2020-02-11T16:26:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.305+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.305+0000 7f9f5b7fe700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f48039d50 0x7f9f4803c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.305+0000 7f9f5b7fe700 1 -- 172.21.15.88:0/3103461782 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f9f60049a40 con 0x7f9f6c0669e0 2020-02-11T16:26:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.305+0000 7f9f6b59e700 1 -- 172.21.15.88:0/3103461782 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c0565b0 con 0x7f9f6c0669e0 2020-02-11T16:26:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.305+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f48039d50 0x7f9f4803c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.306+0000 7f9f6a59c700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f48039d50 0x7f9f4803c210 crc :-1 s=READY pgs=476 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.309+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.309+0000 7f9f5b7fe700 1 -- 172.21.15.88:0/3103461782 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f9f6002f120 con 0x7f9f6c0669e0 2020-02-11T16:26:34.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.557+0000 7f9f6b59e700 1 -- 172.21.15.88:0/3103461782 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f9f6c05cbd0 con 0x7f9f6c0669e0 2020-02-11T16:26:34.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.558+0000 7f9f69d9b700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:34.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.558+0000 7f9f5b7fe700 1 -- 172.21.15.88:0/3103461782 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f9f60031bf0 con 0x7f9f6c0669e0 2020-02-11T16:26:34.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 -- 172.21.15.88:0/3103461782 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f48039d50 msgr2=0x7f9f4803c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f48039d50 0x7f9f4803c210 crc :-1 s=READY pgs=476 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:34.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 -- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 msgr2=0x7f9f6c0ad620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:34.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 0x7f9f6c0ad620 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f9f6c09f120 tx=0x7f9f60010dc0).stop 2020-02-11T16:26:34.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 -- 172.21.15.88:0/3103461782 shutdown_connections 2020-02-11T16:26:34.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f48039d50 0x7f9f4803c210 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:34.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f6c05fc80 0x7f9f6c13a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:34.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 --2- 172.21.15.88:0/3103461782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f6c0669e0 0x7f9f6c0ad620 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:34.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 -- 172.21.15.88:0/3103461782 >> 172.21.15.88:0/3103461782 conn(0x7f9f6c0aeea0 msgr2=0x7f9f6c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:34.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 -- 172.21.15.88:0/3103461782 shutdown_connections 2020-02-11T16:26:34.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:34.560+0000 7f9f6b59e700 1 -- 172.21.15.88:0/3103461782 wait complete. 2020-02-11T16:26:34.573 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:26:44.573 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:26:44.574 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:26:44.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.690+0000 7f113ecd9700 1 Processor -- start 2020-02-11T16:26:44.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.690+0000 7f113ecd9700 1 -- start start 2020-02-11T16:26:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.690+0000 7f113ecd9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11380a18a0 0x7f11380a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.690+0000 7f113ecd9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a6260 0x7f113812eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.690+0000 7f113ecd9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11380a3570 con 0x7f11380a5de0 2020-02-11T16:26:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.690+0000 7f113ecd9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11380a3810 con 0x7f11380a18a0 2020-02-11T16:26:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.690+0000 7f113ecd9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11380a3ab0 con 0x7f11380a6260 2020-02-11T16:26:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11380a18a0 0x7f11380a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11380a18a0 0x7f11380a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59526/0 (socket says 172.21.15.88:59526) 2020-02-11T16:26:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 -- 172.21.15.88:0/3601904368 learned_addr learned my addr 172.21.15.88:0/3601904368 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113d276700 1 --2- 172.21.15.88:0/3601904368 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a6260 0x7f113812eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:44.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 -- 172.21.15.88:0/3601904368 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a6260 msgr2=0x7f113812eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:44.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 --2- 172.21.15.88:0/3601904368 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a6260 0x7f113812eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:44.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 -- 172.21.15.88:0/3601904368 >> v1:172.21.15.52:6789/0 conn(0x7f11380a5de0 legacy=0x7f113812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:44.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 -- 172.21.15.88:0/3601904368 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11380a3d50 con 0x7f11380a18a0 2020-02-11T16:26:44.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 --2- 172.21.15.88:0/3601904368 >> v2:172.21.15.88:3300/0 conn(0x7f11380a18a0 0x7f11380a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f113805ee20 tx=0x7f112c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 --2- 172.21.15.88:0/3601904368 >> v2:172.21.15.88:3300/0 conn(0x7f11380a18a0 0x7f11380a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f113805ee20 tx=0x7f112c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 --2- 172.21.15.88:0/3601904368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11380a18a0 0x7f11380a6dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f113805ee20 tx=0x7f112c0088e0).ready entity=mon.1 client_cookie=4a4b969527e918e0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:44.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 --2- 172.21.15.88:0/3601904368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11380a18a0 0x7f11380a6dd0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f113805ee20 tx=0x7f112c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 --2- 172.21.15.88:0/3601904368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11380a18a0 0x7f11380a6dd0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f113805ee20 tx=0x7f112c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f11377fe700 1 -- 172.21.15.88:0/3601904368 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f112c011720 con 0x7f11380a18a0 2020-02-11T16:26:44.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ca75700 1 --2- 172.21.15.88:0/3601904368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11380a18a0 0x7f11380a6dd0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f113805ee20 tx=0x7f112c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f11377fe700 1 -- 172.21.15.88:0/3601904368 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c011880 con 0x7f11380a18a0 2020-02-11T16:26:44.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f11377fe700 1 -- 172.21.15.88:0/3601904368 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f112c011c20 con 0x7f11380a18a0 2020-02-11T16:26:44.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ecd9700 1 -- 172.21.15.88:0/3601904368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11380a18a0 msgr2=0x7f11380a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.691+0000 7f113ecd9700 1 --2- 172.21.15.88:0/3601904368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11380a18a0 0x7f11380a6dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f113805ee20 tx=0x7f112c0088e0).stop 2020-02-11T16:26:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.692+0000 7f113ecd9700 1 -- 172.21.15.88:0/3601904368 shutdown_connections 2020-02-11T16:26:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.692+0000 7f113ecd9700 1 --2- 172.21.15.88:0/3601904368 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a6260 0x7f113812eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.692+0000 7f113ecd9700 1 --2- 172.21.15.88:0/3601904368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11380a18a0 0x7f11380a6dd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.692+0000 7f113ecd9700 1 -- 172.21.15.88:0/3601904368 >> 172.21.15.88:0/3601904368 conn(0x7f113809d110 msgr2=0x7f113809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.692+0000 7f113ecd9700 1 -- 172.21.15.88:0/3601904368 shutdown_connections 2020-02-11T16:26:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.692+0000 7f113ecd9700 1 -- 172.21.15.88:0/3601904368 wait complete. 2020-02-11T16:26:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.693+0000 7f113ecd9700 1 Processor -- start 2020-02-11T16:26:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.693+0000 7f113ecd9700 1 -- start start 2020-02-11T16:26:44.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.693+0000 7f113ecd9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a5de0 0x7f11381282f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:44.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.693+0000 7f113ecd9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11381350b0 con 0x7f11380a18a0 2020-02-11T16:26:44.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.693+0000 7f113ecd9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1138135350 con 0x7f11380a6260 2020-02-11T16:26:44.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.693+0000 7f113ecd9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11381319d0 con 0x7f11380a5de0 2020-02-11T16:26:44.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f113d276700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f11380a6260 0x7f1138128750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47162/0 (socket says 172.21.15.88:47162) 2020-02-11T16:26:44.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f113d276700 1 -- 172.21.15.88:0/3373002687 learned_addr learned my addr 172.21.15.88:0/3373002687 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:44.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251207009 0 0) 0x7f1138135350 con 0x7f11380a6260 2020-02-11T16:26:44.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1137fff700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a5de0 0x7f11381282f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:44.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1120002fe0 con 0x7f11380a6260 2020-02-11T16:26:44.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3583634931 0 0) 0x7f1120002fe0 con 0x7f11380a6260 2020-02-11T16:26:44.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1138135350 con 0x7f11380a6260 2020-02-11T16:26:44.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f1130002a90 con 0x7f11380a6260 2020-02-11T16:26:44.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a5de0 msgr2=0x7f11381282f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a5de0 0x7f11381282f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 >> v1:172.21.15.88:6789/0 conn(0x7f11380a6260 legacy=0x7f1138128750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 >> v1:172.21.15.52:6789/0 conn(0x7f11380a18a0 legacy=0x7f1138065b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a5de0 0x7f11200049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1120004e10 0x7f1120005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:44.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11381319d0 con 0x7f1120004e10 2020-02-11T16:26:44.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11200043c0 con 0x7f1120003990 2020-02-11T16:26:44.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1120004580 con 0x7f11380a5de0 2020-02-11T16:26:44.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:44.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f1137fff700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1120004e10 0x7f1120005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:44.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.694+0000 7f113ca75700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a5de0 0x7f11200049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:44.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 -- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a5de0 msgr2=0x7f11200049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:44.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a5de0 0x7f11200049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 -- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1120004e10 msgr2=0x7f1120005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1120004e10 0x7f1120005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 -- 172.21.15.88:0/3373002687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11381355f0 con 0x7f1120003990 2020-02-11T16:26:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113ecd9700 1 -- 172.21.15.88:0/3373002687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1138066b10 con 0x7f1120003990 2020-02-11T16:26:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113ca75700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11380a5de0 0x7f11200049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:26:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113ecd9700 1 -- 172.21.15.88:0/3373002687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1138133950 con 0x7f1120003990 2020-02-11T16:26:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1130005e30 con 0x7f1120003990 2020-02-11T16:26:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130007350 con 0x7f1120003990 2020-02-11T16:26:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11300076f0 con 0x7f1120003990 2020-02-11T16:26:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.695+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.696+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f1130010180 con 0x7f1120003990 2020-02-11T16:26:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.696+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.696+0000 7f113ecd9700 1 -- 172.21.15.88:0/3373002687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1114003340 con 0x7f1120003990 2020-02-11T16:26:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.696+0000 7f1135ffb700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1120041f80 0x7f1120044440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.696+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f113004a630 con 0x7f1120003990 2020-02-11T16:26:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.696+0000 7f113ca75700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1120041f80 0x7f1120044440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.696+0000 7f113ca75700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1120041f80 0x7f1120044440 crc :-1 s=READY pgs=477 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.700+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.700+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f113002fc90 con 0x7f1120003990 2020-02-11T16:26:44.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.923+0000 7f113ecd9700 1 -- 172.21.15.88:0/3373002687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f11140036e0 con 0x7f1120003990 2020-02-11T16:26:44.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.923+0000 7f113d276700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:44.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.923+0000 7f1135ffb700 1 -- 172.21.15.88:0/3373002687 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f11300327a0 con 0x7f1120003990 2020-02-11T16:26:44.926 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":168,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:44.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.925+0000 7f113ecd9700 1 -- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1120041f80 msgr2=0x7f1120044440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:44.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.925+0000 7f113ecd9700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1120041f80 0x7f1120044440 crc :-1 s=READY pgs=477 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:44.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.925+0000 7f113ecd9700 1 -- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 msgr2=0x7f1120003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:44.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.925+0000 7f113ecd9700 1 --2- 172.21.15.88:0/3373002687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1120003990 0x7f1120003e10 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f1130002820 tx=0x7f1130011780).stop 2020-02-11T16:26:44.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.925+0000 7f113d276700 1 -- 172.21.15.88:0/3373002687 reap_dead start 2020-02-11T16:26:44.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.925+0000 7f113d276700 1 -- 172.21.15.88:0/3373002687 reap_dead start 2020-02-11T16:26:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.925+0000 7f113ecd9700 1 -- 172.21.15.88:0/3373002687 shutdown_connections 2020-02-11T16:26:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.925+0000 7f113ecd9700 1 -- 172.21.15.88:0/3373002687 >> 172.21.15.88:0/3373002687 conn(0x7f113809d110 msgr2=0x7f113812dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.925+0000 7f113ecd9700 1 -- 172.21.15.88:0/3373002687 shutdown_connections 2020-02-11T16:26:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:44.925+0000 7f113ecd9700 1 -- 172.21.15.88:0/3373002687 wait complete. 2020-02-11T16:26:44.938 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":168,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:44.938 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:26:44.938 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:26:44.938 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:26:45.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.055+0000 7f8832ed0700 1 Processor -- start 2020-02-11T16:26:45.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.055+0000 7f8832ed0700 1 -- start start 2020-02-11T16:26:45.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.056+0000 7f8832ed0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f882c0a18a0 0x7f882c0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:45.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.056+0000 7f8832ed0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f882c0a6260 0x7f882c12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:45.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.056+0000 7f8832ed0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882c0a3570 con 0x7f882c0a5de0 2020-02-11T16:26:45.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.056+0000 7f8832ed0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c0a3810 con 0x7f882c0a6260 2020-02-11T16:26:45.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.056+0000 7f8832ed0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c0a3ab0 con 0x7f882c0a18a0 2020-02-11T16:26:45.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.056+0000 7f882bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f882c0a5de0 0x7f882c12e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47172/0 (socket says 172.21.15.88:47172) 2020-02-11T16:26:45.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.056+0000 7f882bfff700 1 -- 172.21.15.88:0/3421232792 learned_addr learned my addr 172.21.15.88:0/3421232792 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:45.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.056+0000 7f883146d700 1 --2- 172.21.15.88:0/3421232792 >> v2:172.21.15.52:3300/0 conn(0x7f882c0a6260 0x7f882c12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.056+0000 7f8830c6c700 1 --2- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f882c0a18a0 0x7f882c0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f882b7fe700 1 -- 172.21.15.88:0/3421232792 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588598503 0 0) 0x7f882c0a3570 con 0x7f882c0a5de0 2020-02-11T16:26:45.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f882b7fe700 1 -- 172.21.15.88:0/3421232792 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8810003230 con 0x7f882c0a5de0 2020-02-11T16:26:45.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f883146d700 1 -- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f882c0a18a0 msgr2=0x7f882c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:45.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f883146d700 1 --2- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f882c0a18a0 0x7f882c0a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:45.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f883146d700 1 -- 172.21.15.88:0/3421232792 >> v1:172.21.15.88:6789/0 conn(0x7f882c0a5de0 legacy=0x7f882c12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f883146d700 1 -- 172.21.15.88:0/3421232792 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c0a3d50 con 0x7f882c0a6260 2020-02-11T16:26:45.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f883146d700 1 --2- 172.21.15.88:0/3421232792 >> v2:172.21.15.52:3300/0 conn(0x7f882c0a6260 0x7f882c12eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f882c05bbc0 tx=0x7f8824008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f883146d700 1 --2- 172.21.15.88:0/3421232792 >> v2:172.21.15.52:3300/0 conn(0x7f882c0a6260 0x7f882c12eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f882c05bbc0 tx=0x7f8824008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f883146d700 1 --2- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f882c0a6260 0x7f882c12eab0 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f882c05bbc0 tx=0x7f8824008c60).ready entity=mon.0 client_cookie=d3b6668309321485 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f883146d700 1 --2- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f882c0a6260 0x7f882c12eab0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f882c05bbc0 tx=0x7f8824008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f882b7fe700 1 -- 172.21.15.88:0/3421232792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8824011d70 con 0x7f882c0a6260 2020-02-11T16:26:45.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f883146d700 1 --2- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f882c0a6260 0x7f882c12eab0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f882c05bbc0 tx=0x7f8824008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f882b7fe700 1 -- 172.21.15.88:0/3421232792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882400a160 con 0x7f882c0a6260 2020-02-11T16:26:45.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f883146d700 1 --2- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f882c0a6260 0x7f882c12eab0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f882c05bbc0 tx=0x7f8824008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f882b7fe700 1 -- 172.21.15.88:0/3421232792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f882400a540 con 0x7f882c0a6260 2020-02-11T16:26:45.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f8832ed0700 1 -- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f882c0a6260 msgr2=0x7f882c12eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.057+0000 7f8832ed0700 1 --2- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f882c0a6260 0x7f882c12eab0 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f882c05bbc0 tx=0x7f8824008c60).stop 2020-02-11T16:26:45.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.058+0000 7f8832ed0700 1 -- 172.21.15.88:0/3421232792 shutdown_connections 2020-02-11T16:26:45.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.058+0000 7f8832ed0700 1 --2- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f882c0a6260 0x7f882c12eab0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.058+0000 7f8832ed0700 1 --2- 172.21.15.88:0/3421232792 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f882c0a18a0 0x7f882c0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:45.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.058+0000 7f8832ed0700 1 -- 172.21.15.88:0/3421232792 >> 172.21.15.88:0/3421232792 conn(0x7f882c09d110 msgr2=0x7f882c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:45.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.058+0000 7f8832ed0700 1 -- 172.21.15.88:0/3421232792 shutdown_connections 2020-02-11T16:26:45.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.058+0000 7f8832ed0700 1 -- 172.21.15.88:0/3421232792 wait complete. 2020-02-11T16:26:45.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.059+0000 7f8832ed0700 1 Processor -- start 2020-02-11T16:26:45.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.059+0000 7f8832ed0700 1 -- start start 2020-02-11T16:26:45.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.059+0000 7f8832ed0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f882c0a5de0 0x7f882c066690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.059+0000 7f8832ed0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f882c0a6260 0x7f882c066af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f8832ed0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882c05ace0 con 0x7f882c0a18a0 2020-02-11T16:26:45.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f8832ed0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c138270 con 0x7f882c0a5de0 2020-02-11T16:26:45.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f8832ed0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c138510 con 0x7f882c0a6260 2020-02-11T16:26:45.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f882c0a5de0 0x7f882c066690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f882c0a5de0 0x7f882c066690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59552/0 (socket says 172.21.15.88:59552) 2020-02-11T16:26:45.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 -- 172.21.15.88:0/29394639 learned_addr learned my addr 172.21.15.88:0/29394639 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:45.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f883146d700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f882c0a6260 0x7f882c066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 -- 172.21.15.88:0/29394639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f882c0a6260 msgr2=0x7f882c066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f882c0a6260 0x7f882c066af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 -- 172.21.15.88:0/29394639 >> v1:172.21.15.52:6789/0 conn(0x7f882c0a18a0 legacy=0x7f882c05a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 -- 172.21.15.88:0/29394639 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c1387b0 con 0x7f882c0a5de0 2020-02-11T16:26:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f883146d700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f882c0a6260 0x7f882c066af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:26:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 --2- 172.21.15.88:0/29394639 >> v2:172.21.15.88:3300/0 conn(0x7f882c0a5de0 0x7f882c066690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88180010d0 tx=0x7f8818010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 --2- 172.21.15.88:0/29394639 >> v2:172.21.15.88:3300/0 conn(0x7f882c0a5de0 0x7f882c066690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88180010d0 tx=0x7f8818010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a5de0 0x7f882c066690 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f88180010d0 tx=0x7f8818010aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a5de0 0x7f882c066690 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f88180010d0 tx=0x7f8818010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f881800c930 con 0x7f882c0a5de0 2020-02-11T16:26:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a5de0 0x7f882c066690 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f88180010d0 tx=0x7f8818010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f882bfff700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a5de0 0x7f882c066690 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f88180010d0 tx=0x7f8818010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881800ca90 con 0x7f882c0a5de0 2020-02-11T16:26:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f8832ed0700 1 -- 172.21.15.88:0/29394639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c135b40 con 0x7f882c0a5de0 2020-02-11T16:26:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f881800ce70 con 0x7f882c0a5de0 2020-02-11T16:26:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.060+0000 7f8832ed0700 1 -- 172.21.15.88:0/29394639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882c136b00 con 0x7f882c0a5de0 2020-02-11T16:26:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.061+0000 7f882bfff700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a5de0 0x7f882c066690 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f88180010d0 tx=0x7f8818010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.061+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f88180055e0 con 0x7f882c0a5de0 2020-02-11T16:26:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.061+0000 7f882bfff700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a5de0 0x7f882c066690 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f88180010d0 tx=0x7f8818010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.061+0000 7f8832ed0700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 0x7f882c1451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.061+0000 7f8832ed0700 1 -- 172.21.15.88:0/29394639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c05e2f0 con 0x7f882c0a9560 2020-02-11T16:26:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.061+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 0x7f882c1451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8829ffb700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8814039c70 0x7f881403c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f88180496d0 con 0x7f882c0a5de0 2020-02-11T16:26:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8830c6c700 1 -- 172.21.15.88:0/29394639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f882c138940 con 0x7f882c0a9560 2020-02-11T16:26:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f883146d700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8814039c70 0x7f881403c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 0x7f882c1451f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 0x7f882c1451f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 0x7f882c1451f0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 0x7f882c1451f0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f883146d700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8814039c70 0x7f881403c130 crc :-1 s=READY pgs=478 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8820007530 con 0x7f882c0a9560 2020-02-11T16:26:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 0x7f882c1451f0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f882000aed0 con 0x7f882c0a9560 2020-02-11T16:26:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 msgr2=0x7f882c1451f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8829ffb700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 0x7f882c1451f0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).stop 2020-02-11T16:26:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 msgr2=0x7f882c1451f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.062+0000 7f8829ffb700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9560 0x7f882c1451f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.070+0000 7f8832ed0700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 0x7f882c12b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.070+0000 7f8832ed0700 1 -- 172.21.15.88:0/29394639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c1383b0 con 0x7f882c0a9940 2020-02-11T16:26:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.070+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 0x7f882c12b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8830c6c700 1 -- 172.21.15.88:0/29394639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f882c0565b0 con 0x7f882c0a9940 2020-02-11T16:26:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 0x7f882c12b6a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 0x7f882c12b6a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 0x7f882c12b6a0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 0x7f882c12b6a0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8820012d90 con 0x7f882c0a9940 2020-02-11T16:26:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8830c6c700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 0x7f882c12b6a0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7f882000a0a0 con 0x7f882c0a9940 2020-02-11T16:26:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 msgr2=0x7f882c12b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8829ffb700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 0x7f882c12b6a0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).stop 2020-02-11T16:26:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8829ffb700 1 -- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 msgr2=0x7f882c12b6a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.071+0000 7f8829ffb700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a9940 0x7f882c12b6a0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0x7f882c0a4080 tx=0x7f8820010b40).stop 2020-02-11T16:26:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.072+0000 7f8832ed0700 1 -- 172.21.15.88:0/29394639 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8814039c70 msgr2=0x7f881403c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.072+0000 7f8832ed0700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8814039c70 0x7f881403c130 crc :-1 s=READY pgs=478 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.072+0000 7f8832ed0700 1 -- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a5de0 msgr2=0x7f882c066690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.072+0000 7f8832ed0700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a5de0 0x7f882c066690 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f88180010d0 tx=0x7f8818010aa0).stop 2020-02-11T16:26:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.072+0000 7f883146d700 1 -- 172.21.15.88:0/29394639 reap_dead start 2020-02-11T16:26:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.072+0000 7f8832ed0700 1 -- 172.21.15.88:0/29394639 shutdown_connections 2020-02-11T16:26:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.072+0000 7f8832ed0700 1 --2- 172.21.15.88:0/29394639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f882c0a5de0 0x7f882c066690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.072+0000 7f8832ed0700 1 -- 172.21.15.88:0/29394639 >> 172.21.15.88:0/29394639 conn(0x7f882c09d110 msgr2=0x7f882c0a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.072+0000 7f8832ed0700 1 -- 172.21.15.88:0/29394639 shutdown_connections 2020-02-11T16:26:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.072+0000 7f8832ed0700 1 -- 172.21.15.88:0/29394639 wait complete. 2020-02-11T16:26:45.085 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:26:45.085 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:26:45.085 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:26:45.086 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:26:45.086 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 168, 2020-02-11T16:26:45.086 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:26:45.086 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:26:45.086 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:26:45.086 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:26:45.086 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.086 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:26:45.087 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:45.087 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:26:45.087 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:26:45.087 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:45.087 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:45.087 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:45.087 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:45.088 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:45.088 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:45.088 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.088 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:26:45.088 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:26:45.088 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:45.088 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:45.088 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:45.089 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:45.089 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:45.089 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:45.089 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.089 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:26:45.089 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:26:45.090 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:26:45.090 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:26:45.094 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:26:45.094 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:26:45.095 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:45.095 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:45.095 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:26:45.095 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:26:45.095 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:45.095 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:26:45.095 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:45.096 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:45.096 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:45.096 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:45.096 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:45.096 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:45.096 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.096 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:26:45.097 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.097 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:26:45.097 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.097 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:45.097 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:45.097 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:45.097 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:45.098 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.098 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:45.098 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:26:45.098 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.098 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.098 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:45.098 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:26:45.099 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.099 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.099 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.099 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:26:45.099 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:26:45.099 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:45.100 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:45.100 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.100 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.100 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:26:45.100 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:26:45.100 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:45.100 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:45.101 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.101 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:45.101 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:26:45.101 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.101 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.101 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:45.101 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:26:45.102 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.102 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.102 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.102 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.102 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:26:45.102 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:26:45.102 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:45.103 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:45.103 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.103 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.103 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:45.103 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:45.103 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:45.103 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:45.103 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.104 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:45.104 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:26:45.104 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.104 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.104 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:45.104 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:26:45.105 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.105 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.105 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.105 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:26:45.105 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:26:45.105 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:45.107 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:45.107 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.107 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.108 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:26:45.108 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:26:45.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.108 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.108 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.108 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:45.108 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.109 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.109 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:26:45.109 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.109 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.109 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.109 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:26:45.109 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.109 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.110 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.110 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:26:45.111 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:26:45.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.232+0000 7f09e8344700 1 Processor -- start 2020-02-11T16:26:45.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.232+0000 7f09e8344700 1 -- start start 2020-02-11T16:26:45.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e8344700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09e005fac0 0x7f09e00a5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:45.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e8344700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09e0139550 0x7f09e01399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:45.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e8344700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e009dba0 con 0x7f09e005ae60 2020-02-11T16:26:45.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e8344700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e00a5ed0 con 0x7f09e0139550 2020-02-11T16:26:45.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e8344700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e009ddd0 con 0x7f09e005fac0 2020-02-11T16:26:45.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e58df700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09e0139550 0x7f09e01399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e58df700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09e0139550 0x7f09e01399b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59562/0 (socket says 172.21.15.88:59562) 2020-02-11T16:26:45.238 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e58df700 1 -- 172.21.15.88:0/3033233761 learned_addr learned my addr 172.21.15.88:0/3033233761 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:45.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e60e0700 1 --2- 172.21.15.88:0/3033233761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09e005fac0 0x7f09e00a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e58df700 1 -- 172.21.15.88:0/3033233761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09e005fac0 msgr2=0x7f09e00a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:45.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e58df700 1 --2- 172.21.15.88:0/3033233761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09e005fac0 0x7f09e00a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:45.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e58df700 1 -- 172.21.15.88:0/3033233761 >> v1:172.21.15.52:6789/0 conn(0x7f09e005ae60 legacy=0x7f09e005b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e58df700 1 -- 172.21.15.88:0/3033233761 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e009e070 con 0x7f09e0139550 2020-02-11T16:26:45.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e58df700 1 --2- 172.21.15.88:0/3033233761 >> v2:172.21.15.88:3300/0 conn(0x7f09e0139550 0x7f09e01399b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f09d0002f30 tx=0x7f09d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e58df700 1 --2- 172.21.15.88:0/3033233761 >> v2:172.21.15.88:3300/0 conn(0x7f09e0139550 0x7f09e01399b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f09d0002f30 tx=0x7f09d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.233+0000 7f09e58df700 1 --2- 172.21.15.88:0/3033233761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e0139550 0x7f09e01399b0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09d00088e0).ready entity=mon.1 client_cookie=959f7e90dde12def server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e58df700 1 --2- 172.21.15.88:0/3033233761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e0139550 0x7f09e01399b0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e58df700 1 --2- 172.21.15.88:0/3033233761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e0139550 0x7f09e01399b0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e50de700 1 -- 172.21.15.88:0/3033233761 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09d0011760 con 0x7f09e0139550 2020-02-11T16:26:45.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e58df700 1 --2- 172.21.15.88:0/3033233761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e0139550 0x7f09e01399b0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e50de700 1 -- 172.21.15.88:0/3033233761 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d00118c0 con 0x7f09e0139550 2020-02-11T16:26:45.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e50de700 1 -- 172.21.15.88:0/3033233761 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09d0011ca0 con 0x7f09e0139550 2020-02-11T16:26:45.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e8344700 1 -- 172.21.15.88:0/3033233761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e0139550 msgr2=0x7f09e01399b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e8344700 1 --2- 172.21.15.88:0/3033233761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e0139550 0x7f09e01399b0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09d00088e0).stop 2020-02-11T16:26:45.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e8344700 1 -- 172.21.15.88:0/3033233761 shutdown_connections 2020-02-11T16:26:45.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e8344700 1 --2- 172.21.15.88:0/3033233761 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09e005fac0 0x7f09e00a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:45.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e8344700 1 --2- 172.21.15.88:0/3033233761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e0139550 0x7f09e01399b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e8344700 1 -- 172.21.15.88:0/3033233761 >> 172.21.15.88:0/3033233761 conn(0x7f09e00a7bb0 msgr2=0x7f09e00a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:45.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e8344700 1 -- 172.21.15.88:0/3033233761 shutdown_connections 2020-02-11T16:26:45.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.234+0000 7f09e8344700 1 -- 172.21.15.88:0/3033233761 wait complete. 2020-02-11T16:26:45.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.235+0000 7f09e8344700 1 Processor -- start 2020-02-11T16:26:45.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.235+0000 7f09e8344700 1 -- start start 2020-02-11T16:26:45.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e8344700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09e005fac0 0x7f09e0148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e8344700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09e0139550 0x7f09e0135b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e8344700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e00662d0 con 0x7f09e005ae60 2020-02-11T16:26:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e8344700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e00a3d30 con 0x7f09e005fac0 2020-02-11T16:26:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e8344700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0148bc0 con 0x7f09e0139550 2020-02-11T16:26:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09e005fac0 0x7f09e0148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e60e0700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f09e005ae60 0x7f09e0145070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47194/0 (socket says 172.21.15.88:47194) 2020-02-11T16:26:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09e005fac0 0x7f09e0148640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59570/0 (socket says 172.21.15.88:59570) 2020-02-11T16:26:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e60e0700 1 -- 172.21.15.88:0/605129529 learned_addr learned my addr 172.21.15.88:0/605129529 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e68e1700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09e0139550 0x7f09e0135b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 -- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09e0139550 msgr2=0x7f09e0135b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09e0139550 0x7f09e0135b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 -- 172.21.15.88:0/605129529 >> v1:172.21.15.88:6789/0 conn(0x7f09e005ae60 legacy=0x7f09e0145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910162138 0 0) 0x7f09e00662d0 con 0x7f09e005ae60 2020-02-11T16:26:45.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 -- 172.21.15.88:0/605129529 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e0148e60 con 0x7f09e005fac0 2020-02-11T16:26:45.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 --2- 172.21.15.88:0/605129529 >> v2:172.21.15.88:3300/0 conn(0x7f09e005fac0 0x7f09e0148640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09e00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 --2- 172.21.15.88:0/605129529 >> v2:172.21.15.88:3300/0 conn(0x7f09e005fac0 0x7f09e0148640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09e00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e005fac0 0x7f09e0148640 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09e00600c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e005fac0 0x7f09e0148640 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09e00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09d0007340 con 0x7f09e005fac0 2020-02-11T16:26:45.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e58df700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e005fac0 0x7f09e0148640 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09e00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09e8344700 1 -- 172.21.15.88:0/605129529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e0149100 con 0x7f09e005fac0 2020-02-11T16:26:45.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.236+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d00074a0 con 0x7f09e005fac0 2020-02-11T16:26:45.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.237+0000 7f09e58df700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e005fac0 0x7f09e0148640 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09e00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.237+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09d00058b0 con 0x7f09e005fac0 2020-02-11T16:26:45.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.237+0000 7f09e8344700 1 -- 172.21.15.88:0/605129529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e0065db0 con 0x7f09e005fac0 2020-02-11T16:26:45.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.237+0000 7f09e58df700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e005fac0 0x7f09e0148640 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09e00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.237+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f09d0005b30 con 0x7f09e005fac0 2020-02-11T16:26:45.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.237+0000 7f09e58df700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e005fac0 0x7f09e0148640 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09e00600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09e8344700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 0x7f09e00a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09e8344700 1 -- 172.21.15.88:0/605129529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e005e2f0 con 0x7f09e00a1a50 2020-02-11T16:26:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09cf7fe700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f09c0039af0 0x7f09c003bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f09d004a000 con 0x7f09e005fac0 2020-02-11T16:26:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 0x7f09e00a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09e68e1700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f09c0039af0 0x7f09c003bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09e68e1700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f09c0039af0 0x7f09c003bfb0 crc :-1 s=READY pgs=479 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09e60e0700 1 -- 172.21.15.88:0/605129529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09e0149300 con 0x7f09e00a1a50 2020-02-11T16:26:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 0x7f09e00a63c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 0x7f09e00a63c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 0x7f09e00a63c0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 0x7f09e00a63c0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.238+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09dc0059c0 con 0x7f09e00a1a50 2020-02-11T16:26:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.239+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 0x7f09e00a63c0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.239+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f09dc005b20 con 0x7f09e00a1a50 2020-02-11T16:26:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.239+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 msgr2=0x7f09e00a63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.239+0000 7f09cf7fe700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 0x7f09e00a63c0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).stop 2020-02-11T16:26:45.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.239+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 msgr2=0x7f09e00a63c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:45.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.239+0000 7f09cf7fe700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a1a50 0x7f09e00a63c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.249+0000 7f09e8344700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 0x7f09e00a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.249+0000 7f09e8344700 1 -- 172.21.15.88:0/605129529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e00565b0 con 0x7f09e00a8fd0 2020-02-11T16:26:45.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.249+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 0x7f09e00a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.249+0000 7f09e60e0700 1 -- 172.21.15.88:0/605129529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f09e009d430 con 0x7f09e00a8fd0 2020-02-11T16:26:45.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.249+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 0x7f09e00a93b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 0x7f09e00a93b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 0x7f09e00a93b0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 0x7f09e00a93b0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09dc00b430 con 0x7f09e00a8fd0 2020-02-11T16:26:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09e60e0700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 0x7f09e00a93b0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4363 (secure 0 0 0) 0x7f09dc00b590 con 0x7f09e00a8fd0 2020-02-11T16:26:45.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 msgr2=0x7f09e00a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09cf7fe700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 0x7f09e00a93b0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).stop 2020-02-11T16:26:45.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09cf7fe700 1 -- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 msgr2=0x7f09e00a93b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:45.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09cf7fe700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e00a8fd0 0x7f09e00a93b0 secure :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0x7f09dc007a40 tx=0x7f09dc010db0).stop 2020-02-11T16:26:45.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09e8344700 1 -- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f09c0039af0 msgr2=0x7f09c003bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09e8344700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f09c0039af0 0x7f09c003bfb0 crc :-1 s=READY pgs=479 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09e8344700 1 -- 172.21.15.88:0/605129529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e005fac0 msgr2=0x7f09e0148640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09e8344700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e005fac0 0x7f09e0148640 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f09d0002f30 tx=0x7f09e00600c0).stop 2020-02-11T16:26:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09e68e1700 1 -- 172.21.15.88:0/605129529 reap_dead start 2020-02-11T16:26:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.250+0000 7f09e8344700 1 -- 172.21.15.88:0/605129529 shutdown_connections 2020-02-11T16:26:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.251+0000 7f09e8344700 1 --2- 172.21.15.88:0/605129529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09e005fac0 0x7f09e0148640 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.251+0000 7f09e8344700 1 -- 172.21.15.88:0/605129529 >> 172.21.15.88:0/605129529 conn(0x7f09e00a7bb0 msgr2=0x7f09e00a4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.251+0000 7f09e8344700 1 -- 172.21.15.88:0/605129529 shutdown_connections 2020-02-11T16:26:45.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.251+0000 7f09e8344700 1 -- 172.21.15.88:0/605129529 wait complete. 2020-02-11T16:26:45.260 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:26:45.260 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:45.260 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:45.260 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:26:45.260 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 168, 2020-02-11T16:26:45.260 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:26:45.261 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:26:45.261 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:26:45.261 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:26:45.261 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.261 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:26:45.261 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:45.261 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:26:45.262 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:26:45.262 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:45.262 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:45.262 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:45.262 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:45.262 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:45.262 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:45.262 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.263 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:26:45.263 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:26:45.263 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:45.263 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:45.263 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:45.263 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:45.263 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:45.264 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:45.264 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.264 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:26:45.264 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:26:45.264 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:26:45.264 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:26:45.264 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:26:45.265 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:26:45.265 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:45.265 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:45.265 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:26:45.265 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:26:45.265 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:45.266 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:26:45.266 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:45.266 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:45.266 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:45.266 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:45.266 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:45.266 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:45.266 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.267 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:26:45.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.267 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:26:45.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.267 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:45.267 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:45.267 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:45.268 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:45.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.268 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:45.268 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:26:45.268 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.269 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:45.269 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:26:45.269 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.269 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.269 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.269 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:26:45.270 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:26:45.270 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:45.270 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:45.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.270 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:26:45.270 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:26:45.271 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:45.271 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:45.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.271 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:45.271 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:26:45.271 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.272 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:45.272 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:26:45.272 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.272 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.272 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.273 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:26:45.273 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:26:45.273 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:45.273 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:45.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.273 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:45.274 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:45.274 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:45.274 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:45.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.274 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:45.274 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:26:45.274 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.275 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:45.275 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:26:45.275 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.275 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.275 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.276 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:26:45.276 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:26:45.276 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:45.276 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:45.276 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.276 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.276 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:26:45.277 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:26:45.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.277 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.277 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.277 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:45.277 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.277 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.278 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:26:45.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.278 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.278 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.278 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:45.278 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.278 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.279 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:26:45.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.279 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.279 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.279 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:26:45.279 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.279 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.279 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:26:45.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.280 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.280 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.280 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:26:45.280 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.280 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.280 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:26:45.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.281 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.281 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.281 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:45.281 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.281 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.281 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.281 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:26:45.283 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:26:45.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.400+0000 7f349b53d700 1 Processor -- start 2020-02-11T16:26:45.403 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.401+0000 7f349b53d700 1 -- start start 2020-02-11T16:26:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.401+0000 7f349b53d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f34940a5de0 0x7f34940a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.401+0000 7f349b53d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494134a50 0x7f3494134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.401+0000 7f349b53d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940a31b0 con 0x7f34940a18a0 2020-02-11T16:26:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.401+0000 7f349b53d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34940a3570 con 0x7f34940a5de0 2020-02-11T16:26:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.401+0000 7f349b53d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940a3810 con 0x7f3494134a50 2020-02-11T16:26:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.401+0000 7f34992d9700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f34940a18a0 0x7f34940a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47206/0 (socket says 172.21.15.88:47206) 2020-02-11T16:26:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.401+0000 7f34992d9700 1 -- 172.21.15.88:0/116503640 learned_addr learned my addr 172.21.15.88:0/116503640 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> v2:172.21.15.52:3300/0 conn(0x7f34940a5de0 0x7f34940a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3499ada700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494134a50 0x7f3494134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026562997 0 0) 0x7f34940a31b0 con 0x7f34940a18a0 2020-02-11T16:26:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f347c003230 con 0x7f34940a18a0 2020-02-11T16:26:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1832976457 0 0) 0x7f347c003230 con 0x7f34940a18a0 2020-02-11T16:26:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494134a50 msgr2=0x7f3494134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494134a50 0x7f3494134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 >> v2:172.21.15.52:3300/0 conn(0x7f34940a5de0 msgr2=0x7f34940a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 --2- 172.21.15.88:0/116503640 >> v2:172.21.15.52:3300/0 conn(0x7f34940a5de0 0x7f34940a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940a3ab0 con 0x7f34940a18a0 2020-02-11T16:26:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f34900016d0 con 0x7f34940a18a0 2020-02-11T16:26:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 >> v1:172.21.15.88:6789/0 conn(0x7f34940a18a0 legacy=0x7f34940a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494134a50 0x7f347c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f347c003b80 0x7f347c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f347c0045c0 0x7f347c004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940a3570 con 0x7f347c0045c0 2020-02-11T16:26:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940a3810 con 0x7f347c003b80 2020-02-11T16:26:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c005050 con 0x7f3494134a50 2020-02-11T16:26:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> v2:172.21.15.52:3300/0 conn(0x7f34940a5de0 0x7f34940a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:26:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f34992d9700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494134a50 0x7f347c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f347c003b80 0x7f347c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3499ada700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f347c0045c0 0x7f347c004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3498ad8700 1 -- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494134a50 msgr2=0x7f347c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494134a50 0x7f347c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3498ad8700 1 -- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f347c0045c0 msgr2=0x7f347c004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f347c0045c0 0x7f347c004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3498ad8700 1 -- 172.21.15.88:0/116503640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c003230 con 0x7f347c003b80 2020-02-11T16:26:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.402+0000 7f3499ada700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f347c0045c0 0x7f347c004a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:26:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f347c003b80 0x7f347c003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f347c003b80 0x7f347c003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f347c003b80 0x7f347c003fe0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).ready entity=mon.1 client_cookie=e082f24067d47eed server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f347c003b80 0x7f347c003fe0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34840128f0 con 0x7f347c003b80 2020-02-11T16:26:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f347c003b80 0x7f347c003fe0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3484012a50 con 0x7f347c003b80 2020-02-11T16:26:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f3498ad8700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f347c003b80 0x7f347c003fe0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f3483fff700 1 -- 172.21.15.88:0/116503640 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3484012df0 con 0x7f347c003b80 2020-02-11T16:26:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f349b53d700 1 -- 172.21.15.88:0/116503640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f347c003b80 msgr2=0x7f347c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f349b53d700 1 --2- 172.21.15.88:0/116503640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f347c003b80 0x7f347c003fe0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).stop 2020-02-11T16:26:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f3499ada700 1 -- 172.21.15.88:0/116503640 reap_dead start 2020-02-11T16:26:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f349b53d700 1 -- 172.21.15.88:0/116503640 shutdown_connections 2020-02-11T16:26:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f349b53d700 1 -- 172.21.15.88:0/116503640 >> 172.21.15.88:0/116503640 conn(0x7f349409d110 msgr2=0x7f349409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f349b53d700 1 -- 172.21.15.88:0/116503640 shutdown_connections 2020-02-11T16:26:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.403+0000 7f349b53d700 1 -- 172.21.15.88:0/116503640 wait complete. 2020-02-11T16:26:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.404+0000 7f349b53d700 1 Processor -- start 2020-02-11T16:26:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.404+0000 7f349b53d700 1 -- start start 2020-02-11T16:26:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f349b53d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f34940666d0 0x7f3494066b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f349b53d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349414dc10 0x7f3494150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f349b53d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940a7660 con 0x7f3494130f70 2020-02-11T16:26:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f349b53d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3494136a00 con 0x7f34940666d0 2020-02-11T16:26:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f349b53d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940a4780 con 0x7f349414dc10 2020-02-11T16:26:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f34992d9700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3494130f70 0x7f3494136fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47218/0 (socket says 172.21.15.88:47218) 2020-02-11T16:26:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f34992d9700 1 -- 172.21.15.88:0/3615264766 learned_addr learned my addr 172.21.15.88:0/3615264766 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299944081 0 0) 0x7f34940a7660 con 0x7f3494130f70 2020-02-11T16:26:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3474002fe0 con 0x7f3494130f70 2020-02-11T16:26:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> v2:172.21.15.52:3300/0 conn(0x7f34940666d0 0x7f3494066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.405+0000 7f3499ada700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349414dc10 0x7f3494150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3585435128 0 0) 0x7f3474002fe0 con 0x7f3494130f70 2020-02-11T16:26:45.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f34940a7660 con 0x7f3494130f70 2020-02-11T16:26:45.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f349000b930 con 0x7f3494130f70 2020-02-11T16:26:45.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349414dc10 msgr2=0x7f3494150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349414dc10 0x7f3494150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 >> v2:172.21.15.52:3300/0 conn(0x7f34940666d0 msgr2=0x7f3494066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 --2- 172.21.15.88:0/3615264766 >> v2:172.21.15.52:3300/0 conn(0x7f34940666d0 0x7f3494066b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 >> v1:172.21.15.88:6789/0 conn(0x7f3494130f70 legacy=0x7f3494136fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34740052a0 0x7f34740039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349414dc10 0x7f3474003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3494136a00 con 0x7f34740052a0 2020-02-11T16:26:45.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940a4780 con 0x7f34740049b0 2020-02-11T16:26:45.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3474004510 con 0x7f349414dc10 2020-02-11T16:26:45.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> v2:172.21.15.52:3300/0 conn(0x7f34940666d0 0x7f3494066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:26:45.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f3499ada700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349414dc10 0x7f3474003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34740052a0 0x7f34740039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34992d9700 1 -- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349414dc10 msgr2=0x7f3474003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349414dc10 0x7f3474003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.426 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34992d9700 1 -- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34740052a0 msgr2=0x7f34740039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34740052a0 0x7f34740039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34992d9700 1 -- 172.21.15.88:0/3615264766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349412e6c0 con 0x7f34740049b0 2020-02-11T16:26:45.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f349b53d700 1 -- 172.21.15.88:0/3615264766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3494131df0 con 0x7f34740049b0 2020-02-11T16:26:45.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3490000b80 tx=0x7f349412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3490000b80 tx=0x7f349412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.406+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f3490000b80 tx=0x7f349412f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.427 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3490000b80 tx=0x7f349412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f349b53d700 1 -- 172.21.15.88:0/3615264766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34941317a0 con 0x7f34740049b0 2020-02-11T16:26:45.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349000ea10 con 0x7f34740049b0 2020-02-11T16:26:45.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3490000b80 tx=0x7f349412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3490000b80 tx=0x7f349412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34900011f0 con 0x7f34740049b0 2020-02-11T16:26:45.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349000eda0 con 0x7f34740049b0 2020-02-11T16:26:45.428 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3490000b80 tx=0x7f349412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f349b53d700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 0x7f34940a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f349b53d700 1 -- 172.21.15.88:0/3615264766 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349412e570 con 0x7f349405a5d0 2020-02-11T16:26:45.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f34900045b0 con 0x7f34740049b0 2020-02-11T16:26:45.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f34992d9700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3490000b80 tx=0x7f349412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.429 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.407+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 0x7f34940a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f34827fc700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3474041f00 0x7f34740443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f349004a110 con 0x7f34740049b0 2020-02-11T16:26:45.430 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f3498ad8700 1 -- 172.21.15.88:0/3615264766 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3494138ef0 con 0x7f349405a5d0 2020-02-11T16:26:45.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f3499ada700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3474041f00 0x7f34740443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 0x7f34940a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 0x7f34940a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.431 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 0x7f34940a8ff0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f3499ada700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3474041f00 0x7f34740443c0 crc :-1 s=READY pgs=480 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 0x7f34940a8ff0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f348400c590 con 0x7f349405a5d0 2020-02-11T16:26:45.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 0x7f34940a8ff0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f3484007520 con 0x7f349405a5d0 2020-02-11T16:26:45.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 msgr2=0x7f34940a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.432 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f34827fc700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 0x7f34940a8ff0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).stop 2020-02-11T16:26:45.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 msgr2=0x7f34940a8ff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:45.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f3499ada700 1 -- 172.21.15.88:0/3615264766 reap_dead start 2020-02-11T16:26:45.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.408+0000 7f34827fc700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f349405a5d0 0x7f34940a8ff0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.433 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.416+0000 7f349b53d700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 0x7f3494066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.416+0000 7f349b53d700 1 -- 172.21.15.88:0/3615264766 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349405e2f0 con 0x7f3494066af0 2020-02-11T16:26:45.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.417+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 0x7f3494066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.417+0000 7f3498ad8700 1 -- 172.21.15.88:0/3615264766 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3494131b30 con 0x7f3494066af0 2020-02-11T16:26:45.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.417+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 0x7f3494066ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.417+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 0x7f3494066ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.417+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 0x7f3494066ed0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.434 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.417+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 0x7f3494066ed0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.417+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3484007160 con 0x7f3494066af0 2020-02-11T16:26:45.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f3498ad8700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 0x7f3494066ed0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f34840072c0 con 0x7f3494066af0 2020-02-11T16:26:45.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 msgr2=0x7f3494066ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f34827fc700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 0x7f3494066ed0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f3484007920 tx=0x7f348400bed0).stop 2020-02-11T16:26:45.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f34827fc700 1 -- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 msgr2=0x7f3494066ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:26:45.435 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f34827fc700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 0x7f3494066ed0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f349b53d700 1 -- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3474041f00 msgr2=0x7f34740443c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f349b53d700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3474041f00 0x7f34740443c0 crc :-1 s=READY pgs=480 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f349b53d700 1 -- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 msgr2=0x7f3474004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f349b53d700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f3490000b80 tx=0x7f349412f3b0).stop 2020-02-11T16:26:45.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f349b53d700 1 -- 172.21.15.88:0/3615264766 shutdown_connections 2020-02-11T16:26:45.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f349b53d700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34740049b0 0x7f3474004dd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.436 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f349b53d700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3474041f00 0x7f34740443c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f349b53d700 1 --2- 172.21.15.88:0/3615264766 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3494066af0 0x7f3494066ed0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.418+0000 7f349b53d700 1 -- 172.21.15.88:0/3615264766 >> 172.21.15.88:0/3615264766 conn(0x7f349409d110 msgr2=0x7f34940a6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:45.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.419+0000 7f349b53d700 1 -- 172.21.15.88:0/3615264766 shutdown_connections 2020-02-11T16:26:45.437 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.419+0000 7f349b53d700 1 -- 172.21.15.88:0/3615264766 wait complete. 2020-02-11T16:26:45.437 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:26:45.437 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:45.438 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:45.438 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:26:45.438 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 168, 2020-02-11T16:26:45.438 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:26:45.438 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:26:45.438 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:26:45.439 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:26:45.439 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.439 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:26:45.439 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:45.439 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:26:45.439 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:26:45.439 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:45.440 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:45.440 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:45.440 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:45.440 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:45.440 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:45.440 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.440 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:26:45.440 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:26:45.441 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:45.441 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:45.441 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:45.441 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:45.441 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:45.441 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:45.442 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.442 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:26:45.442 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:26:45.442 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:26:45.443 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:26:45.443 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:26:45.443 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:26:45.443 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:45.443 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:26:45.443 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:26:45.444 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:26:45.444 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:26:45.444 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:26:45.444 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:26:45.444 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:26:45.444 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:26:45.444 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:26:45.444 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:26:45.445 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:26:45.445 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.445 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:26:45.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.445 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:26:45.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.445 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:26:45.446 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:26:45.446 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:45.446 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:45.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.446 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:45.446 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:26:45.448 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.448 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:45.448 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:26:45.448 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.449 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.449 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.449 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:26:45.449 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:26:45.449 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:45.450 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:45.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.450 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:26:45.450 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:26:45.450 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:45.450 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:45.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.451 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:45.451 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:26:45.451 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.451 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:45.452 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:26:45.452 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.452 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.452 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.452 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:26:45.452 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:26:45.452 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:45.453 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:45.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.453 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:26:45.453 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:26:45.453 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:26:45.453 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:26:45.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.454 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:26:45.454 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:26:45.454 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.454 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:26:45.455 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:26:45.455 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:26:45.455 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.455 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.455 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:26:45.455 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:26:45.456 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:26:45.456 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:26:45.456 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.456 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:26:45.456 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:26:45.456 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:26:45.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.457 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.457 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.457 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:45.457 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.457 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.457 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:26:45.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.458 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.458 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.458 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:45.458 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.458 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.458 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:26:45.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.459 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.459 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.459 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:26:45.459 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.459 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.459 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:26:45.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.460 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.460 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.460 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:26:45.460 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.460 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:26:45.460 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:26:45.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:26:45.461 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:26:45.461 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:26:45.461 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:26:45.461 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.461 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:26:45.461 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:26:45.462 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:26:45.463 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:26:45.464 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:26:45.464 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:26:45.464 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:26:45.464 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:26:45.464 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:26:45.473 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:26:45.473 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:26:45.473 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:26:45.628 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.626+0000 7f5b86301700 1 Processor -- start 2020-02-11T16:26:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.626+0000 7f5b86301700 1 -- start start 2020-02-11T16:26:45.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b86301700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 0x7f5b8009df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:45.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b86301700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8009e7e0 con 0x7f5b80139050 2020-02-11T16:26:45.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b86301700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b800a4cd0 con 0x7f5b800a6bf0 2020-02-11T16:26:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b86301700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8009e540 con 0x7f5b8005c1f0 2020-02-11T16:26:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b7f7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f5b800a6bf0 legacy=0x7f5b800a45c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b7ffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 0x7f5b8009df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b8489e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5b80139050 0x7f5b80139490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39022/0 (socket says 172.21.15.88:39022) 2020-02-11T16:26:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b8489e700 1 -- 172.21.15.88:0/2303781256 learned_addr learned my addr 172.21.15.88:0/2303781256 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b7ffff700 1 -- 172.21.15.88:0/2303781256 >> v1:172.21.15.88:6789/0 conn(0x7f5b800a6bf0 legacy=0x7f5b800a45c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b7ffff700 1 -- 172.21.15.88:0/2303781256 >> v1:172.21.15.52:6789/0 conn(0x7f5b80139050 legacy=0x7f5b80139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b7ffff700 1 -- 172.21.15.88:0/2303781256 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800a4120 con 0x7f5b8005c1f0 2020-02-11T16:26:45.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b7effd700 1 -- 172.21.15.88:0/2303781256 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117827750 0 0) 0x7f5b8009e7e0 con 0x7f5b80139050 2020-02-11T16:26:45.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b7ffff700 1 --2- 172.21.15.88:0/2303781256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 0x7f5b8009df50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5b70002f30 tx=0x7f5b700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.627+0000 7f5b7ffff700 1 --2- 172.21.15.88:0/2303781256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 0x7f5b8009df50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5b70002f30 tx=0x7f5b700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b7ffff700 1 --2- 172.21.15.88:0/2303781256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 0x7f5b8009df50 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f5b70002f30 tx=0x7f5b700088e0).ready entity=mon.2 client_cookie=ab75fc69f047f1b5 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b7ffff700 1 --2- 172.21.15.88:0/2303781256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 0x7f5b8009df50 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f5b70002f30 tx=0x7f5b700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b7effd700 1 -- 172.21.15.88:0/2303781256 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b70008e40 con 0x7f5b8005c1f0 2020-02-11T16:26:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b7ffff700 1 --2- 172.21.15.88:0/2303781256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 0x7f5b8009df50 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f5b70002f30 tx=0x7f5b700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b7effd700 1 -- 172.21.15.88:0/2303781256 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b700116a0 con 0x7f5b8005c1f0 2020-02-11T16:26:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b7ffff700 1 --2- 172.21.15.88:0/2303781256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 0x7f5b8009df50 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f5b70002f30 tx=0x7f5b700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b7effd700 1 -- 172.21.15.88:0/2303781256 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b70011a80 con 0x7f5b8005c1f0 2020-02-11T16:26:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b86301700 1 -- 172.21.15.88:0/2303781256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 msgr2=0x7f5b8009df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b86301700 1 --2- 172.21.15.88:0/2303781256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 0x7f5b8009df50 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f5b70002f30 tx=0x7f5b700088e0).stop 2020-02-11T16:26:45.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b86301700 1 -- 172.21.15.88:0/2303781256 shutdown_connections 2020-02-11T16:26:45.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b86301700 1 --2- 172.21.15.88:0/2303781256 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b8005c1f0 0x7f5b8009df50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b86301700 1 -- 172.21.15.88:0/2303781256 >> 172.21.15.88:0/2303781256 conn(0x7f5b800ab400 msgr2=0x7f5b800a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:45.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b86301700 1 -- 172.21.15.88:0/2303781256 shutdown_connections 2020-02-11T16:26:45.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.628+0000 7f5b86301700 1 -- 172.21.15.88:0/2303781256 wait complete. 2020-02-11T16:26:45.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.629+0000 7f5b86301700 1 Processor -- start 2020-02-11T16:26:45.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.629+0000 7f5b86301700 1 -- start start 2020-02-11T16:26:45.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.630+0000 7f5b86301700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.630+0000 7f5b86301700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8009f1c0 con 0x7f5b80139050 2020-02-11T16:26:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.630+0000 7f5b7ffff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f5b8005c1f0 legacy=0x7f5b800a2720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.630+0000 7f5b86301700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b80138b70 con 0x7f5b8005c1f0 2020-02-11T16:26:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.630+0000 7f5b86301700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8009ec80 con 0x7f5b800a6bf0 2020-02-11T16:26:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:53942/0 (socket says 172.21.15.88:53942) 2020-02-11T16:26:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 -- 172.21.15.88:0/1970361507 learned_addr learned my addr 172.21.15.88:0/1970361507 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7d7fa700 1 -- 172.21.15.88:0/1970361507 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180076654 0 0) 0x7f5b8009f1c0 con 0x7f5b80139050 2020-02-11T16:26:45.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7d7fa700 1 -- 172.21.15.88:0/1970361507 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b60002fe0 con 0x7f5b80139050 2020-02-11T16:26:45.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 -- 172.21.15.88:0/1970361507 >> v1:172.21.15.88:6789/0 conn(0x7f5b8005c1f0 legacy=0x7f5b800a2720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:45.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 -- 172.21.15.88:0/1970361507 >> v1:172.21.15.52:6789/0 conn(0x7f5b80139050 legacy=0x7f5b80145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 -- 172.21.15.88:0/1970361507 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8009ef20 con 0x7f5b800a6bf0 2020-02-11T16:26:45.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7d7fa700 1 -- 172.21.15.88:0/1970361507 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b74011630 con 0x7f5b800a6bf0 2020-02-11T16:26:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7f7fe700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7d7fa700 1 -- 172.21.15.88:0/1970361507 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b74011790 con 0x7f5b800a6bf0 2020-02-11T16:26:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b86301700 1 -- 172.21.15.88:0/1970361507 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8009e970 con 0x7f5b800a6bf0 2020-02-11T16:26:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b7d7fa700 1 -- 172.21.15.88:0/1970361507 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b74011b30 con 0x7f5b800a6bf0 2020-02-11T16:26:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.631+0000 7f5b86301700 1 -- 172.21.15.88:0/1970361507 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b80145c70 con 0x7f5b800a6bf0 2020-02-11T16:26:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.632+0000 7f5b7f7fe700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.632+0000 7f5b7d7fa700 1 -- 172.21.15.88:0/1970361507 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5b7400b180 con 0x7f5b800a6bf0 2020-02-11T16:26:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.632+0000 7f5b7f7fe700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.632+0000 7f5b86301700 1 -- 172.21.15.88:0/1970361507 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b80066840 con 0x7f5b800a6bf0 2020-02-11T16:26:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.633+0000 7f5b7d7fa700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b60039ef0 0x7f5b6003c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.633+0000 7f5b7d7fa700 1 -- 172.21.15.88:0/1970361507 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5b74049610 con 0x7f5b800a6bf0 2020-02-11T16:26:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.633+0000 7f5b7ffff700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b60039ef0 0x7f5b6003c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.633+0000 7f5b7ffff700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b60039ef0 0x7f5b6003c3b0 crc :-1 s=READY pgs=481 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.637+0000 7f5b7f7fe700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.637+0000 7f5b7d7fa700 1 -- 172.21.15.88:0/1970361507 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f5b80066840 con 0x7f5b800a6bf0 2020-02-11T16:26:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.854+0000 7f5b86301700 1 -- 172.21.15.88:0/1970361507 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5b80066840 con 0x7f5b800a6bf0 2020-02-11T16:26:45.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.854+0000 7f5b7f7fe700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:45.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.854+0000 7f5b7d7fa700 1 -- 172.21.15.88:0/1970361507 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f5b80066840 con 0x7f5b800a6bf0 2020-02-11T16:26:45.857 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":168,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.856+0000 7f5b86301700 1 -- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b60039ef0 msgr2=0x7f5b6003c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.856+0000 7f5b86301700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b60039ef0 0x7f5b6003c3b0 crc :-1 s=READY pgs=481 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.856+0000 7f5b86301700 1 -- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 msgr2=0x7f5b80066b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.856+0000 7f5b86301700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f5b800a2ec0 tx=0x7f5b74010960).stop 2020-02-11T16:26:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.856+0000 7f5b86301700 1 -- 172.21.15.88:0/1970361507 shutdown_connections 2020-02-11T16:26:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.856+0000 7f5b86301700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5b60039ef0 0x7f5b6003c3b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.856+0000 7f5b86301700 1 --2- 172.21.15.88:0/1970361507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5b800a6bf0 0x7f5b80066b00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.856+0000 7f5b86301700 1 -- 172.21.15.88:0/1970361507 >> 172.21.15.88:0/1970361507 conn(0x7f5b800ab400 msgr2=0x7f5b80135340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.856+0000 7f5b86301700 1 -- 172.21.15.88:0/1970361507 shutdown_connections 2020-02-11T16:26:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:45.856+0000 7f5b86301700 1 -- 172.21.15.88:0/1970361507 wait complete. 2020-02-11T16:26:45.869 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":168,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:45.924 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:26:45.926 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:26:48.870 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:26:49.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.007+0000 7f80e3cd3700 1 Processor -- start 2020-02-11T16:26:49.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.007+0000 7f80e3cd3700 1 -- start start 2020-02-11T16:26:49.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e3cd3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a2fa0 0x7f80dc0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:49.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e3cd3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f80dc0a5410 0x7f80dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:49.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e3cd3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc0a4350 con 0x7f80dc0a6da0 2020-02-11T16:26:49.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e3cd3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc0a1e60 con 0x7f80dc0a5410 2020-02-11T16:26:49.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e3cd3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc0a3450 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e1a6f700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a2fa0 msgr2=0x7f80dc0a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:49.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e2270700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f80dc0a6da0 legacy=0x7f80dc131280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:49.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e1a6f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a2fa0 0x7f80dc0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:49.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e126e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f80dc0a5410 0x7f80dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:49.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e126e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f80dc0a5410 0x7f80dc0a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45614/0 (socket says 172.21.15.88:45614) 2020-02-11T16:26:49.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.008+0000 7f80e126e700 1 -- 172.21.15.88:0/3417405048 learned_addr learned my addr 172.21.15.88:0/3417405048 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:49.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e126e700 1 -- 172.21.15.88:0/3417405048 >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a2fa0 msgr2=0x7f80dc0a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:49.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e126e700 1 --2- 172.21.15.88:0/3417405048 >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a2fa0 0x7f80dc0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:49.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e126e700 1 -- 172.21.15.88:0/3417405048 >> v1:172.21.15.88:6789/0 conn(0x7f80dc0a6da0 legacy=0x7f80dc131280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:49.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e126e700 1 -- 172.21.15.88:0/3417405048 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0a3a40 con 0x7f80dc0a5410 2020-02-11T16:26:49.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e126e700 1 --2- 172.21.15.88:0/3417405048 >> v2:172.21.15.52:3300/0 conn(0x7f80dc0a5410 0x7f80dc0a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f80dc05ef00 tx=0x7f80cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e126e700 1 --2- 172.21.15.88:0/3417405048 >> v2:172.21.15.52:3300/0 conn(0x7f80dc0a5410 0x7f80dc0a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f80dc05ef00 tx=0x7f80cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e126e700 1 --2- 172.21.15.88:0/3417405048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80dc0a5410 0x7f80dc0a5870 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f80dc05ef00 tx=0x7f80cc0088e0).ready entity=mon.0 client_cookie=754741e35d5236ce server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:49.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e126e700 1 --2- 172.21.15.88:0/3417405048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80dc0a5410 0x7f80dc0a5870 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f80dc05ef00 tx=0x7f80cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e0a6d700 1 -- 172.21.15.88:0/3417405048 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80cc008e20 con 0x7f80dc0a5410 2020-02-11T16:26:49.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e126e700 1 --2- 172.21.15.88:0/3417405048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80dc0a5410 0x7f80dc0a5870 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f80dc05ef00 tx=0x7f80cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e126e700 1 --2- 172.21.15.88:0/3417405048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80dc0a5410 0x7f80dc0a5870 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f80dc05ef00 tx=0x7f80cc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e0a6d700 1 -- 172.21.15.88:0/3417405048 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc0118d0 con 0x7f80dc0a5410 2020-02-11T16:26:49.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e0a6d700 1 -- 172.21.15.88:0/3417405048 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80cc011c70 con 0x7f80dc0a5410 2020-02-11T16:26:49.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e3cd3700 1 -- 172.21.15.88:0/3417405048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80dc0a5410 msgr2=0x7f80dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:49.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e3cd3700 1 --2- 172.21.15.88:0/3417405048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80dc0a5410 0x7f80dc0a5870 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f80dc05ef00 tx=0x7f80cc0088e0).stop 2020-02-11T16:26:49.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e3cd3700 1 -- 172.21.15.88:0/3417405048 shutdown_connections 2020-02-11T16:26:49.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e3cd3700 1 --2- 172.21.15.88:0/3417405048 >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a2fa0 0x7f80dc0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:49.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e3cd3700 1 --2- 172.21.15.88:0/3417405048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80dc0a5410 0x7f80dc0a5870 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:49.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.009+0000 7f80e3cd3700 1 -- 172.21.15.88:0/3417405048 >> 172.21.15.88:0/3417405048 conn(0x7f80dc09d110 msgr2=0x7f80dc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:49.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.010+0000 7f80e3cd3700 1 -- 172.21.15.88:0/3417405048 shutdown_connections 2020-02-11T16:26:49.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.010+0000 7f80e3cd3700 1 -- 172.21.15.88:0/3417405048 wait complete. 2020-02-11T16:26:49.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.011+0000 7f80e3cd3700 1 Processor -- start 2020-02-11T16:26:49.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.011+0000 7f80e3cd3700 1 -- start start 2020-02-11T16:26:49.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.011+0000 7f80e3cd3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:49.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.011+0000 7f80e3cd3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a6da0 0x7f80dc131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:49.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.011+0000 7f80e3cd3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc134360 con 0x7f80dc0a5410 2020-02-11T16:26:49.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e3cd3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc1353c0 con 0x7f80dc0a6da0 2020-02-11T16:26:49.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e3cd3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc134600 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e2270700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a6da0 msgr2=0x7f80dc131fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:49.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e126e700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f80dc0a5410 legacy=0x7f80dc12f430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:49.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e2270700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a6da0 0x7f80dc131fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:49.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:49.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:53954/0 (socket says 172.21.15.88:53954) 2020-02-11T16:26:49.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 -- 172.21.15.88:0/1833440692 learned_addr learned my addr 172.21.15.88:0/1833440692 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:49.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 -- 172.21.15.88:0/1833440692 >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a6da0 msgr2=0x7f80dc131fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:49.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a6da0 0x7f80dc131fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:49.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 -- 172.21.15.88:0/1833440692 >> v1:172.21.15.88:6789/0 conn(0x7f80dc0a5410 legacy=0x7f80dc12f430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:49.022 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 -- 172.21.15.88:0/1833440692 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc1348a0 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:49.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.012+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.013+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.013+0000 7f80caffd700 1 -- 172.21.15.88:0/1833440692 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d8008d20 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.013+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.013+0000 7f80caffd700 1 -- 172.21.15.88:0/1833440692 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d8008e80 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.013+0000 7f80e3cd3700 1 -- 172.21.15.88:0/1833440692 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc09d950 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.013+0000 7f80caffd700 1 -- 172.21.15.88:0/1833440692 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d8003900 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.013+0000 7f80e3cd3700 1 -- 172.21.15.88:0/1833440692 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc12fb40 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.013+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.014+0000 7f80caffd700 1 -- 172.21.15.88:0/1833440692 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f80d8003b30 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.014+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.014+0000 7f80caffd700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f80bc039ca0 0x7f80bc03c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:49.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.014+0000 7f80caffd700 1 -- 172.21.15.88:0/1833440692 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f80d80496d0 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.014+0000 7f80e3cd3700 1 -- 172.21.15.88:0/1833440692 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc134a30 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.014+0000 7f80e126e700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f80bc039ca0 0x7f80bc03c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:49.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.014+0000 7f80e126e700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f80bc039ca0 0x7f80bc03c160 crc :-1 s=READY pgs=482 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:49.025 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.018+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.018+0000 7f80caffd700 1 -- 172.21.15.88:0/1833440692 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f80d802ecb0 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.234+0000 7f80e3cd3700 1 -- 172.21.15.88:0/1833440692 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f80dc0565b0 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.234+0000 7f80e1a6f700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.234+0000 7f80caffd700 1 -- 172.21.15.88:0/1833440692 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f80d80317c0 con 0x7f80dc0a2fa0 2020-02-11T16:26:49.237 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":168,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 -- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f80bc039ca0 msgr2=0x7f80bc03c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f80bc039ca0 0x7f80bc03c160 crc :-1 s=READY pgs=482 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 -- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 msgr2=0x7f80dc139b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f80dc0a1120 tx=0x7f80d8010a40).stop 2020-02-11T16:26:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 -- 172.21.15.88:0/1833440692 shutdown_connections 2020-02-11T16:26:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f80bc039ca0 0x7f80bc03c160 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 --2- 172.21.15.88:0/1833440692 >> v2:172.21.15.88:3300/0 conn(0x7f80dc0a6da0 0x7f80dc131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 --2- 172.21.15.88:0/1833440692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc0a2fa0 0x7f80dc139b80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 -- 172.21.15.88:0/1833440692 >> 172.21.15.88:0/1833440692 conn(0x7f80dc09d110 msgr2=0x7f80dc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 -- 172.21.15.88:0/1833440692 shutdown_connections 2020-02-11T16:26:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:49.236+0000 7f80e3cd3700 1 -- 172.21.15.88:0/1833440692 wait complete. 2020-02-11T16:26:49.253 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":168,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:52.254 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:26:52.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.369+0000 7f85f5904700 1 Processor -- start 2020-02-11T16:26:52.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.369+0000 7f85f5904700 1 -- start start 2020-02-11T16:26:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85f5904700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85f5904700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85f0138280 0x7f85f01386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85f5904700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f85f013b1c0 0x7f85f013b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85f5904700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f0137bf0 con 0x7f85f0138280 2020-02-11T16:26:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85f5904700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f0138b40 con 0x7f85f013b1c0 2020-02-11T16:26:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85f5904700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00adb40 con 0x7f85f00ad380 2020-02-11T16:26:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85ef7fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f85f013b1c0 msgr2=0x7f85f013b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85ef7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f85f013b1c0 0x7f85f013b600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85eeffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85ee7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85f0138280 0x7f85f01386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85eeffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:53962/0 (socket says 172.21.15.88:53962) 2020-02-11T16:26:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85ee7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85f0138280 0x7f85f01386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45624/0 (socket says 172.21.15.88:45624) 2020-02-11T16:26:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.370+0000 7f85eeffd700 1 -- 172.21.15.88:0/1026770376 learned_addr learned my addr 172.21.15.88:0/1026770376 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:26:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 -- 172.21.15.88:0/1026770376 >> v2:172.21.15.88:3300/0 conn(0x7f85f013b1c0 msgr2=0x7f85f013b600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:26:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 --2- 172.21.15.88:0/1026770376 >> v2:172.21.15.88:3300/0 conn(0x7f85f013b1c0 0x7f85f013b600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 -- 172.21.15.88:0/1026770376 >> v2:172.21.15.52:3300/0 conn(0x7f85f0138280 msgr2=0x7f85f01386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:26:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 --2- 172.21.15.88:0/1026770376 >> v2:172.21.15.52:3300/0 conn(0x7f85f0138280 0x7f85f01386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 -- 172.21.15.88:0/1026770376 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0137de0 con 0x7f85f00ad380 2020-02-11T16:26:52.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85ee7fc700 1 --2- 172.21.15.88:0/1026770376 >> v2:172.21.15.52:3300/0 conn(0x7f85f0138280 0x7f85f01386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:26:52.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 --2- 172.21.15.88:0/1026770376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f85f0138c80 tx=0x7f85e00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 --2- 172.21.15.88:0/1026770376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f85f0138c80 tx=0x7f85e00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 --2- 172.21.15.88:0/1026770376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f85f0138c80 tx=0x7f85e00088e0).ready entity=mon.2 client_cookie=47d87248870d72c0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:52.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 --2- 172.21.15.88:0/1026770376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f85f0138c80 tx=0x7f85e00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85edffb700 1 -- 172.21.15.88:0/1026770376 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e0008e20 con 0x7f85f00ad380 2020-02-11T16:26:52.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 --2- 172.21.15.88:0/1026770376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f85f0138c80 tx=0x7f85e00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85eeffd700 1 --2- 172.21.15.88:0/1026770376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f85f0138c80 tx=0x7f85e00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85edffb700 1 -- 172.21.15.88:0/1026770376 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0011860 con 0x7f85f00ad380 2020-02-11T16:26:52.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85edffb700 1 -- 172.21.15.88:0/1026770376 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e0011c40 con 0x7f85f00ad380 2020-02-11T16:26:52.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85f5904700 1 -- 172.21.15.88:0/1026770376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 msgr2=0x7f85f00a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:52.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.371+0000 7f85f5904700 1 --2- 172.21.15.88:0/1026770376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f85f0138c80 tx=0x7f85e00088e0).stop 2020-02-11T16:26:52.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.372+0000 7f85f5904700 1 -- 172.21.15.88:0/1026770376 shutdown_connections 2020-02-11T16:26:52.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.372+0000 7f85f5904700 1 --2- 172.21.15.88:0/1026770376 >> v2:172.21.15.88:3300/0 conn(0x7f85f013b1c0 0x7f85f013b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:52.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.372+0000 7f85f5904700 1 --2- 172.21.15.88:0/1026770376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85f00ad380 0x7f85f00a9130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:52.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.372+0000 7f85f5904700 1 --2- 172.21.15.88:0/1026770376 >> v2:172.21.15.52:3300/0 conn(0x7f85f0138280 0x7f85f01386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:26:52.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.372+0000 7f85f5904700 1 -- 172.21.15.88:0/1026770376 >> 172.21.15.88:0/1026770376 conn(0x7f85f005ac70 msgr2=0x7f85f00ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:52.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.372+0000 7f85f5904700 1 -- 172.21.15.88:0/1026770376 shutdown_connections 2020-02-11T16:26:52.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.372+0000 7f85f5904700 1 -- 172.21.15.88:0/1026770376 wait complete. 2020-02-11T16:26:52.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85f5904700 1 Processor -- start 2020-02-11T16:26:52.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85f5904700 1 -- start start 2020-02-11T16:26:52.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85f5904700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85f013b1c0 0x7f85f0150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:52.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85f5904700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f01399f0 con 0x7f85f0138280 2020-02-11T16:26:52.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85f5904700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f012e1d0 con 0x7f85f00ad380 2020-02-11T16:26:52.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85f5904700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f0132bd0 con 0x7f85f013b1c0 2020-02-11T16:26:52.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85eeffd700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f85f00ad380 legacy=0x7f85f0139ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:26:52.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85ef7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85f013b1c0 0x7f85f0150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:52.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85ee7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f85f0138280 0x7f85f012b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39054/0 (socket says 172.21.15.88:39054) 2020-02-11T16:26:52.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85ef7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85f013b1c0 0x7f85f0150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45634/0 (socket says 172.21.15.88:45634) 2020-02-11T16:26:52.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.373+0000 7f85ee7fc700 1 -- 172.21.15.88:0/2623671381 learned_addr learned my addr 172.21.15.88:0/2623671381 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:52.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85ef7fe700 1 -- 172.21.15.88:0/2623671381 >> v1:172.21.15.88:6789/0 conn(0x7f85f00ad380 legacy=0x7f85f0139ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:26:52.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85ef7fe700 1 -- 172.21.15.88:0/2623671381 >> v1:172.21.15.52:6789/0 conn(0x7f85f0138280 legacy=0x7f85f012b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:52.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85ef7fe700 1 -- 172.21.15.88:0/2623671381 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0132dc0 con 0x7f85f013b1c0 2020-02-11T16:26:52.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85ef7fe700 1 --2- 172.21.15.88:0/2623671381 >> v2:172.21.15.52:3300/0 conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85ef7fe700 1 --2- 172.21.15.88:0/2623671381 >> v2:172.21.15.52:3300/0 conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85ef7fe700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:52.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85ef7fe700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85ef7fe700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85dffff700 1 -- 172.21.15.88:0/2623671381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e80125e0 con 0x7f85f013b1c0 2020-02-11T16:26:52.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85ef7fe700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85dffff700 1 -- 172.21.15.88:0/2623671381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e8012740 con 0x7f85f013b1c0 2020-02-11T16:26:52.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85f5904700 1 -- 172.21.15.88:0/2623671381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f0139670 con 0x7f85f013b1c0 2020-02-11T16:26:52.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85dffff700 1 -- 172.21.15.88:0/2623671381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e8012b60 con 0x7f85f013b1c0 2020-02-11T16:26:52.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.374+0000 7f85f5904700 1 -- 172.21.15.88:0/2623671381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f012bfa0 con 0x7f85f013b1c0 2020-02-11T16:26:52.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.375+0000 7f85ef7fe700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.375+0000 7f85f5904700 1 -- 172.21.15.88:0/2623671381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f00565b0 con 0x7f85f013b1c0 2020-02-11T16:26:52.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.375+0000 7f85dffff700 1 -- 172.21.15.88:0/2623671381 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f85e800a180 con 0x7f85f013b1c0 2020-02-11T16:26:52.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.375+0000 7f85ef7fe700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.375+0000 7f85dffff700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f85cc039c20 0x7f85cc03c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:26:52.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.375+0000 7f85dffff700 1 -- 172.21.15.88:0/2623671381 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f85e8049f30 con 0x7f85f013b1c0 2020-02-11T16:26:52.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.376+0000 7f85eeffd700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f85cc039c20 0x7f85cc03c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:52.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.376+0000 7f85eeffd700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f85cc039c20 0x7f85cc03c0e0 crc :-1 s=READY pgs=483 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:26:52.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.379+0000 7f85ef7fe700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.379+0000 7f85dffff700 1 -- 172.21.15.88:0/2623671381 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f85e802f550 con 0x7f85f013b1c0 2020-02-11T16:26:52.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.590+0000 7f85f5904700 1 -- 172.21.15.88:0/2623671381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f85f0139450 con 0x7f85f013b1c0 2020-02-11T16:26:52.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.590+0000 7f85ef7fe700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:26:52.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.590+0000 7f85dffff700 1 -- 172.21.15.88:0/2623671381 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f85e8032020 con 0x7f85f013b1c0 2020-02-11T16:26:52.593 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":168,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.592+0000 7f85f5904700 1 -- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f85cc039c20 msgr2=0x7f85cc03c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.592+0000 7f85f5904700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f85cc039c20 0x7f85cc03c0e0 crc :-1 s=READY pgs=483 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.592+0000 7f85f5904700 1 -- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 msgr2=0x7f85f0150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:26:52.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.592+0000 7f85f5904700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 0x7f85f0150b40 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f85f012e360 tx=0x7f85e8010c80).stop 2020-02-11T16:26:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.592+0000 7f85f5904700 1 -- 172.21.15.88:0/2623671381 shutdown_connections 2020-02-11T16:26:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.592+0000 7f85f5904700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f85cc039c20 0x7f85cc03c0e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.592+0000 7f85f5904700 1 --2- 172.21.15.88:0/2623671381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f013b1c0 0x7f85f0150b40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:26:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.592+0000 7f85f5904700 1 -- 172.21.15.88:0/2623671381 >> 172.21.15.88:0/2623671381 conn(0x7f85f005ac70 msgr2=0x7f85f005ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:26:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.592+0000 7f85f5904700 1 -- 172.21.15.88:0/2623671381 shutdown_connections 2020-02-11T16:26:52.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:52.592+0000 7f85f5904700 1 -- 172.21.15.88:0/2623671381 wait complete. 2020-02-11T16:26:52.606 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":168,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:26:55.608 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:26:55.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.725+0000 7f4471125700 1 Processor -- start 2020-02-11T16:26:55.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.725+0000 7f4471125700 1 -- start start 2020-02-11T16:26:55.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f4471125700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:55.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f4471125700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 0x7f446c13b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:26:55.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f4471125700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0a2cf0 con 0x7f446c13b640 2020-02-11T16:26:55.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f4471125700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0a8630 con 0x7f446c0a2870 2020-02-11T16:26:55.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f4471125700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0a30c0 con 0x7f446c0a6ff0 2020-02-11T16:26:55.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f4463fff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 msgr2=0x7f446c13b1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:55.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f4463fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 0x7f446c13b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:55.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f446ad9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:55.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f446b59e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f446c13b640 0x7f446c137c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39062/0 (socket says 172.21.15.88:39062) 2020-02-11T16:26:55.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f446b59e700 1 -- 172.21.15.88:0/3351366811 learned_addr learned my addr 172.21.15.88:0/3351366811 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:26:55.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f446ad9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:53976/0 (socket says 172.21.15.88:53976) 2020-02-11T16:26:55.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:26:55.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:26:55.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:26:55.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.726+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:26:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.927+0000 7f4463fff700 1 -- 172.21.15.88:0/3351366811 >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 msgr2=0x7f446c13b1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.927+0000 7f4463fff700 1 --2- 172.21.15.88:0/3351366811 >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 0x7f446c13b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:26:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.927+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.927+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:26:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.927+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:26:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.927+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:26:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:55.927+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:26:56.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:56.328+0000 7f4463fff700 1 -- 172.21.15.88:0/3351366811 >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 msgr2=0x7f446c13b1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:56.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:56.328+0000 7f4463fff700 1 --2- 172.21.15.88:0/3351366811 >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 0x7f446c13b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:26:56.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:56.328+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:56.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:56.328+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:26:56.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:56.328+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:26:56.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:56.328+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:26:56.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:56.328+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:26:57.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:57.129+0000 7f4463fff700 1 -- 172.21.15.88:0/3351366811 >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 msgr2=0x7f446c13b1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:57.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:57.129+0000 7f4463fff700 1 --2- 172.21.15.88:0/3351366811 >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 0x7f446c13b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:26:57.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:57.129+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:57.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:57.129+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:26:57.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:57.129+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:26:57.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:57.129+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:26:57.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:57.129+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:26:58.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:58.730+0000 7f4463fff700 1 -- 172.21.15.88:0/3351366811 >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 msgr2=0x7f446c13b1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:26:58.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:58.730+0000 7f4463fff700 1 --2- 172.21.15.88:0/3351366811 >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 0x7f446c13b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:26:58.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:58.731+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:26:58.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:58.731+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:26:58.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:58.731+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:26:58.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:58.731+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:26:58.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:26:58.731+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:27:00.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.253+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103274214 0 0) 0x7f4464001450 con 0x7f446c13b640 2020-02-11T16:27:00.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.253+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f444c003230 con 0x7f446c13b640 2020-02-11T16:27:00.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 577882445 0 0) 0x7f444c003230 con 0x7f446c13b640 2020-02-11T16:27:00.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f446c0a73d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:00.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f446c0a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:00.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 msgr2=0x7f446c13b1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:00.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 --2- 172.21.15.88:0/3351366811 >> v2:172.21.15.88:3300/0 conn(0x7f446c0a2870 0x7f446c13b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:00.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0a2130 con 0x7f446c13b640 2020-02-11T16:27:00.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f4464001bc0 con 0x7f446c13b640 2020-02-11T16:27:00.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 >> v1:172.21.15.52:6789/0 conn(0x7f446c13b640 legacy=0x7f446c137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f444c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:00.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f444c003b80 0x7f444c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:00.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f444c004520 0x7f444c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:00.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0a30c0 con 0x7f444c003b80 2020-02-11T16:27:00.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c004f30 con 0x7f444c004520 2020-02-11T16:27:00.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0050f0 con 0x7f446c0a6ff0 2020-02-11T16:27:00.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446b59e700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f444c004520 msgr2=0x7f444c004980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:27:00.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.254+0000 7f446b59e700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f444c004520 0x7f444c004980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:00.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f444c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f4463fff700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f444c003b80 0x7f444c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f444c004520 msgr2=0x7f444c004980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:00.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f444c004520 0x7f444c004980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:00.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f444c003b80 msgr2=0x7f444c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:00.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f444c003b80 0x7f444c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:00.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f446ad9d700 1 -- 172.21.15.88:0/3351366811 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c003230 con 0x7f446c0a6ff0 2020-02-11T16:27:00.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f4463fff700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f444c003b80 0x7f444c003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:27:00.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f444c003720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f445c002f30 tx=0x7f445c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f444c003720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f445c002f30 tx=0x7f445c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.255+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f444c003720 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f445c002f30 tx=0x7f445c00bbe0).ready entity=mon.2 client_cookie=c50b224ea7c970cc server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.256+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f444c003720 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f445c002f30 tx=0x7f445c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.256+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f445c010a90 con 0x7f446c0a6ff0 2020-02-11T16:27:00.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.256+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f444c003720 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f445c002f30 tx=0x7f445c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.256+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f444c003720 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f445c002f30 tx=0x7f445c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.256+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c010bf0 con 0x7f446c0a6ff0 2020-02-11T16:27:00.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.256+0000 7f446a59c700 1 -- 172.21.15.88:0/3351366811 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f445c00e670 con 0x7f446c0a6ff0 2020-02-11T16:27:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.256+0000 7f4471125700 1 -- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 msgr2=0x7f444c003720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.256+0000 7f4471125700 1 --2- 172.21.15.88:0/3351366811 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a6ff0 0x7f444c003720 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f445c002f30 tx=0x7f445c00bbe0).stop 2020-02-11T16:27:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.256+0000 7f446b59e700 1 -- 172.21.15.88:0/3351366811 reap_dead start 2020-02-11T16:27:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.257+0000 7f4471125700 1 -- 172.21.15.88:0/3351366811 shutdown_connections 2020-02-11T16:27:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.257+0000 7f4471125700 1 -- 172.21.15.88:0/3351366811 >> 172.21.15.88:0/3351366811 conn(0x7f446c0ac2d0 msgr2=0x7f446c0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.257+0000 7f4471125700 1 -- 172.21.15.88:0/3351366811 shutdown_connections 2020-02-11T16:27:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.257+0000 7f4471125700 1 -- 172.21.15.88:0/3351366811 wait complete. 2020-02-11T16:27:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f4471125700 1 Processor -- start 2020-02-11T16:27:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f4471125700 1 -- start start 2020-02-11T16:27:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f4471125700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a3410 0x7f446c1310f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f4471125700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f446c131550 0x7f446c1319a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f4471125700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0a4e20 con 0x7f446c134f50 2020-02-11T16:27:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f4471125700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0a50c0 con 0x7f446c131550 2020-02-11T16:27:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f4471125700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0a5360 con 0x7f446c0a3410 2020-02-11T16:27:00.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f4463fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a3410 0x7f446c1310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f446b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f446c131550 0x7f446c1319a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f446b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f446c131550 0x7f446c1319a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45668/0 (socket says 172.21.15.88:45668) 2020-02-11T16:27:00.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f4463fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a3410 0x7f446c1310f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:54004/0 (socket says 172.21.15.88:54004) 2020-02-11T16:27:00.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.258+0000 7f446b59e700 1 -- 172.21.15.88:0/3619188982 learned_addr learned my addr 172.21.15.88:0/3619188982 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:00.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f446b59e700 1 -- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a3410 msgr2=0x7f446c1310f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a3410 0x7f446c1310f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f446b59e700 1 -- 172.21.15.88:0/3619188982 >> v1:172.21.15.52:6789/0 conn(0x7f446c134f50 legacy=0x7f446c137600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f4468d99700 1 -- 172.21.15.88:0/3619188982 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985031089 0 0) 0x7f446c0a4e20 con 0x7f446c134f50 2020-02-11T16:27:00.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f446b59e700 1 -- 172.21.15.88:0/3619188982 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0a6970 con 0x7f446c131550 2020-02-11T16:27:00.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> v2:172.21.15.52:3300/0 conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> v2:172.21.15.52:3300/0 conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f4468d99700 1 -- 172.21.15.88:0/3619188982 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f446400cea0 con 0x7f446c131550 2020-02-11T16:27:00.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f4468d99700 1 -- 172.21.15.88:0/3619188982 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4464004b20 con 0x7f446c131550 2020-02-11T16:27:00.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f4471125700 1 -- 172.21.15.88:0/3619188982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0a1520 con 0x7f446c131550 2020-02-11T16:27:00.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f4468d99700 1 -- 172.21.15.88:0/3619188982 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4464004e80 con 0x7f446c131550 2020-02-11T16:27:00.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.259+0000 7f4471125700 1 -- 172.21.15.88:0/3619188982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0a56e0 con 0x7f446c131550 2020-02-11T16:27:00.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.260+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.260+0000 7f4468d99700 1 -- 172.21.15.88:0/3619188982 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4464001640 con 0x7f446c131550 2020-02-11T16:27:00.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.260+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.260+0000 7f4468d99700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4450039b60 0x7f445003c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.260+0000 7f4468d99700 1 -- 172.21.15.88:0/3619188982 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f44640495b0 con 0x7f446c131550 2020-02-11T16:27:00.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.261+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4450039b60 0x7f445003c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.261+0000 7f4471125700 1 -- 172.21.15.88:0/3619188982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c0a2cf0 con 0x7f446c131550 2020-02-11T16:27:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.261+0000 7f446ad9d700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4450039b60 0x7f445003c020 crc :-1 s=READY pgs=484 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.264+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.264+0000 7f4468d99700 1 -- 172.21.15.88:0/3619188982 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f446c0a2cf0 con 0x7f446c131550 2020-02-11T16:27:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.500+0000 7f4471125700 1 -- 172.21.15.88:0/3619188982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f446c0a2cf0 con 0x7f446c131550 2020-02-11T16:27:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.501+0000 7f446b59e700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.501+0000 7f4468d99700 1 -- 172.21.15.88:0/3619188982 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f446c0a2cf0 con 0x7f446c131550 2020-02-11T16:27:00.504 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":172,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 -- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4450039b60 msgr2=0x7f445003c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4450039b60 0x7f445003c020 crc :-1 s=READY pgs=484 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 -- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 msgr2=0x7f446c1319a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 0x7f446c1319a0 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f446c068dc0 tx=0x7f446c0ac270).stop 2020-02-11T16:27:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 -- 172.21.15.88:0/3619188982 shutdown_connections 2020-02-11T16:27:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4450039b60 0x7f445003c020 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f446c131550 0x7f446c1319a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 --2- 172.21.15.88:0/3619188982 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f446c0a3410 0x7f446c1310f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 -- 172.21.15.88:0/3619188982 >> 172.21.15.88:0/3619188982 conn(0x7f446c0ac2d0 msgr2=0x7f446c0a6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 -- 172.21.15.88:0/3619188982 shutdown_connections 2020-02-11T16:27:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.503+0000 7f4471125700 1 -- 172.21.15.88:0/3619188982 wait complete. 2020-02-11T16:27:00.516 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":172,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:00.516 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:27:00.516 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:27:00.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.630+0000 7f03844f0700 1 Processor -- start 2020-02-11T16:27:00.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.630+0000 7f03844f0700 1 -- start start 2020-02-11T16:27:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.630+0000 7f03844f0700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f037c0a5b20 0x7f037c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.630+0000 7f03844f0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f037c131280 0x7f037c131710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.630+0000 7f03844f0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c0a4350 con 0x7f037c0a2fa0 2020-02-11T16:27:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f03844f0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c0a1e60 con 0x7f037c131280 2020-02-11T16:27:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f03844f0700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0a3450 con 0x7f037c0a5b20 2020-02-11T16:27:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f038228c700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f037c0a2fa0 legacy=0x7f037c0a5410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f037c131280 0x7f037c131710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0381a8b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f037c0a5b20 0x7f037c0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f037c131280 0x7f037c131710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45676/0 (socket says 172.21.15.88:45676) 2020-02-11T16:27:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 -- 172.21.15.88:0/1058643335 learned_addr learned my addr 172.21.15.88:0/1058643335 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 -- 172.21.15.88:0/1058643335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f037c0a5b20 msgr2=0x7f037c0a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 --2- 172.21.15.88:0/1058643335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f037c0a5b20 0x7f037c0a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 -- 172.21.15.88:0/1058643335 >> v1:172.21.15.88:6789/0 conn(0x7f037c0a2fa0 legacy=0x7f037c0a5410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 -- 172.21.15.88:0/1058643335 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0a3a40 con 0x7f037c131280 2020-02-11T16:27:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 --2- 172.21.15.88:0/1058643335 >> v2:172.21.15.52:3300/0 conn(0x7f037c131280 0x7f037c131710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f037c0a52f0 tx=0x7f0374008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 --2- 172.21.15.88:0/1058643335 >> v2:172.21.15.52:3300/0 conn(0x7f037c131280 0x7f037c131710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f037c0a52f0 tx=0x7f0374008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 --2- 172.21.15.88:0/1058643335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c131280 0x7f037c131710 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7f037c0a52f0 tx=0x7f0374008c60).ready entity=mon.0 client_cookie=fc2689439b654e70 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.631+0000 7f0382a8d700 1 --2- 172.21.15.88:0/1058643335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c131280 0x7f037c131710 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f037c0a52f0 tx=0x7f0374008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f038128a700 1 -- 172.21.15.88:0/1058643335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f037400a160 con 0x7f037c131280 2020-02-11T16:27:00.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f0382a8d700 1 --2- 172.21.15.88:0/1058643335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c131280 0x7f037c131710 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f037c0a52f0 tx=0x7f0374008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f0382a8d700 1 --2- 172.21.15.88:0/1058643335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c131280 0x7f037c131710 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f037c0a52f0 tx=0x7f0374008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f038128a700 1 -- 172.21.15.88:0/1058643335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037400a2c0 con 0x7f037c131280 2020-02-11T16:27:00.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f038128a700 1 -- 172.21.15.88:0/1058643335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f037400a660 con 0x7f037c131280 2020-02-11T16:27:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f03844f0700 1 -- 172.21.15.88:0/1058643335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c131280 msgr2=0x7f037c131710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f03844f0700 1 --2- 172.21.15.88:0/1058643335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c131280 0x7f037c131710 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7f037c0a52f0 tx=0x7f0374008c60).stop 2020-02-11T16:27:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f03844f0700 1 -- 172.21.15.88:0/1058643335 shutdown_connections 2020-02-11T16:27:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f03844f0700 1 --2- 172.21.15.88:0/1058643335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c131280 0x7f037c131710 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f03844f0700 1 --2- 172.21.15.88:0/1058643335 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f037c0a5b20 0x7f037c0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f03844f0700 1 -- 172.21.15.88:0/1058643335 >> 172.21.15.88:0/1058643335 conn(0x7f037c09d110 msgr2=0x7f037c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f03844f0700 1 -- 172.21.15.88:0/1058643335 shutdown_connections 2020-02-11T16:27:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.632+0000 7f03844f0700 1 -- 172.21.15.88:0/1058643335 wait complete. 2020-02-11T16:27:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.633+0000 7f03844f0700 1 Processor -- start 2020-02-11T16:27:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.633+0000 7f03844f0700 1 -- start start 2020-02-11T16:27:00.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f03844f0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f037c0a2fa0 0x7f037c148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f03844f0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f037c131280 0x7f037c135640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f03844f0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c1342e0 con 0x7f037c0a5b20 2020-02-11T16:27:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f03844f0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c1378c0 con 0x7f037c0a2fa0 2020-02-11T16:27:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f03844f0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c137b60 con 0x7f037c131280 2020-02-11T16:27:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f0381a8b700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f037c0a5b20 legacy=0x7f037c135d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f0382a8d700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f037c131280 msgr2=0x7f037c135640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:27:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f0382a8d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f037c131280 0x7f037c135640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f038228c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f037c0a2fa0 0x7f037c148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f038228c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f037c0a2fa0 0x7f037c148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45678/0 (socket says 172.21.15.88:45678) 2020-02-11T16:27:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f038228c700 1 -- 172.21.15.88:0/3026728544 learned_addr learned my addr 172.21.15.88:0/3026728544 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f038228c700 1 -- 172.21.15.88:0/3026728544 >> v2:172.21.15.88:3300/0 conn(0x7f037c131280 msgr2=0x7f037c135640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f038228c700 1 --2- 172.21.15.88:0/3026728544 >> v2:172.21.15.88:3300/0 conn(0x7f037c131280 0x7f037c135640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f038228c700 1 -- 172.21.15.88:0/3026728544 >> v1:172.21.15.88:6789/0 conn(0x7f037c0a5b20 legacy=0x7f037c135d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f038228c700 1 -- 172.21.15.88:0/3026728544 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c135aa0 con 0x7f037c0a2fa0 2020-02-11T16:27:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f038228c700 1 --2- 172.21.15.88:0/3026728544 >> v2:172.21.15.52:3300/0 conn(0x7f037c0a2fa0 0x7f037c148780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f037c1374c0 tx=0x7f0378010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f038228c700 1 --2- 172.21.15.88:0/3026728544 >> v2:172.21.15.52:3300/0 conn(0x7f037c0a2fa0 0x7f037c148780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f037c1374c0 tx=0x7f0378010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.634+0000 7f038228c700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a2fa0 0x7f037c148780 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f037c1374c0 tx=0x7f0378010a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f038228c700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a2fa0 0x7f037c148780 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f037c1374c0 tx=0x7f0378010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f038228c700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a2fa0 0x7f037c148780 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f037c1374c0 tx=0x7f0378010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0378008d20 con 0x7f037c0a2fa0 2020-02-11T16:27:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f038228c700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a2fa0 0x7f037c148780 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f037c1374c0 tx=0x7f0378010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0378003710 con 0x7f037c0a2fa0 2020-02-11T16:27:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f03844f0700 1 -- 172.21.15.88:0/3026728544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c1304f0 con 0x7f037c0a2fa0 2020-02-11T16:27:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0378003b30 con 0x7f037c0a2fa0 2020-02-11T16:27:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f03844f0700 1 -- 172.21.15.88:0/3026728544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c12fbc0 con 0x7f037c0a2fa0 2020-02-11T16:27:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f038228c700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a2fa0 0x7f037c148780 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f037c1374c0 tx=0x7f0378010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0378012370 con 0x7f037c0a2fa0 2020-02-11T16:27:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.635+0000 7f038228c700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a2fa0 0x7f037c148780 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f037c1374c0 tx=0x7f0378010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f03844f0700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 0x7f037c149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f03844f0700 1 -- 172.21.15.88:0/3026728544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c05e2f0 con 0x7f037c0aa8d0 2020-02-11T16:27:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f036b7fe700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f035c039c10 0x7f035c03c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f0378049490 con 0x7f037c0a2fa0 2020-02-11T16:27:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 0x7f037c149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f0382a8d700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f035c039c10 0x7f035c03c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f0381a8b700 1 -- 172.21.15.88:0/3026728544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f037c1353a0 con 0x7f037c0aa8d0 2020-02-11T16:27:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f0382a8d700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f035c039c10 0x7f035c03c0d0 crc :-1 s=READY pgs=485 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 0x7f037c149010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 0x7f037c149010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 0x7f037c149010 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 0x7f037c149010 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.636+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036c007530 con 0x7f037c0aa8d0 2020-02-11T16:27:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.637+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 0x7f037c149010 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.637+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f036c00aed0 con 0x7f037c0aa8d0 2020-02-11T16:27:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.637+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 msgr2=0x7f037c149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.637+0000 7f036b7fe700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 0x7f037c149010 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).stop 2020-02-11T16:27:00.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.637+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 msgr2=0x7f037c149010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:00.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.637+0000 7f036b7fe700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0aa8d0 0x7f037c149010 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.645+0000 7f03844f0700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 0x7f037c0a8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.645+0000 7f03844f0700 1 -- 172.21.15.88:0/3026728544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c1342e0 con 0x7f037c0a8360 2020-02-11T16:27:00.655 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.645+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 0x7f037c0a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f0381a8b700 1 -- 172.21.15.88:0/3026728544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f037c0565b0 con 0x7f037c0a8360 2020-02-11T16:27:00.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 0x7f037c0a8740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 0x7f037c0a8740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 0x7f037c0a8740 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 0x7f037c0a8740 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036c00a210 con 0x7f037c0a8360 2020-02-11T16:27:00.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f0381a8b700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 0x7f037c0a8740 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4351 (secure 0 0 0) 0x7f036c00a0a0 con 0x7f037c0a8360 2020-02-11T16:27:00.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 msgr2=0x7f037c0a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f036b7fe700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 0x7f037c0a8740 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f036c007920 tx=0x7f036c00c0c0).stop 2020-02-11T16:27:00.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f036b7fe700 1 -- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 msgr2=0x7f037c0a8740 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:00.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.646+0000 7f036b7fe700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a8360 0x7f037c0a8740 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f03844f0700 1 -- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f035c039c10 msgr2=0x7f035c03c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f03844f0700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f035c039c10 0x7f035c03c0d0 crc :-1 s=READY pgs=485 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f03844f0700 1 -- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a2fa0 msgr2=0x7f037c148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f03844f0700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a2fa0 0x7f037c148780 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f037c1374c0 tx=0x7f0378010a10).stop 2020-02-11T16:27:00.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f0382a8d700 1 -- 172.21.15.88:0/3026728544 reap_dead start 2020-02-11T16:27:00.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f0382a8d700 1 -- 172.21.15.88:0/3026728544 reap_dead start 2020-02-11T16:27:00.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f03844f0700 1 -- 172.21.15.88:0/3026728544 shutdown_connections 2020-02-11T16:27:00.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f03844f0700 1 --2- 172.21.15.88:0/3026728544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037c0a2fa0 0x7f037c148780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f03844f0700 1 -- 172.21.15.88:0/3026728544 >> 172.21.15.88:0/3026728544 conn(0x7f037c09d110 msgr2=0x7f037c05a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:00.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f03844f0700 1 -- 172.21.15.88:0/3026728544 shutdown_connections 2020-02-11T16:27:00.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.647+0000 7f03844f0700 1 -- 172.21.15.88:0/3026728544 wait complete. 2020-02-11T16:27:00.659 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:27:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:27:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 172, 2020-02-11T16:27:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:27:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:27:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:27:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:27:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:27:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:27:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:27:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:27:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:00.663 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:00.663 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:00.663 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.663 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:27:00.663 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:27:00.663 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:27:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:27:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:27:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:27:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:27:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:27:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:27:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:27:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:27:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:27:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:27:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:27:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:27:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:27:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:27:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:27:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:27:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:27:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:27:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:27:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:27:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:27:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:27:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:27:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:27:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:27:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:27:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:27:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:27:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.681 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:27:00.682 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:27:00.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.799+0000 7f54decc7700 1 Processor -- start 2020-02-11T16:27:00.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54decc7700 1 -- start start 2020-02-11T16:27:00.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54decc7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 0x7f54d80a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:00.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54decc7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:00.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54decc7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d8067160 con 0x7f54d80a2110 2020-02-11T16:27:00.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54decc7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d80a3940 con 0x7f54d809ab30 2020-02-11T16:27:00.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54decc7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d80a3be0 con 0x7f54d813c0b0 2020-02-11T16:27:00.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54dd4c4700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f54d80a2110 legacy=0x7f54d805ae60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:00.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54ddcc5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 0x7f54d80a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54de4c6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54de4c6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:54030/0 (socket says 172.21.15.88:54030) 2020-02-11T16:27:00.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54ddcc5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 0x7f54d80a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45690/0 (socket says 172.21.15.88:45690) 2020-02-11T16:27:00.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.800+0000 7f54de4c6700 1 -- 172.21.15.88:0/3030144781 learned_addr learned my addr 172.21.15.88:0/3030144781 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:00.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54de4c6700 1 -- 172.21.15.88:0/3030144781 >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 msgr2=0x7f54d80a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:00.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54de4c6700 1 --2- 172.21.15.88:0/3030144781 >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 0x7f54d80a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:00.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54de4c6700 1 -- 172.21.15.88:0/3030144781 >> v1:172.21.15.88:6789/0 conn(0x7f54d80a2110 legacy=0x7f54d805ae60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:00.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54de4c6700 1 -- 172.21.15.88:0/3030144781 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d80a3e80 con 0x7f54d813c0b0 2020-02-11T16:27:00.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/3030144781 >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 0x7f54d80a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:27:00.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54de4c6700 1 --2- 172.21.15.88:0/3030144781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f54d80ab680 tx=0x7f54d0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54de4c6700 1 --2- 172.21.15.88:0/3030144781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f54d80ab680 tx=0x7f54d0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54de4c6700 1 --2- 172.21.15.88:0/3030144781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f54d80ab680 tx=0x7f54d0008c60).ready entity=mon.2 client_cookie=fe80b2f3ecca6db9 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54de4c6700 1 --2- 172.21.15.88:0/3030144781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f54d80ab680 tx=0x7f54d0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54dccc3700 1 -- 172.21.15.88:0/3030144781 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d000a160 con 0x7f54d813c0b0 2020-02-11T16:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54de4c6700 1 --2- 172.21.15.88:0/3030144781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f54d80ab680 tx=0x7f54d0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54dccc3700 1 -- 172.21.15.88:0/3030144781 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d000a2c0 con 0x7f54d813c0b0 2020-02-11T16:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54de4c6700 1 --2- 172.21.15.88:0/3030144781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f54d80ab680 tx=0x7f54d0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54dccc3700 1 -- 172.21.15.88:0/3030144781 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d000a660 con 0x7f54d813c0b0 2020-02-11T16:27:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54decc7700 1 -- 172.21.15.88:0/3030144781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 msgr2=0x7f54d813e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.801+0000 7f54decc7700 1 --2- 172.21.15.88:0/3030144781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f54d80ab680 tx=0x7f54d0008c60).stop 2020-02-11T16:27:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.802+0000 7f54decc7700 1 -- 172.21.15.88:0/3030144781 shutdown_connections 2020-02-11T16:27:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.802+0000 7f54decc7700 1 --2- 172.21.15.88:0/3030144781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d813c0b0 0x7f54d813e4a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.802+0000 7f54decc7700 1 --2- 172.21.15.88:0/3030144781 >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 0x7f54d80a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.802+0000 7f54decc7700 1 -- 172.21.15.88:0/3030144781 >> 172.21.15.88:0/3030144781 conn(0x7f54d80aa860 msgr2=0x7f54d80aac70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.802+0000 7f54decc7700 1 -- 172.21.15.88:0/3030144781 shutdown_connections 2020-02-11T16:27:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.802+0000 7f54decc7700 1 -- 172.21.15.88:0/3030144781 wait complete. 2020-02-11T16:27:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.803+0000 7f54decc7700 1 Processor -- start 2020-02-11T16:27:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.803+0000 7f54decc7700 1 -- start start 2020-02-11T16:27:00.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.803+0000 7f54decc7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 0x7f54d809c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.803+0000 7f54decc7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d80a2110 0x7f54d8148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.803+0000 7f54decc7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54d813c0b0 0x7f54d8145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.803+0000 7f54decc7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d8148660 con 0x7f54d809ab30 2020-02-11T16:27:00.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.803+0000 7f54decc7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d8148900 con 0x7f54d813c0b0 2020-02-11T16:27:00.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.803+0000 7f54decc7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d8066600 con 0x7f54d80a2110 2020-02-11T16:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54de4c6700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f54d813c0b0 msgr2=0x7f54d8145660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54de4c6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54d813c0b0 0x7f54d8145660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54dd4c4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d80a2110 0x7f54d8148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 0x7f54d809c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54dd4c4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d80a2110 0x7f54d8148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:54036/0 (socket says 172.21.15.88:54036) 2020-02-11T16:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54dd4c4700 1 -- 172.21.15.88:0/2696952013 learned_addr learned my addr 172.21.15.88:0/2696952013 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 -- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d80a2110 msgr2=0x7f54d8148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d80a2110 0x7f54d8148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 -- 172.21.15.88:0/2696952013 >> v2:172.21.15.88:3300/0 conn(0x7f54d813c0b0 msgr2=0x7f54d8145660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/2696952013 >> v2:172.21.15.88:3300/0 conn(0x7f54d813c0b0 0x7f54d8145660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 -- 172.21.15.88:0/2696952013 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d8144f80 con 0x7f54d809ab30 2020-02-11T16:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/2696952013 >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 0x7f54d809c2c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54d4002f30 tx=0x7f54d4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/2696952013 >> v2:172.21.15.52:3300/0 conn(0x7f54d809ab30 0x7f54d809c2c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54d4002f30 tx=0x7f54d4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d809ab30 0x7f54d809c2c0 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f54d4002f30 tx=0x7f54d4010d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d809ab30 0x7f54d809c2c0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f54d4002f30 tx=0x7f54d4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d4007540 con 0x7f54d809ab30 2020-02-11T16:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d809ab30 0x7f54d809c2c0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f54d4002f30 tx=0x7f54d4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d809ab30 0x7f54d809c2c0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f54d4002f30 tx=0x7f54d4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d40059c0 con 0x7f54d809ab30 2020-02-11T16:27:00.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d4005de0 con 0x7f54d809ab30 2020-02-11T16:27:00.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54decc7700 1 -- 172.21.15.88:0/2696952013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d809c720 con 0x7f54d809ab30 2020-02-11T16:27:00.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.804+0000 7f54decc7700 1 -- 172.21.15.88:0/2696952013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d81493c0 con 0x7f54d809ab30 2020-02-11T16:27:00.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.805+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d809ab30 0x7f54d809c2c0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f54d4002f30 tx=0x7f54d4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.818 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.805+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f54d4009440 con 0x7f54d809ab30 2020-02-11T16:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.805+0000 7f54ddcc5700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d809ab30 0x7f54d809c2c0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f54d4002f30 tx=0x7f54d4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.805+0000 7f54c6ffd700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f54b8039d00 0x7f54b803c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54decc7700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 0x7f54d80a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f54d4049ae0 con 0x7f54d809ab30 2020-02-11T16:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54decc7700 1 -- 172.21.15.88:0/2696952013 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d805c630 con 0x7f54d8145ac0 2020-02-11T16:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54dd4c4700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f54b8039d00 0x7f54b803c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 0x7f54d80a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54de4c6700 1 -- 172.21.15.88:0/2696952013 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54d8066770 con 0x7f54d8145ac0 2020-02-11T16:27:00.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54dd4c4700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f54b8039d00 0x7f54b803c1c0 crc :-1 s=READY pgs=486 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 0x7f54d80a7c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d80ab620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 0x7f54d80a7c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d80ab620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 0x7f54d80a7c80 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d80ab620).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 0x7f54d80a7c80 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d80ab620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.820 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.806+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d000a560 con 0x7f54d8145ac0 2020-02-11T16:27:00.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.807+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 0x7f54d80a7c80 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d80ab620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.807+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f54d000a6c0 con 0x7f54d8145ac0 2020-02-11T16:27:00.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.807+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 msgr2=0x7f54d80a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.807+0000 7f54c6ffd700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 0x7f54d80a7c80 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d80ab620).stop 2020-02-11T16:27:00.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.807+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 msgr2=0x7f54d80a7c80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:00.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.807+0000 7f54c6ffd700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d8145ac0 0x7f54d80a7c80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.815+0000 7f54decc7700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 0x7f54d805b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:00.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.815+0000 7f54decc7700 1 -- 172.21.15.88:0/2696952013 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d8148b00 con 0x7f54d805b560 2020-02-11T16:27:00.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.815+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 0x7f54d805b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:00.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54de4c6700 1 -- 172.21.15.88:0/2696952013 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f54d809cac0 con 0x7f54d805b560 2020-02-11T16:27:00.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 0x7f54d805b970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d000a830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 0x7f54d805b970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d000a830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 0x7f54d805b970 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d000a830).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:00.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 0x7f54d805b970 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d000a830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d000f7e0 con 0x7f54d805b560 2020-02-11T16:27:00.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54de4c6700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 0x7f54d805b970 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d000a830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:00.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f54d000f940 con 0x7f54d805b560 2020-02-11T16:27:00.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 msgr2=0x7f54d805b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54c6ffd700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 0x7f54d805b970 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d000a830).stop 2020-02-11T16:27:00.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54c6ffd700 1 -- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 msgr2=0x7f54d805b970 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:00.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.816+0000 7f54c6ffd700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f54d805b560 0x7f54d805b970 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0x7f54d0008840 tx=0x7f54d000a830).stop 2020-02-11T16:27:00.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54decc7700 1 -- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f54b8039d00 msgr2=0x7f54b803c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54decc7700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f54b8039d00 0x7f54b803c1c0 crc :-1 s=READY pgs=486 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54decc7700 1 -- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d809ab30 msgr2=0x7f54d809c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:00.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54decc7700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d809ab30 0x7f54d809c2c0 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f54d4002f30 tx=0x7f54d4010d70).stop 2020-02-11T16:27:00.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54de4c6700 1 -- 172.21.15.88:0/2696952013 reap_dead start 2020-02-11T16:27:00.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54de4c6700 1 -- 172.21.15.88:0/2696952013 reap_dead start 2020-02-11T16:27:00.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54decc7700 1 -- 172.21.15.88:0/2696952013 shutdown_connections 2020-02-11T16:27:00.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54decc7700 1 --2- 172.21.15.88:0/2696952013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d809ab30 0x7f54d809c2c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:00.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54decc7700 1 -- 172.21.15.88:0/2696952013 >> 172.21.15.88:0/2696952013 conn(0x7f54d80aa860 msgr2=0x7f54d80a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:00.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54decc7700 1 -- 172.21.15.88:0/2696952013 shutdown_connections 2020-02-11T16:27:00.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:00.817+0000 7f54decc7700 1 -- 172.21.15.88:0/2696952013 wait complete. 2020-02-11T16:27:00.827 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:27:00.827 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:00.828 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:00.828 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:27:00.828 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 172, 2020-02-11T16:27:00.828 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:27:00.828 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:27:00.828 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:27:00.828 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.828 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:27:00.829 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:00.829 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:27:00.829 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:27:00.829 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:00.829 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:00.829 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:00.829 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:00.830 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:00.830 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:00.830 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.830 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:27:00.830 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:27:00.830 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:00.830 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:00.831 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:00.831 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:00.831 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:00.831 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:00.831 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.831 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:27:00.832 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:27:00.832 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:27:00.832 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:27:00.832 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:27:00.832 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:27:00.832 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:00.832 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:00.833 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:27:00.833 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:27:00.833 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:00.833 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:27:00.833 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:00.833 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:00.833 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:00.833 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:00.834 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:00.834 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:00.834 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.834 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:27:00.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.834 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:27:00.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.835 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:00.835 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:00.835 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:00.835 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:00.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.835 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:00.835 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:27:00.836 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.836 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:00.836 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:27:00.836 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.836 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.837 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.837 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:27:00.837 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:27:00.837 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:00.837 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:00.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.838 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:00.838 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:00.838 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:00.838 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:00.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.838 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:00.838 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:27:00.839 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.839 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:00.839 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:27:00.839 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.839 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.840 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.840 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:27:00.840 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:27:00.840 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:00.840 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:00.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.841 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:00.841 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:00.841 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:00.841 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:00.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.841 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:00.841 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:27:00.842 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.842 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:00.842 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:27:00.842 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:00.842 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.843 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.843 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:27:00.843 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:27:00.843 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:00.843 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:00.843 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:27:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:27:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:00.845 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:00.845 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.845 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.846 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:27:00.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.848 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:00.848 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:00.848 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:00.848 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.848 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.848 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:27:00.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.849 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:00.849 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:00.849 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:27:00.849 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.849 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.849 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:27:00.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.850 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:00.850 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:00.850 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:27:00.850 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.850 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:00.850 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:27:00.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:00.851 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:00.851 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:00.851 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:00.851 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.851 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:00.851 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:00.851 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:27:00.853 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:27:15.987 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:27:15.990 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:27:20.853 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:27:20.853 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:27:20.853 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:27:20.854 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:27:20.856 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:27:20.856 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:27:20.857 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:27:20.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.985+0000 7f5c25c88700 1 Processor -- start 2020-02-11T16:27:20.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.986+0000 7f5c25c88700 1 -- start start 2020-02-11T16:27:20.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.986+0000 7f5c25c88700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 0x7f5c20065c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:20.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.986+0000 7f5c25c88700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2009ab20 con 0x7f5c2005b270 2020-02-11T16:27:20.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.986+0000 7f5c25c88700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c200a6560 con 0x7f5c2013baa0 2020-02-11T16:27:20.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.986+0000 7f5c25c88700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c200a6800 con 0x7f5c200a5490 2020-02-11T16:27:20.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.986+0000 7f5c25487700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5c2013baa0 0x7f5c20142960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47358/0 (socket says 172.21.15.88:47358) 2020-02-11T16:27:20.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.986+0000 7f5c25487700 1 -- 172.21.15.88:0/3385905002 learned_addr learned my addr 172.21.15.88:0/3385905002 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:20.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.986+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3385905002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 0x7f5c20065c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:20.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c1f7fe700 1 -- 172.21.15.88:0/3385905002 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407715691 0 0) 0x7f5c2009ab20 con 0x7f5c2005b270 2020-02-11T16:27:20.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c1f7fe700 1 -- 172.21.15.88:0/3385905002 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c0c003230 con 0x7f5c2005b270 2020-02-11T16:27:20.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c24c86700 1 -- 172.21.15.88:0/3385905002 >> v1:172.21.15.88:6789/0 conn(0x7f5c2013baa0 legacy=0x7f5c20142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:20.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c24c86700 1 -- 172.21.15.88:0/3385905002 >> v1:172.21.15.52:6789/0 conn(0x7f5c2005b270 legacy=0x7f5c2013b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:20.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c24c86700 1 -- 172.21.15.88:0/3385905002 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2009ad80 con 0x7f5c200a5490 2020-02-11T16:27:20.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3385905002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 0x7f5c20065c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c10002f30 tx=0x7f5c100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:20.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3385905002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 0x7f5c20065c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c10002f30 tx=0x7f5c100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:20.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3385905002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 0x7f5c20065c60 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c100088e0).ready entity=mon.2 client_cookie=576efd7d91cddf0f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:20.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3385905002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 0x7f5c20065c60 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:20.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c1f7fe700 1 -- 172.21.15.88:0/3385905002 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c10008e40 con 0x7f5c200a5490 2020-02-11T16:27:20.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3385905002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 0x7f5c20065c60 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:20.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3385905002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 0x7f5c20065c60 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:20.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c1f7fe700 1 -- 172.21.15.88:0/3385905002 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c100115f0 con 0x7f5c200a5490 2020-02-11T16:27:20.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c1f7fe700 1 -- 172.21.15.88:0/3385905002 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c10011990 con 0x7f5c200a5490 2020-02-11T16:27:20.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c25c88700 1 -- 172.21.15.88:0/3385905002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 msgr2=0x7f5c20065c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:20.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.987+0000 7f5c25c88700 1 --2- 172.21.15.88:0/3385905002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 0x7f5c20065c60 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c100088e0).stop 2020-02-11T16:27:20.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.988+0000 7f5c25c88700 1 -- 172.21.15.88:0/3385905002 shutdown_connections 2020-02-11T16:27:20.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.988+0000 7f5c25c88700 1 --2- 172.21.15.88:0/3385905002 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c200a5490 0x7f5c20065c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:20.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.988+0000 7f5c25c88700 1 -- 172.21.15.88:0/3385905002 >> 172.21.15.88:0/3385905002 conn(0x7f5c200aa840 msgr2=0x7f5c200aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:20.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.988+0000 7f5c25c88700 1 -- 172.21.15.88:0/3385905002 shutdown_connections 2020-02-11T16:27:20.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.988+0000 7f5c25c88700 1 -- 172.21.15.88:0/3385905002 wait complete. 2020-02-11T16:27:20.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.988+0000 7f5c25c88700 1 Processor -- start 2020-02-11T16:27:20.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.988+0000 7f5c25c88700 1 -- start start 2020-02-11T16:27:20.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.989+0000 7f5c25c88700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:20.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.989+0000 7f5c25c88700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5c2013baa0 0x7f5c2009ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:20.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.989+0000 7f5c25c88700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c200a0d30 con 0x7f5c200a5490 2020-02-11T16:27:20.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.989+0000 7f5c25c88700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c200a37b0 con 0x7f5c2013baa0 2020-02-11T16:27:20.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.989+0000 7f5c25c88700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2013dcd0 con 0x7f5c2005b270 2020-02-11T16:27:20.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.989+0000 7f5c1ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5c200a5490 0x7f5c20135380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47362/0 (socket says 172.21.15.88:47362) 2020-02-11T16:27:20.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.989+0000 7f5c1ffff700 1 -- 172.21.15.88:0/3058774112 learned_addr learned my addr 172.21.15.88:0/3058774112 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:21.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.989+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:21.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.989+0000 7f5c25487700 1 --2- 172.21.15.88:0/3058774112 >> v2:172.21.15.52:3300/0 conn(0x7f5c2013baa0 0x7f5c2009ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:21.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c24c86700 1 -- 172.21.15.88:0/3058774112 >> v2:172.21.15.52:3300/0 conn(0x7f5c2013baa0 msgr2=0x7f5c2009ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:21.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> v2:172.21.15.52:3300/0 conn(0x7f5c2013baa0 0x7f5c2009ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:21.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c24c86700 1 -- 172.21.15.88:0/3058774112 >> v1:172.21.15.88:6789/0 conn(0x7f5c200a5490 legacy=0x7f5c20135380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:21.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c24c86700 1 -- 172.21.15.88:0/3058774112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c200a1560 con 0x7f5c2005b270 2020-02-11T16:27:21.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c25487700 1 --2- 172.21.15.88:0/3058774112 >> v2:172.21.15.52:3300/0 conn(0x7f5c2013baa0 0x7f5c2009ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:27:21.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:21.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:21.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:21.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:21.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c1dffb700 1 -- 172.21.15.88:0/3058774112 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c10011980 con 0x7f5c2005b270 2020-02-11T16:27:21.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:21.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:21.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c1dffb700 1 -- 172.21.15.88:0/3058774112 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c10007150 con 0x7f5c2005b270 2020-02-11T16:27:21.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c25c88700 1 -- 172.21.15.88:0/3058774112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c200a05f0 con 0x7f5c2005b270 2020-02-11T16:27:21.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c1dffb700 1 -- 172.21.15.88:0/3058774112 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c10007530 con 0x7f5c2005b270 2020-02-11T16:27:21.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.990+0000 7f5c25c88700 1 -- 172.21.15.88:0/3058774112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2009e650 con 0x7f5c2005b270 2020-02-11T16:27:21.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.991+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:21.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.991+0000 7f5c1dffb700 1 -- 172.21.15.88:0/3058774112 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5c100056c0 con 0x7f5c2005b270 2020-02-11T16:27:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.991+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.991+0000 7f5c25c88700 1 -- 172.21.15.88:0/3058774112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c200a4ba0 con 0x7f5c2005b270 2020-02-11T16:27:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.991+0000 7f5c1dffb700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5c00039bf0 0x7f5c0003c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.991+0000 7f5c1dffb700 1 -- 172.21.15.88:0/3058774112 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5c1004a020 con 0x7f5c2005b270 2020-02-11T16:27:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.991+0000 7f5c1ffff700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5c00039bf0 0x7f5c0003c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.992+0000 7f5c1ffff700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5c00039bf0 0x7f5c0003c0b0 crc :-1 s=READY pgs=488 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:21.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.995+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:21.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:20.995+0000 7f5c1dffb700 1 -- 172.21.15.88:0/3058774112 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f5c10032550 con 0x7f5c2005b270 2020-02-11T16:27:21.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.223+0000 7f5c25c88700 1 -- 172.21.15.88:0/3058774112 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5c200565b0 con 0x7f5c2005b270 2020-02-11T16:27:21.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.223+0000 7f5c24c86700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:21.225 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.223+0000 7f5c1dffb700 1 -- 172.21.15.88:0/3058774112 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f5c10032110 con 0x7f5c2005b270 2020-02-11T16:27:21.225 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":172,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:21.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 -- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5c00039bf0 msgr2=0x7f5c0003c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:21.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5c00039bf0 0x7f5c0003c0b0 crc :-1 s=READY pgs=488 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:21.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 -- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 msgr2=0x7f5c2009e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:21.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f5c10002f30 tx=0x7f5c200ab4c0).stop 2020-02-11T16:27:21.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 -- 172.21.15.88:0/3058774112 shutdown_connections 2020-02-11T16:27:21.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5c00039bf0 0x7f5c0003c0b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:21.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 --2- 172.21.15.88:0/3058774112 >> v2:172.21.15.52:3300/0 conn(0x7f5c2013baa0 0x7f5c2009ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:21.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 --2- 172.21.15.88:0/3058774112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5c2005b270 0x7f5c2009e8f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:21.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 -- 172.21.15.88:0/3058774112 >> 172.21.15.88:0/3058774112 conn(0x7f5c200aa840 msgr2=0x7f5c20065c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:21.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 -- 172.21.15.88:0/3058774112 shutdown_connections 2020-02-11T16:27:21.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:21.225+0000 7f5c25c88700 1 -- 172.21.15.88:0/3058774112 wait complete. 2020-02-11T16:27:21.240 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":172,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:24.242 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:27:24.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.357+0000 7f0542246700 1 Processor -- start 2020-02-11T16:27:24.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.357+0000 7f0542246700 1 -- start start 2020-02-11T16:27:24.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f0542246700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f053c0a7120 0x7f053c0a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:24.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f0542246700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f053c0a39e0 0x7f053c0a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:24.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f0542246700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c0a5320 con 0x7f053c12f890 2020-02-11T16:27:24.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f0542246700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c09e7a0 con 0x7f053c0a39e0 2020-02-11T16:27:24.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f0542246700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c1303f0 con 0x7f053c0a7120 2020-02-11T16:27:24.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f053c0a7120 0x7f053c0a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f053c0a7120 0x7f053c0a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59754/0 (socket says 172.21.15.88:59754) 2020-02-11T16:27:24.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053b7fe700 1 -- 172.21.15.88:0/2427890432 learned_addr learned my addr 172.21.15.88:0/2427890432 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:24.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053b7fe700 1 -- 172.21.15.88:0/2427890432 >> v2:172.21.15.88:3300/0 conn(0x7f053c0a7120 msgr2=0x7f053c0a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:27:24.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053b7fe700 1 -- 172.21.15.88:0/2427890432 >> v2:172.21.15.88:3300/0 conn(0x7f053c0a7120 msgr2=0x7f053c0a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:24.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053b7fe700 1 --2- 172.21.15.88:0/2427890432 >> v2:172.21.15.88:3300/0 conn(0x7f053c0a7120 0x7f053c0a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:24.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053b7fe700 1 --2- 172.21.15.88:0/2427890432 >> v2:172.21.15.88:3300/0 conn(0x7f053c0a7120 0x7f053c0a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:24.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053affd700 1 --2- 172.21.15.88:0/2427890432 >> v2:172.21.15.52:3300/0 conn(0x7f053c0a39e0 0x7f053c0a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053affd700 1 -- 172.21.15.88:0/2427890432 >> v2:172.21.15.88:3300/0 conn(0x7f053c0a7120 msgr2=0x7f053c0a4ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:24.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053affd700 1 --2- 172.21.15.88:0/2427890432 >> v2:172.21.15.88:3300/0 conn(0x7f053c0a7120 0x7f053c0a4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:24.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053affd700 1 -- 172.21.15.88:0/2427890432 >> v1:172.21.15.52:6789/0 conn(0x7f053c12f890 legacy=0x7f053c12fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053affd700 1 -- 172.21.15.88:0/2427890432 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c0a5560 con 0x7f053c0a39e0 2020-02-11T16:27:24.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.358+0000 7f053affd700 1 --2- 172.21.15.88:0/2427890432 >> v2:172.21.15.52:3300/0 conn(0x7f053c0a39e0 0x7f053c0a3e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0530002f30 tx=0x7f0530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f053affd700 1 --2- 172.21.15.88:0/2427890432 >> v2:172.21.15.52:3300/0 conn(0x7f053c0a39e0 0x7f053c0a3e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0530002f30 tx=0x7f0530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f053affd700 1 --2- 172.21.15.88:0/2427890432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a3e70 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f0530002f30 tx=0x7f0530007a40).ready entity=mon.0 client_cookie=701dac1a17a6c8c3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f053affd700 1 --2- 172.21.15.88:0/2427890432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a3e70 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f0530002f30 tx=0x7f0530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f053a7fc700 1 -- 172.21.15.88:0/2427890432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0530011470 con 0x7f053c0a39e0 2020-02-11T16:27:24.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f053affd700 1 --2- 172.21.15.88:0/2427890432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a3e70 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f0530002f30 tx=0x7f0530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f053a7fc700 1 -- 172.21.15.88:0/2427890432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05300115d0 con 0x7f053c0a39e0 2020-02-11T16:27:24.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f053affd700 1 --2- 172.21.15.88:0/2427890432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a3e70 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f0530002f30 tx=0x7f0530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f053a7fc700 1 -- 172.21.15.88:0/2427890432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05300119b0 con 0x7f053c0a39e0 2020-02-11T16:27:24.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f0542246700 1 -- 172.21.15.88:0/2427890432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 msgr2=0x7f053c0a3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f0542246700 1 --2- 172.21.15.88:0/2427890432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a3e70 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f0530002f30 tx=0x7f0530007a40).stop 2020-02-11T16:27:24.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f0542246700 1 -- 172.21.15.88:0/2427890432 shutdown_connections 2020-02-11T16:27:24.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f0542246700 1 --2- 172.21.15.88:0/2427890432 >> v2:172.21.15.88:3300/0 conn(0x7f053c0a7120 0x7f053c0a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:24.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f0542246700 1 --2- 172.21.15.88:0/2427890432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a3e70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f0542246700 1 -- 172.21.15.88:0/2427890432 >> 172.21.15.88:0/2427890432 conn(0x7f053c09d110 msgr2=0x7f053c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:24.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f0542246700 1 -- 172.21.15.88:0/2427890432 shutdown_connections 2020-02-11T16:27:24.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.359+0000 7f0542246700 1 -- 172.21.15.88:0/2427890432 wait complete. 2020-02-11T16:27:24.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.360+0000 7f0542246700 1 Processor -- start 2020-02-11T16:27:24.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f0542246700 1 -- start start 2020-02-11T16:27:24.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f0542246700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f053c0a39e0 0x7f053c0a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f0542246700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f053c0a7120 0x7f053c130fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f0542246700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f053c12f890 0x7f053c1273b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f0542246700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c12c120 con 0x7f053c0a39e0 2020-02-11T16:27:24.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f0542246700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c066ad0 con 0x7f053c12f890 2020-02-11T16:27:24.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f0542246700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c066d70 con 0x7f053c0a7120 2020-02-11T16:27:24.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f053bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f053c12f890 0x7f053c1273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f053bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f053c12f890 0x7f053c1273b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59764/0 (socket says 172.21.15.88:59764) 2020-02-11T16:27:24.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f053bfff700 1 -- 172.21.15.88:0/4293839160 learned_addr learned my addr 172.21.15.88:0/4293839160 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:24.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> v2:172.21.15.52:3300/0 conn(0x7f053c0a39e0 0x7f053c0a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f053affd700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f053c0a7120 0x7f053c130fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f053bfff700 1 -- 172.21.15.88:0/4293839160 >> v2:172.21.15.88:3300/0 conn(0x7f053c12f890 msgr2=0x7f053c1273b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:27:24.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f053bfff700 1 -- 172.21.15.88:0/4293839160 >> v2:172.21.15.88:3300/0 conn(0x7f053c12f890 msgr2=0x7f053c1273b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:27:24.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f053bfff700 1 --2- 172.21.15.88:0/4293839160 >> v2:172.21.15.88:3300/0 conn(0x7f053c12f890 0x7f053c1273b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.361+0000 7f053bfff700 1 --2- 172.21.15.88:0/4293839160 >> v2:172.21.15.88:3300/0 conn(0x7f053c12f890 0x7f053c1273b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 -- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f053c0a7120 msgr2=0x7f053c130fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f053c0a7120 0x7f053c130fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 -- 172.21.15.88:0/4293839160 >> v2:172.21.15.88:3300/0 conn(0x7f053c12f890 msgr2=0x7f053c1273b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> v2:172.21.15.88:3300/0 conn(0x7f053c12f890 0x7f053c1273b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 -- 172.21.15.88:0/4293839160 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c067010 con 0x7f053c0a39e0 2020-02-11T16:27:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> v2:172.21.15.52:3300/0 conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> v2:172.21.15.52:3300/0 conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f0538ff9700 1 -- 172.21.15.88:0/4293839160 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f052c005e90 con 0x7f053c0a39e0 2020-02-11T16:27:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f0538ff9700 1 -- 172.21.15.88:0/4293839160 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c007160 con 0x7f053c0a39e0 2020-02-11T16:27:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f0542246700 1 -- 172.21.15.88:0/4293839160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c12b7d0 con 0x7f053c0a39e0 2020-02-11T16:27:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f0538ff9700 1 -- 172.21.15.88:0/4293839160 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f052c007540 con 0x7f053c0a39e0 2020-02-11T16:27:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.362+0000 7f0542246700 1 -- 172.21.15.88:0/4293839160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c1279d0 con 0x7f053c0a39e0 2020-02-11T16:27:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.363+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.363+0000 7f0538ff9700 1 -- 172.21.15.88:0/4293839160 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f052c012220 con 0x7f053c0a39e0 2020-02-11T16:27:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.363+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.363+0000 7f0542246700 1 -- 172.21.15.88:0/4293839160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c067210 con 0x7f053c0a39e0 2020-02-11T16:27:24.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.363+0000 7f0538ff9700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f051c039c40 0x7f051c03c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.363+0000 7f0538ff9700 1 -- 172.21.15.88:0/4293839160 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f052c049da0 con 0x7f053c0a39e0 2020-02-11T16:27:24.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.363+0000 7f053affd700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f051c039c40 0x7f051c03c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.364+0000 7f053affd700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f051c039c40 0x7f051c03c100 crc :-1 s=READY pgs=489 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.367+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.367+0000 7f0538ff9700 1 -- 172.21.15.88:0/4293839160 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f053c067210 con 0x7f053c0a39e0 2020-02-11T16:27:24.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.608+0000 7f0542246700 1 -- 172.21.15.88:0/4293839160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f053c067210 con 0x7f053c0a39e0 2020-02-11T16:27:24.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.609+0000 7f053b7fe700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.609+0000 7f0538ff9700 1 -- 172.21.15.88:0/4293839160 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f052c00a510 con 0x7f053c0a39e0 2020-02-11T16:27:24.611 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":174,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:24.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 -- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f051c039c40 msgr2=0x7f051c03c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f051c039c40 0x7f051c03c100 crc :-1 s=READY pgs=489 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 -- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 msgr2=0x7f053c0a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a1730 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f052c002f30 tx=0x7f052c010b80).stop 2020-02-11T16:27:24.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 -- 172.21.15.88:0/4293839160 shutdown_connections 2020-02-11T16:27:24.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 --2- 172.21.15.88:0/4293839160 >> v2:172.21.15.88:3300/0 conn(0x7f053c12f890 0x7f053c1273b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f051c039c40 0x7f051c03c100 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f053c0a39e0 0x7f053c0a1730 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 --2- 172.21.15.88:0/4293839160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f053c0a7120 0x7f053c130fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 -- 172.21.15.88:0/4293839160 >> 172.21.15.88:0/4293839160 conn(0x7f053c09d110 msgr2=0x7f053c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:24.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 -- 172.21.15.88:0/4293839160 shutdown_connections 2020-02-11T16:27:24.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.611+0000 7f0542246700 1 -- 172.21.15.88:0/4293839160 wait complete. 2020-02-11T16:27:24.623 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":174,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:24.623 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:27:24.624 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:27:24.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.745+0000 7f2cd88e3700 1 Processor -- start 2020-02-11T16:27:24.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.745+0000 7f2cd88e3700 1 -- start start 2020-02-11T16:27:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.746+0000 7f2cd88e3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2cd40a9130 0x7f2cd41314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.746+0000 7f2cd88e3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd40adb40 con 0x7f2cd4131920 2020-02-11T16:27:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.746+0000 7f2cd88e3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd4137de0 con 0x7f2cd40ad380 2020-02-11T16:27:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.746+0000 7f2cd88e3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd4137bf0 con 0x7f2cd40a9130 2020-02-11T16:27:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.746+0000 7f2cd259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2cd40ad380 0x7f2cd4138280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47394/0 (socket says 172.21.15.88:47394) 2020-02-11T16:27:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.746+0000 7f2cd259c700 1 -- 172.21.15.88:0/410091719 learned_addr learned my addr 172.21.15.88:0/410091719 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.747+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/410091719 >> v2:172.21.15.52:3300/0 conn(0x7f2cd40a9130 0x7f2cd41314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.747+0000 7f2ccbfff700 1 -- 172.21.15.88:0/410091719 >> v1:172.21.15.88:6789/0 conn(0x7f2cd40ad380 legacy=0x7f2cd4138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.747+0000 7f2ccbfff700 1 -- 172.21.15.88:0/410091719 >> v1:172.21.15.52:6789/0 conn(0x7f2cd4131920 legacy=0x7f2cd4131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.747+0000 7f2ccbfff700 1 -- 172.21.15.88:0/410091719 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40a95c0 con 0x7f2cd40a9130 2020-02-11T16:27:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.747+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/410091719 >> v2:172.21.15.52:3300/0 conn(0x7f2cd40a9130 0x7f2cd41314c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2cbc002f30 tx=0x7f2cbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.747+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/410091719 >> v2:172.21.15.52:3300/0 conn(0x7f2cd40a9130 0x7f2cd41314c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2cbc002f30 tx=0x7f2cbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.747+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/410091719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cd40a9130 0x7f2cd41314c0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cbc0088e0).ready entity=mon.0 client_cookie=b45d5ffbeb1e790b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/410091719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cd40a9130 0x7f2cd41314c0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/410091719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cd40a9130 0x7f2cd41314c0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2cd1d9b700 1 -- 172.21.15.88:0/410091719 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cbc008e40 con 0x7f2cd40a9130 2020-02-11T16:27:24.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/410091719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cd40a9130 0x7f2cd41314c0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cbc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2cd1d9b700 1 -- 172.21.15.88:0/410091719 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc0116a0 con 0x7f2cd40a9130 2020-02-11T16:27:24.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2cd1d9b700 1 -- 172.21.15.88:0/410091719 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cbc011ac0 con 0x7f2cd40a9130 2020-02-11T16:27:24.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2cd88e3700 1 -- 172.21.15.88:0/410091719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cd40a9130 msgr2=0x7f2cd41314c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2cd88e3700 1 --2- 172.21.15.88:0/410091719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cd40a9130 0x7f2cd41314c0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cbc0088e0).stop 2020-02-11T16:27:24.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2cd88e3700 1 -- 172.21.15.88:0/410091719 shutdown_connections 2020-02-11T16:27:24.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2cd88e3700 1 --2- 172.21.15.88:0/410091719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cd40a9130 0x7f2cd41314c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2cd88e3700 1 -- 172.21.15.88:0/410091719 >> 172.21.15.88:0/410091719 conn(0x7f2cd405ac70 msgr2=0x7f2cd40ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:24.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2cd88e3700 1 -- 172.21.15.88:0/410091719 shutdown_connections 2020-02-11T16:27:24.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.748+0000 7f2cd88e3700 1 -- 172.21.15.88:0/410091719 wait complete. 2020-02-11T16:27:24.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.749+0000 7f2cd88e3700 1 Processor -- start 2020-02-11T16:27:24.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.749+0000 7f2cd88e3700 1 -- start start 2020-02-11T16:27:24.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2cd88e3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2cd88e3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd4132cf0 con 0x7f2cd4131920 2020-02-11T16:27:24.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2cd88e3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd4134210 con 0x7f2cd40a9130 2020-02-11T16:27:24.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2cd88e3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd41344b0 con 0x7f2cd40ad380 2020-02-11T16:27:24.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2cd259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2cd40a9130 0x7f2cd4134950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47400/0 (socket says 172.21.15.88:47400) 2020-02-11T16:27:24.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2cd259c700 1 -- 172.21.15.88:0/1377913216 learned_addr learned my addr 172.21.15.88:0/1377913216 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:24.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231701371 0 0) 0x7f2cd4132cf0 con 0x7f2cd4131920 2020-02-11T16:27:24.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cb8002fe0 con 0x7f2cd4131920 2020-02-11T16:27:24.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2ccbfff700 1 -- 172.21.15.88:0/1377913216 >> v1:172.21.15.88:6789/0 conn(0x7f2cd40a9130 legacy=0x7f2cd4134950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2ccbfff700 1 -- 172.21.15.88:0/1377913216 >> v1:172.21.15.52:6789/0 conn(0x7f2cd4131920 legacy=0x7f2cd41296b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.750+0000 7f2ccbfff700 1 -- 172.21.15.88:0/1377913216 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd41329d0 con 0x7f2cd40ad380 2020-02-11T16:27:24.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cd40a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cd40a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cd40a9750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cd40a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cbc007150 con 0x7f2cd40ad380 2020-02-11T16:27:24.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cd40a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc0072b0 con 0x7f2cd40ad380 2020-02-11T16:27:24.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2cd88e3700 1 -- 172.21.15.88:0/1377913216 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd412a690 con 0x7f2cd40ad380 2020-02-11T16:27:24.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cd40a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cbc0056c0 con 0x7f2cd40ad380 2020-02-11T16:27:24.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2cd88e3700 1 -- 172.21.15.88:0/1377913216 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd41352a0 con 0x7f2cd40ad380 2020-02-11T16:27:24.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.751+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cd40a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2cbc0058c0 con 0x7f2cd40ad380 2020-02-11T16:27:24.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2ccbfff700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cd40a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2ccb7fe700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cb8039f60 0x7f2cb803c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f2cbc04a0e0 con 0x7f2cd40ad380 2020-02-11T16:27:24.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2cd88e3700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 0x7f2cd405e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2cd88e3700 1 -- 172.21.15.88:0/1377913216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd405e2f0 con 0x7f2cd4129dc0 2020-02-11T16:27:24.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2cd259c700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cb8039f60 0x7f2cb803c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 0x7f2cd405e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2cd259c700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cb8039f60 0x7f2cb803c420 crc :-1 s=READY pgs=490 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2cd2d9d700 1 -- 172.21.15.88:0/1377913216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2cd4133db0 con 0x7f2cd4129dc0 2020-02-11T16:27:24.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.752+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 0x7f2cd405e9d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.753+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 0x7f2cd405e9d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.753+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 0x7f2cd405e9d0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.753+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 0x7f2cd405e9d0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.753+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ccc0123b0 con 0x7f2cd4129dc0 2020-02-11T16:27:24.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.753+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 0x7f2cd405e9d0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.753+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f2ccc012510 con 0x7f2cd4129dc0 2020-02-11T16:27:24.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.753+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 msgr2=0x7f2cd405e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.753+0000 7f2ccb7fe700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 0x7f2cd405e9d0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).stop 2020-02-11T16:27:24.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.753+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 msgr2=0x7f2cd405e9d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:24.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.753+0000 7f2ccb7fe700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd4129dc0 0x7f2cd405e9d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.765+0000 7f2cd88e3700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 0x7f2cd4135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.765+0000 7f2cd88e3700 1 -- 172.21.15.88:0/1377913216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd412a1a0 con 0x7f2cd405ee30 2020-02-11T16:27:24.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.765+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 0x7f2cd4135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.765+0000 7f2cd2d9d700 1 -- 172.21.15.88:0/1377913216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2cd40565b0 con 0x7f2cd405ee30 2020-02-11T16:27:24.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.765+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 0x7f2cd4135b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.765+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 0x7f2cd4135b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.765+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 0x7f2cd4135b60 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 0x7f2cd4135b60 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ccc006c60 con 0x7f2cd405ee30 2020-02-11T16:27:24.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd2d9d700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 0x7f2cd4135b60 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f2ccc006dc0 con 0x7f2cd405ee30 2020-02-11T16:27:24.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 msgr2=0x7f2cd4135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2ccb7fe700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 0x7f2cd4135b60 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f2ccc001360 tx=0x7f2ccc00c810).stop 2020-02-11T16:27:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2ccb7fe700 1 -- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 msgr2=0x7f2cd4135b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2ccb7fe700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd405ee30 0x7f2cd4135b60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd88e3700 1 -- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cb8039f60 msgr2=0x7f2cb803c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd88e3700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2cb8039f60 0x7f2cb803c420 crc :-1 s=READY pgs=490 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd88e3700 1 -- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 msgr2=0x7f2cd4132570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd88e3700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f2cbc002f30 tx=0x7f2cd40a9750).stop 2020-02-11T16:27:24.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd2d9d700 1 -- 172.21.15.88:0/1377913216 reap_dead start 2020-02-11T16:27:24.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd88e3700 1 -- 172.21.15.88:0/1377913216 shutdown_connections 2020-02-11T16:27:24.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd88e3700 1 --2- 172.21.15.88:0/1377913216 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2cd40ad380 0x7f2cd4132570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd88e3700 1 -- 172.21.15.88:0/1377913216 >> 172.21.15.88:0/1377913216 conn(0x7f2cd405ac70 msgr2=0x7f2cd4130cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:24.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd88e3700 1 -- 172.21.15.88:0/1377913216 shutdown_connections 2020-02-11T16:27:24.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.766+0000 7f2cd88e3700 1 -- 172.21.15.88:0/1377913216 wait complete. 2020-02-11T16:27:24.778 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:27:24.778 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:24.779 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:24.779 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:27:24.779 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 174, 2020-02-11T16:27:24.779 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:27:24.779 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:27:24.779 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:27:24.779 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:27:24.780 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.781 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:27:24.781 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:24.781 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:27:24.781 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:27:24.781 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:24.782 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:24.782 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:24.782 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:24.782 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:24.782 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:24.783 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.783 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:27:24.783 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:27:24.783 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:24.783 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:24.784 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:24.784 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:24.784 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:24.784 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:24.784 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.784 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:27:24.784 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:27:24.785 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:27:24.785 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:27:24.785 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:27:24.785 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:27:24.785 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:24.785 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:24.786 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:27:24.786 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:27:24.786 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:24.786 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:27:24.786 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:24.786 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:24.786 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:24.787 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:24.787 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:24.787 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:24.787 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.787 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:27:24.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.787 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:27:24.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.788 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:24.788 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:24.788 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:24.788 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:24.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.788 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:24.788 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:27:24.789 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.789 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:24.789 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:27:24.789 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.790 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.790 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.790 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:27:24.790 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:27:24.790 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:24.790 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:24.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.791 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:24.791 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:24.791 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:24.791 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:24.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.792 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:24.792 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:27:24.792 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.792 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:24.792 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:27:24.793 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.793 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.793 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.793 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:27:24.793 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:27:24.794 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:24.794 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:24.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.794 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:24.794 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:24.794 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:24.795 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:24.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.795 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:24.795 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:27:24.795 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.795 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:24.796 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:27:24.796 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.796 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.796 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.796 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:27:24.796 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:27:24.797 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:24.797 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:24.797 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.797 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.797 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:27:24.797 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:27:24.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.798 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:24.798 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:24.798 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:24.798 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.798 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.799 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:27:24.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.799 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:24.799 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:24.799 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:24.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.799 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.800 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:27:24.801 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:27:24.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.941+0000 7f4406011700 1 Processor -- start 2020-02-11T16:27:24.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.941+0000 7f4406011700 1 -- start start 2020-02-11T16:27:24.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.942+0000 7f4406011700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f44000a18a0 0x7f44000a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:24.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.942+0000 7f4406011700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44000a5de0 0x7f44000a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:24.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.942+0000 7f4406011700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44000a31b0 con 0x7f440012e3a0 2020-02-11T16:27:24.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.942+0000 7f4406011700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44000a3570 con 0x7f44000a5de0 2020-02-11T16:27:24.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.942+0000 7f4406011700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44000a3810 con 0x7f44000a18a0 2020-02-11T16:27:24.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.942+0000 7f43ff7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f44000a18a0 0x7f44000a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.942+0000 7f43ff7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f44000a18a0 0x7f44000a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59786/0 (socket says 172.21.15.88:59786) 2020-02-11T16:27:24.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.942+0000 7f43ff7fe700 1 -- 172.21.15.88:0/1637966226 learned_addr learned my addr 172.21.15.88:0/1637966226 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:24.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.942+0000 7f43feffd700 1 --2- 172.21.15.88:0/1637966226 >> v2:172.21.15.52:3300/0 conn(0x7f44000a5de0 0x7f44000a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43ff7fe700 1 -- 172.21.15.88:0/1637966226 >> v2:172.21.15.52:3300/0 conn(0x7f44000a5de0 msgr2=0x7f44000a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:24.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/1637966226 >> v2:172.21.15.52:3300/0 conn(0x7f44000a5de0 0x7f44000a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:24.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43ff7fe700 1 -- 172.21.15.88:0/1637966226 >> v1:172.21.15.52:6789/0 conn(0x7f440012e3a0 legacy=0x7f440012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43ff7fe700 1 -- 172.21.15.88:0/1637966226 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44000a3ab0 con 0x7f44000a18a0 2020-02-11T16:27:24.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/1637966226 >> v2:172.21.15.88:3300/0 conn(0x7f44000a18a0 0x7f44000a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/1637966226 >> v2:172.21.15.88:3300/0 conn(0x7f44000a18a0 0x7f44000a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/1637966226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f44000a6dd0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).ready entity=mon.1 client_cookie=8136563a27d6ead9 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/1637966226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f44000a6dd0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43fe7fc700 1 -- 172.21.15.88:0/1637966226 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f0011670 con 0x7f44000a18a0 2020-02-11T16:27:24.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/1637966226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f44000a6dd0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/1637966226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f44000a6dd0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43fe7fc700 1 -- 172.21.15.88:0/1637966226 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f00117d0 con 0x7f44000a18a0 2020-02-11T16:27:24.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f43fe7fc700 1 -- 172.21.15.88:0/1637966226 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f0011bb0 con 0x7f44000a18a0 2020-02-11T16:27:24.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f4406011700 1 -- 172.21.15.88:0/1637966226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 msgr2=0x7f44000a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f4406011700 1 --2- 172.21.15.88:0/1637966226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f44000a6dd0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).stop 2020-02-11T16:27:24.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f4406011700 1 -- 172.21.15.88:0/1637966226 shutdown_connections 2020-02-11T16:27:24.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f4406011700 1 --2- 172.21.15.88:0/1637966226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f44000a6dd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f4406011700 1 --2- 172.21.15.88:0/1637966226 >> v2:172.21.15.52:3300/0 conn(0x7f44000a5de0 0x7f44000a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:24.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f4406011700 1 -- 172.21.15.88:0/1637966226 >> 172.21.15.88:0/1637966226 conn(0x7f440009d110 msgr2=0x7f440009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:24.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f4406011700 1 -- 172.21.15.88:0/1637966226 shutdown_connections 2020-02-11T16:27:24.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.943+0000 7f4406011700 1 -- 172.21.15.88:0/1637966226 wait complete. 2020-02-11T16:27:24.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.944+0000 7f4406011700 1 Processor -- start 2020-02-11T16:27:24.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.945+0000 7f4406011700 1 -- start start 2020-02-11T16:27:24.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.945+0000 7f4406011700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f44000a18a0 0x7f440012d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.945+0000 7f4406011700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f440012e3a0 0x7f44001304b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.945+0000 7f4406011700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440012fd70 con 0x7f44000a5de0 2020-02-11T16:27:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.945+0000 7f4406011700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440012fb80 con 0x7f440012e3a0 2020-02-11T16:27:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.945+0000 7f4406011700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4400130010 con 0x7f44000a18a0 2020-02-11T16:27:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.945+0000 7f43ff7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f44000a18a0 0x7f440012d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.945+0000 7f43feffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f44000a5de0 0x7f44001340a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47420/0 (socket says 172.21.15.88:47420) 2020-02-11T16:27:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.945+0000 7f43ff7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f44000a18a0 0x7f440012d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59792/0 (socket says 172.21.15.88:59792) 2020-02-11T16:27:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.945+0000 7f43feffd700 1 -- 172.21.15.88:0/3499655467 learned_addr learned my addr 172.21.15.88:0/3499655467 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43fffff700 1 --2- 172.21.15.88:0/3499655467 >> v2:172.21.15.52:3300/0 conn(0x7f440012e3a0 0x7f44001304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43ff7fe700 1 -- 172.21.15.88:0/3499655467 >> v2:172.21.15.52:3300/0 conn(0x7f440012e3a0 msgr2=0x7f44001304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/3499655467 >> v2:172.21.15.52:3300/0 conn(0x7f440012e3a0 0x7f44001304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43ff7fe700 1 -- 172.21.15.88:0/3499655467 >> v1:172.21.15.88:6789/0 conn(0x7f44000a5de0 legacy=0x7f44001340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209615335 0 0) 0x7f440012fd70 con 0x7f44000a5de0 2020-02-11T16:27:24.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43ff7fe700 1 -- 172.21.15.88:0/3499655467 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440012d550 con 0x7f44000a18a0 2020-02-11T16:27:24.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43fffff700 1 --2- 172.21.15.88:0/3499655467 >> v2:172.21.15.52:3300/0 conn(0x7f440012e3a0 0x7f44001304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:27:24.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/3499655467 >> v2:172.21.15.88:3300/0 conn(0x7f44000a18a0 0x7f440012d0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/3499655467 >> v2:172.21.15.88:3300/0 conn(0x7f44000a18a0 0x7f440012d0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f440012d0f0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f440012d0f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f0011e20 con 0x7f44000a18a0 2020-02-11T16:27:24.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f440012d0f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f440012d0f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f0007340 con 0x7f44000a18a0 2020-02-11T16:27:24.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f00056c0 con 0x7f44000a18a0 2020-02-11T16:27:24.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f4406011700 1 -- 172.21.15.88:0/3499655467 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44001315e0 con 0x7f44000a18a0 2020-02-11T16:27:24.960 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.946+0000 7f4406011700 1 -- 172.21.15.88:0/3499655467 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440012de40 con 0x7f44000a18a0 2020-02-11T16:27:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f440012d0f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f4406011700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 0x7f440012bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f4406011700 1 -- 172.21.15.88:0/3499655467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440005e2f0 con 0x7f44000a4990 2020-02-11T16:27:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f43f00058f0 con 0x7f44000a18a0 2020-02-11T16:27:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f43ff7fe700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f440012d0f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 0x7f440012bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f43fcff9700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43e0039a40 0x7f43e003bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f43f0049f50 con 0x7f44000a18a0 2020-02-11T16:27:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f43fffff700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43e0039a40 0x7f43e003bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f43feffd700 1 -- 172.21.15.88:0/3499655467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44000565b0 con 0x7f44000a4990 2020-02-11T16:27:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.947+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 0x7f440012bf70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 0x7f440012bf70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 0x7f440012bf70 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43fffff700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43e0039a40 0x7f43e003bf00 crc :-1 s=READY pgs=491 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 0x7f440012bf70 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f40059c0 con 0x7f44000a4990 2020-02-11T16:27:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 0x7f440012bf70 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f43f4005b20 con 0x7f44000a4990 2020-02-11T16:27:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 msgr2=0x7f440012bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43fcff9700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 0x7f440012bf70 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).stop 2020-02-11T16:27:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 msgr2=0x7f440012bf70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.948+0000 7f43fcff9700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4990 0x7f440012bf70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.957+0000 7f4406011700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 0x7f440012c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:24.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.957+0000 7f4406011700 1 -- 172.21.15.88:0/3499655467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4400133e80 con 0x7f44000a4d70 2020-02-11T16:27:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.957+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 0x7f440012c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43feffd700 1 -- 172.21.15.88:0/3499655467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f440005ccb0 con 0x7f44000a4d70 2020-02-11T16:27:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 0x7f440012c3d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 0x7f440012c3d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 0x7f440012c3d0 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 0x7f440012c3d0 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f400cb60 con 0x7f44000a4d70 2020-02-11T16:27:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43feffd700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 0x7f440012c3d0 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4362 (secure 0 0 0) 0x7f43f400ccc0 con 0x7f44000a4d70 2020-02-11T16:27:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 msgr2=0x7f440012c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43fcff9700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 0x7f440012c3d0 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f43f4007a40 tx=0x7f43f400c910).stop 2020-02-11T16:27:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43fcff9700 1 -- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 msgr2=0x7f440012c3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.958+0000 7f43fcff9700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000a4d70 0x7f440012c3d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f4406011700 1 -- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43e0039a40 msgr2=0x7f43e003bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f4406011700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f43e0039a40 0x7f43e003bf00 crc :-1 s=READY pgs=491 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f4406011700 1 -- 172.21.15.88:0/3499655467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 msgr2=0x7f440012d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:24.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f4406011700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f440012d0f0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f43f0002f30 tx=0x7f43f0007a40).stop 2020-02-11T16:27:24.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f43fffff700 1 -- 172.21.15.88:0/3499655467 reap_dead start 2020-02-11T16:27:24.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f43fffff700 1 -- 172.21.15.88:0/3499655467 reap_dead start 2020-02-11T16:27:24.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f4406011700 1 -- 172.21.15.88:0/3499655467 shutdown_connections 2020-02-11T16:27:24.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f4406011700 1 --2- 172.21.15.88:0/3499655467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44000a18a0 0x7f440012d0f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:24.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f4406011700 1 -- 172.21.15.88:0/3499655467 >> 172.21.15.88:0/3499655467 conn(0x7f440009d110 msgr2=0x7f440012b830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:24.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f4406011700 1 -- 172.21.15.88:0/3499655467 shutdown_connections 2020-02-11T16:27:24.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:24.959+0000 7f4406011700 1 -- 172.21.15.88:0/3499655467 wait complete. 2020-02-11T16:27:24.970 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:27:24.970 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:24.970 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:24.971 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:27:24.971 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 174, 2020-02-11T16:27:24.971 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:27:24.971 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:27:24.971 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:27:24.971 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:27:24.971 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.972 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:27:24.972 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:24.972 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:27:24.972 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:27:24.972 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:24.972 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:24.972 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:24.973 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:24.973 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:24.973 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:24.973 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.973 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:27:24.973 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:27:24.973 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:24.974 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:24.974 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:24.974 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:24.974 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:24.974 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:24.974 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.975 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:27:24.975 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:27:24.975 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:27:24.975 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:27:24.975 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:27:24.975 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:27:24.976 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:24.976 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:24.976 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:27:24.976 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:27:24.976 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:24.977 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:27:24.977 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:24.977 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:24.977 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:24.977 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:24.977 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:24.977 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:24.978 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.978 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:27:24.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.978 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:27:24.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.978 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:24.978 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:24.979 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:24.979 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:24.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.979 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:24.979 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:27:24.979 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.980 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:24.980 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:27:24.980 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.980 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.981 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:27:24.981 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:27:24.981 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:24.981 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:24.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.982 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:24.982 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:24.982 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:24.982 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:24.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.982 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:27:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:24.983 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:27:24.984 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.984 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.984 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.984 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:27:24.984 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:27:24.984 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:24.985 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:24.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.985 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:24.985 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:24.985 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:24.985 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:24.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.986 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:24.986 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:27:24.986 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.986 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:24.986 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:27:24.987 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:24.987 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.987 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.987 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:27:24.987 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:27:24.987 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:24.988 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:24.988 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.988 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:24.988 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:27:24.988 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:27:24.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.988 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:24.989 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:24.989 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:24.989 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.989 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.989 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:27:24.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.989 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:24.990 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:24.990 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:24.990 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.990 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.990 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:27:24.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.990 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:24.991 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:24.991 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:27:24.991 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.991 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.991 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:27:24.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.991 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:24.991 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:24.992 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:27:24.992 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.992 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:24.992 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:27:24.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:24.992 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:24.992 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:24.993 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:24.993 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.993 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:24.993 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:24.993 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:27:24.994 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:27:25.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.113+0000 7efed9a79700 1 Processor -- start 2020-02-11T16:27:25.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.113+0000 7efed9a79700 1 -- start start 2020-02-11T16:27:25.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed9a79700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efed405fc80 0x7efed413bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed9a79700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed40a9750 0x7efed409d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed9a79700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efed40669e0 0x7efed4066e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed9a79700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed41325d0 con 0x7efed40669e0 2020-02-11T16:27:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed9a79700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed413b2f0 con 0x7efed405fc80 2020-02-11T16:27:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed9a79700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed40a9bb0 con 0x7efed40a9750 2020-02-11T16:27:25.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efed405fc80 0x7efed413bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efed405fc80 0x7efed413bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59804/0 (socket says 172.21.15.88:59804) 2020-02-11T16:27:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 -- 172.21.15.88:0/928919091 learned_addr learned my addr 172.21.15.88:0/928919091 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed3fff700 1 --2- 172.21.15.88:0/928919091 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed40a9750 0x7efed409d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed9278700 1 --2- 172.21.15.88:0/928919091 >> v2:172.21.15.52:3300/0 conn(0x7efed40669e0 0x7efed4066e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 -- 172.21.15.88:0/928919091 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed40a9750 msgr2=0x7efed409d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 --2- 172.21.15.88:0/928919091 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed40a9750 0x7efed409d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:25.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 -- 172.21.15.88:0/928919091 >> v2:172.21.15.52:3300/0 conn(0x7efed40669e0 msgr2=0x7efed4066e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 --2- 172.21.15.88:0/928919091 >> v2:172.21.15.52:3300/0 conn(0x7efed40669e0 0x7efed4066e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 -- 172.21.15.88:0/928919091 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed405c1a0 con 0x7efed405fc80 2020-02-11T16:27:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 --2- 172.21.15.88:0/928919091 >> v2:172.21.15.88:3300/0 conn(0x7efed405fc80 0x7efed413bf00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 --2- 172.21.15.88:0/928919091 >> v2:172.21.15.88:3300/0 conn(0x7efed405fc80 0x7efed413bf00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 --2- 172.21.15.88:0/928919091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed413bf00 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).ready entity=mon.1 client_cookie=2ee9a6189f894000 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 --2- 172.21.15.88:0/928919091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed413bf00 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 --2- 172.21.15.88:0/928919091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed413bf00 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed8a77700 1 --2- 172.21.15.88:0/928919091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed413bf00 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed37fe700 1 -- 172.21.15.88:0/928919091 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec80115c0 con 0x7efed405fc80 2020-02-11T16:27:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed37fe700 1 -- 172.21.15.88:0/928919091 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec8011720 con 0x7efed405fc80 2020-02-11T16:27:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.114+0000 7efed37fe700 1 -- 172.21.15.88:0/928919091 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec8011ac0 con 0x7efed405fc80 2020-02-11T16:27:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.115+0000 7efed9a79700 1 -- 172.21.15.88:0/928919091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 msgr2=0x7efed413bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.115+0000 7efed9a79700 1 --2- 172.21.15.88:0/928919091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed413bf00 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).stop 2020-02-11T16:27:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.115+0000 7efed9a79700 1 -- 172.21.15.88:0/928919091 shutdown_connections 2020-02-11T16:27:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.115+0000 7efed9a79700 1 --2- 172.21.15.88:0/928919091 >> v2:172.21.15.52:3300/0 conn(0x7efed40669e0 0x7efed4066e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.115+0000 7efed9a79700 1 --2- 172.21.15.88:0/928919091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed413bf00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.115+0000 7efed9a79700 1 --2- 172.21.15.88:0/928919091 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed40a9750 0x7efed409d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.115+0000 7efed9a79700 1 -- 172.21.15.88:0/928919091 >> 172.21.15.88:0/928919091 conn(0x7efed40aeea0 msgr2=0x7efed40aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.115+0000 7efed9a79700 1 -- 172.21.15.88:0/928919091 shutdown_connections 2020-02-11T16:27:25.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.115+0000 7efed9a79700 1 -- 172.21.15.88:0/928919091 wait complete. 2020-02-11T16:27:25.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.116+0000 7efed9a79700 1 Processor -- start 2020-02-11T16:27:25.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.116+0000 7efed9a79700 1 -- start start 2020-02-11T16:27:25.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed9a79700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efed405fc80 0x7efed409ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:25.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed9a79700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed40a05c0 con 0x7efed40a9750 2020-02-11T16:27:25.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed9a79700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed40a0860 con 0x7efed40669e0 2020-02-11T16:27:25.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed9a79700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed413ada0 con 0x7efed405fc80 2020-02-11T16:27:25.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efed405fc80 0x7efed409ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed3fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efed40669e0 0x7efed41376e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47436/0 (socket says 172.21.15.88:47436) 2020-02-11T16:27:25.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed3fff700 1 -- 172.21.15.88:0/2727617292 learned_addr learned my addr 172.21.15.88:0/2727617292 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:25.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 --2- 172.21.15.88:0/2727617292 >> v2:172.21.15.88:3300/0 conn(0x7efed405fc80 0x7efed409ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59808/0 (socket says 172.21.15.88:59808) 2020-02-11T16:27:25.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 -- 172.21.15.88:0/2727617292 >> v1:172.21.15.88:6789/0 conn(0x7efed40669e0 legacy=0x7efed41376e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 -- 172.21.15.88:0/2727617292 >> v1:172.21.15.52:6789/0 conn(0x7efed40a9750 legacy=0x7efed412e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 -- 172.21.15.88:0/2727617292 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed40a02b0 con 0x7efed405fc80 2020-02-11T16:27:25.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 --2- 172.21.15.88:0/2727617292 >> v2:172.21.15.88:3300/0 conn(0x7efed405fc80 0x7efed409ec90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 --2- 172.21.15.88:0/2727617292 >> v2:172.21.15.88:3300/0 conn(0x7efed405fc80 0x7efed409ec90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed409ec90 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:25.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed409ec90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed409ec90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec8011ea0 con 0x7efed405fc80 2020-02-11T16:27:25.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed8a77700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed409ec90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec80070b0 con 0x7efed405fc80 2020-02-11T16:27:25.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec8007430 con 0x7efed405fc80 2020-02-11T16:27:25.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.117+0000 7efed9a79700 1 -- 172.21.15.88:0/2727617292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed4138a00 con 0x7efed405fc80 2020-02-11T16:27:25.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.118+0000 7efed9a79700 1 -- 172.21.15.88:0/2727617292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed413a5f0 con 0x7efed405fc80 2020-02-11T16:27:25.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.118+0000 7efed8a77700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed409ec90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.118+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7efec80056c0 con 0x7efed405fc80 2020-02-11T16:27:25.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.118+0000 7efed8a77700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed409ec90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.118+0000 7efed9a79700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 0x7efed4130a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:25.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.118+0000 7efed9a79700 1 -- 172.21.15.88:0/2727617292 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed405e2f0 con 0x7efed412ee40 2020-02-11T16:27:25.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed1ffb700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efebc039c20 0x7efebc03c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:25.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7efec804a200 con 0x7efed405fc80 2020-02-11T16:27:25.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 0x7efed4130a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed9278700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efebc039c20 0x7efebc03c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed3fff700 1 -- 172.21.15.88:0/2727617292 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efed4137420 con 0x7efed412ee40 2020-02-11T16:27:25.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed9278700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efebc039c20 0x7efebc03c0e0 crc :-1 s=READY pgs=492 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:25.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 0x7efed4130a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec000c160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 0x7efed4130a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec000c160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 0x7efed4130a30 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec000c160).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:25.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 0x7efed4130a30 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec000c160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.119+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec0007530 con 0x7efed412ee40 2020-02-11T16:27:25.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.120+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 0x7efed4130a30 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec000c160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.120+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7efec000ae90 con 0x7efed412ee40 2020-02-11T16:27:25.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.120+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 msgr2=0x7efed4130a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.120+0000 7efed1ffb700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 0x7efed4130a30 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec000c160).stop 2020-02-11T16:27:25.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.120+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 msgr2=0x7efed4130a30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:25.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.120+0000 7efed1ffb700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed412ee40 0x7efed4130a30 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec000c160).stop 2020-02-11T16:27:25.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.129+0000 7efed9a79700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 0x7efed4065830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:25.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.129+0000 7efed9a79700 1 -- 172.21.15.88:0/2727617292 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed40565b0 con 0x7efed4065450 2020-02-11T16:27:25.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.129+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 0x7efed4065830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.129+0000 7efed3fff700 1 -- 172.21.15.88:0/2727617292 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efed405cbd0 con 0x7efed4065450 2020-02-11T16:27:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.129+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 0x7efed4065830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec0012290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.129+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 0x7efed4065830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec0012290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.129+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 0x7efed4065830 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec0012290).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 0x7efed4065830 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec0012290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec0005ea0 con 0x7efed4065450 2020-02-11T16:27:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed3fff700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 0x7efed4065830 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec0012290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7efec0012e90 con 0x7efed4065450 2020-02-11T16:27:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 msgr2=0x7efed4065830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed1ffb700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 0x7efed4065830 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7efec0007fa0 tx=0x7efec0012290).stop 2020-02-11T16:27:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed1ffb700 1 -- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 msgr2=0x7efed4065830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed1ffb700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efed4065450 0x7efed4065830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed9a79700 1 -- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efebc039c20 msgr2=0x7efebc03c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed9a79700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7efebc039c20 0x7efebc03c0e0 crc :-1 s=READY pgs=492 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:25.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed9a79700 1 -- 172.21.15.88:0/2727617292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 msgr2=0x7efed409ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed9a79700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed409ec90 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7efec8002f30 tx=0x7efec8007a40).stop 2020-02-11T16:27:25.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed9278700 1 -- 172.21.15.88:0/2727617292 reap_dead start 2020-02-11T16:27:25.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed9278700 1 -- 172.21.15.88:0/2727617292 reap_dead start 2020-02-11T16:27:25.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed9a79700 1 -- 172.21.15.88:0/2727617292 shutdown_connections 2020-02-11T16:27:25.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed9a79700 1 --2- 172.21.15.88:0/2727617292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efed405fc80 0x7efed409ec90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:25.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.130+0000 7efed9a79700 1 -- 172.21.15.88:0/2727617292 >> 172.21.15.88:0/2727617292 conn(0x7efed40aeea0 msgr2=0x7efed409dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:25.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.131+0000 7efed9a79700 1 -- 172.21.15.88:0/2727617292 shutdown_connections 2020-02-11T16:27:25.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.131+0000 7efed9a79700 1 -- 172.21.15.88:0/2727617292 wait complete. 2020-02-11T16:27:25.143 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:27:25.143 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:25.143 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:25.143 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:27:25.144 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 174, 2020-02-11T16:27:25.144 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:27:25.144 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:27:25.144 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:27:25.144 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:27:25.144 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:25.144 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:27:25.145 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:25.145 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:27:25.145 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:27:25.145 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:25.145 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:25.145 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:25.145 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:25.145 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:25.146 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:25.146 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:25.146 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:27:25.146 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:27:25.146 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:25.146 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:25.146 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:25.147 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:25.147 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:25.147 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:25.147 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:25.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.147 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:27:25.147 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:27:25.148 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:27:25.148 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:27:25.148 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:27:25.148 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:27:25.148 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:25.148 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:25.148 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:27:25.148 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:27:25.149 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:25.149 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:27:25.149 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:25.149 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:25.149 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:25.149 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:25.149 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:25.150 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:25.150 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:25.150 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:27:25.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.150 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:27:25.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.150 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:25.151 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:25.151 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:25.151 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:25.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.151 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:25.151 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:27:25.151 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:25.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.152 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:25.152 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:27:25.152 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:25.152 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:25.152 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:25.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.153 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:27:25.153 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:27:25.153 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:25.153 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:25.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.153 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:25.154 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:25.154 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:25.154 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:25.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.154 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:25.154 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:27:25.154 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:25.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.155 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:25.155 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:27:25.155 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:25.155 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:25.155 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:25.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.156 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:27:25.156 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:27:25.156 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:25.156 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:25.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.156 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:25.157 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:25.157 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:25.157 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:25.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.157 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:25.157 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:27:25.157 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:25.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.158 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:25.158 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:27:25.158 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:25.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:25.158 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:25.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.159 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:27:25.159 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:27:25.159 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:25.159 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:25.159 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:25.159 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:25.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:25.160 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:27:25.160 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:27:25.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.160 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:25.160 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:25.161 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:25.161 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:25.161 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:25.161 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:27:25.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.161 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:25.161 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:25.161 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:25.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:25.162 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:25.162 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:27:25.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.162 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:25.162 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:25.162 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:27:25.163 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:25.163 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:25.163 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:27:25.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.163 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:25.163 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:25.163 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:27:25.163 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:25.164 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:25.164 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:27:25.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:25.164 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:25.164 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:25.164 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:25.164 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:25.164 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:25.165 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:25.165 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:27:25.166 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:27:25.166 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:27:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.283+0000 7f0ca213d700 1 Processor -- start 2020-02-11T16:27:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.283+0000 7f0ca213d700 1 -- start start 2020-02-11T16:27:25.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0ca213d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:25.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0ca213d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c134e30 0x7f0c9c1352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:25.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0ca213d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c1382e0 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0ca213d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c138580 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0ca213d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c138820 con 0x7f0c9c134e30 2020-02-11T16:27:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59820/0 (socket says 172.21.15.88:59820) 2020-02-11T16:27:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c93fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0c9c0a1e50 0x7f0c9c0a3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47446/0 (socket says 172.21.15.88:47446) 2020-02-11T16:27:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9b7fe700 1 -- 172.21.15.88:0/571731532 learned_addr learned my addr 172.21.15.88:0/571731532 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9bfff700 1 --2- 172.21.15.88:0/571731532 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c134e30 0x7f0c9c1352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9b7fe700 1 -- 172.21.15.88:0/571731532 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c134e30 msgr2=0x7f0c9c1352c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9b7fe700 1 --2- 172.21.15.88:0/571731532 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c134e30 0x7f0c9c1352c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9b7fe700 1 -- 172.21.15.88:0/571731532 >> v1:172.21.15.88:6789/0 conn(0x7f0c9c0a1e50 legacy=0x7f0c9c0a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9b7fe700 1 -- 172.21.15.88:0/571731532 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c135720 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9affd700 1 -- 172.21.15.88:0/571731532 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875344851 0 0) 0x7f0c9c1382e0 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9b7fe700 1 --2- 172.21.15.88:0/571731532 >> v2:172.21.15.88:3300/0 conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0c8c002f30 tx=0x7f0c8c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9b7fe700 1 --2- 172.21.15.88:0/571731532 >> v2:172.21.15.88:3300/0 conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0c8c002f30 tx=0x7f0c8c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.284+0000 7f0c9b7fe700 1 --2- 172.21.15.88:0/571731532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f0c8c002f30 tx=0x7f0c8c0088e0).ready entity=mon.1 client_cookie=a3269a76ea35fe4b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0c9b7fe700 1 --2- 172.21.15.88:0/571731532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f0c8c002f30 tx=0x7f0c8c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0c9affd700 1 -- 172.21.15.88:0/571731532 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c8c0116b0 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0c9b7fe700 1 --2- 172.21.15.88:0/571731532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f0c8c002f30 tx=0x7f0c8c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0c9affd700 1 -- 172.21.15.88:0/571731532 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c011810 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0c9b7fe700 1 --2- 172.21.15.88:0/571731532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f0c8c002f30 tx=0x7f0c8c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0c9affd700 1 -- 172.21.15.88:0/571731532 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c8c011bb0 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0ca213d700 1 -- 172.21.15.88:0/571731532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c9c05c1f0 msgr2=0x7f0c9c137cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0ca213d700 1 --2- 172.21.15.88:0/571731532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f0c8c002f30 tx=0x7f0c8c0088e0).stop 2020-02-11T16:27:25.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0ca213d700 1 -- 172.21.15.88:0/571731532 shutdown_connections 2020-02-11T16:27:25.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0ca213d700 1 --2- 172.21.15.88:0/571731532 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c134e30 0x7f0c9c1352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:25.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0ca213d700 1 --2- 172.21.15.88:0/571731532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c9c05c1f0 0x7f0c9c137cf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:25.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0ca213d700 1 -- 172.21.15.88:0/571731532 >> 172.21.15.88:0/571731532 conn(0x7f0c9c0ab400 msgr2=0x7f0c9c0a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:25.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0ca213d700 1 -- 172.21.15.88:0/571731532 shutdown_connections 2020-02-11T16:27:25.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.285+0000 7f0ca213d700 1 -- 172.21.15.88:0/571731532 wait complete. 2020-02-11T16:27:25.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.286+0000 7f0ca213d700 1 Processor -- start 2020-02-11T16:27:25.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.286+0000 7f0ca213d700 1 -- start start 2020-02-11T16:27:25.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0ca213d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:25.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0ca213d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0c9c134e30 0x7f0c9c147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:25.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0ca213d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c1483e0 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0ca213d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c148210 con 0x7f0c9c134e30 2020-02-11T16:27:25.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0ca213d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c061dc0 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0c9b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0c9c05c1f0 0x7f0c9c148d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47452/0 (socket says 172.21.15.88:47452) 2020-02-11T16:27:25.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0c9b7fe700 1 -- 172.21.15.88:0/1337991336 learned_addr learned my addr 172.21.15.88:0/1337991336 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:25.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0c9bfff700 1 --2- 172.21.15.88:0/1337991336 >> v2:172.21.15.52:3300/0 conn(0x7f0c9c134e30 0x7f0c9c147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164210861 0 0) 0x7f0c9c1483e0 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.287+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c80002fe0 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2773349151 0 0) 0x7f0c80002fe0 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0c9c1483e0 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f0c8c011db0 con 0x7f0c9c05c1f0 2020-02-11T16:27:25.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c93fff700 1 -- 172.21.15.88:0/1337991336 >> v2:172.21.15.52:3300/0 conn(0x7f0c9c134e30 msgr2=0x7f0c9c147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> v2:172.21.15.52:3300/0 conn(0x7f0c9c134e30 0x7f0c9c147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:25.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c93fff700 1 -- 172.21.15.88:0/1337991336 >> v1:172.21.15.88:6789/0 conn(0x7f0c9c05c1f0 legacy=0x7f0c9c148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c93fff700 1 -- 172.21.15.88:0/1337991336 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c148610 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c9bfff700 1 --2- 172.21.15.88:0/1337991336 >> v2:172.21.15.52:3300/0 conn(0x7f0c9c134e30 0x7f0c9c147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:27:25.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:25.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c84011390 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0ca213d700 1 -- 172.21.15.88:0/1337991336 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c1488b0 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c840114f0 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c84011850 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.288+0000 7f0ca213d700 1 -- 172.21.15.88:0/1337991336 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c063600 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.289+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.289+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0c84011a50 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.289+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.289+0000 7f0c997fa700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0c8003a280 0x7f0c8003c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:25.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.289+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f0c84011e40 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.289+0000 7f0ca213d700 1 -- 172.21.15.88:0/1337991336 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c063900 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.289+0000 7f0c9b7fe700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0c8003a280 0x7f0c8003c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:25.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.290+0000 7f0c9b7fe700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0c8003a280 0x7f0c8003c740 crc :-1 s=READY pgs=493 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:25.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.293+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.293+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f0c8402ea40 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.546+0000 7f0ca213d700 1 -- 172.21.15.88:0/1337991336 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f0c9c0565b0 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.548+0000 7f0c93fff700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:25.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.548+0000 7f0c997fa700 1 -- 172.21.15.88:0/1337991336 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f0c840314d0 con 0x7f0c9c0a1e50 2020-02-11T16:27:25.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.550+0000 7f0ca213d700 1 -- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0c8003a280 msgr2=0x7f0c8003c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.550+0000 7f0ca213d700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0c8003a280 0x7f0c8003c740 crc :-1 s=READY pgs=493 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:25.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.550+0000 7f0ca213d700 1 -- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 msgr2=0x7f0c9c147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:25.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.550+0000 7f0ca213d700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f0c84000b80 tx=0x7f0c84001e40).stop 2020-02-11T16:27:25.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.551+0000 7f0ca213d700 1 -- 172.21.15.88:0/1337991336 shutdown_connections 2020-02-11T16:27:25.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.551+0000 7f0ca213d700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0c8003a280 0x7f0c8003c740 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:25.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.551+0000 7f0ca213d700 1 --2- 172.21.15.88:0/1337991336 >> v2:172.21.15.52:3300/0 conn(0x7f0c9c134e30 0x7f0c9c147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:25.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.551+0000 7f0ca213d700 1 --2- 172.21.15.88:0/1337991336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c9c0a1e50 0x7f0c9c147950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:25.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.551+0000 7f0ca213d700 1 -- 172.21.15.88:0/1337991336 >> 172.21.15.88:0/1337991336 conn(0x7f0c9c0ab400 msgr2=0x7f0c9c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:25.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.551+0000 7f0ca213d700 1 -- 172.21.15.88:0/1337991336 shutdown_connections 2020-02-11T16:27:25.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:25.551+0000 7f0ca213d700 1 -- 172.21.15.88:0/1337991336 wait complete. 2020-02-11T16:27:25.564 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:27:35.565 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:27:35.565 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:27:35.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.687+0000 7f0352f46700 1 Processor -- start 2020-02-11T16:27:35.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.687+0000 7f0352f46700 1 -- start start 2020-02-11T16:27:35.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.688+0000 7f0352f46700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f034c0ad380 0x7f034c0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:35.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.688+0000 7f0352f46700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034c13bfe0 con 0x7f034c138280 2020-02-11T16:27:35.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.688+0000 7f0352f46700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034c0adb40 con 0x7f034c138710 2020-02-11T16:27:35.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.688+0000 7f0352f46700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c137bf0 con 0x7f034c0ad380 2020-02-11T16:27:35.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.688+0000 7f03514e3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f034c138710 0x7f034c13b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47462/0 (socket says 172.21.15.88:47462) 2020-02-11T16:27:35.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.688+0000 7f03514e3700 1 -- 172.21.15.88:0/545167306 learned_addr learned my addr 172.21.15.88:0/545167306 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:35.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.688+0000 7f0350ce2700 1 --2- 172.21.15.88:0/545167306 >> v2:172.21.15.52:3300/0 conn(0x7f034c0ad380 0x7f034c0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:35.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.688+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370114344 0 0) 0x7f034c0adb40 con 0x7f034c138710 2020-02-11T16:27:35.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0330003230 con 0x7f034c138710 2020-02-11T16:27:35.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2372928199 0 0) 0x7f0330003230 con 0x7f034c138710 2020-02-11T16:27:35.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 >> v2:172.21.15.52:3300/0 conn(0x7f034c0ad380 msgr2=0x7f034c0a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:35.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 --2- 172.21.15.88:0/545167306 >> v2:172.21.15.52:3300/0 conn(0x7f034c0ad380 0x7f034c0a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:35.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 >> v1:172.21.15.52:6789/0 conn(0x7f034c138280 legacy=0x7f034c13b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:35.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c137de0 con 0x7f034c138710 2020-02-11T16:27:35.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f0344001a50 con 0x7f034c138710 2020-02-11T16:27:35.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 >> v1:172.21.15.88:6789/0 conn(0x7f034c138710 legacy=0x7f034c13b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:35.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 0x7f0330003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:35.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03300044d0 0x7f0330004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:35.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0330004db0 0x7f033000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:35.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03300041c0 con 0x7f0330003720 2020-02-11T16:27:35.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330004330 con 0x7f03300044d0 2020-02-11T16:27:35.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033000bbd0 con 0x7f0330004db0 2020-02-11T16:27:35.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f0350ce2700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 0x7f0330003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:35.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f034bfff700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03300044d0 0x7f0330004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:35.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f03514e3700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0330004db0 0x7f033000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:35.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f0350ce2700 1 -- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0330004db0 msgr2=0x7f033000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:35.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f0350ce2700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0330004db0 0x7f033000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:35.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f0350ce2700 1 -- 172.21.15.88:0/545167306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03300044d0 msgr2=0x7f0330004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:35.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f0350ce2700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03300044d0 0x7f0330004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:35.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f03514e3700 1 -- 172.21.15.88:0/545167306 reap_dead start 2020-02-11T16:27:35.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f0350ce2700 1 -- 172.21.15.88:0/545167306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0330003230 con 0x7f0330003720 2020-02-11T16:27:35.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.689+0000 7f0350ce2700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 0x7f0330003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f03300054a0 tx=0x7f0340007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0350ce2700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 0x7f0330003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f03300054a0 tx=0x7f0340007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0350ce2700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 0x7f0330003b40 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f03300054a0 tx=0x7f0340007dd0).ready entity=mon.0 client_cookie=240625218eca5aa server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:35.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0350ce2700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 0x7f0330003b40 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f03300054a0 tx=0x7f0340007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0340008d00 con 0x7f0330003720 2020-02-11T16:27:35.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0350ce2700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 0x7f0330003b40 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f03300054a0 tx=0x7f0340007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0340008e60 con 0x7f0330003720 2020-02-11T16:27:35.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0350ce2700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 0x7f0330003b40 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f03300054a0 tx=0x7f0340007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f034b7fe700 1 -- 172.21.15.88:0/545167306 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0340010a50 con 0x7f0330003720 2020-02-11T16:27:35.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0352f46700 1 -- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 msgr2=0x7f0330003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0352f46700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 0x7f0330003b40 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f03300054a0 tx=0x7f0340007dd0).stop 2020-02-11T16:27:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0352f46700 1 -- 172.21.15.88:0/545167306 shutdown_connections 2020-02-11T16:27:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0352f46700 1 --2- 172.21.15.88:0/545167306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0330003720 0x7f0330003b40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0352f46700 1 -- 172.21.15.88:0/545167306 >> 172.21.15.88:0/545167306 conn(0x7f034c05ac70 msgr2=0x7f034c0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0352f46700 1 -- 172.21.15.88:0/545167306 shutdown_connections 2020-02-11T16:27:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.690+0000 7f0352f46700 1 -- 172.21.15.88:0/545167306 wait complete. 2020-02-11T16:27:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.691+0000 7f0352f46700 1 Processor -- start 2020-02-11T16:27:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.691+0000 7f0352f46700 1 -- start start 2020-02-11T16:27:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.692+0000 7f0352f46700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0330003720 0x7f034c0a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.692+0000 7f0352f46700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f034c1350d0 0x7f034c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:35.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.692+0000 7f0352f46700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f034c0a6120 0x7f034c145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:35.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.692+0000 7f0352f46700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c133c00 con 0x7f0330003720 2020-02-11T16:27:35.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.692+0000 7f0352f46700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c0ac3d0 con 0x7f034c1350d0 2020-02-11T16:27:35.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.692+0000 7f0352f46700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c0a8be0 con 0x7f034c0a6120 2020-02-11T16:27:35.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.692+0000 7f034bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f034c1350d0 0x7f034c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:35.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.692+0000 7f034bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f034c1350d0 0x7f034c0a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59850/0 (socket says 172.21.15.88:59850) 2020-02-11T16:27:35.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.692+0000 7f034bfff700 1 -- 172.21.15.88:0/2886808700 learned_addr learned my addr 172.21.15.88:0/2886808700 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.692+0000 7f0350ce2700 1 --2- 172.21.15.88:0/2886808700 >> v2:172.21.15.52:3300/0 conn(0x7f0330003720 0x7f034c0a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f03514e3700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f034c0a6120 0x7f034c145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 -- 172.21.15.88:0/2886808700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f034c0a6120 msgr2=0x7f034c145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f034c0a6120 0x7f034c145290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 -- 172.21.15.88:0/2886808700 >> v2:172.21.15.52:3300/0 conn(0x7f0330003720 msgr2=0x7f034c0a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> v2:172.21.15.52:3300/0 conn(0x7f0330003720 0x7f034c0a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 -- 172.21.15.88:0/2886808700 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c0a8420 con 0x7f034c1350d0 2020-02-11T16:27:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> v2:172.21.15.88:3300/0 conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> v2:172.21.15.88:3300/0 conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f0349ffb700 1 -- 172.21.15.88:0/2886808700 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033800c840 con 0x7f034c1350d0 2020-02-11T16:27:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f0349ffb700 1 -- 172.21.15.88:0/2886808700 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033800c9a0 con 0x7f034c1350d0 2020-02-11T16:27:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f0352f46700 1 -- 172.21.15.88:0/2886808700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c0a86c0 con 0x7f034c1350d0 2020-02-11T16:27:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f0349ffb700 1 -- 172.21.15.88:0/2886808700 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033800cd00 con 0x7f034c1350d0 2020-02-11T16:27:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f0352f46700 1 -- 172.21.15.88:0/2886808700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c144dc0 con 0x7f034c1350d0 2020-02-11T16:27:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.693+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.694+0000 7f0349ffb700 1 -- 172.21.15.88:0/2886808700 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f03380064e0 con 0x7f034c1350d0 2020-02-11T16:27:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.694+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.694+0000 7f0352f46700 1 -- 172.21.15.88:0/2886808700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c0a59e0 con 0x7f034c1350d0 2020-02-11T16:27:35.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.694+0000 7f0349ffb700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0334039bf0 0x7f033403c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:35.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.694+0000 7f0349ffb700 1 -- 172.21.15.88:0/2886808700 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f03380496d0 con 0x7f034c1350d0 2020-02-11T16:27:35.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.694+0000 7f0350ce2700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0334039bf0 0x7f033403c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:35.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.695+0000 7f0350ce2700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0334039bf0 0x7f033403c0b0 crc :-1 s=READY pgs=494 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:35.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.698+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.698+0000 7f0349ffb700 1 -- 172.21.15.88:0/2886808700 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f033802ec30 con 0x7f034c1350d0 2020-02-11T16:27:35.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.931+0000 7f0352f46700 1 -- 172.21.15.88:0/2886808700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f034c0565b0 con 0x7f034c1350d0 2020-02-11T16:27:35.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.932+0000 7f034bfff700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:35.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.932+0000 7f0349ffb700 1 -- 172.21.15.88:0/2886808700 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f033800ce60 con 0x7f034c1350d0 2020-02-11T16:27:35.935 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":174,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:35.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 -- 172.21.15.88:0/2886808700 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0334039bf0 msgr2=0x7f033403c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:35.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0334039bf0 0x7f033403c0b0 crc :-1 s=READY pgs=494 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:35.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 -- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 msgr2=0x7f034c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:35.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 0x7f034c0a5cc0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f0338001170 tx=0x7f0338010b20).stop 2020-02-11T16:27:35.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 -- 172.21.15.88:0/2886808700 shutdown_connections 2020-02-11T16:27:35.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f034c0a6120 0x7f034c145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:35.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0334039bf0 0x7f033403c0b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:35.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 --2- 172.21.15.88:0/2886808700 >> v2:172.21.15.52:3300/0 conn(0x7f0330003720 0x7f034c0a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:35.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 --2- 172.21.15.88:0/2886808700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f034c1350d0 0x7f034c0a5cc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:35.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 -- 172.21.15.88:0/2886808700 >> 172.21.15.88:0/2886808700 conn(0x7f034c05ac70 msgr2=0x7f034c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:35.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 -- 172.21.15.88:0/2886808700 shutdown_connections 2020-02-11T16:27:35.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:35.933+0000 7f0352f46700 1 -- 172.21.15.88:0/2886808700 wait complete. 2020-02-11T16:27:35.947 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":174,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:35.947 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:27:35.947 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:27:35.947 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:27:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.085+0000 7fddea660700 1 Processor -- start 2020-02-11T16:27:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.085+0000 7fddea660700 1 -- start start 2020-02-11T16:27:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fddea660700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdde40a1520 0x7fdde4131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fddea660700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde40a4350 con 0x7fdde40a2fa0 2020-02-11T16:27:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fddea660700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde40a3a40 con 0x7fdde40a5b20 2020-02-11T16:27:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fddea660700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde40a1e60 con 0x7fdde40a1520 2020-02-11T16:27:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdde40a5b20 0x7fdde4131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47484/0 (socket says 172.21.15.88:47484) 2020-02-11T16:27:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde37fe700 1 -- 172.21.15.88:0/570109983 learned_addr learned my addr 172.21.15.88:0/570109983 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde8bfd700 1 --2- 172.21.15.88:0/570109983 >> v2:172.21.15.52:3300/0 conn(0x7fdde40a1520 0x7fdde4131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777563346 0 0) 0x7fdde40a3a40 con 0x7fdde40a5b20 2020-02-11T16:27:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd0003230 con 0x7fdde40a5b20 2020-02-11T16:27:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1595436604 0 0) 0x7fddd0003230 con 0x7fdde40a5b20 2020-02-11T16:27:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 >> v2:172.21.15.52:3300/0 conn(0x7fdde40a1520 msgr2=0x7fdde4131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 --2- 172.21.15.88:0/570109983 >> v2:172.21.15.52:3300/0 conn(0x7fdde40a1520 0x7fdde4131990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 >> v1:172.21.15.52:6789/0 conn(0x7fdde40a2fa0 legacy=0x7fdde40a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde40a3ce0 con 0x7fdde40a5b20 2020-02-11T16:27:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fddd80016d0 con 0x7fdde40a5b20 2020-02-11T16:27:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 >> v1:172.21.15.88:6789/0 conn(0x7fdde40a5b20 legacy=0x7fdde4131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd0003720 0x7fddd0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 0x7fddd0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd0004db0 0x7fddd000c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40a1e60 con 0x7fddd0003720 2020-02-11T16:27:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00041c0 con 0x7fddd00044d0 2020-02-11T16:27:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.086+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00056f0 con 0x7fddd0004db0 2020-02-11T16:27:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 0x7fddd0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde3fff700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd0003720 0x7fddd0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde8bfd700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd0004db0 0x7fddd000c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 -- 172.21.15.88:0/570109983 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd0004db0 msgr2=0x7fddd000c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd0004db0 0x7fddd000c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 -- 172.21.15.88:0/570109983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd0003720 msgr2=0x7fddd0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd0003720 0x7fddd0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde8bfd700 1 -- 172.21.15.88:0/570109983 reap_dead start 2020-02-11T16:27:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 -- 172.21.15.88:0/570109983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0003230 con 0x7fddd00044d0 2020-02-11T16:27:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 0x7fddd0004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddd00054a0 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 0x7fddd0004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddd00054a0 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 0x7fddd0004950 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fddd00054a0 tx=0x7fddd800c340).ready entity=mon.1 client_cookie=7d14fd57e5b70bfc server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 0x7fddd0004950 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fddd00054a0 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 0x7fddd0004950 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fddd00054a0 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd800ce70 con 0x7fddd00044d0 2020-02-11T16:27:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde37fe700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 0x7fddd0004950 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fddd00054a0 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd800e350 con 0x7fddd00044d0 2020-02-11T16:27:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fdde2ffd700 1 -- 172.21.15.88:0/570109983 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd800e730 con 0x7fddd00044d0 2020-02-11T16:27:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fddea660700 1 -- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 msgr2=0x7fddd0004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.087+0000 7fddea660700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 0x7fddd0004950 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fddd00054a0 tx=0x7fddd800c340).stop 2020-02-11T16:27:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.088+0000 7fddea660700 1 -- 172.21.15.88:0/570109983 shutdown_connections 2020-02-11T16:27:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.088+0000 7fddea660700 1 --2- 172.21.15.88:0/570109983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd00044d0 0x7fddd0004950 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.088+0000 7fddea660700 1 -- 172.21.15.88:0/570109983 >> 172.21.15.88:0/570109983 conn(0x7fdde409d110 msgr2=0x7fdde409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.089+0000 7fddea660700 1 -- 172.21.15.88:0/570109983 shutdown_connections 2020-02-11T16:27:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.089+0000 7fddea660700 1 -- 172.21.15.88:0/570109983 wait complete. 2020-02-11T16:27:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.090+0000 7fddea660700 1 Processor -- start 2020-02-11T16:27:36.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.090+0000 7fddea660700 1 -- start start 2020-02-11T16:27:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.090+0000 7fddea660700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd00044d0 0x7fdde41365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.090+0000 7fddea660700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdde4066cc0 0x7fdde4130300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.090+0000 7fddea660700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdde40a0380 0x7fdde4130760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.090+0000 7fddea660700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde4131df0 con 0x7fdde40a0380 2020-02-11T16:27:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.090+0000 7fddea660700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde4136a50 con 0x7fdde4066cc0 2020-02-11T16:27:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.090+0000 7fddea660700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40a7840 con 0x7fddd00044d0 2020-02-11T16:27:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdde4066cc0 0x7fdde4130300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdde4066cc0 0x7fdde4130300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59870/0 (socket says 172.21.15.88:59870) 2020-02-11T16:27:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 -- 172.21.15.88:0/4037503922 learned_addr learned my addr 172.21.15.88:0/4037503922 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde8bfd700 1 --2- 172.21.15.88:0/4037503922 >> v2:172.21.15.52:3300/0 conn(0x7fdde40a0380 0x7fdde4130760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd00044d0 0x7fdde41365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 -- 172.21.15.88:0/4037503922 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd00044d0 msgr2=0x7fdde41365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd00044d0 0x7fdde41365f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 -- 172.21.15.88:0/4037503922 >> v2:172.21.15.52:3300/0 conn(0x7fdde40a0380 msgr2=0x7fdde4130760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 --2- 172.21.15.88:0/4037503922 >> v2:172.21.15.52:3300/0 conn(0x7fdde40a0380 0x7fdde4130760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 -- 172.21.15.88:0/4037503922 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde4135fb0 con 0x7fdde4066cc0 2020-02-11T16:27:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 --2- 172.21.15.88:0/4037503922 >> v2:172.21.15.88:3300/0 conn(0x7fdde4066cc0 0x7fdde4130300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdde4137d20 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 --2- 172.21.15.88:0/4037503922 >> v2:172.21.15.88:3300/0 conn(0x7fdde4066cc0 0x7fdde4130300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdde4137d20 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4066cc0 0x7fdde4130300 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fdde4137d20 tx=0x7fddd800c340).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4066cc0 0x7fdde4130300 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdde4137d20 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4066cc0 0x7fdde4130300 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdde4137d20 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd800e6e0 con 0x7fdde4066cc0 2020-02-11T16:27:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde37fe700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4066cc0 0x7fdde4130300 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdde4137d20 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd80100b0 con 0x7fdde4066cc0 2020-02-11T16:27:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fddea660700 1 -- 172.21.15.88:0/4037503922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde41361e0 con 0x7fdde4066cc0 2020-02-11T16:27:36.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd8010490 con 0x7fdde4066cc0 2020-02-11T16:27:36.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.091+0000 7fddea660700 1 -- 172.21.15.88:0/4037503922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde41379e0 con 0x7fdde4066cc0 2020-02-11T16:27:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.092+0000 7fdde37fe700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4066cc0 0x7fdde4130300 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdde4137d20 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.092+0000 7fddea660700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 0x7fdde41442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.092+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fddd80105f0 con 0x7fdde4066cc0 2020-02-11T16:27:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.092+0000 7fddea660700 1 -- 172.21.15.88:0/4037503922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde405e2f0 con 0x7fdde40a7ef0 2020-02-11T16:27:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.092+0000 7fdde37fe700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4066cc0 0x7fdde4130300 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdde4137d20 tx=0x7fddd800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.092+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 0x7fdde41442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde17fa700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddc4039ca0 0x7fddc403c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fddd804a060 con 0x7fdde4066cc0 2020-02-11T16:27:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde3fff700 1 -- 172.21.15.88:0/4037503922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdde40565b0 con 0x7fdde40a7ef0 2020-02-11T16:27:36.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 0x7fdde41442e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde8bfd700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddc4039ca0 0x7fddc403c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 0x7fdde41442e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 0x7fdde41442e0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 0x7fdde41442e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd4001e60 con 0x7fdde40a7ef0 2020-02-11T16:27:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde8bfd700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddc4039ca0 0x7fddc403c160 crc :-1 s=READY pgs=495 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 0x7fdde41442e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fddd400c810 con 0x7fdde40a7ef0 2020-02-11T16:27:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 msgr2=0x7fdde41442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde17fa700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 0x7fdde41442e0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).stop 2020-02-11T16:27:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 msgr2=0x7fdde41442e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:36.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.093+0000 7fdde17fa700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde40a7ef0 0x7fdde41442e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.105+0000 7fddea660700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 0x7fdde4144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.105+0000 7fddea660700 1 -- 172.21.15.88:0/4037503922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40a0e20 con 0x7fdde4144740 2020-02-11T16:27:36.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 0x7fdde4144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde3fff700 1 -- 172.21.15.88:0/4037503922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdde405ccb0 con 0x7fdde4144740 2020-02-11T16:27:36.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 0x7fdde4144b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 0x7fdde4144b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 0x7fdde4144b20 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 0x7fdde4144b20 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd400b8b0 con 0x7fdde4144740 2020-02-11T16:27:36.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde3fff700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 0x7fdde4144b20 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7fddd4010350 con 0x7fdde4144740 2020-02-11T16:27:36.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 msgr2=0x7fdde4144b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde17fa700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 0x7fdde4144b20 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fdde405ef00 tx=0x7fddd400c4b0).stop 2020-02-11T16:27:36.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde17fa700 1 -- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 msgr2=0x7fdde4144b20 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:36.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.106+0000 7fdde17fa700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4144740 0x7fdde4144b20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fddea660700 1 -- 172.21.15.88:0/4037503922 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddc4039ca0 msgr2=0x7fddc403c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fddea660700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddc4039ca0 0x7fddc403c160 crc :-1 s=READY pgs=495 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fddea660700 1 -- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4066cc0 msgr2=0x7fdde4130300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fddea660700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4066cc0 0x7fdde4130300 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fdde4137d20 tx=0x7fddd800c340).stop 2020-02-11T16:27:36.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fdde8bfd700 1 -- 172.21.15.88:0/4037503922 reap_dead start 2020-02-11T16:27:36.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fdde8bfd700 1 -- 172.21.15.88:0/4037503922 reap_dead start 2020-02-11T16:27:36.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fddea660700 1 -- 172.21.15.88:0/4037503922 shutdown_connections 2020-02-11T16:27:36.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fddea660700 1 --2- 172.21.15.88:0/4037503922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdde4066cc0 0x7fdde4130300 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fddea660700 1 -- 172.21.15.88:0/4037503922 >> 172.21.15.88:0/4037503922 conn(0x7fdde409d110 msgr2=0x7fdde4131050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:36.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fddea660700 1 -- 172.21.15.88:0/4037503922 shutdown_connections 2020-02-11T16:27:36.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.107+0000 7fddea660700 1 -- 172.21.15.88:0/4037503922 wait complete. 2020-02-11T16:27:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:27:36.126 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:36.126 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:36.126 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:27:36.126 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 174, 2020-02-11T16:27:36.126 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:27:36.126 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:27:36.126 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:27:36.127 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:27:36.127 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.127 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:27:36.127 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:36.127 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:27:36.127 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:27:36.127 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:36.128 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:36.128 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:36.128 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:36.128 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:36.128 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:36.129 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.129 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:27:36.129 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:27:36.129 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:36.129 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:36.129 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:36.129 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:36.130 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:36.130 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:36.130 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.130 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:27:36.130 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:27:36.130 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:27:36.130 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:27:36.131 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:27:36.131 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:27:36.131 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:36.131 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:36.131 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:27:36.131 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:27:36.131 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:36.132 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:27:36.132 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:36.132 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:36.132 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:36.132 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:36.132 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:36.132 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:36.133 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.133 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:27:36.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.133 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:27:36.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.133 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:36.133 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:36.134 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:36.134 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:36.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.134 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:36.134 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:27:36.134 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.135 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:36.135 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:27:36.135 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.135 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.135 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.136 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:27:36.136 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:27:36.136 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:36.136 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:36.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.137 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:36.137 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:36.137 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:36.137 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:36.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.138 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:36.138 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:27:36.138 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.138 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:36.138 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:27:36.138 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.139 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.139 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.139 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:27:36.139 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:27:36.139 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:36.139 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:36.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.140 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:36.140 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:36.140 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:36.140 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:36.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.140 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:36.141 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:27:36.141 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.141 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.141 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:36.141 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:27:36.141 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.142 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.142 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.142 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:27:36.142 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:27:36.142 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:36.142 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:36.143 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.143 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.143 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:27:36.143 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:27:36.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.143 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:27:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:27:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.145 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:27:36.147 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:27:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.275+0000 7fac89369700 1 Processor -- start 2020-02-11T16:27:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.275+0000 7fac89369700 1 -- start start 2020-02-11T16:27:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.276+0000 7fac89369700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac840ad380 0x7fac840a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.276+0000 7fac89369700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac84138280 0x7fac841386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.276+0000 7fac89369700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac840adb40 con 0x7fac8413b1c0 2020-02-11T16:27:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.276+0000 7fac89369700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac84137bf0 con 0x7fac840ad380 2020-02-11T16:27:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.276+0000 7fac89369700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac84138b40 con 0x7fac84138280 2020-02-11T16:27:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.276+0000 7fac82ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac840ad380 0x7fac840a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.276+0000 7fac82ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac840ad380 0x7fac840a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59880/0 (socket says 172.21.15.88:59880) 2020-02-11T16:27:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.276+0000 7fac82ffd700 1 -- 172.21.15.88:0/3267509568 learned_addr learned my addr 172.21.15.88:0/3267509568 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac827fc700 1 --2- 172.21.15.88:0/3267509568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac84138280 0x7fac841386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac82ffd700 1 -- 172.21.15.88:0/3267509568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac84138280 msgr2=0x7fac841386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3267509568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac84138280 0x7fac841386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac82ffd700 1 -- 172.21.15.88:0/3267509568 >> v1:172.21.15.88:6789/0 conn(0x7fac8413b1c0 legacy=0x7fac8413b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac82ffd700 1 -- 172.21.15.88:0/3267509568 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84137de0 con 0x7fac840ad380 2020-02-11T16:27:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac81ffb700 1 -- 172.21.15.88:0/3267509568 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971351027 0 0) 0x7fac840adb40 con 0x7fac8413b1c0 2020-02-11T16:27:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3267509568 >> v2:172.21.15.88:3300/0 conn(0x7fac840ad380 0x7fac840a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac74002f30 tx=0x7fac740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3267509568 >> v2:172.21.15.88:3300/0 conn(0x7fac840ad380 0x7fac840a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac74002f30 tx=0x7fac740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3267509568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac840ad380 0x7fac840a9130 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fac74002f30 tx=0x7fac740088e0).ready entity=mon.1 client_cookie=8ad832e1c48a73a5 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3267509568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac840ad380 0x7fac840a9130 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fac74002f30 tx=0x7fac740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac81ffb700 1 -- 172.21.15.88:0/3267509568 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac740116b0 con 0x7fac840ad380 2020-02-11T16:27:36.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3267509568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac840ad380 0x7fac840a9130 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fac74002f30 tx=0x7fac740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac81ffb700 1 -- 172.21.15.88:0/3267509568 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac74011810 con 0x7fac840ad380 2020-02-11T16:27:36.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3267509568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac840ad380 0x7fac840a9130 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fac74002f30 tx=0x7fac740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac81ffb700 1 -- 172.21.15.88:0/3267509568 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac74011bb0 con 0x7fac840ad380 2020-02-11T16:27:36.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac89369700 1 -- 172.21.15.88:0/3267509568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac840ad380 msgr2=0x7fac840a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.277+0000 7fac89369700 1 --2- 172.21.15.88:0/3267509568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac840ad380 0x7fac840a9130 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fac74002f30 tx=0x7fac740088e0).stop 2020-02-11T16:27:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.278+0000 7fac89369700 1 -- 172.21.15.88:0/3267509568 shutdown_connections 2020-02-11T16:27:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.278+0000 7fac89369700 1 --2- 172.21.15.88:0/3267509568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac840ad380 0x7fac840a9130 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.278+0000 7fac89369700 1 --2- 172.21.15.88:0/3267509568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac84138280 0x7fac841386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.278+0000 7fac89369700 1 -- 172.21.15.88:0/3267509568 >> 172.21.15.88:0/3267509568 conn(0x7fac8405ac70 msgr2=0x7fac840ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.278+0000 7fac89369700 1 -- 172.21.15.88:0/3267509568 shutdown_connections 2020-02-11T16:27:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.278+0000 7fac89369700 1 -- 172.21.15.88:0/3267509568 wait complete. 2020-02-11T16:27:36.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.279+0000 7fac89369700 1 Processor -- start 2020-02-11T16:27:36.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.279+0000 7fac89369700 1 -- start start 2020-02-11T16:27:36.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac89369700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac89369700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8412e230 con 0x7fac840ad380 2020-02-11T16:27:36.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac89369700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8413aaf0 con 0x7fac84138280 2020-02-11T16:27:36.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac89369700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8413ad90 con 0x7fac8413b1c0 2020-02-11T16:27:36.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac827fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fac84138280 0x7fac84145090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47512/0 (socket says 172.21.15.88:47512) 2020-02-11T16:27:36.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac827fc700 1 -- 172.21.15.88:0/3992496927 learned_addr learned my addr 172.21.15.88:0/3992496927 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:36.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac837fe700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969268072 0 0) 0x7fac8413aaf0 con 0x7fac84138280 2020-02-11T16:27:36.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac60002fe0 con 0x7fac84138280 2020-02-11T16:27:36.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832185154 0 0) 0x7fac8412e230 con 0x7fac840ad380 2020-02-11T16:27:36.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac8413aaf0 con 0x7fac840ad380 2020-02-11T16:27:36.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac837fe700 1 -- 172.21.15.88:0/3992496927 >> v1:172.21.15.88:6789/0 conn(0x7fac84138280 legacy=0x7fac84145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac837fe700 1 -- 172.21.15.88:0/3992496927 >> v1:172.21.15.52:6789/0 conn(0x7fac840ad380 legacy=0x7fac8412db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac837fe700 1 -- 172.21.15.88:0/3992496927 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84144bf0 con 0x7fac8413b1c0 2020-02-11T16:27:36.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.280+0000 7fac837fe700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac7c001210 tx=0x7fac7c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac837fe700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac7c001210 tx=0x7fac7c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac837fe700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fac7c001210 tx=0x7fac7c010c30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac837fe700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fac7c001210 tx=0x7fac7c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7c006af0 con 0x7fac8413b1c0 2020-02-11T16:27:36.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac837fe700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fac7c001210 tx=0x7fac7c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c006c50 con 0x7fac8413b1c0 2020-02-11T16:27:36.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac837fe700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fac7c001210 tx=0x7fac7c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7c006dc0 con 0x7fac8413b1c0 2020-02-11T16:27:36.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac89369700 1 -- 172.21.15.88:0/3992496927 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac841325e0 con 0x7fac8413b1c0 2020-02-11T16:27:36.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac89369700 1 -- 172.21.15.88:0/3992496927 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac84066ea0 con 0x7fac8413b1c0 2020-02-11T16:27:36.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.281+0000 7fac837fe700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fac7c001210 tx=0x7fac7c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac89369700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 0x7fac84135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac89369700 1 -- 172.21.15.88:0/3992496927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8405e2f0 con 0x7fac8413a570 2020-02-11T16:27:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac837fe700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fac7c001210 tx=0x7fac7c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fac7c002730 con 0x7fac8413b1c0 2020-02-11T16:27:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 0x7fac84135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac73fff700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fac6003a0b0 0x7fac6003c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fac7c049a00 con 0x7fac8413b1c0 2020-02-11T16:27:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac827fc700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fac6003a0b0 0x7fac6003c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac82ffd700 1 -- 172.21.15.88:0/3992496927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac8413a980 con 0x7fac8413a570 2020-02-11T16:27:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 0x7fac84135b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 0x7fac84135b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 0x7fac84135b60 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.282+0000 7fac827fc700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fac6003a0b0 0x7fac6003c570 crc :-1 s=READY pgs=496 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.283+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 0x7fac84135b60 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.283+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac74007340 con 0x7fac8413a570 2020-02-11T16:27:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.283+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 0x7fac84135b60 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.283+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fac740074a0 con 0x7fac8413a570 2020-02-11T16:27:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.283+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 msgr2=0x7fac84135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.283+0000 7fac73fff700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 0x7fac84135b60 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).stop 2020-02-11T16:27:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.283+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 msgr2=0x7fac84135b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.283+0000 7fac73fff700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac8413a570 0x7fac84135b60 secure :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).stop 2020-02-11T16:27:36.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.295+0000 7fac89369700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 0x7fac841363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.295+0000 7fac89369700 1 -- 172.21.15.88:0/3992496927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac84144df0 con 0x7fac84135fc0 2020-02-11T16:27:36.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.296+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 0x7fac841363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.296+0000 7fac82ffd700 1 -- 172.21.15.88:0/3992496927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fac840565b0 con 0x7fac84135fc0 2020-02-11T16:27:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.296+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 0x7fac841363d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.296+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 0x7fac841363d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.296+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 0x7fac841363d0 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.296+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 0x7fac841363d0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.296+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7400d610 con 0x7fac84135fc0 2020-02-11T16:27:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac82ffd700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 0x7fac841363d0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4363 (secure 0 0 0) 0x7fac7400d770 con 0x7fac84135fc0 2020-02-11T16:27:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 msgr2=0x7fac841363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac73fff700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 0x7fac841363d0 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).stop 2020-02-11T16:27:36.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac73fff700 1 -- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 msgr2=0x7fac841363d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:36.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac73fff700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84135fc0 0x7fac841363d0 secure :-1 s=CLOSED pgs=320 cs=0 l=1 rx=0x7fac74007ed0 tx=0x7fac74011460).stop 2020-02-11T16:27:36.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac89369700 1 -- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fac6003a0b0 msgr2=0x7fac6003c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac89369700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fac6003a0b0 0x7fac6003c570 crc :-1 s=READY pgs=496 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac89369700 1 -- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 msgr2=0x7fac84134f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac89369700 1 --2- 172.21.15.88:0/3992496927 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fac8413b1c0 0x7fac84134f90 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fac7c001210 tx=0x7fac7c010c30).stop 2020-02-11T16:27:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac837fe700 1 -- 172.21.15.88:0/3992496927 reap_dead start 2020-02-11T16:27:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac837fe700 1 -- 172.21.15.88:0/3992496927 reap_dead start 2020-02-11T16:27:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac89369700 1 -- 172.21.15.88:0/3992496927 shutdown_connections 2020-02-11T16:27:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac89369700 1 -- 172.21.15.88:0/3992496927 >> 172.21.15.88:0/3992496927 conn(0x7fac8405ac70 msgr2=0x7fac84069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac89369700 1 -- 172.21.15.88:0/3992496927 shutdown_connections 2020-02-11T16:27:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.297+0000 7fac89369700 1 -- 172.21.15.88:0/3992496927 wait complete. 2020-02-11T16:27:36.303 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:27:36.304 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:36.304 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:36.304 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:27:36.304 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 174, 2020-02-11T16:27:36.304 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:27:36.304 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:27:36.304 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:27:36.304 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:27:36.305 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.305 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:27:36.305 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:36.305 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:27:36.305 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:27:36.305 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:36.305 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:36.306 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:36.306 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:36.306 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:36.306 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:36.306 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.306 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:27:36.306 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:27:36.306 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:36.307 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:36.307 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:36.307 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:36.307 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:36.307 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:36.307 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.308 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:27:36.308 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:27:36.308 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:27:36.308 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:27:36.308 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:27:36.308 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:27:36.308 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:36.309 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:36.309 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:27:36.309 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:27:36.309 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:36.309 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:27:36.309 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:36.309 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:36.309 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:36.310 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:36.310 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:36.310 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:36.310 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.310 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:27:36.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.311 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:27:36.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.311 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:36.311 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:36.311 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:36.311 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:36.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.312 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:36.312 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:27:36.312 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.312 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:36.312 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:27:36.313 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.313 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.313 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.313 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:27:36.313 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:27:36.313 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:36.313 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:36.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.314 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:36.314 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:36.314 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:36.314 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:36.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.315 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:36.315 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:27:36.315 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.315 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:36.315 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:27:36.316 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.316 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.316 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.316 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:27:36.316 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:27:36.316 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:36.316 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:36.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.317 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:36.317 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:36.317 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:36.317 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:36.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.317 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:36.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:27:36.318 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.318 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:36.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:27:36.318 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.318 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.319 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.319 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:27:36.319 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:27:36.319 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:36.319 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:36.319 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.319 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.320 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:27:36.320 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:27:36.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.320 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.320 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.320 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:36.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.321 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.321 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:27:36.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.321 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.321 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.322 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:36.322 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.322 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.322 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:27:36.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.322 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.322 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.322 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:27:36.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.323 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.323 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:27:36.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.323 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.323 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.323 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:27:36.324 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.324 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.324 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:27:36.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.324 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.324 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.324 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:36.325 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.325 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.325 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:27:36.326 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:27:36.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.453+0000 7f0db658f700 1 Processor -- start 2020-02-11T16:27:36.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.453+0000 7f0db658f700 1 -- start start 2020-02-11T16:27:36.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.454+0000 7f0db658f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 0x7f0db00a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.454+0000 7f0db658f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0db00a5410 0x7f0db00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.454+0000 7f0db658f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db00a4350 con 0x7f0db0131280 2020-02-11T16:27:36.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.454+0000 7f0db658f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db00a1e60 con 0x7f0db00a2fa0 2020-02-11T16:27:36.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.454+0000 7f0db658f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db00a3450 con 0x7f0db00a5410 2020-02-11T16:27:36.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.454+0000 7f0daf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0db00a5410 0x7f0db00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.454+0000 7f0daf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0db00a5410 0x7f0db00a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59898/0 (socket says 172.21.15.88:59898) 2020-02-11T16:27:36.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.454+0000 7f0daf7fe700 1 -- 172.21.15.88:0/2207362452 learned_addr learned my addr 172.21.15.88:0/2207362452 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:36.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daffff700 1 --2- 172.21.15.88:0/2207362452 >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 0x7f0db00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daf7fe700 1 -- 172.21.15.88:0/2207362452 >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 msgr2=0x7f0db00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:36.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daf7fe700 1 --2- 172.21.15.88:0/2207362452 >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 0x7f0db00a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daf7fe700 1 -- 172.21.15.88:0/2207362452 >> v1:172.21.15.88:6789/0 conn(0x7f0db0131280 legacy=0x7f0db01316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daf7fe700 1 -- 172.21.15.88:0/2207362452 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db00a3a40 con 0x7f0db00a5410 2020-02-11T16:27:36.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daf7fe700 1 --2- 172.21.15.88:0/2207362452 >> v2:172.21.15.88:3300/0 conn(0x7f0db00a5410 0x7f0db00a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0da4002f30 tx=0x7f0da4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daf7fe700 1 --2- 172.21.15.88:0/2207362452 >> v2:172.21.15.88:3300/0 conn(0x7f0db00a5410 0x7f0db00a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0da4002f30 tx=0x7f0da4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daf7fe700 1 --2- 172.21.15.88:0/2207362452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0db00a5410 0x7f0db00a5870 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f0da4002f30 tx=0x7f0da4007a40).ready entity=mon.1 client_cookie=122925a84e2e07a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daf7fe700 1 --2- 172.21.15.88:0/2207362452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0db00a5410 0x7f0db00a5870 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f0da4002f30 tx=0x7f0da4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daf7fe700 1 --2- 172.21.15.88:0/2207362452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0db00a5410 0x7f0db00a5870 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f0da4002f30 tx=0x7f0da4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daeffd700 1 -- 172.21.15.88:0/2207362452 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da4013880 con 0x7f0db00a5410 2020-02-11T16:27:36.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daf7fe700 1 --2- 172.21.15.88:0/2207362452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0db00a5410 0x7f0db00a5870 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f0da4002f30 tx=0x7f0da4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daeffd700 1 -- 172.21.15.88:0/2207362452 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da40139e0 con 0x7f0db00a5410 2020-02-11T16:27:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0daeffd700 1 -- 172.21.15.88:0/2207362452 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da4013d80 con 0x7f0db00a5410 2020-02-11T16:27:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0db658f700 1 -- 172.21.15.88:0/2207362452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0db00a5410 msgr2=0x7f0db00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.455+0000 7f0db658f700 1 --2- 172.21.15.88:0/2207362452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0db00a5410 0x7f0db00a5870 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f0da4002f30 tx=0x7f0da4007a40).stop 2020-02-11T16:27:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.456+0000 7f0db658f700 1 -- 172.21.15.88:0/2207362452 shutdown_connections 2020-02-11T16:27:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.456+0000 7f0db658f700 1 --2- 172.21.15.88:0/2207362452 >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 0x7f0db00a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.456+0000 7f0db658f700 1 --2- 172.21.15.88:0/2207362452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0db00a5410 0x7f0db00a5870 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.456+0000 7f0db658f700 1 -- 172.21.15.88:0/2207362452 >> 172.21.15.88:0/2207362452 conn(0x7f0db009d110 msgr2=0x7f0db009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.456+0000 7f0db658f700 1 -- 172.21.15.88:0/2207362452 shutdown_connections 2020-02-11T16:27:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.456+0000 7f0db658f700 1 -- 172.21.15.88:0/2207362452 wait complete. 2020-02-11T16:27:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.457+0000 7f0db658f700 1 Processor -- start 2020-02-11T16:27:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.457+0000 7f0db658f700 1 -- start start 2020-02-11T16:27:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.458+0000 7f0db658f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 0x7f0db0132ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.458+0000 7f0db658f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.458+0000 7f0db658f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db0133710 con 0x7f0db00a5410 2020-02-11T16:27:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.458+0000 7f0db658f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db01339b0 con 0x7f0db00a2fa0 2020-02-11T16:27:36.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.458+0000 7f0db658f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0133c50 con 0x7f0db0131280 2020-02-11T16:27:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.458+0000 7f0daffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 0x7f0db0132ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.458+0000 7f0daffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 0x7f0db0132ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45888/0 (socket says 172.21.15.88:45888) 2020-02-11T16:27:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.458+0000 7f0daffff700 1 -- 172.21.15.88:0/2277729954 learned_addr learned my addr 172.21.15.88:0/2277729954 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.458+0000 7f0db4b2c700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db4b2c700 1 -- 172.21.15.88:0/2277729954 >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 msgr2=0x7f0db0132ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db4b2c700 1 --2- 172.21.15.88:0/2277729954 >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 0x7f0db0132ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db4b2c700 1 -- 172.21.15.88:0/2277729954 >> v1:172.21.15.52:6789/0 conn(0x7f0db00a5410 legacy=0x7f0db0145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db4b2c700 1 -- 172.21.15.88:0/2277729954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db005a9a0 con 0x7f0db0131280 2020-02-11T16:27:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> v2:172.21.15.52:3300/0 conn(0x7f0db00a2fa0 0x7f0db0132ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:27:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db4b2c700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0db005ef00 tx=0x7f0da8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db4b2c700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0db005ef00 tx=0x7f0da8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db4b2c700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f0db005ef00 tx=0x7f0da8010ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db4b2c700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f0db005ef00 tx=0x7f0da8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da8012240 con 0x7f0db0131280 2020-02-11T16:27:36.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db4b2c700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f0db005ef00 tx=0x7f0da8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db4b2c700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f0db005ef00 tx=0x7f0da8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da80123a0 con 0x7f0db0131280 2020-02-11T16:27:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da80127c0 con 0x7f0db0131280 2020-02-11T16:27:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db658f700 1 -- 172.21.15.88:0/2277729954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db0145910 con 0x7f0db0131280 2020-02-11T16:27:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.459+0000 7f0db658f700 1 -- 172.21.15.88:0/2277729954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db01334a0 con 0x7f0db0131280 2020-02-11T16:27:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.460+0000 7f0db4b2c700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f0db005ef00 tx=0x7f0da8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.460+0000 7f0db658f700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 0x7f0db01387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.460+0000 7f0db658f700 1 -- 172.21.15.88:0/2277729954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db005e2f0 con 0x7f0db00a00f0 2020-02-11T16:27:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.460+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0da8012a30 con 0x7f0db0131280 2020-02-11T16:27:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.460+0000 7f0db4b2c700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f0db005ef00 tx=0x7f0da8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.460+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 0x7f0db01387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.460+0000 7f0dad7fa700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0d90039c70 0x7f0d9003c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.460+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f0da8049f70 con 0x7f0db0131280 2020-02-11T16:27:36.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0daf7fe700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0d90039c70 0x7f0d9003c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0daffff700 1 -- 172.21.15.88:0/2277729954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0db00565b0 con 0x7f0db00a00f0 2020-02-11T16:27:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 0x7f0db01387f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0daf7fe700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0d90039c70 0x7f0d9003c130 crc :-1 s=READY pgs=497 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 0x7f0db01387f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 0x7f0db01387f0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0011250).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 0x7f0db01387f0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da0012e40 con 0x7f0db00a00f0 2020-02-11T16:27:36.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 0x7f0db01387f0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f0da000aed0 con 0x7f0db00a00f0 2020-02-11T16:27:36.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 msgr2=0x7f0db01387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0dad7fa700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 0x7f0db01387f0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0011250).stop 2020-02-11T16:27:36.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 msgr2=0x7f0db01387f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:36.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.461+0000 7f0dad7fa700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a00f0 0x7f0db01387f0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0011250).stop 2020-02-11T16:27:36.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.472+0000 7f0db658f700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 0x7f0db00a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.472+0000 7f0db658f700 1 -- 172.21.15.88:0/2277729954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0145aa0 con 0x7f0db00a8160 2020-02-11T16:27:36.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.472+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 0x7f0db00a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.472+0000 7f0daffff700 1 -- 172.21.15.88:0/2277729954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0db005ccb0 con 0x7f0db00a8160 2020-02-11T16:27:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.472+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 0x7f0db00a8570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 0x7f0db00a8570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 0x7f0db00a8570 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0012fa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 0x7f0db00a8570 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da000a860 con 0x7f0db00a8160 2020-02-11T16:27:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0daffff700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 0x7f0db00a8570 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f0da000a9c0 con 0x7f0db00a8160 2020-02-11T16:27:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 msgr2=0x7f0db00a8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0dad7fa700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 0x7f0db00a8570 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f0da0003070 tx=0x7f0da0012fa0).stop 2020-02-11T16:27:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0dad7fa700 1 -- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 msgr2=0x7f0db00a8570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0dad7fa700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db00a8160 0x7f0db00a8570 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0db658f700 1 -- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0d90039c70 msgr2=0x7f0d9003c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0db658f700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0d90039c70 0x7f0d9003c130 crc :-1 s=READY pgs=497 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0db658f700 1 -- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 msgr2=0x7f0db009fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0db658f700 1 --2- 172.21.15.88:0/2277729954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0db0131280 0x7f0db009fc90 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f0db005ef00 tx=0x7f0da8010ba0).stop 2020-02-11T16:27:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0db4b2c700 1 -- 172.21.15.88:0/2277729954 reap_dead start 2020-02-11T16:27:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.473+0000 7f0db4b2c700 1 -- 172.21.15.88:0/2277729954 reap_dead start 2020-02-11T16:27:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.474+0000 7f0db658f700 1 -- 172.21.15.88:0/2277729954 shutdown_connections 2020-02-11T16:27:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.474+0000 7f0db658f700 1 -- 172.21.15.88:0/2277729954 >> 172.21.15.88:0/2277729954 conn(0x7f0db009d110 msgr2=0x7f0db00aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.474+0000 7f0db658f700 1 -- 172.21.15.88:0/2277729954 shutdown_connections 2020-02-11T16:27:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.474+0000 7f0db658f700 1 -- 172.21.15.88:0/2277729954 wait complete. 2020-02-11T16:27:36.481 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:27:36.481 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:36.481 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:36.481 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:27:36.481 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 174, 2020-02-11T16:27:36.481 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:27:36.482 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:27:36.482 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:27:36.482 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:27:36.482 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.482 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:27:36.482 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:36.482 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:27:36.482 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:27:36.483 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:36.483 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:36.483 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:36.483 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:36.483 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:36.483 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:36.484 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.484 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:27:36.484 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:27:36.484 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:36.484 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:36.484 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:36.484 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:36.485 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:36.485 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:36.485 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.485 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:27:36.485 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:27:36.485 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:27:36.486 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:27:36.486 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:27:36.486 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:27:36.486 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:36.486 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:36.486 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:27:36.486 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:27:36.486 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:36.487 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:27:36.487 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:36.487 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:36.487 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:36.487 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:36.487 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:36.487 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:27:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:27:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:36.488 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:27:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:27:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.490 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:27:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:27:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:36.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.492 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:27:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:27:36.493 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:27:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:27:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:36.494 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.495 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:27:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:27:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:36.496 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:27:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:27:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:36.497 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:27:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:27:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.498 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:27:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.499 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:27:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.500 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:27:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:27:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.501 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:27:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:27:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:36.502 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:36.503 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:36.503 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:27:36.504 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:27:36.504 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:27:36.505 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:27:36.505 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:27:36.505 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:27:36.505 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:27:36.514 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:27:36.514 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:27:36.514 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:27:36.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.676+0000 7f29a9702700 1 Processor -- start 2020-02-11T16:27:36.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.676+0000 7f29a9702700 1 -- start start 2020-02-11T16:27:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.677+0000 7f29a9702700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.677+0000 7f29a9702700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29a40a1e50 0x7f29a40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.677+0000 7f29a9702700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29a40a3ad0 0x7f29a4134e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.677+0000 7f29a9702700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a40a3f60 con 0x7f29a40a3ad0 2020-02-11T16:27:36.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.677+0000 7f29a9702700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a41382e0 con 0x7f29a40a1e50 2020-02-11T16:27:36.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.677+0000 7f29a9702700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a4138580 con 0x7f29a405c1f0 2020-02-11T16:27:36.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.677+0000 7f299bfff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f29a40a1e50 msgr2=0x7f29a40a3670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:27:36.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f299bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29a40a1e50 0x7f29a40a3670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:36.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:54238/0 (socket says 172.21.15.88:54238) 2020-02-11T16:27:36.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 -- 172.21.15.88:0/1068095895 learned_addr learned my addr 172.21.15.88:0/1068095895 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:36.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a37fe700 1 --2- 172.21.15.88:0/1068095895 >> v2:172.21.15.52:3300/0 conn(0x7f29a40a3ad0 0x7f29a4134e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 -- 172.21.15.88:0/1068095895 >> v2:172.21.15.88:3300/0 conn(0x7f29a40a1e50 msgr2=0x7f29a40a3670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:36.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 --2- 172.21.15.88:0/1068095895 >> v2:172.21.15.88:3300/0 conn(0x7f29a40a1e50 0x7f29a40a3670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 -- 172.21.15.88:0/1068095895 >> v2:172.21.15.52:3300/0 conn(0x7f29a40a3ad0 msgr2=0x7f29a4134e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:36.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 --2- 172.21.15.88:0/1068095895 >> v2:172.21.15.52:3300/0 conn(0x7f29a40a3ad0 0x7f29a4134e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 -- 172.21.15.88:0/1068095895 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a4138820 con 0x7f29a405c1f0 2020-02-11T16:27:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 --2- 172.21.15.88:0/1068095895 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2994002f30 tx=0x7f2994007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 --2- 172.21.15.88:0/1068095895 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2994002f30 tx=0x7f2994007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 --2- 172.21.15.88:0/1068095895 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f2994002f30 tx=0x7f2994007a40).ready entity=mon.2 client_cookie=e6d3cf3e9c4aa279 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 --2- 172.21.15.88:0/1068095895 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f2994002f30 tx=0x7f2994007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 --2- 172.21.15.88:0/1068095895 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f2994002f30 tx=0x7f2994007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a27fc700 1 -- 172.21.15.88:0/1068095895 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2994008e20 con 0x7f29a405c1f0 2020-02-11T16:27:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a2ffd700 1 --2- 172.21.15.88:0/1068095895 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f2994002f30 tx=0x7f2994007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a27fc700 1 -- 172.21.15.88:0/1068095895 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2994011860 con 0x7f29a405c1f0 2020-02-11T16:27:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a27fc700 1 -- 172.21.15.88:0/1068095895 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2994011c40 con 0x7f29a405c1f0 2020-02-11T16:27:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a9702700 1 -- 172.21.15.88:0/1068095895 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 msgr2=0x7f29a4137cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.678+0000 7f29a9702700 1 --2- 172.21.15.88:0/1068095895 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f2994002f30 tx=0x7f2994007a40).stop 2020-02-11T16:27:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.679+0000 7f29a9702700 1 -- 172.21.15.88:0/1068095895 shutdown_connections 2020-02-11T16:27:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.679+0000 7f29a9702700 1 --2- 172.21.15.88:0/1068095895 >> v2:172.21.15.52:3300/0 conn(0x7f29a40a3ad0 0x7f29a4134e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.679+0000 7f29a9702700 1 --2- 172.21.15.88:0/1068095895 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a405c1f0 0x7f29a4137cf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.679+0000 7f29a9702700 1 --2- 172.21.15.88:0/1068095895 >> v2:172.21.15.88:3300/0 conn(0x7f29a40a1e50 0x7f29a40a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.679+0000 7f29a9702700 1 -- 172.21.15.88:0/1068095895 >> 172.21.15.88:0/1068095895 conn(0x7f29a40ab400 msgr2=0x7f29a40a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.679+0000 7f29a9702700 1 -- 172.21.15.88:0/1068095895 shutdown_connections 2020-02-11T16:27:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.679+0000 7f29a9702700 1 -- 172.21.15.88:0/1068095895 wait complete. 2020-02-11T16:27:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.680+0000 7f29a9702700 1 Processor -- start 2020-02-11T16:27:36.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.680+0000 7f29a9702700 1 -- start start 2020-02-11T16:27:36.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f29a9702700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29a405c1f0 0x7f29a41373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f29a9702700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f29a9702700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a4144e50 con 0x7f29a40a3ad0 2020-02-11T16:27:36.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f29a9702700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a4137ce0 con 0x7f29a405c1f0 2020-02-11T16:27:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f29a9702700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a4148650 con 0x7f29a40a1e50 2020-02-11T16:27:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f29a2ffd700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f29a405c1f0 msgr2=0x7f29a41373d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:27:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f29a2ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29a405c1f0 0x7f29a41373d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f299bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f299bfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:54246/0 (socket says 172.21.15.88:54246) 2020-02-11T16:27:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f29a37fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f29a40a3ad0 0x7f29a4145320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39332/0 (socket says 172.21.15.88:39332) 2020-02-11T16:27:36.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f299bfff700 1 -- 172.21.15.88:0/115530748 learned_addr learned my addr 172.21.15.88:0/115530748 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:36.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f29a0ff9700 1 -- 172.21.15.88:0/115530748 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99733962 0 0) 0x7f29a4144e50 con 0x7f29a40a3ad0 2020-02-11T16:27:36.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f29a0ff9700 1 -- 172.21.15.88:0/115530748 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2988002fe0 con 0x7f29a40a3ad0 2020-02-11T16:27:36.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f299bfff700 1 -- 172.21.15.88:0/115530748 >> v2:172.21.15.88:3300/0 conn(0x7f29a405c1f0 msgr2=0x7f29a41373d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:36.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> v2:172.21.15.88:3300/0 conn(0x7f29a405c1f0 0x7f29a41373d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f299bfff700 1 -- 172.21.15.88:0/115530748 >> v1:172.21.15.52:6789/0 conn(0x7f29a40a3ad0 legacy=0x7f29a4145320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f299bfff700 1 -- 172.21.15.88:0/115530748 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a4133ab0 con 0x7f29a40a1e50 2020-02-11T16:27:36.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.681+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.682+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.682+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.682+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.682+0000 7f29a0ff9700 1 -- 172.21.15.88:0/115530748 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f298c008db0 con 0x7f29a40a1e50 2020-02-11T16:27:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.682+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.682+0000 7f29a0ff9700 1 -- 172.21.15.88:0/115530748 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c0037a0 con 0x7f29a40a1e50 2020-02-11T16:27:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.682+0000 7f29a9702700 1 -- 172.21.15.88:0/115530748 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a4137830 con 0x7f29a40a1e50 2020-02-11T16:27:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.682+0000 7f29a0ff9700 1 -- 172.21.15.88:0/115530748 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f298c003b80 con 0x7f29a40a1e50 2020-02-11T16:27:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.682+0000 7f29a9702700 1 -- 172.21.15.88:0/115530748 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a412d3c0 con 0x7f29a40a1e50 2020-02-11T16:27:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.682+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.683+0000 7f29a0ff9700 1 -- 172.21.15.88:0/115530748 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f298c012330 con 0x7f29a40a1e50 2020-02-11T16:27:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.683+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.683+0000 7f29a0ff9700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2988039f50 0x7f298803c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.683+0000 7f29a0ff9700 1 -- 172.21.15.88:0/115530748 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f298c0494a0 con 0x7f29a40a1e50 2020-02-11T16:27:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.683+0000 7f29a2ffd700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2988039f50 0x7f298803c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.683+0000 7f29a9702700 1 -- 172.21.15.88:0/115530748 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a4137b40 con 0x7f29a40a1e50 2020-02-11T16:27:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.683+0000 7f29a2ffd700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2988039f50 0x7f298803c410 crc :-1 s=READY pgs=498 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:36.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.687+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.687+0000 7f29a0ff9700 1 -- 172.21.15.88:0/115530748 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f29a4137b40 con 0x7f29a40a1e50 2020-02-11T16:27:36.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.958+0000 7f29a9702700 1 -- 172.21.15.88:0/115530748 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f29a41484b0 con 0x7f29a40a1e50 2020-02-11T16:27:36.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.958+0000 7f299bfff700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:36.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.958+0000 7f29a0ff9700 1 -- 172.21.15.88:0/115530748 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f29a41484b0 con 0x7f29a40a1e50 2020-02-11T16:27:36.962 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":174,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 -- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2988039f50 msgr2=0x7f298803c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2988039f50 0x7f298803c410 crc :-1 s=READY pgs=498 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 -- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 msgr2=0x7f29a4148af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f298c000b20 tx=0x7f298c010990).stop 2020-02-11T16:27:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 -- 172.21.15.88:0/115530748 shutdown_connections 2020-02-11T16:27:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2988039f50 0x7f298803c410 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 --2- 172.21.15.88:0/115530748 >> v2:172.21.15.88:3300/0 conn(0x7f29a405c1f0 0x7f29a41373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 --2- 172.21.15.88:0/115530748 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29a40a1e50 0x7f29a4148af0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 -- 172.21.15.88:0/115530748 >> 172.21.15.88:0/115530748 conn(0x7f29a40ab400 msgr2=0x7f29a4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:36.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 -- 172.21.15.88:0/115530748 shutdown_connections 2020-02-11T16:27:36.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:36.960+0000 7f29a9702700 1 -- 172.21.15.88:0/115530748 wait complete. 2020-02-11T16:27:36.974 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":174,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:39.975 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:27:40.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.094+0000 7fc0c5285700 1 Processor -- start 2020-02-11T16:27:40.096 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.094+0000 7fc0c5285700 1 -- start start 2020-02-11T16:27:40.099 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0c5285700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0c00a7230 0x7fc0c00a2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0c5285700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 0x7fc0c00a2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0c5285700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c00a48a0 con 0x7fc0c005fac0 2020-02-11T16:27:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0c5285700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c00a3c70 con 0x7fc0c00a7230 2020-02-11T16:27:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0c5285700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00a4fa0 con 0x7fc0c0135230 2020-02-11T16:27:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0be7fc700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fc0c00a7230 msgr2=0x7fc0c00a2010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:27:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0be7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0c00a7230 0x7fc0c00a2010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:40.100 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0beffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc0c005fac0 0x7fc0c0134b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39336/0 (socket says 172.21.15.88:39336) 2020-02-11T16:27:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0beffd700 1 -- 172.21.15.88:0/1592053618 learned_addr learned my addr 172.21.15.88:0/1592053618 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0bf7fe700 1 --2- 172.21.15.88:0/1592053618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 0x7fc0c00a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.095+0000 7fc0bdffb700 1 -- 172.21.15.88:0/1592053618 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734939086 0 0) 0x7fc0c00a48a0 con 0x7fc0c005fac0 2020-02-11T16:27:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bdffb700 1 -- 172.21.15.88:0/1592053618 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a4003230 con 0x7fc0c005fac0 2020-02-11T16:27:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bf7fe700 1 -- 172.21.15.88:0/1592053618 >> v2:172.21.15.88:3300/0 conn(0x7fc0c00a7230 msgr2=0x7fc0c00a2010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bf7fe700 1 --2- 172.21.15.88:0/1592053618 >> v2:172.21.15.88:3300/0 conn(0x7fc0c00a7230 0x7fc0c00a2010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:40.101 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bf7fe700 1 -- 172.21.15.88:0/1592053618 >> v1:172.21.15.52:6789/0 conn(0x7fc0c005fac0 legacy=0x7fc0c0134b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bf7fe700 1 -- 172.21.15.88:0/1592053618 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00a4d70 con 0x7fc0c0135230 2020-02-11T16:27:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bf7fe700 1 --2- 172.21.15.88:0/1592053618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 0x7fc0c00a2470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc0b80032b0 tx=0x7fc0b8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bf7fe700 1 --2- 172.21.15.88:0/1592053618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 0x7fc0c00a2470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc0b80032b0 tx=0x7fc0b8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bf7fe700 1 --2- 172.21.15.88:0/1592053618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 0x7fc0c00a2470 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fc0b80032b0 tx=0x7fc0b8008c60).ready entity=mon.2 client_cookie=4ed417935160a298 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bf7fe700 1 --2- 172.21.15.88:0/1592053618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 0x7fc0c00a2470 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fc0b80032b0 tx=0x7fc0b8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bdffb700 1 -- 172.21.15.88:0/1592053618 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0b800a350 con 0x7fc0c0135230 2020-02-11T16:27:40.102 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bf7fe700 1 --2- 172.21.15.88:0/1592053618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 0x7fc0c00a2470 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fc0b80032b0 tx=0x7fc0b8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bf7fe700 1 --2- 172.21.15.88:0/1592053618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 0x7fc0c00a2470 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fc0b80032b0 tx=0x7fc0b8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bdffb700 1 -- 172.21.15.88:0/1592053618 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b800a4b0 con 0x7fc0c0135230 2020-02-11T16:27:40.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0bdffb700 1 -- 172.21.15.88:0/1592053618 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0b800a850 con 0x7fc0c0135230 2020-02-11T16:27:40.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0c5285700 1 -- 172.21.15.88:0/1592053618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 msgr2=0x7fc0c00a2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:40.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0c5285700 1 --2- 172.21.15.88:0/1592053618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 0x7fc0c00a2470 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fc0b80032b0 tx=0x7fc0b8008c60).stop 2020-02-11T16:27:40.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0c5285700 1 -- 172.21.15.88:0/1592053618 shutdown_connections 2020-02-11T16:27:40.103 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0c5285700 1 --2- 172.21.15.88:0/1592053618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0c0135230 0x7fc0c00a2470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:40.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0c5285700 1 --2- 172.21.15.88:0/1592053618 >> v2:172.21.15.88:3300/0 conn(0x7fc0c00a7230 0x7fc0c00a2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:40.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.096+0000 7fc0c5285700 1 -- 172.21.15.88:0/1592053618 >> 172.21.15.88:0/1592053618 conn(0x7fc0c00a7a70 msgr2=0x7fc0c00a7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:40.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.097+0000 7fc0c5285700 1 -- 172.21.15.88:0/1592053618 shutdown_connections 2020-02-11T16:27:40.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.097+0000 7fc0c5285700 1 -- 172.21.15.88:0/1592053618 wait complete. 2020-02-11T16:27:40.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.097+0000 7fc0c5285700 1 Processor -- start 2020-02-11T16:27:40.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.097+0000 7fc0c5285700 1 -- start start 2020-02-11T16:27:40.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.098+0000 7fc0c5285700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0c00a7230 0x7fc0c00a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:40.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.098+0000 7fc0c5285700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0c0135230 0x7fc0c00a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:40.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.098+0000 7fc0c5285700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c009ff70 con 0x7fc0c005fac0 2020-02-11T16:27:40.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.098+0000 7fc0c5285700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c01416d0 con 0x7fc0c00a7230 2020-02-11T16:27:40.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.098+0000 7fc0c5285700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c00a01a0 con 0x7fc0c0135230 2020-02-11T16:27:40.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.098+0000 7fc0beffd700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fc0c005fac0 legacy=0x7fc0c0140df0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:40.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.098+0000 7fc0bf7fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fc0c0135230 msgr2=0x7fc0c00a0aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:27:40.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.098+0000 7fc0bf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0c0135230 0x7fc0c00a0aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:40.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.098+0000 7fc0be7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0c00a7230 0x7fc0c00a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:40.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0c00a7230 0x7fc0c00a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45922/0 (socket says 172.21.15.88:45922) 2020-02-11T16:27:40.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 -- 172.21.15.88:0/435148361 learned_addr learned my addr 172.21.15.88:0/435148361 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:40.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 -- 172.21.15.88:0/435148361 >> v2:172.21.15.88:3300/0 conn(0x7fc0c0135230 msgr2=0x7fc0c00a0aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:40.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> v2:172.21.15.88:3300/0 conn(0x7fc0c0135230 0x7fc0c00a0aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:40.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 -- 172.21.15.88:0/435148361 >> v1:172.21.15.88:6789/0 conn(0x7fc0c005fac0 legacy=0x7fc0c0140df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:40.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 -- 172.21.15.88:0/435148361 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00a0f00 con 0x7fc0c00a7230 2020-02-11T16:27:40.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> v2:172.21.15.52:3300/0 conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> v2:172.21.15.52:3300/0 conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:40.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0affff700 1 -- 172.21.15.88:0/435148361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0b4008d70 con 0x7fc0c00a7230 2020-02-11T16:27:40.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0affff700 1 -- 172.21.15.88:0/435148361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b40037a0 con 0x7fc0c00a7230 2020-02-11T16:27:40.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0affff700 1 -- 172.21.15.88:0/435148361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0b4003b80 con 0x7fc0c00a7230 2020-02-11T16:27:40.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0c5285700 1 -- 172.21.15.88:0/435148361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c00a19f0 con 0x7fc0c00a7230 2020-02-11T16:27:40.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.099+0000 7fc0c5285700 1 -- 172.21.15.88:0/435148361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c0061ac0 con 0x7fc0c00a7230 2020-02-11T16:27:40.112 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.100+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.100+0000 7fc0affff700 1 -- 172.21.15.88:0/435148361 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc0b4012310 con 0x7fc0c00a7230 2020-02-11T16:27:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.100+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.100+0000 7fc0c5285700 1 -- 172.21.15.88:0/435148361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c00565b0 con 0x7fc0c00a7230 2020-02-11T16:27:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.100+0000 7fc0affff700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc09c039b60 0x7fc09c03c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.100+0000 7fc0affff700 1 -- 172.21.15.88:0/435148361 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc0b4049580 con 0x7fc0c00a7230 2020-02-11T16:27:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.101+0000 7fc0beffd700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc09c039b60 0x7fc09c03c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.101+0000 7fc0beffd700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc09c039b60 0x7fc09c03c020 crc :-1 s=READY pgs=499 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.104+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.104+0000 7fc0affff700 1 -- 172.21.15.88:0/435148361 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc0b402eba0 con 0x7fc0c00a7230 2020-02-11T16:27:40.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.329+0000 7fc0c5285700 1 -- 172.21.15.88:0/435148361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc0c005cb20 con 0x7fc0c00a7230 2020-02-11T16:27:40.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.330+0000 7fc0be7fc700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:40.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.330+0000 7fc0affff700 1 -- 172.21.15.88:0/435148361 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fc0b40316b0 con 0x7fc0c00a7230 2020-02-11T16:27:40.333 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":174,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:40.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.331+0000 7fc0c5285700 1 -- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc09c039b60 msgr2=0x7fc09c03c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:40.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.331+0000 7fc0c5285700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc09c039b60 0x7fc09c03c020 crc :-1 s=READY pgs=499 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:40.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.331+0000 7fc0c5285700 1 -- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 msgr2=0x7fc0c00a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:40.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.331+0000 7fc0c5285700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 0x7fc0c00a0640 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7fc0c009e160 tx=0x7fc0b40109f0).stop 2020-02-11T16:27:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.331+0000 7fc0c5285700 1 -- 172.21.15.88:0/435148361 shutdown_connections 2020-02-11T16:27:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.331+0000 7fc0c5285700 1 --2- 172.21.15.88:0/435148361 >> v2:172.21.15.88:3300/0 conn(0x7fc0c0135230 0x7fc0c00a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.331+0000 7fc0c5285700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc09c039b60 0x7fc09c03c020 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.331+0000 7fc0c5285700 1 --2- 172.21.15.88:0/435148361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00a7230 0x7fc0c00a0640 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.331+0000 7fc0c5285700 1 -- 172.21.15.88:0/435148361 >> 172.21.15.88:0/435148361 conn(0x7fc0c00a7a70 msgr2=0x7fc0c01342c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.332+0000 7fc0c5285700 1 -- 172.21.15.88:0/435148361 shutdown_connections 2020-02-11T16:27:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:40.332+0000 7fc0c5285700 1 -- 172.21.15.88:0/435148361 wait complete. 2020-02-11T16:27:40.344 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":174,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:43.345 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:27:43.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.464+0000 7f759389e700 1 Processor -- start 2020-02-11T16:27:43.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.465+0000 7f759389e700 1 -- start start 2020-02-11T16:27:43.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.465+0000 7f759389e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 0x7f758c0a8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:43.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.465+0000 7f759389e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758c0a4af0 con 0x7f758c0a7c00 2020-02-11T16:27:43.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.465+0000 7f759389e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758c0a4d90 con 0x7f758c136750 2020-02-11T16:27:43.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.465+0000 7f759389e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c1302a0 con 0x7f758c0a3a90 2020-02-11T16:27:43.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.465+0000 7f7591e3b700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f758c136750 legacy=0x7f758c140370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:43.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f7590e39700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f758c0a7c00 0x7f758c136040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39350/0 (socket says 172.21.15.88:39350) 2020-02-11T16:27:43.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f7590e39700 1 -- 172.21.15.88:0/552739307 learned_addr learned my addr 172.21.15.88:0/552739307 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:43.469 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f759163a700 1 --2- 172.21.15.88:0/552739307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 0x7f758c0a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f759163a700 1 -- 172.21.15.88:0/552739307 >> v1:172.21.15.88:6789/0 conn(0x7f758c136750 legacy=0x7f758c140370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f759163a700 1 -- 172.21.15.88:0/552739307 >> v1:172.21.15.52:6789/0 conn(0x7f758c0a7c00 legacy=0x7f758c136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f759163a700 1 -- 172.21.15.88:0/552739307 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c0a5540 con 0x7f758c0a3a90 2020-02-11T16:27:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f759163a700 1 --2- 172.21.15.88:0/552739307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 0x7f758c0a8690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f758c0ad0c0 tx=0x7f75880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f759163a700 1 --2- 172.21.15.88:0/552739307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 0x7f758c0a8690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f758c0ad0c0 tx=0x7f75880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f759163a700 1 --2- 172.21.15.88:0/552739307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 0x7f758c0a8690 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f758c0ad0c0 tx=0x7f75880088e0).ready entity=mon.2 client_cookie=35eb4aad7d3b1942 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:43.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f759163a700 1 --2- 172.21.15.88:0/552739307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 0x7f758c0a8690 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f758c0ad0c0 tx=0x7f75880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.466+0000 7f757bfff700 1 -- 172.21.15.88:0/552739307 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7588008e40 con 0x7f758c0a3a90 2020-02-11T16:27:43.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f759163a700 1 --2- 172.21.15.88:0/552739307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 0x7f758c0a8690 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f758c0ad0c0 tx=0x7f75880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f759163a700 1 --2- 172.21.15.88:0/552739307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 0x7f758c0a8690 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f758c0ad0c0 tx=0x7f75880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f757bfff700 1 -- 172.21.15.88:0/552739307 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7588011660 con 0x7f758c0a3a90 2020-02-11T16:27:43.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f757bfff700 1 -- 172.21.15.88:0/552739307 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7588011a40 con 0x7f758c0a3a90 2020-02-11T16:27:43.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f759389e700 1 -- 172.21.15.88:0/552739307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 msgr2=0x7f758c0a8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:43.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f759389e700 1 --2- 172.21.15.88:0/552739307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 0x7f758c0a8690 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f758c0ad0c0 tx=0x7f75880088e0).stop 2020-02-11T16:27:43.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f759389e700 1 -- 172.21.15.88:0/552739307 shutdown_connections 2020-02-11T16:27:43.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f759389e700 1 --2- 172.21.15.88:0/552739307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a3a90 0x7f758c0a8690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:43.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f759389e700 1 -- 172.21.15.88:0/552739307 >> 172.21.15.88:0/552739307 conn(0x7f758c0ac2d0 msgr2=0x7f758c0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:43.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f759389e700 1 -- 172.21.15.88:0/552739307 shutdown_connections 2020-02-11T16:27:43.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.467+0000 7f759389e700 1 -- 172.21.15.88:0/552739307 wait complete. 2020-02-11T16:27:43.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.468+0000 7f759389e700 1 Processor -- start 2020-02-11T16:27:43.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.468+0000 7f759389e700 1 -- start start 2020-02-11T16:27:43.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f759389e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f758c0a3a90 0x7f758c139160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:43.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f759389e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:43.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f759389e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758c131690 con 0x7f758c136750 2020-02-11T16:27:43.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f759389e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758c1383b0 con 0x7f758c0a3a90 2020-02-11T16:27:43.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f759163a700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f758c0a3a90 msgr2=0x7f758c139160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:27:43.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f759389e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c131930 con 0x7f758c0a7c00 2020-02-11T16:27:43.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f759163a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f758c0a3a90 0x7f758c139160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:43.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f7591e3b700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f758c136750 legacy=0x7f758c1303e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:43.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f7590e39700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:43.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f7590e39700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:54274/0 (socket says 172.21.15.88:54274) 2020-02-11T16:27:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f7590e39700 1 -- 172.21.15.88:0/2958304270 learned_addr learned my addr 172.21.15.88:0/2958304270 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f7590e39700 1 -- 172.21.15.88:0/2958304270 >> v2:172.21.15.88:3300/0 conn(0x7f758c0a3a90 msgr2=0x7f758c139160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> v2:172.21.15.88:3300/0 conn(0x7f758c0a3a90 0x7f758c139160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f7590e39700 1 -- 172.21.15.88:0/2958304270 >> v1:172.21.15.88:6789/0 conn(0x7f758c136750 legacy=0x7f758c1303e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.469+0000 7f7590e39700 1 -- 172.21.15.88:0/2958304270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c1435e0 con 0x7f758c0a7c00 2020-02-11T16:27:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f757a7fc700 1 -- 172.21.15.88:0/2958304270 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f757c00c950 con 0x7f758c0a7c00 2020-02-11T16:27:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f757a7fc700 1 -- 172.21.15.88:0/2958304270 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c00cab0 con 0x7f758c0a7c00 2020-02-11T16:27:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f759389e700 1 -- 172.21.15.88:0/2958304270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c132c50 con 0x7f758c0a7c00 2020-02-11T16:27:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f757a7fc700 1 -- 172.21.15.88:0/2958304270 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f757c00ce90 con 0x7f758c0a7c00 2020-02-11T16:27:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f759389e700 1 -- 172.21.15.88:0/2958304270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c137110 con 0x7f758c0a7c00 2020-02-11T16:27:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.470+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.471+0000 7f757a7fc700 1 -- 172.21.15.88:0/2958304270 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f757c0055c0 con 0x7f758c0a7c00 2020-02-11T16:27:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.471+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.471+0000 7f757a7fc700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c039b90 0x7f756c03c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.471+0000 7f757a7fc700 1 -- 172.21.15.88:0/2958304270 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f757c049590 con 0x7f758c0a7c00 2020-02-11T16:27:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.471+0000 7f759163a700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c039b90 0x7f756c03c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.471+0000 7f759389e700 1 -- 172.21.15.88:0/2958304270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c0565b0 con 0x7f758c0a7c00 2020-02-11T16:27:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.471+0000 7f759163a700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c039b90 0x7f756c03c050 crc :-1 s=READY pgs=500 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.475+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.475+0000 7f757a7fc700 1 -- 172.21.15.88:0/2958304270 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f757c02eb50 con 0x7f758c0a7c00 2020-02-11T16:27:43.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.702+0000 7f759389e700 1 -- 172.21.15.88:0/2958304270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f758c0a59e0 con 0x7f758c0a7c00 2020-02-11T16:27:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.703+0000 7f7590e39700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:43.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.703+0000 7f757a7fc700 1 -- 172.21.15.88:0/2958304270 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f757c0080c0 con 0x7f758c0a7c00 2020-02-11T16:27:43.706 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":174,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:43.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 -- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c039b90 msgr2=0x7f756c03c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:43.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c039b90 0x7f756c03c050 crc :-1 s=READY pgs=500 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:43.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 -- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 msgr2=0x7f758c136cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:43.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f758c0aba10 tx=0x7f757c0013a0).stop 2020-02-11T16:27:43.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 -- 172.21.15.88:0/2958304270 shutdown_connections 2020-02-11T16:27:43.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f756c039b90 0x7f756c03c050 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:43.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 --2- 172.21.15.88:0/2958304270 >> v2:172.21.15.88:3300/0 conn(0x7f758c0a3a90 0x7f758c139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:43.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 --2- 172.21.15.88:0/2958304270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f758c0a7c00 0x7f758c136cb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:43.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 -- 172.21.15.88:0/2958304270 >> 172.21.15.88:0/2958304270 conn(0x7f758c0ac2d0 msgr2=0x7f758c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:43.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 -- 172.21.15.88:0/2958304270 shutdown_connections 2020-02-11T16:27:43.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:43.704+0000 7f759389e700 1 -- 172.21.15.88:0/2958304270 wait complete. 2020-02-11T16:27:43.717 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":174,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:46.491 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:27:46.494 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:27:46.719 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:27:46.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.842+0000 7f59d9f3c700 1 Processor -- start 2020-02-11T16:27:46.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.842+0000 7f59d9f3c700 1 -- start start 2020-02-11T16:27:46.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.843+0000 7f59d9f3c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:46.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.843+0000 7f59d9f3c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:46.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.843+0000 7f59d9f3c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d40adb40 con 0x7f59d413b1c0 2020-02-11T16:27:46.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.843+0000 7f59d9f3c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d4137bf0 con 0x7f59d4138280 2020-02-11T16:27:46.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.843+0000 7f59d9f3c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d4138b40 con 0x7f59d40ad380 2020-02-11T16:27:46.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.843+0000 7f59d3fff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f59d413b1c0 legacy=0x7f59d413b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:46.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d2ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:46.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d37fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:46.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d2ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:45942/0 (socket says 172.21.15.88:45942) 2020-02-11T16:27:46.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d37fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:54280/0 (socket says 172.21.15.88:54280) 2020-02-11T16:27:46.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 learned_addr learned my addr 172.21.15.88:0/1015636008 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:46.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:27:46.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:46.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:27:46.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:46.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:46.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:46.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:46.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:46.844+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:47.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.044+0000 7f59d3fff700 1 -- 172.21.15.88:0/1015636008 >> v1:172.21.15.88:6789/0 conn(0x7f59d413b1c0 legacy=0x7f59d413b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:47.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.045+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:47.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.045+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:47.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.045+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:27:47.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.045+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:47.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.045+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:47.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.045+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:27:47.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.045+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:27:47.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.045+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:47.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.045+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:47.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.045+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:27:47.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.445+0000 7f59d3fff700 1 -- 172.21.15.88:0/1015636008 >> v1:172.21.15.88:6789/0 conn(0x7f59d413b1c0 legacy=0x7f59d413b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:47.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.446+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:47.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.446+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:47.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.446+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:27:47.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.446+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:47.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.446+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:27:47.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.446+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:47.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.446+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:47.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.446+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:47.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.446+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:27:47.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:47.446+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:27:48.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.246+0000 7f59d3fff700 1 -- 172.21.15.88:0/1015636008 >> v1:172.21.15.88:6789/0 conn(0x7f59d413b1c0 legacy=0x7f59d413b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:48.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.247+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:48.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.247+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:48.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.247+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:27:48.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.247+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:48.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.247+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:48.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.247+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:27:48.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.247+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:48.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.247+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:27:48.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.247+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:48.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:48.247+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:27:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.847+0000 7f59d3fff700 1 -- 172.21.15.88:0/1015636008 >> v1:172.21.15.88:6789/0 conn(0x7f59d413b1c0 legacy=0x7f59d413b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:49.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.849+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:49.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.849+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:49.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.849+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:27:49.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.849+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:27:49.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.849+0000 7f59d2ffd700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:49.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.849+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:27:49.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.849+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:49.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.849+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:27:49.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.849+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:27:49.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:49.849+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:27:53.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.051+0000 7f59d3fff700 1 -- 172.21.15.88:0/1015636008 >> v1:172.21.15.88:6789/0 conn(0x7f59d413b1c0 legacy=0x7f59d413b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:53.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.053+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.053+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.053+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 msgr2=0x7f59d41386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.053+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.053+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 >> v1:172.21.15.88:6789/0 conn(0x7f59d413b1c0 legacy=0x7f59d413b600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.053+0000 7f59d37fe700 1 -- 172.21.15.88:0/1015636008 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4137de0 con 0x7f59d40ad380 2020-02-11T16:27:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.053+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:27:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.053+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59d40af2b0 tx=0x7f59c400ba00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.053+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59d40af2b0 tx=0x7f59c400ba00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.053+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f59d40af2b0 tx=0x7f59c400ba00).ready entity=mon.2 client_cookie=9cfff014d9d891a8 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f59d40af2b0 tx=0x7f59c400ba00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f59d40af2b0 tx=0x7f59c400ba00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d27fc700 1 -- 172.21.15.88:0/1015636008 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59c4011b90 con 0x7f59d40ad380 2020-02-11T16:27:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d37fe700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f59d40af2b0 tx=0x7f59c400ba00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d27fc700 1 -- 172.21.15.88:0/1015636008 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4011cf0 con 0x7f59d40ad380 2020-02-11T16:27:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d27fc700 1 -- 172.21.15.88:0/1015636008 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59c4011e60 con 0x7f59d40ad380 2020-02-11T16:27:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d9f3c700 1 -- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 msgr2=0x7f59d40a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d9f3c700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f59d40af2b0 tx=0x7f59c400ba00).stop 2020-02-11T16:27:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d9f3c700 1 -- 172.21.15.88:0/1015636008 shutdown_connections 2020-02-11T16:27:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d9f3c700 1 --2- 172.21.15.88:0/1015636008 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d40ad380 0x7f59d40a9130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d9f3c700 1 --2- 172.21.15.88:0/1015636008 >> v2:172.21.15.52:3300/0 conn(0x7f59d4138280 0x7f59d41386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d9f3c700 1 -- 172.21.15.88:0/1015636008 >> 172.21.15.88:0/1015636008 conn(0x7f59d405ac70 msgr2=0x7f59d40ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d9f3c700 1 -- 172.21.15.88:0/1015636008 shutdown_connections 2020-02-11T16:27:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.054+0000 7f59d9f3c700 1 -- 172.21.15.88:0/1015636008 wait complete. 2020-02-11T16:27:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.055+0000 7f59d9f3c700 1 Processor -- start 2020-02-11T16:27:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.056+0000 7f59d9f3c700 1 -- start start 2020-02-11T16:27:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.056+0000 7f59d9f3c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.056+0000 7f59d9f3c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d413a150 con 0x7f59d413b1c0 2020-02-11T16:27:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.056+0000 7f59d9f3c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d40670b0 con 0x7f59d40ad380 2020-02-11T16:27:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.056+0000 7f59d9f3c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d413ab00 con 0x7f59d4138280 2020-02-11T16:27:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.056+0000 7f59d37fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f59d40ad380 legacy=0x7f59d412dbd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.056+0000 7f59d3fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f59d413b1c0 0x7f59d412b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39402/0 (socket says 172.21.15.88:39402) 2020-02-11T16:27:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.056+0000 7f59d2ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.056+0000 7f59d3fff700 1 -- 172.21.15.88:0/2651816224 learned_addr learned my addr 172.21.15.88:0/2651816224 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d0ff9700 1 -- 172.21.15.88:0/2651816224 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944188306 0 0) 0x7f59cc004040 con 0x7f59d413b1c0 2020-02-11T16:27:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d2ffd700 1 -- 172.21.15.88:0/2651816224 >> v1:172.21.15.88:6789/0 conn(0x7f59d40ad380 legacy=0x7f59d412dbd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:53.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d2ffd700 1 -- 172.21.15.88:0/2651816224 >> v1:172.21.15.52:6789/0 conn(0x7f59d413b1c0 legacy=0x7f59d412b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d2ffd700 1 -- 172.21.15.88:0/2651816224 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d41398b0 con 0x7f59d4138280 2020-02-11T16:27:53.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d0ff9700 1 -- 172.21.15.88:0/2651816224 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59c8005e90 con 0x7f59d4138280 2020-02-11T16:27:53.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d0ff9700 1 -- 172.21.15.88:0/2651816224 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8007160 con 0x7f59d4138280 2020-02-11T16:27:53.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d0ff9700 1 -- 172.21.15.88:0/2651816224 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59c8007500 con 0x7f59d4138280 2020-02-11T16:27:53.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d9f3c700 1 -- 172.21.15.88:0/2651816224 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d4132c30 con 0x7f59d4138280 2020-02-11T16:27:53.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.057+0000 7f59d9f3c700 1 -- 172.21.15.88:0/2651816224 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d41330d0 con 0x7f59d4138280 2020-02-11T16:27:53.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.058+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.058+0000 7f59d0ff9700 1 -- 172.21.15.88:0/2651816224 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f59c80124e0 con 0x7f59d4138280 2020-02-11T16:27:53.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.058+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.058+0000 7f59d9f3c700 1 -- 172.21.15.88:0/2651816224 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d41396c0 con 0x7f59d4138280 2020-02-11T16:27:53.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.058+0000 7f59d0ff9700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f59b4039b70 0x7f59b403c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.058+0000 7f59d0ff9700 1 -- 172.21.15.88:0/2651816224 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f59c8049b00 con 0x7f59d4138280 2020-02-11T16:27:53.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.059+0000 7f59d37fe700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f59b4039b70 0x7f59b403c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.059+0000 7f59d37fe700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f59b4039b70 0x7f59b403c030 crc :-1 s=READY pgs=501 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.062+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.062+0000 7f59d0ff9700 1 -- 172.21.15.88:0/2651816224 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f59c802f0a0 con 0x7f59d4138280 2020-02-11T16:27:53.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.296+0000 7f59d9f3c700 1 -- 172.21.15.88:0/2651816224 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f59d40565b0 con 0x7f59d4138280 2020-02-11T16:27:53.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.297+0000 7f59d2ffd700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.297+0000 7f59d0ff9700 1 -- 172.21.15.88:0/2651816224 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f59c8031b70 con 0x7f59d4138280 2020-02-11T16:27:53.299 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":178,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.299+0000 7f59d9f3c700 1 -- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f59b4039b70 msgr2=0x7f59b403c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.299+0000 7f59d9f3c700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f59b4039b70 0x7f59b403c030 crc :-1 s=READY pgs=501 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.299+0000 7f59d9f3c700 1 -- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 msgr2=0x7f59d4139cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.299+0000 7f59d9f3c700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f59d4066f00 tx=0x7f59c8010e80).stop 2020-02-11T16:27:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.299+0000 7f59d9f3c700 1 -- 172.21.15.88:0/2651816224 shutdown_connections 2020-02-11T16:27:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.299+0000 7f59d9f3c700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f59b4039b70 0x7f59b403c030 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.299+0000 7f59d9f3c700 1 --2- 172.21.15.88:0/2651816224 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4138280 0x7f59d4139cf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.299+0000 7f59d9f3c700 1 -- 172.21.15.88:0/2651816224 >> 172.21.15.88:0/2651816224 conn(0x7f59d405ac70 msgr2=0x7f59d4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:53.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.299+0000 7f59d9f3c700 1 -- 172.21.15.88:0/2651816224 shutdown_connections 2020-02-11T16:27:53.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.299+0000 7f59d9f3c700 1 -- 172.21.15.88:0/2651816224 wait complete. 2020-02-11T16:27:53.312 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":178,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:27:53.312 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:27:53.312 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:27:53.442 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.441+0000 7fe799981700 1 Processor -- start 2020-02-11T16:27:53.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.441+0000 7fe799981700 1 -- start start 2020-02-11T16:27:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe799981700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 0x7fe7940a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe799981700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe794066af0 con 0x7fe7940a4ce0 2020-02-11T16:27:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe799981700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940a5180 con 0x7fe79409e840 2020-02-11T16:27:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe799981700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940a5a30 con 0x7fe79405fc80 2020-02-11T16:27:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe7937fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fe79409e840 legacy=0x7fe79413f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe792ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 0x7fe7940a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe7927fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe7940a4ce0 0x7fe7940a4050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39410/0 (socket says 172.21.15.88:39410) 2020-02-11T16:27:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe7927fc700 1 -- 172.21.15.88:0/3798187491 learned_addr learned my addr 172.21.15.88:0/3798187491 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe791ffb700 1 -- 172.21.15.88:0/3798187491 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013551804 0 0) 0x7fe794066af0 con 0x7fe7940a4ce0 2020-02-11T16:27:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe791ffb700 1 -- 172.21.15.88:0/3798187491 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe778003230 con 0x7fe7940a4ce0 2020-02-11T16:27:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe792ffd700 1 -- 172.21.15.88:0/3798187491 >> v1:172.21.15.88:6789/0 conn(0x7fe79409e840 legacy=0x7fe79413f430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:53.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.442+0000 7fe792ffd700 1 -- 172.21.15.88:0/3798187491 >> v1:172.21.15.52:6789/0 conn(0x7fe7940a4ce0 legacy=0x7fe7940a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe792ffd700 1 -- 172.21.15.88:0/3798187491 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7940a5420 con 0x7fe79405fc80 2020-02-11T16:27:53.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe792ffd700 1 --2- 172.21.15.88:0/3798187491 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 0x7fe7940a68b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe794060230 tx=0x7fe7840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe792ffd700 1 --2- 172.21.15.88:0/3798187491 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 0x7fe7940a68b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe794060230 tx=0x7fe7840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe792ffd700 1 --2- 172.21.15.88:0/3798187491 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 0x7fe7940a68b0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fe794060230 tx=0x7fe7840088e0).ready entity=mon.2 client_cookie=28412454f86db2d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe792ffd700 1 --2- 172.21.15.88:0/3798187491 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 0x7fe7940a68b0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fe794060230 tx=0x7fe7840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe791ffb700 1 -- 172.21.15.88:0/3798187491 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe784008e40 con 0x7fe79405fc80 2020-02-11T16:27:53.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe792ffd700 1 --2- 172.21.15.88:0/3798187491 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 0x7fe7940a68b0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fe794060230 tx=0x7fe7840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe792ffd700 1 --2- 172.21.15.88:0/3798187491 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 0x7fe7940a68b0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fe794060230 tx=0x7fe7840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe791ffb700 1 -- 172.21.15.88:0/3798187491 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7840115b0 con 0x7fe79405fc80 2020-02-11T16:27:53.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe791ffb700 1 -- 172.21.15.88:0/3798187491 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe784011950 con 0x7fe79405fc80 2020-02-11T16:27:53.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe799981700 1 -- 172.21.15.88:0/3798187491 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 msgr2=0x7fe7940a68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.443+0000 7fe799981700 1 --2- 172.21.15.88:0/3798187491 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 0x7fe7940a68b0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fe794060230 tx=0x7fe7840088e0).stop 2020-02-11T16:27:53.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.444+0000 7fe799981700 1 -- 172.21.15.88:0/3798187491 shutdown_connections 2020-02-11T16:27:53.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.444+0000 7fe799981700 1 --2- 172.21.15.88:0/3798187491 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe79405fc80 0x7fe7940a68b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.444+0000 7fe799981700 1 -- 172.21.15.88:0/3798187491 >> 172.21.15.88:0/3798187491 conn(0x7fe7940a7bb0 msgr2=0x7fe7940a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:53.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.444+0000 7fe799981700 1 -- 172.21.15.88:0/3798187491 shutdown_connections 2020-02-11T16:27:53.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.444+0000 7fe799981700 1 -- 172.21.15.88:0/3798187491 wait complete. 2020-02-11T16:27:53.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.445+0000 7fe799981700 1 Processor -- start 2020-02-11T16:27:53.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.445+0000 7fe799981700 1 -- start start 2020-02-11T16:27:53.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe799981700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe79409e840 0x7fe794113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe799981700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe794115a80 con 0x7fe7940a4ce0 2020-02-11T16:27:53.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe799981700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe794115d20 con 0x7fe79405fc80 2020-02-11T16:27:53.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe799981700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe794115770 con 0x7fe79409e840 2020-02-11T16:27:53.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe792ffd700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fe79405fc80 legacy=0x7fe794112d60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:53.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe7927fc700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fe79409e840 msgr2=0x7fe794113960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:27:53.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe7927fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe79409e840 0x7fe794113960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:53.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe7937fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe7940a4ce0 0x7fe794137870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39416/0 (socket says 172.21.15.88:39416) 2020-02-11T16:27:53.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe7937fe700 1 -- 172.21.15.88:0/4019613893 learned_addr learned my addr 172.21.15.88:0/4019613893 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:27:53.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532970485 0 0) 0x7fe794115a80 con 0x7fe7940a4ce0 2020-02-11T16:27:53.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.446+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe770002fe0 con 0x7fe7940a4ce0 2020-02-11T16:27:53.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 892838682 0 0) 0x7fe770002fe0 con 0x7fe7940a4ce0 2020-02-11T16:27:53.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe794115a80 con 0x7fe7940a4ce0 2020-02-11T16:27:53.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe78c004200 con 0x7fe7940a4ce0 2020-02-11T16:27:53.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 >> v2:172.21.15.88:3300/0 conn(0x7fe79409e840 msgr2=0x7fe794113960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:53.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 --2- 172.21.15.88:0/4019613893 >> v2:172.21.15.88:3300/0 conn(0x7fe79409e840 0x7fe794113960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 >> v1:172.21.15.88:6789/0 conn(0x7fe79405fc80 legacy=0x7fe794112d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:53.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 >> v1:172.21.15.52:6789/0 conn(0x7fe7940a4ce0 legacy=0x7fe794137870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7700049b0 0x7fe770004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe770003920 0x7fe770003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe794115770 con 0x7fe7700049b0 2020-02-11T16:27:53.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700053e0 con 0x7fe770003920 2020-02-11T16:27:53.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77000bbb0 con 0x7fe7700041e0 2020-02-11T16:27:53.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe7927fc700 1 -- 172.21.15.88:0/4019613893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe770003920 msgr2=0x7fe770003d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:27:53.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe7927fc700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe770003920 0x7fe770003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:27:53.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7700049b0 0x7fe770004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe7937fe700 1 -- 172.21.15.88:0/4019613893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe770003920 msgr2=0x7fe770003d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:53.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe770003920 0x7fe770003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe7937fe700 1 -- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7700049b0 msgr2=0x7fe770004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7700049b0 0x7fe770004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe7937fe700 1 -- 172.21.15.88:0/4019613893 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79405ae60 con 0x7fe7700041e0 2020-02-11T16:27:53.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7700049b0 0x7fe770004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:27:53.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe799981700 1 -- 172.21.15.88:0/4019613893 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7940a1800 con 0x7fe7700041e0 2020-02-11T16:27:53.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe78c003b00 tx=0x7fe78c011690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.447+0000 7fe799981700 1 -- 172.21.15.88:0/4019613893 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe794113f80 con 0x7fe7700041e0 2020-02-11T16:27:53.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe7937fe700 1 -- 172.21.15.88:0/4019613893 reap_dead start 2020-02-11T16:27:53.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe78c003b00 tx=0x7fe78c011690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fe78c003b00 tx=0x7fe78c011690).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fe78c003b00 tx=0x7fe78c011690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78c00a1a0 con 0x7fe7700041e0 2020-02-11T16:27:53.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fe78c003b00 tx=0x7fe78c011690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fe78c003b00 tx=0x7fe78c011690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00a300 con 0x7fe7700041e0 2020-02-11T16:27:53.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78c00a660 con 0x7fe7700041e0 2020-02-11T16:27:53.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe799981700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 0x7fe7740058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe799981700 1 -- 172.21.15.88:0/4019613893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe774005ea0 con 0x7fe774003420 2020-02-11T16:27:53.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fe78c003b00 tx=0x7fe78c011690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.448+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 0x7fe7740058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe78c00ed70 con 0x7fe7700041e0 2020-02-11T16:27:53.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe7937fe700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fe78c003b00 tx=0x7fe78c011690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe792ffd700 1 -- 172.21.15.88:0/4019613893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe774006060 con 0x7fe774003420 2020-02-11T16:27:53.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 0x7fe7740058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 0x7fe7740058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 0x7fe7740058e0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe783fff700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe77003da50 0x7fe77003ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe78c04a090 con 0x7fe7700041e0 2020-02-11T16:27:53.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 0x7fe7740058e0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe784007150 con 0x7fe774003420 2020-02-11T16:27:53.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe7927fc700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe77003da50 0x7fe77003ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 0x7fe7740058e0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fe7840072b0 con 0x7fe774003420 2020-02-11T16:27:53.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 msgr2=0x7fe7740058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe7927fc700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe77003da50 0x7fe77003ff10 crc :-1 s=READY pgs=502 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe783fff700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 0x7fe7740058e0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).stop 2020-02-11T16:27:53.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 msgr2=0x7fe7740058e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:53.468 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.449+0000 7fe783fff700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 0x7fe7740058e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.460+0000 7fe799981700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 0x7fe7740068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.460+0000 7fe799981700 1 -- 172.21.15.88:0/4019613893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe774006d80 con 0x7fe774006440 2020-02-11T16:27:53.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.460+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 0x7fe7740068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.460+0000 7fe792ffd700 1 -- 172.21.15.88:0/4019613893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe774006f40 con 0x7fe774006440 2020-02-11T16:27:53.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 0x7fe7740068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 0x7fe7740068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 0x7fe7740068f0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 0x7fe7740068f0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78400c730 con 0x7fe774006440 2020-02-11T16:27:53.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe792ffd700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 0x7fe7740068f0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4351 (secure 0 0 0) 0x7fe78400c890 con 0x7fe774006440 2020-02-11T16:27:53.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 msgr2=0x7fe7740068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe783fff700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 0x7fe7740068f0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7fe784007ed0 tx=0x7fe7940601d0).stop 2020-02-11T16:27:53.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe783fff700 1 -- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 msgr2=0x7fe7740068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:53.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.461+0000 7fe783fff700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 0x7fe7740068f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 -- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe77003da50 msgr2=0x7fe77003ff10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe77003da50 0x7fe77003ff10 crc :-1 s=READY pgs=502 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 -- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 msgr2=0x7fe77000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fe78c003b00 tx=0x7fe78c011690).stop 2020-02-11T16:27:53.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 -- 172.21.15.88:0/4019613893 shutdown_connections 2020-02-11T16:27:53.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe77003da50 0x7fe77003ff10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe7700041e0 0x7fe77000b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774003420 0x7fe7740058e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 --2- 172.21.15.88:0/4019613893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe774006440 0x7fe7740068f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 -- 172.21.15.88:0/4019613893 >> 172.21.15.88:0/4019613893 conn(0x7fe7940a7bb0 msgr2=0x7fe7940a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:53.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 -- 172.21.15.88:0/4019613893 shutdown_connections 2020-02-11T16:27:53.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.462+0000 7fe799981700 1 -- 172.21.15.88:0/4019613893 wait complete. 2020-02-11T16:27:53.475 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:27:53.475 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:53.476 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:53.476 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:27:53.476 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 178, 2020-02-11T16:27:53.476 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:27:53.476 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:27:53.476 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:27:53.476 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.477 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2020-02-11T16:27:53.477 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:53.477 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:27:53.477 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:27:53.477 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:53.477 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:53.477 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:53.478 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:53.478 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:53.478 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:53.478 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.478 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:27:53.478 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:27:53.479 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:53.479 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:53.479 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:53.479 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:53.479 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:53.479 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:53.480 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.480 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:27:53.480 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:27:53.480 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:27:53.480 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:27:53.480 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:27:53.481 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:27:53.481 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:53.481 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:53.481 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:27:53.481 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:27:53.481 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:53.482 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:27:53.482 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:53.482 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:53.482 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:53.482 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:53.482 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:53.483 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:53.483 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.483 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:27:53.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.483 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:27:53.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.483 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:53.484 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:53.484 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:53.484 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:53.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.484 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:53.484 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:27:53.485 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.485 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:53.485 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:27:53.485 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.486 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.486 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.486 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:27:53.486 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:27:53.486 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:53.487 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:53.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.487 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:53.487 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:53.487 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:53.488 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:53.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.488 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:53.488 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:27:53.488 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.488 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:53.489 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:27:53.489 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.489 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.489 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.489 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:27:53.489 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:27:53.490 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:53.490 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:53.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.490 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:53.490 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:53.491 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:53.491 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:53.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.491 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:53.491 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:27:53.491 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.492 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:53.492 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:27:53.492 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.492 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.492 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.493 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:27:53.493 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:27:53.493 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:53.493 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:53.493 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.493 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.494 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:27:53.494 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:27:53.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.494 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:53.494 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:53.494 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:53.495 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.495 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.495 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:27:53.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.495 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:53.495 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:53.495 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:53.496 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.496 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.496 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:27:53.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.496 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:53.496 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:53.496 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:27:53.497 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.497 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.497 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:27:53.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.497 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:53.497 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:53.497 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:27:53.498 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.498 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.498 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:27:53.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.498 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:53.498 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:53.498 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:53.499 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.499 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.499 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.499 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:27:53.500 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:27:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.627+0000 7f29b55c3700 1 Processor -- start 2020-02-11T16:27:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.627+0000 7f29b55c3700 1 -- start start 2020-02-11T16:27:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29b55c3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 0x7f29b00a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29b55c3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29b0138280 0x7f29b01386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:27:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29b55c3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00adb40 con 0x7f29b013b1c0 2020-02-11T16:27:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29b55c3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b0137bf0 con 0x7f29b0138280 2020-02-11T16:27:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29b55c3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b0138b40 con 0x7f29b00ad380 2020-02-11T16:27:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29af7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f29b013b1c0 legacy=0x7f29b013b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29b0138280 0x7f29b01386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29aeffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 0x7f29b00a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29b0138280 0x7f29b01386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46008/0 (socket says 172.21.15.88:46008) 2020-02-11T16:27:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 -- 172.21.15.88:0/60192465 learned_addr learned my addr 172.21.15.88:0/60192465 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 -- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 msgr2=0x7f29b00a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:27:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 0x7f29b00a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 -- 172.21.15.88:0/60192465 >> v1:172.21.15.88:6789/0 conn(0x7f29b013b1c0 legacy=0x7f29b013b600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:27:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 -- 172.21.15.88:0/60192465 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b0137de0 con 0x7f29b0138280 2020-02-11T16:27:53.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29aeffd700 1 --2- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 0x7f29b00a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:27:53.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/60192465 >> v2:172.21.15.52:3300/0 conn(0x7f29b0138280 0x7f29b01386e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f29b00af2b0 tx=0x7f29a40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/60192465 >> v2:172.21.15.52:3300/0 conn(0x7f29b0138280 0x7f29b01386e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f29b00af2b0 tx=0x7f29a40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b01386e0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f29b00af2b0 tx=0x7f29a40088e0).ready entity=mon.0 client_cookie=5387f6d8389f805d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b01386e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f29b00af2b0 tx=0x7f29a40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b01386e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f29b00af2b0 tx=0x7f29a40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29adffb700 1 -- 172.21.15.88:0/60192465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a4011670 con 0x7f29b0138280 2020-02-11T16:27:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b01386e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f29b00af2b0 tx=0x7f29a40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29adffb700 1 -- 172.21.15.88:0/60192465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a40117d0 con 0x7f29b0138280 2020-02-11T16:27:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29adffb700 1 -- 172.21.15.88:0/60192465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a4011b70 con 0x7f29b0138280 2020-02-11T16:27:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29b55c3700 1 -- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 msgr2=0x7f29b01386e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.628+0000 7f29b55c3700 1 --2- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b01386e0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f29b00af2b0 tx=0x7f29a40088e0).stop 2020-02-11T16:27:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.629+0000 7f29b55c3700 1 -- 172.21.15.88:0/60192465 shutdown_connections 2020-02-11T16:27:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.629+0000 7f29b55c3700 1 --2- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 0x7f29b00a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:27:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.629+0000 7f29b55c3700 1 --2- 172.21.15.88:0/60192465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b01386e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.629+0000 7f29b55c3700 1 -- 172.21.15.88:0/60192465 >> 172.21.15.88:0/60192465 conn(0x7f29b005ac70 msgr2=0x7f29b00ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.629+0000 7f29b55c3700 1 -- 172.21.15.88:0/60192465 shutdown_connections 2020-02-11T16:27:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.630+0000 7f29b55c3700 1 -- 172.21.15.88:0/60192465 wait complete. 2020-02-11T16:27:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.630+0000 7f29b55c3700 1 Processor -- start 2020-02-11T16:27:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.631+0000 7f29b55c3700 1 -- start start 2020-02-11T16:27:53.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.631+0000 7f29b55c3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 0x7f29b012ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.631+0000 7f29b55c3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29b0138280 0x7f29b012eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.631+0000 7f29b55c3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b0133560 con 0x7f29b013b1c0 2020-02-11T16:27:53.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.631+0000 7f29b55c3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b01307f0 con 0x7f29b0138280 2020-02-11T16:27:53.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.631+0000 7f29b55c3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b0132e60 con 0x7f29b00ad380 2020-02-11T16:27:53.642 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.631+0000 7f29af7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f29b013b1c0 legacy=0x7f29b012b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:27:53.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29b0138280 0x7f29b012eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29aeffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 0x7f29b012ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29b0138280 0x7f29b012eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46016/0 (socket says 172.21.15.88:46016) 2020-02-11T16:27:53.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 -- 172.21.15.88:0/856475786 learned_addr learned my addr 172.21.15.88:0/856475786 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:27:53.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 -- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 msgr2=0x7f29b012ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 0x7f29b012ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 -- 172.21.15.88:0/856475786 >> v1:172.21.15.88:6789/0 conn(0x7f29b013b1c0 legacy=0x7f29b012b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:27:53.643 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 -- 172.21.15.88:0/856475786 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b01330c0 con 0x7f29b0138280 2020-02-11T16:27:53.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b00ad380 0x7f29b012ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:27:53.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/856475786 >> v2:172.21.15.52:3300/0 conn(0x7f29b0138280 0x7f29b012eee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29b0132bf0 tx=0x7f29a4011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/856475786 >> v2:172.21.15.52:3300/0 conn(0x7f29b0138280 0x7f29b012eee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29b0132bf0 tx=0x7f29a4011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b012eee0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f29b0132bf0 tx=0x7f29a4011420).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b012eee0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f29b0132bf0 tx=0x7f29a4011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.632+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a4011af0 con 0x7f29b0138280 2020-02-11T16:27:53.644 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.633+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b012eee0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f29b0132bf0 tx=0x7f29a4011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.633+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a4007150 con 0x7f29b0138280 2020-02-11T16:27:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.633+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b012eee0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f29b0132bf0 tx=0x7f29a4011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.633+0000 7f29b55c3700 1 -- 172.21.15.88:0/856475786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b0130110 con 0x7f29b0138280 2020-02-11T16:27:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.633+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a40074b0 con 0x7f29b0138280 2020-02-11T16:27:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.633+0000 7f29b55c3700 1 -- 172.21.15.88:0/856475786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b012f920 con 0x7f29b0138280 2020-02-11T16:27:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.633+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b012eee0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f29b0132bf0 tx=0x7f29a4011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29b55c3700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 0x7f29b00654c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29b55c3700 1 -- 172.21.15.88:0/856475786 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b005e2f0 con 0x7f29b012bed0 2020-02-11T16:27:53.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f29a40056c0 con 0x7f29b0138280 2020-02-11T16:27:53.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29ae7fc700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b012eee0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f29b0132bf0 tx=0x7f29a4011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 0x7f29b00654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f299ffff700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f298c039bf0 0x7f298c03c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f29a4049d10 con 0x7f29b0138280 2020-02-11T16:27:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29af7fe700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f298c039bf0 0x7f298c03c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29aeffd700 1 -- 172.21.15.88:0/856475786 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29b01332a0 con 0x7f29b012bed0 2020-02-11T16:27:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 0x7f29b00654c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 0x7f29b00654c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 0x7f29b00654c0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0011320).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29af7fe700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f298c039bf0 0x7f298c03c0b0 crc :-1 s=READY pgs=503 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 0x7f29b00654c0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.634+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a0007350 con 0x7f29b012bed0 2020-02-11T16:27:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.635+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 0x7f29b00654c0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.635+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f29a00074b0 con 0x7f29b012bed0 2020-02-11T16:27:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.635+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 msgr2=0x7f29b00654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.635+0000 7f299ffff700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 0x7f29b00654c0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0011320).stop 2020-02-11T16:27:53.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.635+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 msgr2=0x7f29b00654c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:53.649 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.635+0000 7f299ffff700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b012bed0 0x7f29b00654c0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0011320).stop 2020-02-11T16:27:53.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.645+0000 7f29b55c3700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 0x7f29b0138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:27:53.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.645+0000 7f29b55c3700 1 -- 172.21.15.88:0/856475786 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00565b0 con 0x7f29b0066010 2020-02-11T16:27:53.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.645+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 0x7f29b0138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:27:53.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.645+0000 7f29aeffd700 1 -- 172.21.15.88:0/856475786 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f29b005ccb0 con 0x7f29b0066010 2020-02-11T16:27:53.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.645+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 0x7f29b0138fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.645+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 0x7f29b0138fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.645+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 0x7f29b0138fd0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0012fa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:27:53.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 0x7f29b0138fd0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a0008b00 con 0x7f29b0066010 2020-02-11T16:27:53.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f29aeffd700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 0x7f29b0138fd0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:27:53.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f29a000f1e0 con 0x7f29b0066010 2020-02-11T16:27:53.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 msgr2=0x7f29b0138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f299ffff700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 0x7f29b0138fd0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0012fa0).stop 2020-02-11T16:27:53.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f299ffff700 1 -- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 msgr2=0x7f29b0138fd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:27:53.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f299ffff700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f29b0066010 0x7f29b0138fd0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0x7f29a0002f30 tx=0x7f29a0012fa0).stop 2020-02-11T16:27:53.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f29b55c3700 1 -- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f298c039bf0 msgr2=0x7f298c03c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f29b55c3700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f298c039bf0 0x7f298c03c0b0 crc :-1 s=READY pgs=503 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.653 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f29b55c3700 1 -- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 msgr2=0x7f29b012eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:27:53.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f29b55c3700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b012eee0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f29b0132bf0 tx=0x7f29a4011420).stop 2020-02-11T16:27:53.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.646+0000 7f29af7fe700 1 -- 172.21.15.88:0/856475786 reap_dead start 2020-02-11T16:27:53.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.647+0000 7f29b55c3700 1 -- 172.21.15.88:0/856475786 shutdown_connections 2020-02-11T16:27:53.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.647+0000 7f29b55c3700 1 --2- 172.21.15.88:0/856475786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b0138280 0x7f29b012eee0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:27:53.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.647+0000 7f29b55c3700 1 -- 172.21.15.88:0/856475786 >> 172.21.15.88:0/856475786 conn(0x7f29b005ac70 msgr2=0x7f29b0131430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:27:53.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.647+0000 7f29b55c3700 1 -- 172.21.15.88:0/856475786 shutdown_connections 2020-02-11T16:27:53.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:27:53.647+0000 7f29b55c3700 1 -- 172.21.15.88:0/856475786 wait complete. 2020-02-11T16:27:53.655 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:27:53.655 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:53.655 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:53.655 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:27:53.655 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 178, 2020-02-11T16:27:53.656 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:27:53.656 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:27:53.656 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:27:53.656 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.656 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2020-02-11T16:27:53.656 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:27:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:27:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:27:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:27:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:27:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:27:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:27:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:27:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:27:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:27:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:27:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:27:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:27:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:27:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:27:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:27:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:27:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:27:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:27:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:27:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:27:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:27:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.663 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:27:53.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.663 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:27:53.663 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:27:53.663 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:53.663 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:53.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.664 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:53.664 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:27:53.664 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.664 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:53.665 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:27:53.665 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.665 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.665 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.665 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:27:53.665 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:27:53.665 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:53.666 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:53.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.666 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:27:53.666 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:27:53.666 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:53.666 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:53.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.667 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:53.667 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:27:53.667 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.667 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:53.668 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:27:53.668 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.668 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.668 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.668 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:27:53.669 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:27:53.669 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:53.669 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:53.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.669 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:27:53.669 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:27:53.670 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:27:53.670 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:27:53.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.670 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:27:53.670 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:27:53.670 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.671 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:27:53.671 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:27:53.671 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:27:53.671 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.671 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.672 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:27:53.672 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:27:53.672 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:27:53.672 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:27:53.672 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.672 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:27:53.673 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:27:53.673 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:27:53.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.673 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:53.673 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:53.673 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:53.673 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.674 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.674 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:27:53.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.674 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:53.674 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:53.674 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:53.675 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.675 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.675 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:27:53.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.675 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:53.675 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:53.676 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:27:53.681 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.681 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.681 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:27:53.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.682 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:53.682 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:53.682 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:27:53.682 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.682 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:27:53.682 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:27:53.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:27:53.682 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:27:53.683 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:27:53.683 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:27:53.683 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.683 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:27:53.683 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:27:53.683 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:27:53.684 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:28:13.685 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:28:13.685 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:28:13.685 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:28:13.686 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:28:13.688 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:28:13.689 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:28:13.689 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:28:13.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.814+0000 7ff9a98ad700 1 Processor -- start 2020-02-11T16:28:13.817 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.814+0000 7ff9a98ad700 1 -- start start 2020-02-11T16:28:13.821 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a98ad700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 0x7ff9a40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:13.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a98ad700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a6260 0x7ff9a412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:13.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a98ad700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a40a3570 con 0x7ff9a40a5de0 2020-02-11T16:28:13.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a98ad700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a40a3810 con 0x7ff9a40a6260 2020-02-11T16:28:13.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a98ad700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40a3ab0 con 0x7ff9a40a18a0 2020-02-11T16:28:13.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a6260 0x7ff9a412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:13.822 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a6260 0x7ff9a412eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60050/0 (socket says 172.21.15.88:60050) 2020-02-11T16:28:13.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a37fe700 1 -- 172.21.15.88:0/4243591090 learned_addr learned my addr 172.21.15.88:0/4243591090 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:13.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/4243591090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 0x7ff9a40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:13.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a37fe700 1 -- 172.21.15.88:0/4243591090 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a6260 msgr2=0x7ff9a412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:28:13.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a37fe700 1 -- 172.21.15.88:0/4243591090 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a6260 msgr2=0x7ff9a412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:13.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/4243591090 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a6260 0x7ff9a412eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:13.823 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.815+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/4243591090 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a6260 0x7ff9a412eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a27fc700 1 -- 172.21.15.88:0/4243591090 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776681918 0 0) 0x7ff9a40a3570 con 0x7ff9a40a5de0 2020-02-11T16:28:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a27fc700 1 -- 172.21.15.88:0/4243591090 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff984003230 con 0x7ff9a40a5de0 2020-02-11T16:28:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a2ffd700 1 -- 172.21.15.88:0/4243591090 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a6260 msgr2=0x7ff9a412eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:28:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/4243591090 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a6260 0x7ff9a412eab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a2ffd700 1 -- 172.21.15.88:0/4243591090 >> v1:172.21.15.52:6789/0 conn(0x7ff9a40a5de0 legacy=0x7ff9a412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a2ffd700 1 -- 172.21.15.88:0/4243591090 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40a3d50 con 0x7ff9a40a18a0 2020-02-11T16:28:13.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/4243591090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 0x7ff9a40a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff9a405bbc0 tx=0x7ff9940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/4243591090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 0x7ff9a40a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff9a405bbc0 tx=0x7ff9940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/4243591090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 0x7ff9a40a6dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7ff9a405bbc0 tx=0x7ff9940088e0).ready entity=mon.2 client_cookie=5ea709dad65551fe server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:13.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/4243591090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 0x7ff9a40a6dd0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff9a405bbc0 tx=0x7ff9940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a27fc700 1 -- 172.21.15.88:0/4243591090 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff994008e40 con 0x7ff9a40a18a0 2020-02-11T16:28:13.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/4243591090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 0x7ff9a40a6dd0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff9a405bbc0 tx=0x7ff9940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/4243591090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 0x7ff9a40a6dd0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff9a405bbc0 tx=0x7ff9940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a27fc700 1 -- 172.21.15.88:0/4243591090 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9940115b0 con 0x7ff9a40a18a0 2020-02-11T16:28:13.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a27fc700 1 -- 172.21.15.88:0/4243591090 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff994011990 con 0x7ff9a40a18a0 2020-02-11T16:28:13.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a98ad700 1 -- 172.21.15.88:0/4243591090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 msgr2=0x7ff9a40a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:13.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.816+0000 7ff9a98ad700 1 --2- 172.21.15.88:0/4243591090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 0x7ff9a40a6dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7ff9a405bbc0 tx=0x7ff9940088e0).stop 2020-02-11T16:28:13.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.817+0000 7ff9a98ad700 1 -- 172.21.15.88:0/4243591090 shutdown_connections 2020-02-11T16:28:13.826 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.817+0000 7ff9a98ad700 1 --2- 172.21.15.88:0/4243591090 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a6260 0x7ff9a412eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:13.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.817+0000 7ff9a98ad700 1 --2- 172.21.15.88:0/4243591090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a18a0 0x7ff9a40a6dd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:13.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.817+0000 7ff9a98ad700 1 -- 172.21.15.88:0/4243591090 >> 172.21.15.88:0/4243591090 conn(0x7ff9a409d110 msgr2=0x7ff9a409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:13.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.817+0000 7ff9a98ad700 1 -- 172.21.15.88:0/4243591090 shutdown_connections 2020-02-11T16:28:13.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.817+0000 7ff9a98ad700 1 -- 172.21.15.88:0/4243591090 wait complete. 2020-02-11T16:28:13.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a98ad700 1 Processor -- start 2020-02-11T16:28:13.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a98ad700 1 -- start start 2020-02-11T16:28:13.827 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a98ad700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a18a0 0x7ff9a4130510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:13.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a98ad700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:13.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a98ad700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a4146fd0 con 0x7ff9a40a5de0 2020-02-11T16:28:13.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a98ad700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a4135c50 con 0x7ff9a40a18a0 2020-02-11T16:28:13.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a98ad700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4135f20 con 0x7ff9a40a6260 2020-02-11T16:28:13.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a2ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a18a0 0x7ff9a4130510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:13.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a2ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a18a0 0x7ff9a4130510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60052/0 (socket says 172.21.15.88:60052) 2020-02-11T16:28:13.828 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff99bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff9a40a5de0 0x7ff9a41468c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47680/0 (socket says 172.21.15.88:47680) 2020-02-11T16:28:13.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a2ffd700 1 -- 172.21.15.88:0/1671987115 learned_addr learned my addr 172.21.15.88:0/1671987115 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:13.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a2ffd700 1 -- 172.21.15.88:0/1671987115 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a18a0 msgr2=0x7ff9a4130510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:28:13.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a2ffd700 1 -- 172.21.15.88:0/1671987115 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a18a0 msgr2=0x7ff9a4130510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:28:13.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/1671987115 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a18a0 0x7ff9a4130510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:13.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.818+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/1671987115 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a18a0 0x7ff9a4130510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:13.829 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.819+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.819+0000 7ff9a37fe700 1 -- 172.21.15.88:0/1671987115 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a18a0 msgr2=0x7ff9a4130510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:28:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.819+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a18a0 0x7ff9a4130510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.819+0000 7ff9a37fe700 1 -- 172.21.15.88:0/1671987115 >> v1:172.21.15.88:6789/0 conn(0x7ff9a40a5de0 legacy=0x7ff9a41468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a37fe700 1 -- 172.21.15.88:0/1671987115 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a41361c0 con 0x7ff9a40a6260 2020-02-11T16:28:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a0ff9700 1 -- 172.21.15.88:0/1671987115 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff99c00e8a0 con 0x7ff9a40a6260 2020-02-11T16:28:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a0ff9700 1 -- 172.21.15.88:0/1671987115 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c00ea00 con 0x7ff9a40a6260 2020-02-11T16:28:13.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a0ff9700 1 -- 172.21.15.88:0/1671987115 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff99c00eda0 con 0x7ff9a40a6260 2020-02-11T16:28:13.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a98ad700 1 -- 172.21.15.88:0/1671987115 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a4136460 con 0x7ff9a40a6260 2020-02-11T16:28:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a98ad700 1 -- 172.21.15.88:0/1671987115 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a4134f50 con 0x7ff9a40a6260 2020-02-11T16:28:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.820+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.821+0000 7ff9a0ff9700 1 -- 172.21.15.88:0/1671987115 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff99c005a40 con 0x7ff9a40a6260 2020-02-11T16:28:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.821+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.821+0000 7ff9a98ad700 1 -- 172.21.15.88:0/1671987115 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a40565b0 con 0x7ff9a40a6260 2020-02-11T16:28:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.821+0000 7ff9a0ff9700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff988039c40 0x7ff98803c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.821+0000 7ff9a0ff9700 1 -- 172.21.15.88:0/1671987115 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff99c049cc0 con 0x7ff9a40a6260 2020-02-11T16:28:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.821+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff988039c40 0x7ff98803c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.822+0000 7ff9a2ffd700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff988039c40 0x7ff98803c100 crc :-1 s=READY pgs=505 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.825+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:13.825+0000 7ff9a0ff9700 1 -- 172.21.15.88:0/1671987115 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff99c02f3a0 con 0x7ff9a40a6260 2020-02-11T16:28:14.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.067+0000 7ff9a98ad700 1 -- 172.21.15.88:0/1671987115 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff9a405ccb0 con 0x7ff9a40a6260 2020-02-11T16:28:14.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.068+0000 7ff9a37fe700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:14.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.068+0000 7ff9a0ff9700 1 -- 172.21.15.88:0/1671987115 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7ff99c031e70 con 0x7ff9a40a6260 2020-02-11T16:28:14.071 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":178,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:14.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 -- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff988039c40 msgr2=0x7ff98803c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:14.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff988039c40 0x7ff98803c100 crc :-1 s=READY pgs=505 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:14.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 -- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 msgr2=0x7ff9a4130970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:14.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7ff99c0032b0 tx=0x7ff99c010f20).stop 2020-02-11T16:28:14.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 -- 172.21.15.88:0/1671987115 shutdown_connections 2020-02-11T16:28:14.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff988039c40 0x7ff98803c100 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:14.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 --2- 172.21.15.88:0/1671987115 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff9a40a6260 0x7ff9a4130970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:14.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 --2- 172.21.15.88:0/1671987115 >> v2:172.21.15.88:3300/0 conn(0x7ff9a40a18a0 0x7ff9a4130510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:14.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 -- 172.21.15.88:0/1671987115 >> 172.21.15.88:0/1671987115 conn(0x7ff9a409d110 msgr2=0x7ff9a40a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:14.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 -- 172.21.15.88:0/1671987115 shutdown_connections 2020-02-11T16:28:14.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:14.069+0000 7ff9a98ad700 1 -- 172.21.15.88:0/1671987115 wait complete. 2020-02-11T16:28:14.084 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":178,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:16.575 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:28:16.578 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:28:17.085 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:28:17.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.217+0000 7f3b77944700 1 Processor -- start 2020-02-11T16:28:17.220 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.217+0000 7f3b77944700 1 -- start start 2020-02-11T16:28:17.221 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.218+0000 7f3b77944700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:17.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.218+0000 7f3b77944700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:17.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.218+0000 7f3b77944700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b700a4af0 con 0x7f3b700a7c00 2020-02-11T16:28:17.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.218+0000 7f3b77944700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b701302a0 con 0x7f3b700a3a90 2020-02-11T16:28:17.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.218+0000 7f3b77944700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b70135a20 con 0x7f3b70136750 2020-02-11T16:28:17.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.218+0000 7f3b74edf700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3b700a7c00 0x7f3b70136040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47700/0 (socket says 172.21.15.88:47700) 2020-02-11T16:28:17.222 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.218+0000 7f3b74edf700 1 -- 172.21.15.88:0/826143750 learned_addr learned my addr 172.21.15.88:0/826143750 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:17.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.218+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:17.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.219+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:17.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.219+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:28:17.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.219+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:17.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.219+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:17.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.219+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:17.223 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.219+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:28:17.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.219+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:17.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.219+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:17.224 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.219+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.420+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.420+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.420+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:28:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.420+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.420+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.420+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:28:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.420+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.420+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.420+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:28:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.420+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:28:17.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.821+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:17.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.821+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:17.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.821+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:28:17.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.821+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:17.824 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.821+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:17.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.821+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:28:17.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.821+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:17.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.821+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:17.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.821+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:28:17.825 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:17.821+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:28:18.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:18.622+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:18.625 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:18.622+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:18.622+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:28:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:18.622+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:18.622+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:18.622+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:28:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:18.622+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:28:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:18.622+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:18.622+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:18.622+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:28:20.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:20.224+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:20.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:20.224+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:20.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:20.224+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:28:20.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:20.224+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:20.224+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:20.224+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:28:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:20.224+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:28:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:20.224+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:20.224+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:20.224+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:28:21.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165735217 0 0) 0x7f3b700a4af0 con 0x7f3b700a7c00 2020-02-11T16:28:21.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b58003230 con 0x7f3b700a7c00 2020-02-11T16:28:21.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1934034657 0 0) 0x7f3b58003230 con 0x7f3b700a7c00 2020-02-11T16:28:21.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b700a8080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:28:21.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b700a8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:21.834 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 msgr2=0x7f3b700a8690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:28:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 --2- 172.21.15.88:0/826143750 >> v2:172.21.15.52:3300/0 conn(0x7f3b700a3a90 0x7f3b700a8690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b700a4d90 con 0x7f3b700a7c00 2020-02-11T16:28:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f3b600016d0 con 0x7f3b700a7c00 2020-02-11T16:28:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 >> v1:172.21.15.88:6789/0 conn(0x7f3b700a7c00 legacy=0x7f3b70136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b58003750 0x7f3b58003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b58004090 0x7f3b58004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b58004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b701302a0 con 0x7f3b58004090 2020-02-11T16:28:21.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58004fb0 con 0x7f3b58003750 2020-02-11T16:28:21.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58005170 con 0x7f3b70136750 2020-02-11T16:28:21.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b58003750 0x7f3b58003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:21.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b74edf700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b58004090 0x7f3b58004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:21.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.829+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b58004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:21.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 msgr2=0x7f3b58004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:21.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b58004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:21.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b58004090 msgr2=0x7f3b58004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:21.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b58004090 0x7f3b58004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:21.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 -- 172.21.15.88:0/826143750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b58003230 con 0x7f3b58003750 2020-02-11T16:28:21.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b70136750 0x7f3b58004b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:28:21.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b58003750 0x7f3b58003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b58003750 0x7f3b58003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b58003750 0x7f3b58003b70 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).ready entity=mon.1 client_cookie=857806147fd093e0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b58003750 0x7f3b58003b70 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6c010a90 con 0x7f3b58003750 2020-02-11T16:28:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b58003750 0x7f3b58003b70 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b5ffff700 1 -- 172.21.15.88:0/826143750 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c010bf0 con 0x7f3b58003750 2020-02-11T16:28:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b756e0700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b58003750 0x7f3b58003b70 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b77944700 1 -- 172.21.15.88:0/826143750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b58003750 msgr2=0x7f3b58003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b77944700 1 --2- 172.21.15.88:0/826143750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b58003750 0x7f3b58003b70 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).stop 2020-02-11T16:28:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.830+0000 7f3b75ee1700 1 -- 172.21.15.88:0/826143750 reap_dead start 2020-02-11T16:28:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.831+0000 7f3b77944700 1 -- 172.21.15.88:0/826143750 shutdown_connections 2020-02-11T16:28:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.831+0000 7f3b77944700 1 -- 172.21.15.88:0/826143750 >> 172.21.15.88:0/826143750 conn(0x7f3b700ac2d0 msgr2=0x7f3b700ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.831+0000 7f3b77944700 1 -- 172.21.15.88:0/826143750 shutdown_connections 2020-02-11T16:28:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.831+0000 7f3b77944700 1 -- 172.21.15.88:0/826143750 wait complete. 2020-02-11T16:28:21.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.832+0000 7f3b77944700 1 Processor -- start 2020-02-11T16:28:21.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.832+0000 7f3b77944700 1 -- start start 2020-02-11T16:28:21.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.832+0000 7f3b77944700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b70066f90 0x7f3b700a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:21.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.832+0000 7f3b77944700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b7012dbb0 0x7f3b7014d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:21.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b77944700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b700a6c70 con 0x7f3b70063c20 2020-02-11T16:28:21.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b77944700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b70065940 con 0x7f3b70066f90 2020-02-11T16:28:21.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b77944700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b700a6970 con 0x7f3b7012dbb0 2020-02-11T16:28:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b70066f90 0x7f3b700a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b74edf700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3b70063c20 0x7f3b7012d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47728/0 (socket says 172.21.15.88:47728) 2020-02-11T16:28:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b74edf700 1 -- 172.21.15.88:0/4052199293 learned_addr learned my addr 172.21.15.88:0/4052199293 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b75ee1700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b7012dbb0 0x7f3b7014d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 -- 172.21.15.88:0/4052199293 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b7012dbb0 msgr2=0x7f3b7014d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b7012dbb0 0x7f3b7014d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b5e7fc700 1 -- 172.21.15.88:0/4052199293 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780739528 0 0) 0x7f3b700a6c70 con 0x7f3b70063c20 2020-02-11T16:28:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 -- 172.21.15.88:0/4052199293 >> v1:172.21.15.88:6789/0 conn(0x7f3b70063c20 legacy=0x7f3b7012d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 -- 172.21.15.88:0/4052199293 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b700a2570 con 0x7f3b70066f90 2020-02-11T16:28:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> v2:172.21.15.88:3300/0 conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> v2:172.21.15.88:3300/0 conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b5e7fc700 1 -- 172.21.15.88:0/4052199293 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6c0077e0 con 0x7f3b70066f90 2020-02-11T16:28:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b5e7fc700 1 -- 172.21.15.88:0/4052199293 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c00ee60 con 0x7f3b70066f90 2020-02-11T16:28:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b77944700 1 -- 172.21.15.88:0/4052199293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b70066770 con 0x7f3b70066f90 2020-02-11T16:28:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b5e7fc700 1 -- 172.21.15.88:0/4052199293 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6c005aa0 con 0x7f3b70066f90 2020-02-11T16:28:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.833+0000 7f3b77944700 1 -- 172.21.15.88:0/4052199293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b700656a0 con 0x7f3b70066f90 2020-02-11T16:28:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.835+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.835+0000 7f3b77944700 1 -- 172.21.15.88:0/4052199293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b700a2960 con 0x7f3b70066f90 2020-02-11T16:28:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.835+0000 7f3b5e7fc700 1 -- 172.21.15.88:0/4052199293 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3b6c005d10 con 0x7f3b70066f90 2020-02-11T16:28:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.835+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.835+0000 7f3b5e7fc700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b50039bb0 0x7f3b5003c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.835+0000 7f3b5e7fc700 1 -- 172.21.15.88:0/4052199293 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3b6c04cbb0 con 0x7f3b70066f90 2020-02-11T16:28:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.835+0000 7f3b74edf700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b50039bb0 0x7f3b5003c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.836+0000 7f3b74edf700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b50039bb0 0x7f3b5003c070 crc :-1 s=READY pgs=506 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.840+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:21.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:21.840+0000 7f3b5e7fc700 1 -- 172.21.15.88:0/4052199293 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3b6c032100 con 0x7f3b70066f90 2020-02-11T16:28:22.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.111+0000 7f3b77944700 1 -- 172.21.15.88:0/4052199293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3b700565b0 con 0x7f3b70066f90 2020-02-11T16:28:22.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.111+0000 7f3b756e0700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.111+0000 7f3b5e7fc700 1 -- 172.21.15.88:0/4052199293 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f3b6c031cc0 con 0x7f3b70066f90 2020-02-11T16:28:22.115 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":186,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:22.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 -- 172.21.15.88:0/4052199293 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b50039bb0 msgr2=0x7f3b5003c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b50039bb0 0x7f3b5003c070 crc :-1 s=READY pgs=506 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 -- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 msgr2=0x7f3b700a2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 0x7f3b700a2c40 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f3b6c002f30 tx=0x7f3b6c00bbe0).stop 2020-02-11T16:28:22.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 -- 172.21.15.88:0/4052199293 shutdown_connections 2020-02-11T16:28:22.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f3b50039bb0 0x7f3b5003c070 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b7012dbb0 0x7f3b7014d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 --2- 172.21.15.88:0/4052199293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b70066f90 0x7f3b700a2c40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 -- 172.21.15.88:0/4052199293 >> 172.21.15.88:0/4052199293 conn(0x7f3b700ac2d0 msgr2=0x7f3b70069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:22.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 -- 172.21.15.88:0/4052199293 shutdown_connections 2020-02-11T16:28:22.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.113+0000 7f3b77944700 1 -- 172.21.15.88:0/4052199293 wait complete. 2020-02-11T16:28:22.126 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":186,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:22.127 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:28:22.127 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:28:22.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.263+0000 7fbf2359e700 1 Processor -- start 2020-02-11T16:28:22.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.263+0000 7fbf2359e700 1 -- start start 2020-02-11T16:28:22.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2359e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbf2405fc80 0x7fbf2413bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:22.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2359e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf241325d0 con 0x7fbf240670f0 2020-02-11T16:28:22.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2359e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2413b2f0 con 0x7fbf240a9750 2020-02-11T16:28:22.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2359e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf240a9bb0 con 0x7fbf2405fc80 2020-02-11T16:28:22.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf21d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbf240a9750 0x7fbf240669e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47734/0 (socket says 172.21.15.88:47734) 2020-02-11T16:28:22.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf21d9b700 1 -- 172.21.15.88:0/1542498759 learned_addr learned my addr 172.21.15.88:0/1542498759 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:22.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2259c700 1 --2- 172.21.15.88:0/1542498759 >> v2:172.21.15.52:3300/0 conn(0x7fbf2405fc80 0x7fbf2413bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991006483 0 0) 0x7fbf2413b2f0 con 0x7fbf240a9750 2020-02-11T16:28:22.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf08003230 con 0x7fbf240a9750 2020-02-11T16:28:22.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2282982799 0 0) 0x7fbf08003230 con 0x7fbf240a9750 2020-02-11T16:28:22.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 >> v2:172.21.15.52:3300/0 conn(0x7fbf2405fc80 msgr2=0x7fbf2413bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:22.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 --2- 172.21.15.88:0/1542498759 >> v2:172.21.15.52:3300/0 conn(0x7fbf2405fc80 0x7fbf2413bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:22.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 >> v1:172.21.15.52:6789/0 conn(0x7fbf240670f0 legacy=0x7fbf24142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2405c1a0 con 0x7fbf240a9750 2020-02-11T16:28:22.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fbf180016d0 con 0x7fbf240a9750 2020-02-11T16:28:22.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 >> v1:172.21.15.88:6789/0 conn(0x7fbf240a9750 legacy=0x7fbf240669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf08003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:22.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbf080044d0 0x7fbf08004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:22.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf08004db0 0x7fbf0800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:22.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240a9bb0 con 0x7fbf08004db0 2020-02-11T16:28:22.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf080041c0 con 0x7fbf08003720 2020-02-11T16:28:22.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.264+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0800bb80 con 0x7fbf080044d0 2020-02-11T16:28:22.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf08003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf22d9d700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf08004db0 0x7fbf0800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.273 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbf080044d0 0x7fbf08004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 -- 172.21.15.88:0/1542498759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbf080044d0 msgr2=0x7fbf08004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:22.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbf080044d0 0x7fbf08004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:22.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 -- 172.21.15.88:0/1542498759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf08004db0 msgr2=0x7fbf0800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:22.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf08004db0 0x7fbf0800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:22.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 -- 172.21.15.88:0/1542498759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf08003230 con 0x7fbf08003720 2020-02-11T16:28:22.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf22d9d700 1 -- 172.21.15.88:0/1542498759 reap_dead start 2020-02-11T16:28:22.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf08003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf08003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf08003b40 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).ready entity=mon.1 client_cookie=d60fac67e5c47a20 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf08003b40 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf08003b40 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2259c700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf08003b40 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf14008d00 con 0x7fbf08003720 2020-02-11T16:28:22.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14008e60 con 0x7fbf08003720 2020-02-11T16:28:22.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2159a700 1 -- 172.21.15.88:0/1542498759 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf14010ae0 con 0x7fbf08003720 2020-02-11T16:28:22.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2359e700 1 -- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 msgr2=0x7fbf08003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.265+0000 7fbf2359e700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf08003b40 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).stop 2020-02-11T16:28:22.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.266+0000 7fbf2359e700 1 -- 172.21.15.88:0/1542498759 shutdown_connections 2020-02-11T16:28:22.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.266+0000 7fbf2359e700 1 --2- 172.21.15.88:0/1542498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf08003b40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.266+0000 7fbf2359e700 1 -- 172.21.15.88:0/1542498759 >> 172.21.15.88:0/1542498759 conn(0x7fbf240aeea0 msgr2=0x7fbf240aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:22.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.266+0000 7fbf2359e700 1 -- 172.21.15.88:0/1542498759 shutdown_connections 2020-02-11T16:28:22.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.266+0000 7fbf2359e700 1 -- 172.21.15.88:0/1542498759 wait complete. 2020-02-11T16:28:22.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.267+0000 7fbf2359e700 1 Processor -- start 2020-02-11T16:28:22.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.267+0000 7fbf2359e700 1 -- start start 2020-02-11T16:28:22.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbf08003720 0x7fbf24148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2359e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbf2412f740 0x7fbf24148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2359e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbf24136100 0x7fbf241365b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2359e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf241373b0 con 0x7fbf2412f740 2020-02-11T16:28:22.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2359e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf240606c0 con 0x7fbf08003720 2020-02-11T16:28:22.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2359e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240a8ab0 con 0x7fbf24136100 2020-02-11T16:28:22.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbf08003720 0x7fbf24148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbf08003720 0x7fbf24148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60120/0 (socket says 172.21.15.88:60120) 2020-02-11T16:28:22.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 -- 172.21.15.88:0/480135870 learned_addr learned my addr 172.21.15.88:0/480135870 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:22.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> v2:172.21.15.52:3300/0 conn(0x7fbf2412f740 0x7fbf24148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf22d9d700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbf24136100 0x7fbf241365b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 -- 172.21.15.88:0/480135870 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbf24136100 msgr2=0x7fbf241365b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbf24136100 0x7fbf241365b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 -- 172.21.15.88:0/480135870 >> v2:172.21.15.52:3300/0 conn(0x7fbf2412f740 msgr2=0x7fbf24148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 --2- 172.21.15.88:0/480135870 >> v2:172.21.15.52:3300/0 conn(0x7fbf2412f740 0x7fbf24148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 -- 172.21.15.88:0/480135870 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf241300f0 con 0x7fbf08003720 2020-02-11T16:28:22.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 --2- 172.21.15.88:0/480135870 >> v2:172.21.15.88:3300/0 conn(0x7fbf08003720 0x7fbf24148810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 --2- 172.21.15.88:0/480135870 >> v2:172.21.15.88:3300/0 conn(0x7fbf08003720 0x7fbf24148810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.268+0000 7fbf2259c700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf24148810 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.269+0000 7fbf2259c700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf24148810 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.269+0000 7fbf2259c700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf24148810 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.269+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf14010e60 con 0x7fbf08003720 2020-02-11T16:28:22.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.269+0000 7fbf2259c700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf24148810 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.269+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14005ac0 con 0x7fbf08003720 2020-02-11T16:28:22.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.269+0000 7fbf2359e700 1 -- 172.21.15.88:0/480135870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2413af40 con 0x7fbf08003720 2020-02-11T16:28:22.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.269+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf14005e20 con 0x7fbf08003720 2020-02-11T16:28:22.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.269+0000 7fbf2359e700 1 -- 172.21.15.88:0/480135870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf24138af0 con 0x7fbf08003720 2020-02-11T16:28:22.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.269+0000 7fbf2259c700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf24148810 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.270+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fbf1400f1f0 con 0x7fbf08003720 2020-02-11T16:28:22.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.270+0000 7fbf2359e700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 0x7fbf2409de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.270+0000 7fbf2359e700 1 -- 172.21.15.88:0/480135870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf24138500 con 0x7fbf24136a10 2020-02-11T16:28:22.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.270+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 0x7fbf2409de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.270+0000 7fbf2259c700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf24148810 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.270+0000 7fbf137fe700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbf00039c10 0x7fbf0003c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.270+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fbf1404ca90 con 0x7fbf08003720 2020-02-11T16:28:22.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf21d9b700 1 -- 172.21.15.88:0/480135870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf24135e00 con 0x7fbf24136a10 2020-02-11T16:28:22.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf22d9d700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbf00039c10 0x7fbf0003c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 0x7fbf2409de30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 0x7fbf2409de30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 0x7fbf2409de30 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 0x7fbf2409de30 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf22d9d700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbf00039c10 0x7fbf0003c0d0 crc :-1 s=READY pgs=507 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf18010540 con 0x7fbf24136a10 2020-02-11T16:28:22.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 0x7fbf2409de30 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fbf1800e370 con 0x7fbf24136a10 2020-02-11T16:28:22.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 msgr2=0x7fbf2409de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf137fe700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 0x7fbf2409de30 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).stop 2020-02-11T16:28:22.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 msgr2=0x7fbf2409de30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:22.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.271+0000 7fbf137fe700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf24136a10 0x7fbf2409de30 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).stop 2020-02-11T16:28:22.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.283+0000 7fbf2359e700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 0x7fbf2412c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.283+0000 7fbf2359e700 1 -- 172.21.15.88:0/480135870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2405e2f0 con 0x7fbf2412c180 2020-02-11T16:28:22.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.283+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 0x7fbf2412c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.283+0000 7fbf21d9b700 1 -- 172.21.15.88:0/480135870 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbf240565b0 con 0x7fbf2412c180 2020-02-11T16:28:22.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.283+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 0x7fbf2412c590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.283+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 0x7fbf2412c590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.283+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 0x7fbf2412c590 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.283+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 0x7fbf2412c590 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.283+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf18004a20 con 0x7fbf2412c180 2020-02-11T16:28:22.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf21d9b700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 0x7fbf2412c590 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7fbf18004b80 con 0x7fbf2412c180 2020-02-11T16:28:22.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 msgr2=0x7fbf2412c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf137fe700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 0x7fbf2412c590 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).stop 2020-02-11T16:28:22.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf137fe700 1 -- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 msgr2=0x7fbf2412c590 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:22.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf137fe700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2412c180 0x7fbf2412c590 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0x7fbf180013e0 tx=0x7fbf240a9cf0).stop 2020-02-11T16:28:22.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf2359e700 1 -- 172.21.15.88:0/480135870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbf00039c10 msgr2=0x7fbf0003c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf2359e700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbf00039c10 0x7fbf0003c0d0 crc :-1 s=READY pgs=507 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf2359e700 1 -- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 msgr2=0x7fbf24148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf2359e700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf24148810 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fbf080054a0 tx=0x7fbf14010080).stop 2020-02-11T16:28:22.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.284+0000 7fbf22d9d700 1 -- 172.21.15.88:0/480135870 reap_dead start 2020-02-11T16:28:22.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.285+0000 7fbf2359e700 1 -- 172.21.15.88:0/480135870 shutdown_connections 2020-02-11T16:28:22.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.285+0000 7fbf2359e700 1 --2- 172.21.15.88:0/480135870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf08003720 0x7fbf24148810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.285+0000 7fbf2359e700 1 -- 172.21.15.88:0/480135870 >> 172.21.15.88:0/480135870 conn(0x7fbf240aeea0 msgr2=0x7fbf24069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:22.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.285+0000 7fbf2359e700 1 -- 172.21.15.88:0/480135870 shutdown_connections 2020-02-11T16:28:22.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.285+0000 7fbf2359e700 1 -- 172.21.15.88:0/480135870 wait complete. 2020-02-11T16:28:22.300 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:28:22.300 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:22.300 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:22.301 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:28:22.301 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 186, 2020-02-11T16:28:22.301 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:28:22.301 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:28:22.301 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:28:22.301 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:28:22.301 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.302 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:28:22.302 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:22.302 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:28:22.302 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:28:22.302 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:22.302 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:22.302 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:22.303 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:22.303 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:22.303 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:22.303 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.303 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:28:22.303 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:28:22.303 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:22.304 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:22.304 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:22.304 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:22.304 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:22.304 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:22.304 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.305 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:28:22.305 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:28:22.305 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:28:22.305 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:28:22.305 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:28:22.305 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:28:22.306 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:22.306 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:22.306 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:28:22.306 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:28:22.306 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:22.306 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:28:22.306 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:22.306 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:22.307 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:22.307 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:22.307 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:22.307 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:22.307 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.307 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:28:22.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.308 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:28:22.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.308 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:22.308 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:22.309 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:22.309 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:22.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.309 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:22.309 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:28:22.309 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.310 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:22.310 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:28:22.310 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.310 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.311 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.311 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:28:22.311 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:28:22.311 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:22.311 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:22.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.312 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:22.312 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:22.312 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:22.312 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:22.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.313 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:22.313 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:28:22.313 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.313 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:22.313 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:28:22.314 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.314 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.314 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:28:22.314 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:28:22.314 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:22.314 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:22.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.315 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:28:22.315 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:28:22.315 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:22.315 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:22.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.316 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:22.316 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:28:22.316 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.316 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:22.316 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:28:22.317 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.317 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.317 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.317 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:28:22.317 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:28:22.317 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:22.317 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:22.318 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.318 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.318 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:28:22.318 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:28:22.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.318 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.319 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.319 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:22.319 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.319 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.319 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:28:22.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.319 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.320 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.320 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:28:22.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.320 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.320 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:28:22.321 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:28:22.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.461+0000 7f52ab627700 1 Processor -- start 2020-02-11T16:28:22.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.461+0000 7f52ab627700 1 -- start start 2020-02-11T16:28:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52ab627700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f52a40a18a0 0x7f52a40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52ab627700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52a40a6260 0x7f52a412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52ab627700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40a3570 con 0x7f52a40a5de0 2020-02-11T16:28:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52ab627700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40a3810 con 0x7f52a40a18a0 2020-02-11T16:28:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52ab627700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40a3ab0 con 0x7f52a40a6260 2020-02-11T16:28:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a9bc4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52a40a6260 0x7f52a412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a9bc4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52a40a6260 0x7f52a412eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60134/0 (socket says 172.21.15.88:60134) 2020-02-11T16:28:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a9bc4700 1 -- 172.21.15.88:0/3058777200 learned_addr learned my addr 172.21.15.88:0/3058777200 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3058777200 >> v2:172.21.15.52:3300/0 conn(0x7f52a40a18a0 0x7f52a40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a9bc4700 1 -- 172.21.15.88:0/3058777200 >> v2:172.21.15.52:3300/0 conn(0x7f52a40a18a0 msgr2=0x7f52a40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3058777200 >> v2:172.21.15.52:3300/0 conn(0x7f52a40a18a0 0x7f52a40a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a9bc4700 1 -- 172.21.15.88:0/3058777200 >> v1:172.21.15.52:6789/0 conn(0x7f52a40a5de0 legacy=0x7f52a412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a9bc4700 1 -- 172.21.15.88:0/3058777200 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40a3d50 con 0x7f52a40a6260 2020-02-11T16:28:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3058777200 >> v2:172.21.15.52:3300/0 conn(0x7f52a40a18a0 0x7f52a40a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:28:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3058777200 >> v2:172.21.15.88:3300/0 conn(0x7f52a40a6260 0x7f52a412eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52a405bbc0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3058777200 >> v2:172.21.15.88:3300/0 conn(0x7f52a40a6260 0x7f52a412eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52a405bbc0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.462+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3058777200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a6260 0x7f52a412eab0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f52a405bbc0 tx=0x7f529c007dc0).ready entity=mon.1 client_cookie=ac976b27df9d2fca server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3058777200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a6260 0x7f52a412eab0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f52a405bbc0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3058777200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a6260 0x7f52a412eab0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f52a405bbc0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f5293fff700 1 -- 172.21.15.88:0/3058777200 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f529c00a160 con 0x7f52a40a6260 2020-02-11T16:28:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3058777200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a6260 0x7f52a412eab0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f52a405bbc0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f5293fff700 1 -- 172.21.15.88:0/3058777200 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c00a2c0 con 0x7f52a40a6260 2020-02-11T16:28:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f5293fff700 1 -- 172.21.15.88:0/3058777200 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f529c00a6a0 con 0x7f52a40a6260 2020-02-11T16:28:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52ab627700 1 -- 172.21.15.88:0/3058777200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a6260 msgr2=0x7f52a412eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52ab627700 1 --2- 172.21.15.88:0/3058777200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a6260 0x7f52a412eab0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f52a405bbc0 tx=0x7f529c007dc0).stop 2020-02-11T16:28:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52ab627700 1 -- 172.21.15.88:0/3058777200 shutdown_connections 2020-02-11T16:28:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52ab627700 1 --2- 172.21.15.88:0/3058777200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a6260 0x7f52a412eab0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52ab627700 1 --2- 172.21.15.88:0/3058777200 >> v2:172.21.15.52:3300/0 conn(0x7f52a40a18a0 0x7f52a40a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52ab627700 1 -- 172.21.15.88:0/3058777200 >> 172.21.15.88:0/3058777200 conn(0x7f52a409d110 msgr2=0x7f52a409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52ab627700 1 -- 172.21.15.88:0/3058777200 shutdown_connections 2020-02-11T16:28:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.463+0000 7f52ab627700 1 -- 172.21.15.88:0/3058777200 wait complete. 2020-02-11T16:28:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.465+0000 7f52ab627700 1 Processor -- start 2020-02-11T16:28:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.465+0000 7f52ab627700 1 -- start start 2020-02-11T16:28:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.465+0000 7f52ab627700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52a40a18a0 0x7f52a4065700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.465+0000 7f52ab627700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52a40a5de0 0x7f52a4134c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.465+0000 7f52ab627700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a4139000 con 0x7f52a40a6260 2020-02-11T16:28:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.465+0000 7f52ab627700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a412f4c0 con 0x7f52a40a18a0 2020-02-11T16:28:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.465+0000 7f52ab627700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a41306e0 con 0x7f52a40a5de0 2020-02-11T16:28:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.465+0000 7f52a93c3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52a40a18a0 0x7f52a4065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.465+0000 7f52a93c3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52a40a18a0 0x7f52a4065700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60136/0 (socket says 172.21.15.88:60136) 2020-02-11T16:28:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.465+0000 7f52a93c3700 1 -- 172.21.15.88:0/3043334477 learned_addr learned my addr 172.21.15.88:0/3043334477 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a8bc2700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52a40a5de0 0x7f52a4134c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a93c3700 1 -- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52a40a5de0 msgr2=0x7f52a4134c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52a40a5de0 0x7f52a4134c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a93c3700 1 -- 172.21.15.88:0/3043334477 >> v1:172.21.15.52:6789/0 conn(0x7f52a40a6260 legacy=0x7f52a41293d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a93c3700 1 -- 172.21.15.88:0/3043334477 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a41302b0 con 0x7f52a40a18a0 2020-02-11T16:28:22.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a8bc2700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52a40a5de0 0x7f52a4134c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:28:22.478 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3043334477 >> v2:172.21.15.88:3300/0 conn(0x7f52a40a18a0 0x7f52a4065700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52a41305f0 tx=0x7f52a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3043334477 >> v2:172.21.15.88:3300/0 conn(0x7f52a40a18a0 0x7f52a4065700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52a41305f0 tx=0x7f52a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a18a0 0x7f52a4065700 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f52a41305f0 tx=0x7f52a0010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a18a0 0x7f52a4065700 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f52a41305f0 tx=0x7f52a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a18a0 0x7f52a4065700 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f52a41305f0 tx=0x7f52a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52a0008e80 con 0x7f52a40a18a0 2020-02-11T16:28:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a18a0 0x7f52a4065700 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f52a41305f0 tx=0x7f52a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a0007160 con 0x7f52a40a18a0 2020-02-11T16:28:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52a0007540 con 0x7f52a40a18a0 2020-02-11T16:28:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52ab627700 1 -- 172.21.15.88:0/3043334477 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a4130930 con 0x7f52a40a18a0 2020-02-11T16:28:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.466+0000 7f52ab627700 1 -- 172.21.15.88:0/3043334477 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a4129fe0 con 0x7f52a40a18a0 2020-02-11T16:28:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.467+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a18a0 0x7f52a4065700 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f52a41305f0 tx=0x7f52a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.467+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f52a00059c0 con 0x7f52a40a18a0 2020-02-11T16:28:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.467+0000 7f52a93c3700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a18a0 0x7f52a4065700 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f52a41305f0 tx=0x7f52a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.467+0000 7f52927fc700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5284039bb0 0x7f528403c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.467+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f52a0049960 con 0x7f52a40a18a0 2020-02-11T16:28:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.467+0000 7f52ab627700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 0x7f52a4129ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.467+0000 7f52ab627700 1 -- 172.21.15.88:0/3043334477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a405e2f0 con 0x7f52a4066e90 2020-02-11T16:28:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.467+0000 7f52a8bc2700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5284039bb0 0x7f528403c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.467+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 0x7f52a4129ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.468+0000 7f52a8bc2700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5284039bb0 0x7f528403c070 crc :-1 s=READY pgs=508 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.468+0000 7f52a9bc4700 1 -- 172.21.15.88:0/3043334477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52a40565b0 con 0x7f52a4066e90 2020-02-11T16:28:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.468+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 0x7f52a4129ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.468+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 0x7f52a4129ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.468+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 0x7f52a4129ae0 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.468+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 0x7f52a4129ae0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.468+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f529c005a40 con 0x7f52a4066e90 2020-02-11T16:28:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.468+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 0x7f52a4129ae0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.468+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f529c005ba0 con 0x7f52a4066e90 2020-02-11T16:28:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.469+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 msgr2=0x7f52a4129ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.469+0000 7f52927fc700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 0x7f52a4129ae0 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).stop 2020-02-11T16:28:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.469+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 msgr2=0x7f52a4129ae0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:22.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.469+0000 7f52927fc700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a4066e90 0x7f52a4129ae0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.480+0000 7f52ab627700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 0x7f52a41329c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.480+0000 7f52ab627700 1 -- 172.21.15.88:0/3043334477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4130fd0 con 0x7f52a40a4d90 2020-02-11T16:28:22.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.481+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 0x7f52a41329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.481+0000 7f52a9bc4700 1 -- 172.21.15.88:0/3043334477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f52a405ccb0 con 0x7f52a40a4d90 2020-02-11T16:28:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.481+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 0x7f52a41329c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.481+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 0x7f52a41329c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.481+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 0x7f52a41329c0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.481+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 0x7f52a41329c0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.481+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f529c00f990 con 0x7f52a40a4d90 2020-02-11T16:28:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52a9bc4700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 0x7f52a41329c0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4362 (secure 0 0 0) 0x7f529c00faf0 con 0x7f52a40a4d90 2020-02-11T16:28:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 msgr2=0x7f52a41329c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52927fc700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 0x7f52a41329c0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f52a40654c0 tx=0x7f529c007dc0).stop 2020-02-11T16:28:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52927fc700 1 -- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 msgr2=0x7f52a41329c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52927fc700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a40a4d90 0x7f52a41329c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52ab627700 1 -- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5284039bb0 msgr2=0x7f528403c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52ab627700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5284039bb0 0x7f528403c070 crc :-1 s=READY pgs=508 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52ab627700 1 -- 172.21.15.88:0/3043334477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a18a0 msgr2=0x7f52a4065700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52ab627700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a18a0 0x7f52a4065700 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f52a41305f0 tx=0x7f52a0010bd0).stop 2020-02-11T16:28:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52a9bc4700 1 -- 172.21.15.88:0/3043334477 reap_dead start 2020-02-11T16:28:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52ab627700 1 -- 172.21.15.88:0/3043334477 shutdown_connections 2020-02-11T16:28:22.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52ab627700 1 --2- 172.21.15.88:0/3043334477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a40a18a0 0x7f52a4065700 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0x7f52a41305f0 tx=0x7f52a0010bd0).stop 2020-02-11T16:28:22.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.482+0000 7f52ab627700 1 -- 172.21.15.88:0/3043334477 >> 172.21.15.88:0/3043334477 conn(0x7f52a409d110 msgr2=0x7f52a40a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:22.490 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.483+0000 7f52ab627700 1 -- 172.21.15.88:0/3043334477 shutdown_connections 2020-02-11T16:28:22.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.483+0000 7f52ab627700 1 -- 172.21.15.88:0/3043334477 wait complete. 2020-02-11T16:28:22.491 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:28:22.493 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 186, 2020-02-11T16:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:28:22.494 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:28:22.496 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:22.496 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:28:22.496 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:28:22.496 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:22.496 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:22.497 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:22.497 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:22.497 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:22.497 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:22.498 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.498 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:28:22.498 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:28:22.498 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:22.498 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:22.499 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:22.499 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:22.499 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:22.499 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:22.500 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.500 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:28:22.500 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:28:22.501 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:28:22.501 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:28:22.501 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:28:22.501 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:28:22.501 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:22.502 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:22.502 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:28:22.502 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:28:22.502 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:22.502 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:28:22.502 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:22.503 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:22.503 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:22.503 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:22.503 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:22.503 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:22.503 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.503 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:28:22.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.504 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:28:22.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.504 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:22.504 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:22.504 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:22.504 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:22.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.505 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:22.505 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:28:22.505 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.505 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:22.506 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:28:22.506 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.506 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:28:22.506 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:28:22.507 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:22.507 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:22.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.507 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:22.507 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:22.508 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:22.508 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:22.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.508 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:22.509 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:28:22.509 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.509 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:22.510 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:28:22.510 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.510 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.510 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.510 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:28:22.511 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:28:22.511 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:22.511 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:22.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.512 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:28:22.512 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:28:22.512 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:22.512 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:22.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.512 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:22.512 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:28:22.513 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.513 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:22.513 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:28:22.513 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.513 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.514 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.514 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:28:22.514 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:28:22.514 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:22.514 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:22.514 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.515 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.515 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:28:22.515 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:28:22.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.515 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.515 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.516 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:22.516 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.516 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.516 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:28:22.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.516 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.516 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.517 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:22.517 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.517 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.517 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:28:22.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.517 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.517 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.518 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:28:22.518 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.518 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.518 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:28:22.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.518 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.518 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.519 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:28:22.519 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.519 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.519 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:28:22.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.519 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.519 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.519 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:22.520 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.520 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.520 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.520 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:28:22.521 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:28:22.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.651+0000 7f538122a700 1 Processor -- start 2020-02-11T16:28:22.654 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.651+0000 7f538122a700 1 -- start start 2020-02-11T16:28:22.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f538122a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f537c05fc80 0x7f537c13bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:22.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f538122a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0a9750 0x7f537c09d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:22.656 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f538122a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c1325d0 con 0x7f537c0669e0 2020-02-11T16:28:22.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f538122a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c0a9bb0 con 0x7f537c05fc80 2020-02-11T16:28:22.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f538122a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c05c1a0 con 0x7f537c0a9750 2020-02-11T16:28:22.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f5380a29700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f537c0669e0 0x7f537c137da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47778/0 (socket says 172.21.15.88:47778) 2020-02-11T16:28:22.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f5380a29700 1 -- 172.21.15.88:0/1997886756 learned_addr learned my addr 172.21.15.88:0/1997886756 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:22.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f537bfff700 1 --2- 172.21.15.88:0/1997886756 >> v2:172.21.15.88:3300/0 conn(0x7f537c05fc80 0x7f537c13bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f537b7fe700 1 --2- 172.21.15.88:0/1997886756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0a9750 0x7f537c09d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.657 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f537affd700 1 -- 172.21.15.88:0/1997886756 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530539455 0 0) 0x7f537c1325d0 con 0x7f537c0669e0 2020-02-11T16:28:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.652+0000 7f537affd700 1 -- 172.21.15.88:0/1997886756 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5368003230 con 0x7f537c0669e0 2020-02-11T16:28:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537bfff700 1 -- 172.21.15.88:0/1997886756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0a9750 msgr2=0x7f537c09d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537bfff700 1 --2- 172.21.15.88:0/1997886756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0a9750 0x7f537c09d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537bfff700 1 -- 172.21.15.88:0/1997886756 >> v1:172.21.15.88:6789/0 conn(0x7f537c0669e0 legacy=0x7f537c137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537bfff700 1 -- 172.21.15.88:0/1997886756 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c13b2f0 con 0x7f537c05fc80 2020-02-11T16:28:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537bfff700 1 --2- 172.21.15.88:0/1997886756 >> v2:172.21.15.88:3300/0 conn(0x7f537c05fc80 0x7f537c13bf00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f536c002f30 tx=0x7f536c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.658 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537bfff700 1 --2- 172.21.15.88:0/1997886756 >> v2:172.21.15.88:3300/0 conn(0x7f537c05fc80 0x7f537c13bf00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f536c002f30 tx=0x7f536c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537bfff700 1 --2- 172.21.15.88:0/1997886756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c05fc80 0x7f537c13bf00 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f536c002f30 tx=0x7f536c0088e0).ready entity=mon.1 client_cookie=613b7c140bb1c5c3 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537bfff700 1 --2- 172.21.15.88:0/1997886756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c05fc80 0x7f537c13bf00 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f536c002f30 tx=0x7f536c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537affd700 1 -- 172.21.15.88:0/1997886756 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f536c008e40 con 0x7f537c05fc80 2020-02-11T16:28:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537bfff700 1 --2- 172.21.15.88:0/1997886756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c05fc80 0x7f537c13bf00 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f536c002f30 tx=0x7f536c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537affd700 1 -- 172.21.15.88:0/1997886756 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c011540 con 0x7f537c05fc80 2020-02-11T16:28:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537bfff700 1 --2- 172.21.15.88:0/1997886756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c05fc80 0x7f537c13bf00 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f536c002f30 tx=0x7f536c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.659 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f537affd700 1 -- 172.21.15.88:0/1997886756 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f536c0118e0 con 0x7f537c05fc80 2020-02-11T16:28:22.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f538122a700 1 -- 172.21.15.88:0/1997886756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c05fc80 msgr2=0x7f537c13bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.653+0000 7f538122a700 1 --2- 172.21.15.88:0/1997886756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c05fc80 0x7f537c13bf00 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f536c002f30 tx=0x7f536c0088e0).stop 2020-02-11T16:28:22.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.654+0000 7f538122a700 1 -- 172.21.15.88:0/1997886756 shutdown_connections 2020-02-11T16:28:22.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.654+0000 7f538122a700 1 --2- 172.21.15.88:0/1997886756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c05fc80 0x7f537c13bf00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.654+0000 7f538122a700 1 --2- 172.21.15.88:0/1997886756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0a9750 0x7f537c09d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:22.660 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.654+0000 7f538122a700 1 -- 172.21.15.88:0/1997886756 >> 172.21.15.88:0/1997886756 conn(0x7f537c0aeea0 msgr2=0x7f537c0aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:22.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.655+0000 7f538122a700 1 -- 172.21.15.88:0/1997886756 shutdown_connections 2020-02-11T16:28:22.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.655+0000 7f538122a700 1 -- 172.21.15.88:0/1997886756 wait complete. 2020-02-11T16:28:22.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.656+0000 7f538122a700 1 Processor -- start 2020-02-11T16:28:22.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.656+0000 7f538122a700 1 -- start start 2020-02-11T16:28:22.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.656+0000 7f538122a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f537c0a9750 0x7f537c135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.656+0000 7f538122a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c138380 con 0x7f537c05fc80 2020-02-11T16:28:22.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.656+0000 7f538122a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c138620 con 0x7f537c0669e0 2020-02-11T16:28:22.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.656+0000 7f538122a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c1388c0 con 0x7f537c0a9750 2020-02-11T16:28:22.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f537bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f537c05fc80 0x7f537c13a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39562/0 (socket says 172.21.15.88:39562) 2020-02-11T16:28:22.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f537bfff700 1 -- 172.21.15.88:0/426368110 learned_addr learned my addr 172.21.15.88:0/426368110 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:22.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f5380a29700 1 --2- 172.21.15.88:0/426368110 >> v2:172.21.15.88:3300/0 conn(0x7f537c0a9750 0x7f537c135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360517264 0 0) 0x7f537c138380 con 0x7f537c05fc80 2020-02-11T16:28:22.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f535c002fe0 con 0x7f537c05fc80 2020-02-11T16:28:22.665 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f5380a29700 1 -- 172.21.15.88:0/426368110 >> v1:172.21.15.88:6789/0 conn(0x7f537c0669e0 legacy=0x7f537c12c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f5380a29700 1 -- 172.21.15.88:0/426368110 >> v1:172.21.15.52:6789/0 conn(0x7f537c05fc80 legacy=0x7f537c13a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f5380a29700 1 -- 172.21.15.88:0/426368110 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c0add40 con 0x7f537c0a9750 2020-02-11T16:28:22.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f5380a29700 1 --2- 172.21.15.88:0/426368110 >> v2:172.21.15.88:3300/0 conn(0x7f537c0a9750 0x7f537c135cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f537c0adc70 tx=0x7f5374010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f5380a29700 1 --2- 172.21.15.88:0/426368110 >> v2:172.21.15.88:3300/0 conn(0x7f537c0a9750 0x7f537c135cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f537c0adc70 tx=0x7f5374010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.657+0000 7f5380a29700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c0a9750 0x7f537c135cb0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f537c0adc70 tx=0x7f5374010bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.658+0000 7f5380a29700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c0a9750 0x7f537c135cb0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f537c0adc70 tx=0x7f5374010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.658+0000 7f5380a29700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c0a9750 0x7f537c135cb0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f537c0adc70 tx=0x7f5374010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.658+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5374005e50 con 0x7f537c0a9750 2020-02-11T16:28:22.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.658+0000 7f5380a29700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c0a9750 0x7f537c135cb0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f537c0adc70 tx=0x7f5374010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.658+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5374012440 con 0x7f537c0a9750 2020-02-11T16:28:22.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.658+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5374012820 con 0x7f537c0a9750 2020-02-11T16:28:22.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.658+0000 7f538122a700 1 -- 172.21.15.88:0/426368110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c12ce20 con 0x7f537c0a9750 2020-02-11T16:28:22.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.658+0000 7f538122a700 1 -- 172.21.15.88:0/426368110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c0ad750 con 0x7f537c0a9750 2020-02-11T16:28:22.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.658+0000 7f5380a29700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c0a9750 0x7f537c135cb0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f537c0adc70 tx=0x7f5374010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5374012980 con 0x7f537c0a9750 2020-02-11T16:28:22.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f5380a29700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c0a9750 0x7f537c135cb0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f537c0adc70 tx=0x7f5374010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f53797fa700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f535c039ff0 0x7f535c03c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f538122a700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 0x7f537c065450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f538122a700 1 -- 172.21.15.88:0/426368110 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c05e2f0 con 0x7f537c0ab020 2020-02-11T16:28:22.668 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5374049de0 con 0x7f537c0a9750 2020-02-11T16:28:22.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f537bfff700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f535c039ff0 0x7f535c03c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 0x7f537c065450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f537bfff700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f535c039ff0 0x7f535c03c4b0 crc :-1 s=READY pgs=509 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f537b7fe700 1 -- 172.21.15.88:0/426368110 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f537c12d010 con 0x7f537c0ab020 2020-02-11T16:28:22.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 0x7f537c065450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.659+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 0x7f537c065450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.660+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 0x7f537c065450 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.660+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 0x7f537c065450 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.660+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5370008e60 con 0x7f537c0ab020 2020-02-11T16:28:22.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.660+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 0x7f537c065450 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.660+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f53700123f0 con 0x7f537c0ab020 2020-02-11T16:28:22.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.660+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 msgr2=0x7f537c065450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.660+0000 7f53797fa700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 0x7f537c065450 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).stop 2020-02-11T16:28:22.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.660+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 msgr2=0x7f537c065450 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:22.671 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.660+0000 7f53797fa700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab020 0x7f537c065450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.671+0000 7f538122a700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 0x7f537c0658b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.674 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.671+0000 7f538122a700 1 -- 172.21.15.88:0/426368110 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c13b040 con 0x7f537c0ab400 2020-02-11T16:28:22.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.672+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 0x7f537c0658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.672+0000 7f537b7fe700 1 -- 172.21.15.88:0/426368110 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f537c138a90 con 0x7f537c0ab400 2020-02-11T16:28:22.676 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.672+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 0x7f537c0658b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.672+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 0x7f537c0658b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.672+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 0x7f537c0658b0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.672+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 0x7f537c0658b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.672+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f537000f860 con 0x7f537c0ab400 2020-02-11T16:28:22.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f537b7fe700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 0x7f537c0658b0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7f5370012e50 con 0x7f537c0ab400 2020-02-11T16:28:22.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 msgr2=0x7f537c0658b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f53797fa700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 0x7f537c0658b0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f5370002f30 tx=0x7f5370010b60).stop 2020-02-11T16:28:22.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f53797fa700 1 -- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 msgr2=0x7f537c0658b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:22.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f53797fa700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f537c0ab400 0x7f537c0658b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f538122a700 1 -- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f535c039ff0 msgr2=0x7f535c03c4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f538122a700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f535c039ff0 0x7f535c03c4b0 crc :-1 s=READY pgs=509 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f538122a700 1 -- 172.21.15.88:0/426368110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c0a9750 msgr2=0x7f537c135cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f538122a700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c0a9750 0x7f537c135cb0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f537c0adc70 tx=0x7f5374010bf0).stop 2020-02-11T16:28:22.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f5380a29700 1 -- 172.21.15.88:0/426368110 reap_dead start 2020-02-11T16:28:22.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f5380a29700 1 -- 172.21.15.88:0/426368110 reap_dead start 2020-02-11T16:28:22.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f538122a700 1 -- 172.21.15.88:0/426368110 shutdown_connections 2020-02-11T16:28:22.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f538122a700 1 --2- 172.21.15.88:0/426368110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f537c0a9750 0x7f537c135cb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f538122a700 1 -- 172.21.15.88:0/426368110 >> 172.21.15.88:0/426368110 conn(0x7f537c0aeea0 msgr2=0x7f537c12e980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f538122a700 1 -- 172.21.15.88:0/426368110 shutdown_connections 2020-02-11T16:28:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.673+0000 7f538122a700 1 -- 172.21.15.88:0/426368110 wait complete. 2020-02-11T16:28:22.680 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:28:22.680 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:28:22.680 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:28:22.680 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:28:22.680 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 186, 2020-02-11T16:28:22.681 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:28:22.681 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:28:22.681 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:28:22.681 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:28:22.681 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.681 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:28:22.682 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:22.682 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:28:22.682 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:28:22.682 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:22.682 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:22.682 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:22.682 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:22.683 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:22.683 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:22.683 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.683 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:28:22.683 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:28:22.683 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:22.684 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:22.684 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:22.684 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:22.684 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:22.684 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:22.684 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:28:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:28:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:28:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:28:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:28:22.685 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:28:22.686 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:22.686 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:22.686 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:28:22.686 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:28:22.686 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:22.686 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:28:22.686 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:22.686 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:22.687 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:22.687 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:22.687 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:22.687 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:22.687 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.687 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:28:22.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.688 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:28:22.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.688 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:22.688 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:22.688 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:22.688 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:22.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.689 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:22.689 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:28:22.689 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.689 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:22.689 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:28:22.690 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.690 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.690 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.690 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:28:22.690 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:28:22.690 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:22.691 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:22.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.691 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:22.691 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:22.691 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:22.692 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:22.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.692 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:22.692 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:28:22.692 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.693 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:22.693 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:28:22.693 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.693 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.693 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.693 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:28:22.694 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:28:22.694 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:22.694 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:22.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.694 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:28:22.695 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:28:22.695 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:22.695 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:22.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.695 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:22.695 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:28:22.695 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.696 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:22.696 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:28:22.696 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:22.697 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.697 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.697 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:28:22.697 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:28:22.697 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:22.697 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:22.698 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.698 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:22.698 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:28:22.698 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:28:22.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.698 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.698 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.699 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:22.699 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.699 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.699 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:28:22.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.699 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.701 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.701 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:22.702 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.702 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.702 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:28:22.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.702 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.702 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.702 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:28:22.703 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.703 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.703 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:28:22.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.703 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.703 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.703 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:28:22.703 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.704 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:22.704 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:28:22.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:22.704 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:22.704 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:22.704 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:22.704 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.705 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:22.705 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:22.705 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:28:22.706 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:28:22.706 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:28:22.831 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.828+0000 7f69ee922700 1 Processor -- start 2020-02-11T16:28:22.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.829+0000 7f69ee922700 1 -- start start 2020-02-11T16:28:22.841 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.829+0000 7f69ee922700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 0x7f69e809df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.829+0000 7f69ee922700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e809e7e0 con 0x7f69e805c1f0 2020-02-11T16:28:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.829+0000 7f69ee922700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80a4cd0 con 0x7f69e8139050 2020-02-11T16:28:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.829+0000 7f69ee922700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e809e540 con 0x7f69e80a6bf0 2020-02-11T16:28:22.842 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.829+0000 7f69ecebf700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f69e8139050 0x7f69e8139490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47796/0 (socket says 172.21.15.88:47796) 2020-02-11T16:28:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.829+0000 7f69ecebf700 1 -- 172.21.15.88:0/1046587231 learned_addr learned my addr 172.21.15.88:0/1046587231 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.829+0000 7f69e77fe700 1 --2- 172.21.15.88:0/1046587231 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 0x7f69e809df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e6ffd700 1 -- 172.21.15.88:0/1046587231 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589009191 0 0) 0x7f69e80a4cd0 con 0x7f69e8139050 2020-02-11T16:28:22.843 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e6ffd700 1 -- 172.21.15.88:0/1046587231 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d4003230 con 0x7f69e8139050 2020-02-11T16:28:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e6ffd700 1 -- 172.21.15.88:0/1046587231 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490993438 0 0) 0x7f69e809e7e0 con 0x7f69e805c1f0 2020-02-11T16:28:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e6ffd700 1 -- 172.21.15.88:0/1046587231 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e80a4cd0 con 0x7f69e805c1f0 2020-02-11T16:28:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e77fe700 1 -- 172.21.15.88:0/1046587231 >> v1:172.21.15.88:6789/0 conn(0x7f69e8139050 legacy=0x7f69e8139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.844 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e77fe700 1 -- 172.21.15.88:0/1046587231 >> v1:172.21.15.52:6789/0 conn(0x7f69e805c1f0 legacy=0x7f69e80a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e77fe700 1 -- 172.21.15.88:0/1046587231 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e80a4120 con 0x7f69e80a6bf0 2020-02-11T16:28:22.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e77fe700 1 --2- 172.21.15.88:0/1046587231 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 0x7f69e809df50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f69dc002f30 tx=0x7f69dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.845 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e77fe700 1 --2- 172.21.15.88:0/1046587231 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 0x7f69e809df50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f69dc002f30 tx=0x7f69dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e77fe700 1 --2- 172.21.15.88:0/1046587231 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 0x7f69e809df50 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0088e0).ready entity=mon.2 client_cookie=efc68892e74a7b94 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e77fe700 1 --2- 172.21.15.88:0/1046587231 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 0x7f69e809df50 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e6ffd700 1 -- 172.21.15.88:0/1046587231 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69dc008e40 con 0x7f69e80a6bf0 2020-02-11T16:28:22.846 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e77fe700 1 --2- 172.21.15.88:0/1046587231 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 0x7f69e809df50 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e77fe700 1 --2- 172.21.15.88:0/1046587231 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 0x7f69e809df50 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e6ffd700 1 -- 172.21.15.88:0/1046587231 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc011540 con 0x7f69e80a6bf0 2020-02-11T16:28:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69e6ffd700 1 -- 172.21.15.88:0/1046587231 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69dc0118e0 con 0x7f69e80a6bf0 2020-02-11T16:28:22.847 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69ee922700 1 -- 172.21.15.88:0/1046587231 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 msgr2=0x7f69e809df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.830+0000 7f69ee922700 1 --2- 172.21.15.88:0/1046587231 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 0x7f69e809df50 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0088e0).stop 2020-02-11T16:28:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.831+0000 7f69ee922700 1 -- 172.21.15.88:0/1046587231 shutdown_connections 2020-02-11T16:28:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.831+0000 7f69ee922700 1 --2- 172.21.15.88:0/1046587231 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e80a6bf0 0x7f69e809df50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.831+0000 7f69ee922700 1 -- 172.21.15.88:0/1046587231 >> 172.21.15.88:0/1046587231 conn(0x7f69e80ab400 msgr2=0x7f69e80a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:22.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.831+0000 7f69ee922700 1 -- 172.21.15.88:0/1046587231 shutdown_connections 2020-02-11T16:28:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.831+0000 7f69ee922700 1 -- 172.21.15.88:0/1046587231 wait complete. 2020-02-11T16:28:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.832+0000 7f69ee922700 1 Processor -- start 2020-02-11T16:28:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.832+0000 7f69ee922700 1 -- start start 2020-02-11T16:28:22.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69ee922700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e805c1f0 0x7f69e8142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69ee922700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69e80a6bf0 0x7f69e81431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69ee922700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69e8139050 0x7f69e8130c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69ee922700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e8143600 con 0x7f69e8139050 2020-02-11T16:28:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69ee922700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80aa2e0 con 0x7f69e80a6bf0 2020-02-11T16:28:22.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69ee922700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80a00d0 con 0x7f69e805c1f0 2020-02-11T16:28:22.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69e80a6bf0 0x7f69e81431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69e80a6bf0 0x7f69e81431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60174/0 (socket says 172.21.15.88:60174) 2020-02-11T16:28:22.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e77fe700 1 -- 172.21.15.88:0/181494090 learned_addr learned my addr 172.21.15.88:0/181494090 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:22.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e7fff700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e805c1f0 0x7f69e8142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69ecebf700 1 --2- 172.21.15.88:0/181494090 >> v2:172.21.15.52:3300/0 conn(0x7f69e8139050 0x7f69e8130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e77fe700 1 -- 172.21.15.88:0/181494090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e805c1f0 msgr2=0x7f69e8142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e805c1f0 0x7f69e8142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e77fe700 1 -- 172.21.15.88:0/181494090 >> v2:172.21.15.52:3300/0 conn(0x7f69e8139050 msgr2=0x7f69e8130c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> v2:172.21.15.52:3300/0 conn(0x7f69e8139050 0x7f69e8130c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:22.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e77fe700 1 -- 172.21.15.88:0/181494090 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e80a0370 con 0x7f69e80a6bf0 2020-02-11T16:28:22.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> v2:172.21.15.88:3300/0 conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.833+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> v2:172.21.15.88:3300/0 conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.853 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.834+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.834+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.834+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.834+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.834+0000 7f69e57fa700 1 -- 172.21.15.88:0/181494090 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69dc00f700 con 0x7f69e80a6bf0 2020-02-11T16:28:22.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.834+0000 7f69e57fa700 1 -- 172.21.15.88:0/181494090 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc00f860 con 0x7f69e80a6bf0 2020-02-11T16:28:22.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.834+0000 7f69ee922700 1 -- 172.21.15.88:0/181494090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e80a0610 con 0x7f69e80a6bf0 2020-02-11T16:28:22.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.834+0000 7f69e57fa700 1 -- 172.21.15.88:0/181494090 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69dc007340 con 0x7f69e80a6bf0 2020-02-11T16:28:22.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.834+0000 7f69ee922700 1 -- 172.21.15.88:0/181494090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e80613b0 con 0x7f69e80a6bf0 2020-02-11T16:28:22.855 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.834+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.835+0000 7f69e57fa700 1 -- 172.21.15.88:0/181494090 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f69dc0056c0 con 0x7f69e80a6bf0 2020-02-11T16:28:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.835+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.835+0000 7f69ee922700 1 -- 172.21.15.88:0/181494090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e80a07a0 con 0x7f69e80a6bf0 2020-02-11T16:28:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.835+0000 7f69e57fa700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69c8039ca0 0x7f69c803c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.835+0000 7f69e57fa700 1 -- 172.21.15.88:0/181494090 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f69dc04a250 con 0x7f69e80a6bf0 2020-02-11T16:28:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.835+0000 7f69e7fff700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69c8039ca0 0x7f69c803c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.835+0000 7f69e7fff700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69c8039ca0 0x7f69c803c160 crc :-1 s=READY pgs=510 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:22.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.839+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:22.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:22.839+0000 7f69e57fa700 1 -- 172.21.15.88:0/181494090 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f69dc032720 con 0x7f69e80a6bf0 2020-02-11T16:28:23.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.086+0000 7f69ee922700 1 -- 172.21.15.88:0/181494090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f69e80565b0 con 0x7f69e80a6bf0 2020-02-11T16:28:23.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.088+0000 7f69e77fe700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:23.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.088+0000 7f69e57fa700 1 -- 172.21.15.88:0/181494090 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f69dc0322e0 con 0x7f69e80a6bf0 2020-02-11T16:28:23.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 -- 172.21.15.88:0/181494090 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69c8039ca0 msgr2=0x7f69c803c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:23.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69c8039ca0 0x7f69c803c160 crc :-1 s=READY pgs=510 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:23.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 -- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 msgr2=0x7f69e81431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:23.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 0x7f69e81431a0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f69dc002f30 tx=0x7f69dc0112f0).stop 2020-02-11T16:28:23.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 -- 172.21.15.88:0/181494090 shutdown_connections 2020-02-11T16:28:23.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f69c8039ca0 0x7f69c803c160 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:23.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 --2- 172.21.15.88:0/181494090 >> v2:172.21.15.52:3300/0 conn(0x7f69e8139050 0x7f69e8130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:23.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69e805c1f0 0x7f69e8142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:23.094 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 --2- 172.21.15.88:0/181494090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e80a6bf0 0x7f69e81431a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:23.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 -- 172.21.15.88:0/181494090 >> 172.21.15.88:0/181494090 conn(0x7f69e80ab400 msgr2=0x7f69e81353d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:23.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 -- 172.21.15.88:0/181494090 shutdown_connections 2020-02-11T16:28:23.095 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:23.090+0000 7f69ee922700 1 -- 172.21.15.88:0/181494090 wait complete. 2020-02-11T16:28:23.104 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:28:33.105 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:28:33.106 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:28:33.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.229+0000 7fb0d8943700 1 Processor -- start 2020-02-11T16:28:33.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.229+0000 7fb0d8943700 1 -- start start 2020-02-11T16:28:33.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.230+0000 7fb0d8943700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0d4139c60 0x7fb0d40a5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:33.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.230+0000 7fb0d8943700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d409dba0 con 0x7fb0d4135f90 2020-02-11T16:28:33.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.230+0000 7fb0d8943700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d40a5ed0 con 0x7fb0d405fac0 2020-02-11T16:28:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.230+0000 7fb0d8943700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d409ddd0 con 0x7fb0d4139c60 2020-02-11T16:28:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.230+0000 7fb0cbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0d4139c60 0x7fb0d40a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.230+0000 7fb0cbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0d4139c60 0x7fb0d40a5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60184/0 (socket says 172.21.15.88:60184) 2020-02-11T16:28:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.230+0000 7fb0cbfff700 1 -- 172.21.15.88:0/3210919388 learned_addr learned my addr 172.21.15.88:0/3210919388 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.230+0000 7fb0d259c700 1 --1- 172.21.15.88:0/3210919388 >> v1:172.21.15.88:6789/0 conn(0x7fb0d405fac0 0x7fb0d4139550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47806/0 (socket says 172.21.15.88:47806) 2020-02-11T16:28:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0d1d9b700 1 -- 172.21.15.88:0/3210919388 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468606306 0 0) 0x7fb0d40a5ed0 con 0x7fb0d405fac0 2020-02-11T16:28:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0d1d9b700 1 -- 172.21.15.88:0/3210919388 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b4003230 con 0x7fb0d405fac0 2020-02-11T16:28:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0d1d9b700 1 -- 172.21.15.88:0/3210919388 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918212489 0 0) 0x7fb0d409dba0 con 0x7fb0d4135f90 2020-02-11T16:28:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0cbfff700 1 -- 172.21.15.88:0/3210919388 >> v1:172.21.15.88:6789/0 conn(0x7fb0d405fac0 legacy=0x7fb0d4139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0cbfff700 1 -- 172.21.15.88:0/3210919388 >> v1:172.21.15.52:6789/0 conn(0x7fb0d4135f90 legacy=0x7fb0d4136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0cbfff700 1 -- 172.21.15.88:0/3210919388 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d409e070 con 0x7fb0d4139c60 2020-02-11T16:28:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0cbfff700 1 --2- 172.21.15.88:0/3210919388 >> v2:172.21.15.88:3300/0 conn(0x7fb0d4139c60 0x7fb0d40a5030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb0bc002f30 tx=0x7fb0bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0cbfff700 1 --2- 172.21.15.88:0/3210919388 >> v2:172.21.15.88:3300/0 conn(0x7fb0d4139c60 0x7fb0d40a5030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb0bc002f30 tx=0x7fb0bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0cbfff700 1 --2- 172.21.15.88:0/3210919388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d4139c60 0x7fb0d40a5030 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fb0bc002f30 tx=0x7fb0bc0088e0).ready entity=mon.1 client_cookie=cb4a6a41d7e6617 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0cbfff700 1 --2- 172.21.15.88:0/3210919388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d4139c60 0x7fb0d40a5030 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fb0bc002f30 tx=0x7fb0bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0cbfff700 1 --2- 172.21.15.88:0/3210919388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d4139c60 0x7fb0d40a5030 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fb0bc002f30 tx=0x7fb0bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0d1d9b700 1 -- 172.21.15.88:0/3210919388 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0bc0116b0 con 0x7fb0d4139c60 2020-02-11T16:28:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0cbfff700 1 --2- 172.21.15.88:0/3210919388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d4139c60 0x7fb0d40a5030 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fb0bc002f30 tx=0x7fb0bc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0d1d9b700 1 -- 172.21.15.88:0/3210919388 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc011810 con 0x7fb0d4139c60 2020-02-11T16:28:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0d1d9b700 1 -- 172.21.15.88:0/3210919388 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0bc011b70 con 0x7fb0d4139c60 2020-02-11T16:28:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0d8943700 1 -- 172.21.15.88:0/3210919388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d4139c60 msgr2=0x7fb0d40a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.231+0000 7fb0d8943700 1 --2- 172.21.15.88:0/3210919388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d4139c60 0x7fb0d40a5030 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fb0bc002f30 tx=0x7fb0bc0088e0).stop 2020-02-11T16:28:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.232+0000 7fb0d8943700 1 -- 172.21.15.88:0/3210919388 shutdown_connections 2020-02-11T16:28:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.232+0000 7fb0d8943700 1 --2- 172.21.15.88:0/3210919388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d4139c60 0x7fb0d40a5030 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.232+0000 7fb0d8943700 1 -- 172.21.15.88:0/3210919388 >> 172.21.15.88:0/3210919388 conn(0x7fb0d40a7bb0 msgr2=0x7fb0d40a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.232+0000 7fb0d8943700 1 -- 172.21.15.88:0/3210919388 shutdown_connections 2020-02-11T16:28:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.232+0000 7fb0d8943700 1 -- 172.21.15.88:0/3210919388 wait complete. 2020-02-11T16:28:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.233+0000 7fb0d8943700 1 Processor -- start 2020-02-11T16:28:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.233+0000 7fb0d8943700 1 -- start start 2020-02-11T16:28:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.233+0000 7fb0d8943700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0d4139c60 0x7fb0d40a4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.233+0000 7fb0d8943700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d40a0570 con 0x7fb0d405fac0 2020-02-11T16:28:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.233+0000 7fb0d8943700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d40a71c0 con 0x7fb0d4135f90 2020-02-11T16:28:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.233+0000 7fb0d8943700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40a4d10 con 0x7fb0d4139c60 2020-02-11T16:28:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.233+0000 7fb0cbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb0d4135f90 0x7fb0d41440a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47814/0 (socket says 172.21.15.88:47814) 2020-02-11T16:28:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.233+0000 7fb0cbfff700 1 -- 172.21.15.88:0/2482417411 learned_addr learned my addr 172.21.15.88:0/2482417411 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0d2d9d700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0d4139c60 0x7fb0d40a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665218258 0 0) 0x7fb0d40a71c0 con 0x7fb0d4135f90 2020-02-11T16:28:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b8007570 con 0x7fb0d4135f90 2020-02-11T16:28:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055980220 0 0) 0x7fb0d40a0570 con 0x7fb0d405fac0 2020-02-11T16:28:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d40a71c0 con 0x7fb0d405fac0 2020-02-11T16:28:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 479747019 0 0) 0x7fb0b8007570 con 0x7fb0d4135f90 2020-02-11T16:28:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb0d40a0570 con 0x7fb0d4135f90 2020-02-11T16:28:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fb0bc011de0 con 0x7fb0d4135f90 2020-02-11T16:28:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0d4139c60 msgr2=0x7fb0d40a4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0d4139c60 0x7fb0d40a4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 >> v1:172.21.15.88:6789/0 conn(0x7fb0d4135f90 legacy=0x7fb0d41440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 >> v1:172.21.15.52:6789/0 conn(0x7fb0d405fac0 legacy=0x7fb0d41335f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0d4139c60 0x7fb0b8007c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8008070 0x7fb0b80084f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40a4d10 con 0x7fb0b8008070 2020-02-11T16:28:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b8008950 con 0x7fb0b8008f50 2020-02-11T16:28:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b800fb60 con 0x7fb0d4139c60 2020-02-11T16:28:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0d2d9d700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8008070 0x7fb0b80084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.234+0000 7fb0cbfff700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0d4139c60 0x7fb0b8007c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 -- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0d4139c60 msgr2=0x7fb0b8007c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0d4139c60 0x7fb0b8007c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 -- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8008070 msgr2=0x7fb0b80084f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8008070 0x7fb0b80084f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 -- 172.21.15.88:0/2482417411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40a4fb0 con 0x7fb0b8008f50 2020-02-11T16:28:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d8943700 1 -- 172.21.15.88:0/2482417411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d40a5250 con 0x7fb0b8008f50 2020-02-11T16:28:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d8943700 1 -- 172.21.15.88:0/2482417411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d40a9860 con 0x7fb0b8008f50 2020-02-11T16:28:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0c400cc70 con 0x7fb0b8008f50 2020-02-11T16:28:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.235+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.236+0000 7fb0d8943700 1 -- 172.21.15.88:0/2482417411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d40565b0 con 0x7fb0b8008f50 2020-02-11T16:28:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.236+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.236+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c400ce10 con 0x7fb0b8008f50 2020-02-11T16:28:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.236+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0c400d230 con 0x7fb0b8008f50 2020-02-11T16:28:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.236+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb0c400d450 con 0x7fb0b8008f50 2020-02-11T16:28:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.236+0000 7fb0cb7fe700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb0b80464a0 0x7fb0b8048960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.236+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb0c40495f0 con 0x7fb0b8008f50 2020-02-11T16:28:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.237+0000 7fb0cbfff700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb0b80464a0 0x7fb0b8048960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.237+0000 7fb0cbfff700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb0b80464a0 0x7fb0b8048960 crc :-1 s=READY pgs=511 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.241+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.241+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb0c402eb80 con 0x7fb0b8008f50 2020-02-11T16:28:33.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.512+0000 7fb0d8943700 1 -- 172.21.15.88:0/2482417411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb0d405cb20 con 0x7fb0b8008f50 2020-02-11T16:28:33.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.512+0000 7fb0d259c700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.512+0000 7fb0cb7fe700 1 -- 172.21.15.88:0/2482417411 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fb0c4031690 con 0x7fb0b8008f50 2020-02-11T16:28:33.516 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":186,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:33.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.514+0000 7fb0d8943700 1 -- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb0b80464a0 msgr2=0x7fb0b8048960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.514+0000 7fb0d8943700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb0b80464a0 0x7fb0b8048960 crc :-1 s=READY pgs=511 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.517 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.514+0000 7fb0d8943700 1 -- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 msgr2=0x7fb0b8009350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.514+0000 7fb0d8943700 1 --2- 172.21.15.88:0/2482417411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b8008f50 0x7fb0b8009350 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fb0d40a70f0 tx=0x7fb0c4001480).stop 2020-02-11T16:28:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.514+0000 7fb0d2d9d700 1 -- 172.21.15.88:0/2482417411 reap_dead start 2020-02-11T16:28:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.514+0000 7fb0d2d9d700 1 -- 172.21.15.88:0/2482417411 reap_dead start 2020-02-11T16:28:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.514+0000 7fb0d8943700 1 -- 172.21.15.88:0/2482417411 shutdown_connections 2020-02-11T16:28:33.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.514+0000 7fb0d8943700 1 -- 172.21.15.88:0/2482417411 >> 172.21.15.88:0/2482417411 conn(0x7fb0d40a7bb0 msgr2=0x7fb0d4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:33.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.514+0000 7fb0d8943700 1 -- 172.21.15.88:0/2482417411 shutdown_connections 2020-02-11T16:28:33.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.514+0000 7fb0d8943700 1 -- 172.21.15.88:0/2482417411 wait complete. 2020-02-11T16:28:33.529 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":186,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:33.529 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:28:33.529 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:28:33.534 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:28:33.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.663+0000 7fd8ce01a700 1 Processor -- start 2020-02-11T16:28:33.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.663+0000 7fd8ce01a700 1 -- start start 2020-02-11T16:28:33.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8ce01a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8c80a3980 0x7fd8c81393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:33.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8ce01a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c809e5c0 con 0x7fd8c80a5920 2020-02-11T16:28:33.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8ce01a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c8133700 con 0x7fd8c8133300 2020-02-11T16:28:33.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8ce01a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c809e7f0 con 0x7fd8c80a3980 2020-02-11T16:28:33.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8cd819700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd8c8133300 0x7fd8c81404d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47828/0 (socket says 172.21.15.88:47828) 2020-02-11T16:28:33.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8cd819700 1 -- 172.21.15.88:0/1649420087 learned_addr learned my addr 172.21.15.88:0/1649420087 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:33.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8cd018700 1 --2- 172.21.15.88:0/1649420087 >> v2:172.21.15.52:3300/0 conn(0x7fd8c80a3980 0x7fd8c81393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8b7fff700 1 -- 172.21.15.88:0/1649420087 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575739704 0 0) 0x7fd8c8133700 con 0x7fd8c8133300 2020-02-11T16:28:33.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8b7fff700 1 -- 172.21.15.88:0/1649420087 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b0003230 con 0x7fd8c8133300 2020-02-11T16:28:33.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8b7fff700 1 -- 172.21.15.88:0/1649420087 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3357659788 0 0) 0x7fd8b0003230 con 0x7fd8c8133300 2020-02-11T16:28:33.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8cd018700 1 -- 172.21.15.88:0/1649420087 >> v1:172.21.15.88:6789/0 conn(0x7fd8c8133300 legacy=0x7fd8c81404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8cd018700 1 -- 172.21.15.88:0/1649420087 >> v1:172.21.15.52:6789/0 conn(0x7fd8c80a5920 legacy=0x7fd8c8132bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8cd018700 1 -- 172.21.15.88:0/1649420087 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80a4ce0 con 0x7fd8c80a3980 2020-02-11T16:28:33.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.664+0000 7fd8cd018700 1 --2- 172.21.15.88:0/1649420087 >> v2:172.21.15.52:3300/0 conn(0x7fd8c80a3980 0x7fd8c81393f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8c0001bf0 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8cd018700 1 --2- 172.21.15.88:0/1649420087 >> v2:172.21.15.52:3300/0 conn(0x7fd8c80a3980 0x7fd8c81393f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8c0001bf0 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8cd018700 1 --2- 172.21.15.88:0/1649420087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8c80a3980 0x7fd8c81393f0 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7fd8c0001bf0 tx=0x7fd8c80684d0).ready entity=mon.0 client_cookie=5027f4631d9ca66f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.692 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8cd018700 1 --2- 172.21.15.88:0/1649420087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8c80a3980 0x7fd8c81393f0 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7fd8c0001bf0 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8b7fff700 1 -- 172.21.15.88:0/1649420087 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c0001a50 con 0x7fd8c80a3980 2020-02-11T16:28:33.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8cd018700 1 --2- 172.21.15.88:0/1649420087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8c80a3980 0x7fd8c81393f0 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7fd8c0001bf0 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8b7fff700 1 -- 172.21.15.88:0/1649420087 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c40112c0 con 0x7fd8c80a3980 2020-02-11T16:28:33.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8cd018700 1 --2- 172.21.15.88:0/1649420087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8c80a3980 0x7fd8c81393f0 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7fd8c0001bf0 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8b7fff700 1 -- 172.21.15.88:0/1649420087 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c4011620 con 0x7fd8c80a3980 2020-02-11T16:28:33.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8ce01a700 1 -- 172.21.15.88:0/1649420087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8c80a3980 msgr2=0x7fd8c81393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8ce01a700 1 --2- 172.21.15.88:0/1649420087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8c80a3980 0x7fd8c81393f0 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7fd8c0001bf0 tx=0x7fd8c80684d0).stop 2020-02-11T16:28:33.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8ce01a700 1 -- 172.21.15.88:0/1649420087 shutdown_connections 2020-02-11T16:28:33.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8ce01a700 1 --2- 172.21.15.88:0/1649420087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8c80a3980 0x7fd8c81393f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8ce01a700 1 -- 172.21.15.88:0/1649420087 >> 172.21.15.88:0/1649420087 conn(0x7fd8c80a9fb0 msgr2=0x7fd8c80aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:33.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8ce01a700 1 -- 172.21.15.88:0/1649420087 shutdown_connections 2020-02-11T16:28:33.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.665+0000 7fd8ce01a700 1 -- 172.21.15.88:0/1649420087 wait complete. 2020-02-11T16:28:33.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.666+0000 7fd8ce01a700 1 Processor -- start 2020-02-11T16:28:33.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.666+0000 7fd8ce01a700 1 -- start start 2020-02-11T16:28:33.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8ce01a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd8c8133300 0x7fd8c814e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8ce01a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c8131890 con 0x7fd8c80a5920 2020-02-11T16:28:33.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8ce01a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c809a7c0 con 0x7fd8c80a3980 2020-02-11T16:28:33.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8ce01a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c8130570 con 0x7fd8c8133300 2020-02-11T16:28:33.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8cd819700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd8c8133300 0x7fd8c814e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8cd018700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd8c80a3980 0x7fd8c80a7de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47830/0 (socket says 172.21.15.88:47830) 2020-02-11T16:28:33.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8cd018700 1 -- 172.21.15.88:0/37785709 learned_addr learned my addr 172.21.15.88:0/37785709 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:33.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8cd819700 1 -- 172.21.15.88:0/37785709 >> v1:172.21.15.88:6789/0 conn(0x7fd8c80a3980 legacy=0x7fd8c80a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200325534 0 0) 0x7fd8c8131890 con 0x7fd8c80a5920 2020-02-11T16:28:33.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8cd819700 1 -- 172.21.15.88:0/37785709 >> v1:172.21.15.52:6789/0 conn(0x7fd8c80a5920 legacy=0x7fd8c80a8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.667+0000 7fd8cd819700 1 -- 172.21.15.88:0/37785709 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80a84f0 con 0x7fd8c8133300 2020-02-11T16:28:33.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8cd819700 1 --2- 172.21.15.88:0/37785709 >> v2:172.21.15.88:3300/0 conn(0x7fd8c8133300 0x7fd8c814e7b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8c4003070 tx=0x7fd8c000c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8cd819700 1 --2- 172.21.15.88:0/37785709 >> v2:172.21.15.88:3300/0 conn(0x7fd8c8133300 0x7fd8c814e7b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8c4003070 tx=0x7fd8c000c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8cd819700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8133300 0x7fd8c814e7b0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fd8c4003070 tx=0x7fd8c000c890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8cd819700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8133300 0x7fd8c814e7b0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fd8c4003070 tx=0x7fd8c000c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c0004a60 con 0x7fd8c8133300 2020-02-11T16:28:33.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8cd819700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8133300 0x7fd8c814e7b0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fd8c4003070 tx=0x7fd8c000c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8cd819700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8133300 0x7fd8c814e7b0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fd8c4003070 tx=0x7fd8c000c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c0004bc0 con 0x7fd8c8133300 2020-02-11T16:28:33.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c000d0c0 con 0x7fd8c8133300 2020-02-11T16:28:33.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8ce01a700 1 -- 172.21.15.88:0/37785709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c812ff10 con 0x7fd8c8133300 2020-02-11T16:28:33.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.668+0000 7fd8ce01a700 1 -- 172.21.15.88:0/37785709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c812fa10 con 0x7fd8c8133300 2020-02-11T16:28:33.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.669+0000 7fd8ce01a700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 0x7fd8c809c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.669+0000 7fd8ce01a700 1 -- 172.21.15.88:0/37785709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80a9300 con 0x7fd8c80a0f50 2020-02-11T16:28:33.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.669+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 0x7fd8c809c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.669+0000 7fd8cd819700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8133300 0x7fd8c814e7b0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fd8c4003070 tx=0x7fd8c000c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.669+0000 7fd8cd018700 1 -- 172.21.15.88:0/37785709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8c80565b0 con 0x7fd8c80a0f50 2020-02-11T16:28:33.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.669+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 0x7fd8c809c400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 0x7fd8c809c400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 0x7fd8c809c400 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd8c000d2f0 con 0x7fd8c8133300 2020-02-11T16:28:33.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8cd819700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8133300 0x7fd8c814e7b0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fd8c4003070 tx=0x7fd8c000c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 0x7fd8c809c400 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8b67fc700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd8a8039c30 0x7fd8a803c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fd8c0049a30 con 0x7fd8c8133300 2020-02-11T16:28:33.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 0x7fd8c809c400 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c400f850 con 0x7fd8c80a0f50 2020-02-11T16:28:33.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8cc817700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd8a8039c30 0x7fd8a803c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fd8c4011c20 con 0x7fd8c80a0f50 2020-02-11T16:28:33.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 msgr2=0x7fd8c809c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8b67fc700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 0x7fd8c809c400 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).stop 2020-02-11T16:28:33.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 msgr2=0x7fd8c809c400 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:33.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8b67fc700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c80a0f50 0x7fd8c809c400 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.670+0000 7fd8cc817700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd8a8039c30 0x7fd8a803c0f0 crc :-1 s=READY pgs=512 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.681+0000 7fd8ce01a700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 0x7fd8c8133b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.681+0000 7fd8ce01a700 1 -- 172.21.15.88:0/37785709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c809a950 con 0x7fd8c8135580 2020-02-11T16:28:33.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.681+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 0x7fd8c8133b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8cd018700 1 -- 172.21.15.88:0/37785709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd8c805e2f0 con 0x7fd8c8135580 2020-02-11T16:28:33.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 0x7fd8c8133b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 0x7fd8c8133b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 0x7fd8c8133b70 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 0x7fd8c8133b70 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c4005ea0 con 0x7fd8c8135580 2020-02-11T16:28:33.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8cd018700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 0x7fd8c8133b70 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7fd8c400d5c0 con 0x7fd8c8135580 2020-02-11T16:28:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 msgr2=0x7fd8c8133b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8b67fc700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 0x7fd8c8133b70 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).stop 2020-02-11T16:28:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8b67fc700 1 -- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 msgr2=0x7fd8c8133b70 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.682+0000 7fd8b67fc700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8135580 0x7fd8c8133b70 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0x7fd8c4000b80 tx=0x7fd8c80684d0).stop 2020-02-11T16:28:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8ce01a700 1 -- 172.21.15.88:0/37785709 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd8a8039c30 msgr2=0x7fd8a803c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8ce01a700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd8a8039c30 0x7fd8a803c0f0 crc :-1 s=READY pgs=512 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8ce01a700 1 -- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8133300 msgr2=0x7fd8c814e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8ce01a700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8133300 0x7fd8c814e7b0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fd8c4003070 tx=0x7fd8c000c890).stop 2020-02-11T16:28:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8cd819700 1 -- 172.21.15.88:0/37785709 reap_dead start 2020-02-11T16:28:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8cd819700 1 -- 172.21.15.88:0/37785709 reap_dead start 2020-02-11T16:28:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8ce01a700 1 -- 172.21.15.88:0/37785709 shutdown_connections 2020-02-11T16:28:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8ce01a700 1 --2- 172.21.15.88:0/37785709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c8133300 0x7fd8c814e7b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8ce01a700 1 -- 172.21.15.88:0/37785709 >> 172.21.15.88:0/37785709 conn(0x7fd8c80a9fb0 msgr2=0x7fd8c81329c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8ce01a700 1 -- 172.21.15.88:0/37785709 shutdown_connections 2020-02-11T16:28:33.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.683+0000 7fd8ce01a700 1 -- 172.21.15.88:0/37785709 wait complete. 2020-02-11T16:28:33.730 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:28:33.730 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:33.731 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:33.731 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:28:33.731 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 186, 2020-02-11T16:28:33.732 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:28:33.732 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:28:33.732 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:28:33.732 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:28:33.733 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:33.733 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2020-02-11T16:28:33.733 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:33.733 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:28:33.734 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:28:33.734 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:33.734 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:33.734 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:28:33.736 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:28:33.736 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:33.736 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:33.736 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:33.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.738 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:28:33.738 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:28:33.738 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:28:33.738 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:28:33.739 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:28:33.739 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:28:33.739 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:33.739 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:33.740 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:28:33.740 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:28:33.740 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:33.740 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:28:33.741 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:33.741 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:33.741 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:33.741 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:33.742 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:33.742 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:33.742 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:33.742 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:28:33.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.743 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:28:33.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.743 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:33.744 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:33.744 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:33.744 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:33.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.745 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:33.745 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:28:33.745 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:33.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.746 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:33.746 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:28:33.746 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:33.747 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:33.747 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:33.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.747 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:28:33.748 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:28:33.748 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:33.748 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:33.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.749 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:33.749 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:33.749 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:33.749 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:33.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.750 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:33.750 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:28:33.750 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:33.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.751 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:33.751 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:28:33.752 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:33.752 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:33.752 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:33.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.752 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:28:33.753 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:28:33.753 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:33.753 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:33.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.754 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:28:33.754 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:28:33.754 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:33.755 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:33.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.755 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:33.755 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:28:33.756 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:33.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.756 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:33.757 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:28:33.757 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:33.757 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:33.757 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:33.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.758 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:28:33.758 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:28:33.759 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:33.759 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:33.759 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:33.759 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:33.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:33.760 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:28:33.760 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:28:33.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.760 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:33.761 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:33.761 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:33.761 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:33.762 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:33.762 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:28:33.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:33.762 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:33.763 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:33.763 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:28:33.763 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:33.764 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:33.764 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:33.764 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:28:33.766 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:28:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.910+0000 7f00fda36700 1 Processor -- start 2020-02-11T16:28:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.910+0000 7f00fda36700 1 -- start start 2020-02-11T16:28:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.911+0000 7f00fda36700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f00f805be70 0x7f00f80a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.911+0000 7f00fda36700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00f805c250 0x7f00f80a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.911+0000 7f00fda36700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f809d6b0 con 0x7f00f8137f10 2020-02-11T16:28:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.911+0000 7f00fda36700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f80a3f20 con 0x7f00f805be70 2020-02-11T16:28:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.911+0000 7f00fda36700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f812ee50 con 0x7f00f805c250 2020-02-11T16:28:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.911+0000 7f00f6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f00f805be70 0x7f00f80a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.911+0000 7f00f6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f00f805be70 0x7f00f80a31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60216/0 (socket says 172.21.15.88:60216) 2020-02-11T16:28:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.911+0000 7f00f6ffd700 1 -- 172.21.15.88:0/7919465 learned_addr learned my addr 172.21.15.88:0/7919465 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.911+0000 7f00f67fc700 1 --2- 172.21.15.88:0/7919465 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00f805c250 0x7f00f80a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f6ffd700 1 -- 172.21.15.88:0/7919465 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00f805c250 msgr2=0x7f00f80a6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/7919465 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00f805c250 0x7f00f80a6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f6ffd700 1 -- 172.21.15.88:0/7919465 >> v1:172.21.15.52:6789/0 conn(0x7f00f8137f10 legacy=0x7f00f812e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f6ffd700 1 -- 172.21.15.88:0/7919465 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f812f050 con 0x7f00f805be70 2020-02-11T16:28:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/7919465 >> v2:172.21.15.88:3300/0 conn(0x7f00f805be70 0x7f00f80a31c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00e8002f30 tx=0x7f00e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/7919465 >> v2:172.21.15.88:3300/0 conn(0x7f00f805be70 0x7f00f80a31c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00e8002f30 tx=0x7f00e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/7919465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00f805be70 0x7f00f80a31c0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e80088e0).ready entity=mon.1 client_cookie=342d7c325bb6c5d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/7919465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00f805be70 0x7f00f80a31c0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f5ffb700 1 -- 172.21.15.88:0/7919465 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e80116b0 con 0x7f00f805be70 2020-02-11T16:28:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/7919465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00f805be70 0x7f00f80a31c0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/7919465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00f805be70 0x7f00f80a31c0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f5ffb700 1 -- 172.21.15.88:0/7919465 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8011810 con 0x7f00f805be70 2020-02-11T16:28:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00f5ffb700 1 -- 172.21.15.88:0/7919465 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e8011bf0 con 0x7f00f805be70 2020-02-11T16:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00fda36700 1 -- 172.21.15.88:0/7919465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00f805be70 msgr2=0x7f00f80a31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.912+0000 7f00fda36700 1 --2- 172.21.15.88:0/7919465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00f805be70 0x7f00f80a31c0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e80088e0).stop 2020-02-11T16:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.913+0000 7f00fda36700 1 -- 172.21.15.88:0/7919465 shutdown_connections 2020-02-11T16:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.913+0000 7f00fda36700 1 --2- 172.21.15.88:0/7919465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00f805be70 0x7f00f80a31c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.913+0000 7f00fda36700 1 --2- 172.21.15.88:0/7919465 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00f805c250 0x7f00f80a6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.913+0000 7f00fda36700 1 -- 172.21.15.88:0/7919465 >> 172.21.15.88:0/7919465 conn(0x7f00f80ab400 msgr2=0x7f00f80a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.913+0000 7f00fda36700 1 -- 172.21.15.88:0/7919465 shutdown_connections 2020-02-11T16:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.913+0000 7f00fda36700 1 -- 172.21.15.88:0/7919465 wait complete. 2020-02-11T16:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.914+0000 7f00fda36700 1 Processor -- start 2020-02-11T16:28:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.914+0000 7f00fda36700 1 -- start start 2020-02-11T16:28:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00fda36700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f00f805be70 0x7f00f809e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00fda36700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00f8137f10 0x7f00f8136e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00fda36700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f81372d0 con 0x7f00f805c250 2020-02-11T16:28:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00fda36700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f8135b10 con 0x7f00f805be70 2020-02-11T16:28:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00fda36700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80a1460 con 0x7f00f8137f10 2020-02-11T16:28:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00f6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f00f805be70 0x7f00f809e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00f67fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f00f805c250 0x7f00f8147200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47852/0 (socket says 172.21.15.88:47852) 2020-02-11T16:28:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00f67fc700 1 -- 172.21.15.88:0/696778519 learned_addr learned my addr 172.21.15.88:0/696778519 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00f77fe700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00f8137f10 0x7f00f8136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477045627 0 0) 0x7f00ec0080a0 con 0x7f00f805c250 2020-02-11T16:28:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d4002fe0 con 0x7f00f805c250 2020-02-11T16:28:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00f6ffd700 1 -- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00f8137f10 msgr2=0x7f00f8136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00f8137f10 0x7f00f8136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00f6ffd700 1 -- 172.21.15.88:0/696778519 >> v1:172.21.15.88:6789/0 conn(0x7f00f805c250 legacy=0x7f00f8147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00f6ffd700 1 -- 172.21.15.88:0/696778519 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f81494c0 con 0x7f00f805be70 2020-02-11T16:28:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/696778519 >> v2:172.21.15.52:3300/0 conn(0x7f00f805be70 0x7f00f809e330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e8011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.915+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/696778519 >> v2:172.21.15.52:3300/0 conn(0x7f00f805be70 0x7f00f809e330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e8011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.916+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f805be70 0x7f00f809e330 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e8011460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.916+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f805be70 0x7f00f809e330 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e8011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.916+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e800f910 con 0x7f00f805be70 2020-02-11T16:28:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.916+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f805be70 0x7f00f809e330 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e8011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.916+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f805be70 0x7f00f809e330 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e8011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.916+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8011e60 con 0x7f00f805be70 2020-02-11T16:28:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.916+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e8011c40 con 0x7f00f805be70 2020-02-11T16:28:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.916+0000 7f00fda36700 1 -- 172.21.15.88:0/696778519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f8149760 con 0x7f00f805be70 2020-02-11T16:28:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.916+0000 7f00fda36700 1 -- 172.21.15.88:0/696778519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f81491f0 con 0x7f00f805be70 2020-02-11T16:28:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.916+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f805be70 0x7f00f809e330 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e8011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00fda36700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 0x7f00f8132870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00fda36700 1 -- 172.21.15.88:0/696778519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f805c630 con 0x7f00f80a0c60 2020-02-11T16:28:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f00e80056c0 con 0x7f00f805be70 2020-02-11T16:28:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00f6ffd700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f805be70 0x7f00f809e330 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e8011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 0x7f00f8132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00e7fff700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f00d4039fe0 0x7f00d403c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f00e8049f20 con 0x7f00f805be70 2020-02-11T16:28:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00f77fe700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f00d4039fe0 0x7f00d403c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00f67fc700 1 -- 172.21.15.88:0/696778519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00f814a150 con 0x7f00f80a0c60 2020-02-11T16:28:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 0x7f00f8132870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec00c940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 0x7f00f8132870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec00c940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00f77fe700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f00d4039fe0 0x7f00d403c4a0 crc :-1 s=READY pgs=513 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.917+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 0x7f00f8132870 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec00c940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.918+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 0x7f00f8132870 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec00c940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.918+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00ec007540 con 0x7f00f80a0c60 2020-02-11T16:28:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.918+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 0x7f00f8132870 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec00c940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.918+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f00ec0059c0 con 0x7f00f80a0c60 2020-02-11T16:28:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.918+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 msgr2=0x7f00f8132870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.918+0000 7f00e7fff700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 0x7f00f8132870 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec00c940).stop 2020-02-11T16:28:33.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.918+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 msgr2=0x7f00f8132870 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:33.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.918+0000 7f00e7fff700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f80a0c60 0x7f00f8132870 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.983 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.929+0000 7f00fda36700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 0x7f00f81330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.929+0000 7f00fda36700 1 -- 172.21.15.88:0/696778519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80565b0 con 0x7f00f8132cd0 2020-02-11T16:28:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.930+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 0x7f00f81330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.930+0000 7f00f67fc700 1 -- 172.21.15.88:0/696778519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f00f805cb20 con 0x7f00f8132cd0 2020-02-11T16:28:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.930+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 0x7f00f81330b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec0125f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.930+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 0x7f00f81330b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec0125f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.930+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 0x7f00f81330b0 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec0125f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.930+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 0x7f00f81330b0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec0125f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.930+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00ec00cba0 con 0x7f00f8132cd0 2020-02-11T16:28:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00f67fc700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 0x7f00f81330b0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec0125f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4363 (secure 0 0 0) 0x7f00ec010120 con 0x7f00f8132cd0 2020-02-11T16:28:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 msgr2=0x7f00f81330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00e7fff700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 0x7f00f81330b0 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f00ec002f30 tx=0x7f00ec0125f0).stop 2020-02-11T16:28:33.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00e7fff700 1 -- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 msgr2=0x7f00f81330b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:33.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00e7fff700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f8132cd0 0x7f00f81330b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00fda36700 1 -- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f00d4039fe0 msgr2=0x7f00d403c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00fda36700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f00d4039fe0 0x7f00d403c4a0 crc :-1 s=READY pgs=513 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00fda36700 1 -- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f805be70 msgr2=0x7f00f809e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00fda36700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f805be70 0x7f00f809e330 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f00e8002f30 tx=0x7f00e8011460).stop 2020-02-11T16:28:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00f77fe700 1 -- 172.21.15.88:0/696778519 reap_dead start 2020-02-11T16:28:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00f77fe700 1 -- 172.21.15.88:0/696778519 reap_dead start 2020-02-11T16:28:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00fda36700 1 -- 172.21.15.88:0/696778519 shutdown_connections 2020-02-11T16:28:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00fda36700 1 --2- 172.21.15.88:0/696778519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f805be70 0x7f00f809e330 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00fda36700 1 -- 172.21.15.88:0/696778519 >> 172.21.15.88:0/696778519 conn(0x7f00f80ab400 msgr2=0x7f00f80a5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00fda36700 1 -- 172.21.15.88:0/696778519 shutdown_connections 2020-02-11T16:28:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:33.931+0000 7f00fda36700 1 -- 172.21.15.88:0/696778519 wait complete. 2020-02-11T16:28:33.998 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:28:33.998 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:33.998 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:33.999 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:28:33.999 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 186, 2020-02-11T16:28:33.999 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:28:33.999 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:28:33.999 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:28:34.000 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:28:34.000 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.000 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:28:34.000 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:34.000 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:28:34.000 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:28:34.001 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:34.001 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:34.001 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:34.001 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:34.001 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:34.002 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:34.002 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.002 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:28:34.002 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:28:34.002 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:34.003 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:34.003 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:34.003 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:34.003 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:34.003 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:34.004 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.004 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:28:34.004 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:28:34.004 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:28:34.005 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:28:34.005 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:28:34.005 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:28:34.005 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:34.005 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:34.014 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:28:34.014 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:28:34.014 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:34.014 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:28:34.015 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:34.015 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:34.015 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:34.015 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:34.015 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:34.016 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:34.016 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.016 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:28:34.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.016 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:28:34.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.017 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:34.017 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:34.017 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:34.018 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:34.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.018 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:34.018 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:28:34.018 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.019 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:34.019 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:28:34.020 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.020 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.020 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.020 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:28:34.021 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:28:34.021 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:34.030 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:34.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.030 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:34.031 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:34.031 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:34.031 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:34.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.032 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:34.032 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:28:34.032 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.033 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:34.033 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:28:34.034 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.034 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.034 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.035 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:28:34.035 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:28:34.035 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:34.035 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:34.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.036 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:28:34.036 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:28:34.037 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:34.037 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:34.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.037 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:34.038 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:28:34.038 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.038 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:34.039 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:28:34.039 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.039 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.039 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.040 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:28:34.040 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:28:34.040 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:34.040 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:34.041 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.041 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.041 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:28:34.041 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:28:34.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.050 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:34.050 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:34.050 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:34.051 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.051 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.051 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:28:34.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.052 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:34.052 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:34.052 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:34.052 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.053 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.053 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:28:34.053 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.053 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:34.054 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:34.054 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:28:34.054 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.054 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.054 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:28:34.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.055 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:34.055 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:34.055 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:28:34.056 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.056 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.056 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:28:34.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.056 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:34.057 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:34.057 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:34.057 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.057 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.065 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.065 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:28:34.067 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:28:34.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.190+0000 7f5e69cfb700 1 Processor -- start 2020-02-11T16:28:34.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.190+0000 7f5e69cfb700 1 -- start start 2020-02-11T16:28:34.215 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.191+0000 7f5e69cfb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e640a18a0 0x7f5e640a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:34.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.191+0000 7f5e69cfb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e640a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:34.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.191+0000 7f5e69cfb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e640a31b0 con 0x7f5e6412e3a0 2020-02-11T16:28:34.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.191+0000 7f5e69cfb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e640a3570 con 0x7f5e640a18a0 2020-02-11T16:28:34.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.191+0000 7f5e69cfb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640a3810 con 0x7f5e640a5de0 2020-02-11T16:28:34.216 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.191+0000 7f5e637fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e640a18a0 0x7f5e640a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.191+0000 7f5e62ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e640a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.191+0000 7f5e637fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e640a18a0 0x7f5e640a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46220/0 (socket says 172.21.15.88:46220) 2020-02-11T16:28:34.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.191+0000 7f5e637fe700 1 -- 172.21.15.88:0/2157178740 learned_addr learned my addr 172.21.15.88:0/2157178740 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:34.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e62ffd700 1 -- 172.21.15.88:0/2157178740 >> v2:172.21.15.52:3300/0 conn(0x7f5e640a18a0 msgr2=0x7f5e640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:34.217 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/2157178740 >> v2:172.21.15.52:3300/0 conn(0x7f5e640a18a0 0x7f5e640a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:34.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e62ffd700 1 -- 172.21.15.88:0/2157178740 >> v1:172.21.15.52:6789/0 conn(0x7f5e6412e3a0 legacy=0x7f5e6412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e62ffd700 1 -- 172.21.15.88:0/2157178740 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e640a3ab0 con 0x7f5e640a5de0 2020-02-11T16:28:34.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e637fe700 1 --2- 172.21.15.88:0/2157178740 >> v2:172.21.15.52:3300/0 conn(0x7f5e640a18a0 0x7f5e640a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:28:34.226 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/2157178740 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e640a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e58002f30 tx=0x7f5e580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/2157178740 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e640a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e58002f30 tx=0x7f5e580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/2157178740 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e640a6260 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e580088e0).ready entity=mon.2 client_cookie=fadd145a2556051f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:34.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/2157178740 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e640a6260 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e627fc700 1 -- 172.21.15.88:0/2157178740 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e58008e40 con 0x7f5e640a5de0 2020-02-11T16:28:34.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/2157178740 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e640a6260 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/2157178740 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e640a6260 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e627fc700 1 -- 172.21.15.88:0/2157178740 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580115f0 con 0x7f5e640a5de0 2020-02-11T16:28:34.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e627fc700 1 -- 172.21.15.88:0/2157178740 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e580119d0 con 0x7f5e640a5de0 2020-02-11T16:28:34.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e69cfb700 1 -- 172.21.15.88:0/2157178740 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 msgr2=0x7f5e640a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.192+0000 7f5e69cfb700 1 --2- 172.21.15.88:0/2157178740 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e640a6260 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e580088e0).stop 2020-02-11T16:28:34.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.193+0000 7f5e69cfb700 1 -- 172.21.15.88:0/2157178740 shutdown_connections 2020-02-11T16:28:34.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.193+0000 7f5e69cfb700 1 --2- 172.21.15.88:0/2157178740 >> v2:172.21.15.52:3300/0 conn(0x7f5e640a18a0 0x7f5e640a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:34.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.193+0000 7f5e69cfb700 1 --2- 172.21.15.88:0/2157178740 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e640a6260 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.193+0000 7f5e69cfb700 1 -- 172.21.15.88:0/2157178740 >> 172.21.15.88:0/2157178740 conn(0x7f5e6409d110 msgr2=0x7f5e6409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:34.229 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.193+0000 7f5e69cfb700 1 -- 172.21.15.88:0/2157178740 shutdown_connections 2020-02-11T16:28:34.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.193+0000 7f5e69cfb700 1 -- 172.21.15.88:0/2157178740 wait complete. 2020-02-11T16:28:34.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.194+0000 7f5e69cfb700 1 Processor -- start 2020-02-11T16:28:34.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.194+0000 7f5e69cfb700 1 -- start start 2020-02-11T16:28:34.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e69cfb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5e640a18a0 0x7f5e64141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:34.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e69cfb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e6409ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:34.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e69cfb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e6412e3a0 0x7f5e6409f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:34.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e69cfb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e641422d0 con 0x7f5e6412e3a0 2020-02-11T16:28:34.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e69cfb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e64142570 con 0x7f5e640a18a0 2020-02-11T16:28:34.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e69cfb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e64142810 con 0x7f5e640a5de0 2020-02-11T16:28:34.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5e640a18a0 0x7f5e64141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5e640a18a0 0x7f5e64141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60240/0 (socket says 172.21.15.88:60240) 2020-02-11T16:28:34.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 -- 172.21.15.88:0/1198977214 learned_addr learned my addr 172.21.15.88:0/1198977214 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:34.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e63fff700 1 --2- 172.21.15.88:0/1198977214 >> v2:172.21.15.52:3300/0 conn(0x7f5e6412e3a0 0x7f5e6409f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 -- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 msgr2=0x7f5e6409ec50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:28:34.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e640a5de0 0x7f5e6409ec50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 -- 172.21.15.88:0/1198977214 >> v2:172.21.15.52:3300/0 conn(0x7f5e6412e3a0 msgr2=0x7f5e6409f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 --2- 172.21.15.88:0/1198977214 >> v2:172.21.15.52:3300/0 conn(0x7f5e6412e3a0 0x7f5e6409f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 -- 172.21.15.88:0/1198977214 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e64139010 con 0x7f5e640a18a0 2020-02-11T16:28:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 --2- 172.21.15.88:0/1198977214 >> v2:172.21.15.88:3300/0 conn(0x7f5e640a18a0 0x7f5e64141c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e54002ef0 tx=0x7f5e54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 --2- 172.21.15.88:0/1198977214 >> v2:172.21.15.88:3300/0 conn(0x7f5e640a18a0 0x7f5e64141c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e54002ef0 tx=0x7f5e54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.195+0000 7f5e637fe700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640a18a0 0x7f5e64141c30 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f5e54002ef0 tx=0x7f5e54010eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:34.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.196+0000 7f5e637fe700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640a18a0 0x7f5e64141c30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f5e54002ef0 tx=0x7f5e54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.196+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e54007540 con 0x7f5e640a18a0 2020-02-11T16:28:34.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.196+0000 7f5e637fe700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640a18a0 0x7f5e64141c30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f5e54002ef0 tx=0x7f5e54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.196+0000 7f5e69cfb700 1 -- 172.21.15.88:0/1198977214 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6409f510 con 0x7f5e640a18a0 2020-02-11T16:28:34.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.196+0000 7f5e637fe700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640a18a0 0x7f5e64141c30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f5e54002ef0 tx=0x7f5e54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.196+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e540059c0 con 0x7f5e640a18a0 2020-02-11T16:28:34.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.196+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e54005de0 con 0x7f5e640a18a0 2020-02-11T16:28:34.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.196+0000 7f5e69cfb700 1 -- 172.21.15.88:0/1198977214 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e640a0cc0 con 0x7f5e640a18a0 2020-02-11T16:28:34.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.196+0000 7f5e637fe700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640a18a0 0x7f5e64141c30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f5e54002ef0 tx=0x7f5e54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.196+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5e54010180 con 0x7f5e640a18a0 2020-02-11T16:28:34.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e637fe700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640a18a0 0x7f5e64141c30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f5e54002ef0 tx=0x7f5e54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e69cfb700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 0x7f5e6409e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:34.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e69cfb700 1 -- 172.21.15.88:0/1198977214 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6405e2f0 con 0x7f5e6412d9c0 2020-02-11T16:28:34.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e60ff9700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e44039c80 0x7f5e4403c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:34.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5e54049cf0 con 0x7f5e640a18a0 2020-02-11T16:28:34.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 0x7f5e6409e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e63fff700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e44039c80 0x7f5e4403c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e63fff700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e44039c80 0x7f5e4403c140 crc :-1 s=READY pgs=514 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:34.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e62ffd700 1 -- 172.21.15.88:0/1198977214 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e64142150 con 0x7f5e6412d9c0 2020-02-11T16:28:34.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 0x7f5e6409e240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 0x7f5e6409e240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.197+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 0x7f5e6409e240 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:34.246 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.198+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 0x7f5e6409e240 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.198+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e58007340 con 0x7f5e6412d9c0 2020-02-11T16:28:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.198+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 0x7f5e6409e240 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.198+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f5e580074a0 con 0x7f5e6412d9c0 2020-02-11T16:28:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.198+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 msgr2=0x7f5e6409e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.198+0000 7f5e60ff9700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 0x7f5e6409e240 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).stop 2020-02-11T16:28:34.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.198+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 msgr2=0x7f5e6409e240 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:34.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.198+0000 7f5e60ff9700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e6412d9c0 0x7f5e6409e240 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.208+0000 7f5e69cfb700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 0x7f5e64145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:34.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.208+0000 7f5e69cfb700 1 -- 172.21.15.88:0/1198977214 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e64142410 con 0x7f5e64145200 2020-02-11T16:28:34.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.208+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 0x7f5e64145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e62ffd700 1 -- 172.21.15.88:0/1198977214 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5e640565b0 con 0x7f5e64145200 2020-02-11T16:28:34.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 0x7f5e64145610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 0x7f5e64145610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 0x7f5e64145610 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:34.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 0x7f5e64145610 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e58005e20 con 0x7f5e64145200 2020-02-11T16:28:34.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e62ffd700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 0x7f5e64145610 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f5e5800d610 con 0x7f5e64145200 2020-02-11T16:28:34.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 msgr2=0x7f5e64145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e60ff9700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 0x7f5e64145610 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).stop 2020-02-11T16:28:34.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e60ff9700 1 -- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 msgr2=0x7f5e64145610 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.209+0000 7f5e60ff9700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e64145200 0x7f5e64145610 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0x7f5e58002f30 tx=0x7f5e640a1c80).stop 2020-02-11T16:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e69cfb700 1 -- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e44039c80 msgr2=0x7f5e4403c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e69cfb700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e44039c80 0x7f5e4403c140 crc :-1 s=READY pgs=514 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e69cfb700 1 -- 172.21.15.88:0/1198977214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640a18a0 msgr2=0x7f5e64141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e69cfb700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640a18a0 0x7f5e64141c30 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f5e54002ef0 tx=0x7f5e54010eb0).stop 2020-02-11T16:28:34.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e63fff700 1 -- 172.21.15.88:0/1198977214 reap_dead start 2020-02-11T16:28:34.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e63fff700 1 -- 172.21.15.88:0/1198977214 reap_dead start 2020-02-11T16:28:34.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e69cfb700 1 -- 172.21.15.88:0/1198977214 shutdown_connections 2020-02-11T16:28:34.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e69cfb700 1 --2- 172.21.15.88:0/1198977214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640a18a0 0x7f5e64141c30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e69cfb700 1 -- 172.21.15.88:0/1198977214 >> 172.21.15.88:0/1198977214 conn(0x7f5e6409d110 msgr2=0x7f5e640a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:34.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e69cfb700 1 -- 172.21.15.88:0/1198977214 shutdown_connections 2020-02-11T16:28:34.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.210+0000 7f5e69cfb700 1 -- 172.21.15.88:0/1198977214 wait complete. 2020-02-11T16:28:34.263 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:28:34.263 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:28:34.263 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:28:34.263 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:28:34.264 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 186, 2020-02-11T16:28:34.264 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:28:34.264 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:28:34.264 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:28:34.264 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:28:34.265 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.265 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:28:34.265 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:34.265 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:28:34.270 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:28:34.270 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:34.270 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:34.270 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:34.271 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:34.271 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:34.271 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:34.271 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.272 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:28:34.272 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:28:34.272 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:34.272 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:34.272 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:34.273 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:34.273 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:34.273 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:34.278 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.278 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:28:34.278 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:28:34.279 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:28:34.279 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:28:34.279 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:28:34.279 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:28:34.280 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:34.280 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:34.280 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:28:34.280 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:28:34.281 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:34.281 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:28:34.281 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:34.281 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:34.286 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:34.286 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:34.286 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:34.286 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:34.287 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.287 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:28:34.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.287 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:28:34.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.288 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:34.288 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:34.288 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:34.288 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:34.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.289 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:34.289 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:28:34.289 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.290 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:34.291 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:28:34.291 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.291 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.291 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.292 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:28:34.292 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:28:34.292 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:34.293 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:34.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.293 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:34.302 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:34.302 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:34.302 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:34.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.303 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:34.303 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:28:34.303 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.304 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:34.304 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:28:34.304 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.304 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.305 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.305 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:28:34.305 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:28:34.310 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:34.310 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:34.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.310 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:28:34.311 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:28:34.311 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:34.311 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:34.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.312 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:34.312 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:28:34.312 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.313 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:34.313 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:28:34.313 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:34.313 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.318 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:28:34.318 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:28:34.319 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:34.319 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:34.319 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.320 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:34.320 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:28:34.320 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:28:34.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.321 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:34.321 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:34.321 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:34.326 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.326 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.326 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:28:34.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.326 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:34.327 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:34.327 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:34.327 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.327 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.328 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:28:34.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.328 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:34.328 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:34.328 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:28:34.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.329 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.329 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:28:34.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.334 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:34.334 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:34.334 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:28:34.334 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.335 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:34.335 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:28:34.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:34.337 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:28:34.343 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2020-02-11T16:28:34.344 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:28:34.344 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2020-02-11T16:28:34.344 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:28:34.344 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-02-11T16:28:34.345 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:28:34.359 INFO:tasks.ceph.mon.c:Stopped 2020-02-11T16:28:34.359 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:28:34.359 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:28:34.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.486+0000 7f02ae883700 1 Processor -- start 2020-02-11T16:28:34.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.486+0000 7f02ae883700 1 -- start start 2020-02-11T16:28:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.487+0000 7f02ae883700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02a805fc80 0x7f02a80a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.487+0000 7f02ae883700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f02a80a4ce0 0x7f02a80a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.487+0000 7f02ae883700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a8066af0 con 0x7f02a809e840 2020-02-11T16:28:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.487+0000 7f02ae883700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a80a5a30 con 0x7f02a80a4ce0 2020-02-11T16:28:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.487+0000 7f02ae883700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a80a5180 con 0x7f02a805fc80 2020-02-11T16:28:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.487+0000 7f02a7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02a805fc80 0x7f02a80a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.487+0000 7f02a7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02a805fc80 0x7f02a80a68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60276/0 (socket says 172.21.15.88:60276) 2020-02-11T16:28:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.487+0000 7f02a7fff700 1 -- 172.21.15.88:0/3717088986 learned_addr learned my addr 172.21.15.88:0/3717088986 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.487+0000 7f02a77fe700 1 --2- 172.21.15.88:0/3717088986 >> v2:172.21.15.52:3300/0 conn(0x7f02a80a4ce0 0x7f02a80a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a7fff700 1 -- 172.21.15.88:0/3717088986 >> v2:172.21.15.52:3300/0 conn(0x7f02a80a4ce0 msgr2=0x7f02a80a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a7fff700 1 --2- 172.21.15.88:0/3717088986 >> v2:172.21.15.52:3300/0 conn(0x7f02a80a4ce0 0x7f02a80a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a7fff700 1 -- 172.21.15.88:0/3717088986 >> v1:172.21.15.52:6789/0 conn(0x7f02a809e840 legacy=0x7f02a80a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a7fff700 1 -- 172.21.15.88:0/3717088986 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a80a5420 con 0x7f02a805fc80 2020-02-11T16:28:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a77fe700 1 --2- 172.21.15.88:0/3717088986 >> v2:172.21.15.52:3300/0 conn(0x7f02a80a4ce0 0x7f02a80a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:28:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a7fff700 1 --2- 172.21.15.88:0/3717088986 >> v2:172.21.15.88:3300/0 conn(0x7f02a805fc80 0x7f02a80a68b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f02a8060230 tx=0x7f0298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a7fff700 1 --2- 172.21.15.88:0/3717088986 >> v2:172.21.15.88:3300/0 conn(0x7f02a805fc80 0x7f02a80a68b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f02a8060230 tx=0x7f0298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a7fff700 1 --2- 172.21.15.88:0/3717088986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a805fc80 0x7f02a80a68b0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f02a8060230 tx=0x7f0298007a40).ready entity=mon.1 client_cookie=7f21f559a05fc4ab server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a7fff700 1 --2- 172.21.15.88:0/3717088986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a805fc80 0x7f02a80a68b0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f02a8060230 tx=0x7f0298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a7fff700 1 --2- 172.21.15.88:0/3717088986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a805fc80 0x7f02a80a68b0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f02a8060230 tx=0x7f0298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a7fff700 1 --2- 172.21.15.88:0/3717088986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a805fc80 0x7f02a80a68b0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f02a8060230 tx=0x7f0298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a6ffd700 1 -- 172.21.15.88:0/3717088986 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02980116e0 con 0x7f02a805fc80 2020-02-11T16:28:34.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a6ffd700 1 -- 172.21.15.88:0/3717088986 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0298011840 con 0x7f02a805fc80 2020-02-11T16:28:34.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02a6ffd700 1 -- 172.21.15.88:0/3717088986 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0298011c20 con 0x7f02a805fc80 2020-02-11T16:28:34.508 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02ae883700 1 -- 172.21.15.88:0/3717088986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a805fc80 msgr2=0x7f02a80a68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02ae883700 1 --2- 172.21.15.88:0/3717088986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a805fc80 0x7f02a80a68b0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f02a8060230 tx=0x7f0298007a40).stop 2020-02-11T16:28:34.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02ae883700 1 -- 172.21.15.88:0/3717088986 shutdown_connections 2020-02-11T16:28:34.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02ae883700 1 --2- 172.21.15.88:0/3717088986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a805fc80 0x7f02a80a68b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02ae883700 1 --2- 172.21.15.88:0/3717088986 >> v2:172.21.15.52:3300/0 conn(0x7f02a80a4ce0 0x7f02a80a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:34.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.488+0000 7f02ae883700 1 -- 172.21.15.88:0/3717088986 >> 172.21.15.88:0/3717088986 conn(0x7f02a80a7bb0 msgr2=0x7f02a80a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:34.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.489+0000 7f02ae883700 1 -- 172.21.15.88:0/3717088986 shutdown_connections 2020-02-11T16:28:34.509 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.489+0000 7f02ae883700 1 -- 172.21.15.88:0/3717088986 wait complete. 2020-02-11T16:28:34.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.490+0000 7f02ae883700 1 Processor -- start 2020-02-11T16:28:34.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.490+0000 7f02ae883700 1 -- start start 2020-02-11T16:28:34.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.490+0000 7f02ae883700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f02a805fc80 0x7f02a812cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:34.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.490+0000 7f02ae883700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02a809e840 0x7f02a80a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:34.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.490+0000 7f02ae883700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a812eca0 con 0x7f02a80a4ce0 2020-02-11T16:28:34.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.490+0000 7f02ae883700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a80a07c0 con 0x7f02a805fc80 2020-02-11T16:28:34.510 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.490+0000 7f02ae883700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a8067250 con 0x7f02a809e840 2020-02-11T16:28:34.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.490+0000 7f02a77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02a809e840 0x7f02a80a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.490+0000 7f02a77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02a809e840 0x7f02a80a0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60284/0 (socket says 172.21.15.88:60284) 2020-02-11T16:28:34.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 -- 172.21.15.88:0/4065647197 learned_addr learned my addr 172.21.15.88:0/4065647197 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:34.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a7fff700 1 --2- 172.21.15.88:0/4065647197 >> v2:172.21.15.52:3300/0 conn(0x7f02a805fc80 0x7f02a812cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 -- 172.21.15.88:0/4065647197 >> v2:172.21.15.52:3300/0 conn(0x7f02a805fc80 msgr2=0x7f02a812cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> v2:172.21.15.52:3300/0 conn(0x7f02a805fc80 0x7f02a812cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.511 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 -- 172.21.15.88:0/4065647197 >> v1:172.21.15.52:6789/0 conn(0x7f02a80a4ce0 legacy=0x7f02a812a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 -- 172.21.15.88:0/4065647197 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a812e760 con 0x7f02a809e840 2020-02-11T16:28:34.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> v2:172.21.15.88:3300/0 conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> v2:172.21.15.88:3300/0 conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:34.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.512 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a57fa700 1 -- 172.21.15.88:0/4065647197 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029c005e90 con 0x7f02a809e840 2020-02-11T16:28:34.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a57fa700 1 -- 172.21.15.88:0/4065647197 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c007160 con 0x7f02a809e840 2020-02-11T16:28:34.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02ae883700 1 -- 172.21.15.88:0/4065647197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a812ea00 con 0x7f02a809e840 2020-02-11T16:28:34.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02a57fa700 1 -- 172.21.15.88:0/4065647197 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029c007540 con 0x7f02a809e840 2020-02-11T16:28:34.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.491+0000 7f02ae883700 1 -- 172.21.15.88:0/4065647197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a812aa90 con 0x7f02a809e840 2020-02-11T16:28:34.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.492+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.513 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.492+0000 7f02a57fa700 1 -- 172.21.15.88:0/4065647197 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f029c00e2c0 con 0x7f02a809e840 2020-02-11T16:28:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.492+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.492+0000 7f02a57fa700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0288039d20 0x7f028803c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.492+0000 7f02ae883700 1 -- 172.21.15.88:0/4065647197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a80565b0 con 0x7f02a809e840 2020-02-11T16:28:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.492+0000 7f02a57fa700 1 -- 172.21.15.88:0/4065647197 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f029c007e40 con 0x7f02a809e840 2020-02-11T16:28:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.493+0000 7f02a7fff700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0288039d20 0x7f028803c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.493+0000 7f02a7fff700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0288039d20 0x7f028803c1e0 crc :-1 s=READY pgs=515 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.496+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.515 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.496+0000 7f02a57fa700 1 -- 172.21.15.88:0/4065647197 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f029c02f350 con 0x7f02a809e840 2020-02-11T16:28:34.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.730+0000 7f02ae883700 1 -- 172.21.15.88:0/4065647197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f02a805cb20 con 0x7f02a809e840 2020-02-11T16:28:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.730+0000 7f02a77fe700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.730+0000 7f02a57fa700 1 -- 172.21.15.88:0/4065647197 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f029c00a510 con 0x7f02a809e840 2020-02-11T16:28:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 -- 172.21.15.88:0/4065647197 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0288039d20 msgr2=0x7f028803c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0288039d20 0x7f028803c1e0 crc :-1 s=READY pgs=515 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 -- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 msgr2=0x7f02a80a0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:34.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 0x7f02a80a0360 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f02a809dd00 tx=0x7f029c010c40).stop 2020-02-11T16:28:34.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 -- 172.21.15.88:0/4065647197 shutdown_connections 2020-02-11T16:28:34.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f0288039d20 0x7f028803c1e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 --2- 172.21.15.88:0/4065647197 >> v2:172.21.15.52:3300/0 conn(0x7f02a805fc80 0x7f02a812cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 --2- 172.21.15.88:0/4065647197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a809e840 0x7f02a80a0360 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:34.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 -- 172.21.15.88:0/4065647197 >> 172.21.15.88:0/4065647197 conn(0x7f02a80a7bb0 msgr2=0x7f02a809d110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:34.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 -- 172.21.15.88:0/4065647197 shutdown_connections 2020-02-11T16:28:34.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:34.732+0000 7f02ae883700 1 -- 172.21.15.88:0/4065647197 wait complete. 2020-02-11T16:28:34.743 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":186,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:34.748 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":186,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:37.752 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:28:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.859+0000 7f7a029d2700 1 Processor -- start 2020-02-11T16:28:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.859+0000 7f7a029d2700 1 -- start start 2020-02-11T16:28:37.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.860+0000 7f7a029d2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc05be70 0x7f79fc0a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:37.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.860+0000 7f7a029d2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79fc05c250 0x7f79fc0a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:37.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.860+0000 7f7a029d2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc09d6b0 con 0x7f79fc137f10 2020-02-11T16:28:37.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.860+0000 7f7a029d2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc0a3f20 con 0x7f79fc05c250 2020-02-11T16:28:37.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.860+0000 7f7a029d2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc12ee50 con 0x7f79fc05be70 2020-02-11T16:28:37.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.860+0000 7f79fbfff700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc05be70 msgr2=0x7f79fc0a31c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:28:37.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.860+0000 7f79fbfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc05be70 0x7f79fc0a31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:37.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.860+0000 7f7a00f6f700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f79fc137f10 0x7f79fc12e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47918/0 (socket says 172.21.15.88:47918) 2020-02-11T16:28:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.860+0000 7f7a00f6f700 1 -- 172.21.15.88:0/1226630778 learned_addr learned my addr 172.21.15.88:0/1226630778 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.860+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/1226630778 >> v2:172.21.15.52:3300/0 conn(0x7f79fc05c250 0x7f79fc0a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79fb7fe700 1 -- 172.21.15.88:0/1226630778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc05be70 msgr2=0x7f79fc0a31c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:28:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/1226630778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc05be70 0x7f79fc0a31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:37.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79fb7fe700 1 -- 172.21.15.88:0/1226630778 >> v1:172.21.15.88:6789/0 conn(0x7f79fc137f10 legacy=0x7f79fc12e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:37.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79fb7fe700 1 -- 172.21.15.88:0/1226630778 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc12f050 con 0x7f79fc05c250 2020-02-11T16:28:37.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/1226630778 >> v2:172.21.15.52:3300/0 conn(0x7f79fc05c250 0x7f79fc0a6ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79fc134970 tx=0x7f79f00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/1226630778 >> v2:172.21.15.52:3300/0 conn(0x7f79fc05c250 0x7f79fc0a6ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79fc134970 tx=0x7f79f00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/1226630778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79fc05c250 0x7f79fc0a6ca0 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f79fc134970 tx=0x7f79f00088e0).ready entity=mon.0 client_cookie=b3064de279b02fcc server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:37.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/1226630778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79fc05c250 0x7f79fc0a6ca0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f79fc134970 tx=0x7f79f00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79faffd700 1 -- 172.21.15.88:0/1226630778 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f0011660 con 0x7f79fc05c250 2020-02-11T16:28:37.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/1226630778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79fc05c250 0x7f79fc0a6ca0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f79fc134970 tx=0x7f79f00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/1226630778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79fc05c250 0x7f79fc0a6ca0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f79fc134970 tx=0x7f79f00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79faffd700 1 -- 172.21.15.88:0/1226630778 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f00117c0 con 0x7f79fc05c250 2020-02-11T16:28:37.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f79faffd700 1 -- 172.21.15.88:0/1226630778 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f0011ba0 con 0x7f79fc05c250 2020-02-11T16:28:37.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f7a029d2700 1 -- 172.21.15.88:0/1226630778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79fc05c250 msgr2=0x7f79fc0a6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:37.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f7a029d2700 1 --2- 172.21.15.88:0/1226630778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79fc05c250 0x7f79fc0a6ca0 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f79fc134970 tx=0x7f79f00088e0).stop 2020-02-11T16:28:37.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f7a029d2700 1 -- 172.21.15.88:0/1226630778 shutdown_connections 2020-02-11T16:28:37.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f7a029d2700 1 --2- 172.21.15.88:0/1226630778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc05be70 0x7f79fc0a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:37.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f7a029d2700 1 --2- 172.21.15.88:0/1226630778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79fc05c250 0x7f79fc0a6ca0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:37.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.861+0000 7f7a029d2700 1 -- 172.21.15.88:0/1226630778 >> 172.21.15.88:0/1226630778 conn(0x7f79fc0ab400 msgr2=0x7f79fc0a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:37.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.862+0000 7f7a029d2700 1 -- 172.21.15.88:0/1226630778 shutdown_connections 2020-02-11T16:28:37.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.862+0000 7f7a029d2700 1 -- 172.21.15.88:0/1226630778 wait complete. 2020-02-11T16:28:37.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.862+0000 7f7a029d2700 1 Processor -- start 2020-02-11T16:28:37.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f7a029d2700 1 -- start start 2020-02-11T16:28:37.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f7a029d2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79fc05be70 0x7f79fc12c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:37.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f7a029d2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79fc05c250 0x7f79fc12c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:37.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f7a029d2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc137f10 0x7f79fc129300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:37.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f7a029d2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc131530 con 0x7f79fc05c250 2020-02-11T16:28:37.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f7a029d2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc12ae80 con 0x7f79fc05be70 2020-02-11T16:28:37.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f7a029d2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc12fd40 con 0x7f79fc137f10 2020-02-11T16:28:37.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f79fbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79fc05be70 0x7f79fc12c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:37.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f79fbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79fc05be70 0x7f79fc12c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60296/0 (socket says 172.21.15.88:60296) 2020-02-11T16:28:37.884 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f79fbfff700 1 -- 172.21.15.88:0/3419067704 learned_addr learned my addr 172.21.15.88:0/3419067704 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:37.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f7a00f6f700 1 -- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc137f10 msgr2=0x7f79fc129300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:28:37.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.863+0000 7f7a00f6f700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc137f10 0x7f79fc129300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:37.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/3419067704 >> v2:172.21.15.52:3300/0 conn(0x7f79fc05c250 0x7f79fc12c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:37.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 -- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc137f10 msgr2=0x7f79fc129300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:28:37.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc137f10 0x7f79fc129300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:37.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 -- 172.21.15.88:0/3419067704 >> v2:172.21.15.52:3300/0 conn(0x7f79fc05c250 msgr2=0x7f79fc12c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:37.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> v2:172.21.15.52:3300/0 conn(0x7f79fc05c250 0x7f79fc12c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:37.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 -- 172.21.15.88:0/3419067704 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc130df0 con 0x7f79fc05be70 2020-02-11T16:28:37.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/3419067704 >> v2:172.21.15.52:3300/0 conn(0x7f79fc05c250 0x7f79fc12c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:28:37.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> v2:172.21.15.88:3300/0 conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> v2:172.21.15.88:3300/0 conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:37.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79f97fa700 1 -- 172.21.15.88:0/3419067704 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79ec008d20 con 0x7f79fc05be70 2020-02-11T16:28:37.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79f97fa700 1 -- 172.21.15.88:0/3419067704 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec003730 con 0x7f79fc05be70 2020-02-11T16:28:37.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f7a029d2700 1 -- 172.21.15.88:0/3419067704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc131090 con 0x7f79fc05be70 2020-02-11T16:28:37.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f79f97fa700 1 -- 172.21.15.88:0/3419067704 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79ec003b50 con 0x7f79fc05be70 2020-02-11T16:28:37.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.864+0000 7f7a029d2700 1 -- 172.21.15.88:0/3419067704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc1307a0 con 0x7f79fc05be70 2020-02-11T16:28:37.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.865+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.865+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.865+0000 7f79f97fa700 1 -- 172.21.15.88:0/3419067704 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f79ec003cb0 con 0x7f79fc05be70 2020-02-11T16:28:37.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.865+0000 7f7a029d2700 1 -- 172.21.15.88:0/3419067704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc0565b0 con 0x7f79fc05be70 2020-02-11T16:28:37.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.865+0000 7f79f97fa700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039ca0 0x7f79dc03c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:37.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.865+0000 7f79f97fa700 1 -- 172.21.15.88:0/3419067704 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f79ec04bb50 con 0x7f79fc05be70 2020-02-11T16:28:37.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.866+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039ca0 0x7f79dc03c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:37.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.866+0000 7f79fb7fe700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039ca0 0x7f79dc03c160 crc :-1 s=READY pgs=516 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:37.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.870+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:37.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:37.870+0000 7f79f97fa700 1 -- 172.21.15.88:0/3419067704 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f79ec0310f0 con 0x7f79fc05be70 2020-02-11T16:28:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.104+0000 7f7a029d2700 1 -- 172.21.15.88:0/3419067704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f79fc131290 con 0x7f79fc05be70 2020-02-11T16:28:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.105+0000 7f79fbfff700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.105+0000 7f79f97fa700 1 -- 172.21.15.88:0/3419067704 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f79fc131290 con 0x7f79fc05be70 2020-02-11T16:28:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.106+0000 7f7a029d2700 1 -- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039ca0 msgr2=0x7f79dc03c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.106+0000 7f7a029d2700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039ca0 0x7f79dc03c160 crc :-1 s=READY pgs=516 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.106+0000 7f7a029d2700 1 -- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 msgr2=0x7f79fc12c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.106+0000 7f7a029d2700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 0x7f79fc12c2a0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f79ec000b20 tx=0x7f79ec012c20).stop 2020-02-11T16:28:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.106+0000 7f7a029d2700 1 -- 172.21.15.88:0/3419067704 shutdown_connections 2020-02-11T16:28:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.106+0000 7f7a029d2700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79fc137f10 0x7f79fc129300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.106+0000 7f7a029d2700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79fc05be70 0x7f79fc12c2a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.106+0000 7f7a029d2700 1 --2- 172.21.15.88:0/3419067704 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79dc039ca0 0x7f79dc03c160 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.106+0000 7f7a029d2700 1 --2- 172.21.15.88:0/3419067704 >> v2:172.21.15.52:3300/0 conn(0x7f79fc05c250 0x7f79fc12c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.106+0000 7f7a029d2700 1 -- 172.21.15.88:0/3419067704 >> 172.21.15.88:0/3419067704 conn(0x7f79fc0ab400 msgr2=0x7f79fc0a2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.107+0000 7f7a029d2700 1 -- 172.21.15.88:0/3419067704 shutdown_connections 2020-02-11T16:28:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:38.107+0000 7f7a029d2700 1 -- 172.21.15.88:0/3419067704 wait complete. 2020-02-11T16:28:38.111 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":186,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:38.120 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":186,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:41.121 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:28:41.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.248+0000 7fe9067c8700 1 Processor -- start 2020-02-11T16:28:41.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.248+0000 7fe9067c8700 1 -- start start 2020-02-11T16:28:41.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe9067c8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9000a2fa0 0x7fe9000a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:41.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe9067c8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe900131990 0x7fe9000a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:41.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe9067c8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9000a4350 con 0x7fe9000a5410 2020-02-11T16:28:41.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe9067c8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9000a1e60 con 0x7fe900131990 2020-02-11T16:28:41.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe9067c8700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000a3450 con 0x7fe9000a2fa0 2020-02-11T16:28:41.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe8fffff700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9000a2fa0 msgr2=0x7fe9000a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:28:41.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe8fffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9000a2fa0 0x7fe9000a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:41.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe904d65700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe900131990 0x7fe9000a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:41.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe904d65700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe900131990 0x7fe9000a5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60306/0 (socket says 172.21.15.88:60306) 2020-02-11T16:28:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe904d65700 1 -- 172.21.15.88:0/3055144112 learned_addr learned my addr 172.21.15.88:0/3055144112 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe904d65700 1 -- 172.21.15.88:0/3055144112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9000a2fa0 msgr2=0x7fe9000a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:28:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe904d65700 1 --2- 172.21.15.88:0/3055144112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9000a2fa0 0x7fe9000a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe904d65700 1 -- 172.21.15.88:0/3055144112 >> v1:172.21.15.52:6789/0 conn(0x7fe9000a5410 legacy=0x7fe900131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe904d65700 1 -- 172.21.15.88:0/3055144112 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9000a3a40 con 0x7fe900131990 2020-02-11T16:28:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.249+0000 7fe904d65700 1 --2- 172.21.15.88:0/3055144112 >> v2:172.21.15.88:3300/0 conn(0x7fe900131990 0x7fe9000a5890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe8f80032b0 tx=0x7fe8f8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe904d65700 1 --2- 172.21.15.88:0/3055144112 >> v2:172.21.15.88:3300/0 conn(0x7fe900131990 0x7fe9000a5890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe8f80032b0 tx=0x7fe8f8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe904d65700 1 --2- 172.21.15.88:0/3055144112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe900131990 0x7fe9000a5890 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fe8f80032b0 tx=0x7fe8f8008c60).ready entity=mon.1 client_cookie=71d7df00df85b64f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe904d65700 1 --2- 172.21.15.88:0/3055144112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe900131990 0x7fe9000a5890 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fe8f80032b0 tx=0x7fe8f8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe904d65700 1 --2- 172.21.15.88:0/3055144112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe900131990 0x7fe9000a5890 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fe8f80032b0 tx=0x7fe8f8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe8feffd700 1 -- 172.21.15.88:0/3055144112 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f800a350 con 0x7fe900131990 2020-02-11T16:28:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe904d65700 1 --2- 172.21.15.88:0/3055144112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe900131990 0x7fe9000a5890 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fe8f80032b0 tx=0x7fe8f8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe8feffd700 1 -- 172.21.15.88:0/3055144112 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f800a4b0 con 0x7fe900131990 2020-02-11T16:28:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe8feffd700 1 -- 172.21.15.88:0/3055144112 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f800a890 con 0x7fe900131990 2020-02-11T16:28:41.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe9067c8700 1 -- 172.21.15.88:0/3055144112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe900131990 msgr2=0x7fe9000a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:41.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe9067c8700 1 --2- 172.21.15.88:0/3055144112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe900131990 0x7fe9000a5890 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fe8f80032b0 tx=0x7fe8f8008c60).stop 2020-02-11T16:28:41.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe9067c8700 1 -- 172.21.15.88:0/3055144112 shutdown_connections 2020-02-11T16:28:41.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe9067c8700 1 --2- 172.21.15.88:0/3055144112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe900131990 0x7fe9000a5890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:41.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe9067c8700 1 --2- 172.21.15.88:0/3055144112 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9000a2fa0 0x7fe9000a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:41.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe9067c8700 1 -- 172.21.15.88:0/3055144112 >> 172.21.15.88:0/3055144112 conn(0x7fe90009d110 msgr2=0x7fe90009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:41.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe9067c8700 1 -- 172.21.15.88:0/3055144112 shutdown_connections 2020-02-11T16:28:41.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.250+0000 7fe9067c8700 1 -- 172.21.15.88:0/3055144112 wait complete. 2020-02-11T16:28:41.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.251+0000 7fe9067c8700 1 Processor -- start 2020-02-11T16:28:41.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.251+0000 7fe9067c8700 1 -- start start 2020-02-11T16:28:41.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.252+0000 7fe9067c8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9000a2fa0 0x7fe9001342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:41.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.252+0000 7fe9067c8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe900135330 con 0x7fe9000a5410 2020-02-11T16:28:41.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.252+0000 7fe9067c8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe900130650 con 0x7fe900131990 2020-02-11T16:28:41.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.252+0000 7fe9067c8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe900138140 con 0x7fe9000a2fa0 2020-02-11T16:28:41.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.252+0000 7fe8fffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9000a2fa0 0x7fe9001342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:41.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.252+0000 7fe8fffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9000a2fa0 0x7fe9001342b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60308/0 (socket says 172.21.15.88:60308) 2020-02-11T16:28:41.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.252+0000 7fe8fffff700 1 -- 172.21.15.88:0/976646257 learned_addr learned my addr 172.21.15.88:0/976646257 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:41.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.252+0000 7fe8fffff700 1 -- 172.21.15.88:0/976646257 >> v1:172.21.15.88:6789/0 conn(0x7fe900131990 legacy=0x7fe900133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:41.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.252+0000 7fe8fffff700 1 -- 172.21.15.88:0/976646257 >> v1:172.21.15.52:6789/0 conn(0x7fe9000a5410 legacy=0x7fe90012bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:41.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.252+0000 7fe8fffff700 1 -- 172.21.15.88:0/976646257 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900138330 con 0x7fe9000a2fa0 2020-02-11T16:28:41.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe8fffff700 1 --2- 172.21.15.88:0/976646257 >> v2:172.21.15.88:3300/0 conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe8fffff700 1 --2- 172.21.15.88:0/976646257 >> v2:172.21.15.88:3300/0 conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe8fffff700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:41.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe8fffff700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe8fffff700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe8fffff700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe8fd7fa700 1 -- 172.21.15.88:0/976646257 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f0008d20 con 0x7fe9000a2fa0 2020-02-11T16:28:41.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe8fd7fa700 1 -- 172.21.15.88:0/976646257 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f0003730 con 0x7fe9000a2fa0 2020-02-11T16:28:41.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe8fd7fa700 1 -- 172.21.15.88:0/976646257 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f0003b50 con 0x7fe9000a2fa0 2020-02-11T16:28:41.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe9067c8700 1 -- 172.21.15.88:0/976646257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe900133b10 con 0x7fe9000a2fa0 2020-02-11T16:28:41.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe9067c8700 1 -- 172.21.15.88:0/976646257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe900134f00 con 0x7fe9000a2fa0 2020-02-11T16:28:41.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.253+0000 7fe8fffff700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.254+0000 7fe8fd7fa700 1 -- 172.21.15.88:0/976646257 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe8f00123e0 con 0x7fe9000a2fa0 2020-02-11T16:28:41.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.254+0000 7fe8fffff700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.254+0000 7fe9067c8700 1 -- 172.21.15.88:0/976646257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90012b8b0 con 0x7fe9000a2fa0 2020-02-11T16:28:41.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.254+0000 7fe8fd7fa700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8e0039b60 0x7fe8e003c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:41.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.254+0000 7fe8fd7fa700 1 -- 172.21.15.88:0/976646257 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe8f0049800 con 0x7fe9000a2fa0 2020-02-11T16:28:41.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.254+0000 7fe8ff7fe700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8e0039b60 0x7fe8e003c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:41.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.255+0000 7fe8ff7fe700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8e0039b60 0x7fe8e003c020 crc :-1 s=READY pgs=517 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:41.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.258+0000 7fe8fffff700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.258+0000 7fe8fd7fa700 1 -- 172.21.15.88:0/976646257 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe8f002ee00 con 0x7fe9000a2fa0 2020-02-11T16:28:41.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.497+0000 7fe9067c8700 1 -- 172.21.15.88:0/976646257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe9000565b0 con 0x7fe9000a2fa0 2020-02-11T16:28:41.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.497+0000 7fe8fffff700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:41.499 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.497+0000 7fe8fd7fa700 1 -- 172.21.15.88:0/976646257 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fe8f00318f0 con 0x7fe9000a2fa0 2020-02-11T16:28:41.500 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":186,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.499+0000 7fe9067c8700 1 -- 172.21.15.88:0/976646257 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8e0039b60 msgr2=0x7fe8e003c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.499+0000 7fe9067c8700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8e0039b60 0x7fe8e003c020 crc :-1 s=READY pgs=517 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.499+0000 7fe9067c8700 1 -- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 msgr2=0x7fe9001342b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.499+0000 7fe9067c8700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 0x7fe9001342b0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fe8f0000b20 tx=0x7fe8f0010a40).stop 2020-02-11T16:28:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.499+0000 7fe9067c8700 1 -- 172.21.15.88:0/976646257 shutdown_connections 2020-02-11T16:28:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.499+0000 7fe9067c8700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe8e0039b60 0x7fe8e003c020 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.499+0000 7fe9067c8700 1 --2- 172.21.15.88:0/976646257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9000a2fa0 0x7fe9001342b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.499+0000 7fe9067c8700 1 -- 172.21.15.88:0/976646257 >> 172.21.15.88:0/976646257 conn(0x7fe90009d110 msgr2=0x7fe900069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.499+0000 7fe9067c8700 1 -- 172.21.15.88:0/976646257 shutdown_connections 2020-02-11T16:28:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:41.499+0000 7fe9067c8700 1 -- 172.21.15.88:0/976646257 wait complete. 2020-02-11T16:28:41.511 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":186,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:44.513 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:28:44.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.631+0000 7fe70cb2c700 1 Processor -- start 2020-02-11T16:28:44.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.631+0000 7fe70cb2c700 1 -- start start 2020-02-11T16:28:44.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe70cb2c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe70cb2c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe70cb2c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7080a4350 con 0x7fe7080a2fa0 2020-02-11T16:28:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe70cb2c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7080a1e60 con 0x7fe708131280 2020-02-11T16:28:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe70cb2c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7080a3450 con 0x7fe7080a5b20 2020-02-11T16:28:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe6fffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe6fffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60322/0 (socket says 172.21.15.88:60322) 2020-02-11T16:28:44.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 learned_addr learned my addr 172.21.15.88:0/2330711541 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:28:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:28:44.636 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:44.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:44.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.632+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:44.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.833+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:44.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.833+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:28:44.835 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.833+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:44.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.833+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:44.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.833+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:44.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.833+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:28:44.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.833+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:28:44.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.833+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:44.836 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.833+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:44.837 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:44.833+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:28:45.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:45.234+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:45.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:45.234+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:28:45.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:45.234+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:45.236 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:45.234+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:45.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:45.234+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:45.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:45.234+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:28:45.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:45.234+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:28:45.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:45.234+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:45.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:45.234+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:45.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:45.234+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:28:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:46.035+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:46.035+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:28:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:46.035+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:46.035+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:46.035+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:28:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:46.035+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:46.035+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:28:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:46.035+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:46.035+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:46.041 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:46.035+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:28:46.631 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:28:46.634 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:28:47.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:47.636+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:47.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:47.636+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:28:47.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:47.636+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:47.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:47.636+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:47.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:47.636+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:28:47.639 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:47.637+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:47.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:47.637+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:28:47.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:47.637+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:28:47.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:47.637+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:28:47.640 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:47.637+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:28:49.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.333+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239967914 0 0) 0x7fe7080a4350 con 0x7fe7080a2fa0 2020-02-11T16:28:49.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.333+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e8003230 con 0x7fe7080a2fa0 2020-02-11T16:28:49.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2525134473 0 0) 0x7fe6e8003230 con 0x7fe7080a2fa0 2020-02-11T16:28:49.342 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 msgr2=0x7fe7080a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:28:49.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.88:3300/0 conn(0x7fe7080a5b20 0x7fe7080a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:49.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 msgr2=0x7fe7081316f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:28:49.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 --2- 172.21.15.88:0/2330711541 >> v2:172.21.15.52:3300/0 conn(0x7fe708131280 0x7fe7081316f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:49.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7080a3a40 con 0x7fe7080a2fa0 2020-02-11T16:28:49.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe6f80016d0 con 0x7fe7080a2fa0 2020-02-11T16:28:49.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 >> v1:172.21.15.88:6789/0 conn(0x7fe7080a2fa0 legacy=0x7fe7080a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 0x7fe6e8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:49.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6e80044d0 0x7fe6e8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:49.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e8004db0 0x7fe6e800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:49.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7080a1e60 con 0x7fe6e8004db0 2020-02-11T16:28:49.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80041f0 con 0x7fe6e8003750 2020-02-11T16:28:49.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e800dd90 con 0x7fe6e80044d0 2020-02-11T16:28:49.344 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe6fffff700 1 -- 172.21.15.88:0/2330711541 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6e80044d0 msgr2=0x7fe6e8004950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:28:49.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe6fffff700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6e80044d0 0x7fe6e8004950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:49.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe70659c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 0x7fe6e8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.338+0000 7fe706d9d700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e8004db0 0x7fe6e800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 -- 172.21.15.88:0/2330711541 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6e80044d0 msgr2=0x7fe6e8004950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:28:49.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6e80044d0 0x7fe6e8004950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:49.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 -- 172.21.15.88:0/2330711541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e8004db0 msgr2=0x7fe6e800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:49.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e8004db0 0x7fe6e800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:49.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe706d9d700 1 -- 172.21.15.88:0/2330711541 reap_dead start 2020-02-11T16:28:49.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 -- 172.21.15.88:0/2330711541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8003230 con 0x7fe6e8003750 2020-02-11T16:28:49.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 0x7fe6e8003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe6e80054a0 tx=0x7fe708067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 0x7fe6e8003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe6e80054a0 tx=0x7fe708067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 0x7fe6e8003b70 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fe6e80054a0 tx=0x7fe708067410).ready entity=mon.1 client_cookie=d6a3a3dfc82c6b68 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 0x7fe6e8003b70 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fe6e80054a0 tx=0x7fe708067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6f8001de0 con 0x7fe6e8003750 2020-02-11T16:28:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 0x7fe6e8003b70 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fe6e80054a0 tx=0x7fe708067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f800e8c0 con 0x7fe6e8003750 2020-02-11T16:28:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70659c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 0x7fe6e8003b70 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fe6e80054a0 tx=0x7fe708067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe705d9b700 1 -- 172.21.15.88:0/2330711541 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6f800ec60 con 0x7fe6e8003750 2020-02-11T16:28:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70cb2c700 1 -- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 msgr2=0x7fe6e8003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.339+0000 7fe70cb2c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 0x7fe6e8003b70 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fe6e80054a0 tx=0x7fe708067410).stop 2020-02-11T16:28:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.340+0000 7fe70cb2c700 1 -- 172.21.15.88:0/2330711541 shutdown_connections 2020-02-11T16:28:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.340+0000 7fe70cb2c700 1 --2- 172.21.15.88:0/2330711541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6e8003750 0x7fe6e8003b70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.340+0000 7fe70cb2c700 1 -- 172.21.15.88:0/2330711541 >> 172.21.15.88:0/2330711541 conn(0x7fe70809d110 msgr2=0x7fe70809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.340+0000 7fe70cb2c700 1 -- 172.21.15.88:0/2330711541 shutdown_connections 2020-02-11T16:28:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.340+0000 7fe70cb2c700 1 -- 172.21.15.88:0/2330711541 wait complete. 2020-02-11T16:28:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.341+0000 7fe70cb2c700 1 Processor -- start 2020-02-11T16:28:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.341+0000 7fe70cb2c700 1 -- start start 2020-02-11T16:28:49.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.341+0000 7fe70cb2c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6e8003750 0x7fe708141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.341+0000 7fe70cb2c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70809def0 con 0x7fe708132cc0 2020-02-11T16:28:49.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.341+0000 7fe70cb2c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7080a04d0 con 0x7fe708141770 2020-02-11T16:28:49.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.341+0000 7fe70cb2c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe708133a50 con 0x7fe6e8003750 2020-02-11T16:28:49.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe706d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe708141770 0x7fe70814b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47984/0 (socket says 172.21.15.88:47984) 2020-02-11T16:28:49.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe706d9d700 1 -- 172.21.15.88:0/649641479 learned_addr learned my addr 172.21.15.88:0/649641479 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:49.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144470168 0 0) 0x7fe7080a04d0 con 0x7fe708141770 2020-02-11T16:28:49.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe70659c700 1 --2- 172.21.15.88:0/649641479 >> v2:172.21.15.52:3300/0 conn(0x7fe6e8003750 0x7fe708141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6ec002fe0 con 0x7fe708141770 2020-02-11T16:28:49.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 101295967 0 0) 0x7fe6ec002fe0 con 0x7fe708141770 2020-02-11T16:28:49.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe7080a04d0 con 0x7fe708141770 2020-02-11T16:28:49.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe70000b740 con 0x7fe708141770 2020-02-11T16:28:49.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 >> v2:172.21.15.52:3300/0 conn(0x7fe6e8003750 msgr2=0x7fe708141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 --2- 172.21.15.88:0/649641479 >> v2:172.21.15.52:3300/0 conn(0x7fe6e8003750 0x7fe708141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 >> v1:172.21.15.88:6789/0 conn(0x7fe708141770 legacy=0x7fe70814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 >> v1:172.21.15.52:6789/0 conn(0x7fe708132cc0 legacy=0x7fe7081301d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6ec004a00 0x7fe6ec004e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ec0041e0 0x7fe6ec00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe708133a50 con 0x7fe6ec0041e0 2020-02-11T16:28:49.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec004660 con 0x7fe6ec003920 2020-02-11T16:28:49.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec00bbb0 con 0x7fe6ec004a00 2020-02-11T16:28:49.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe70659c700 1 -- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6ec004a00 msgr2=0x7fe6ec004e20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:28:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe70659c700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6ec004a00 0x7fe6ec004e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.342+0000 7fe706d9d700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ec0041e0 0x7fe6ec00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 -- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6ec004a00 msgr2=0x7fe6ec004e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:28:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6ec004a00 0x7fe6ec004e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 -- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ec0041e0 msgr2=0x7fe6ec00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ec0041e0 0x7fe6ec00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 -- 172.21.15.88:0/649641479 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708140bd0 con 0x7fe6ec003920 2020-02-11T16:28:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe70cb2c700 1 -- 172.21.15.88:0/649641479 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe708140e70 con 0x7fe6ec003920 2020-02-11T16:28:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe706d9d700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ec0041e0 0x7fe6ec00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:28:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe706d9d700 1 -- 172.21.15.88:0/649641479 reap_dead start 2020-02-11T16:28:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe70cb2c700 1 -- 172.21.15.88:0/649641479 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70809f930 con 0x7fe6ec003920 2020-02-11T16:28:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6f0005e90 con 0x7fe6ec003920 2020-02-11T16:28:49.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f0007160 con 0x7fe6ec003920 2020-02-11T16:28:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6f0007500 con 0x7fe6ec003920 2020-02-11T16:28:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.343+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.344+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe6f000e150 con 0x7fe6ec003920 2020-02-11T16:28:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.344+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.344+0000 7fe6ff7fe700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6ec03d3f0 0x7fe6ec03f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.344+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe6f00497f0 con 0x7fe6ec003920 2020-02-11T16:28:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.344+0000 7fe70cb2c700 1 -- 172.21.15.88:0/649641479 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7080565b0 con 0x7fe6ec003920 2020-02-11T16:28:49.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.344+0000 7fe70659c700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6ec03d3f0 0x7fe6ec03f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.344+0000 7fe70659c700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6ec03d3f0 0x7fe6ec03f8b0 crc :-1 s=READY pgs=518 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.348+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.360 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.348+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe6f002ee50 con 0x7fe6ec003920 2020-02-11T16:28:49.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.610+0000 7fe70cb2c700 1 -- 172.21.15.88:0/649641479 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe70805ccb0 con 0x7fe6ec003920 2020-02-11T16:28:49.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.611+0000 7fe6fffff700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.611+0000 7fe6ff7fe700 1 -- 172.21.15.88:0/649641479 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fe6f00318c0 con 0x7fe6ec003920 2020-02-11T16:28:49.613 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":190,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:49.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.612+0000 7fe70cb2c700 1 -- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6ec03d3f0 msgr2=0x7fe6ec03f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.612+0000 7fe70cb2c700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6ec03d3f0 0x7fe6ec03f8b0 crc :-1 s=READY pgs=518 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.612+0000 7fe70cb2c700 1 -- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 msgr2=0x7fe6ec003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.612+0000 7fe70cb2c700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fe6ec005650 tx=0x7fe6f0007aa0).stop 2020-02-11T16:28:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.612+0000 7fe70cb2c700 1 -- 172.21.15.88:0/649641479 shutdown_connections 2020-02-11T16:28:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.612+0000 7fe70cb2c700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe6ec03d3f0 0x7fe6ec03f8b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.612+0000 7fe70cb2c700 1 --2- 172.21.15.88:0/649641479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6ec003920 0x7fe6ec003d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.612+0000 7fe70cb2c700 1 -- 172.21.15.88:0/649641479 >> 172.21.15.88:0/649641479 conn(0x7fe70809d110 msgr2=0x7fe708069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:49.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.612+0000 7fe70cb2c700 1 -- 172.21.15.88:0/649641479 shutdown_connections 2020-02-11T16:28:49.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.612+0000 7fe70cb2c700 1 -- 172.21.15.88:0/649641479 wait complete. 2020-02-11T16:28:49.625 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":190,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:28:49.625 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:28:49.625 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:28:49.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.744+0000 7fa12759e700 1 Processor -- start 2020-02-11T16:28:49.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.744+0000 7fa12759e700 1 -- start start 2020-02-11T16:28:49.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa12759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1280a4880 0x7fa1280a6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:49.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa12759e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa128137790 con 0x7fa12805b1e0 2020-02-11T16:28:49.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa12759e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1281379c0 con 0x7fa1280a6470 2020-02-11T16:28:49.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa12759e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa128137c60 con 0x7fa1280a4880 2020-02-11T16:28:49.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1280a4880 0x7fa1280a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1280a4880 0x7fa1280a6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60370/0 (socket says 172.21.15.88:60370) 2020-02-11T16:28:49.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 -- 172.21.15.88:0/4057878509 learned_addr learned my addr 172.21.15.88:0/4057878509 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:49.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 -- 172.21.15.88:0/4057878509 >> v1:172.21.15.88:6789/0 conn(0x7fa1280a6470 legacy=0x7fa1280a5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 -- 172.21.15.88:0/4057878509 >> v1:172.21.15.52:6789/0 conn(0x7fa12805b1e0 legacy=0x7fa128138100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 -- 172.21.15.88:0/4057878509 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280a4100 con 0x7fa1280a4880 2020-02-11T16:28:49.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4057878509 >> v2:172.21.15.88:3300/0 conn(0x7fa1280a4880 0x7fa1280a6010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa118002f30 tx=0x7fa1180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4057878509 >> v2:172.21.15.88:3300/0 conn(0x7fa1280a4880 0x7fa1280a6010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa118002f30 tx=0x7fa1180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4057878509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a4880 0x7fa1280a6010 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fa118002f30 tx=0x7fa1180088e0).ready entity=mon.1 client_cookie=85afd2d29db6fd05 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4057878509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a4880 0x7fa1280a6010 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fa118002f30 tx=0x7fa1180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa12559a700 1 -- 172.21.15.88:0/4057878509 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa118011760 con 0x7fa1280a4880 2020-02-11T16:28:49.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4057878509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a4880 0x7fa1280a6010 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fa118002f30 tx=0x7fa1180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.745+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4057878509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a4880 0x7fa1280a6010 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fa118002f30 tx=0x7fa1180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.746+0000 7fa12559a700 1 -- 172.21.15.88:0/4057878509 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1180118c0 con 0x7fa1280a4880 2020-02-11T16:28:49.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.746+0000 7fa12559a700 1 -- 172.21.15.88:0/4057878509 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa118011ca0 con 0x7fa1280a4880 2020-02-11T16:28:49.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.746+0000 7fa12759e700 1 -- 172.21.15.88:0/4057878509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a4880 msgr2=0x7fa1280a6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.746+0000 7fa12759e700 1 --2- 172.21.15.88:0/4057878509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a4880 0x7fa1280a6010 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fa118002f30 tx=0x7fa1180088e0).stop 2020-02-11T16:28:49.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.746+0000 7fa12759e700 1 -- 172.21.15.88:0/4057878509 shutdown_connections 2020-02-11T16:28:49.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.746+0000 7fa12759e700 1 --2- 172.21.15.88:0/4057878509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a4880 0x7fa1280a6010 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.746+0000 7fa12759e700 1 -- 172.21.15.88:0/4057878509 >> 172.21.15.88:0/4057878509 conn(0x7fa1280a9fb0 msgr2=0x7fa1280aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:49.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.746+0000 7fa12759e700 1 -- 172.21.15.88:0/4057878509 shutdown_connections 2020-02-11T16:28:49.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.746+0000 7fa12759e700 1 -- 172.21.15.88:0/4057878509 wait complete. 2020-02-11T16:28:49.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.747+0000 7fa12759e700 1 Processor -- start 2020-02-11T16:28:49.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.747+0000 7fa12759e700 1 -- start start 2020-02-11T16:28:49.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12759e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa12805b1e0 0x7fa128148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12759e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1280a6470 0x7fa12809f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12759e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12809f4c0 con 0x7fa1280a4880 2020-02-11T16:28:49.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12759e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12809f6b0 con 0x7fa12805b1e0 2020-02-11T16:28:49.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12759e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa128149380 con 0x7fa1280a6470 2020-02-11T16:28:49.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa126d9d700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1280a6470 msgr2=0x7fa12809f060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:28:49.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa126d9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1280a6470 0x7fa12809f060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:28:49.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa125d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa1280a4880 0x7fa1280666a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48002/0 (socket says 172.21.15.88:48002) 2020-02-11T16:28:49.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa125d9b700 1 -- 172.21.15.88:0/4208600527 learned_addr learned my addr 172.21.15.88:0/4208600527 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:28:49.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12659c700 1 --2- 172.21.15.88:0/4208600527 >> v2:172.21.15.52:3300/0 conn(0x7fa12805b1e0 0x7fa128148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755927882 0 0) 0x7fa1280a4100 con 0x7fa1280a4880 2020-02-11T16:28:49.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa104002fe0 con 0x7fa1280a4880 2020-02-11T16:28:49.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12659c700 1 -- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1280a6470 msgr2=0x7fa12809f060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:28:49.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12659c700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1280a6470 0x7fa12809f060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12659c700 1 -- 172.21.15.88:0/4208600527 >> v1:172.21.15.88:6789/0 conn(0x7fa1280a4880 legacy=0x7fa1280666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12659c700 1 -- 172.21.15.88:0/4208600527 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128149620 con 0x7fa12805b1e0 2020-02-11T16:28:49.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12659c700 1 --2- 172.21.15.88:0/4208600527 >> v2:172.21.15.52:3300/0 conn(0x7fa12805b1e0 0x7fa128148da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa128137fe0 tx=0x7fa1280684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.748+0000 7fa12659c700 1 --2- 172.21.15.88:0/4208600527 >> v2:172.21.15.52:3300/0 conn(0x7fa12805b1e0 0x7fa128148da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa128137fe0 tx=0x7fa1280684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.749+0000 7fa12659c700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12805b1e0 0x7fa128148da0 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7fa128137fe0 tx=0x7fa1280684d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.749+0000 7fa12659c700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12805b1e0 0x7fa128148da0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fa128137fe0 tx=0x7fa1280684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.749+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa11c006c10 con 0x7fa12805b1e0 2020-02-11T16:28:49.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.749+0000 7fa12659c700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12805b1e0 0x7fa128148da0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fa128137fe0 tx=0x7fa1280684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.749+0000 7fa12659c700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12805b1e0 0x7fa128148da0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fa128137fe0 tx=0x7fa1280684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.749+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c006db0 con 0x7fa12805b1e0 2020-02-11T16:28:49.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.749+0000 7fa12759e700 1 -- 172.21.15.88:0/4208600527 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa128135330 con 0x7fa12805b1e0 2020-02-11T16:28:49.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.749+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa11c0110c0 con 0x7fa12805b1e0 2020-02-11T16:28:49.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.749+0000 7fa12759e700 1 -- 172.21.15.88:0/4208600527 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa128066db0 con 0x7fa12805b1e0 2020-02-11T16:28:49.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.749+0000 7fa12659c700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12805b1e0 0x7fa128148da0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fa128137fe0 tx=0x7fa1280684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa12759e700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 0x7fa12809fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa12759e700 1 -- 172.21.15.88:0/4208600527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280565b0 con 0x7fa12809cbc0 2020-02-11T16:28:49.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa11c011340 con 0x7fa12805b1e0 2020-02-11T16:28:49.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa12659c700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12805b1e0 0x7fa128148da0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fa128137fe0 tx=0x7fa1280684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 0x7fa12809fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa1177fe700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa10403a010 0x7fa10403c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa11c0498b0 con 0x7fa12805b1e0 2020-02-11T16:28:49.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa125d9b700 1 -- 172.21.15.88:0/4208600527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1280a2b40 con 0x7fa12809cbc0 2020-02-11T16:28:49.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 0x7fa12809fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa1280a9f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 0x7fa12809fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa1280a9f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa126d9d700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa10403a010 0x7fa10403c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 0x7fa12809fe80 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa1280a9f50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 0x7fa12809fe80 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa1280a9f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.750+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa118007340 con 0x7fa12809cbc0 2020-02-11T16:28:49.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.751+0000 7fa126d9d700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa10403a010 0x7fa10403c4d0 crc :-1 s=READY pgs=519 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.751+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 0x7fa12809fe80 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa1280a9f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.751+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa1180074a0 con 0x7fa12809cbc0 2020-02-11T16:28:49.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.751+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 msgr2=0x7fa12809fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.751+0000 7fa1177fe700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 0x7fa12809fe80 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa1280a9f50).stop 2020-02-11T16:28:49.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.751+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 msgr2=0x7fa12809fe80 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:49.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.751+0000 7fa1177fe700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12809cbc0 0x7fa12809fe80 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa1280a9f50).stop 2020-02-11T16:28:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.763+0000 7fa12759e700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 0x7fa1280a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.763+0000 7fa12759e700 1 -- 172.21.15.88:0/4208600527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12805e2f0 con 0x7fa1280a85e0 2020-02-11T16:28:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.763+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 0x7fa1280a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa125d9b700 1 -- 172.21.15.88:0/4208600527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa12809f7f0 con 0x7fa1280a85e0 2020-02-11T16:28:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 0x7fa1280a89f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa118008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 0x7fa1280a89f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa118008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 0x7fa1280a89f0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa118008300).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 0x7fa1280a89f0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa118008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa11800ea40 con 0x7fa1280a85e0 2020-02-11T16:28:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa125d9b700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 0x7fa1280a89f0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa118008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.767 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4179 (secure 0 0 0) 0x7fa11800eba0 con 0x7fa1280a85e0 2020-02-11T16:28:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 msgr2=0x7fa1280a89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa1177fe700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 0x7fa1280a89f0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fa118007ed0 tx=0x7fa118008300).stop 2020-02-11T16:28:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa1177fe700 1 -- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 msgr2=0x7fa1280a89f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.764+0000 7fa1177fe700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1280a85e0 0x7fa1280a89f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.765+0000 7fa12759e700 1 -- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa10403a010 msgr2=0x7fa10403c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.765+0000 7fa12759e700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa10403a010 0x7fa10403c4d0 crc :-1 s=READY pgs=519 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.765+0000 7fa12759e700 1 -- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12805b1e0 msgr2=0x7fa128148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.768 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.765+0000 7fa12759e700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12805b1e0 0x7fa128148da0 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7fa128137fe0 tx=0x7fa1280684d0).stop 2020-02-11T16:28:49.769 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.765+0000 7fa126d9d700 1 -- 172.21.15.88:0/4208600527 reap_dead start 2020-02-11T16:28:49.769 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:28:49.769 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:49.769 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:49.769 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:28:49.769 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 190, 2020-02-11T16:28:49.770 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:28:49.770 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:28:49.770 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:28:49.770 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.770 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:28:49.770 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:49.770 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:28:49.770 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:28:49.771 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:49.771 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:49.771 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:49.771 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:49.771 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:49.771 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:49.771 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.772 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:28:49.772 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:28:49.772 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:49.772 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:49.772 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:49.772 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:49.772 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:49.772 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:49.773 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.773 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:28:49.773 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:28:49.773 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:28:49.773 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:28:49.773 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:28:49.774 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:28:49.774 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:49.774 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:49.774 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:28:49.774 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:28:49.774 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:49.774 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:28:49.775 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:49.775 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:49.775 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:49.775 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:49.775 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:49.775 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:49.775 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.775 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:28:49.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.776 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:28:49.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.776 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:49.776 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:49.776 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:49.776 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:49.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.777 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:49.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:28:49.777 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.777 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:49.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:28:49.778 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.778 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.778 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.778 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:28:49.778 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:28:49.778 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:49.779 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:49.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.782 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:49.782 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:49.782 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:49.782 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:49.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:49.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:28:49.783 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:49.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:28:49.784 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.784 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:28:49.784 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:28:49.784 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:49.785 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:49.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.785 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:28:49.785 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:28:49.785 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:49.785 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:49.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.786 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:49.786 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:28:49.786 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.786 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:49.786 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:28:49.787 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.787 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.787 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:28:49.787 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:28:49.787 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:49.788 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:49.788 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.788 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.788 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:28:49.788 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:28:49.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.788 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:28:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.789 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:28:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:49.790 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:49.791 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:49.791 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.791 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.791 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:28:49.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.791 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:49.791 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:28:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.792 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.792 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:28:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.765+0000 7fa12759e700 1 -- 172.21.15.88:0/4208600527 shutdown_connections 2020-02-11T16:28:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.765+0000 7fa12759e700 1 --2- 172.21.15.88:0/4208600527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12805b1e0 0x7fa128148da0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.765+0000 7fa12759e700 1 -- 172.21.15.88:0/4208600527 >> 172.21.15.88:0/4208600527 conn(0x7fa1280a9fb0 msgr2=0x7fa128069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.765+0000 7fa12759e700 1 -- 172.21.15.88:0/4208600527 shutdown_connections 2020-02-11T16:28:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.765+0000 7fa12759e700 1 -- 172.21.15.88:0/4208600527 wait complete. 2020-02-11T16:28:49.794 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:28:49.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.915+0000 7fedf4d9f700 1 Processor -- start 2020-02-11T16:28:49.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.915+0000 7fedf4d9f700 1 -- start start 2020-02-11T16:28:49.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.916+0000 7fedf4d9f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fedf0067030 0x7fedf00a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:49.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.916+0000 7fedf4d9f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fedf0134820 0x7fedf0134c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:28:49.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.916+0000 7fedf4d9f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf0066570 con 0x7fedf005fc80 2020-02-11T16:28:49.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.916+0000 7fedf4d9f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf0066390 con 0x7fedf0067030 2020-02-11T16:28:49.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.916+0000 7fedf4d9f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf0066810 con 0x7fedf0134820 2020-02-11T16:28:49.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.916+0000 7fedeffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fedf0134820 0x7fedf0134c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.916+0000 7fedeffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fedf0134820 0x7fedf0134c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60390/0 (socket says 172.21.15.88:60390) 2020-02-11T16:28:49.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.916+0000 7fedeffff700 1 -- 172.21.15.88:0/4104095572 learned_addr learned my addr 172.21.15.88:0/4104095572 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:49.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.916+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4104095572 >> v2:172.21.15.52:3300/0 conn(0x7fedf0067030 0x7fedf00a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeffff700 1 -- 172.21.15.88:0/4104095572 >> v2:172.21.15.52:3300/0 conn(0x7fedf0067030 msgr2=0x7fedf00a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:28:49.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeffff700 1 --2- 172.21.15.88:0/4104095572 >> v2:172.21.15.52:3300/0 conn(0x7fedf0067030 0x7fedf00a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:49.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeffff700 1 -- 172.21.15.88:0/4104095572 >> v1:172.21.15.88:6789/0 conn(0x7fedf005fc80 legacy=0x7fedf0137c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedee7fc700 1 -- 172.21.15.88:0/4104095572 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859875607 0 0) 0x7fedf0066570 con 0x7fedf005fc80 2020-02-11T16:28:49.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeffff700 1 -- 172.21.15.88:0/4104095572 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf01383a0 con 0x7fedf0134820 2020-02-11T16:28:49.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4104095572 >> v2:172.21.15.52:3300/0 conn(0x7fedf0067030 0x7fedf00a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:28:49.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeffff700 1 --2- 172.21.15.88:0/4104095572 >> v2:172.21.15.88:3300/0 conn(0x7fedf0134820 0x7fedf0134c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fede80032b0 tx=0x7fede8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeffff700 1 --2- 172.21.15.88:0/4104095572 >> v2:172.21.15.88:3300/0 conn(0x7fedf0134820 0x7fedf0134c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fede80032b0 tx=0x7fede8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeffff700 1 --2- 172.21.15.88:0/4104095572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf0134820 0x7fedf0134c40 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fede80032b0 tx=0x7fede8007dc0).ready entity=mon.1 client_cookie=fdc839bdd170c160 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeffff700 1 --2- 172.21.15.88:0/4104095572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf0134820 0x7fedf0134c40 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fede80032b0 tx=0x7fede8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedee7fc700 1 -- 172.21.15.88:0/4104095572 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fede800a160 con 0x7fedf0134820 2020-02-11T16:28:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeffff700 1 --2- 172.21.15.88:0/4104095572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf0134820 0x7fedf0134c40 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fede80032b0 tx=0x7fede8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedee7fc700 1 -- 172.21.15.88:0/4104095572 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede800a2c0 con 0x7fedf0134820 2020-02-11T16:28:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedeffff700 1 --2- 172.21.15.88:0/4104095572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf0134820 0x7fedf0134c40 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fede80032b0 tx=0x7fede8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedee7fc700 1 -- 172.21.15.88:0/4104095572 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fede800a660 con 0x7fedf0134820 2020-02-11T16:28:49.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4104095572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf0134820 msgr2=0x7fedf0134c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedf4d9f700 1 --2- 172.21.15.88:0/4104095572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf0134820 0x7fedf0134c40 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fede80032b0 tx=0x7fede8007dc0).stop 2020-02-11T16:28:49.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4104095572 shutdown_connections 2020-02-11T16:28:49.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedf4d9f700 1 --2- 172.21.15.88:0/4104095572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf0134820 0x7fedf0134c40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedf4d9f700 1 --2- 172.21.15.88:0/4104095572 >> v2:172.21.15.52:3300/0 conn(0x7fedf0067030 0x7fedf00a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:28:49.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.917+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4104095572 >> 172.21.15.88:0/4104095572 conn(0x7fedf00abb00 msgr2=0x7fedf00a7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:49.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.918+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4104095572 shutdown_connections 2020-02-11T16:28:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.918+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4104095572 wait complete. 2020-02-11T16:28:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.918+0000 7fedf4d9f700 1 Processor -- start 2020-02-11T16:28:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedf4d9f700 1 -- start start 2020-02-11T16:28:49.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedf4d9f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fedf005fc80 0x7fedf00a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedf4d9f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf00a25d0 con 0x7fedf0134820 2020-02-11T16:28:49.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedf4d9f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf00a2870 con 0x7fedf0067030 2020-02-11T16:28:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedf4d9f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf00a2b10 con 0x7fedf005fc80 2020-02-11T16:28:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedef7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fedf005fc80 0x7fedf00a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedef7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fedf005fc80 0x7fedf00a3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60392/0 (socket says 172.21.15.88:60392) 2020-02-11T16:28:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedef7fe700 1 -- 172.21.15.88:0/4151097326 learned_addr learned my addr 172.21.15.88:0/4151097326 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:28:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedef7fe700 1 -- 172.21.15.88:0/4151097326 >> v1:172.21.15.88:6789/0 conn(0x7fedf0067030 legacy=0x7fedf0145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740510175 0 0) 0x7fedf00a2870 con 0x7fedf0067030 2020-02-11T16:28:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.919+0000 7fedef7fe700 1 -- 172.21.15.88:0/4151097326 >> v1:172.21.15.52:6789/0 conn(0x7fedf0134820 legacy=0x7fedf013ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedef7fe700 1 -- 172.21.15.88:0/4151097326 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00a1900 con 0x7fedf005fc80 2020-02-11T16:28:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedef7fe700 1 --2- 172.21.15.88:0/4151097326 >> v2:172.21.15.88:3300/0 conn(0x7fedf005fc80 0x7fedf00a3a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fedf00a1790 tx=0x7fede0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedef7fe700 1 --2- 172.21.15.88:0/4151097326 >> v2:172.21.15.88:3300/0 conn(0x7fedf005fc80 0x7fedf00a3a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fedf00a1790 tx=0x7fede0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedef7fe700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf005fc80 0x7fedf00a3a30 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fedf00a1790 tx=0x7fede0010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedef7fe700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf005fc80 0x7fedf00a3a30 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fedf00a1790 tx=0x7fede0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fede000cc20 con 0x7fedf005fc80 2020-02-11T16:28:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4151097326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf00a3e90 con 0x7fedf005fc80 2020-02-11T16:28:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4151097326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf00a3170 con 0x7fedf005fc80 2020-02-11T16:28:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedef7fe700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf005fc80 0x7fedf00a3a30 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fedf00a1790 tx=0x7fede0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedef7fe700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf005fc80 0x7fedf00a3a30 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fedf00a1790 tx=0x7fede0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede000cd80 con 0x7fedf005fc80 2020-02-11T16:28:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fede00066d0 con 0x7fedf005fc80 2020-02-11T16:28:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.920+0000 7fedef7fe700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf005fc80 0x7fedf00a3a30 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fedf00a1790 tx=0x7fede0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.921+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fede0006830 con 0x7fedf005fc80 2020-02-11T16:28:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.921+0000 7fedef7fe700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf005fc80 0x7fedf00a3a30 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fedf00a1790 tx=0x7fede0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.921+0000 7fedf4d9f700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 0x7fedcc0058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.921+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4151097326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc005ea0 con 0x7fedcc003420 2020-02-11T16:28:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.921+0000 7fedecff9700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedd0039b20 0x7fedd003bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.921+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fede00496a0 con 0x7fedf005fc80 2020-02-11T16:28:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.921+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 0x7fedcc0058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.921+0000 7fedeffff700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedd0039b20 0x7fedd003bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.921+0000 7fedeeffd700 1 -- 172.21.15.88:0/4151097326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fedcc006060 con 0x7fedcc003420 2020-02-11T16:28:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedeffff700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedd0039b20 0x7fedd003bfe0 crc :-1 s=READY pgs=520 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 0x7fedcc0058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 0x7fedcc0058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 0x7fedcc0058e0 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 0x7fedcc0058e0 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fede4012b30 con 0x7fedcc003420 2020-02-11T16:28:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 0x7fedcc0058e0 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fede4007520 con 0x7fedcc003420 2020-02-11T16:28:49.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 msgr2=0x7fedcc0058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedecff9700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 0x7fedcc0058e0 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).stop 2020-02-11T16:28:49.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 msgr2=0x7fedcc0058e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:49.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.922+0000 7fedecff9700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc003420 0x7fedcc0058e0 secure :-1 s=CLOSED pgs=371 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).stop 2020-02-11T16:28:49.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.931+0000 7fedf4d9f700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 0x7fedcc0068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:28:49.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.931+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4151097326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc006dd0 con 0x7fedcc006440 2020-02-11T16:28:49.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.931+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 0x7fedcc0068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:28:49.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedeeffd700 1 -- 172.21.15.88:0/4151097326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fedcc006f90 con 0x7fedcc006440 2020-02-11T16:28:49.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 0x7fedcc0068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 0x7fedcc0068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 0x7fedcc0068f0 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:28:49.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 0x7fedcc0068f0 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fede4007350 con 0x7fedcc006440 2020-02-11T16:28:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedeeffd700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 0x7fedcc0068f0 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:28:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4351 (secure 0 0 0) 0x7fede40058d0 con 0x7fedcc006440 2020-02-11T16:28:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 msgr2=0x7fedcc0068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedecff9700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 0x7fedcc0068f0 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).stop 2020-02-11T16:28:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedecff9700 1 -- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 msgr2=0x7fedcc0068f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:28:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.932+0000 7fedecff9700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedcc006440 0x7fedcc0068f0 secure :-1 s=CLOSED pgs=372 cs=0 l=1 rx=0x7fede4002ef0 tx=0x7fede400c0b0).stop 2020-02-11T16:28:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.933+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedd0039b20 msgr2=0x7fedd003bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.933+0000 7fedf4d9f700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedd0039b20 0x7fedd003bfe0 crc :-1 s=READY pgs=520 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.933+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4151097326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf005fc80 msgr2=0x7fedf00a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:28:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.933+0000 7fedf4d9f700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf005fc80 0x7fedf00a3a30 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fedf00a1790 tx=0x7fede0010a40).stop 2020-02-11T16:28:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.933+0000 7fedeffff700 1 -- 172.21.15.88:0/4151097326 reap_dead start 2020-02-11T16:28:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.933+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4151097326 shutdown_connections 2020-02-11T16:28:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.933+0000 7fedf4d9f700 1 --2- 172.21.15.88:0/4151097326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedf005fc80 0x7fedf00a3a30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:28:49.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.933+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4151097326 >> 172.21.15.88:0/4151097326 conn(0x7fedf00abb00 msgr2=0x7fedf005b740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:28:49.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.933+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4151097326 shutdown_connections 2020-02-11T16:28:49.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:28:49.933+0000 7fedf4d9f700 1 -- 172.21.15.88:0/4151097326 wait complete. 2020-02-11T16:28:49.941 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:28:49.941 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:49.942 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:49.942 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:28:49.942 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 190, 2020-02-11T16:28:49.942 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:28:49.942 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:28:49.942 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:28:49.942 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.943 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:28:49.943 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:49.943 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:28:49.943 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:28:49.943 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:49.943 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:49.943 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:49.944 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:49.944 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:49.944 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:49.944 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.944 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:28:49.945 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:28:49.945 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:49.945 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:49.945 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:49.946 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:49.946 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:49.946 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:49.946 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.947 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:28:49.947 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:28:49.947 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:28:49.947 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:28:49.947 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:28:49.948 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:28:49.948 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:49.948 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:28:49.948 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:28:49.948 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:28:49.949 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:28:49.949 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:28:49.950 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:28:49.950 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:28:49.950 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:28:49.951 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:28:49.951 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:28:49.952 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:28:49.952 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.952 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:28:49.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.953 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:28:49.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.953 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:28:49.953 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:28:49.953 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:49.954 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:49.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.954 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:49.954 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:28:49.955 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:28:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.957 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:28:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:28:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:28:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:28:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:49.959 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:28:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:28:49.960 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:28:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:28:49.961 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:28:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:28:49.962 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:28:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:28:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:28:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:28:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.964 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:28:49.964 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:28:49.965 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:28:49.965 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.965 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:28:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:28:49.966 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:28:49.967 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:28:49.973 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.973 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:28:49.978 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:28:49.979 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:28:49.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.980 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:49.980 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:49.980 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:49.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.980 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.980 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:28:49.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.981 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:49.981 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:49.981 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:28:49.981 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.981 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.985 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:28:49.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.986 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:49.986 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:49.986 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2020-02-11T16:28:49.986 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.987 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.987 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:28:49.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.987 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:49.987 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:49.987 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:28:49.988 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.988 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:28:49.988 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:28:49.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:28:49.988 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:28:49.988 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:28:49.988 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:28:49.989 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.989 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:28:49.989 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:28:49.989 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:28:49.990 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:29:09.992 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:29:09.992 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2020-02-11T16:29:09.992 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-11T16:29:09.992 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-11T16:29:09.994 INFO:tasks.ceph.mon.c:Started 2020-02-11T16:29:09.994 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:29:09.995 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:29:10.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.113+0000 7f287c8fc700 1 Processor -- start 2020-02-11T16:29:10.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.113+0000 7f287c8fc700 1 -- start start 2020-02-11T16:29:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.113+0000 7f287c8fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28780ad380 0x7f28780a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.113+0000 7f287c8fc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287813bfe0 con 0x7f2878138280 2020-02-11T16:29:10.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.113+0000 7f287c8fc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780adb40 con 0x7f2878138710 2020-02-11T16:29:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.113+0000 7f287c8fc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2878137bf0 con 0x7f28780ad380 2020-02-11T16:29:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f2876d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2878138710 0x7f287813b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48040/0 (socket says 172.21.15.88:48040) 2020-02-11T16:29:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f2876d9d700 1 -- 172.21.15.88:0/2159882728 learned_addr learned my addr 172.21.15.88:0/2159882728 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287659c700 1 --2- 172.21.15.88:0/2159882728 >> v2:172.21.15.52:3300/0 conn(0x7f28780ad380 0x7f28780a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f2875d9b700 1 -- 172.21.15.88:0/2159882728 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389399049 0 0) 0x7f28780adb40 con 0x7f2878138710 2020-02-11T16:29:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f2875d9b700 1 -- 172.21.15.88:0/2159882728 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2858003230 con 0x7f2878138710 2020-02-11T16:29:10.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287659c700 1 -- 172.21.15.88:0/2159882728 >> v1:172.21.15.88:6789/0 conn(0x7f2878138710 legacy=0x7f287813b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287659c700 1 -- 172.21.15.88:0/2159882728 >> v1:172.21.15.52:6789/0 conn(0x7f2878138280 legacy=0x7f287813b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f2875d9b700 1 -- 172.21.15.88:0/2159882728 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630807713 0 0) 0x7f287813bfe0 con 0x7f2878138280 2020-02-11T16:29:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287659c700 1 -- 172.21.15.88:0/2159882728 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2878137de0 con 0x7f28780ad380 2020-02-11T16:29:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287659c700 1 --2- 172.21.15.88:0/2159882728 >> v2:172.21.15.52:3300/0 conn(0x7f28780ad380 0x7f28780a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2868002f30 tx=0x7f28680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287659c700 1 --2- 172.21.15.88:0/2159882728 >> v2:172.21.15.52:3300/0 conn(0x7f28780ad380 0x7f28780a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2868002f30 tx=0x7f28680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287659c700 1 --2- 172.21.15.88:0/2159882728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28780ad380 0x7f28780a9130 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680088e0).ready entity=mon.0 client_cookie=62e33bd15d4ceb17 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287659c700 1 --2- 172.21.15.88:0/2159882728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28780ad380 0x7f28780a9130 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f2875d9b700 1 -- 172.21.15.88:0/2159882728 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2868008e40 con 0x7f28780ad380 2020-02-11T16:29:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287659c700 1 --2- 172.21.15.88:0/2159882728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28780ad380 0x7f28780a9130 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287659c700 1 --2- 172.21.15.88:0/2159882728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28780ad380 0x7f28780a9130 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f2875d9b700 1 -- 172.21.15.88:0/2159882728 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28680115f0 con 0x7f28780ad380 2020-02-11T16:29:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f2875d9b700 1 -- 172.21.15.88:0/2159882728 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2868011950 con 0x7f28780ad380 2020-02-11T16:29:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287c8fc700 1 -- 172.21.15.88:0/2159882728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28780ad380 msgr2=0x7f28780a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.114+0000 7f287c8fc700 1 --2- 172.21.15.88:0/2159882728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28780ad380 0x7f28780a9130 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680088e0).stop 2020-02-11T16:29:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.115+0000 7f287c8fc700 1 -- 172.21.15.88:0/2159882728 shutdown_connections 2020-02-11T16:29:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.115+0000 7f287c8fc700 1 --2- 172.21.15.88:0/2159882728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28780ad380 0x7f28780a9130 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.115+0000 7f287c8fc700 1 -- 172.21.15.88:0/2159882728 >> 172.21.15.88:0/2159882728 conn(0x7f287805ac70 msgr2=0x7f28780ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.115+0000 7f287c8fc700 1 -- 172.21.15.88:0/2159882728 shutdown_connections 2020-02-11T16:29:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.115+0000 7f287c8fc700 1 -- 172.21.15.88:0/2159882728 wait complete. 2020-02-11T16:29:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f287c8fc700 1 Processor -- start 2020-02-11T16:29:10.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f287c8fc700 1 -- start start 2020-02-11T16:29:10.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f287c8fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28780ad380 0x7f287812df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:10.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f287c8fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2878138280 0x7f2878129700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:10.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f287c8fc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287812d740 con 0x7f2878138710 2020-02-11T16:29:10.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f287c8fc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28781292a0 con 0x7f2878138280 2020-02-11T16:29:10.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f287c8fc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2878127ac0 con 0x7f28780ad380 2020-02-11T16:29:10.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f287659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28780ad380 0x7f287812df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:10.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f287659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28780ad380 0x7f287812df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60416/0 (socket says 172.21.15.88:60416) 2020-02-11T16:29:10.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f287659c700 1 -- 172.21.15.88:0/1724745787 learned_addr learned my addr 172.21.15.88:0/1724745787 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:10.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.116+0000 7f286ffff700 1 --2- 172.21.15.88:0/1724745787 >> v2:172.21.15.52:3300/0 conn(0x7f2878138280 0x7f2878129700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:10.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287659c700 1 -- 172.21.15.88:0/1724745787 >> v2:172.21.15.52:3300/0 conn(0x7f2878138280 msgr2=0x7f2878129700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:10.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> v2:172.21.15.52:3300/0 conn(0x7f2878138280 0x7f2878129700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:10.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287659c700 1 -- 172.21.15.88:0/1724745787 >> v1:172.21.15.52:6789/0 conn(0x7f2878138710 legacy=0x7f2878129b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:10.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287659c700 1 -- 172.21.15.88:0/1724745787 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287812c520 con 0x7f28780ad380 2020-02-11T16:29:10.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> v2:172.21.15.88:3300/0 conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> v2:172.21.15.88:3300/0 conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:10.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f286f7fe700 1 -- 172.21.15.88:0/1724745787 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286800f800 con 0x7f28780ad380 2020-02-11T16:29:10.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287c8fc700 1 -- 172.21.15.88:0/1724745787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2878127d60 con 0x7f28780ad380 2020-02-11T16:29:10.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287c8fc700 1 -- 172.21.15.88:0/1724745787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2878132050 con 0x7f28780ad380 2020-02-11T16:29:10.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f286f7fe700 1 -- 172.21.15.88:0/1724745787 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2868007150 con 0x7f28780ad380 2020-02-11T16:29:10.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.117+0000 7f286f7fe700 1 -- 172.21.15.88:0/1724745787 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2868007570 con 0x7f28780ad380 2020-02-11T16:29:10.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.118+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.118+0000 7f286f7fe700 1 -- 172.21.15.88:0/1724745787 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f28680056c0 con 0x7f28780ad380 2020-02-11T16:29:10.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.118+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.118+0000 7f286f7fe700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f285c039c20 0x7f285c03c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.118+0000 7f286f7fe700 1 -- 172.21.15.88:0/1724745787 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f286804a070 con 0x7f28780ad380 2020-02-11T16:29:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.119+0000 7f287c8fc700 1 -- 172.21.15.88:0/1724745787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28781293e0 con 0x7f28780ad380 2020-02-11T16:29:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.119+0000 7f286ffff700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f285c039c20 0x7f285c03c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.119+0000 7f286ffff700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f285c039c20 0x7f285c03c0e0 crc :-1 s=READY pgs=522 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:10.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.123+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.123+0000 7f286f7fe700 1 -- 172.21.15.88:0/1724745787 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f286802f6b0 con 0x7f28780ad380 2020-02-11T16:29:10.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.358+0000 7f287c8fc700 1 -- 172.21.15.88:0/1724745787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f28780565b0 con 0x7f28780ad380 2020-02-11T16:29:10.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.359+0000 7f287659c700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:10.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.359+0000 7f286f7fe700 1 -- 172.21.15.88:0/1724745787 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f28680321c0 con 0x7f28780ad380 2020-02-11T16:29:10.362 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":190,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.360+0000 7f287c8fc700 1 -- 172.21.15.88:0/1724745787 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f285c039c20 msgr2=0x7f285c03c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.360+0000 7f287c8fc700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f285c039c20 0x7f285c03c0e0 crc :-1 s=READY pgs=522 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.360+0000 7f287c8fc700 1 -- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 msgr2=0x7f287812df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.360+0000 7f287c8fc700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 0x7f287812df80 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f2868002f30 tx=0x7f28680113a0).stop 2020-02-11T16:29:10.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.361+0000 7f287c8fc700 1 -- 172.21.15.88:0/1724745787 shutdown_connections 2020-02-11T16:29:10.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.361+0000 7f287c8fc700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28780ad380 0x7f287812df80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:10.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.361+0000 7f287c8fc700 1 --2- 172.21.15.88:0/1724745787 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f285c039c20 0x7f285c03c0e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:10.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.361+0000 7f287c8fc700 1 --2- 172.21.15.88:0/1724745787 >> v2:172.21.15.52:3300/0 conn(0x7f2878138280 0x7f2878129700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:10.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.361+0000 7f287c8fc700 1 -- 172.21.15.88:0/1724745787 >> 172.21.15.88:0/1724745787 conn(0x7f287805ac70 msgr2=0x7f2878069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:10.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.361+0000 7f287c8fc700 1 -- 172.21.15.88:0/1724745787 shutdown_connections 2020-02-11T16:29:10.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:10.361+0000 7f287c8fc700 1 -- 172.21.15.88:0/1724745787 wait complete. 2020-02-11T16:29:10.374 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":190,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:13.375 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:29:13.519 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.517+0000 7f1b8759e700 1 Processor -- start 2020-02-11T16:29:13.520 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.517+0000 7f1b8759e700 1 -- start start 2020-02-11T16:29:13.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b8759e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b88137c90 0x7f1b880a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:13.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b8759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b880a4b70 0x7f1b880a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:13.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b8759e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b880a5e40 con 0x7f1b880a83a0 2020-02-11T16:29:13.522 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b8759e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b88066090 con 0x7f1b88137c90 2020-02-11T16:29:13.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b8759e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b880a8780 con 0x7f1b880a4b70 2020-02-11T16:29:13.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b8659c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1b880a83a0 0x7f1b88066530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48050/0 (socket says 172.21.15.88:48050) 2020-02-11T16:29:13.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b8659c700 1 -- 172.21.15.88:0/2035910368 learned_addr learned my addr 172.21.15.88:0/2035910368 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:13.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/2035910368 >> v2:172.21.15.52:3300/0 conn(0x7f1b88137c90 0x7f1b880a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:13.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b86d9d700 1 --2- 172.21.15.88:0/2035910368 >> v2:172.21.15.88:3300/0 conn(0x7f1b880a4b70 0x7f1b880a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:13.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b8559a700 1 -- 172.21.15.88:0/2035910368 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301041805 0 0) 0x7f1b880a5e40 con 0x7f1b880a83a0 2020-02-11T16:29:13.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b8559a700 1 -- 172.21.15.88:0/2035910368 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b6c003230 con 0x7f1b880a83a0 2020-02-11T16:29:13.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b85d9b700 1 -- 172.21.15.88:0/2035910368 >> v2:172.21.15.88:3300/0 conn(0x7f1b880a4b70 msgr2=0x7f1b880a4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:13.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/2035910368 >> v2:172.21.15.88:3300/0 conn(0x7f1b880a4b70 0x7f1b880a4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:13.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b85d9b700 1 -- 172.21.15.88:0/2035910368 >> v1:172.21.15.88:6789/0 conn(0x7f1b880a83a0 legacy=0x7f1b88066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:13.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b85d9b700 1 -- 172.21.15.88:0/2035910368 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b880a53f0 con 0x7f1b88137c90 2020-02-11T16:29:13.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/2035910368 >> v2:172.21.15.52:3300/0 conn(0x7f1b88137c90 0x7f1b880a23a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1b78002f30 tx=0x7f1b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/2035910368 >> v2:172.21.15.52:3300/0 conn(0x7f1b88137c90 0x7f1b880a23a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1b78002f30 tx=0x7f1b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.524 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.518+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/2035910368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88137c90 0x7f1b880a23a0 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7f1b78002f30 tx=0x7f1b78007a40).ready entity=mon.0 client_cookie=75f926a118cb4ecb server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:13.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/2035910368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88137c90 0x7f1b880a23a0 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f1b78002f30 tx=0x7f1b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b8559a700 1 -- 172.21.15.88:0/2035910368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b78011310 con 0x7f1b88137c90 2020-02-11T16:29:13.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/2035910368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88137c90 0x7f1b880a23a0 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f1b78002f30 tx=0x7f1b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b8559a700 1 -- 172.21.15.88:0/2035910368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b78011470 con 0x7f1b88137c90 2020-02-11T16:29:13.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/2035910368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88137c90 0x7f1b880a23a0 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f1b78002f30 tx=0x7f1b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b8559a700 1 -- 172.21.15.88:0/2035910368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b78011810 con 0x7f1b88137c90 2020-02-11T16:29:13.525 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b8759e700 1 -- 172.21.15.88:0/2035910368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88137c90 msgr2=0x7f1b880a23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:13.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b8759e700 1 --2- 172.21.15.88:0/2035910368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88137c90 0x7f1b880a23a0 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7f1b78002f30 tx=0x7f1b78007a40).stop 2020-02-11T16:29:13.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b8759e700 1 -- 172.21.15.88:0/2035910368 shutdown_connections 2020-02-11T16:29:13.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b8759e700 1 --2- 172.21.15.88:0/2035910368 >> v2:172.21.15.88:3300/0 conn(0x7f1b880a4b70 0x7f1b880a4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:13.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b8759e700 1 --2- 172.21.15.88:0/2035910368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88137c90 0x7f1b880a23a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:13.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b8759e700 1 -- 172.21.15.88:0/2035910368 >> 172.21.15.88:0/2035910368 conn(0x7f1b880abb00 msgr2=0x7f1b880a7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:13.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.519+0000 7f1b8759e700 1 -- 172.21.15.88:0/2035910368 shutdown_connections 2020-02-11T16:29:13.526 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.520+0000 7f1b8759e700 1 -- 172.21.15.88:0/2035910368 wait complete. 2020-02-11T16:29:13.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.521+0000 7f1b8759e700 1 Processor -- start 2020-02-11T16:29:13.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.521+0000 7f1b8759e700 1 -- start start 2020-02-11T16:29:13.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b8759e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 0x7f1b881320a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:13.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b8759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b88137c90 0x7f1b88132500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:13.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b8759e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b880a0370 con 0x7f1b880a83a0 2020-02-11T16:29:13.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b8759e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b880a0610 con 0x7f1b88137c90 2020-02-11T16:29:13.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b8759e700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880a08b0 con 0x7f1b880a4b70 2020-02-11T16:29:13.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b86d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b88137c90 0x7f1b88132500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:13.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b86d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b88137c90 0x7f1b88132500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60434/0 (socket says 172.21.15.88:60434) 2020-02-11T16:29:13.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b85d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1b880a83a0 0x7f1b8809f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39840/0 (socket says 172.21.15.88:39840) 2020-02-11T16:29:13.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b86d9d700 1 -- 172.21.15.88:0/3822201133 learned_addr learned my addr 172.21.15.88:0/3822201133 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:13.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 0x7f1b881320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:13.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b8659c700 1 -- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 msgr2=0x7f1b881320a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:29:13.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b8659c700 1 -- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 msgr2=0x7f1b881320a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:29:13.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 0x7f1b881320a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:13.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 0x7f1b881320a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:13.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843647632 0 0) 0x7f1b880a0370 con 0x7f1b880a83a0 2020-02-11T16:29:13.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b64002fe0 con 0x7f1b880a83a0 2020-02-11T16:29:13.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2123292998 0 0) 0x7f1b64002fe0 con 0x7f1b880a83a0 2020-02-11T16:29:13.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1b880a0370 con 0x7f1b880a83a0 2020-02-11T16:29:13.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f1b78011e20 con 0x7f1b880a83a0 2020-02-11T16:29:13.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 msgr2=0x7f1b881320a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:29:13.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b777fe700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 0x7f1b881320a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:13.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 >> v2:172.21.15.88:3300/0 conn(0x7f1b88137c90 msgr2=0x7f1b88132500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:13.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.522+0000 7f1b777fe700 1 --2- 172.21.15.88:0/3822201133 >> v2:172.21.15.88:3300/0 conn(0x7f1b88137c90 0x7f1b88132500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:13.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 >> v1:172.21.15.52:6789/0 conn(0x7f1b880a83a0 legacy=0x7f1b8809f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:13.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b777fe700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:13.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b777fe700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b64003920 0x7f1b64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:13.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b777fe700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 0x7f1b64004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:13.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880a0610 con 0x7f1b64004a80 2020-02-11T16:29:13.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880a08b0 con 0x7f1b64003920 2020-02-11T16:29:13.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64005550 con 0x7f1b880a4b70 2020-02-11T16:29:13.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:13.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b86d9d700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 0x7f1b64004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:13.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b64003920 0x7f1b64003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:13.536 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b86d9d700 1 -- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 msgr2=0x7f1b64004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:29:13.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b86d9d700 1 -- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 msgr2=0x7f1b64004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:29:13.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b86d9d700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 0x7f1b64004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:13.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b86d9d700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 0x7f1b64004200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:13.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8659c700 1 -- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 msgr2=0x7f1b64004200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:29:13.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b880a4b70 0x7f1b64004200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:13.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8659c700 1 -- 172.21.15.88:0/3822201133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b64003920 msgr2=0x7f1b64003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:13.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b64003920 0x7f1b64003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:13.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8659c700 1 -- 172.21.15.88:0/3822201133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b88137990 con 0x7f1b64004a80 2020-02-11T16:29:13.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8759e700 1 -- 172.21.15.88:0/3822201133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b881370a0 con 0x7f1b64004a80 2020-02-11T16:29:13.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8759e700 1 -- 172.21.15.88:0/3822201133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b880a0ec0 con 0x7f1b64004a80 2020-02-11T16:29:13.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:13.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.523+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7c00c630 con 0x7f1b64004a80 2020-02-11T16:29:13.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.524+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.524+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.524+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c00c790 con 0x7f1b64004a80 2020-02-11T16:29:13.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.524+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7c00cbb0 con 0x7f1b64004a80 2020-02-11T16:29:13.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.524+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.524+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f1b7c00cd10 con 0x7f1b64004a80 2020-02-11T16:29:13.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.524+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.525+0000 7f1b777fe700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1b64041e50 0x7f1b64044310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:13.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.525+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f1b7c049610 con 0x7f1b64004a80 2020-02-11T16:29:13.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.525+0000 7f1b8759e700 1 -- 172.21.15.88:0/3822201133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b60003340 con 0x7f1b64004a80 2020-02-11T16:29:13.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.525+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1b64041e50 0x7f1b64044310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:13.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.525+0000 7f1b85d9b700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1b64041e50 0x7f1b64044310 crc :-1 s=READY pgs=523 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:13.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.529+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.529+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f1b7c02ed30 con 0x7f1b64004a80 2020-02-11T16:29:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.739+0000 7f1b8759e700 1 -- 172.21.15.88:0/3822201133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1b600036e0 con 0x7f1b64004a80 2020-02-11T16:29:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.739+0000 7f1b8659c700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.739+0000 7f1b777fe700 1 -- 172.21.15.88:0/3822201133 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f1b7c0080c0 con 0x7f1b64004a80 2020-02-11T16:29:13.742 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":190,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:13.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.741+0000 7f1b8759e700 1 -- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1b64041e50 msgr2=0x7f1b64044310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:13.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.741+0000 7f1b8759e700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1b64041e50 0x7f1b64044310 crc :-1 s=READY pgs=523 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:13.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.741+0000 7f1b8759e700 1 -- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 msgr2=0x7f1b64004e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.741+0000 7f1b8759e700 1 --2- 172.21.15.88:0/3822201133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b64004a80 0x7f1b64004e60 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f1b7c0010d0 tx=0x7f1b7c010be0).stop 2020-02-11T16:29:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.741+0000 7f1b86d9d700 1 -- 172.21.15.88:0/3822201133 reap_dead start 2020-02-11T16:29:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.741+0000 7f1b8759e700 1 -- 172.21.15.88:0/3822201133 shutdown_connections 2020-02-11T16:29:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.741+0000 7f1b8759e700 1 -- 172.21.15.88:0/3822201133 >> 172.21.15.88:0/3822201133 conn(0x7f1b880abb00 msgr2=0x7f1b88069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:13.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.742+0000 7f1b8759e700 1 -- 172.21.15.88:0/3822201133 shutdown_connections 2020-02-11T16:29:13.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:13.742+0000 7f1b8759e700 1 -- 172.21.15.88:0/3822201133 wait complete. 2020-02-11T16:29:13.757 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":190,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:16.700 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:29:16.703 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:29:16.758 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:29:16.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.872+0000 7ff55d3e5700 1 Processor -- start 2020-02-11T16:29:16.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.873+0000 7ff55d3e5700 1 -- start start 2020-02-11T16:29:16.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.873+0000 7ff55d3e5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff5580a5de0 0x7ff5580a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:16.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.873+0000 7ff55d3e5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5580a31b0 con 0x7ff558134a50 2020-02-11T16:29:16.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.873+0000 7ff55d3e5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5580a3570 con 0x7ff5580a18a0 2020-02-11T16:29:16.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.873+0000 7ff55d3e5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5580a3810 con 0x7ff5580a5de0 2020-02-11T16:29:16.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.873+0000 7ff556ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff5580a18a0 0x7ff5580a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48070/0 (socket says 172.21.15.88:48070) 2020-02-11T16:29:16.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.873+0000 7ff556ffd700 1 -- 172.21.15.88:0/1061174120 learned_addr learned my addr 172.21.15.88:0/1061174120 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:16.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff5567fc700 1 --2- 172.21.15.88:0/1061174120 >> v2:172.21.15.52:3300/0 conn(0x7ff5580a5de0 0x7ff5580a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:16.887 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190329259 0 0) 0x7ff5580a3570 con 0x7ff5580a18a0 2020-02-11T16:29:16.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff53c003230 con 0x7ff5580a18a0 2020-02-11T16:29:16.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1101175928 0 0) 0x7ff53c003230 con 0x7ff5580a18a0 2020-02-11T16:29:16.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 >> v2:172.21.15.52:3300/0 conn(0x7ff5580a5de0 msgr2=0x7ff5580a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:16.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 --2- 172.21.15.88:0/1061174120 >> v2:172.21.15.52:3300/0 conn(0x7ff5580a5de0 0x7ff5580a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:16.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 >> v1:172.21.15.52:6789/0 conn(0x7ff558134a50 legacy=0x7ff558134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:16.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580a3ab0 con 0x7ff5580a18a0 2020-02-11T16:29:16.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7ff5480016d0 con 0x7ff5580a18a0 2020-02-11T16:29:16.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 >> v1:172.21.15.88:6789/0 conn(0x7ff5580a18a0 legacy=0x7ff5580a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:16.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff53c003720 0x7ff53c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:16.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff53c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:16.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff53c004db0 0x7ff53c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:16.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580a3810 con 0x7ff53c004db0 2020-02-11T16:29:16.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0041c0 con 0x7ff53c0044d0 2020-02-11T16:29:16.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c00bb80 con 0x7ff53c003720 2020-02-11T16:29:16.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff5567fc700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff53c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:16.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff556ffd700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff53c003720 0x7ff53c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:16.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff5577fe700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff53c004db0 0x7ff53c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:16.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff5567fc700 1 -- 172.21.15.88:0/1061174120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff53c003720 msgr2=0x7ff53c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:16.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff5567fc700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff53c003720 0x7ff53c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:16.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff5567fc700 1 -- 172.21.15.88:0/1061174120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff53c004db0 msgr2=0x7ff53c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:16.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff5567fc700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff53c004db0 0x7ff53c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:16.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff5567fc700 1 -- 172.21.15.88:0/1061174120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c003230 con 0x7ff53c0044d0 2020-02-11T16:29:16.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.874+0000 7ff5577fe700 1 -- 172.21.15.88:0/1061174120 reap_dead start 2020-02-11T16:29:16.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff5567fc700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff53c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff53c0054a0 tx=0x7ff54c010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff5567fc700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff53c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff53c0054a0 tx=0x7ff54c010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff5567fc700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff53c004950 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7ff53c0054a0 tx=0x7ff54c010080).ready entity=mon.1 client_cookie=529df877b7d09608 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:16.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff5567fc700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff53c004950 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ff53c0054a0 tx=0x7ff54c010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff5567fc700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff53c004950 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ff53c0054a0 tx=0x7ff54c010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54c008d50 con 0x7ff53c0044d0 2020-02-11T16:29:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff5567fc700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff53c004950 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ff53c0054a0 tx=0x7ff54c010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c0108c0 con 0x7ff53c0044d0 2020-02-11T16:29:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff555ffb700 1 -- 172.21.15.88:0/1061174120 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54c010c60 con 0x7ff53c0044d0 2020-02-11T16:29:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff55d3e5700 1 -- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 msgr2=0x7ff53c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:16.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff55d3e5700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff53c004950 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7ff53c0054a0 tx=0x7ff54c010080).stop 2020-02-11T16:29:16.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff55d3e5700 1 -- 172.21.15.88:0/1061174120 shutdown_connections 2020-02-11T16:29:16.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff55d3e5700 1 --2- 172.21.15.88:0/1061174120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff53c004950 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:16.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff55d3e5700 1 -- 172.21.15.88:0/1061174120 >> 172.21.15.88:0/1061174120 conn(0x7ff55809d110 msgr2=0x7ff55809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:16.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff55d3e5700 1 -- 172.21.15.88:0/1061174120 shutdown_connections 2020-02-11T16:29:16.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.875+0000 7ff55d3e5700 1 -- 172.21.15.88:0/1061174120 wait complete. 2020-02-11T16:29:16.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.876+0000 7ff55d3e5700 1 Processor -- start 2020-02-11T16:29:16.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.876+0000 7ff55d3e5700 1 -- start start 2020-02-11T16:29:16.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff55d3e5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff53c0044d0 0x7ff55812c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:16.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff55d3e5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff5580a9d00 0x7ff5580aa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:16.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff55d3e5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5580a7660 con 0x7ff558144970 2020-02-11T16:29:16.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff55d3e5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55812f5b0 con 0x7ff5580a9d00 2020-02-11T16:29:16.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff55d3e5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5580a4780 con 0x7ff53c0044d0 2020-02-11T16:29:16.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff556ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff53c0044d0 0x7ff55812c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:16.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff556ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff53c0044d0 0x7ff55812c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60452/0 (socket says 172.21.15.88:60452) 2020-02-11T16:29:16.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff556ffd700 1 -- 172.21.15.88:0/2345106973 learned_addr learned my addr 172.21.15.88:0/2345106973 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:16.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff5567fc700 1 --2- 172.21.15.88:0/2345106973 >> v2:172.21.15.52:3300/0 conn(0x7ff5580a9d00 0x7ff5580aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:16.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff556ffd700 1 -- 172.21.15.88:0/2345106973 >> v2:172.21.15.52:3300/0 conn(0x7ff5580a9d00 msgr2=0x7ff5580aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:16.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> v2:172.21.15.52:3300/0 conn(0x7ff5580a9d00 0x7ff5580aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:16.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff556ffd700 1 -- 172.21.15.88:0/2345106973 >> v1:172.21.15.88:6789/0 conn(0x7ff558144970 legacy=0x7ff558144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:16.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff556ffd700 1 -- 172.21.15.88:0/2345106973 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580a97a0 con 0x7ff53c0044d0 2020-02-11T16:29:16.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> v2:172.21.15.88:3300/0 conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> v2:172.21.15.88:3300/0 conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.877+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:16.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.878+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.878+0000 7ff547fff700 1 -- 172.21.15.88:0/2345106973 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54800e160 con 0x7ff53c0044d0 2020-02-11T16:29:16.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.878+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.878+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.878+0000 7ff547fff700 1 -- 172.21.15.88:0/2345106973 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54800e2c0 con 0x7ff53c0044d0 2020-02-11T16:29:16.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.878+0000 7ff547fff700 1 -- 172.21.15.88:0/2345106973 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54800e6a0 con 0x7ff53c0044d0 2020-02-11T16:29:16.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.878+0000 7ff55d3e5700 1 -- 172.21.15.88:0/2345106973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55812f7c0 con 0x7ff53c0044d0 2020-02-11T16:29:16.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.878+0000 7ff55d3e5700 1 -- 172.21.15.88:0/2345106973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5580a8900 con 0x7ff53c0044d0 2020-02-11T16:29:16.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.878+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.878+0000 7ff547fff700 1 -- 172.21.15.88:0/2345106973 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff548007250 con 0x7ff53c0044d0 2020-02-11T16:29:16.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.879+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.879+0000 7ff55d3e5700 1 -- 172.21.15.88:0/2345106973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5580a9930 con 0x7ff53c0044d0 2020-02-11T16:29:16.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.879+0000 7ff547fff700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff534039ca0 0x7ff53403c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:16.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.879+0000 7ff547fff700 1 -- 172.21.15.88:0/2345106973 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff548049910 con 0x7ff53c0044d0 2020-02-11T16:29:16.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.879+0000 7ff5567fc700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff534039ca0 0x7ff53403c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:16.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.879+0000 7ff5567fc700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff534039ca0 0x7ff53403c160 crc :-1 s=READY pgs=524 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:16.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.883+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:16.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:16.883+0000 7ff547fff700 1 -- 172.21.15.88:0/2345106973 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff54802ed20 con 0x7ff53c0044d0 2020-02-11T16:29:17.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.103+0000 7ff55d3e5700 1 -- 172.21.15.88:0/2345106973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff5580565b0 con 0x7ff53c0044d0 2020-02-11T16:29:17.106 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.104+0000 7ff556ffd700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.104+0000 7ff547fff700 1 -- 172.21.15.88:0/2345106973 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7ff5480319a0 con 0x7ff53c0044d0 2020-02-11T16:29:17.107 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:17.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.105+0000 7ff55d3e5700 1 -- 172.21.15.88:0/2345106973 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff534039ca0 msgr2=0x7ff53403c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.105+0000 7ff55d3e5700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff534039ca0 0x7ff53403c160 crc :-1 s=READY pgs=524 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.105+0000 7ff55d3e5700 1 -- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 msgr2=0x7ff55812c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.105+0000 7ff55d3e5700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff55812c560 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7ff5480013e0 tx=0x7ff548010e60).stop 2020-02-11T16:29:17.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.105+0000 7ff55d3e5700 1 -- 172.21.15.88:0/2345106973 shutdown_connections 2020-02-11T16:29:17.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.105+0000 7ff55d3e5700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff53c0044d0 0x7ff55812c560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.105+0000 7ff55d3e5700 1 --2- 172.21.15.88:0/2345106973 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff534039ca0 0x7ff53403c160 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.105+0000 7ff55d3e5700 1 --2- 172.21.15.88:0/2345106973 >> v2:172.21.15.52:3300/0 conn(0x7ff5580a9d00 0x7ff5580aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.105+0000 7ff55d3e5700 1 -- 172.21.15.88:0/2345106973 >> 172.21.15.88:0/2345106973 conn(0x7ff55809d110 msgr2=0x7ff558069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:17.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.106+0000 7ff55d3e5700 1 -- 172.21.15.88:0/2345106973 shutdown_connections 2020-02-11T16:29:17.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.106+0000 7ff55d3e5700 1 -- 172.21.15.88:0/2345106973 wait complete. 2020-02-11T16:29:17.125 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":192,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:17.125 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:29:17.125 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:29:17.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.307+0000 7fd64737f700 1 Processor -- start 2020-02-11T16:29:17.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.307+0000 7fd64737f700 1 -- start start 2020-02-11T16:29:17.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.308+0000 7fd64737f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd6400a3ab0 0x7fd6400a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:17.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.308+0000 7fd64737f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd640139c30 0x7fd64012f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:17.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.308+0000 7fd64737f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6400a4b00 con 0x7fd6400a6f70 2020-02-11T16:29:17.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.308+0000 7fd64737f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6400a75b0 con 0x7fd6400a3ab0 2020-02-11T16:29:17.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.308+0000 7fd64737f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6400a7850 con 0x7fd640139c30 2020-02-11T16:29:17.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.308+0000 7fd64591c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd640139c30 0x7fd64012f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.308+0000 7fd64591c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd640139c30 0x7fd64012f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60462/0 (socket says 172.21.15.88:60462) 2020-02-11T16:29:17.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.308+0000 7fd64591c700 1 -- 172.21.15.88:0/1000511107 learned_addr learned my addr 172.21.15.88:0/1000511107 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:17.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.308+0000 7fd64511b700 1 --2- 172.21.15.88:0/1000511107 >> v2:172.21.15.52:3300/0 conn(0x7fd6400a3ab0 0x7fd6400a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd64591c700 1 -- 172.21.15.88:0/1000511107 >> v2:172.21.15.52:3300/0 conn(0x7fd6400a3ab0 msgr2=0x7fd6400a6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:17.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd64591c700 1 --2- 172.21.15.88:0/1000511107 >> v2:172.21.15.52:3300/0 conn(0x7fd6400a3ab0 0x7fd6400a6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:17.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd637fff700 1 -- 172.21.15.88:0/1000511107 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999813428 0 0) 0x7fd6400a4b00 con 0x7fd6400a6f70 2020-02-11T16:29:17.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd64591c700 1 -- 172.21.15.88:0/1000511107 >> v1:172.21.15.88:6789/0 conn(0x7fd6400a6f70 legacy=0x7fd640139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd64591c700 1 -- 172.21.15.88:0/1000511107 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6401390f0 con 0x7fd640139c30 2020-02-11T16:29:17.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd64591c700 1 --2- 172.21.15.88:0/1000511107 >> v2:172.21.15.88:3300/0 conn(0x7fd640139c30 0x7fd64012f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd6380032b0 tx=0x7fd638007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd64591c700 1 --2- 172.21.15.88:0/1000511107 >> v2:172.21.15.88:3300/0 conn(0x7fd640139c30 0x7fd64012f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd6380032b0 tx=0x7fd638007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd64591c700 1 --2- 172.21.15.88:0/1000511107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd640139c30 0x7fd64012f8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fd6380032b0 tx=0x7fd638007dc0).ready entity=mon.1 client_cookie=662670dc32dee49e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd64591c700 1 --2- 172.21.15.88:0/1000511107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd640139c30 0x7fd64012f8f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd6380032b0 tx=0x7fd638007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd637fff700 1 -- 172.21.15.88:0/1000511107 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd63800a160 con 0x7fd640139c30 2020-02-11T16:29:17.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd64591c700 1 --2- 172.21.15.88:0/1000511107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd640139c30 0x7fd64012f8f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd6380032b0 tx=0x7fd638007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd637fff700 1 -- 172.21.15.88:0/1000511107 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63800a2c0 con 0x7fd640139c30 2020-02-11T16:29:17.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd64591c700 1 --2- 172.21.15.88:0/1000511107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd640139c30 0x7fd64012f8f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd6380032b0 tx=0x7fd638007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.309+0000 7fd637fff700 1 -- 172.21.15.88:0/1000511107 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd63800a660 con 0x7fd640139c30 2020-02-11T16:29:17.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.310+0000 7fd64737f700 1 -- 172.21.15.88:0/1000511107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd640139c30 msgr2=0x7fd64012f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.310+0000 7fd64737f700 1 --2- 172.21.15.88:0/1000511107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd640139c30 0x7fd64012f8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fd6380032b0 tx=0x7fd638007dc0).stop 2020-02-11T16:29:17.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.310+0000 7fd64737f700 1 -- 172.21.15.88:0/1000511107 shutdown_connections 2020-02-11T16:29:17.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.310+0000 7fd64737f700 1 --2- 172.21.15.88:0/1000511107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd640139c30 0x7fd64012f8f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.310+0000 7fd64737f700 1 --2- 172.21.15.88:0/1000511107 >> v2:172.21.15.52:3300/0 conn(0x7fd6400a3ab0 0x7fd6400a6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:17.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.310+0000 7fd64737f700 1 -- 172.21.15.88:0/1000511107 >> 172.21.15.88:0/1000511107 conn(0x7fd64009d110 msgr2=0x7fd64009d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:17.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.310+0000 7fd64737f700 1 -- 172.21.15.88:0/1000511107 shutdown_connections 2020-02-11T16:29:17.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.310+0000 7fd64737f700 1 -- 172.21.15.88:0/1000511107 wait complete. 2020-02-11T16:29:17.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.311+0000 7fd64737f700 1 Processor -- start 2020-02-11T16:29:17.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.311+0000 7fd64737f700 1 -- start start 2020-02-11T16:29:17.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64737f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6400a3ab0 0x7fd640132a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64737f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6400a6f70 0x7fd640146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64737f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd640131040 con 0x7fd640139c30 2020-02-11T16:29:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64737f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd640130e50 con 0x7fd6400a3ab0 2020-02-11T16:29:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64737f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6401312e0 con 0x7fd6400a6f70 2020-02-11T16:29:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64511b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6400a3ab0 0x7fd640132a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64511b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6400a3ab0 0x7fd640132a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60466/0 (socket says 172.21.15.88:60466) 2020-02-11T16:29:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64511b700 1 -- 172.21.15.88:0/1832305471 learned_addr learned my addr 172.21.15.88:0/1832305471 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6400a6f70 0x7fd640146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64491a700 1 -- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6400a6f70 msgr2=0x7fd640146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:29:17.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64491a700 1 -- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6400a6f70 msgr2=0x7fd640146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:29:17.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6400a6f70 0x7fd640146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:17.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6400a6f70 0x7fd640146420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:17.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64511b700 1 -- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6400a6f70 msgr2=0x7fd640146420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:29:17.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64511b700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6400a6f70 0x7fd640146420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64511b700 1 -- 172.21.15.88:0/1832305471 >> v1:172.21.15.52:6789/0 conn(0x7fd640139c30 legacy=0x7fd640146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986789989 0 0) 0x7fd640131040 con 0x7fd640139c30 2020-02-11T16:29:17.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64511b700 1 -- 172.21.15.88:0/1832305471 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640138e20 con 0x7fd6400a3ab0 2020-02-11T16:29:17.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.312+0000 7fd64511b700 1 --2- 172.21.15.88:0/1832305471 >> v2:172.21.15.88:3300/0 conn(0x7fd6400a3ab0 0x7fd640132a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd640128ed0 tx=0x7fd630010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd64511b700 1 --2- 172.21.15.88:0/1832305471 >> v2:172.21.15.88:3300/0 conn(0x7fd6400a3ab0 0x7fd640132a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd640128ed0 tx=0x7fd630010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd64511b700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a3ab0 0x7fd640132a30 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fd640128ed0 tx=0x7fd630010da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd64511b700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a3ab0 0x7fd640132a30 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd640128ed0 tx=0x7fd630010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd630005e90 con 0x7fd6400a3ab0 2020-02-11T16:29:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd64511b700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a3ab0 0x7fd640132a30 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd640128ed0 tx=0x7fd630010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd64511b700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a3ab0 0x7fd640132a30 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd640128ed0 tx=0x7fd630010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd630007160 con 0x7fd6400a3ab0 2020-02-11T16:29:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd64737f700 1 -- 172.21.15.88:0/1832305471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd640130a70 con 0x7fd6400a3ab0 2020-02-11T16:29:17.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd630007540 con 0x7fd6400a3ab0 2020-02-11T16:29:17.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd64737f700 1 -- 172.21.15.88:0/1832305471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64012f2a0 con 0x7fd6400a3ab0 2020-02-11T16:29:17.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.313+0000 7fd64511b700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a3ab0 0x7fd640132a30 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd640128ed0 tx=0x7fd630010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.314+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd630012490 con 0x7fd6400a3ab0 2020-02-11T16:29:17.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.314+0000 7fd64511b700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a3ab0 0x7fd640132a30 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd640128ed0 tx=0x7fd630010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.314+0000 7fd64737f700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 0x7fd640146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.314+0000 7fd64737f700 1 -- 172.21.15.88:0/1832305471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64005e2f0 con 0x7fd64012ebc0 2020-02-11T16:29:17.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.314+0000 7fd6367fc700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd628039bb0 0x7fd62803c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.314+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fd63004a020 con 0x7fd6400a3ab0 2020-02-11T16:29:17.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.314+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 0x7fd640146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd64591c700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd628039bb0 0x7fd62803c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd64491a700 1 -- 172.21.15.88:0/1832305471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6401324e0 con 0x7fd64012ebc0 2020-02-11T16:29:17.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 0x7fd640146f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 0x7fd640146f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd64591c700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd628039bb0 0x7fd62803c070 crc :-1 s=READY pgs=525 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 0x7fd640146f90 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 0x7fd640146f90 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd63c00cc20 con 0x7fd64012ebc0 2020-02-11T16:29:17.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 0x7fd640146f90 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fd63c00cd80 con 0x7fd64012ebc0 2020-02-11T16:29:17.328 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 msgr2=0x7fd640146f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd6367fc700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 0x7fd640146f90 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).stop 2020-02-11T16:29:17.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 msgr2=0x7fd640146f90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:17.329 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.315+0000 7fd6367fc700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd64012ebc0 0x7fd640146f90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.328+0000 7fd64737f700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 0x7fd6400a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.330 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.328+0000 7fd64737f700 1 -- 172.21.15.88:0/1832305471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400565b0 con 0x7fd6400a9740 2020-02-11T16:29:17.331 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.328+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 0x7fd6400a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.328+0000 7fd64491a700 1 -- 172.21.15.88:0/1832305471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd64005bb00 con 0x7fd6400a9740 2020-02-11T16:29:17.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.328+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 0x7fd6400a7ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.328+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 0x7fd6400a7ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.328+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 0x7fd6400a7ef0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.329+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 0x7fd6400a7ef0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.329+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd63c001e30 con 0x7fd6400a9740 2020-02-11T16:29:17.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.329+0000 7fd64491a700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 0x7fd6400a7ef0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.329+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4190 (secure 0 0 0) 0x7fd63c014520 con 0x7fd6400a9740 2020-02-11T16:29:17.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.329+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 msgr2=0x7fd6400a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.329+0000 7fd6367fc700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 0x7fd6400a7ef0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fd63c000b80 tx=0x7fd63c010ba0).stop 2020-02-11T16:29:17.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.329+0000 7fd6367fc700 1 -- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 msgr2=0x7fd6400a7ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:17.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.329+0000 7fd6367fc700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a9740 0x7fd6400a7ef0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64737f700 1 -- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd628039bb0 msgr2=0x7fd62803c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64737f700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd628039bb0 0x7fd62803c070 crc :-1 s=READY pgs=525 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64737f700 1 -- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a3ab0 msgr2=0x7fd640132a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64737f700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a3ab0 0x7fd640132a30 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fd640128ed0 tx=0x7fd630010da0).stop 2020-02-11T16:29:17.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64591c700 1 -- 172.21.15.88:0/1832305471 reap_dead start 2020-02-11T16:29:17.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64591c700 1 -- 172.21.15.88:0/1832305471 reap_dead start 2020-02-11T16:29:17.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64737f700 1 -- 172.21.15.88:0/1832305471 shutdown_connections 2020-02-11T16:29:17.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64737f700 1 --2- 172.21.15.88:0/1832305471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6400a3ab0 0x7fd640132a30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64737f700 1 -- 172.21.15.88:0/1832305471 >> 172.21.15.88:0/1832305471 conn(0x7fd64009d110 msgr2=0x7fd640129720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:17.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64737f700 1 -- 172.21.15.88:0/1832305471 shutdown_connections 2020-02-11T16:29:17.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.330+0000 7fd64737f700 1 -- 172.21.15.88:0/1832305471 wait complete. 2020-02-11T16:29:17.336 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:29:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:29:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:29:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:29:17.336 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 192, 2020-02-11T16:29:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:29:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:29:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:29:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:29:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:29:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:29:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:29:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:17.338 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:29:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:29:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:17.339 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:29:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:29:17.340 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:29:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:29:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:29:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:29:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:29:17.341 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:29:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:29:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:17.342 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:29:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:29:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.343 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:29:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:29:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:29:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:29:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.346 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:29:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:29:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:29:17.347 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:29:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:29:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:29:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.349 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:29:17.350 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:29:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:29:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:29:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:29:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:29:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.353 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:29:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.354 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:29:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.355 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:29:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:29:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.356 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.357 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:29:17.358 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:29:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.543+0000 7f7d7f39d700 1 Processor -- start 2020-02-11T16:29:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.543+0000 7f7d7f39d700 1 -- start start 2020-02-11T16:29:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.544+0000 7f7d7f39d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d780a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.544+0000 7f7d7f39d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d780a6170 0x7f7d78134240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.544+0000 7f7d7f39d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d780a22b0 con 0x7f7d781346a0 2020-02-11T16:29:17.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.544+0000 7f7d7f39d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d780a2550 con 0x7f7d780a6170 2020-02-11T16:29:17.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.544+0000 7f7d7f39d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780a3a30 con 0x7f7d7805b1e0 2020-02-11T16:29:17.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.544+0000 7f7d7db9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d780a6170 0x7f7d78134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.544+0000 7f7d7db9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d780a6170 0x7f7d78134240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60480/0 (socket says 172.21.15.88:60480) 2020-02-11T16:29:17.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.544+0000 7f7d7db9a700 1 -- 172.21.15.88:0/3679450392 learned_addr learned my addr 172.21.15.88:0/3679450392 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:17.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.544+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d780a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7e39b700 1 -- 172.21.15.88:0/3679450392 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 msgr2=0x7f7d780a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:29:17.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7e39b700 1 -- 172.21.15.88:0/3679450392 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 msgr2=0x7f7d780a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:29:17.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d780a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:17.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d780a3f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:17.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7db9a700 1 -- 172.21.15.88:0/3679450392 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 msgr2=0x7f7d780a3f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:29:17.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7db9a700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d780a3f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:17.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7db9a700 1 -- 172.21.15.88:0/3679450392 >> v1:172.21.15.52:6789/0 conn(0x7f7d781346a0 legacy=0x7f7d78134b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7db9a700 1 -- 172.21.15.88:0/3679450392 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780a65f0 con 0x7f7d780a6170 2020-02-11T16:29:17.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7db9a700 1 --2- 172.21.15.88:0/3679450392 >> v2:172.21.15.88:3300/0 conn(0x7f7d780a6170 0x7f7d78134240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d68002f30 tx=0x7f7d680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7db9a700 1 --2- 172.21.15.88:0/3679450392 >> v2:172.21.15.88:3300/0 conn(0x7f7d780a6170 0x7f7d78134240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d68002f30 tx=0x7f7d680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7db9a700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d780a6170 0x7f7d78134240 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f7d68002f30 tx=0x7f7d680088e0).ready entity=mon.1 client_cookie=e8a145e9c56872c0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7db9a700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d780a6170 0x7f7d78134240 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f7d68002f30 tx=0x7f7d680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7db9a700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d780a6170 0x7f7d78134240 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f7d68002f30 tx=0x7f7d680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7db9a700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d780a6170 0x7f7d78134240 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f7d68002f30 tx=0x7f7d680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7d399700 1 -- 172.21.15.88:0/3679450392 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d68011760 con 0x7f7d780a6170 2020-02-11T16:29:17.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7d399700 1 -- 172.21.15.88:0/3679450392 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d680118c0 con 0x7f7d780a6170 2020-02-11T16:29:17.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7d399700 1 -- 172.21.15.88:0/3679450392 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d68011ca0 con 0x7f7d780a6170 2020-02-11T16:29:17.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7f39d700 1 -- 172.21.15.88:0/3679450392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d780a6170 msgr2=0x7f7d78134240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.545+0000 7f7d7f39d700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d780a6170 0x7f7d78134240 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f7d68002f30 tx=0x7f7d680088e0).stop 2020-02-11T16:29:17.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.546+0000 7f7d7f39d700 1 -- 172.21.15.88:0/3679450392 shutdown_connections 2020-02-11T16:29:17.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.546+0000 7f7d7f39d700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d780a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:17.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.546+0000 7f7d7f39d700 1 --2- 172.21.15.88:0/3679450392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d780a6170 0x7f7d78134240 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.546+0000 7f7d7f39d700 1 -- 172.21.15.88:0/3679450392 >> 172.21.15.88:0/3679450392 conn(0x7f7d780a9fb0 msgr2=0x7f7d780aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:17.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.546+0000 7f7d7f39d700 1 -- 172.21.15.88:0/3679450392 shutdown_connections 2020-02-11T16:29:17.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.546+0000 7f7d7f39d700 1 -- 172.21.15.88:0/3679450392 wait complete. 2020-02-11T16:29:17.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.547+0000 7f7d7f39d700 1 Processor -- start 2020-02-11T16:29:17.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.547+0000 7f7d7f39d700 1 -- start start 2020-02-11T16:29:17.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.548+0000 7f7d7f39d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d7809a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.548+0000 7f7d7f39d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d781346a0 0x7f7d7814cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.548+0000 7f7d7f39d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7805bb40 con 0x7f7d780a6170 2020-02-11T16:29:17.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.548+0000 7f7d7f39d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7809ee20 con 0x7f7d781346a0 2020-02-11T16:29:17.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.548+0000 7f7d7f39d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7809f0c0 con 0x7f7d7805b1e0 2020-02-11T16:29:17.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.548+0000 7f7d7eb9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d781346a0 0x7f7d7814cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.548+0000 7f7d7e39b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d7809a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.548+0000 7f7d7eb9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d781346a0 0x7f7d7814cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60488/0 (socket says 172.21.15.88:60488) 2020-02-11T16:29:17.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.548+0000 7f7d7eb9c700 1 -- 172.21.15.88:0/1462404899 learned_addr learned my addr 172.21.15.88:0/1462404899 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:17.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327766185 0 0) 0x7f7d7805bb40 con 0x7f7d780a6170 2020-02-11T16:29:17.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.548+0000 7f7d7e39b700 1 -- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 msgr2=0x7f7d7809a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:29:17.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d58002fe0 con 0x7f7d780a6170 2020-02-11T16:29:17.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7e39b700 1 -- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 msgr2=0x7f7d7809a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:29:17.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d7809a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:17.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d7809a0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:17.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7eb9c700 1 -- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 msgr2=0x7f7d7809a0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:29:17.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7eb9c700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d7805b1e0 0x7f7d7809a0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7eb9c700 1 -- 172.21.15.88:0/1462404899 >> v1:172.21.15.52:6789/0 conn(0x7f7d780a6170 legacy=0x7f7d7809abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7eb9c700 1 -- 172.21.15.88:0/1462404899 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7809a520 con 0x7f7d781346a0 2020-02-11T16:29:17.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7eb9c700 1 --2- 172.21.15.88:0/1462404899 >> v2:172.21.15.88:3300/0 conn(0x7f7d781346a0 0x7f7d7814cfa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d780a5dd0 tx=0x7f7d7000c790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7eb9c700 1 --2- 172.21.15.88:0/1462404899 >> v2:172.21.15.88:3300/0 conn(0x7f7d781346a0 0x7f7d7814cfa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d780a5dd0 tx=0x7f7d7000c790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7eb9c700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d781346a0 0x7f7d7814cfa0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f7d780a5dd0 tx=0x7f7d7000c790).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7eb9c700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d781346a0 0x7f7d7814cfa0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f7d780a5dd0 tx=0x7f7d7000c790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d700101c0 con 0x7f7d781346a0 2020-02-11T16:29:17.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7eb9c700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d781346a0 0x7f7d7814cfa0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f7d780a5dd0 tx=0x7f7d7000c790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d7eb9c700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d781346a0 0x7f7d7814cfa0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f7d780a5dd0 tx=0x7f7d7000c790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70010320 con 0x7f7d781346a0 2020-02-11T16:29:17.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.549+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d70010740 con 0x7f7d781346a0 2020-02-11T16:29:17.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.550+0000 7f7d7f39d700 1 -- 172.21.15.88:0/1462404899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7809ea30 con 0x7f7d781346a0 2020-02-11T16:29:17.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.550+0000 7f7d7f39d700 1 -- 172.21.15.88:0/1462404899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d78137fc0 con 0x7f7d781346a0 2020-02-11T16:29:17.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.550+0000 7f7d7eb9c700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d781346a0 0x7f7d7814cfa0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f7d780a5dd0 tx=0x7f7d7000c790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f7d70006860 con 0x7f7d781346a0 2020-02-11T16:29:17.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d7eb9c700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d781346a0 0x7f7d7814cfa0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f7d780a5dd0 tx=0x7f7d7000c790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d7f39d700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 0x7f7d7814d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d7f39d700 1 -- 172.21.15.88:0/1462404899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7809ef60 con 0x7f7d780a6780 2020-02-11T16:29:17.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d677fe700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7d5803a070 0x7f7d5803c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f7d70049cb0 con 0x7f7d781346a0 2020-02-11T16:29:17.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 0x7f7d7814d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d7db9a700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7d5803a070 0x7f7d5803c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d7e39b700 1 -- 172.21.15.88:0/1462404899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d7809a940 con 0x7f7d780a6780 2020-02-11T16:29:17.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 0x7f7d7814d400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d7db9a700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7d5803a070 0x7f7d5803c530 crc :-1 s=READY pgs=526 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.551+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 0x7f7d7814d400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.552+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 0x7f7d7814d400 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.552+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 0x7f7d7814d400 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.552+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d74012b90 con 0x7f7d780a6780 2020-02-11T16:29:17.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.552+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 0x7f7d7814d400 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.552+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f7d74012cf0 con 0x7f7d780a6780 2020-02-11T16:29:17.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.552+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 msgr2=0x7f7d7814d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.552+0000 7f7d677fe700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 0x7f7d7814d400 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).stop 2020-02-11T16:29:17.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.552+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 msgr2=0x7f7d7814d400 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:17.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.552+0000 7f7d677fe700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d780a6780 0x7f7d7814d400 secure :-1 s=CLOSED pgs=385 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).stop 2020-02-11T16:29:17.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.564+0000 7f7d7f39d700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 0x7f7d780a8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.564+0000 7f7d7f39d700 1 -- 172.21.15.88:0/1462404899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7809f200 con 0x7f7d7814d860 2020-02-11T16:29:17.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.564+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 0x7f7d780a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.564+0000 7f7d7e39b700 1 -- 172.21.15.88:0/1462404899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7d780565b0 con 0x7f7d7814d860 2020-02-11T16:29:17.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.564+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 0x7f7d780a8500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.564+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 0x7f7d780a8500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.564+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 0x7f7d780a8500 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.564+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 0x7f7d780a8500 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.564+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d74009560 con 0x7f7d7814d860 2020-02-11T16:29:17.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.565+0000 7f7d7e39b700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 0x7f7d780a8500 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.569 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.565+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4362 (secure 0 0 0) 0x7f7d740096c0 con 0x7f7d7814d860 2020-02-11T16:29:17.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.565+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 msgr2=0x7f7d780a8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.565+0000 7f7d677fe700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 0x7f7d780a8500 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f7d74002f30 tx=0x7f7d780684d0).stop 2020-02-11T16:29:17.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.565+0000 7f7d677fe700 1 -- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 msgr2=0x7f7d780a8500 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:17.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.565+0000 7f7d677fe700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d7814d860 0x7f7d780a8500 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.565+0000 7f7d7f39d700 1 -- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7d5803a070 msgr2=0x7f7d5803c530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.565+0000 7f7d7f39d700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f7d5803a070 0x7f7d5803c530 crc :-1 s=READY pgs=526 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.570 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.565+0000 7f7d7f39d700 1 -- 172.21.15.88:0/1462404899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d781346a0 msgr2=0x7f7d7814cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.571 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.565+0000 7f7d7f39d700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d781346a0 0x7f7d7814cfa0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f7d780a5dd0 tx=0x7f7d7000c790).stop 2020-02-11T16:29:17.571 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:29:17.571 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:17.571 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:17.571 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:29:17.571 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 192, 2020-02-11T16:29:17.571 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:29:17.572 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:29:17.572 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:29:17.572 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:29:17.572 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.572 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:29:17.572 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:17.572 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:29:17.573 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:29:17.573 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:17.573 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:17.573 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:17.573 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:17.573 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:17.573 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:17.573 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.574 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:29:17.574 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:29:17.574 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:17.574 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:17.574 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:17.574 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:17.574 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:17.575 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:17.575 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.575 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:29:17.575 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:29:17.575 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:29:17.575 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:29:17.575 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:29:17.576 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:29:17.576 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:17.576 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:17.576 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:29:17.576 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:29:17.576 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:17.576 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:29:17.577 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:17.577 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:17.577 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:17.577 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:17.577 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:17.577 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:17.577 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.578 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:29:17.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.578 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:29:17.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.578 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:17.578 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:17.578 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:17.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:17.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.579 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:17.579 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:29:17.579 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.579 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:17.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:29:17.580 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.580 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.580 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:29:17.580 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:29:17.581 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:17.581 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:17.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.581 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:29:17.581 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:29:17.581 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:17.581 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:17.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.582 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:17.582 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:29:17.582 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.582 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:17.583 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:29:17.583 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.583 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.583 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.583 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:29:17.583 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:29:17.583 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:17.584 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:17.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.584 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:17.584 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:17.584 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:17.584 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:17.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.585 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:17.585 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:29:17.585 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.585 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:17.586 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:29:17.586 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:17.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.586 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.586 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:29:17.586 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:29:17.586 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:17.587 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:17.587 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.587 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:17.587 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:29:17.587 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:29:17.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.588 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:17.588 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:17.588 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:17.588 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.588 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.588 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:29:17.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.588 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:17.589 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:17.589 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:17.589 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.589 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.589 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:29:17.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.589 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:17.590 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:17.590 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2020-02-11T16:29:17.590 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.590 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.590 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:29:17.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.590 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:17.591 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:17.591 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:29:17.591 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.591 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:17.591 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:29:17.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:17.591 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:17.591 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:17.592 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:29:17.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.592 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:17.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:17.592 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:29:17.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.566+0000 7f7d7eb9c700 1 -- 172.21.15.88:0/1462404899 reap_dead start 2020-02-11T16:29:17.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.566+0000 7f7d7eb9c700 1 -- 172.21.15.88:0/1462404899 reap_dead start 2020-02-11T16:29:17.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.566+0000 7f7d7f39d700 1 -- 172.21.15.88:0/1462404899 shutdown_connections 2020-02-11T16:29:17.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.566+0000 7f7d7f39d700 1 --2- 172.21.15.88:0/1462404899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d781346a0 0x7f7d7814cfa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.566+0000 7f7d7f39d700 1 -- 172.21.15.88:0/1462404899 >> 172.21.15.88:0/1462404899 conn(0x7f7d780a9fb0 msgr2=0x7f7d7805a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:17.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.566+0000 7f7d7f39d700 1 -- 172.21.15.88:0/1462404899 shutdown_connections 2020-02-11T16:29:17.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.566+0000 7f7d7f39d700 1 -- 172.21.15.88:0/1462404899 wait complete. 2020-02-11T16:29:17.595 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:29:17.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.708+0000 7ff89c6ef700 1 Processor -- start 2020-02-11T16:29:17.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.708+0000 7ff89c6ef700 1 -- start start 2020-02-11T16:29:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.709+0000 7ff89c6ef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff8940a6260 0x7ff894135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.709+0000 7ff89c6ef700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8940a31b0 con 0x7ff8940a5de0 2020-02-11T16:29:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.709+0000 7ff89c6ef700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8940a3570 con 0x7ff8940a18a0 2020-02-11T16:29:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.709+0000 7ff89c6ef700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8940a3810 con 0x7ff8940a6260 2020-02-11T16:29:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.709+0000 7ff899c8a700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff8940a5de0 0x7ff894134a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39908/0 (socket says 172.21.15.88:39908) 2020-02-11T16:29:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.709+0000 7ff899c8a700 1 -- 172.21.15.88:0/205996602 learned_addr learned my addr 172.21.15.88:0/205996602 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7593596 0 0) 0x7ff8940a31b0 con 0x7ff8940a5de0 2020-02-11T16:29:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff87c003230 con 0x7ff8940a5de0 2020-02-11T16:29:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3158765732 0 0) 0x7ff87c003230 con 0x7ff8940a5de0 2020-02-11T16:29:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 >> v2:172.21.15.88:3300/0 conn(0x7ff8940a6260 msgr2=0x7ff894135160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 --2- 172.21.15.88:0/205996602 >> v2:172.21.15.88:3300/0 conn(0x7ff8940a6260 0x7ff894135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 >> v1:172.21.15.88:6789/0 conn(0x7ff8940a18a0 legacy=0x7ff8940a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940a3ab0 con 0x7ff8940a5de0 2020-02-11T16:29:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7ff8900016d0 con 0x7ff8940a5de0 2020-02-11T16:29:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 >> v1:172.21.15.52:6789/0 conn(0x7ff8940a5de0 legacy=0x7ff894134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c003720 0x7ff87c003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 0x7ff87c004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff87c004ae0 0x7ff87c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940a3810 con 0x7ff87c003720 2020-02-11T16:29:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c00b8b0 con 0x7ff87c004ae0 2020-02-11T16:29:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c00ba70 con 0x7ff87c004090 2020-02-11T16:29:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff87c004ae0 0x7ff87c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.710+0000 7ff899c8a700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 0x7ff87c004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff89a48b700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c003720 0x7ff87c003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 -- 172.21.15.88:0/205996602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff87c004ae0 msgr2=0x7ff87c004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff87c004ae0 0x7ff87c004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 -- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c003720 msgr2=0x7ff87c003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c003720 0x7ff87c003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 -- 172.21.15.88:0/205996602 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c003230 con 0x7ff87c004090 2020-02-11T16:29:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff89a48b700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c003720 0x7ff87c003b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:29:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 0x7ff87c004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff87c004ae0 0x7ff87c004f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:29:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff89ac8c700 1 -- 172.21.15.88:0/205996602 reap_dead start 2020-02-11T16:29:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 0x7ff87c004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 0x7ff87c004570 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).ready entity=mon.2 client_cookie=f5c16c8e0479d944 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 0x7ff87c004570 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff89000ce70 con 0x7ff87c004090 2020-02-11T16:29:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 0x7ff87c004570 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899c8a700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 0x7ff87c004570 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89000e350 con 0x7ff87c004090 2020-02-11T16:29:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff899489700 1 -- 172.21.15.88:0/205996602 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff89000e730 con 0x7ff87c004090 2020-02-11T16:29:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff89c6ef700 1 -- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 msgr2=0x7ff87c004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.711+0000 7ff89c6ef700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 0x7ff87c004570 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).stop 2020-02-11T16:29:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.712+0000 7ff89c6ef700 1 -- 172.21.15.88:0/205996602 shutdown_connections 2020-02-11T16:29:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.712+0000 7ff89c6ef700 1 --2- 172.21.15.88:0/205996602 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff87c004090 0x7ff87c004570 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.712+0000 7ff89c6ef700 1 -- 172.21.15.88:0/205996602 >> 172.21.15.88:0/205996602 conn(0x7ff89409d110 msgr2=0x7ff89409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.713+0000 7ff89c6ef700 1 -- 172.21.15.88:0/205996602 shutdown_connections 2020-02-11T16:29:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.713+0000 7ff89c6ef700 1 -- 172.21.15.88:0/205996602 wait complete. 2020-02-11T16:29:17.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.714+0000 7ff89c6ef700 1 Processor -- start 2020-02-11T16:29:17.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.714+0000 7ff89c6ef700 1 -- start start 2020-02-11T16:29:17.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.714+0000 7ff89c6ef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff89409e910 0x7ff8940a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.714+0000 7ff89c6ef700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89412d480 0x7ff894129290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff89c6ef700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89412d930 con 0x7ff8940a0d70 2020-02-11T16:29:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff89c6ef700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89412db90 con 0x7ff89409e910 2020-02-11T16:29:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff89c6ef700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89412de30 con 0x7ff89412d480 2020-02-11T16:29:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff89409e910 0x7ff8940a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff89409e910 0x7ff8940a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60510/0 (socket says 172.21.15.88:60510) 2020-02-11T16:29:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 -- 172.21.15.88:0/149651066 learned_addr learned my addr 172.21.15.88:0/149651066 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89412d480 0x7ff894129290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89412d480 msgr2=0x7ff894129290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:29:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89412d480 msgr2=0x7ff894129290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:29:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89412d480 0x7ff894129290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89412d480 0x7ff894129290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89412d480 msgr2=0x7ff894129290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:29:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478693297 0 0) 0x7ff89412d930 con 0x7ff8940a0d70 2020-02-11T16:29:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89412d480 0x7ff894129290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 -- 172.21.15.88:0/149651066 >> v1:172.21.15.52:6789/0 conn(0x7ff8940a0d70 legacy=0x7ff89409e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 -- 172.21.15.88:0/149651066 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8941296f0 con 0x7ff89409e910 2020-02-11T16:29:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 --2- 172.21.15.88:0/149651066 >> v2:172.21.15.88:3300/0 conn(0x7ff89409e910 0x7ff8940a04c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 --2- 172.21.15.88:0/149651066 >> v2:172.21.15.88:3300/0 conn(0x7ff89409e910 0x7ff8940a04c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89409e910 0x7ff8940a04c0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89409e910 0x7ff8940a04c0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff890001b00 con 0x7ff89409e910 2020-02-11T16:29:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89409e910 0x7ff8940a04c0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff899c8a700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89409e910 0x7ff8940a04c0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8900100b0 con 0x7ff89409e910 2020-02-11T16:29:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff89c6ef700 1 -- 172.21.15.88:0/149651066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8941298a0 con 0x7ff89409e910 2020-02-11T16:29:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8900104d0 con 0x7ff89409e910 2020-02-11T16:29:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.715+0000 7ff89c6ef700 1 -- 172.21.15.88:0/149651066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff894129cb0 con 0x7ff89409e910 2020-02-11T16:29:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.716+0000 7ff899c8a700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89409e910 0x7ff8940a04c0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.716+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff890010790 con 0x7ff89409e910 2020-02-11T16:29:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.716+0000 7ff899c8a700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89409e910 0x7ff8940a04c0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.716+0000 7ff8837fe700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff874039a80 0x7ff87403bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.716+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff89004c100 con 0x7ff89409e910 2020-02-11T16:29:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.716+0000 7ff89c6ef700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.716+0000 7ff89c6ef700 1 -- 172.21.15.88:0/149651066 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89405e2f0 con 0x7ff8940a4ce0 2020-02-11T16:29:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.716+0000 7ff89a48b700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff874039a80 0x7ff87403bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.716+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.717+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 msgr2=0x7ff8940a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:29:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.717+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 msgr2=0x7ff8940a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:29:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.717+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.717+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.717+0000 7ff89a48b700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff874039a80 0x7ff87403bf40 crc :-1 s=READY pgs=527 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:17.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.918+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:17.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.918+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 msgr2=0x7ff8940a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:29:17.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.918+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 msgr2=0x7ff8940a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:29:17.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.918+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:17.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:17.918+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:29:18.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:18.319+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:18.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:18.319+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 msgr2=0x7ff8940a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:29:18.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:18.319+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 msgr2=0x7ff8940a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:29:18.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:18.319+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:18.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:18.319+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:29:19.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:19.120+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:19.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:19.120+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 msgr2=0x7ff8940a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:29:19.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:19.120+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 msgr2=0x7ff8940a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:29:19.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:19.120+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:19.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:19.120+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:29:20.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.722+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.722+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff89409def0 con 0x7ff8940a4ce0 2020-02-11T16:29:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.722+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.722+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.722+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.722+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.722+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff884007160 con 0x7ff8940a4ce0 2020-02-11T16:29:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.723+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.723+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff88400b0b0 con 0x7ff8940a4ce0 2020-02-11T16:29:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.723+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 msgr2=0x7ff8940a7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.723+0000 7ff8837fe700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).stop 2020-02-11T16:29:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.723+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 msgr2=0x7ff8940a7fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:20.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.723+0000 7ff8837fe700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a4ce0 0x7ff8940a7fe0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:20.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.733+0000 7ff89c6ef700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 0x7ff8940a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:20.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.733+0000 7ff89c6ef700 1 -- 172.21.15.88:0/149651066 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89412dcd0 con 0x7ff8940a50c0 2020-02-11T16:29:20.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.733+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 0x7ff8940a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.733+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff8940565b0 con 0x7ff8940a50c0 2020-02-11T16:29:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.733+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 0x7ff8940a8440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.733+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 0x7ff8940a8440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.733+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 0x7ff8940a8440 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.733+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 0x7ff8940a8440 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.733+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff88400aa40 con 0x7ff8940a50c0 2020-02-11T16:29:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89ac8c700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 0x7ff8940a8440 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7ff88400aba0 con 0x7ff8940a50c0 2020-02-11T16:29:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 msgr2=0x7ff8940a8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff8837fe700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 0x7ff8940a8440 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).stop 2020-02-11T16:29:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff8837fe700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 msgr2=0x7ff8940a8440 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff8837fe700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8940a50c0 0x7ff8940a8440 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0x7ff8900010d0 tx=0x7ff884010cd0).stop 2020-02-11T16:29:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89c6ef700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff874039a80 msgr2=0x7ff87403bf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89c6ef700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff874039a80 0x7ff87403bf40 crc :-1 s=READY pgs=527 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89c6ef700 1 -- 172.21.15.88:0/149651066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89409e910 msgr2=0x7ff8940a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89ac8c700 1 -- 172.21.15.88:0/149651066 reap_dead start 2020-02-11T16:29:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89c6ef700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89409e910 0x7ff8940a04c0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7ff8940a5cc0 tx=0x7ff89412f3b0).stop 2020-02-11T16:29:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89c6ef700 1 -- 172.21.15.88:0/149651066 shutdown_connections 2020-02-11T16:29:20.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89c6ef700 1 --2- 172.21.15.88:0/149651066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89409e910 0x7ff8940a04c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:20.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89c6ef700 1 -- 172.21.15.88:0/149651066 >> 172.21.15.88:0/149651066 conn(0x7ff89409d110 msgr2=0x7ff894069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:20.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89c6ef700 1 -- 172.21.15.88:0/149651066 shutdown_connections 2020-02-11T16:29:20.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.734+0000 7ff89c6ef700 1 -- 172.21.15.88:0/149651066 wait complete. 2020-02-11T16:29:20.740 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:29:20.740 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:29:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 192, 2020-02-11T16:29:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:29:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:29:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:29:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:29:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 4, 2020-02-11T16:29:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:29:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:29:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:29:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:29:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:29:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:29:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:29:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:29:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:29:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:29:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:29:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:29:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:29:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:29:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:29:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:29:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:29:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:29:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:29:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:20.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.754 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:29:20.754 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:29:20.754 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:20.754 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:20.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.755 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:20.755 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:29:20.755 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:20.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.755 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:29:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:29:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:29:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:29:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:29:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:29:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:29:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:20.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:20.761 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:29:20.761 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:29:20.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.761 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:20.761 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:20.761 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:20.762 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:20.762 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:20.762 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:29:20.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:20.762 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:20.762 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:20.762 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:20.763 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:20.763 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:20.763 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:20.763 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:29:20.765 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:29:20.765 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:29:20.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.881+0000 7f5e4f4b7700 1 Processor -- start 2020-02-11T16:29:20.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.881+0000 7f5e4f4b7700 1 -- start start 2020-02-11T16:29:20.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.881+0000 7f5e4f4b7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.881+0000 7f5e4f4b7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e48065de0 con 0x7f5e480a54b0 2020-02-11T16:29:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.881+0000 7f5e4f4b7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e480a6860 con 0x7f5e48066bf0 2020-02-11T16:29:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.881+0000 7f5e4f4b7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480a5a70 con 0x7f5e4805b270 2020-02-11T16:29:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.881+0000 7f5e4ecb6700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5e48066bf0 0x7f5e480a4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48154/0 (socket says 172.21.15.88:48154) 2020-02-11T16:29:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4ecb6700 1 -- 172.21.15.88:0/1267119379 learned_addr learned my addr 172.21.15.88:0/1267119379 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4dcb4700 1 --2- 172.21.15.88:0/1267119379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:20.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4d4b3700 1 -- 172.21.15.88:0/1267119379 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212418045 0 0) 0x7f5e480a6860 con 0x7f5e48066bf0 2020-02-11T16:29:20.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4d4b3700 1 -- 172.21.15.88:0/1267119379 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e30003230 con 0x7f5e48066bf0 2020-02-11T16:29:20.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4d4b3700 1 -- 172.21.15.88:0/1267119379 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202544178 0 0) 0x7f5e48065de0 con 0x7f5e480a54b0 2020-02-11T16:29:20.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4d4b3700 1 -- 172.21.15.88:0/1267119379 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e480a6860 con 0x7f5e480a54b0 2020-02-11T16:29:20.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4dcb4700 1 -- 172.21.15.88:0/1267119379 >> v1:172.21.15.88:6789/0 conn(0x7f5e48066bf0 legacy=0x7f5e480a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:20.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4dcb4700 1 -- 172.21.15.88:0/1267119379 >> v1:172.21.15.52:6789/0 conn(0x7f5e480a54b0 legacy=0x7f5e480664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:20.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4dcb4700 1 -- 172.21.15.88:0/1267119379 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48066040 con 0x7f5e4805b270 2020-02-11T16:29:20.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4dcb4700 1 --2- 172.21.15.88:0/1267119379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a6c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e38002f30 tx=0x7f5e380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4dcb4700 1 --2- 172.21.15.88:0/1267119379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a6c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e38002f30 tx=0x7f5e380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4dcb4700 1 --2- 172.21.15.88:0/1267119379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a6c90 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f5e38002f30 tx=0x7f5e380088e0).ready entity=mon.2 client_cookie=3b3fe37051db1018 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:20.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4dcb4700 1 --2- 172.21.15.88:0/1267119379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a6c90 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f5e38002f30 tx=0x7f5e380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4d4b3700 1 -- 172.21.15.88:0/1267119379 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e38008e40 con 0x7f5e4805b270 2020-02-11T16:29:20.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4dcb4700 1 --2- 172.21.15.88:0/1267119379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a6c90 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f5e38002f30 tx=0x7f5e380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4d4b3700 1 -- 172.21.15.88:0/1267119379 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e38011540 con 0x7f5e4805b270 2020-02-11T16:29:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4dcb4700 1 --2- 172.21.15.88:0/1267119379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a6c90 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f5e38002f30 tx=0x7f5e380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4d4b3700 1 -- 172.21.15.88:0/1267119379 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e380118a0 con 0x7f5e4805b270 2020-02-11T16:29:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/1267119379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 msgr2=0x7f5e480a6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.882+0000 7f5e4f4b7700 1 --2- 172.21.15.88:0/1267119379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a6c90 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f5e38002f30 tx=0x7f5e380088e0).stop 2020-02-11T16:29:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.883+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/1267119379 shutdown_connections 2020-02-11T16:29:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.883+0000 7f5e4f4b7700 1 --2- 172.21.15.88:0/1267119379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a6c90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:20.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.883+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/1267119379 >> 172.21.15.88:0/1267119379 conn(0x7f5e480aa860 msgr2=0x7f5e480aac70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:20.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.883+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/1267119379 shutdown_connections 2020-02-11T16:29:20.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.883+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/1267119379 wait complete. 2020-02-11T16:29:20.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.884+0000 7f5e4f4b7700 1 Processor -- start 2020-02-11T16:29:20.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.884+0000 7f5e4f4b7700 1 -- start start 2020-02-11T16:29:20.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4f4b7700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:20.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4f4b7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e480a54b0 0x7f5e4809c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:20.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4f4b7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e48139190 con 0x7f5e48066bf0 2020-02-11T16:29:20.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4f4b7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e480a0390 con 0x7f5e480a54b0 2020-02-11T16:29:20.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4f4b7700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4809e980 con 0x7f5e4805b270 2020-02-11T16:29:20.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4dcb4700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5e48066bf0 0x7f5e48138a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39942/0 (socket says 172.21.15.88:39942) 2020-02-11T16:29:20.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4dcb4700 1 -- 172.21.15.88:0/4199874477 learned_addr learned my addr 172.21.15.88:0/4199874477 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:20.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:20.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4ecb6700 1 --2- 172.21.15.88:0/4199874477 >> v2:172.21.15.52:3300/0 conn(0x7f5e480a54b0 0x7f5e4809c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:20.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e377fe700 1 -- 172.21.15.88:0/4199874477 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030741344 0 0) 0x7f5e48066040 con 0x7f5e48066bf0 2020-02-11T16:29:20.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e377fe700 1 -- 172.21.15.88:0/4199874477 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e28002fe0 con 0x7f5e48066bf0 2020-02-11T16:29:20.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 -- 172.21.15.88:0/4199874477 >> v2:172.21.15.52:3300/0 conn(0x7f5e480a54b0 msgr2=0x7f5e4809c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:20.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> v2:172.21.15.52:3300/0 conn(0x7f5e480a54b0 0x7f5e4809c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 -- 172.21.15.88:0/4199874477 >> v1:172.21.15.52:6789/0 conn(0x7f5e48066bf0 legacy=0x7f5e48138a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 -- 172.21.15.88:0/4199874477 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4809ccd0 con 0x7f5e4805b270 2020-02-11T16:29:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e377fe700 1 -- 172.21.15.88:0/4199874477 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e44006bc0 con 0x7f5e4805b270 2020-02-11T16:29:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e377fe700 1 -- 172.21.15.88:0/4199874477 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e44006d60 con 0x7f5e4805b270 2020-02-11T16:29:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/4199874477 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4809dae0 con 0x7f5e4805b270 2020-02-11T16:29:20.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.885+0000 7f5e377fe700 1 -- 172.21.15.88:0/4199874477 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e44008350 con 0x7f5e4805b270 2020-02-11T16:29:20.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.886+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/4199874477 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e480a4170 con 0x7f5e4805b270 2020-02-11T16:29:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.886+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.887+0000 7f5e377fe700 1 -- 172.21.15.88:0/4199874477 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f5e44008550 con 0x7f5e4805b270 2020-02-11T16:29:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.887+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.887+0000 7f5e377fe700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e28039f70 0x7f5e2803c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.887+0000 7f5e377fe700 1 -- 172.21.15.88:0/4199874477 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f5e44049ab0 con 0x7f5e4805b270 2020-02-11T16:29:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.887+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/4199874477 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e480565b0 con 0x7f5e4805b270 2020-02-11T16:29:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.887+0000 7f5e4dcb4700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e28039f70 0x7f5e2803c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.887+0000 7f5e4dcb4700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e28039f70 0x7f5e2803c430 crc :-1 s=READY pgs=528 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:20.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.893+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:20.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:20.893+0000 7f5e377fe700 1 -- 172.21.15.88:0/4199874477 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f5e4402f190 con 0x7f5e4805b270 2020-02-11T16:29:21.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.132+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/4199874477 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f5e480a1550 con 0x7f5e4805b270 2020-02-11T16:29:21.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.133+0000 7f5e4e4b5700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:21.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.133+0000 7f5e377fe700 1 -- 172.21.15.88:0/4199874477 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f5e44031be0 con 0x7f5e4805b270 2020-02-11T16:29:21.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.134+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e28039f70 msgr2=0x7f5e2803c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:21.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.134+0000 7f5e4f4b7700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e28039f70 0x7f5e2803c430 crc :-1 s=READY pgs=528 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.134+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 msgr2=0x7f5e480a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.134+0000 7f5e4f4b7700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f5e440010d0 tx=0x7f5e440108d0).stop 2020-02-11T16:29:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.134+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/4199874477 shutdown_connections 2020-02-11T16:29:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.134+0000 7f5e4f4b7700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f5e28039f70 0x7f5e2803c430 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.134+0000 7f5e4f4b7700 1 --2- 172.21.15.88:0/4199874477 >> v2:172.21.15.52:3300/0 conn(0x7f5e480a54b0 0x7f5e4809c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.134+0000 7f5e4f4b7700 1 --2- 172.21.15.88:0/4199874477 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e4805b270 0x7f5e480a0960 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.134+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/4199874477 >> 172.21.15.88:0/4199874477 conn(0x7f5e480aa860 msgr2=0x7f5e48069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.135+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/4199874477 shutdown_connections 2020-02-11T16:29:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:21.135+0000 7f5e4f4b7700 1 -- 172.21.15.88:0/4199874477 wait complete. 2020-02-11T16:29:21.150 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:29:31.151 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:29:31.152 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:29:31.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.262+0000 7fddd9a09700 1 Processor -- start 2020-02-11T16:29:31.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.262+0000 7fddd9a09700 1 -- start start 2020-02-11T16:29:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd9a09700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddd405fc80 0x7fddd40a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd9a09700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd409e840 0x7fddd40a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:31.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd9a09700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd4066af0 con 0x7fddd40a4ce0 2020-02-11T16:29:31.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd9a09700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd40a5a30 con 0x7fddd405fc80 2020-02-11T16:29:31.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd9a09700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40a5180 con 0x7fddd409e840 2020-02-11T16:29:31.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddd405fc80 0x7fddd40a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddd405fc80 0x7fddd40a68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60542/0 (socket says 172.21.15.88:60542) 2020-02-11T16:29:31.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 -- 172.21.15.88:0/176669064 learned_addr learned my addr 172.21.15.88:0/176669064 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd37fe700 1 --2- 172.21.15.88:0/176669064 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd409e840 0x7fddd40a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 -- 172.21.15.88:0/176669064 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd409e840 msgr2=0x7fddd40a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/176669064 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd409e840 0x7fddd40a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 -- 172.21.15.88:0/176669064 >> v1:172.21.15.88:6789/0 conn(0x7fddd40a4ce0 legacy=0x7fddd40a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 -- 172.21.15.88:0/176669064 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40a5420 con 0x7fddd405fc80 2020-02-11T16:29:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/176669064 >> v2:172.21.15.88:3300/0 conn(0x7fddd405fc80 0x7fddd40a68b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddc4002f30 tx=0x7fddc40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/176669064 >> v2:172.21.15.88:3300/0 conn(0x7fddd405fc80 0x7fddd40a68b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddc4002f30 tx=0x7fddc40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/176669064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd405fc80 0x7fddd40a68b0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddc40088e0).ready entity=mon.1 client_cookie=cc3cf9b73d6c35e2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/176669064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd405fc80 0x7fddd40a68b0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddc40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd27fc700 1 -- 172.21.15.88:0/176669064 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc4008e20 con 0x7fddd405fc80 2020-02-11T16:29:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/176669064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd405fc80 0x7fddd40a68b0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddc40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/176669064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd405fc80 0x7fddd40a68b0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddc40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd27fc700 1 -- 172.21.15.88:0/176669064 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4013ab0 con 0x7fddd405fc80 2020-02-11T16:29:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd27fc700 1 -- 172.21.15.88:0/176669064 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc4013e90 con 0x7fddd405fc80 2020-02-11T16:29:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd9a09700 1 -- 172.21.15.88:0/176669064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd405fc80 msgr2=0x7fddd40a68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.263+0000 7fddd9a09700 1 --2- 172.21.15.88:0/176669064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd405fc80 0x7fddd40a68b0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddc40088e0).stop 2020-02-11T16:29:31.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.264+0000 7fddd9a09700 1 -- 172.21.15.88:0/176669064 shutdown_connections 2020-02-11T16:29:31.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.264+0000 7fddd9a09700 1 --2- 172.21.15.88:0/176669064 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd409e840 0x7fddd40a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:31.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.264+0000 7fddd9a09700 1 --2- 172.21.15.88:0/176669064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd405fc80 0x7fddd40a68b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.264+0000 7fddd9a09700 1 -- 172.21.15.88:0/176669064 >> 172.21.15.88:0/176669064 conn(0x7fddd40a7bb0 msgr2=0x7fddd40a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:31.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.264+0000 7fddd9a09700 1 -- 172.21.15.88:0/176669064 shutdown_connections 2020-02-11T16:29:31.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.264+0000 7fddd9a09700 1 -- 172.21.15.88:0/176669064 wait complete. 2020-02-11T16:29:31.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.265+0000 7fddd9a09700 1 Processor -- start 2020-02-11T16:29:31.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.265+0000 7fddd9a09700 1 -- start start 2020-02-11T16:29:31.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.266+0000 7fddd9a09700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.266+0000 7fddd9a09700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd4144f50 con 0x7fddd409e840 2020-02-11T16:29:31.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.266+0000 7fddd9a09700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd4140ee0 con 0x7fddd40a4ce0 2020-02-11T16:29:31.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.266+0000 7fddd9a09700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4141180 con 0x7fddd405fc80 2020-02-11T16:29:31.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.266+0000 7fddd2ffd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.266+0000 7fddcbfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fddd409e840 0x7fddd4144130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39958/0 (socket says 172.21.15.88:39958) 2020-02-11T16:29:31.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.266+0000 7fddcbfff700 1 -- 172.21.15.88:0/2582876848 learned_addr learned my addr 172.21.15.88:0/2582876848 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:31.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007522622 0 0) 0x7fddd4140ee0 con 0x7fddd40a4ce0 2020-02-11T16:29:31.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb8002fe0 con 0x7fddd40a4ce0 2020-02-11T16:29:31.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597946480 0 0) 0x7fddd4144f50 con 0x7fddd409e840 2020-02-11T16:29:31.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd4140ee0 con 0x7fddd409e840 2020-02-11T16:29:31.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd2ffd700 1 -- 172.21.15.88:0/2582876848 >> v1:172.21.15.88:6789/0 conn(0x7fddd40a4ce0 legacy=0x7fddd4144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd2ffd700 1 -- 172.21.15.88:0/2582876848 >> v1:172.21.15.52:6789/0 conn(0x7fddd409e840 legacy=0x7fddd4144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd2ffd700 1 -- 172.21.15.88:0/2582876848 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4141420 con 0x7fddd405fc80 2020-02-11T16:29:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc4008e20 con 0x7fddd405fc80 2020-02-11T16:29:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4007340 con 0x7fddd405fc80 2020-02-11T16:29:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc40056c0 con 0x7fddd405fc80 2020-02-11T16:29:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd9a09700 1 -- 172.21.15.88:0/2582876848 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd40aaa80 con 0x7fddd405fc80 2020-02-11T16:29:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.267+0000 7fddd9a09700 1 -- 172.21.15.88:0/2582876848 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd4135bc0 con 0x7fddd405fc80 2020-02-11T16:29:31.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.268+0000 7fddd9a09700 1 -- 172.21.15.88:0/2582876848 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd4140d20 con 0x7fddd405fc80 2020-02-11T16:29:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.268+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.268+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fddc4005820 con 0x7fddd405fc80 2020-02-11T16:29:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.268+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.269+0000 7fddd0ff9700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddb803a110 0x7fddb803c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.269+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fddc404c070 con 0x7fddd405fc80 2020-02-11T16:29:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.269+0000 7fddcbfff700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddb803a110 0x7fddb803c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.269+0000 7fddcbfff700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddb803a110 0x7fddb803c5d0 crc :-1 s=READY pgs=529 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.273+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.273+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fddc4034660 con 0x7fddd405fc80 2020-02-11T16:29:31.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.539+0000 7fddd9a09700 1 -- 172.21.15.88:0/2582876848 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fddd40565b0 con 0x7fddd405fc80 2020-02-11T16:29:31.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.539+0000 7fddd2ffd700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.539+0000 7fddd0ff9700 1 -- 172.21.15.88:0/2582876848 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fddc4034220 con 0x7fddd405fc80 2020-02-11T16:29:31.541 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.542+0000 7fddd9a09700 1 -- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddb803a110 msgr2=0x7fddb803c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.542+0000 7fddd9a09700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddb803a110 0x7fddb803c5d0 crc :-1 s=READY pgs=529 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.542+0000 7fddd9a09700 1 -- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 msgr2=0x7fddd40a0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.542+0000 7fddd9a09700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddd40669c0).stop 2020-02-11T16:29:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.542+0000 7fddd9a09700 1 -- 172.21.15.88:0/2582876848 shutdown_connections 2020-02-11T16:29:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.542+0000 7fddd9a09700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fddb803a110 0x7fddb803c5d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.542+0000 7fddd9a09700 1 --2- 172.21.15.88:0/2582876848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddd405fc80 0x7fddd40a0540 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.542+0000 7fddd9a09700 1 -- 172.21.15.88:0/2582876848 >> 172.21.15.88:0/2582876848 conn(0x7fddd40a7bb0 msgr2=0x7fddd4138150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.543+0000 7fddd9a09700 1 -- 172.21.15.88:0/2582876848 shutdown_connections 2020-02-11T16:29:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.543+0000 7fddd9a09700 1 -- 172.21.15.88:0/2582876848 wait complete. 2020-02-11T16:29:31.557 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":192,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:31.557 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:29:31.558 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:29:31.558 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:29:31.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.669+0000 7f8cbb7c3700 1 Processor -- start 2020-02-11T16:29:31.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.669+0000 7f8cbb7c3700 1 -- start start 2020-02-11T16:29:31.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.669+0000 7f8cbb7c3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cb40a18a0 0x7f8cb40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:31.677 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.669+0000 7f8cbb7c3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8cb40a5de0 0x7f8cb40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:31.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.669+0000 7f8cbb7c3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cb412e3a0 0x7f8cb412e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:31.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.669+0000 7f8cbb7c3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40a3570 con 0x7f8cb40a18a0 2020-02-11T16:29:31.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.669+0000 7f8cbb7c3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40a3810 con 0x7f8cb40a5de0 2020-02-11T16:29:31.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.669+0000 7f8cbb7c3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40a3ab0 con 0x7f8cb412e3a0 2020-02-11T16:29:31.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8cb40a5de0 0x7f8cb40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8cb40a5de0 0x7f8cb40a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60556/0 (socket says 172.21.15.88:60556) 2020-02-11T16:29:31.678 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 -- 172.21.15.88:0/3716101371 learned_addr learned my addr 172.21.15.88:0/3716101371 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:31.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb9d60700 1 --2- 172.21.15.88:0/3716101371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cb412e3a0 0x7f8cb412e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb955f700 1 --2- 172.21.15.88:0/3716101371 >> v2:172.21.15.52:3300/0 conn(0x7f8cb40a18a0 0x7f8cb40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 -- 172.21.15.88:0/3716101371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cb412e3a0 msgr2=0x7f8cb412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:31.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/3716101371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cb412e3a0 0x7f8cb412e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:31.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 -- 172.21.15.88:0/3716101371 >> v2:172.21.15.52:3300/0 conn(0x7f8cb40a18a0 msgr2=0x7f8cb40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:29:31.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/3716101371 >> v2:172.21.15.52:3300/0 conn(0x7f8cb40a18a0 0x7f8cb40a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:31.679 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 -- 172.21.15.88:0/3716101371 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40a3d50 con 0x7f8cb40a5de0 2020-02-11T16:29:31.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/3716101371 >> v2:172.21.15.88:3300/0 conn(0x7f8cb40a5de0 0x7f8cb40a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ca4002f30 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/3716101371 >> v2:172.21.15.88:3300/0 conn(0x7f8cb40a5de0 0x7f8cb40a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ca4002f30 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/3716101371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb40a5de0 0x7f8cb40a6260 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f8ca4002f30 tx=0x7f8ca4007a40).ready entity=mon.1 client_cookie=2934bd7e66372fa2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/3716101371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb40a5de0 0x7f8cb40a6260 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f8ca4002f30 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/3716101371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb40a5de0 0x7f8cb40a6260 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f8ca4002f30 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/3716101371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb40a5de0 0x7f8cb40a6260 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f8ca4002f30 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8ca3fff700 1 -- 172.21.15.88:0/3716101371 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca40115c0 con 0x7f8cb40a5de0 2020-02-11T16:29:31.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8ca3fff700 1 -- 172.21.15.88:0/3716101371 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4011720 con 0x7f8cb40a5de0 2020-02-11T16:29:31.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8ca3fff700 1 -- 172.21.15.88:0/3716101371 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca4011b00 con 0x7f8cb40a5de0 2020-02-11T16:29:31.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/3716101371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb40a5de0 msgr2=0x7f8cb40a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.670+0000 7f8cbb7c3700 1 --2- 172.21.15.88:0/3716101371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb40a5de0 0x7f8cb40a6260 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f8ca4002f30 tx=0x7f8ca4007a40).stop 2020-02-11T16:29:31.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.671+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/3716101371 shutdown_connections 2020-02-11T16:29:31.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.671+0000 7f8cbb7c3700 1 --2- 172.21.15.88:0/3716101371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cb412e3a0 0x7f8cb412e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:31.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.671+0000 7f8cbb7c3700 1 --2- 172.21.15.88:0/3716101371 >> v2:172.21.15.52:3300/0 conn(0x7f8cb40a18a0 0x7f8cb40a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:31.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.671+0000 7f8cbb7c3700 1 --2- 172.21.15.88:0/3716101371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb40a5de0 0x7f8cb40a6260 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.671+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/3716101371 >> 172.21.15.88:0/3716101371 conn(0x7f8cb409d110 msgr2=0x7f8cb409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:31.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.671+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/3716101371 shutdown_connections 2020-02-11T16:29:31.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.671+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/3716101371 wait complete. 2020-02-11T16:29:31.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cbb7c3700 1 Processor -- start 2020-02-11T16:29:31.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cbb7c3700 1 -- start start 2020-02-11T16:29:31.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cbb7c3700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cb40a18a0 0x7f8cb409edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cbb7c3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8cb412e3a0 0x7f8cb409f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cbb7c3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40a0810 con 0x7f8cb40a5de0 2020-02-11T16:29:31.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cbb7c3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb4128100 con 0x7f8cb412e3a0 2020-02-11T16:29:31.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cbb7c3700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40a0c40 con 0x7f8cb40a18a0 2020-02-11T16:29:31.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cb9d60700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8cb412e3a0 0x7f8cb409f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cb9d60700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8cb412e3a0 0x7f8cb409f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60564/0 (socket says 172.21.15.88:60564) 2020-02-11T16:29:31.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cb9d60700 1 -- 172.21.15.88:0/1549277208 learned_addr learned my addr 172.21.15.88:0/1549277208 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:31.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.672+0000 7f8cb955f700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cb40a18a0 0x7f8cb409edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 -- 172.21.15.88:0/1549277208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cb40a18a0 msgr2=0x7f8cb409edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cb40a18a0 0x7f8cb409edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 -- 172.21.15.88:0/1549277208 >> v1:172.21.15.52:6789/0 conn(0x7f8cb40a5de0 legacy=0x7f8cb4133950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 -- 172.21.15.88:0/1549277208 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40a0e30 con 0x7f8cb412e3a0 2020-02-11T16:29:31.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704227157 0 0) 0x7f8cb40a0810 con 0x7f8cb40a5de0 2020-02-11T16:29:31.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 --2- 172.21.15.88:0/1549277208 >> v2:172.21.15.88:3300/0 conn(0x7f8cb412e3a0 0x7f8cb409f210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cac0032b0 tx=0x7f8cac010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 --2- 172.21.15.88:0/1549277208 >> v2:172.21.15.88:3300/0 conn(0x7f8cb412e3a0 0x7f8cb409f210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cac0032b0 tx=0x7f8cac010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb412e3a0 0x7f8cb409f210 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f8cac0032b0 tx=0x7f8cac010f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb412e3a0 0x7f8cb409f210 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f8cac0032b0 tx=0x7f8cac010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cac00e350 con 0x7f8cb412e3a0 2020-02-11T16:29:31.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb412e3a0 0x7f8cb409f210 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f8cac0032b0 tx=0x7f8cac010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb412e3a0 0x7f8cb409f210 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f8cac0032b0 tx=0x7f8cac010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac005c30 con 0x7f8cb412e3a0 2020-02-11T16:29:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/1549277208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb41279c0 con 0x7f8cb412e3a0 2020-02-11T16:29:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cac0129f0 con 0x7f8cb412e3a0 2020-02-11T16:29:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/1549277208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb412e080 con 0x7f8cb412e3a0 2020-02-11T16:29:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.673+0000 7f8cb9d60700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb412e3a0 0x7f8cb409f210 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f8cac0032b0 tx=0x7f8cac010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8cac012c60 con 0x7f8cb412e3a0 2020-02-11T16:29:31.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8cb9d60700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb412e3a0 0x7f8cb409f210 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f8cac0032b0 tx=0x7f8cac010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8ca27fc700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c94039c40 0x7f8c9403c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8cac049a50 con 0x7f8cb412e3a0 2020-02-11T16:29:31.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8cbb7c3700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 0x7f8cb405aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/1549277208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb405e2f0 con 0x7f8cb409e240 2020-02-11T16:29:31.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 0x7f8cb405aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8cb955f700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c94039c40 0x7f8c9403c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8cb8d5e700 1 -- 172.21.15.88:0/1549277208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8cb4127e60 con 0x7f8cb409e240 2020-02-11T16:29:31.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 0x7f8cb405aad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8cb955f700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c94039c40 0x7f8c9403c100 crc :-1 s=READY pgs=530 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 0x7f8cb405aad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.674+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 0x7f8cb405aad0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.675+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 0x7f8cb405aad0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.675+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca4011da0 con 0x7f8cb409e240 2020-02-11T16:29:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.675+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 0x7f8cb405aad0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.675+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8ca4007150 con 0x7f8cb409e240 2020-02-11T16:29:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.675+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 msgr2=0x7f8cb405aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.675+0000 7f8ca27fc700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 0x7f8cb405aad0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).stop 2020-02-11T16:29:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.675+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 msgr2=0x7f8cb405aad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.675+0000 7f8ca27fc700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb409e240 0x7f8cb405aad0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8cbb7c3700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 0x7f8cb4134470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/1549277208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4136250 con 0x7f8cb4134060 2020-02-11T16:29:31.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 0x7f8cb4134470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8cb8d5e700 1 -- 172.21.15.88:0/1549277208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8cb40565b0 con 0x7f8cb4134060 2020-02-11T16:29:31.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 0x7f8cb4134470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 0x7f8cb4134470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 0x7f8cb4134470 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 0x7f8cb4134470 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca400c730 con 0x7f8cb4134060 2020-02-11T16:29:31.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8cb8d5e700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 0x7f8cb4134470 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4191 (secure 0 0 0) 0x7f8ca400c890 con 0x7f8cb4134060 2020-02-11T16:29:31.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 msgr2=0x7f8cb4134470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8ca27fc700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 0x7f8cb4134470 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).stop 2020-02-11T16:29:31.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8ca27fc700 1 -- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 msgr2=0x7f8cb4134470 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:31.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.683+0000 7f8ca27fc700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb4134060 0x7f8cb4134470 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0x7f8ca4000b80 tx=0x7f8ca4007a40).stop 2020-02-11T16:29:31.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/1549277208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c94039c40 msgr2=0x7f8c9403c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cbb7c3700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8c94039c40 0x7f8c9403c100 crc :-1 s=READY pgs=530 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb412e3a0 msgr2=0x7f8cb409f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cbb7c3700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb412e3a0 0x7f8cb409f210 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f8cac0032b0 tx=0x7f8cac010f60).stop 2020-02-11T16:29:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cb9d60700 1 -- 172.21.15.88:0/1549277208 reap_dead start 2020-02-11T16:29:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cb9d60700 1 -- 172.21.15.88:0/1549277208 reap_dead start 2020-02-11T16:29:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/1549277208 shutdown_connections 2020-02-11T16:29:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cbb7c3700 1 --2- 172.21.15.88:0/1549277208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cb412e3a0 0x7f8cb409f210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/1549277208 >> 172.21.15.88:0/1549277208 conn(0x7f8cb409d110 msgr2=0x7f8cb40a5100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:31.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/1549277208 shutdown_connections 2020-02-11T16:29:31.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.684+0000 7f8cbb7c3700 1 -- 172.21.15.88:0/1549277208 wait complete. 2020-02-11T16:29:31.697 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:29:31.697 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:29:31.697 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:29:31.697 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:29:31.698 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 192, 2020-02-11T16:29:31.698 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:29:31.698 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:29:31.699 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:29:31.699 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:29:31.699 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.699 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:29:31.699 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:31.699 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:29:31.699 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:29:31.700 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:31.700 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:31.700 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:31.700 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:31.700 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:31.700 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:31.700 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.700 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:29:31.701 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:29:31.701 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:31.701 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:31.701 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:31.701 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:31.701 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:31.702 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:31.702 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.702 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:29:31.703 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:29:31.703 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:29:31.703 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:29:31.703 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:29:31.703 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:29:31.704 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:31.704 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:31.704 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:29:31.704 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:29:31.704 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:31.704 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:29:31.705 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:31.705 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:31.705 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:31.705 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:31.706 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:31.706 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:31.706 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.706 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:29:31.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.706 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:29:31.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.707 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:31.707 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:31.707 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:31.707 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:31.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.707 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:31.708 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:29:31.708 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.708 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:31.708 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:29:31.708 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.709 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.709 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.709 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:29:31.710 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:29:31.710 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:31.710 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:31.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.710 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:29:31.710 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:29:31.711 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:31.711 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:31.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.711 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:31.711 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:29:31.711 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.712 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:31.713 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:29:31.713 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.713 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.713 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.714 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:29:31.714 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:29:31.714 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:31.714 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:31.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.715 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:31.715 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:31.715 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:31.715 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:31.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.715 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:31.715 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:29:31.715 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.716 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:31.716 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:29:31.716 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.717 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.717 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.717 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:29:31.717 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:29:31.718 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:31.718 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:31.718 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.718 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.718 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:29:31.718 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:29:31.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.719 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:31.719 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:31.719 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:31.719 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.719 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.719 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:29:31.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.720 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:31.720 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:31.720 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:31.720 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.720 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.720 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:29:31.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.721 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:31.721 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:31.721 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:31.721 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.721 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.721 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:29:31.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.722 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:31.722 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:31.722 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:29:31.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.722 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.722 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:29:31.726 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:29:31.848 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.847+0000 7f44e9245700 1 Processor -- start 2020-02-11T16:29:31.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.847+0000 7f44e9245700 1 -- start start 2020-02-11T16:29:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e9245700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44e40ad380 0x7f44e40a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e9245700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e413bfe0 con 0x7f44e4138710 2020-02-11T16:29:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e9245700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e40adb40 con 0x7f44e4138280 2020-02-11T16:29:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e9245700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e4137bf0 con 0x7f44e40ad380 2020-02-11T16:29:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f44e4138280 0x7f44e413b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48198/0 (socket says 172.21.15.88:48198) 2020-02-11T16:29:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e259c700 1 -- 172.21.15.88:0/3584145610 learned_addr learned my addr 172.21.15.88:0/3584145610 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/3584145610 >> v2:172.21.15.52:3300/0 conn(0x7f44e40ad380 0x7f44e40a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e1d9b700 1 -- 172.21.15.88:0/3584145610 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396200403 0 0) 0x7f44e40adb40 con 0x7f44e4138280 2020-02-11T16:29:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e1d9b700 1 -- 172.21.15.88:0/3584145610 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c8003230 con 0x7f44e4138280 2020-02-11T16:29:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e2d9d700 1 -- 172.21.15.88:0/3584145610 >> v1:172.21.15.88:6789/0 conn(0x7f44e4138280 legacy=0x7f44e413b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e2d9d700 1 -- 172.21.15.88:0/3584145610 >> v1:172.21.15.52:6789/0 conn(0x7f44e4138710 legacy=0x7f44e413b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e1d9b700 1 -- 172.21.15.88:0/3584145610 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188218224 0 0) 0x7f44e413bfe0 con 0x7f44e4138710 2020-02-11T16:29:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e2d9d700 1 -- 172.21.15.88:0/3584145610 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4137de0 con 0x7f44e40ad380 2020-02-11T16:29:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/3584145610 >> v2:172.21.15.52:3300/0 conn(0x7f44e40ad380 0x7f44e40a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f44d4002f30 tx=0x7f44d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/3584145610 >> v2:172.21.15.52:3300/0 conn(0x7f44e40ad380 0x7f44e40a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f44d4002f30 tx=0x7f44d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.848+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/3584145610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e40ad380 0x7f44e40a9130 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f44d4002f30 tx=0x7f44d40088e0).ready entity=mon.0 client_cookie=e11790e51ff8ca38 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/3584145610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e40ad380 0x7f44e40a9130 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f44d4002f30 tx=0x7f44d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e1d9b700 1 -- 172.21.15.88:0/3584145610 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44d4008e40 con 0x7f44e40ad380 2020-02-11T16:29:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/3584145610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e40ad380 0x7f44e40a9130 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f44d4002f30 tx=0x7f44d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/3584145610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e40ad380 0x7f44e40a9130 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f44d4002f30 tx=0x7f44d40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e1d9b700 1 -- 172.21.15.88:0/3584145610 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d40115f0 con 0x7f44e40ad380 2020-02-11T16:29:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e1d9b700 1 -- 172.21.15.88:0/3584145610 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44d4011950 con 0x7f44e40ad380 2020-02-11T16:29:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e9245700 1 -- 172.21.15.88:0/3584145610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e40ad380 msgr2=0x7f44e40a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e9245700 1 --2- 172.21.15.88:0/3584145610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e40ad380 0x7f44e40a9130 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f44d4002f30 tx=0x7f44d40088e0).stop 2020-02-11T16:29:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e9245700 1 -- 172.21.15.88:0/3584145610 shutdown_connections 2020-02-11T16:29:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e9245700 1 --2- 172.21.15.88:0/3584145610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e40ad380 0x7f44e40a9130 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e9245700 1 -- 172.21.15.88:0/3584145610 >> 172.21.15.88:0/3584145610 conn(0x7f44e405ac70 msgr2=0x7f44e40ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e9245700 1 -- 172.21.15.88:0/3584145610 shutdown_connections 2020-02-11T16:29:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.849+0000 7f44e9245700 1 -- 172.21.15.88:0/3584145610 wait complete. 2020-02-11T16:29:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.850+0000 7f44e9245700 1 Processor -- start 2020-02-11T16:29:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.850+0000 7f44e9245700 1 -- start start 2020-02-11T16:29:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.851+0000 7f44e9245700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f44e4138710 0x7f44e4150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.851+0000 7f44e9245700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e4133790 con 0x7f44e40ad380 2020-02-11T16:29:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.851+0000 7f44e9245700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e4133a30 con 0x7f44e4138280 2020-02-11T16:29:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.851+0000 7f44e9245700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e41377b0 con 0x7f44e4138710 2020-02-11T16:29:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.851+0000 7f44e359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f44e4138710 0x7f44e4150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.851+0000 7f44e2d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f44e40ad380 0x7f44e4134170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:39984/0 (socket says 172.21.15.88:39984) 2020-02-11T16:29:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.851+0000 7f44e2d9d700 1 -- 172.21.15.88:0/1893888781 learned_addr learned my addr 172.21.15.88:0/1893888781 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.851+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096887879 0 0) 0x7f44e4133790 con 0x7f44e40ad380 2020-02-11T16:29:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c0002fe0 con 0x7f44e40ad380 2020-02-11T16:29:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e359e700 1 -- 172.21.15.88:0/1893888781 >> v1:172.21.15.88:6789/0 conn(0x7f44e4138280 legacy=0x7f44e4128770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e359e700 1 -- 172.21.15.88:0/1893888781 >> v1:172.21.15.52:6789/0 conn(0x7f44e40ad380 legacy=0x7f44e4134170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e359e700 1 -- 172.21.15.88:0/1893888781 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4133cd0 con 0x7f44e4138710 2020-02-11T16:29:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e359e700 1 --2- 172.21.15.88:0/1893888781 >> v2:172.21.15.88:3300/0 conn(0x7f44e4138710 0x7f44e4150620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44e40a8460 tx=0x7f44dc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e359e700 1 --2- 172.21.15.88:0/1893888781 >> v2:172.21.15.88:3300/0 conn(0x7f44e4138710 0x7f44e4150620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44e40a8460 tx=0x7f44dc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e359e700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44e4138710 0x7f44e4150620 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f44e40a8460 tx=0x7f44dc010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e359e700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44e4138710 0x7f44e4150620 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f44e40a8460 tx=0x7f44dc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e359e700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44e4138710 0x7f44e4150620 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f44e40a8460 tx=0x7f44dc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e359e700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44e4138710 0x7f44e4150620 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f44e40a8460 tx=0x7f44dc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44dc012290 con 0x7f44e4138710 2020-02-11T16:29:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc012430 con 0x7f44e4138710 2020-02-11T16:29:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44dc012850 con 0x7f44e4138710 2020-02-11T16:29:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e9245700 1 -- 172.21.15.88:0/1893888781 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e41353e0 con 0x7f44e4138710 2020-02-11T16:29:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.852+0000 7f44e9245700 1 -- 172.21.15.88:0/1893888781 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e40a79e0 con 0x7f44e4138710 2020-02-11T16:29:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44e359e700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44e4138710 0x7f44e4150620 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f44e40a8460 tx=0x7f44dc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44e9245700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 0x7f44e4128e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44e9245700 1 -- 172.21.15.88:0/1893888781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e405e2f0 con 0x7f44e4133210 2020-02-11T16:29:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f44dc012ac0 con 0x7f44e4138710 2020-02-11T16:29:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44e359e700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44e4138710 0x7f44e4150620 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f44e40a8460 tx=0x7f44dc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 0x7f44e4128e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44d3fff700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f44c0039f30 0x7f44c003c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f44dc04a0c0 con 0x7f44e4138710 2020-02-11T16:29:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44e259c700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f44c0039f30 0x7f44c003c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44e2d9d700 1 -- 172.21.15.88:0/1893888781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44e40565b0 con 0x7f44e4133210 2020-02-11T16:29:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.853+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 0x7f44e4128e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 0x7f44e4128e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 0x7f44e4128e80 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 0x7f44e4128e80 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44d4011900 con 0x7f44e4133210 2020-02-11T16:29:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44e259c700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f44c0039f30 0x7f44c003c3f0 crc :-1 s=READY pgs=531 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 0x7f44e4128e80 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f44d4007150 con 0x7f44e4133210 2020-02-11T16:29:31.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 msgr2=0x7f44e4128e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44d3fff700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 0x7f44e4128e80 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).stop 2020-02-11T16:29:31.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 msgr2=0x7f44e4128e80 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:31.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.854+0000 7f44d3fff700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e4133210 0x7f44e4128e80 secure :-1 s=CLOSED pgs=396 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).stop 2020-02-11T16:29:31.871 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.865+0000 7f44e9245700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 0x7f44e4135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:31.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.865+0000 7f44e9245700 1 -- 172.21.15.88:0/1893888781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40a6850 con 0x7f44e41292e0 2020-02-11T16:29:31.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.865+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 0x7f44e4135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:31.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.865+0000 7f44e2d9d700 1 -- 172.21.15.88:0/1893888781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f44e4133e60 con 0x7f44e41292e0 2020-02-11T16:29:31.872 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.865+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 0x7f44e4135b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.866+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 0x7f44e4135b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.866+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 0x7f44e4135b60 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:31.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.866+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 0x7f44e4135b60 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.866+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44d4008e60 con 0x7f44e41292e0 2020-02-11T16:29:31.873 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.866+0000 7f44e2d9d700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 0x7f44e4135b60 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:31.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.866+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4363 (secure 0 0 0) 0x7f44d400c730 con 0x7f44e41292e0 2020-02-11T16:29:31.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.866+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 msgr2=0x7f44e4135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.866+0000 7f44d3fff700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 0x7f44e4135b60 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).stop 2020-02-11T16:29:31.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.866+0000 7f44d3fff700 1 -- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 msgr2=0x7f44e4135b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.866+0000 7f44d3fff700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44e41292e0 0x7f44e4135b60 secure :-1 s=CLOSED pgs=397 cs=0 l=1 rx=0x7f44d40084c0 tx=0x7f44d40113a0).stop 2020-02-11T16:29:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e9245700 1 -- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f44c0039f30 msgr2=0x7f44c003c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e9245700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f44c0039f30 0x7f44c003c3f0 crc :-1 s=READY pgs=531 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e9245700 1 -- 172.21.15.88:0/1893888781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44e4138710 msgr2=0x7f44e4150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:31.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e9245700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44e4138710 0x7f44e4150620 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f44e40a8460 tx=0x7f44dc010c30).stop 2020-02-11T16:29:31.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e359e700 1 -- 172.21.15.88:0/1893888781 reap_dead start 2020-02-11T16:29:31.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e359e700 1 -- 172.21.15.88:0/1893888781 reap_dead start 2020-02-11T16:29:31.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e9245700 1 -- 172.21.15.88:0/1893888781 shutdown_connections 2020-02-11T16:29:31.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e9245700 1 --2- 172.21.15.88:0/1893888781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44e4138710 0x7f44e4150620 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:31.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e9245700 1 -- 172.21.15.88:0/1893888781 >> 172.21.15.88:0/1893888781 conn(0x7f44e405ac70 msgr2=0x7f44e4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:31.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e9245700 1 -- 172.21.15.88:0/1893888781 shutdown_connections 2020-02-11T16:29:31.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:31.867+0000 7f44e9245700 1 -- 172.21.15.88:0/1893888781 wait complete. 2020-02-11T16:29:31.878 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:29:31.878 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:31.878 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:31.878 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:29:31.878 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 192, 2020-02-11T16:29:31.879 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:29:31.879 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:29:31.879 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:29:31.879 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:29:31.880 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.880 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 16, 2020-02-11T16:29:31.880 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:31.880 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:29:31.880 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:29:31.881 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:31.881 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:31.881 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:31.881 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:31.882 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:31.882 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:31.882 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.882 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:29:31.882 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:29:31.883 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:31.883 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:31.883 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:31.883 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:31.884 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:31.884 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:31.884 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.884 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:29:31.885 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:29:31.885 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:29:31.885 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:29:31.885 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:29:31.886 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:29:31.886 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:31.886 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:31.886 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:29:31.887 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:29:31.887 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:31.887 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:29:31.887 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:31.888 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:31.888 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:31.888 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:31.888 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:31.889 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:31.889 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.889 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:29:31.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.889 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:29:31.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.890 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:31.890 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:31.890 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:31.891 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:31.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.891 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:31.891 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:29:31.892 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.892 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:31.892 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:29:31.893 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.893 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.893 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.894 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:29:31.894 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:29:31.894 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:31.894 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:31.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.895 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:29:31.895 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:29:31.895 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:31.895 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:31.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.895 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:29:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:29:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:29:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:29:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:29:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:29:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:29:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:29:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:29:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:29:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:29:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:31.903 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:31.903 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:31.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.903 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.903 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:29:31.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.903 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:31.903 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:31.904 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2020-02-11T16:29:31.904 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.904 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.904 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:29:31.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.904 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:31.904 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:31.905 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:29:31.905 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.905 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:31.905 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:29:31.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:31.905 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:31.905 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:31.906 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:29:31.906 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.906 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:31.906 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:31.906 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:29:31.907 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:29:32.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.044+0000 7f8cee844700 1 Processor -- start 2020-02-11T16:29:32.046 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.044+0000 7f8cee844700 1 -- start start 2020-02-11T16:29:32.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.045+0000 7f8cee844700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ce805be70 0x7f8ce80a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:32.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.045+0000 7f8cee844700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce809d6b0 con 0x7f8ce8137f10 2020-02-11T16:29:32.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.045+0000 7f8cee844700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce812ee50 con 0x7f8ce805c250 2020-02-11T16:29:32.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.045+0000 7f8cee844700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce80a3f20 con 0x7f8ce805be70 2020-02-11T16:29:32.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.045+0000 7f8ce77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8ce805c250 0x7f8ce80a6ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48214/0 (socket says 172.21.15.88:48214) 2020-02-11T16:29:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.045+0000 7f8ce77fe700 1 -- 172.21.15.88:0/2925365691 learned_addr learned my addr 172.21.15.88:0/2925365691 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.045+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/2925365691 >> v2:172.21.15.52:3300/0 conn(0x7f8ce805be70 0x7f8ce80a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.045+0000 7f8ce6ffd700 1 -- 172.21.15.88:0/2925365691 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262967899 0 0) 0x7f8ce812ee50 con 0x7f8ce805c250 2020-02-11T16:29:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce6ffd700 1 -- 172.21.15.88:0/2925365691 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd4003230 con 0x7f8ce805c250 2020-02-11T16:29:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce6ffd700 1 -- 172.21.15.88:0/2925365691 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751385177 0 0) 0x7f8ce809d6b0 con 0x7f8ce8137f10 2020-02-11T16:29:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce6ffd700 1 -- 172.21.15.88:0/2925365691 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce812ee50 con 0x7f8ce8137f10 2020-02-11T16:29:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce6ffd700 1 -- 172.21.15.88:0/2925365691 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 772668019 0 0) 0x7f8cd4003230 con 0x7f8ce805c250 2020-02-11T16:29:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce7fff700 1 -- 172.21.15.88:0/2925365691 >> v1:172.21.15.88:6789/0 conn(0x7f8ce805c250 legacy=0x7f8ce80a6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce7fff700 1 -- 172.21.15.88:0/2925365691 >> v1:172.21.15.52:6789/0 conn(0x7f8ce8137f10 legacy=0x7f8ce812e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce7fff700 1 -- 172.21.15.88:0/2925365691 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce812f050 con 0x7f8ce805be70 2020-02-11T16:29:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/2925365691 >> v2:172.21.15.52:3300/0 conn(0x7f8ce805be70 0x7f8ce80a31c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ce0001450 tx=0x7f8cd80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/2925365691 >> v2:172.21.15.52:3300/0 conn(0x7f8ce805be70 0x7f8ce80a31c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ce0001450 tx=0x7f8cd80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/2925365691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce805be70 0x7f8ce80a31c0 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f8ce0001450 tx=0x7f8cd80088e0).ready entity=mon.0 client_cookie=830feef709e5ca61 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/2925365691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce805be70 0x7f8ce80a31c0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f8ce0001450 tx=0x7f8cd80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce6ffd700 1 -- 172.21.15.88:0/2925365691 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cdc0016d0 con 0x7f8ce805be70 2020-02-11T16:29:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/2925365691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce805be70 0x7f8ce80a31c0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f8ce0001450 tx=0x7f8cd80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/2925365691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce805be70 0x7f8ce80a31c0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f8ce0001450 tx=0x7f8cd80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce6ffd700 1 -- 172.21.15.88:0/2925365691 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8013420 con 0x7f8ce805be70 2020-02-11T16:29:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8ce6ffd700 1 -- 172.21.15.88:0/2925365691 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd8013780 con 0x7f8ce805be70 2020-02-11T16:29:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8cee844700 1 -- 172.21.15.88:0/2925365691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce805be70 msgr2=0x7f8ce80a31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.046+0000 7f8cee844700 1 --2- 172.21.15.88:0/2925365691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce805be70 0x7f8ce80a31c0 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f8ce0001450 tx=0x7f8cd80088e0).stop 2020-02-11T16:29:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.047+0000 7f8cee844700 1 -- 172.21.15.88:0/2925365691 shutdown_connections 2020-02-11T16:29:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.047+0000 7f8cee844700 1 --2- 172.21.15.88:0/2925365691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce805be70 0x7f8ce80a31c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.047+0000 7f8cee844700 1 -- 172.21.15.88:0/2925365691 >> 172.21.15.88:0/2925365691 conn(0x7f8ce80ab400 msgr2=0x7f8ce80a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.047+0000 7f8cee844700 1 -- 172.21.15.88:0/2925365691 shutdown_connections 2020-02-11T16:29:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.047+0000 7f8cee844700 1 -- 172.21.15.88:0/2925365691 wait complete. 2020-02-11T16:29:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.048+0000 7f8cee844700 1 Processor -- start 2020-02-11T16:29:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.048+0000 7f8cee844700 1 -- start start 2020-02-11T16:29:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.049+0000 7f8cee844700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ce805c250 0x7f8ce8127d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.049+0000 7f8cee844700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce8137f10 0x7f8ce81281c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.049+0000 7f8cee844700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce8135b10 con 0x7f8ce805be70 2020-02-11T16:29:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.049+0000 7f8cee844700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce8136a10 con 0x7f8ce805c250 2020-02-11T16:29:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.049+0000 7f8cee844700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce81324c0 con 0x7f8ce8137f10 2020-02-11T16:29:32.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.049+0000 7f8ce77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ce805c250 0x7f8ce8127d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:32.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.049+0000 7f8ce77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ce805c250 0x7f8ce8127d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60596/0 (socket says 172.21.15.88:60596) 2020-02-11T16:29:32.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.049+0000 7f8ce77fe700 1 -- 172.21.15.88:0/326999872 learned_addr learned my addr 172.21.15.88:0/326999872 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:32.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.049+0000 7f8cecde1700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce8137f10 0x7f8ce81281c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:32.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.049+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901487939 0 0) 0x7f8ce8135b10 con 0x7f8ce805be70 2020-02-11T16:29:32.058 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc8002fe0 con 0x7f8ce805be70 2020-02-11T16:29:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce77fe700 1 -- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce8137f10 msgr2=0x7f8ce81281c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce77fe700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce8137f10 0x7f8ce81281c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce77fe700 1 -- 172.21.15.88:0/326999872 >> v1:172.21.15.52:6789/0 conn(0x7f8ce805be70 legacy=0x7f8ce80a8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce77fe700 1 -- 172.21.15.88:0/326999872 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8136c00 con 0x7f8ce805c250 2020-02-11T16:29:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce77fe700 1 --2- 172.21.15.88:0/326999872 >> v2:172.21.15.88:3300/0 conn(0x7f8ce805c250 0x7f8ce8127d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cdc0018b0 tx=0x7f8cdc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce77fe700 1 --2- 172.21.15.88:0/326999872 >> v2:172.21.15.88:3300/0 conn(0x7f8ce805c250 0x7f8ce8127d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cdc0018b0 tx=0x7f8cdc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce77fe700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ce805c250 0x7f8ce8127d60 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f8cdc0018b0 tx=0x7f8cdc010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce77fe700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ce805c250 0x7f8ce8127d60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f8cdc0018b0 tx=0x7f8cdc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cdc00ccf0 con 0x7f8ce805c250 2020-02-11T16:29:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce77fe700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ce805c250 0x7f8ce8127d60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f8cdc0018b0 tx=0x7f8cdc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc00ce50 con 0x7f8ce805c250 2020-02-11T16:29:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce77fe700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ce805c250 0x7f8ce8127d60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f8cdc0018b0 tx=0x7f8cdc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.050+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cdc0046e0 con 0x7f8ce805c250 2020-02-11T16:29:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.051+0000 7f8cee844700 1 -- 172.21.15.88:0/326999872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce812a790 con 0x7f8ce805c250 2020-02-11T16:29:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.051+0000 7f8cee844700 1 -- 172.21.15.88:0/326999872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce8136ef0 con 0x7f8ce805c250 2020-02-11T16:29:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.051+0000 7f8ce77fe700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ce805c250 0x7f8ce8127d60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f8cdc0018b0 tx=0x7f8cdc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.051+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8cdc0048e0 con 0x7f8ce805c250 2020-02-11T16:29:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.051+0000 7f8ce77fe700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ce805c250 0x7f8ce8127d60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f8cdc0018b0 tx=0x7f8cdc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8cee844700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 0x7f8ce80a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8cee844700 1 -- 172.21.15.88:0/326999872 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce805c630 con 0x7f8ce812d5b0 2020-02-11T16:29:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8ce57fa700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cc8039f60 0x7f8cc803c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8cdc0499d0 con 0x7f8ce805c250 2020-02-11T16:29:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 0x7f8ce80a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8cecde1700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cc8039f60 0x7f8cc803c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8ce7fff700 1 -- 172.21.15.88:0/326999872 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ce812a920 con 0x7f8ce812d5b0 2020-02-11T16:29:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8cecde1700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cc8039f60 0x7f8cc803c420 crc :-1 s=READY pgs=532 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 0x7f8ce80a2c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 0x7f8ce80a2c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 0x7f8ce80a2c10 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 0x7f8ce80a2c10 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.052+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd800f760 con 0x7f8ce812d5b0 2020-02-11T16:29:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.053+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 0x7f8ce80a2c10 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.053+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8cd8007150 con 0x7f8ce812d5b0 2020-02-11T16:29:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.053+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 msgr2=0x7f8ce80a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.053+0000 7f8ce57fa700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 0x7f8ce80a2c10 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).stop 2020-02-11T16:29:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.053+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 msgr2=0x7f8ce80a2c10 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.053+0000 7f8ce57fa700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce812d5b0 0x7f8ce80a2c10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.063+0000 7f8cee844700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 0x7f8ce812c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.063+0000 7f8cee844700 1 -- 172.21.15.88:0/326999872 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80aa6a0 con 0x7f8ce80a8fa0 2020-02-11T16:29:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.063+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 0x7f8ce812c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.063+0000 7f8ce7fff700 1 -- 172.21.15.88:0/326999872 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8ce80565b0 con 0x7f8ce80a8fa0 2020-02-11T16:29:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.063+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 0x7f8ce812c0b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.064+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 0x7f8ce812c0b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.064+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 0x7f8ce812c0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.064+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 0x7f8ce812c0b0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.064+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd800a560 con 0x7f8ce80a8fa0 2020-02-11T16:29:32.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.064+0000 7f8ce7fff700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 0x7f8ce812c0b0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.064+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7f8cd800a6c0 con 0x7f8ce80a8fa0 2020-02-11T16:29:32.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.064+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 msgr2=0x7f8ce812c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.064+0000 7f8ce57fa700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 0x7f8ce812c0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f8cd8000b80 tx=0x7f8ce80a3990).stop 2020-02-11T16:29:32.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.064+0000 7f8ce57fa700 1 -- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 msgr2=0x7f8ce812c0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:32.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.064+0000 7f8ce57fa700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ce80a8fa0 0x7f8ce812c0b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.065+0000 7f8cee844700 1 -- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cc8039f60 msgr2=0x7f8cc803c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.065+0000 7f8cee844700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8cc8039f60 0x7f8cc803c420 crc :-1 s=READY pgs=532 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.065+0000 7f8cee844700 1 -- 172.21.15.88:0/326999872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ce805c250 msgr2=0x7f8ce8127d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.065+0000 7f8cee844700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ce805c250 0x7f8ce8127d60 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f8cdc0018b0 tx=0x7f8cdc010bd0).stop 2020-02-11T16:29:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.065+0000 7f8cecde1700 1 -- 172.21.15.88:0/326999872 reap_dead start 2020-02-11T16:29:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.065+0000 7f8cee844700 1 -- 172.21.15.88:0/326999872 shutdown_connections 2020-02-11T16:29:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.065+0000 7f8cee844700 1 --2- 172.21.15.88:0/326999872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ce805c250 0x7f8ce8127d60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.065+0000 7f8cee844700 1 -- 172.21.15.88:0/326999872 >> 172.21.15.88:0/326999872 conn(0x7f8ce80ab400 msgr2=0x7f8ce8134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:32.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.065+0000 7f8cee844700 1 -- 172.21.15.88:0/326999872 shutdown_connections 2020-02-11T16:29:32.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.065+0000 7f8cee844700 1 -- 172.21.15.88:0/326999872 wait complete. 2020-02-11T16:29:32.070 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:29:32.070 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:32.070 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:32.070 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:29:32.071 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 192, 2020-02-11T16:29:32.071 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:29:32.071 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:29:32.071 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:29:32.071 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:29:32.071 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:32.071 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 16, 2020-02-11T16:29:32.072 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:32.072 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:29:32.072 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:29:32.072 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:32.072 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:32.072 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:32.072 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:32.073 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:32.073 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:32.073 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:32.073 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:29:32.073 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:29:32.073 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:32.073 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:32.074 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:32.074 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:32.074 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:32.074 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:32.074 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:32.074 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.074 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:29:32.075 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:29:32.075 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:29:32.075 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:29:32.075 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:29:32.075 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:29:32.075 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:32.075 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:32.075 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:29:32.076 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:29:32.076 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:32.076 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:29:32.076 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:32.076 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:32.076 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:32.076 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:32.077 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:32.077 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:32.077 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:32.077 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:29:32.077 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.077 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:29:32.077 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.078 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:32.078 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:32.078 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:32.078 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:32.078 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.078 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:32.078 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:29:32.079 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:32.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.079 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.079 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:32.079 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:29:32.079 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:32.079 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:32.080 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:32.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.080 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:29:32.080 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:29:32.080 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:32.080 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:32.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.081 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.081 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:29:32.081 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:29:32.081 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:32.081 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:32.081 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.081 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:32.082 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:29:32.082 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:32.082 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.082 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.082 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:32.082 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:29:32.082 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:32.082 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:32.083 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:32.083 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.083 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:29:32.083 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:29:32.083 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:32.083 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:32.083 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.084 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.084 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:32.084 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:32.084 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:32.084 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:32.084 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.084 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:32.085 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:29:32.085 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:32.085 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.085 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.085 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:32.085 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:29:32.085 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:32.086 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:32.086 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:32.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.086 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:29:32.086 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:29:32.086 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:32.086 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:32.087 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:32.087 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:32.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:32.087 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:29:32.087 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:29:32.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.087 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:32.087 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:32.088 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:32.088 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:32.088 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:32.088 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:29:32.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:32.088 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:32.088 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:32.089 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:32.089 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:32.089 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:32.089 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:32.089 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:29:32.090 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:29:32.090 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:29:32.091 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:29:32.091 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:29:32.091 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:29:32.091 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:29:32.102 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:29:32.102 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:29:32.102 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:29:32.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9f250d700 1 Processor -- start 2020-02-11T16:29:32.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9f250d700 1 -- start start 2020-02-11T16:29:32.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9f250d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec0a8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:32.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9f250d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 0x7fb9ec0a8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:32.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9f250d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec0a4af0 con 0x7fb9ec0a7c00 2020-02-11T16:29:32.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9f250d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec1302a0 con 0x7fb9ec136750 2020-02-11T16:29:32.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9f250d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec135a20 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9f0aaa700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 msgr2=0x7fb9ec0a8080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:32.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9f0aaa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 0x7fb9ec0a8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:32.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9eb7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb9ec0a7c00 0x7fb9ec136040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40028/0 (socket says 172.21.15.88:40028) 2020-02-11T16:29:32.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9eb7fe700 1 -- 172.21.15.88:0/3763256650 learned_addr learned my addr 172.21.15.88:0/3763256650 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:32.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.286+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/3763256650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec0a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:32.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9ebfff700 1 -- 172.21.15.88:0/3763256650 >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 msgr2=0x7fb9ec0a8080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:29:32.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/3763256650 >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 0x7fb9ec0a8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:32.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9ebfff700 1 -- 172.21.15.88:0/3763256650 >> v1:172.21.15.52:6789/0 conn(0x7fb9ec0a7c00 legacy=0x7fb9ec136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9ebfff700 1 -- 172.21.15.88:0/3763256650 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0a4d90 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9eaffd700 1 -- 172.21.15.88:0/3763256650 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756461555 0 0) 0x7fb9ec0a4af0 con 0x7fb9ec0a7c00 2020-02-11T16:29:32.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/3763256650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec0a8690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9dc002f30 tx=0x7fb9dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/3763256650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec0a8690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9dc002f30 tx=0x7fb9dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/3763256650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec0a8690 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9dc0088e0).ready entity=mon.2 client_cookie=7e8bd13e207f419e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:32.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/3763256650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec0a8690 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9eaffd700 1 -- 172.21.15.88:0/3763256650 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9dc0116a0 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/3763256650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec0a8690 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/3763256650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec0a8690 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9eaffd700 1 -- 172.21.15.88:0/3763256650 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc011800 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9eaffd700 1 -- 172.21.15.88:0/3763256650 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9dc011ba0 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9f250d700 1 -- 172.21.15.88:0/3763256650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 msgr2=0x7fb9ec0a8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.287+0000 7fb9f250d700 1 --2- 172.21.15.88:0/3763256650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec0a8690 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9dc0088e0).stop 2020-02-11T16:29:32.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.289+0000 7fb9f250d700 1 -- 172.21.15.88:0/3763256650 shutdown_connections 2020-02-11T16:29:32.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.289+0000 7fb9f250d700 1 --2- 172.21.15.88:0/3763256650 >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 0x7fb9ec0a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:32.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.289+0000 7fb9f250d700 1 --2- 172.21.15.88:0/3763256650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec0a8690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.289+0000 7fb9f250d700 1 -- 172.21.15.88:0/3763256650 >> 172.21.15.88:0/3763256650 conn(0x7fb9ec0ac2d0 msgr2=0x7fb9ec0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:32.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.289+0000 7fb9f250d700 1 -- 172.21.15.88:0/3763256650 shutdown_connections 2020-02-11T16:29:32.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.289+0000 7fb9f250d700 1 -- 172.21.15.88:0/3763256650 wait complete. 2020-02-11T16:29:32.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.290+0000 7fb9f250d700 1 Processor -- start 2020-02-11T16:29:32.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.290+0000 7fb9f250d700 1 -- start start 2020-02-11T16:29:32.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9f250d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:32.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9f250d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9ec0a7c00 0x7fb9ec1305e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:32.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9f250d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 0x7fb9ec130a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:32.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9f250d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec138070 con 0x7fb9ec0a7c00 2020-02-11T16:29:32.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9f250d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec136c40 con 0x7fb9ec136750 2020-02-11T16:29:32.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9f250d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec1382d0 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9f0aaa700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 msgr2=0x7fb9ec130a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:32.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9f0aaa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 0x7fb9ec130a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:32.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9eb7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9ec0a7c00 0x7fb9ec1305e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:32.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9ebfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:32.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9eb7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9ec0a7c00 0x7fb9ec1305e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46612/0 (socket says 172.21.15.88:46612) 2020-02-11T16:29:32.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9eb7fe700 1 -- 172.21.15.88:0/556274336 learned_addr learned my addr 172.21.15.88:0/556274336 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9ebfff700 1 -- 172.21.15.88:0/556274336 >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 msgr2=0x7fb9ec130a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:29:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 0x7fb9ec130a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9ebfff700 1 -- 172.21.15.88:0/556274336 >> v2:172.21.15.52:3300/0 conn(0x7fb9ec0a7c00 msgr2=0x7fb9ec1305e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.291+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> v2:172.21.15.52:3300/0 conn(0x7fb9ec0a7c00 0x7fb9ec1305e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9ebfff700 1 -- 172.21.15.88:0/556274336 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec138570 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9eb7fe700 1 --2- 172.21.15.88:0/556274336 >> v2:172.21.15.52:3300/0 conn(0x7fb9ec0a7c00 0x7fb9ec1305e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:29:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9e97fa700 1 -- 172.21.15.88:0/556274336 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9dc011e20 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9e97fa700 1 -- 172.21.15.88:0/556274336 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc007340 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9f250d700 1 -- 172.21.15.88:0/556274336 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec138810 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9e97fa700 1 -- 172.21.15.88:0/556274336 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9dc0056c0 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.292+0000 7fb9f250d700 1 -- 172.21.15.88:0/556274336 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec060280 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.293+0000 7fb9f250d700 1 -- 172.21.15.88:0/556274336 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ec0565b0 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.294+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.294+0000 7fb9e97fa700 1 -- 172.21.15.88:0/556274336 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb9dc005820 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.294+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.294+0000 7fb9e97fa700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb9cc039d00 0x7fb9cc03c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:32.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.294+0000 7fb9e97fa700 1 -- 172.21.15.88:0/556274336 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb9dc04e160 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.294+0000 7fb9eb7fe700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb9cc039d00 0x7fb9cc03c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:32.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.295+0000 7fb9eb7fe700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb9cc039d00 0x7fb9cc03c1c0 crc :-1 s=READY pgs=533 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:32.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.299+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.299+0000 7fb9e97fa700 1 -- 172.21.15.88:0/556274336 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb9dc032500 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.546+0000 7fb9f250d700 1 -- 172.21.15.88:0/556274336 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb9ec05ccb0 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.546+0000 7fb9ebfff700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.546+0000 7fb9e97fa700 1 -- 172.21.15.88:0/556274336 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fb9dc0320c0 con 0x7fb9ec0a3a90 2020-02-11T16:29:32.548 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:32.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.548+0000 7fb9f250d700 1 -- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb9cc039d00 msgr2=0x7fb9cc03c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.548+0000 7fb9f250d700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb9cc039d00 0x7fb9cc03c1c0 crc :-1 s=READY pgs=533 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.548+0000 7fb9f250d700 1 -- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 msgr2=0x7fb9ec1328a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:32.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.548+0000 7fb9f250d700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7fb9dc002f30 tx=0x7fb9ec0a3e70).stop 2020-02-11T16:29:32.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.549+0000 7fb9f250d700 1 -- 172.21.15.88:0/556274336 shutdown_connections 2020-02-11T16:29:32.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.549+0000 7fb9f250d700 1 --2- 172.21.15.88:0/556274336 >> v2:172.21.15.88:3300/0 conn(0x7fb9ec136750 0x7fb9ec130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.549+0000 7fb9f250d700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9ec0a3a90 0x7fb9ec1328a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.549+0000 7fb9f250d700 1 --2- 172.21.15.88:0/556274336 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb9cc039d00 0x7fb9cc03c1c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.549+0000 7fb9f250d700 1 --2- 172.21.15.88:0/556274336 >> v2:172.21.15.52:3300/0 conn(0x7fb9ec0a7c00 0x7fb9ec1305e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:32.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.549+0000 7fb9f250d700 1 -- 172.21.15.88:0/556274336 >> 172.21.15.88:0/556274336 conn(0x7fb9ec0ac2d0 msgr2=0x7fb9ec0a9560 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:32.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.549+0000 7fb9f250d700 1 -- 172.21.15.88:0/556274336 shutdown_connections 2020-02-11T16:29:32.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:32.549+0000 7fb9f250d700 1 -- 172.21.15.88:0/556274336 wait complete. 2020-02-11T16:29:32.562 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":192,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:33.959 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 4% (376/9310) Checking out files: 5% (466/9310) Checking out files: 6% (559/9310) Checking out files: 7% (652/9310) Checking out files: 7% (709/9310) Checking out files: 8% (745/9310) Checking out files: 9% (838/9310) Checking out files: 10% (931/9310) Checking out files: 11% (1025/9310) Checking out files: 11% (1026/9310) Checking out files: 12% (1118/9310) Checking out files: 13% (1211/9310) Checking out files: 13% (1302/9310) Checking out files: 14% (1304/9310) Checking out files: 15% (1397/9310) Checking out files: 16% (1490/9310) Checking out files: 17% (1583/9310) Checking out files: 17% (1613/9310) Checking out files: 18% (1676/9310) Checking out files: 19% (1769/9310) Checking out files: 19% (1858/9310) Checking out files: 20% (1862/9310) Checking out files: 21% (1956/9310) Checking out files: 21% (2045/9310) Checking out files: 22% (2049/9310) Checking out files: 23% (2142/9310) Checking out files: 24% (2235/9310) Checking out files: 24% (2311/9310) Checking out files: 25% (2328/9310) Checking out files: 26% (2421/9310) Checking out files: 26% (2505/9310) Checking out files: 27% (2514/9310) Checking out files: 28% (2607/9310) Checking out files: 29% (2700/9310) Checking out files: 30% (2793/9310) Checking out files: 30% (2804/9310) Checking out files: 31% (2887/9310) Checking out files: 32% (2980/9310) Checking out files: 32% (3051/9310) Checking out files: 33% (3073/9310) Checking out files: 34% (3166/9310) Checking out files: 35% (3259/9310) Checking out files: 35% (3278/9310) Checking out files: 36% (3352/9310) Checking out files: 37% (3445/9310) Checking out files: 38% (3538/9310) Checking out files: 38% (3593/9310) Checking out files: 39% (3631/9310) Checking out files: 40% (3724/9310) Checking out files: 41% (3818/9310) Checking out files: 41% (3847/9310) Checking out files: 42% (3911/9310) Checking out files: 43% (4004/9310) Checking out files: 43% (4064/9310) Checking out files: 44% (4097/9310) Checking out files: 45% (4190/9310) Checking out files: 45% (4250/9310) Checking out files: 46% (4283/9310) Checking out files: 47% (4376/9310) Checking out files: 48% (4469/9310) Checking out files: 48% (4510/9310) Checking out files: 49% (4562/9310) Checking out files: 50% (4655/9310) Checking out files: 51% (4749/9310) Checking out files: 51% (4785/9310) Checking out files: 52% (4842/9310) Checking out files: 53% (4935/9310) Checking out files: 54% (5028/9310) Checking out files: 54% (5078/9310) Checking out files: 55% (5121/9310) Checking out files: 56% (5214/9310) Checking out files: 57% (5307/9310) Checking out files: 57% (5344/9310) Checking out files: 58% (5400/9310) Checking out files: 59% (5493/9310) Checking out files: 60% (5586/9310) Checking out files: 60% (5678/9310) Checking out files: 61% (5680/9310) Checking out files: 61% (5712/9310) Checking out files: 62% (5773/9310) Checking out files: 63% (5866/9310) Checking out files: 64% (5959/9310) Checking out files: 64% (6013/9310) Checking out files: 65% (6052/9310) Checking out files: 66% (6145/9310) Checking out files: 67% (6238/9310) Checking out files: 68% (6331/9310) Checking out files: 69% (6424/9310) Checking out files: 69% (6429/9310) Checking out files: 70% (6517/9310) Checking out files: 70% (6580/9310) Checking out files: 71% (6611/9310) Checking out files: 72% (6704/9310) Checking out files: 72% (6760/9310) Checking out files: 73% (6797/9310) Checking out files: 74% (6890/9310) Checking out files: 74% (6976/9310) Checking out files: 75% (6983/9310) Checking out files: 76% (7076/9310) Checking out files: 77% (7169/9310) Checking out files: 77% (7191/9310) Checking out files: 78% (7262/9310) Checking out files: 78% (7340/9310) Checking out files: 79% (7355/9310) Checking out files: 79% (7387/9310) Checking out files: 80% (7448/9310) Checking out files: 81% (7542/9310) Checking out files: 82% (7635/9310) Checking out files: 82% (7659/9310) Checking out files: 83% (7728/9310) Checking out files: 84% (7821/9310) Checking out files: 84% (7903/9310) Checking out files: 85% (7914/9310) Checking out files: 86% (8007/9310) Checking out files: 87% (8100/9310) Checking out files: 87% (8141/9310) Checking out files: 88% (8193/9310) Checking out files: 89% (8286/9310) Checking out files: 90% (8379/9310) Checking out files: 90% (8419/9310) Checking out files: 91% (8473/9310) Checking out files: 92% (8566/9310) Checking out files: 92% (8628/9310) Checking out files: 93% (8659/9310) Checking out files: 94% (8752/9310) Checking out files: 94% (8836/9310) Checking out files: 95% (8845/9310) Checking out files: 96% (8938/9310) Checking out files: 97% (9031/9310) Checking out files: 97% (9087/9310) Checking out files: 98% (9124/9310) Checking out files: 99% (9217/9310) Checking out files: 100% (9310/9310) Checking out files: 100% (9310/9310), done. 2020-02-11T16:29:33.999 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ceph 2020-02-11T16:29:34.000 INFO:tasks.workunit.client.0.smithi088.stderr:++ seq 1 21 2020-02-11T16:29:34.002 INFO:tasks.workunit.client.0.smithi088.stderr:+ versions='1 2020-02-11T16:29:34.002 INFO:tasks.workunit.client.0.smithi088.stderr:2 2020-02-11T16:29:34.002 INFO:tasks.workunit.client.0.smithi088.stderr:3 2020-02-11T16:29:34.002 INFO:tasks.workunit.client.0.smithi088.stderr:4 2020-02-11T16:29:34.002 INFO:tasks.workunit.client.0.smithi088.stderr:5 2020-02-11T16:29:34.003 INFO:tasks.workunit.client.0.smithi088.stderr:6 2020-02-11T16:29:34.003 INFO:tasks.workunit.client.0.smithi088.stderr:7 2020-02-11T16:29:34.003 INFO:tasks.workunit.client.0.smithi088.stderr:8 2020-02-11T16:29:34.003 INFO:tasks.workunit.client.0.smithi088.stderr:9 2020-02-11T16:29:34.003 INFO:tasks.workunit.client.0.smithi088.stderr:10 2020-02-11T16:29:34.003 INFO:tasks.workunit.client.0.smithi088.stderr:11 2020-02-11T16:29:34.003 INFO:tasks.workunit.client.0.smithi088.stderr:12 2020-02-11T16:29:34.004 INFO:tasks.workunit.client.0.smithi088.stderr:13 2020-02-11T16:29:34.004 INFO:tasks.workunit.client.0.smithi088.stderr:14 2020-02-11T16:29:34.004 INFO:tasks.workunit.client.0.smithi088.stderr:15 2020-02-11T16:29:34.004 INFO:tasks.workunit.client.0.smithi088.stderr:16 2020-02-11T16:29:34.004 INFO:tasks.workunit.client.0.smithi088.stderr:17 2020-02-11T16:29:34.004 INFO:tasks.workunit.client.0.smithi088.stderr:18 2020-02-11T16:29:34.004 INFO:tasks.workunit.client.0.smithi088.stderr:19 2020-02-11T16:29:34.005 INFO:tasks.workunit.client.0.smithi088.stderr:20 2020-02-11T16:29:34.005 INFO:tasks.workunit.client.0.smithi088.stderr:21' 2020-02-11T16:29:34.005 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:29:34.005 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.1 2020-02-11T16:29:34.005 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.1 2020-02-11T16:29:34.005 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.1 2020-02-11T16:29:34.006 INFO:tasks.workunit.client.0.smithi088.stdout:v0.1 2020-02-11T16:29:35.563 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:29:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.668+0000 7fe0692bd700 1 Processor -- start 2020-02-11T16:29:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.668+0000 7fe0692bd700 1 -- start start 2020-02-11T16:29:35.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.669+0000 7fe0692bd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0640a18a0 0x7fe0640a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:35.680 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.669+0000 7fe0692bd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 0x7fe06412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:35.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.669+0000 7fe0692bd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0640a3570 con 0x7fe0640a5de0 2020-02-11T16:29:35.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.669+0000 7fe0692bd700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0640a3810 con 0x7fe0640a18a0 2020-02-11T16:29:35.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.669+0000 7fe0692bd700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640a3ab0 con 0x7fe0640a6260 2020-02-11T16:29:35.681 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.669+0000 7fe062ffd700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fe0640a18a0 msgr2=0x7fe0640a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:35.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.669+0000 7fe062ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0640a18a0 0x7fe0640a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:35.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.669+0000 7fe0627fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe0640a5de0 0x7fe06412e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40040/0 (socket says 172.21.15.88:40040) 2020-02-11T16:29:35.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.669+0000 7fe0637fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 0x7fe06412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:35.682 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.669+0000 7fe0627fc700 1 -- 172.21.15.88:0/1573846147 learned_addr learned my addr 172.21.15.88:0/1573846147 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:35.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe061ffb700 1 -- 172.21.15.88:0/1573846147 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919803014 0 0) 0x7fe0640a3570 con 0x7fe0640a5de0 2020-02-11T16:29:35.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe061ffb700 1 -- 172.21.15.88:0/1573846147 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe044003230 con 0x7fe0640a5de0 2020-02-11T16:29:35.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0637fe700 1 -- 172.21.15.88:0/1573846147 >> v2:172.21.15.88:3300/0 conn(0x7fe0640a18a0 msgr2=0x7fe0640a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:29:35.683 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0637fe700 1 --2- 172.21.15.88:0/1573846147 >> v2:172.21.15.88:3300/0 conn(0x7fe0640a18a0 0x7fe0640a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:35.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0637fe700 1 -- 172.21.15.88:0/1573846147 >> v1:172.21.15.52:6789/0 conn(0x7fe0640a5de0 legacy=0x7fe06412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:35.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0637fe700 1 -- 172.21.15.88:0/1573846147 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640a3d50 con 0x7fe0640a6260 2020-02-11T16:29:35.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0637fe700 1 --2- 172.21.15.88:0/1573846147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 0x7fe06412eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe05c0032b0 tx=0x7fe05c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0637fe700 1 --2- 172.21.15.88:0/1573846147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 0x7fe06412eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe05c0032b0 tx=0x7fe05c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.684 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0637fe700 1 --2- 172.21.15.88:0/1573846147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 0x7fe06412eab0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fe05c0032b0 tx=0x7fe05c008c60).ready entity=mon.2 client_cookie=c84862cc6f7e928b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:35.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0637fe700 1 --2- 172.21.15.88:0/1573846147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 0x7fe06412eab0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe05c0032b0 tx=0x7fe05c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe061ffb700 1 -- 172.21.15.88:0/1573846147 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe05c00a160 con 0x7fe0640a6260 2020-02-11T16:29:35.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0637fe700 1 --2- 172.21.15.88:0/1573846147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 0x7fe06412eab0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe05c0032b0 tx=0x7fe05c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.685 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe061ffb700 1 -- 172.21.15.88:0/1573846147 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c00a2c0 con 0x7fe0640a6260 2020-02-11T16:29:35.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0637fe700 1 --2- 172.21.15.88:0/1573846147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 0x7fe06412eab0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe05c0032b0 tx=0x7fe05c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe061ffb700 1 -- 172.21.15.88:0/1573846147 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe05c00a660 con 0x7fe0640a6260 2020-02-11T16:29:35.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0692bd700 1 -- 172.21.15.88:0/1573846147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 msgr2=0x7fe06412eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:35.686 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.670+0000 7fe0692bd700 1 --2- 172.21.15.88:0/1573846147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 0x7fe06412eab0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fe05c0032b0 tx=0x7fe05c008c60).stop 2020-02-11T16:29:35.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.671+0000 7fe0692bd700 1 -- 172.21.15.88:0/1573846147 shutdown_connections 2020-02-11T16:29:35.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.671+0000 7fe0692bd700 1 --2- 172.21.15.88:0/1573846147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0640a6260 0x7fe06412eab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:35.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.671+0000 7fe0692bd700 1 --2- 172.21.15.88:0/1573846147 >> v2:172.21.15.88:3300/0 conn(0x7fe0640a18a0 0x7fe0640a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:35.687 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.671+0000 7fe0692bd700 1 -- 172.21.15.88:0/1573846147 >> 172.21.15.88:0/1573846147 conn(0x7fe06409d110 msgr2=0x7fe06409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:35.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.671+0000 7fe0692bd700 1 -- 172.21.15.88:0/1573846147 shutdown_connections 2020-02-11T16:29:35.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.671+0000 7fe0692bd700 1 -- 172.21.15.88:0/1573846147 wait complete. 2020-02-11T16:29:35.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0692bd700 1 Processor -- start 2020-02-11T16:29:35.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0692bd700 1 -- start start 2020-02-11T16:29:35.688 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0692bd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0640a5de0 0x7fe0641349b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:35.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0692bd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0640a6260 0x7fe064133950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:35.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0692bd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe064135ca0 con 0x7fe0640a18a0 2020-02-11T16:29:35.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0692bd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0640a0b00 con 0x7fe0640a5de0 2020-02-11T16:29:35.689 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0692bd700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0640a0da0 con 0x7fe0640a6260 2020-02-11T16:29:35.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0637fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fe0640a6260 msgr2=0x7fe064133950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:35.690 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0637fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0640a6260 0x7fe064133950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:35.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0627fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0640a5de0 0x7fe0641349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:35.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0627fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0640a5de0 0x7fe0641349b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46626/0 (socket says 172.21.15.88:46626) 2020-02-11T16:29:35.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.672+0000 7fe0627fc700 1 -- 172.21.15.88:0/882341153 learned_addr learned my addr 172.21.15.88:0/882341153 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:35.693 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0627fc700 1 -- 172.21.15.88:0/882341153 >> v2:172.21.15.88:3300/0 conn(0x7fe0640a6260 msgr2=0x7fe064133950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:29:35.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> v2:172.21.15.88:3300/0 conn(0x7fe0640a6260 0x7fe064133950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:35.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0627fc700 1 -- 172.21.15.88:0/882341153 >> v1:172.21.15.52:6789/0 conn(0x7fe0640a18a0 legacy=0x7fe064138640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:35.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0627fc700 1 -- 172.21.15.88:0/882341153 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe064134510 con 0x7fe0640a5de0 2020-02-11T16:29:35.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> v2:172.21.15.52:3300/0 conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> v2:172.21.15.52:3300/0 conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:35.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe05bfff700 1 -- 172.21.15.88:0/882341153 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe05400c930 con 0x7fe0640a5de0 2020-02-11T16:29:35.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe05bfff700 1 -- 172.21.15.88:0/882341153 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05400ca90 con 0x7fe0640a5de0 2020-02-11T16:29:35.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0692bd700 1 -- 172.21.15.88:0/882341153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe064138d50 con 0x7fe0640a5de0 2020-02-11T16:29:35.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe05bfff700 1 -- 172.21.15.88:0/882341153 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe05400ce70 con 0x7fe0640a5de0 2020-02-11T16:29:35.697 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.673+0000 7fe0692bd700 1 -- 172.21.15.88:0/882341153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0640a0820 con 0x7fe0640a5de0 2020-02-11T16:29:35.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.674+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.674+0000 7fe05bfff700 1 -- 172.21.15.88:0/882341153 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe0540055e0 con 0x7fe0640a5de0 2020-02-11T16:29:35.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.674+0000 7fe0692bd700 1 -- 172.21.15.88:0/882341153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0640565b0 con 0x7fe0640a5de0 2020-02-11T16:29:35.698 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.674+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.674+0000 7fe05bfff700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe048039bd0 0x7fe04803c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:35.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.674+0000 7fe05bfff700 1 -- 172.21.15.88:0/882341153 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe0540496d0 con 0x7fe0640a5de0 2020-02-11T16:29:35.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.674+0000 7fe062ffd700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe048039bd0 0x7fe04803c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:35.699 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.674+0000 7fe062ffd700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe048039bd0 0x7fe04803c090 crc :-1 s=READY pgs=534 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:35.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.678+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.700 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.678+0000 7fe05bfff700 1 -- 172.21.15.88:0/882341153 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe05402ecb0 con 0x7fe0640a5de0 2020-02-11T16:29:35.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.878+0000 7fe0692bd700 1 -- 172.21.15.88:0/882341153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe06412d110 con 0x7fe0640a5de0 2020-02-11T16:29:35.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.878+0000 7fe0627fc700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:35.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.878+0000 7fe05bfff700 1 -- 172.21.15.88:0/882341153 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fe0540100b0 con 0x7fe0640a5de0 2020-02-11T16:29:35.881 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:35.882 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 -- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe048039bd0 msgr2=0x7fe04803c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:35.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe048039bd0 0x7fe04803c090 crc :-1 s=READY pgs=534 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:35.883 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 -- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 msgr2=0x7fe0641349b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:35.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 0x7fe0641349b0 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7fe0540010d0 tx=0x7fe054010aa0).stop 2020-02-11T16:29:35.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 -- 172.21.15.88:0/882341153 shutdown_connections 2020-02-11T16:29:35.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 --2- 172.21.15.88:0/882341153 >> v2:172.21.15.88:3300/0 conn(0x7fe0640a6260 0x7fe064133950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:35.885 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe048039bd0 0x7fe04803c090 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:35.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 --2- 172.21.15.88:0/882341153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0640a5de0 0x7fe0641349b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:35.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 -- 172.21.15.88:0/882341153 >> 172.21.15.88:0/882341153 conn(0x7fe06409d110 msgr2=0x7fe0640a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:35.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 -- 172.21.15.88:0/882341153 shutdown_connections 2020-02-11T16:29:35.886 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:35.880+0000 7fe0692bd700 1 -- 172.21.15.88:0/882341153 wait complete. 2020-02-11T16:29:35.892 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":192,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:38.893 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:29:39.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.002+0000 7fe19ecc1700 1 Processor -- start 2020-02-11T16:29:39.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.002+0000 7fe19ecc1700 1 -- start start 2020-02-11T16:29:39.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.002+0000 7fe19ecc1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 0x7fe1980a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:39.011 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.002+0000 7fe19ecc1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 0x7fe19812eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:39.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.002+0000 7fe19ecc1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1980a3570 con 0x7fe1980a5de0 2020-02-11T16:29:39.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.002+0000 7fe19ecc1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1980a3810 con 0x7fe1980a18a0 2020-02-11T16:29:39.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.002+0000 7fe19ecc1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980a3ab0 con 0x7fe1980a6260 2020-02-11T16:29:39.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.002+0000 7fe19ca5d700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 msgr2=0x7fe1980a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:39.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.002+0000 7fe19ca5d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 0x7fe1980a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:39.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe197fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe1980a5de0 0x7fe19812e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40054/0 (socket says 172.21.15.88:40054) 2020-02-11T16:29:39.012 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe197fff700 1 -- 172.21.15.88:0/2427703836 learned_addr learned my addr 172.21.15.88:0/2427703836 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:39.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 --2- 172.21.15.88:0/2427703836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 0x7fe19812eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:39.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 -- 172.21.15.88:0/2427703836 >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 msgr2=0x7fe1980a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:29:39.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 --2- 172.21.15.88:0/2427703836 >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 0x7fe1980a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:39.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 -- 172.21.15.88:0/2427703836 >> v1:172.21.15.52:6789/0 conn(0x7fe1980a5de0 legacy=0x7fe19812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:39.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 -- 172.21.15.88:0/2427703836 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980a3d50 con 0x7fe1980a6260 2020-02-11T16:29:39.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 --2- 172.21.15.88:0/2427703836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 0x7fe19812eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe18c002f30 tx=0x7fe18c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 --2- 172.21.15.88:0/2427703836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 0x7fe19812eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe18c002f30 tx=0x7fe18c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 --2- 172.21.15.88:0/2427703836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 0x7fe19812eab0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fe18c002f30 tx=0x7fe18c0088e0).ready entity=mon.2 client_cookie=6d1ba97bb1bae85c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:39.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 --2- 172.21.15.88:0/2427703836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 0x7fe19812eab0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe18c002f30 tx=0x7fe18c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe1977fe700 1 -- 172.21.15.88:0/2427703836 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18c0116a0 con 0x7fe1980a6260 2020-02-11T16:29:39.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 --2- 172.21.15.88:0/2427703836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 0x7fe19812eab0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe18c002f30 tx=0x7fe18c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19d25e700 1 --2- 172.21.15.88:0/2427703836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 0x7fe19812eab0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe18c002f30 tx=0x7fe18c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe1977fe700 1 -- 172.21.15.88:0/2427703836 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c011800 con 0x7fe1980a6260 2020-02-11T16:29:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe1977fe700 1 -- 172.21.15.88:0/2427703836 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18c011be0 con 0x7fe1980a6260 2020-02-11T16:29:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19ecc1700 1 -- 172.21.15.88:0/2427703836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 msgr2=0x7fe19812eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.003+0000 7fe19ecc1700 1 --2- 172.21.15.88:0/2427703836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 0x7fe19812eab0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fe18c002f30 tx=0x7fe18c0088e0).stop 2020-02-11T16:29:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.004+0000 7fe19ecc1700 1 -- 172.21.15.88:0/2427703836 shutdown_connections 2020-02-11T16:29:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.004+0000 7fe19ecc1700 1 --2- 172.21.15.88:0/2427703836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe1980a6260 0x7fe19812eab0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.004+0000 7fe19ecc1700 1 --2- 172.21.15.88:0/2427703836 >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 0x7fe1980a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:39.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.004+0000 7fe19ecc1700 1 -- 172.21.15.88:0/2427703836 >> 172.21.15.88:0/2427703836 conn(0x7fe19809d110 msgr2=0x7fe19809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:39.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.004+0000 7fe19ecc1700 1 -- 172.21.15.88:0/2427703836 shutdown_connections 2020-02-11T16:29:39.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.004+0000 7fe19ecc1700 1 -- 172.21.15.88:0/2427703836 wait complete. 2020-02-11T16:29:39.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.005+0000 7fe19ecc1700 1 Processor -- start 2020-02-11T16:29:39.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.005+0000 7fe19ecc1700 1 -- start start 2020-02-11T16:29:39.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19ecc1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 0x7fe198135620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:39.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19ecc1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe1980a6260 0x7fe1981281f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:39.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19ecc1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe198138320 con 0x7fe1980a5de0 2020-02-11T16:29:39.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19ecc1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe198138130 con 0x7fe1980a6260 2020-02-11T16:29:39.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19ecc1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1981339f0 con 0x7fe1980a18a0 2020-02-11T16:29:39.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19ca5d700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 msgr2=0x7fe198135620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:39.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19ca5d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 0x7fe198135620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:39.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe1980a6260 0x7fe1981281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:39.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe1980a6260 0x7fe1981281f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46640/0 (socket says 172.21.15.88:46640) 2020-02-11T16:29:39.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 -- 172.21.15.88:0/1896742530 learned_addr learned my addr 172.21.15.88:0/1896742530 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:39.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 -- 172.21.15.88:0/1896742530 >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 msgr2=0x7fe198135620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:29:39.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 0x7fe198135620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:39.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 -- 172.21.15.88:0/1896742530 >> v1:172.21.15.52:6789/0 conn(0x7fe1980a5de0 legacy=0x7fe1981343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:39.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 -- 172.21.15.88:0/1896742530 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe198133c90 con 0x7fe1980a6260 2020-02-11T16:29:39.018 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> v2:172.21.15.52:3300/0 conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> v2:172.21.15.52:3300/0 conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:39.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe195ffb700 1 -- 172.21.15.88:0/1896742530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18c007340 con 0x7fe1980a6260 2020-02-11T16:29:39.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe195ffb700 1 -- 172.21.15.88:0/1896742530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c0074a0 con 0x7fe1980a6260 2020-02-11T16:29:39.019 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19ecc1700 1 -- 172.21.15.88:0/1896742530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe198133f30 con 0x7fe1980a6260 2020-02-11T16:29:39.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe195ffb700 1 -- 172.21.15.88:0/1896742530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18c0058b0 con 0x7fe1980a6260 2020-02-11T16:29:39.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.006+0000 7fe19ecc1700 1 -- 172.21.15.88:0/1896742530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe198135bc0 con 0x7fe1980a6260 2020-02-11T16:29:39.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.007+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.007+0000 7fe19ecc1700 1 -- 172.21.15.88:0/1896742530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1980565b0 con 0x7fe1980a6260 2020-02-11T16:29:39.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.007+0000 7fe195ffb700 1 -- 172.21.15.88:0/1896742530 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe18c005aa0 con 0x7fe1980a6260 2020-02-11T16:29:39.020 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.007+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.007+0000 7fe195ffb700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe178039bc0 0x7fe17803c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:39.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.008+0000 7fe195ffb700 1 -- 172.21.15.88:0/1896742530 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fe18c04a440 con 0x7fe1980a6260 2020-02-11T16:29:39.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.008+0000 7fe19ca5d700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe178039bc0 0x7fe17803c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:39.021 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.008+0000 7fe19ca5d700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe178039bc0 0x7fe17803c080 crc :-1 s=READY pgs=535 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:39.023 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.012+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.024 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.012+0000 7fe195ffb700 1 -- 172.21.15.88:0/1896742530 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe18c032a10 con 0x7fe1980a6260 2020-02-11T16:29:39.227 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.225+0000 7fe19ecc1700 1 -- 172.21.15.88:0/1896742530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe19805ccb0 con 0x7fe1980a6260 2020-02-11T16:29:39.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.225+0000 7fe19d25e700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:39.228 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.225+0000 7fe195ffb700 1 -- 172.21.15.88:0/1896742530 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fe18c0325d0 con 0x7fe1980a6260 2020-02-11T16:29:39.228 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:39.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.229+0000 7fe19ecc1700 1 -- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe178039bc0 msgr2=0x7fe17803c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:39.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.229+0000 7fe19ecc1700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe178039bc0 0x7fe17803c080 crc :-1 s=READY pgs=535 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:39.232 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.229+0000 7fe19ecc1700 1 -- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 msgr2=0x7fe1981281f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:39.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.229+0000 7fe19ecc1700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 0x7fe1981281f0 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7fe198138660 tx=0x7fe1980a1c80).stop 2020-02-11T16:29:39.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.230+0000 7fe19ecc1700 1 -- 172.21.15.88:0/1896742530 shutdown_connections 2020-02-11T16:29:39.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.230+0000 7fe19ecc1700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe178039bc0 0x7fe17803c080 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:39.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.230+0000 7fe19ecc1700 1 --2- 172.21.15.88:0/1896742530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1980a6260 0x7fe1981281f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:39.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.230+0000 7fe19ecc1700 1 --2- 172.21.15.88:0/1896742530 >> v2:172.21.15.88:3300/0 conn(0x7fe1980a18a0 0x7fe198135620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:39.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.230+0000 7fe19ecc1700 1 -- 172.21.15.88:0/1896742530 >> 172.21.15.88:0/1896742530 conn(0x7fe19809d110 msgr2=0x7fe1980a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:39.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.230+0000 7fe19ecc1700 1 -- 172.21.15.88:0/1896742530 shutdown_connections 2020-02-11T16:29:39.235 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:39.230+0000 7fe19ecc1700 1 -- 172.21.15.88:0/1896742530 wait complete. 2020-02-11T16:29:39.245 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":192,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:42.247 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:29:42.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.383+0000 7f209914f700 1 Processor -- start 2020-02-11T16:29:42.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.383+0000 7f209914f700 1 -- start start 2020-02-11T16:29:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.384+0000 7f209914f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 0x7f20941399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:42.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.384+0000 7f209914f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:42.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.384+0000 7f209914f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20941390f0 con 0x7f20940a3ab0 2020-02-11T16:29:42.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.384+0000 7f209914f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20940a75b0 con 0x7f2094139520 2020-02-11T16:29:42.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.384+0000 7f209914f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20940a7850 con 0x7f209412f8f0 2020-02-11T16:29:42.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.384+0000 7f2092d9d700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f20940a3ab0 legacy=0x7f20940a6b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:29:42.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.384+0000 7f209259c700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 msgr2=0x7f20941399b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:42.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.384+0000 7f209259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 0x7f20941399b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:42.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.385+0000 7f209359e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.385+0000 7f209359e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:54986/0 (socket says 172.21.15.88:54986) 2020-02-11T16:29:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.385+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 learned_addr learned my addr 172.21.15.88:0/3292622168 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.385+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:29:42.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.385+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:29:42.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.385+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:42.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.385+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.585+0000 7f2092d9d700 1 -- 172.21.15.88:0/3292622168 >> v1:172.21.15.88:6789/0 conn(0x7f20940a3ab0 legacy=0x7f20940a6b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:29:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.585+0000 7f209259c700 1 -- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 msgr2=0x7f20941399b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.585+0000 7f209259c700 1 --2- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 0x7f20941399b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:29:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.586+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.586+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:29:42.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.586+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:29:42.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.586+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:42.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.586+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:29:42.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.986+0000 7f2092d9d700 1 -- 172.21.15.88:0/3292622168 >> v1:172.21.15.88:6789/0 conn(0x7f20940a3ab0 legacy=0x7f20940a6b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:29:42.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.986+0000 7f209259c700 1 -- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 msgr2=0x7f20941399b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:42.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.986+0000 7f209259c700 1 --2- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 0x7f20941399b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:29:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.987+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.987+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:29:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.987+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:29:42.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.987+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:42.990 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:42.987+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:29:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:43.787+0000 7f209259c700 1 -- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 msgr2=0x7f20941399b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:43.787+0000 7f2092d9d700 1 -- 172.21.15.88:0/3292622168 >> v1:172.21.15.88:6789/0 conn(0x7f20940a3ab0 legacy=0x7f20940a6b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:29:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:43.787+0000 7f209259c700 1 --2- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 0x7f20941399b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:29:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:43.788+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:43.788+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:29:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:43.788+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:29:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:43.788+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:43.788+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:29:45.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:45.388+0000 7f209259c700 1 -- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 msgr2=0x7f20941399b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:45.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:45.388+0000 7f2092d9d700 1 -- 172.21.15.88:0/3292622168 >> v1:172.21.15.88:6789/0 conn(0x7f20940a3ab0 legacy=0x7f20940a6b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:29:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:45.388+0000 7f209259c700 1 --2- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 0x7f20941399b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:29:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:45.389+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:45.389+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:29:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:45.389+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:29:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:45.389+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:29:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:45.389+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:29:46.848 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:29:46.850 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:29:48.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.591+0000 7f209259c700 1 -- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 msgr2=0x7f20941399b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:48.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.591+0000 7f2092d9d700 1 -- 172.21.15.88:0/3292622168 >> v1:172.21.15.88:6789/0 conn(0x7f20940a3ab0 legacy=0x7f20940a6b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:29:48.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.591+0000 7f209259c700 1 --2- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 0x7f20941399b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:29:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 msgr2=0x7f20941399b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:29:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 0x7f20941399b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 >> v1:172.21.15.88:6789/0 conn(0x7f20940a3ab0 legacy=0x7f20940a6b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:29:48.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 -- 172.21.15.88:0/3292622168 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2094139e10 con 0x7f209412f8f0 2020-02-11T16:29:48.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20940a3ef0 tx=0x7f208c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20940a3ef0 tx=0x7f208c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f20940a3ef0 tx=0x7f208c0102b0).ready entity=mon.2 client_cookie=c7360402b9adcd0d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:48.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f20940a3ef0 tx=0x7f208c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f2091d9b700 1 -- 172.21.15.88:0/3292622168 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f208c011e70 con 0x7f209412f8f0 2020-02-11T16:29:48.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f20940a3ef0 tx=0x7f208c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209359e700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f20940a3ef0 tx=0x7f208c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f2091d9b700 1 -- 172.21.15.88:0/3292622168 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c00a350 con 0x7f209412f8f0 2020-02-11T16:29:48.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f2091d9b700 1 -- 172.21.15.88:0/3292622168 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f208c00a6b0 con 0x7f209412f8f0 2020-02-11T16:29:48.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209914f700 1 -- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f209412fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.592+0000 7f209914f700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f20940a3ef0 tx=0x7f208c0102b0).stop 2020-02-11T16:29:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.593+0000 7f209914f700 1 -- 172.21.15.88:0/3292622168 shutdown_connections 2020-02-11T16:29:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.593+0000 7f209914f700 1 --2- 172.21.15.88:0/3292622168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f209412fd60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.593+0000 7f209914f700 1 --2- 172.21.15.88:0/3292622168 >> v2:172.21.15.88:3300/0 conn(0x7f2094139520 0x7f20941399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:29:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.593+0000 7f209914f700 1 -- 172.21.15.88:0/3292622168 >> 172.21.15.88:0/3292622168 conn(0x7f209409d110 msgr2=0x7f209409d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.593+0000 7f209914f700 1 -- 172.21.15.88:0/3292622168 shutdown_connections 2020-02-11T16:29:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.593+0000 7f209914f700 1 -- 172.21.15.88:0/3292622168 wait complete. 2020-02-11T16:29:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.594+0000 7f209914f700 1 Processor -- start 2020-02-11T16:29:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.594+0000 7f209914f700 1 -- start start 2020-02-11T16:29:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f209914f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20940a3ab0 0x7f209409f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f209914f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f2094129360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f209914f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2094135ad0 con 0x7f2094139520 2020-02-11T16:29:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f209914f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20940a0a10 con 0x7f20940a3ab0 2020-02-11T16:29:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f209914f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20940a0710 con 0x7f209412f8f0 2020-02-11T16:29:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f209259c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f2094129360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f2092d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20940a3ab0 0x7f209409f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f209259c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f2094129360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55020/0 (socket says 172.21.15.88:55020) 2020-02-11T16:29:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f209259c700 1 -- 172.21.15.88:0/61125263 learned_addr learned my addr 172.21.15.88:0/61125263 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f2092d9d700 1 -- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 msgr2=0x7f2094129360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f2094129360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f2092d9d700 1 -- 172.21.15.88:0/61125263 >> v1:172.21.15.52:6789/0 conn(0x7f2094139520 legacy=0x7f2094146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f2092d9d700 1 -- 172.21.15.88:0/61125263 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209409f0e0 con 0x7f20940a3ab0 2020-02-11T16:29:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f209259c700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f2094129360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:29:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> v2:172.21.15.52:3300/0 conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> v2:172.21.15.52:3300/0 conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.595+0000 7f2083fff700 1 -- 172.21.15.88:0/61125263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2084009580 con 0x7f20940a3ab0 2020-02-11T16:29:48.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.596+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.596+0000 7f2083fff700 1 -- 172.21.15.88:0/61125263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20840096e0 con 0x7f20940a3ab0 2020-02-11T16:29:48.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.596+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.596+0000 7f209914f700 1 -- 172.21.15.88:0/61125263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2094135d00 con 0x7f20940a3ab0 2020-02-11T16:29:48.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.596+0000 7f2083fff700 1 -- 172.21.15.88:0/61125263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f208400a070 con 0x7f20940a3ab0 2020-02-11T16:29:48.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.596+0000 7f209914f700 1 -- 172.21.15.88:0/61125263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20941361a0 con 0x7f20940a3ab0 2020-02-11T16:29:48.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.596+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.597+0000 7f2083fff700 1 -- 172.21.15.88:0/61125263 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2084003a10 con 0x7f20940a3ab0 2020-02-11T16:29:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.597+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.597+0000 7f209914f700 1 -- 172.21.15.88:0/61125263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20940565b0 con 0x7f20940a3ab0 2020-02-11T16:29:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.597+0000 7f2083fff700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2070039c80 0x7f207003c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.597+0000 7f2083fff700 1 -- 172.21.15.88:0/61125263 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f2084049860 con 0x7f20940a3ab0 2020-02-11T16:29:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.597+0000 7f209259c700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2070039c80 0x7f207003c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.597+0000 7f209259c700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2070039c80 0x7f207003c140 crc :-1 s=READY pgs=536 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.603+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.603+0000 7f2083fff700 1 -- 172.21.15.88:0/61125263 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f208402ed60 con 0x7f20940a3ab0 2020-02-11T16:29:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.802+0000 7f209914f700 1 -- 172.21.15.88:0/61125263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f209405ccb0 con 0x7f20940a3ab0 2020-02-11T16:29:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.803+0000 7f2092d9d700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.803+0000 7f2083fff700 1 -- 172.21.15.88:0/61125263 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f2084031870 con 0x7f20940a3ab0 2020-02-11T16:29:48.806 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":196,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 -- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2070039c80 msgr2=0x7f207003c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2070039c80 0x7f207003c140 crc :-1 s=READY pgs=536 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 -- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 msgr2=0x7f209409f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 0x7f209409f420 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f20840038c0 tx=0x7f2084010950).stop 2020-02-11T16:29:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 -- 172.21.15.88:0/61125263 shutdown_connections 2020-02-11T16:29:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2070039c80 0x7f207003c140 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940a3ab0 0x7f209409f420 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 --2- 172.21.15.88:0/61125263 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f209412f8f0 0x7f2094129360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 -- 172.21.15.88:0/61125263 >> 172.21.15.88:0/61125263 conn(0x7f209409d110 msgr2=0x7f2094129f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 -- 172.21.15.88:0/61125263 shutdown_connections 2020-02-11T16:29:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.804+0000 7f209914f700 1 -- 172.21.15.88:0/61125263 wait complete. 2020-02-11T16:29:48.817 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":196,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:29:48.817 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:29:48.818 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:29:48.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.927+0000 7f6f3f234700 1 Processor -- start 2020-02-11T16:29:48.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.927+0000 7f6f3f234700 1 -- start start 2020-02-11T16:29:48.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.927+0000 7f6f3f234700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 0x7f6f381314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:48.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.927+0000 7f6f3f234700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f380adb40 con 0x7f6f380ad380 2020-02-11T16:29:48.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.927+0000 7f6f3f234700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f38137de0 con 0x7f6f38131920 2020-02-11T16:29:48.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.927+0000 7f6f3f234700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38137bf0 con 0x7f6f380a9130 2020-02-11T16:29:48.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.927+0000 7f6f3d7d1700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f6f38131920 legacy=0x7f6f38131d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:29:48.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.927+0000 7f6f3cfd0700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6f380ad380 0x7f6f38138280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40110/0 (socket says 172.21.15.88:40110) 2020-02-11T16:29:48.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.927+0000 7f6f3cfd0700 1 -- 172.21.15.88:0/110207903 learned_addr learned my addr 172.21.15.88:0/110207903 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:29:48.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.927+0000 7f6f37fff700 1 --2- 172.21.15.88:0/110207903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 0x7f6f381314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:48.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f377fe700 1 -- 172.21.15.88:0/110207903 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802403822 0 0) 0x7f6f380adb40 con 0x7f6f380ad380 2020-02-11T16:29:48.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f377fe700 1 -- 172.21.15.88:0/110207903 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f1c003230 con 0x7f6f380ad380 2020-02-11T16:29:48.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f37fff700 1 -- 172.21.15.88:0/110207903 >> v1:172.21.15.88:6789/0 conn(0x7f6f38131920 legacy=0x7f6f38131d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:29:48.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f37fff700 1 -- 172.21.15.88:0/110207903 >> v1:172.21.15.52:6789/0 conn(0x7f6f380ad380 legacy=0x7f6f38138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.933 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f37fff700 1 -- 172.21.15.88:0/110207903 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380a8e70 con 0x7f6f380a9130 2020-02-11T16:29:48.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f37fff700 1 --2- 172.21.15.88:0/110207903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 0x7f6f381314c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f380aa850 tx=0x7f6f240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f37fff700 1 --2- 172.21.15.88:0/110207903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 0x7f6f381314c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f380aa850 tx=0x7f6f240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f37fff700 1 --2- 172.21.15.88:0/110207903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 0x7f6f381314c0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f6f380aa850 tx=0x7f6f240088e0).ready entity=mon.2 client_cookie=98b71a8bd785b8a9 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:48.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f37fff700 1 --2- 172.21.15.88:0/110207903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 0x7f6f381314c0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f6f380aa850 tx=0x7f6f240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f377fe700 1 -- 172.21.15.88:0/110207903 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f24008e40 con 0x7f6f380a9130 2020-02-11T16:29:48.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f37fff700 1 --2- 172.21.15.88:0/110207903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 0x7f6f381314c0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f6f380aa850 tx=0x7f6f240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f377fe700 1 -- 172.21.15.88:0/110207903 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f240115b0 con 0x7f6f380a9130 2020-02-11T16:29:48.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f37fff700 1 --2- 172.21.15.88:0/110207903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 0x7f6f381314c0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f6f380aa850 tx=0x7f6f240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f377fe700 1 -- 172.21.15.88:0/110207903 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f24011910 con 0x7f6f380a9130 2020-02-11T16:29:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f3f234700 1 -- 172.21.15.88:0/110207903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 msgr2=0x7f6f381314c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.928+0000 7f6f3f234700 1 --2- 172.21.15.88:0/110207903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 0x7f6f381314c0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f6f380aa850 tx=0x7f6f240088e0).stop 2020-02-11T16:29:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.929+0000 7f6f3f234700 1 -- 172.21.15.88:0/110207903 shutdown_connections 2020-02-11T16:29:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.929+0000 7f6f3f234700 1 --2- 172.21.15.88:0/110207903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f380a9130 0x7f6f381314c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.929+0000 7f6f3f234700 1 -- 172.21.15.88:0/110207903 >> 172.21.15.88:0/110207903 conn(0x7f6f3805ac70 msgr2=0x7f6f380ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.929+0000 7f6f3f234700 1 -- 172.21.15.88:0/110207903 shutdown_connections 2020-02-11T16:29:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.929+0000 7f6f3f234700 1 -- 172.21.15.88:0/110207903 wait complete. 2020-02-11T16:29:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.930+0000 7f6f3f234700 1 Processor -- start 2020-02-11T16:29:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.930+0000 7f6f3f234700 1 -- start start 2020-02-11T16:29:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3f234700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f380a9130 0x7f6f38065490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3f234700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f38066870 con 0x7f6f38131920 2020-02-11T16:29:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3f234700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f38066330 con 0x7f6f380ad380 2020-02-11T16:29:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3f234700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f380665d0 con 0x7f6f380a9130 2020-02-11T16:29:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f37fff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f6f380ad380 legacy=0x7f6f38126750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:29:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f380a9130 0x7f6f38065490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f380a9130 0x7f6f38065490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46694/0 (socket says 172.21.15.88:46694) 2020-02-11T16:29:48.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 -- 172.21.15.88:0/2741751130 learned_addr learned my addr 172.21.15.88:0/2741751130 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:48.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 -- 172.21.15.88:0/2741751130 >> v1:172.21.15.88:6789/0 conn(0x7f6f380ad380 legacy=0x7f6f38126750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:29:48.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 -- 172.21.15.88:0/2741751130 >> v1:172.21.15.52:6789/0 conn(0x7f6f38131920 legacy=0x7f6f3814f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 -- 172.21.15.88:0/2741751130 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38137880 con 0x7f6f380a9130 2020-02-11T16:29:48.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 --2- 172.21.15.88:0/2741751130 >> v2:172.21.15.52:3300/0 conn(0x7f6f380a9130 0x7f6f38065490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f2c0010d0 tx=0x7f6f2c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 --2- 172.21.15.88:0/2741751130 >> v2:172.21.15.52:3300/0 conn(0x7f6f380a9130 0x7f6f38065490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f2c0010d0 tx=0x7f6f2c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.942 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f380a9130 0x7f6f38065490 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7f6f2c0010d0 tx=0x7f6f2c010a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f380a9130 0x7f6f38065490 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7f6f2c0010d0 tx=0x7f6f2c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2c005cc0 con 0x7f6f380a9130 2020-02-11T16:29:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.931+0000 7f6f3cfd0700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f380a9130 0x7f6f38065490 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7f6f2c0010d0 tx=0x7f6f2c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f3cfd0700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f380a9130 0x7f6f38065490 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7f6f2c0010d0 tx=0x7f6f2c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c005e20 con 0x7f6f380a9130 2020-02-11T16:29:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f3f234700 1 -- 172.21.15.88:0/2741751130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3812b6c0 con 0x7f6f380a9130 2020-02-11T16:29:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2c0122d0 con 0x7f6f380a9130 2020-02-11T16:29:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f3f234700 1 -- 172.21.15.88:0/2741751130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3812d840 con 0x7f6f380a9130 2020-02-11T16:29:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f3cfd0700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f380a9130 0x7f6f38065490 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7f6f2c0010d0 tx=0x7f6f2c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f3f234700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 0x7f6f3812cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f3f234700 1 -- 172.21.15.88:0/2741751130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3805e2f0 con 0x7f6f38130a00 2020-02-11T16:29:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6f2c012500 con 0x7f6f380a9130 2020-02-11T16:29:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f3cfd0700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f380a9130 0x7f6f38065490 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7f6f2c0010d0 tx=0x7f6f2c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.932+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 0x7f6f3812cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f35ffb700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f20039c20 0x7f6f2003c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6f2c049ad0 con 0x7f6f380a9130 2020-02-11T16:29:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f37fff700 1 -- 172.21.15.88:0/2741751130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f3812cd00 con 0x7f6f38130a00 2020-02-11T16:29:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f3d7d1700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f20039c20 0x7f6f2003c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 0x7f6f3812cec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 0x7f6f3812cec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 0x7f6f3812cec0 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 0x7f6f3812cec0 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f3d7d1700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f20039c20 0x7f6f2003c0e0 crc :-1 s=READY pgs=537 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2400f760 con 0x7f6f38130a00 2020-02-11T16:29:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 0x7f6f3812cec0 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f6f24007150 con 0x7f6f38130a00 2020-02-11T16:29:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 msgr2=0x7f6f3812cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f35ffb700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 0x7f6f3812cec0 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).stop 2020-02-11T16:29:48.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 msgr2=0x7f6f3812cec0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:48.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.933+0000 7f6f35ffb700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f38130a00 0x7f6f3812cec0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.941+0000 7f6f3f234700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 0x7f6f3812f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:48.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.941+0000 7f6f3f234700 1 -- 172.21.15.88:0/2741751130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3812b850 con 0x7f6f3812a950 2020-02-11T16:29:48.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 0x7f6f3812f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:48.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f37fff700 1 -- 172.21.15.88:0/2741751130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6f380565b0 con 0x7f6f3812a950 2020-02-11T16:29:48.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 0x7f6f3812f500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 0x7f6f3812f500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 0x7f6f3812f500 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 0x7f6f3812f500 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2400e690 con 0x7f6f3812a950 2020-02-11T16:29:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f37fff700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 0x7f6f3812f500 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4351 (secure 0 0 0) 0x7f6f2400e7f0 con 0x7f6f3812a950 2020-02-11T16:29:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 msgr2=0x7f6f3812f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f35ffb700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 0x7f6f3812f500 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7f6f240084c0 tx=0x7f6f380a9000).stop 2020-02-11T16:29:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f35ffb700 1 -- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 msgr2=0x7f6f3812f500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.942+0000 7f6f35ffb700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f3812a950 0x7f6f3812f500 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3f234700 1 -- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f20039c20 msgr2=0x7f6f2003c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3f234700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6f20039c20 0x7f6f2003c0e0 crc :-1 s=READY pgs=537 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3f234700 1 -- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f380a9130 msgr2=0x7f6f38065490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3f234700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f380a9130 0x7f6f38065490 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7f6f2c0010d0 tx=0x7f6f2c010a40).stop 2020-02-11T16:29:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3d7d1700 1 -- 172.21.15.88:0/2741751130 reap_dead start 2020-02-11T16:29:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3d7d1700 1 -- 172.21.15.88:0/2741751130 reap_dead start 2020-02-11T16:29:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3f234700 1 -- 172.21.15.88:0/2741751130 shutdown_connections 2020-02-11T16:29:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3f234700 1 --2- 172.21.15.88:0/2741751130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f380a9130 0x7f6f38065490 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3f234700 1 -- 172.21.15.88:0/2741751130 >> 172.21.15.88:0/2741751130 conn(0x7f6f3805ac70 msgr2=0x7f6f3812e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3f234700 1 -- 172.21.15.88:0/2741751130 shutdown_connections 2020-02-11T16:29:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:48.943+0000 7f6f3f234700 1 -- 172.21.15.88:0/2741751130 wait complete. 2020-02-11T16:29:48.954 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:29:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:29:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 196, 2020-02-11T16:29:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:29:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:29:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:29:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2020-02-11T16:29:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:29:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:29:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:29:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:29:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:29:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:29:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:29:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:29:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:29:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:29:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:29:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:29:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:29:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:29:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:29:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:29:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:29:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:29:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:29:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:29:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:29:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:29:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:29:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:29:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:29:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:29:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:29:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:29:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:29:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:29:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:29:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:29:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:29:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:29:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:29:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:29:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:29:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:29:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:48.976 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:29:48.977 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:29:49.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.108+0000 7fc549cf9700 1 Processor -- start 2020-02-11T16:29:49.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.108+0000 7fc549cf9700 1 -- start start 2020-02-11T16:29:49.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc549cf9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5440ad380 0x7fc5440a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:29:49.113 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc549cf9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54413bfe0 con 0x7fc544138280 2020-02-11T16:29:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc549cf9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5440adb40 con 0x7fc544138710 2020-02-11T16:29:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc549cf9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc544137bf0 con 0x7fc5440ad380 2020-02-11T16:29:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc543fff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fc544138710 legacy=0x7fc54413b8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:29:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc5437fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5440ad380 0x7fc5440a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc5437fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5440ad380 0x7fc5440a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46706/0 (socket says 172.21.15.88:46706) 2020-02-11T16:29:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc5437fe700 1 -- 172.21.15.88:0/3011296627 learned_addr learned my addr 172.21.15.88:0/3011296627 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc5437fe700 1 -- 172.21.15.88:0/3011296627 >> v1:172.21.15.88:6789/0 conn(0x7fc544138710 legacy=0x7fc54413b8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:29:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc5437fe700 1 -- 172.21.15.88:0/3011296627 >> v1:172.21.15.52:6789/0 conn(0x7fc544138280 legacy=0x7fc54413b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc5427fc700 1 -- 172.21.15.88:0/3011296627 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164257057 0 0) 0x7fc54413bfe0 con 0x7fc544138280 2020-02-11T16:29:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc5437fe700 1 -- 172.21.15.88:0/3011296627 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544137de0 con 0x7fc5440ad380 2020-02-11T16:29:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3011296627 >> v2:172.21.15.52:3300/0 conn(0x7fc5440ad380 0x7fc5440a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc54413c170 tx=0x7fc5380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3011296627 >> v2:172.21.15.52:3300/0 conn(0x7fc5440ad380 0x7fc5440a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc54413c170 tx=0x7fc5380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.109+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3011296627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440ad380 0x7fc5440a9130 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380088e0).ready entity=mon.0 client_cookie=464fd91faf313053 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3011296627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440ad380 0x7fc5440a9130 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc5427fc700 1 -- 172.21.15.88:0/3011296627 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc538011720 con 0x7fc5440ad380 2020-02-11T16:29:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3011296627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440ad380 0x7fc5440a9130 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc5427fc700 1 -- 172.21.15.88:0/3011296627 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc538011880 con 0x7fc5440ad380 2020-02-11T16:29:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3011296627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440ad380 0x7fc5440a9130 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc5427fc700 1 -- 172.21.15.88:0/3011296627 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc538011c20 con 0x7fc5440ad380 2020-02-11T16:29:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc549cf9700 1 -- 172.21.15.88:0/3011296627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440ad380 msgr2=0x7fc5440a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc549cf9700 1 --2- 172.21.15.88:0/3011296627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440ad380 0x7fc5440a9130 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380088e0).stop 2020-02-11T16:29:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc549cf9700 1 -- 172.21.15.88:0/3011296627 shutdown_connections 2020-02-11T16:29:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc549cf9700 1 --2- 172.21.15.88:0/3011296627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440ad380 0x7fc5440a9130 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc549cf9700 1 -- 172.21.15.88:0/3011296627 >> 172.21.15.88:0/3011296627 conn(0x7fc54405ac70 msgr2=0x7fc5440ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc549cf9700 1 -- 172.21.15.88:0/3011296627 shutdown_connections 2020-02-11T16:29:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.110+0000 7fc549cf9700 1 -- 172.21.15.88:0/3011296627 wait complete. 2020-02-11T16:29:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.111+0000 7fc549cf9700 1 Processor -- start 2020-02-11T16:29:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.111+0000 7fc549cf9700 1 -- start start 2020-02-11T16:29:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc549cf9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc549cf9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc544138280 0x7fc54412f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc549cf9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc544138710 0x7fc5440a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc549cf9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5441450e0 con 0x7fc544138280 2020-02-11T16:29:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc549cf9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc544145380 con 0x7fc544138710 2020-02-11T16:29:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc549cf9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc544145620 con 0x7fc5440ad380 2020-02-11T16:29:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc543fff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fc544138710 msgr2=0x7fc5440a5f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:29:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc543fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc544138710 0x7fc5440a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:29:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc542ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc544138280 0x7fc54412f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc5437fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc542ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc544138280 0x7fc54412f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46714/0 (socket says 172.21.15.88:46714) 2020-02-11T16:29:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc542ffd700 1 -- 172.21.15.88:0/3297503804 learned_addr learned my addr 172.21.15.88:0/3297503804 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:29:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc5437fe700 1 -- 172.21.15.88:0/3297503804 >> v2:172.21.15.88:3300/0 conn(0x7fc544138710 msgr2=0x7fc5440a5f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:29:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3297503804 >> v2:172.21.15.88:3300/0 conn(0x7fc544138710 0x7fc5440a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc5437fe700 1 -- 172.21.15.88:0/3297503804 >> v2:172.21.15.52:3300/0 conn(0x7fc544138280 msgr2=0x7fc54412f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3297503804 >> v2:172.21.15.52:3300/0 conn(0x7fc544138280 0x7fc54412f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc5437fe700 1 -- 172.21.15.88:0/3297503804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54412f630 con 0x7fc5440ad380 2020-02-11T16:29:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> v2:172.21.15.52:3300/0 conn(0x7fc544138280 0x7fc54412f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:29:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.112+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380114d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc538007340 con 0x7fc5440ad380 2020-02-11T16:29:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5380074a0 con 0x7fc5440ad380 2020-02-11T16:29:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc549cf9700 1 -- 172.21.15.88:0/3297503804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5440a7260 con 0x7fc5440ad380 2020-02-11T16:29:49.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5380058b0 con 0x7fc5440ad380 2020-02-11T16:29:49.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc549cf9700 1 -- 172.21.15.88:0/3297503804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5440a6cc0 con 0x7fc5440ad380 2020-02-11T16:29:49.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc549cf9700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 0x7fc54412b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.113+0000 7fc549cf9700 1 -- 172.21.15.88:0/3297503804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54405e2f0 con 0x7fc544136b70 2020-02-11T16:29:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc538005b30 con 0x7fc5440ad380 2020-02-11T16:29:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc5437fe700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380114d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 0x7fc54412b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc540ff9700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc524039bf0 0x7fc52403c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fc53804a2d0 con 0x7fc5440ad380 2020-02-11T16:29:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc543fff700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc524039bf0 0x7fc52403c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc542ffd700 1 -- 172.21.15.88:0/3297503804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc544144f60 con 0x7fc544136b70 2020-02-11T16:29:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 0x7fc54412b9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 0x7fc54412b9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 0x7fc54412b9e0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 0x7fc54412b9e0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc543fff700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc524039bf0 0x7fc52403c0b0 crc :-1 s=READY pgs=538 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc534012890 con 0x7fc544136b70 2020-02-11T16:29:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 0x7fc54412b9e0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.114+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fc5340129f0 con 0x7fc544136b70 2020-02-11T16:29:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.115+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 msgr2=0x7fc54412b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.115+0000 7fc540ff9700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 0x7fc54412b9e0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).stop 2020-02-11T16:29:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.115+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 msgr2=0x7fc54412b9e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.115+0000 7fc540ff9700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc544136b70 0x7fc54412b9e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.123+0000 7fc549cf9700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 0x7fc544148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:29:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.123+0000 7fc549cf9700 1 -- 172.21.15.88:0/3297503804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc544145220 con 0x7fc54412be40 2020-02-11T16:29:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.123+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 0x7fc544148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:29:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.123+0000 7fc542ffd700 1 -- 172.21.15.88:0/3297503804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc5440565b0 con 0x7fc54412be40 2020-02-11T16:29:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.123+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 0x7fc544148410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.123+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 0x7fc544148410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.123+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 0x7fc544148410 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:29:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 0x7fc544148410 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc534010810 con 0x7fc54412be40 2020-02-11T16:29:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc542ffd700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 0x7fc544148410 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:29:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4009 (secure 0 0 0) 0x7fc534003a10 con 0x7fc54412be40 2020-02-11T16:29:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 msgr2=0x7fc544148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc540ff9700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 0x7fc544148410 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).stop 2020-02-11T16:29:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc540ff9700 1 -- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 msgr2=0x7fc544148410 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:29:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc540ff9700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc54412be40 0x7fc544148410 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0x7fc534000b80 tx=0x7fc534011000).stop 2020-02-11T16:29:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc549cf9700 1 -- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc524039bf0 msgr2=0x7fc52403c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc549cf9700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc524039bf0 0x7fc52403c0b0 crc :-1 s=READY pgs=538 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:29:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc549cf9700 1 -- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 msgr2=0x7fc544145ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:29:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc549cf9700 1 --2- 172.21.15.88:0/3297503804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc5440ad380 0x7fc544145ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fc54413c170 tx=0x7fc5380114d0).stop 2020-02-11T16:29:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc543fff700 1 -- 172.21.15.88:0/3297503804 reap_dead start 2020-02-11T16:29:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc543fff700 1 -- 172.21.15.88:0/3297503804 reap_dead start 2020-02-11T16:29:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc549cf9700 1 -- 172.21.15.88:0/3297503804 shutdown_connections 2020-02-11T16:29:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc549cf9700 1 -- 172.21.15.88:0/3297503804 >> 172.21.15.88:0/3297503804 conn(0x7fc54405ac70 msgr2=0x7fc544069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:29:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc549cf9700 1 -- 172.21.15.88:0/3297503804 shutdown_connections 2020-02-11T16:29:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:29:49.124+0000 7fc549cf9700 1 -- 172.21.15.88:0/3297503804 wait complete. 2020-02-11T16:29:49.139 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:29:49.139 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:49.140 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:49.140 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:29:49.140 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 196, 2020-02-11T16:29:49.140 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:29:49.140 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:29:49.140 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:29:49.140 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:49.141 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2020-02-11T16:29:49.141 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:49.141 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:29:49.141 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:29:49.141 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:49.141 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:49.141 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:49.142 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:49.142 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:49.142 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:49.142 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:49.142 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:29:49.142 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:29:49.142 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:49.143 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:49.143 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:49.143 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:49.143 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:49.143 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:49.143 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:49.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.144 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:29:49.144 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:29:49.144 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:29:49.144 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:29:49.144 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:29:49.144 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:29:49.144 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:49.145 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:29:49.145 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:29:49.145 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:29:49.145 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:29:49.145 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:29:49.145 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:29:49.145 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:29:49.146 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:29:49.146 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:29:49.146 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:29:49.146 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:29:49.146 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:49.146 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:29:49.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.147 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:29:49.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.147 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:29:49.147 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:29:49.147 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:49.147 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:49.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.147 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:49.148 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:29:49.148 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:49.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.148 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:49.148 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:29:49.148 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:49.149 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:49.149 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:49.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.149 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:29:49.149 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:29:49.149 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:49.149 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:49.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.150 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:29:49.150 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:29:49.150 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:49.150 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:49.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:29:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:49.151 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:29:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:29:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:29:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:29:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:29:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:29:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:29:49.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:29:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:29:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:29:49.154 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:29:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:29:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:29:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:29:49.155 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:29:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:29:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:29:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:29:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:29:49.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:29:49.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:29:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:29:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:29:49.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:29:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:29:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:29:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:29:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:29:49.159 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:29:49.159 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:29:49.160 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:30:09.161 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:30:09.162 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:30:09.162 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:30:09.162 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:30:09.169 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:30:09.169 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:30:09.169 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:30:09.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.286+0000 7f23b0abc700 1 Processor -- start 2020-02-11T16:30:09.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.286+0000 7f23b0abc700 1 -- start start 2020-02-11T16:30:09.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23b0abc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:09.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23b0abc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0a4350 con 0x7f23ac0a5b20 2020-02-11T16:30:09.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23b0abc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0a3a40 con 0x7f23ac0a2fa0 2020-02-11T16:30:09.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23b0abc700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0a1e60 con 0x7f23ac0a1520 2020-02-11T16:30:09.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23aa59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f23ac0a2fa0 0x7f23ac0a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48370/0 (socket says 172.21.15.88:48370) 2020-02-11T16:30:09.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23aa59c700 1 -- 172.21.15.88:0/4114020840 learned_addr learned my addr 172.21.15.88:0/4114020840 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:09.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23aad9d700 1 --2- 172.21.15.88:0/4114020840 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:09.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23a959a700 1 -- 172.21.15.88:0/4114020840 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236925670 0 0) 0x7f23ac0a4350 con 0x7f23ac0a5b20 2020-02-11T16:30:09.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23a959a700 1 -- 172.21.15.88:0/4114020840 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2390003230 con 0x7f23ac0a5b20 2020-02-11T16:30:09.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23aad9d700 1 -- 172.21.15.88:0/4114020840 >> v1:172.21.15.88:6789/0 conn(0x7f23ac0a2fa0 legacy=0x7f23ac0a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:09.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23aad9d700 1 -- 172.21.15.88:0/4114020840 >> v1:172.21.15.52:6789/0 conn(0x7f23ac0a5b20 legacy=0x7f23ac131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:09.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23aad9d700 1 -- 172.21.15.88:0/4114020840 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0a3ce0 con 0x7f23ac0a1520 2020-02-11T16:30:09.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23aad9d700 1 --2- 172.21.15.88:0/4114020840 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac131990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23a40032b0 tx=0x7f23a4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.287+0000 7f23aad9d700 1 --2- 172.21.15.88:0/4114020840 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac131990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23a40032b0 tx=0x7f23a4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23aad9d700 1 --2- 172.21.15.88:0/4114020840 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac131990 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f23a40032b0 tx=0x7f23a4008c60).ready entity=mon.2 client_cookie=401990221c26582d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:09.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23aad9d700 1 --2- 172.21.15.88:0/4114020840 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac131990 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f23a40032b0 tx=0x7f23a4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23aad9d700 1 --2- 172.21.15.88:0/4114020840 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac131990 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f23a40032b0 tx=0x7f23a4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23a959a700 1 -- 172.21.15.88:0/4114020840 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a4011e60 con 0x7f23ac0a1520 2020-02-11T16:30:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23aad9d700 1 --2- 172.21.15.88:0/4114020840 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac131990 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f23a40032b0 tx=0x7f23a4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23a959a700 1 -- 172.21.15.88:0/4114020840 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a400a160 con 0x7f23ac0a1520 2020-02-11T16:30:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23a959a700 1 -- 172.21.15.88:0/4114020840 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a400a4c0 con 0x7f23ac0a1520 2020-02-11T16:30:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23b0abc700 1 -- 172.21.15.88:0/4114020840 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 msgr2=0x7f23ac131990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23b0abc700 1 --2- 172.21.15.88:0/4114020840 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac131990 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f23a40032b0 tx=0x7f23a4008c60).stop 2020-02-11T16:30:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23b0abc700 1 -- 172.21.15.88:0/4114020840 shutdown_connections 2020-02-11T16:30:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23b0abc700 1 --2- 172.21.15.88:0/4114020840 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac131990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.288+0000 7f23b0abc700 1 -- 172.21.15.88:0/4114020840 >> 172.21.15.88:0/4114020840 conn(0x7f23ac09d110 msgr2=0x7f23ac09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.289+0000 7f23b0abc700 1 -- 172.21.15.88:0/4114020840 shutdown_connections 2020-02-11T16:30:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.289+0000 7f23b0abc700 1 -- 172.21.15.88:0/4114020840 wait complete. 2020-02-11T16:30:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.289+0000 7f23b0abc700 1 Processor -- start 2020-02-11T16:30:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.289+0000 7f23b0abc700 1 -- start start 2020-02-11T16:30:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23b0abc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23b0abc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23ac0a2fa0 0x7f23ac12a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:09.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23b0abc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f23ac0a5b20 0x7f23ac12a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23b0abc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac131df0 con 0x7f23ac0a2fa0 2020-02-11T16:30:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23b0abc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac0a0100 con 0x7f23ac0a5b20 2020-02-11T16:30:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23b0abc700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0a03a0 con 0x7f23ac0a1520 2020-02-11T16:30:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23aad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f23ac0a5b20 0x7f23ac12a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23aa59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23a9d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23ac0a2fa0 0x7f23ac12a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:09.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23aa59c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55074/0 (socket says 172.21.15.88:55074) 2020-02-11T16:30:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23aad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f23ac0a5b20 0x7f23ac12a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60754/0 (socket says 172.21.15.88:60754) 2020-02-11T16:30:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23aa59c700 1 -- 172.21.15.88:0/2701571742 learned_addr learned my addr 172.21.15.88:0/2701571742 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23aad9d700 1 -- 172.21.15.88:0/2701571742 >> v2:172.21.15.88:3300/0 conn(0x7f23ac0a5b20 msgr2=0x7f23ac12a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:30:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23aad9d700 1 -- 172.21.15.88:0/2701571742 >> v2:172.21.15.88:3300/0 conn(0x7f23ac0a5b20 msgr2=0x7f23ac12a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:30:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23aad9d700 1 --2- 172.21.15.88:0/2701571742 >> v2:172.21.15.88:3300/0 conn(0x7f23ac0a5b20 0x7f23ac12a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23aad9d700 1 --2- 172.21.15.88:0/2701571742 >> v2:172.21.15.88:3300/0 conn(0x7f23ac0a5b20 0x7f23ac12a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.290+0000 7f23aa59c700 1 -- 172.21.15.88:0/2701571742 >> v2:172.21.15.88:3300/0 conn(0x7f23ac0a5b20 msgr2=0x7f23ac12a840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:09.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> v2:172.21.15.88:3300/0 conn(0x7f23ac0a5b20 0x7f23ac12a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:09.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 -- 172.21.15.88:0/2701571742 >> v2:172.21.15.52:3300/0 conn(0x7f23ac0a2fa0 msgr2=0x7f23ac12a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:09.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> v2:172.21.15.52:3300/0 conn(0x7f23ac0a2fa0 0x7f23ac12a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:09.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 -- 172.21.15.88:0/2701571742 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0a0640 con 0x7f23ac0a1520 2020-02-11T16:30:09.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:09.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f239b7fe700 1 -- 172.21.15.88:0/2701571742 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f239c005ca0 con 0x7f23ac0a1520 2020-02-11T16:30:09.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f239b7fe700 1 -- 172.21.15.88:0/2701571742 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c005e00 con 0x7f23ac0a1520 2020-02-11T16:30:09.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23b0abc700 1 -- 172.21.15.88:0/2701571742 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac12aca0 con 0x7f23ac0a1520 2020-02-11T16:30:09.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f239b7fe700 1 -- 172.21.15.88:0/2701571742 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f239c0062b0 con 0x7f23ac0a1520 2020-02-11T16:30:09.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23b0abc700 1 -- 172.21.15.88:0/2701571742 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac0a0eb0 con 0x7f23ac0a1520 2020-02-11T16:30:09.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.291+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.292+0000 7f239b7fe700 1 -- 172.21.15.88:0/2701571742 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f239c006520 con 0x7f23ac0a1520 2020-02-11T16:30:09.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.292+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.292+0000 7f239b7fe700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2388039d00 0x7f238803c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:09.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.292+0000 7f239b7fe700 1 -- 172.21.15.88:0/2701571742 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f239c049a50 con 0x7f23ac0a1520 2020-02-11T16:30:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.292+0000 7f23b0abc700 1 -- 172.21.15.88:0/2701571742 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac0565b0 con 0x7f23ac0a1520 2020-02-11T16:30:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.292+0000 7f23a9d9b700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2388039d00 0x7f238803c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.292+0000 7f23a9d9b700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2388039d00 0x7f238803c1c0 crc :-1 s=READY pgs=540 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.297+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.297+0000 7f239b7fe700 1 -- 172.21.15.88:0/2701571742 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f239c02efd0 con 0x7f23ac0a1520 2020-02-11T16:30:09.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.578+0000 7f23b0abc700 1 -- 172.21.15.88:0/2701571742 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f23ac0a07d0 con 0x7f23ac0a1520 2020-02-11T16:30:09.580 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.579+0000 7f23aa59c700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:09.581 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.579+0000 7f239b7fe700 1 -- 172.21.15.88:0/2701571742 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f239c031ae0 con 0x7f23ac0a1520 2020-02-11T16:30:09.581 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":196,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:09.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.580+0000 7f23b0abc700 1 -- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2388039d00 msgr2=0x7f238803c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:09.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.580+0000 7f23b0abc700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2388039d00 0x7f238803c1c0 crc :-1 s=READY pgs=540 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:09.582 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.580+0000 7f23b0abc700 1 -- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 msgr2=0x7f23ac0a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.580+0000 7f23b0abc700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f23ac0a4d40 tx=0x7f239c010900).stop 2020-02-11T16:30:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.580+0000 7f23b0abc700 1 -- 172.21.15.88:0/2701571742 shutdown_connections 2020-02-11T16:30:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.580+0000 7f23b0abc700 1 --2- 172.21.15.88:0/2701571742 >> v2:172.21.15.88:3300/0 conn(0x7f23ac0a5b20 0x7f23ac12a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.580+0000 7f23b0abc700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23ac0a1520 0x7f23ac0a0a50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.580+0000 7f23b0abc700 1 --2- 172.21.15.88:0/2701571742 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2388039d00 0x7f238803c1c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.580+0000 7f23b0abc700 1 --2- 172.21.15.88:0/2701571742 >> v2:172.21.15.52:3300/0 conn(0x7f23ac0a2fa0 0x7f23ac12a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.580+0000 7f23b0abc700 1 -- 172.21.15.88:0/2701571742 >> 172.21.15.88:0/2701571742 conn(0x7f23ac09d110 msgr2=0x7f23ac069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:09.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.581+0000 7f23b0abc700 1 -- 172.21.15.88:0/2701571742 shutdown_connections 2020-02-11T16:30:09.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:09.581+0000 7f23b0abc700 1 -- 172.21.15.88:0/2701571742 wait complete. 2020-02-11T16:30:09.595 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":196,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:12.596 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:30:12.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.749+0000 7fd8b5620700 1 Processor -- start 2020-02-11T16:30:12.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.749+0000 7fd8b5620700 1 -- start start 2020-02-11T16:30:12.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8b5620700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:12.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8b5620700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b013c1a0 con 0x7fd8b00a9730 2020-02-11T16:30:12.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8b5620700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b00a61d0 con 0x7fd8b00a5610 2020-02-11T16:30:12.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8b5620700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b013b3a0 con 0x7fd8b005e8f0 2020-02-11T16:30:12.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8b4e1f700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd8b00a5610 0x7fd8b00a5ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48402/0 (socket says 172.21.15.88:48402) 2020-02-11T16:30:12.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8b4e1f700 1 -- 172.21.15.88:0/3620576589 learned_addr learned my addr 172.21.15.88:0/3620576589 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:12.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:12.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:30:12.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:30:12.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:12.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.750+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:12.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.951+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.951+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:30:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.951+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:30:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.951+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:12.951+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:30:13.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:13.352+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:13.353+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:30:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:13.353+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:30:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:13.353+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:13.353+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:30:14.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:14.154+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:14.154+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:30:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:14.154+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:30:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:14.154+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:14.154+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:30:15.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:15.756+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:15.756+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:30:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:15.756+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:30:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:15.756+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:15.756+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:30:16.927 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:30:16.929 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:30:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.279+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458798620 0 0) 0x7fd8b013c1a0 con 0x7fd8b00a9730 2020-02-11T16:30:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.279+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd89c003230 con 0x7fd8b00a9730 2020-02-11T16:30:17.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 985449480 0 0) 0x7fd89c003230 con 0x7fd8b00a9730 2020-02-11T16:30:17.285 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 msgr2=0x7fd8b013bd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:30:17.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 --2- 172.21.15.88:0/3620576589 >> v2:172.21.15.52:3300/0 conn(0x7fd8b005e8f0 0x7fd8b013bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:17.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 >> v1:172.21.15.88:6789/0 conn(0x7fd8b00a5610 legacy=0x7fd8b00a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:17.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b013b600 con 0x7fd8b00a9730 2020-02-11T16:30:17.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fd8a00016d0 con 0x7fd8b00a9730 2020-02-11T16:30:17.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 >> v1:172.21.15.52:6789/0 conn(0x7fd8b00a9730 legacy=0x7fd8b0066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:17.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd89c003720 0x7fd89c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:17.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 0x7fd89c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:17.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c004db0 0x7fd89c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:17.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b013b3a0 con 0x7fd89c004db0 2020-02-11T16:30:17.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0041c0 con 0x7fd89c003720 2020-02-11T16:30:17.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c00bb80 con 0x7fd89c0044d0 2020-02-11T16:30:17.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 0x7fd89c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c004db0 0x7fd89c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8affff700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd89c003720 0x7fd89c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd89c003720 msgr2=0x7fd89c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:17.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd89c003720 0x7fd89c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:17.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c004db0 msgr2=0x7fd89c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:17.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c004db0 0x7fd89c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:17.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8af7fe700 1 -- 172.21.15.88:0/3620576589 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c003230 con 0x7fd89c0044d0 2020-02-11T16:30:17.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c004db0 0x7fd89c00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:30:17.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8b4e1f700 1 -- 172.21.15.88:0/3620576589 reap_dead start 2020-02-11T16:30:17.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 0x7fd89c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd89c0054a0 tx=0x7fd8a400bc00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 0x7fd89c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd89c0054a0 tx=0x7fd8a400bc00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.282+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 0x7fd89c004950 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fd89c0054a0 tx=0x7fd8a400bc00).ready entity=mon.2 client_cookie=a937eb58079aca34 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:17.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.283+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 0x7fd89c004950 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fd89c0054a0 tx=0x7fd8a400bc00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.283+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 0x7fd89c004950 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fd89c0054a0 tx=0x7fd8a400bc00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.283+0000 7fd8af7fe700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 0x7fd89c004950 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fd89c0054a0 tx=0x7fd8a400bc00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.283+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a4005b40 con 0x7fd89c0044d0 2020-02-11T16:30:17.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.283+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a4005ca0 con 0x7fd89c0044d0 2020-02-11T16:30:17.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.283+0000 7fd8aeffd700 1 -- 172.21.15.88:0/3620576589 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a4010750 con 0x7fd89c0044d0 2020-02-11T16:30:17.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.283+0000 7fd8b5620700 1 -- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 msgr2=0x7fd89c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:17.290 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.283+0000 7fd8b5620700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 0x7fd89c004950 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fd89c0054a0 tx=0x7fd8a400bc00).stop 2020-02-11T16:30:17.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.285+0000 7fd8b5620700 1 -- 172.21.15.88:0/3620576589 shutdown_connections 2020-02-11T16:30:17.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.285+0000 7fd8b5620700 1 --2- 172.21.15.88:0/3620576589 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0044d0 0x7fd89c004950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:17.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.285+0000 7fd8b5620700 1 -- 172.21.15.88:0/3620576589 >> 172.21.15.88:0/3620576589 conn(0x7fd8b00ae440 msgr2=0x7fd8b00ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:17.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.285+0000 7fd8b5620700 1 -- 172.21.15.88:0/3620576589 shutdown_connections 2020-02-11T16:30:17.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.285+0000 7fd8b5620700 1 -- 172.21.15.88:0/3620576589 wait complete. 2020-02-11T16:30:17.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.286+0000 7fd8b5620700 1 Processor -- start 2020-02-11T16:30:17.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.286+0000 7fd8b5620700 1 -- start start 2020-02-11T16:30:17.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b5620700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:17.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b5620700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b0131730 con 0x7fd8b0149260 2020-02-11T16:30:17.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b5620700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b013b080 con 0x7fd89c0044d0 2020-02-11T16:30:17.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b5620700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0132fe0 con 0x7fd8b00a7d80 2020-02-11T16:30:17.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8affff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd89c0044d0 0x7fd8b0148b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48420/0 (socket says 172.21.15.88:48420) 2020-02-11T16:30:17.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8affff700 1 -- 172.21.15.88:0/3711498881 learned_addr learned my addr 172.21.15.88:0/3711498881 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:17.295 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b4e1f700 1 -- 172.21.15.88:0/3711498881 >> v1:172.21.15.88:6789/0 conn(0x7fd89c0044d0 legacy=0x7fd8b0148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:17.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b4e1f700 1 -- 172.21.15.88:0/3711498881 >> v1:172.21.15.52:6789/0 conn(0x7fd8b0149260 legacy=0x7fd8b0126130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:17.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8ad7fa700 1 -- 172.21.15.88:0/3711498881 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108426581 0 0) 0x7fd8b0131730 con 0x7fd8b0149260 2020-02-11T16:30:17.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b4e1f700 1 -- 172.21.15.88:0/3711498881 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b013ab20 con 0x7fd8b00a7d80 2020-02-11T16:30:17.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.287+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.288+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.288+0000 7fd8ad7fa700 1 -- 172.21.15.88:0/3711498881 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a8004870 con 0x7fd8b00a7d80 2020-02-11T16:30:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.288+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.288+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.288+0000 7fd8ad7fa700 1 -- 172.21.15.88:0/3711498881 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a80049d0 con 0x7fd8b00a7d80 2020-02-11T16:30:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.288+0000 7fd8b5620700 1 -- 172.21.15.88:0/3711498881 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b0138e80 con 0x7fd8b00a7d80 2020-02-11T16:30:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.288+0000 7fd8ad7fa700 1 -- 172.21.15.88:0/3711498881 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a8004d70 con 0x7fd8b00a7d80 2020-02-11T16:30:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.288+0000 7fd8b5620700 1 -- 172.21.15.88:0/3711498881 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b0139ff0 con 0x7fd8b00a7d80 2020-02-11T16:30:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.288+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.289+0000 7fd8ad7fa700 1 -- 172.21.15.88:0/3711498881 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd8a8006180 con 0x7fd8b00a7d80 2020-02-11T16:30:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.289+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.289+0000 7fd8ad7fa700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd890039a80 0x7fd89003bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:17.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.289+0000 7fd8b5620700 1 -- 172.21.15.88:0/3711498881 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b0132990 con 0x7fd8b00a7d80 2020-02-11T16:30:17.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.289+0000 7fd8ad7fa700 1 -- 172.21.15.88:0/3711498881 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fd8a8049690 con 0x7fd8b00a7d80 2020-02-11T16:30:17.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.289+0000 7fd8affff700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd890039a80 0x7fd89003bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.289+0000 7fd8affff700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd890039a80 0x7fd89003bf40 crc :-1 s=READY pgs=541 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:17.299 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.296+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.296+0000 7fd8ad7fa700 1 -- 172.21.15.88:0/3711498881 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd8a802ec30 con 0x7fd8b00a7d80 2020-02-11T16:30:17.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.553+0000 7fd8b5620700 1 -- 172.21.15.88:0/3711498881 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd8b00565b0 con 0x7fd8b00a7d80 2020-02-11T16:30:17.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.553+0000 7fd8b4e1f700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.553+0000 7fd8ad7fa700 1 -- 172.21.15.88:0/3711498881 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fd8a80100c0 con 0x7fd8b00a7d80 2020-02-11T16:30:17.555 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":204,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:17.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.555+0000 7fd8b5620700 1 -- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd890039a80 msgr2=0x7fd89003bf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:17.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.555+0000 7fd8b5620700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd890039a80 0x7fd89003bf40 crc :-1 s=READY pgs=541 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:17.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.555+0000 7fd8b5620700 1 -- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 msgr2=0x7fd8b0126840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:17.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.555+0000 7fd8b5620700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fd8b00aa020 tx=0x7fd8a8010ed0).stop 2020-02-11T16:30:17.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.555+0000 7fd8b5620700 1 -- 172.21.15.88:0/3711498881 shutdown_connections 2020-02-11T16:30:17.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.555+0000 7fd8b5620700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd890039a80 0x7fd89003bf40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:17.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.555+0000 7fd8b5620700 1 --2- 172.21.15.88:0/3711498881 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8b00a7d80 0x7fd8b0126840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:17.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.555+0000 7fd8b5620700 1 -- 172.21.15.88:0/3711498881 >> 172.21.15.88:0/3711498881 conn(0x7fd8b00ae440 msgr2=0x7fd8b0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:17.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.555+0000 7fd8b5620700 1 -- 172.21.15.88:0/3711498881 shutdown_connections 2020-02-11T16:30:17.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.555+0000 7fd8b5620700 1 -- 172.21.15.88:0/3711498881 wait complete. 2020-02-11T16:30:17.569 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":204,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:17.569 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:30:17.570 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:30:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.708+0000 7fddb294b700 1 Processor -- start 2020-02-11T16:30:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.708+0000 7fddb294b700 1 -- start start 2020-02-11T16:30:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.708+0000 7fddb294b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.708+0000 7fddb294b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fddac0a6fa0 0x7fddac0a2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.708+0000 7fddb294b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac0a1e80 con 0x7fddac0a2be0 2020-02-11T16:30:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.708+0000 7fddb294b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac0a3700 con 0x7fddac0a6fa0 2020-02-11T16:30:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.708+0000 7fddb294b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0a25c0 con 0x7fddac05c1f0 2020-02-11T16:30:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.709+0000 7fddabfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.709+0000 7fddabfff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55126/0 (socket says 172.21.15.88:55126) 2020-02-11T16:30:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.709+0000 7fddabfff700 1 -- 172.21.15.88:0/3533635377 learned_addr learned my addr 172.21.15.88:0/3533635377 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.709+0000 7fddab7fe700 1 --2- 172.21.15.88:0/3533635377 >> v2:172.21.15.52:3300/0 conn(0x7fddac0a6fa0 0x7fddac0a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.709+0000 7fddabfff700 1 -- 172.21.15.88:0/3533635377 >> v2:172.21.15.52:3300/0 conn(0x7fddac0a6fa0 msgr2=0x7fddac0a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.709+0000 7fddabfff700 1 --2- 172.21.15.88:0/3533635377 >> v2:172.21.15.52:3300/0 conn(0x7fddac0a6fa0 0x7fddac0a2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.709+0000 7fddabfff700 1 -- 172.21.15.88:0/3533635377 >> v1:172.21.15.52:6789/0 conn(0x7fddac0a2be0 legacy=0x7fddac0a52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.709+0000 7fddabfff700 1 -- 172.21.15.88:0/3533635377 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0a2120 con 0x7fddac05c1f0 2020-02-11T16:30:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.709+0000 7fddabfff700 1 --2- 172.21.15.88:0/3533635377 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd9c002f30 tx=0x7fdd9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.711+0000 7fddabfff700 1 --2- 172.21.15.88:0/3533635377 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd9c002f30 tx=0x7fdd9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.711+0000 7fddabfff700 1 --2- 172.21.15.88:0/3533635377 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fdd9c002f30 tx=0x7fdd9c0088e0).ready entity=mon.2 client_cookie=e8bb503620349278 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.711+0000 7fddabfff700 1 --2- 172.21.15.88:0/3533635377 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdd9c002f30 tx=0x7fdd9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.711+0000 7fddabfff700 1 --2- 172.21.15.88:0/3533635377 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdd9c002f30 tx=0x7fdd9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.711+0000 7fddabfff700 1 --2- 172.21.15.88:0/3533635377 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdd9c002f30 tx=0x7fdd9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.711+0000 7fddaaffd700 1 -- 172.21.15.88:0/3533635377 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9c0127c0 con 0x7fddac05c1f0 2020-02-11T16:30:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.711+0000 7fddaaffd700 1 -- 172.21.15.88:0/3533635377 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c012920 con 0x7fddac05c1f0 2020-02-11T16:30:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.711+0000 7fddaaffd700 1 -- 172.21.15.88:0/3533635377 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9c012cc0 con 0x7fddac05c1f0 2020-02-11T16:30:17.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.711+0000 7fddb294b700 1 -- 172.21.15.88:0/3533635377 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 msgr2=0x7fddac0a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:17.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.711+0000 7fddb294b700 1 --2- 172.21.15.88:0/3533635377 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fdd9c002f30 tx=0x7fdd9c0088e0).stop 2020-02-11T16:30:17.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.712+0000 7fddb294b700 1 -- 172.21.15.88:0/3533635377 shutdown_connections 2020-02-11T16:30:17.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.712+0000 7fddb294b700 1 --2- 172.21.15.88:0/3533635377 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fddac05c1f0 0x7fddac0a43e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:17.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.712+0000 7fddb294b700 1 --2- 172.21.15.88:0/3533635377 >> v2:172.21.15.52:3300/0 conn(0x7fddac0a6fa0 0x7fddac0a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:17.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.712+0000 7fddb294b700 1 -- 172.21.15.88:0/3533635377 >> 172.21.15.88:0/3533635377 conn(0x7fddac0ab400 msgr2=0x7fddac0a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:17.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.712+0000 7fddb294b700 1 -- 172.21.15.88:0/3533635377 shutdown_connections 2020-02-11T16:30:17.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.712+0000 7fddb294b700 1 -- 172.21.15.88:0/3533635377 wait complete. 2020-02-11T16:30:17.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.713+0000 7fddb294b700 1 Processor -- start 2020-02-11T16:30:17.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.713+0000 7fddb294b700 1 -- start start 2020-02-11T16:30:17.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddb294b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddac05c1f0 0x7fddac137f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:17.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddb294b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fddac0a6fa0 0x7fddac12c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:17.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddb294b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac1387b0 con 0x7fddac0a2be0 2020-02-11T16:30:17.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddb294b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac138510 con 0x7fddac0a6fa0 2020-02-11T16:30:17.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddb294b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac138a90 con 0x7fddac05c1f0 2020-02-11T16:30:17.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddabfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddac05c1f0 0x7fddac137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddabfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddac05c1f0 0x7fddac137f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60808/0 (socket says 172.21.15.88:60808) 2020-02-11T16:30:17.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddabfff700 1 -- 172.21.15.88:0/2199497362 learned_addr learned my addr 172.21.15.88:0/2199497362 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:17.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddb0ee8700 1 --2- 172.21.15.88:0/2199497362 >> v2:172.21.15.52:3300/0 conn(0x7fddac0a6fa0 0x7fddac12c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddabfff700 1 -- 172.21.15.88:0/2199497362 >> v2:172.21.15.88:3300/0 conn(0x7fddac05c1f0 msgr2=0x7fddac137f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2020-02-11T16:30:17.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddabfff700 1 -- 172.21.15.88:0/2199497362 >> v2:172.21.15.88:3300/0 conn(0x7fddac05c1f0 msgr2=0x7fddac137f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:30:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddabfff700 1 --2- 172.21.15.88:0/2199497362 >> v2:172.21.15.88:3300/0 conn(0x7fddac05c1f0 0x7fddac137f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.714+0000 7fddabfff700 1 --2- 172.21.15.88:0/2199497362 >> v2:172.21.15.88:3300/0 conn(0x7fddac05c1f0 0x7fddac137f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.715+0000 7fddb0ee8700 1 -- 172.21.15.88:0/2199497362 >> v2:172.21.15.88:3300/0 conn(0x7fddac05c1f0 msgr2=0x7fddac137f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.715+0000 7fddb0ee8700 1 --2- 172.21.15.88:0/2199497362 >> v2:172.21.15.88:3300/0 conn(0x7fddac05c1f0 0x7fddac137f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.715+0000 7fddb0ee8700 1 -- 172.21.15.88:0/2199497362 >> v1:172.21.15.52:6789/0 conn(0x7fddac0a2be0 legacy=0x7fddac12bb50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:17.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.715+0000 7fddb0ee8700 1 -- 172.21.15.88:0/2199497362 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac131900 con 0x7fddac0a6fa0 2020-02-11T16:30:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.715+0000 7fddb0ee8700 1 --2- 172.21.15.88:0/2199497362 >> v2:172.21.15.52:3300/0 conn(0x7fddac0a6fa0 0x7fddac12c260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddac12f940 tx=0x7fdda4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.715+0000 7fddb0ee8700 1 --2- 172.21.15.88:0/2199497362 >> v2:172.21.15.52:3300/0 conn(0x7fddac0a6fa0 0x7fddac12c260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddac12f940 tx=0x7fdda4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.715+0000 7fddb0ee8700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac0a6fa0 0x7fddac12c260 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7fddac12f940 tx=0x7fdda4010c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.715+0000 7fddb0ee8700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac0a6fa0 0x7fddac12c260 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fddac12f940 tx=0x7fdda4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.715+0000 7fddb0ee8700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac0a6fa0 0x7fddac12c260 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fddac12f940 tx=0x7fdda4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.715+0000 7fddb0ee8700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac0a6fa0 0x7fddac12c260 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fddac12f940 tx=0x7fdda4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.716+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda40122b0 con 0x7fddac0a6fa0 2020-02-11T16:30:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.716+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda4012410 con 0x7fddac0a6fa0 2020-02-11T16:30:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.716+0000 7fddb294b700 1 -- 172.21.15.88:0/2199497362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac12f2c0 con 0x7fddac0a6fa0 2020-02-11T16:30:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.716+0000 7fddb294b700 1 -- 172.21.15.88:0/2199497362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac1357b0 con 0x7fddac0a6fa0 2020-02-11T16:30:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.716+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda4012830 con 0x7fddac0a6fa0 2020-02-11T16:30:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.717+0000 7fddb0ee8700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac0a6fa0 0x7fddac12c260 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fddac12f940 tx=0x7fdda4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.717+0000 7fddb0ee8700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac0a6fa0 0x7fddac12c260 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fddac12f940 tx=0x7fdda4010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.717+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdda4012990 con 0x7fddac0a6fa0 2020-02-11T16:30:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.717+0000 7fdda97fa700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd8c039e20 0x7fdd8c03c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:17.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.717+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fdda4049fa0 con 0x7fddac0a6fa0 2020-02-11T16:30:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.718+0000 7fddabfff700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd8c039e20 0x7fdd8c03c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.718+0000 7fddb294b700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.718+0000 7fddb294b700 1 -- 172.21.15.88:0/2199497362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac05c630 con 0x7fddac138e30 2020-02-11T16:30:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.718+0000 7fddabfff700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd8c039e20 0x7fdd8c03c2e0 crc :-1 s=READY pgs=542 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.718+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.718+0000 7fddab7fe700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 msgr2=0x7fddac05a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:30:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.718+0000 7fddab7fe700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 msgr2=0x7fddac05a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:30:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.718+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.718+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:17.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.919+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:17.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.919+0000 7fddab7fe700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 msgr2=0x7fddac05a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:30:17.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.919+0000 7fddab7fe700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 msgr2=0x7fddac05a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:30:17.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.919+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:17.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:17.919+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:30:18.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:18.320+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:18.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:18.320+0000 7fddab7fe700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 msgr2=0x7fddac05a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:30:18.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:18.320+0000 7fddab7fe700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 msgr2=0x7fddac05a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:30:18.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:18.320+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:18.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:18.320+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:30:19.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:19.121+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:19.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:19.121+0000 7fddab7fe700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 msgr2=0x7fddac05a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:30:19.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:19.121+0000 7fddab7fe700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 msgr2=0x7fddac05a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:30:19.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:19.121+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:30:19.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:19.121+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:30:19.185 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 3% (307/10097) Checking out files: 4% (404/10097) Checking out files: 5% (505/10097) Checking out files: 5% (561/10097) Checking out files: 6% (606/10097) Checking out files: 7% (707/10097) Checking out files: 7% (772/10097) Checking out files: 8% (808/10097) Checking out files: 9% (909/10097) Checking out files: 9% (969/10097) Checking out files: 10% (1010/10097) Checking out files: 11% (1111/10097) Checking out files: 11% (1155/10097) Checking out files: 12% (1212/10097) Checking out files: 13% (1313/10097) Checking out files: 13% (1346/10097) Checking out files: 14% (1414/10097) Checking out files: 15% (1515/10097) Checking out files: 15% (1550/10097) Checking out files: 16% (1616/10097) Checking out files: 17% (1717/10097) Checking out files: 17% (1755/10097) Checking out files: 18% (1818/10097) Checking out files: 19% (1919/10097) Checking out files: 19% (1961/10097) Checking out files: 20% (2020/10097) Checking out files: 21% (2121/10097) Checking out files: 21% (2183/10097) Checking out files: 22% (2222/10097) Checking out files: 23% (2323/10097) Checking out files: 24% (2424/10097) Checking out files: 24% (2438/10097) Checking out files: 25% (2525/10097) Checking out files: 26% (2626/10097) Checking out files: 26% (2647/10097) Checking out files: 27% (2727/10097) Checking out files: 28% (2828/10097) Checking out files: 28% (2855/10097) Checking out files: 29% (2929/10097) Checking out files: 30% (3030/10097) Checking out files: 30% (3051/10097) Checking out files: 31% (3131/10097) Checking out files: 32% (3232/10097) Checking out files: 32% (3246/10097) Checking out files: 33% (3333/10097) Checking out files: 34% (3433/10097) Checking out files: 34% (3508/10097) Checking out files: 35% (3534/10097) Checking out files: 36% (3635/10097) Checking out files: 37% (3736/10097) Checking out files: 37% (3769/10097) Checking out files: 38% (3837/10097) Checking out files: 39% (3938/10097) Checking out files: 39% (3968/10097) Checking out files: 40% (4039/10097) Checking out files: 40% (4102/10097) Checking out files: 41% (4140/10097) Checking out files: 42% (4241/10097) Checking out files: 43% (4342/10097) Checking out files: 43% (4348/10097) Checking out files: 44% (4443/10097) Checking out files: 45% (4544/10097) Checking out files: 45% (4640/10097) Checking out files: 46% (4645/10097) Checking out files: 47% (4746/10097) Checking out files: 48% (4847/10097) Checking out files: 48% (4908/10097) Checking out files: 49% (4948/10097) Checking out files: 50% (5049/10097) Checking out files: 50% (5123/10097) Checking out files: 51% (5150/10097) Checking out files: 52% (5251/10097) Checking out files: 53% (5352/10097) Checking out files: 53% (5405/10097) Checking out files: 54% (5453/10097) Checking out files: 55% (5554/10097) Checking out files: 56% (5655/10097) Checking out files: 56% (5693/10097) Checking out files: 57% (5756/10097) Checking out files: 58% (5857/10097) Checking out files: 59% (5958/10097) Checking out files: 59% (5960/10097) Checking out files: 60% (6059/10097) Checking out files: 60% (6139/10097) Checking out files: 61% (6160/10097) Checking out files: 62% (6261/10097) Checking out files: 62% (6294/10097) Checking out files: 63% (6362/10097) Checking out files: 64% (6463/10097) Checking out files: 64% (6469/10097) Checking out files: 65% (6564/10097) Checking out files: 65% (6661/10097) Checking out files: 66% (6665/10097) Checking out files: 67% (6765/10097) Checking out files: 67% (6864/10097) Checking out files: 68% (6866/10097) Checking out files: 69% (6967/10097) Checking out files: 70% (7068/10097) Checking out files: 70% (7118/10097) Checking out files: 71% (7169/10097) Checking out files: 72% (7270/10097) Checking out files: 72% (7297/10097) Checking out files: 73% (7371/10097) Checking out files: 74% (7472/10097) Checking out files: 75% (7573/10097) Checking out files: 75% (7591/10097) Checking out files: 76% (7674/10097) Checking out files: 77% (7775/10097) Checking out files: 77% (7856/10097) Checking out files: 78% (7876/10097) Checking out files: 79% (7977/10097) Checking out files: 79% (8058/10097) Checking out files: 80% (8078/10097) Checking out files: 81% (8179/10097) Checking out files: 81% (8262/10097) Checking out files: 82% (8280/10097) Checking out files: 83% (8381/10097) Checking out files: 83% (8449/10097) Checking out files: 84% (8482/10097) Checking out files: 85% (8583/10097) Checking out files: 86% (8684/10097) Checking out files: 86% (8720/10097) Checking out files: 87% (8785/10097) Checking out files: 88% (8886/10097) Checking out files: 89% (8987/10097) Checking out files: 89% (9005/10097) Checking out files: 90% (9088/10097) Checking out files: 91% (9189/10097) Checking out files: 91% (9220/10097) Checking out files: 92% (9290/10097) Checking out files: 93% (9391/10097) Checking out files: 93% (9435/10097) Checking out files: 94% (9492/10097) Checking out files: 95% (9593/10097) Checking out files: 95% (9666/10097) Checking out files: 96% (9694/10097) Checking out files: 97% (9795/10097) Checking out files: 98% (9896/10097) Checking out files: 98% (9901/10097) Checking out files: 99% (9997/10097) Checking out files: 100% (10097/10097) Checking out files: 100% (10097/10097), done. 2020-02-11T16:30:19.247 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 204c175eea msg: blobhash on entity_name_t causes strange badness... should look into that, but avoid for now 2020-02-11T16:30:19.250 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.1 2020-02-11T16:30:19.325 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:19.325 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.2 2020-02-11T16:30:19.325 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.2 2020-02-11T16:30:19.325 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.2 2020-02-11T16:30:19.326 INFO:tasks.workunit.client.0.smithi088.stdout:v0.2 2020-02-11T16:30:20.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.722+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:20.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.722+0000 7fddab7fe700 1 -- 172.21.15.88:0/2199497362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fddac138c90 con 0x7fddac138e30 2020-02-11T16:30:20.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.722+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.722+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.722+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.722+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.722+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda0007530 con 0x7fddac138e30 2020-02-11T16:30:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.723+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.723+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fdda000aeb0 con 0x7fddac138e30 2020-02-11T16:30:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.723+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 msgr2=0x7fddac05a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.723+0000 7fdda97fa700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).stop 2020-02-11T16:30:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.723+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 msgr2=0x7fddac05a640 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.723+0000 7fdda97fa700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac138e30 0x7fddac05a640 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.735+0000 7fddb294b700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 0x7fddac0a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.735+0000 7fddb294b700 1 -- 172.21.15.88:0/2199497362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac138650 con 0x7fddac0a8740 2020-02-11T16:30:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.735+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 0x7fddac0a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fddab7fe700 1 -- 172.21.15.88:0/2199497362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fddac0565b0 con 0x7fddac0a8740 2020-02-11T16:30:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 0x7fddac0a8b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 0x7fddac0a8b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 0x7fddac0a8b50 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 0x7fddac0a8b50 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda0005e60 con 0x7fddac0a8740 2020-02-11T16:30:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fddab7fe700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 0x7fddac0a8b50 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7fdda000e410 con 0x7fddac0a8740 2020-02-11T16:30:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 msgr2=0x7fddac0a8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fdda97fa700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 0x7fddac0a8b50 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).stop 2020-02-11T16:30:20.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fdda97fa700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 msgr2=0x7fddac0a8b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:20.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.736+0000 7fdda97fa700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddac0a8740 0x7fddac0a8b50 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda000c1f0).stop 2020-02-11T16:30:20.740 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:30:20.740 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:30:20.740 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:30:20.740 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:30:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 204, 2020-02-11T16:30:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:30:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:30:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:30:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:30:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2020-02-11T16:30:20.741 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:30:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:30:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:20.742 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:30:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:30:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:20.743 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:30:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:30:20.744 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:30:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:30:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:30:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:30:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:20.745 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:30:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:30:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:30:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:20.746 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:30:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:30:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:30:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:30:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:30:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:30:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.750 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:30:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:30:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:30:20.751 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:30:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.752 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:30:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:30:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:20.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.755 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:20.755 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:30:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:30:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.757 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:30:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:30:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.758 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:30:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:30:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.759 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:30:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.760 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.761 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:30:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.737+0000 7fddb294b700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd8c039e20 msgr2=0x7fdd8c03c2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.737+0000 7fddb294b700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdd8c039e20 0x7fdd8c03c2e0 crc :-1 s=READY pgs=542 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.737+0000 7fddb294b700 1 -- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac0a6fa0 msgr2=0x7fddac12c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.737+0000 7fddb294b700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac0a6fa0 0x7fddac12c260 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7fddac12f940 tx=0x7fdda4010c50).stop 2020-02-11T16:30:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.737+0000 7fddb0ee8700 1 -- 172.21.15.88:0/2199497362 reap_dead start 2020-02-11T16:30:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.737+0000 7fddb294b700 1 -- 172.21.15.88:0/2199497362 shutdown_connections 2020-02-11T16:30:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.737+0000 7fddb294b700 1 --2- 172.21.15.88:0/2199497362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac0a6fa0 0x7fddac12c260 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:20.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.737+0000 7fddb294b700 1 -- 172.21.15.88:0/2199497362 >> 172.21.15.88:0/2199497362 conn(0x7fddac0ab400 msgr2=0x7fddac069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:20.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.738+0000 7fddb294b700 1 -- 172.21.15.88:0/2199497362 shutdown_connections 2020-02-11T16:30:20.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.738+0000 7fddb294b700 1 -- 172.21.15.88:0/2199497362 wait complete. 2020-02-11T16:30:20.764 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:30:20.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.898+0000 7ff634724700 1 Processor -- start 2020-02-11T16:30:20.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.898+0000 7ff634724700 1 -- start start 2020-02-11T16:30:20.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.899+0000 7ff634724700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff62c0a6ff0 0x7ff62c0a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:20.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.899+0000 7ff634724700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff62c0a2870 0x7ff62c13b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:20.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.899+0000 7ff634724700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c0a2cf0 con 0x7ff62c13b640 2020-02-11T16:30:20.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.899+0000 7ff634724700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62c0a8630 con 0x7ff62c0a2870 2020-02-11T16:30:20.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.899+0000 7ff634724700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0a30c0 con 0x7ff62c0a6ff0 2020-02-11T16:30:20.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.899+0000 7ff631cbf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff62c0a2870 0x7ff62c13b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:20.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff62c0a2870 0x7ff62c13b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60826/0 (socket says 172.21.15.88:60826) 2020-02-11T16:30:20.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 -- 172.21.15.88:0/1489597923 learned_addr learned my addr 172.21.15.88:0/1489597923 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:20.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff632cc1700 1 --1- 172.21.15.88:0/1489597923 >> v1:172.21.15.88:6789/0 conn(0x7ff62c13b640 0x7ff62c137c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48452/0 (socket says 172.21.15.88:48452) 2020-02-11T16:30:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff6324c0700 1 --2- 172.21.15.88:0/1489597923 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff62c0a6ff0 0x7ff62c0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff6314be700 1 -- 172.21.15.88:0/1489597923 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143031 0 0) 0x7ff624001450 con 0x7ff62c13b640 2020-02-11T16:30:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff6314be700 1 -- 172.21.15.88:0/1489597923 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff614003230 con 0x7ff62c13b640 2020-02-11T16:30:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 -- 172.21.15.88:0/1489597923 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff62c0a6ff0 msgr2=0x7ff62c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 --2- 172.21.15.88:0/1489597923 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff62c0a6ff0 0x7ff62c0a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 -- 172.21.15.88:0/1489597923 >> v1:172.21.15.88:6789/0 conn(0x7ff62c13b640 legacy=0x7ff62c137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 -- 172.21.15.88:0/1489597923 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c0a2130 con 0x7ff62c0a2870 2020-02-11T16:30:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 --2- 172.21.15.88:0/1489597923 >> v2:172.21.15.88:3300/0 conn(0x7ff62c0a2870 0x7ff62c13b1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff61c002f30 tx=0x7ff61c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 --2- 172.21.15.88:0/1489597923 >> v2:172.21.15.88:3300/0 conn(0x7ff62c0a2870 0x7ff62c13b1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff61c002f30 tx=0x7ff61c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 --2- 172.21.15.88:0/1489597923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c0a2870 0x7ff62c13b1e0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7ff61c002f30 tx=0x7ff61c0088e0).ready entity=mon.1 client_cookie=b1f3bfc62b9a84f5 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 --2- 172.21.15.88:0/1489597923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c0a2870 0x7ff62c13b1e0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7ff61c002f30 tx=0x7ff61c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff6314be700 1 -- 172.21.15.88:0/1489597923 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c011600 con 0x7ff62c0a2870 2020-02-11T16:30:20.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 --2- 172.21.15.88:0/1489597923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c0a2870 0x7ff62c13b1e0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7ff61c002f30 tx=0x7ff61c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff6314be700 1 -- 172.21.15.88:0/1489597923 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c011760 con 0x7ff62c0a2870 2020-02-11T16:30:20.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff631cbf700 1 --2- 172.21.15.88:0/1489597923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c0a2870 0x7ff62c13b1e0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7ff61c002f30 tx=0x7ff61c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff6314be700 1 -- 172.21.15.88:0/1489597923 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c011b40 con 0x7ff62c0a2870 2020-02-11T16:30:20.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff634724700 1 -- 172.21.15.88:0/1489597923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c0a2870 msgr2=0x7ff62c13b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.900+0000 7ff634724700 1 --2- 172.21.15.88:0/1489597923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c0a2870 0x7ff62c13b1e0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7ff61c002f30 tx=0x7ff61c0088e0).stop 2020-02-11T16:30:20.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.901+0000 7ff634724700 1 -- 172.21.15.88:0/1489597923 shutdown_connections 2020-02-11T16:30:20.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.901+0000 7ff634724700 1 --2- 172.21.15.88:0/1489597923 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff62c0a6ff0 0x7ff62c0a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:20.912 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.901+0000 7ff634724700 1 --2- 172.21.15.88:0/1489597923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c0a2870 0x7ff62c13b1e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:20.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.901+0000 7ff634724700 1 -- 172.21.15.88:0/1489597923 >> 172.21.15.88:0/1489597923 conn(0x7ff62c0ac2d0 msgr2=0x7ff62c0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:20.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.901+0000 7ff634724700 1 -- 172.21.15.88:0/1489597923 shutdown_connections 2020-02-11T16:30:20.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.901+0000 7ff634724700 1 -- 172.21.15.88:0/1489597923 wait complete. 2020-02-11T16:30:20.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.902+0000 7ff634724700 1 Processor -- start 2020-02-11T16:30:20.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.902+0000 7ff634724700 1 -- start start 2020-02-11T16:30:20.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff634724700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff62c0a2870 0x7ff62c138790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:20.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff634724700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff62c13b640 0x7ff62c1453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:20.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff634724700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c148f20 con 0x7ff62c0a6ff0 2020-02-11T16:30:20.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff634724700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62c1491c0 con 0x7ff62c0a2870 2020-02-11T16:30:20.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff634724700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62c149460 con 0x7ff62c13b640 2020-02-11T16:30:20.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff631cbf700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff62c0a6ff0 0x7ff62c131620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48460/0 (socket says 172.21.15.88:48460) 2020-02-11T16:30:20.914 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff632cc1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff62c13b640 0x7ff62c1453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:20.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff631cbf700 1 -- 172.21.15.88:0/3636362965 learned_addr learned my addr 172.21.15.88:0/3636362965 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:20.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff6324c0700 1 --2- 172.21.15.88:0/3636362965 >> v2:172.21.15.52:3300/0 conn(0x7ff62c0a2870 0x7ff62c138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:20.915 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff632cc1700 1 -- 172.21.15.88:0/3636362965 >> v2:172.21.15.52:3300/0 conn(0x7ff62c0a2870 msgr2=0x7ff62c138790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff632cc1700 1 --2- 172.21.15.88:0/3636362965 >> v2:172.21.15.52:3300/0 conn(0x7ff62c0a2870 0x7ff62c138790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:20.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff632cc1700 1 -- 172.21.15.88:0/3636362965 >> v1:172.21.15.88:6789/0 conn(0x7ff62c0a6ff0 legacy=0x7ff62c131620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff632cc1700 1 -- 172.21.15.88:0/3636362965 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c1346f0 con 0x7ff62c13b640 2020-02-11T16:30:20.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.903+0000 7ff632cc1700 1 --2- 172.21.15.88:0/3636362965 >> v2:172.21.15.88:3300/0 conn(0x7ff62c13b640 0x7ff62c1453a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6240015e0 tx=0x7ff624010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.904+0000 7ff632cc1700 1 --2- 172.21.15.88:0/3636362965 >> v2:172.21.15.88:3300/0 conn(0x7ff62c13b640 0x7ff62c1453a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6240015e0 tx=0x7ff624010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.904+0000 7ff632cc1700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c13b640 0x7ff62c1453a0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7ff6240015e0 tx=0x7ff624010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:20.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.904+0000 7ff632cc1700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c13b640 0x7ff62c1453a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff6240015e0 tx=0x7ff624010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.904+0000 7ff632cc1700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c13b640 0x7ff62c1453a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff6240015e0 tx=0x7ff624010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.904+0000 7ff632cc1700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c13b640 0x7ff62c1453a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff6240015e0 tx=0x7ff624010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.904+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff624005e80 con 0x7ff62c13b640 2020-02-11T16:30:20.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.904+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff624012460 con 0x7ff62c13b640 2020-02-11T16:30:20.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.904+0000 7ff634724700 1 -- 172.21.15.88:0/3636362965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c148af0 con 0x7ff62c13b640 2020-02-11T16:30:20.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.904+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff624012840 con 0x7ff62c13b640 2020-02-11T16:30:20.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.904+0000 7ff634724700 1 -- 172.21.15.88:0/3636362965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62c131ef0 con 0x7ff62c13b640 2020-02-11T16:30:20.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.905+0000 7ff632cc1700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c13b640 0x7ff62c1453a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff6240015e0 tx=0x7ff624010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.905+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff624012ab0 con 0x7ff62c13b640 2020-02-11T16:30:20.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.905+0000 7ff632cc1700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c13b640 0x7ff62c1453a0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff6240015e0 tx=0x7ff624010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.905+0000 7ff61b7fe700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff60c039cd0 0x7ff60c03c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:20.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.905+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff624049d10 con 0x7ff62c13b640 2020-02-11T16:30:20.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.906+0000 7ff6324c0700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff60c039cd0 0x7ff60c03c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:20.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.906+0000 7ff6324c0700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff60c039cd0 0x7ff60c03c190 crc :-1 s=READY pgs=543 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:20.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.909+0000 7ff634724700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 0x7ff62c0ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:20.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.909+0000 7ff634724700 1 -- 172.21.15.88:0/3636362965 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c05e2f0 con 0x7ff62c145800 2020-02-11T16:30:20.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.909+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 0x7ff62c0ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:20.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.909+0000 7ff631cbf700 1 -- 172.21.15.88:0/3636362965 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff62c145100 con 0x7ff62c145800 2020-02-11T16:30:20.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.909+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 0x7ff62c0ab1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.910+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 0x7ff62c0ab1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.910+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 0x7ff62c0ab1e0 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:20.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.910+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 0x7ff62c0ab1e0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.910+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c007340 con 0x7ff62c145800 2020-02-11T16:30:20.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.910+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 0x7ff62c0ab1e0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.910+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff61c0074a0 con 0x7ff62c145800 2020-02-11T16:30:20.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.910+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 msgr2=0x7ff62c0ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.910+0000 7ff61b7fe700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 0x7ff62c0ab1e0 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).stop 2020-02-11T16:30:20.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.910+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 msgr2=0x7ff62c0ab1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:20.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.910+0000 7ff61b7fe700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c145800 0x7ff62c0ab1e0 secure :-1 s=CLOSED pgs=427 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).stop 2020-02-11T16:30:20.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.919+0000 7ff634724700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 0x7ff62c138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:20.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.919+0000 7ff634724700 1 -- 172.21.15.88:0/3636362965 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c149300 con 0x7ff62c0ab640 2020-02-11T16:30:20.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 0x7ff62c138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:20.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff631cbf700 1 -- 172.21.15.88:0/3636362965 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff62c0a2cf0 con 0x7ff62c0ab640 2020-02-11T16:30:20.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 0x7ff62c138ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 0x7ff62c138ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 0x7ff62c138ff0 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:20.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 0x7ff62c138ff0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c005ea0 con 0x7ff62c0ab640 2020-02-11T16:30:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff631cbf700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 0x7ff62c138ff0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4362 (secure 0 0 0) 0x7ff61c00d610 con 0x7ff62c0ab640 2020-02-11T16:30:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 msgr2=0x7ff62c138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff61b7fe700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 0x7ff62c138ff0 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7ff62c134580 tx=0x7ff62c0ac270).stop 2020-02-11T16:30:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff61b7fe700 1 -- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 msgr2=0x7ff62c138ff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.920+0000 7ff61b7fe700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff62c0ab640 0x7ff62c138ff0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.921+0000 7ff634724700 1 -- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff60c039cd0 msgr2=0x7ff60c03c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.921+0000 7ff634724700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff60c039cd0 0x7ff60c03c190 crc :-1 s=READY pgs=543 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:20.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.921+0000 7ff634724700 1 -- 172.21.15.88:0/3636362965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c13b640 msgr2=0x7ff62c1453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:20.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.921+0000 7ff634724700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c13b640 0x7ff62c1453a0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7ff6240015e0 tx=0x7ff624010bd0).stop 2020-02-11T16:30:20.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.921+0000 7ff632cc1700 1 -- 172.21.15.88:0/3636362965 reap_dead start 2020-02-11T16:30:20.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.921+0000 7ff632cc1700 1 -- 172.21.15.88:0/3636362965 reap_dead start 2020-02-11T16:30:20.931 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:30:20.931 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:20.931 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:20.932 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:30:20.932 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 204, 2020-02-11T16:30:20.932 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:30:20.932 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:30:20.932 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:30:20.932 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:30:20.933 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.933 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2020-02-11T16:30:20.933 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:20.933 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:30:20.933 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:30:20.933 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:20.934 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:20.934 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:20.934 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:20.935 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:20.935 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:20.935 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.935 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:30:20.935 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:30:20.935 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:20.936 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:20.936 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:20.936 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:20.936 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:20.936 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:20.936 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.937 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:30:20.937 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:30:20.937 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:30:20.937 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:30:20.937 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:30:20.938 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:30:20.938 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:20.938 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:20.938 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:30:20.938 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:30:20.939 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:20.939 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:30:20.939 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:20.939 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:20.939 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:20.939 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:20.940 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:20.940 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:20.940 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.940 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:30:20.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.940 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:30:20.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.941 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:20.941 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:20.941 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:20.941 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:20.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.942 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:20.942 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:30:20.943 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.943 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:20.943 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:30:20.944 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.944 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.944 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:30:20.945 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:30:20.945 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:20.945 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:20.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.946 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:30:20.946 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:30:20.947 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:20.947 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:20.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.947 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:20.948 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:30:20.948 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.948 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:20.949 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:30:20.949 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.949 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.949 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.950 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:30:20.950 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:30:20.950 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:20.951 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:20.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.952 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:20.952 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:20.952 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:20.952 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:20.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.953 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:20.954 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:30:20.954 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.955 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:20.955 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:30:20.955 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:20.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.956 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.957 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:30:20.957 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:30:20.957 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:20.957 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:20.958 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.958 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:20.958 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:30:20.959 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:30:20.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.959 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:20.959 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:20.960 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:20.960 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.960 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.960 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:30:20.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.961 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:20.961 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:20.961 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:20.961 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.961 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.962 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:30:20.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.962 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:20.962 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:20.962 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:30:20.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.963 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.963 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:30:20.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.963 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:20.963 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:20.963 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:30:20.964 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.964 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:20.964 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:30:20.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:20.964 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:20.964 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:20.965 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:30:20.965 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.966 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:20.966 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:20.966 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:30:20.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.923+0000 7ff634724700 1 -- 172.21.15.88:0/3636362965 shutdown_connections 2020-02-11T16:30:20.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.923+0000 7ff634724700 1 --2- 172.21.15.88:0/3636362965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff62c13b640 0x7ff62c1453a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:20.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.923+0000 7ff634724700 1 -- 172.21.15.88:0/3636362965 >> 172.21.15.88:0/3636362965 conn(0x7ff62c0ac2d0 msgr2=0x7ff62c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:20.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.923+0000 7ff634724700 1 -- 172.21.15.88:0/3636362965 shutdown_connections 2020-02-11T16:30:20.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:20.923+0000 7ff634724700 1 -- 172.21.15.88:0/3636362965 wait complete. 2020-02-11T16:30:20.969 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:30:21.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.102+0000 7fa0cb91c700 1 Processor -- start 2020-02-11T16:30:21.104 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.103+0000 7fa0cb91c700 1 -- start start 2020-02-11T16:30:21.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.103+0000 7fa0cb91c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:21.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.103+0000 7fa0cb91c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa0c413b6f0 0x7fa0c4142630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:21.107 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.103+0000 7fa0cb91c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c4138360 con 0x7fa0c413b290 2020-02-11T16:30:21.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.103+0000 7fa0cb91c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c4138150 con 0x7fa0c413b6f0 2020-02-11T16:30:21.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.103+0000 7fa0cb91c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4138600 con 0x7fa0c4131f50 2020-02-11T16:30:21.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:21.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c9eb9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa0c413b6f0 0x7fa0c4142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:21.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c9eb9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa0c413b6f0 0x7fa0c4142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46834/0 (socket says 172.21.15.88:46834) 2020-02-11T16:30:21.108 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55168/0 (socket says 172.21.15.88:55168) 2020-02-11T16:30:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c9eb9700 1 -- 172.21.15.88:0/3378627722 learned_addr learned my addr 172.21.15.88:0/3378627722 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c8eb7700 1 --1- 172.21.15.88:0/3378627722 >> v1:172.21.15.52:6789/0 conn(0x7fa0c413b290 0x7fa0c409d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40254/0 (socket says 172.21.15.88:40254) 2020-02-11T16:30:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 -- 172.21.15.88:0/3378627722 >> v2:172.21.15.52:3300/0 conn(0x7fa0c413b6f0 msgr2=0x7fa0c4142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/3378627722 >> v2:172.21.15.52:3300/0 conn(0x7fa0c413b6f0 0x7fa0c4142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 -- 172.21.15.88:0/3378627722 >> v1:172.21.15.52:6789/0 conn(0x7fa0c413b290 legacy=0x7fa0c409d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 -- 172.21.15.88:0/3378627722 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c409d8b0 con 0x7fa0c4131f50 2020-02-11T16:30:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c9eb9700 1 --2- 172.21.15.88:0/3378627722 >> v2:172.21.15.52:3300/0 conn(0x7fa0c413b6f0 0x7fa0c4142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:30:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/3378627722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa0b40010d0 tx=0x7fa0c00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/3378627722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa0b40010d0 tx=0x7fa0c00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/3378627722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c00088e0).ready entity=mon.2 client_cookie=abc7b877db237815 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/3378627722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/3378627722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.104+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/3378627722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.105+0000 7fa0b3fff700 1 -- 172.21.15.88:0/3378627722 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c0008d30 con 0x7fa0c4131f50 2020-02-11T16:30:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.105+0000 7fa0b3fff700 1 -- 172.21.15.88:0/3378627722 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c0008e90 con 0x7fa0c4131f50 2020-02-11T16:30:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.105+0000 7fa0b3fff700 1 -- 172.21.15.88:0/3378627722 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c0011830 con 0x7fa0c4131f50 2020-02-11T16:30:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.106+0000 7fa0cb91c700 1 -- 172.21.15.88:0/3378627722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 msgr2=0x7fa0c405f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.106+0000 7fa0cb91c700 1 --2- 172.21.15.88:0/3378627722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c00088e0).stop 2020-02-11T16:30:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.106+0000 7fa0cb91c700 1 -- 172.21.15.88:0/3378627722 shutdown_connections 2020-02-11T16:30:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.106+0000 7fa0cb91c700 1 --2- 172.21.15.88:0/3378627722 >> v2:172.21.15.52:3300/0 conn(0x7fa0c413b6f0 0x7fa0c4142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.106+0000 7fa0cb91c700 1 --2- 172.21.15.88:0/3378627722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c4131f50 0x7fa0c405f900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.106+0000 7fa0cb91c700 1 -- 172.21.15.88:0/3378627722 >> 172.21.15.88:0/3378627722 conn(0x7fa0c40a7bb0 msgr2=0x7fa0c40a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.106+0000 7fa0cb91c700 1 -- 172.21.15.88:0/3378627722 shutdown_connections 2020-02-11T16:30:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.106+0000 7fa0cb91c700 1 -- 172.21.15.88:0/3378627722 wait complete. 2020-02-11T16:30:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.107+0000 7fa0cb91c700 1 Processor -- start 2020-02-11T16:30:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.107+0000 7fa0cb91c700 1 -- start start 2020-02-11T16:30:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0cb91c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa0c4131f50 0x7fa0c40a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0cb91c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa0c413b290 0x7fa0c40a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0cb91c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c41354c0 con 0x7fa0c40a44d0 2020-02-11T16:30:21.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0cb91c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c409f510 con 0x7fa0c413b290 2020-02-11T16:30:21.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0cb91c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c40a1060 con 0x7fa0c4131f50 2020-02-11T16:30:21.119 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0c96b8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa0c4131f50 0x7fa0c40a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0c96b8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa0c4131f50 0x7fa0c40a07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60850/0 (socket says 172.21.15.88:60850) 2020-02-11T16:30:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0c96b8700 1 -- 172.21.15.88:0/1986957581 learned_addr learned my addr 172.21.15.88:0/1986957581 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209438618 0 0) 0x7fa0c41354c0 con 0x7fa0c40a44d0 2020-02-11T16:30:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0c96b8700 1 -- 172.21.15.88:0/1986957581 >> v2:172.21.15.52:3300/0 conn(0x7fa0c413b290 msgr2=0x7fa0c40a0c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/1986957581 >> v2:172.21.15.52:3300/0 conn(0x7fa0c413b290 0x7fa0c40a0c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0c96b8700 1 -- 172.21.15.88:0/1986957581 >> v1:172.21.15.52:6789/0 conn(0x7fa0c40a44d0 legacy=0x7fa0c41312a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0c96b8700 1 -- 172.21.15.88:0/1986957581 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c409edd0 con 0x7fa0c4131f50 2020-02-11T16:30:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/1986957581 >> v2:172.21.15.88:3300/0 conn(0x7fa0c4131f50 0x7fa0c40a07a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c40600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/1986957581 >> v2:172.21.15.88:3300/0 conn(0x7fa0c4131f50 0x7fa0c40a07a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c40600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.108+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0c4131f50 0x7fa0c40a07a0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c40600c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.109+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0c4131f50 0x7fa0c40a07a0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c40600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.109+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c0007350 con 0x7fa0c4131f50 2020-02-11T16:30:21.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.109+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0c4131f50 0x7fa0c40a07a0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c40600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.109+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0c4131f50 0x7fa0c40a07a0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c40600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.109+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c00074b0 con 0x7fa0c4131f50 2020-02-11T16:30:21.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.109+0000 7fa0cb91c700 1 -- 172.21.15.88:0/1986957581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c409f070 con 0x7fa0c4131f50 2020-02-11T16:30:21.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.109+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c0011bc0 con 0x7fa0c4131f50 2020-02-11T16:30:21.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.109+0000 7fa0cb91c700 1 -- 172.21.15.88:0/1986957581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c40a3600 con 0x7fa0c4131f50 2020-02-11T16:30:21.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.110+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0c4131f50 0x7fa0c40a07a0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c40600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.110+0000 7fa0aa7fc700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 0x7fa0980058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:21.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.110+0000 7fa0aa7fc700 1 -- 172.21.15.88:0/1986957581 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa098005ea0 con 0x7fa098003420 2020-02-11T16:30:21.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.110+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa0c0012060 con 0x7fa0c4131f50 2020-02-11T16:30:21.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.110+0000 7fa0c96b8700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0c4131f50 0x7fa0c40a07a0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c40600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.110+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 0x7fa0980058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:21.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.110+0000 7fa0b27fc700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa0a4039bd0 0x7fa0a403c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:21.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.110+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fa0c004a180 con 0x7fa0c4131f50 2020-02-11T16:30:21.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.110+0000 7fa0c8eb7700 1 -- 172.21.15.88:0/1986957581 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa098006060 con 0x7fa098003420 2020-02-11T16:30:21.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0c9eb9700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa0a4039bd0 0x7fa0a403c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:21.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 0x7fa0980058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 0x7fa0980058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 0x7fa0980058e0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:21.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0c9eb9700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa0a4039bd0 0x7fa0a403c090 crc :-1 s=READY pgs=544 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:21.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 0x7fa0980058e0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b4011250 con 0x7fa098003420 2020-02-11T16:30:21.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 0x7fa0980058e0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa0b400ad40 con 0x7fa098003420 2020-02-11T16:30:21.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 msgr2=0x7fa0980058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0b27fc700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 0x7fa0980058e0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).stop 2020-02-11T16:30:21.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 msgr2=0x7fa0980058e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:21.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.111+0000 7fa0b27fc700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa098003420 0x7fa0980058e0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).stop 2020-02-11T16:30:21.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.125+0000 7fa0aa7fc700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 0x7fa098006890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:21.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.125+0000 7fa0aa7fc700 1 -- 172.21.15.88:0/1986957581 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa098006e50 con 0x7fa0980063e0 2020-02-11T16:30:21.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.125+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 0x7fa098006890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.125+0000 7fa0c8eb7700 1 -- 172.21.15.88:0/1986957581 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa098007010 con 0x7fa0980063e0 2020-02-11T16:30:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.125+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 0x7fa098006890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.125+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 0x7fa098006890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 0x7fa098006890 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 0x7fa098006890 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b4005e30 con 0x7fa0980063e0 2020-02-11T16:30:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0c8eb7700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 0x7fa098006890 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4020 (secure 0 0 0) 0x7fa0b400b2b0 con 0x7fa0980063e0 2020-02-11T16:30:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 msgr2=0x7fa098006890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0b27fc700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 0x7fa098006890 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fa0b4001190 tx=0x7fa0b4010960).stop 2020-02-11T16:30:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0b27fc700 1 -- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 msgr2=0x7fa098006890 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0b27fc700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0980063e0 0x7fa098006890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0aa7fc700 1 -- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa0a4039bd0 msgr2=0x7fa0a403c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0aa7fc700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa0a4039bd0 0x7fa0a403c090 crc :-1 s=READY pgs=544 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0aa7fc700 1 -- 172.21.15.88:0/1986957581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0c4131f50 msgr2=0x7fa0c40a07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0aa7fc700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0c4131f50 0x7fa0c40a07a0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fa0b40010d0 tx=0x7fa0c40600c0).stop 2020-02-11T16:30:21.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0c9eb9700 1 -- 172.21.15.88:0/1986957581 reap_dead start 2020-02-11T16:30:21.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.126+0000 7fa0c9eb9700 1 -- 172.21.15.88:0/1986957581 reap_dead start 2020-02-11T16:30:21.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.128+0000 7fa0aa7fc700 1 -- 172.21.15.88:0/1986957581 shutdown_connections 2020-02-11T16:30:21.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.128+0000 7fa0aa7fc700 1 --2- 172.21.15.88:0/1986957581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0c4131f50 0x7fa0c40a07a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.128+0000 7fa0aa7fc700 1 -- 172.21.15.88:0/1986957581 >> 172.21.15.88:0/1986957581 conn(0x7fa0c40a7bb0 msgr2=0x7fa0c4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:21.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.128+0000 7fa0aa7fc700 1 -- 172.21.15.88:0/1986957581 shutdown_connections 2020-02-11T16:30:21.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.128+0000 7fa0aa7fc700 1 -- 172.21.15.88:0/1986957581 wait complete. 2020-02-11T16:30:21.134 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:30:21.134 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:21.134 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:30:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 204, 2020-02-11T16:30:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:30:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:30:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:30:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:30:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2020-02-11T16:30:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:30:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:30:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:30:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:30:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:21.139 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:21.139 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:21.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.139 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:30:21.139 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:30:21.139 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:30:21.139 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:30:21.140 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:30:21.140 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:30:21.140 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:21.140 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:21.140 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:30:21.140 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:30:21.141 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:21.141 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:30:21.141 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:21.141 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:21.141 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:21.142 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:21.142 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:21.142 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:21.142 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:21.142 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:30:21.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.143 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:30:21.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.143 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:21.143 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:21.143 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:21.143 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:21.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.143 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:21.144 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:30:21.144 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:21.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.144 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:21.144 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:30:21.144 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:21.145 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:21.145 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:21.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.145 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:30:21.145 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:30:21.145 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:21.146 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:21.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.147 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:30:21.147 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:30:21.151 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:21.151 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:21.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.151 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:21.152 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:30:21.152 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:21.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.153 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:21.153 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:30:21.153 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:21.153 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:21.153 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:21.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.154 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:30:21.154 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:30:21.154 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:21.155 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:21.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.156 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:21.156 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:21.156 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:21.156 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:21.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.156 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:21.157 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:30:21.157 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:21.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.157 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:21.157 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:30:21.157 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:21.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:21.158 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:21.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.158 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:30:21.158 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:30:21.158 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:21.159 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:21.159 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:21.159 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:21.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:21.159 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:30:21.159 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:30:21.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.160 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:21.160 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:21.160 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:21.160 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:21.160 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:21.160 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:30:21.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.161 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:21.161 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:21.161 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:21.161 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:21.161 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:21.161 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:30:21.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:21.162 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:21.162 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:21.162 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:30:21.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:21.162 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:21.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:21.163 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:30:21.165 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:30:21.165 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:30:21.296 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.295+0000 7f6aca409700 1 Processor -- start 2020-02-11T16:30:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.295+0000 7f6aca409700 1 -- start start 2020-02-11T16:30:21.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6aca409700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ac40ad380 0x7f6ac40a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:21.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6aca409700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac413bfe0 con 0x7f6ac4138280 2020-02-11T16:30:21.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6aca409700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac40adb40 con 0x7f6ac4138710 2020-02-11T16:30:21.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6aca409700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac4137bf0 con 0x7f6ac40ad380 2020-02-11T16:30:21.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6ac89a6700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6ac4138710 0x7f6ac413b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48490/0 (socket says 172.21.15.88:48490) 2020-02-11T16:30:21.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6ac89a6700 1 -- 172.21.15.88:0/642164550 learned_addr learned my addr 172.21.15.88:0/642164550 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:21.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6ac3fff700 1 --2- 172.21.15.88:0/642164550 >> v2:172.21.15.52:3300/0 conn(0x7f6ac40ad380 0x7f6ac40a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:21.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6ac2ffd700 1 -- 172.21.15.88:0/642164550 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792360375 0 0) 0x7f6ac40adb40 con 0x7f6ac4138710 2020-02-11T16:30:21.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6ac2ffd700 1 -- 172.21.15.88:0/642164550 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab0003230 con 0x7f6ac4138710 2020-02-11T16:30:21.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6ac3fff700 1 -- 172.21.15.88:0/642164550 >> v1:172.21.15.88:6789/0 conn(0x7f6ac4138710 legacy=0x7f6ac413b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6ac2ffd700 1 -- 172.21.15.88:0/642164550 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 810329762 0 0) 0x7f6ab0003230 con 0x7f6ac4138710 2020-02-11T16:30:21.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6ac3fff700 1 -- 172.21.15.88:0/642164550 >> v1:172.21.15.52:6789/0 conn(0x7f6ac4138280 legacy=0x7f6ac413b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6ac3fff700 1 -- 172.21.15.88:0/642164550 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4137de0 con 0x7f6ac40ad380 2020-02-11T16:30:21.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.296+0000 7f6ac3fff700 1 --2- 172.21.15.88:0/642164550 >> v2:172.21.15.52:3300/0 conn(0x7f6ac40ad380 0x7f6ac40a9130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ab80010d0 tx=0x7f6ab40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6ac3fff700 1 --2- 172.21.15.88:0/642164550 >> v2:172.21.15.52:3300/0 conn(0x7f6ac40ad380 0x7f6ac40a9130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ab80010d0 tx=0x7f6ab40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6ac3fff700 1 --2- 172.21.15.88:0/642164550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac40ad380 0x7f6ac40a9130 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7f6ab80010d0 tx=0x7f6ab40088e0).ready entity=mon.0 client_cookie=bf08261063da0f0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:21.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6ac3fff700 1 --2- 172.21.15.88:0/642164550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac40ad380 0x7f6ac40a9130 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f6ab80010d0 tx=0x7f6ab40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6ac2ffd700 1 -- 172.21.15.88:0/642164550 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6abc001a50 con 0x7f6ac40ad380 2020-02-11T16:30:21.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6ac3fff700 1 --2- 172.21.15.88:0/642164550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac40ad380 0x7f6ac40a9130 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f6ab80010d0 tx=0x7f6ab40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6ac2ffd700 1 -- 172.21.15.88:0/642164550 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab4008b40 con 0x7f6ac40ad380 2020-02-11T16:30:21.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6ac3fff700 1 --2- 172.21.15.88:0/642164550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac40ad380 0x7f6ac40a9130 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f6ab80010d0 tx=0x7f6ab40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6aca409700 1 -- 172.21.15.88:0/642164550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac40ad380 msgr2=0x7f6ac40a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6aca409700 1 --2- 172.21.15.88:0/642164550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac40ad380 0x7f6ac40a9130 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7f6ab80010d0 tx=0x7f6ab40088e0).stop 2020-02-11T16:30:21.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6ac2ffd700 1 -- 172.21.15.88:0/642164550 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab4008ea0 con 0x7f6ac40ad380 2020-02-11T16:30:21.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6aca409700 1 -- 172.21.15.88:0/642164550 shutdown_connections 2020-02-11T16:30:21.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6aca409700 1 --2- 172.21.15.88:0/642164550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac40ad380 0x7f6ac40a9130 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6aca409700 1 -- 172.21.15.88:0/642164550 >> 172.21.15.88:0/642164550 conn(0x7f6ac405ac70 msgr2=0x7f6ac40ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:21.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6aca409700 1 -- 172.21.15.88:0/642164550 shutdown_connections 2020-02-11T16:30:21.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.297+0000 7f6aca409700 1 -- 172.21.15.88:0/642164550 wait complete. 2020-02-11T16:30:21.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.298+0000 7f6aca409700 1 Processor -- start 2020-02-11T16:30:21.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.298+0000 7f6aca409700 1 -- start start 2020-02-11T16:30:21.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6aca409700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ac40ad380 0x7f6ac412b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:21.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6aca409700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ac4138280 0x7f6ac412a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:21.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6aca409700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac412b690 con 0x7f6ac4138710 2020-02-11T16:30:21.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6aca409700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac412f510 con 0x7f6ac4138280 2020-02-11T16:30:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6aca409700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac412f7b0 con 0x7f6ac40ad380 2020-02-11T16:30:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6ac37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ac4138280 0x7f6ac412a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6ac37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ac4138280 0x7f6ac412a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46854/0 (socket says 172.21.15.88:46854) 2020-02-11T16:30:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6ac3fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ac40ad380 0x7f6ac412b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6ac37fe700 1 -- 172.21.15.88:0/416113359 learned_addr learned my addr 172.21.15.88:0/416113359 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6ac37fe700 1 -- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ac40ad380 msgr2=0x7f6ac412b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ac40ad380 0x7f6ac412b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6ac37fe700 1 -- 172.21.15.88:0/416113359 >> v1:172.21.15.52:6789/0 conn(0x7f6ac4138710 legacy=0x7f6ac4129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.299+0000 7f6ac17fa700 1 -- 172.21.15.88:0/416113359 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293919187 0 0) 0x7f6ac412b690 con 0x7f6ac4138710 2020-02-11T16:30:21.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac37fe700 1 -- 172.21.15.88:0/416113359 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac40671e0 con 0x7f6ac4138280 2020-02-11T16:30:21.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> v2:172.21.15.52:3300/0 conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> v2:172.21.15.52:3300/0 conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:21.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac17fa700 1 -- 172.21.15.88:0/416113359 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab800cc20 con 0x7f6ac4138280 2020-02-11T16:30:21.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6aca409700 1 -- 172.21.15.88:0/416113359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac412fc50 con 0x7f6ac4138280 2020-02-11T16:30:21.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac17fa700 1 -- 172.21.15.88:0/416113359 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab800cd80 con 0x7f6ac4138280 2020-02-11T16:30:21.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac17fa700 1 -- 172.21.15.88:0/416113359 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab8012380 con 0x7f6ac4138280 2020-02-11T16:30:21.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6aca409700 1 -- 172.21.15.88:0/416113359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac4137a00 con 0x7f6ac4138280 2020-02-11T16:30:21.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.300+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.301+0000 7f6ac17fa700 1 -- 172.21.15.88:0/416113359 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f6ab8012600 con 0x7f6ac4138280 2020-02-11T16:30:21.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.301+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.301+0000 7f6aca409700 1 -- 172.21.15.88:0/416113359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac40565b0 con 0x7f6ac4138280 2020-02-11T16:30:21.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.301+0000 7f6ac17fa700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6aa4039a90 0x7f6aa403bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:21.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.301+0000 7f6ac17fa700 1 -- 172.21.15.88:0/416113359 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f6ab8013060 con 0x7f6ac4138280 2020-02-11T16:30:21.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.301+0000 7f6ac3fff700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6aa4039a90 0x7f6aa403bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:21.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.301+0000 7f6ac3fff700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6aa4039a90 0x7f6aa403bf50 crc :-1 s=READY pgs=545 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:21.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.306+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.306+0000 7f6ac17fa700 1 -- 172.21.15.88:0/416113359 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f6ab802eee0 con 0x7f6ac4138280 2020-02-11T16:30:21.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.540+0000 7f6aca409700 1 -- 172.21.15.88:0/416113359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f6ac40a5350 con 0x7f6ac4138280 2020-02-11T16:30:21.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.541+0000 7f6ac37fe700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:21.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.541+0000 7f6ac17fa700 1 -- 172.21.15.88:0/416113359 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f6ab80319b0 con 0x7f6ac4138280 2020-02-11T16:30:21.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 -- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6aa4039a90 msgr2=0x7f6aa403bf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6aa4039a90 0x7f6aa403bf50 crc :-1 s=READY pgs=545 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 -- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 msgr2=0x7f6ac412a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:21.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 0x7f6ac412a470 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7f6ab8001190 tx=0x7f6ab8010af0).stop 2020-02-11T16:30:21.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 -- 172.21.15.88:0/416113359 shutdown_connections 2020-02-11T16:30:21.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ac40ad380 0x7f6ac412b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f6aa4039a90 0x7f6aa403bf50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 --2- 172.21.15.88:0/416113359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac4138280 0x7f6ac412a470 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:21.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 -- 172.21.15.88:0/416113359 >> 172.21.15.88:0/416113359 conn(0x7f6ac405ac70 msgr2=0x7f6ac4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:21.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 -- 172.21.15.88:0/416113359 shutdown_connections 2020-02-11T16:30:21.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:21.543+0000 7f6aca409700 1 -- 172.21.15.88:0/416113359 wait complete. 2020-02-11T16:30:21.557 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:30:21.578 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 64% (144/222) Checking out files: 65% (145/222) Checking out files: 66% (147/222) Checking out files: 67% (149/222) Checking out files: 68% (151/222) Checking out files: 69% (154/222) Checking out files: 70% (156/222) Checking out files: 71% (158/222) Checking out files: 72% (160/222) Checking out files: 73% (163/222) Checking out files: 74% (165/222) Checking out files: 75% (167/222) Checking out files: 76% (169/222) Checking out files: 77% (171/222) Checking out files: 78% (174/222) Checking out files: 79% (176/222) Checking out files: 80% (178/222) Checking out files: 81% (180/222) Checking out files: 82% (183/222) Checking out files: 83% (185/222) Checking out files: 84% (187/222) Checking out files: 85% (189/222) Checking out files: 86% (191/222) Checking out files: 87% (194/222) Checking out files: 88% (196/222) Checking out files: 89% (198/222) Checking out files: 90% (200/222) Checking out files: 91% (203/222) Checking out files: 92% (205/222) Checking out files: 93% (207/222) Checking out files: 94% (209/222) Checking out files: 95% (211/222) Checking out files: 96% (214/222) Checking out files: 97% (216/222) Checking out files: 98% (218/222) Checking out files: 99% (220/222) Checking out files: 100% (222/222) Checking out files: 100% (222/222), done. 2020-02-11T16:30:21.785 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 2b5f76f48e readme 2020-02-11T16:30:21.788 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.2 2020-02-11T16:30:21.911 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:21.911 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.3 2020-02-11T16:30:21.912 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.3 2020-02-11T16:30:21.912 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.3 2020-02-11T16:30:21.912 INFO:tasks.workunit.client.0.smithi088.stdout:v0.3 2020-02-11T16:30:24.428 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 44% (132/295) Checking out files: 45% (133/295) Checking out files: 46% (136/295) Checking out files: 47% (139/295) Checking out files: 48% (142/295) Checking out files: 49% (145/295) Checking out files: 50% (148/295) Checking out files: 51% (151/295) Checking out files: 52% (154/295) Checking out files: 53% (157/295) Checking out files: 54% (160/295) Checking out files: 55% (163/295) Checking out files: 56% (166/295) Checking out files: 57% (169/295) Checking out files: 58% (172/295) Checking out files: 59% (175/295) Checking out files: 60% (177/295) Checking out files: 61% (180/295) Checking out files: 62% (183/295) Checking out files: 63% (186/295) Checking out files: 64% (189/295) Checking out files: 65% (192/295) Checking out files: 66% (195/295) Checking out files: 67% (198/295) Checking out files: 68% (201/295) Checking out files: 69% (204/295) Checking out files: 70% (207/295) Checking out files: 71% (210/295) Checking out files: 72% (213/295) Checking out files: 73% (216/295) Checking out files: 74% (219/295) Checking out files: 75% (222/295) Checking out files: 76% (225/295) Checking out files: 77% (228/295) Checking out files: 78% (231/295) Checking out files: 79% (234/295) Checking out files: 80% (236/295) Checking out files: 81% (239/295) Checking out files: 82% (242/295) Checking out files: 83% (245/295) Checking out files: 84% (248/295) Checking out files: 85% (251/295) Checking out files: 86% (254/295) Checking out files: 87% (257/295) Checking out files: 88% (260/295) Checking out files: 89% (263/295) Checking out files: 90% (266/295) Checking out files: 91% (269/295) Checking out files: 92% (272/295) Checking out files: 93% (275/295) Checking out files: 94% (278/295) Checking out files: 95% (281/295) Checking out files: 96% (284/295) Checking out files: 97% (287/295) Checking out files: 98% (290/295) Checking out files: 99% (293/295) Checking out files: 100% (295/295) Checking out files: 100% (295/295), done. 2020-02-11T16:30:24.483 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 2e986fe9dd include ceph.spec in configure.ac 2020-02-11T16:30:24.486 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.3 2020-02-11T16:30:24.744 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:24.744 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.4 2020-02-11T16:30:24.744 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.4 2020-02-11T16:30:24.745 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.4 2020-02-11T16:30:24.745 INFO:tasks.workunit.client.0.smithi088.stdout:v0.4 2020-02-11T16:30:27.031 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 61% (153/247) Checking out files: 62% (154/247) Checking out files: 63% (156/247) Checking out files: 64% (159/247) Checking out files: 65% (161/247) Checking out files: 66% (164/247) Checking out files: 67% (166/247) Checking out files: 68% (168/247) Checking out files: 69% (171/247) Checking out files: 70% (173/247) Checking out files: 71% (176/247) Checking out files: 72% (178/247) Checking out files: 73% (181/247) Checking out files: 74% (183/247) Checking out files: 75% (186/247) Checking out files: 76% (188/247) Checking out files: 77% (191/247) Checking out files: 78% (193/247) Checking out files: 79% (196/247) Checking out files: 80% (198/247) Checking out files: 81% (201/247) Checking out files: 82% (203/247) Checking out files: 83% (206/247) Checking out files: 84% (208/247) Checking out files: 85% (210/247) Checking out files: 86% (213/247) Checking out files: 87% (215/247) Checking out files: 88% (218/247) Checking out files: 89% (220/247) Checking out files: 90% (223/247) Checking out files: 91% (225/247) Checking out files: 92% (228/247) Checking out files: 93% (230/247) Checking out files: 94% (233/247) Checking out files: 95% (235/247) Checking out files: 96% (238/247) Checking out files: 97% (240/247) Checking out files: 98% (243/247) Checking out files: 99% (245/247) Checking out files: 100% (247/247) Checking out files: 100% (247/247), done. 2020-02-11T16:30:27.110 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 13b1bf7c49 kclient: initializing kaddr (merge fix) 2020-02-11T16:30:27.113 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.4 2020-02-11T16:30:27.190 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:27.190 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.5 2020-02-11T16:30:27.190 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.5 2020-02-11T16:30:27.190 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.5 2020-02-11T16:30:27.191 INFO:tasks.workunit.client.0.smithi088.stdout:v0.5 2020-02-11T16:30:29.343 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 63% (156/245) Checking out files: 64% (157/245) Checking out files: 65% (160/245) Checking out files: 66% (162/245) Checking out files: 67% (165/245) Checking out files: 68% (167/245) Checking out files: 69% (170/245) Checking out files: 70% (172/245) Checking out files: 71% (174/245) Checking out files: 72% (177/245) Checking out files: 73% (179/245) Checking out files: 74% (182/245) Checking out files: 75% (184/245) Checking out files: 76% (187/245) Checking out files: 77% (189/245) Checking out files: 78% (192/245) Checking out files: 79% (194/245) Checking out files: 80% (196/245) Checking out files: 81% (199/245) Checking out files: 82% (201/245) Checking out files: 83% (204/245) Checking out files: 84% (206/245) Checking out files: 85% (209/245) Checking out files: 86% (211/245) Checking out files: 87% (214/245) Checking out files: 88% (216/245) Checking out files: 89% (219/245) Checking out files: 90% (221/245) Checking out files: 91% (223/245) Checking out files: 92% (226/245) Checking out files: 93% (228/245) Checking out files: 94% (231/245) Checking out files: 95% (233/245) Checking out files: 96% (236/245) Checking out files: 97% (238/245) Checking out files: 98% (241/245) Checking out files: 99% (243/245) Checking out files: 100% (245/245) Checking out files: 100% (245/245), done. 2020-02-11T16:30:29.413 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 1dd420957f journal: detect size of raw block devices properly 2020-02-11T16:30:29.417 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.5 2020-02-11T16:30:29.687 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:29.687 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.6 2020-02-11T16:30:29.687 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.6 2020-02-11T16:30:29.687 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.6 2020-02-11T16:30:29.688 INFO:tasks.workunit.client.0.smithi088.stdout:v0.6 2020-02-11T16:30:31.558 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:30:31.558 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:30:31.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.687+0000 7f377c931700 1 Processor -- start 2020-02-11T16:30:31.694 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.687+0000 7f377c931700 1 -- start start 2020-02-11T16:30:31.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f377c931700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37780a4ce0 0x7f37780a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:31.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f377c931700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f377809e840 0x7f37780a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:31.695 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f377c931700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3778066af0 con 0x7f377805fc80 2020-02-11T16:30:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f377c931700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37780a5a30 con 0x7f377809e840 2020-02-11T16:30:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f377c931700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37780a5180 con 0x7f37780a4ce0 2020-02-11T16:30:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f3776d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f377809e840 0x7f37780a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f3776d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f377809e840 0x7f37780a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60878/0 (socket says 172.21.15.88:60878) 2020-02-11T16:30:31.696 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f3776d9d700 1 -- 172.21.15.88:0/285803399 learned_addr learned my addr 172.21.15.88:0/285803399 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:31.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f376ffff700 1 --2- 172.21.15.88:0/285803399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37780a4ce0 0x7f37780a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:31.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f3776d9d700 1 -- 172.21.15.88:0/285803399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37780a4ce0 msgr2=0x7f37780a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:31.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f3776d9d700 1 --2- 172.21.15.88:0/285803399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37780a4ce0 0x7f37780a4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:31.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f3776d9d700 1 -- 172.21.15.88:0/285803399 >> v1:172.21.15.52:6789/0 conn(0x7f377805fc80 legacy=0x7f37780a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:31.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f3776d9d700 1 -- 172.21.15.88:0/285803399 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780a5420 con 0x7f377809e840 2020-02-11T16:30:31.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.688+0000 7f376ffff700 1 --2- 172.21.15.88:0/285803399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37780a4ce0 0x7f37780a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:30:31.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f3776d9d700 1 --2- 172.21.15.88:0/285803399 >> v2:172.21.15.88:3300/0 conn(0x7f377809e840 0x7f37780a44b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f37700032b0 tx=0x7f3770008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f3776d9d700 1 --2- 172.21.15.88:0/285803399 >> v2:172.21.15.88:3300/0 conn(0x7f377809e840 0x7f37780a44b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f37700032b0 tx=0x7f3770008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f3776d9d700 1 --2- 172.21.15.88:0/285803399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f377809e840 0x7f37780a44b0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f37700032b0 tx=0x7f3770008c60).ready entity=mon.1 client_cookie=c0dc2a356940a8a2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:31.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f3776d9d700 1 --2- 172.21.15.88:0/285803399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f377809e840 0x7f37780a44b0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f37700032b0 tx=0x7f3770008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.703 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f3775d9b700 1 -- 172.21.15.88:0/285803399 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f377000a160 con 0x7f377809e840 2020-02-11T16:30:31.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f3776d9d700 1 --2- 172.21.15.88:0/285803399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f377809e840 0x7f37780a44b0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f37700032b0 tx=0x7f3770008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f3776d9d700 1 --2- 172.21.15.88:0/285803399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f377809e840 0x7f37780a44b0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f37700032b0 tx=0x7f3770008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f3775d9b700 1 -- 172.21.15.88:0/285803399 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377000a2c0 con 0x7f377809e840 2020-02-11T16:30:31.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f3775d9b700 1 -- 172.21.15.88:0/285803399 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f377000a6a0 con 0x7f377809e840 2020-02-11T16:30:31.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f377c931700 1 -- 172.21.15.88:0/285803399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f377809e840 msgr2=0x7f37780a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:31.704 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.689+0000 7f377c931700 1 --2- 172.21.15.88:0/285803399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f377809e840 0x7f37780a44b0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f37700032b0 tx=0x7f3770008c60).stop 2020-02-11T16:30:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.690+0000 7f377c931700 1 -- 172.21.15.88:0/285803399 shutdown_connections 2020-02-11T16:30:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.690+0000 7f377c931700 1 --2- 172.21.15.88:0/285803399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f377809e840 0x7f37780a44b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.690+0000 7f377c931700 1 --2- 172.21.15.88:0/285803399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37780a4ce0 0x7f37780a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.690+0000 7f377c931700 1 -- 172.21.15.88:0/285803399 >> 172.21.15.88:0/285803399 conn(0x7f37780a7bb0 msgr2=0x7f37780a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.690+0000 7f377c931700 1 -- 172.21.15.88:0/285803399 shutdown_connections 2020-02-11T16:30:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.690+0000 7f377c931700 1 -- 172.21.15.88:0/285803399 wait complete. 2020-02-11T16:30:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.691+0000 7f377c931700 1 Processor -- start 2020-02-11T16:30:31.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.691+0000 7f377c931700 1 -- start start 2020-02-11T16:30:31.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.691+0000 7f377c931700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f377805fc80 0x7f3778066150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:31.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.691+0000 7f377c931700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:31.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.691+0000 7f377c931700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3778145440 con 0x7f37780a4ce0 2020-02-11T16:30:31.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.691+0000 7f377c931700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37781456a0 con 0x7f377805fc80 2020-02-11T16:30:31.706 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.691+0000 7f377c931700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3778145940 con 0x7f377809e840 2020-02-11T16:30:31.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:31.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f377659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f377805fc80 0x7f3778066150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:31.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55206/0 (socket says 172.21.15.88:55206) 2020-02-11T16:30:31.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 -- 172.21.15.88:0/564151381 learned_addr learned my addr 172.21.15.88:0/564151381 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:31.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 -- 172.21.15.88:0/564151381 >> v2:172.21.15.52:3300/0 conn(0x7f377805fc80 msgr2=0x7f3778066150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:31.707 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> v2:172.21.15.52:3300/0 conn(0x7f377805fc80 0x7f3778066150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:31.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 -- 172.21.15.88:0/564151381 >> v1:172.21.15.52:6789/0 conn(0x7f37780a4ce0 legacy=0x7f37780649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:31.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 -- 172.21.15.88:0/564151381 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778145be0 con 0x7f377809e840 2020-02-11T16:30:31.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:31.708 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376f7fe700 1 -- 172.21.15.88:0/564151381 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37600105e0 con 0x7f377809e840 2020-02-11T16:30:31.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.710 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376f7fe700 1 -- 172.21.15.88:0/564151381 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376000e910 con 0x7f377809e840 2020-02-11T16:30:31.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f376f7fe700 1 -- 172.21.15.88:0/564151381 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f376000ed30 con 0x7f377809e840 2020-02-11T16:30:31.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f377c931700 1 -- 172.21.15.88:0/564151381 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37780665b0 con 0x7f377809e840 2020-02-11T16:30:31.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.692+0000 7f377c931700 1 -- 172.21.15.88:0/564151381 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3778114140 con 0x7f377809e840 2020-02-11T16:30:31.711 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.693+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.693+0000 7f376f7fe700 1 -- 172.21.15.88:0/564151381 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f3760007170 con 0x7f377809e840 2020-02-11T16:30:31.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.693+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.694+0000 7f376f7fe700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f375c039d50 0x7f375c03c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:31.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.694+0000 7f376f7fe700 1 -- 172.21.15.88:0/564151381 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f3760049980 con 0x7f377809e840 2020-02-11T16:30:31.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.694+0000 7f377c931700 1 -- 172.21.15.88:0/564151381 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37780565b0 con 0x7f377809e840 2020-02-11T16:30:31.712 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.694+0000 7f377659c700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f375c039d50 0x7f375c03c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:31.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.694+0000 7f377659c700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f375c039d50 0x7f375c03c210 crc :-1 s=READY pgs=546 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:31.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.699+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.699+0000 7f376f7fe700 1 -- 172.21.15.88:0/564151381 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f376002ef40 con 0x7f377809e840 2020-02-11T16:30:31.727 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 62% (143/227) Checking out files: 63% (144/227) Checking out files: 64% (146/227) Checking out files: 65% (148/227) Checking out files: 66% (150/227) Checking out files: 67% (153/227) Checking out files: 68% (155/227) Checking out files: 69% (157/227) Checking out files: 70% (159/227) Checking out files: 71% (162/227) Checking out files: 72% (164/227) Checking out files: 73% (166/227) Checking out files: 74% (168/227) Checking out files: 75% (171/227) Checking out files: 76% (173/227) Checking out files: 77% (175/227) Checking out files: 78% (178/227) Checking out files: 79% (180/227) Checking out files: 80% (182/227) Checking out files: 81% (184/227) Checking out files: 82% (187/227) Checking out files: 83% (189/227) Checking out files: 84% (191/227) Checking out files: 85% (193/227) Checking out files: 86% (196/227) Checking out files: 87% (198/227) Checking out files: 88% (200/227) Checking out files: 89% (203/227) Checking out files: 90% (205/227) Checking out files: 91% (207/227) Checking out files: 92% (209/227) Checking out files: 93% (212/227) Checking out files: 94% (214/227) Checking out files: 95% (216/227) Checking out files: 96% (218/227) Checking out files: 97% (221/227) Checking out files: 98% (223/227) Checking out files: 99% (225/227) Checking out files: 100% (227/227) Checking out files: 100% (227/227), done. 2020-02-11T16:30:31.850 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at a4c752df71 v0.6 2020-02-11T16:30:31.852 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.6 2020-02-11T16:30:31.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.919+0000 7f377c931700 1 -- 172.21.15.88:0/564151381 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f37780a7400 con 0x7f377809e840 2020-02-11T16:30:31.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.920+0000 7f376ffff700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:31.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.920+0000 7f376f7fe700 1 -- 172.21.15.88:0/564151381 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f3760031a50 con 0x7f377809e840 2020-02-11T16:30:31.923 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":204,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:31.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 -- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f375c039d50 msgr2=0x7f375c03c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:31.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f375c039d50 0x7f375c03c210 crc :-1 s=READY pgs=546 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:31.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 -- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 msgr2=0x7f3778113ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:31.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f3760002ef0 tx=0x7f3760010ec0).stop 2020-02-11T16:30:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 -- 172.21.15.88:0/564151381 shutdown_connections 2020-02-11T16:30:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f375c039d50 0x7f375c03c210 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 --2- 172.21.15.88:0/564151381 >> v2:172.21.15.52:3300/0 conn(0x7f377805fc80 0x7f3778066150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 --2- 172.21.15.88:0/564151381 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f377809e840 0x7f3778113ce0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 -- 172.21.15.88:0/564151381 >> 172.21.15.88:0/564151381 conn(0x7f37780a7bb0 msgr2=0x7f37780a3410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 -- 172.21.15.88:0/564151381 shutdown_connections 2020-02-11T16:30:31.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:31.921+0000 7f377c931700 1 -- 172.21.15.88:0/564151381 wait complete. 2020-02-11T16:30:31.934 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":204,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:31.934 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:30:31.934 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:30:31.934 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:30:32.043 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:32.043 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.7 2020-02-11T16:30:32.043 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.7 2020-02-11T16:30:32.043 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.7 2020-02-11T16:30:32.044 INFO:tasks.workunit.client.0.smithi088.stdout:v0.7 2020-02-11T16:30:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.063+0000 7f57d2461700 1 Processor -- start 2020-02-11T16:30:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.063+0000 7f57d2461700 1 -- start start 2020-02-11T16:30:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57d2461700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57cc0a2fa0 0x7f57cc0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57d2461700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57cc0a5410 0x7f57cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57d2461700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57cc0a4350 con 0x7f57cc0a6da0 2020-02-11T16:30:32.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57d2461700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc0a1e60 con 0x7f57cc0a2fa0 2020-02-11T16:30:32.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57d2461700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc0a3450 con 0x7f57cc0a5410 2020-02-11T16:30:32.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57cb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57cc0a5410 0x7f57cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57d09fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f57cc0a6da0 0x7f57cc131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48518/0 (socket says 172.21.15.88:48518) 2020-02-11T16:30:32.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57d09fe700 1 -- 172.21.15.88:0/1481570856 learned_addr learned my addr 172.21.15.88:0/1481570856 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:32.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1481570856 >> v2:172.21.15.52:3300/0 conn(0x7f57cc0a2fa0 0x7f57cc0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57caffd700 1 -- 172.21.15.88:0/1481570856 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70882663 0 0) 0x7f57cc0a4350 con 0x7f57cc0a6da0 2020-02-11T16:30:32.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.064+0000 7f57caffd700 1 -- 172.21.15.88:0/1481570856 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57b8003230 con 0x7f57cc0a6da0 2020-02-11T16:30:32.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57cb7fe700 1 -- 172.21.15.88:0/1481570856 >> v2:172.21.15.52:3300/0 conn(0x7f57cc0a2fa0 msgr2=0x7f57cc0a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:32.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1481570856 >> v2:172.21.15.52:3300/0 conn(0x7f57cc0a2fa0 0x7f57cc0a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57cb7fe700 1 -- 172.21.15.88:0/1481570856 >> v1:172.21.15.88:6789/0 conn(0x7f57cc0a6da0 legacy=0x7f57cc131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57cb7fe700 1 -- 172.21.15.88:0/1481570856 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc0a3a40 con 0x7f57cc0a5410 2020-02-11T16:30:32.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1481570856 >> v2:172.21.15.88:3300/0 conn(0x7f57cc0a5410 0x7f57cc0a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1481570856 >> v2:172.21.15.88:3300/0 conn(0x7f57cc0a5410 0x7f57cc0a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1481570856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc0a5870 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).ready entity=mon.1 client_cookie=54c107ad46bb5e30 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1481570856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc0a5870 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57caffd700 1 -- 172.21.15.88:0/1481570856 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57c0011310 con 0x7f57cc0a5410 2020-02-11T16:30:32.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1481570856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc0a5870 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1481570856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc0a5870 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57caffd700 1 -- 172.21.15.88:0/1481570856 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0011470 con 0x7f57cc0a5410 2020-02-11T16:30:32.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57caffd700 1 -- 172.21.15.88:0/1481570856 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57c00117d0 con 0x7f57cc0a5410 2020-02-11T16:30:32.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57d2461700 1 -- 172.21.15.88:0/1481570856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 msgr2=0x7f57cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57d2461700 1 --2- 172.21.15.88:0/1481570856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc0a5870 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).stop 2020-02-11T16:30:32.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57d2461700 1 -- 172.21.15.88:0/1481570856 shutdown_connections 2020-02-11T16:30:32.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57d2461700 1 --2- 172.21.15.88:0/1481570856 >> v2:172.21.15.52:3300/0 conn(0x7f57cc0a2fa0 0x7f57cc0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57d2461700 1 --2- 172.21.15.88:0/1481570856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc0a5870 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57d2461700 1 -- 172.21.15.88:0/1481570856 >> 172.21.15.88:0/1481570856 conn(0x7f57cc09d110 msgr2=0x7f57cc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:32.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57d2461700 1 -- 172.21.15.88:0/1481570856 shutdown_connections 2020-02-11T16:30:32.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.065+0000 7f57d2461700 1 -- 172.21.15.88:0/1481570856 wait complete. 2020-02-11T16:30:32.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.066+0000 7f57d2461700 1 Processor -- start 2020-02-11T16:30:32.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.066+0000 7f57d2461700 1 -- start start 2020-02-11T16:30:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57d2461700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f57cc0a2fa0 0x7f57cc09ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57d2461700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57cc0a5410 0x7f57cc09f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57d2461700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57cc1450f0 con 0x7f57cc0a6da0 2020-02-11T16:30:32.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57d2461700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc09ea20 con 0x7f57cc0a5410 2020-02-11T16:30:32.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57d2461700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc136630 con 0x7f57cc0a2fa0 2020-02-11T16:30:32.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57cb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57cc0a5410 0x7f57cc09f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57cb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57cc0a5410 0x7f57cc09f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60898/0 (socket says 172.21.15.88:60898) 2020-02-11T16:30:32.080 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57cb7fe700 1 -- 172.21.15.88:0/1483895394 learned_addr learned my addr 172.21.15.88:0/1483895394 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f57cc0a2fa0 0x7f57cc09ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57cb7fe700 1 -- 172.21.15.88:0/1483895394 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f57cc0a2fa0 msgr2=0x7f57cc09ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f57cc0a2fa0 0x7f57cc09ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57cb7fe700 1 -- 172.21.15.88:0/1483895394 >> v1:172.21.15.52:6789/0 conn(0x7f57cc0a6da0 legacy=0x7f57cc145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57cb7fe700 1 -- 172.21.15.88:0/1483895394 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc1368d0 con 0x7f57cc0a5410 2020-02-11T16:30:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.067+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1483895394 >> v2:172.21.15.88:3300/0 conn(0x7f57cc0a5410 0x7f57cc09f2e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1483895394 >> v2:172.21.15.88:3300/0 conn(0x7f57cc0a5410 0x7f57cc09f2e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc09f2e0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc09f2e0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57c000f760 con 0x7f57cc0a5410 2020-02-11T16:30:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc09f2e0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc09f2e0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0007150 con 0x7f57cc0a5410 2020-02-11T16:30:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57d2461700 1 -- 172.21.15.88:0/1483895394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57cc135330 con 0x7f57cc0a5410 2020-02-11T16:30:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57c00074f0 con 0x7f57cc0a5410 2020-02-11T16:30:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57d2461700 1 -- 172.21.15.88:0/1483895394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57cc135960 con 0x7f57cc0a5410 2020-02-11T16:30:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc09f2e0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f57c00056c0 con 0x7f57cc0a5410 2020-02-11T16:30:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57cb7fe700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc09f2e0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57d2461700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 0x7f57cc0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.068+0000 7f57d2461700 1 -- 172.21.15.88:0/1483895394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc05e2f0 con 0x7f57cc129ea0 2020-02-11T16:30:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 0x7f57cc0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57c97fa700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57ac039ca0 0x7f57ac03c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f57c004a4c0 con 0x7f57cc0a5410 2020-02-11T16:30:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57cbfff700 1 -- 172.21.15.88:0/1483895394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57cc0565b0 con 0x7f57cc129ea0 2020-02-11T16:30:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57d09fe700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57ac039ca0 0x7f57ac03c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 0x7f57cc0a5830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 0x7f57cc0a5830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 0x7f57cc0a5830 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 0x7f57cc0a5830 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57bc005a10 con 0x7f57cc129ea0 2020-02-11T16:30:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57d09fe700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57ac039ca0 0x7f57ac03c160 crc :-1 s=READY pgs=547 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 0x7f57cc0a5830 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f57bc005b70 con 0x7f57cc129ea0 2020-02-11T16:30:32.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 msgr2=0x7f57cc0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57c97fa700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 0x7f57cc0a5830 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).stop 2020-02-11T16:30:32.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 msgr2=0x7f57cc0a5830 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:32.086 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.069+0000 7f57c97fa700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc129ea0 0x7f57cc0a5830 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).stop 2020-02-11T16:30:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.077+0000 7f57d2461700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 0x7f57cc05a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.077+0000 7f57d2461700 1 -- 172.21.15.88:0/1483895394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc136770 con 0x7f57cc05a5d0 2020-02-11T16:30:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.077+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 0x7f57cc05a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57cbfff700 1 -- 172.21.15.88:0/1483895394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f57cc136ad0 con 0x7f57cc05a5d0 2020-02-11T16:30:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 0x7f57cc05a9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 0x7f57cc05a9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 0x7f57cc05a9e0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 0x7f57cc05a9e0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57bc00b6a0 con 0x7f57cc05a5d0 2020-02-11T16:30:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57cbfff700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 0x7f57cc05a9e0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7f57bc00b800 con 0x7f57cc05a5d0 2020-02-11T16:30:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 msgr2=0x7f57cc05a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57c97fa700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 0x7f57cc05a9e0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f57bc002f30 tx=0x7f57bc010e30).stop 2020-02-11T16:30:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57c97fa700 1 -- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 msgr2=0x7f57cc05a9e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57c97fa700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc05a5d0 0x7f57cc05a9e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57d2461700 1 -- 172.21.15.88:0/1483895394 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57ac039ca0 msgr2=0x7f57ac03c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57d2461700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f57ac039ca0 0x7f57ac03c160 crc :-1 s=READY pgs=547 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57d2461700 1 -- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 msgr2=0x7f57cc09f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.091 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57d2461700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc09f2e0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f57c0002f30 tx=0x7f57c0007a40).stop 2020-02-11T16:30:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.078+0000 7f57d09fe700 1 -- 172.21.15.88:0/1483895394 reap_dead start 2020-02-11T16:30:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.079+0000 7f57d2461700 1 -- 172.21.15.88:0/1483895394 shutdown_connections 2020-02-11T16:30:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.079+0000 7f57d2461700 1 --2- 172.21.15.88:0/1483895394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc0a5410 0x7f57cc09f2e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.079+0000 7f57d2461700 1 -- 172.21.15.88:0/1483895394 >> 172.21.15.88:0/1483895394 conn(0x7f57cc09d110 msgr2=0x7f57cc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.079+0000 7f57d2461700 1 -- 172.21.15.88:0/1483895394 shutdown_connections 2020-02-11T16:30:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.079+0000 7f57d2461700 1 -- 172.21.15.88:0/1483895394 wait complete. 2020-02-11T16:30:32.093 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:30:32.093 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:30:32.094 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:30:32.094 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:30:32.094 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 204, 2020-02-11T16:30:32.094 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:30:32.094 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:30:32.094 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:30:32.094 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:30:32.095 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.095 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2020-02-11T16:30:32.095 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:32.095 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:30:32.095 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:30:32.095 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:32.096 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:32.096 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:32.096 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:32.096 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:32.097 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:32.097 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.097 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:30:32.097 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:30:32.097 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:32.097 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:32.098 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:32.098 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:32.098 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:32.098 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:32.098 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.099 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:30:32.099 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:30:32.099 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:30:32.099 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:30:32.100 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:30:32.100 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:30:32.100 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:32.100 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:32.100 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:30:32.100 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:30:32.100 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:32.101 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:30:32.101 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:32.101 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:32.101 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:32.101 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:32.101 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:32.101 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:32.102 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.102 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:30:32.102 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.102 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:30:32.102 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.102 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:32.102 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:32.103 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:32.103 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:32.103 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.103 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:32.103 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:30:32.103 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.103 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.104 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:32.104 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:30:32.104 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.104 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.104 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.104 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.104 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:30:32.105 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:30:32.105 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:32.105 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:32.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.105 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.106 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:30:32.106 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:30:32.106 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:32.106 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:32.106 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.106 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:32.107 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:30:32.107 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.107 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.107 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:32.107 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:30:32.107 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.108 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.108 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.108 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:30:32.108 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:30:32.108 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:32.108 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:32.109 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.109 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.109 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:32.109 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:32.109 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:32.109 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:32.109 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.110 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:32.110 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:30:32.110 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.110 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.110 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.110 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:32.110 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:30:32.111 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.111 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.111 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.112 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:30:32.112 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:30:32.112 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:32.113 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:32.113 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.113 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.113 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:30:32.113 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:30:32.114 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.114 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:32.114 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:32.114 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:32.114 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.114 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.114 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:30:32.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.115 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:32.115 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:32.115 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:30:32.115 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.115 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.115 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.116 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:30:32.117 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:30:32.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.234+0000 7f8fbfaaa700 1 Processor -- start 2020-02-11T16:30:32.237 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.234+0000 7f8fbfaaa700 1 -- start start 2020-02-11T16:30:32.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbfaaa700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fb80a73d0 0x7f8fb80a2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbfaaa700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8fb813b8f0 0x7f8fb8142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbfaaa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb80a2cd0 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbfaaa700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb8132460 con 0x7f8fb80a73d0 2020-02-11T16:30:32.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbfaaa700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb80a8630 con 0x7f8fb813b8f0 2020-02-11T16:30:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbd045700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fb80a73d0 0x7f8fb80a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbd846700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8fb80a6ff0 0x7f8fb813b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40314/0 (socket says 172.21.15.88:40314) 2020-02-11T16:30:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbd045700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fb80a73d0 0x7f8fb80a2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46894/0 (socket says 172.21.15.88:46894) 2020-02-11T16:30:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbd846700 1 -- 172.21.15.88:0/4227477768 learned_addr learned my addr 172.21.15.88:0/4227477768 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbe047700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8fb813b8f0 0x7f8fb8142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbd045700 1 -- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8fb813b8f0 msgr2=0x7f8fb8142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbd045700 1 --2- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8fb813b8f0 0x7f8fb8142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbd045700 1 -- 172.21.15.88:0/4227477768 >> v1:172.21.15.52:6789/0 conn(0x7f8fb80a6ff0 legacy=0x7f8fb813b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbc844700 1 -- 172.21.15.88:0/4227477768 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608903056 0 0) 0x7f8fb80a2cd0 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbd045700 1 -- 172.21.15.88:0/4227477768 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb80a30c0 con 0x7f8fb80a73d0 2020-02-11T16:30:32.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.235+0000 7f8fbe047700 1 --2- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8fb813b8f0 0x7f8fb8142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:30:32.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbd045700 1 --2- 172.21.15.88:0/4227477768 >> v2:172.21.15.52:3300/0 conn(0x7f8fb80a73d0 0x7f8fb80a2870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8fa8002f30 tx=0x7f8fa80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbd045700 1 --2- 172.21.15.88:0/4227477768 >> v2:172.21.15.52:3300/0 conn(0x7f8fb80a73d0 0x7f8fb80a2870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8fa8002f30 tx=0x7f8fa80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbd045700 1 --2- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80a73d0 0x7f8fb80a2870 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f8fa8002f30 tx=0x7f8fa80088e0).ready entity=mon.0 client_cookie=790c6f445a89fbb6 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbd045700 1 --2- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80a73d0 0x7f8fb80a2870 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f8fa8002f30 tx=0x7f8fa80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbc844700 1 -- 172.21.15.88:0/4227477768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa8008e40 con 0x7f8fb80a73d0 2020-02-11T16:30:32.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbd045700 1 --2- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80a73d0 0x7f8fb80a2870 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f8fa8002f30 tx=0x7f8fa80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbd045700 1 --2- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80a73d0 0x7f8fb80a2870 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f8fa8002f30 tx=0x7f8fa80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbc844700 1 -- 172.21.15.88:0/4227477768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa80115f0 con 0x7f8fb80a73d0 2020-02-11T16:30:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80a73d0 msgr2=0x7f8fb80a2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbc844700 1 -- 172.21.15.88:0/4227477768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa8011990 con 0x7f8fb80a73d0 2020-02-11T16:30:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbfaaa700 1 --2- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80a73d0 0x7f8fb80a2870 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f8fa8002f30 tx=0x7f8fa80088e0).stop 2020-02-11T16:30:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/4227477768 shutdown_connections 2020-02-11T16:30:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbfaaa700 1 --2- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8fb813b8f0 0x7f8fb8142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbfaaa700 1 --2- 172.21.15.88:0/4227477768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80a73d0 0x7f8fb80a2870 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/4227477768 >> 172.21.15.88:0/4227477768 conn(0x7f8fb80ac2d0 msgr2=0x7f8fb80ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:32.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/4227477768 shutdown_connections 2020-02-11T16:30:32.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.236+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/4227477768 wait complete. 2020-02-11T16:30:32.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.237+0000 7f8fbfaaa700 1 Processor -- start 2020-02-11T16:30:32.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.237+0000 7f8fbfaaa700 1 -- start start 2020-02-11T16:30:32.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbfaaa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbfaaa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb8138de0 con 0x7f8fb80a73d0 2020-02-11T16:30:32.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbfaaa700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb81326c0 con 0x7f8fb813b8f0 2020-02-11T16:30:32.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbfaaa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb8137ab0 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbd846700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbe047700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8fb813b8f0 0x7f8fb814f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48542/0 (socket says 172.21.15.88:48542) 2020-02-11T16:30:32.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbe047700 1 -- 172.21.15.88:0/1348405195 learned_addr learned my addr 172.21.15.88:0/1348405195 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:32.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755746692 0 0) 0x7f8fb8138de0 con 0x7f8fb80a73d0 2020-02-11T16:30:32.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f98002fe0 con 0x7f8fb80a73d0 2020-02-11T16:30:32.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274660562 0 0) 0x7f8fb81326c0 con 0x7f8fb813b8f0 2020-02-11T16:30:32.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb8138de0 con 0x7f8fb813b8f0 2020-02-11T16:30:32.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbd846700 1 -- 172.21.15.88:0/1348405195 >> v1:172.21.15.88:6789/0 conn(0x7f8fb813b8f0 legacy=0x7f8fb814f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbd846700 1 -- 172.21.15.88:0/1348405195 >> v1:172.21.15.52:6789/0 conn(0x7f8fb80a73d0 legacy=0x7f8fb812e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbd846700 1 -- 172.21.15.88:0/1348405195 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb8136fd0 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.238+0000 7f8fbd846700 1 --2- 172.21.15.88:0/1348405195 >> v2:172.21.15.88:3300/0 conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8fb4000b80 tx=0x7f8fb4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fbd846700 1 --2- 172.21.15.88:0/1348405195 >> v2:172.21.15.88:3300/0 conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8fb4000b80 tx=0x7f8fb4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fbd846700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f8fb4000b80 tx=0x7f8fb4010900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fbd846700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f8fb4000b80 tx=0x7f8fb4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fb4005ca0 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fbd846700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f8fb4000b80 tx=0x7f8fb4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/1348405195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb81354c0 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fbd846700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f8fb4000b80 tx=0x7f8fb4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb4005e00 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fb40062b0 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/1348405195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb812ee30 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.239+0000 7f8fbd846700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f8fb4000b80 tx=0x7f8fb4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f8fb4006530 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fbd846700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f8fb4000b80 tx=0x7f8fb4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fbfaaa700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 0x7f8fb8145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/1348405195 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb805e2f0 con 0x7f8fb8135e30 2020-02-11T16:30:32.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fa6ffd700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f9803a030 0x7f8f9803c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 0x7f8fb8145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f8fb4049930 con 0x7f8fb80a6ff0 2020-02-11T16:30:32.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fbe047700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f9803a030 0x7f8f9803c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fbd045700 1 -- 172.21.15.88:0/1348405195 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fb8132880 con 0x7f8fb8135e30 2020-02-11T16:30:32.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 0x7f8fb8145300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fbe047700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f9803a030 0x7f8f9803c4f0 crc :-1 s=READY pgs=548 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 0x7f8fb8145300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.240+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 0x7f8fb8145300 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.241+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 0x7f8fb8145300 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.241+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa8011e70 con 0x7f8fb8135e30 2020-02-11T16:30:32.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.241+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 0x7f8fb8145300 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.241+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f8fa8011800 con 0x7f8fb8135e30 2020-02-11T16:30:32.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.241+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 msgr2=0x7f8fb8145300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.241+0000 7f8fa6ffd700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 0x7f8fb8145300 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).stop 2020-02-11T16:30:32.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.241+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 msgr2=0x7f8fb8145300 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:32.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.241+0000 7f8fa6ffd700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb8135e30 0x7f8fb8145300 secure :-1 s=CLOSED pgs=441 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).stop 2020-02-11T16:30:32.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.249+0000 7f8fbfaaa700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 0x7f8fb80aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.249+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/1348405195 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb8132ce0 con 0x7f8fb80ac6b0 2020-02-11T16:30:32.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.249+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 0x7f8fb80aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.249+0000 7f8fbd045700 1 -- 172.21.15.88:0/1348405195 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8fb8136e20 con 0x7f8fb80ac6b0 2020-02-11T16:30:32.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.249+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 0x7f8fb80aa1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.260 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.249+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 0x7f8fb80aa1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.249+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 0x7f8fb80aa1d0 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 0x7f8fb80aa1d0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa800d420 con 0x7f8fb80ac6b0 2020-02-11T16:30:32.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbd045700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 0x7f8fb80aa1d0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4363 (secure 0 0 0) 0x7f8fa800d580 con 0x7f8fb80ac6b0 2020-02-11T16:30:32.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 msgr2=0x7f8fb80aa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fa6ffd700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 0x7f8fb80aa1d0 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).stop 2020-02-11T16:30:32.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fa6ffd700 1 -- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 msgr2=0x7f8fb80aa1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:32.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fa6ffd700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fb80ac6b0 0x7f8fb80aa1d0 secure :-1 s=CLOSED pgs=442 cs=0 l=1 rx=0x7f8fa8007ed0 tx=0x7f8fb8138ce0).stop 2020-02-11T16:30:32.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f9803a030 msgr2=0x7f8f9803c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbfaaa700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8f9803a030 0x7f8f9803c4f0 crc :-1 s=READY pgs=548 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/1348405195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb80a6ff0 msgr2=0x7f8fb8144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbfaaa700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f8fb4000b80 tx=0x7f8fb4010900).stop 2020-02-11T16:30:32.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbe047700 1 -- 172.21.15.88:0/1348405195 reap_dead start 2020-02-11T16:30:32.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/1348405195 shutdown_connections 2020-02-11T16:30:32.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbfaaa700 1 --2- 172.21.15.88:0/1348405195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb80a6ff0 0x7f8fb8144ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/1348405195 >> 172.21.15.88:0/1348405195 conn(0x7f8fb80ac2d0 msgr2=0x7f8fb8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:32.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/1348405195 shutdown_connections 2020-02-11T16:30:32.264 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.250+0000 7f8fbfaaa700 1 -- 172.21.15.88:0/1348405195 wait complete. 2020-02-11T16:30:32.264 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:30:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:30:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 204, 2020-02-11T16:30:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:30:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:30:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:30:32.266 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:30:32.266 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.266 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2020-02-11T16:30:32.266 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:32.266 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:30:32.266 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:30:32.267 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:32.267 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:32.267 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:32.267 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:32.267 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:32.267 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:32.267 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.267 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:30:32.268 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:30:32.268 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:32.268 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:32.268 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:32.268 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:32.268 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:32.268 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:32.269 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.269 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:30:32.269 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:30:32.269 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:30:32.269 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:30:32.269 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:30:32.270 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:30:32.270 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:32.270 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:32.270 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:30:32.270 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:30:32.270 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:32.270 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:30:32.271 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:32.271 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:32.271 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:32.271 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:32.271 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:32.271 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:32.271 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.272 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:30:32.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.272 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:30:32.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.272 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:32.272 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:32.272 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:32.272 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:32.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.273 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:32.273 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:30:32.273 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.275 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:32.275 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:30:32.275 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.275 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.275 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.276 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:30:32.276 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:30:32.276 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:32.276 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:32.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.277 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:30:32.277 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:30:32.277 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:32.277 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:32.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.277 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:32.278 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:30:32.278 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.279 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:32.279 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:30:32.279 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.279 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.279 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.280 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:30:32.280 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:30:32.280 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:32.280 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:32.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.281 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:32.281 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:32.281 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:32.281 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:32.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.281 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:32.282 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:30:32.282 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.282 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:32.282 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:30:32.282 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.283 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.283 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.283 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:30:32.283 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:30:32.283 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:32.283 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:32.283 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.284 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.284 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:30:32.284 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:30:32.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.284 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:32.284 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:30:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:32.286 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:32.286 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.286 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.286 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:30:32.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.286 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:32.287 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:32.287 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:30:32.287 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.287 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.288 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:30:32.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.288 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:32.288 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:32.288 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:30:32.288 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.288 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.288 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:30:32.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.289 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:32.289 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:32.289 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:30:32.289 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.289 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.289 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.290 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:30:32.291 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:30:32.443 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.441+0000 7feda3162700 1 Processor -- start 2020-02-11T16:30:32.444 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.441+0000 7feda3162700 1 -- start start 2020-02-11T16:30:32.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.441+0000 7feda3162700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed9c0a2fa0 0x7fed9c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.441+0000 7feda3162700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed9c0a5410 0x7fed9c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.441+0000 7feda3162700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c131280 0x7fed9c1316d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.441+0000 7feda3162700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0a1e60 con 0x7fed9c0a2fa0 2020-02-11T16:30:32.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.441+0000 7feda3162700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0a3450 con 0x7fed9c0a5410 2020-02-11T16:30:32.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.441+0000 7feda3162700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0a4350 con 0x7fed9c131280 2020-02-11T16:30:32.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed9c0a5410 0x7fed9c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed9c0a5410 0x7fed9c0a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60924/0 (socket says 172.21.15.88:60924) 2020-02-11T16:30:32.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 -- 172.21.15.88:0/2825189700 learned_addr learned my addr 172.21.15.88:0/2825189700 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:32.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7feda16ff700 1 --2- 172.21.15.88:0/2825189700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c131280 0x7fed9c1316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 -- 172.21.15.88:0/2825189700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c131280 msgr2=0x7fed9c1316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:32.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2825189700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c131280 0x7fed9c1316d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 -- 172.21.15.88:0/2825189700 >> v2:172.21.15.52:3300/0 conn(0x7fed9c0a2fa0 msgr2=0x7fed9c0a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:30:32.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2825189700 >> v2:172.21.15.52:3300/0 conn(0x7fed9c0a2fa0 0x7fed9c0a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 -- 172.21.15.88:0/2825189700 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c0a3a40 con 0x7fed9c0a5410 2020-02-11T16:30:32.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2825189700 >> v2:172.21.15.88:3300/0 conn(0x7fed9c0a5410 0x7fed9c0a5870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.456 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2825189700 >> v2:172.21.15.88:3300/0 conn(0x7fed9c0a5410 0x7fed9c0a5870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2825189700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c0a5870 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).ready entity=mon.1 client_cookie=335ed0a85e2f4233 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2825189700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c0a5870 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9b7fe700 1 -- 172.21.15.88:0/2825189700 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed90008e20 con 0x7fed9c0a5410 2020-02-11T16:30:32.457 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2825189700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c0a5870 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2825189700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c0a5870 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9b7fe700 1 -- 172.21.15.88:0/2825189700 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90012970 con 0x7fed9c0a5410 2020-02-11T16:30:32.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7fed9b7fe700 1 -- 172.21.15.88:0/2825189700 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed90012d50 con 0x7fed9c0a5410 2020-02-11T16:30:32.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7feda3162700 1 -- 172.21.15.88:0/2825189700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 msgr2=0x7fed9c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.458 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.442+0000 7feda3162700 1 --2- 172.21.15.88:0/2825189700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c0a5870 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).stop 2020-02-11T16:30:32.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.443+0000 7feda3162700 1 -- 172.21.15.88:0/2825189700 shutdown_connections 2020-02-11T16:30:32.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.443+0000 7feda3162700 1 --2- 172.21.15.88:0/2825189700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c131280 0x7fed9c1316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.443+0000 7feda3162700 1 --2- 172.21.15.88:0/2825189700 >> v2:172.21.15.52:3300/0 conn(0x7fed9c0a2fa0 0x7fed9c0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.459 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.443+0000 7feda3162700 1 --2- 172.21.15.88:0/2825189700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c0a5870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.443+0000 7feda3162700 1 -- 172.21.15.88:0/2825189700 >> 172.21.15.88:0/2825189700 conn(0x7fed9c09d110 msgr2=0x7fed9c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:32.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.443+0000 7feda3162700 1 -- 172.21.15.88:0/2825189700 shutdown_connections 2020-02-11T16:30:32.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.444+0000 7feda3162700 1 -- 172.21.15.88:0/2825189700 wait complete. 2020-02-11T16:30:32.460 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.445+0000 7feda3162700 1 Processor -- start 2020-02-11T16:30:32.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.445+0000 7feda3162700 1 -- start start 2020-02-11T16:30:32.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7feda3162700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c0a2fa0 0x7fed9c09f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7feda3162700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed9c0a5410 0x7fed9c09f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.461 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7feda3162700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed9c131280 0x7fed9c137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7feda3162700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c1365c0 con 0x7fed9c131280 2020-02-11T16:30:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7feda3162700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c09f930 con 0x7fed9c0a5410 2020-02-11T16:30:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7feda3162700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0671b0 con 0x7fed9c0a2fa0 2020-02-11T16:30:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7fed9bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed9c0a5410 0x7fed9c09f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7fed9bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed9c0a5410 0x7fed9c09f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60930/0 (socket says 172.21.15.88:60930) 2020-02-11T16:30:32.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7fed9bfff700 1 -- 172.21.15.88:0/2140949569 learned_addr learned my addr 172.21.15.88:0/2140949569 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:32.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c0a2fa0 0x7fed9c09f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.446+0000 7feda16ff700 1 --2- 172.21.15.88:0/2140949569 >> v2:172.21.15.52:3300/0 conn(0x7fed9c131280 0x7fed9c137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.463 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 -- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c0a2fa0 msgr2=0x7fed9c09f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c0a2fa0 0x7fed9c09f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 -- 172.21.15.88:0/2140949569 >> v2:172.21.15.52:3300/0 conn(0x7fed9c131280 msgr2=0x7fed9c137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2140949569 >> v2:172.21.15.52:3300/0 conn(0x7fed9c131280 0x7fed9c137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.464 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 -- 172.21.15.88:0/2140949569 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c135330 con 0x7fed9c0a5410 2020-02-11T16:30:32.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2140949569 >> v2:172.21.15.88:3300/0 conn(0x7fed9c0a5410 0x7fed9c09f4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2140949569 >> v2:172.21.15.88:3300/0 conn(0x7fed9c0a5410 0x7fed9c09f4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c09f4d0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.465 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c09f4d0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed90008e20 con 0x7fed9c0a5410 2020-02-11T16:30:32.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c09f4d0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c09f4d0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90007340 con 0x7fed9c0a5410 2020-02-11T16:30:32.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed900056c0 con 0x7fed9c0a5410 2020-02-11T16:30:32.467 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7feda3162700 1 -- 172.21.15.88:0/2140949569 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c148a50 con 0x7fed9c0a5410 2020-02-11T16:30:32.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.447+0000 7feda3162700 1 -- 172.21.15.88:0/2140949569 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c0a58a0 con 0x7fed9c0a5410 2020-02-11T16:30:32.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.448+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c09f4d0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.448+0000 7feda3162700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 0x7fed9c0aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.448+0000 7feda3162700 1 -- 172.21.15.88:0/2140949569 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c05e2f0 con 0x7fed9c137bf0 2020-02-11T16:30:32.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.448+0000 7fed9bfff700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c09f4d0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.448+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fed9000e0c0 con 0x7fed9c0a5410 2020-02-11T16:30:32.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.448+0000 7fed99ffb700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed7c039e10 0x7fed7c03c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.449+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fed90049f40 con 0x7fed9c0a5410 2020-02-11T16:30:32.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.449+0000 7feda16ff700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed7c039e10 0x7fed7c03c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.449+0000 7feda16ff700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed7c039e10 0x7fed7c03c2d0 crc :-1 s=READY pgs=549 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.449+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 0x7fed9c0aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7feda0efe700 1 -- 172.21.15.88:0/2140949569 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed9c066e20 con 0x7fed9c137bf0 2020-02-11T16:30:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 0x7fed9c0aa8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 0x7fed9c0aa8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 0x7fed9c0aa8d0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 0x7fed9c0aa8d0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8c0058e0 con 0x7fed9c137bf0 2020-02-11T16:30:32.476 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 0x7fed9c0aa8d0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fed8c002da0 con 0x7fed9c137bf0 2020-02-11T16:30:32.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 msgr2=0x7fed9c0aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.477 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7fed99ffb700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 0x7fed9c0aa8d0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).stop 2020-02-11T16:30:32.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 msgr2=0x7fed9c0aa8d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:32.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.450+0000 7fed99ffb700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c137bf0 0x7fed9c0aa8d0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).stop 2020-02-11T16:30:32.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.463+0000 7feda3162700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 0x7fed9c145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.463+0000 7feda3162700 1 -- 172.21.15.88:0/2140949569 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0565b0 con 0x7fed9c144f10 2020-02-11T16:30:32.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.463+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 0x7fed9c145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.463+0000 7feda0efe700 1 -- 172.21.15.88:0/2140949569 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fed9c149100 con 0x7fed9c144f10 2020-02-11T16:30:32.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.463+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 0x7fed9c145320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.464+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 0x7fed9c145320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.464+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 0x7fed9c145320 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.464+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 0x7fed9c145320 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.464+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8c00f510 con 0x7fed9c144f10 2020-02-11T16:30:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.464+0000 7feda0efe700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 0x7fed9c145320 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.464+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4021 (secure 0 0 0) 0x7fed8c00f670 con 0x7fed9c144f10 2020-02-11T16:30:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.464+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 msgr2=0x7fed9c145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.464+0000 7fed99ffb700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 0x7fed9c145320 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).stop 2020-02-11T16:30:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.464+0000 7fed99ffb700 1 -- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 msgr2=0x7fed9c145320 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.464+0000 7fed99ffb700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fed9c144f10 0x7fed9c145320 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0x7fed8c002f60 tx=0x7fed8c010b70).stop 2020-02-11T16:30:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.468+0000 7feda3162700 1 -- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed7c039e10 msgr2=0x7fed7c03c2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.468+0000 7feda3162700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fed7c039e10 0x7fed7c03c2d0 crc :-1 s=READY pgs=549 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.468+0000 7feda3162700 1 -- 172.21.15.88:0/2140949569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 msgr2=0x7fed9c09f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.468+0000 7feda3162700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c09f4d0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fed90002f30 tx=0x7fed90007a40).stop 2020-02-11T16:30:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.468+0000 7feda16ff700 1 -- 172.21.15.88:0/2140949569 reap_dead start 2020-02-11T16:30:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.468+0000 7feda16ff700 1 -- 172.21.15.88:0/2140949569 reap_dead start 2020-02-11T16:30:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.468+0000 7feda3162700 1 -- 172.21.15.88:0/2140949569 shutdown_connections 2020-02-11T16:30:32.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.468+0000 7feda3162700 1 --2- 172.21.15.88:0/2140949569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a5410 0x7fed9c09f4d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.468+0000 7feda3162700 1 -- 172.21.15.88:0/2140949569 >> 172.21.15.88:0/2140949569 conn(0x7fed9c09d110 msgr2=0x7fed9c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:32.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.470+0000 7feda3162700 1 -- 172.21.15.88:0/2140949569 shutdown_connections 2020-02-11T16:30:32.487 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.470+0000 7feda3162700 1 -- 172.21.15.88:0/2140949569 wait complete. 2020-02-11T16:30:32.488 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:30:32.488 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:32.488 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:32.488 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:30:32.489 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 204, 2020-02-11T16:30:32.489 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:30:32.489 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:30:32.489 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:30:32.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:30:32.491 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.491 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2020-02-11T16:30:32.491 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:32.492 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:30:32.492 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:30:32.492 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:32.492 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:32.493 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:32.493 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:32.493 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:32.493 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:32.493 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.494 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:30:32.494 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:30:32.494 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:32.494 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:32.495 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:32.495 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:32.495 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:32.495 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:32.496 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.496 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:30:32.496 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:30:32.497 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:30:32.497 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:30:32.497 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:30:32.497 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:30:32.498 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:32.498 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:32.498 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:30:32.499 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:30:32.499 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:32.499 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:30:32.499 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:32.500 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:32.500 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:32.500 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:32.500 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:32.501 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:32.501 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.501 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:30:32.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.502 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:30:32.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.503 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:32.503 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:32.503 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:32.504 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:32.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.504 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:32.504 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:30:32.505 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.505 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:32.506 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:30:32.506 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.507 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:30:32.507 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:30:32.507 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:32.507 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:32.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.508 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:30:32.508 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:30:32.509 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:32.509 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:32.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.509 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:30:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:30:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.512 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.513 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:30:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:30:32.514 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:32.515 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.516 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:30:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:30:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.518 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:30:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:30:32.519 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.520 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:30:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:30:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:32.522 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:30:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.523 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:32.524 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:30:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:32.525 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:30:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:32.526 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:32.526 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:30:32.528 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2020-02-11T16:30:32.528 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:30:32.529 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2020-02-11T16:30:32.529 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:30:32.529 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-02-11T16:30:32.530 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:30:32.544 INFO:tasks.ceph.mon.a:Stopped 2020-02-11T16:30:32.544 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:30:32.544 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:30:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.743+0000 7fb62a817700 1 Processor -- start 2020-02-11T16:30:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.743+0000 7fb62a817700 1 -- start start 2020-02-11T16:30:32.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb62a817700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb6240a36c0 0x7fb6240a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb62a817700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb6240a5d60 0x7fb6240a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb62a817700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb624135120 con 0x7fb6240a6c80 2020-02-11T16:30:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb62a817700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb624135390 con 0x7fb6240a36c0 2020-02-11T16:30:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb62a817700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb624135630 con 0x7fb6240a5d60 2020-02-11T16:30:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb61b7fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fb6240a36c0 msgr2=0x7fb6240a3b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb61b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb6240a36c0 0x7fb6240a3b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb628db4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb6240a5d60 0x7fb6240a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb623fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb6240a6c80 0x7fb624134a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40348/0 (socket says 172.21.15.88:40348) 2020-02-11T16:30:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb623fff700 1 -- 172.21.15.88:0/379403314 learned_addr learned my addr 172.21.15.88:0/379403314 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658665546 0 0) 0x7fb624135120 con 0x7fb6240a6c80 2020-02-11T16:30:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb604003230 con 0x7fb6240a6c80 2020-02-11T16:30:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2234366283 0 0) 0x7fb604003230 con 0x7fb6240a6c80 2020-02-11T16:30:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb6240a5d60 msgr2=0x7fb6240a61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb6237fe700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb6240a5d60 0x7fb6240a61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 >> v2:172.21.15.88:3300/0 conn(0x7fb6240a36c0 msgr2=0x7fb6240a3b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:30:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb6237fe700 1 --2- 172.21.15.88:0/379403314 >> v2:172.21.15.88:3300/0 conn(0x7fb6240a36c0 0x7fb6240a3b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6241358d0 con 0x7fb6240a6c80 2020-02-11T16:30:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fb6140016d0 con 0x7fb6240a6c80 2020-02-11T16:30:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.745+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 >> v1:172.21.15.52:6789/0 conn(0x7fb6240a6c80 legacy=0x7fb624134a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb6237fe700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb6240a5d60 0x7fb604003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb6237fe700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb604003b80 0x7fb604003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb6237fe700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604004570 0x7fb6040049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:32.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb624135390 con 0x7fb604004570 2020-02-11T16:30:32.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb624135630 con 0x7fb604003b80 2020-02-11T16:30:32.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb604005000 con 0x7fb6240a5d60 2020-02-11T16:30:32.760 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb61b7fe700 1 -- 172.21.15.88:0/379403314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb604003b80 msgr2=0x7fb604003fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:32.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb604003b80 0x7fb604003fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:32.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb628db4700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604004570 0x7fb6040049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.761 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb628db4700 1 -- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb6240a5d60 msgr2=0x7fb604003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:32.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb628db4700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb6240a5d60 0x7fb604003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb628db4700 1 -- 172.21.15.88:0/379403314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb604003b80 msgr2=0x7fb604003fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:30:32.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb628db4700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb604003b80 0x7fb604003fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:32.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb628db4700 1 -- 172.21.15.88:0/379403314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb604003230 con 0x7fb604004570 2020-02-11T16:30:32.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb628db4700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604004570 0x7fb6040049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb61c0032b0 tx=0x7fb61c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb628db4700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604004570 0x7fb6040049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb61c0032b0 tx=0x7fb61c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.746+0000 7fb628db4700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604004570 0x7fb6040049d0 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7fb61c0032b0 tx=0x7fb61c010400).ready entity=mon.0 client_cookie=5a2db97df7247b85 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.763 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.748+0000 7fb628db4700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604004570 0x7fb6040049d0 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7fb61c0032b0 tx=0x7fb61c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.748+0000 7fb628db4700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604004570 0x7fb6040049d0 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7fb61c0032b0 tx=0x7fb61c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.748+0000 7fb628db4700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604004570 0x7fb6040049d0 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7fb61c0032b0 tx=0x7fb61c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.748+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61c0112b0 con 0x7fb604004570 2020-02-11T16:30:32.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.748+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c011410 con 0x7fb604004570 2020-02-11T16:30:32.764 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.748+0000 7fb6237fe700 1 -- 172.21.15.88:0/379403314 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61c0117b0 con 0x7fb604004570 2020-02-11T16:30:32.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.748+0000 7fb62a817700 1 -- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604004570 msgr2=0x7fb6040049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:32.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.748+0000 7fb62a817700 1 --2- 172.21.15.88:0/379403314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604004570 0x7fb6040049d0 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7fb61c0032b0 tx=0x7fb61c010400).stop 2020-02-11T16:30:32.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.749+0000 7fb628db4700 1 -- 172.21.15.88:0/379403314 reap_dead start 2020-02-11T16:30:32.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.749+0000 7fb62a817700 1 -- 172.21.15.88:0/379403314 shutdown_connections 2020-02-11T16:30:32.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.749+0000 7fb62a817700 1 -- 172.21.15.88:0/379403314 >> 172.21.15.88:0/379403314 conn(0x7fb62409d110 msgr2=0x7fb62409d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:32.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.749+0000 7fb62a817700 1 -- 172.21.15.88:0/379403314 shutdown_connections 2020-02-11T16:30:32.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.749+0000 7fb62a817700 1 -- 172.21.15.88:0/379403314 wait complete. 2020-02-11T16:30:32.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.751+0000 7fb62a817700 1 Processor -- start 2020-02-11T16:30:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.753+0000 7fb62a817700 1 -- start start 2020-02-11T16:30:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb62a817700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb624133c90 0x7fb624149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb62a817700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb62409ef00 0x7fb6240a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb62a817700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb624131ed0 con 0x7fb6240a0a50 2020-02-11T16:30:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb62a817700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62405b970 con 0x7fb62409ef00 2020-02-11T16:30:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb62a817700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6241316f0 con 0x7fb624133c90 2020-02-11T16:30:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb628db4700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fb6240a0a50 legacy=0x7fb62414cde0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb61b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb62409ef00 0x7fb6240a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb61b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb62409ef00 0x7fb6240a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46938/0 (socket says 172.21.15.88:46938) 2020-02-11T16:30:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb61b7fe700 1 -- 172.21.15.88:0/1108929338 learned_addr learned my addr 172.21.15.88:0/1108929338 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb61b7fe700 1 -- 172.21.15.88:0/1108929338 >> v2:172.21.15.88:3300/0 conn(0x7fb624133c90 msgr2=0x7fb624149890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> v2:172.21.15.88:3300/0 conn(0x7fb624133c90 0x7fb624149890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb61b7fe700 1 -- 172.21.15.88:0/1108929338 >> v1:172.21.15.88:6789/0 conn(0x7fb6240a0a50 legacy=0x7fb62414cde0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb61b7fe700 1 -- 172.21.15.88:0/1108929338 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624131990 con 0x7fb62409ef00 2020-02-11T16:30:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.754+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> v2:172.21.15.52:3300/0 conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> v2:172.21.15.52:3300/0 conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb621ffb700 1 -- 172.21.15.88:0/1108929338 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60c011730 con 0x7fb62409ef00 2020-02-11T16:30:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb621ffb700 1 -- 172.21.15.88:0/1108929338 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c011890 con 0x7fb62409ef00 2020-02-11T16:30:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb621ffb700 1 -- 172.21.15.88:0/1108929338 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60c011c70 con 0x7fb62409ef00 2020-02-11T16:30:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb62a817700 1 -- 172.21.15.88:0/1108929338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb624131c30 con 0x7fb62409ef00 2020-02-11T16:30:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb62a817700 1 -- 172.21.15.88:0/1108929338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb624130e20 con 0x7fb62409ef00 2020-02-11T16:30:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.755+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.756+0000 7fb621ffb700 1 -- 172.21.15.88:0/1108929338 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb60c00b180 con 0x7fb62409ef00 2020-02-11T16:30:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.756+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.756+0000 7fb621ffb700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb608039c40 0x7fb60803c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.756+0000 7fb621ffb700 1 -- 172.21.15.88:0/1108929338 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7fb60c049620 con 0x7fb62409ef00 2020-02-11T16:30:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.756+0000 7fb62a817700 1 -- 172.21.15.88:0/1108929338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc003340 con 0x7fb62409ef00 2020-02-11T16:30:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.756+0000 7fb623fff700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb608039c40 0x7fb60803c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.757+0000 7fb623fff700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb608039c40 0x7fb60803c100 crc :-1 s=READY pgs=550 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:32.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.764+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:32.775 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:32.764+0000 7fb621ffb700 1 -- 172.21.15.88:0/1108929338 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb60c02ec60 con 0x7fb62409ef00 2020-02-11T16:30:33.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.019+0000 7fb62a817700 1 -- 172.21.15.88:0/1108929338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb5fc0036e0 con 0x7fb62409ef00 2020-02-11T16:30:33.029 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.019+0000 7fb61b7fe700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.019+0000 7fb621ffb700 1 -- 172.21.15.88:0/1108929338 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fb60c031710 con 0x7fb62409ef00 2020-02-11T16:30:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 -- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb608039c40 msgr2=0x7fb60803c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb608039c40 0x7fb60803c100 crc :-1 s=READY pgs=550 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 -- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 msgr2=0x7fb6240a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 0x7fb6240a05f0 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7fb62409ede0 tx=0x7fb60c0109b0).stop 2020-02-11T16:30:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 -- 172.21.15.88:0/1108929338 shutdown_connections 2020-02-11T16:30:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 --2- 172.21.15.88:0/1108929338 >> v2:172.21.15.88:3300/0 conn(0x7fb624133c90 0x7fb624149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb608039c40 0x7fb60803c100 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 --2- 172.21.15.88:0/1108929338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62409ef00 0x7fb6240a05f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 -- 172.21.15.88:0/1108929338 >> 172.21.15.88:0/1108929338 conn(0x7fb62409d110 msgr2=0x7fb624069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 -- 172.21.15.88:0/1108929338 shutdown_connections 2020-02-11T16:30:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:33.022+0000 7fb62a817700 1 -- 172.21.15.88:0/1108929338 wait complete. 2020-02-11T16:30:33.032 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":204,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:33.038 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":204,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:34.023 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 84% (170/201) Checking out files: 85% (171/201) Checking out files: 86% (173/201) Checking out files: 87% (175/201) Checking out files: 88% (177/201) Checking out files: 89% (179/201) Checking out files: 90% (181/201) Checking out files: 91% (183/201) Checking out files: 92% (185/201) Checking out files: 93% (187/201) Checking out files: 94% (189/201) Checking out files: 95% (191/201) Checking out files: 96% (193/201) Checking out files: 97% (195/201) Checking out files: 98% (197/201) Checking out files: 99% (199/201) Checking out files: 100% (201/201) Checking out files: 100% (201/201), done. 2020-02-11T16:30:34.161 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at c46e1b320c mkcephfs: btrfsctl -a between mkfs and mount 2020-02-11T16:30:34.165 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.7 2020-02-11T16:30:34.354 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:34.354 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.8 2020-02-11T16:30:34.354 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.8 2020-02-11T16:30:34.354 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.8 2020-02-11T16:30:34.355 INFO:tasks.workunit.client.0.smithi088.stdout:v0.8 2020-02-11T16:30:36.039 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:30:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.164+0000 7febb22f4700 1 Processor -- start 2020-02-11T16:30:36.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.164+0000 7febb22f4700 1 -- start start 2020-02-11T16:30:36.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febb22f4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febac05be70 0x7febac0a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:36.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febb22f4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:36.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febb22f4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febac137f10 0x7febac12e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febb22f4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac0a3f20 con 0x7febac137f10 2020-02-11T16:30:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febb22f4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac09d6b0 con 0x7febac05be70 2020-02-11T16:30:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febb22f4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac12f050 con 0x7febac05c250 2020-02-11T16:30:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febabfff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7febac05be70 msgr2=0x7febac0a31c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febabfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febac05be70 0x7febac0a31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55282/0 (socket says 172.21.15.88:55282) 2020-02-11T16:30:36.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 -- 172.21.15.88:0/3606414068 learned_addr learned my addr 172.21.15.88:0/3606414068 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:36.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 -- 172.21.15.88:0/3606414068 >> v2:172.21.15.88:3300/0 conn(0x7febac05be70 msgr2=0x7febac0a31c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:30:36.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 --2- 172.21.15.88:0/3606414068 >> v2:172.21.15.88:3300/0 conn(0x7febac05be70 0x7febac0a31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:36.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 -- 172.21.15.88:0/3606414068 >> v2:172.21.15.52:3300/0 conn(0x7febac137f10 msgr2=0x7febac12e740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:30:36.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 --2- 172.21.15.88:0/3606414068 >> v2:172.21.15.52:3300/0 conn(0x7febac137f10 0x7febac12e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:36.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 -- 172.21.15.88:0/3606414068 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0a6560 con 0x7febac05c250 2020-02-11T16:30:36.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 --2- 172.21.15.88:0/3606414068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feba40032b0 tx=0x7feba4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 --2- 172.21.15.88:0/3606414068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feba40032b0 tx=0x7feba4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 --2- 172.21.15.88:0/3606414068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7feba40032b0 tx=0x7feba4007dc0).ready entity=mon.2 client_cookie=5a9d084c8ca4ef28 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:36.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 --2- 172.21.15.88:0/3606414068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7feba40032b0 tx=0x7feba4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 --2- 172.21.15.88:0/3606414068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7feba40032b0 tx=0x7feba4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febaaffd700 1 -- 172.21.15.88:0/3606414068 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba4011e90 con 0x7febac05c250 2020-02-11T16:30:36.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.165+0000 7febab7fe700 1 --2- 172.21.15.88:0/3606414068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7feba40032b0 tx=0x7feba4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.166+0000 7febaaffd700 1 -- 172.21.15.88:0/3606414068 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba400a350 con 0x7febac05c250 2020-02-11T16:30:36.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.166+0000 7febaaffd700 1 -- 172.21.15.88:0/3606414068 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba400a730 con 0x7febac05c250 2020-02-11T16:30:36.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.166+0000 7febb22f4700 1 -- 172.21.15.88:0/3606414068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 msgr2=0x7febac0a6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:36.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.166+0000 7febb22f4700 1 --2- 172.21.15.88:0/3606414068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7feba40032b0 tx=0x7feba4007dc0).stop 2020-02-11T16:30:36.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.167+0000 7febb22f4700 1 -- 172.21.15.88:0/3606414068 shutdown_connections 2020-02-11T16:30:36.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.167+0000 7febb22f4700 1 --2- 172.21.15.88:0/3606414068 >> v2:172.21.15.52:3300/0 conn(0x7febac137f10 0x7febac12e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:36.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.167+0000 7febb22f4700 1 --2- 172.21.15.88:0/3606414068 >> v2:172.21.15.88:3300/0 conn(0x7febac05be70 0x7febac0a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:36.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.167+0000 7febb22f4700 1 --2- 172.21.15.88:0/3606414068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febac05c250 0x7febac0a6ca0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:36.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.167+0000 7febb22f4700 1 -- 172.21.15.88:0/3606414068 >> 172.21.15.88:0/3606414068 conn(0x7febac0ab400 msgr2=0x7febac0a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:36.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.167+0000 7febb22f4700 1 -- 172.21.15.88:0/3606414068 shutdown_connections 2020-02-11T16:30:36.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.167+0000 7febb22f4700 1 -- 172.21.15.88:0/3606414068 wait complete. 2020-02-11T16:30:36.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.168+0000 7febb22f4700 1 Processor -- start 2020-02-11T16:30:36.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.168+0000 7febb22f4700 1 -- start start 2020-02-11T16:30:36.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febb22f4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febac05c250 0x7febac12e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febb22f4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febac137f10 0x7febac131f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febb22f4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac135ed0 con 0x7febac05be70 2020-02-11T16:30:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febb22f4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac12e600 con 0x7febac137f10 2020-02-11T16:30:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febb22f4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac1323d0 con 0x7febac05c250 2020-02-11T16:30:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febab7fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7febac05c250 msgr2=0x7febac12e1a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febab7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febac05c250 0x7febac12e1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febb0891700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febac137f10 0x7febac131f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:36.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febb0891700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febac137f10 0x7febac131f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:46950/0 (socket says 172.21.15.88:46950) 2020-02-11T16:30:36.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febabfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7febac05be70 0x7febac12da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40368/0 (socket says 172.21.15.88:40368) 2020-02-11T16:30:36.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.169+0000 7febb0891700 1 -- 172.21.15.88:0/3335094736 learned_addr learned my addr 172.21.15.88:0/3335094736 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:36.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb0891700 1 -- 172.21.15.88:0/3335094736 >> v2:172.21.15.88:3300/0 conn(0x7febac05c250 msgr2=0x7febac12e1a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:36.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> v2:172.21.15.88:3300/0 conn(0x7febac05c250 0x7febac12e1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:36.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb0891700 1 -- 172.21.15.88:0/3335094736 >> v1:172.21.15.52:6789/0 conn(0x7febac05be70 legacy=0x7febac12da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:36.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb0891700 1 -- 172.21.15.88:0/3335094736 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac136170 con 0x7febac137f10 2020-02-11T16:30:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> v2:172.21.15.52:3300/0 conn(0x7febac137f10 0x7febac131f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> v2:172.21.15.52:3300/0 conn(0x7febac137f10 0x7febac131f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 0x7febac131f70 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 0x7febac131f70 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7feba97fa700 1 -- 172.21.15.88:0/3335094736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba0005990 con 0x7febac137f10 2020-02-11T16:30:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 0x7febac131f70 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb22f4700 1 -- 172.21.15.88:0/3335094736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac131ad0 con 0x7febac137f10 2020-02-11T16:30:36.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7feba97fa700 1 -- 172.21.15.88:0/3335094736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba0005af0 con 0x7febac137f10 2020-02-11T16:30:36.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 0x7febac131f70 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7feba97fa700 1 -- 172.21.15.88:0/3335094736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba0011270 con 0x7febac137f10 2020-02-11T16:30:36.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.170+0000 7febb22f4700 1 -- 172.21.15.88:0/3335094736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac13f850 con 0x7febac137f10 2020-02-11T16:30:36.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.171+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 0x7febac131f70 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.171+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 0x7febac131f70 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.171+0000 7feba97fa700 1 -- 172.21.15.88:0/3335094736 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7feba00114f0 con 0x7febac137f10 2020-02-11T16:30:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.171+0000 7febb22f4700 1 -- 172.21.15.88:0/3335094736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac1367a0 con 0x7febac137f10 2020-02-11T16:30:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.171+0000 7feba97fa700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb8c039be0 0x7feb8c03c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.171+0000 7feba97fa700 1 -- 172.21.15.88:0/3335094736 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7feba00497b0 con 0x7febac137f10 2020-02-11T16:30:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.171+0000 7febabfff700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb8c039be0 0x7feb8c03c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.173+0000 7febabfff700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb8c039be0 0x7feb8c03c0a0 crc :-1 s=READY pgs=551 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:36.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.176+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 0x7febac131f70 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.176+0000 7feba97fa700 1 -- 172.21.15.88:0/3335094736 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7feba002eaa0 con 0x7febac137f10 2020-02-11T16:30:36.390 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 71% (160/225) Checking out files: 72% (162/225) Checking out files: 73% (165/225) Checking out files: 74% (167/225) Checking out files: 75% (169/225) Checking out files: 76% (171/225) Checking out files: 77% (174/225) Checking out files: 78% (176/225) Checking out files: 79% (178/225) Checking out files: 80% (180/225) Checking out files: 81% (183/225) Checking out files: 82% (185/225) Checking out files: 83% (187/225) Checking out files: 84% (189/225) Checking out files: 85% (192/225) Checking out files: 86% (194/225) Checking out files: 87% (196/225) Checking out files: 88% (198/225) Checking out files: 89% (201/225) Checking out files: 90% (203/225) Checking out files: 91% (205/225) Checking out files: 92% (207/225) Checking out files: 93% (210/225) Checking out files: 94% (212/225) Checking out files: 95% (214/225) Checking out files: 96% (216/225) Checking out files: 97% (219/225) Checking out files: 98% (221/225) Checking out files: 99% (223/225) Checking out files: 100% (225/225) Checking out files: 100% (225/225), done. 2020-02-11T16:30:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.437+0000 7febb22f4700 1 -- 172.21.15.88:0/3335094736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7febac135cd0 con 0x7febac137f10 2020-02-11T16:30:36.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.437+0000 7febb0891700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 0x7febac131f70 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:36.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.437+0000 7feba97fa700 1 -- 172.21.15.88:0/3335094736 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7feba0031780 con 0x7febac137f10 2020-02-11T16:30:36.440 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":204,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.442+0000 7febb22f4700 1 -- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb8c039be0 msgr2=0x7feb8c03c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.442+0000 7febb22f4700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb8c039be0 0x7feb8c03c0a0 crc :-1 s=READY pgs=551 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.442+0000 7febb22f4700 1 -- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 msgr2=0x7febac131f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.442+0000 7febb22f4700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 0x7febac131f70 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7feba0002f60 tx=0x7feba0010940).stop 2020-02-11T16:30:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.442+0000 7febb22f4700 1 -- 172.21.15.88:0/3335094736 shutdown_connections 2020-02-11T16:30:36.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.442+0000 7febb22f4700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7feb8c039be0 0x7feb8c03c0a0 crc :-1 s=CLOSED pgs=551 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.442+0000 7febb22f4700 1 --2- 172.21.15.88:0/3335094736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febac137f10 0x7febac131f70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.442+0000 7febb22f4700 1 --2- 172.21.15.88:0/3335094736 >> v2:172.21.15.88:3300/0 conn(0x7febac05c250 0x7febac12e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.442+0000 7febb22f4700 1 -- 172.21.15.88:0/3335094736 >> 172.21.15.88:0/3335094736 conn(0x7febac0ab400 msgr2=0x7febac0a2440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.444+0000 7febb22f4700 1 -- 172.21.15.88:0/3335094736 shutdown_connections 2020-02-11T16:30:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:36.444+0000 7febb22f4700 1 -- 172.21.15.88:0/3335094736 wait complete. 2020-02-11T16:30:36.460 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":204,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":19,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:36.473 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 284161c00a kclient: kill dput/d_drop debug cruft 2020-02-11T16:30:36.477 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.8 2020-02-11T16:30:36.609 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:36.610 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.9 2020-02-11T16:30:36.610 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.9 2020-02-11T16:30:36.610 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.9 2020-02-11T16:30:36.610 INFO:tasks.workunit.client.0.smithi088.stdout:v0.9 2020-02-11T16:30:38.396 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 82% (159/193) Checking out files: 83% (161/193) Checking out files: 84% (163/193) Checking out files: 85% (165/193) Checking out files: 86% (166/193) Checking out files: 87% (168/193) Checking out files: 88% (170/193) Checking out files: 89% (172/193) Checking out files: 90% (174/193) Checking out files: 91% (176/193) Checking out files: 92% (178/193) Checking out files: 93% (180/193) Checking out files: 94% (182/193) Checking out files: 95% (184/193) Checking out files: 96% (186/193) Checking out files: 97% (188/193) Checking out files: 98% (190/193) Checking out files: 99% (192/193) Checking out files: 100% (193/193) Checking out files: 100% (193/193), done. 2020-02-11T16:30:38.467 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 4148185392 kclient: strip out kernel version compatibility cruft 2020-02-11T16:30:38.470 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.9 2020-02-11T16:30:38.777 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:38.777 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.10 2020-02-11T16:30:38.777 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.10 2020-02-11T16:30:38.777 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.10 2020-02-11T16:30:38.777 INFO:tasks.workunit.client.0.smithi088.stdout:v0.10 2020-02-11T16:30:39.462 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:30:39.630 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.628+0000 7f1d35b53700 1 Processor -- start 2020-02-11T16:30:39.631 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.628+0000 7f1d35b53700 1 -- start start 2020-02-11T16:30:39.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.629+0000 7f1d35b53700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 0x7f1d300a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:39.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.629+0000 7f1d35b53700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d300a4350 con 0x7f1d300a2fa0 2020-02-11T16:30:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.629+0000 7f1d35b53700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d300a3a40 con 0x7f1d30131280 2020-02-11T16:30:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.629+0000 7f1d35b53700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300a1e60 con 0x7f1d300a5b20 2020-02-11T16:30:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.629+0000 7f1d2effd700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 msgr2=0x7f1d300a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.629+0000 7f1d2ffff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f1d30131280 legacy=0x7f1d301316f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.629+0000 7f1d2effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 0x7f1d300a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.629+0000 7f1d2f7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1d300a2fa0 0x7f1d300a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40376/0 (socket says 172.21.15.88:40376) 2020-02-11T16:30:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.629+0000 7f1d2f7fe700 1 -- 172.21.15.88:0/2482170754 learned_addr learned my addr 172.21.15.88:0/2482170754 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:39.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.830+0000 7f1d2ffff700 1 -- 172.21.15.88:0/2482170754 >> v1:172.21.15.88:6789/0 conn(0x7f1d30131280 legacy=0x7f1d301316f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:39.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.830+0000 7f1d2effd700 1 -- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 msgr2=0x7f1d300a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:39.832 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:39.830+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 0x7f1d300a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:30:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:40.231+0000 7f1d2ffff700 1 -- 172.21.15.88:0/2482170754 >> v1:172.21.15.88:6789/0 conn(0x7f1d30131280 legacy=0x7f1d301316f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:40.231+0000 7f1d2effd700 1 -- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 msgr2=0x7f1d300a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:40.234 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:40.231+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 0x7f1d300a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:30:40.668 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 76% (126/164) Checking out files: 77% (127/164) Checking out files: 78% (128/164) Checking out files: 79% (130/164) Checking out files: 80% (132/164) Checking out files: 81% (133/164) Checking out files: 82% (135/164) Checking out files: 83% (137/164) Checking out files: 84% (138/164) Checking out files: 85% (140/164) Checking out files: 86% (142/164) Checking out files: 87% (143/164) Checking out files: 88% (145/164) Checking out files: 89% (146/164) Checking out files: 90% (148/164) Checking out files: 91% (150/164) Checking out files: 92% (151/164) Checking out files: 93% (153/164) Checking out files: 94% (155/164) Checking out files: 95% (156/164) Checking out files: 96% (158/164) Checking out files: 97% (160/164) Checking out files: 98% (161/164) Checking out files: 99% (163/164) Checking out files: 100% (164/164) Checking out files: 100% (164/164), done. 2020-02-11T16:30:40.753 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 007313fe84 v0.10 2020-02-11T16:30:40.756 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.10 2020-02-11T16:30:40.900 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:40.900 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.11 2020-02-11T16:30:40.901 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.11 2020-02-11T16:30:40.901 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.11 2020-02-11T16:30:40.901 INFO:tasks.workunit.client.0.smithi088.stdout:v0.11 2020-02-11T16:30:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:41.032+0000 7f1d2effd700 1 -- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 msgr2=0x7f1d300a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:41.032+0000 7f1d2ffff700 1 -- 172.21.15.88:0/2482170754 >> v1:172.21.15.88:6789/0 conn(0x7f1d30131280 legacy=0x7f1d301316f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:41.032+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 0x7f1d300a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:30:42.210 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 9fa6f5e7d0 v0.11 2020-02-11T16:30:42.212 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.11 2020-02-11T16:30:42.302 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:42.302 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.12 2020-02-11T16:30:42.303 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.12 2020-02-11T16:30:42.303 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.12 2020-02-11T16:30:42.303 INFO:tasks.workunit.client.0.smithi088.stdout:v0.12 2020-02-11T16:30:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:42.633+0000 7f1d2ffff700 1 -- 172.21.15.88:0/2482170754 >> v1:172.21.15.88:6789/0 conn(0x7f1d30131280 legacy=0x7f1d301316f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:42.637 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:42.635+0000 7f1d2effd700 1 -- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 msgr2=0x7f1d300a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:42.638 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:42.635+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 0x7f1d300a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:30:43.401 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at f524150822 v0.12 2020-02-11T16:30:43.404 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.12 2020-02-11T16:30:43.583 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:43.583 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.13 2020-02-11T16:30:43.584 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.13 2020-02-11T16:30:43.584 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.13 2020-02-11T16:30:43.584 INFO:tasks.workunit.client.0.smithi088.stdout:v0.13 2020-02-11T16:30:45.074 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 2b32297267 v0.13 2020-02-11T16:30:45.077 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.13 2020-02-11T16:30:45.238 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:45.238 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.14 2020-02-11T16:30:45.238 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.14 2020-02-11T16:30:45.239 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.14 2020-02-11T16:30:45.239 INFO:tasks.workunit.client.0.smithi088.stdout:v0.14 2020-02-11T16:30:45.838 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:45.836+0000 7f1d2ffff700 1 -- 172.21.15.88:0/2482170754 >> v1:172.21.15.88:6789/0 conn(0x7f1d30131280 legacy=0x7f1d301316f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:45.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:45.838+0000 7f1d2effd700 1 -- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 msgr2=0x7f1d300a1520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:45.840 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:45.838+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 0x7f1d300a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:30:46.743 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 1ec1e8d6fb v0.14 2020-02-11T16:30:46.746 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.14 2020-02-11T16:30:46.923 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:46.923 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.15 2020-02-11T16:30:46.923 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.15 2020-02-11T16:30:46.923 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.15 2020-02-11T16:30:46.924 INFO:tasks.workunit.client.0.smithi088.stdout:v0.15 2020-02-11T16:30:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.340+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248757326 0 0) 0x7f1d300a4350 con 0x7f1d300a2fa0 2020-02-11T16:30:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.340+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d1c003230 con 0x7f1d300a2fa0 2020-02-11T16:30:47.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3930652613 0 0) 0x7f1d1c003230 con 0x7f1d300a2fa0 2020-02-11T16:30:47.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 msgr2=0x7f1d300a1520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:30:47.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 --2- 172.21.15.88:0/2482170754 >> v2:172.21.15.88:3300/0 conn(0x7f1d300a5b20 0x7f1d300a1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:47.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 >> v1:172.21.15.88:6789/0 conn(0x7f1d30131280 legacy=0x7f1d301316f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:30:47.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d300a3ce0 con 0x7f1d300a2fa0 2020-02-11T16:30:47.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f1d240015d0 con 0x7f1d300a2fa0 2020-02-11T16:30:47.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 >> v1:172.21.15.52:6789/0 conn(0x7f1d300a2fa0 legacy=0x7f1d300a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c003720 0x7f1d1c003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 0x7f1d1c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c004a20 0x7f1d1c004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300a1e60 con 0x7f1d1c003fa0 2020-02-11T16:30:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c00b7b0 con 0x7f1d1c003720 2020-02-11T16:30:47.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c00b970 con 0x7f1d1c004a20 2020-02-11T16:30:47.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2f7fe700 1 -- 172.21.15.88:0/2482170754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c003720 msgr2=0x7f1d1c003b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:47.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c003720 0x7f1d1c003b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:47.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 0x7f1d1c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.343+0000 7f1d2ffff700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c004a20 0x7f1d1c004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.344+0000 7f1d2effd700 1 -- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c004a20 msgr2=0x7f1d1c004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:47.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.344+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c004a20 0x7f1d1c004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:47.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.344+0000 7f1d2effd700 1 -- 172.21.15.88:0/2482170754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c003720 msgr2=0x7f1d1c003b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:30:47.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.344+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c003720 0x7f1d1c003b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:47.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.344+0000 7f1d2effd700 1 -- 172.21.15.88:0/2482170754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c003230 con 0x7f1d1c003fa0 2020-02-11T16:30:47.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.344+0000 7f1d2ffff700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c004a20 0x7f1d1c004ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:30:47.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.344+0000 7f1d2ffff700 1 -- 172.21.15.88:0/2482170754 reap_dead start 2020-02-11T16:30:47.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.344+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 0x7f1d1c0044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d20003710 tx=0x7f1d2000ba40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.344+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 0x7f1d1c0044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d20003710 tx=0x7f1d2000ba40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.344+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 0x7f1d1c0044d0 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7f1d20003710 tx=0x7f1d2000ba40).ready entity=mon.0 client_cookie=d5e330839582bc65 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 0x7f1d1c0044d0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f1d20003710 tx=0x7f1d2000ba40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2000e960 con 0x7f1d1c003fa0 2020-02-11T16:30:47.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 0x7f1d1c0044d0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f1d20003710 tx=0x7f1d2000ba40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d2effd700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 0x7f1d1c0044d0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f1d20003710 tx=0x7f1d2000ba40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2000eac0 con 0x7f1d1c003fa0 2020-02-11T16:30:47.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d2e7fc700 1 -- 172.21.15.88:0/2482170754 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2000ee20 con 0x7f1d1c003fa0 2020-02-11T16:30:47.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d35b53700 1 -- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 msgr2=0x7f1d1c0044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d35b53700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 0x7f1d1c0044d0 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7f1d20003710 tx=0x7f1d2000ba40).stop 2020-02-11T16:30:47.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d35b53700 1 -- 172.21.15.88:0/2482170754 shutdown_connections 2020-02-11T16:30:47.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d35b53700 1 --2- 172.21.15.88:0/2482170754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d1c003fa0 0x7f1d1c0044d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d35b53700 1 -- 172.21.15.88:0/2482170754 >> 172.21.15.88:0/2482170754 conn(0x7f1d3009d110 msgr2=0x7f1d3009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d35b53700 1 -- 172.21.15.88:0/2482170754 shutdown_connections 2020-02-11T16:30:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.345+0000 7f1d35b53700 1 -- 172.21.15.88:0/2482170754 wait complete. 2020-02-11T16:30:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.346+0000 7f1d35b53700 1 Processor -- start 2020-02-11T16:30:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.346+0000 7f1d35b53700 1 -- start start 2020-02-11T16:30:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.347+0000 7f1d35b53700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.347+0000 7f1d35b53700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d30121c10 con 0x7f1d3009f0a0 2020-02-11T16:30:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.347+0000 7f1d35b53700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d30121120 con 0x7f1d3014ae60 2020-02-11T16:30:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.347+0000 7f1d35b53700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30130db0 con 0x7f1d1c003fa0 2020-02-11T16:30:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.347+0000 7f1d2ffff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f1d3014ae60 legacy=0x7f1d3014d250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.347+0000 7f1d2effd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1d3009f0a0 0x7f1d30123750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40410/0 (socket says 172.21.15.88:40410) 2020-02-11T16:30:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.347+0000 7f1d2effd700 1 -- 172.21.15.88:0/4155638041 learned_addr learned my addr 172.21.15.88:0/4155638041 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.347+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.347+0000 7f1d2cff9700 1 -- 172.21.15.88:0/4155638041 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211503809 0 0) 0x7f1d30121c10 con 0x7f1d3009f0a0 2020-02-11T16:30:47.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.347+0000 7f1d2cff9700 1 -- 172.21.15.88:0/4155638041 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d10002fe0 con 0x7f1d3009f0a0 2020-02-11T16:30:47.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2f7fe700 1 -- 172.21.15.88:0/4155638041 >> v1:172.21.15.88:6789/0 conn(0x7f1d3014ae60 legacy=0x7f1d3014d250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:47.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2f7fe700 1 -- 172.21.15.88:0/4155638041 >> v1:172.21.15.52:6789/0 conn(0x7f1d3009f0a0 legacy=0x7f1d30123750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.370 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2f7fe700 1 -- 172.21.15.88:0/4155638041 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30121350 con 0x7f1d1c003fa0 2020-02-11T16:30:47.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:47.371 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2cff9700 1 -- 172.21.15.88:0/4155638041 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2400c730 con 0x7f1d1c003fa0 2020-02-11T16:30:47.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2cff9700 1 -- 172.21.15.88:0/4155638041 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2400c890 con 0x7f1d1c003fa0 2020-02-11T16:30:47.372 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d35b53700 1 -- 172.21.15.88:0/4155638041 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d301215f0 con 0x7f1d1c003fa0 2020-02-11T16:30:47.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2cff9700 1 -- 172.21.15.88:0/4155638041 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2400cc30 con 0x7f1d1c003fa0 2020-02-11T16:30:47.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d35b53700 1 -- 172.21.15.88:0/4155638041 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d301274e0 con 0x7f1d1c003fa0 2020-02-11T16:30:47.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.348+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.373 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.349+0000 7f1d2cff9700 1 -- 172.21.15.88:0/4155638041 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f1d240044f0 con 0x7f1d1c003fa0 2020-02-11T16:30:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.349+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.349+0000 7f1d35b53700 1 -- 172.21.15.88:0/4155638041 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d301230b0 con 0x7f1d1c003fa0 2020-02-11T16:30:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.349+0000 7f1d2cff9700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d10039ed0 0x7f1d1003c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.349+0000 7f1d2cff9700 1 -- 172.21.15.88:0/4155638041 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f1d24049530 con 0x7f1d1c003fa0 2020-02-11T16:30:47.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.349+0000 7f1d2effd700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d10039ed0 0x7f1d1003c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.350+0000 7f1d2effd700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d10039ed0 0x7f1d1003c390 crc :-1 s=READY pgs=552 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:47.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.353+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.375 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.353+0000 7f1d2cff9700 1 -- 172.21.15.88:0/4155638041 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f1d2402e8c0 con 0x7f1d1c003fa0 2020-02-11T16:30:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.616+0000 7f1d35b53700 1 -- 172.21.15.88:0/4155638041 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1d300565b0 con 0x7f1d1c003fa0 2020-02-11T16:30:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.616+0000 7f1d2f7fe700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.616+0000 7f1d2cff9700 1 -- 172.21.15.88:0/4155638041 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f1d240315a0 con 0x7f1d1c003fa0 2020-02-11T16:30:47.618 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":208,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.618+0000 7f1d35b53700 1 -- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d10039ed0 msgr2=0x7f1d1003c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.618+0000 7f1d35b53700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d10039ed0 0x7f1d1003c390 crc :-1 s=READY pgs=552 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.618+0000 7f1d35b53700 1 -- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 msgr2=0x7f1d30121f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.618+0000 7f1d35b53700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f1d3009ece0 tx=0x7f1d24010ba0).stop 2020-02-11T16:30:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.618+0000 7f1d35b53700 1 -- 172.21.15.88:0/4155638041 shutdown_connections 2020-02-11T16:30:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.618+0000 7f1d35b53700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1d10039ed0 0x7f1d1003c390 crc :-1 s=CLOSED pgs=552 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.619+0000 7f1d35b53700 1 --2- 172.21.15.88:0/4155638041 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d1c003fa0 0x7f1d30121f10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.619+0000 7f1d35b53700 1 -- 172.21.15.88:0/4155638041 >> 172.21.15.88:0/4155638041 conn(0x7f1d3009d110 msgr2=0x7f1d3009d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:47.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.621+0000 7f1d35b53700 1 -- 172.21.15.88:0/4155638041 shutdown_connections 2020-02-11T16:30:47.622 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.621+0000 7f1d35b53700 1 -- 172.21.15.88:0/4155638041 wait complete. 2020-02-11T16:30:47.642 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":208,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:30:47.643 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:30:47.643 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:30:47.765 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.763+0000 7f2813d73700 1 Processor -- start 2020-02-11T16:30:47.766 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.764+0000 7f2813d73700 1 -- start start 2020-02-11T16:30:47.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.764+0000 7f2813d73700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f280c0a2fa0 0x7f280c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:47.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.764+0000 7f2813d73700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f280c0a5410 0x7f280c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:47.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.764+0000 7f2813d73700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c0a4350 con 0x7f280c131280 2020-02-11T16:30:47.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.764+0000 7f2813d73700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c0a1e60 con 0x7f280c0a2fa0 2020-02-11T16:30:47.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.764+0000 7f2813d73700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0a3450 con 0x7f280c0a5410 2020-02-11T16:30:47.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.764+0000 7f2812310700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f280c131280 legacy=0x7f280c1316f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:47.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f281130e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f280c0a5410 0x7f280c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.779 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f280c0a2fa0 0x7f280c0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f281130e700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f280c0a5410 0x7f280c0a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55332/0 (socket says 172.21.15.88:55332) 2020-02-11T16:30:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f281130e700 1 -- 172.21.15.88:0/593546218 learned_addr learned my addr 172.21.15.88:0/593546218 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 -- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f280c0a5410 msgr2=0x7f280c0a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 --2- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f280c0a5410 0x7f280c0a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 -- 172.21.15.88:0/593546218 >> v1:172.21.15.88:6789/0 conn(0x7f280c131280 legacy=0x7f280c1316f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:30:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 -- 172.21.15.88:0/593546218 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0a3a40 con 0x7f280c0a2fa0 2020-02-11T16:30:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f281130e700 1 --2- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f280c0a5410 0x7f280c0a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:30:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 --2- 172.21.15.88:0/593546218 >> v2:172.21.15.52:3300/0 conn(0x7f280c0a2fa0 0x7f280c0a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f280c0a52f0 tx=0x7f28080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 --2- 172.21.15.88:0/593546218 >> v2:172.21.15.52:3300/0 conn(0x7f280c0a2fa0 0x7f280c0a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f280c0a52f0 tx=0x7f28080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 --2- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280c0a2fa0 0x7f280c0a1520 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7f280c0a52f0 tx=0x7f28080088e0).ready entity=mon.0 client_cookie=9645b61f9c5b294a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 --2- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280c0a2fa0 0x7f280c0a1520 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7f280c0a52f0 tx=0x7f28080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2810b0d700 1 -- 172.21.15.88:0/593546218 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2808008e40 con 0x7f280c0a2fa0 2020-02-11T16:30:47.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 --2- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280c0a2fa0 0x7f280c0a1520 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7f280c0a52f0 tx=0x7f28080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2810b0d700 1 -- 172.21.15.88:0/593546218 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28080115b0 con 0x7f280c0a2fa0 2020-02-11T16:30:47.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2811b0f700 1 --2- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280c0a2fa0 0x7f280c0a1520 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7f280c0a52f0 tx=0x7f28080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2810b0d700 1 -- 172.21.15.88:0/593546218 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2808011990 con 0x7f280c0a2fa0 2020-02-11T16:30:47.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2813d73700 1 -- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280c0a2fa0 msgr2=0x7f280c0a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.765+0000 7f2813d73700 1 --2- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280c0a2fa0 0x7f280c0a1520 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7f280c0a52f0 tx=0x7f28080088e0).stop 2020-02-11T16:30:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.766+0000 7f2813d73700 1 -- 172.21.15.88:0/593546218 shutdown_connections 2020-02-11T16:30:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.766+0000 7f2813d73700 1 --2- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280c0a2fa0 0x7f280c0a1520 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.766+0000 7f2813d73700 1 --2- 172.21.15.88:0/593546218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f280c0a5410 0x7f280c0a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:47.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.766+0000 7f2813d73700 1 -- 172.21.15.88:0/593546218 >> 172.21.15.88:0/593546218 conn(0x7f280c09d110 msgr2=0x7f280c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:47.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.766+0000 7f2813d73700 1 -- 172.21.15.88:0/593546218 shutdown_connections 2020-02-11T16:30:47.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.766+0000 7f2813d73700 1 -- 172.21.15.88:0/593546218 wait complete. 2020-02-11T16:30:47.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.767+0000 7f2813d73700 1 Processor -- start 2020-02-11T16:30:47.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.767+0000 7f2813d73700 1 -- start start 2020-02-11T16:30:47.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f2813d73700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f280c0a5410 0x7f280c0a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:47.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f2813d73700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c137ff0 con 0x7f280c131280 2020-02-11T16:30:47.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f2813d73700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c138290 con 0x7f280c0a2fa0 2020-02-11T16:30:47.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f2813d73700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c135c70 con 0x7f280c0a5410 2020-02-11T16:30:47.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f281130e700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f280c0a5410 msgr2=0x7f280c0a0c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:47.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f2811b0f700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f280c0a2fa0 legacy=0x7f280c135530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:47.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f281130e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f280c0a5410 0x7f280c0a0c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:47.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f2812310700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f280c131280 0x7f280c12ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40426/0 (socket says 172.21.15.88:40426) 2020-02-11T16:30:47.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f2812310700 1 -- 172.21.15.88:0/3770769753 learned_addr learned my addr 172.21.15.88:0/3770769753 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:30:47.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959097300 0 0) 0x7f280c137ff0 con 0x7f280c131280 2020-02-11T16:30:47.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ec002fe0 con 0x7f280c131280 2020-02-11T16:30:47.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3990532217 0 0) 0x7f27ec002fe0 con 0x7f280c131280 2020-02-11T16:30:47.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f280c137ff0 con 0x7f280c131280 2020-02-11T16:30:47.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f2804008650 con 0x7f280c131280 2020-02-11T16:30:47.787 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 >> v2:172.21.15.88:3300/0 conn(0x7f280c0a5410 msgr2=0x7f280c0a0c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:47.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.768+0000 7f27faffd700 1 --2- 172.21.15.88:0/3770769753 >> v2:172.21.15.88:3300/0 conn(0x7f280c0a5410 0x7f280c0a0c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 >> v1:172.21.15.88:6789/0 conn(0x7f280c0a2fa0 legacy=0x7f280c135530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:47.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 >> v1:172.21.15.52:6789/0 conn(0x7f280c131280 legacy=0x7f280c12ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27ec0049b0 0x7f27ec004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:47.788 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27ec003f30 0x7f27ec0043b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c135c70 con 0x7f27ec0052b0 2020-02-11T16:30:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec00b810 con 0x7f27ec003f30 2020-02-11T16:30:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec00b9d0 con 0x7f27ec0049b0 2020-02-11T16:30:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f2812310700 1 -- 172.21.15.88:0/3770769753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27ec003f30 msgr2=0x7f27ec0043b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2020-02-11T16:30:47.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f2812310700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27ec003f30 0x7f27ec0043b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:30:47.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27ec0049b0 0x7f27ec004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 -- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27ec0049b0 msgr2=0x7f27ec004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.790 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27ec0049b0 0x7f27ec004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 -- 172.21.15.88:0/3770769753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27ec003f30 msgr2=0x7f27ec0043b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:47.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27ec003f30 0x7f27ec0043b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f2812310700 1 -- 172.21.15.88:0/3770769753 reap_dead start 2020-02-11T16:30:47.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 -- 172.21.15.88:0/3770769753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c138530 con 0x7f27ec0052b0 2020-02-11T16:30:47.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f2813d73700 1 -- 172.21.15.88:0/3770769753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c066cd0 con 0x7f27ec0052b0 2020-02-11T16:30:47.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27fc007720 tx=0x7f27fc00ca10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f2813d73700 1 -- 172.21.15.88:0/3770769753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c09ffe0 con 0x7f27ec0052b0 2020-02-11T16:30:47.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27fc007720 tx=0x7f27fc00ca10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7f27fc007720 tx=0x7f27fc00ca10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:47.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7f27fc007720 tx=0x7f27fc00ca10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27fc008e10 con 0x7f27ec0052b0 2020-02-11T16:30:47.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7f27fc007720 tx=0x7f27fc00ca10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7f27fc007720 tx=0x7f27fc00ca10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00b250 con 0x7f27ec0052b0 2020-02-11T16:30:47.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.769+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27fc00b5f0 con 0x7f27ec0052b0 2020-02-11T16:30:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.770+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7f27fc007720 tx=0x7f27fc00ca10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.770+0000 7f281130e700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7f27fc007720 tx=0x7f27fc00ca10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.770+0000 7f2813d73700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 0x7f27e80058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.770+0000 7f2813d73700 1 -- 172.21.15.88:0/3770769753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e8005ea0 con 0x7f27e8003420 2020-02-11T16:30:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.770+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 0x7f27e80058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f27fc00b750 con 0x7f27ec0052b0 2020-02-11T16:30:47.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f2811b0f700 1 -- 172.21.15.88:0/3770769753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27e8006060 con 0x7f27e8003420 2020-02-11T16:30:47.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 0x7f27e80058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f27faffd700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27ec03dbd0 0x7f27ec040090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:47.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f27fc049820 con 0x7f27ec0052b0 2020-02-11T16:30:47.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 0x7f27e80058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 0x7f27e80058e0 secure :-1 s=READY pgs=455 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:47.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f2812310700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27ec03dbd0 0x7f27ec040090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 0x7f27e80058e0 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2808007bd0 con 0x7f27e8003420 2020-02-11T16:30:47.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f2812310700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27ec03dbd0 0x7f27ec040090 crc :-1 s=READY pgs=553 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:47.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 0x7f27e80058e0 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f2808007340 con 0x7f27e8003420 2020-02-11T16:30:47.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 msgr2=0x7f27e80058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f27faffd700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 0x7f27e80058e0 secure :-1 s=READY pgs=455 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).stop 2020-02-11T16:30:47.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 msgr2=0x7f27e80058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:47.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.771+0000 7f27faffd700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 0x7f27e80058e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.782+0000 7f2813d73700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 0x7f27e80068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.782+0000 7f2813d73700 1 -- 172.21.15.88:0/3770769753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e8006da0 con 0x7f27e8006440 2020-02-11T16:30:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 0x7f27e80068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f2811b0f700 1 -- 172.21.15.88:0/3770769753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f27e8006f60 con 0x7f27e8006440 2020-02-11T16:30:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 0x7f27e80068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 0x7f27e80068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 0x7f27e80068f0 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:47.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 0x7f27e80068f0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2808012450 con 0x7f27e8006440 2020-02-11T16:30:47.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f2811b0f700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 0x7f27e80068f0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:47.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4351 (secure 0 0 0) 0x7f28080125b0 con 0x7f27e8006440 2020-02-11T16:30:47.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 msgr2=0x7f27e80068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f27faffd700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 0x7f27e80068f0 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7f2808000b80 tx=0x7f280c067410).stop 2020-02-11T16:30:47.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f27faffd700 1 -- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 msgr2=0x7f27e80068f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:47.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.783+0000 7f27faffd700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 0x7f27e80068f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 -- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27ec03dbd0 msgr2=0x7f27ec040090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27ec03dbd0 0x7f27ec040090 crc :-1 s=READY pgs=553 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 -- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 msgr2=0x7f27ec0039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:47.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7f27fc007720 tx=0x7f27fc00ca10).stop 2020-02-11T16:30:47.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 -- 172.21.15.88:0/3770769753 shutdown_connections 2020-02-11T16:30:47.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27ec03dbd0 0x7f27ec040090 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27ec0052b0 0x7f27ec0039c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8003420 0x7f27e80058e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 --2- 172.21.15.88:0/3770769753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e8006440 0x7f27e80068f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:47.807 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 -- 172.21.15.88:0/3770769753 >> 172.21.15.88:0/3770769753 conn(0x7f280c09d110 msgr2=0x7f280c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:47.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 -- 172.21.15.88:0/3770769753 shutdown_connections 2020-02-11T16:30:47.808 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.784+0000 7f2813d73700 1 -- 172.21.15.88:0/3770769753 wait complete. 2020-02-11T16:30:47.808 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:30:47.808 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:30:47.809 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 208, 2020-02-11T16:30:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:30:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:30:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:30:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:30:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:47.810 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:30:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:30:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:47.811 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:30:47.812 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:30:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:47.813 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:47.815 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:47.815 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:47.815 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:47.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.815 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:30:47.816 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:30:47.816 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:30:47.816 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:30:47.816 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:30:47.816 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:30:47.816 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:47.817 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:47.817 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:30:47.817 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:30:47.817 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:30:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:47.818 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:30:47.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:30:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:47.820 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:30:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:30:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:47.822 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:30:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:30:47.823 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.824 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:30:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:30:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:47.825 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:30:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:47.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:30:47.828 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.829 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:30:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:30:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:47.831 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:30:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:47.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:30:47.833 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.834 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:30:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:30:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:47.835 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:30:47.836 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:30:47.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.837 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:47.837 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:47.837 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:30:47.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:47.839 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:30:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:47.840 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:30:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:30:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.841 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:30:47.842 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:30:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:30:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:47.844 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:47.844 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:30:47.845 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:30:47.865 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:30:47.869 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:30:47.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.987+0000 7ff4a022d700 1 Processor -- start 2020-02-11T16:30:47.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.987+0000 7ff4a022d700 1 -- start start 2020-02-11T16:30:47.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff4a022d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff4980a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:47.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff4a022d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff498138280 0x7ff4981386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:30:47.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff4a022d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4980adb40 con 0x7ff49813b1c0 2020-02-11T16:30:47.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff4a022d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff498137bf0 con 0x7ff498138280 2020-02-11T16:30:47.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff4a022d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff498138b40 con 0x7ff4980ad380 2020-02-11T16:30:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49dfc9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff4980a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49d7c8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff498138280 0x7ff4981386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49dfc9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff4980a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55356/0 (socket says 172.21.15.88:55356) 2020-02-11T16:30:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49dfc9700 1 -- 172.21.15.88:0/1519257898 learned_addr learned my addr 172.21.15.88:0/1519257898 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49d7c8700 1 -- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 msgr2=0x7ff4980a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:30:47.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49d7c8700 1 --2- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff4980a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:47.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49d7c8700 1 -- 172.21.15.88:0/1519257898 >> v1:172.21.15.52:6789/0 conn(0x7ff49813b1c0 legacy=0x7ff49813b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:48.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49cfc7700 1 -- 172.21.15.88:0/1519257898 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832215921 0 0) 0x7ff4980adb40 con 0x7ff49813b1c0 2020-02-11T16:30:48.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49d7c8700 1 -- 172.21.15.88:0/1519257898 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498137de0 con 0x7ff498138280 2020-02-11T16:30:48.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff4980a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:30:48.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.988+0000 7ff49d7c8700 1 --2- 172.21.15.88:0/1519257898 >> v2:172.21.15.52:3300/0 conn(0x7ff498138280 0x7ff4981386e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff488002f30 tx=0x7ff4880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.989+0000 7ff49d7c8700 1 --2- 172.21.15.88:0/1519257898 >> v2:172.21.15.52:3300/0 conn(0x7ff498138280 0x7ff4981386e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff488002f30 tx=0x7ff4880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.989+0000 7ff49d7c8700 1 --2- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff498138280 0x7ff4981386e0 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7ff488002f30 tx=0x7ff4880088e0).ready entity=mon.0 client_cookie=602a03344bca33ea server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:48.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.989+0000 7ff49d7c8700 1 --2- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff498138280 0x7ff4981386e0 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7ff488002f30 tx=0x7ff4880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.989+0000 7ff49cfc7700 1 -- 172.21.15.88:0/1519257898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff488008e40 con 0x7ff498138280 2020-02-11T16:30:48.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.989+0000 7ff49d7c8700 1 --2- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff498138280 0x7ff4981386e0 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7ff488002f30 tx=0x7ff4880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.989+0000 7ff49cfc7700 1 -- 172.21.15.88:0/1519257898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4880115f0 con 0x7ff498138280 2020-02-11T16:30:48.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.989+0000 7ff49d7c8700 1 --2- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff498138280 0x7ff4981386e0 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7ff488002f30 tx=0x7ff4880088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.989+0000 7ff49cfc7700 1 -- 172.21.15.88:0/1519257898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff488011990 con 0x7ff498138280 2020-02-11T16:30:48.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.989+0000 7ff4a022d700 1 -- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff498138280 msgr2=0x7ff4981386e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:48.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.989+0000 7ff4a022d700 1 --2- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff498138280 0x7ff4981386e0 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7ff488002f30 tx=0x7ff4880088e0).stop 2020-02-11T16:30:48.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.990+0000 7ff4a022d700 1 -- 172.21.15.88:0/1519257898 shutdown_connections 2020-02-11T16:30:48.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.990+0000 7ff4a022d700 1 --2- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff4980a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:30:48.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.990+0000 7ff4a022d700 1 --2- 172.21.15.88:0/1519257898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff498138280 0x7ff4981386e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:48.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.990+0000 7ff4a022d700 1 -- 172.21.15.88:0/1519257898 >> 172.21.15.88:0/1519257898 conn(0x7ff49805ac70 msgr2=0x7ff4980ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:48.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.990+0000 7ff4a022d700 1 -- 172.21.15.88:0/1519257898 shutdown_connections 2020-02-11T16:30:48.002 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.990+0000 7ff4a022d700 1 -- 172.21.15.88:0/1519257898 wait complete. 2020-02-11T16:30:48.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff4a022d700 1 Processor -- start 2020-02-11T16:30:48.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff4a022d700 1 -- start start 2020-02-11T16:30:48.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff4a022d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff498132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:48.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff4a022d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff49813b1c0 0x7ff49814d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:48.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff4a022d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff498130f10 con 0x7ff498138280 2020-02-11T16:30:48.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff4a022d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff498138dc0 con 0x7ff49813b1c0 2020-02-11T16:30:48.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff4a022d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49812ec40 con 0x7ff4980ad380 2020-02-11T16:30:48.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff49d7c8700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7ff498138280 legacy=0x7ff49814cda0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6789/0 2020-02-11T16:30:48.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff49dfc9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff498132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:48.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff49e7ca700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff49813b1c0 0x7ff49814d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:48.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff49dfc9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff498132570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55362/0 (socket says 172.21.15.88:55362) 2020-02-11T16:30:48.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff49e7ca700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff49813b1c0 0x7ff49814d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:47028/0 (socket says 172.21.15.88:47028) 2020-02-11T16:30:48.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.991+0000 7ff49dfc9700 1 -- 172.21.15.88:0/361946981 learned_addr learned my addr 172.21.15.88:0/361946981 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:30:48.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49e7ca700 1 -- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 msgr2=0x7ff498132570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:48.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49e7ca700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff498132570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:48.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49e7ca700 1 -- 172.21.15.88:0/361946981 >> v1:172.21.15.88:6789/0 conn(0x7ff498138280 legacy=0x7ff49814cda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:30:48.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49e7ca700 1 -- 172.21.15.88:0/361946981 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498137630 con 0x7ff49813b1c0 2020-02-11T16:30:48.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4980ad380 0x7ff498132570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:30:48.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49e7ca700 1 --2- 172.21.15.88:0/361946981 >> v2:172.21.15.52:3300/0 conn(0x7ff49813b1c0 0x7ff49814d4b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff49813b140 tx=0x7ff490010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49e7ca700 1 --2- 172.21.15.88:0/361946981 >> v2:172.21.15.52:3300/0 conn(0x7ff49813b1c0 0x7ff49814d4b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff49813b140 tx=0x7ff490010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49e7ca700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff49813b1c0 0x7ff49814d4b0 secure :-1 s=READY pgs=459 cs=0 l=1 rx=0x7ff49813b140 tx=0x7ff490010c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:48.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49e7ca700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff49813b1c0 0x7ff49814d4b0 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7ff49813b140 tx=0x7ff490010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff490012260 con 0x7ff49813b1c0 2020-02-11T16:30:48.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49e7ca700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff49813b1c0 0x7ff49814d4b0 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7ff49813b140 tx=0x7ff490010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4900123c0 con 0x7ff49813b1c0 2020-02-11T16:30:48.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff4a022d700 1 -- 172.21.15.88:0/361946981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff498137990 con 0x7ff49813b1c0 2020-02-11T16:30:48.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff49e7ca700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff49813b1c0 0x7ff49814d4b0 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7ff49813b140 tx=0x7ff490010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4900127e0 con 0x7ff49813b1c0 2020-02-11T16:30:48.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.992+0000 7ff4a022d700 1 -- 172.21.15.88:0/361946981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff498137100 con 0x7ff49813b1c0 2020-02-11T16:30:48.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.993+0000 7ff49e7ca700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff49813b1c0 0x7ff49814d4b0 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7ff49813b140 tx=0x7ff490010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.993+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff490013060 con 0x7ff49813b1c0 2020-02-11T16:30:48.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.993+0000 7ff49e7ca700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff49813b1c0 0x7ff49814d4b0 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7ff49813b140 tx=0x7ff490010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.993+0000 7ff4a022d700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 0x7ff498065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:48.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.993+0000 7ff4a022d700 1 -- 172.21.15.88:0/361946981 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49805e2f0 con 0x7ff4981329d0 2020-02-11T16:30:48.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.994+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 0x7ff498065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:48.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.994+0000 7ff486ffd700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff478039b90 0x7ff47803c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:48.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.994+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7ff490003070 con 0x7ff49813b1c0 2020-02-11T16:30:48.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.994+0000 7ff49d7c8700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff478039b90 0x7ff47803c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:48.008 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.994+0000 7ff49dfc9700 1 -- 172.21.15.88:0/361946981 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff49814c960 con 0x7ff4981329d0 2020-02-11T16:30:48.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.994+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 0x7ff498065d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.994+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 0x7ff498065d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.994+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 0x7ff498065d10 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:48.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.994+0000 7ff49d7c8700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff478039b90 0x7ff47803c050 crc :-1 s=READY pgs=554 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:48.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.994+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 0x7ff498065d10 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.009 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.995+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff49400e350 con 0x7ff4981329d0 2020-02-11T16:30:48.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.995+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 0x7ff498065d10 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.995+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff49400b190 con 0x7ff4981329d0 2020-02-11T16:30:48.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.995+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 msgr2=0x7ff498065d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:48.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.995+0000 7ff486ffd700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 0x7ff498065d10 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).stop 2020-02-11T16:30:48.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.995+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 msgr2=0x7ff498065d10 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:48.010 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:47.995+0000 7ff486ffd700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4981329d0 0x7ff498065d10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:48.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.004+0000 7ff4a022d700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 0x7ff498135f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:30:48.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.004+0000 7ff4a022d700 1 -- 172.21.15.88:0/361946981 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff498137290 con 0x7ff498135b40 2020-02-11T16:30:48.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.005+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 0x7ff498135f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:30:48.013 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.005+0000 7ff49dfc9700 1 -- 172.21.15.88:0/361946981 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff4980565b0 con 0x7ff498135b40 2020-02-11T16:30:48.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.005+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 0x7ff498135f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.005+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 0x7ff498135f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.005+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 0x7ff498135f50 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:30:48.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.005+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 0x7ff498135f50 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.005+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff49400c8f0 con 0x7ff498135b40 2020-02-11T16:30:48.014 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff49dfc9700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 0x7ff498135f50 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:30:48.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4009 (secure 0 0 0) 0x7ff49400ca50 con 0x7ff498135b40 2020-02-11T16:30:48.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 msgr2=0x7ff498135f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:48.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff486ffd700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 0x7ff498135f50 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).stop 2020-02-11T16:30:48.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff486ffd700 1 -- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 msgr2=0x7ff498135f50 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:30:48.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff486ffd700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff498135b40 0x7ff498135f50 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0x7ff494002ef0 tx=0x7ff494011430).stop 2020-02-11T16:30:48.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff4a022d700 1 -- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff478039b90 msgr2=0x7ff47803c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:48.015 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff4a022d700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff478039b90 0x7ff47803c050 crc :-1 s=READY pgs=554 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:48.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff4a022d700 1 -- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff49813b1c0 msgr2=0x7ff49814d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:30:48.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff4a022d700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff49813b1c0 0x7ff49814d4b0 secure :-1 s=READY pgs=459 cs=0 l=1 rx=0x7ff49813b140 tx=0x7ff490010c00).stop 2020-02-11T16:30:48.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff49e7ca700 1 -- 172.21.15.88:0/361946981 reap_dead start 2020-02-11T16:30:48.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff49e7ca700 1 -- 172.21.15.88:0/361946981 reap_dead start 2020-02-11T16:30:48.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff4a022d700 1 -- 172.21.15.88:0/361946981 shutdown_connections 2020-02-11T16:30:48.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff4a022d700 1 --2- 172.21.15.88:0/361946981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff49813b1c0 0x7ff49814d4b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:30:48.016 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff4a022d700 1 -- 172.21.15.88:0/361946981 >> 172.21.15.88:0/361946981 conn(0x7ff49805ac70 msgr2=0x7ff498069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:30:48.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff4a022d700 1 -- 172.21.15.88:0/361946981 shutdown_connections 2020-02-11T16:30:48.017 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:30:48.006+0000 7ff4a022d700 1 -- 172.21.15.88:0/361946981 wait complete. 2020-02-11T16:30:48.017 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:30:48.017 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:48.017 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:48.017 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:30:48.017 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 208, 2020-02-11T16:30:48.018 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:30:48.018 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:30:48.018 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:30:48.018 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:48.018 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:30:48.018 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:48.018 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:30:48.019 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:30:48.019 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:48.019 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:48.019 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:48.019 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:48.019 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:48.019 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:48.020 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:48.020 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:30:48.020 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:30:48.020 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:48.020 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:48.020 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:48.020 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:48.020 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:48.021 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:48.021 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:48.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.021 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:30:48.021 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:30:48.021 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:30:48.021 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:30:48.022 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:30:48.022 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:30:48.022 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:48.022 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:30:48.022 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:30:48.022 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:30:48.022 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:30:48.023 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:30:48.023 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:30:48.023 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:30:48.023 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:30:48.023 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:30:48.023 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:30:48.023 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:30:48.024 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:48.024 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:30:48.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.024 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:30:48.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.024 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:30:48.024 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:30:48.024 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:48.025 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:48.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.025 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:48.025 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:30:48.025 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:48.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.026 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:48.026 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:30:48.026 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:48.026 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:48.026 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:48.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.026 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:30:48.027 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:30:48.027 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:48.027 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:48.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.027 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:30:48.027 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:30:48.027 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:48.028 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:48.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.028 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:48.028 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:30:48.028 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:48.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.029 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:48.029 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:30:48.029 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:48.029 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:48.029 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:48.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.029 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:30:48.030 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:30:48.030 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:48.030 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:48.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.030 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:30:48.030 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:30:48.031 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:30:48.031 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:30:48.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.031 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:30:48.031 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:30:48.032 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:48.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.032 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:30:48.033 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:30:48.033 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:30:48.033 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:48.033 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:48.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.034 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:30:48.034 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:30:48.034 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:30:48.034 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:30:48.034 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:48.035 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:48.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:30:48.035 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:30:48.035 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:30:48.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.036 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:48.036 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:48.036 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:48.036 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:48.037 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:48.037 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:30:48.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.037 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:48.038 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:48.038 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:30:48.038 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:48.038 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:30:48.038 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:30:48.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:30:48.039 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:30:48.039 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:30:48.039 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:30:48.040 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:48.040 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:30:48.040 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:30:48.040 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:30:48.042 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:30:48.481 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at ab3c421eb9 v0.15 2020-02-11T16:30:48.486 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.15 2020-02-11T16:30:48.735 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:48.735 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.16 2020-02-11T16:30:48.735 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.16 2020-02-11T16:30:48.735 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.16 2020-02-11T16:30:48.736 INFO:tasks.workunit.client.0.smithi088.stdout:v0.16 2020-02-11T16:30:50.102 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 38dbaa5175 v0.16 2020-02-11T16:30:50.105 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.16 2020-02-11T16:30:50.186 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:50.187 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.17 2020-02-11T16:30:50.187 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.17 2020-02-11T16:30:50.187 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.17 2020-02-11T16:30:50.187 INFO:tasks.workunit.client.0.smithi088.stdout:v0.17 2020-02-11T16:30:51.987 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 85% (185/217) Checking out files: 86% (187/217) Checking out files: 87% (189/217) Checking out files: 88% (191/217) Checking out files: 89% (194/217) Checking out files: 90% (196/217) Checking out files: 91% (198/217) Checking out files: 92% (200/217) Checking out files: 93% (202/217) Checking out files: 94% (204/217) Checking out files: 95% (207/217) Checking out files: 96% (209/217) Checking out files: 97% (211/217) Checking out files: 98% (213/217) Checking out files: 99% (215/217) Checking out files: 100% (217/217) Checking out files: 100% (217/217), done. 2020-02-11T16:30:52.035 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at dac3a8c35f v0.17 2020-02-11T16:30:52.037 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.17 2020-02-11T16:30:52.092 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:52.092 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.18 2020-02-11T16:30:52.092 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.18 2020-02-11T16:30:52.092 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.18 2020-02-11T16:30:52.092 INFO:tasks.workunit.client.0.smithi088.stdout:v0.18 2020-02-11T16:30:57.120 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 23% (183/779) Checking out files: 24% (187/779) Checking out files: 25% (195/779) Checking out files: 26% (203/779) Checking out files: 27% (211/779) Checking out files: 28% (219/779) Checking out files: 29% (226/779) Checking out files: 30% (234/779) Checking out files: 31% (242/779) Checking out files: 32% (250/779) Checking out files: 33% (258/779) Checking out files: 34% (265/779) Checking out files: 35% (273/779) Checking out files: 36% (281/779) Checking out files: 37% (289/779) Checking out files: 38% (297/779) Checking out files: 39% (304/779) Checking out files: 40% (312/779) Checking out files: 41% (320/779) Checking out files: 42% (328/779) Checking out files: 43% (335/779) Checking out files: 44% (343/779) Checking out files: 45% (351/779) Checking out files: 46% (359/779) Checking out files: 47% (367/779) Checking out files: 48% (374/779) Checking out files: 49% (382/779) Checking out files: 50% (390/779) Checking out files: 51% (398/779) Checking out files: 52% (406/779) Checking out files: 53% (413/779) Checking out files: 54% (421/779) Checking out files: 55% (429/779) Checking out files: 56% (437/779) Checking out files: 56% (438/779) Checking out files: 57% (445/779) Checking out files: 58% (452/779) Checking out files: 59% (460/779) Checking out files: 60% (468/779) Checking out files: 61% (476/779) Checking out files: 62% (483/779) Checking out files: 63% (491/779) Checking out files: 64% (499/779) Checking out files: 65% (507/779) Checking out files: 66% (515/779) Checking out files: 67% (522/779) Checking out files: 68% (530/779) Checking out files: 69% (538/779) Checking out files: 70% (546/779) Checking out files: 71% (554/779) Checking out files: 72% (561/779) Checking out files: 73% (569/779) Checking out files: 74% (577/779) Checking out files: 75% (585/779) Checking out files: 75% (588/779) Checking out files: 76% (593/779) Checking out files: 77% (600/779) Checking out files: 78% (608/779) Checking out files: 79% (616/779) Checking out files: 80% (624/779) Checking out files: 81% (631/779) Checking out files: 82% (639/779) Checking out files: 83% (647/779) Checking out files: 84% (655/779) Checking out files: 85% (663/779) Checking out files: 86% (670/779) Checking out files: 87% (678/779) Checking out files: 88% (686/779) Checking out files: 89% (694/779) Checking out files: 90% (702/779) Checking out files: 90% (706/779) Checking out files: 91% (709/779) Checking out files: 92% (717/779) Checking out files: 93% (725/779) Checking out files: 94% (733/779) Checking out files: 95% (741/779) Checking out files: 96% (748/779) Checking out files: 97% (756/779) Checking out files: 98% (764/779) Checking out files: 99% (772/779) Checking out files: 100% (779/779) Checking out files: 100% (779/779), done. 2020-02-11T16:30:57.237 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 2f10137986 v0.18 2020-02-11T16:30:57.240 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.18 2020-02-11T16:30:57.279 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:57.279 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.19 2020-02-11T16:30:57.279 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.19 2020-02-11T16:30:57.279 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.19 2020-02-11T16:30:57.280 INFO:tasks.workunit.client.0.smithi088.stdout:v0.19 2020-02-11T16:30:59.123 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 61% (133/217) Checking out files: 62% (135/217) Checking out files: 63% (137/217) Checking out files: 64% (139/217) Checking out files: 65% (142/217) Checking out files: 66% (144/217) Checking out files: 67% (146/217) Checking out files: 68% (148/217) Checking out files: 69% (150/217) Checking out files: 70% (152/217) Checking out files: 71% (155/217) Checking out files: 72% (157/217) Checking out files: 73% (159/217) Checking out files: 74% (161/217) Checking out files: 75% (163/217) Checking out files: 76% (165/217) Checking out files: 77% (168/217) Checking out files: 78% (170/217) Checking out files: 79% (172/217) Checking out files: 80% (174/217) Checking out files: 81% (176/217) Checking out files: 82% (178/217) Checking out files: 83% (181/217) Checking out files: 84% (183/217) Checking out files: 85% (185/217) Checking out files: 86% (187/217) Checking out files: 87% (189/217) Checking out files: 88% (191/217) Checking out files: 89% (194/217) Checking out files: 90% (196/217) Checking out files: 91% (198/217) Checking out files: 92% (200/217) Checking out files: 93% (202/217) Checking out files: 94% (204/217) Checking out files: 95% (207/217) Checking out files: 96% (209/217) Checking out files: 97% (211/217) Checking out files: 98% (213/217) Checking out files: 99% (215/217) Checking out files: 100% (217/217) Checking out files: 100% (217/217), done. 2020-02-11T16:30:59.198 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 98f5be53f8 v0.19 2020-02-11T16:30:59.201 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.19 2020-02-11T16:30:59.407 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:30:59.407 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.20 2020-02-11T16:30:59.407 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.20 2020-02-11T16:30:59.408 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.20 2020-02-11T16:30:59.408 INFO:tasks.workunit.client.0.smithi088.stdout:v0.20 2020-02-11T16:31:01.376 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 64% (158/245) Checking out files: 65% (160/245) Checking out files: 66% (162/245) Checking out files: 67% (165/245) Checking out files: 68% (167/245) Checking out files: 69% (170/245) Checking out files: 70% (172/245) Checking out files: 71% (174/245) Checking out files: 72% (177/245) Checking out files: 73% (179/245) Checking out files: 74% (182/245) Checking out files: 75% (184/245) Checking out files: 76% (187/245) Checking out files: 77% (189/245) Checking out files: 78% (192/245) Checking out files: 79% (194/245) Checking out files: 80% (196/245) Checking out files: 81% (199/245) Checking out files: 82% (201/245) Checking out files: 83% (204/245) Checking out files: 84% (206/245) Checking out files: 85% (209/245) Checking out files: 86% (211/245) Checking out files: 87% (214/245) Checking out files: 88% (216/245) Checking out files: 89% (219/245) Checking out files: 90% (221/245) Checking out files: 91% (223/245) Checking out files: 92% (226/245) Checking out files: 93% (228/245) Checking out files: 94% (231/245) Checking out files: 95% (233/245) Checking out files: 96% (236/245) Checking out files: 97% (238/245) Checking out files: 98% (241/245) Checking out files: 99% (243/245) Checking out files: 100% (245/245) Checking out files: 100% (245/245), done. 2020-02-11T16:31:01.426 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 266d2076b6 debian: fix up debian scripts 2020-02-11T16:31:01.430 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.20 2020-02-11T16:31:01.555 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:01.555 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.21 2020-02-11T16:31:01.555 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo v0.21 2020-02-11T16:31:01.555 INFO:tasks.workunit.client.0.smithi088.stderr:+ git reset --hard v0.21 2020-02-11T16:31:01.555 INFO:tasks.workunit.client.0.smithi088.stdout:v0.21 2020-02-11T16:31:06.276 INFO:tasks.workunit.client.0.smithi088.stderr:Checking out files: 30% (164/537) Checking out files: 31% (167/537) Checking out files: 32% (172/537) Checking out files: 33% (178/537) Checking out files: 34% (183/537) Checking out files: 35% (188/537) Checking out files: 36% (194/537) Checking out files: 37% (199/537) Checking out files: 38% (205/537) Checking out files: 39% (210/537) Checking out files: 40% (215/537) Checking out files: 41% (221/537) Checking out files: 42% (226/537) Checking out files: 43% (231/537) Checking out files: 44% (237/537) Checking out files: 45% (242/537) Checking out files: 46% (248/537) Checking out files: 47% (253/537) Checking out files: 48% (258/537) Checking out files: 49% (264/537) Checking out files: 50% (269/537) Checking out files: 51% (274/537) Checking out files: 52% (280/537) Checking out files: 53% (285/537) Checking out files: 53% (289/537) Checking out files: 54% (290/537) Checking out files: 55% (296/537) Checking out files: 56% (301/537) Checking out files: 57% (307/537) Checking out files: 58% (312/537) Checking out files: 59% (317/537) Checking out files: 60% (323/537) Checking out files: 61% (328/537) Checking out files: 62% (333/537) Checking out files: 63% (339/537) Checking out files: 64% (344/537) Checking out files: 65% (350/537) Checking out files: 66% (355/537) Checking out files: 67% (360/537) Checking out files: 68% (366/537) Checking out files: 69% (371/537) Checking out files: 70% (376/537) Checking out files: 71% (382/537) Checking out files: 72% (387/537) Checking out files: 73% (393/537) Checking out files: 74% (398/537) Checking out files: 75% (403/537) Checking out files: 75% (406/537) Checking out files: 76% (409/537) Checking out files: 77% (414/537) Checking out files: 78% (419/537) Checking out files: 79% (425/537) Checking out files: 80% (430/537) Checking out files: 81% (435/537) Checking out files: 82% (441/537) Checking out files: 83% (446/537) Checking out files: 84% (452/537) Checking out files: 85% (457/537) Checking out files: 86% (462/537) Checking out files: 87% (468/537) Checking out files: 88% (473/537) Checking out files: 89% (478/537) Checking out files: 90% (484/537) Checking out files: 91% (489/537) Checking out files: 92% (495/537) Checking out files: 93% (500/537) Checking out files: 94% (505/537) Checking out files: 95% (511/537) Checking out files: 95% (514/537) Checking out files: 96% (516/537) Checking out files: 97% (521/537) Checking out files: 98% (527/537) Checking out files: 99% (532/537) Checking out files: 100% (537/537) Checking out files: 100% (537/537), done. 2020-02-11T16:31:06.325 INFO:tasks.workunit.client.0.smithi088.stdout:HEAD is now at 090436f56a v0.21 2020-02-11T16:31:06.328 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/v0.21 2020-02-11T16:31:06.422 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:06.422 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.1 2020-02-11T16:31:06.422 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.1 2020-02-11T16:31:06.422 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.1 2020-02-11T16:31:06.422 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.1 2020-02-11T16:31:06.887 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:08.043 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2020-02-11T16:31:08.043 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2020-02-11T16:31:08.044 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-11T16:31:08.044 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-11T16:31:08.046 INFO:tasks.ceph.mon.a:Started 2020-02-11T16:31:08.046 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:31:08.046 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:31:08.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.166+0000 7f81e1859700 1 Processor -- start 2020-02-11T16:31:08.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.166+0000 7f81e1859700 1 -- start start 2020-02-11T16:31:08.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81e1859700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81dc138570 0x7f81dc143370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:08.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81e1859700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc0a8360 con 0x7f81dc067000 2020-02-11T16:31:08.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81e1859700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc0a8600 con 0x7f81dc065660 2020-02-11T16:31:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81e1859700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc0a9ad0 con 0x7f81dc138570 2020-02-11T16:31:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81daffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f81dc065660 0x7f81dc0a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48682/0 (socket says 172.21.15.88:48682) 2020-02-11T16:31:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81daffd700 1 -- 172.21.15.88:0/2591026912 learned_addr learned my addr 172.21.15.88:0/2591026912 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2591026912 >> v2:172.21.15.52:3300/0 conn(0x7f81dc138570 0x7f81dc143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81db7fe700 1 -- 172.21.15.88:0/2591026912 >> v1:172.21.15.88:6789/0 conn(0x7f81dc065660 legacy=0x7f81dc0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81db7fe700 1 -- 172.21.15.88:0/2591026912 >> v1:172.21.15.52:6789/0 conn(0x7f81dc067000 legacy=0x7f81dc137e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81db7fe700 1 -- 172.21.15.88:0/2591026912 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc138990 con 0x7f81dc138570 2020-02-11T16:31:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.167+0000 7f81d9ffb700 1 -- 172.21.15.88:0/2591026912 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925219132 0 0) 0x7f81dc0a8360 con 0x7f81dc067000 2020-02-11T16:31:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2591026912 >> v2:172.21.15.52:3300/0 conn(0x7f81dc138570 0x7f81dc143370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f81d40032b0 tx=0x7f81d4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2591026912 >> v2:172.21.15.52:3300/0 conn(0x7f81dc138570 0x7f81dc143370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f81d40032b0 tx=0x7f81d4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2591026912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81dc138570 0x7f81dc143370 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81d4008c60).ready entity=mon.0 client_cookie=f07b7b0233a75d63 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2591026912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81dc138570 0x7f81dc143370 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81d4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81d9ffb700 1 -- 172.21.15.88:0/2591026912 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d400a160 con 0x7f81dc138570 2020-02-11T16:31:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2591026912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81dc138570 0x7f81dc143370 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81d4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2591026912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81dc138570 0x7f81dc143370 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81d4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81d9ffb700 1 -- 172.21.15.88:0/2591026912 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400a2c0 con 0x7f81dc138570 2020-02-11T16:31:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81d9ffb700 1 -- 172.21.15.88:0/2591026912 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d400a6a0 con 0x7f81dc138570 2020-02-11T16:31:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81e1859700 1 -- 172.21.15.88:0/2591026912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81dc138570 msgr2=0x7f81dc143370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81e1859700 1 --2- 172.21.15.88:0/2591026912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81dc138570 0x7f81dc143370 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81d4008c60).stop 2020-02-11T16:31:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81e1859700 1 -- 172.21.15.88:0/2591026912 shutdown_connections 2020-02-11T16:31:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81e1859700 1 --2- 172.21.15.88:0/2591026912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81dc138570 0x7f81dc143370 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81e1859700 1 -- 172.21.15.88:0/2591026912 >> 172.21.15.88:0/2591026912 conn(0x7f81dc0ae280 msgr2=0x7f81dc0ae690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81e1859700 1 -- 172.21.15.88:0/2591026912 shutdown_connections 2020-02-11T16:31:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.168+0000 7f81e1859700 1 -- 172.21.15.88:0/2591026912 wait complete. 2020-02-11T16:31:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.169+0000 7f81e1859700 1 Processor -- start 2020-02-11T16:31:08.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.169+0000 7f81e1859700 1 -- start start 2020-02-11T16:31:08.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81e1859700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81dc067000 0x7f81dc133b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:08.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81e1859700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:08.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81e1859700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc133940 con 0x7f81dc065660 2020-02-11T16:31:08.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81e1859700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc12c530 con 0x7f81dc067000 2020-02-11T16:31:08.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81e1859700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0a8cd0 con 0x7f81dc138570 2020-02-11T16:31:08.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81da7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81dc067000 0x7f81dc133b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:08.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81daffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f81dc065660 0x7f81dc133230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40470/0 (socket says 172.21.15.88:40470) 2020-02-11T16:31:08.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81daffd700 1 -- 172.21.15.88:0/2987033876 learned_addr learned my addr 172.21.15.88:0/2987033876 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:08.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81da7fc700 1 -- 172.21.15.88:0/2987033876 >> v2:172.21.15.88:3300/0 conn(0x7f81dc067000 msgr2=0x7f81dc133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:31:08.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81da7fc700 1 -- 172.21.15.88:0/2987033876 >> v2:172.21.15.88:3300/0 conn(0x7f81dc067000 msgr2=0x7f81dc133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:31:08.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:08.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81da7fc700 1 --2- 172.21.15.88:0/2987033876 >> v2:172.21.15.88:3300/0 conn(0x7f81dc067000 0x7f81dc133b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:31:08.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81da7fc700 1 --2- 172.21.15.88:0/2987033876 >> v2:172.21.15.88:3300/0 conn(0x7f81dc067000 0x7f81dc133b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:08.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81cbfff700 1 -- 172.21.15.88:0/2987033876 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501026990 0 0) 0x7f81dc133940 con 0x7f81dc065660 2020-02-11T16:31:08.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81cbfff700 1 -- 172.21.15.88:0/2987033876 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b8002fe0 con 0x7f81dc065660 2020-02-11T16:31:08.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81db7fe700 1 -- 172.21.15.88:0/2987033876 >> v2:172.21.15.88:3300/0 conn(0x7f81dc067000 msgr2=0x7f81dc133b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:08.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> v2:172.21.15.88:3300/0 conn(0x7f81dc067000 0x7f81dc133b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:08.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81db7fe700 1 -- 172.21.15.88:0/2987033876 >> v1:172.21.15.52:6789/0 conn(0x7f81dc065660 legacy=0x7f81dc133230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:08.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81db7fe700 1 -- 172.21.15.88:0/2987033876 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc135170 con 0x7f81dc138570 2020-02-11T16:31:08.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.170+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:08.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81cbfff700 1 -- 172.21.15.88:0/2987033876 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d4005c30 con 0x7f81dc138570 2020-02-11T16:31:08.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81cbfff700 1 -- 172.21.15.88:0/2987033876 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4005d90 con 0x7f81dc138570 2020-02-11T16:31:08.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81e1859700 1 -- 172.21.15.88:0/2987033876 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc12c8b0 con 0x7f81dc138570 2020-02-11T16:31:08.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81cbfff700 1 -- 172.21.15.88:0/2987033876 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d400f760 con 0x7f81dc138570 2020-02-11T16:31:08.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81e1859700 1 -- 172.21.15.88:0/2987033876 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc137d20 con 0x7f81dc138570 2020-02-11T16:31:08.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.171+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.172+0000 7f81cbfff700 1 -- 172.21.15.88:0/2987033876 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f81d400f9d0 con 0x7f81dc138570 2020-02-11T16:31:08.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.172+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.172+0000 7f81e1859700 1 -- 172.21.15.88:0/2987033876 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc0565b0 con 0x7f81dc138570 2020-02-11T16:31:08.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.172+0000 7f81cbfff700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81b803a030 0x7f81b803c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:08.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.172+0000 7f81cbfff700 1 -- 172.21.15.88:0/2987033876 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f81d404a9d0 con 0x7f81dc138570 2020-02-11T16:31:08.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.172+0000 7f81daffd700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81b803a030 0x7f81b803c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:08.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.172+0000 7f81daffd700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81b803a030 0x7f81b803c4f0 crc :-1 s=READY pgs=556 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:08.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.175+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.185 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.175+0000 7f81cbfff700 1 -- 172.21.15.88:0/2987033876 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f81d4030090 con 0x7f81dc138570 2020-02-11T16:31:08.342 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:08.348 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:08.349 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.2 2020-02-11T16:31:08.349 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.2 2020-02-11T16:31:08.349 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.2 2020-02-11T16:31:08.349 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.2 2020-02-11T16:31:08.353 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:08.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.417+0000 7f81e1859700 1 -- 172.21.15.88:0/2987033876 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f81dc132250 con 0x7f81dc138570 2020-02-11T16:31:08.420 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.418+0000 7f81db7fe700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:08.421 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.418+0000 7f81cbfff700 1 -- 172.21.15.88:0/2987033876 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7f81d4032b80 con 0x7f81dc138570 2020-02-11T16:31:08.421 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":208,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:08.422 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 -- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81b803a030 msgr2=0x7f81b803c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:08.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81b803a030 0x7f81b803c4f0 crc :-1 s=READY pgs=556 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:08.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 -- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 msgr2=0x7f81dc133f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:08.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f81d40032b0 tx=0x7f81dc138b20).stop 2020-02-11T16:31:08.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 -- 172.21.15.88:0/2987033876 shutdown_connections 2020-02-11T16:31:08.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f81b803a030 0x7f81b803c4f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:08.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 --2- 172.21.15.88:0/2987033876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81dc138570 0x7f81dc133f80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:08.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 --2- 172.21.15.88:0/2987033876 >> v2:172.21.15.88:3300/0 conn(0x7f81dc067000 0x7f81dc133b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:08.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 -- 172.21.15.88:0/2987033876 >> 172.21.15.88:0/2987033876 conn(0x7f81dc0ae280 msgr2=0x7f81dc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:08.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 -- 172.21.15.88:0/2987033876 shutdown_connections 2020-02-11T16:31:08.425 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:08.419+0000 7f81e1859700 1 -- 172.21.15.88:0/2987033876 wait complete. 2020-02-11T16:31:08.433 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":208,"quorum":[0,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:09.301 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:09.308 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:09.309 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.3 2020-02-11T16:31:09.309 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.3 2020-02-11T16:31:09.309 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.3 2020-02-11T16:31:09.309 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.3 2020-02-11T16:31:09.314 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:10.172 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:10.178 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:10.178 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.4 2020-02-11T16:31:10.179 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.4 2020-02-11T16:31:10.179 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.4 2020-02-11T16:31:10.179 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.4 2020-02-11T16:31:10.183 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:10.949 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:10.956 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:10.956 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.5 2020-02-11T16:31:10.957 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.5 2020-02-11T16:31:10.957 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.5 2020-02-11T16:31:10.957 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.5 2020-02-11T16:31:10.962 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:11.434 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:31:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.552+0000 7f9abcba9700 1 Processor -- start 2020-02-11T16:31:11.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.552+0000 7f9abcba9700 1 -- start start 2020-02-11T16:31:11.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9abcba9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:11.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9abcba9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab80a31b0 con 0x7f9ab80a5de0 2020-02-11T16:31:11.557 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9abcba9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab80a3570 con 0x7f9ab80a6260 2020-02-11T16:31:11.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9abcba9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80a3810 con 0x7f9ab80a18a0 2020-02-11T16:31:11.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9ab6d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9ab80a6260 0x7f9ab812eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48712/0 (socket says 172.21.15.88:48712) 2020-02-11T16:31:11.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9ab6d9d700 1 -- 172.21.15.88:0/693388347 learned_addr learned my addr 172.21.15.88:0/693388347 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:11.558 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9ab659c700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:31:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9ab659c700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:31:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:31:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.553+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:11.756 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.754+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:11.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.754+0000 7f9ab659c700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:31:11.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.754+0000 7f9ab659c700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:31:11.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.754+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:31:11.757 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:11.754+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:31:11.908 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:11.914 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:11.914 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.6 2020-02-11T16:31:11.914 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.6 2020-02-11T16:31:11.915 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.6 2020-02-11T16:31:11.915 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.6 2020-02-11T16:31:11.919 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:12.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:12.155+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:12.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:12.155+0000 7f9ab659c700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:31:12.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:12.155+0000 7f9ab659c700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:31:12.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:12.155+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:31:12.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:12.155+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:31:12.819 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:12.825 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:12.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.7 2020-02-11T16:31:12.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.7 2020-02-11T16:31:12.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.7 2020-02-11T16:31:12.826 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.7 2020-02-11T16:31:12.829 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:12.958 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:12.956+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:12.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:12.956+0000 7f9ab659c700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:31:12.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:12.956+0000 7f9ab659c700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:31:12.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:12.956+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:31:12.959 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:12.956+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:31:13.534 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:13.540 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:13.540 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.8 2020-02-11T16:31:13.540 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.8 2020-02-11T16:31:13.541 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.8 2020-02-11T16:31:13.541 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.8 2020-02-11T16:31:13.545 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:14.352 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:14.358 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:14.358 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.9 2020-02-11T16:31:14.358 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.9 2020-02-11T16:31:14.359 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.9 2020-02-11T16:31:14.359 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.9 2020-02-11T16:31:14.363 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:14.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:14.558+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:14.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:14.558+0000 7f9ab659c700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:31:14.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:14.558+0000 7f9ab659c700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:31:14.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:14.558+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:31:14.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:14.558+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:31:15.218 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:15.224 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:15.225 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.10 2020-02-11T16:31:15.225 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.10 2020-02-11T16:31:15.225 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.10 2020-02-11T16:31:15.225 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.10 2020-02-11T16:31:15.229 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:16.100 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:16.106 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:16.106 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.11 2020-02-11T16:31:16.107 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.11 2020-02-11T16:31:16.107 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.11 2020-02-11T16:31:16.107 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.11 2020-02-11T16:31:16.110 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:16.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.163+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861746269 0 0) 0x7f9ab80a31b0 con 0x7f9ab80a5de0 2020-02-11T16:31:16.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.163+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a9c003230 con 0x7f9ab80a5de0 2020-02-11T16:31:16.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1880115820 0 0) 0x7f9a9c003230 con 0x7f9ab80a5de0 2020-02-11T16:31:16.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9ab80a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:16.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9ab80a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:16.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 >> v1:172.21.15.88:6789/0 conn(0x7f9ab80a6260 legacy=0x7f9ab812eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.169 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab80a3ab0 con 0x7f9ab80a5de0 2020-02-11T16:31:16.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f9aac0016d0 con 0x7f9ab80a5de0 2020-02-11T16:31:16.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 >> v1:172.21.15.52:6789/0 conn(0x7f9ab80a5de0 legacy=0x7f9ab812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9c003750 0x7f9a9c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:16.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9a9c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:16.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a9c004930 0x7f9a9c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:16.170 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80a3810 con 0x7f9a9c003750 2020-02-11T16:31:16.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c005300 con 0x7f9a9c004930 2020-02-11T16:31:16.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c004120 con 0x7f9ab80a18a0 2020-02-11T16:31:16.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab6d9d700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a9c004930 0x7f9a9c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9c003750 0x7f9a9c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab5d9b700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9a9c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab6d9d700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 msgr2=0x7f9a9c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:16.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab6d9d700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9a9c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:16.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab6d9d700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9c003750 msgr2=0x7f9a9c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:16.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.165+0000 7f9ab6d9d700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9c003750 0x7f9a9c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:16.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.166+0000 7f9ab6d9d700 1 -- 172.21.15.88:0/693388347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c003230 con 0x7f9a9c004930 2020-02-11T16:31:16.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.166+0000 7f9ab659c700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9c003750 0x7f9a9c003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:31:16.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.166+0000 7f9ab5d9b700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab80a18a0 0x7f9a9c0044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:31:16.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.166+0000 7f9ab6d9d700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a9c004930 0x7f9a9c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ab0001760 tx=0x7f9ab00123a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.166+0000 7f9ab6d9d700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a9c004930 0x7f9a9c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ab0001760 tx=0x7f9ab00123a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.173 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.166+0000 7f9ab6d9d700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a9c004930 0x7f9a9c004db0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f9ab0001760 tx=0x7f9ab00123a0).ready entity=mon.1 client_cookie=62214076e19af2a7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.167+0000 7f9ab6d9d700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a9c004930 0x7f9a9c004db0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f9ab0001760 tx=0x7f9ab00123a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.167+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ab000d4a0 con 0x7f9a9c004930 2020-02-11T16:31:16.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.167+0000 7f9ab6d9d700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a9c004930 0x7f9a9c004db0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f9ab0001760 tx=0x7f9ab00123a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.167+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000d600 con 0x7f9a9c004930 2020-02-11T16:31:16.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.167+0000 7f9ab6d9d700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a9c004930 0x7f9a9c004db0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f9ab0001760 tx=0x7f9ab00123a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.177 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.167+0000 7f9ab559a700 1 -- 172.21.15.88:0/693388347 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ab000d9a0 con 0x7f9a9c004930 2020-02-11T16:31:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.167+0000 7f9abcba9700 1 -- 172.21.15.88:0/693388347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a9c004930 msgr2=0x7f9a9c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.167+0000 7f9abcba9700 1 --2- 172.21.15.88:0/693388347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a9c004930 0x7f9a9c004db0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f9ab0001760 tx=0x7f9ab00123a0).stop 2020-02-11T16:31:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.167+0000 7f9ab6d9d700 1 -- 172.21.15.88:0/693388347 reap_dead start 2020-02-11T16:31:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.168+0000 7f9abcba9700 1 -- 172.21.15.88:0/693388347 shutdown_connections 2020-02-11T16:31:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.168+0000 7f9abcba9700 1 -- 172.21.15.88:0/693388347 >> 172.21.15.88:0/693388347 conn(0x7f9ab809d110 msgr2=0x7f9ab809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.168+0000 7f9abcba9700 1 -- 172.21.15.88:0/693388347 shutdown_connections 2020-02-11T16:31:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.168+0000 7f9abcba9700 1 -- 172.21.15.88:0/693388347 wait complete. 2020-02-11T16:31:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.169+0000 7f9abcba9700 1 Processor -- start 2020-02-11T16:31:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.169+0000 7f9abcba9700 1 -- start start 2020-02-11T16:31:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.169+0000 7f9abcba9700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9abcba9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab80a7660 con 0x7f9ab81278f0 2020-02-11T16:31:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9abcba9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab80a4780 con 0x7f9ab8130f10 2020-02-11T16:31:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9abcba9700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab812f570 con 0x7f9ab8134f20 2020-02-11T16:31:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab659c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab5d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9ab8130f10 0x7f9ab81271e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48732/0 (socket says 172.21.15.88:48732) 2020-02-11T16:31:16.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab5d9b700 1 -- 172.21.15.88:0/1734274659 learned_addr learned my addr 172.21.15.88:0/1734274659 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:16.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab659c700 1 -- 172.21.15.88:0/1734274659 >> v1:172.21.15.88:6789/0 conn(0x7f9ab8130f10 legacy=0x7f9ab81271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab659c700 1 -- 172.21.15.88:0/1734274659 >> v1:172.21.15.52:6789/0 conn(0x7f9ab81278f0 legacy=0x7f9ab814b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab659c700 1 -- 172.21.15.88:0/1734274659 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab812f810 con 0x7f9ab8134f20 2020-02-11T16:31:16.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab659c700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.180 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab659c700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab659c700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab659c700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab659c700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9aa77fe700 1 -- 172.21.15.88:0/1734274659 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aa8005e90 con 0x7f9ab8134f20 2020-02-11T16:31:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9ab659c700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9aa77fe700 1 -- 172.21.15.88:0/1734274659 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8007160 con 0x7f9ab8134f20 2020-02-11T16:31:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9abcba9700 1 -- 172.21.15.88:0/1734274659 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab8136c20 con 0x7f9ab8134f20 2020-02-11T16:31:16.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9aa77fe700 1 -- 172.21.15.88:0/1734274659 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aa8007540 con 0x7f9ab8134f20 2020-02-11T16:31:16.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.170+0000 7f9abcba9700 1 -- 172.21.15.88:0/1734274659 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab8131550 con 0x7f9ab8134f20 2020-02-11T16:31:16.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.171+0000 7f9ab659c700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.171+0000 7f9aa77fe700 1 -- 172.21.15.88:0/1734274659 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f9aa8012570 con 0x7f9ab8134f20 2020-02-11T16:31:16.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.171+0000 7f9ab659c700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.171+0000 7f9aa77fe700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9a94039bb0 0x7f9a9403c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.172+0000 7f9aa77fe700 1 -- 172.21.15.88:0/1734274659 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f9aa8049ea0 con 0x7f9ab8134f20 2020-02-11T16:31:16.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.172+0000 7f9abcba9700 1 -- 172.21.15.88:0/1734274659 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab8127d00 con 0x7f9ab8134f20 2020-02-11T16:31:16.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.172+0000 7f9ab5d9b700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9a94039bb0 0x7f9a9403c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.183 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.172+0000 7f9ab5d9b700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9a94039bb0 0x7f9a9403c070 crc :-1 s=READY pgs=557 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.175+0000 7f9ab659c700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.184 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.175+0000 7f9aa77fe700 1 -- 172.21.15.88:0/1734274659 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f9aa802f520 con 0x7f9ab8134f20 2020-02-11T16:31:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.435+0000 7f9abcba9700 1 -- 172.21.15.88:0/1734274659 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9ab812f9a0 con 0x7f9ab8134f20 2020-02-11T16:31:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.436+0000 7f9ab659c700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.439 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.436+0000 7f9aa77fe700 1 -- 172.21.15.88:0/1734274659 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7f9aa800a0c0 con 0x7f9ab8134f20 2020-02-11T16:31:16.439 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":216,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:16.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.437+0000 7f9abcba9700 1 -- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9a94039bb0 msgr2=0x7f9a9403c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.437+0000 7f9abcba9700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9a94039bb0 0x7f9a9403c070 crc :-1 s=READY pgs=557 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.440 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.437+0000 7f9abcba9700 1 -- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 msgr2=0x7f9ab8137770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.437+0000 7f9abcba9700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f9aa8002f30 tx=0x7f9aa8010e80).stop 2020-02-11T16:31:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.437+0000 7f9abcba9700 1 -- 172.21.15.88:0/1734274659 shutdown_connections 2020-02-11T16:31:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.437+0000 7f9abcba9700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9a94039bb0 0x7f9a9403c070 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.437+0000 7f9abcba9700 1 --2- 172.21.15.88:0/1734274659 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ab8134f20 0x7f9ab8137770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.437+0000 7f9abcba9700 1 -- 172.21.15.88:0/1734274659 >> 172.21.15.88:0/1734274659 conn(0x7f9ab809d110 msgr2=0x7f9ab80a6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.438+0000 7f9abcba9700 1 -- 172.21.15.88:0/1734274659 shutdown_connections 2020-02-11T16:31:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.438+0000 7f9abcba9700 1 -- 172.21.15.88:0/1734274659 wait complete. 2020-02-11T16:31:16.451 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":216,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:16.451 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:31:16.452 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:31:16.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.571+0000 7f419a907700 1 Processor -- start 2020-02-11T16:31:16.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.571+0000 7f419a907700 1 -- start start 2020-02-11T16:31:16.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f419a907700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:16.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f419a907700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4194136750 0x7f41940a8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:16.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f419a907700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41940a4af0 con 0x7f41940a7c00 2020-02-11T16:31:16.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f419a907700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41941302a0 con 0x7f4194136750 2020-02-11T16:31:16.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f419a907700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4194135a20 con 0x7f41940a3a90 2020-02-11T16:31:16.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f4198ea4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4194136750 0x7f41940a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f4193fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f4198ea4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4194136750 0x7f41940a8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:47102/0 (socket says 172.21.15.88:47102) 2020-02-11T16:31:16.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f4193fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55436/0 (socket says 172.21.15.88:55436) 2020-02-11T16:31:16.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f4198ea4700 1 -- 172.21.15.88:0/2679447720 learned_addr learned my addr 172.21.15.88:0/2679447720 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:16.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.572+0000 7f418bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f41940a7c00 0x7f4194136040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40520/0 (socket says 172.21.15.88:40520) 2020-02-11T16:31:16.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f4193fff700 1 -- 172.21.15.88:0/2679447720 >> v2:172.21.15.52:3300/0 conn(0x7f4194136750 msgr2=0x7f41940a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:16.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f4193fff700 1 --2- 172.21.15.88:0/2679447720 >> v2:172.21.15.52:3300/0 conn(0x7f4194136750 0x7f41940a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:16.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f4193fff700 1 -- 172.21.15.88:0/2679447720 >> v1:172.21.15.52:6789/0 conn(0x7f41940a7c00 legacy=0x7f4194136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f4193fff700 1 -- 172.21.15.88:0/2679447720 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41940a4d90 con 0x7f41940a3a90 2020-02-11T16:31:16.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f4193fff700 1 --2- 172.21.15.88:0/2679447720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4184002f30 tx=0x7f41840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.588 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f4193fff700 1 --2- 172.21.15.88:0/2679447720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4184002f30 tx=0x7f41840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f4193fff700 1 --2- 172.21.15.88:0/2679447720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41840088e0).ready entity=mon.2 client_cookie=9cf1619162b61516 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f4193fff700 1 --2- 172.21.15.88:0/2679447720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f41937fe700 1 -- 172.21.15.88:0/2679447720 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4184008e40 con 0x7f41940a3a90 2020-02-11T16:31:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f4193fff700 1 --2- 172.21.15.88:0/2679447720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f4193fff700 1 --2- 172.21.15.88:0/2679447720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f41937fe700 1 -- 172.21.15.88:0/2679447720 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840115f0 con 0x7f41940a3a90 2020-02-11T16:31:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f41937fe700 1 -- 172.21.15.88:0/2679447720 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41840119d0 con 0x7f41940a3a90 2020-02-11T16:31:16.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f419a907700 1 -- 172.21.15.88:0/2679447720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 msgr2=0x7f41940a8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f419a907700 1 --2- 172.21.15.88:0/2679447720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41840088e0).stop 2020-02-11T16:31:16.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f419a907700 1 -- 172.21.15.88:0/2679447720 shutdown_connections 2020-02-11T16:31:16.591 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f419a907700 1 --2- 172.21.15.88:0/2679447720 >> v2:172.21.15.52:3300/0 conn(0x7f4194136750 0x7f41940a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:16.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f419a907700 1 --2- 172.21.15.88:0/2679447720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f41940a8690 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.573+0000 7f419a907700 1 -- 172.21.15.88:0/2679447720 >> 172.21.15.88:0/2679447720 conn(0x7f41940ac2d0 msgr2=0x7f41940ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:16.592 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.574+0000 7f419a907700 1 -- 172.21.15.88:0/2679447720 shutdown_connections 2020-02-11T16:31:16.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.574+0000 7f419a907700 1 -- 172.21.15.88:0/2679447720 wait complete. 2020-02-11T16:31:16.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.575+0000 7f419a907700 1 Processor -- start 2020-02-11T16:31:16.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.575+0000 7f419a907700 1 -- start start 2020-02-11T16:31:16.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.575+0000 7f419a907700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.575+0000 7f419a907700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41940a7c00 0x7f419405f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.575+0000 7f419a907700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41940a2730 con 0x7f4194136750 2020-02-11T16:31:16.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.575+0000 7f419a907700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41940a29d0 con 0x7f41940a7c00 2020-02-11T16:31:16.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.575+0000 7f419a907700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41940a2c70 con 0x7f41940a3a90 2020-02-11T16:31:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f418bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41940a7c00 0x7f419405f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4198ea4700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4194136750 0x7f419412daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48748/0 (socket says 172.21.15.88:48748) 2020-02-11T16:31:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4198ea4700 1 -- 172.21.15.88:0/3143247416 learned_addr learned my addr 172.21.15.88:0/3143247416 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436684642 0 0) 0x7f41940a2730 con 0x7f4194136750 2020-02-11T16:31:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4178002fe0 con 0x7f4194136750 2020-02-11T16:31:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 -- 172.21.15.88:0/3143247416 >> v2:172.21.15.52:3300/0 conn(0x7f41940a7c00 msgr2=0x7f419405f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 --2- 172.21.15.88:0/3143247416 >> v2:172.21.15.52:3300/0 conn(0x7f41940a7c00 0x7f419405f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 -- 172.21.15.88:0/3143247416 >> v1:172.21.15.88:6789/0 conn(0x7f4194136750 legacy=0x7f419412daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 -- 172.21.15.88:0/3143247416 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419405ac70 con 0x7f41940a3a90 2020-02-11T16:31:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41940a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41940a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41940a3e70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41940a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41940a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4184011880 con 0x7f41940a3a90 2020-02-11T16:31:16.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4193fff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41940a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840119e0 con 0x7f41940a3a90 2020-02-11T16:31:16.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4184007340 con 0x7f41940a3a90 2020-02-11T16:31:16.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f419a907700 1 -- 172.21.15.88:0/3143247416 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419412e1b0 con 0x7f41940a3a90 2020-02-11T16:31:16.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.576+0000 7f419a907700 1 -- 172.21.15.88:0/3143247416 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41940abd80 con 0x7f41940a3a90 2020-02-11T16:31:16.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.577+0000 7f4193fff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41940a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.577+0000 7f419a907700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 0x7f41940a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.577+0000 7f419a907700 1 -- 172.21.15.88:0/3143247416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419405e2f0 con 0x7f4194127b30 2020-02-11T16:31:16.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.577+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f41840056c0 con 0x7f41940a3a90 2020-02-11T16:31:16.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.577+0000 7f4193fff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41940a3e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.577+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 0x7f41940a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.577+0000 7f4191ffb700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4178039f90 0x7f417803c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f4184049d60 con 0x7f41940a3a90 2020-02-11T16:31:16.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f418bfff700 1 -- 172.21.15.88:0/3143247416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41940a3030 con 0x7f4194127b30 2020-02-11T16:31:16.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f4198ea4700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4178039f90 0x7f417803c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 0x7f41940a8c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 0x7f41940a8c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 0x7f41940a8c90 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 0x7f41940a8c90 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f4198ea4700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4178039f90 0x7f417803c450 crc :-1 s=READY pgs=558 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f417c0129f0 con 0x7f4194127b30 2020-02-11T16:31:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 0x7f41940a8c90 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f417c012b50 con 0x7f4194127b30 2020-02-11T16:31:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 msgr2=0x7f41940a8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f4191ffb700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 0x7f41940a8c90 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).stop 2020-02-11T16:31:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 msgr2=0x7f41940a8c90 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:16.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.578+0000 7f4191ffb700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127b30 0x7f41940a8c90 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).stop 2020-02-11T16:31:16.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f419a907700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 0x7f41940aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f419a907700 1 -- 172.21.15.88:0/3143247416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41940565b0 con 0x7f4194127f40 2020-02-11T16:31:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 0x7f41940aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f418bfff700 1 -- 172.21.15.88:0/3143247416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f41940a5280 con 0x7f4194127f40 2020-02-11T16:31:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 0x7f41940aa1b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 0x7f41940aa1b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 0x7f41940aa1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 0x7f41940aa1b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f417c00cac0 con 0x7f4194127f40 2020-02-11T16:31:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f418bfff700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 0x7f41940aa1b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f417c00cc20 con 0x7f4194127f40 2020-02-11T16:31:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 msgr2=0x7f41940aa1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f4191ffb700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 0x7f41940aa1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f41940a7ae0 tx=0x7f417c010bd0).stop 2020-02-11T16:31:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.587+0000 7f4191ffb700 1 -- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 msgr2=0x7f41940aa1b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:16.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f4191ffb700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4194127f40 0x7f41940aa1b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f419a907700 1 -- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4178039f90 msgr2=0x7f417803c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f419a907700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4178039f90 0x7f417803c450 crc :-1 s=READY pgs=558 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f419a907700 1 -- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 msgr2=0x7f419405ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f419a907700 1 --2- 172.21.15.88:0/3143247416 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41940a3a90 0x7f419405ec70 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f4184002f30 tx=0x7f41940a3e70).stop 2020-02-11T16:31:16.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f4198ea4700 1 -- 172.21.15.88:0/3143247416 reap_dead start 2020-02-11T16:31:16.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f4198ea4700 1 -- 172.21.15.88:0/3143247416 reap_dead start 2020-02-11T16:31:16.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f419a907700 1 -- 172.21.15.88:0/3143247416 shutdown_connections 2020-02-11T16:31:16.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f419a907700 1 -- 172.21.15.88:0/3143247416 >> 172.21.15.88:0/3143247416 conn(0x7f41940ac2d0 msgr2=0x7f4194069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:16.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f419a907700 1 -- 172.21.15.88:0/3143247416 shutdown_connections 2020-02-11T16:31:16.615 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.588+0000 7f419a907700 1 -- 172.21.15.88:0/3143247416 wait complete. 2020-02-11T16:31:16.615 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:31:16.615 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:16.615 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:16.616 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:31:16.616 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 216, 2020-02-11T16:31:16.616 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:31:16.616 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:31:16.616 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:31:16.617 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:31:16.617 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.617 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:31:16.617 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:16.618 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:31:16.618 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:31:16.618 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:16.618 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:16.619 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:16.619 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:16.619 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:16.620 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:16.620 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.620 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:31:16.620 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:31:16.620 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:16.621 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:16.621 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:16.621 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:16.621 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:16.622 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:16.622 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.622 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:31:16.623 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:31:16.623 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:31:16.623 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:31:16.623 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:31:16.626 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:31:16.627 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:16.627 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:16.627 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:31:16.627 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:31:16.628 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:16.628 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:31:16.628 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:16.628 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:16.629 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:16.629 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:16.629 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:16.629 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:16.630 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.630 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:31:16.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.630 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:31:16.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.631 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:31:16.631 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:31:16.631 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:16.631 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:16.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.632 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:16.632 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:31:16.632 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.633 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:16.634 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:31:16.634 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.634 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.634 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.635 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:31:16.635 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:31:16.635 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:16.636 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:16.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.636 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:16.637 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:16.637 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:16.637 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:16.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.638 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:16.638 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:31:16.638 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.639 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:16.639 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:31:16.639 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.640 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.640 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.640 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:31:16.641 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:31:16.641 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:16.642 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:16.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.642 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:16.642 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:16.643 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:16.643 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:16.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.643 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:16.644 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:31:16.644 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.645 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:16.645 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:31:16.645 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.645 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.646 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:31:16.646 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:31:16.647 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:16.647 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:16.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.647 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.648 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:31:16.648 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:31:16.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.648 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:16.649 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:16.649 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:16.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.649 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.649 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:31:16.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.649 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:16.650 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:16.650 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:16.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.650 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.650 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:31:16.651 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:31:16.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.777+0000 7f0423af6700 1 Processor -- start 2020-02-11T16:31:16.780 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.777+0000 7f0423af6700 1 -- start start 2020-02-11T16:31:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.778+0000 7f0423af6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f041c131f50 0x7f041c05f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.778+0000 7f0423af6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c138360 con 0x7f041c13b290 2020-02-11T16:31:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.778+0000 7f0423af6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c138600 con 0x7f041c13b6f0 2020-02-11T16:31:16.782 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.778+0000 7f0423af6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c09d8b0 con 0x7f041c131f50 2020-02-11T16:31:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.778+0000 7f0421892700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f041c131f50 0x7f041c05f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.778+0000 7f0421892700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f041c131f50 0x7f041c05f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:32898/0 (socket says 172.21.15.88:32898) 2020-02-11T16:31:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.778+0000 7f0421892700 1 -- 172.21.15.88:0/677431071 learned_addr learned my addr 172.21.15.88:0/677431071 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.778+0000 7f0422093700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f041c13b6f0 0x7f041c142630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48760/0 (socket says 172.21.15.88:48760) 2020-02-11T16:31:16.783 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0421892700 1 -- 172.21.15.88:0/677431071 >> v1:172.21.15.88:6789/0 conn(0x7f041c13b6f0 legacy=0x7f041c142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0421892700 1 -- 172.21.15.88:0/677431071 >> v1:172.21.15.52:6789/0 conn(0x7f041c13b290 legacy=0x7f041c09d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0421892700 1 -- 172.21.15.88:0/677431071 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c137d40 con 0x7f041c131f50 2020-02-11T16:31:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0421892700 1 --2- 172.21.15.88:0/677431071 >> v2:172.21.15.88:3300/0 conn(0x7f041c131f50 0x7f041c05f900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0418002f30 tx=0x7f04180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0421892700 1 --2- 172.21.15.88:0/677431071 >> v2:172.21.15.88:3300/0 conn(0x7f041c131f50 0x7f041c05f900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0418002f30 tx=0x7f04180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0421892700 1 --2- 172.21.15.88:0/677431071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c131f50 0x7f041c05f900 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f04180088e0).ready entity=mon.1 client_cookie=7b7123a393f30046 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.784 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0421892700 1 --2- 172.21.15.88:0/677431071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c131f50 0x7f041c05f900 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f04180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0421892700 1 --2- 172.21.15.88:0/677431071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c131f50 0x7f041c05f900 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f04180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0420890700 1 -- 172.21.15.88:0/677431071 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0418011760 con 0x7f041c131f50 2020-02-11T16:31:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0421892700 1 --2- 172.21.15.88:0/677431071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c131f50 0x7f041c05f900 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f04180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0420890700 1 -- 172.21.15.88:0/677431071 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04180118c0 con 0x7f041c131f50 2020-02-11T16:31:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0420890700 1 -- 172.21.15.88:0/677431071 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0418011ca0 con 0x7f041c131f50 2020-02-11T16:31:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0423af6700 1 -- 172.21.15.88:0/677431071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c131f50 msgr2=0x7f041c05f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.785 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0423af6700 1 --2- 172.21.15.88:0/677431071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c131f50 0x7f041c05f900 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f04180088e0).stop 2020-02-11T16:31:16.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0423af6700 1 -- 172.21.15.88:0/677431071 shutdown_connections 2020-02-11T16:31:16.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0423af6700 1 --2- 172.21.15.88:0/677431071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041c131f50 0x7f041c05f900 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.779+0000 7f0423af6700 1 -- 172.21.15.88:0/677431071 >> 172.21.15.88:0/677431071 conn(0x7f041c0a7bb0 msgr2=0x7f041c0a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:16.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.780+0000 7f0423af6700 1 -- 172.21.15.88:0/677431071 shutdown_connections 2020-02-11T16:31:16.786 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.780+0000 7f0423af6700 1 -- 172.21.15.88:0/677431071 wait complete. 2020-02-11T16:31:16.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.780+0000 7f0423af6700 1 Processor -- start 2020-02-11T16:31:16.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.780+0000 7f0423af6700 1 -- start start 2020-02-11T16:31:16.791 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.781+0000 7f0423af6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f041c131f50 0x7f041c1463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.781+0000 7f0423af6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f041c12fa30 0x7f041c138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.781+0000 7f0423af6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c139310 con 0x7f041c13b290 2020-02-11T16:31:16.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.781+0000 7f0423af6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c145800 con 0x7f041c131f50 2020-02-11T16:31:16.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.781+0000 7f0423af6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c12fec0 con 0x7f041c12fa30 2020-02-11T16:31:16.792 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.781+0000 7f0421892700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f041c131f50 0x7f041c1463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.781+0000 7f0421892700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f041c131f50 0x7f041c1463d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:47122/0 (socket says 172.21.15.88:47122) 2020-02-11T16:31:16.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.781+0000 7f0421892700 1 -- 172.21.15.88:0/191999900 learned_addr learned my addr 172.21.15.88:0/191999900 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:16.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.781+0000 7f0422093700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f041c12fa30 0x7f041c138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 -- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f041c12fa30 msgr2=0x7f041c138eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f041c12fa30 0x7f041c138eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 -- 172.21.15.88:0/191999900 >> v1:172.21.15.52:6789/0 conn(0x7f041c13b290 legacy=0x7f041c136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.793 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 -- 172.21.15.88:0/191999900 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0aae10 con 0x7f041c131f50 2020-02-11T16:31:16.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 --2- 172.21.15.88:0/191999900 >> v2:172.21.15.52:3300/0 conn(0x7f041c131f50 0x7f041c1463d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f041c0600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 --2- 172.21.15.88:0/191999900 >> v2:172.21.15.52:3300/0 conn(0x7f041c131f50 0x7f041c1463d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f041c0600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c131f50 0x7f041c1463d0 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f041c0600c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c131f50 0x7f041c1463d0 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f041c0600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.794 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0418007340 con 0x7f041c131f50 2020-02-11T16:31:16.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c131f50 0x7f041c1463d0 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f041c0600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0423af6700 1 -- 172.21.15.88:0/191999900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c1459f0 con 0x7f041c131f50 2020-02-11T16:31:16.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c131f50 0x7f041c1463d0 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f041c0600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0423af6700 1 -- 172.21.15.88:0/191999900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c145f30 con 0x7f041c131f50 2020-02-11T16:31:16.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04180074a0 con 0x7f041c131f50 2020-02-11T16:31:16.795 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04180058b0 con 0x7f041c131f50 2020-02-11T16:31:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.782+0000 7f0421892700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c131f50 0x7f041c1463d0 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f041c0600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.783+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f0418005b20 con 0x7f041c131f50 2020-02-11T16:31:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.783+0000 7f0421892700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c131f50 0x7f041c1463d0 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f041c0600c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.783+0000 7f0423af6700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 0x7f041c0a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.783+0000 7f0423af6700 1 -- 172.21.15.88:0/191999900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c05e2f0 con 0x7f041c13b6f0 2020-02-11T16:31:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.783+0000 7f040affd700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f03fc039ca0 0x7f03fc03c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.783+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f041804a260 con 0x7f041c131f50 2020-02-11T16:31:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.783+0000 7f0422093700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f03fc039ca0 0x7f03fc03c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.783+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 0x7f041c0a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f0422093700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f03fc039ca0 0x7f03fc03c160 crc :-1 s=READY pgs=559 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f0421091700 1 -- 172.21.15.88:0/191999900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f041c0a6320 con 0x7f041c13b6f0 2020-02-11T16:31:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 0x7f041c0a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 0x7f041c0a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 0x7f041c0a8ff0 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 0x7f041c0a8ff0 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f040c00cc20 con 0x7f041c13b6f0 2020-02-11T16:31:16.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 0x7f041c0a8ff0 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f040c00cd80 con 0x7f041c13b6f0 2020-02-11T16:31:16.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 msgr2=0x7f041c0a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f040affd700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 0x7f041c0a8ff0 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).stop 2020-02-11T16:31:16.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 msgr2=0x7f041c0a8ff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:16.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.784+0000 7f040affd700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c13b6f0 0x7f041c0a8ff0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.793+0000 7f0423af6700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 0x7f041c0a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.793+0000 7f0423af6700 1 -- 172.21.15.88:0/191999900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0a7500 con 0x7f041c0a9450 2020-02-11T16:31:16.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.793+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 0x7f041c0a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.793+0000 7f0421091700 1 -- 172.21.15.88:0/191999900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f041c130f40 con 0x7f041c0a9450 2020-02-11T16:31:16.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.793+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 0x7f041c0a9830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.793+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 0x7f041c0a9830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.793+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 0x7f041c0a9830 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.793+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 0x7f041c0a9830 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.793+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f040c0068e0 con 0x7f041c0a9450 2020-02-11T16:31:16.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0421091700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 0x7f041c0a9830 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4362 (secure 0 0 0) 0x7f040c00b380 con 0x7f041c0a9450 2020-02-11T16:31:16.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 msgr2=0x7f041c0a9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f040affd700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 0x7f041c0a9830 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).stop 2020-02-11T16:31:16.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f040affd700 1 -- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 msgr2=0x7f041c0a9830 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:16.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f040affd700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c0a9450 0x7f041c0a9830 secure :-1 s=CLOSED pgs=473 cs=0 l=1 rx=0x7f041c0aad40 tx=0x7f040c0023e0).stop 2020-02-11T16:31:16.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0423af6700 1 -- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f03fc039ca0 msgr2=0x7f03fc03c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0423af6700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f03fc039ca0 0x7f03fc03c160 crc :-1 s=READY pgs=559 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0423af6700 1 -- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c131f50 msgr2=0x7f041c1463d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0423af6700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c131f50 0x7f041c1463d0 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f041c0600c0).stop 2020-02-11T16:31:16.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0422093700 1 -- 172.21.15.88:0/191999900 reap_dead start 2020-02-11T16:31:16.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0423af6700 1 -- 172.21.15.88:0/191999900 shutdown_connections 2020-02-11T16:31:16.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0423af6700 1 --2- 172.21.15.88:0/191999900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f041c131f50 0x7f041c1463d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0423af6700 1 -- 172.21.15.88:0/191999900 >> 172.21.15.88:0/191999900 conn(0x7f041c0a7bb0 msgr2=0x7f041c066110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:16.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0423af6700 1 -- 172.21.15.88:0/191999900 shutdown_connections 2020-02-11T16:31:16.806 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.794+0000 7f0423af6700 1 -- 172.21.15.88:0/191999900 wait complete. 2020-02-11T16:31:16.806 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:31:16.806 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:31:16.806 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:31:16.806 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:31:16.807 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 216, 2020-02-11T16:31:16.807 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:31:16.807 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:31:16.807 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:31:16.807 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:31:16.807 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.807 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:31:16.808 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:16.808 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:31:16.808 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:31:16.808 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:16.808 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:16.808 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:16.808 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:16.809 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:16.809 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:16.809 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.809 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:31:16.809 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:31:16.809 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:16.809 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:16.810 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:16.810 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:16.810 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:16.810 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:16.810 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.811 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:31:16.811 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:31:16.811 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:31:16.811 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:31:16.811 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:31:16.811 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:31:16.812 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:16.812 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:16.812 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:31:16.812 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:31:16.812 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:16.812 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:31:16.812 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:16.812 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:16.813 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:16.813 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:16.813 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:16.813 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:16.813 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.813 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:31:16.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.814 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:31:16.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.814 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:31:16.814 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:31:16.814 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:16.815 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:16.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.815 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:16.815 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:31:16.815 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.816 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:16.816 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:31:16.816 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.816 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.816 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.816 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:31:16.817 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:31:16.817 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:16.817 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:16.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.817 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:16.817 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:16.817 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:16.818 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:16.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.818 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:16.818 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:31:16.818 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.819 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:16.819 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:31:16.819 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.819 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.819 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.820 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:31:16.820 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:31:16.820 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:16.820 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:16.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.821 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:16.821 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:16.821 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:16.821 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:16.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.821 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:16.822 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:31:16.822 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.822 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:16.822 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:31:16.822 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.823 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.823 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:31:16.823 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:31:16.823 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:16.823 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:16.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.824 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.824 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:31:16.824 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:31:16.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.824 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:16.824 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:16.825 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:16.825 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.825 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.825 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:31:16.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.825 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:16.825 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:16.826 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:16.826 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.826 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.826 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:31:16.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.826 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:16.827 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:16.827 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:31:16.827 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.827 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.827 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:31:16.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.828 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:16.828 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:16.828 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:31:16.828 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.828 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.828 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:31:16.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.828 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:16.829 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:16.829 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:31:16.829 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.829 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.829 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.829 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:31:16.832 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:31:16.933 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:16.940 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:16.940 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.12 2020-02-11T16:31:16.940 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.12 2020-02-11T16:31:16.940 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.12 2020-02-11T16:31:16.941 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.12 2020-02-11T16:31:16.944 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:16.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27e1ced700 1 Processor -- start 2020-02-11T16:31:16.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27e1ced700 1 -- start start 2020-02-11T16:31:16.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27e1ced700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27dc05c1f0 0x7f27dc0a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:16.961 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27e1ced700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27dc12d990 0x7f27dc12de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:16.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27e1ced700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27dc0a1e80 con 0x7f27dc0a6fa0 2020-02-11T16:31:16.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27e1ced700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc0a25c0 con 0x7f27dc05c1f0 2020-02-11T16:31:16.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27e1ced700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc0a2120 con 0x7f27dc12d990 2020-02-11T16:31:16.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27dbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27dc12d990 0x7f27dc12de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27dbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27dc12d990 0x7f27dc12de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:32920/0 (socket says 172.21.15.88:32920) 2020-02-11T16:31:16.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27dbfff700 1 -- 172.21.15.88:0/1434736146 learned_addr learned my addr 172.21.15.88:0/1434736146 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:16.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.949+0000 7f27db7fe700 1 --2- 172.21.15.88:0/1434736146 >> v2:172.21.15.52:3300/0 conn(0x7f27dc05c1f0 0x7f27dc0a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27dbfff700 1 -- 172.21.15.88:0/1434736146 >> v2:172.21.15.52:3300/0 conn(0x7f27dc05c1f0 msgr2=0x7f27dc0a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:16.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27dbfff700 1 --2- 172.21.15.88:0/1434736146 >> v2:172.21.15.52:3300/0 conn(0x7f27dc05c1f0 0x7f27dc0a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:16.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27dbfff700 1 -- 172.21.15.88:0/1434736146 >> v1:172.21.15.52:6789/0 conn(0x7f27dc0a6fa0 legacy=0x7f27dc0a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27dbfff700 1 -- 172.21.15.88:0/1434736146 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc0a2e90 con 0x7f27dc12d990 2020-02-11T16:31:16.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27dbfff700 1 --2- 172.21.15.88:0/1434736146 >> v2:172.21.15.88:3300/0 conn(0x7f27dc12d990 0x7f27dc12de20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27dc0a42f0 tx=0x7f27d4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27dbfff700 1 --2- 172.21.15.88:0/1434736146 >> v2:172.21.15.88:3300/0 conn(0x7f27dc12d990 0x7f27dc12de20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27dc0a42f0 tx=0x7f27d4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27dbfff700 1 --2- 172.21.15.88:0/1434736146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc12d990 0x7f27dc12de20 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f27dc0a42f0 tx=0x7f27d4008c60).ready entity=mon.1 client_cookie=be410b8147b36847 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27dbfff700 1 --2- 172.21.15.88:0/1434736146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc12d990 0x7f27dc12de20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f27dc0a42f0 tx=0x7f27d4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27da7fc700 1 -- 172.21.15.88:0/1434736146 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d400b160 con 0x7f27dc12d990 2020-02-11T16:31:16.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27dbfff700 1 --2- 172.21.15.88:0/1434736146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc12d990 0x7f27dc12de20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f27dc0a42f0 tx=0x7f27d4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27dbfff700 1 --2- 172.21.15.88:0/1434736146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc12d990 0x7f27dc12de20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f27dc0a42f0 tx=0x7f27d4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27da7fc700 1 -- 172.21.15.88:0/1434736146 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d400b2c0 con 0x7f27dc12d990 2020-02-11T16:31:16.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27da7fc700 1 -- 172.21.15.88:0/1434736146 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d400b6a0 con 0x7f27dc12d990 2020-02-11T16:31:16.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27e1ced700 1 -- 172.21.15.88:0/1434736146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc12d990 msgr2=0x7f27dc12de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.950+0000 7f27e1ced700 1 --2- 172.21.15.88:0/1434736146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc12d990 0x7f27dc12de20 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f27dc0a42f0 tx=0x7f27d4008c60).stop 2020-02-11T16:31:16.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.951+0000 7f27e1ced700 1 -- 172.21.15.88:0/1434736146 shutdown_connections 2020-02-11T16:31:16.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.951+0000 7f27e1ced700 1 --2- 172.21.15.88:0/1434736146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc12d990 0x7f27dc12de20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.951+0000 7f27e1ced700 1 --2- 172.21.15.88:0/1434736146 >> v2:172.21.15.52:3300/0 conn(0x7f27dc05c1f0 0x7f27dc0a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:16.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.951+0000 7f27e1ced700 1 -- 172.21.15.88:0/1434736146 >> 172.21.15.88:0/1434736146 conn(0x7f27dc0ab400 msgr2=0x7f27dc0a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:16.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.951+0000 7f27e1ced700 1 -- 172.21.15.88:0/1434736146 shutdown_connections 2020-02-11T16:31:16.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.951+0000 7f27e1ced700 1 -- 172.21.15.88:0/1434736146 wait complete. 2020-02-11T16:31:16.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.952+0000 7f27e1ced700 1 Processor -- start 2020-02-11T16:31:16.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.952+0000 7f27e1ced700 1 -- start start 2020-02-11T16:31:16.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.952+0000 7f27e1ced700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.952+0000 7f27e1ced700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27dc134d40 con 0x7f27dc12d990 2020-02-11T16:31:16.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.952+0000 7f27e1ced700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27dc134f70 con 0x7f27dc0a6fa0 2020-02-11T16:31:16.969 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.952+0000 7f27e1ced700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc12cbd0 con 0x7f27dc05c1f0 2020-02-11T16:31:16.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27dbfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f27dc12d990 0x7f27dc14d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40564/0 (socket says 172.21.15.88:40564) 2020-02-11T16:31:16.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27dbfff700 1 -- 172.21.15.88:0/231036849 learned_addr learned my addr 172.21.15.88:0/231036849 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:16.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27db7fe700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27daffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f27dc0a6fa0 0x7f27dc126b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48784/0 (socket says 172.21.15.88:48784) 2020-02-11T16:31:16.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966408238 0 0) 0x7f27dc134d40 con 0x7f27dc12d990 2020-02-11T16:31:16.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27bc002fe0 con 0x7f27dc12d990 2020-02-11T16:31:16.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922548307 0 0) 0x7f27dc134f70 con 0x7f27dc0a6fa0 2020-02-11T16:31:16.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27dc134d40 con 0x7f27dc0a6fa0 2020-02-11T16:31:16.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27db7fe700 1 -- 172.21.15.88:0/231036849 >> v1:172.21.15.88:6789/0 conn(0x7f27dc0a6fa0 legacy=0x7f27dc126b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27db7fe700 1 -- 172.21.15.88:0/231036849 >> v1:172.21.15.52:6789/0 conn(0x7f27dc12d990 legacy=0x7f27dc14d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27db7fe700 1 -- 172.21.15.88:0/231036849 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc0a0680 con 0x7f27dc05c1f0 2020-02-11T16:31:16.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27db7fe700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27db7fe700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27db7fe700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27db7fe700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27cc007530 con 0x7f27dc05c1f0 2020-02-11T16:31:16.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27db7fe700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27db7fe700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc0056c0 con 0x7f27dc05c1f0 2020-02-11T16:31:16.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27e1ced700 1 -- 172.21.15.88:0/231036849 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc133100 con 0x7f27dc05c1f0 2020-02-11T16:31:16.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27cc005a60 con 0x7f27dc05c1f0 2020-02-11T16:31:16.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.953+0000 7f27e1ced700 1 -- 172.21.15.88:0/231036849 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27dc0a0180 con 0x7f27dc05c1f0 2020-02-11T16:31:16.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.954+0000 7f27db7fe700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.954+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f27cc005cd0 con 0x7f27dc05c1f0 2020-02-11T16:31:16.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.954+0000 7f27db7fe700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.954+0000 7f27e1ced700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 0x7f27dc0a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.954+0000 7f27e1ced700 1 -- 172.21.15.88:0/231036849 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc09ded0 con 0x7f27dc132800 2020-02-11T16:31:16.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.954+0000 7f27d8ff9700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27bc03a130 0x7f27bc03c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.954+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 0x7f27dc0a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.954+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f27cc00d0c0 con 0x7f27dc05c1f0 2020-02-11T16:31:16.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.954+0000 7f27dbfff700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27bc03a130 0x7f27bc03c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27daffd700 1 -- 172.21.15.88:0/231036849 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27dc0a08a0 con 0x7f27dc132800 2020-02-11T16:31:16.974 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 0x7f27dc0a0a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 0x7f27dc0a0a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 0x7f27dc0a0a60 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0010b20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27dbfff700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27bc03a130 0x7f27bc03c5f0 crc :-1 s=READY pgs=560 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 0x7f27dc0a0a60 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d000ca30 con 0x7f27dc132800 2020-02-11T16:31:16.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 0x7f27dc0a0a60 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f27d0013060 con 0x7f27dc132800 2020-02-11T16:31:16.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 msgr2=0x7f27dc0a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27d8ff9700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 0x7f27dc0a0a60 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0010b20).stop 2020-02-11T16:31:16.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 msgr2=0x7f27dc0a0a60 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:16.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.955+0000 7f27d8ff9700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc132800 0x7f27dc0a0a60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.964+0000 7f27e1ced700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 0x7f27dc05a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:16.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.964+0000 7f27e1ced700 1 -- 172.21.15.88:0/231036849 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc05c630 con 0x7f27dc05a5d0 2020-02-11T16:31:16.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.964+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 0x7f27dc05a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:16.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27daffd700 1 -- 172.21.15.88:0/231036849 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f27dc09d2d0 con 0x7f27dc05a5d0 2020-02-11T16:31:16.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 0x7f27dc05a9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.979 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 0x7f27dc05a9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 0x7f27dc05a9b0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0001500).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 0x7f27dc05a9b0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d000b830 con 0x7f27dc05a5d0 2020-02-11T16:31:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27daffd700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 0x7f27dc05a9b0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4020 (secure 0 0 0) 0x7f27d0015550 con 0x7f27dc05a5d0 2020-02-11T16:31:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 msgr2=0x7f27dc05a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27d8ff9700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 0x7f27dc05a9b0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f27d00010d0 tx=0x7f27d0001500).stop 2020-02-11T16:31:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27d8ff9700 1 -- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 msgr2=0x7f27dc05a9b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27d8ff9700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05a5d0 0x7f27dc05a9b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.965+0000 7f27e1ced700 1 -- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27bc03a130 msgr2=0x7f27bc03c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.966+0000 7f27e1ced700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f27bc03a130 0x7f27bc03c5f0 crc :-1 s=READY pgs=560 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.966+0000 7f27e1ced700 1 -- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 msgr2=0x7f27dc09da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.966+0000 7f27dbfff700 1 -- 172.21.15.88:0/231036849 reap_dead start 2020-02-11T16:31:16.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.966+0000 7f27e1ced700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f27cc002f30 tx=0x7f27cc010bf0).stop 2020-02-11T16:31:16.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.966+0000 7f27e1ced700 1 -- 172.21.15.88:0/231036849 shutdown_connections 2020-02-11T16:31:16.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.966+0000 7f27e1ced700 1 --2- 172.21.15.88:0/231036849 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27dc05c1f0 0x7f27dc09da70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:16.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.966+0000 7f27e1ced700 1 -- 172.21.15.88:0/231036849 >> 172.21.15.88:0/231036849 conn(0x7f27dc0ab400 msgr2=0x7f27dc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:16.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.966+0000 7f27e1ced700 1 -- 172.21.15.88:0/231036849 shutdown_connections 2020-02-11T16:31:16.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:16.966+0000 7f27e1ced700 1 -- 172.21.15.88:0/231036849 wait complete. 2020-02-11T16:31:16.982 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:31:16.983 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:16.983 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:16.983 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:31:16.983 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 216, 2020-02-11T16:31:16.983 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:31:16.983 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:31:16.984 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:31:16.984 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:31:16.984 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.984 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:31:16.984 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:16.984 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:31:16.984 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:31:16.985 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:16.985 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:16.985 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:16.985 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:16.985 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:16.985 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:16.986 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.986 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:31:16.986 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:31:16.986 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:16.986 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:16.986 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:16.986 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:16.987 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:16.987 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:16.987 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.987 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:31:16.987 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:31:16.987 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:31:16.987 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:31:16.988 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:31:16.988 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:31:16.988 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:16.988 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:16.988 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:31:16.988 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:31:16.988 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:16.989 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:31:16.989 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:16.989 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:16.989 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:16.989 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:16.989 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:16.989 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:16.990 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:16.990 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:31:16.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.990 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:31:16.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.990 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:31:16.991 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:31:16.991 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:16.991 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:16.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.991 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:16.991 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:31:16.991 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.992 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:16.992 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:31:16.992 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.992 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.992 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.993 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:31:16.993 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:31:16.993 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:16.993 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:16.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.993 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:16.994 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:16.994 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:16.994 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:16.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.994 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:16.994 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:31:16.994 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.995 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:16.995 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:31:16.995 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.995 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.995 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.996 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:31:16.996 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:31:16.996 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:16.996 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:16.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.996 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:16.997 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:16.997 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:16.997 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:16.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.997 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:16.997 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:31:16.997 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:16.998 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:16.998 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:31:16.998 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:16.998 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.998 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:16.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:16.999 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:31:16.999 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:31:16.999 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:16.999 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:16.999 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:16.999 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:17.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:17.000 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:31:17.000 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:31:17.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:17.000 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:17.000 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:17.000 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:17.000 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:17.001 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:17.001 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:31:17.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:17.001 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:17.001 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:17.001 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:17.001 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:17.002 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:17.002 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:31:17.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:17.002 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:17.002 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:17.002 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:31:17.002 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:17.003 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:17.003 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:17.003 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:31:17.004 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:31:17.004 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:31:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.126+0000 7f2b668dc700 1 Processor -- start 2020-02-11T16:31:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.126+0000 7f2b668dc700 1 -- start start 2020-02-11T16:31:17.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b668dc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b600a5b20 0x7f2b600a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:17.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b668dc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b60131280 0x7f2b601316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:17.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b668dc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b600a4350 con 0x7f2b600a2fa0 2020-02-11T16:31:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b668dc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b600a1e60 con 0x7f2b600a5b20 2020-02-11T16:31:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b668dc700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b600a3450 con 0x7f2b60131280 2020-02-11T16:31:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b600a5b20 0x7f2b600a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2b600a2fa0 0x7f2b600a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48792/0 (socket says 172.21.15.88:48792) 2020-02-11T16:31:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5ffff700 1 -- 172.21.15.88:0/3906821889 learned_addr learned my addr 172.21.15.88:0/3906821889 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b64e79700 1 --2- 172.21.15.88:0/3906821889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b60131280 0x7f2b601316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 -- 172.21.15.88:0/3906821889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b60131280 msgr2=0x7f2b601316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:17.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 --2- 172.21.15.88:0/3906821889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b60131280 0x7f2b601316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:17.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 -- 172.21.15.88:0/3906821889 >> v1:172.21.15.88:6789/0 conn(0x7f2b600a2fa0 legacy=0x7f2b600a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:17.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5effd700 1 -- 172.21.15.88:0/3906821889 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820961218 0 0) 0x7f2b600a4350 con 0x7f2b600a2fa0 2020-02-11T16:31:17.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 -- 172.21.15.88:0/3906821889 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600a3a40 con 0x7f2b600a5b20 2020-02-11T16:31:17.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 --2- 172.21.15.88:0/3906821889 >> v2:172.21.15.88:3300/0 conn(0x7f2b600a5b20 0x7f2b600a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b6005efb0 tx=0x7f2b540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 --2- 172.21.15.88:0/3906821889 >> v2:172.21.15.88:3300/0 conn(0x7f2b600a5b20 0x7f2b600a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b6005efb0 tx=0x7f2b540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 --2- 172.21.15.88:0/3906821889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a5b20 0x7f2b600a1520 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f2b6005efb0 tx=0x7f2b540088e0).ready entity=mon.1 client_cookie=29d9105bac1e3b2c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:17.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 --2- 172.21.15.88:0/3906821889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a5b20 0x7f2b600a1520 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f2b6005efb0 tx=0x7f2b540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5effd700 1 -- 172.21.15.88:0/3906821889 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b54008e40 con 0x7f2b600a5b20 2020-02-11T16:31:17.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 --2- 172.21.15.88:0/3906821889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a5b20 0x7f2b600a1520 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f2b6005efb0 tx=0x7f2b540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.127+0000 7f2b5f7fe700 1 --2- 172.21.15.88:0/3906821889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a5b20 0x7f2b600a1520 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f2b6005efb0 tx=0x7f2b540088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.128+0000 7f2b5effd700 1 -- 172.21.15.88:0/3906821889 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b540115b0 con 0x7f2b600a5b20 2020-02-11T16:31:17.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.128+0000 7f2b5effd700 1 -- 172.21.15.88:0/3906821889 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b54011950 con 0x7f2b600a5b20 2020-02-11T16:31:17.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.128+0000 7f2b668dc700 1 -- 172.21.15.88:0/3906821889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a5b20 msgr2=0x7f2b600a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:17.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.128+0000 7f2b668dc700 1 --2- 172.21.15.88:0/3906821889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a5b20 0x7f2b600a1520 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f2b6005efb0 tx=0x7f2b540088e0).stop 2020-02-11T16:31:17.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.128+0000 7f2b668dc700 1 -- 172.21.15.88:0/3906821889 shutdown_connections 2020-02-11T16:31:17.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.128+0000 7f2b668dc700 1 --2- 172.21.15.88:0/3906821889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b60131280 0x7f2b601316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:17.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.128+0000 7f2b668dc700 1 --2- 172.21.15.88:0/3906821889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b600a5b20 0x7f2b600a1520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:17.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.128+0000 7f2b668dc700 1 -- 172.21.15.88:0/3906821889 >> 172.21.15.88:0/3906821889 conn(0x7f2b6009d110 msgr2=0x7f2b6009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:17.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.128+0000 7f2b668dc700 1 -- 172.21.15.88:0/3906821889 shutdown_connections 2020-02-11T16:31:17.135 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.128+0000 7f2b668dc700 1 -- 172.21.15.88:0/3906821889 wait complete. 2020-02-11T16:31:17.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.129+0000 7f2b668dc700 1 Processor -- start 2020-02-11T16:31:17.138 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.129+0000 7f2b668dc700 1 -- start start 2020-02-11T16:31:17.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b668dc700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b600a2fa0 0x7f2b6009feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:17.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b668dc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b600a5b20 0x7f2b60130530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:17.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b668dc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b60131280 0x7f2b60130990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:17.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b668dc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b600a0310 con 0x7f2b600a5b20 2020-02-11T16:31:17.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b668dc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b60130df0 con 0x7f2b60131280 2020-02-11T16:31:17.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b668dc700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b600a09c0 con 0x7f2b600a2fa0 2020-02-11T16:31:17.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b5ffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b600a2fa0 0x7f2b6009feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:17.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b5f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b600a5b20 0x7f2b60130530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:17.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b64e79700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b60131280 0x7f2b60130990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:17.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b5ffff700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b600a2fa0 0x7f2b6009feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55496/0 (socket says 172.21.15.88:55496) 2020-02-11T16:31:17.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b5f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b600a5b20 0x7f2b60130530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:47160/0 (socket says 172.21.15.88:47160) 2020-02-11T16:31:17.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b5ffff700 1 -- 172.21.15.88:0/4047566004 learned_addr learned my addr 172.21.15.88:0/4047566004 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:17.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b64e79700 1 -- 172.21.15.88:0/4047566004 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b600a2fa0 msgr2=0x7f2b6009feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:17.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b600a2fa0 0x7f2b6009feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:17.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b64e79700 1 -- 172.21.15.88:0/4047566004 >> v2:172.21.15.52:3300/0 conn(0x7f2b600a5b20 msgr2=0x7f2b60130530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:17.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> v2:172.21.15.52:3300/0 conn(0x7f2b600a5b20 0x7f2b60130530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:17.141 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b64e79700 1 -- 172.21.15.88:0/4047566004 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600a0c60 con 0x7f2b60131280 2020-02-11T16:31:17.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.130+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> v2:172.21.15.88:3300/0 conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> v2:172.21.15.88:3300/0 conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:17.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.142 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b5d7fa700 1 -- 172.21.15.88:0/4047566004 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b5800e350 con 0x7f2b60131280 2020-02-11T16:31:17.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b5d7fa700 1 -- 172.21.15.88:0/4047566004 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b58005c30 con 0x7f2b60131280 2020-02-11T16:31:17.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b5d7fa700 1 -- 172.21.15.88:0/4047566004 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b58005e20 con 0x7f2b60131280 2020-02-11T16:31:17.143 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b668dc700 1 -- 172.21.15.88:0/4047566004 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b600a0f00 con 0x7f2b60131280 2020-02-11T16:31:17.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b668dc700 1 -- 172.21.15.88:0/4047566004 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b601384e0 con 0x7f2b60131280 2020-02-11T16:31:17.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.131+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.132+0000 7f2b5d7fa700 1 -- 172.21.15.88:0/4047566004 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f2b5800caf0 con 0x7f2b60131280 2020-02-11T16:31:17.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.132+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.132+0000 7f2b5d7fa700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b40039ca0 0x7f2b4003c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:17.144 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.132+0000 7f2b5d7fa700 1 -- 172.21.15.88:0/4047566004 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f2b580498f0 con 0x7f2b60131280 2020-02-11T16:31:17.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.132+0000 7f2b668dc700 1 -- 172.21.15.88:0/4047566004 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b600565b0 con 0x7f2b60131280 2020-02-11T16:31:17.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.132+0000 7f2b5ffff700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b40039ca0 0x7f2b4003c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:17.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.132+0000 7f2b5ffff700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b40039ca0 0x7f2b4003c160 crc :-1 s=READY pgs=561 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:17.145 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.136+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.136+0000 7f2b5d7fa700 1 -- 172.21.15.88:0/4047566004 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f2b5802eed0 con 0x7f2b60131280 2020-02-11T16:31:17.361 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.359+0000 7f2b668dc700 1 -- 172.21.15.88:0/4047566004 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f2b6005ccb0 con 0x7f2b60131280 2020-02-11T16:31:17.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.360+0000 7f2b64e79700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:17.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.360+0000 7f2b5d7fa700 1 -- 172.21.15.88:0/4047566004 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f2b580319e0 con 0x7f2b60131280 2020-02-11T16:31:17.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 -- 172.21.15.88:0/4047566004 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b40039ca0 msgr2=0x7f2b4003c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:17.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b40039ca0 0x7f2b4003c160 crc :-1 s=READY pgs=561 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:17.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 -- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 msgr2=0x7f2b60130990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:17.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 0x7f2b60130990 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f2b580032b0 tx=0x7f2b58010ec0).stop 2020-02-11T16:31:17.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 -- 172.21.15.88:0/4047566004 shutdown_connections 2020-02-11T16:31:17.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b60131280 0x7f2b60130990 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:17.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2b600a2fa0 0x7f2b6009feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:17.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 --2- 172.21.15.88:0/4047566004 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f2b40039ca0 0x7f2b4003c160 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:17.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 --2- 172.21.15.88:0/4047566004 >> v2:172.21.15.52:3300/0 conn(0x7f2b600a5b20 0x7f2b60130530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:17.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 -- 172.21.15.88:0/4047566004 >> 172.21.15.88:0/4047566004 conn(0x7f2b6009d110 msgr2=0x7f2b60069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:17.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 -- 172.21.15.88:0/4047566004 shutdown_connections 2020-02-11T16:31:17.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:17.362+0000 7f2b668dc700 1 -- 172.21.15.88:0/4047566004 wait complete. 2020-02-11T16:31:17.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:31:17.822 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:17.829 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:17.829 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.13 2020-02-11T16:31:17.830 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.13 2020-02-11T16:31:17.830 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.13 2020-02-11T16:31:17.830 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.13 2020-02-11T16:31:17.834 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:18.585 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:18.591 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:18.591 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.14 2020-02-11T16:31:18.591 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.14 2020-02-11T16:31:18.592 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.14 2020-02-11T16:31:18.592 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.14 2020-02-11T16:31:18.596 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:19.593 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:19.600 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:19.600 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.15 2020-02-11T16:31:19.600 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.15 2020-02-11T16:31:19.600 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.15 2020-02-11T16:31:19.601 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.15 2020-02-11T16:31:19.605 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:20.501 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:20.507 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:20.508 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.16 2020-02-11T16:31:20.508 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.16 2020-02-11T16:31:20.508 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.16 2020-02-11T16:31:20.508 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.16 2020-02-11T16:31:20.512 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:21.313 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:21.319 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:21.319 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.17 2020-02-11T16:31:21.319 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.17 2020-02-11T16:31:21.320 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.17 2020-02-11T16:31:21.320 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.17 2020-02-11T16:31:21.323 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:22.279 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:31:22.282 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:31:22.349 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:22.357 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:22.357 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.18 2020-02-11T16:31:22.357 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.18 2020-02-11T16:31:22.357 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.18 2020-02-11T16:31:22.357 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.18 2020-02-11T16:31:22.377 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:23.165 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:23.172 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:23.172 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.19 2020-02-11T16:31:23.172 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.19 2020-02-11T16:31:23.172 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.19 2020-02-11T16:31:23.173 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.19 2020-02-11T16:31:23.176 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:23.953 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:23.959 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:23.960 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.20 2020-02-11T16:31:23.960 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.20 2020-02-11T16:31:23.960 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.20 2020-02-11T16:31:23.960 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.20 2020-02-11T16:31:23.964 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:24.799 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:24.806 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:24.806 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.21 2020-02-11T16:31:24.806 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo checking v0.21 2020-02-11T16:31:24.806 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .snap/v0.21 2020-02-11T16:31:24.806 INFO:tasks.workunit.client.0.smithi088.stdout:checking v0.21 2020-02-11T16:31:24.810 INFO:tasks.workunit.client.0.smithi088.stderr:+ git diff --exit-code 2020-02-11T16:31:25.603 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ../.. 2020-02-11T16:31:25.611 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.611 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.1 2020-02-11T16:31:25.611 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.1 2020-02-11T16:31:25.621 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.621 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.2 2020-02-11T16:31:25.621 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.2 2020-02-11T16:31:25.647 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.647 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.3 2020-02-11T16:31:25.648 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.3 2020-02-11T16:31:25.698 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.698 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.4 2020-02-11T16:31:25.698 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.4 2020-02-11T16:31:25.719 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.719 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.5 2020-02-11T16:31:25.719 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.5 2020-02-11T16:31:25.752 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.752 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.6 2020-02-11T16:31:25.752 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.6 2020-02-11T16:31:25.779 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.780 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.7 2020-02-11T16:31:25.780 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.7 2020-02-11T16:31:25.807 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.807 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.8 2020-02-11T16:31:25.807 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.8 2020-02-11T16:31:25.842 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.843 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.9 2020-02-11T16:31:25.843 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.9 2020-02-11T16:31:25.883 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.883 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.10 2020-02-11T16:31:25.883 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.10 2020-02-11T16:31:25.905 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.906 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.11 2020-02-11T16:31:25.906 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.11 2020-02-11T16:31:25.928 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.928 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.12 2020-02-11T16:31:25.928 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.12 2020-02-11T16:31:25.950 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.951 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.13 2020-02-11T16:31:25.951 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.13 2020-02-11T16:31:25.985 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.985 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.14 2020-02-11T16:31:25.985 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.14 2020-02-11T16:31:25.997 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:25.997 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.15 2020-02-11T16:31:25.997 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.15 2020-02-11T16:31:26.029 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:26.029 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.16 2020-02-11T16:31:26.029 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.16 2020-02-11T16:31:26.050 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:26.050 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.17 2020-02-11T16:31:26.050 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.17 2020-02-11T16:31:26.134 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:26.134 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.18 2020-02-11T16:31:26.134 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.18 2020-02-11T16:31:26.160 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:26.160 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.19 2020-02-11T16:31:26.160 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.19 2020-02-11T16:31:26.202 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:26.203 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.20 2020-02-11T16:31:26.203 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.20 2020-02-11T16:31:26.224 INFO:tasks.workunit.client.0.smithi088.stderr:+ for v in $versions 2020-02-11T16:31:26.224 INFO:tasks.workunit.client.0.smithi088.stderr:+ ver=v0.21 2020-02-11T16:31:26.224 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/v0.21 2020-02-11T16:31:26.244 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:31:26.244 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:31:26.244 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:31:26.244 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:31:27.234 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.232+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 35'5124 (0'0,35'5124] local-lis/les=21/22 n=1148 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=35'5124 lcod 35'5122 mlcod 35'5122 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.235 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.233+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 35'5001 (0'0,35'5001] local-lis/les=21/22 n=1107 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=35'5001 lcod 35'4999 mlcod 35'4999 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.235 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.232+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 35'5142 (0'0,35'5142] local-lis/les=21/22 n=1131 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=35'5142 lcod 35'5140 mlcod 35'5140 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.235 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.233+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 35'5286 (0'0,35'5286] local-lis/les=21/22 n=1181 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=35'5286 lcod 35'5284 mlcod 35'5284 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.238 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.236+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5126 (0'0,36'5126] local-lis/les=21/22 n=1146 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=35'5124 crt=35'5124 lcod 35'5122 mlcod 35'5122 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.239 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.236+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5003 (0'0,36'5003] local-lis/les=21/22 n=1105 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=35'5001 crt=35'5001 lcod 35'4999 mlcod 35'4999 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.239 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.232+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 35'5347 (0'0,35'5347] local-lis/les=21/22 n=1197 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=35'5347 lcod 35'5345 mlcod 35'5345 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.239 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.232+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 35'4999 (0'0,35'4999] local-lis/les=21/22 n=1072 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=35'4999 lcod 35'4997 mlcod 35'4997 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.239 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.235+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5001 (0'0,36'5001] local-lis/les=21/22 n=1070 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=35'4999 crt=35'4999 lcod 35'4997 mlcod 35'4997 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.239 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.236+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5349 (0'0,36'5349] local-lis/les=21/22 n=1195 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=35'5347 crt=35'5347 lcod 35'5345 mlcod 35'5345 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.240 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.236+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5144 (0'0,36'5144] local-lis/les=21/22 n=1129 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=35'5142 crt=35'5142 lcod 35'5140 mlcod 35'5140 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.240 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.237+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 35'4997 (0'0,35'4997] local-lis/les=21/22 n=1153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=35'4997 lcod 35'4995 mlcod 35'4995 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.243 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.240+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'4999 (0'0,36'4999] local-lis/les=21/22 n=1151 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=35'4997 crt=35'4997 lcod 35'4995 mlcod 35'4995 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.244 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.235+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5288 (0'0,36'5288] local-lis/les=21/22 n=1179 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=35'5286 crt=35'5286 lcod 35'5284 mlcod 35'5284 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.244 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.237+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 35'5162 (0'0,35'5162] local-lis/les=21/22 n=1201 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=35'5162 lcod 35'5160 mlcod 35'5160 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.245 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.240+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5164 (0'0,36'5164] local-lis/les=21/22 n=1199 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=35'5162 crt=35'5162 lcod 35'5160 mlcod 35'5160 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.256 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.253+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5003 (0'0,36'5003] local-lis/les=21/22 n=1068 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5003 lcod 36'5001 mlcod 36'5001 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.256 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.253+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5166 (0'0,36'5166] local-lis/les=21/22 n=1197 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5166 lcod 36'5164 mlcod 36'5164 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.257 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.254+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5128 (0'0,36'5128] local-lis/les=21/22 n=1144 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5128 lcod 36'5126 mlcod 36'5126 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.257 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.254+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5351 (0'0,36'5351] local-lis/les=21/22 n=1193 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5351 lcod 36'5349 mlcod 36'5349 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.258 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.255+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5146 (0'0,36'5146] local-lis/les=21/22 n=1127 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5146 lcod 36'5144 mlcod 36'5144 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.258 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.255+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5005 (0'0,36'5005] local-lis/les=21/22 n=1066 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5003 crt=36'5003 lcod 36'5001 mlcod 36'5001 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.259 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.257+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5130 (0'0,36'5130] local-lis/les=21/22 n=1142 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5128 crt=36'5128 lcod 36'5126 mlcod 36'5126 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.259 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.257+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5168 (0'0,36'5168] local-lis/les=21/22 n=1195 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5166 crt=36'5166 lcod 36'5164 mlcod 36'5164 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.264 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.259+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5148 (0'0,36'5148] local-lis/les=21/22 n=1125 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5146 crt=36'5146 lcod 36'5144 mlcod 36'5144 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.267 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.262+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5353 (0'0,36'5353] local-lis/les=21/22 n=1191 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5351 crt=36'5351 lcod 36'5349 mlcod 36'5349 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.267 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.261+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5005 (0'0,36'5005] local-lis/les=21/22 n=1103 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5005 lcod 36'5003 mlcod 36'5003 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.268 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.265+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5001 (0'0,36'5001] local-lis/les=21/22 n=1149 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5001 lcod 36'4999 mlcod 36'4999 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.270 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.268+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5290 (0'0,36'5290] local-lis/les=21/22 n=1177 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5290 lcod 36'5288 mlcod 36'5288 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.270 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.268+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5003 (0'0,36'5003] local-lis/les=21/22 n=1147 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5001 crt=36'5001 lcod 36'4999 mlcod 36'4999 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.273 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.271+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5292 (0'0,36'5292] local-lis/les=21/22 n=1175 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5290 crt=36'5290 lcod 36'5288 mlcod 36'5288 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.274 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.264+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5007 (0'0,36'5007] local-lis/les=21/22 n=1101 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5005 crt=36'5005 lcod 36'5003 mlcod 36'5003 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.280 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.277+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5355 (0'0,36'5355] local-lis/les=21/22 n=1189 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5355 lcod 36'5353 mlcod 36'5353 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.280 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.277+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5150 (0'0,36'5150] local-lis/les=21/22 n=1123 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5150 lcod 36'5148 mlcod 36'5148 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.282 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.279+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5009 (0'0,36'5009] local-lis/les=21/22 n=1099 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5009 lcod 36'5007 mlcod 36'5007 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.283 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.280+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5170 (0'0,36'5170] local-lis/les=21/22 n=1193 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5170 lcod 36'5168 mlcod 36'5168 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.284 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.278+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5132 (0'0,36'5132] local-lis/les=21/22 n=1140 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5132 lcod 36'5130 mlcod 36'5130 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.285 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.281+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5152 (0'0,36'5152] local-lis/les=21/22 n=1121 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5150 crt=36'5150 lcod 36'5148 mlcod 36'5148 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.287 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.284+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5172 (0'0,36'5172] local-lis/les=21/22 n=1191 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5170 crt=36'5170 lcod 36'5168 mlcod 36'5168 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.287 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.285+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5134 (0'0,36'5134] local-lis/les=21/22 n=1138 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5132 crt=36'5132 lcod 36'5130 mlcod 36'5130 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.289 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.282+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5357 (0'0,36'5357] local-lis/les=21/22 n=1187 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5355 crt=36'5355 lcod 36'5353 mlcod 36'5353 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.290 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.284+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5007 (0'0,36'5007] local-lis/les=21/22 n=1064 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5007 lcod 36'5005 mlcod 36'5005 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.291 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.287+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5009 (0'0,36'5009] local-lis/les=21/22 n=1062 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5007 crt=36'5007 lcod 36'5005 mlcod 36'5005 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.291 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.286+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5294 (0'0,36'5294] local-lis/les=21/22 n=1173 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5294 lcod 36'5292 mlcod 36'5292 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.292 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.289+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5296 (0'0,36'5296] local-lis/les=21/22 n=1171 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5294 crt=36'5294 lcod 36'5292 mlcod 36'5292 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.297 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.287+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5011 (0'0,36'5011] local-lis/les=21/22 n=1097 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5009 crt=36'5009 lcod 36'5007 mlcod 36'5007 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.297 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.295+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5005 (0'0,36'5005] local-lis/les=21/22 n=1145 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5005 lcod 36'5003 mlcod 36'5003 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.300 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.298+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5007 (0'0,36'5007] local-lis/les=21/22 n=1143 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5005 crt=36'5005 lcod 36'5003 mlcod 36'5003 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.304 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.301+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5359 (0'0,36'5359] local-lis/les=21/22 n=1185 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5359 lcod 36'5357 mlcod 36'5357 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.306 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.303+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5011 (0'0,36'5011] local-lis/les=21/22 n=1060 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5011 lcod 36'5009 mlcod 36'5009 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.307 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.304+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5361 (0'0,36'5361] local-lis/les=21/22 n=1183 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5359 crt=36'5359 lcod 36'5357 mlcod 36'5357 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.307 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.305+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5013 (0'0,36'5013] local-lis/les=21/22 n=1095 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5013 lcod 36'5011 mlcod 36'5011 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.310 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.304+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5298 (0'0,36'5298] local-lis/les=21/22 n=1169 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5298 lcod 36'5296 mlcod 36'5296 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.311 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.307+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5300 (0'0,36'5300] local-lis/les=21/22 n=1167 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5298 crt=36'5298 lcod 36'5296 mlcod 36'5296 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.312 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.310+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5009 (0'0,36'5009] local-lis/les=21/22 n=1141 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5009 lcod 36'5007 mlcod 36'5007 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.313 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.311+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5154 (0'0,36'5154] local-lis/les=21/22 n=1119 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5154 lcod 36'5152 mlcod 36'5152 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.315 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.308+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5015 (0'0,36'5015] local-lis/les=21/22 n=1093 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5013 crt=36'5013 lcod 36'5011 mlcod 36'5011 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.317 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.313+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5011 (0'0,36'5011] local-lis/les=21/22 n=1139 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5009 crt=36'5009 lcod 36'5007 mlcod 36'5007 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.318 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.314+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5156 (0'0,36'5156] local-lis/les=21/22 n=1117 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5154 crt=36'5154 lcod 36'5152 mlcod 36'5152 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.319 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.313+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5013 (0'0,36'5013] local-lis/les=21/22 n=1058 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5011 crt=36'5011 lcod 36'5009 mlcod 36'5009 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.320 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.317+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5174 (0'0,36'5174] local-lis/les=21/22 n=1189 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5174 lcod 36'5172 mlcod 36'5172 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.325 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.320+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5176 (0'0,36'5176] local-lis/les=21/22 n=1187 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5174 crt=36'5174 lcod 36'5172 mlcod 36'5172 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.327 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.324+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5015 (0'0,36'5015] local-lis/les=21/22 n=1056 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5015 lcod 36'5013 mlcod 36'5013 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.328 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.326+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5017 (0'0,36'5017] local-lis/les=21/22 n=1054 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5015 crt=36'5015 lcod 36'5013 mlcod 36'5013 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.331 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.310+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5136 (0'0,36'5136] local-lis/les=21/22 n=1136 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5136 lcod 36'5134 mlcod 36'5134 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.333 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.317+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5138 (0'0,36'5138] local-lis/les=21/22 n=1134 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5136 crt=36'5136 lcod 36'5134 mlcod 36'5134 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.336 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.333+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5013 (0'0,36'5013] local-lis/les=21/22 n=1137 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5013 lcod 36'5011 mlcod 36'5011 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.336 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.334+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5363 (0'0,36'5363] local-lis/les=21/22 n=1181 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5363 lcod 36'5361 mlcod 36'5361 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.342 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.330+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5017 (0'0,36'5017] local-lis/les=21/22 n=1091 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5017 lcod 36'5015 mlcod 36'5015 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.343 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.338+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5158 (0'0,36'5158] local-lis/les=21/22 n=1115 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5158 lcod 36'5156 mlcod 36'5156 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.344 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.340+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5015 (0'0,36'5015] local-lis/les=21/22 n=1135 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5013 crt=36'5013 lcod 36'5011 mlcod 36'5011 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.344 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.340+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5178 (0'0,36'5178] local-lis/les=21/22 n=1185 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5178 lcod 36'5176 mlcod 36'5176 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.345 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.335+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5019 (0'0,36'5019] local-lis/les=21/22 n=1089 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5017 crt=36'5017 lcod 36'5015 mlcod 36'5015 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.346 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.340+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5365 (0'0,36'5365] local-lis/les=21/22 n=1179 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5363 crt=36'5363 lcod 36'5361 mlcod 36'5361 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.347 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.344+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5180 (0'0,36'5180] local-lis/les=21/22 n=1183 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5178 crt=36'5178 lcod 36'5176 mlcod 36'5176 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.347 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.345+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5019 (0'0,36'5019] local-lis/les=21/22 n=1052 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5019 lcod 36'5017 mlcod 36'5017 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.348 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.342+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5160 (0'0,36'5160] local-lis/les=21/22 n=1113 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5158 crt=36'5158 lcod 36'5156 mlcod 36'5156 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.350 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.347+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5140 (0'0,36'5140] local-lis/les=21/22 n=1132 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5140 lcod 36'5138 mlcod 36'5138 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.351 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.348+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5021 (0'0,36'5021] local-lis/les=21/22 n=1050 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5019 crt=36'5019 lcod 36'5017 mlcod 36'5017 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.351 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.347+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5302 (0'0,36'5302] local-lis/les=21/22 n=1165 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5302 lcod 36'5300 mlcod 36'5300 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.353 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.351+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5304 (0'0,36'5304] local-lis/les=21/22 n=1163 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5302 crt=36'5302 lcod 36'5300 mlcod 36'5300 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.358 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.355+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5142 (0'0,36'5142] local-lis/les=21/22 n=1130 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5140 crt=36'5140 lcod 36'5138 mlcod 36'5138 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.358 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.356+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5162 (0'0,36'5162] local-lis/les=21/22 n=1111 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5162 lcod 36'5160 mlcod 36'5160 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.362 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.359+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5164 (0'0,36'5164] local-lis/les=21/22 n=1109 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5162 crt=36'5162 lcod 36'5160 mlcod 36'5160 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.363 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.360+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5182 (0'0,36'5182] local-lis/les=21/22 n=1181 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5182 lcod 36'5180 mlcod 36'5180 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.364 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.362+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5017 (0'0,36'5017] local-lis/les=21/22 n=1133 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5017 lcod 36'5015 mlcod 36'5015 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.366 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.363+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5184 (0'0,36'5184] local-lis/les=21/22 n=1179 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5182 crt=36'5182 lcod 36'5180 mlcod 36'5180 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.367 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.365+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5019 (0'0,36'5019] local-lis/les=21/22 n=1131 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5017 crt=36'5017 lcod 36'5015 mlcod 36'5015 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.369 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.365+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5021 (0'0,36'5021] local-lis/les=21/22 n=1087 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5021 lcod 36'5019 mlcod 36'5019 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.372 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.367+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5367 (0'0,36'5367] local-lis/les=21/22 n=1177 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5367 lcod 36'5365 mlcod 36'5365 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.372 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.367+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5023 (0'0,36'5023] local-lis/les=21/22 n=1048 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5023 lcod 36'5021 mlcod 36'5021 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.373 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.371+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5023 (0'0,36'5023] local-lis/les=21/22 n=1085 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5021 crt=36'5021 lcod 36'5019 mlcod 36'5019 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.374 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.372+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5144 (0'0,36'5144] local-lis/les=21/22 n=1128 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5144 lcod 36'5142 mlcod 36'5142 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.375 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.373+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5025 (0'0,36'5025] local-lis/les=21/22 n=1046 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5023 crt=36'5023 lcod 36'5021 mlcod 36'5021 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.376 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.374+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5369 (0'0,36'5369] local-lis/les=21/22 n=1175 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5367 crt=36'5367 lcod 36'5365 mlcod 36'5365 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.378 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:31:27.378 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:31:27.381 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.377+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5166 (0'0,36'5166] local-lis/les=21/22 n=1107 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5166 lcod 36'5164 mlcod 36'5164 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.381 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.379+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5146 (0'0,36'5146] local-lis/les=21/22 n=1126 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5144 crt=36'5144 lcod 36'5142 mlcod 36'5142 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.382 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.379+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5186 (0'0,36'5186] local-lis/les=21/22 n=1177 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5186 lcod 36'5184 mlcod 36'5184 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.385 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.380+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5168 (0'0,36'5168] local-lis/les=21/22 n=1105 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5166 crt=36'5166 lcod 36'5164 mlcod 36'5164 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.386 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.383+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5306 (0'0,36'5306] local-lis/les=21/22 n=1161 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5306 lcod 36'5304 mlcod 36'5304 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.386 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.384+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5188 (0'0,36'5188] local-lis/les=21/22 n=1175 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5186 crt=36'5186 lcod 36'5184 mlcod 36'5184 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.389 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.387+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5308 (0'0,36'5308] local-lis/les=21/22 n=1159 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5306 crt=36'5306 lcod 36'5304 mlcod 36'5304 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.391 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.386+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5021 (0'0,36'5021] local-lis/les=21/22 n=1129 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5021 lcod 36'5019 mlcod 36'5019 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.389+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5023 (0'0,36'5023] local-lis/les=21/22 n=1127 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5021 crt=36'5021 lcod 36'5019 mlcod 36'5019 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.394 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.389+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5025 (0'0,36'5025] local-lis/les=21/22 n=1083 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5025 lcod 36'5023 mlcod 36'5023 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.396 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.393+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5371 (0'0,36'5371] local-lis/les=21/22 n=1173 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5371 lcod 36'5369 mlcod 36'5369 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.398 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.393+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5027 (0'0,36'5027] local-lis/les=21/22 n=1081 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5025 crt=36'5025 lcod 36'5023 mlcod 36'5023 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.399 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.396+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5373 (0'0,36'5373] local-lis/les=21/22 n=1171 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5371 crt=36'5371 lcod 36'5369 mlcod 36'5369 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.399 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.396+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5027 (0'0,36'5027] local-lis/les=21/22 n=1044 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5027 lcod 36'5025 mlcod 36'5025 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.402 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.400+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5029 (0'0,36'5029] local-lis/les=21/22 n=1042 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5027 crt=36'5027 lcod 36'5025 mlcod 36'5025 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.403 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.400+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5310 (0'0,36'5310] local-lis/les=21/22 n=1157 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5310 lcod 36'5308 mlcod 36'5308 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.405 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.403+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5148 (0'0,36'5148] local-lis/les=21/22 n=1124 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5148 lcod 36'5146 mlcod 36'5146 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.406 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.404+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5312 (0'0,36'5312] local-lis/les=21/22 n=1155 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5310 crt=36'5310 lcod 36'5308 mlcod 36'5308 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.416 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.406+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5170 (0'0,36'5170] local-lis/les=21/22 n=1103 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5170 lcod 36'5168 mlcod 36'5168 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.416 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.410+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5172 (0'0,36'5172] local-lis/les=21/22 n=1101 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5170 crt=36'5170 lcod 36'5168 mlcod 36'5168 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.416 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.412+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5190 (0'0,36'5190] local-lis/les=21/22 n=1173 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5190 lcod 36'5188 mlcod 36'5188 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.416 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.405+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5029 (0'0,36'5029] local-lis/les=21/22 n=1079 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5029 lcod 36'5027 mlcod 36'5027 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.416 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.411+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5150 (0'0,36'5150] local-lis/les=21/22 n=1122 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5148 crt=36'5148 lcod 36'5146 mlcod 36'5146 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.417 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.414+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5375 (0'0,36'5375] local-lis/les=21/22 n=1169 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5375 lcod 36'5373 mlcod 36'5373 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.417 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.415+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5031 (0'0,36'5031] local-lis/les=21/22 n=1040 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5031 lcod 36'5029 mlcod 36'5029 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.418 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.415+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5192 (0'0,36'5192] local-lis/les=21/22 n=1171 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5190 crt=36'5190 lcod 36'5188 mlcod 36'5188 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.420 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.418+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5031 (0'0,36'5031] local-lis/les=21/22 n=1077 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5029 crt=36'5029 lcod 36'5027 mlcod 36'5027 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.423 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.421+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5377 (0'0,36'5377] local-lis/les=21/22 n=1167 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5375 crt=36'5375 lcod 36'5373 mlcod 36'5373 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.424 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.422+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5025 (0'0,36'5025] local-lis/les=21/22 n=1125 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5025 lcod 36'5023 mlcod 36'5023 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.426 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.424+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5033 (0'0,36'5033] local-lis/les=21/22 n=1038 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5031 crt=36'5031 lcod 36'5029 mlcod 36'5029 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.427 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.425+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5027 (0'0,36'5027] local-lis/les=21/22 n=1123 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5025 crt=36'5025 lcod 36'5023 mlcod 36'5023 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.429 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.427+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5152 (0'0,36'5152] local-lis/les=21/22 n=1120 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5152 lcod 36'5150 mlcod 36'5150 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.429 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.427+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5314 (0'0,36'5314] local-lis/les=21/22 n=1153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5314 lcod 36'5312 mlcod 36'5312 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.433 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.430+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5033 (0'0,36'5033] local-lis/les=21/22 n=1075 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5033 lcod 36'5031 mlcod 36'5031 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.434 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.431+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5316 (0'0,36'5316] local-lis/les=21/22 n=1151 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5314 crt=36'5314 lcod 36'5312 mlcod 36'5312 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.435 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.431+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5154 (0'0,36'5154] local-lis/les=21/22 n=1118 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5152 crt=36'5152 lcod 36'5150 mlcod 36'5150 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.441 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.433+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5035 (0'0,36'5035] local-lis/les=21/22 n=1073 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5033 crt=36'5033 lcod 36'5031 mlcod 36'5031 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.442 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.438+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5174 (0'0,36'5174] local-lis/les=21/22 n=1099 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5174 lcod 36'5172 mlcod 36'5172 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.443 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.441+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5379 (0'0,36'5379] local-lis/les=21/22 n=1165 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5379 lcod 36'5377 mlcod 36'5377 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.445 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.441+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5176 (0'0,36'5176] local-lis/les=21/22 n=1097 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5174 crt=36'5174 lcod 36'5172 mlcod 36'5172 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.447 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.444+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5381 (0'0,36'5381] local-lis/les=21/22 n=1163 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5379 crt=36'5379 lcod 36'5377 mlcod 36'5377 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.447 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.436+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5194 (0'0,36'5194] local-lis/les=21/22 n=1169 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5194 lcod 36'5192 mlcod 36'5192 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.448 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.439+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5196 (0'0,36'5196] local-lis/les=21/22 n=1167 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5194 crt=36'5194 lcod 36'5192 mlcod 36'5192 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.451 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.449+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5318 (0'0,36'5318] local-lis/les=21/22 n=1149 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5318 lcod 36'5316 mlcod 36'5316 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.451 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.447+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5156 (0'0,36'5156] local-lis/les=21/22 n=1116 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5156 lcod 36'5154 mlcod 36'5154 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.452 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.450+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5035 (0'0,36'5035] local-lis/les=21/22 n=1036 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5035 lcod 36'5033 mlcod 36'5033 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.454 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.451+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5158 (0'0,36'5158] local-lis/les=21/22 n=1114 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5156 crt=36'5156 lcod 36'5154 mlcod 36'5154 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.455 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.452+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5320 (0'0,36'5320] local-lis/les=21/22 n=1147 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5318 crt=36'5318 lcod 36'5316 mlcod 36'5316 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.459 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.456+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5037 (0'0,36'5037] local-lis/les=21/22 n=1034 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5035 crt=36'5035 lcod 36'5033 mlcod 36'5033 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.460 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.455+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5029 (0'0,36'5029] local-lis/les=21/22 n=1121 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5029 lcod 36'5027 mlcod 36'5027 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.460 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.458+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5031 (0'0,36'5031] local-lis/les=21/22 n=1119 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5029 crt=36'5029 lcod 36'5027 mlcod 36'5027 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.463 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.461+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5198 (0'0,36'5198] local-lis/les=21/22 n=1165 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5198 lcod 36'5196 mlcod 36'5196 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.467 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.465+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5037 (0'0,36'5037] local-lis/les=21/22 n=1071 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5037 lcod 36'5035 mlcod 36'5035 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.467 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.462+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5178 (0'0,36'5178] local-lis/les=21/22 n=1095 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5178 lcod 36'5176 mlcod 36'5176 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.468 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.465+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5180 (0'0,36'5180] local-lis/les=21/22 n=1093 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5178 crt=36'5178 lcod 36'5176 mlcod 36'5176 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.472 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.470+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5200 (0'0,36'5200] local-lis/les=21/22 n=1163 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5198 crt=36'5198 lcod 36'5196 mlcod 36'5196 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.472 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.470+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5383 (0'0,36'5383] local-lis/les=21/22 n=1161 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5383 lcod 36'5381 mlcod 36'5381 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.473 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.468+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5160 (0'0,36'5160] local-lis/les=21/22 n=1112 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5160 lcod 36'5158 mlcod 36'5158 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.473 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.472+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5162 (0'0,36'5162] local-lis/les=21/22 n=1110 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5160 crt=36'5160 lcod 36'5158 mlcod 36'5158 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.476 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.474+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5322 (0'0,36'5322] local-lis/les=21/22 n=1145 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5322 lcod 36'5320 mlcod 36'5320 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.477 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.474+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5385 (0'0,36'5385] local-lis/les=21/22 n=1159 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5383 crt=36'5383 lcod 36'5381 mlcod 36'5381 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.478 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.475+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5033 (0'0,36'5033] local-lis/les=21/22 n=1117 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5033 lcod 36'5031 mlcod 36'5031 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.481 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.478+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5035 (0'0,36'5035] local-lis/les=21/22 n=1115 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5033 crt=36'5033 lcod 36'5031 mlcod 36'5031 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.482 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.480+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5039 (0'0,36'5039] local-lis/les=21/22 n=1032 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5039 lcod 36'5037 mlcod 36'5037 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.483 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.481+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5039 (0'0,36'5039] local-lis/les=21/22 n=1069 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5037 crt=36'5037 lcod 36'5035 mlcod 36'5035 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.484 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.481+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5324 (0'0,36'5324] local-lis/les=21/22 n=1143 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5322 crt=36'5322 lcod 36'5320 mlcod 36'5320 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.489 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.484+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5041 (0'0,36'5041] local-lis/les=21/22 n=1030 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5039 crt=36'5039 lcod 36'5037 mlcod 36'5037 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.492 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.490+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5182 (0'0,36'5182] local-lis/les=21/22 n=1091 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5182 lcod 36'5180 mlcod 36'5180 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.495 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.492+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5387 (0'0,36'5387] local-lis/les=21/22 n=1157 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5387 lcod 36'5385 mlcod 36'5385 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.495 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.491+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5202 (0'0,36'5202] local-lis/les=21/22 n=1161 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5202 lcod 36'5200 mlcod 36'5200 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.498 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.496+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5389 (0'0,36'5389] local-lis/les=21/22 n=1155 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5387 crt=36'5387 lcod 36'5385 mlcod 36'5385 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.500 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.496+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5037 (0'0,36'5037] local-lis/les=21/22 n=1113 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5037 lcod 36'5035 mlcod 36'5035 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.501 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.499+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5041 (0'0,36'5041] local-lis/les=21/22 n=1067 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5041 lcod 36'5039 mlcod 36'5039 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.501 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.500+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5164 (0'0,36'5164] local-lis/les=21/22 n=1108 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5164 lcod 36'5162 mlcod 36'5162 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.502 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.498+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5184 (0'0,36'5184] local-lis/les=21/22 n=1089 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5182 crt=36'5182 lcod 36'5180 mlcod 36'5180 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.502 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.498+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5204 (0'0,36'5204] local-lis/les=21/22 n=1159 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5202 crt=36'5202 lcod 36'5200 mlcod 36'5200 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.503 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.500+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5039 (0'0,36'5039] local-lis/les=21/22 n=1111 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5037 crt=36'5037 lcod 36'5035 mlcod 36'5035 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.507 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.503+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5166 (0'0,36'5166] local-lis/les=21/22 n=1106 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5164 crt=36'5164 lcod 36'5162 mlcod 36'5162 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.509 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.507+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5043 (0'0,36'5043] local-lis/les=21/22 n=1065 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5041 crt=36'5041 lcod 36'5039 mlcod 36'5039 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.514 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.505+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5326 (0'0,36'5326] local-lis/les=21/22 n=1141 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5326 lcod 36'5324 mlcod 36'5324 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.514 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.509+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5328 (0'0,36'5328] local-lis/les=21/22 n=1139 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5326 crt=36'5326 lcod 36'5324 mlcod 36'5324 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.515 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.507+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5043 (0'0,36'5043] local-lis/les=21/22 n=1028 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5043 lcod 36'5041 mlcod 36'5041 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.516 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.511+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5045 (0'0,36'5045] local-lis/les=21/22 n=1026 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5043 crt=36'5043 lcod 36'5041 mlcod 36'5041 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.517 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.514+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5186 (0'0,36'5186] local-lis/les=21/22 n=1087 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5186 lcod 36'5184 mlcod 36'5184 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.520 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.518+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5206 (0'0,36'5206] local-lis/les=21/22 n=1157 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5206 lcod 36'5204 mlcod 36'5204 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.520 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.517+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5188 (0'0,36'5188] local-lis/les=21/22 n=1085 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5186 crt=36'5186 lcod 36'5184 mlcod 36'5184 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.526 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.522+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5208 (0'0,36'5208] local-lis/les=21/22 n=1155 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5206 crt=36'5206 lcod 36'5204 mlcod 36'5204 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.527 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.525+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5045 (0'0,36'5045] local-lis/les=21/22 n=1063 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5045 lcod 36'5043 mlcod 36'5043 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.527 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.521+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5391 (0'0,36'5391] local-lis/les=21/22 n=1153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5391 lcod 36'5389 mlcod 36'5389 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.528 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.524+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5393 (0'0,36'5393] local-lis/les=21/22 n=1151 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5391 crt=36'5391 lcod 36'5389 mlcod 36'5389 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.533 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.531+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5330 (0'0,36'5330] local-lis/les=21/22 n=1137 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5330 lcod 36'5328 mlcod 36'5328 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.533 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.531+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5041 (0'0,36'5041] local-lis/les=21/22 n=1109 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5041 lcod 36'5039 mlcod 36'5039 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.534 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.532+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5047 (0'0,36'5047] local-lis/les=21/22 n=1061 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5045 crt=36'5045 lcod 36'5043 mlcod 36'5043 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.535 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.532+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5047 (0'0,36'5047] local-lis/les=21/22 n=1024 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5047 lcod 36'5045 mlcod 36'5045 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.537 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.534+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5043 (0'0,36'5043] local-lis/les=21/22 n=1107 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5041 crt=36'5041 lcod 36'5039 mlcod 36'5039 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.539 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.537+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5190 (0'0,36'5190] local-lis/les=21/22 n=1083 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5190 lcod 36'5188 mlcod 36'5188 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.540 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.533+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5168 (0'0,36'5168] local-lis/les=21/22 n=1104 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5168 lcod 36'5166 mlcod 36'5166 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.541 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.539+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5332 (0'0,36'5332] local-lis/les=21/22 n=1135 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5330 crt=36'5330 lcod 36'5328 mlcod 36'5328 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.545 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.540+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5170 (0'0,36'5170] local-lis/les=21/22 n=1102 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5168 crt=36'5168 lcod 36'5166 mlcod 36'5166 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.545 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.540+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5192 (0'0,36'5192] local-lis/les=21/22 n=1081 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5190 crt=36'5190 lcod 36'5188 mlcod 36'5188 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.549 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.546+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5049 (0'0,36'5049] local-lis/les=21/22 n=1022 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5047 crt=36'5047 lcod 36'5045 mlcod 36'5045 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.550 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.546+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5210 (0'0,36'5210] local-lis/les=21/22 n=1153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5210 lcod 36'5208 mlcod 36'5208 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.552 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.547+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5049 (0'0,36'5049] local-lis/les=21/22 n=1059 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5049 lcod 36'5047 mlcod 36'5047 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.553 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.549+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5045 (0'0,36'5045] local-lis/les=21/22 n=1105 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5045 lcod 36'5043 mlcod 36'5043 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.555 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.550+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5212 (0'0,36'5212] local-lis/les=21/22 n=1151 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5210 crt=36'5210 lcod 36'5208 mlcod 36'5208 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.556 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.554+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5047 (0'0,36'5047] local-lis/les=21/22 n=1103 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5045 crt=36'5045 lcod 36'5043 mlcod 36'5043 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.558 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.550+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5395 (0'0,36'5395] local-lis/les=21/22 n=1149 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5395 lcod 36'5393 mlcod 36'5393 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.558 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.554+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5051 (0'0,36'5051] local-lis/les=21/22 n=1057 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5049 crt=36'5049 lcod 36'5047 mlcod 36'5047 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.560 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.558+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5397 (0'0,36'5397] local-lis/les=21/22 n=1147 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5395 crt=36'5395 lcod 36'5393 mlcod 36'5393 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.561 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.559+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5051 (0'0,36'5051] local-lis/les=21/22 n=1020 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5051 lcod 36'5049 mlcod 36'5049 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.565 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.563+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5053 (0'0,36'5053] local-lis/les=21/22 n=1018 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5051 crt=36'5051 lcod 36'5049 mlcod 36'5049 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.566 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.564+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5172 (0'0,36'5172] local-lis/les=21/22 n=1100 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5172 lcod 36'5170 mlcod 36'5170 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.568 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.564+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5214 (0'0,36'5214] local-lis/les=21/22 n=1149 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5214 lcod 36'5212 mlcod 36'5212 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.569 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.568+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5174 (0'0,36'5174] local-lis/les=21/22 n=1098 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5172 crt=36'5172 lcod 36'5170 mlcod 36'5170 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.570 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.564+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5194 (0'0,36'5194] local-lis/les=21/22 n=1079 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5194 lcod 36'5192 mlcod 36'5192 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.570 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.567+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5196 (0'0,36'5196] local-lis/les=21/22 n=1077 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5194 crt=36'5194 lcod 36'5192 mlcod 36'5192 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.570 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.567+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5216 (0'0,36'5216] local-lis/les=21/22 n=1147 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5214 crt=36'5214 lcod 36'5212 mlcod 36'5212 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.573 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.571+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5334 (0'0,36'5334] local-lis/les=21/22 n=1133 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5334 lcod 36'5332 mlcod 36'5332 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.577 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.575+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5336 (0'0,36'5336] local-lis/les=21/22 n=1131 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5334 crt=36'5334 lcod 36'5332 mlcod 36'5332 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.578 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.576+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5049 (0'0,36'5049] local-lis/les=21/22 n=1101 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5049 lcod 36'5047 mlcod 36'5047 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.580 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.577+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5055 (0'0,36'5055] local-lis/les=21/22 n=1016 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5055 lcod 36'5053 mlcod 36'5053 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.580 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.571+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5053 (0'0,36'5053] local-lis/les=21/22 n=1055 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5053 lcod 36'5051 mlcod 36'5051 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.582 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.577+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5055 (0'0,36'5055] local-lis/les=21/22 n=1053 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5053 crt=36'5053 lcod 36'5051 mlcod 36'5051 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.582 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.579+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5051 (0'0,36'5051] local-lis/les=21/22 n=1099 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5049 crt=36'5049 lcod 36'5047 mlcod 36'5047 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.583 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.581+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5057 (0'0,36'5057] local-lis/les=21/22 n=1014 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5055 crt=36'5055 lcod 36'5053 mlcod 36'5053 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.591 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.589+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5218 (0'0,36'5218] local-lis/les=21/22 n=1145 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5218 lcod 36'5216 mlcod 36'5216 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.592 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.589+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5399 (0'0,36'5399] local-lis/les=21/22 n=1145 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5399 lcod 36'5397 mlcod 36'5397 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.592 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.589+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5176 (0'0,36'5176] local-lis/les=21/22 n=1096 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5176 lcod 36'5174 mlcod 36'5174 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.593 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.590+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5198 (0'0,36'5198] local-lis/les=21/22 n=1075 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5198 lcod 36'5196 mlcod 36'5196 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.594 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.592+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5178 (0'0,36'5178] local-lis/les=21/22 n=1094 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5176 crt=36'5176 lcod 36'5174 mlcod 36'5174 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.595 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.593+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5220 (0'0,36'5220] local-lis/les=21/22 n=1143 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5218 crt=36'5218 lcod 36'5216 mlcod 36'5216 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.590+0000 7f457b8f1700 1 Processor -- start 2020-02-11T16:31:27.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.590+0000 7f457b8f1700 1 -- start start 2020-02-11T16:31:27.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.591+0000 7f457b8f1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6fe0 0x7f45740a2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:27.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.591+0000 7f457b8f1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f457413fb00 0x7f457413ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:27.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.591+0000 7f457b8f1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45741368c0 con 0x7f45740a6280 2020-02-11T16:31:27.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.591+0000 7f457b8f1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45740a2870 con 0x7f457413fb00 2020-02-11T16:31:27.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.591+0000 7f457b8f1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45740a2b10 con 0x7f45740a6fe0 2020-02-11T16:31:27.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.591+0000 7f457968d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f45740a6280 0x7f45740a4ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48806/0 (socket says 172.21.15.88:48806) 2020-02-11T16:31:27.597 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.591+0000 7f457968d700 1 -- 172.21.15.88:0/3455834025 learned_addr learned my addr 172.21.15.88:0/3455834025 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:27.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.591+0000 7f4579e8e700 1 --2- 172.21.15.88:0/3455834025 >> v2:172.21.15.52:3300/0 conn(0x7f457413fb00 0x7f457413ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:27.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.592+0000 7f4579e8e700 1 -- 172.21.15.88:0/3455834025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6fe0 msgr2=0x7f45740a2360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:27.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.592+0000 7f4579e8e700 1 --2- 172.21.15.88:0/3455834025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6fe0 0x7f45740a2360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:27.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.592+0000 7f4579e8e700 1 -- 172.21.15.88:0/3455834025 >> v1:172.21.15.88:6789/0 conn(0x7f45740a6280 legacy=0x7f45740a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:27.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.592+0000 7f4579e8e700 1 -- 172.21.15.88:0/3455834025 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45740a4a50 con 0x7f457413fb00 2020-02-11T16:31:27.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.592+0000 7f4579e8e700 1 --2- 172.21.15.88:0/3455834025 >> v2:172.21.15.52:3300/0 conn(0x7f457413fb00 0x7f457413ffb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4564002f30 tx=0x7f45640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.598 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.592+0000 7f4579e8e700 1 --2- 172.21.15.88:0/3455834025 >> v2:172.21.15.52:3300/0 conn(0x7f457413fb00 0x7f457413ffb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4564002f30 tx=0x7f45640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.592+0000 7f4579e8e700 1 --2- 172.21.15.88:0/3455834025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f457413fb00 0x7f457413ffb0 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f4564002f30 tx=0x7f45640088e0).ready entity=mon.0 client_cookie=b2db9bc314329405 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:27.599 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.593+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5401 (0'0,36'5401] local-lis/les=21/22 n=1143 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5399 crt=36'5399 lcod 36'5397 mlcod 36'5397 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.599 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.593+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5338 (0'0,36'5338] local-lis/les=21/22 n=1129 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5338 lcod 36'5336 mlcod 36'5336 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.600 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.596+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5200 (0'0,36'5200] local-lis/les=21/22 n=1073 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5198 crt=36'5198 lcod 36'5196 mlcod 36'5196 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.594+0000 7f4579e8e700 1 --2- 172.21.15.88:0/3455834025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f457413fb00 0x7f457413ffb0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f4564002f30 tx=0x7f45640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.600 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.594+0000 7f4579e8e700 1 --2- 172.21.15.88:0/3455834025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f457413fb00 0x7f457413ffb0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f4564002f30 tx=0x7f45640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.594+0000 7f4579e8e700 1 --2- 172.21.15.88:0/3455834025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f457413fb00 0x7f457413ffb0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f4564002f30 tx=0x7f45640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.594+0000 7f456bfff700 1 -- 172.21.15.88:0/3455834025 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45640116a0 con 0x7f457413fb00 2020-02-11T16:31:27.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.594+0000 7f456bfff700 1 -- 172.21.15.88:0/3455834025 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4564011800 con 0x7f457413fb00 2020-02-11T16:31:27.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.594+0000 7f456bfff700 1 -- 172.21.15.88:0/3455834025 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4564011be0 con 0x7f457413fb00 2020-02-11T16:31:27.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.594+0000 7f457b8f1700 1 -- 172.21.15.88:0/3455834025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f457413fb00 msgr2=0x7f457413ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:27.601 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.594+0000 7f457b8f1700 1 --2- 172.21.15.88:0/3455834025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f457413fb00 0x7f457413ffb0 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f4564002f30 tx=0x7f45640088e0).stop 2020-02-11T16:31:27.602 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.599+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5057 (0'0,36'5057] local-lis/les=21/22 n=1051 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5057 lcod 36'5055 mlcod 36'5055 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.603 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.597+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5340 (0'0,36'5340] local-lis/les=21/22 n=1127 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5338 crt=36'5338 lcod 36'5336 mlcod 36'5336 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.599+0000 7f457b8f1700 1 -- 172.21.15.88:0/3455834025 shutdown_connections 2020-02-11T16:31:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.599+0000 7f457b8f1700 1 --2- 172.21.15.88:0/3455834025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f457413fb00 0x7f457413ffb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.599+0000 7f457b8f1700 1 --2- 172.21.15.88:0/3455834025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6fe0 0x7f45740a2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.599+0000 7f457b8f1700 1 -- 172.21.15.88:0/3455834025 >> 172.21.15.88:0/3455834025 conn(0x7f457409d110 msgr2=0x7f457409d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:27.604 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.601+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5059 (0'0,36'5059] local-lis/les=21/22 n=1012 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5059 lcod 36'5057 mlcod 36'5057 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.604 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.598+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5053 (0'0,36'5053] local-lis/les=21/22 n=1097 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5053 lcod 36'5051 mlcod 36'5051 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.606 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.604+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5061 (0'0,36'5061] local-lis/les=21/22 n=1010 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5059 crt=36'5059 lcod 36'5057 mlcod 36'5057 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.601+0000 7f457b8f1700 1 -- 172.21.15.88:0/3455834025 shutdown_connections 2020-02-11T16:31:27.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.601+0000 7f457b8f1700 1 -- 172.21.15.88:0/3455834025 wait complete. 2020-02-11T16:31:27.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.603+0000 7f457b8f1700 1 Processor -- start 2020-02-11T16:31:27.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.605+0000 7f457b8f1700 1 -- start start 2020-02-11T16:31:27.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.606+0000 7f457b8f1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:27.611 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.606+0000 7f457b8f1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f45740a6fe0 0x7f4574138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:27.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.606+0000 7f457b8f1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45741385b0 con 0x7f457413fb00 2020-02-11T16:31:27.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.606+0000 7f457b8f1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4574137110 con 0x7f45740a6fe0 2020-02-11T16:31:27.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.606+0000 7f457b8f1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45741373b0 con 0x7f45740a6280 2020-02-11T16:31:27.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.606+0000 7f457968d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:27.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.606+0000 7f457968d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55508/0 (socket says 172.21.15.88:55508) 2020-02-11T16:31:27.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.606+0000 7f457968d700 1 -- 172.21.15.88:0/1767375525 learned_addr learned my addr 172.21.15.88:0/1767375525 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:27.612 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457968d700 1 -- 172.21.15.88:0/1767375525 >> v2:172.21.15.52:3300/0 conn(0x7f45740a6fe0 msgr2=0x7f4574138970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2020-02-11T16:31:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> v2:172.21.15.52:3300/0 conn(0x7f45740a6fe0 0x7f4574138970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457968d700 1 -- 172.21.15.88:0/1767375525 >> v1:172.21.15.52:6789/0 conn(0x7f457413fb00 legacy=0x7f4574133d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457968d700 1 -- 172.21.15.88:0/1767375525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457413d2a0 con 0x7f45740a6280 2020-02-11T16:31:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f456a7fc700 1 -- 172.21.15.88:0/1767375525 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4570005ca0 con 0x7f45740a6280 2020-02-11T16:31:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f456a7fc700 1 -- 172.21.15.88:0/1767375525 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4570005e00 con 0x7f45740a6280 2020-02-11T16:31:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f456a7fc700 1 -- 172.21.15.88:0/1767375525 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45700062b0 con 0x7f45740a6280 2020-02-11T16:31:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.607+0000 7f457b8f1700 1 -- 172.21.15.88:0/1767375525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45741364a0 con 0x7f45740a6280 2020-02-11T16:31:27.614 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.608+0000 7f457b8f1700 1 -- 172.21.15.88:0/1767375525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4574136a50 con 0x7f45740a6280 2020-02-11T16:31:27.616 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.609+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5180 (0'0,36'5180] local-lis/les=21/22 n=1092 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5180 lcod 36'5178 mlcod 36'5178 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.609+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.609+0000 7f457b8f1700 1 -- 172.21.15.88:0/1767375525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45740565b0 con 0x7f45740a6280 2020-02-11T16:31:27.616 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.609+0000 7f456a7fc700 1 -- 172.21.15.88:0/1767375525 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f45700064e0 con 0x7f45740a6280 2020-02-11T16:31:27.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.609+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.610+0000 7f456a7fc700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f455c039c80 0x7f455c03c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:27.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.610+0000 7f456a7fc700 1 -- 172.21.15.88:0/1767375525 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f4570049950 con 0x7f45740a6280 2020-02-11T16:31:27.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.610+0000 7f4578e8c700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f455c039c80 0x7f455c03c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:27.617 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.610+0000 7f4578e8c700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f455c039c80 0x7f455c03c140 crc :-1 s=READY pgs=562 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:27.617 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.610+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5055 (0'0,36'5055] local-lis/les=21/22 n=1095 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5053 crt=36'5053 lcod 36'5051 mlcod 36'5051 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.618 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.612+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5182 (0'0,36'5182] local-lis/les=21/22 n=1090 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5180 crt=36'5180 lcod 36'5178 mlcod 36'5178 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.618 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.615+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5222 (0'0,36'5222] local-lis/les=21/22 n=1141 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5222 lcod 36'5220 mlcod 36'5220 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.615+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.615+0000 7f456a7fc700 1 -- 172.21.15.88:0/1767375525 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f457002f030 con 0x7f45740a6280 2020-02-11T16:31:27.623 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.618+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5224 (0'0,36'5224] local-lis/les=21/22 n=1139 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5222 crt=36'5222 lcod 36'5220 mlcod 36'5220 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.624 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.622+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5342 (0'0,36'5342] local-lis/les=21/22 n=1125 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5342 lcod 36'5340 mlcod 36'5340 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.625 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.622+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5059 (0'0,36'5059] local-lis/les=21/22 n=1049 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5057 crt=36'5057 lcod 36'5055 mlcod 36'5055 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.628 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.619+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5202 (0'0,36'5202] local-lis/les=21/22 n=1071 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5202 lcod 36'5200 mlcod 36'5200 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.628 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.622+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5204 (0'0,36'5204] local-lis/les=21/22 n=1069 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5202 crt=36'5202 lcod 36'5200 mlcod 36'5200 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.628 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.626+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5063 (0'0,36'5063] local-lis/les=21/22 n=1008 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5063 lcod 36'5061 mlcod 36'5061 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.629 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.626+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5344 (0'0,36'5344] local-lis/les=21/22 n=1123 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5342 crt=36'5342 lcod 36'5340 mlcod 36'5340 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.635 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.633+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5184 (0'0,36'5184] local-lis/les=21/22 n=1088 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5184 lcod 36'5182 mlcod 36'5182 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.636 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.629+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5403 (0'0,36'5403] local-lis/les=21/22 n=1141 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5403 lcod 36'5401 mlcod 36'5401 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.636 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.631+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5065 (0'0,36'5065] local-lis/les=21/22 n=1006 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5063 crt=36'5063 lcod 36'5061 mlcod 36'5061 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.636 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.633+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5405 (0'0,36'5405] local-lis/les=21/22 n=1139 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5403 crt=36'5403 lcod 36'5401 mlcod 36'5401 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.639 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.634+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5057 (0'0,36'5057] local-lis/les=21/22 n=1093 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5057 lcod 36'5055 mlcod 36'5055 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.640 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.637+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5059 (0'0,36'5059] local-lis/les=21/22 n=1091 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5057 crt=36'5057 lcod 36'5055 mlcod 36'5055 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.640 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.636+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5186 (0'0,36'5186] local-lis/les=21/22 n=1086 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5184 crt=36'5184 lcod 36'5182 mlcod 36'5182 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.641 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.639+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5226 (0'0,36'5226] local-lis/les=21/22 n=1137 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5226 lcod 36'5224 mlcod 36'5224 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.646 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.643+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5228 (0'0,36'5228] local-lis/les=21/22 n=1135 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5226 crt=36'5226 lcod 36'5224 mlcod 36'5224 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.651 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.645+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5206 (0'0,36'5206] local-lis/les=21/22 n=1067 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5206 lcod 36'5204 mlcod 36'5204 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.651 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.648+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5208 (0'0,36'5208] local-lis/les=21/22 n=1065 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5206 crt=36'5206 lcod 36'5204 mlcod 36'5204 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.652 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.650+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5067 (0'0,36'5067] local-lis/les=21/22 n=1004 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5067 lcod 36'5065 mlcod 36'5065 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.653 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.650+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5061 (0'0,36'5061] local-lis/les=21/22 n=1047 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5061 lcod 36'5059 mlcod 36'5059 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.656 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.654+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5069 (0'0,36'5069] local-lis/les=21/22 n=1002 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5067 crt=36'5067 lcod 36'5065 mlcod 36'5065 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.658 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.656+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5063 (0'0,36'5063] local-lis/les=21/22 n=1045 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5061 crt=36'5061 lcod 36'5059 mlcod 36'5059 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.660 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.657+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5346 (0'0,36'5346] local-lis/les=21/22 n=1121 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5346 lcod 36'5344 mlcod 36'5344 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.663 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.661+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5348 (0'0,36'5348] local-lis/les=21/22 n=1119 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5346 crt=36'5346 lcod 36'5344 mlcod 36'5344 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.667 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.663+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5230 (0'0,36'5230] local-lis/les=21/22 n=1133 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5230 lcod 36'5228 mlcod 36'5228 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.668 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.662+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5061 (0'0,36'5061] local-lis/les=21/22 n=1089 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5061 lcod 36'5059 mlcod 36'5059 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.669 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.663+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5210 (0'0,36'5210] local-lis/les=21/22 n=1063 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5210 lcod 36'5208 mlcod 36'5208 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.669 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.666+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5063 (0'0,36'5063] local-lis/les=21/22 n=1087 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5061 crt=36'5061 lcod 36'5059 mlcod 36'5059 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.670 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.667+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5232 (0'0,36'5232] local-lis/les=21/22 n=1131 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5230 crt=36'5230 lcod 36'5228 mlcod 36'5228 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.670 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.667+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5072 (0'0,36'5072] local-lis/les=21/22 n=999 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5071 crt=36'5069 lcod 36'5069 mlcod 36'5069 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.671 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.669+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5408 (0'0,36'5408] local-lis/les=21/22 n=1136 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5408 lcod 36'5407 mlcod 36'5407 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.673 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.670+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5074 (0'0,36'5074] local-lis/les=21/22 n=997 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5071 crt=36'5071 lcod 36'5069 mlcod 36'5069 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.675 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.673+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5410 (0'0,36'5410] local-lis/les=21/22 n=1134 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5408 crt=36'5408 lcod 36'5407 mlcod 36'5407 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.675 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.673+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5188 (0'0,36'5188] local-lis/les=21/22 n=1084 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5188 lcod 36'5186 mlcod 36'5186 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.679 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.677+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5065 (0'0,36'5065] local-lis/les=21/22 n=1043 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5065 lcod 36'5063 mlcod 36'5063 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.686 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.681+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5190 (0'0,36'5190] local-lis/les=21/22 n=1082 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5188 crt=36'5188 lcod 36'5186 mlcod 36'5186 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.686 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.682+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5067 (0'0,36'5067] local-lis/les=21/22 n=1041 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5065 crt=36'5065 lcod 36'5063 mlcod 36'5063 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.690 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.683+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5350 (0'0,36'5350] local-lis/les=21/22 n=1117 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5350 lcod 36'5348 mlcod 36'5348 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.690 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.687+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5352 (0'0,36'5352] local-lis/les=21/22 n=1115 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5350 crt=36'5350 lcod 36'5348 mlcod 36'5348 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.693 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.690+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5212 (0'0,36'5212] local-lis/les=21/22 n=1061 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5210 crt=36'5210 lcod 36'5208 mlcod 36'5208 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.694 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.691+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5066 (0'0,36'5066] local-lis/les=21/22 n=1084 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5065 crt=36'5061 lcod 36'5063 mlcod 36'5063 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.694 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.693+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5192 (0'0,36'5192] local-lis/les=21/22 n=1080 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5192 lcod 36'5190 mlcod 36'5190 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.696 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.689+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5235 (0'0,36'5235] local-lis/les=21/22 n=1128 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5234 crt=36'5230 lcod 36'5232 mlcod 36'5232 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.698 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.690+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5076 (0'0,36'5076] local-lis/les=21/22 n=995 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5076 lcod 36'5074 mlcod 36'5074 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.698 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.696+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5194 (0'0,36'5194] local-lis/les=21/22 n=1078 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5192 crt=36'5192 lcod 36'5190 mlcod 36'5190 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.699 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.696+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5412 (0'0,36'5412] local-lis/les=21/22 n=1132 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5412 lcod 36'5410 mlcod 36'5410 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.700 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.697+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5078 (0'0,36'5078] local-lis/les=21/22 n=993 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5076 crt=36'5076 lcod 36'5074 mlcod 36'5074 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.701 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.698+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5237 (0'0,36'5237] local-lis/les=21/22 n=1126 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5234 crt=36'5234 lcod 36'5232 mlcod 36'5232 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.705 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.699+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5414 (0'0,36'5414] local-lis/les=21/22 n=1130 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5412 crt=36'5412 lcod 36'5410 mlcod 36'5410 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.706 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.704+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5068 (0'0,36'5068] local-lis/les=21/22 n=1082 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5065 crt=36'5065 lcod 36'5063 mlcod 36'5063 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.710 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.706+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5069 (0'0,36'5069] local-lis/les=21/22 n=1039 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5069 lcod 36'5067 mlcod 36'5067 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.712 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.710+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5071 (0'0,36'5071] local-lis/les=21/22 n=1037 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5069 crt=36'5069 lcod 36'5067 mlcod 36'5067 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.712 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.710+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5214 (0'0,36'5214] local-lis/les=21/22 n=1059 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5214 lcod 36'5212 mlcod 36'5212 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.716 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.714+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5080 (0'0,36'5080] local-lis/les=21/22 n=991 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5080 lcod 36'5078 mlcod 36'5078 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.718 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.716+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5216 (0'0,36'5216] local-lis/les=21/22 n=1057 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5214 crt=36'5214 lcod 36'5212 mlcod 36'5212 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.724 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.719+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5354 (0'0,36'5354] local-lis/les=21/22 n=1113 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5354 lcod 36'5352 mlcod 36'5352 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.724 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.722+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5356 (0'0,36'5356] local-lis/les=21/22 n=1111 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5354 crt=36'5354 lcod 36'5352 mlcod 36'5352 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.728 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.718+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5082 (0'0,36'5082] local-lis/les=21/22 n=989 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5080 crt=36'5080 lcod 36'5078 mlcod 36'5078 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.729 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.720+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5416 (0'0,36'5416] local-lis/les=21/22 n=1128 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5416 lcod 36'5414 mlcod 36'5414 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.729 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.726+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5241 (0'0,36'5241] local-lis/les=21/22 n=1122 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5240 crt=36'5235 lcod 36'5239 mlcod 36'5239 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.730 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.728+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5196 (0'0,36'5196] local-lis/les=21/22 n=1076 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5196 lcod 36'5194 mlcod 36'5194 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.730 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.727+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5418 (0'0,36'5418] local-lis/les=21/22 n=1126 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5416 crt=36'5416 lcod 36'5414 mlcod 36'5414 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.733 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.728+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5070 (0'0,36'5070] local-lis/les=21/22 n=1080 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5070 lcod 36'5068 mlcod 36'5068 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.733 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.732+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5198 (0'0,36'5198] local-lis/les=21/22 n=1074 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5196 crt=36'5196 lcod 36'5194 mlcod 36'5194 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.734 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.731+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5072 (0'0,36'5072] local-lis/les=21/22 n=1078 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5070 crt=36'5070 lcod 36'5068 mlcod 36'5068 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.737 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.734+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5218 (0'0,36'5218] local-lis/les=21/22 n=1055 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5218 lcod 36'5216 mlcod 36'5216 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.738 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.734+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5243 (0'0,36'5243] local-lis/les=21/22 n=1120 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5240 crt=36'5240 lcod 36'5239 mlcod 36'5239 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.738 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.734+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5358 (0'0,36'5358] local-lis/les=21/22 n=1109 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5358 lcod 36'5356 mlcod 36'5356 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.740 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.737+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5220 (0'0,36'5220] local-lis/les=21/22 n=1053 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5218 crt=36'5218 lcod 36'5216 mlcod 36'5216 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.740 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.738+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5360 (0'0,36'5360] local-lis/les=21/22 n=1107 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5358 crt=36'5358 lcod 36'5356 mlcod 36'5356 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.742 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.735+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5084 (0'0,36'5084] local-lis/les=21/22 n=987 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5084 lcod 36'5082 mlcod 36'5082 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.742 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.738+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5073 (0'0,36'5073] local-lis/les=21/22 n=1035 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5073 lcod 36'5071 mlcod 36'5071 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.749 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.745+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5086 (0'0,36'5086] local-lis/les=21/22 n=985 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5084 crt=36'5084 lcod 36'5082 mlcod 36'5082 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.750 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.748+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5075 (0'0,36'5075] local-lis/les=21/22 n=1033 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5073 crt=36'5073 lcod 36'5071 mlcod 36'5071 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.755 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.752+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5245 (0'0,36'5245] local-lis/les=21/22 n=1118 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5245 lcod 36'5243 mlcod 36'5243 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.761 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.760+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5077 (0'0,36'5077] local-lis/les=21/22 n=1031 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5077 lcod 36'5075 mlcod 36'5075 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.764 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.758+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5222 (0'0,36'5222] local-lis/les=21/22 n=1051 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5222 lcod 36'5220 mlcod 36'5220 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.765 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.759+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5075 (0'0,36'5075] local-lis/les=21/22 n=1075 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5075 lcod 36'5074 mlcod 36'5074 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.765 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.762+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5224 (0'0,36'5224] local-lis/les=21/22 n=1049 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5222 crt=36'5222 lcod 36'5220 mlcod 36'5220 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.766 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.763+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5077 (0'0,36'5077] local-lis/les=21/22 n=1073 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5075 crt=36'5075 lcod 36'5074 mlcod 36'5074 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.766 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.758+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5421 (0'0,36'5421] local-lis/les=21/22 n=1123 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5421 lcod 36'5420 mlcod 36'5420 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.767 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.765+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5201 (0'0,36'5201] local-lis/les=21/22 n=1071 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5200 crt=36'5198 lcod 36'5198 mlcod 36'5198 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.769 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.761+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5423 (0'0,36'5423] local-lis/les=21/22 n=1121 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5421 crt=36'5421 lcod 36'5420 mlcod 36'5420 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.769 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.763+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5079 (0'0,36'5079] local-lis/les=21/22 n=1029 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5077 crt=36'5077 lcod 36'5075 mlcod 36'5075 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.771 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.768+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5247 (0'0,36'5247] local-lis/les=21/22 n=1116 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5245 crt=36'5245 lcod 36'5243 mlcod 36'5243 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.771 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.768+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5362 (0'0,36'5362] local-lis/les=21/22 n=1105 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5362 lcod 36'5360 mlcod 36'5360 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.771 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.769+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5203 (0'0,36'5203] local-lis/les=21/22 n=1069 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5200 crt=36'5200 lcod 36'5198 mlcod 36'5198 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.774 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.772+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5364 (0'0,36'5364] local-lis/les=21/22 n=1103 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5362 crt=36'5362 lcod 36'5360 mlcod 36'5360 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.776 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.773+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5088 (0'0,36'5088] local-lis/les=21/22 n=983 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5088 lcod 36'5086 mlcod 36'5086 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.779 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.776+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5090 (0'0,36'5090] local-lis/les=21/22 n=981 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5088 crt=36'5088 lcod 36'5086 mlcod 36'5086 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.782 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.779+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5226 (0'0,36'5226] local-lis/les=21/22 n=1047 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5226 lcod 36'5224 mlcod 36'5224 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.785 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.783+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5205 (0'0,36'5205] local-lis/les=21/22 n=1067 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5205 lcod 36'5203 mlcod 36'5203 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.786 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.780+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5081 (0'0,36'5081] local-lis/les=21/22 n=1027 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5081 lcod 36'5079 mlcod 36'5079 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.786 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.784+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5366 (0'0,36'5366] local-lis/les=21/22 n=1101 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5366 lcod 36'5364 mlcod 36'5364 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.787 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.785+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5083 (0'0,36'5083] local-lis/les=21/22 n=1025 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5081 crt=36'5081 lcod 36'5079 mlcod 36'5079 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.789 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.787+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5207 (0'0,36'5207] local-lis/les=21/22 n=1065 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5205 crt=36'5205 lcod 36'5203 mlcod 36'5203 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.791 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.783+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5425 (0'0,36'5425] local-lis/les=21/22 n=1119 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5425 lcod 36'5423 mlcod 36'5423 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.792 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.786+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5427 (0'0,36'5427] local-lis/les=21/22 n=1117 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5425 crt=36'5425 lcod 36'5423 mlcod 36'5423 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.792 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.786+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5228 (0'0,36'5228] local-lis/les=21/22 n=1045 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5226 crt=36'5226 lcod 36'5224 mlcod 36'5224 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.793 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.788+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5079 (0'0,36'5079] local-lis/les=21/22 n=1071 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5079 lcod 36'5077 mlcod 36'5077 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.794 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.791+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5081 (0'0,36'5081] local-lis/les=21/22 n=1069 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5079 crt=36'5079 lcod 36'5077 mlcod 36'5077 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.795 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.793+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5368 (0'0,36'5368] local-lis/les=21/22 n=1099 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5366 crt=36'5366 lcod 36'5364 mlcod 36'5364 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.799 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.795+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5251 (0'0,36'5251] local-lis/les=21/22 n=1112 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5249 crt=36'5245 lcod 36'5247 mlcod 36'5247 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.802 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.799+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5092 (0'0,36'5092] local-lis/les=21/22 n=979 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5092 lcod 36'5090 mlcod 36'5090 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.802 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.799+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5253 (0'0,36'5253] local-lis/les=21/22 n=1110 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5249 crt=36'5249 lcod 36'5247 mlcod 36'5247 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.803 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.800+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5085 (0'0,36'5085] local-lis/les=21/22 n=1023 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5085 lcod 36'5083 mlcod 36'5083 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.805 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.803+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5094 (0'0,36'5094] local-lis/les=21/22 n=977 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5092 crt=36'5092 lcod 36'5090 mlcod 36'5090 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.809 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.808+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5209 (0'0,36'5209] local-lis/les=21/22 n=1063 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5209 lcod 36'5207 mlcod 36'5207 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.810 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.806+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5230 (0'0,36'5230] local-lis/les=21/22 n=1043 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5230 lcod 36'5228 mlcod 36'5228 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.813 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.810+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5232 (0'0,36'5232] local-lis/les=21/22 n=1041 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5230 crt=36'5230 lcod 36'5228 mlcod 36'5228 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.813 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.811+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5429 (0'0,36'5429] local-lis/les=21/22 n=1115 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5429 lcod 36'5427 mlcod 36'5427 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.813 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.812+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5211 (0'0,36'5211] local-lis/les=21/22 n=1061 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5209 crt=36'5209 lcod 36'5207 mlcod 36'5207 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.817 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.814+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5431 (0'0,36'5431] local-lis/les=21/22 n=1113 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5429 crt=36'5429 lcod 36'5427 mlcod 36'5427 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.818 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.808+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5087 (0'0,36'5087] local-lis/les=21/22 n=1021 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5085 crt=36'5085 lcod 36'5083 mlcod 36'5083 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.820 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.817+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5083 (0'0,36'5083] local-lis/les=21/22 n=1067 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5083 lcod 36'5081 mlcod 36'5081 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.822 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.820+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5089 (0'0,36'5089] local-lis/les=21/22 n=1019 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5089 lcod 36'5087 mlcod 36'5087 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.828 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.820+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5085 (0'0,36'5085] local-lis/les=21/22 n=1065 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5083 crt=36'5083 lcod 36'5081 mlcod 36'5081 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.830 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.823+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5091 (0'0,36'5091] local-lis/les=21/22 n=1017 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5089 crt=36'5089 lcod 36'5087 mlcod 36'5087 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.832 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.828+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5434 (0'0,36'5434] local-lis/les=21/22 n=1110 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5433 crt=36'5429 lcod 36'5431 mlcod 36'5431 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.832 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.829+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5096 (0'0,36'5096] local-lis/les=21/22 n=975 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5096 lcod 36'5094 mlcod 36'5094 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.837 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.827+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5255 (0'0,36'5255] local-lis/les=21/22 n=1108 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5255 lcod 36'5253 mlcod 36'5253 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.838 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.830+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5257 (0'0,36'5257] local-lis/les=21/22 n=1106 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5255 crt=36'5255 lcod 36'5253 mlcod 36'5253 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.838 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.833+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5234 (0'0,36'5234] local-lis/les=21/22 n=1039 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5234 lcod 36'5232 mlcod 36'5232 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.839 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.832+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5370 (0'0,36'5370] local-lis/les=21/22 n=1097 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5370 lcod 36'5368 mlcod 36'5368 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.842 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.837+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5236 (0'0,36'5236] local-lis/les=21/22 n=1037 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5234 crt=36'5234 lcod 36'5232 mlcod 36'5232 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.842 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.839+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5087 (0'0,36'5087] local-lis/les=21/22 n=1063 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5087 lcod 36'5085 mlcod 36'5085 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.843 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.838+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5372 (0'0,36'5372] local-lis/les=21/22 n=1095 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5370 crt=36'5370 lcod 36'5368 mlcod 36'5368 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.845 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.842+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5089 (0'0,36'5089] local-lis/les=21/22 n=1061 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5087 crt=36'5087 lcod 36'5085 mlcod 36'5085 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.845 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.844+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5214 (0'0,36'5214] local-lis/les=21/22 n=1058 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5213 crt=36'5209 lcod 36'5211 mlcod 36'5211 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.846 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.832+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5098 (0'0,36'5098] local-lis/les=21/22 n=973 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5096 crt=36'5096 lcod 36'5094 mlcod 36'5094 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.846 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.832+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5436 (0'0,36'5436] local-lis/les=21/22 n=1108 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5433 crt=36'5433 lcod 36'5431 mlcod 36'5431 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.850 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.846+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5093 (0'0,36'5093] local-lis/les=21/22 n=1015 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5093 lcod 36'5091 mlcod 36'5091 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.853 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.848+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5216 (0'0,36'5216] local-lis/les=21/22 n=1056 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5213 crt=36'5213 lcod 36'5211 mlcod 36'5211 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.853 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.851+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5374 (0'0,36'5374] local-lis/les=21/22 n=1093 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5374 lcod 36'5372 mlcod 36'5372 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.855 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.853+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5259 (0'0,36'5259] local-lis/les=21/22 n=1104 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5259 lcod 36'5257 mlcod 36'5257 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.857 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.854+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5376 (0'0,36'5376] local-lis/les=21/22 n=1091 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5374 crt=36'5374 lcod 36'5372 mlcod 36'5372 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.859 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.856+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5095 (0'0,36'5095] local-lis/les=21/22 n=1013 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5093 crt=36'5093 lcod 36'5091 mlcod 36'5091 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.863 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.860+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5261 (0'0,36'5261] local-lis/les=21/22 n=1102 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5259 crt=36'5259 lcod 36'5257 mlcod 36'5257 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.865 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.863+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5438 (0'0,36'5438] local-lis/les=21/22 n=1106 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5438 lcod 36'5436 mlcod 36'5436 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.870 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.865+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5218 (0'0,36'5218] local-lis/les=21/22 n=1054 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5218 lcod 36'5216 mlcod 36'5216 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.873 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.863+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5100 (0'0,36'5100] local-lis/les=21/22 n=971 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5100 lcod 36'5098 mlcod 36'5098 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.874 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.867+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5440 (0'0,36'5440] local-lis/les=21/22 n=1104 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5438 crt=36'5438 lcod 36'5436 mlcod 36'5436 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.875 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.864+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5092 (0'0,36'5092] local-lis/les=21/22 n=1058 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5091 crt=36'5087 lcod 36'5089 mlcod 36'5089 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.875 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.864+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5238 (0'0,36'5238] local-lis/les=21/22 n=1035 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5238 lcod 36'5236 mlcod 36'5236 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.876 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.873+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5097 (0'0,36'5097] local-lis/les=21/22 n=1011 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5097 lcod 36'5095 mlcod 36'5095 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.876 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.868+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5094 (0'0,36'5094] local-lis/les=21/22 n=1056 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5091 crt=36'5091 lcod 36'5089 mlcod 36'5089 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.877 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.868+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5240 (0'0,36'5240] local-lis/les=21/22 n=1033 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5238 crt=36'5238 lcod 36'5236 mlcod 36'5236 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.877 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.874+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5102 (0'0,36'5102] local-lis/les=21/22 n=969 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5100 crt=36'5100 lcod 36'5098 mlcod 36'5098 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.877 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.875+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5220 (0'0,36'5220] local-lis/les=21/22 n=1052 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5218 crt=36'5218 lcod 36'5216 mlcod 36'5216 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.879 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.877+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5264 (0'0,36'5264] local-lis/les=21/22 n=1099 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5263 crt=36'5259 lcod 36'5261 mlcod 36'5261 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.881 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.878+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5378 (0'0,36'5378] local-lis/les=21/22 n=1089 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5378 lcod 36'5376 mlcod 36'5376 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.883 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.880+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5099 (0'0,36'5099] local-lis/les=21/22 n=1009 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5097 crt=36'5097 lcod 36'5095 mlcod 36'5095 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.885 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.882+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5096 (0'0,36'5096] local-lis/les=21/22 n=1054 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5096 lcod 36'5094 mlcod 36'5094 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.886 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.884+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5380 (0'0,36'5380] local-lis/les=21/22 n=1087 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5378 crt=36'5378 lcod 36'5376 mlcod 36'5376 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.887 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.885+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5104 (0'0,36'5104] local-lis/les=21/22 n=967 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5104 lcod 36'5102 mlcod 36'5102 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.891 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.888+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5098 (0'0,36'5098] local-lis/les=21/22 n=1052 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5096 crt=36'5096 lcod 36'5094 mlcod 36'5094 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.891 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.888+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5106 (0'0,36'5106] local-lis/les=21/22 n=965 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5104 crt=36'5104 lcod 36'5102 mlcod 36'5102 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.891 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.889+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5242 (0'0,36'5242] local-lis/les=21/22 n=1031 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5242 lcod 36'5240 mlcod 36'5240 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.896 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.890+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5266 (0'0,36'5266] local-lis/les=21/22 n=1097 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5263 crt=36'5263 lcod 36'5261 mlcod 36'5261 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.899 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.896+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5222 (0'0,36'5222] local-lis/les=21/22 n=1050 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5222 lcod 36'5220 mlcod 36'5220 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.899 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.893+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5244 (0'0,36'5244] local-lis/les=21/22 n=1029 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5242 crt=36'5242 lcod 36'5240 mlcod 36'5240 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.903 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.900+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5102 (0'0,36'5102] local-lis/les=21/22 n=1006 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5101 crt=36'5101 lcod 36'5099 mlcod 36'5099 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.905 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.899+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5442 (0'0,36'5442] local-lis/les=21/22 n=1102 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5442 lcod 36'5440 mlcod 36'5440 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.905 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.901+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5382 (0'0,36'5382] local-lis/les=21/22 n=1085 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5382 lcod 36'5380 mlcod 36'5380 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.905 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.901+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5268 (0'0,36'5268] local-lis/les=21/22 n=1095 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5268 lcod 36'5266 mlcod 36'5266 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.909 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.906+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5108 (0'0,36'5108] local-lis/les=21/22 n=963 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5108 lcod 36'5106 mlcod 36'5106 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.910 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.907+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5444 (0'0,36'5444] local-lis/les=21/22 n=1100 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5442 crt=36'5442 lcod 36'5440 mlcod 36'5440 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.910 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.903+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5224 (0'0,36'5224] local-lis/les=21/22 n=1048 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5222 crt=36'5222 lcod 36'5220 mlcod 36'5220 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.910 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.903+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5104 (0'0,36'5104] local-lis/les=21/22 n=1004 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5101 crt=36'5101 lcod 36'5099 mlcod 36'5099 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.912 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.908+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5384 (0'0,36'5384] local-lis/les=21/22 n=1083 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5382 crt=36'5382 lcod 36'5380 mlcod 36'5380 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.912 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.909+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5270 (0'0,36'5270] local-lis/les=21/22 n=1093 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5268 crt=36'5268 lcod 36'5266 mlcod 36'5266 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.919 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.915+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5100 (0'0,36'5100] local-lis/les=21/22 n=1050 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5100 lcod 36'5098 mlcod 36'5098 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.919 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.915+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5246 (0'0,36'5246] local-lis/les=21/22 n=1027 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5246 lcod 36'5244 mlcod 36'5244 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.921 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.917+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5226 (0'0,36'5226] local-lis/les=21/22 n=1046 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5226 lcod 36'5224 mlcod 36'5224 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.923 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.919+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5248 (0'0,36'5248] local-lis/les=21/22 n=1025 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5246 crt=36'5246 lcod 36'5244 mlcod 36'5244 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.925 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.922+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5110 (0'0,36'5110] local-lis/les=21/22 n=961 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5108 crt=36'5108 lcod 36'5106 mlcod 36'5106 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.925 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.923+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5446 (0'0,36'5446] local-lis/les=21/22 n=1098 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5446 lcod 36'5444 mlcod 36'5444 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.926 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.923+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5102 (0'0,36'5102] local-lis/les=21/22 n=1048 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5100 crt=36'5100 lcod 36'5098 mlcod 36'5098 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.930 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.926+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5448 (0'0,36'5448] local-lis/les=21/22 n=1096 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5446 crt=36'5446 lcod 36'5444 mlcod 36'5444 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.930 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.929+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5106 (0'0,36'5106] local-lis/les=21/22 n=1002 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5106 lcod 36'5104 mlcod 36'5104 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.931 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.924+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5228 (0'0,36'5228] local-lis/les=21/22 n=1044 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5226 crt=36'5226 lcod 36'5224 mlcod 36'5224 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.937 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.936+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5108 (0'0,36'5108] local-lis/les=21/22 n=1000 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5106 crt=36'5106 lcod 36'5104 mlcod 36'5104 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.938 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.936+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5387 (0'0,36'5387] local-lis/les=21/22 n=1080 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5386 crt=36'5382 lcod 36'5384 mlcod 36'5384 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.943 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.940+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5112 (0'0,36'5112] local-lis/les=21/22 n=959 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5112 lcod 36'5110 mlcod 36'5110 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.944 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.941+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5450 (0'0,36'5450] local-lis/les=21/22 n=1094 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5450 lcod 36'5448 mlcod 36'5448 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.944 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.941+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5389 (0'0,36'5389] local-lis/les=21/22 n=1078 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5386 crt=36'5386 lcod 36'5384 mlcod 36'5384 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.944 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.942+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5250 (0'0,36'5250] local-lis/les=21/22 n=1023 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5250 lcod 36'5248 mlcod 36'5248 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.948 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.945+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5252 (0'0,36'5252] local-lis/les=21/22 n=1021 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5250 crt=36'5250 lcod 36'5248 mlcod 36'5248 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.948 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.945+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5452 (0'0,36'5452] local-lis/les=21/22 n=1092 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5450 crt=36'5450 lcod 36'5448 mlcod 36'5448 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.949 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.947+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5104 (0'0,36'5104] local-lis/les=21/22 n=1046 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5104 lcod 36'5102 mlcod 36'5102 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.950 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.947+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5114 (0'0,36'5114] local-lis/les=21/22 n=957 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5112 crt=36'5112 lcod 36'5110 mlcod 36'5110 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.952 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.950+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5106 (0'0,36'5106] local-lis/les=21/22 n=1044 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5104 crt=36'5104 lcod 36'5102 mlcod 36'5102 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.954 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.949+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5230 (0'0,36'5230] local-lis/les=21/22 n=1042 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5230 lcod 36'5228 mlcod 36'5228 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.954 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.950+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5110 (0'0,36'5110] local-lis/les=21/22 n=998 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5110 lcod 36'5108 mlcod 36'5108 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.956 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.951+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5274 (0'0,36'5274] local-lis/les=21/22 n=1089 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5273 crt=36'5273 lcod 36'5272 mlcod 36'5272 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.960 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.956+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5232 (0'0,36'5232] local-lis/les=21/22 n=1040 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5230 crt=36'5230 lcod 36'5228 mlcod 36'5228 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.960 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.955+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5276 (0'0,36'5276] local-lis/les=21/22 n=1087 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5273 crt=36'5273 lcod 36'5272 mlcod 36'5272 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.961 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.957+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5112 (0'0,36'5112] local-lis/les=21/22 n=996 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5110 crt=36'5110 lcod 36'5108 mlcod 36'5108 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.966 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.963+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5391 (0'0,36'5391] local-lis/les=21/22 n=1076 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5391 lcod 36'5389 mlcod 36'5389 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.967 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.965+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5254 (0'0,36'5254] local-lis/les=21/22 n=1019 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5254 lcod 36'5252 mlcod 36'5252 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.968 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.965+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5454 (0'0,36'5454] local-lis/les=21/22 n=1090 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5454 lcod 36'5452 mlcod 36'5452 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.969 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.967+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5393 (0'0,36'5393] local-lis/les=21/22 n=1074 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5391 crt=36'5391 lcod 36'5389 mlcod 36'5389 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.972 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.970+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5456 (0'0,36'5456] local-lis/les=21/22 n=1088 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5454 crt=36'5454 lcod 36'5452 mlcod 36'5452 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.974 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.972+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5117 (0'0,36'5117] local-lis/les=21/22 n=954 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5117 lcod 36'5116 mlcod 36'5116 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.977 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.972+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5256 (0'0,36'5256] local-lis/les=21/22 n=1017 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5254 crt=36'5254 lcod 36'5252 mlcod 36'5252 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.982 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.980+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5115 (0'0,36'5115] local-lis/les=21/22 n=993 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5115 lcod 36'5114 mlcod 36'5114 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.983 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.978+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5119 (0'0,36'5119] local-lis/les=21/22 n=952 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5117 crt=36'5117 lcod 36'5116 mlcod 36'5116 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.983 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.978+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5108 (0'0,36'5108] local-lis/les=21/22 n=1042 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5108 lcod 36'5106 mlcod 36'5106 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.984 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.981+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5110 (0'0,36'5110] local-lis/les=21/22 n=1040 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5108 crt=36'5108 lcod 36'5106 mlcod 36'5106 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.984 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.983+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5234 (0'0,36'5234] local-lis/les=21/22 n=1038 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5234 lcod 36'5232 mlcod 36'5232 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.984+0000 7f457b8f1700 1 -- 172.21.15.88:0/1767375525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4574136d50 con 0x7f45740a6280 2020-02-11T16:31:27.987 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.982+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5278 (0'0,36'5278] local-lis/les=21/22 n=1085 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5278 lcod 36'5276 mlcod 36'5276 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.986+0000 7f457968d700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:27.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.986+0000 7f456a7fc700 1 -- 172.21.15.88:0/1767375525 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7f45700330c0 con 0x7f45740a6280 2020-02-11T16:31:27.989 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":216,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:27.989 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:27.986+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5280 (0'0,36'5280] local-lis/les=21/22 n=1083 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5278 crt=36'5278 lcod 36'5276 mlcod 36'5276 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.992 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.986+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5117 (0'0,36'5117] local-lis/les=21/22 n=991 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5115 crt=36'5115 lcod 36'5114 mlcod 36'5114 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.991+0000 7f457b8f1700 1 -- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f455c039c80 msgr2=0x7f455c03c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:27.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.991+0000 7f457b8f1700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f455c039c80 0x7f455c03c140 crc :-1 s=READY pgs=562 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:27.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.991+0000 7f457b8f1700 1 -- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 msgr2=0x7f4574139750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:27.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.991+0000 7f457b8f1700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f4574135700 tx=0x7f4570010a10).stop 2020-02-11T16:31:27.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.991+0000 7f457b8f1700 1 -- 172.21.15.88:0/1767375525 shutdown_connections 2020-02-11T16:31:27.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.991+0000 7f457b8f1700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f45740a6280 0x7f4574139750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.991+0000 7f457b8f1700 1 --2- 172.21.15.88:0/1767375525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f455c039c80 0x7f455c03c140 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.991+0000 7f457b8f1700 1 --2- 172.21.15.88:0/1767375525 >> v2:172.21.15.52:3300/0 conn(0x7f45740a6fe0 0x7f4574138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.991+0000 7f457b8f1700 1 -- 172.21.15.88:0/1767375525 >> 172.21.15.88:0/1767375525 conn(0x7f457409d110 msgr2=0x7f457413ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:27.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.992+0000 7f457b8f1700 1 -- 172.21.15.88:0/1767375525 shutdown_connections 2020-02-11T16:31:27.996 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:27.993+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5236 (0'0,36'5236] local-lis/les=21/22 n=1036 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5234 crt=36'5234 lcod 36'5232 mlcod 36'5232 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:27.992+0000 7f457b8f1700 1 -- 172.21.15.88:0/1767375525 wait complete. 2020-02-11T16:31:27.998 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:27.996+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5459 (0'0,36'5459] local-lis/les=21/22 n=1085 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5459 lcod 36'5458 mlcod 36'5458 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:27.999 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:27.996+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5119 (0'0,36'5119] local-lis/les=21/22 n=989 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5119 lcod 36'5117 mlcod 36'5117 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.004 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.002+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5121 (0'0,36'5121] local-lis/les=21/22 n=950 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5121 lcod 36'5119 mlcod 36'5119 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.006 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.004+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5238 (0'0,36'5238] local-lis/les=21/22 n=1034 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5238 lcod 36'5236 mlcod 36'5236 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.008 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.003+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5461 (0'0,36'5461] local-lis/les=21/22 n=1083 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5459 crt=36'5459 lcod 36'5458 mlcod 36'5458 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.008 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.001+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5396 (0'0,36'5396] local-lis/les=21/22 n=1071 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5396 lcod 36'5395 mlcod 36'5395 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.009 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.993+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5258 (0'0,36'5258] local-lis/les=21/22 n=1015 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5258 lcod 36'5256 mlcod 36'5256 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.009 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.002+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5282 (0'0,36'5282] local-lis/les=21/22 n=1081 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5282 lcod 36'5280 mlcod 36'5280 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.010 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.996+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5112 (0'0,36'5112] local-lis/les=21/22 n=1038 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5112 lcod 36'5110 mlcod 36'5110 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.010 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:27.999+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5260 (0'0,36'5260] local-lis/les=21/22 n=1013 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5258 crt=36'5258 lcod 36'5256 mlcod 36'5256 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.010 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.005+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5398 (0'0,36'5398] local-lis/les=21/22 n=1069 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5396 crt=36'5396 lcod 36'5395 mlcod 36'5395 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.012 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.010+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5121 (0'0,36'5121] local-lis/les=21/22 n=987 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5119 crt=36'5119 lcod 36'5117 mlcod 36'5117 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.013 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.008+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5123 (0'0,36'5123] local-lis/les=21/22 n=948 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5121 crt=36'5121 lcod 36'5119 mlcod 36'5119 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.014 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.009+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5284 (0'0,36'5284] local-lis/les=21/22 n=1079 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5282 crt=36'5282 lcod 36'5280 mlcod 36'5280 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.014 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.008+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5114 (0'0,36'5114] local-lis/les=21/22 n=1036 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5112 crt=36'5112 lcod 36'5110 mlcod 36'5110 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.015 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.011+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5240 (0'0,36'5240] local-lis/les=21/22 n=1032 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5238 crt=36'5238 lcod 36'5236 mlcod 36'5236 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.020 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":216,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:28.020 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:31:28.020 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:31:28.020 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:31:28.024 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.022+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5286 (0'0,36'5286] local-lis/les=21/22 n=1077 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5286 lcod 36'5284 mlcod 36'5284 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.025 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.020+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5117 (0'0,36'5117] local-lis/les=21/22 n=1033 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5116 crt=36'5114 lcod 36'5114 mlcod 36'5114 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.027 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.024+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5263 (0'0,36'5263] local-lis/les=21/22 n=1010 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5262 crt=36'5260 lcod 36'5260 mlcod 36'5260 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.027 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.025+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5242 (0'0,36'5242] local-lis/les=21/22 n=1030 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5242 lcod 36'5240 mlcod 36'5240 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.032 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.026+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5400 (0'0,36'5400] local-lis/les=21/22 n=1067 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5400 lcod 36'5398 mlcod 36'5398 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.032 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.029+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5288 (0'0,36'5288] local-lis/les=21/22 n=1075 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5286 crt=36'5286 lcod 36'5284 mlcod 36'5284 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.034 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.026+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5463 (0'0,36'5463] local-lis/les=21/22 n=1081 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5463 lcod 36'5461 mlcod 36'5461 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.034 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.032+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5123 (0'0,36'5123] local-lis/les=21/22 n=985 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5123 lcod 36'5121 mlcod 36'5121 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.037 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.028+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5125 (0'0,36'5125] local-lis/les=21/22 n=946 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5125 lcod 36'5123 mlcod 36'5123 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.037 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.029+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5465 (0'0,36'5465] local-lis/les=21/22 n=1079 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5463 crt=36'5463 lcod 36'5461 mlcod 36'5461 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.038 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.032+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5402 (0'0,36'5402] local-lis/les=21/22 n=1065 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5400 crt=36'5400 lcod 36'5398 mlcod 36'5398 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.038 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.027+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5265 (0'0,36'5265] local-lis/les=21/22 n=1008 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5262 crt=36'5262 lcod 36'5260 mlcod 36'5260 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.038 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.034+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5119 (0'0,36'5119] local-lis/les=21/22 n=1031 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5116 crt=36'5116 lcod 36'5114 mlcod 36'5114 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.039 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.036+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5125 (0'0,36'5125] local-lis/les=21/22 n=983 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5123 crt=36'5123 lcod 36'5121 mlcod 36'5121 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.039 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.037+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5244 (0'0,36'5244] local-lis/les=21/22 n=1028 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5242 crt=36'5242 lcod 36'5240 mlcod 36'5240 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.041 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.039+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5127 (0'0,36'5127] local-lis/les=21/22 n=944 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5125 crt=36'5125 lcod 36'5123 mlcod 36'5123 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.049 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.046+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5290 (0'0,36'5290] local-lis/les=21/22 n=1073 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5290 lcod 36'5288 mlcod 36'5288 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.050 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.047+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5404 (0'0,36'5404] local-lis/les=21/22 n=1063 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5404 lcod 36'5402 mlcod 36'5402 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.053 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.051+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5246 (0'0,36'5246] local-lis/les=21/22 n=1026 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5246 lcod 36'5244 mlcod 36'5244 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.056 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.048+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5467 (0'0,36'5467] local-lis/les=21/22 n=1077 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5467 lcod 36'5465 mlcod 36'5465 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.056 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.051+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5469 (0'0,36'5469] local-lis/les=21/22 n=1075 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5467 crt=36'5467 lcod 36'5465 mlcod 36'5465 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.056 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.050+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5292 (0'0,36'5292] local-lis/les=21/22 n=1071 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5290 crt=36'5290 lcod 36'5288 mlcod 36'5288 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.056 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.050+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5406 (0'0,36'5406] local-lis/les=21/22 n=1061 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5404 crt=36'5404 lcod 36'5402 mlcod 36'5402 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.056 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.049+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5121 (0'0,36'5121] local-lis/les=21/22 n=1029 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5121 lcod 36'5119 mlcod 36'5119 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.057 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.053+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5123 (0'0,36'5123] local-lis/les=21/22 n=1027 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5121 crt=36'5121 lcod 36'5119 mlcod 36'5119 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.062 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.057+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5127 (0'0,36'5127] local-lis/les=21/22 n=981 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5127 lcod 36'5125 mlcod 36'5125 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.062 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.057+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5268 (0'0,36'5268] local-lis/les=21/22 n=1005 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5267 crt=36'5262 lcod 36'5265 mlcod 36'5265 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.065 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.055+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5129 (0'0,36'5129] local-lis/les=21/22 n=942 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5129 lcod 36'5127 mlcod 36'5127 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.066 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.059+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5131 (0'0,36'5131] local-lis/les=21/22 n=940 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5129 crt=36'5129 lcod 36'5127 mlcod 36'5127 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.067 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.063+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5248 (0'0,36'5248] local-lis/les=21/22 n=1024 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5246 crt=36'5246 lcod 36'5244 mlcod 36'5244 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.070 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.064+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5270 (0'0,36'5270] local-lis/les=21/22 n=1003 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5267 crt=36'5267 lcod 36'5265 mlcod 36'5265 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.070 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.067+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5129 (0'0,36'5129] local-lis/les=21/22 n=979 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5127 crt=36'5127 lcod 36'5125 mlcod 36'5125 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.073 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.069+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5133 (0'0,36'5133] local-lis/les=21/22 n=938 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5133 lcod 36'5131 mlcod 36'5131 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.076 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.072+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5471 (0'0,36'5471] local-lis/les=21/22 n=1073 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5471 lcod 36'5469 mlcod 36'5469 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.077 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.074+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5408 (0'0,36'5408] local-lis/les=21/22 n=1059 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5408 lcod 36'5406 mlcod 36'5406 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.078 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.075+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5473 (0'0,36'5473] local-lis/les=21/22 n=1071 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5471 crt=36'5471 lcod 36'5469 mlcod 36'5469 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.078 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.076+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5126 (0'0,36'5126] local-lis/les=21/22 n=1024 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5125 crt=36'5121 lcod 36'5123 mlcod 36'5123 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.079 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.077+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5135 (0'0,36'5135] local-lis/les=21/22 n=936 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5133 crt=36'5133 lcod 36'5131 mlcod 36'5131 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.080 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.077+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5410 (0'0,36'5410] local-lis/les=21/22 n=1057 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5408 crt=36'5408 lcod 36'5406 mlcod 36'5406 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.084 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.081+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5294 (0'0,36'5294] local-lis/les=21/22 n=1069 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5294 lcod 36'5292 mlcod 36'5292 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.086 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.084+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5131 (0'0,36'5131] local-lis/les=21/22 n=977 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5131 lcod 36'5129 mlcod 36'5129 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.087 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.084+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5296 (0'0,36'5296] local-lis/les=21/22 n=1067 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5294 crt=36'5294 lcod 36'5292 mlcod 36'5292 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.088 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.087+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5250 (0'0,36'5250] local-lis/les=21/22 n=1022 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5250 lcod 36'5248 mlcod 36'5248 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.090 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.088+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5133 (0'0,36'5133] local-lis/les=21/22 n=975 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5131 crt=36'5131 lcod 36'5129 mlcod 36'5129 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.093 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.088+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5128 (0'0,36'5128] local-lis/les=21/22 n=1022 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5125 crt=36'5125 lcod 36'5123 mlcod 36'5123 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.094 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.090+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5252 (0'0,36'5252] local-lis/les=21/22 n=1020 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5250 crt=36'5250 lcod 36'5248 mlcod 36'5248 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.097 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.094+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5273 (0'0,36'5273] local-lis/les=21/22 n=1000 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5273 lcod 36'5272 mlcod 36'5272 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.098 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.092+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5137 (0'0,36'5137] local-lis/les=21/22 n=934 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5137 lcod 36'5135 mlcod 36'5135 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.099 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.095+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5475 (0'0,36'5475] local-lis/les=21/22 n=1069 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5475 lcod 36'5473 mlcod 36'5473 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.100 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.098+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5139 (0'0,36'5139] local-lis/les=21/22 n=932 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5137 crt=36'5137 lcod 36'5135 mlcod 36'5135 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.101 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.098+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5477 (0'0,36'5477] local-lis/les=21/22 n=1067 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5475 crt=36'5475 lcod 36'5473 mlcod 36'5473 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.102 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.099+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5298 (0'0,36'5298] local-lis/les=21/22 n=1065 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5298 lcod 36'5296 mlcod 36'5296 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.105 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.103+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5130 (0'0,36'5130] local-lis/les=21/22 n=1020 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5130 lcod 36'5128 mlcod 36'5128 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.105 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.103+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5275 (0'0,36'5275] local-lis/les=21/22 n=998 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5273 crt=36'5273 lcod 36'5272 mlcod 36'5272 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.107 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.105+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5413 (0'0,36'5413] local-lis/les=21/22 n=1054 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5412 crt=36'5410 lcod 36'5410 mlcod 36'5410 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.108 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.106+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5300 (0'0,36'5300] local-lis/les=21/22 n=1063 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5298 crt=36'5298 lcod 36'5296 mlcod 36'5296 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.110 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.108+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5415 (0'0,36'5415] local-lis/les=21/22 n=1052 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5412 crt=36'5412 lcod 36'5410 mlcod 36'5410 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.111 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.107+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5132 (0'0,36'5132] local-lis/les=21/22 n=1018 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5130 crt=36'5130 lcod 36'5128 mlcod 36'5128 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.114 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.112+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5135 (0'0,36'5135] local-lis/les=21/22 n=973 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5135 lcod 36'5133 mlcod 36'5133 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.118 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.116+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5254 (0'0,36'5254] local-lis/les=21/22 n=1018 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5254 lcod 36'5252 mlcod 36'5252 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.120 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.116+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5137 (0'0,36'5137] local-lis/les=21/22 n=971 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5135 crt=36'5135 lcod 36'5133 mlcod 36'5133 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.125 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.123+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5256 (0'0,36'5256] local-lis/les=21/22 n=1016 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5254 crt=36'5254 lcod 36'5252 mlcod 36'5252 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.127 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.118+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5141 (0'0,36'5141] local-lis/les=21/22 n=930 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5141 lcod 36'5139 mlcod 36'5139 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.127 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.121+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5143 (0'0,36'5143] local-lis/les=21/22 n=928 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5141 crt=36'5141 lcod 36'5139 mlcod 36'5139 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.127 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.121+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5479 (0'0,36'5479] local-lis/les=21/22 n=1065 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5479 lcod 36'5477 mlcod 36'5477 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.127 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.125+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5481 (0'0,36'5481] local-lis/les=21/22 n=1063 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5479 crt=36'5479 lcod 36'5477 mlcod 36'5477 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.128 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.121+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5278 (0'0,36'5278] local-lis/les=21/22 n=995 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5277 crt=36'5273 lcod 36'5275 mlcod 36'5275 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.128 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.125+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5280 (0'0,36'5280] local-lis/les=21/22 n=993 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5277 crt=36'5277 lcod 36'5275 mlcod 36'5275 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.133 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.130+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5302 (0'0,36'5302] local-lis/les=21/22 n=1061 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5302 lcod 36'5300 mlcod 36'5300 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.135 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.133+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5139 (0'0,36'5139] local-lis/les=21/22 n=969 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5139 lcod 36'5137 mlcod 36'5137 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.138 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.133+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5304 (0'0,36'5304] local-lis/les=21/22 n=1059 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5302 crt=36'5302 lcod 36'5300 mlcod 36'5300 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.142 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.137+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5417 (0'0,36'5417] local-lis/les=21/22 n=1050 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5417 lcod 36'5415 mlcod 36'5415 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.142 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.136+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5141 (0'0,36'5141] local-lis/les=21/22 n=967 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5139 crt=36'5139 lcod 36'5137 mlcod 36'5137 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.143 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.139+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5134 (0'0,36'5134] local-lis/les=21/22 n=1016 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5134 lcod 36'5132 mlcod 36'5132 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.144 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.141+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5419 (0'0,36'5419] local-lis/les=21/22 n=1048 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5417 crt=36'5417 lcod 36'5415 mlcod 36'5415 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.144 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.140+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5145 (0'0,36'5145] local-lis/les=21/22 n=926 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5145 lcod 36'5143 mlcod 36'5143 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.145 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.142+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5136 (0'0,36'5136] local-lis/les=21/22 n=1014 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5134 crt=36'5134 lcod 36'5132 mlcod 36'5132 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.146 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.144+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5147 (0'0,36'5147] local-lis/les=21/22 n=924 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5145 crt=36'5145 lcod 36'5143 mlcod 36'5143 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.149 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.146+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5483 (0'0,36'5483] local-lis/les=21/22 n=1061 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5483 lcod 36'5481 mlcod 36'5481 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.149 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.147+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5260 (0'0,36'5260] local-lis/les=21/22 n=1012 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5258 crt=36'5254 lcod 36'5256 mlcod 36'5256 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.152 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.148+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5282 (0'0,36'5282] local-lis/les=21/22 n=991 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5282 lcod 36'5280 mlcod 36'5280 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.155 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.152+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5284 (0'0,36'5284] local-lis/les=21/22 n=989 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5282 crt=36'5282 lcod 36'5280 mlcod 36'5280 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.155 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.151+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5262 (0'0,36'5262] local-lis/les=21/22 n=1010 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5258 crt=36'5258 lcod 36'5256 mlcod 36'5256 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.159 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.157+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5306 (0'0,36'5306] local-lis/les=21/22 n=1057 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5306 lcod 36'5304 mlcod 36'5304 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.160 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.157+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5143 (0'0,36'5143] local-lis/les=21/22 n=965 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5143 lcod 36'5141 mlcod 36'5141 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.161 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.157+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5485 (0'0,36'5485] local-lis/les=21/22 n=1059 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5483 crt=36'5483 lcod 36'5481 mlcod 36'5481 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.162 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.160+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5145 (0'0,36'5145] local-lis/les=21/22 n=963 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5143 crt=36'5143 lcod 36'5141 mlcod 36'5141 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.162 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.160+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5421 (0'0,36'5421] local-lis/les=21/22 n=1046 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5421 lcod 36'5419 mlcod 36'5419 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.166 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.163+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5423 (0'0,36'5423] local-lis/les=21/22 n=1044 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5421 crt=36'5421 lcod 36'5419 mlcod 36'5419 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.167 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.164+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5308 (0'0,36'5308] local-lis/les=21/22 n=1055 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5306 crt=36'5306 lcod 36'5304 mlcod 36'5304 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.172 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.170+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5286 (0'0,36'5286] local-lis/les=21/22 n=987 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5286 lcod 36'5284 mlcod 36'5284 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.175 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.173+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5149 (0'0,36'5149] local-lis/les=21/22 n=922 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5149 lcod 36'5147 mlcod 36'5147 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.176 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.174+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5138 (0'0,36'5138] local-lis/les=21/22 n=1012 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5138 lcod 36'5136 mlcod 36'5136 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.178 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.175+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5488 (0'0,36'5488] local-lis/les=21/22 n=1056 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5487 crt=36'5483 lcod 36'5485 mlcod 36'5485 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.179 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.176+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5426 (0'0,36'5426] local-lis/les=21/22 n=1041 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5425 crt=36'5421 lcod 36'5423 mlcod 36'5423 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.180 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.174+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5147 (0'0,36'5147] local-lis/les=21/22 n=961 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5147 lcod 36'5145 mlcod 36'5145 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.180 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.177+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5140 (0'0,36'5140] local-lis/les=21/22 n=1010 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5138 crt=36'5138 lcod 36'5136 mlcod 36'5136 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.184 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.181+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5288 (0'0,36'5288] local-lis/les=21/22 n=985 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5286 crt=36'5286 lcod 36'5284 mlcod 36'5284 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.185 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.180+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5149 (0'0,36'5149] local-lis/les=21/22 n=959 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5147 crt=36'5147 lcod 36'5145 mlcod 36'5145 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.186 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.184+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5264 (0'0,36'5264] local-lis/les=21/22 n=1008 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5264 lcod 36'5262 mlcod 36'5262 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.187 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.180+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5151 (0'0,36'5151] local-lis/les=21/22 n=920 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5149 crt=36'5149 lcod 36'5147 mlcod 36'5147 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.188 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.181+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5490 (0'0,36'5490] local-lis/les=21/22 n=1054 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5487 crt=36'5487 lcod 36'5485 mlcod 36'5485 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.188 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.185+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5428 (0'0,36'5428] local-lis/les=21/22 n=1039 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5425 crt=36'5425 lcod 36'5423 mlcod 36'5423 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.191 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.188+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5266 (0'0,36'5266] local-lis/les=21/22 n=1006 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5264 crt=36'5264 lcod 36'5262 mlcod 36'5262 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.191 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.188+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5310 (0'0,36'5310] local-lis/les=21/22 n=1053 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5310 lcod 36'5308 mlcod 36'5308 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.194 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.192+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5290 (0'0,36'5290] local-lis/les=21/22 n=983 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5290 lcod 36'5288 mlcod 36'5288 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.197 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.192+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5312 (0'0,36'5312] local-lis/les=21/22 n=1051 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5310 crt=36'5310 lcod 36'5308 mlcod 36'5308 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.199 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.197+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5152 (0'0,36'5152] local-lis/les=21/22 n=956 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5151 crt=36'5147 lcod 36'5149 mlcod 36'5149 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.201 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.199+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5292 (0'0,36'5292] local-lis/les=21/22 n=981 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5290 crt=36'5290 lcod 36'5288 mlcod 36'5288 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.204 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.202+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5143 (0'0,36'5143] local-lis/les=21/22 n=1007 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5142 crt=36'5142 lcod 36'5140 mlcod 36'5140 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.205 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.201+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5154 (0'0,36'5154] local-lis/les=21/22 n=954 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5151 crt=36'5151 lcod 36'5149 mlcod 36'5149 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.209 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.207+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5268 (0'0,36'5268] local-lis/les=21/22 n=1004 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5268 lcod 36'5266 mlcod 36'5266 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.212 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.206+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5492 (0'0,36'5492] local-lis/les=21/22 n=1052 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5492 lcod 36'5490 mlcod 36'5490 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.212 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.210+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5270 (0'0,36'5270] local-lis/les=21/22 n=1002 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5268 crt=36'5268 lcod 36'5266 mlcod 36'5266 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.213 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.206+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5430 (0'0,36'5430] local-lis/les=21/22 n=1037 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5430 lcod 36'5428 mlcod 36'5428 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.214 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.212+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5145 (0'0,36'5145] local-lis/les=21/22 n=1005 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5142 crt=36'5142 lcod 36'5140 mlcod 36'5140 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.216 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.209+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5153 (0'0,36'5153] local-lis/les=21/22 n=918 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5153 lcod 36'5151 mlcod 36'5151 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.217 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.212+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5155 (0'0,36'5155] local-lis/les=21/22 n=916 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5153 crt=36'5153 lcod 36'5151 mlcod 36'5151 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.218 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.213+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5494 (0'0,36'5494] local-lis/les=21/22 n=1050 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5492 crt=36'5492 lcod 36'5490 mlcod 36'5490 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.219 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.216+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5315 (0'0,36'5315] local-lis/les=21/22 n=1048 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5314 crt=36'5310 lcod 36'5312 mlcod 36'5312 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.220 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.218+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5432 (0'0,36'5432] local-lis/les=21/22 n=1035 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5430 crt=36'5430 lcod 36'5428 mlcod 36'5428 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.223 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.219+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5294 (0'0,36'5294] local-lis/les=21/22 n=979 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5294 lcod 36'5292 mlcod 36'5292 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.223 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.220+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5317 (0'0,36'5317] local-lis/les=21/22 n=1046 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5314 crt=36'5314 lcod 36'5312 mlcod 36'5312 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.225 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.222+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5296 (0'0,36'5296] local-lis/les=21/22 n=977 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5294 crt=36'5294 lcod 36'5292 mlcod 36'5292 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.231 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.229+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5157 (0'0,36'5157] local-lis/les=21/22 n=914 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5157 lcod 36'5155 mlcod 36'5155 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.235 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.232+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5147 (0'0,36'5147] local-lis/les=21/22 n=1003 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5147 lcod 36'5145 mlcod 36'5145 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.238 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.229+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5156 (0'0,36'5156] local-lis/les=21/22 n=952 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5156 lcod 36'5154 mlcod 36'5154 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.238 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.233+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5158 (0'0,36'5158] local-lis/les=21/22 n=950 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5156 crt=36'5156 lcod 36'5154 mlcod 36'5154 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.239 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.237+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5272 (0'0,36'5272] local-lis/les=21/22 n=1000 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5272 lcod 36'5270 mlcod 36'5270 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.240 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.238+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5434 (0'0,36'5434] local-lis/les=21/22 n=1033 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5434 lcod 36'5432 mlcod 36'5432 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.242 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.235+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5496 (0'0,36'5496] local-lis/les=21/22 n=1048 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5496 lcod 36'5494 mlcod 36'5494 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.242 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.236+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5159 (0'0,36'5159] local-lis/les=21/22 n=912 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5157 crt=36'5157 lcod 36'5155 mlcod 36'5155 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.245 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.242+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5319 (0'0,36'5319] local-lis/les=21/22 n=1044 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5319 lcod 36'5317 mlcod 36'5317 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.247 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.243+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5498 (0'0,36'5498] local-lis/les=21/22 n=1046 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5496 crt=36'5496 lcod 36'5494 mlcod 36'5494 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.249 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.248+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5274 (0'0,36'5274] local-lis/les=21/22 n=998 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5272 crt=36'5272 lcod 36'5270 mlcod 36'5270 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.251 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.249+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5436 (0'0,36'5436] local-lis/les=21/22 n=1031 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5434 crt=36'5434 lcod 36'5432 mlcod 36'5432 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.252 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.249+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5321 (0'0,36'5321] local-lis/les=21/22 n=1042 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5319 crt=36'5319 lcod 36'5317 mlcod 36'5317 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.252 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.250+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5160 (0'0,36'5160] local-lis/les=21/22 n=948 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5160 lcod 36'5158 mlcod 36'5158 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.255 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.254+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5162 (0'0,36'5162] local-lis/les=21/22 n=946 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5160 crt=36'5160 lcod 36'5158 mlcod 36'5158 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.257 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.254+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5162 (0'0,36'5162] local-lis/les=21/22 n=909 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5162 lcod 36'5161 mlcod 36'5161 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.258 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.251+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5149 (0'0,36'5149] local-lis/les=21/22 n=1001 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5147 crt=36'5147 lcod 36'5145 mlcod 36'5145 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.258 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.251+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5299 (0'0,36'5299] local-lis/les=21/22 n=974 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5299 lcod 36'5298 mlcod 36'5298 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.260 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.258+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5164 (0'0,36'5164] local-lis/les=21/22 n=907 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5162 crt=36'5162 lcod 36'5161 mlcod 36'5161 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.261 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.259+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5501 (0'0,36'5501] local-lis/les=21/22 n=1043 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5500 crt=36'5496 lcod 36'5498 mlcod 36'5498 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.262 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.259+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5301 (0'0,36'5301] local-lis/les=21/22 n=972 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5299 crt=36'5299 lcod 36'5298 mlcod 36'5298 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.269 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.263+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5503 (0'0,36'5503] local-lis/les=21/22 n=1041 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5500 crt=36'5500 lcod 36'5498 mlcod 36'5498 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.269 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.264+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5151 (0'0,36'5151] local-lis/les=21/22 n=999 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5151 lcod 36'5149 mlcod 36'5149 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.261+0000 7ff19e851700 1 Processor -- start 2020-02-11T16:31:28.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.261+0000 7ff19e851700 1 -- start start 2020-02-11T16:31:28.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.262+0000 7ff19e851700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 0x7ff19814d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:28.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.262+0000 7ff19e851700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980a4920 con 0x7ff198066690 2020-02-11T16:31:28.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.262+0000 7ff19e851700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980a4bc0 con 0x7ff1980a4020 2020-02-11T16:31:28.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.262+0000 7ff19e851700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980a1bb0 con 0x7ff19814ce30 2020-02-11T16:31:28.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.263+0000 7ff19d04e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff1980a4020 0x7ff19805b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48816/0 (socket says 172.21.15.88:48816) 2020-02-11T16:31:28.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.263+0000 7ff19d04e700 1 -- 172.21.15.88:0/2669838751 learned_addr learned my addr 172.21.15.88:0/2669838751 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:28.270 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.263+0000 7ff19e050700 1 --2- 172.21.15.88:0/2669838751 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 0x7ff19814d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.263+0000 7ff19c84d700 1 -- 172.21.15.88:0/2669838751 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588879326 0 0) 0x7ff1980a4bc0 con 0x7ff1980a4020 2020-02-11T16:31:28.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.263+0000 7ff19c84d700 1 -- 172.21.15.88:0/2669838751 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff180014240 con 0x7ff1980a4020 2020-02-11T16:31:28.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.264+0000 7ff19e050700 1 -- 172.21.15.88:0/2669838751 >> v1:172.21.15.88:6789/0 conn(0x7ff1980a4020 legacy=0x7ff19805b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.264+0000 7ff19e050700 1 -- 172.21.15.88:0/2669838751 >> v1:172.21.15.52:6789/0 conn(0x7ff198066690 legacy=0x7ff19814c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.264+0000 7ff19e050700 1 -- 172.21.15.88:0/2669838751 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980a4f10 con 0x7ff19814ce30 2020-02-11T16:31:28.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.264+0000 7ff19e050700 1 --2- 172.21.15.88:0/2669838751 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 0x7ff19814d2c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff194002f30 tx=0x7ff1940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.271 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.264+0000 7ff19e050700 1 --2- 172.21.15.88:0/2669838751 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 0x7ff19814d2c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff194002f30 tx=0x7ff1940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.264+0000 7ff19e050700 1 --2- 172.21.15.88:0/2669838751 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 0x7ff19814d2c0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7ff194002f30 tx=0x7ff1940088e0).ready entity=mon.2 client_cookie=eca908db6868a6d7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.264+0000 7ff19e050700 1 --2- 172.21.15.88:0/2669838751 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 0x7ff19814d2c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7ff194002f30 tx=0x7ff1940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.264+0000 7ff19e050700 1 --2- 172.21.15.88:0/2669838751 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 0x7ff19814d2c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7ff194002f30 tx=0x7ff1940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.264+0000 7ff19e050700 1 --2- 172.21.15.88:0/2669838751 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 0x7ff19814d2c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7ff194002f30 tx=0x7ff1940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.265+0000 7ff19c84d700 1 -- 172.21.15.88:0/2669838751 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1940115f0 con 0x7ff19814ce30 2020-02-11T16:31:28.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.265+0000 7ff19c84d700 1 -- 172.21.15.88:0/2669838751 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff194011750 con 0x7ff19814ce30 2020-02-11T16:31:28.272 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.265+0000 7ff19c84d700 1 -- 172.21.15.88:0/2669838751 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff194011b30 con 0x7ff19814ce30 2020-02-11T16:31:28.274 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.270+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5164 (0'0,36'5164] local-lis/les=21/22 n=944 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5164 lcod 36'5162 mlcod 36'5162 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.274 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.267+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5153 (0'0,36'5153] local-lis/les=21/22 n=997 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5151 crt=36'5151 lcod 36'5149 mlcod 36'5149 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.274 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.268+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5303 (0'0,36'5303] local-lis/les=21/22 n=970 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5303 lcod 36'5301 mlcod 36'5301 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.274 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.272+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5305 (0'0,36'5305] local-lis/les=21/22 n=968 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5303 crt=36'5303 lcod 36'5301 mlcod 36'5301 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.267+0000 7ff19e851700 1 -- 172.21.15.88:0/2669838751 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 msgr2=0x7ff19814d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.267+0000 7ff19e851700 1 --2- 172.21.15.88:0/2669838751 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 0x7ff19814d2c0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7ff194002f30 tx=0x7ff1940088e0).stop 2020-02-11T16:31:28.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.268+0000 7ff19e851700 1 -- 172.21.15.88:0/2669838751 shutdown_connections 2020-02-11T16:31:28.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.268+0000 7ff19e851700 1 --2- 172.21.15.88:0/2669838751 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff19814ce30 0x7ff19814d2c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.275 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.268+0000 7ff19e851700 1 -- 172.21.15.88:0/2669838751 >> 172.21.15.88:0/2669838751 conn(0x7ff1980a9fb0 msgr2=0x7ff1980aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:28.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.272+0000 7ff19e851700 1 -- 172.21.15.88:0/2669838751 shutdown_connections 2020-02-11T16:31:28.276 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.272+0000 7ff19e851700 1 -- 172.21.15.88:0/2669838751 wait complete. 2020-02-11T16:31:28.277 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.274+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5324 (0'0,36'5324] local-lis/les=21/22 n=1039 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5323 crt=36'5321 lcod 36'5321 mlcod 36'5321 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.278 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.275+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5438 (0'0,36'5438] local-lis/les=21/22 n=1029 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5438 lcod 36'5436 mlcod 36'5436 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.274+0000 7ff19e851700 1 Processor -- start 2020-02-11T16:31:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.274+0000 7ff19e851700 1 -- start start 2020-02-11T16:31:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.275+0000 7ff19e851700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff198066690 0x7ff19807e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.275+0000 7ff19e851700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19807f460 con 0x7ff1980a4020 2020-02-11T16:31:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.275+0000 7ff19e851700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff198156290 con 0x7ff19814ce30 2020-02-11T16:31:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.275+0000 7ff19e851700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19807dbd0 con 0x7ff198066690 2020-02-11T16:31:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.275+0000 7ff19d04e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff1980a4020 0x7ff198155470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.88:40604/0 (socket says 172.21.15.88:40604) 2020-02-11T16:31:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.275+0000 7ff19d04e700 1 -- 172.21.15.88:0/1220747687 learned_addr learned my addr 172.21.15.88:0/1220747687 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.275+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144361207 0 0) 0x7ff19807f460 con 0x7ff1980a4020 2020-02-11T16:31:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.275+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff180002f90 con 0x7ff1980a4020 2020-02-11T16:31:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> v2:172.21.15.52:3300/0 conn(0x7ff198066690 0x7ff19807e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 720666308 0 0) 0x7ff180002f90 con 0x7ff1980a4020 2020-02-11T16:31:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 --> v1:172.21.15.52:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff19807f460 con 0x7ff1980a4020 2020-02-11T16:31:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786100300 0 0) 0x7ff198156290 con 0x7ff19814ce30 2020-02-11T16:31:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff180002f90 con 0x7ff19814ce30 2020-02-11T16:31:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7ff190001cc0 con 0x7ff1980a4020 2020-02-11T16:31:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 >> v2:172.21.15.52:3300/0 conn(0x7ff198066690 msgr2=0x7ff19807e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff18effd700 1 --2- 172.21.15.88:0/1220747687 >> v2:172.21.15.52:3300/0 conn(0x7ff198066690 0x7ff19807e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 >> v1:172.21.15.88:6789/0 conn(0x7ff19814ce30 legacy=0x7ff198155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 >> v1:172.21.15.52:6789/0 conn(0x7ff1980a4020 legacy=0x7ff198155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.276+0000 7ff18effd700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff180014e70 0x7ff1800051e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff18effd700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff18effd700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff180007f10 0x7ff18000a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19807dbd0 con 0x7ff180007f10 2020-02-11T16:31:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18000a930 con 0x7ff180005640 2020-02-11T16:31:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff180014e70 0x7ff1800051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18000aaf0 con 0x7ff180014e70 2020-02-11T16:31:28.286 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.277+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5166 (0'0,36'5166] local-lis/les=21/22 n=942 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5164 crt=36'5164 lcod 36'5162 mlcod 36'5162 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.286 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.280+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5276 (0'0,36'5276] local-lis/les=21/22 n=996 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5276 lcod 36'5274 mlcod 36'5274 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff19e050700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff180007f10 0x7ff18000a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff19d04e700 1 -- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff180014e70 msgr2=0x7ff1800051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.286 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff180014e70 0x7ff1800051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff19d04e700 1 -- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff180007f10 msgr2=0x7ff18000a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff180007f10 0x7ff18000a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.277+0000 7ff19d04e700 1 -- 172.21.15.88:0/1220747687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19807de70 con 0x7ff180005640 2020-02-11T16:31:28.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.278+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1900058a0 tx=0x7ff190011860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.278+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1900058a0 tx=0x7ff190011860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.278+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7ff1900058a0 tx=0x7ff190011860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.287 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.278+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7ff1900058a0 tx=0x7ff190011860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.278+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7ff1900058a0 tx=0x7ff190011860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.278+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7ff1900058a0 tx=0x7ff190011860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.280+0000 7ff19e050700 1 -- 172.21.15.88:0/1220747687 reap_dead start 2020-02-11T16:31:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.280+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff190012ea0 con 0x7ff180005640 2020-02-11T16:31:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.280+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff190005d40 con 0x7ff180005640 2020-02-11T16:31:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.280+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff190012470 con 0x7ff180005640 2020-02-11T16:31:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.280+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff180014e70 0x7ff1800051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-11T16:31:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.280+0000 7ff19e851700 1 -- 172.21.15.88:0/1220747687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19805baa0 con 0x7ff180005640 2020-02-11T16:31:28.289 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.280+0000 7ff19e851700 1 -- 172.21.15.88:0/1220747687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff198077a30 con 0x7ff180005640 2020-02-11T16:31:28.289 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.279+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5326 (0'0,36'5326] local-lis/les=21/22 n=1037 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5323 crt=36'5323 lcod 36'5321 mlcod 36'5321 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.289 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.279+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5440 (0'0,36'5440] local-lis/les=21/22 n=1027 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5438 crt=36'5438 lcod 36'5436 mlcod 36'5436 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.290 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.283+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5166 (0'0,36'5166] local-lis/les=21/22 n=905 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5166 lcod 36'5164 mlcod 36'5164 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.290 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.287+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5168 (0'0,36'5168] local-lis/les=21/22 n=903 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5166 crt=36'5166 lcod 36'5164 mlcod 36'5164 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.291 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.283+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5155 (0'0,36'5155] local-lis/les=21/22 n=995 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5155 lcod 36'5153 mlcod 36'5153 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.291 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.287+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5157 (0'0,36'5157] local-lis/les=21/22 n=993 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5155 crt=36'5155 lcod 36'5153 mlcod 36'5153 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.282+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7ff1900058a0 tx=0x7ff190011860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.283+0000 7ff19d04e700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7ff1900058a0 tx=0x7ff190011860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.283+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff1900125d0 con 0x7ff180005640 2020-02-11T16:31:28.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.283+0000 7ff19e851700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 0x7ff1740058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.291 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.283+0000 7ff19e851700 1 -- 172.21.15.88:0/1220747687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff174005ea0 con 0x7ff174003420 2020-02-11T16:31:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.284+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 0x7ff1740058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.284+0000 7ff18effd700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff180060110 0x7ff1800625d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.284+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff19004a1f0 con 0x7ff180005640 2020-02-11T16:31:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.284+0000 7ff19d84f700 1 -- 172.21.15.88:0/1220747687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff174006060 con 0x7ff174003420 2020-02-11T16:31:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.284+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 0x7ff1740058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.284+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 0x7ff1740058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.284+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 0x7ff1740058e0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.285+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 0x7ff1740058e0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.285+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff188003840 con 0x7ff174003420 2020-02-11T16:31:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.285+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 0x7ff1740058e0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.285+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff188001910 con 0x7ff174003420 2020-02-11T16:31:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.285+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 msgr2=0x7ff1740058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.285+0000 7ff18effd700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 0x7ff1740058e0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).stop 2020-02-11T16:31:28.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.285+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 msgr2=0x7ff1740058e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:28.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.285+0000 7ff18effd700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 0x7ff1740058e0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).stop 2020-02-11T16:31:28.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.286+0000 7ff19e050700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff180060110 0x7ff1800625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.294 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.286+0000 7ff19e050700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff180060110 0x7ff1800625d0 crc :-1 s=READY pgs=563 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.295 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.292+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5506 (0'0,36'5506] local-lis/les=21/22 n=1038 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5505 crt=36'5501 lcod 36'5503 mlcod 36'5503 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.295 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.292+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5442 (0'0,36'5442] local-lis/les=21/22 n=1025 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5442 lcod 36'5440 mlcod 36'5440 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.297 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.293+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5278 (0'0,36'5278] local-lis/les=21/22 n=994 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5276 crt=36'5276 lcod 36'5274 mlcod 36'5274 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.298 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.293+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5168 (0'0,36'5168] local-lis/les=21/22 n=940 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5168 lcod 36'5166 mlcod 36'5166 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.298 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.296+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5508 (0'0,36'5508] local-lis/les=21/22 n=1036 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5505 crt=36'5505 lcod 36'5503 mlcod 36'5503 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.299 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.297+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5170 (0'0,36'5170] local-lis/les=21/22 n=938 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5168 crt=36'5168 lcod 36'5166 mlcod 36'5166 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.302 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.299+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5444 (0'0,36'5444] local-lis/les=21/22 n=1023 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5442 crt=36'5442 lcod 36'5440 mlcod 36'5440 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.303 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.299+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5328 (0'0,36'5328] local-lis/les=21/22 n=1035 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5328 lcod 36'5326 mlcod 36'5326 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.302+0000 7ff19e851700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 0x7ff1740068f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.302+0000 7ff19e851700 1 -- 172.21.15.88:0/1220747687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff174006d80 con 0x7ff174006440 2020-02-11T16:31:28.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.302+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 0x7ff1740068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.302+0000 7ff19d84f700 1 -- 172.21.15.88:0/1220747687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff174006f40 con 0x7ff174006440 2020-02-11T16:31:28.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.302+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 0x7ff1740068f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.302+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 0x7ff1740068f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.302+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 0x7ff1740068f0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.302+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 0x7ff1740068f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.302+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1880103e0 con 0x7ff174006440 2020-02-11T16:31:28.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.303+0000 7ff19d84f700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 0x7ff1740068f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.303+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7ff18800e350 con 0x7ff174006440 2020-02-11T16:31:28.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.303+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 msgr2=0x7ff1740068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.303+0000 7ff18effd700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 0x7ff1740068f0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7ff1980aaf20 tx=0x7ff1980684d0).stop 2020-02-11T16:31:28.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.303+0000 7ff18effd700 1 -- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 msgr2=0x7ff1740068f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:28.308 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.303+0000 7ff18effd700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 0x7ff1740068f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.309 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.304+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5330 (0'0,36'5330] local-lis/les=21/22 n=1033 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5328 crt=36'5328 lcod 36'5326 mlcod 36'5326 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.309 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:31:28.309 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:28.309 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:28.310 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:31:28.310 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 216, 2020-02-11T16:31:28.310 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:31:28.310 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:31:28.310 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:31:28.310 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:31:28.310 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.311 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:31:28.311 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:28.311 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:31:28.311 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:31:28.311 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:28.311 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:28.311 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:28.312 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:28.312 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:28.312 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:28.312 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.312 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:31:28.313 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:31:28.313 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:28.313 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:28.313 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:28.313 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:28.313 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:28.314 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:28.314 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.314 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:31:28.314 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:31:28.314 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:31:28.314 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:31:28.315 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:31:28.315 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:31:28.315 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:28.315 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:28.315 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:31:28.315 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:31:28.315 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:28.316 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:31:28.316 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:28.316 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:28.316 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:28.316 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:28.316 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:28.316 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:28.317 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.317 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:31:28.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.317 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:31:28.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.317 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:31:28.317 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:31:28.318 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:28.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:28.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.318 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:28.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:31:28.318 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.319 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:28.319 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:31:28.319 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.319 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.320 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.320 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:31:28.320 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:31:28.320 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:28.320 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:28.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.321 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:28.321 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:28.321 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:28.321 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:28.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.321 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:28.321 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:31:28.322 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.322 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:28.322 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:31:28.323 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.323 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.323 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:31:28.323 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:31:28.323 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:28.324 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:28.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.324 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:28.324 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:28.324 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:28.324 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:28.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.325 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:28.325 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:31:28.325 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.325 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:28.326 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:31:28.326 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.326 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.326 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.326 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:31:28.326 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:31:28.327 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:28.327 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:28.327 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.327 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.327 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:31:28.327 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:31:28.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.328 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:28.328 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:28.328 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:28.328 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.328 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.328 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:31:28.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.329 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:28.329 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:28.329 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:31:28.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.329 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.329 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:31:28.330 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.304+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5308 (0'0,36'5308] local-lis/les=21/22 n=965 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5307 crt=36'5307 lcod 36'5305 mlcod 36'5305 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.332 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.310+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5280 (0'0,36'5280] local-lis/les=21/22 n=992 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5280 lcod 36'5278 mlcod 36'5278 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.333 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.314+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5282 (0'0,36'5282] local-lis/les=21/22 n=990 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5280 crt=36'5280 lcod 36'5278 mlcod 36'5278 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.333 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.313+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5172 (0'0,36'5172] local-lis/les=21/22 n=936 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5172 lcod 36'5170 mlcod 36'5170 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.333 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.317+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5174 (0'0,36'5174] local-lis/les=21/22 n=934 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5172 crt=36'5172 lcod 36'5170 mlcod 36'5170 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.309+0000 7ff19e851700 1 -- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff180060110 msgr2=0x7ff1800625d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.309+0000 7ff19e851700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff180060110 0x7ff1800625d0 crc :-1 s=READY pgs=563 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.309+0000 7ff19e851700 1 -- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 msgr2=0x7ff180007ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.309+0000 7ff19e851700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7ff1900058a0 tx=0x7ff190011860).stop 2020-02-11T16:31:28.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.311+0000 7ff19e851700 1 -- 172.21.15.88:0/1220747687 shutdown_connections 2020-02-11T16:31:28.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.311+0000 7ff19e851700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff180060110 0x7ff1800625d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.334 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.311+0000 7ff19e851700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180005640 0x7ff180007ab0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.311+0000 7ff19e851700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174003420 0x7ff1740058e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.311+0000 7ff19e851700 1 --2- 172.21.15.88:0/1220747687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff174006440 0x7ff1740068f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.311+0000 7ff19e851700 1 -- 172.21.15.88:0/1220747687 >> 172.21.15.88:0/1220747687 conn(0x7ff1980a9fb0 msgr2=0x7ff198069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:28.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.312+0000 7ff19e851700 1 -- 172.21.15.88:0/1220747687 shutdown_connections 2020-02-11T16:31:28.335 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.312+0000 7ff19e851700 1 -- 172.21.15.88:0/1220747687 wait complete. 2020-02-11T16:31:28.335 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.310+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5310 (0'0,36'5310] local-lis/les=21/22 n=963 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5307 crt=36'5307 lcod 36'5305 mlcod 36'5305 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.335 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.322+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5159 (0'0,36'5159] local-lis/les=21/22 n=991 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5159 lcod 36'5157 mlcod 36'5157 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.336 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.325+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5161 (0'0,36'5161] local-lis/les=21/22 n=989 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5159 crt=36'5159 lcod 36'5157 mlcod 36'5157 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.336 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.318+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5446 (0'0,36'5446] local-lis/les=21/22 n=1021 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5446 lcod 36'5444 mlcod 36'5444 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.336 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.322+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5448 (0'0,36'5448] local-lis/les=21/22 n=1019 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5446 crt=36'5446 lcod 36'5444 mlcod 36'5444 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.336 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.327+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5332 (0'0,36'5332] local-lis/les=21/22 n=1031 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5332 lcod 36'5330 mlcod 36'5330 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.336 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.313+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5170 (0'0,36'5170] local-lis/les=21/22 n=901 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5170 lcod 36'5168 mlcod 36'5168 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.336 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.315+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5511 (0'0,36'5511] local-lis/les=21/22 n=1033 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5510 crt=36'5508 lcod 36'5508 mlcod 36'5508 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.337 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.317+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5172 (0'0,36'5172] local-lis/les=21/22 n=899 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5170 crt=36'5170 lcod 36'5168 mlcod 36'5168 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.337 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.318+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5513 (0'0,36'5513] local-lis/les=21/22 n=1031 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5510 crt=36'5510 lcod 36'5508 mlcod 36'5508 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.337 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.335+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5284 (0'0,36'5284] local-lis/les=21/22 n=988 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5284 lcod 36'5282 mlcod 36'5282 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.338 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.331+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5334 (0'0,36'5334] local-lis/les=21/22 n=1029 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5332 crt=36'5332 lcod 36'5330 mlcod 36'5330 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.341 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.334+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5174 (0'0,36'5174] local-lis/les=21/22 n=897 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5174 lcod 36'5172 mlcod 36'5172 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.342 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.340+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5313 (0'0,36'5313] local-lis/les=21/22 n=960 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5313 lcod 36'5312 mlcod 36'5312 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.342 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.336+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5515 (0'0,36'5515] local-lis/les=21/22 n=1029 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5515 lcod 36'5513 mlcod 36'5513 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.343 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.339+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5286 (0'0,36'5286] local-lis/les=21/22 n=986 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5284 crt=36'5284 lcod 36'5282 mlcod 36'5282 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.343 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.339+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5517 (0'0,36'5517] local-lis/les=21/22 n=1027 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5515 crt=36'5515 lcod 36'5513 mlcod 36'5513 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.344 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.341+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5176 (0'0,36'5176] local-lis/les=21/22 n=895 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5174 crt=36'5174 lcod 36'5172 mlcod 36'5172 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.344 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.342+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5451 (0'0,36'5451] local-lis/les=21/22 n=1016 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5450 crt=36'5446 lcod 36'5448 mlcod 36'5448 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.346 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.343+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5315 (0'0,36'5315] local-lis/les=21/22 n=958 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5313 crt=36'5313 lcod 36'5312 mlcod 36'5312 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.347 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:31:28.347 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.345+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5176 (0'0,36'5176] local-lis/les=21/22 n=932 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5176 lcod 36'5174 mlcod 36'5174 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.349 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.346+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5453 (0'0,36'5453] local-lis/les=21/22 n=1014 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5450 crt=36'5450 lcod 36'5448 mlcod 36'5448 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.351 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.349+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5178 (0'0,36'5178] local-lis/les=21/22 n=930 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5176 crt=36'5176 lcod 36'5174 mlcod 36'5174 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.358 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.356+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5336 (0'0,36'5336] local-lis/les=21/22 n=1027 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5336 lcod 36'5334 mlcod 36'5334 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.362 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.359+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5338 (0'0,36'5338] local-lis/les=21/22 n=1025 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5336 crt=36'5336 lcod 36'5334 mlcod 36'5334 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.366 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.357+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5288 (0'0,36'5288] local-lis/les=21/22 n=984 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5288 lcod 36'5286 mlcod 36'5286 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.367 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.363+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5290 (0'0,36'5290] local-lis/les=21/22 n=982 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5288 crt=36'5288 lcod 36'5286 mlcod 36'5286 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.369 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.364+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5163 (0'0,36'5163] local-lis/les=21/22 n=987 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5163 lcod 36'5161 mlcod 36'5161 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.370 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.368+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5180 (0'0,36'5180] local-lis/les=21/22 n=928 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5180 lcod 36'5178 mlcod 36'5178 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.370 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.366+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5520 (0'0,36'5520] local-lis/les=21/22 n=1024 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5520 lcod 36'5519 mlcod 36'5519 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.370 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.367+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5178 (0'0,36'5178] local-lis/les=21/22 n=893 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5178 lcod 36'5176 mlcod 36'5176 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.373 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.370+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5522 (0'0,36'5522] local-lis/les=21/22 n=1022 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5520 crt=36'5520 lcod 36'5519 mlcod 36'5519 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.373 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.370+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5180 (0'0,36'5180] local-lis/les=21/22 n=891 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5178 crt=36'5178 lcod 36'5176 mlcod 36'5176 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.373 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.367+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5455 (0'0,36'5455] local-lis/les=21/22 n=1012 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5455 lcod 36'5453 mlcod 36'5453 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.374 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.370+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5457 (0'0,36'5457] local-lis/les=21/22 n=1010 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5455 crt=36'5455 lcod 36'5453 mlcod 36'5453 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.379 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.376+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5341 (0'0,36'5341] local-lis/les=21/22 n=1022 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5340 crt=36'5336 lcod 36'5338 mlcod 36'5338 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.380 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.372+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5292 (0'0,36'5292] local-lis/les=21/22 n=980 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5292 lcod 36'5290 mlcod 36'5290 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.380 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.376+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5294 (0'0,36'5294] local-lis/les=21/22 n=978 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5292 crt=36'5292 lcod 36'5290 mlcod 36'5290 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.382 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.379+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5165 (0'0,36'5165] local-lis/les=21/22 n=985 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5163 crt=36'5163 lcod 36'5161 mlcod 36'5161 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.385 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.374+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5182 (0'0,36'5182] local-lis/les=21/22 n=926 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5180 crt=36'5180 lcod 36'5178 mlcod 36'5178 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.387 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.384+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5343 (0'0,36'5343] local-lis/les=21/22 n=1020 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5340 crt=36'5340 lcod 36'5338 mlcod 36'5338 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.388 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.385+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5318 (0'0,36'5318] local-lis/les=21/22 n=955 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5318 lcod 36'5317 mlcod 36'5317 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.391 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.389+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5183 (0'0,36'5183] local-lis/les=21/22 n=888 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5183 lcod 36'5182 mlcod 36'5182 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.389+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5320 (0'0,36'5320] local-lis/les=21/22 n=953 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5318 crt=36'5318 lcod 36'5317 mlcod 36'5317 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.395 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.393+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5185 (0'0,36'5185] local-lis/les=21/22 n=886 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5183 crt=36'5183 lcod 36'5182 mlcod 36'5182 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.396 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.391+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5460 (0'0,36'5460] local-lis/les=21/22 n=1007 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5459 crt=36'5455 lcod 36'5457 mlcod 36'5457 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.397 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.394+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5462 (0'0,36'5462] local-lis/les=21/22 n=1005 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5459 crt=36'5459 lcod 36'5457 mlcod 36'5457 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.397 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.395+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5184 (0'0,36'5184] local-lis/les=21/22 n=924 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5184 lcod 36'5182 mlcod 36'5182 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.399 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.398+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5296 (0'0,36'5296] local-lis/les=21/22 n=976 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5296 lcod 36'5294 mlcod 36'5294 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.403 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.401+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5186 (0'0,36'5186] local-lis/les=21/22 n=922 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5184 crt=36'5184 lcod 36'5182 mlcod 36'5182 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.403 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.402+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5298 (0'0,36'5298] local-lis/les=21/22 n=974 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5296 crt=36'5296 lcod 36'5294 mlcod 36'5294 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.406 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.404+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5345 (0'0,36'5345] local-lis/les=21/22 n=1018 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5345 lcod 36'5343 mlcod 36'5343 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.408 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.405+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5167 (0'0,36'5167] local-lis/les=21/22 n=983 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5167 lcod 36'5165 mlcod 36'5165 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.413 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.411+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5347 (0'0,36'5347] local-lis/les=21/22 n=1016 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5345 crt=36'5345 lcod 36'5343 mlcod 36'5343 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.419 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.416+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5465 (0'0,36'5465] local-lis/les=21/22 n=1002 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5465 lcod 36'5464 mlcod 36'5464 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.419 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.411+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5525 (0'0,36'5525] local-lis/les=21/22 n=1019 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5525 lcod 36'5524 mlcod 36'5524 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.422 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.421+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5188 (0'0,36'5188] local-lis/les=21/22 n=920 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5188 lcod 36'5186 mlcod 36'5186 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.423 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.420+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5467 (0'0,36'5467] local-lis/les=21/22 n=1000 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5465 crt=36'5465 lcod 36'5464 mlcod 36'5464 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.423 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.415+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5527 (0'0,36'5527] local-lis/les=21/22 n=1017 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5525 crt=36'5525 lcod 36'5524 mlcod 36'5524 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.424 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.416+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5187 (0'0,36'5187] local-lis/les=21/22 n=884 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5187 lcod 36'5185 mlcod 36'5185 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.425 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.422+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5189 (0'0,36'5189] local-lis/les=21/22 n=882 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5187 crt=36'5187 lcod 36'5185 mlcod 36'5185 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.426 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.424+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5190 (0'0,36'5190] local-lis/les=21/22 n=918 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5188 crt=36'5188 lcod 36'5186 mlcod 36'5186 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.426 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.424+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5301 (0'0,36'5301] local-lis/les=21/22 n=971 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5301 lcod 36'5300 mlcod 36'5300 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.427 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.424+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5350 (0'0,36'5350] local-lis/les=21/22 n=1013 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5349 crt=36'5345 lcod 36'5347 mlcod 36'5347 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.427 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.412+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5169 (0'0,36'5169] local-lis/les=21/22 n=981 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5167 crt=36'5167 lcod 36'5165 mlcod 36'5165 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.427 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.425+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5322 (0'0,36'5322] local-lis/les=21/22 n=951 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5322 lcod 36'5320 mlcod 36'5320 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.430 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.428+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5303 (0'0,36'5303] local-lis/les=21/22 n=969 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5301 crt=36'5301 lcod 36'5300 mlcod 36'5300 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.433 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.428+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5352 (0'0,36'5352] local-lis/les=21/22 n=1011 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5349 crt=36'5349 lcod 36'5347 mlcod 36'5347 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.434 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.429+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5324 (0'0,36'5324] local-lis/les=21/22 n=949 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5322 crt=36'5322 lcod 36'5320 mlcod 36'5320 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.439 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.435+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5171 (0'0,36'5171] local-lis/les=21/22 n=979 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5171 lcod 36'5169 mlcod 36'5169 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.442 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.439+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5173 (0'0,36'5173] local-lis/les=21/22 n=977 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5171 crt=36'5171 lcod 36'5169 mlcod 36'5169 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.447 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.440+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5469 (0'0,36'5469] local-lis/les=21/22 n=998 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5469 lcod 36'5467 mlcod 36'5467 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.448 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.445+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5471 (0'0,36'5471] local-lis/les=21/22 n=996 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5469 crt=36'5469 lcod 36'5467 mlcod 36'5467 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.448 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.446+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5326 (0'0,36'5326] local-lis/les=21/22 n=947 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5326 lcod 36'5324 mlcod 36'5324 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.451 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.449+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5529 (0'0,36'5529] local-lis/les=21/22 n=1015 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5529 lcod 36'5527 mlcod 36'5527 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.452 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.450+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5354 (0'0,36'5354] local-lis/les=21/22 n=1009 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5354 lcod 36'5352 mlcod 36'5352 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.454 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.451+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5328 (0'0,36'5328] local-lis/les=21/22 n=945 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5326 crt=36'5326 lcod 36'5324 mlcod 36'5324 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.457 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.452+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5193 (0'0,36'5193] local-lis/les=21/22 n=878 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5192 crt=36'5189 lcod 36'5191 mlcod 36'5191 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.457 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.452+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5531 (0'0,36'5531] local-lis/les=21/22 n=1013 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5529 crt=36'5529 lcod 36'5527 mlcod 36'5527 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.457 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.454+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5356 (0'0,36'5356] local-lis/les=21/22 n=1007 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5354 crt=36'5354 lcod 36'5352 mlcod 36'5352 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.459 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.454+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5192 (0'0,36'5192] local-lis/les=21/22 n=916 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5192 lcod 36'5190 mlcod 36'5190 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.462 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.457+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5305 (0'0,36'5305] local-lis/les=21/22 n=967 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5305 lcod 36'5303 mlcod 36'5303 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.462 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.461+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5307 (0'0,36'5307] local-lis/les=21/22 n=965 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5305 crt=36'5305 lcod 36'5303 mlcod 36'5303 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.467 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.465+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5330 (0'0,36'5330] local-lis/les=21/22 n=943 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5330 lcod 36'5328 mlcod 36'5328 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.468 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.465+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5473 (0'0,36'5473] local-lis/les=21/22 n=994 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5473 lcod 36'5471 mlcod 36'5471 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.469 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.466+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5194 (0'0,36'5194] local-lis/les=21/22 n=914 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5192 crt=36'5192 lcod 36'5190 mlcod 36'5190 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.470 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.467+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5195 (0'0,36'5195] local-lis/les=21/22 n=876 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5192 crt=36'5192 lcod 36'5191 mlcod 36'5191 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.472 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.467+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5175 (0'0,36'5175] local-lis/les=21/22 n=975 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5175 lcod 36'5173 mlcod 36'5173 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.472 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.467+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5533 (0'0,36'5533] local-lis/les=21/22 n=1011 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5533 lcod 36'5531 mlcod 36'5531 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.472 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.468+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5332 (0'0,36'5332] local-lis/les=21/22 n=941 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5330 crt=36'5330 lcod 36'5328 mlcod 36'5328 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.473 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.469+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5475 (0'0,36'5475] local-lis/les=21/22 n=992 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5473 crt=36'5473 lcod 36'5471 mlcod 36'5471 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.473 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.470+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5177 (0'0,36'5177] local-lis/les=21/22 n=973 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5175 crt=36'5175 lcod 36'5173 mlcod 36'5173 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.477 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.474+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5535 (0'0,36'5535] local-lis/les=21/22 n=1009 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5533 crt=36'5533 lcod 36'5531 mlcod 36'5531 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.483 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.482+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5309 (0'0,36'5309] local-lis/les=21/22 n=963 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5309 lcod 36'5307 mlcod 36'5307 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.487 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.485+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5311 (0'0,36'5311] local-lis/les=21/22 n=961 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5309 crt=36'5309 lcod 36'5307 mlcod 36'5307 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.489 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.484+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5477 (0'0,36'5477] local-lis/les=21/22 n=990 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5477 lcod 36'5475 mlcod 36'5475 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.490 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.485+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5358 (0'0,36'5358] local-lis/les=21/22 n=1005 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5358 lcod 36'5356 mlcod 36'5356 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.491 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.485+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5197 (0'0,36'5197] local-lis/les=21/22 n=911 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5197 lcod 36'5196 mlcod 36'5196 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.493 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.488+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5479 (0'0,36'5479] local-lis/les=21/22 n=988 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5477 crt=36'5477 lcod 36'5475 mlcod 36'5475 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.493 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.489+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5360 (0'0,36'5360] local-lis/les=21/22 n=1003 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5358 crt=36'5358 lcod 36'5356 mlcod 36'5356 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.494 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.489+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5537 (0'0,36'5537] local-lis/les=21/22 n=1007 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5537 lcod 36'5535 mlcod 36'5535 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.496 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.494+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5334 (0'0,36'5334] local-lis/les=21/22 n=939 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5334 lcod 36'5332 mlcod 36'5332 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.501 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.492+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5199 (0'0,36'5199] local-lis/les=21/22 n=909 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5197 crt=36'5197 lcod 36'5196 mlcod 36'5196 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.501 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.498+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5336 (0'0,36'5336] local-lis/les=21/22 n=937 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5334 crt=36'5334 lcod 36'5332 mlcod 36'5332 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.502 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.500+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5197 (0'0,36'5197] local-lis/les=21/22 n=874 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5197 lcod 36'5195 mlcod 36'5195 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.503 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.501+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5179 (0'0,36'5179] local-lis/les=21/22 n=971 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5179 lcod 36'5177 mlcod 36'5177 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.506 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.504+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5199 (0'0,36'5199] local-lis/les=21/22 n=872 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5197 crt=36'5197 lcod 36'5195 mlcod 36'5195 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.507 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.505+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5314 (0'0,36'5314] local-lis/les=21/22 n=958 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5313 crt=36'5309 lcod 36'5311 mlcod 36'5311 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.507 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.505+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5181 (0'0,36'5181] local-lis/les=21/22 n=969 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5179 crt=36'5179 lcod 36'5177 mlcod 36'5177 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.511 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.509+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5202 (0'0,36'5202] local-lis/les=21/22 n=906 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5201 crt=36'5197 lcod 36'5199 mlcod 36'5199 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.512 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.510+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5316 (0'0,36'5316] local-lis/les=21/22 n=956 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5313 crt=36'5313 lcod 36'5311 mlcod 36'5311 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.513 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.511+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5481 (0'0,36'5481] local-lis/les=21/22 n=986 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5481 lcod 36'5479 mlcod 36'5479 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.515 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.513+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5541 (0'0,36'5541] local-lis/les=21/22 n=1004 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5541 lcod 36'5539 mlcod 36'5539 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.519 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.515+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5483 (0'0,36'5483] local-lis/les=21/22 n=984 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5481 crt=36'5481 lcod 36'5479 mlcod 36'5479 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.520 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.517+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5543 (0'0,36'5543] local-lis/les=21/22 n=1002 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5541 crt=36'5541 lcod 36'5539 mlcod 36'5539 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.520 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.513+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5204 (0'0,36'5204] local-lis/les=21/22 n=904 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5201 crt=36'5201 lcod 36'5199 mlcod 36'5199 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.523 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.521+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5362 (0'0,36'5362] local-lis/les=21/22 n=1001 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5362 lcod 36'5360 mlcod 36'5360 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.526 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.524+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5201 (0'0,36'5201] local-lis/les=21/22 n=870 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5201 lcod 36'5199 mlcod 36'5199 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.528 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.525+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5364 (0'0,36'5364] local-lis/les=21/22 n=999 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5362 crt=36'5362 lcod 36'5360 mlcod 36'5360 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.531 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.527+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5318 (0'0,36'5318] local-lis/les=21/22 n=954 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5318 lcod 36'5316 mlcod 36'5316 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.532 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.528+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5203 (0'0,36'5203] local-lis/les=21/22 n=868 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5201 crt=36'5201 lcod 36'5199 mlcod 36'5199 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.533 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.530+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5485 (0'0,36'5485] local-lis/les=21/22 n=982 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5485 lcod 36'5483 mlcod 36'5483 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.533 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.530+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5183 (0'0,36'5183] local-lis/les=21/22 n=967 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5183 lcod 36'5181 mlcod 36'5181 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.535 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.533+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5206 (0'0,36'5206] local-lis/les=21/22 n=902 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5206 lcod 36'5204 mlcod 36'5204 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.536 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.533+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5320 (0'0,36'5320] local-lis/les=21/22 n=952 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5318 crt=36'5318 lcod 36'5316 mlcod 36'5316 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.540 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.538+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5208 (0'0,36'5208] local-lis/les=21/22 n=900 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5206 crt=36'5206 lcod 36'5204 mlcod 36'5204 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.540 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.538+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5487 (0'0,36'5487] local-lis/les=21/22 n=980 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5485 crt=36'5485 lcod 36'5483 mlcod 36'5483 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.543 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.537+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5338 (0'0,36'5338] local-lis/les=21/22 n=935 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5338 lcod 36'5336 mlcod 36'5336 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.543 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.537+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5185 (0'0,36'5185] local-lis/les=21/22 n=965 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5183 crt=36'5183 lcod 36'5181 mlcod 36'5181 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.544 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.541+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5546 (0'0,36'5546] local-lis/les=21/22 n=999 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5545 crt=36'5541 lcod 36'5543 mlcod 36'5543 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.548 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.544+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5205 (0'0,36'5205] local-lis/les=21/22 n=866 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5205 lcod 36'5203 mlcod 36'5203 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.549 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.548+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5210 (0'0,36'5210] local-lis/les=21/22 n=898 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5210 lcod 36'5208 mlcod 36'5208 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.550 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.546+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5366 (0'0,36'5366] local-lis/les=21/22 n=997 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5366 lcod 36'5364 mlcod 36'5364 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.553 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.551+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5340 (0'0,36'5340] local-lis/les=21/22 n=933 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5338 crt=36'5338 lcod 36'5336 mlcod 36'5336 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.555 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.552+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5368 (0'0,36'5368] local-lis/les=21/22 n=995 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5366 crt=36'5366 lcod 36'5364 mlcod 36'5364 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.556 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.554+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5489 (0'0,36'5489] local-lis/les=21/22 n=978 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5489 lcod 36'5487 mlcod 36'5487 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.557 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.552+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5548 (0'0,36'5548] local-lis/les=21/22 n=997 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5545 crt=36'5545 lcod 36'5543 mlcod 36'5543 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.557 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.552+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5207 (0'0,36'5207] local-lis/les=21/22 n=864 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5205 crt=36'5205 lcod 36'5203 mlcod 36'5203 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.558 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.555+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5212 (0'0,36'5212] local-lis/les=21/22 n=896 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5210 crt=36'5210 lcod 36'5208 mlcod 36'5208 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.562 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.559+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5491 (0'0,36'5491] local-lis/les=21/22 n=976 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5489 crt=36'5489 lcod 36'5487 mlcod 36'5487 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.563 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.561+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5322 (0'0,36'5322] local-lis/les=21/22 n=950 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5322 lcod 36'5320 mlcod 36'5320 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.566 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.564+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5324 (0'0,36'5324] local-lis/les=21/22 n=948 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5322 crt=36'5322 lcod 36'5320 mlcod 36'5320 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.568 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.564+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5187 (0'0,36'5187] local-lis/les=21/22 n=963 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5187 lcod 36'5185 mlcod 36'5185 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.566+0000 7ff722c95700 1 Processor -- start 2020-02-11T16:31:28.568 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.566+0000 7ff722c95700 1 -- start start 2020-02-11T16:31:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.566+0000 7ff722c95700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff71c0ad380 0x7ff71c0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.566+0000 7ff722c95700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff71c138280 0x7ff71c1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff722c95700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c0adb40 con 0x7ff71c13b1c0 2020-02-11T16:31:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff722c95700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c137bf0 con 0x7ff71c138280 2020-02-11T16:31:28.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff722c95700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c138b40 con 0x7ff71c0ad380 2020-02-11T16:31:28.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff71bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff71c138280 0x7ff71c1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff71bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff71c138280 0x7ff71c1386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:32986/0 (socket says 172.21.15.88:32986) 2020-02-11T16:31:28.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff71bfff700 1 -- 172.21.15.88:0/871752310 learned_addr learned my addr 172.21.15.88:0/871752310 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:28.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff721232700 1 --1- 172.21.15.88:0/871752310 >> v1:172.21.15.88:6789/0 conn(0x7ff71c13b1c0 0x7ff71c13b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48840/0 (socket says 172.21.15.88:48840) 2020-02-11T16:31:28.573 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff71bfff700 1 -- 172.21.15.88:0/871752310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff71c0ad380 msgr2=0x7ff71c0a9130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2020-02-11T16:31:28.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff71bfff700 1 --2- 172.21.15.88:0/871752310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff71c0ad380 0x7ff71c0a9130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:28.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff71bfff700 1 -- 172.21.15.88:0/871752310 >> v1:172.21.15.88:6789/0 conn(0x7ff71c13b1c0 legacy=0x7ff71c13b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff71bfff700 1 -- 172.21.15.88:0/871752310 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c137de0 con 0x7ff71c138280 2020-02-11T16:31:28.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.567+0000 7ff71bfff700 1 --2- 172.21.15.88:0/871752310 >> v2:172.21.15.88:3300/0 conn(0x7ff71c138280 0x7ff71c1386e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff710002f30 tx=0x7ff7100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.568+0000 7ff71bfff700 1 --2- 172.21.15.88:0/871752310 >> v2:172.21.15.88:3300/0 conn(0x7ff71c138280 0x7ff71c1386e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff710002f30 tx=0x7ff7100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.568+0000 7ff71bfff700 1 --2- 172.21.15.88:0/871752310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c138280 0x7ff71c1386e0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7ff710002f30 tx=0x7ff7100088e0).ready entity=mon.1 client_cookie=47460b3df20149a1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.574 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.568+0000 7ff71bfff700 1 --2- 172.21.15.88:0/871752310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c138280 0x7ff71c1386e0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7ff710002f30 tx=0x7ff7100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.568+0000 7ff71bfff700 1 --2- 172.21.15.88:0/871752310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c138280 0x7ff71c1386e0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7ff710002f30 tx=0x7ff7100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.575 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.568+0000 7ff71bfff700 1 --2- 172.21.15.88:0/871752310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c138280 0x7ff71c1386e0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7ff710002f30 tx=0x7ff7100088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.576 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.570+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5372 (0'0,36'5372] local-lis/les=21/22 n=992 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5370 crt=36'5370 lcod 36'5368 mlcod 36'5368 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.576 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.568+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5189 (0'0,36'5189] local-lis/les=21/22 n=961 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5187 crt=36'5187 lcod 36'5185 mlcod 36'5185 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.576 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.570+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5343 (0'0,36'5343] local-lis/les=21/22 n=930 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5342 crt=36'5340 lcod 36'5340 mlcod 36'5340 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.571+0000 7ff71b7fe700 1 -- 172.21.15.88:0/871752310 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff710008e20 con 0x7ff71c138280 2020-02-11T16:31:28.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.572+0000 7ff71b7fe700 1 -- 172.21.15.88:0/871752310 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff710011950 con 0x7ff71c138280 2020-02-11T16:31:28.577 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.572+0000 7ff71b7fe700 1 -- 172.21.15.88:0/871752310 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff710011d30 con 0x7ff71c138280 2020-02-11T16:31:28.577 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.574+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5214 (0'0,36'5214] local-lis/les=21/22 n=894 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5214 lcod 36'5212 mlcod 36'5212 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.579 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.573+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5551 (0'0,36'5551] local-lis/les=21/22 n=994 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5550 crt=36'5548 lcod 36'5548 mlcod 36'5548 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.579 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.574+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5345 (0'0,36'5345] local-lis/les=21/22 n=928 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5342 crt=36'5342 lcod 36'5340 mlcod 36'5340 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.579 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.574+0000 7ff722c95700 1 -- 172.21.15.88:0/871752310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c138280 msgr2=0x7ff71c1386e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.581 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.579+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5216 (0'0,36'5216] local-lis/les=21/22 n=892 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5214 crt=36'5214 lcod 36'5212 mlcod 36'5212 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.584 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.577+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5493 (0'0,36'5493] local-lis/les=21/22 n=974 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5493 lcod 36'5491 mlcod 36'5491 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.584 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.580+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5495 (0'0,36'5495] local-lis/les=21/22 n=972 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5493 crt=36'5493 lcod 36'5491 mlcod 36'5491 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.574+0000 7ff722c95700 1 --2- 172.21.15.88:0/871752310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c138280 0x7ff71c1386e0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7ff710002f30 tx=0x7ff7100088e0).stop 2020-02-11T16:31:28.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.580+0000 7ff722c95700 1 -- 172.21.15.88:0/871752310 shutdown_connections 2020-02-11T16:31:28.584 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.580+0000 7ff722c95700 1 --2- 172.21.15.88:0/871752310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff71c0ad380 0x7ff71c0a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.580+0000 7ff722c95700 1 --2- 172.21.15.88:0/871752310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c138280 0x7ff71c1386e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.580+0000 7ff722c95700 1 -- 172.21.15.88:0/871752310 >> 172.21.15.88:0/871752310 conn(0x7ff71c05ac70 msgr2=0x7ff71c0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.580+0000 7ff722c95700 1 -- 172.21.15.88:0/871752310 shutdown_connections 2020-02-11T16:31:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.580+0000 7ff722c95700 1 -- 172.21.15.88:0/871752310 wait complete. 2020-02-11T16:31:28.585 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.582+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5553 (0'0,36'5553] local-lis/les=21/22 n=992 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5550 crt=36'5550 lcod 36'5548 mlcod 36'5548 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.585+0000 7ff722c95700 1 Processor -- start 2020-02-11T16:31:28.587 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.586+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5326 (0'0,36'5326] local-lis/les=21/22 n=946 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5326 lcod 36'5324 mlcod 36'5324 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.589 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.587+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5209 (0'0,36'5209] local-lis/les=21/22 n=862 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5209 lcod 36'5207 mlcod 36'5207 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.587+0000 7ff722c95700 1 -- start start 2020-02-11T16:31:28.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff722c95700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff71c0ad380 0x7ff71c12f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff722c95700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff71c13b1c0 0x7ff71c12ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.593 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff722c95700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c12e400 con 0x7ff71c138280 2020-02-11T16:31:28.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff722c95700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c130700 con 0x7ff71c13b1c0 2020-02-11T16:31:28.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff722c95700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c13ab20 con 0x7ff71c0ad380 2020-02-11T16:31:28.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff71bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff71c138280 0x7ff71c14d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48846/0 (socket says 172.21.15.88:48846) 2020-02-11T16:31:28.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff71bfff700 1 -- 172.21.15.88:0/1135437799 learned_addr learned my addr 172.21.15.88:0/1135437799 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:28.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff721232700 1 --2- 172.21.15.88:0/1135437799 >> v2:172.21.15.52:3300/0 conn(0x7ff71c13b1c0 0x7ff71c12ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff720a31700 1 --2- 172.21.15.88:0/1135437799 >> v2:172.21.15.88:3300/0 conn(0x7ff71c0ad380 0x7ff71c12f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.594 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff720a31700 1 -- 172.21.15.88:0/1135437799 >> v2:172.21.15.52:3300/0 conn(0x7ff71c13b1c0 msgr2=0x7ff71c12ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff720a31700 1 --2- 172.21.15.88:0/1135437799 >> v2:172.21.15.52:3300/0 conn(0x7ff71c13b1c0 0x7ff71c12ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff720a31700 1 -- 172.21.15.88:0/1135437799 >> v1:172.21.15.88:6789/0 conn(0x7ff71c138280 legacy=0x7ff71c14d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.588+0000 7ff720a31700 1 -- 172.21.15.88:0/1135437799 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c12fb00 con 0x7ff71c0ad380 2020-02-11T16:31:28.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.589+0000 7ff721232700 1 --2- 172.21.15.88:0/1135437799 >> v2:172.21.15.52:3300/0 conn(0x7ff71c13b1c0 0x7ff71c12ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:31:28.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.589+0000 7ff720a31700 1 --2- 172.21.15.88:0/1135437799 >> v2:172.21.15.88:3300/0 conn(0x7ff71c0ad380 0x7ff71c12f4f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7100084c0 tx=0x7ff714010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.589+0000 7ff720a31700 1 --2- 172.21.15.88:0/1135437799 >> v2:172.21.15.88:3300/0 conn(0x7ff71c0ad380 0x7ff71c12f4f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7100084c0 tx=0x7ff714010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.595 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.589+0000 7ff720a31700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c0ad380 0x7ff71c12f4f0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7ff7100084c0 tx=0x7ff714010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.589+0000 7ff720a31700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c0ad380 0x7ff71c12f4f0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7ff7100084c0 tx=0x7ff714010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.589+0000 7ff720a31700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c0ad380 0x7ff71c12f4f0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7ff7100084c0 tx=0x7ff714010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.596 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.589+0000 7ff720a31700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c0ad380 0x7ff71c12f4f0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7ff7100084c0 tx=0x7ff714010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.596 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.590+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5211 (0'0,36'5211] local-lis/les=21/22 n=860 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5209 crt=36'5209 lcod 36'5207 mlcod 36'5207 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.596 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.590+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5191 (0'0,36'5191] local-lis/les=21/22 n=959 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5191 lcod 36'5189 mlcod 36'5189 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.597 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.593+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5328 (0'0,36'5328] local-lis/les=21/22 n=944 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5326 crt=36'5326 lcod 36'5324 mlcod 36'5324 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.597 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.591+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5374 (0'0,36'5374] local-lis/les=21/22 n=990 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5374 lcod 36'5372 mlcod 36'5372 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.598 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.595+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5376 (0'0,36'5376] local-lis/les=21/22 n=988 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5374 crt=36'5374 lcod 36'5372 mlcod 36'5372 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.601 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.596+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5348 (0'0,36'5348] local-lis/les=21/22 n=925 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5347 crt=36'5343 lcod 36'5345 mlcod 36'5345 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.601 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.600+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5218 (0'0,36'5218] local-lis/les=21/22 n=890 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5218 lcod 36'5216 mlcod 36'5216 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.602 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.600+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5350 (0'0,36'5350] local-lis/les=21/22 n=923 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5347 crt=36'5347 lcod 36'5345 mlcod 36'5345 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.602 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.597+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5556 (0'0,36'5556] local-lis/les=21/22 n=989 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5555 crt=36'5551 lcod 36'5553 mlcod 36'5553 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.603 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.601+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5558 (0'0,36'5558] local-lis/les=21/22 n=987 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5555 crt=36'5555 lcod 36'5553 mlcod 36'5553 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.593+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff714005d90 con 0x7ff71c0ad380 2020-02-11T16:31:28.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.593+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7140015c0 con 0x7ff71c0ad380 2020-02-11T16:31:28.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.593+0000 7ff722c95700 1 -- 172.21.15.88:0/1135437799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c12c670 con 0x7ff71c0ad380 2020-02-11T16:31:28.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.594+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7140019a0 con 0x7ff71c0ad380 2020-02-11T16:31:28.605 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.594+0000 7ff722c95700 1 -- 172.21.15.88:0/1135437799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c12ed60 con 0x7ff71c0ad380 2020-02-11T16:31:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.594+0000 7ff720a31700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c0ad380 0x7ff71c12f4f0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7ff7100084c0 tx=0x7ff714010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.595+0000 7ff722c95700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 0x7ff71c0654c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.595+0000 7ff722c95700 1 -- 172.21.15.88:0/1135437799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c05e2f0 con 0x7ff71c12be60 2020-02-11T16:31:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.595+0000 7ff720a31700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c0ad380 0x7ff71c12f4f0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7ff7100084c0 tx=0x7ff714010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.595+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff714001b00 con 0x7ff71c0ad380 2020-02-11T16:31:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.595+0000 7ff719ffb700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff6fc039dc0 0x7ff6fc03c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.595+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 0x7ff71c0654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.595+0000 7ff721232700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff6fc039dc0 0x7ff6fc03c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.598+0000 7ff71bfff700 1 -- 172.21.15.88:0/1135437799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff71c12e5c0 con 0x7ff71c12be60 2020-02-11T16:31:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.598+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 0x7ff71c0654c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.598+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 0x7ff71c0654c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.598+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff7140499e0 con 0x7ff71c0ad380 2020-02-11T16:31:28.609 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.605+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5220 (0'0,36'5220] local-lis/les=21/22 n=888 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5218 crt=36'5218 lcod 36'5216 mlcod 36'5216 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.603+0000 7ff721232700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff6fc039dc0 0x7ff6fc03c280 crc :-1 s=READY pgs=564 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.603+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 0x7ff71c0654c0 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.604+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 0x7ff71c0654c0 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.604+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff710007960 con 0x7ff71c12be60 2020-02-11T16:31:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.604+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 0x7ff71c0654c0 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.604+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff710007340 con 0x7ff71c12be60 2020-02-11T16:31:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.604+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 msgr2=0x7ff71c0654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.604+0000 7ff719ffb700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 0x7ff71c0654c0 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).stop 2020-02-11T16:31:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.604+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 msgr2=0x7ff71c0654c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.604+0000 7ff719ffb700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c12be60 0x7ff71c0654c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.612 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.608+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5213 (0'0,36'5213] local-lis/les=21/22 n=858 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5213 lcod 36'5211 mlcod 36'5211 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.614 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.611+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5215 (0'0,36'5215] local-lis/les=21/22 n=856 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5213 crt=36'5213 lcod 36'5211 mlcod 36'5211 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.615 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.611+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5330 (0'0,36'5330] local-lis/les=21/22 n=942 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5330 lcod 36'5328 mlcod 36'5328 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.619 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.612+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5379 (0'0,36'5379] local-lis/les=21/22 n=985 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5378 crt=36'5376 lcod 36'5376 mlcod 36'5376 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.620 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.613+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5193 (0'0,36'5193] local-lis/les=21/22 n=957 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5193 lcod 36'5191 mlcod 36'5191 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.621 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.618+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5381 (0'0,36'5381] local-lis/les=21/22 n=983 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5378 crt=36'5378 lcod 36'5376 mlcod 36'5376 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.620+0000 7ff722c95700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 0x7ff71c1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.621+0000 7ff722c95700 1 -- 172.21.15.88:0/1135437799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c12fcc0 con 0x7ff71c138fd0 2020-02-11T16:31:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.621+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 0x7ff71c1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.624 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.621+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5352 (0'0,36'5352] local-lis/les=21/22 n=921 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5352 lcod 36'5350 mlcod 36'5350 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.624 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.621+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5222 (0'0,36'5222] local-lis/les=21/22 n=886 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5222 lcod 36'5220 mlcod 36'5220 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.625 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.622+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5195 (0'0,36'5195] local-lis/les=21/22 n=955 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5193 crt=36'5193 lcod 36'5191 mlcod 36'5191 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.625 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.623+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5332 (0'0,36'5332] local-lis/les=21/22 n=940 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5330 crt=36'5330 lcod 36'5328 mlcod 36'5328 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.626 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.624+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5497 (0'0,36'5497] local-lis/les=21/22 n=970 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5497 lcod 36'5495 mlcod 36'5495 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.626 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.624+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5354 (0'0,36'5354] local-lis/les=21/22 n=919 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5352 crt=36'5352 lcod 36'5350 mlcod 36'5350 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.624+0000 7ff71bfff700 1 -- 172.21.15.88:0/1135437799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff71c0565b0 con 0x7ff71c138fd0 2020-02-11T16:31:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.624+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 0x7ff71c1393e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.628 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.625+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5224 (0'0,36'5224] local-lis/les=21/22 n=884 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5222 crt=36'5222 lcod 36'5220 mlcod 36'5220 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.632 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.628+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5560 (0'0,36'5560] local-lis/les=21/22 n=985 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5560 lcod 36'5558 mlcod 36'5558 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.632 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.627+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5499 (0'0,36'5499] local-lis/les=21/22 n=968 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5497 crt=36'5497 lcod 36'5495 mlcod 36'5495 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.627+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 0x7ff71c1393e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.627+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 0x7ff71c1393e0 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.628+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 0x7ff71c1393e0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.628+0000 7ff71bfff700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 0x7ff71c1393e0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.629+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff71000e8d0 con 0x7ff71c138fd0 2020-02-11T16:31:28.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.629+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4363 (secure 0 0 0) 0x7ff71000ea30 con 0x7ff71c138fd0 2020-02-11T16:31:28.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.629+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 msgr2=0x7ff71c1393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.633 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.629+0000 7ff719ffb700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 0x7ff71c1393e0 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).stop 2020-02-11T16:31:28.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.629+0000 7ff719ffb700 1 -- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 msgr2=0x7ff71c1393e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:28.634 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.629+0000 7ff719ffb700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff71c138fd0 0x7ff71c1393e0 secure :-1 s=CLOSED pgs=480 cs=0 l=1 rx=0x7ff7100082e0 tx=0x7ff710011510).stop 2020-02-11T16:31:28.634 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.631+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5217 (0'0,36'5217] local-lis/les=21/22 n=854 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5217 lcod 36'5215 mlcod 36'5215 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.635 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.632+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5562 (0'0,36'5562] local-lis/les=21/22 n=983 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5560 crt=36'5560 lcod 36'5558 mlcod 36'5558 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.635 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:31:28.635 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:31:28.635 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:31:28.635 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:31:28.635 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 216, 2020-02-11T16:31:28.636 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:31:28.636 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:31:28.636 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:31:28.636 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:31:28.636 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.636 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:31:28.636 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:28.637 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:31:28.637 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:31:28.637 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:28.637 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:28.637 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:28.637 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:28.637 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:28.638 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:28.638 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.638 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:31:28.638 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:31:28.638 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:28.639 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:28.639 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:28.639 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:28.639 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:28.639 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:28.639 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:31:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:31:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:31:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:31:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:31:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:31:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:31:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:31:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:31:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:31:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:31:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:31:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:31:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:31:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:31:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:31:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:31:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:31:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:31:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:31:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:31:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:31:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:31:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:31:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:31:28.652 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:28.652 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:28.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.652 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.652 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:31:28.652 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:31:28.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.653 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:28.653 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:28.653 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:28.653 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.653 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.653 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:31:28.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.654 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:28.654 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:28.654 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:28.654 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.654 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.654 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:31:28.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.655 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:28.655 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:28.655 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2020-02-11T16:31:28.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.655 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.655 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:31:28.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.656 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:28.656 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:28.656 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:31:28.656 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.656 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.656 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:31:28.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.657 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:28.657 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:28.657 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:31:28.657 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.657 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.657 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.658 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:31:28.660 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.641+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5334 (0'0,36'5334] local-lis/les=21/22 n=938 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5334 lcod 36'5332 mlcod 36'5332 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.661 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.652+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5336 (0'0,36'5336] local-lis/les=21/22 n=936 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5334 crt=36'5334 lcod 36'5332 mlcod 36'5332 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.661 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.650+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5226 (0'0,36'5226] local-lis/les=21/22 n=882 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5226 lcod 36'5224 mlcod 36'5224 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.661 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.635+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5219 (0'0,36'5219] local-lis/les=21/22 n=852 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5217 crt=36'5217 lcod 36'5215 mlcod 36'5215 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.661 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.649+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5221 (0'0,36'5221] local-lis/les=21/22 n=850 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5221 lcod 36'5219 mlcod 36'5219 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.661 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.651+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5564 (0'0,36'5564] local-lis/les=21/22 n=981 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5564 lcod 36'5562 mlcod 36'5562 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.661 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.653+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5223 (0'0,36'5223] local-lis/les=21/22 n=848 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5221 crt=36'5221 lcod 36'5219 mlcod 36'5219 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.662 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.657+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5566 (0'0,36'5566] local-lis/les=21/22 n=979 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5564 crt=36'5564 lcod 36'5562 mlcod 36'5562 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.662 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.638+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5197 (0'0,36'5197] local-lis/les=21/22 n=953 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5197 lcod 36'5195 mlcod 36'5195 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.662 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.641+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5199 (0'0,36'5199] local-lis/les=21/22 n=951 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5197 crt=36'5197 lcod 36'5195 mlcod 36'5195 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.662 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.649+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5356 (0'0,36'5356] local-lis/les=21/22 n=917 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5356 lcod 36'5354 mlcod 36'5354 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.662 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.653+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5358 (0'0,36'5358] local-lis/les=21/22 n=915 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5356 crt=36'5356 lcod 36'5354 mlcod 36'5354 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.662 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.641+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5384 (0'0,36'5384] local-lis/les=21/22 n=980 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5383 crt=36'5379 lcod 36'5381 mlcod 36'5381 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.663 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.645+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5386 (0'0,36'5386] local-lis/les=21/22 n=978 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5383 crt=36'5383 lcod 36'5381 mlcod 36'5381 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.641+0000 7ff722c95700 1 -- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff6fc039dc0 msgr2=0x7ff6fc03c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.641+0000 7ff722c95700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff6fc039dc0 0x7ff6fc03c280 crc :-1 s=READY pgs=564 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.641+0000 7ff721232700 1 -- 172.21.15.88:0/1135437799 reap_dead start 2020-02-11T16:31:28.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.641+0000 7ff722c95700 1 -- 172.21.15.88:0/1135437799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c0ad380 msgr2=0x7ff71c12f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.641+0000 7ff722c95700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c0ad380 0x7ff71c12f4f0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7ff7100084c0 tx=0x7ff714010bb0).stop 2020-02-11T16:31:28.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.645+0000 7ff722c95700 1 -- 172.21.15.88:0/1135437799 shutdown_connections 2020-02-11T16:31:28.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.645+0000 7ff722c95700 1 --2- 172.21.15.88:0/1135437799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff71c0ad380 0x7ff71c12f4f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.645+0000 7ff722c95700 1 -- 172.21.15.88:0/1135437799 >> 172.21.15.88:0/1135437799 conn(0x7ff71c05ac70 msgr2=0x7ff71c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:28.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.645+0000 7ff722c95700 1 -- 172.21.15.88:0/1135437799 shutdown_connections 2020-02-11T16:31:28.664 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.645+0000 7ff722c95700 1 -- 172.21.15.88:0/1135437799 wait complete. 2020-02-11T16:31:28.665 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.662+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5228 (0'0,36'5228] local-lis/les=21/22 n=880 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5226 crt=36'5226 lcod 36'5224 mlcod 36'5224 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.666 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:31:28.667 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.665+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5388 (0'0,36'5388] local-lis/les=21/22 n=976 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5388 lcod 36'5386 mlcod 36'5386 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.667 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.665+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5501 (0'0,36'5501] local-lis/les=21/22 n=966 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5501 lcod 36'5499 mlcod 36'5499 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.671 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.670+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5338 (0'0,36'5338] local-lis/les=21/22 n=934 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5338 lcod 36'5336 mlcod 36'5336 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.675 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.669+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5225 (0'0,36'5225] local-lis/les=21/22 n=846 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5225 lcod 36'5223 mlcod 36'5223 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.675 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.668+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5503 (0'0,36'5503] local-lis/les=21/22 n=964 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5501 crt=36'5501 lcod 36'5499 mlcod 36'5499 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.675 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.671+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5390 (0'0,36'5390] local-lis/les=21/22 n=974 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5388 crt=36'5388 lcod 36'5386 mlcod 36'5386 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.676 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.674+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5340 (0'0,36'5340] local-lis/les=21/22 n=932 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5338 crt=36'5338 lcod 36'5336 mlcod 36'5336 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.677 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.674+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5230 (0'0,36'5230] local-lis/les=21/22 n=878 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5230 lcod 36'5228 mlcod 36'5228 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.678 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.673+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5227 (0'0,36'5227] local-lis/les=21/22 n=844 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5225 crt=36'5225 lcod 36'5223 mlcod 36'5223 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.681 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.680+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5232 (0'0,36'5232] local-lis/les=21/22 n=876 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5230 crt=36'5230 lcod 36'5228 mlcod 36'5228 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.684 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.682+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5202 (0'0,36'5202] local-lis/les=21/22 n=948 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5202 lcod 36'5201 mlcod 36'5201 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.688 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.685+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5230 (0'0,36'5230] local-lis/les=21/22 n=841 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5230 lcod 36'5229 mlcod 36'5229 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.688 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.685+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5204 (0'0,36'5204] local-lis/les=21/22 n=946 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5202 crt=36'5202 lcod 36'5201 mlcod 36'5201 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.689 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.686+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5360 (0'0,36'5360] local-lis/les=21/22 n=913 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5360 lcod 36'5358 mlcod 36'5358 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.691 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.688+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5342 (0'0,36'5342] local-lis/les=21/22 n=930 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5342 lcod 36'5340 mlcod 36'5340 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.694 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.692+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5344 (0'0,36'5344] local-lis/les=21/22 n=928 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5342 crt=36'5342 lcod 36'5340 mlcod 36'5340 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.694 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.692+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5232 (0'0,36'5232] local-lis/les=21/22 n=839 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5230 crt=36'5230 lcod 36'5229 mlcod 36'5229 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.695 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.693+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5362 (0'0,36'5362] local-lis/les=21/22 n=911 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5360 crt=36'5360 lcod 36'5358 mlcod 36'5358 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.696 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.693+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5569 (0'0,36'5569] local-lis/les=21/22 n=976 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5569 lcod 36'5568 mlcod 36'5568 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.700 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.697+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5571 (0'0,36'5571] local-lis/les=21/22 n=974 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5569 crt=36'5569 lcod 36'5568 mlcod 36'5568 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.700 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.698+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5392 (0'0,36'5392] local-lis/les=21/22 n=972 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5392 lcod 36'5390 mlcod 36'5390 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.701 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.699+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5506 (0'0,36'5506] local-lis/les=21/22 n=961 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5505 crt=36'5505 lcod 36'5503 mlcod 36'5503 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.705 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.702+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5508 (0'0,36'5508] local-lis/les=21/22 n=959 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5505 crt=36'5505 lcod 36'5503 mlcod 36'5503 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.705 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.701+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5235 (0'0,36'5235] local-lis/les=21/22 n=873 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5234 crt=36'5230 lcod 36'5232 mlcod 36'5232 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.709 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.707+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5237 (0'0,36'5237] local-lis/les=21/22 n=871 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5234 crt=36'5234 lcod 36'5232 mlcod 36'5232 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.711 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.708+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5364 (0'0,36'5364] local-lis/les=21/22 n=909 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5364 lcod 36'5362 mlcod 36'5362 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.715 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.712+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5366 (0'0,36'5366] local-lis/les=21/22 n=907 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5364 crt=36'5364 lcod 36'5362 mlcod 36'5362 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.717 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.715+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5394 (0'0,36'5394] local-lis/les=21/22 n=970 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5394 lcod 36'5392 mlcod 36'5392 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.721 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.716+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5234 (0'0,36'5234] local-lis/les=21/22 n=837 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5234 lcod 36'5232 mlcod 36'5232 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.721 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.716+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5206 (0'0,36'5206] local-lis/les=21/22 n=944 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5206 lcod 36'5204 mlcod 36'5204 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.723 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.720+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5208 (0'0,36'5208] local-lis/les=21/22 n=942 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5206 crt=36'5206 lcod 36'5204 mlcod 36'5204 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.724 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.721+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5396 (0'0,36'5396] local-lis/les=21/22 n=968 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5394 crt=36'5394 lcod 36'5392 mlcod 36'5392 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.725 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.723+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5236 (0'0,36'5236] local-lis/les=21/22 n=835 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5234 crt=36'5234 lcod 36'5232 mlcod 36'5232 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.726 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.724+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5239 (0'0,36'5239] local-lis/les=21/22 n=869 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5239 lcod 36'5237 mlcod 36'5237 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.727 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.724+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5511 (0'0,36'5511] local-lis/les=21/22 n=956 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5510 crt=36'5505 lcod 36'5508 mlcod 36'5508 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.727 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.725+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5346 (0'0,36'5346] local-lis/les=21/22 n=926 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5346 lcod 36'5344 mlcod 36'5344 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.730 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.727+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5513 (0'0,36'5513] local-lis/les=21/22 n=954 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5510 crt=36'5510 lcod 36'5508 mlcod 36'5508 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.732 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.729+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5348 (0'0,36'5348] local-lis/les=21/22 n=924 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5346 crt=36'5346 lcod 36'5344 mlcod 36'5344 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.735 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.733+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5574 (0'0,36'5574] local-lis/les=21/22 n=971 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5573 crt=36'5571 lcod 36'5571 mlcod 36'5571 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.737 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.732+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5241 (0'0,36'5241] local-lis/les=21/22 n=867 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5239 crt=36'5239 lcod 36'5237 mlcod 36'5237 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.738 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.736+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5238 (0'0,36'5238] local-lis/les=21/22 n=833 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5238 lcod 36'5236 mlcod 36'5236 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.738 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.736+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5576 (0'0,36'5576] local-lis/les=21/22 n=969 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5573 crt=36'5573 lcod 36'5571 mlcod 36'5571 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.744 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.741+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5368 (0'0,36'5368] local-lis/les=21/22 n=905 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5368 lcod 36'5366 mlcod 36'5366 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.745 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.742+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5240 (0'0,36'5240] local-lis/les=21/22 n=831 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5238 crt=36'5238 lcod 36'5236 mlcod 36'5236 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.746 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.743+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5515 (0'0,36'5515] local-lis/les=21/22 n=952 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5515 lcod 36'5513 mlcod 36'5513 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.748 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.745+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5370 (0'0,36'5370] local-lis/les=21/22 n=903 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5368 crt=36'5368 lcod 36'5366 mlcod 36'5366 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.752 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.747+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5517 (0'0,36'5517] local-lis/les=21/22 n=950 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5515 crt=36'5515 lcod 36'5513 mlcod 36'5513 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.755 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.751+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5210 (0'0,36'5210] local-lis/les=21/22 n=940 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5210 lcod 36'5208 mlcod 36'5208 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.756 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.744+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5243 (0'0,36'5243] local-lis/les=21/22 n=865 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5243 lcod 36'5241 mlcod 36'5241 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.757 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.748+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5245 (0'0,36'5245] local-lis/les=21/22 n=863 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5243 crt=36'5243 lcod 36'5241 mlcod 36'5241 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.757 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.754+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5212 (0'0,36'5212] local-lis/les=21/22 n=938 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5210 crt=36'5210 lcod 36'5208 mlcod 36'5208 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.758 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.756+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5398 (0'0,36'5398] local-lis/les=21/22 n=966 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5398 lcod 36'5396 mlcod 36'5396 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.759 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.756+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5578 (0'0,36'5578] local-lis/les=21/22 n=967 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5578 lcod 36'5576 mlcod 36'5576 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.759 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.753+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5350 (0'0,36'5350] local-lis/les=21/22 n=922 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5350 lcod 36'5348 mlcod 36'5348 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.761 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.759+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5352 (0'0,36'5352] local-lis/les=21/22 n=920 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5350 crt=36'5350 lcod 36'5348 mlcod 36'5348 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.762 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.760+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5400 (0'0,36'5400] local-lis/les=21/22 n=964 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5398 crt=36'5398 lcod 36'5396 mlcod 36'5396 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.768 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.764+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5519 (0'0,36'5519] local-lis/les=21/22 n=948 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5519 lcod 36'5517 mlcod 36'5517 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.769 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.766+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5247 (0'0,36'5247] local-lis/les=21/22 n=861 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5247 lcod 36'5245 mlcod 36'5245 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.771 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.769+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5249 (0'0,36'5249] local-lis/les=21/22 n=859 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5247 crt=36'5247 lcod 36'5245 mlcod 36'5245 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.774 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.768+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5521 (0'0,36'5521] local-lis/les=21/22 n=946 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5519 crt=36'5519 lcod 36'5517 mlcod 36'5517 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.774 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.766+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5373 (0'0,36'5373] local-lis/les=21/22 n=900 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5373 lcod 36'5372 mlcod 36'5372 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.774 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.769+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5375 (0'0,36'5375] local-lis/les=21/22 n=898 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5373 crt=36'5373 lcod 36'5372 mlcod 36'5372 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.775 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.768+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5580 (0'0,36'5580] local-lis/les=21/22 n=965 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5578 crt=36'5578 lcod 36'5576 mlcod 36'5576 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.775 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.768+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5243 (0'0,36'5243] local-lis/les=21/22 n=828 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5242 crt=36'5238 lcod 36'5240 mlcod 36'5240 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.776 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.771+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5245 (0'0,36'5245] local-lis/les=21/22 n=826 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5242 crt=36'5242 lcod 36'5240 mlcod 36'5240 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.778 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.776+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5402 (0'0,36'5402] local-lis/les=21/22 n=962 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5402 lcod 36'5400 mlcod 36'5400 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.779 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.775+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5214 (0'0,36'5214] local-lis/les=21/22 n=936 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5214 lcod 36'5212 mlcod 36'5212 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.782 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.779+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5404 (0'0,36'5404] local-lis/les=21/22 n=960 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5402 crt=36'5402 lcod 36'5400 mlcod 36'5400 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.783 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.781+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5354 (0'0,36'5354] local-lis/les=21/22 n=918 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5354 lcod 36'5352 mlcod 36'5352 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.785 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.780+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5216 (0'0,36'5216] local-lis/les=21/22 n=934 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5214 crt=36'5214 lcod 36'5212 mlcod 36'5212 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.788 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.787+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5356 (0'0,36'5356] local-lis/les=21/22 n=916 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5354 crt=36'5354 lcod 36'5352 mlcod 36'5352 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.789 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.787+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5582 (0'0,36'5582] local-lis/les=21/22 n=963 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5582 lcod 36'5580 mlcod 36'5580 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.792 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.789+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5251 (0'0,36'5251] local-lis/les=21/22 n=857 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5251 lcod 36'5249 mlcod 36'5249 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.795 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.792+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5253 (0'0,36'5253] local-lis/les=21/22 n=855 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5251 crt=36'5251 lcod 36'5249 mlcod 36'5249 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.796 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.791+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5584 (0'0,36'5584] local-lis/les=21/22 n=961 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5582 crt=36'5582 lcod 36'5580 mlcod 36'5580 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.800 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.798+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5219 (0'0,36'5219] local-lis/les=21/22 n=931 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5218 crt=36'5214 lcod 36'5216 mlcod 36'5216 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.801 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.796+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5523 (0'0,36'5523] local-lis/les=21/22 n=944 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5523 lcod 36'5521 mlcod 36'5521 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.802 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.797+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5406 (0'0,36'5406] local-lis/les=21/22 n=958 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5406 lcod 36'5404 mlcod 36'5404 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.802 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.800+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5525 (0'0,36'5525] local-lis/les=21/22 n=942 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5523 crt=36'5523 lcod 36'5521 mlcod 36'5521 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.806 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.801+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5248 (0'0,36'5248] local-lis/les=21/22 n=823 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5247 crt=36'5245 lcod 36'5245 mlcod 36'5245 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.807 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.804+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5221 (0'0,36'5221] local-lis/les=21/22 n=929 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5218 crt=36'5218 lcod 36'5216 mlcod 36'5216 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.808 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.805+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5377 (0'0,36'5377] local-lis/les=21/22 n=896 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5377 lcod 36'5375 mlcod 36'5375 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.809 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.807+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5408 (0'0,36'5408] local-lis/les=21/22 n=956 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5406 crt=36'5406 lcod 36'5404 mlcod 36'5404 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.813 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.810+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5379 (0'0,36'5379] local-lis/les=21/22 n=894 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5377 crt=36'5377 lcod 36'5375 mlcod 36'5375 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.814 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.812+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5255 (0'0,36'5255] local-lis/les=21/22 n=853 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5255 lcod 36'5253 mlcod 36'5253 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.814 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.809+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5250 (0'0,36'5250] local-lis/les=21/22 n=821 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5247 crt=36'5247 lcod 36'5245 mlcod 36'5245 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.819 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.816+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5586 (0'0,36'5586] local-lis/les=21/22 n=959 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5586 lcod 36'5584 mlcod 36'5584 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.821 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.813+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5358 (0'0,36'5358] local-lis/les=21/22 n=914 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5358 lcod 36'5356 mlcod 36'5356 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.821 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.816+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5257 (0'0,36'5257] local-lis/les=21/22 n=851 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5255 crt=36'5255 lcod 36'5253 mlcod 36'5253 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.822 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.817+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5360 (0'0,36'5360] local-lis/les=21/22 n=912 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5358 crt=36'5358 lcod 36'5356 mlcod 36'5356 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.825 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.821+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5411 (0'0,36'5411] local-lis/les=21/22 n=953 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5410 crt=36'5408 lcod 36'5408 mlcod 36'5408 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.828 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.824+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5413 (0'0,36'5413] local-lis/les=21/22 n=951 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5410 crt=36'5410 lcod 36'5408 mlcod 36'5408 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.830 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.818+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5223 (0'0,36'5223] local-lis/les=21/22 n=927 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5223 lcod 36'5221 mlcod 36'5221 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.835 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.822+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5225 (0'0,36'5225] local-lis/les=21/22 n=925 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5223 crt=36'5223 lcod 36'5221 mlcod 36'5221 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.835 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.834+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5259 (0'0,36'5259] local-lis/les=21/22 n=849 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5259 lcod 36'5257 mlcod 36'5257 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.837 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.831+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5252 (0'0,36'5252] local-lis/les=21/22 n=819 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5252 lcod 36'5250 mlcod 36'5250 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.837 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.834+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5588 (0'0,36'5588] local-lis/les=21/22 n=957 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5588 lcod 36'5586 mlcod 36'5586 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.837 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.830+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5381 (0'0,36'5381] local-lis/les=21/22 n=892 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5381 lcod 36'5379 mlcod 36'5379 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.838 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.836+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5254 (0'0,36'5254] local-lis/les=21/22 n=817 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5252 crt=36'5252 lcod 36'5250 mlcod 36'5250 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.840 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.832+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5227 (0'0,36'5227] local-lis/les=21/22 n=923 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5227 lcod 36'5225 mlcod 36'5225 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.840 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.838+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5590 (0'0,36'5590] local-lis/les=21/22 n=955 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5588 crt=36'5588 lcod 36'5586 mlcod 36'5586 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.841 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.837+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5229 (0'0,36'5229] local-lis/les=21/22 n=921 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5227 crt=36'5227 lcod 36'5225 mlcod 36'5225 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.844 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.840+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5261 (0'0,36'5261] local-lis/les=21/22 n=847 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5259 crt=36'5259 lcod 36'5257 mlcod 36'5257 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.845 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.843+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5362 (0'0,36'5362] local-lis/les=21/22 n=910 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5362 lcod 36'5360 mlcod 36'5360 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.849 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.844+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5527 (0'0,36'5527] local-lis/les=21/22 n=940 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5527 lcod 36'5525 mlcod 36'5525 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.850 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.847+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5415 (0'0,36'5415] local-lis/les=21/22 n=949 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5415 lcod 36'5413 mlcod 36'5413 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.851 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.847+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5383 (0'0,36'5383] local-lis/les=21/22 n=890 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5381 crt=36'5381 lcod 36'5379 mlcod 36'5379 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.853 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.848+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5529 (0'0,36'5529] local-lis/les=21/22 n=938 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5527 crt=36'5527 lcod 36'5525 mlcod 36'5525 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.854 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.847+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5364 (0'0,36'5364] local-lis/les=21/22 n=908 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5362 crt=36'5362 lcod 36'5360 mlcod 36'5360 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.854 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.851+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5417 (0'0,36'5417] local-lis/les=21/22 n=947 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5415 crt=36'5415 lcod 36'5413 mlcod 36'5413 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.860 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.857+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5256 (0'0,36'5256] local-lis/les=21/22 n=815 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5256 lcod 36'5254 mlcod 36'5254 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.863 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.857+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5231 (0'0,36'5231] local-lis/les=21/22 n=919 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5231 lcod 36'5229 mlcod 36'5229 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.863 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.857+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5385 (0'0,36'5385] local-lis/les=21/22 n=888 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5385 lcod 36'5383 mlcod 36'5383 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.864 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.861+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5258 (0'0,36'5258] local-lis/les=21/22 n=813 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5256 crt=36'5256 lcod 36'5254 mlcod 36'5254 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.864 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.861+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5387 (0'0,36'5387] local-lis/les=21/22 n=886 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5385 crt=36'5385 lcod 36'5383 mlcod 36'5383 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.864 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.861+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5233 (0'0,36'5233] local-lis/les=21/22 n=917 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5231 crt=36'5231 lcod 36'5229 mlcod 36'5229 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.866 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.858+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5366 (0'0,36'5366] local-lis/les=21/22 n=906 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5366 lcod 36'5364 mlcod 36'5364 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.870 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.867+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5532 (0'0,36'5532] local-lis/les=21/22 n=935 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5531 crt=36'5527 lcod 36'5529 mlcod 36'5529 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.870 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.861+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5368 (0'0,36'5368] local-lis/les=21/22 n=904 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5366 crt=36'5366 lcod 36'5364 mlcod 36'5364 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.874 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.870+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5592 (0'0,36'5592] local-lis/les=21/22 n=953 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5592 lcod 36'5590 mlcod 36'5590 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.874 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.871+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5534 (0'0,36'5534] local-lis/les=21/22 n=933 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5531 crt=36'5531 lcod 36'5529 mlcod 36'5529 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.876 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.874+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5594 (0'0,36'5594] local-lis/les=21/22 n=951 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5592 crt=36'5592 lcod 36'5590 mlcod 36'5590 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.877 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.875+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5235 (0'0,36'5235] local-lis/les=21/22 n=915 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5235 lcod 36'5233 mlcod 36'5233 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.880 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.872+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5264 (0'0,36'5264] local-lis/les=21/22 n=844 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5263 crt=36'5261 lcod 36'5261 mlcod 36'5261 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.882 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.872+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5419 (0'0,36'5419] local-lis/les=21/22 n=945 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5419 lcod 36'5417 mlcod 36'5417 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.882 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.876+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5421 (0'0,36'5421] local-lis/les=21/22 n=943 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5419 crt=36'5419 lcod 36'5417 mlcod 36'5417 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.883 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.879+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5266 (0'0,36'5266] local-lis/les=21/22 n=842 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5263 crt=36'5263 lcod 36'5261 mlcod 36'5261 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.885 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.881+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5389 (0'0,36'5389] local-lis/les=21/22 n=884 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5389 lcod 36'5387 mlcod 36'5387 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.886 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.883+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5237 (0'0,36'5237] local-lis/les=21/22 n=913 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5235 crt=36'5235 lcod 36'5233 mlcod 36'5233 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.889 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.886+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5391 (0'0,36'5391] local-lis/les=21/22 n=882 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5389 crt=36'5389 lcod 36'5387 mlcod 36'5387 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.890 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.888+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5260 (0'0,36'5260] local-lis/les=21/22 n=811 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5260 lcod 36'5258 mlcod 36'5258 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.894 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.891+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5240 (0'0,36'5240] local-lis/les=21/22 n=910 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5239 crt=36'5237 lcod 36'5237 mlcod 36'5237 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.894 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.891+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5370 (0'0,36'5370] local-lis/les=21/22 n=902 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5370 lcod 36'5368 mlcod 36'5368 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.897 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.895+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5596 (0'0,36'5596] local-lis/les=21/22 n=949 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5596 lcod 36'5594 mlcod 36'5594 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.898 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.896+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5262 (0'0,36'5262] local-lis/les=21/22 n=809 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5260 crt=36'5260 lcod 36'5258 mlcod 36'5258 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.899 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.897+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5536 (0'0,36'5536] local-lis/les=21/22 n=931 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5536 lcod 36'5534 mlcod 36'5534 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.900 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.898+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5372 (0'0,36'5372] local-lis/les=21/22 n=900 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5370 crt=36'5370 lcod 36'5368 mlcod 36'5368 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.902 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.898+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5268 (0'0,36'5268] local-lis/les=21/22 n=840 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5268 lcod 36'5266 mlcod 36'5266 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.904 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.900+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5538 (0'0,36'5538] local-lis/les=21/22 n=929 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5536 crt=36'5536 lcod 36'5534 mlcod 36'5534 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.905 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.903+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5242 (0'0,36'5242] local-lis/les=21/22 n=908 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5239 crt=36'5239 lcod 36'5237 mlcod 36'5237 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.906 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.903+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5598 (0'0,36'5598] local-lis/les=21/22 n=947 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5596 crt=36'5596 lcod 36'5594 mlcod 36'5594 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.902+0000 7ff6bab93700 1 Processor -- start 2020-02-11T16:31:28.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.902+0000 7ff6bab93700 1 -- start start 2020-02-11T16:31:28.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.902+0000 7ff6bab93700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6b40a6ae0 0x7ff6b4144e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:28.910 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.902+0000 7ff6bab93700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40a7090 con 0x7ff6b40a6280 2020-02-11T16:31:28.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.902+0000 7ff6bab93700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40a2550 con 0x7ff6b41452b0 2020-02-11T16:31:28.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.902+0000 7ff6bab93700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b40a2360 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.911 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.903+0000 7ff6b9130700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff6b41452b0 0x7ff6b4145740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48860/0 (socket says 172.21.15.88:48860) 2020-02-11T16:31:28.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.903+0000 7ff6b9130700 1 -- 172.21.15.88:0/541462815 learned_addr learned my addr 172.21.15.88:0/541462815 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:28.913 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.903+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/541462815 >> v2:172.21.15.88:3300/0 conn(0x7ff6b40a6ae0 0x7ff6b4144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.913 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.907+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5393 (0'0,36'5393] local-lis/les=21/22 n=880 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5393 lcod 36'5391 mlcod 36'5391 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.914 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.906+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5270 (0'0,36'5270] local-lis/les=21/22 n=838 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5268 crt=36'5268 lcod 36'5266 mlcod 36'5266 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.915 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.910+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5264 (0'0,36'5264] local-lis/les=21/22 n=807 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5264 lcod 36'5262 mlcod 36'5262 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.915 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.907+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5424 (0'0,36'5424] local-lis/les=21/22 n=940 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5424 lcod 36'5423 mlcod 36'5423 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.916 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.910+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5395 (0'0,36'5395] local-lis/les=21/22 n=878 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5393 crt=36'5393 lcod 36'5391 mlcod 36'5391 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.903+0000 7ff6b3fff700 1 -- 172.21.15.88:0/541462815 >> v1:172.21.15.88:6789/0 conn(0x7ff6b41452b0 legacy=0x7ff6b4145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b3fff700 1 -- 172.21.15.88:0/541462815 >> v1:172.21.15.52:6789/0 conn(0x7ff6b40a6280 legacy=0x7ff6b40a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b3fff700 1 -- 172.21.15.88:0/541462815 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40a7490 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/541462815 >> v2:172.21.15.88:3300/0 conn(0x7ff6b40a6ae0 0x7ff6b4144e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff6a80010d0 tx=0x7ff6a00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.903+0000 7ff6b37fe700 1 -- 172.21.15.88:0/541462815 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008012632 0 0) 0x7ff6b40a2550 con 0x7ff6b41452b0 2020-02-11T16:31:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/541462815 >> v2:172.21.15.88:3300/0 conn(0x7ff6b40a6ae0 0x7ff6b4144e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff6a80010d0 tx=0x7ff6a00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/541462815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4144e50 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7ff6a80010d0 tx=0x7ff6a00088e0).ready entity=mon.1 client_cookie=503b964baf236d38 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/541462815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4144e50 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7ff6a80010d0 tx=0x7ff6a00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/541462815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4144e50 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7ff6a80010d0 tx=0x7ff6a00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b37fe700 1 -- 172.21.15.88:0/541462815 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6a0010b10 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/541462815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4144e50 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7ff6a80010d0 tx=0x7ff6a00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b37fe700 1 -- 172.21.15.88:0/541462815 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0010c70 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.910+0000 7ff6b37fe700 1 -- 172.21.15.88:0/541462815 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6a0011430 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.911+0000 7ff6bab93700 1 -- 172.21.15.88:0/541462815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 msgr2=0x7ff6b4144e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.911+0000 7ff6bab93700 1 --2- 172.21.15.88:0/541462815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4144e50 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7ff6a80010d0 tx=0x7ff6a00088e0).stop 2020-02-11T16:31:28.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.911+0000 7ff6bab93700 1 -- 172.21.15.88:0/541462815 shutdown_connections 2020-02-11T16:31:28.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.911+0000 7ff6bab93700 1 --2- 172.21.15.88:0/541462815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4144e50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.911+0000 7ff6bab93700 1 -- 172.21.15.88:0/541462815 >> 172.21.15.88:0/541462815 conn(0x7ff6b409d110 msgr2=0x7ff6b409d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:28.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.912+0000 7ff6bab93700 1 -- 172.21.15.88:0/541462815 shutdown_connections 2020-02-11T16:31:28.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.912+0000 7ff6bab93700 1 -- 172.21.15.88:0/541462815 wait complete. 2020-02-11T16:31:28.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.913+0000 7ff6bab93700 1 Processor -- start 2020-02-11T16:31:28.920 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.911+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5426 (0'0,36'5426] local-lis/les=21/22 n=938 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5424 crt=36'5424 lcod 36'5423 mlcod 36'5423 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.920 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.914+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5266 (0'0,36'5266] local-lis/les=21/22 n=805 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5264 crt=36'5264 lcod 36'5262 mlcod 36'5262 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.914+0000 7ff6bab93700 1 -- start start 2020-02-11T16:31:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.915+0000 7ff6bab93700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6b40a6ae0 0x7ff6b4145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.915+0000 7ff6bab93700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b41452b0 0x7ff6b407e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.915+0000 7ff6bab93700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b4062640 con 0x7ff6b40a6280 2020-02-11T16:31:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.915+0000 7ff6bab93700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b40628e0 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.915+0000 7ff6bab93700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4065510 con 0x7ff6b41452b0 2020-02-11T16:31:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6b40a6ae0 0x7ff6b4145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6b40a6ae0 0x7ff6b4145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33008/0 (socket says 172.21.15.88:33008) 2020-02-11T16:31:28.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 -- 172.21.15.88:0/587323954 learned_addr learned my addr 172.21.15.88:0/587323954 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:28.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 -- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b41452b0 msgr2=0x7ff6b407e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b41452b0 0x7ff6b407e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 -- 172.21.15.88:0/587323954 >> v1:172.21.15.52:6789/0 conn(0x7ff6b40a6280 legacy=0x7ff6b4062d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 -- 172.21.15.88:0/587323954 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40a9070 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/587323954 >> v2:172.21.15.88:3300/0 conn(0x7ff6b40a6ae0 0x7ff6b4145c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6b40a5d60 tx=0x7ff6b40a7620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/587323954 >> v2:172.21.15.88:3300/0 conn(0x7ff6b40a6ae0 0x7ff6b4145c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6b40a5d60 tx=0x7ff6b40a7620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4145c50 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7ff6b40a5d60 tx=0x7ff6b40a7620).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4145c50 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7ff6b40a5d60 tx=0x7ff6b40a7620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4145c50 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7ff6b40a5d60 tx=0x7ff6b40a7620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4145c50 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7ff6b40a5d60 tx=0x7ff6b40a7620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.916+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6a0008b40 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.917+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0008ca0 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.917+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6a00058b0 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.924 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.918+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5540 (0'0,36'5540] local-lis/les=21/22 n=927 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5540 lcod 36'5538 mlcod 36'5538 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.926 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.923+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5398 (0'0,36'5398] local-lis/les=21/22 n=875 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5397 crt=36'5393 lcod 36'5395 mlcod 36'5395 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.926 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.922+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5542 (0'0,36'5542] local-lis/les=21/22 n=925 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5540 crt=36'5540 lcod 36'5538 mlcod 36'5538 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.922+0000 7ff6bab93700 1 -- 172.21.15.88:0/587323954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b4066050 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.922+0000 7ff6bab93700 1 -- 172.21.15.88:0/587323954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b4063490 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.922+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4145c50 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7ff6b40a5d60 tx=0x7ff6b40a7620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.923+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff6a0005b20 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.923+0000 7ff6b3fff700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4145c50 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7ff6b40a5d60 tx=0x7ff6b40a7620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.923+0000 7ff6b1ffb700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff69c039d00 0x7ff69c03c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.923+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff6a0049f80 con 0x7ff6b40a6ae0 2020-02-11T16:31:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.924+0000 7ff6bab93700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 0x7ff6b4069d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.924+0000 7ff6bab93700 1 -- 172.21.15.88:0/587323954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b405e2f0 con 0x7ff6b407e8e0 2020-02-11T16:31:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.925+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 0x7ff6b4069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.925+0000 7ff6b892f700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff69c039d00 0x7ff69c03c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.925+0000 7ff6b9130700 1 -- 172.21.15.88:0/587323954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b4065e90 con 0x7ff6b407e8e0 2020-02-11T16:31:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.925+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 0x7ff6b4069d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.925+0000 7ff6b892f700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff69c039d00 0x7ff69c03c1c0 crc :-1 s=READY pgs=565 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.925+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 0x7ff6b4069d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.925+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 0x7ff6b4069d30 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.931 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.926+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5374 (0'0,36'5374] local-lis/les=21/22 n=898 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5374 lcod 36'5372 mlcod 36'5372 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.931 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.928+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5272 (0'0,36'5272] local-lis/les=21/22 n=836 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5272 lcod 36'5270 mlcod 36'5270 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.926+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 0x7ff6b4069d30 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.926+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 0x7ff6b4069d30 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.927+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6ac012400 con 0x7ff6b407e8e0 2020-02-11T16:31:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.927+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7ff6ac0125a0 con 0x7ff6b407e8e0 2020-02-11T16:31:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.927+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 msgr2=0x7ff6b4069d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.927+0000 7ff6b1ffb700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 0x7ff6b4069d30 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).stop 2020-02-11T16:31:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.927+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 msgr2=0x7ff6b4069d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.927+0000 7ff6b1ffb700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b407e8e0 0x7ff6b4069d30 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).stop 2020-02-11T16:31:28.933 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.925+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5601 (0'0,36'5601] local-lis/les=21/22 n=944 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5600 crt=36'5596 lcod 36'5598 mlcod 36'5598 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.933 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.927+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5244 (0'0,36'5244] local-lis/les=21/22 n=906 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5244 lcod 36'5242 mlcod 36'5242 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.933 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.927+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5400 (0'0,36'5400] local-lis/les=21/22 n=873 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5397 crt=36'5397 lcod 36'5395 mlcod 36'5395 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.934 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.932+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5376 (0'0,36'5376] local-lis/les=21/22 n=896 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5374 crt=36'5374 lcod 36'5372 mlcod 36'5372 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.937 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.929+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5603 (0'0,36'5603] local-lis/les=21/22 n=942 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5600 crt=36'5600 lcod 36'5598 mlcod 36'5598 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.937 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.930+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5268 (0'0,36'5268] local-lis/les=21/22 n=803 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5268 lcod 36'5266 mlcod 36'5266 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.937 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.934+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5270 (0'0,36'5270] local-lis/les=21/22 n=801 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5268 crt=36'5268 lcod 36'5266 mlcod 36'5266 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.938 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.932+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5246 (0'0,36'5246] local-lis/les=21/22 n=904 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5244 crt=36'5244 lcod 36'5242 mlcod 36'5242 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.941+0000 7ff6bab93700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 0x7ff6b40a8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.941+0000 7ff6bab93700 1 -- 172.21.15.88:0/587323954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40565b0 con 0x7ff6b40a7ef0 2020-02-11T16:31:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.942+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 0x7ff6b40a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.942+0000 7ff6b9130700 1 -- 172.21.15.88:0/587323954 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff6b4062a20 con 0x7ff6b40a7ef0 2020-02-11T16:31:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.942+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 0x7ff6b40a8300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.942+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 0x7ff6b40a8300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.942+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 0x7ff6b40a8300 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:28.948 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.942+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5428 (0'0,36'5428] local-lis/les=21/22 n=936 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5428 lcod 36'5426 mlcod 36'5426 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.946+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 0x7ff6b40a8300 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.946+0000 7ff6b9130700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 0x7ff6b40a8300 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.946+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6ac001e30 con 0x7ff6b40a7ef0 2020-02-11T16:31:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.946+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4021 (secure 0 0 0) 0x7ff6ac008650 con 0x7ff6b40a7ef0 2020-02-11T16:31:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.946+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 msgr2=0x7ff6b40a8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.946+0000 7ff6b1ffb700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 0x7ff6b40a8300 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).stop 2020-02-11T16:31:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.946+0000 7ff6b1ffb700 1 -- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 msgr2=0x7ff6b40a8300 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.946+0000 7ff6b1ffb700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6b40a7ef0 0x7ff6b40a8300 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0x7ff6ac001210 tx=0x7ff6ac010b70).stop 2020-02-11T16:31:28.950 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.947+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5544 (0'0,36'5544] local-lis/les=21/22 n=923 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5544 lcod 36'5542 mlcod 36'5542 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.950 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.948+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5402 (0'0,36'5402] local-lis/les=21/22 n=871 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5402 lcod 36'5400 mlcod 36'5400 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.952 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:31:28.952 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:28.952 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:28.952 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:31:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 216, 2020-02-11T16:31:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:31:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:31:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:31:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:31:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2020-02-11T16:31:28.953 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:31:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:31:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:28.954 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:31:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:31:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:28.955 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:31:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:31:28.956 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:31:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:31:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:31:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:31:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:28.957 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:31:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:31:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:31:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:28.958 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:31:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:31:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.959 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:31:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:31:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:31:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:31:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:31:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:31:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:28.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:28.963 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:31:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:31:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.964 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:31:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:31:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:28.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:28.966 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:31:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:28.967 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:31:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:31:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:31:28.968 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:31:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:31:28.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:31:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:31:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:28.971 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:31:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:28.972 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:28.972 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:31:28.975 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.953+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5275 (0'0,36'5275] local-lis/les=21/22 n=833 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5275 lcod 36'5274 mlcod 36'5274 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.975 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.957+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5277 (0'0,36'5277] local-lis/les=21/22 n=831 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5275 crt=36'5275 lcod 36'5274 mlcod 36'5274 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.975 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.961+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5378 (0'0,36'5378] local-lis/les=21/22 n=894 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5378 lcod 36'5376 mlcod 36'5376 active+clean+snaptrim trimq=[1fe~2a]] removing snap head 2020-02-11T16:31:28.975 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.950+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5248 (0'0,36'5248] local-lis/les=21/22 n=902 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5248 lcod 36'5246 mlcod 36'5246 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.976 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.954+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5250 (0'0,36'5250] local-lis/les=21/22 n=900 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5248 crt=36'5248 lcod 36'5246 mlcod 36'5246 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.976 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.955+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5404 (0'0,36'5404] local-lis/les=21/22 n=869 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5402 crt=36'5402 lcod 36'5400 mlcod 36'5400 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.976 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.970+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5252 (0'0,36'5252] local-lis/les=21/22 n=898 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5252 lcod 36'5250 mlcod 36'5250 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.976 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.951+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5546 (0'0,36'5546] local-lis/les=21/22 n=921 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5544 crt=36'5544 lcod 36'5542 mlcod 36'5542 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.976 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.961+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5434 (0'0,36'5434] local-lis/les=21/22 n=931 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5432 crt=36'5428 lcod 36'5430 mlcod 36'5430 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.976 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.965+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5436 (0'0,36'5436] local-lis/les=21/22 n=929 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5432 crt=36'5432 lcod 36'5430 mlcod 36'5430 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.976 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.966+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5548 (0'0,36'5548] local-lis/les=21/22 n=919 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5548 lcod 36'5546 mlcod 36'5546 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.977 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:28.970+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5550 (0'0,36'5550] local-lis/les=21/22 n=917 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5548 crt=36'5548 lcod 36'5546 mlcod 36'5546 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.977 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.956+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5272 (0'0,36'5272] local-lis/les=21/22 n=799 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5272 lcod 36'5270 mlcod 36'5270 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.977 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.965+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5605 (0'0,36'5605] local-lis/les=21/22 n=940 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5605 lcod 36'5603 mlcod 36'5603 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.966+0000 7ff6bab93700 1 -- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff69c039d00 msgr2=0x7ff69c03c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.966+0000 7ff6bab93700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff69c039d00 0x7ff69c03c1c0 crc :-1 s=READY pgs=565 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.977 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.966+0000 7ff6b9130700 1 -- 172.21.15.88:0/587323954 reap_dead start 2020-02-11T16:31:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.966+0000 7ff6bab93700 1 -- 172.21.15.88:0/587323954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 msgr2=0x7ff6b4145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.966+0000 7ff6bab93700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4145c50 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7ff6b40a5d60 tx=0x7ff6b40a7620).stop 2020-02-11T16:31:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.966+0000 7ff6bab93700 1 -- 172.21.15.88:0/587323954 shutdown_connections 2020-02-11T16:31:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.966+0000 7ff6bab93700 1 --2- 172.21.15.88:0/587323954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b40a6ae0 0x7ff6b4145c50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.966+0000 7ff6bab93700 1 -- 172.21.15.88:0/587323954 >> 172.21.15.88:0/587323954 conn(0x7ff6b409d110 msgr2=0x7ff6b409d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.967+0000 7ff6bab93700 1 -- 172.21.15.88:0/587323954 shutdown_connections 2020-02-11T16:31:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:28.967+0000 7ff6bab93700 1 -- 172.21.15.88:0/587323954 wait complete. 2020-02-11T16:31:28.979 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.970+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5274 (0'0,36'5274] local-lis/les=21/22 n=797 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5274 lcod 36'5272 mlcod 36'5272 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.979 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.974+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5607 (0'0,36'5607] local-lis/les=21/22 n=938 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5605 crt=36'5605 lcod 36'5603 mlcod 36'5603 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.980 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.977+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5276 (0'0,36'5276] local-lis/les=21/22 n=795 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5274 crt=36'5274 lcod 36'5272 mlcod 36'5272 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.980 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.976+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5279 (0'0,36'5279] local-lis/les=21/22 n=829 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5279 lcod 36'5277 mlcod 36'5277 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.981 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.978+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5254 (0'0,36'5254] local-lis/les=21/22 n=896 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5252 crt=36'5252 lcod 36'5250 mlcod 36'5250 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.982 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.980+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5281 (0'0,36'5281] local-lis/les=21/22 n=827 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5279 crt=36'5279 lcod 36'5277 mlcod 36'5277 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.983 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.980+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5406 (0'0,36'5406] local-lis/les=21/22 n=867 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5406 lcod 36'5404 mlcod 36'5404 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.986 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.984+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5408 (0'0,36'5408] local-lis/les=21/22 n=865 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5406 crt=36'5406 lcod 36'5404 mlcod 36'5404 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.989 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.987+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5380 (0'0,36'5380] local-lis/les=21/22 n=892 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5380 lcod 36'5378 mlcod 36'5378 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.993 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2020-02-11T16:31:28.993 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:31:28.993 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2020-02-11T16:31:28.994 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:31:28.994 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-02-11T16:31:28.994 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:31:28.995 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:28.991+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5382 (0'0,36'5382] local-lis/les=21/22 n=890 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5380 crt=36'5380 lcod 36'5378 mlcod 36'5378 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.998 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:28.995+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5256 (0'0,36'5256] local-lis/les=21/22 n=894 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5256 lcod 36'5254 mlcod 36'5254 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:28.998 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.993+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5609 (0'0,36'5609] local-lis/les=21/22 n=936 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5609 lcod 36'5607 mlcod 36'5607 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:28.998 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.995+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5279 (0'0,36'5279] local-lis/les=21/22 n=792 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5279 lcod 36'5278 mlcod 36'5278 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.000 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:28.998+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5284 (0'0,36'5284] local-lis/les=21/22 n=824 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5283 crt=36'5279 lcod 36'5281 mlcod 36'5281 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.003 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.000+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5258 (0'0,36'5258] local-lis/les=21/22 n=892 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5256 crt=36'5256 lcod 36'5254 mlcod 36'5254 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.004 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:28.999+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5611 (0'0,36'5611] local-lis/les=21/22 n=934 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5609 crt=36'5609 lcod 36'5607 mlcod 36'5607 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.008 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.005+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5281 (0'0,36'5281] local-lis/les=21/22 n=790 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5279 crt=36'5279 lcod 36'5278 mlcod 36'5278 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.008 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.002+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5439 (0'0,36'5439] local-lis/les=21/22 n=926 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5438 crt=36'5436 lcod 36'5436 mlcod 36'5436 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.009 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.006+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5410 (0'0,36'5410] local-lis/les=21/22 n=863 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5410 lcod 36'5408 mlcod 36'5408 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.013 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.010+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5412 (0'0,36'5412] local-lis/les=21/22 n=861 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5410 crt=36'5410 lcod 36'5408 mlcod 36'5408 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.014 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.011+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5552 (0'0,36'5552] local-lis/les=21/22 n=915 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5552 lcod 36'5550 mlcod 36'5550 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.015 INFO:tasks.ceph.mon.b:Stopped 2020-02-11T16:31:29.015 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:31:29.016 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:31:29.017 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.014+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5554 (0'0,36'5554] local-lis/les=21/22 n=913 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5552 crt=36'5552 lcod 36'5550 mlcod 36'5550 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.020 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.018+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5441 (0'0,36'5441] local-lis/les=21/22 n=924 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5441 lcod 36'5439 mlcod 36'5439 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.023 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.021+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5384 (0'0,36'5384] local-lis/les=21/22 n=888 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5384 lcod 36'5382 mlcod 36'5382 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.024 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.021+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5443 (0'0,36'5443] local-lis/les=21/22 n=922 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5441 crt=36'5441 lcod 36'5439 mlcod 36'5439 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.024 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.022+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5284 (0'0,36'5284] local-lis/les=21/22 n=787 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5283 crt=36'5279 lcod 36'5281 mlcod 36'5281 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.028 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.025+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5286 (0'0,36'5286] local-lis/les=21/22 n=785 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5283 crt=36'5283 lcod 36'5281 mlcod 36'5281 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.030 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.028+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5556 (0'0,36'5556] local-lis/les=21/22 n=911 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5556 lcod 36'5554 mlcod 36'5554 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.031 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.028+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5386 (0'0,36'5386] local-lis/les=21/22 n=886 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5384 crt=36'5384 lcod 36'5382 mlcod 36'5382 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.031 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.023+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5286 (0'0,36'5286] local-lis/les=21/22 n=822 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5283 crt=36'5283 lcod 36'5281 mlcod 36'5281 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.033 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.031+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5558 (0'0,36'5558] local-lis/les=21/22 n=909 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5556 crt=36'5556 lcod 36'5554 mlcod 36'5554 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.035 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.032+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5260 (0'0,36'5260] local-lis/les=21/22 n=890 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5260 lcod 36'5258 mlcod 36'5258 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.038 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.036+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5262 (0'0,36'5262] local-lis/les=21/22 n=888 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5260 crt=36'5260 lcod 36'5258 mlcod 36'5258 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.040 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.038+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5288 (0'0,36'5288] local-lis/les=21/22 n=820 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5288 lcod 36'5286 mlcod 36'5286 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.042 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.041+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5290 (0'0,36'5290] local-lis/les=21/22 n=818 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5288 crt=36'5288 lcod 36'5286 mlcod 36'5286 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.048 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.043+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5445 (0'0,36'5445] local-lis/les=21/22 n=920 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5445 lcod 36'5443 mlcod 36'5443 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.049 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.042+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5613 (0'0,36'5613] local-lis/les=21/22 n=932 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5613 lcod 36'5611 mlcod 36'5611 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.053 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.044+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5288 (0'0,36'5288] local-lis/les=21/22 n=783 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5288 lcod 36'5286 mlcod 36'5286 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.053 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.046+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5615 (0'0,36'5615] local-lis/les=21/22 n=930 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5613 crt=36'5613 lcod 36'5611 mlcod 36'5611 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.053 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.047+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5290 (0'0,36'5290] local-lis/les=21/22 n=781 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5288 crt=36'5288 lcod 36'5286 mlcod 36'5286 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.053 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.046+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5414 (0'0,36'5414] local-lis/les=21/22 n=859 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5414 lcod 36'5412 mlcod 36'5412 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.054 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.047+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5447 (0'0,36'5447] local-lis/les=21/22 n=918 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5445 crt=36'5445 lcod 36'5443 mlcod 36'5443 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.058 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.056+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5416 (0'0,36'5416] local-lis/les=21/22 n=857 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5414 crt=36'5414 lcod 36'5412 mlcod 36'5412 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.058 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.056+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5266 (0'0,36'5266] local-lis/les=21/22 n=884 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5264 crt=36'5260 lcod 36'5262 mlcod 36'5262 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.061 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.059+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5560 (0'0,36'5560] local-lis/les=21/22 n=907 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5560 lcod 36'5558 mlcod 36'5558 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.062 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.059+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5268 (0'0,36'5268] local-lis/les=21/22 n=882 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5264 crt=36'5264 lcod 36'5262 mlcod 36'5262 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.062 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.061+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5388 (0'0,36'5388] local-lis/les=21/22 n=884 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5388 lcod 36'5386 mlcod 36'5386 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.064 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.062+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5617 (0'0,36'5617] local-lis/les=21/22 n=928 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5617 lcod 36'5615 mlcod 36'5615 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.065 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.063+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5292 (0'0,36'5292] local-lis/les=21/22 n=816 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5292 lcod 36'5290 mlcod 36'5290 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.066 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.064+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5390 (0'0,36'5390] local-lis/les=21/22 n=882 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5388 crt=36'5388 lcod 36'5386 mlcod 36'5386 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.067 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.062+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5562 (0'0,36'5562] local-lis/les=21/22 n=905 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5560 crt=36'5560 lcod 36'5558 mlcod 36'5558 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.071 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.067+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5294 (0'0,36'5294] local-lis/les=21/22 n=814 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5292 crt=36'5292 lcod 36'5290 mlcod 36'5290 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.074 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.071+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5449 (0'0,36'5449] local-lis/les=21/22 n=916 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5449 lcod 36'5447 mlcod 36'5447 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.076 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.071+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5292 (0'0,36'5292] local-lis/les=21/22 n=779 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5292 lcod 36'5290 mlcod 36'5290 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.076 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.071+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5619 (0'0,36'5619] local-lis/les=21/22 n=926 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5617 crt=36'5617 lcod 36'5615 mlcod 36'5615 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.076 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.073+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5418 (0'0,36'5418] local-lis/les=21/22 n=855 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5418 lcod 36'5416 mlcod 36'5416 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.077 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.074+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5294 (0'0,36'5294] local-lis/les=21/22 n=777 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5292 crt=36'5292 lcod 36'5290 mlcod 36'5290 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.082 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.078+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5270 (0'0,36'5270] local-lis/les=21/22 n=880 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5270 lcod 36'5268 mlcod 36'5268 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.084 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.082+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5392 (0'0,36'5392] local-lis/les=21/22 n=880 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5392 lcod 36'5390 mlcod 36'5390 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.084 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.082+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5272 (0'0,36'5272] local-lis/les=21/22 n=878 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5270 crt=36'5270 lcod 36'5268 mlcod 36'5268 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.086 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.084+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5451 (0'0,36'5451] local-lis/les=21/22 n=914 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5449 crt=36'5449 lcod 36'5447 mlcod 36'5447 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.089 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.086+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5565 (0'0,36'5565] local-lis/les=21/22 n=902 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5564 crt=36'5564 lcod 36'5562 mlcod 36'5562 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.093 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.090+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5567 (0'0,36'5567] local-lis/les=21/22 n=900 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5564 crt=36'5564 lcod 36'5562 mlcod 36'5562 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.094 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.088+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5394 (0'0,36'5394] local-lis/les=21/22 n=878 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5392 crt=36'5392 lcod 36'5390 mlcod 36'5390 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.097 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.095+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5296 (0'0,36'5296] local-lis/les=21/22 n=812 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5296 lcod 36'5294 mlcod 36'5294 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.101 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.094+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5274 (0'0,36'5274] local-lis/les=21/22 n=876 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5274 lcod 36'5272 mlcod 36'5272 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.101 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.094+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5420 (0'0,36'5420] local-lis/les=21/22 n=853 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5420 lcod 36'5418 mlcod 36'5418 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.102 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.094+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5296 (0'0,36'5296] local-lis/les=21/22 n=775 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5296 lcod 36'5294 mlcod 36'5294 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.102 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.095+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5622 (0'0,36'5622] local-lis/les=21/22 n=923 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5621 crt=36'5617 lcod 36'5619 mlcod 36'5619 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.102 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.097+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5298 (0'0,36'5298] local-lis/les=21/22 n=773 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5296 crt=36'5296 lcod 36'5294 mlcod 36'5294 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.102 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.097+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5276 (0'0,36'5276] local-lis/les=21/22 n=874 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5274 crt=36'5274 lcod 36'5272 mlcod 36'5272 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.103 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.097+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5422 (0'0,36'5422] local-lis/les=21/22 n=851 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5420 crt=36'5420 lcod 36'5418 mlcod 36'5418 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.103 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.098+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5624 (0'0,36'5624] local-lis/les=21/22 n=921 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5621 crt=36'5621 lcod 36'5619 mlcod 36'5619 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.105 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.102+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5298 (0'0,36'5298] local-lis/les=21/22 n=810 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5296 crt=36'5296 lcod 36'5294 mlcod 36'5294 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.111 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.104+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5453 (0'0,36'5453] local-lis/les=21/22 n=912 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5453 lcod 36'5451 mlcod 36'5451 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.111 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.107+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5455 (0'0,36'5455] local-lis/les=21/22 n=910 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5453 crt=36'5453 lcod 36'5451 mlcod 36'5451 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.116 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.115+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5396 (0'0,36'5396] local-lis/les=21/22 n=876 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5396 lcod 36'5394 mlcod 36'5394 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.120 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.118+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5424 (0'0,36'5424] local-lis/les=21/22 n=849 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5424 lcod 36'5422 mlcod 36'5422 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.121 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.118+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5398 (0'0,36'5398] local-lis/les=21/22 n=874 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5396 crt=36'5396 lcod 36'5394 mlcod 36'5394 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.122 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.120+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5626 (0'0,36'5626] local-lis/les=21/22 n=919 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5626 lcod 36'5624 mlcod 36'5624 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.123 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.121+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5278 (0'0,36'5278] local-lis/les=21/22 n=872 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5278 lcod 36'5276 mlcod 36'5276 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.126 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.122+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5426 (0'0,36'5426] local-lis/les=21/22 n=847 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5424 crt=36'5424 lcod 36'5422 mlcod 36'5422 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.127 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.124+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5570 (0'0,36'5570] local-lis/les=21/22 n=897 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5569 crt=36'5569 lcod 36'5567 mlcod 36'5567 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.129 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.121+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5301 (0'0,36'5301] local-lis/les=21/22 n=770 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5300 crt=36'5296 lcod 36'5298 mlcod 36'5298 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.130 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.124+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5303 (0'0,36'5303] local-lis/les=21/22 n=768 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5300 crt=36'5300 lcod 36'5298 mlcod 36'5298 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.133 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.128+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5280 (0'0,36'5280] local-lis/les=21/22 n=870 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5278 crt=36'5278 lcod 36'5276 mlcod 36'5276 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.133 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.128+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5457 (0'0,36'5457] local-lis/les=21/22 n=908 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5457 lcod 36'5455 mlcod 36'5455 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.135 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.132+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5300 (0'0,36'5300] local-lis/les=21/22 n=808 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5300 lcod 36'5298 mlcod 36'5298 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.136 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.133+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5628 (0'0,36'5628] local-lis/les=21/22 n=917 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5626 crt=36'5626 lcod 36'5624 mlcod 36'5624 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.136 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.132+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5459 (0'0,36'5459] local-lis/les=21/22 n=906 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5457 crt=36'5457 lcod 36'5455 mlcod 36'5455 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.141 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.135+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5302 (0'0,36'5302] local-lis/les=21/22 n=806 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5300 crt=36'5300 lcod 36'5298 mlcod 36'5298 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.142 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.139+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5572 (0'0,36'5572] local-lis/les=21/22 n=895 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5569 crt=36'5569 lcod 36'5567 mlcod 36'5567 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.145 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.141+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5305 (0'0,36'5305] local-lis/les=21/22 n=766 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5305 lcod 36'5303 mlcod 36'5303 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.146 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.143+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5428 (0'0,36'5428] local-lis/les=21/22 n=845 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5428 lcod 36'5426 mlcod 36'5426 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.146 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.144+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5400 (0'0,36'5400] local-lis/les=21/22 n=872 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5400 lcod 36'5398 mlcod 36'5398 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.149 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.145+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5282 (0'0,36'5282] local-lis/les=21/22 n=868 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5282 lcod 36'5280 mlcod 36'5280 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.152 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.148+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5284 (0'0,36'5284] local-lis/les=21/22 n=866 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5282 crt=36'5282 lcod 36'5280 mlcod 36'5280 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.152 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.149+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5430 (0'0,36'5430] local-lis/les=21/22 n=843 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5428 crt=36'5428 lcod 36'5426 mlcod 36'5426 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.156 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.152+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5304 (0'0,36'5304] local-lis/les=21/22 n=804 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5304 lcod 36'5302 mlcod 36'5302 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.156 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.153+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5402 (0'0,36'5402] local-lis/les=21/22 n=870 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5400 crt=36'5400 lcod 36'5398 mlcod 36'5398 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.161 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.149+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5307 (0'0,36'5307] local-lis/les=21/22 n=764 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5305 crt=36'5305 lcod 36'5303 mlcod 36'5303 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.162 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.155+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5630 (0'0,36'5630] local-lis/les=21/22 n=915 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5630 lcod 36'5628 mlcod 36'5628 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.162 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.158+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5632 (0'0,36'5632] local-lis/les=21/22 n=913 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5630 crt=36'5630 lcod 36'5628 mlcod 36'5628 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.163 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.160+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5306 (0'0,36'5306] local-lis/les=21/22 n=802 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5304 crt=36'5304 lcod 36'5302 mlcod 36'5302 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.163 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.158+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5461 (0'0,36'5461] local-lis/les=21/22 n=904 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5461 lcod 36'5459 mlcod 36'5459 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.163 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.160+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5575 (0'0,36'5575] local-lis/les=21/22 n=892 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5574 crt=36'5569 lcod 36'5572 mlcod 36'5572 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.170 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.162+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5463 (0'0,36'5463] local-lis/les=21/22 n=902 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5461 crt=36'5461 lcod 36'5459 mlcod 36'5459 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.170 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.168+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5577 (0'0,36'5577] local-lis/les=21/22 n=890 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5574 crt=36'5574 lcod 36'5572 mlcod 36'5572 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.172 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.166+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5432 (0'0,36'5432] local-lis/les=21/22 n=841 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5432 lcod 36'5430 mlcod 36'5430 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.172 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.169+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5309 (0'0,36'5309] local-lis/les=21/22 n=762 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5309 lcod 36'5307 mlcod 36'5307 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.173 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.167+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5404 (0'0,36'5404] local-lis/les=21/22 n=868 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5404 lcod 36'5402 mlcod 36'5402 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.173 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.170+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5406 (0'0,36'5406] local-lis/les=21/22 n=866 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5404 crt=36'5404 lcod 36'5402 mlcod 36'5402 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.175 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.173+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5311 (0'0,36'5311] local-lis/les=21/22 n=760 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5309 crt=36'5309 lcod 36'5307 mlcod 36'5307 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.177 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.174+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5434 (0'0,36'5434] local-lis/les=21/22 n=839 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5432 crt=36'5432 lcod 36'5430 mlcod 36'5430 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.182 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.177+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5465 (0'0,36'5465] local-lis/les=21/22 n=900 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5465 lcod 36'5463 mlcod 36'5463 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.185 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.182+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5286 (0'0,36'5286] local-lis/les=21/22 n=864 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5286 lcod 36'5284 mlcod 36'5284 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.189 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.184+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5579 (0'0,36'5579] local-lis/les=21/22 n=888 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5579 lcod 36'5577 mlcod 36'5577 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.190 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.185+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5634 (0'0,36'5634] local-lis/les=21/22 n=911 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5634 lcod 36'5632 mlcod 36'5632 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.191 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.188+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5581 (0'0,36'5581] local-lis/les=21/22 n=886 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5579 crt=36'5579 lcod 36'5577 mlcod 36'5577 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.191 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.190+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5408 (0'0,36'5408] local-lis/les=21/22 n=864 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5408 lcod 36'5406 mlcod 36'5406 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.192 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.186+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5288 (0'0,36'5288] local-lis/les=21/22 n=862 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5286 crt=36'5286 lcod 36'5284 mlcod 36'5284 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.192 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.187+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5436 (0'0,36'5436] local-lis/les=21/22 n=837 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5436 lcod 36'5434 mlcod 36'5434 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.193 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.189+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5467 (0'0,36'5467] local-lis/les=21/22 n=898 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5465 crt=36'5465 lcod 36'5463 mlcod 36'5463 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.193 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.190+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5438 (0'0,36'5438] local-lis/les=21/22 n=835 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5436 crt=36'5436 lcod 36'5434 mlcod 36'5434 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.196 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.193+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5410 (0'0,36'5410] local-lis/les=21/22 n=862 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5408 crt=36'5408 lcod 36'5406 mlcod 36'5406 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.198 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.196+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5636 (0'0,36'5636] local-lis/les=21/22 n=909 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5634 crt=36'5634 lcod 36'5632 mlcod 36'5632 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.201 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.193+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5310 (0'0,36'5310] local-lis/les=21/22 n=798 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5309 crt=36'5304 lcod 36'5308 mlcod 36'5308 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.202 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.198+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5313 (0'0,36'5313] local-lis/les=21/22 n=758 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5313 lcod 36'5311 mlcod 36'5311 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.203 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.202+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5312 (0'0,36'5312] local-lis/les=21/22 n=796 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5309 crt=36'5309 lcod 36'5308 mlcod 36'5308 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.209 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.202+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5315 (0'0,36'5315] local-lis/les=21/22 n=756 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5313 crt=36'5313 lcod 36'5311 mlcod 36'5311 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.213 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.204+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5469 (0'0,36'5469] local-lis/les=21/22 n=896 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5469 lcod 36'5467 mlcod 36'5467 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.214 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.206+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5583 (0'0,36'5583] local-lis/les=21/22 n=884 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5583 lcod 36'5581 mlcod 36'5581 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.214 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.210+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5585 (0'0,36'5585] local-lis/les=21/22 n=882 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5583 crt=36'5583 lcod 36'5581 mlcod 36'5581 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.215 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.213+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5412 (0'0,36'5412] local-lis/les=21/22 n=860 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5412 lcod 36'5410 mlcod 36'5410 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.215 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.212+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5638 (0'0,36'5638] local-lis/les=21/22 n=907 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5638 lcod 36'5636 mlcod 36'5636 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.215 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.209+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5290 (0'0,36'5290] local-lis/les=21/22 n=860 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5290 lcod 36'5288 mlcod 36'5288 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.216 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.214+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5292 (0'0,36'5292] local-lis/les=21/22 n=858 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5290 crt=36'5290 lcod 36'5288 mlcod 36'5288 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.218 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.216+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5314 (0'0,36'5314] local-lis/les=21/22 n=794 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5314 lcod 36'5312 mlcod 36'5312 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.221 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.220+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5316 (0'0,36'5316] local-lis/les=21/22 n=792 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5314 crt=36'5314 lcod 36'5312 mlcod 36'5312 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.229 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.221+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5587 (0'0,36'5587] local-lis/les=21/22 n=880 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5587 lcod 36'5585 mlcod 36'5585 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.229 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.221+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5317 (0'0,36'5317] local-lis/les=21/22 n=754 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5317 lcod 36'5315 mlcod 36'5315 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.231 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.227+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5414 (0'0,36'5414] local-lis/les=21/22 n=858 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5412 crt=36'5412 lcod 36'5410 mlcod 36'5410 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.231 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.225+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5319 (0'0,36'5319] local-lis/les=21/22 n=752 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5317 crt=36'5317 lcod 36'5315 mlcod 36'5315 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.231 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.225+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5589 (0'0,36'5589] local-lis/les=21/22 n=878 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5587 crt=36'5587 lcod 36'5585 mlcod 36'5585 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.231 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.226+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5471 (0'0,36'5471] local-lis/les=21/22 n=894 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5469 crt=36'5469 lcod 36'5467 mlcod 36'5467 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.235 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.230+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5441 (0'0,36'5441] local-lis/les=21/22 n=832 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5441 lcod 36'5440 mlcod 36'5440 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.235 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.232+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5295 (0'0,36'5295] local-lis/les=21/22 n=855 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5294 crt=36'5290 lcod 36'5292 mlcod 36'5292 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.233+0000 7fd8a2c21700 1 Processor -- start 2020-02-11T16:31:29.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.233+0000 7fd8a2c21700 1 -- start start 2020-02-11T16:31:29.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.233+0000 7fd8a2c21700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd89c0a6fd0 0x7fd89c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:29.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.233+0000 7fd8a2c21700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 0x7fd89c0a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:29.239 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.233+0000 7fd8a2c21700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0a2890 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd8a2c21700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c0a2ac0 con 0x7fd89c0a6fd0 2020-02-11T16:31:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd8a2c21700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0a2d60 con 0x7fd89c0a73b0 2020-02-11T16:31:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd8a09bd700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fd89c0a6fd0 msgr2=0x7fd89c0a5810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd8a09bd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd89c0a6fd0 0x7fd89c0a5810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd8a11be700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd89c0a5ec0 0x7fd89c137960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48910/0 (socket says 172.21.15.88:48910) 2020-02-11T16:31:29.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd8a11be700 1 -- 172.21.15.88:0/2953958505 learned_addr learned my addr 172.21.15.88:0/2953958505 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:29.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd89bfff700 1 --2- 172.21.15.88:0/2953958505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 0x7fd89c0a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:29.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd89bfff700 1 -- 172.21.15.88:0/2953958505 >> v2:172.21.15.52:3300/0 conn(0x7fd89c0a6fd0 msgr2=0x7fd89c0a5810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:29.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd89bfff700 1 --2- 172.21.15.88:0/2953958505 >> v2:172.21.15.52:3300/0 conn(0x7fd89c0a6fd0 0x7fd89c0a5810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:29.241 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd89bfff700 1 -- 172.21.15.88:0/2953958505 >> v1:172.21.15.88:6789/0 conn(0x7fd89c0a5ec0 legacy=0x7fd89c137960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd89bfff700 1 -- 172.21.15.88:0/2953958505 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0a68a0 con 0x7fd89c0a73b0 2020-02-11T16:31:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd89bfff700 1 --2- 172.21.15.88:0/2953958505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 0x7fd89c0a4e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd894004990 tx=0x7fd8900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd89bfff700 1 --2- 172.21.15.88:0/2953958505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 0x7fd89c0a4e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd894004990 tx=0x7fd8900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.234+0000 7fd89bfff700 1 --2- 172.21.15.88:0/2953958505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 0x7fd89c0a4e10 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fd894004990 tx=0x7fd8900088e0).ready entity=mon.2 client_cookie=1039f9655b615a23 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.235+0000 7fd89bfff700 1 --2- 172.21.15.88:0/2953958505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 0x7fd89c0a4e10 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd894004990 tx=0x7fd8900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.235+0000 7fd89bfff700 1 --2- 172.21.15.88:0/2953958505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 0x7fd89c0a4e10 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd894004990 tx=0x7fd8900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.235+0000 7fd89bfff700 1 --2- 172.21.15.88:0/2953958505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 0x7fd89c0a4e10 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fd894004990 tx=0x7fd8900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.235+0000 7fd89b7fe700 1 -- 172.21.15.88:0/2953958505 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd890009e60 con 0x7fd89c0a73b0 2020-02-11T16:31:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.235+0000 7fd89b7fe700 1 -- 172.21.15.88:0/2953958505 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd890011800 con 0x7fd89c0a73b0 2020-02-11T16:31:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.235+0000 7fd89b7fe700 1 -- 172.21.15.88:0/2953958505 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd890011b60 con 0x7fd89c0a73b0 2020-02-11T16:31:29.244 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.236+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5297 (0'0,36'5297] local-lis/les=21/22 n=853 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5294 crt=36'5294 lcod 36'5292 mlcod 36'5292 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.244 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.236+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5642 (0'0,36'5642] local-lis/les=21/22 n=904 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5642 lcod 36'5640 mlcod 36'5640 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.237+0000 7fd8a2c21700 1 -- 172.21.15.88:0/2953958505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 msgr2=0x7fd89c0a4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:29.245 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.237+0000 7fd8a2c21700 1 --2- 172.21.15.88:0/2953958505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 0x7fd89c0a4e10 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fd894004990 tx=0x7fd8900088e0).stop 2020-02-11T16:31:29.245 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.238+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5443 (0'0,36'5443] local-lis/les=21/22 n=830 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5441 crt=36'5441 lcod 36'5440 mlcod 36'5440 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.246 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.239+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5644 (0'0,36'5644] local-lis/les=21/22 n=902 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5642 crt=36'5642 lcod 36'5640 mlcod 36'5640 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.246 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.241+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5473 (0'0,36'5473] local-lis/les=21/22 n=892 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5473 lcod 36'5471 mlcod 36'5471 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.244+0000 7fd8a2c21700 1 -- 172.21.15.88:0/2953958505 shutdown_connections 2020-02-11T16:31:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.244+0000 7fd8a2c21700 1 --2- 172.21.15.88:0/2953958505 >> v2:172.21.15.52:3300/0 conn(0x7fd89c0a6fd0 0x7fd89c0a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.244+0000 7fd8a2c21700 1 --2- 172.21.15.88:0/2953958505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a73b0 0x7fd89c0a4e10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.244+0000 7fd8a2c21700 1 -- 172.21.15.88:0/2953958505 >> 172.21.15.88:0/2953958505 conn(0x7fd89c09d110 msgr2=0x7fd89c09d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:29.249 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.244+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5321 (0'0,36'5321] local-lis/les=21/22 n=750 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5321 lcod 36'5319 mlcod 36'5319 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.250 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.245+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5591 (0'0,36'5591] local-lis/les=21/22 n=876 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5591 lcod 36'5589 mlcod 36'5589 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.251 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.248+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5416 (0'0,36'5416] local-lis/les=21/22 n=856 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5416 lcod 36'5414 mlcod 36'5414 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.251 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.247+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5475 (0'0,36'5475] local-lis/les=21/22 n=890 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5473 crt=36'5473 lcod 36'5471 mlcod 36'5471 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.253 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.248+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5593 (0'0,36'5593] local-lis/les=21/22 n=874 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5591 crt=36'5591 lcod 36'5589 mlcod 36'5589 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.253 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.251+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5418 (0'0,36'5418] local-lis/les=21/22 n=854 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5416 crt=36'5416 lcod 36'5414 mlcod 36'5414 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.254 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.251+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5299 (0'0,36'5299] local-lis/les=21/22 n=851 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5299 lcod 36'5297 mlcod 36'5297 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.251+0000 7fd8a2c21700 1 -- 172.21.15.88:0/2953958505 shutdown_connections 2020-02-11T16:31:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.253+0000 7fd8a2c21700 1 -- 172.21.15.88:0/2953958505 wait complete. 2020-02-11T16:31:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.254+0000 7fd8a2c21700 1 Processor -- start 2020-02-11T16:31:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.254+0000 7fd8a2c21700 1 -- start start 2020-02-11T16:31:29.258 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.255+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5323 (0'0,36'5323] local-lis/les=21/22 n=748 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5321 crt=36'5321 lcod 36'5319 mlcod 36'5319 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.258 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.255+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5445 (0'0,36'5445] local-lis/les=21/22 n=828 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5445 lcod 36'5443 mlcod 36'5443 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.255+0000 7fd8a2c21700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.255+0000 7fd8a2c21700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c134f10 con 0x7fd89c0a73b0 2020-02-11T16:31:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.255+0000 7fd8a2c21700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c12fa40 con 0x7fd89c0a6fd0 2020-02-11T16:31:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.255+0000 7fd8a2c21700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c12fcd0 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.255+0000 7fd8a11be700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7fd89c0a73b0 legacy=0x7fd89c1537d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.257+0000 7fd8a09bd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.257+0000 7fd8a09bd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55616/0 (socket says 172.21.15.88:55616) 2020-02-11T16:31:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.257+0000 7fd8a09bd700 1 -- 172.21.15.88:0/3027223525 learned_addr learned my addr 172.21.15.88:0/3027223525 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.258+0000 7fd8a09bd700 1 -- 172.21.15.88:0/3027223525 >> v1:172.21.15.88:6789/0 conn(0x7fd89c0a6fd0 legacy=0x7fd89c127d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.258+0000 7fd8a09bd700 1 -- 172.21.15.88:0/3027223525 >> v1:172.21.15.52:6789/0 conn(0x7fd89c0a73b0 legacy=0x7fd89c1537d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.258+0000 7fd8a09bd700 1 -- 172.21.15.88:0/3027223525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c127610 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.258+0000 7fd8a09bd700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.258+0000 7fd8a09bd700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.258+0000 7fd8a09bd700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.258+0000 7fd8a09bd700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.258+0000 7fd899ffb700 1 -- 172.21.15.88:0/3027223525 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd88c008d20 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.258+0000 7fd8a09bd700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.258+0000 7fd8a09bd700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.263 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.258+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5301 (0'0,36'5301] local-lis/les=21/22 n=849 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5299 crt=36'5299 lcod 36'5297 mlcod 36'5297 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.264 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.259+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5447 (0'0,36'5447] local-lis/les=21/22 n=826 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5445 crt=36'5445 lcod 36'5443 mlcod 36'5443 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.265 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.260+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5319 (0'0,36'5319] local-lis/les=21/22 n=789 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5319 lcod 36'5318 mlcod 36'5318 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.266 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.260+0000 7fd8a2c21700 1 -- 172.21.15.88:0/3027223525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c1278b0 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.260+0000 7fd8a2c21700 1 -- 172.21.15.88:0/3027223525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c067180 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.261+0000 7fd8a09bd700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.262+0000 7fd8a09bd700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.263+0000 7fd899ffb700 1 -- 172.21.15.88:0/3027223525 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c003730 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.263+0000 7fd899ffb700 1 -- 172.21.15.88:0/3027223525 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd88c003b50 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.263+0000 7fd899ffb700 1 -- 172.21.15.88:0/3027223525 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd88c012480 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.263+0000 7fd899ffb700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd87c039d10 0x7fd87c03c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.263+0000 7fd899ffb700 1 -- 172.21.15.88:0/3027223525 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fd88c049730 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.263+0000 7fd89bfff700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd87c039d10 0x7fd87c03c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.264+0000 7fd89bfff700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd87c039d10 0x7fd87c03c1d0 crc :-1 s=READY pgs=566 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:29.269 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.262+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5646 (0'0,36'5646] local-lis/les=21/22 n=900 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5646 lcod 36'5644 mlcod 36'5644 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.265+0000 7fd8a2c21700 1 -- 172.21.15.88:0/3027223525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd878003340 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.270 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.268+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5477 (0'0,36'5477] local-lis/les=21/22 n=888 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5477 lcod 36'5475 mlcod 36'5475 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.273 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.270+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5321 (0'0,36'5321] local-lis/les=21/22 n=787 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5319 crt=36'5319 lcod 36'5318 mlcod 36'5318 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.272+0000 7fd8a09bd700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.272+0000 7fd899ffb700 1 -- 172.21.15.88:0/3027223525 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd88c02ed60 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.276 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.271+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5648 (0'0,36'5648] local-lis/les=21/22 n=898 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5648 lcod 36'5646 mlcod 36'5646 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.276 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.271+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5326 (0'0,36'5326] local-lis/les=21/22 n=745 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5325 crt=36'5321 lcod 36'5323 mlcod 36'5323 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.277 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.271+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5479 (0'0,36'5479] local-lis/les=21/22 n=886 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5477 crt=36'5477 lcod 36'5475 mlcod 36'5475 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.277 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.273+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5595 (0'0,36'5595] local-lis/les=21/22 n=872 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5595 lcod 36'5593 mlcod 36'5593 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.279 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.277+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5597 (0'0,36'5597] local-lis/les=21/22 n=870 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5595 crt=36'5595 lcod 36'5593 mlcod 36'5593 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.280 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.275+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5449 (0'0,36'5449] local-lis/les=21/22 n=824 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5449 lcod 36'5447 mlcod 36'5447 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.281 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.279+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5451 (0'0,36'5451] local-lis/les=21/22 n=822 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5449 crt=36'5449 lcod 36'5447 mlcod 36'5447 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.284 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.280+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5650 (0'0,36'5650] local-lis/les=21/22 n=896 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5648 crt=36'5648 lcod 36'5646 mlcod 36'5646 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.284 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.276+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5421 (0'0,36'5421] local-lis/les=21/22 n=851 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5421 lcod 36'5420 mlcod 36'5420 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.285 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.283+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5323 (0'0,36'5323] local-lis/les=21/22 n=785 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5323 lcod 36'5321 mlcod 36'5321 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.286 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.281+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5303 (0'0,36'5303] local-lis/les=21/22 n=847 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5303 lcod 36'5301 mlcod 36'5301 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.290 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.288+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5305 (0'0,36'5305] local-lis/les=21/22 n=845 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5303 crt=36'5303 lcod 36'5301 mlcod 36'5301 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.292 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.290+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5481 (0'0,36'5481] local-lis/les=21/22 n=884 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5481 lcod 36'5479 mlcod 36'5479 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.294 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.279+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5423 (0'0,36'5423] local-lis/les=21/22 n=849 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5421 crt=36'5421 lcod 36'5420 mlcod 36'5420 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.296 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.293+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5325 (0'0,36'5325] local-lis/les=21/22 n=783 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5323 crt=36'5323 lcod 36'5321 mlcod 36'5321 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.299 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.297+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5483 (0'0,36'5483] local-lis/les=21/22 n=882 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5481 crt=36'5481 lcod 36'5479 mlcod 36'5479 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.305 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.302+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5453 (0'0,36'5453] local-lis/les=21/22 n=820 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5453 lcod 36'5451 mlcod 36'5451 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.305 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.299+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5652 (0'0,36'5652] local-lis/les=21/22 n=894 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5652 lcod 36'5650 mlcod 36'5650 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.306 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.303+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5307 (0'0,36'5307] local-lis/les=21/22 n=843 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5307 lcod 36'5305 mlcod 36'5305 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.306 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.303+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5654 (0'0,36'5654] local-lis/les=21/22 n=892 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5652 crt=36'5652 lcod 36'5650 mlcod 36'5650 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.311 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.309+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5599 (0'0,36'5599] local-lis/les=21/22 n=868 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5599 lcod 36'5597 mlcod 36'5597 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.312 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.309+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5327 (0'0,36'5327] local-lis/les=21/22 n=781 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5327 lcod 36'5325 mlcod 36'5325 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.314 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.312+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5455 (0'0,36'5455] local-lis/les=21/22 n=818 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5453 crt=36'5453 lcod 36'5451 mlcod 36'5451 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.315 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.313+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5329 (0'0,36'5329] local-lis/les=21/22 n=779 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5327 crt=36'5327 lcod 36'5325 mlcod 36'5325 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.315 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.313+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5601 (0'0,36'5601] local-lis/les=21/22 n=866 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5599 crt=36'5599 lcod 36'5597 mlcod 36'5597 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.321 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.317+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5309 (0'0,36'5309] local-lis/les=21/22 n=841 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5307 crt=36'5307 lcod 36'5305 mlcod 36'5305 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.323 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.321+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5425 (0'0,36'5425] local-lis/les=21/22 n=847 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5425 lcod 36'5423 mlcod 36'5423 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.326 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.322+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5656 (0'0,36'5656] local-lis/les=21/22 n=890 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5656 lcod 36'5654 mlcod 36'5654 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.326 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.324+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5427 (0'0,36'5427] local-lis/les=21/22 n=845 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5425 crt=36'5425 lcod 36'5423 mlcod 36'5423 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.327 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.324+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5486 (0'0,36'5486] local-lis/les=21/22 n=879 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5485 crt=36'5481 lcod 36'5483 mlcod 36'5483 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.331 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.327+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5658 (0'0,36'5658] local-lis/les=21/22 n=888 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5656 crt=36'5656 lcod 36'5654 mlcod 36'5654 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.332 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.327+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5312 (0'0,36'5312] local-lis/les=21/22 n=838 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5311 crt=36'5309 lcod 36'5309 mlcod 36'5309 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.336 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.331+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5488 (0'0,36'5488] local-lis/les=21/22 n=877 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5485 crt=36'5485 lcod 36'5483 mlcod 36'5483 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.336 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.334+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5331 (0'0,36'5331] local-lis/les=21/22 n=777 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5331 lcod 36'5329 mlcod 36'5329 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.337 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.332+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5603 (0'0,36'5603] local-lis/les=21/22 n=864 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5603 lcod 36'5601 mlcod 36'5601 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.338 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.336+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5605 (0'0,36'5605] local-lis/les=21/22 n=862 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5603 crt=36'5603 lcod 36'5601 mlcod 36'5601 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.338 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.334+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5314 (0'0,36'5314] local-lis/les=21/22 n=836 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5311 crt=36'5311 lcod 36'5309 mlcod 36'5309 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.339 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.335+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5457 (0'0,36'5457] local-lis/les=21/22 n=816 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5457 lcod 36'5455 mlcod 36'5455 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.339 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.337+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5333 (0'0,36'5333] local-lis/les=21/22 n=775 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5331 crt=36'5331 lcod 36'5329 mlcod 36'5329 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.341 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.339+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5459 (0'0,36'5459] local-lis/les=21/22 n=814 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5457 crt=36'5457 lcod 36'5455 mlcod 36'5455 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.344 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.341+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5330 (0'0,36'5330] local-lis/les=21/22 n=741 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5330 lcod 36'5329 mlcod 36'5329 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.348 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.346+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5332 (0'0,36'5332] local-lis/les=21/22 n=739 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5330 crt=36'5330 lcod 36'5329 mlcod 36'5329 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.355 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.353+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5429 (0'0,36'5429] local-lis/les=21/22 n=843 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5429 lcod 36'5427 mlcod 36'5427 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.356 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.350+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5607 (0'0,36'5607] local-lis/les=21/22 n=860 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5607 lcod 36'5605 mlcod 36'5605 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.356 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.354+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5335 (0'0,36'5335] local-lis/les=21/22 n=773 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5335 lcod 36'5333 mlcod 36'5333 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.359 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.357+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5431 (0'0,36'5431] local-lis/les=21/22 n=841 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5429 crt=36'5429 lcod 36'5427 mlcod 36'5427 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.359 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.351+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5660 (0'0,36'5660] local-lis/les=21/22 n=886 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5660 lcod 36'5658 mlcod 36'5658 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.359 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.357+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5337 (0'0,36'5337] local-lis/les=21/22 n=771 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5335 crt=36'5335 lcod 36'5333 mlcod 36'5333 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.360 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.358+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5662 (0'0,36'5662] local-lis/les=21/22 n=884 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5660 crt=36'5660 lcod 36'5658 mlcod 36'5658 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.364 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.361+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5334 (0'0,36'5334] local-lis/les=21/22 n=737 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5334 lcod 36'5332 mlcod 36'5332 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.365 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.354+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5609 (0'0,36'5609] local-lis/les=21/22 n=858 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5607 crt=36'5607 lcod 36'5605 mlcod 36'5605 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.369 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.366+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5462 (0'0,36'5462] local-lis/les=21/22 n=811 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5462 lcod 36'5461 mlcod 36'5461 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.370 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.367+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5491 (0'0,36'5491] local-lis/les=21/22 n=874 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5491 lcod 36'5490 mlcod 36'5490 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.374 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.372+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5493 (0'0,36'5493] local-lis/les=21/22 n=872 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5491 crt=36'5491 lcod 36'5490 mlcod 36'5490 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.375 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.368+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5316 (0'0,36'5316] local-lis/les=21/22 n=834 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5316 lcod 36'5314 mlcod 36'5314 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.376 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.370+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5464 (0'0,36'5464] local-lis/les=21/22 n=809 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5462 crt=36'5462 lcod 36'5461 mlcod 36'5461 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.376 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.372+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5318 (0'0,36'5318] local-lis/les=21/22 n=832 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5316 crt=36'5316 lcod 36'5314 mlcod 36'5314 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.377 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.365+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5336 (0'0,36'5336] local-lis/les=21/22 n=735 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5334 crt=36'5334 lcod 36'5332 mlcod 36'5332 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.380 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.374+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5664 (0'0,36'5664] local-lis/les=21/22 n=882 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5664 lcod 36'5662 mlcod 36'5662 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.381 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.379+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5341 (0'0,36'5341] local-lis/les=21/22 n=767 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5339 crt=36'5335 lcod 36'5337 mlcod 36'5337 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.382 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.378+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5666 (0'0,36'5666] local-lis/les=21/22 n=880 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5664 crt=36'5664 lcod 36'5662 mlcod 36'5662 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.382 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.376+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5433 (0'0,36'5433] local-lis/les=21/22 n=839 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5433 lcod 36'5431 mlcod 36'5431 active+clean+snaptrim trimq=[1ff~29] ps=[1fe~1]] removing snap head 2020-02-11T16:31:29.385 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.383+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5343 (0'0,36'5343] local-lis/les=21/22 n=765 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5339 crt=36'5339 lcod 36'5337 mlcod 36'5337 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.389 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.386+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5320 (0'0,36'5320] local-lis/les=21/22 n=830 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5320 lcod 36'5318 mlcod 36'5318 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.395 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.392+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5338 (0'0,36'5338] local-lis/les=21/22 n=733 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5338 lcod 36'5336 mlcod 36'5336 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.396 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.394+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5435 (0'0,36'5435] local-lis/les=21/22 n=837 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5435 lcod 36'5433 mlcod 36'5433 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.396 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.389+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5611 (0'0,36'5611] local-lis/les=21/22 n=856 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5611 lcod 36'5609 mlcod 36'5609 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.397 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.390+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5495 (0'0,36'5495] local-lis/les=21/22 n=870 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5495 lcod 36'5493 mlcod 36'5493 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.397 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.393+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5613 (0'0,36'5613] local-lis/les=21/22 n=854 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5611 crt=36'5611 lcod 36'5609 mlcod 36'5609 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.398 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.394+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5497 (0'0,36'5497] local-lis/les=21/22 n=868 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5495 crt=36'5495 lcod 36'5493 mlcod 36'5493 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.400 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.398+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5668 (0'0,36'5668] local-lis/les=21/22 n=878 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5668 lcod 36'5666 mlcod 36'5666 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.400 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.398+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5437 (0'0,36'5437] local-lis/les=21/22 n=835 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5435 crt=36'5435 lcod 36'5433 mlcod 36'5433 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.401 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.399+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5322 (0'0,36'5322] local-lis/les=21/22 n=828 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5320 crt=36'5320 lcod 36'5318 mlcod 36'5318 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.402 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.400+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5340 (0'0,36'5340] local-lis/les=21/22 n=731 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5338 crt=36'5338 lcod 36'5336 mlcod 36'5336 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.403 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.400+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5466 (0'0,36'5466] local-lis/les=21/22 n=807 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5466 lcod 36'5464 mlcod 36'5464 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.411 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.406+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5346 (0'0,36'5346] local-lis/les=21/22 n=762 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5346 lcod 36'5345 mlcod 36'5345 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.412 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.406+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5670 (0'0,36'5670] local-lis/les=21/22 n=876 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5668 crt=36'5668 lcod 36'5666 mlcod 36'5666 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.413 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.407+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5468 (0'0,36'5468] local-lis/les=21/22 n=805 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5466 crt=36'5466 lcod 36'5464 mlcod 36'5464 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.416 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.412+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5348 (0'0,36'5348] local-lis/les=21/22 n=760 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5346 crt=36'5346 lcod 36'5345 mlcod 36'5345 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.419 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.417+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5325 (0'0,36'5325] local-lis/les=21/22 n=825 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5324 crt=36'5320 lcod 36'5322 mlcod 36'5322 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.422 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.420+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5342 (0'0,36'5342] local-lis/les=21/22 n=729 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5342 lcod 36'5340 mlcod 36'5340 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.424 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.422+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5439 (0'0,36'5439] local-lis/les=21/22 n=833 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5439 lcod 36'5437 mlcod 36'5437 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.426 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.423+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5344 (0'0,36'5344] local-lis/les=21/22 n=727 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5342 crt=36'5342 lcod 36'5340 mlcod 36'5340 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.426 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.424+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5672 (0'0,36'5672] local-lis/les=21/22 n=874 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5672 lcod 36'5670 mlcod 36'5670 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.426 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.424+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5327 (0'0,36'5327] local-lis/les=21/22 n=823 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5324 crt=36'5324 lcod 36'5322 mlcod 36'5322 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.429 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.427+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5350 (0'0,36'5350] local-lis/les=21/22 n=758 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5350 lcod 36'5348 mlcod 36'5348 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.430 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.425+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5441 (0'0,36'5441] local-lis/les=21/22 n=831 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5439 crt=36'5439 lcod 36'5437 mlcod 36'5437 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.431 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.428+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5674 (0'0,36'5674] local-lis/les=21/22 n=872 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5672 crt=36'5672 lcod 36'5670 mlcod 36'5670 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.432 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.430+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5615 (0'0,36'5615] local-lis/les=21/22 n=852 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5615 lcod 36'5613 mlcod 36'5613 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.433 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.431+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5352 (0'0,36'5352] local-lis/les=21/22 n=756 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5350 crt=36'5350 lcod 36'5348 mlcod 36'5348 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.440 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.435+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5501 (0'0,36'5501] local-lis/les=21/22 n=864 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5500 crt=36'5500 lcod 36'5499 mlcod 36'5499 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.441 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.439+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5503 (0'0,36'5503] local-lis/les=21/22 n=862 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5500 crt=36'5500 lcod 36'5499 mlcod 36'5499 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.444 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.440+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5470 (0'0,36'5470] local-lis/les=21/22 n=803 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5470 lcod 36'5468 mlcod 36'5468 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.446 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.444+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5330 (0'0,36'5330] local-lis/les=21/22 n=820 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5329 crt=36'5325 lcod 36'5327 mlcod 36'5327 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.447 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.444+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5472 (0'0,36'5472] local-lis/les=21/22 n=801 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5470 crt=36'5470 lcod 36'5468 mlcod 36'5468 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.449 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.446+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5346 (0'0,36'5346] local-lis/les=21/22 n=725 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5346 lcod 36'5344 mlcod 36'5344 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.451 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.448+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5617 (0'0,36'5617] local-lis/les=21/22 n=850 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5617 lcod 36'5615 mlcod 36'5615 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.453 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.451+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5676 (0'0,36'5676] local-lis/les=21/22 n=870 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5676 lcod 36'5674 mlcod 36'5674 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.453 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.452+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5443 (0'0,36'5443] local-lis/les=21/22 n=829 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5443 lcod 36'5441 mlcod 36'5441 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.454 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.451+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5619 (0'0,36'5619] local-lis/les=21/22 n=848 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5617 crt=36'5617 lcod 36'5615 mlcod 36'5615 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.457 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.454+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5678 (0'0,36'5678] local-lis/les=21/22 n=868 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5676 crt=36'5676 lcod 36'5674 mlcod 36'5674 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.457 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.455+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5348 (0'0,36'5348] local-lis/les=21/22 n=723 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5346 crt=36'5346 lcod 36'5344 mlcod 36'5344 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.460 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.456+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5445 (0'0,36'5445] local-lis/les=21/22 n=827 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5443 crt=36'5443 lcod 36'5441 mlcod 36'5441 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.462 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.459+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5332 (0'0,36'5332] local-lis/les=21/22 n=818 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5329 crt=36'5329 lcod 36'5327 mlcod 36'5327 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.463 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.456+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5354 (0'0,36'5354] local-lis/les=21/22 n=754 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5354 lcod 36'5352 mlcod 36'5352 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.463 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.460+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5505 (0'0,36'5505] local-lis/les=21/22 n=860 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5505 lcod 36'5503 mlcod 36'5503 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.470 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.463+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5474 (0'0,36'5474] local-lis/les=21/22 n=799 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5474 lcod 36'5472 mlcod 36'5472 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.477 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.471+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5476 (0'0,36'5476] local-lis/les=21/22 n=797 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5474 crt=36'5474 lcod 36'5472 mlcod 36'5472 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.477 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.474+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5350 (0'0,36'5350] local-lis/les=21/22 n=721 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5350 lcod 36'5348 mlcod 36'5348 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.482 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.472+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5621 (0'0,36'5621] local-lis/les=21/22 n=846 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5621 lcod 36'5619 mlcod 36'5619 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.483 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.478+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5357 (0'0,36'5357] local-lis/les=21/22 n=751 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5356 crt=36'5354 lcod 36'5354 mlcod 36'5354 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.483 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.481+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5448 (0'0,36'5448] local-lis/les=21/22 n=824 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5447 crt=36'5443 lcod 36'5445 mlcod 36'5445 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.483 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.476+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5623 (0'0,36'5623] local-lis/les=21/22 n=844 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5621 crt=36'5621 lcod 36'5619 mlcod 36'5619 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.483 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.479+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5352 (0'0,36'5352] local-lis/les=21/22 n=719 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5350 crt=36'5350 lcod 36'5348 mlcod 36'5348 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.484 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.479+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5680 (0'0,36'5680] local-lis/les=21/22 n=866 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5680 lcod 36'5678 mlcod 36'5678 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.484 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.480+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5334 (0'0,36'5334] local-lis/les=21/22 n=816 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5334 lcod 36'5332 mlcod 36'5332 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.488 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.485+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5336 (0'0,36'5336] local-lis/les=21/22 n=814 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5334 crt=36'5334 lcod 36'5332 mlcod 36'5332 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.490 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.488+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5359 (0'0,36'5359] local-lis/les=21/22 n=749 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5356 crt=36'5356 lcod 36'5354 mlcod 36'5354 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.492 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.486+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5682 (0'0,36'5682] local-lis/les=21/22 n=864 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5680 crt=36'5680 lcod 36'5678 mlcod 36'5678 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.492 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.485+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5509 (0'0,36'5509] local-lis/les=21/22 n=857 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5509 lcod 36'5507 mlcod 36'5507 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.492 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.489+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5511 (0'0,36'5511] local-lis/les=21/22 n=855 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5509 crt=36'5509 lcod 36'5507 mlcod 36'5507 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.494 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.492+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5478 (0'0,36'5478] local-lis/les=21/22 n=795 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5478 lcod 36'5476 mlcod 36'5476 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.497 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.493+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5450 (0'0,36'5450] local-lis/les=21/22 n=822 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5447 crt=36'5447 lcod 36'5445 mlcod 36'5445 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.502 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.498+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5480 (0'0,36'5480] local-lis/les=21/22 n=793 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5478 crt=36'5478 lcod 36'5476 mlcod 36'5476 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.506 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.500+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5625 (0'0,36'5625] local-lis/les=21/22 n=842 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5625 lcod 36'5623 mlcod 36'5623 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.507 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.503+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5627 (0'0,36'5627] local-lis/les=21/22 n=840 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5625 crt=36'5625 lcod 36'5623 mlcod 36'5623 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.507 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.504+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5513 (0'0,36'5513] local-lis/les=21/22 n=853 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5513 lcod 36'5511 mlcod 36'5511 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.509 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.506+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5339 (0'0,36'5339] local-lis/les=21/22 n=811 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5338 crt=36'5338 lcod 36'5336 mlcod 36'5336 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.510 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.506+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5361 (0'0,36'5361] local-lis/les=21/22 n=747 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5361 lcod 36'5359 mlcod 36'5359 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.511 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.508+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5453 (0'0,36'5453] local-lis/les=21/22 n=819 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5452 crt=36'5448 lcod 36'5450 mlcod 36'5450 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.512 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.510+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5354 (0'0,36'5354] local-lis/les=21/22 n=717 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5354 lcod 36'5352 mlcod 36'5352 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.516 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.513+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5482 (0'0,36'5482] local-lis/les=21/22 n=791 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5482 lcod 36'5480 mlcod 36'5480 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.517 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.513+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5363 (0'0,36'5363] local-lis/les=21/22 n=745 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5361 crt=36'5361 lcod 36'5359 mlcod 36'5359 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.518 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.514+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5341 (0'0,36'5341] local-lis/les=21/22 n=809 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5338 crt=36'5338 lcod 36'5336 mlcod 36'5336 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.518 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.514+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5684 (0'0,36'5684] local-lis/les=21/22 n=862 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5684 lcod 36'5682 mlcod 36'5682 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.518 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.515+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5356 (0'0,36'5356] local-lis/les=21/22 n=715 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5354 crt=36'5354 lcod 36'5352 mlcod 36'5352 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.520 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.516+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5484 (0'0,36'5484] local-lis/les=21/22 n=789 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5482 crt=36'5482 lcod 36'5480 mlcod 36'5480 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.522 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.519+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5515 (0'0,36'5515] local-lis/les=21/22 n=851 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5513 crt=36'5513 lcod 36'5511 mlcod 36'5511 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.522 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.519+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5686 (0'0,36'5686] local-lis/les=21/22 n=860 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5684 crt=36'5684 lcod 36'5682 mlcod 36'5682 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.523 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.516+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5455 (0'0,36'5455] local-lis/les=21/22 n=817 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5452 crt=36'5452 lcod 36'5450 mlcod 36'5450 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.531 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.528+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5629 (0'0,36'5629] local-lis/les=21/22 n=838 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5629 lcod 36'5627 mlcod 36'5627 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.532 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.529+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5358 (0'0,36'5358] local-lis/les=21/22 n=713 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5358 lcod 36'5356 mlcod 36'5356 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.536 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.534+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5360 (0'0,36'5360] local-lis/les=21/22 n=711 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5358 crt=36'5358 lcod 36'5356 mlcod 36'5356 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.537 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.533+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5631 (0'0,36'5631] local-lis/les=21/22 n=836 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5629 crt=36'5629 lcod 36'5627 mlcod 36'5627 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.537 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.534+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5517 (0'0,36'5517] local-lis/les=21/22 n=849 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5517 lcod 36'5515 mlcod 36'5515 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.539 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.537+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5487 (0'0,36'5487] local-lis/les=21/22 n=786 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5486 crt=36'5482 lcod 36'5484 mlcod 36'5484 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.540 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.538+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5343 (0'0,36'5343] local-lis/les=21/22 n=807 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5343 lcod 36'5341 mlcod 36'5341 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.541 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.538+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5365 (0'0,36'5365] local-lis/les=21/22 n=743 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5365 lcod 36'5363 mlcod 36'5363 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.546 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.543+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5367 (0'0,36'5367] local-lis/les=21/22 n=741 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5365 crt=36'5365 lcod 36'5363 mlcod 36'5363 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.549 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.546+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5489 (0'0,36'5489] local-lis/les=21/22 n=784 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5486 crt=36'5486 lcod 36'5484 mlcod 36'5484 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.550 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.544+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5457 (0'0,36'5457] local-lis/les=21/22 n=815 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5457 lcod 36'5455 mlcod 36'5455 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.550 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.547+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5459 (0'0,36'5459] local-lis/les=21/22 n=813 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5457 crt=36'5457 lcod 36'5455 mlcod 36'5455 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.551 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.546+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5688 (0'0,36'5688] local-lis/les=21/22 n=858 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5688 lcod 36'5686 mlcod 36'5686 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.552 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.549+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5345 (0'0,36'5345] local-lis/les=21/22 n=805 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5343 crt=36'5343 lcod 36'5341 mlcod 36'5341 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.557 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.549+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5690 (0'0,36'5690] local-lis/les=21/22 n=856 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5688 crt=36'5688 lcod 36'5686 mlcod 36'5686 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.557 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.556+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5369 (0'0,36'5369] local-lis/les=21/22 n=739 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5369 lcod 36'5367 mlcod 36'5367 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.558 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.552+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5633 (0'0,36'5633] local-lis/les=21/22 n=834 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5633 lcod 36'5631 mlcod 36'5631 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.558 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.553+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5520 (0'0,36'5520] local-lis/les=21/22 n=846 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5520 lcod 36'5519 mlcod 36'5519 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.559 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.556+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5635 (0'0,36'5635] local-lis/les=21/22 n=832 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5633 crt=36'5633 lcod 36'5631 mlcod 36'5631 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.563 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.561+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5371 (0'0,36'5371] local-lis/les=21/22 n=737 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5369 crt=36'5369 lcod 36'5367 mlcod 36'5367 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.564 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.558+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5522 (0'0,36'5522] local-lis/les=21/22 n=844 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5520 crt=36'5520 lcod 36'5519 mlcod 36'5519 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.568 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.566+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5462 (0'0,36'5462] local-lis/les=21/22 n=810 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5461 crt=36'5457 lcod 36'5459 mlcod 36'5459 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.569 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.566+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5491 (0'0,36'5491] local-lis/les=21/22 n=782 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5491 lcod 36'5489 mlcod 36'5489 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.570 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.568+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5347 (0'0,36'5347] local-lis/les=21/22 n=803 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5347 lcod 36'5345 mlcod 36'5345 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.571 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.568+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5363 (0'0,36'5363] local-lis/les=21/22 n=708 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5362 crt=36'5358 lcod 36'5360 mlcod 36'5360 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.574 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.571+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5349 (0'0,36'5349] local-lis/les=21/22 n=801 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5347 crt=36'5347 lcod 36'5345 mlcod 36'5345 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.574 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.572+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5692 (0'0,36'5692] local-lis/les=21/22 n=854 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5692 lcod 36'5690 mlcod 36'5690 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.575 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.571+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5464 (0'0,36'5464] local-lis/les=21/22 n=808 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5461 crt=36'5461 lcod 36'5459 mlcod 36'5459 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.575 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.572+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5365 (0'0,36'5365] local-lis/les=21/22 n=706 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5362 crt=36'5362 lcod 36'5360 mlcod 36'5360 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.579 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.576+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5493 (0'0,36'5493] local-lis/les=21/22 n=780 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5491 crt=36'5491 lcod 36'5489 mlcod 36'5489 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.583 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.580+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5373 (0'0,36'5373] local-lis/les=21/22 n=735 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5373 lcod 36'5371 mlcod 36'5371 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.584 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.582+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5694 (0'0,36'5694] local-lis/les=21/22 n=852 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5692 crt=36'5692 lcod 36'5690 mlcod 36'5690 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.585 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.583+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5375 (0'0,36'5375] local-lis/les=21/22 n=733 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5373 crt=36'5373 lcod 36'5371 mlcod 36'5371 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.588 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.583+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5637 (0'0,36'5637] local-lis/les=21/22 n=830 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5637 lcod 36'5635 mlcod 36'5635 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.588 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.586+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5524 (0'0,36'5524] local-lis/les=21/22 n=842 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5524 lcod 36'5522 mlcod 36'5522 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.589 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.587+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5639 (0'0,36'5639] local-lis/les=21/22 n=828 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5637 crt=36'5637 lcod 36'5635 mlcod 36'5635 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.592 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.589+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5526 (0'0,36'5526] local-lis/les=21/22 n=840 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5524 crt=36'5524 lcod 36'5522 mlcod 36'5522 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.595 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.593+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5466 (0'0,36'5466] local-lis/les=21/22 n=806 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5466 lcod 36'5464 mlcod 36'5464 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.601 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.599+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5351 (0'0,36'5351] local-lis/les=21/22 n=799 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5351 lcod 36'5349 mlcod 36'5349 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.601 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.600+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5468 (0'0,36'5468] local-lis/les=21/22 n=804 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5466 crt=36'5466 lcod 36'5464 mlcod 36'5464 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.603 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.588+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5368 (0'0,36'5368] local-lis/les=21/22 n=703 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5367 crt=36'5363 lcod 36'5365 mlcod 36'5365 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.604 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.601+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5495 (0'0,36'5495] local-lis/les=21/22 n=778 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5495 lcod 36'5493 mlcod 36'5493 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.608 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.597+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5370 (0'0,36'5370] local-lis/les=21/22 n=701 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5367 crt=36'5367 lcod 36'5365 mlcod 36'5365 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.608 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.606+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5353 (0'0,36'5353] local-lis/les=21/22 n=797 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5351 crt=36'5351 lcod 36'5349 mlcod 36'5349 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.609 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.601+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5696 (0'0,36'5696] local-lis/les=21/22 n=850 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5696 lcod 36'5694 mlcod 36'5694 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.610 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.605+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5698 (0'0,36'5698] local-lis/les=21/22 n=848 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5696 crt=36'5696 lcod 36'5694 mlcod 36'5694 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.611 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.609+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5641 (0'0,36'5641] local-lis/les=21/22 n=826 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5641 lcod 36'5639 mlcod 36'5639 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.612 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.606+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5377 (0'0,36'5377] local-lis/les=21/22 n=731 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5377 lcod 36'5375 mlcod 36'5375 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.613 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.611+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5497 (0'0,36'5497] local-lis/les=21/22 n=776 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5495 crt=36'5495 lcod 36'5493 mlcod 36'5493 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.613 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.609+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5379 (0'0,36'5379] local-lis/les=21/22 n=729 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5377 crt=36'5377 lcod 36'5375 mlcod 36'5375 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.619 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.617+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5470 (0'0,36'5470] local-lis/les=21/22 n=802 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5470 lcod 36'5468 mlcod 36'5468 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.621 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.618+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5529 (0'0,36'5529] local-lis/les=21/22 n=837 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5529 lcod 36'5528 mlcod 36'5528 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.621 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.619+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5643 (0'0,36'5643] local-lis/les=21/22 n=824 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5641 crt=36'5641 lcod 36'5639 mlcod 36'5639 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.626 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.620+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5372 (0'0,36'5372] local-lis/les=21/22 n=699 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5372 lcod 36'5370 mlcod 36'5370 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.626 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.620+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5700 (0'0,36'5700] local-lis/les=21/22 n=846 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5700 lcod 36'5698 mlcod 36'5698 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.629 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.623+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5702 (0'0,36'5702] local-lis/les=21/22 n=844 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5700 crt=36'5700 lcod 36'5698 mlcod 36'5698 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.629 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.623+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5374 (0'0,36'5374] local-lis/les=21/22 n=697 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5372 crt=36'5372 lcod 36'5370 mlcod 36'5370 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.629 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.625+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5531 (0'0,36'5531] local-lis/les=21/22 n=835 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5529 crt=36'5529 lcod 36'5528 mlcod 36'5528 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.632 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.628+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5356 (0'0,36'5356] local-lis/les=21/22 n=794 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5355 crt=36'5353 lcod 36'5353 mlcod 36'5353 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.632 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.630+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5499 (0'0,36'5499] local-lis/les=21/22 n=774 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5499 lcod 36'5497 mlcod 36'5497 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.634 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.632+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5472 (0'0,36'5472] local-lis/les=21/22 n=800 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5470 crt=36'5470 lcod 36'5468 mlcod 36'5468 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.637 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.633+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5501 (0'0,36'5501] local-lis/les=21/22 n=772 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5499 crt=36'5499 lcod 36'5497 mlcod 36'5497 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.638 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.635+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5358 (0'0,36'5358] local-lis/les=21/22 n=792 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5355 crt=36'5355 lcod 36'5353 mlcod 36'5353 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.645 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.643+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5376 (0'0,36'5376] local-lis/les=21/22 n=695 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5376 lcod 36'5374 mlcod 36'5374 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.646 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.636+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5382 (0'0,36'5382] local-lis/les=21/22 n=726 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5382 lcod 36'5381 mlcod 36'5381 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.647 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.644+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5533 (0'0,36'5533] local-lis/les=21/22 n=833 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5533 lcod 36'5531 mlcod 36'5531 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.647 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.644+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5384 (0'0,36'5384] local-lis/les=21/22 n=724 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5382 crt=36'5382 lcod 36'5381 mlcod 36'5381 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.649 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.646+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5704 (0'0,36'5704] local-lis/les=21/22 n=842 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5704 lcod 36'5702 mlcod 36'5702 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.649 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.647+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5378 (0'0,36'5378] local-lis/les=21/22 n=693 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5376 crt=36'5376 lcod 36'5374 mlcod 36'5374 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.652 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.650+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5645 (0'0,36'5645] local-lis/les=21/22 n=822 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5645 lcod 36'5643 mlcod 36'5643 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.653 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.650+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5706 (0'0,36'5706] local-lis/les=21/22 n=840 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5704 crt=36'5704 lcod 36'5702 mlcod 36'5702 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.653 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.650+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5503 (0'0,36'5503] local-lis/les=21/22 n=770 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5503 lcod 36'5501 mlcod 36'5501 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.654 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.652+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5474 (0'0,36'5474] local-lis/les=21/22 n=798 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5474 lcod 36'5472 mlcod 36'5472 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.655 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.653+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5535 (0'0,36'5535] local-lis/les=21/22 n=831 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5533 crt=36'5533 lcod 36'5531 mlcod 36'5531 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.657 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.656+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5476 (0'0,36'5476] local-lis/les=21/22 n=796 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5474 crt=36'5474 lcod 36'5472 mlcod 36'5472 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.658 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.654+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5505 (0'0,36'5505] local-lis/les=21/22 n=768 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5503 crt=36'5503 lcod 36'5501 mlcod 36'5501 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.659 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.657+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5647 (0'0,36'5647] local-lis/les=21/22 n=820 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5645 crt=36'5645 lcod 36'5643 mlcod 36'5643 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.660+0000 7fd8a2c21700 1 -- 172.21.15.88:0/3027223525 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd8780036e0 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.661+0000 7fd8a09bd700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:29.663 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.661+0000 7fd899ffb700 1 -- 172.21.15.88:0/3027223525 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fd88c031830 con 0x7fd89c0a5ec0 2020-02-11T16:31:29.664 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":216,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.663+0000 7fd8a2c21700 1 -- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd87c039d10 msgr2=0x7fd87c03c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.663+0000 7fd8a2c21700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd87c039d10 0x7fd87c03c1d0 crc :-1 s=READY pgs=566 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.663+0000 7fd8a2c21700 1 -- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 msgr2=0x7fd89c133dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.663+0000 7fd8a2c21700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fd89c1290e0 tx=0x7fd88c010a70).stop 2020-02-11T16:31:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.663+0000 7fd8a2c21700 1 -- 172.21.15.88:0/3027223525 shutdown_connections 2020-02-11T16:31:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.663+0000 7fd8a2c21700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd87c039d10 0x7fd87c03c1d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:29.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.663+0000 7fd8a2c21700 1 --2- 172.21.15.88:0/3027223525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd89c0a5ec0 0x7fd89c133dc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:29.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.663+0000 7fd8a2c21700 1 -- 172.21.15.88:0/3027223525 >> 172.21.15.88:0/3027223525 conn(0x7fd89c09d110 msgr2=0x7fd89c05a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:29.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.663+0000 7fd8a2c21700 1 -- 172.21.15.88:0/3027223525 shutdown_connections 2020-02-11T16:31:29.667 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:29.663+0000 7fd8a2c21700 1 -- 172.21.15.88:0/3027223525 wait complete. 2020-02-11T16:31:29.668 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.665+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5360 (0'0,36'5360] local-lis/les=21/22 n=790 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5360 lcod 36'5358 mlcod 36'5358 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.671 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.669+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5362 (0'0,36'5362] local-lis/les=21/22 n=788 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5360 crt=36'5360 lcod 36'5358 mlcod 36'5358 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.671 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.669+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5537 (0'0,36'5537] local-lis/les=21/22 n=829 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5537 lcod 36'5535 mlcod 36'5535 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.673 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.670+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5387 (0'0,36'5387] local-lis/les=21/22 n=721 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5387 lcod 36'5386 mlcod 36'5386 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.675 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.673+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5539 (0'0,36'5539] local-lis/les=21/22 n=827 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5537 crt=36'5537 lcod 36'5535 mlcod 36'5535 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.677 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.675+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5478 (0'0,36'5478] local-lis/les=21/22 n=794 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5478 lcod 36'5476 mlcod 36'5476 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.680 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.678+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5649 (0'0,36'5649] local-lis/les=21/22 n=818 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5649 lcod 36'5647 mlcod 36'5647 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.684 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.680+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5507 (0'0,36'5507] local-lis/les=21/22 n=766 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5507 lcod 36'5505 mlcod 36'5505 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.684 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.682+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5651 (0'0,36'5651] local-lis/les=21/22 n=816 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5649 crt=36'5649 lcod 36'5647 mlcod 36'5647 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.686 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.684+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5509 (0'0,36'5509] local-lis/les=21/22 n=764 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5507 crt=36'5507 lcod 36'5505 mlcod 36'5505 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.687 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.681+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5480 (0'0,36'5480] local-lis/les=21/22 n=792 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5478 crt=36'5478 lcod 36'5476 mlcod 36'5476 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.689 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.679+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5708 (0'0,36'5708] local-lis/les=21/22 n=838 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5708 lcod 36'5706 mlcod 36'5706 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.689 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.682+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5710 (0'0,36'5710] local-lis/les=21/22 n=836 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5708 crt=36'5708 lcod 36'5706 mlcod 36'5706 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.689 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.684+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5382 (0'0,36'5382] local-lis/les=21/22 n=689 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5381 crt=36'5376 lcod 36'5380 mlcod 36'5380 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.690 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":216,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:29.690 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.680+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5389 (0'0,36'5389] local-lis/les=21/22 n=719 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5387 crt=36'5387 lcod 36'5386 mlcod 36'5386 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.690 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.688+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5384 (0'0,36'5384] local-lis/les=21/22 n=687 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5381 crt=36'5381 lcod 36'5380 mlcod 36'5380 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.695 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.693+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5541 (0'0,36'5541] local-lis/les=21/22 n=825 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5541 lcod 36'5539 mlcod 36'5539 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.698 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.695+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5364 (0'0,36'5364] local-lis/les=21/22 n=786 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5364 lcod 36'5362 mlcod 36'5362 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.698 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.696+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5543 (0'0,36'5543] local-lis/les=21/22 n=823 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5541 crt=36'5541 lcod 36'5539 mlcod 36'5539 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.700 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.698+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5366 (0'0,36'5366] local-lis/les=21/22 n=784 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5364 crt=36'5364 lcod 36'5362 mlcod 36'5362 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.702 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.700+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5392 (0'0,36'5392] local-lis/les=21/22 n=716 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5392 lcod 36'5391 mlcod 36'5391 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.704 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.702+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5653 (0'0,36'5653] local-lis/les=21/22 n=814 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5653 lcod 36'5651 mlcod 36'5651 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.707 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.704+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5386 (0'0,36'5386] local-lis/les=21/22 n=685 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5386 lcod 36'5384 mlcod 36'5384 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.708 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.707+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5394 (0'0,36'5394] local-lis/les=21/22 n=714 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5392 crt=36'5392 lcod 36'5391 mlcod 36'5391 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.711 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.708+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5655 (0'0,36'5655] local-lis/les=21/22 n=812 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5653 crt=36'5653 lcod 36'5651 mlcod 36'5651 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.711 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.709+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5388 (0'0,36'5388] local-lis/les=21/22 n=683 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5386 crt=36'5386 lcod 36'5384 mlcod 36'5384 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.712 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.710+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5482 (0'0,36'5482] local-lis/les=21/22 n=790 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5482 lcod 36'5480 mlcod 36'5480 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.713 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.711+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5712 (0'0,36'5712] local-lis/les=21/22 n=834 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5712 lcod 36'5710 mlcod 36'5710 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.716 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.711+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5511 (0'0,36'5511] local-lis/les=21/22 n=762 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5511 lcod 36'5509 mlcod 36'5509 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.717 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.714+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5484 (0'0,36'5484] local-lis/les=21/22 n=788 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5482 crt=36'5482 lcod 36'5480 mlcod 36'5480 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.717 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.714+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5513 (0'0,36'5513] local-lis/les=21/22 n=760 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5511 crt=36'5511 lcod 36'5509 mlcod 36'5509 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.721 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.719+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5546 (0'0,36'5546] local-lis/les=21/22 n=820 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5546 lcod 36'5545 mlcod 36'5545 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.722 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.719+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5714 (0'0,36'5714] local-lis/les=21/22 n=832 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5712 crt=36'5712 lcod 36'5710 mlcod 36'5710 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.729 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.725+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5390 (0'0,36'5390] local-lis/les=21/22 n=681 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5390 lcod 36'5388 mlcod 36'5388 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.729 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.726+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5369 (0'0,36'5369] local-lis/les=21/22 n=781 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5368 crt=36'5364 lcod 36'5366 mlcod 36'5366 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.731 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.728+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5392 (0'0,36'5392] local-lis/les=21/22 n=679 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5390 crt=36'5390 lcod 36'5388 mlcod 36'5388 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.731 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.729+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5396 (0'0,36'5396] local-lis/les=21/22 n=712 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5396 lcod 36'5394 mlcod 36'5394 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.733 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.728+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5548 (0'0,36'5548] local-lis/les=21/22 n=818 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5546 crt=36'5546 lcod 36'5545 mlcod 36'5545 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.733 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.728+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5657 (0'0,36'5657] local-lis/les=21/22 n=810 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5657 lcod 36'5655 mlcod 36'5655 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.734 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.732+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5659 (0'0,36'5659] local-lis/les=21/22 n=808 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5657 crt=36'5657 lcod 36'5655 mlcod 36'5655 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.740 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.737+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5398 (0'0,36'5398] local-lis/les=21/22 n=710 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5396 crt=36'5396 lcod 36'5394 mlcod 36'5394 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.742 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.739+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5515 (0'0,36'5515] local-lis/les=21/22 n=758 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5515 lcod 36'5513 mlcod 36'5513 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.743 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.741+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5394 (0'0,36'5394] local-lis/les=21/22 n=677 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5394 lcod 36'5392 mlcod 36'5392 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.747 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.745+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5486 (0'0,36'5486] local-lis/les=21/22 n=786 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5486 lcod 36'5484 mlcod 36'5484 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.749 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.743+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5718 (0'0,36'5718] local-lis/les=21/22 n=829 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5716 crt=36'5716 lcod 36'5714 mlcod 36'5714 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.750 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.745+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5396 (0'0,36'5396] local-lis/les=21/22 n=675 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5394 crt=36'5394 lcod 36'5392 mlcod 36'5392 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.750 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.747+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5371 (0'0,36'5371] local-lis/les=21/22 n=779 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5371 lcod 36'5369 mlcod 36'5369 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.751 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.749+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5488 (0'0,36'5488] local-lis/les=21/22 n=784 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5486 crt=36'5486 lcod 36'5484 mlcod 36'5484 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.753 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.751+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5373 (0'0,36'5373] local-lis/les=21/22 n=777 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5371 crt=36'5371 lcod 36'5369 mlcod 36'5369 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.754 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.752+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5401 (0'0,36'5401] local-lis/les=21/22 n=707 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5400 crt=36'5396 lcod 36'5398 mlcod 36'5398 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.757 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.750+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5551 (0'0,36'5551] local-lis/les=21/22 n=815 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5551 lcod 36'5550 mlcod 36'5550 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.757 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.751+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5661 (0'0,36'5661] local-lis/les=21/22 n=806 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5661 lcod 36'5659 mlcod 36'5659 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.758 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.755+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5553 (0'0,36'5553] local-lis/les=21/22 n=813 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5551 crt=36'5551 lcod 36'5550 mlcod 36'5550 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.760 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.758+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5663 (0'0,36'5663] local-lis/les=21/22 n=804 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5661 crt=36'5661 lcod 36'5659 mlcod 36'5659 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.761 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.757+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5403 (0'0,36'5403] local-lis/les=21/22 n=705 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5400 crt=36'5400 lcod 36'5398 mlcod 36'5398 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.764 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.762+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5517 (0'0,36'5517] local-lis/les=21/22 n=756 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5517 lcod 36'5515 mlcod 36'5515 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.765 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.762+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5399 (0'0,36'5399] local-lis/les=21/22 n=672 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5398 crt=36'5394 lcod 36'5396 mlcod 36'5396 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.769 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.765+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5519 (0'0,36'5519] local-lis/les=21/22 n=754 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5517 crt=36'5517 lcod 36'5515 mlcod 36'5515 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.769 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.766+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5375 (0'0,36'5375] local-lis/les=21/22 n=775 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5375 lcod 36'5373 mlcod 36'5373 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.770 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.768+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5401 (0'0,36'5401] local-lis/les=21/22 n=670 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5398 crt=36'5398 lcod 36'5396 mlcod 36'5396 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.772 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.770+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5377 (0'0,36'5377] local-lis/les=21/22 n=773 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5375 crt=36'5375 lcod 36'5373 mlcod 36'5373 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.772 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.770+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5720 (0'0,36'5720] local-lis/les=21/22 n=827 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5720 lcod 36'5718 mlcod 36'5718 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.774 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.772+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5555 (0'0,36'5555] local-lis/les=21/22 n=811 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5555 lcod 36'5553 mlcod 36'5553 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.778 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.775+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5557 (0'0,36'5557] local-lis/les=21/22 n=809 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5555 crt=36'5555 lcod 36'5553 mlcod 36'5553 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.780 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.778+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5722 (0'0,36'5722] local-lis/les=21/22 n=825 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5720 crt=36'5720 lcod 36'5718 mlcod 36'5718 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.781 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.779+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5405 (0'0,36'5405] local-lis/les=21/22 n=703 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5405 lcod 36'5403 mlcod 36'5403 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.782 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.779+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5665 (0'0,36'5665] local-lis/les=21/22 n=802 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5665 lcod 36'5663 mlcod 36'5663 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.785 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.783+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5491 (0'0,36'5491] local-lis/les=21/22 n=781 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5490 crt=36'5486 lcod 36'5488 mlcod 36'5488 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.785 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.783+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5667 (0'0,36'5667] local-lis/les=21/22 n=800 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5665 crt=36'5665 lcod 36'5663 mlcod 36'5663 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.789 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.783+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5521 (0'0,36'5521] local-lis/les=21/22 n=752 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5521 lcod 36'5519 mlcod 36'5519 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.790 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.787+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5523 (0'0,36'5523] local-lis/les=21/22 n=750 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5521 crt=36'5521 lcod 36'5519 mlcod 36'5519 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.790 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.788+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5379 (0'0,36'5379] local-lis/les=21/22 n=771 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5379 lcod 36'5377 mlcod 36'5377 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.792 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.788+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5407 (0'0,36'5407] local-lis/les=21/22 n=701 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5405 crt=36'5405 lcod 36'5403 mlcod 36'5403 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.793 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.790+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5493 (0'0,36'5493] local-lis/les=21/22 n=779 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5490 crt=36'5490 lcod 36'5488 mlcod 36'5488 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.793 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.791+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5381 (0'0,36'5381] local-lis/les=21/22 n=769 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5379 crt=36'5379 lcod 36'5377 mlcod 36'5377 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.794 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.791+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5724 (0'0,36'5724] local-lis/les=21/22 n=823 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5724 lcod 36'5722 mlcod 36'5722 active+clean+snaptrim trimq=[200~28] ps=[1fe~2]] removing snap head 2020-02-11T16:31:29.799 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.794+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5559 (0'0,36'5559] local-lis/les=21/22 n=807 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5559 lcod 36'5557 mlcod 36'5557 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.803 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.800+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5404 (0'0,36'5404] local-lis/les=21/22 n=667 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5403 crt=36'5403 lcod 36'5401 mlcod 36'5401 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.804 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.799+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5561 (0'0,36'5561] local-lis/les=21/22 n=805 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5559 crt=36'5559 lcod 36'5557 mlcod 36'5557 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.805 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.802+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5525 (0'0,36'5525] local-lis/les=21/22 n=748 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5525 lcod 36'5523 mlcod 36'5523 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.805 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.803+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5669 (0'0,36'5669] local-lis/les=21/22 n=798 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5669 lcod 36'5667 mlcod 36'5667 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.806 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.804+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5406 (0'0,36'5406] local-lis/les=21/22 n=665 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5403 crt=36'5403 lcod 36'5401 mlcod 36'5401 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.809 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.805+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5527 (0'0,36'5527] local-lis/les=21/22 n=746 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5525 crt=36'5525 lcod 36'5523 mlcod 36'5523 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.813 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.807+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5671 (0'0,36'5671] local-lis/les=21/22 n=796 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5669 crt=36'5669 lcod 36'5667 mlcod 36'5667 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.814 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.811+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5383 (0'0,36'5383] local-lis/les=21/22 n=767 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5383 lcod 36'5381 mlcod 36'5381 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.815 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.813+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5726 (0'0,36'5726] local-lis/les=21/22 n=821 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5726 lcod 36'5724 mlcod 36'5724 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.816 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.814+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5385 (0'0,36'5385] local-lis/les=21/22 n=765 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5383 crt=36'5383 lcod 36'5381 mlcod 36'5381 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.820 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.816+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5728 (0'0,36'5728] local-lis/les=21/22 n=819 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5726 crt=36'5726 lcod 36'5724 mlcod 36'5724 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.822 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.820+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5409 (0'0,36'5409] local-lis/les=21/22 n=662 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5408 crt=36'5406 lcod 36'5406 mlcod 36'5406 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.823 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.821+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5409 (0'0,36'5409] local-lis/les=21/22 n=699 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5409 lcod 36'5407 mlcod 36'5407 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.823 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.821+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5495 (0'0,36'5495] local-lis/les=21/22 n=777 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5495 lcod 36'5493 mlcod 36'5493 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.824 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.822+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5529 (0'0,36'5529] local-lis/les=21/22 n=744 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5529 lcod 36'5527 mlcod 36'5527 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.825 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.823+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5411 (0'0,36'5411] local-lis/les=21/22 n=660 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5408 crt=36'5408 lcod 36'5406 mlcod 36'5406 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.827 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.825+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5411 (0'0,36'5411] local-lis/les=21/22 n=697 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5409 crt=36'5409 lcod 36'5407 mlcod 36'5407 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.827 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.825+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5531 (0'0,36'5531] local-lis/les=21/22 n=742 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5529 crt=36'5529 lcod 36'5527 mlcod 36'5527 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.830 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.826+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5497 (0'0,36'5497] local-lis/les=21/22 n=775 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5495 crt=36'5495 lcod 36'5493 mlcod 36'5493 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.830 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.822+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5674 (0'0,36'5674] local-lis/les=21/22 n=793 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5673 crt=36'5669 lcod 36'5671 mlcod 36'5671 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.835 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.833+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5413 (0'0,36'5413] local-lis/les=21/22 n=658 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5413 lcod 36'5411 mlcod 36'5411 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.841 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.839+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5414 (0'0,36'5414] local-lis/les=21/22 n=694 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5413 crt=36'5409 lcod 36'5411 mlcod 36'5411 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.841 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.837+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5415 (0'0,36'5415] local-lis/les=21/22 n=656 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5413 crt=36'5413 lcod 36'5411 mlcod 36'5411 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.844 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.835+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5563 (0'0,36'5563] local-lis/les=21/22 n=803 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5563 lcod 36'5561 mlcod 36'5561 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.845 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.841+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5388 (0'0,36'5388] local-lis/les=21/22 n=762 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5387 crt=36'5385 lcod 36'5385 mlcod 36'5385 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.845 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.838+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5565 (0'0,36'5565] local-lis/les=21/22 n=801 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5563 crt=36'5563 lcod 36'5561 mlcod 36'5561 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.846 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.840+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5676 (0'0,36'5676] local-lis/les=21/22 n=791 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5676 lcod 36'5674 mlcod 36'5674 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.847 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.845+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5416 (0'0,36'5416] local-lis/les=21/22 n=692 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5413 crt=36'5413 lcod 36'5411 mlcod 36'5411 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.848 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.846+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5390 (0'0,36'5390] local-lis/les=21/22 n=760 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5387 crt=36'5387 lcod 36'5385 mlcod 36'5385 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.850 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.848+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5499 (0'0,36'5499] local-lis/les=21/22 n=773 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5499 lcod 36'5497 mlcod 36'5497 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.850 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.847+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5678 (0'0,36'5678] local-lis/les=21/22 n=789 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5676 crt=36'5676 lcod 36'5674 mlcod 36'5674 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.853 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.841+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5730 (0'0,36'5730] local-lis/les=21/22 n=817 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5730 lcod 36'5728 mlcod 36'5728 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.854 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.850+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5533 (0'0,36'5533] local-lis/les=21/22 n=740 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5533 lcod 36'5531 mlcod 36'5531 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.854 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.852+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5501 (0'0,36'5501] local-lis/les=21/22 n=771 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5499 crt=36'5499 lcod 36'5497 mlcod 36'5497 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.855 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.848+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5732 (0'0,36'5732] local-lis/les=21/22 n=815 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5730 crt=36'5730 lcod 36'5728 mlcod 36'5728 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.855 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.853+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5535 (0'0,36'5535] local-lis/les=21/22 n=738 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5533 crt=36'5533 lcod 36'5531 mlcod 36'5531 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.860 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.858+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5417 (0'0,36'5417] local-lis/les=21/22 n=654 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5417 lcod 36'5415 mlcod 36'5415 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.863 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.861+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5419 (0'0,36'5419] local-lis/les=21/22 n=652 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5417 crt=36'5417 lcod 36'5415 mlcod 36'5415 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.865 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.855+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5680 (0'0,36'5680] local-lis/les=21/22 n=787 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5680 lcod 36'5678 mlcod 36'5678 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.865 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.861+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5682 (0'0,36'5682] local-lis/les=21/22 n=785 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5680 crt=36'5680 lcod 36'5678 mlcod 36'5678 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.867 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.865+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5567 (0'0,36'5567] local-lis/les=21/22 n=799 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5567 lcod 36'5565 mlcod 36'5565 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.871 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.869+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5393 (0'0,36'5393] local-lis/les=21/22 n=757 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5392 crt=36'5388 lcod 36'5390 mlcod 36'5390 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.873 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.871+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5684 (0'0,36'5684] local-lis/les=21/22 n=783 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5684 lcod 36'5682 mlcod 36'5682 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.874 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.872+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5395 (0'0,36'5395] local-lis/les=21/22 n=755 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5392 crt=36'5392 lcod 36'5390 mlcod 36'5390 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.876 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.872+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5503 (0'0,36'5503] local-lis/les=21/22 n=769 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5503 lcod 36'5501 mlcod 36'5501 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.877 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.869+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5734 (0'0,36'5734] local-lis/les=21/22 n=813 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5734 lcod 36'5732 mlcod 36'5732 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.877 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.872+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5736 (0'0,36'5736] local-lis/les=21/22 n=811 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5734 crt=36'5734 lcod 36'5732 mlcod 36'5732 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.878 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.874+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5686 (0'0,36'5686] local-lis/les=21/22 n=781 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5684 crt=36'5684 lcod 36'5682 mlcod 36'5682 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.881 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.877+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5505 (0'0,36'5505] local-lis/les=21/22 n=767 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5503 crt=36'5503 lcod 36'5501 mlcod 36'5501 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.881 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.878+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5421 (0'0,36'5421] local-lis/les=21/22 n=650 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5421 lcod 36'5419 mlcod 36'5419 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.882 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.879+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5569 (0'0,36'5569] local-lis/les=21/22 n=797 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5567 crt=36'5567 lcod 36'5565 mlcod 36'5565 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.884 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.882+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5423 (0'0,36'5423] local-lis/les=21/22 n=648 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5421 crt=36'5421 lcod 36'5419 mlcod 36'5419 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.885 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.876+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5419 (0'0,36'5419] local-lis/les=21/22 n=689 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5419 lcod 36'5418 mlcod 36'5418 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.886 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.880+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5421 (0'0,36'5421] local-lis/les=21/22 n=687 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5419 crt=36'5419 lcod 36'5418 mlcod 36'5418 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.890 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.888+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5538 (0'0,36'5538] local-lis/les=21/22 n=735 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5538 lcod 36'5537 mlcod 36'5537 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.893 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.891+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5540 (0'0,36'5540] local-lis/les=21/22 n=733 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5538 crt=36'5538 lcod 36'5537 mlcod 36'5537 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.896 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.894+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5688 (0'0,36'5688] local-lis/les=21/22 n=779 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5688 lcod 36'5686 mlcod 36'5686 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.900 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.898+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5690 (0'0,36'5690] local-lis/les=21/22 n=777 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5688 crt=36'5688 lcod 36'5686 mlcod 36'5686 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.901 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.893+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5397 (0'0,36'5397] local-lis/les=21/22 n=753 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5397 lcod 36'5395 mlcod 36'5395 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.902 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.898+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5399 (0'0,36'5399] local-lis/les=21/22 n=751 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5397 crt=36'5397 lcod 36'5395 mlcod 36'5395 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.902 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.900+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5573 (0'0,36'5573] local-lis/les=21/22 n=793 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5572 crt=36'5572 lcod 36'5571 mlcod 36'5571 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.905 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.902+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5425 (0'0,36'5425] local-lis/les=21/22 n=646 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5425 lcod 36'5423 mlcod 36'5423 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.906 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.904+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5739 (0'0,36'5739] local-lis/les=21/22 n=808 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5739 lcod 36'5738 mlcod 36'5738 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.908 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.906+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5507 (0'0,36'5507] local-lis/les=21/22 n=765 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5507 lcod 36'5505 mlcod 36'5505 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.911 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.906+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5427 (0'0,36'5427] local-lis/les=21/22 n=644 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5425 crt=36'5425 lcod 36'5423 mlcod 36'5423 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.911 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.908+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5741 (0'0,36'5741] local-lis/les=21/22 n=806 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5739 crt=36'5739 lcod 36'5738 mlcod 36'5738 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.911 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.906+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5575 (0'0,36'5575] local-lis/les=21/22 n=791 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5572 crt=36'5572 lcod 36'5571 mlcod 36'5571 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.912 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.904+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5423 (0'0,36'5423] local-lis/les=21/22 n=685 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5423 lcod 36'5421 mlcod 36'5421 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.913 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.911+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5509 (0'0,36'5509] local-lis/les=21/22 n=763 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5507 crt=36'5507 lcod 36'5505 mlcod 36'5505 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.915 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.911+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5425 (0'0,36'5425] local-lis/les=21/22 n=683 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5423 crt=36'5423 lcod 36'5421 mlcod 36'5421 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.916 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.913+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5401 (0'0,36'5401] local-lis/les=21/22 n=749 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5401 lcod 36'5399 mlcod 36'5399 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.922 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.916+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5542 (0'0,36'5542] local-lis/les=21/22 n=731 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5542 lcod 36'5540 mlcod 36'5540 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.923 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.917+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5403 (0'0,36'5403] local-lis/les=21/22 n=747 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5401 crt=36'5401 lcod 36'5399 mlcod 36'5399 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.923 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.919+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5544 (0'0,36'5544] local-lis/les=21/22 n=729 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5542 crt=36'5542 lcod 36'5540 mlcod 36'5540 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.936 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.933+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5428 (0'0,36'5428] local-lis/les=21/22 n=680 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5427 crt=36'5425 lcod 36'5425 mlcod 36'5425 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.937 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.933+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5429 (0'0,36'5429] local-lis/les=21/22 n=642 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5429 lcod 36'5427 mlcod 36'5427 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.937 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.935+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5511 (0'0,36'5511] local-lis/les=21/22 n=761 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5511 lcod 36'5509 mlcod 36'5509 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.938 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.934+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5406 (0'0,36'5406] local-lis/les=21/22 n=744 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5405 crt=36'5403 lcod 36'5403 mlcod 36'5403 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.938 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.936+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5744 (0'0,36'5744] local-lis/les=21/22 n=803 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5744 lcod 36'5743 mlcod 36'5743 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.939 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.937+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5431 (0'0,36'5431] local-lis/les=21/22 n=640 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5429 crt=36'5429 lcod 36'5427 mlcod 36'5427 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.940 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.939+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5513 (0'0,36'5513] local-lis/les=21/22 n=759 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5511 crt=36'5511 lcod 36'5509 mlcod 36'5509 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.942 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.938+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5546 (0'0,36'5546] local-lis/les=21/22 n=727 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5546 lcod 36'5544 mlcod 36'5544 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.942 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.938+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5408 (0'0,36'5408] local-lis/les=21/22 n=742 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5405 crt=36'5405 lcod 36'5403 mlcod 36'5403 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.943 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.927+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5692 (0'0,36'5692] local-lis/les=21/22 n=775 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5692 lcod 36'5690 mlcod 36'5690 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.943 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.927+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5579 (0'0,36'5579] local-lis/les=21/22 n=788 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5577 crt=36'5577 lcod 36'5575 mlcod 36'5575 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.943 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.932+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5694 (0'0,36'5694] local-lis/les=21/22 n=773 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5692 crt=36'5692 lcod 36'5690 mlcod 36'5690 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.944 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.939+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5746 (0'0,36'5746] local-lis/les=21/22 n=801 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5744 crt=36'5744 lcod 36'5743 mlcod 36'5743 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.947 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.945+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5548 (0'0,36'5548] local-lis/les=21/22 n=725 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5546 crt=36'5546 lcod 36'5544 mlcod 36'5544 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.948 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.946+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5581 (0'0,36'5581] local-lis/les=21/22 n=786 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5581 lcod 36'5579 mlcod 36'5579 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.952 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.948+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5430 (0'0,36'5430] local-lis/les=21/22 n=678 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5427 crt=36'5427 lcod 36'5425 mlcod 36'5425 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.953 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.949+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5583 (0'0,36'5583] local-lis/les=21/22 n=784 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5581 crt=36'5581 lcod 36'5579 mlcod 36'5579 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.953 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.951+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5433 (0'0,36'5433] local-lis/les=21/22 n=638 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5433 lcod 36'5431 mlcod 36'5431 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.956 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.954+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5696 (0'0,36'5696] local-lis/les=21/22 n=771 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5696 lcod 36'5694 mlcod 36'5694 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.957 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.955+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5435 (0'0,36'5435] local-lis/les=21/22 n=636 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5433 crt=36'5433 lcod 36'5431 mlcod 36'5431 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.960 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.958+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5698 (0'0,36'5698] local-lis/les=21/22 n=769 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5696 crt=36'5696 lcod 36'5694 mlcod 36'5694 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.964 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.962+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5410 (0'0,36'5410] local-lis/les=21/22 n=740 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5410 lcod 36'5408 mlcod 36'5408 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.967 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.965+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5585 (0'0,36'5585] local-lis/les=21/22 n=782 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5585 lcod 36'5583 mlcod 36'5583 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.967 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.964+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5551 (0'0,36'5551] local-lis/les=21/22 n=722 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5550 crt=36'5546 lcod 36'5548 mlcod 36'5548 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.970 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.966+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5515 (0'0,36'5515] local-lis/les=21/22 n=757 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5515 lcod 36'5513 mlcod 36'5513 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.971 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.969+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5517 (0'0,36'5517] local-lis/les=21/22 n=755 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5515 crt=36'5515 lcod 36'5513 mlcod 36'5513 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.972 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.967+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5553 (0'0,36'5553] local-lis/les=21/22 n=720 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5550 crt=36'5550 lcod 36'5548 mlcod 36'5548 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.972 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.968+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5437 (0'0,36'5437] local-lis/les=21/22 n=634 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5437 lcod 36'5435 mlcod 36'5435 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.973 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.971+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5439 (0'0,36'5439] local-lis/les=21/22 n=632 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5437 crt=36'5437 lcod 36'5435 mlcod 36'5435 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.974 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.972+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5412 (0'0,36'5412] local-lis/les=21/22 n=738 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5410 crt=36'5410 lcod 36'5408 mlcod 36'5408 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.978 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.975+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5749 (0'0,36'5749] local-lis/les=21/22 n=798 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5748 crt=36'5744 lcod 36'5746 mlcod 36'5746 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.980 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.978+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5700 (0'0,36'5700] local-lis/les=21/22 n=767 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5700 lcod 36'5698 mlcod 36'5698 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.982 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.979+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5432 (0'0,36'5432] local-lis/les=21/22 n=676 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5432 lcod 36'5430 mlcod 36'5430 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.984 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.979+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5751 (0'0,36'5751] local-lis/les=21/22 n=796 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5748 crt=36'5748 lcod 36'5746 mlcod 36'5746 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.984 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.981+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5588 (0'0,36'5588] local-lis/les=21/22 n=779 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5587 crt=36'5585 lcod 36'5585 mlcod 36'5585 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.986 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:29.983+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5434 (0'0,36'5434] local-lis/les=21/22 n=674 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5432 crt=36'5432 lcod 36'5430 mlcod 36'5430 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.988 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.985+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5702 (0'0,36'5702] local-lis/les=21/22 n=765 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5700 crt=36'5700 lcod 36'5698 mlcod 36'5698 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.990 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:29.988+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5590 (0'0,36'5590] local-lis/les=21/22 n=777 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5587 crt=36'5587 lcod 36'5585 mlcod 36'5585 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.992 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.990+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5415 (0'0,36'5415] local-lis/les=21/22 n=735 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5414 crt=36'5414 lcod 36'5412 mlcod 36'5412 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.994 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.992+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5519 (0'0,36'5519] local-lis/les=21/22 n=753 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5519 lcod 36'5517 mlcod 36'5517 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.995 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.993+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5417 (0'0,36'5417] local-lis/les=21/22 n=733 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5414 crt=36'5414 lcod 36'5412 mlcod 36'5412 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:29.997 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.994+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5555 (0'0,36'5555] local-lis/les=21/22 n=718 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5555 lcod 36'5553 mlcod 36'5553 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:29.999 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:29.996+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5521 (0'0,36'5521] local-lis/les=21/22 n=751 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5519 crt=36'5519 lcod 36'5517 mlcod 36'5517 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.000 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:29.997+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5557 (0'0,36'5557] local-lis/les=21/22 n=716 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5555 crt=36'5555 lcod 36'5553 mlcod 36'5553 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.000 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.996+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5441 (0'0,36'5441] local-lis/les=21/22 n=630 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5441 lcod 36'5439 mlcod 36'5439 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.001 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.997+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5753 (0'0,36'5753] local-lis/les=21/22 n=794 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5753 lcod 36'5751 mlcod 36'5751 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.001 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:29.999+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5443 (0'0,36'5443] local-lis/les=21/22 n=628 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5441 crt=36'5441 lcod 36'5439 mlcod 36'5439 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.004 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.003+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5436 (0'0,36'5436] local-lis/les=21/22 n=672 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5436 lcod 36'5434 mlcod 36'5434 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.006 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.003+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5592 (0'0,36'5592] local-lis/les=21/22 n=775 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5592 lcod 36'5590 mlcod 36'5590 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.008 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.004+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5755 (0'0,36'5755] local-lis/les=21/22 n=792 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5753 crt=36'5753 lcod 36'5751 mlcod 36'5751 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.009 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.007+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5438 (0'0,36'5438] local-lis/les=21/22 n=670 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5436 crt=36'5436 lcod 36'5434 mlcod 36'5434 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.010 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.007+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5594 (0'0,36'5594] local-lis/les=21/22 n=773 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5592 crt=36'5592 lcod 36'5590 mlcod 36'5590 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.013 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.011+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5704 (0'0,36'5704] local-lis/les=21/22 n=763 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5704 lcod 36'5702 mlcod 36'5702 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.014 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.012+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5524 (0'0,36'5524] local-lis/les=21/22 n=748 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5523 crt=36'5519 lcod 36'5521 mlcod 36'5521 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.016 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.013+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5559 (0'0,36'5559] local-lis/les=21/22 n=714 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5559 lcod 36'5557 mlcod 36'5557 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.017 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.015+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5757 (0'0,36'5757] local-lis/les=21/22 n=790 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5757 lcod 36'5755 mlcod 36'5755 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.018 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.015+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5706 (0'0,36'5706] local-lis/les=21/22 n=761 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5704 crt=36'5704 lcod 36'5702 mlcod 36'5702 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.019 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.017+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5561 (0'0,36'5561] local-lis/les=21/22 n=712 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5559 crt=36'5559 lcod 36'5557 mlcod 36'5557 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.020 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.017+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5419 (0'0,36'5419] local-lis/les=21/22 n=731 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5419 lcod 36'5417 mlcod 36'5417 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.023 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.020+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5440 (0'0,36'5440] local-lis/les=21/22 n=668 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5440 lcod 36'5438 mlcod 36'5438 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.024 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.020+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5421 (0'0,36'5421] local-lis/les=21/22 n=729 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5419 crt=36'5419 lcod 36'5417 mlcod 36'5417 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.025 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.023+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5445 (0'0,36'5445] local-lis/les=21/22 n=626 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5445 lcod 36'5443 mlcod 36'5443 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.029 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.025+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5526 (0'0,36'5526] local-lis/les=21/22 n=746 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5523 crt=36'5523 lcod 36'5521 mlcod 36'5521 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.029 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.026+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5447 (0'0,36'5447] local-lis/les=21/22 n=624 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5445 crt=36'5445 lcod 36'5443 mlcod 36'5443 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.029 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.023+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5442 (0'0,36'5442] local-lis/les=21/22 n=666 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5440 crt=36'5440 lcod 36'5438 mlcod 36'5438 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.030 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.028+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5759 (0'0,36'5759] local-lis/les=21/22 n=788 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5757 crt=36'5757 lcod 36'5755 mlcod 36'5755 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.036 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.034+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5709 (0'0,36'5709] local-lis/les=21/22 n=758 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5708 crt=36'5704 lcod 36'5706 mlcod 36'5706 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.040 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.037+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5711 (0'0,36'5711] local-lis/les=21/22 n=756 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5708 crt=36'5708 lcod 36'5706 mlcod 36'5706 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.043 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.041+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5528 (0'0,36'5528] local-lis/les=21/22 n=744 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5528 lcod 36'5526 mlcod 36'5526 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.046 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.042+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5761 (0'0,36'5761] local-lis/les=21/22 n=786 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5761 lcod 36'5759 mlcod 36'5759 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.047 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.045+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5530 (0'0,36'5530] local-lis/les=21/22 n=742 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5528 crt=36'5528 lcod 36'5526 mlcod 36'5526 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.048 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.046+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5763 (0'0,36'5763] local-lis/les=21/22 n=784 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5761 crt=36'5761 lcod 36'5759 mlcod 36'5759 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.050 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.042+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5563 (0'0,36'5563] local-lis/les=21/22 n=710 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5563 lcod 36'5561 mlcod 36'5561 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.050 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.046+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5565 (0'0,36'5565] local-lis/les=21/22 n=708 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5563 crt=36'5563 lcod 36'5561 mlcod 36'5561 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.051 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.048+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5423 (0'0,36'5423] local-lis/les=21/22 n=727 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5423 lcod 36'5421 mlcod 36'5421 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.053 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.051+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5425 (0'0,36'5425] local-lis/les=21/22 n=725 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5423 crt=36'5423 lcod 36'5421 mlcod 36'5421 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.059 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.057+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5449 (0'0,36'5449] local-lis/les=21/22 n=622 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5449 lcod 36'5447 mlcod 36'5447 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.060 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.055+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5444 (0'0,36'5444] local-lis/les=21/22 n=664 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5444 lcod 36'5442 mlcod 36'5442 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.060 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.057+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5596 (0'0,36'5596] local-lis/les=21/22 n=771 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5596 lcod 36'5594 mlcod 36'5594 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.062 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.060+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5598 (0'0,36'5598] local-lis/les=21/22 n=769 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5596 crt=36'5596 lcod 36'5594 mlcod 36'5594 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.063 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.059+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5446 (0'0,36'5446] local-lis/les=21/22 n=662 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5444 crt=36'5444 lcod 36'5442 mlcod 36'5442 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.066 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.059+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5451 (0'0,36'5451] local-lis/les=21/22 n=620 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5449 crt=36'5449 lcod 36'5447 mlcod 36'5447 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.068 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.067+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5533 (0'0,36'5533] local-lis/les=21/22 n=739 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5532 crt=36'5528 lcod 36'5530 mlcod 36'5530 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.070 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.068+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5567 (0'0,36'5567] local-lis/les=21/22 n=706 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5567 lcod 36'5565 mlcod 36'5565 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.073 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.071+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5427 (0'0,36'5427] local-lis/les=21/22 n=723 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5427 lcod 36'5425 mlcod 36'5425 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.075 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.071+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5535 (0'0,36'5535] local-lis/les=21/22 n=737 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5532 crt=36'5532 lcod 36'5530 mlcod 36'5530 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.076 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.074+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5765 (0'0,36'5765] local-lis/les=21/22 n=782 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5765 lcod 36'5763 mlcod 36'5763 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.079 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.077+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5429 (0'0,36'5429] local-lis/les=21/22 n=721 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5427 crt=36'5427 lcod 36'5425 mlcod 36'5425 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.080 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.077+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5448 (0'0,36'5448] local-lis/les=21/22 n=660 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5448 lcod 36'5446 mlcod 36'5446 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.086 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.083+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5767 (0'0,36'5767] local-lis/les=21/22 n=780 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5765 crt=36'5765 lcod 36'5763 mlcod 36'5763 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.086 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.074+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5715 (0'0,36'5715] local-lis/les=21/22 n=752 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5714 crt=36'5714 lcod 36'5713 mlcod 36'5713 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.086 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.076+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5600 (0'0,36'5600] local-lis/les=21/22 n=767 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5600 lcod 36'5598 mlcod 36'5598 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.086 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.077+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5717 (0'0,36'5717] local-lis/les=21/22 n=750 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5714 crt=36'5714 lcod 36'5713 mlcod 36'5713 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.087 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.082+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5602 (0'0,36'5602] local-lis/les=21/22 n=765 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5600 crt=36'5600 lcod 36'5598 mlcod 36'5598 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.087 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.084+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5450 (0'0,36'5450] local-lis/les=21/22 n=658 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5448 crt=36'5448 lcod 36'5446 mlcod 36'5446 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.089 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.086+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5453 (0'0,36'5453] local-lis/les=21/22 n=618 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5453 lcod 36'5451 mlcod 36'5451 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.090 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.087+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5569 (0'0,36'5569] local-lis/les=21/22 n=704 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5569 lcod 36'5567 mlcod 36'5567 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.091 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.089+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5537 (0'0,36'5537] local-lis/les=21/22 n=735 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5537 lcod 36'5535 mlcod 36'5535 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.093 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.091+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5571 (0'0,36'5571] local-lis/les=21/22 n=702 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5569 crt=36'5569 lcod 36'5567 mlcod 36'5567 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.095 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.093+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5455 (0'0,36'5455] local-lis/les=21/22 n=616 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5453 crt=36'5453 lcod 36'5451 mlcod 36'5451 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.096 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.094+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5605 (0'0,36'5605] local-lis/les=21/22 n=762 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5604 crt=36'5600 lcod 36'5602 mlcod 36'5602 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.099 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.096+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5431 (0'0,36'5431] local-lis/les=21/22 n=719 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5431 lcod 36'5429 mlcod 36'5429 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.101 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.098+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5769 (0'0,36'5769] local-lis/les=21/22 n=778 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5769 lcod 36'5767 mlcod 36'5767 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.103 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.098+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5539 (0'0,36'5539] local-lis/les=21/22 n=733 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5537 crt=36'5537 lcod 36'5535 mlcod 36'5535 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.105 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.103+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5607 (0'0,36'5607] local-lis/les=21/22 n=760 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5604 crt=36'5604 lcod 36'5602 mlcod 36'5602 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.106 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.103+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5452 (0'0,36'5452] local-lis/les=21/22 n=656 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5452 lcod 36'5450 mlcod 36'5450 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.106 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.104+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5433 (0'0,36'5433] local-lis/les=21/22 n=717 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5431 crt=36'5431 lcod 36'5429 mlcod 36'5429 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.109 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.105+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5720 (0'0,36'5720] local-lis/les=21/22 n=747 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5719 crt=36'5717 lcod 36'5717 mlcod 36'5717 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.112 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.109+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5722 (0'0,36'5722] local-lis/les=21/22 n=745 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5719 crt=36'5719 lcod 36'5717 mlcod 36'5717 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.114 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.111+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5573 (0'0,36'5573] local-lis/les=21/22 n=700 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5573 lcod 36'5571 mlcod 36'5571 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.115 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.108+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5454 (0'0,36'5454] local-lis/les=21/22 n=654 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5452 crt=36'5452 lcod 36'5450 mlcod 36'5450 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.116 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.114+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5575 (0'0,36'5575] local-lis/les=21/22 n=698 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5573 crt=36'5573 lcod 36'5571 mlcod 36'5571 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.119 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.117+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5458 (0'0,36'5458] local-lis/les=21/22 n=613 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5457 crt=36'5457 lcod 36'5455 mlcod 36'5455 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.120 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.118+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5541 (0'0,36'5541] local-lis/les=21/22 n=731 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5541 lcod 36'5539 mlcod 36'5539 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.122 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.120+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5460 (0'0,36'5460] local-lis/les=21/22 n=611 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5457 crt=36'5457 lcod 36'5455 mlcod 36'5455 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.124 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.121+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5543 (0'0,36'5543] local-lis/les=21/22 n=729 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5541 crt=36'5541 lcod 36'5539 mlcod 36'5539 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.127 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.122+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5456 (0'0,36'5456] local-lis/les=21/22 n=652 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5456 lcod 36'5454 mlcod 36'5454 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.128 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.126+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5458 (0'0,36'5458] local-lis/les=21/22 n=650 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5456 crt=36'5456 lcod 36'5454 mlcod 36'5454 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.131 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.128+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5435 (0'0,36'5435] local-lis/les=21/22 n=715 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5435 lcod 36'5433 mlcod 36'5433 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.131 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.128+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5609 (0'0,36'5609] local-lis/les=21/22 n=758 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5609 lcod 36'5607 mlcod 36'5607 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.132 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.130+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5462 (0'0,36'5462] local-lis/les=21/22 n=609 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5462 lcod 36'5460 mlcod 36'5460 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.133 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.131+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5773 (0'0,36'5773] local-lis/les=21/22 n=775 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5773 lcod 36'5771 mlcod 36'5771 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.135 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.132+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5437 (0'0,36'5437] local-lis/les=21/22 n=713 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5435 crt=36'5435 lcod 36'5433 mlcod 36'5433 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.142 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.135+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5577 (0'0,36'5577] local-lis/les=21/22 n=696 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5577 lcod 36'5575 mlcod 36'5575 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.142 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.135+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5611 (0'0,36'5611] local-lis/les=21/22 n=756 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5609 crt=36'5609 lcod 36'5607 mlcod 36'5607 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.143 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.138+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5724 (0'0,36'5724] local-lis/les=21/22 n=743 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5724 lcod 36'5722 mlcod 36'5722 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.143 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.135+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5775 (0'0,36'5775] local-lis/les=21/22 n=773 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5773 crt=36'5773 lcod 36'5771 mlcod 36'5771 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.143 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.136+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5464 (0'0,36'5464] local-lis/les=21/22 n=607 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5462 crt=36'5462 lcod 36'5460 mlcod 36'5460 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.148 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.146+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5726 (0'0,36'5726] local-lis/les=21/22 n=741 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5724 crt=36'5724 lcod 36'5722 mlcod 36'5722 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.148 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.146+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5579 (0'0,36'5579] local-lis/les=21/22 n=694 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5577 crt=36'5577 lcod 36'5575 mlcod 36'5575 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.149 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.147+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5546 (0'0,36'5546] local-lis/les=21/22 n=726 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5545 crt=36'5543 lcod 36'5543 mlcod 36'5543 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.153 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.151+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5548 (0'0,36'5548] local-lis/les=21/22 n=724 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5545 crt=36'5545 lcod 36'5543 mlcod 36'5543 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.154 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.152+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5613 (0'0,36'5613] local-lis/les=21/22 n=754 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5613 lcod 36'5611 mlcod 36'5611 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.154 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.152+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5466 (0'0,36'5466] local-lis/les=21/22 n=605 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5466 lcod 36'5464 mlcod 36'5464 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.155 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.152+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5460 (0'0,36'5460] local-lis/les=21/22 n=648 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5460 lcod 36'5458 mlcod 36'5458 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.159 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.156+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5462 (0'0,36'5462] local-lis/les=21/22 n=646 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5460 crt=36'5460 lcod 36'5458 mlcod 36'5458 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.159 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.154+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5777 (0'0,36'5777] local-lis/les=21/22 n=771 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5777 lcod 36'5775 mlcod 36'5775 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.160 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.155+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5468 (0'0,36'5468] local-lis/les=21/22 n=603 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5466 crt=36'5466 lcod 36'5464 mlcod 36'5464 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.160 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.155+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5615 (0'0,36'5615] local-lis/les=21/22 n=752 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5613 crt=36'5613 lcod 36'5611 mlcod 36'5611 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.164 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.161+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5779 (0'0,36'5779] local-lis/les=21/22 n=769 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5777 crt=36'5777 lcod 36'5775 mlcod 36'5775 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.166 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.164+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5581 (0'0,36'5581] local-lis/les=21/22 n=692 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5581 lcod 36'5579 mlcod 36'5579 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.167 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.164+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5728 (0'0,36'5728] local-lis/les=21/22 n=739 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5728 lcod 36'5726 mlcod 36'5726 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.170 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.167+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5583 (0'0,36'5583] local-lis/les=21/22 n=690 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5581 crt=36'5581 lcod 36'5579 mlcod 36'5579 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.170 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.168+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5464 (0'0,36'5464] local-lis/les=21/22 n=644 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5464 lcod 36'5462 mlcod 36'5462 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.173 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.171+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5466 (0'0,36'5466] local-lis/les=21/22 n=642 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5464 crt=36'5464 lcod 36'5462 mlcod 36'5462 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.174 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.172+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5440 (0'0,36'5440] local-lis/les=21/22 n=710 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5440 lcod 36'5439 mlcod 36'5439 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.174 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.172+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5730 (0'0,36'5730] local-lis/les=21/22 n=737 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5728 crt=36'5728 lcod 36'5726 mlcod 36'5726 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.178 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.175+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5442 (0'0,36'5442] local-lis/les=21/22 n=708 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5440 crt=36'5440 lcod 36'5439 mlcod 36'5439 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.178 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.177+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5550 (0'0,36'5550] local-lis/les=21/22 n=722 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5550 lcod 36'5548 mlcod 36'5548 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.179 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.176+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5618 (0'0,36'5618] local-lis/les=21/22 n=749 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5618 lcod 36'5617 mlcod 36'5617 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.181 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.178+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5781 (0'0,36'5781] local-lis/les=21/22 n=767 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5781 lcod 36'5779 mlcod 36'5779 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.182 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.181+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5552 (0'0,36'5552] local-lis/les=21/22 n=720 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5550 crt=36'5550 lcod 36'5548 mlcod 36'5548 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.185 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.182+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5783 (0'0,36'5783] local-lis/les=21/22 n=765 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5781 crt=36'5781 lcod 36'5779 mlcod 36'5779 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.186 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.184+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5620 (0'0,36'5620] local-lis/les=21/22 n=747 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5618 crt=36'5618 lcod 36'5617 mlcod 36'5617 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.188 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.186+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5469 (0'0,36'5469] local-lis/les=21/22 n=639 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5468 crt=36'5464 lcod 36'5466 mlcod 36'5466 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.191 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.189+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5471 (0'0,36'5471] local-lis/les=21/22 n=637 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5468 crt=36'5468 lcod 36'5466 mlcod 36'5466 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.196 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.193+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5585 (0'0,36'5585] local-lis/les=21/22 n=688 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5585 lcod 36'5583 mlcod 36'5583 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.196 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.193+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5444 (0'0,36'5444] local-lis/les=21/22 n=706 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5444 lcod 36'5442 mlcod 36'5442 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.197 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.194+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5733 (0'0,36'5733] local-lis/les=21/22 n=734 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5733 lcod 36'5732 mlcod 36'5732 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.200 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.197+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5735 (0'0,36'5735] local-lis/les=21/22 n=732 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5733 crt=36'5733 lcod 36'5732 mlcod 36'5732 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.200 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.198+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5554 (0'0,36'5554] local-lis/les=21/22 n=718 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5554 lcod 36'5552 mlcod 36'5552 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.201 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.198+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5587 (0'0,36'5587] local-lis/les=21/22 n=686 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5585 crt=36'5585 lcod 36'5583 mlcod 36'5583 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.202 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.200+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5471 (0'0,36'5471] local-lis/les=21/22 n=600 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5470 crt=36'5468 lcod 36'5468 mlcod 36'5468 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.205 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.202+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5623 (0'0,36'5623] local-lis/les=21/22 n=744 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5622 crt=36'5618 lcod 36'5620 mlcod 36'5620 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.207 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.206+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5556 (0'0,36'5556] local-lis/les=21/22 n=716 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5554 crt=36'5554 lcod 36'5552 mlcod 36'5552 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.209 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.206+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5473 (0'0,36'5473] local-lis/les=21/22 n=598 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5470 crt=36'5470 lcod 36'5468 mlcod 36'5468 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.210 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.202+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5446 (0'0,36'5446] local-lis/les=21/22 n=704 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5444 crt=36'5444 lcod 36'5442 mlcod 36'5442 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.221 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.219+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5448 (0'0,36'5448] local-lis/les=21/22 n=702 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5448 lcod 36'5446 mlcod 36'5446 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.221 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.213+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5473 (0'0,36'5473] local-lis/les=21/22 n=635 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5473 lcod 36'5471 mlcod 36'5471 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.222 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.219+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5475 (0'0,36'5475] local-lis/les=21/22 n=596 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5475 lcod 36'5473 mlcod 36'5473 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.222 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.217+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5475 (0'0,36'5475] local-lis/les=21/22 n=633 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5473 crt=36'5473 lcod 36'5471 mlcod 36'5471 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.223 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.221+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5786 (0'0,36'5786] local-lis/les=21/22 n=762 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5785 crt=36'5781 lcod 36'5783 mlcod 36'5783 active+clean+snaptrim trimq=[201~27] ps=[1fe~3]] removing snap head 2020-02-11T16:31:30.225 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.223+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5477 (0'0,36'5477] local-lis/les=21/22 n=594 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5475 crt=36'5475 lcod 36'5473 mlcod 36'5473 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.226 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.224+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5589 (0'0,36'5589] local-lis/les=21/22 n=684 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5589 lcod 36'5587 mlcod 36'5587 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.227 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.224+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5559 (0'0,36'5559] local-lis/les=21/22 n=713 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5558 crt=36'5554 lcod 36'5556 mlcod 36'5556 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.227 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.224+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5627 (0'0,36'5627] local-lis/les=21/22 n=741 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5627 lcod 36'5625 mlcod 36'5625 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.231 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.228+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5561 (0'0,36'5561] local-lis/les=21/22 n=711 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5558 crt=36'5558 lcod 36'5556 mlcod 36'5556 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.232 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.227+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5629 (0'0,36'5629] local-lis/les=21/22 n=739 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5627 crt=36'5627 lcod 36'5625 mlcod 36'5625 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.236 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.233+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5737 (0'0,36'5737] local-lis/les=21/22 n=730 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5737 lcod 36'5735 mlcod 36'5735 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.238 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.236+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5591 (0'0,36'5591] local-lis/les=21/22 n=682 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5589 crt=36'5589 lcod 36'5587 mlcod 36'5587 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.240 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.236+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5788 (0'0,36'5788] local-lis/les=21/22 n=760 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5788 lcod 36'5786 mlcod 36'5786 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.242 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.230+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5477 (0'0,36'5477] local-lis/les=21/22 n=631 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5477 lcod 36'5475 mlcod 36'5475 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.242 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.239+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5450 (0'0,36'5450] local-lis/les=21/22 n=700 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5450 lcod 36'5448 mlcod 36'5448 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.243 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.240+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5790 (0'0,36'5790] local-lis/les=21/22 n=758 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5788 crt=36'5788 lcod 36'5786 mlcod 36'5786 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.243 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.241+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5480 (0'0,36'5480] local-lis/les=21/22 n=591 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5479 crt=36'5475 lcod 36'5477 mlcod 36'5477 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.244 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.233+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5479 (0'0,36'5479] local-lis/les=21/22 n=629 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5477 crt=36'5477 lcod 36'5475 mlcod 36'5475 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.245 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.243+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5452 (0'0,36'5452] local-lis/les=21/22 n=698 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5450 crt=36'5450 lcod 36'5448 mlcod 36'5448 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.245 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.237+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5739 (0'0,36'5739] local-lis/les=21/22 n=728 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5737 crt=36'5737 lcod 36'5735 mlcod 36'5735 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.252 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.250+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5482 (0'0,36'5482] local-lis/les=21/22 n=589 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5479 crt=36'5479 lcod 36'5477 mlcod 36'5477 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.378 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.251+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5563 (0'0,36'5563] local-lis/les=21/22 n=709 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5563 lcod 36'5561 mlcod 36'5561 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.378 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.255+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5565 (0'0,36'5565] local-lis/les=21/22 n=707 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5563 crt=36'5563 lcod 36'5561 mlcod 36'5561 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.379 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.286+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5568 (0'0,36'5568] local-lis/les=21/22 n=704 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5567 crt=36'5567 lcod 36'5565 mlcod 36'5565 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.379 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.290+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5570 (0'0,36'5570] local-lis/les=21/22 n=702 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5567 crt=36'5567 lcod 36'5565 mlcod 36'5565 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.379 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.324+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5572 (0'0,36'5572] local-lis/les=21/22 n=700 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5572 lcod 36'5570 mlcod 36'5570 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.379 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.334+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5574 (0'0,36'5574] local-lis/les=21/22 n=698 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5572 crt=36'5572 lcod 36'5570 mlcod 36'5570 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.379 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.354+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5576 (0'0,36'5576] local-lis/les=21/22 n=696 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5576 lcod 36'5574 mlcod 36'5574 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.379 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.358+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5578 (0'0,36'5578] local-lis/les=21/22 n=694 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5576 crt=36'5576 lcod 36'5574 mlcod 36'5574 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.380 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.257+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5481 (0'0,36'5481] local-lis/les=21/22 n=627 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5481 lcod 36'5479 mlcod 36'5479 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.380 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.265+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5483 (0'0,36'5483] local-lis/les=21/22 n=625 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5481 crt=36'5481 lcod 36'5479 mlcod 36'5479 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.380 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.278+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5485 (0'0,36'5485] local-lis/les=21/22 n=623 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5485 lcod 36'5483 mlcod 36'5483 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.380 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.286+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5487 (0'0,36'5487] local-lis/les=21/22 n=621 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5485 crt=36'5485 lcod 36'5483 mlcod 36'5483 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.380 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.316+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5489 (0'0,36'5489] local-lis/les=21/22 n=619 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5489 lcod 36'5487 mlcod 36'5487 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.380 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.320+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5491 (0'0,36'5491] local-lis/les=21/22 n=617 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5489 crt=36'5489 lcod 36'5487 mlcod 36'5487 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.380 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.348+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5494 (0'0,36'5494] local-lis/les=21/22 n=614 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5493 crt=36'5493 lcod 36'5491 mlcod 36'5491 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.381 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.358+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5496 (0'0,36'5496] local-lis/les=21/22 n=612 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5493 crt=36'5493 lcod 36'5491 mlcod 36'5491 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.381 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.254+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5631 (0'0,36'5631] local-lis/les=21/22 n=737 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5631 lcod 36'5629 mlcod 36'5629 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.381 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.257+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5741 (0'0,36'5741] local-lis/les=21/22 n=726 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5741 lcod 36'5739 mlcod 36'5739 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.381 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.257+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5633 (0'0,36'5633] local-lis/les=21/22 n=735 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5631 crt=36'5631 lcod 36'5629 mlcod 36'5629 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.381 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.260+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5743 (0'0,36'5743] local-lis/les=21/22 n=724 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5741 crt=36'5741 lcod 36'5739 mlcod 36'5739 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.381 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.278+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5745 (0'0,36'5745] local-lis/les=21/22 n=722 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5745 lcod 36'5743 mlcod 36'5743 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.382 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.286+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5635 (0'0,36'5635] local-lis/les=21/22 n=733 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5635 lcod 36'5633 mlcod 36'5633 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.382 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.290+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5637 (0'0,36'5637] local-lis/les=21/22 n=731 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5635 crt=36'5635 lcod 36'5633 mlcod 36'5633 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.382 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.302+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5747 (0'0,36'5747] local-lis/les=21/22 n=720 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5747 lcod 36'5745 mlcod 36'5745 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.382 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.305+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5749 (0'0,36'5749] local-lis/les=21/22 n=718 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5747 crt=36'5747 lcod 36'5745 mlcod 36'5745 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.382 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.313+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5639 (0'0,36'5639] local-lis/les=21/22 n=729 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5639 lcod 36'5637 mlcod 36'5637 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.382 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.316+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5641 (0'0,36'5641] local-lis/les=21/22 n=727 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5639 crt=36'5639 lcod 36'5637 mlcod 36'5637 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.382 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.322+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5751 (0'0,36'5751] local-lis/les=21/22 n=716 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5751 lcod 36'5749 mlcod 36'5749 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.383 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.326+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5753 (0'0,36'5753] local-lis/les=21/22 n=714 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5751 crt=36'5751 lcod 36'5749 mlcod 36'5749 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.383 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.334+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5643 (0'0,36'5643] local-lis/les=21/22 n=725 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5643 lcod 36'5641 mlcod 36'5641 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.383 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.338+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5645 (0'0,36'5645] local-lis/les=21/22 n=723 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5643 crt=36'5643 lcod 36'5641 mlcod 36'5641 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.383 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.349+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5755 (0'0,36'5755] local-lis/les=21/22 n=712 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5755 lcod 36'5753 mlcod 36'5753 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.383 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.353+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5757 (0'0,36'5757] local-lis/les=21/22 n=710 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5755 crt=36'5755 lcod 36'5753 mlcod 36'5753 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.383 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.361+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5647 (0'0,36'5647] local-lis/les=21/22 n=721 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5647 lcod 36'5645 mlcod 36'5645 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.383 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.365+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5649 (0'0,36'5649] local-lis/les=21/22 n=719 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5647 crt=36'5647 lcod 36'5645 mlcod 36'5645 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.384 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.373+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5759 (0'0,36'5759] local-lis/les=21/22 n=708 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5759 lcod 36'5757 mlcod 36'5757 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.384 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.254+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5593 (0'0,36'5593] local-lis/les=21/22 n=680 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5593 lcod 36'5591 mlcod 36'5591 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.384 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.257+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5595 (0'0,36'5595] local-lis/les=21/22 n=678 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5593 crt=36'5593 lcod 36'5591 mlcod 36'5591 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.384 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.264+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5455 (0'0,36'5455] local-lis/les=21/22 n=695 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5455 lcod 36'5454 mlcod 36'5454 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.384 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.270+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5457 (0'0,36'5457] local-lis/les=21/22 n=693 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5455 crt=36'5455 lcod 36'5454 mlcod 36'5454 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.384 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.281+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5459 (0'0,36'5459] local-lis/les=21/22 n=691 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5459 lcod 36'5457 mlcod 36'5457 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.384 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.285+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5461 (0'0,36'5461] local-lis/les=21/22 n=689 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5459 crt=36'5459 lcod 36'5457 mlcod 36'5457 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.385 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.295+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5598 (0'0,36'5598] local-lis/les=21/22 n=675 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5598 lcod 36'5597 mlcod 36'5597 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.385 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.298+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5600 (0'0,36'5600] local-lis/les=21/22 n=673 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5598 crt=36'5598 lcod 36'5597 mlcod 36'5597 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.385 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.303+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5463 (0'0,36'5463] local-lis/les=21/22 n=687 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5463 lcod 36'5461 mlcod 36'5461 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.385 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.307+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5465 (0'0,36'5465] local-lis/les=21/22 n=685 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5463 crt=36'5463 lcod 36'5461 mlcod 36'5461 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.385 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.318+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5603 (0'0,36'5603] local-lis/les=21/22 n=670 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5602 crt=36'5598 lcod 36'5600 mlcod 36'5600 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.385 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.326+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5605 (0'0,36'5605] local-lis/les=21/22 n=668 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5602 crt=36'5602 lcod 36'5600 mlcod 36'5600 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.385 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.326+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5467 (0'0,36'5467] local-lis/les=21/22 n=683 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5467 lcod 36'5465 mlcod 36'5465 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.386 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.330+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5469 (0'0,36'5469] local-lis/les=21/22 n=681 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5467 crt=36'5467 lcod 36'5465 mlcod 36'5465 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.386 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.341+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5607 (0'0,36'5607] local-lis/les=21/22 n=666 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5607 lcod 36'5605 mlcod 36'5605 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.386 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.344+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5609 (0'0,36'5609] local-lis/les=21/22 n=664 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5607 crt=36'5607 lcod 36'5605 mlcod 36'5605 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.386 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.358+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5471 (0'0,36'5471] local-lis/les=21/22 n=679 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5471 lcod 36'5469 mlcod 36'5469 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.386 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.362+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5473 (0'0,36'5473] local-lis/les=21/22 n=677 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5471 crt=36'5471 lcod 36'5469 mlcod 36'5469 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.386 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.367+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5611 (0'0,36'5611] local-lis/les=21/22 n=662 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5611 lcod 36'5609 mlcod 36'5609 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.386 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.371+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5613 (0'0,36'5613] local-lis/les=21/22 n=660 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5611 crt=36'5611 lcod 36'5609 mlcod 36'5609 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.387 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.264+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5484 (0'0,36'5484] local-lis/les=21/22 n=587 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5484 lcod 36'5482 mlcod 36'5482 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.387 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.268+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5486 (0'0,36'5486] local-lis/les=21/22 n=585 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5484 crt=36'5484 lcod 36'5482 mlcod 36'5482 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.387 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.276+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5792 (0'0,36'5792] local-lis/les=21/22 n=756 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5792 lcod 36'5790 mlcod 36'5790 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.387 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.280+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5794 (0'0,36'5794] local-lis/les=21/22 n=754 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5792 crt=36'5792 lcod 36'5790 mlcod 36'5790 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.387 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.292+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5796 (0'0,36'5796] local-lis/les=21/22 n=752 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5796 lcod 36'5794 mlcod 36'5794 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.387 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.295+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5798 (0'0,36'5798] local-lis/les=21/22 n=750 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5796 crt=36'5796 lcod 36'5794 mlcod 36'5794 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.387 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.301+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5489 (0'0,36'5489] local-lis/les=21/22 n=582 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5488 crt=36'5488 lcod 36'5486 mlcod 36'5486 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.388 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.304+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5491 (0'0,36'5491] local-lis/les=21/22 n=580 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5488 crt=36'5488 lcod 36'5486 mlcod 36'5486 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.388 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.317+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5801 (0'0,36'5801] local-lis/les=21/22 n=747 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5800 crt=36'5798 lcod 36'5798 mlcod 36'5798 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.388 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.321+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5803 (0'0,36'5803] local-lis/les=21/22 n=745 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5800 crt=36'5800 lcod 36'5798 mlcod 36'5798 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.388 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.333+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5493 (0'0,36'5493] local-lis/les=21/22 n=578 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5493 lcod 36'5491 mlcod 36'5491 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.388 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.337+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5495 (0'0,36'5495] local-lis/les=21/22 n=576 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5493 crt=36'5493 lcod 36'5491 mlcod 36'5491 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.388 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.351+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5806 (0'0,36'5806] local-lis/les=21/22 n=742 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5806 lcod 36'5805 mlcod 36'5805 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.388 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.354+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5808 (0'0,36'5808] local-lis/les=21/22 n=740 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5806 crt=36'5806 lcod 36'5805 mlcod 36'5805 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.389 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.356+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5498 (0'0,36'5498] local-lis/les=21/22 n=573 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5497 crt=36'5497 lcod 36'5495 mlcod 36'5495 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.389 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.360+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5500 (0'0,36'5500] local-lis/les=21/22 n=571 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5497 crt=36'5497 lcod 36'5495 mlcod 36'5495 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.390 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.376+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5498 (0'0,36'5498] local-lis/les=21/22 n=610 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5498 lcod 36'5496 mlcod 36'5496 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.391 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.380+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5500 (0'0,36'5500] local-lis/les=21/22 n=608 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5498 crt=36'5498 lcod 36'5496 mlcod 36'5496 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.391 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.380+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5580 (0'0,36'5580] local-lis/les=21/22 n=692 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5580 lcod 36'5578 mlcod 36'5578 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.391 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.387+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5582 (0'0,36'5582] local-lis/les=21/22 n=690 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5580 crt=36'5580 lcod 36'5578 mlcod 36'5578 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.391 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.378+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5503 (0'0,36'5503] local-lis/les=21/22 n=568 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5502 crt=36'5497 lcod 36'5500 mlcod 36'5500 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.391 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.382+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5505 (0'0,36'5505] local-lis/les=21/22 n=566 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5502 crt=36'5502 lcod 36'5500 mlcod 36'5500 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.392 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.376+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5761 (0'0,36'5761] local-lis/les=21/22 n=706 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5759 crt=36'5759 lcod 36'5757 mlcod 36'5757 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.392 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.380+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5651 (0'0,36'5651] local-lis/les=21/22 n=717 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5651 lcod 36'5649 mlcod 36'5649 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.376+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5475 (0'0,36'5475] local-lis/les=21/22 n=675 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5475 lcod 36'5473 mlcod 36'5473 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.385+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5477 (0'0,36'5477] local-lis/les=21/22 n=673 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5475 crt=36'5475 lcod 36'5473 mlcod 36'5473 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.393 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.389+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5810 (0'0,36'5810] local-lis/les=21/22 n=738 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5810 lcod 36'5808 mlcod 36'5808 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.393 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.390+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5616 (0'0,36'5616] local-lis/les=21/22 n=657 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5615 crt=36'5611 lcod 36'5613 mlcod 36'5613 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.393 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.391+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5653 (0'0,36'5653] local-lis/les=21/22 n=715 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5651 crt=36'5651 lcod 36'5649 mlcod 36'5649 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.395 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.393+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5812 (0'0,36'5812] local-lis/les=21/22 n=736 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5810 crt=36'5810 lcod 36'5808 mlcod 36'5808 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.398 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.396+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5508 (0'0,36'5508] local-lis/les=21/22 n=563 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5507 crt=36'5503 lcod 36'5505 mlcod 36'5505 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.400 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.397+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5618 (0'0,36'5618] local-lis/les=21/22 n=655 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5615 crt=36'5615 lcod 36'5613 mlcod 36'5613 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.402 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.400+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5510 (0'0,36'5510] local-lis/les=21/22 n=561 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5507 crt=36'5507 lcod 36'5505 mlcod 36'5505 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.403 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.400+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5763 (0'0,36'5763] local-lis/les=21/22 n=704 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5763 lcod 36'5761 mlcod 36'5761 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.405 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.403+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5502 (0'0,36'5502] local-lis/les=21/22 n=606 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5502 lcod 36'5500 mlcod 36'5500 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.405 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.403+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5765 (0'0,36'5765] local-lis/les=21/22 n=702 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5763 crt=36'5763 lcod 36'5761 mlcod 36'5761 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.412 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.409+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5504 (0'0,36'5504] local-lis/les=21/22 n=604 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5502 crt=36'5502 lcod 36'5500 mlcod 36'5500 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.414 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.410+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5655 (0'0,36'5655] local-lis/les=21/22 n=713 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5655 lcod 36'5653 mlcod 36'5653 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.414 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.410+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5480 (0'0,36'5480] local-lis/les=21/22 n=670 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5479 crt=36'5475 lcod 36'5477 mlcod 36'5477 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.417 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.415+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5584 (0'0,36'5584] local-lis/les=21/22 n=688 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5584 lcod 36'5582 mlcod 36'5582 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.418 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.412+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5814 (0'0,36'5814] local-lis/les=21/22 n=734 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5814 lcod 36'5812 mlcod 36'5812 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.419 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.415+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5816 (0'0,36'5816] local-lis/les=21/22 n=732 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5814 crt=36'5814 lcod 36'5812 mlcod 36'5812 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.421 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.413+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5657 (0'0,36'5657] local-lis/les=21/22 n=711 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5655 crt=36'5655 lcod 36'5653 mlcod 36'5653 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.422 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.414+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5482 (0'0,36'5482] local-lis/les=21/22 n=668 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5479 crt=36'5479 lcod 36'5477 mlcod 36'5477 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.424 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.422+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5586 (0'0,36'5586] local-lis/les=21/22 n=686 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5584 crt=36'5584 lcod 36'5582 mlcod 36'5582 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.425 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.423+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5620 (0'0,36'5620] local-lis/les=21/22 n=653 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5620 lcod 36'5618 mlcod 36'5618 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.426 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.424+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5512 (0'0,36'5512] local-lis/les=21/22 n=559 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5512 lcod 36'5510 mlcod 36'5510 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.428 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.424+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5507 (0'0,36'5507] local-lis/les=21/22 n=601 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5506 crt=36'5504 lcod 36'5504 mlcod 36'5504 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.431 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.427+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5514 (0'0,36'5514] local-lis/les=21/22 n=557 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5512 crt=36'5512 lcod 36'5510 mlcod 36'5510 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.431 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.429+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5768 (0'0,36'5768] local-lis/les=21/22 n=699 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5767 crt=36'5763 lcod 36'5765 mlcod 36'5765 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.432 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.429+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5509 (0'0,36'5509] local-lis/les=21/22 n=599 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5506 crt=36'5506 lcod 36'5504 mlcod 36'5504 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.435 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.432+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5659 (0'0,36'5659] local-lis/les=21/22 n=709 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5659 lcod 36'5657 mlcod 36'5657 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.436 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.433+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5770 (0'0,36'5770] local-lis/les=21/22 n=697 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5767 crt=36'5767 lcod 36'5765 mlcod 36'5765 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.436 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.430+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5818 (0'0,36'5818] local-lis/les=21/22 n=730 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5818 lcod 36'5816 mlcod 36'5816 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.437 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.435+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5820 (0'0,36'5820] local-lis/les=21/22 n=728 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5818 crt=36'5818 lcod 36'5816 mlcod 36'5816 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.438 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.435+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5661 (0'0,36'5661] local-lis/les=21/22 n=707 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5659 crt=36'5659 lcod 36'5657 mlcod 36'5657 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.442 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.430+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5622 (0'0,36'5622] local-lis/les=21/22 n=651 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5620 crt=36'5620 lcod 36'5618 mlcod 36'5618 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.442 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.433+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5484 (0'0,36'5484] local-lis/les=21/22 n=666 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5484 lcod 36'5482 mlcod 36'5482 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.447 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.442+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5486 (0'0,36'5486] local-lis/les=21/22 n=664 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5484 crt=36'5484 lcod 36'5482 mlcod 36'5482 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.448 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.445+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5517 (0'0,36'5517] local-lis/les=21/22 n=554 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5516 crt=36'5514 lcod 36'5514 mlcod 36'5514 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.450 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.447+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5624 (0'0,36'5624] local-lis/les=21/22 n=649 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5624 lcod 36'5622 mlcod 36'5622 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.453 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.451+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5626 (0'0,36'5626] local-lis/les=21/22 n=647 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5624 crt=36'5624 lcod 36'5622 mlcod 36'5622 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.454 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.451+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5663 (0'0,36'5663] local-lis/les=21/22 n=705 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5663 lcod 36'5661 mlcod 36'5661 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.454 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.450+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5588 (0'0,36'5588] local-lis/les=21/22 n=684 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5588 lcod 36'5586 mlcod 36'5586 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.457 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.455+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5665 (0'0,36'5665] local-lis/les=21/22 n=703 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5663 crt=36'5663 lcod 36'5661 mlcod 36'5661 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.459 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.449+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5511 (0'0,36'5511] local-lis/les=21/22 n=597 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5511 lcod 36'5509 mlcod 36'5509 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.459 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.453+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5513 (0'0,36'5513] local-lis/les=21/22 n=595 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5511 crt=36'5511 lcod 36'5509 mlcod 36'5509 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.460 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.457+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5590 (0'0,36'5590] local-lis/les=21/22 n=682 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5588 crt=36'5588 lcod 36'5586 mlcod 36'5586 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.464 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.461+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5488 (0'0,36'5488] local-lis/les=21/22 n=662 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5488 lcod 36'5486 mlcod 36'5486 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.464 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.461+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5772 (0'0,36'5772] local-lis/les=21/22 n=695 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5772 lcod 36'5770 mlcod 36'5770 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.468 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.466+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5774 (0'0,36'5774] local-lis/les=21/22 n=693 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5772 crt=36'5772 lcod 36'5770 mlcod 36'5770 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.473 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.470+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5519 (0'0,36'5519] local-lis/les=21/22 n=552 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5519 lcod 36'5517 mlcod 36'5517 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.473 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.470+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5490 (0'0,36'5490] local-lis/les=21/22 n=660 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5488 crt=36'5488 lcod 36'5486 mlcod 36'5486 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.473 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.470+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5667 (0'0,36'5667] local-lis/les=21/22 n=701 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5667 lcod 36'5665 mlcod 36'5665 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.474 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.471+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5593 (0'0,36'5593] local-lis/les=21/22 n=679 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5592 crt=36'5590 lcod 36'5590 mlcod 36'5590 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.475 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.473+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5824 (0'0,36'5824] local-lis/les=21/22 n=724 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5823 crt=36'5823 lcod 36'5822 mlcod 36'5822 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.476 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.475+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5595 (0'0,36'5595] local-lis/les=21/22 n=677 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5592 crt=36'5592 lcod 36'5590 mlcod 36'5590 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.479 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.477+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5521 (0'0,36'5521] local-lis/les=21/22 n=550 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5519 crt=36'5519 lcod 36'5517 mlcod 36'5517 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.480 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.476+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5515 (0'0,36'5515] local-lis/les=21/22 n=593 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5515 lcod 36'5513 mlcod 36'5513 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.482 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.480+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5517 (0'0,36'5517] local-lis/les=21/22 n=591 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5515 crt=36'5515 lcod 36'5513 mlcod 36'5513 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.483 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.477+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5669 (0'0,36'5669] local-lis/les=21/22 n=699 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5667 crt=36'5667 lcod 36'5665 mlcod 36'5665 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.484 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.481+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5826 (0'0,36'5826] local-lis/les=21/22 n=722 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5823 crt=36'5823 lcod 36'5822 mlcod 36'5822 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.485 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.483+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5628 (0'0,36'5628] local-lis/les=21/22 n=645 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5628 lcod 36'5626 mlcod 36'5626 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.488 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.486+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5776 (0'0,36'5776] local-lis/les=21/22 n=691 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5776 lcod 36'5774 mlcod 36'5774 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.491 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.487+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5630 (0'0,36'5630] local-lis/les=21/22 n=643 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5628 crt=36'5628 lcod 36'5626 mlcod 36'5626 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.492 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.489+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5778 (0'0,36'5778] local-lis/les=21/22 n=689 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5776 crt=36'5776 lcod 36'5774 mlcod 36'5774 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.492 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.489+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5492 (0'0,36'5492] local-lis/les=21/22 n=658 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5492 lcod 36'5490 mlcod 36'5490 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.494 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.491+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5523 (0'0,36'5523] local-lis/les=21/22 n=548 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5523 lcod 36'5521 mlcod 36'5521 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.496 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.493+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5494 (0'0,36'5494] local-lis/les=21/22 n=656 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5492 crt=36'5492 lcod 36'5490 mlcod 36'5490 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.496 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.494+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5672 (0'0,36'5672] local-lis/les=21/22 n=696 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5671 crt=36'5669 lcod 36'5669 mlcod 36'5669 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.498 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.495+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5525 (0'0,36'5525] local-lis/les=21/22 n=546 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5523 crt=36'5523 lcod 36'5521 mlcod 36'5521 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.502 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.498+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5674 (0'0,36'5674] local-lis/les=21/22 n=694 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5671 crt=36'5671 lcod 36'5669 mlcod 36'5669 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.503 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.501+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5780 (0'0,36'5780] local-lis/les=21/22 n=687 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5780 lcod 36'5778 mlcod 36'5778 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.504 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.502+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5828 (0'0,36'5828] local-lis/les=21/22 n=720 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5828 lcod 36'5826 mlcod 36'5826 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.506 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.503+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5632 (0'0,36'5632] local-lis/les=21/22 n=641 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5632 lcod 36'5630 mlcod 36'5630 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.507 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.505+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5597 (0'0,36'5597] local-lis/les=21/22 n=675 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5597 lcod 36'5595 mlcod 36'5595 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.507 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.505+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5782 (0'0,36'5782] local-lis/les=21/22 n=685 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5780 crt=36'5780 lcod 36'5778 mlcod 36'5778 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.511 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.509+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5599 (0'0,36'5599] local-lis/les=21/22 n=673 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5597 crt=36'5597 lcod 36'5595 mlcod 36'5595 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.511 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.507+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5634 (0'0,36'5634] local-lis/les=21/22 n=639 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5632 crt=36'5632 lcod 36'5630 mlcod 36'5630 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.515 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.507+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5830 (0'0,36'5830] local-lis/les=21/22 n=718 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5828 crt=36'5828 lcod 36'5826 mlcod 36'5826 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.515 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.508+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5527 (0'0,36'5527] local-lis/les=21/22 n=544 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5527 lcod 36'5525 mlcod 36'5525 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.516 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.509+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5519 (0'0,36'5519] local-lis/les=21/22 n=589 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5519 lcod 36'5517 mlcod 36'5517 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.516 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.512+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5529 (0'0,36'5529] local-lis/les=21/22 n=542 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5527 crt=36'5527 lcod 36'5525 mlcod 36'5525 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.518 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.516+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5497 (0'0,36'5497] local-lis/les=21/22 n=653 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5496 crt=36'5492 lcod 36'5494 mlcod 36'5494 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.519 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.516+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5521 (0'0,36'5521] local-lis/les=21/22 n=587 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5519 crt=36'5519 lcod 36'5517 mlcod 36'5517 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.522 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.519+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5499 (0'0,36'5499] local-lis/les=21/22 n=651 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5496 crt=36'5496 lcod 36'5494 mlcod 36'5494 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.524 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.522+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5832 (0'0,36'5832] local-lis/les=21/22 n=716 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5832 lcod 36'5830 mlcod 36'5830 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.526 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.524+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5601 (0'0,36'5601] local-lis/les=21/22 n=671 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5601 lcod 36'5599 mlcod 36'5599 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.530 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.528+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5636 (0'0,36'5636] local-lis/les=21/22 n=637 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5636 lcod 36'5634 mlcod 36'5634 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.534 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.531+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5638 (0'0,36'5638] local-lis/les=21/22 n=635 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5636 crt=36'5636 lcod 36'5634 mlcod 36'5634 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.536 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.533+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5784 (0'0,36'5784] local-lis/les=21/22 n=683 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5784 lcod 36'5782 mlcod 36'5782 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.536 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.533+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5676 (0'0,36'5676] local-lis/les=21/22 n=692 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5676 lcod 36'5674 mlcod 36'5674 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.538 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.536+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5786 (0'0,36'5786] local-lis/les=21/22 n=681 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5784 crt=36'5784 lcod 36'5782 mlcod 36'5782 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.539 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.535+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5603 (0'0,36'5603] local-lis/les=21/22 n=669 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5601 crt=36'5601 lcod 36'5599 mlcod 36'5599 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.539 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.537+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5678 (0'0,36'5678] local-lis/les=21/22 n=690 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5676 crt=36'5676 lcod 36'5674 mlcod 36'5674 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.546 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.540+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5532 (0'0,36'5532] local-lis/les=21/22 n=539 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5531 crt=36'5527 lcod 36'5529 mlcod 36'5529 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.547 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.542+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5836 (0'0,36'5836] local-lis/les=21/22 n=713 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5836 lcod 36'5834 mlcod 36'5834 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.549 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.545+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5501 (0'0,36'5501] local-lis/les=21/22 n=649 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5501 lcod 36'5499 mlcod 36'5499 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.549 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.546+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5534 (0'0,36'5534] local-lis/les=21/22 n=537 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5531 crt=36'5531 lcod 36'5529 mlcod 36'5529 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.550 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.546+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5838 (0'0,36'5838] local-lis/les=21/22 n=711 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5836 crt=36'5836 lcod 36'5834 mlcod 36'5834 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.551 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.548+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5503 (0'0,36'5503] local-lis/les=21/22 n=647 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5501 crt=36'5501 lcod 36'5499 mlcod 36'5499 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.554 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.551+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5680 (0'0,36'5680] local-lis/les=21/22 n=688 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5680 lcod 36'5678 mlcod 36'5678 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.555 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.551+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5788 (0'0,36'5788] local-lis/les=21/22 n=679 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5788 lcod 36'5786 mlcod 36'5786 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.557 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.555+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5640 (0'0,36'5640] local-lis/les=21/22 n=633 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5640 lcod 36'5638 mlcod 36'5638 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.559 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.557+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5524 (0'0,36'5524] local-lis/les=21/22 n=584 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5524 lcod 36'5523 mlcod 36'5523 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.562 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.558+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5790 (0'0,36'5790] local-lis/les=21/22 n=677 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5788 crt=36'5788 lcod 36'5786 mlcod 36'5786 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.563 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.561+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5526 (0'0,36'5526] local-lis/les=21/22 n=582 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5524 crt=36'5524 lcod 36'5523 mlcod 36'5523 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.563 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.558+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5642 (0'0,36'5642] local-lis/les=21/22 n=631 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5640 crt=36'5640 lcod 36'5638 mlcod 36'5638 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.564 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.562+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5682 (0'0,36'5682] local-lis/les=21/22 n=686 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5680 crt=36'5680 lcod 36'5678 mlcod 36'5678 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.568 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.565+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5536 (0'0,36'5536] local-lis/les=21/22 n=535 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5536 lcod 36'5534 mlcod 36'5534 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.568 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.566+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5840 (0'0,36'5840] local-lis/les=21/22 n=709 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5840 lcod 36'5838 mlcod 36'5838 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.574 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.569+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5538 (0'0,36'5538] local-lis/les=21/22 n=533 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5536 crt=36'5536 lcod 36'5534 mlcod 36'5534 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.577 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.574+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5792 (0'0,36'5792] local-lis/les=21/22 n=675 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5792 lcod 36'5790 mlcod 36'5790 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.578 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.576+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5528 (0'0,36'5528] local-lis/les=21/22 n=580 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5528 lcod 36'5526 mlcod 36'5526 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.582 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.579+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5687 (0'0,36'5687] local-lis/les=21/22 n=682 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5684 crt=36'5684 lcod 36'5682 mlcod 36'5682 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.583 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.581+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5530 (0'0,36'5530] local-lis/les=21/22 n=578 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5528 crt=36'5528 lcod 36'5526 mlcod 36'5526 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.583 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.575+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5605 (0'0,36'5605] local-lis/les=21/22 n=667 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5605 lcod 36'5603 mlcod 36'5603 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.584 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.580+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5607 (0'0,36'5607] local-lis/les=21/22 n=665 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5605 crt=36'5605 lcod 36'5603 mlcod 36'5603 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.585 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.575+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5506 (0'0,36'5506] local-lis/les=21/22 n=644 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5506 lcod 36'5505 mlcod 36'5505 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.586 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.579+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5508 (0'0,36'5508] local-lis/les=21/22 n=642 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5506 crt=36'5506 lcod 36'5505 mlcod 36'5505 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.588 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.586+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5794 (0'0,36'5794] local-lis/les=21/22 n=673 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5792 crt=36'5792 lcod 36'5790 mlcod 36'5790 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.589 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.587+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5644 (0'0,36'5644] local-lis/les=21/22 n=629 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5644 lcod 36'5642 mlcod 36'5642 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.592 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.590+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5540 (0'0,36'5540] local-lis/les=21/22 n=531 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5540 lcod 36'5538 mlcod 36'5538 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.592 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.590+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5646 (0'0,36'5646] local-lis/les=21/22 n=627 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5644 crt=36'5644 lcod 36'5642 mlcod 36'5642 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.595 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.592+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5843 (0'0,36'5843] local-lis/les=21/22 n=706 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5843 lcod 36'5842 mlcod 36'5842 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.597 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.596+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5609 (0'0,36'5609] local-lis/les=21/22 n=663 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5609 lcod 36'5607 mlcod 36'5607 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.599 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.595+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5542 (0'0,36'5542] local-lis/les=21/22 n=529 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5540 crt=36'5540 lcod 36'5538 mlcod 36'5538 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.599 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.596+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5845 (0'0,36'5845] local-lis/les=21/22 n=704 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5843 crt=36'5843 lcod 36'5842 mlcod 36'5842 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.602 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.596+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5532 (0'0,36'5532] local-lis/les=21/22 n=576 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5532 lcod 36'5530 mlcod 36'5530 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.602 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.600+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5611 (0'0,36'5611] local-lis/les=21/22 n=661 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5609 crt=36'5609 lcod 36'5607 mlcod 36'5607 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.604 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.602+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5796 (0'0,36'5796] local-lis/les=21/22 n=671 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5796 lcod 36'5794 mlcod 36'5794 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.609 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.605+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5798 (0'0,36'5798] local-lis/les=21/22 n=669 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5796 crt=36'5796 lcod 36'5794 mlcod 36'5794 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.609 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.603+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5510 (0'0,36'5510] local-lis/les=21/22 n=640 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5510 lcod 36'5508 mlcod 36'5508 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.610 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.607+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5512 (0'0,36'5512] local-lis/les=21/22 n=638 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5510 crt=36'5510 lcod 36'5508 mlcod 36'5508 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.610 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.605+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5534 (0'0,36'5534] local-lis/les=21/22 n=574 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5532 crt=36'5532 lcod 36'5530 mlcod 36'5530 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.612 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.610+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5689 (0'0,36'5689] local-lis/les=21/22 n=680 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5689 lcod 36'5687 mlcod 36'5687 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.616 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.613+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5691 (0'0,36'5691] local-lis/les=21/22 n=678 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5689 crt=36'5689 lcod 36'5687 mlcod 36'5687 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.617 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.612+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5649 (0'0,36'5649] local-lis/les=21/22 n=624 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5649 lcod 36'5648 mlcod 36'5648 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.617 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.614+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5545 (0'0,36'5545] local-lis/les=21/22 n=526 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5544 crt=36'5540 lcod 36'5542 mlcod 36'5542 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.620 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.618+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5651 (0'0,36'5651] local-lis/les=21/22 n=622 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5649 crt=36'5649 lcod 36'5648 mlcod 36'5648 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.621 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.618+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5547 (0'0,36'5547] local-lis/les=21/22 n=524 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5544 crt=36'5544 lcod 36'5542 mlcod 36'5542 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.623 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.620+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5847 (0'0,36'5847] local-lis/les=21/22 n=702 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5847 lcod 36'5845 mlcod 36'5845 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.623 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.620+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5801 (0'0,36'5801] local-lis/les=21/22 n=666 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5800 crt=36'5796 lcod 36'5798 mlcod 36'5798 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.628 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.624+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5849 (0'0,36'5849] local-lis/les=21/22 n=700 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5847 crt=36'5847 lcod 36'5845 mlcod 36'5845 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.628 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.624+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5803 (0'0,36'5803] local-lis/les=21/22 n=664 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5800 crt=36'5800 lcod 36'5798 mlcod 36'5798 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.629 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.628+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5613 (0'0,36'5613] local-lis/les=21/22 n=659 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5613 lcod 36'5611 mlcod 36'5611 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.632 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.630+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5653 (0'0,36'5653] local-lis/les=21/22 n=620 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5653 lcod 36'5651 mlcod 36'5651 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.633 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.631+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5514 (0'0,36'5514] local-lis/les=21/22 n=636 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5514 lcod 36'5512 mlcod 36'5512 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.635 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.632+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5655 (0'0,36'5655] local-lis/les=21/22 n=618 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5653 crt=36'5653 lcod 36'5651 mlcod 36'5651 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.640 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.632+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5615 (0'0,36'5615] local-lis/les=21/22 n=657 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5613 crt=36'5613 lcod 36'5611 mlcod 36'5611 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.645 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.635+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5536 (0'0,36'5536] local-lis/les=21/22 n=572 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5536 lcod 36'5534 mlcod 36'5534 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.645 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.642+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5538 (0'0,36'5538] local-lis/les=21/22 n=570 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5536 crt=36'5536 lcod 36'5534 mlcod 36'5534 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.646 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.641+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5549 (0'0,36'5549] local-lis/les=21/22 n=522 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5549 lcod 36'5547 mlcod 36'5547 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.649 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.642+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5851 (0'0,36'5851] local-lis/les=21/22 n=698 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5851 lcod 36'5849 mlcod 36'5849 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.650 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.644+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5551 (0'0,36'5551] local-lis/les=21/22 n=520 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5549 crt=36'5549 lcod 36'5547 mlcod 36'5547 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.652 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.646+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5853 (0'0,36'5853] local-lis/les=21/22 n=696 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5851 crt=36'5851 lcod 36'5849 mlcod 36'5849 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.654 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.651+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5695 (0'0,36'5695] local-lis/les=21/22 n=674 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5694 crt=36'5694 lcod 36'5693 mlcod 36'5693 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.656 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.654+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5617 (0'0,36'5617] local-lis/les=21/22 n=655 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5617 lcod 36'5615 mlcod 36'5615 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.657 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.654+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5516 (0'0,36'5516] local-lis/les=21/22 n=634 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5516 lcod 36'5514 mlcod 36'5514 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.658 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.655+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5697 (0'0,36'5697] local-lis/les=21/22 n=672 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5694 crt=36'5694 lcod 36'5693 mlcod 36'5693 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.660 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.658+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5619 (0'0,36'5619] local-lis/les=21/22 n=653 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5617 crt=36'5617 lcod 36'5615 mlcod 36'5615 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.661 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.658+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5518 (0'0,36'5518] local-lis/les=21/22 n=632 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5516 crt=36'5516 lcod 36'5514 mlcod 36'5514 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.662 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.659+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5806 (0'0,36'5806] local-lis/les=21/22 n=661 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5806 lcod 36'5805 mlcod 36'5805 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.664 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.662+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5657 (0'0,36'5657] local-lis/les=21/22 n=616 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5657 lcod 36'5655 mlcod 36'5655 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.669 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.666+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5659 (0'0,36'5659] local-lis/les=21/22 n=614 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5657 crt=36'5657 lcod 36'5655 mlcod 36'5655 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.671 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.663+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5808 (0'0,36'5808] local-lis/les=21/22 n=659 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5806 crt=36'5806 lcod 36'5805 mlcod 36'5805 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.672 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.665+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5855 (0'0,36'5855] local-lis/les=21/22 n=694 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5855 lcod 36'5853 mlcod 36'5853 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.672 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.668+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5553 (0'0,36'5553] local-lis/les=21/22 n=518 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5553 lcod 36'5551 mlcod 36'5551 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.673 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.669+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5857 (0'0,36'5857] local-lis/les=21/22 n=692 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5855 crt=36'5855 lcod 36'5853 mlcod 36'5853 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.676 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.673+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5555 (0'0,36'5555] local-lis/les=21/22 n=516 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5553 crt=36'5553 lcod 36'5551 mlcod 36'5551 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.677 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.670+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5622 (0'0,36'5622] local-lis/les=21/22 n=650 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5621 crt=36'5617 lcod 36'5619 mlcod 36'5619 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.680 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.678+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5624 (0'0,36'5624] local-lis/les=21/22 n=648 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5621 crt=36'5621 lcod 36'5619 mlcod 36'5619 active+clean+snaptrim trimq=[202~26] ps=[1fe~4]] removing snap head 2020-02-11T16:31:30.681 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.678+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5540 (0'0,36'5540] local-lis/les=21/22 n=568 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5540 lcod 36'5538 mlcod 36'5538 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.684 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.682+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5699 (0'0,36'5699] local-lis/les=21/22 n=670 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5699 lcod 36'5697 mlcod 36'5697 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.685 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.683+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5542 (0'0,36'5542] local-lis/les=21/22 n=566 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5540 crt=36'5540 lcod 36'5538 mlcod 36'5538 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.688 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.682+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5520 (0'0,36'5520] local-lis/les=21/22 n=630 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5520 lcod 36'5518 mlcod 36'5518 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.688 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.686+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5522 (0'0,36'5522] local-lis/les=21/22 n=628 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5520 crt=36'5520 lcod 36'5518 mlcod 36'5518 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.692 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.689+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5701 (0'0,36'5701] local-lis/les=21/22 n=668 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5699 crt=36'5699 lcod 36'5697 mlcod 36'5697 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.693 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.690+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5810 (0'0,36'5810] local-lis/les=21/22 n=657 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5810 lcod 36'5808 mlcod 36'5808 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.694 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.692+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5661 (0'0,36'5661] local-lis/les=21/22 n=612 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5661 lcod 36'5659 mlcod 36'5659 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.696 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.693+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5860 (0'0,36'5860] local-lis/les=21/22 n=689 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5859 crt=36'5855 lcod 36'5857 mlcod 36'5857 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.696 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.694+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5812 (0'0,36'5812] local-lis/les=21/22 n=655 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5810 crt=36'5810 lcod 36'5808 mlcod 36'5808 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.697 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.695+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5544 (0'0,36'5544] local-lis/les=21/22 n=564 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5544 lcod 36'5542 mlcod 36'5542 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.698 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.696+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5663 (0'0,36'5663] local-lis/les=21/22 n=610 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5661 crt=36'5661 lcod 36'5659 mlcod 36'5659 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.700 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.697+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5862 (0'0,36'5862] local-lis/les=21/22 n=687 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5859 crt=36'5859 lcod 36'5857 mlcod 36'5857 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.700 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.696+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5626 (0'0,36'5626] local-lis/les=21/22 n=646 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5626 lcod 36'5624 mlcod 36'5624 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.702 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.700+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5557 (0'0,36'5557] local-lis/les=21/22 n=514 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5557 lcod 36'5555 mlcod 36'5555 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.707 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.702+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5628 (0'0,36'5628] local-lis/les=21/22 n=644 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5626 crt=36'5626 lcod 36'5624 mlcod 36'5624 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.713 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.710+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5559 (0'0,36'5559] local-lis/les=21/22 n=512 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5559 lcod 36'5557 mlcod 36'5557 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.714 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.710+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5814 (0'0,36'5814] local-lis/les=21/22 n=653 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5814 lcod 36'5812 mlcod 36'5812 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.714 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.712+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5864 (0'0,36'5864] local-lis/les=21/22 n=685 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5864 lcod 36'5862 mlcod 36'5862 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.715 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.713+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5561 (0'0,36'5561] local-lis/les=21/22 n=510 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5559 crt=36'5559 lcod 36'5557 mlcod 36'5557 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.716 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.713+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5816 (0'0,36'5816] local-lis/les=21/22 n=651 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5814 crt=36'5814 lcod 36'5812 mlcod 36'5812 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.719 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.717+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5630 (0'0,36'5630] local-lis/les=21/22 n=642 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5630 lcod 36'5628 mlcod 36'5628 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.719 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.716+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5526 (0'0,36'5526] local-lis/les=21/22 n=624 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5524 crt=36'5520 lcod 36'5522 mlcod 36'5522 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.720 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.715+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5866 (0'0,36'5866] local-lis/les=21/22 n=683 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5864 crt=36'5864 lcod 36'5862 mlcod 36'5862 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.722 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.717+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5665 (0'0,36'5665] local-lis/les=21/22 n=608 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5665 lcod 36'5663 mlcod 36'5663 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.723 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.720+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5528 (0'0,36'5528] local-lis/les=21/22 n=622 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5524 crt=36'5524 lcod 36'5522 mlcod 36'5522 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.727 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.725+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5667 (0'0,36'5667] local-lis/les=21/22 n=606 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5665 crt=36'5665 lcod 36'5663 mlcod 36'5663 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.727 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.724+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5632 (0'0,36'5632] local-lis/les=21/22 n=640 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5630 crt=36'5630 lcod 36'5628 mlcod 36'5628 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.728 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.718+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5703 (0'0,36'5703] local-lis/les=21/22 n=666 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5703 lcod 36'5701 mlcod 36'5701 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.734 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.732+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5563 (0'0,36'5563] local-lis/les=21/22 n=508 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5563 lcod 36'5561 mlcod 36'5561 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.735 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.733+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5819 (0'0,36'5819] local-lis/les=21/22 n=648 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5818 crt=36'5814 lcod 36'5816 mlcod 36'5816 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.737 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.735+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5565 (0'0,36'5565] local-lis/les=21/22 n=506 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5563 crt=36'5563 lcod 36'5561 mlcod 36'5561 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.738 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.736+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5821 (0'0,36'5821] local-lis/les=21/22 n=646 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5818 crt=36'5818 lcod 36'5816 mlcod 36'5816 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.742 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.739+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5546 (0'0,36'5546] local-lis/les=21/22 n=562 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5546 lcod 36'5544 mlcod 36'5544 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.745 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.743+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5548 (0'0,36'5548] local-lis/les=21/22 n=560 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5546 crt=36'5546 lcod 36'5544 mlcod 36'5544 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.745 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.743+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5705 (0'0,36'5705] local-lis/les=21/22 n=664 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5705 lcod 36'5703 mlcod 36'5703 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.746 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.743+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5868 (0'0,36'5868] local-lis/les=21/22 n=681 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5868 lcod 36'5866 mlcod 36'5866 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.749 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.746+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5707 (0'0,36'5707] local-lis/les=21/22 n=662 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5705 crt=36'5705 lcod 36'5703 mlcod 36'5703 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.749 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.746+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5669 (0'0,36'5669] local-lis/les=21/22 n=604 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5669 lcod 36'5667 mlcod 36'5667 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.754 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.747+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5870 (0'0,36'5870] local-lis/les=21/22 n=679 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5868 crt=36'5868 lcod 36'5866 mlcod 36'5866 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.757 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.753+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5567 (0'0,36'5567] local-lis/les=21/22 n=504 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5567 lcod 36'5565 mlcod 36'5565 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.759 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.756+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5569 (0'0,36'5569] local-lis/les=21/22 n=502 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5567 crt=36'5567 lcod 36'5565 mlcod 36'5565 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.760 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.750+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5671 (0'0,36'5671] local-lis/les=21/22 n=602 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5669 crt=36'5669 lcod 36'5667 mlcod 36'5667 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.760 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.752+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5531 (0'0,36'5531] local-lis/les=21/22 n=619 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5531 lcod 36'5530 mlcod 36'5530 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.761 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.759+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5634 (0'0,36'5634] local-lis/les=21/22 n=638 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5634 lcod 36'5632 mlcod 36'5632 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.761 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.758+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5533 (0'0,36'5533] local-lis/les=21/22 n=617 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5531 crt=36'5531 lcod 36'5530 mlcod 36'5530 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.765 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.760+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5551 (0'0,36'5551] local-lis/les=21/22 n=557 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5550 crt=36'5546 lcod 36'5548 mlcod 36'5548 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.766 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.763+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5823 (0'0,36'5823] local-lis/les=21/22 n=644 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5823 lcod 36'5821 mlcod 36'5821 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.766 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.763+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5710 (0'0,36'5710] local-lis/les=21/22 n=659 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5709 crt=36'5705 lcod 36'5707 mlcod 36'5707 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.768 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.763+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5636 (0'0,36'5636] local-lis/les=21/22 n=636 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5634 crt=36'5634 lcod 36'5632 mlcod 36'5632 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.770 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.767+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5712 (0'0,36'5712] local-lis/les=21/22 n=657 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5709 crt=36'5709 lcod 36'5707 mlcod 36'5707 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.770 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.767+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5872 (0'0,36'5872] local-lis/les=21/22 n=677 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5872 lcod 36'5870 mlcod 36'5870 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.771 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.768+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5673 (0'0,36'5673] local-lis/les=21/22 n=600 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5673 lcod 36'5671 mlcod 36'5671 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.773 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.768+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5825 (0'0,36'5825] local-lis/les=21/22 n=642 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5823 crt=36'5823 lcod 36'5821 mlcod 36'5821 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.774 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.772+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5675 (0'0,36'5675] local-lis/les=21/22 n=598 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5673 crt=36'5673 lcod 36'5671 mlcod 36'5671 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.775 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.773+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5535 (0'0,36'5535] local-lis/les=21/22 n=615 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5535 lcod 36'5533 mlcod 36'5533 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.777 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.774+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5874 (0'0,36'5874] local-lis/les=21/22 n=675 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5872 crt=36'5872 lcod 36'5870 mlcod 36'5870 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.781 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.778+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5571 (0'0,36'5571] local-lis/les=21/22 n=500 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5571 lcod 36'5569 mlcod 36'5569 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.782 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.780+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5537 (0'0,36'5537] local-lis/les=21/22 n=613 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5535 crt=36'5535 lcod 36'5533 mlcod 36'5533 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.785 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.780+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5553 (0'0,36'5553] local-lis/les=21/22 n=555 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5550 crt=36'5550 lcod 36'5548 mlcod 36'5548 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.786 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.782+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5573 (0'0,36'5573] local-lis/les=21/22 n=498 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5571 crt=36'5571 lcod 36'5569 mlcod 36'5569 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.789 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.784+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5715 (0'0,36'5715] local-lis/les=21/22 n=654 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5714 crt=36'5710 lcod 36'5712 mlcod 36'5712 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.790 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.787+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5677 (0'0,36'5677] local-lis/les=21/22 n=596 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5677 lcod 36'5675 mlcod 36'5675 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.790 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.788+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5717 (0'0,36'5717] local-lis/les=21/22 n=652 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5714 crt=36'5714 lcod 36'5712 mlcod 36'5712 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.792 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.789+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5827 (0'0,36'5827] local-lis/les=21/22 n=640 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5827 lcod 36'5825 mlcod 36'5825 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.794 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.791+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5679 (0'0,36'5679] local-lis/les=21/22 n=594 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5677 crt=36'5677 lcod 36'5675 mlcod 36'5675 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.795 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.792+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5829 (0'0,36'5829] local-lis/les=21/22 n=638 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5827 crt=36'5827 lcod 36'5825 mlcod 36'5825 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.801 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.796+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5638 (0'0,36'5638] local-lis/les=21/22 n=634 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5638 lcod 36'5636 mlcod 36'5636 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.802 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.799+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5640 (0'0,36'5640] local-lis/les=21/22 n=632 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5638 crt=36'5638 lcod 36'5636 mlcod 36'5636 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.803 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.801+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5555 (0'0,36'5555] local-lis/les=21/22 n=553 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5555 lcod 36'5553 mlcod 36'5553 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.807 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.800+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5575 (0'0,36'5575] local-lis/les=21/22 n=496 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5575 lcod 36'5573 mlcod 36'5573 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.807 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.801+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5876 (0'0,36'5876] local-lis/les=21/22 n=673 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5876 lcod 36'5874 mlcod 36'5874 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.808 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.804+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5577 (0'0,36'5577] local-lis/les=21/22 n=494 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5575 crt=36'5575 lcod 36'5573 mlcod 36'5573 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.809 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.805+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5878 (0'0,36'5878] local-lis/les=21/22 n=671 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5876 crt=36'5876 lcod 36'5874 mlcod 36'5874 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.810 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.797+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5539 (0'0,36'5539] local-lis/les=21/22 n=611 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5539 lcod 36'5537 mlcod 36'5537 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.810 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.801+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5541 (0'0,36'5541] local-lis/les=21/22 n=609 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5539 crt=36'5539 lcod 36'5537 mlcod 36'5537 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.811 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.808+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5831 (0'0,36'5831] local-lis/les=21/22 n=636 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5831 lcod 36'5829 mlcod 36'5829 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.816 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.813+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5833 (0'0,36'5833] local-lis/les=21/22 n=634 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5831 crt=36'5831 lcod 36'5829 mlcod 36'5829 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.818 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.816+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5721 (0'0,36'5721] local-lis/les=21/22 n=648 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5721 lcod 36'5720 mlcod 36'5720 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.818 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.811+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5557 (0'0,36'5557] local-lis/les=21/22 n=551 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5555 crt=36'5555 lcod 36'5553 mlcod 36'5553 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.822 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.819+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5723 (0'0,36'5723] local-lis/les=21/22 n=646 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5721 crt=36'5721 lcod 36'5720 mlcod 36'5720 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.822 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.818+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5681 (0'0,36'5681] local-lis/les=21/22 n=592 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5681 lcod 36'5679 mlcod 36'5679 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.826 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.821+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5683 (0'0,36'5683] local-lis/les=21/22 n=590 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5681 crt=36'5681 lcod 36'5679 mlcod 36'5679 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.827 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.825+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5643 (0'0,36'5643] local-lis/les=21/22 n=629 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5643 lcod 36'5642 mlcod 36'5642 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.827 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.825+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5579 (0'0,36'5579] local-lis/les=21/22 n=492 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5579 lcod 36'5577 mlcod 36'5577 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.832 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.829+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5559 (0'0,36'5559] local-lis/les=21/22 n=549 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5559 lcod 36'5557 mlcod 36'5557 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.833 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.831+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5581 (0'0,36'5581] local-lis/les=21/22 n=490 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5579 crt=36'5579 lcod 36'5577 mlcod 36'5577 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.834 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.831+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5645 (0'0,36'5645] local-lis/les=21/22 n=627 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5643 crt=36'5643 lcod 36'5642 mlcod 36'5642 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.834 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.832+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5880 (0'0,36'5880] local-lis/les=21/22 n=669 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5880 lcod 36'5878 mlcod 36'5878 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.835 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.833+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5543 (0'0,36'5543] local-lis/les=21/22 n=607 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5543 lcod 36'5541 mlcod 36'5541 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.836 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.833+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5561 (0'0,36'5561] local-lis/les=21/22 n=547 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5559 crt=36'5559 lcod 36'5557 mlcod 36'5557 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.837 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.835+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5882 (0'0,36'5882] local-lis/les=21/22 n=667 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5880 crt=36'5880 lcod 36'5878 mlcod 36'5878 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.838 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.836+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5545 (0'0,36'5545] local-lis/les=21/22 n=605 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5543 crt=36'5543 lcod 36'5541 mlcod 36'5541 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.844 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.841+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5836 (0'0,36'5836] local-lis/les=21/22 n=631 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5835 crt=36'5831 lcod 36'5833 mlcod 36'5833 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.844 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.841+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5685 (0'0,36'5685] local-lis/les=21/22 n=588 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5685 lcod 36'5683 mlcod 36'5683 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.847 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.845+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5687 (0'0,36'5687] local-lis/les=21/22 n=586 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5685 crt=36'5685 lcod 36'5683 mlcod 36'5683 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.848 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.845+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5583 (0'0,36'5583] local-lis/les=21/22 n=488 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5583 lcod 36'5581 mlcod 36'5581 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.848 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.845+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5838 (0'0,36'5838] local-lis/les=21/22 n=629 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5835 crt=36'5835 lcod 36'5833 mlcod 36'5833 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.851 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.849+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5585 (0'0,36'5585] local-lis/les=21/22 n=486 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5583 crt=36'5583 lcod 36'5581 mlcod 36'5581 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.851 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.850+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5563 (0'0,36'5563] local-lis/les=21/22 n=545 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5563 lcod 36'5561 mlcod 36'5561 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.853 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.851+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5647 (0'0,36'5647] local-lis/les=21/22 n=625 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5647 lcod 36'5645 mlcod 36'5645 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.857 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.855+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5649 (0'0,36'5649] local-lis/les=21/22 n=623 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5647 crt=36'5647 lcod 36'5645 mlcod 36'5645 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.858 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.856+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5886 (0'0,36'5886] local-lis/les=21/22 n=664 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5884 crt=36'5884 lcod 36'5882 mlcod 36'5882 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.862 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.860+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5726 (0'0,36'5726] local-lis/les=21/22 n=643 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5725 crt=36'5721 lcod 36'5723 mlcod 36'5723 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.864 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.862+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5565 (0'0,36'5565] local-lis/les=21/22 n=543 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5563 crt=36'5563 lcod 36'5561 mlcod 36'5561 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.864 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.862+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5547 (0'0,36'5547] local-lis/les=21/22 n=603 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5547 lcod 36'5545 mlcod 36'5545 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.868 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.866+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5549 (0'0,36'5549] local-lis/les=21/22 n=601 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5547 crt=36'5547 lcod 36'5545 mlcod 36'5545 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.869 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.864+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5728 (0'0,36'5728] local-lis/les=21/22 n=641 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5725 crt=36'5725 lcod 36'5723 mlcod 36'5723 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.874 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.873+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5651 (0'0,36'5651] local-lis/les=21/22 n=621 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5651 lcod 36'5649 mlcod 36'5649 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.875 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.871+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5587 (0'0,36'5587] local-lis/les=21/22 n=484 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5587 lcod 36'5585 mlcod 36'5585 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.877 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.871+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5689 (0'0,36'5689] local-lis/les=21/22 n=584 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5689 lcod 36'5687 mlcod 36'5687 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.879 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.877+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5568 (0'0,36'5568] local-lis/les=21/22 n=540 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5567 crt=36'5567 lcod 36'5565 mlcod 36'5565 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.886 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.884+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5570 (0'0,36'5570] local-lis/les=21/22 n=538 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5567 crt=36'5567 lcod 36'5565 mlcod 36'5565 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.887 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.880+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5888 (0'0,36'5888] local-lis/les=21/22 n=662 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5888 lcod 36'5886 mlcod 36'5886 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.887 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.881+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5589 (0'0,36'5589] local-lis/les=21/22 n=482 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5587 crt=36'5587 lcod 36'5585 mlcod 36'5585 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.887 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.881+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5691 (0'0,36'5691] local-lis/les=21/22 n=582 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5689 crt=36'5689 lcod 36'5687 mlcod 36'5687 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.888 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.885+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5551 (0'0,36'5551] local-lis/les=21/22 n=599 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5551 lcod 36'5549 mlcod 36'5549 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.889 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.884+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5890 (0'0,36'5890] local-lis/les=21/22 n=660 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5888 crt=36'5888 lcod 36'5886 mlcod 36'5886 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.889 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.876+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5731 (0'0,36'5731] local-lis/les=21/22 n=638 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5730 crt=36'5728 lcod 36'5728 mlcod 36'5728 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.890 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.886+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5653 (0'0,36'5653] local-lis/les=21/22 n=619 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5651 crt=36'5651 lcod 36'5649 mlcod 36'5649 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.890 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.877+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5840 (0'0,36'5840] local-lis/les=21/22 n=627 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5840 lcod 36'5838 mlcod 36'5838 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.890 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.882+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5733 (0'0,36'5733] local-lis/les=21/22 n=636 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5730 crt=36'5730 lcod 36'5728 mlcod 36'5728 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.891 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.888+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5553 (0'0,36'5553] local-lis/les=21/22 n=597 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5551 crt=36'5551 lcod 36'5549 mlcod 36'5549 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.892 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.890+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5842 (0'0,36'5842] local-lis/les=21/22 n=625 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5840 crt=36'5840 lcod 36'5838 mlcod 36'5838 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.898 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.894+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5735 (0'0,36'5735] local-lis/les=21/22 n=634 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5735 lcod 36'5733 mlcod 36'5733 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.899 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.897+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5737 (0'0,36'5737] local-lis/les=21/22 n=632 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5735 crt=36'5735 lcod 36'5733 mlcod 36'5733 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.903 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.898+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5694 (0'0,36'5694] local-lis/les=21/22 n=579 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5693 crt=36'5691 lcod 36'5691 mlcod 36'5691 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.904 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.898+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5892 (0'0,36'5892] local-lis/les=21/22 n=658 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5892 lcod 36'5890 mlcod 36'5890 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.904 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.900+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5696 (0'0,36'5696] local-lis/les=21/22 n=577 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5693 crt=36'5693 lcod 36'5691 mlcod 36'5691 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.905 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.902+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5894 (0'0,36'5894] local-lis/les=21/22 n=656 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5892 crt=36'5892 lcod 36'5890 mlcod 36'5890 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.908 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.902+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5844 (0'0,36'5844] local-lis/les=21/22 n=623 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5844 lcod 36'5842 mlcod 36'5842 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.909 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.905+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5573 (0'0,36'5573] local-lis/les=21/22 n=535 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5572 crt=36'5572 lcod 36'5570 mlcod 36'5570 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.909 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.906+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5846 (0'0,36'5846] local-lis/les=21/22 n=621 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5844 crt=36'5844 lcod 36'5842 mlcod 36'5842 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.913 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.911+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5655 (0'0,36'5655] local-lis/les=21/22 n=617 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5655 lcod 36'5653 mlcod 36'5653 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.913 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.910+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5591 (0'0,36'5591] local-lis/les=21/22 n=480 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5591 lcod 36'5589 mlcod 36'5589 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.916 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.915+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5657 (0'0,36'5657] local-lis/les=21/22 n=615 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5655 crt=36'5655 lcod 36'5653 mlcod 36'5653 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.917 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.914+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5555 (0'0,36'5555] local-lis/les=21/22 n=595 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5555 lcod 36'5553 mlcod 36'5553 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.917 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.914+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5593 (0'0,36'5593] local-lis/les=21/22 n=478 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5591 crt=36'5591 lcod 36'5589 mlcod 36'5589 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.919 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.917+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5557 (0'0,36'5557] local-lis/les=21/22 n=593 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5555 crt=36'5555 lcod 36'5553 mlcod 36'5553 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.919 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.916+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5575 (0'0,36'5575] local-lis/les=21/22 n=533 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5572 crt=36'5572 lcod 36'5570 mlcod 36'5570 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.925 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.922+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5739 (0'0,36'5739] local-lis/les=21/22 n=630 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5739 lcod 36'5737 mlcod 36'5737 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.928 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.925+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5741 (0'0,36'5741] local-lis/les=21/22 n=628 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5739 crt=36'5739 lcod 36'5737 mlcod 36'5737 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.928 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.925+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5698 (0'0,36'5698] local-lis/les=21/22 n=575 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5698 lcod 36'5696 mlcod 36'5696 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.932 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.929+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5700 (0'0,36'5700] local-lis/les=21/22 n=573 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5698 crt=36'5698 lcod 36'5696 mlcod 36'5696 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.933 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.931+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5848 (0'0,36'5848] local-lis/les=21/22 n=619 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5848 lcod 36'5846 mlcod 36'5846 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.935 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.928+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5896 (0'0,36'5896] local-lis/les=21/22 n=654 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5896 lcod 36'5894 mlcod 36'5894 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.936 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.932+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5898 (0'0,36'5898] local-lis/les=21/22 n=652 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5896 crt=36'5896 lcod 36'5894 mlcod 36'5894 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.939 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.936+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5659 (0'0,36'5659] local-lis/les=21/22 n=613 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5659 lcod 36'5657 mlcod 36'5657 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.939 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.935+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5850 (0'0,36'5850] local-lis/les=21/22 n=617 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5848 crt=36'5848 lcod 36'5846 mlcod 36'5846 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.940 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.936+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5595 (0'0,36'5595] local-lis/les=21/22 n=476 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5595 lcod 36'5593 mlcod 36'5593 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.941 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.939+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5597 (0'0,36'5597] local-lis/les=21/22 n=474 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5595 crt=36'5595 lcod 36'5593 mlcod 36'5593 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.943 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.941+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5661 (0'0,36'5661] local-lis/les=21/22 n=611 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5659 crt=36'5659 lcod 36'5657 mlcod 36'5657 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.944 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.942+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5577 (0'0,36'5577] local-lis/les=21/22 n=531 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5577 lcod 36'5575 mlcod 36'5575 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.947 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.945+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5743 (0'0,36'5743] local-lis/les=21/22 n=626 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5743 lcod 36'5741 mlcod 36'5741 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.948 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.946+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5579 (0'0,36'5579] local-lis/les=21/22 n=529 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5577 crt=36'5577 lcod 36'5575 mlcod 36'5575 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.951 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.949+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5900 (0'0,36'5900] local-lis/les=21/22 n=650 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5900 lcod 36'5898 mlcod 36'5898 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.952 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.950+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5560 (0'0,36'5560] local-lis/les=21/22 n=590 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5560 lcod 36'5559 mlcod 36'5559 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.957 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.952+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5745 (0'0,36'5745] local-lis/les=21/22 n=624 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5743 crt=36'5743 lcod 36'5741 mlcod 36'5741 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.958 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.954+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5562 (0'0,36'5562] local-lis/les=21/22 n=588 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5560 crt=36'5560 lcod 36'5559 mlcod 36'5559 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.959 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.956+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5852 (0'0,36'5852] local-lis/les=21/22 n=615 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5852 lcod 36'5850 mlcod 36'5850 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.963 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.961+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5663 (0'0,36'5663] local-lis/les=21/22 n=609 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5663 lcod 36'5661 mlcod 36'5661 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.964 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.962+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5599 (0'0,36'5599] local-lis/les=21/22 n=472 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5599 lcod 36'5597 mlcod 36'5597 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.967 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.960+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5854 (0'0,36'5854] local-lis/les=21/22 n=613 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5852 crt=36'5852 lcod 36'5850 mlcod 36'5850 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.967 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.965+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5665 (0'0,36'5665] local-lis/les=21/22 n=607 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5663 crt=36'5663 lcod 36'5661 mlcod 36'5661 active+clean+snaptrim trimq=[203~25] ps=[1fe~5]] removing snap head 2020-02-11T16:31:30.968 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.966+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5601 (0'0,36'5601] local-lis/les=21/22 n=470 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5599 crt=36'5599 lcod 36'5597 mlcod 36'5597 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.969 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.967+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5902 (0'0,36'5902] local-lis/les=21/22 n=648 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5902 lcod 36'5900 mlcod 36'5900 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.970 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.968+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5703 (0'0,36'5703] local-lis/les=21/22 n=570 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5703 lcod 36'5702 mlcod 36'5702 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.976 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.972+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5705 (0'0,36'5705] local-lis/les=21/22 n=568 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5703 crt=36'5703 lcod 36'5702 mlcod 36'5702 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.976 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.970+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5904 (0'0,36'5904] local-lis/les=21/22 n=646 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5902 crt=36'5902 lcod 36'5900 mlcod 36'5900 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.978 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.976+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5564 (0'0,36'5564] local-lis/les=21/22 n=586 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5564 lcod 36'5562 mlcod 36'5562 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.978 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.972+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5582 (0'0,36'5582] local-lis/les=21/22 n=526 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5581 crt=36'5577 lcod 36'5579 mlcod 36'5579 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.979 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.976+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5747 (0'0,36'5747] local-lis/les=21/22 n=622 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5747 lcod 36'5745 mlcod 36'5745 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.981 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.979+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5566 (0'0,36'5566] local-lis/les=21/22 n=584 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5564 crt=36'5564 lcod 36'5562 mlcod 36'5562 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.982 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.979+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5749 (0'0,36'5749] local-lis/les=21/22 n=620 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5747 crt=36'5747 lcod 36'5745 mlcod 36'5745 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.982 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.979+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5584 (0'0,36'5584] local-lis/les=21/22 n=524 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5581 crt=36'5581 lcod 36'5579 mlcod 36'5579 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.995 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:30.992+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5667 (0'0,36'5667] local-lis/les=21/22 n=605 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5667 lcod 36'5665 mlcod 36'5665 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.995 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.991+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5604 (0'0,36'5604] local-lis/les=21/22 n=467 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5604 lcod 36'5603 mlcod 36'5603 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:30.999 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.989+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5857 (0'0,36'5857] local-lis/les=21/22 n=610 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5856 crt=36'5856 lcod 36'5854 mlcod 36'5854 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:30.999 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.993+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5751 (0'0,36'5751] local-lis/les=21/22 n=618 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5751 lcod 36'5749 mlcod 36'5749 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.000 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.993+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5859 (0'0,36'5859] local-lis/les=21/22 n=608 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5856 crt=36'5856 lcod 36'5854 mlcod 36'5854 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.001 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:30.997+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5753 (0'0,36'5753] local-lis/les=21/22 n=616 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5751 crt=36'5751 lcod 36'5749 mlcod 36'5749 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.001 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.995+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5606 (0'0,36'5606] local-lis/les=21/22 n=465 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5604 crt=36'5604 lcod 36'5603 mlcod 36'5603 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.001 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:30.999+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5586 (0'0,36'5586] local-lis/les=21/22 n=522 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5586 lcod 36'5584 mlcod 36'5584 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.002 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:30.999+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5906 (0'0,36'5906] local-lis/les=21/22 n=644 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5906 lcod 36'5904 mlcod 36'5904 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.002 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:30.997+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5707 (0'0,36'5707] local-lis/les=21/22 n=566 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5707 lcod 36'5705 mlcod 36'5705 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.004 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.002+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5669 (0'0,36'5669] local-lis/les=21/22 n=603 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5667 crt=36'5667 lcod 36'5665 mlcod 36'5665 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.005 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.003+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5569 (0'0,36'5569] local-lis/les=21/22 n=581 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5568 crt=36'5564 lcod 36'5566 mlcod 36'5566 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.006 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.004+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5588 (0'0,36'5588] local-lis/les=21/22 n=520 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5586 crt=36'5586 lcod 36'5584 mlcod 36'5584 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.007 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.005+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5908 (0'0,36'5908] local-lis/les=21/22 n=642 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5906 crt=36'5906 lcod 36'5904 mlcod 36'5904 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.009 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.007+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5709 (0'0,36'5709] local-lis/les=21/22 n=564 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5707 crt=36'5707 lcod 36'5705 mlcod 36'5705 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.014 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.010+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5571 (0'0,36'5571] local-lis/les=21/22 n=579 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5568 crt=36'5568 lcod 36'5566 mlcod 36'5566 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.016 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.012+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5757 (0'0,36'5757] local-lis/les=21/22 n=613 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5755 crt=36'5755 lcod 36'5753 mlcod 36'5753 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.019 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.016+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5590 (0'0,36'5590] local-lis/les=21/22 n=518 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5590 lcod 36'5588 mlcod 36'5588 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.022 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.019+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5608 (0'0,36'5608] local-lis/les=21/22 n=463 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5608 lcod 36'5606 mlcod 36'5606 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.022 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.020+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5592 (0'0,36'5592] local-lis/les=21/22 n=516 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5590 crt=36'5590 lcod 36'5588 mlcod 36'5588 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.026 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.024+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5671 (0'0,36'5671] local-lis/les=21/22 n=601 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5671 lcod 36'5669 mlcod 36'5669 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.029 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.018+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5861 (0'0,36'5861] local-lis/les=21/22 n=606 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5861 lcod 36'5859 mlcod 36'5859 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.030 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.022+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5863 (0'0,36'5863] local-lis/les=21/22 n=604 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5861 crt=36'5861 lcod 36'5859 mlcod 36'5859 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.032 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.028+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5910 (0'0,36'5910] local-lis/les=21/22 n=640 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5910 lcod 36'5908 mlcod 36'5908 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.032 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.028+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5610 (0'0,36'5610] local-lis/les=21/22 n=461 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5608 crt=36'5608 lcod 36'5606 mlcod 36'5606 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.034 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.029+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5711 (0'0,36'5711] local-lis/les=21/22 n=562 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5711 lcod 36'5709 mlcod 36'5709 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.035 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.031+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5573 (0'0,36'5573] local-lis/les=21/22 n=577 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5573 lcod 36'5571 mlcod 36'5571 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.035 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.033+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5713 (0'0,36'5713] local-lis/les=21/22 n=560 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5711 crt=36'5711 lcod 36'5709 mlcod 36'5709 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.036 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.034+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5673 (0'0,36'5673] local-lis/les=21/22 n=599 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5671 crt=36'5671 lcod 36'5669 mlcod 36'5669 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.037 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.035+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5912 (0'0,36'5912] local-lis/les=21/22 n=638 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5910 crt=36'5910 lcod 36'5908 mlcod 36'5908 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.038 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.033+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5760 (0'0,36'5760] local-lis/les=21/22 n=610 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5759 crt=36'5755 lcod 36'5757 mlcod 36'5757 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.040 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.037+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5762 (0'0,36'5762] local-lis/les=21/22 n=608 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5759 crt=36'5759 lcod 36'5757 mlcod 36'5757 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.043 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.037+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5575 (0'0,36'5575] local-lis/les=21/22 n=575 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5573 crt=36'5573 lcod 36'5571 mlcod 36'5571 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.047 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.043+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5594 (0'0,36'5594] local-lis/les=21/22 n=514 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5594 lcod 36'5592 mlcod 36'5592 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.047 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.045+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5866 (0'0,36'5866] local-lis/les=21/22 n=601 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5866 lcod 36'5865 mlcod 36'5865 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.048 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.046+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5612 (0'0,36'5612] local-lis/les=21/22 n=459 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5612 lcod 36'5610 mlcod 36'5610 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.049 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.047+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5675 (0'0,36'5675] local-lis/les=21/22 n=597 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5675 lcod 36'5673 mlcod 36'5673 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.052 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.049+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5868 (0'0,36'5868] local-lis/les=21/22 n=599 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5866 crt=36'5866 lcod 36'5865 mlcod 36'5865 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.053 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.049+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5614 (0'0,36'5614] local-lis/les=21/22 n=457 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5612 crt=36'5612 lcod 36'5610 mlcod 36'5610 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.055 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.053+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5577 (0'0,36'5577] local-lis/les=21/22 n=573 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5577 lcod 36'5575 mlcod 36'5575 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.057 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.051+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5677 (0'0,36'5677] local-lis/les=21/22 n=595 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5675 crt=36'5675 lcod 36'5673 mlcod 36'5673 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.059 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.056+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5716 (0'0,36'5716] local-lis/les=21/22 n=557 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5716 lcod 36'5715 mlcod 36'5715 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.059 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.057+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5579 (0'0,36'5579] local-lis/les=21/22 n=571 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5577 crt=36'5577 lcod 36'5575 mlcod 36'5575 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.061 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.055+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5596 (0'0,36'5596] local-lis/les=21/22 n=512 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5594 crt=36'5594 lcod 36'5592 mlcod 36'5592 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.062 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.060+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5718 (0'0,36'5718] local-lis/les=21/22 n=555 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5716 crt=36'5716 lcod 36'5715 mlcod 36'5715 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.066 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.064+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5915 (0'0,36'5915] local-lis/les=21/22 n=635 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5915 lcod 36'5914 mlcod 36'5914 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.069 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.067+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5917 (0'0,36'5917] local-lis/les=21/22 n=633 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5915 crt=36'5915 lcod 36'5914 mlcod 36'5914 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.073 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.064+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5764 (0'0,36'5764] local-lis/les=21/22 n=606 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5764 lcod 36'5762 mlcod 36'5762 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.073 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.068+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5870 (0'0,36'5870] local-lis/les=21/22 n=597 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5870 lcod 36'5868 mlcod 36'5868 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.074 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.072+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5872 (0'0,36'5872] local-lis/les=21/22 n=595 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5870 crt=36'5870 lcod 36'5868 mlcod 36'5868 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.077 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.074+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5581 (0'0,36'5581] local-lis/les=21/22 n=569 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5581 lcod 36'5579 mlcod 36'5579 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.077 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.075+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5598 (0'0,36'5598] local-lis/les=21/22 n=510 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5598 lcod 36'5596 mlcod 36'5596 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.078 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.075+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5616 (0'0,36'5616] local-lis/les=21/22 n=455 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5616 lcod 36'5614 mlcod 36'5614 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.081 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.078+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5583 (0'0,36'5583] local-lis/les=21/22 n=567 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5581 crt=36'5581 lcod 36'5579 mlcod 36'5579 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.081 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.079+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5600 (0'0,36'5600] local-lis/les=21/22 n=508 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5598 crt=36'5598 lcod 36'5596 mlcod 36'5596 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.082 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.080+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5720 (0'0,36'5720] local-lis/les=21/22 n=553 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5720 lcod 36'5718 mlcod 36'5718 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.083 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.078+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5618 (0'0,36'5618] local-lis/les=21/22 n=453 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5616 crt=36'5616 lcod 36'5614 mlcod 36'5614 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.089 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.083+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5722 (0'0,36'5722] local-lis/les=21/22 n=551 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5720 crt=36'5720 lcod 36'5718 mlcod 36'5718 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.091 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.082+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5766 (0'0,36'5766] local-lis/les=21/22 n=604 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5766 lcod 36'5764 mlcod 36'5764 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.091 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.086+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5768 (0'0,36'5768] local-lis/les=21/22 n=602 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5766 crt=36'5766 lcod 36'5764 mlcod 36'5764 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.096 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.093+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5919 (0'0,36'5919] local-lis/les=21/22 n=631 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5919 lcod 36'5917 mlcod 36'5917 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.097 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.094+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5681 (0'0,36'5681] local-lis/les=21/22 n=591 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5681 lcod 36'5680 mlcod 36'5680 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.100 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.097+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5921 (0'0,36'5921] local-lis/les=21/22 n=629 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5919 crt=36'5919 lcod 36'5917 mlcod 36'5917 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.102 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.099+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5771 (0'0,36'5771] local-lis/les=21/22 n=599 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5770 crt=36'5766 lcod 36'5768 mlcod 36'5768 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.103 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.101+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5586 (0'0,36'5586] local-lis/les=21/22 n=564 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5585 crt=36'5581 lcod 36'5583 mlcod 36'5583 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.104 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.102+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5683 (0'0,36'5683] local-lis/les=21/22 n=589 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5681 crt=36'5681 lcod 36'5680 mlcod 36'5680 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.107 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.101+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5874 (0'0,36'5874] local-lis/les=21/22 n=593 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5874 lcod 36'5872 mlcod 36'5872 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.109 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.106+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5620 (0'0,36'5620] local-lis/les=21/22 n=451 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5620 lcod 36'5618 mlcod 36'5618 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.109 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.105+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5588 (0'0,36'5588] local-lis/les=21/22 n=562 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5585 crt=36'5585 lcod 36'5583 mlcod 36'5583 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.110 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.107+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5724 (0'0,36'5724] local-lis/les=21/22 n=549 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5724 lcod 36'5722 mlcod 36'5722 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.110 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.107+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5773 (0'0,36'5773] local-lis/les=21/22 n=597 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5770 crt=36'5770 lcod 36'5768 mlcod 36'5768 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.112 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.105+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5602 (0'0,36'5602] local-lis/les=21/22 n=506 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5602 lcod 36'5600 mlcod 36'5600 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.113 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.110+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5604 (0'0,36'5604] local-lis/les=21/22 n=504 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5602 crt=36'5602 lcod 36'5600 mlcod 36'5600 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.114 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.111+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5726 (0'0,36'5726] local-lis/les=21/22 n=547 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5724 crt=36'5724 lcod 36'5722 mlcod 36'5722 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.115 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.113+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5622 (0'0,36'5622] local-lis/les=21/22 n=449 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5620 crt=36'5620 lcod 36'5618 mlcod 36'5618 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.117 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.115+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5923 (0'0,36'5923] local-lis/les=21/22 n=627 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5923 lcod 36'5921 mlcod 36'5921 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.120 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.118+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5876 (0'0,36'5876] local-lis/les=21/22 n=591 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5876 lcod 36'5874 mlcod 36'5874 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.120 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.118+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5925 (0'0,36'5925] local-lis/les=21/22 n=625 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5923 crt=36'5923 lcod 36'5921 mlcod 36'5921 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.124 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.122+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5878 (0'0,36'5878] local-lis/les=21/22 n=589 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5876 crt=36'5876 lcod 36'5874 mlcod 36'5874 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.126 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.122+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5685 (0'0,36'5685] local-lis/les=21/22 n=587 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5685 lcod 36'5683 mlcod 36'5683 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.126 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.124+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5775 (0'0,36'5775] local-lis/les=21/22 n=595 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5775 lcod 36'5773 mlcod 36'5773 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.130 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.127+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5777 (0'0,36'5777] local-lis/les=21/22 n=593 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5775 crt=36'5775 lcod 36'5773 mlcod 36'5773 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.130 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.128+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5687 (0'0,36'5687] local-lis/les=21/22 n=585 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5685 crt=36'5685 lcod 36'5683 mlcod 36'5683 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.137 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.127+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5590 (0'0,36'5590] local-lis/les=21/22 n=560 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5590 lcod 36'5588 mlcod 36'5588 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.137 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.131+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5592 (0'0,36'5592] local-lis/les=21/22 n=558 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5590 crt=36'5590 lcod 36'5588 mlcod 36'5588 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.138 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.136+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5625 (0'0,36'5625] local-lis/les=21/22 n=446 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5625 lcod 36'5624 mlcod 36'5624 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.142 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.139+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5627 (0'0,36'5627] local-lis/les=21/22 n=444 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5625 crt=36'5625 lcod 36'5624 mlcod 36'5624 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.146 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.143+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5927 (0'0,36'5927] local-lis/les=21/22 n=623 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5927 lcod 36'5925 mlcod 36'5925 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.146 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.138+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5606 (0'0,36'5606] local-lis/les=21/22 n=502 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5606 lcod 36'5604 mlcod 36'5604 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.147 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.145+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5880 (0'0,36'5880] local-lis/les=21/22 n=587 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5880 lcod 36'5878 mlcod 36'5878 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.148 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.146+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5689 (0'0,36'5689] local-lis/les=21/22 n=583 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5689 lcod 36'5687 mlcod 36'5687 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.148 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.146+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5729 (0'0,36'5729] local-lis/les=21/22 n=544 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5729 lcod 36'5728 mlcod 36'5728 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.149 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.146+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5929 (0'0,36'5929] local-lis/les=21/22 n=621 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5927 crt=36'5927 lcod 36'5925 mlcod 36'5925 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.150 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.148+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5882 (0'0,36'5882] local-lis/les=21/22 n=585 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5880 crt=36'5880 lcod 36'5878 mlcod 36'5878 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.153 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.151+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5608 (0'0,36'5608] local-lis/les=21/22 n=500 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5606 crt=36'5606 lcod 36'5604 mlcod 36'5604 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.157 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.154+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5629 (0'0,36'5629] local-lis/les=21/22 n=442 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5629 lcod 36'5627 mlcod 36'5627 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.163 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.148+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5595 (0'0,36'5595] local-lis/les=21/22 n=555 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5594 crt=36'5590 lcod 36'5592 mlcod 36'5592 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.163 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.150+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5731 (0'0,36'5731] local-lis/les=21/22 n=542 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5729 crt=36'5729 lcod 36'5728 mlcod 36'5728 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.163 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.152+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5597 (0'0,36'5597] local-lis/les=21/22 n=553 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5594 crt=36'5594 lcod 36'5592 mlcod 36'5592 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.164 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.158+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5779 (0'0,36'5779] local-lis/les=21/22 n=591 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5779 lcod 36'5777 mlcod 36'5777 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.164 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.158+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5631 (0'0,36'5631] local-lis/les=21/22 n=440 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5629 crt=36'5629 lcod 36'5627 mlcod 36'5627 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.164 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.156+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5691 (0'0,36'5691] local-lis/les=21/22 n=581 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5689 crt=36'5689 lcod 36'5687 mlcod 36'5687 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.165 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.161+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5781 (0'0,36'5781] local-lis/les=21/22 n=589 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5779 crt=36'5779 lcod 36'5777 mlcod 36'5777 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.170 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.168+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5610 (0'0,36'5610] local-lis/les=21/22 n=498 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5610 lcod 36'5608 mlcod 36'5608 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.171 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.169+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5884 (0'0,36'5884] local-lis/les=21/22 n=583 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5884 lcod 36'5882 mlcod 36'5882 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.176 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.172+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5783 (0'0,36'5783] local-lis/les=21/22 n=587 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5783 lcod 36'5781 mlcod 36'5781 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.177 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.172+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5612 (0'0,36'5612] local-lis/les=21/22 n=496 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5610 crt=36'5610 lcod 36'5608 mlcod 36'5608 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.177 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.174+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5886 (0'0,36'5886] local-lis/les=21/22 n=581 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5884 crt=36'5884 lcod 36'5882 mlcod 36'5882 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.178 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.176+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5599 (0'0,36'5599] local-lis/les=21/22 n=551 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5599 lcod 36'5597 mlcod 36'5597 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.178 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.176+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5785 (0'0,36'5785] local-lis/les=21/22 n=585 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5783 crt=36'5783 lcod 36'5781 mlcod 36'5781 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.180 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.179+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5693 (0'0,36'5693] local-lis/les=21/22 n=579 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5693 lcod 36'5691 mlcod 36'5691 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.184 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.179+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5601 (0'0,36'5601] local-lis/les=21/22 n=549 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5599 crt=36'5599 lcod 36'5597 mlcod 36'5597 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.186 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.183+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5695 (0'0,36'5695] local-lis/les=21/22 n=577 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5693 crt=36'5693 lcod 36'5691 mlcod 36'5691 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.186 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.182+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5633 (0'0,36'5633] local-lis/les=21/22 n=438 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5633 lcod 36'5631 mlcod 36'5631 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.186 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.180+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5733 (0'0,36'5733] local-lis/les=21/22 n=540 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5733 lcod 36'5731 mlcod 36'5731 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.191 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.186+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5635 (0'0,36'5635] local-lis/les=21/22 n=436 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5633 crt=36'5633 lcod 36'5631 mlcod 36'5631 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.191 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.183+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5735 (0'0,36'5735] local-lis/les=21/22 n=538 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5733 crt=36'5733 lcod 36'5731 mlcod 36'5731 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.193 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.189+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5888 (0'0,36'5888] local-lis/les=21/22 n=579 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5888 lcod 36'5886 mlcod 36'5886 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.197 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.194+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5933 (0'0,36'5933] local-lis/les=21/22 n=617 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5933 lcod 36'5932 mlcod 36'5932 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.197 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.195+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5890 (0'0,36'5890] local-lis/les=21/22 n=577 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5888 crt=36'5888 lcod 36'5886 mlcod 36'5886 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.199 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.197+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5614 (0'0,36'5614] local-lis/les=21/22 n=494 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5614 lcod 36'5612 mlcod 36'5612 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.202 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.201+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5616 (0'0,36'5616] local-lis/les=21/22 n=492 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5614 crt=36'5614 lcod 36'5612 mlcod 36'5612 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.204 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.200+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5637 (0'0,36'5637] local-lis/les=21/22 n=434 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5637 lcod 36'5635 mlcod 36'5635 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.206 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.204+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5788 (0'0,36'5788] local-lis/les=21/22 n=582 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5788 lcod 36'5787 mlcod 36'5787 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.210 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.207+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5790 (0'0,36'5790] local-lis/les=21/22 n=580 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5788 crt=36'5788 lcod 36'5787 mlcod 36'5787 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.210 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.204+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5639 (0'0,36'5639] local-lis/les=21/22 n=432 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5637 crt=36'5637 lcod 36'5635 mlcod 36'5635 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.210 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.205+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5935 (0'0,36'5935] local-lis/les=21/22 n=615 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5933 crt=36'5933 lcod 36'5932 mlcod 36'5932 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.212 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.211+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5697 (0'0,36'5697] local-lis/les=21/22 n=575 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5697 lcod 36'5695 mlcod 36'5695 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.214 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.204+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5738 (0'0,36'5738] local-lis/les=21/22 n=535 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5737 crt=36'5733 lcod 36'5735 mlcod 36'5735 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.215 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.208+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5740 (0'0,36'5740] local-lis/les=21/22 n=533 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5737 crt=36'5737 lcod 36'5735 mlcod 36'5735 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.217 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.215+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5699 (0'0,36'5699] local-lis/les=21/22 n=573 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5697 crt=36'5697 lcod 36'5695 mlcod 36'5695 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.217 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.213+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5618 (0'0,36'5618] local-lis/les=21/22 n=490 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5618 lcod 36'5616 mlcod 36'5616 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.219 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.217+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5893 (0'0,36'5893] local-lis/les=21/22 n=574 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5892 crt=36'5892 lcod 36'5890 mlcod 36'5890 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.222 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.218+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5641 (0'0,36'5641] local-lis/les=21/22 n=430 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5641 lcod 36'5639 mlcod 36'5639 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.223 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.220+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5895 (0'0,36'5895] local-lis/les=21/22 n=572 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5892 crt=36'5892 lcod 36'5890 mlcod 36'5890 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.228 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.221+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5620 (0'0,36'5620] local-lis/les=21/22 n=488 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5618 crt=36'5618 lcod 36'5616 mlcod 36'5616 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.229 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.224+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5643 (0'0,36'5643] local-lis/les=21/22 n=428 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5641 crt=36'5641 lcod 36'5639 mlcod 36'5639 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.230 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.228+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5937 (0'0,36'5937] local-lis/les=21/22 n=613 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5937 lcod 36'5935 mlcod 36'5935 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.231 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.229+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5792 (0'0,36'5792] local-lis/les=21/22 n=578 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5792 lcod 36'5790 mlcod 36'5790 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.232 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.231+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5701 (0'0,36'5701] local-lis/les=21/22 n=571 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5701 lcod 36'5699 mlcod 36'5699 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.237 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.235+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5703 (0'0,36'5703] local-lis/les=21/22 n=569 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5701 crt=36'5701 lcod 36'5699 mlcod 36'5699 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.238 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.232+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5939 (0'0,36'5939] local-lis/les=21/22 n=611 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5937 crt=36'5937 lcod 36'5935 mlcod 36'5935 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.238 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.233+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5794 (0'0,36'5794] local-lis/les=21/22 n=576 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5792 crt=36'5792 lcod 36'5790 mlcod 36'5790 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.239 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.230+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5742 (0'0,36'5742] local-lis/les=21/22 n=531 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5742 lcod 36'5740 mlcod 36'5740 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.239 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.231+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5604 (0'0,36'5604] local-lis/les=21/22 n=546 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5604 lcod 36'5603 mlcod 36'5603 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.239 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.234+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5744 (0'0,36'5744] local-lis/les=21/22 n=529 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5742 crt=36'5742 lcod 36'5740 mlcod 36'5740 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.239 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.234+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5606 (0'0,36'5606] local-lis/les=21/22 n=544 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5604 crt=36'5604 lcod 36'5603 mlcod 36'5603 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.248 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.245+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5897 (0'0,36'5897] local-lis/les=21/22 n=570 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5897 lcod 36'5895 mlcod 36'5895 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.248 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.246+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5796 (0'0,36'5796] local-lis/les=21/22 n=574 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5796 lcod 36'5794 mlcod 36'5794 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.252 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.247+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5646 (0'0,36'5646] local-lis/les=21/22 n=425 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5645 crt=36'5641 lcod 36'5643 mlcod 36'5643 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.252 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.249+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5899 (0'0,36'5899] local-lis/les=21/22 n=568 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5897 crt=36'5897 lcod 36'5895 mlcod 36'5895 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.252 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.249+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5798 (0'0,36'5798] local-lis/les=21/22 n=572 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5796 crt=36'5796 lcod 36'5794 mlcod 36'5794 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.253 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.251+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5622 (0'0,36'5622] local-lis/les=21/22 n=486 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5622 lcod 36'5620 mlcod 36'5620 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.255 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.251+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5648 (0'0,36'5648] local-lis/les=21/22 n=423 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5645 crt=36'5645 lcod 36'5643 mlcod 36'5643 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.255 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.253+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5609 (0'0,36'5609] local-lis/les=21/22 n=541 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5608 crt=36'5604 lcod 36'5606 mlcod 36'5606 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.258 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.256+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5611 (0'0,36'5611] local-lis/les=21/22 n=539 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5608 crt=36'5608 lcod 36'5606 mlcod 36'5606 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.263 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.259+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5705 (0'0,36'5705] local-lis/les=21/22 n=567 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5705 lcod 36'5703 mlcod 36'5703 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.266 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.261+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5624 (0'0,36'5624] local-lis/les=21/22 n=484 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5622 crt=36'5622 lcod 36'5620 mlcod 36'5620 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.268 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.264+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5707 (0'0,36'5707] local-lis/les=21/22 n=565 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5705 crt=36'5705 lcod 36'5703 mlcod 36'5703 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.269 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.267+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5943 (0'0,36'5943] local-lis/les=21/22 n=608 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5941 crt=36'5941 lcod 36'5939 mlcod 36'5939 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.271 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.269+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5650 (0'0,36'5650] local-lis/les=21/22 n=421 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5650 lcod 36'5648 mlcod 36'5648 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.273 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.271+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5746 (0'0,36'5746] local-lis/les=21/22 n=527 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5746 lcod 36'5744 mlcod 36'5744 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.277 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.274+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5801 (0'0,36'5801] local-lis/les=21/22 n=569 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5800 crt=36'5796 lcod 36'5798 mlcod 36'5798 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.277 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.273+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5652 (0'0,36'5652] local-lis/les=21/22 n=419 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5650 crt=36'5650 lcod 36'5648 mlcod 36'5648 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.277 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.275+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5748 (0'0,36'5748] local-lis/les=21/22 n=525 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5746 crt=36'5746 lcod 36'5744 mlcod 36'5744 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.279 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.277+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5901 (0'0,36'5901] local-lis/les=21/22 n=566 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5901 lcod 36'5899 mlcod 36'5899 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.283 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.281+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5709 (0'0,36'5709] local-lis/les=21/22 n=563 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5709 lcod 36'5707 mlcod 36'5707 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.286 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.278+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5803 (0'0,36'5803] local-lis/les=21/22 n=567 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5800 crt=36'5800 lcod 36'5798 mlcod 36'5798 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.286 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.280+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5903 (0'0,36'5903] local-lis/les=21/22 n=564 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5901 crt=36'5901 lcod 36'5899 mlcod 36'5899 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.287 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.285+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5711 (0'0,36'5711] local-lis/les=21/22 n=561 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5709 crt=36'5709 lcod 36'5707 mlcod 36'5707 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.288 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.286+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5613 (0'0,36'5613] local-lis/les=21/22 n=537 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5613 lcod 36'5611 mlcod 36'5611 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.291 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.289+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5626 (0'0,36'5626] local-lis/les=21/22 n=482 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5626 lcod 36'5624 mlcod 36'5624 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.292 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.289+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5615 (0'0,36'5615] local-lis/les=21/22 n=535 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5613 crt=36'5613 lcod 36'5611 mlcod 36'5611 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.294 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.293+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5628 (0'0,36'5628] local-lis/les=21/22 n=480 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5626 crt=36'5626 lcod 36'5624 mlcod 36'5624 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.299 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.295+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5946 (0'0,36'5946] local-lis/les=21/22 n=605 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5945 crt=36'5941 lcod 36'5943 mlcod 36'5943 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.299 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.296+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5654 (0'0,36'5654] local-lis/les=21/22 n=417 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5654 lcod 36'5652 mlcod 36'5652 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.299 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.297+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5750 (0'0,36'5750] local-lis/les=21/22 n=523 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5750 lcod 36'5748 mlcod 36'5748 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.301 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.299+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5948 (0'0,36'5948] local-lis/les=21/22 n=603 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5945 crt=36'5945 lcod 36'5943 mlcod 36'5943 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.302 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.299+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5656 (0'0,36'5656] local-lis/les=21/22 n=415 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5654 crt=36'5654 lcod 36'5652 mlcod 36'5652 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.305 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.300+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5752 (0'0,36'5752] local-lis/les=21/22 n=521 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5750 crt=36'5750 lcod 36'5748 mlcod 36'5748 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.307 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.305+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5806 (0'0,36'5806] local-lis/les=21/22 n=564 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5805 crt=36'5803 lcod 36'5803 mlcod 36'5803 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.309 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.306+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5617 (0'0,36'5617] local-lis/les=21/22 n=533 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5617 lcod 36'5615 mlcod 36'5615 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.309 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.305+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5713 (0'0,36'5713] local-lis/les=21/22 n=559 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5713 lcod 36'5711 mlcod 36'5711 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.312 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.309+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5619 (0'0,36'5619] local-lis/les=21/22 n=531 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5617 crt=36'5617 lcod 36'5615 mlcod 36'5615 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.312 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.310+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5905 (0'0,36'5905] local-lis/les=21/22 n=562 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5905 lcod 36'5903 mlcod 36'5903 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.317 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.313+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5630 (0'0,36'5630] local-lis/les=21/22 n=478 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5630 lcod 36'5628 mlcod 36'5628 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.318 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.314+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5715 (0'0,36'5715] local-lis/les=21/22 n=557 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5713 crt=36'5713 lcod 36'5711 mlcod 36'5711 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.318 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.316+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5632 (0'0,36'5632] local-lis/les=21/22 n=476 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5630 crt=36'5630 lcod 36'5628 mlcod 36'5628 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.319 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.313+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5808 (0'0,36'5808] local-lis/les=21/22 n=562 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5805 crt=36'5805 lcod 36'5803 mlcod 36'5803 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.319 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.313+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5907 (0'0,36'5907] local-lis/les=21/22 n=560 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5905 crt=36'5905 lcod 36'5903 mlcod 36'5903 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.323 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.321+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5950 (0'0,36'5950] local-lis/les=21/22 n=601 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5950 lcod 36'5948 mlcod 36'5948 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.326 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.324+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5658 (0'0,36'5658] local-lis/les=21/22 n=413 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5658 lcod 36'5656 mlcod 36'5656 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.326 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.324+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5754 (0'0,36'5754] local-lis/les=21/22 n=519 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5754 lcod 36'5752 mlcod 36'5752 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.329 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.326+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5952 (0'0,36'5952] local-lis/les=21/22 n=599 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5950 crt=36'5950 lcod 36'5948 mlcod 36'5948 active+clean+snaptrim trimq=[204~24] ps=[1fe~6]] removing snap head 2020-02-11T16:31:31.329 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.326+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5660 (0'0,36'5660] local-lis/les=21/22 n=411 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5658 crt=36'5658 lcod 36'5656 mlcod 36'5656 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.329 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.326+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5756 (0'0,36'5756] local-lis/les=21/22 n=517 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5754 crt=36'5754 lcod 36'5752 mlcod 36'5752 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.333 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.331+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5718 (0'0,36'5718] local-lis/les=21/22 n=554 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5717 crt=36'5713 lcod 36'5715 mlcod 36'5715 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.335 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.331+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5909 (0'0,36'5909] local-lis/les=21/22 n=558 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5909 lcod 36'5907 mlcod 36'5907 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.340 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.333+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5621 (0'0,36'5621] local-lis/les=21/22 n=529 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5621 lcod 36'5619 mlcod 36'5619 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.340 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.338+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5720 (0'0,36'5720] local-lis/les=21/22 n=552 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5717 crt=36'5717 lcod 36'5715 mlcod 36'5715 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.341 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.337+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5623 (0'0,36'5623] local-lis/les=21/22 n=527 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5621 crt=36'5621 lcod 36'5619 mlcod 36'5619 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.344 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.337+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5635 (0'0,36'5635] local-lis/les=21/22 n=473 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5634 crt=36'5630 lcod 36'5632 mlcod 36'5632 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.346 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.344+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5758 (0'0,36'5758] local-lis/les=21/22 n=515 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5758 lcod 36'5756 mlcod 36'5756 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.346 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.341+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5911 (0'0,36'5911] local-lis/les=21/22 n=556 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5909 crt=36'5909 lcod 36'5907 mlcod 36'5907 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.347 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.345+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5812 (0'0,36'5812] local-lis/les=21/22 n=559 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5810 crt=36'5810 lcod 36'5808 mlcod 36'5808 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.348 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.345+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5954 (0'0,36'5954] local-lis/les=21/22 n=597 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5954 lcod 36'5952 mlcod 36'5952 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.349 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.347+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5760 (0'0,36'5760] local-lis/les=21/22 n=513 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5758 crt=36'5758 lcod 36'5756 mlcod 36'5756 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.352 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.349+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5637 (0'0,36'5637] local-lis/les=21/22 n=471 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5634 crt=36'5634 lcod 36'5632 mlcod 36'5632 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.353 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.349+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5956 (0'0,36'5956] local-lis/les=21/22 n=595 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5954 crt=36'5954 lcod 36'5952 mlcod 36'5952 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.367 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.361+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5640 (0'0,36'5640] local-lis/les=21/22 n=468 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5639 crt=36'5635 lcod 36'5637 mlcod 36'5637 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.367 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.356+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5913 (0'0,36'5913] local-lis/les=21/22 n=554 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5913 lcod 36'5911 mlcod 36'5911 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.367 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.360+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5915 (0'0,36'5915] local-lis/les=21/22 n=552 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5913 crt=36'5913 lcod 36'5911 mlcod 36'5911 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.367 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.361+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5814 (0'0,36'5814] local-lis/les=21/22 n=557 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5814 lcod 36'5812 mlcod 36'5812 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.368 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.356+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5662 (0'0,36'5662] local-lis/les=21/22 n=409 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5662 lcod 36'5660 mlcod 36'5660 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.368 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.365+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5625 (0'0,36'5625] local-lis/les=21/22 n=525 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5625 lcod 36'5623 mlcod 36'5623 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.369 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.366+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5664 (0'0,36'5664] local-lis/les=21/22 n=407 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5662 crt=36'5662 lcod 36'5660 mlcod 36'5660 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.369 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.365+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5642 (0'0,36'5642] local-lis/les=21/22 n=466 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5639 crt=36'5639 lcod 36'5637 mlcod 36'5637 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.373 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.371+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5958 (0'0,36'5958] local-lis/les=21/22 n=593 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5958 lcod 36'5956 mlcod 36'5956 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.375 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.368+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5627 (0'0,36'5627] local-lis/les=21/22 n=523 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5625 crt=36'5625 lcod 36'5623 mlcod 36'5623 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.377 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.375+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5960 (0'0,36'5960] local-lis/les=21/22 n=591 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5958 crt=36'5958 lcod 36'5956 mlcod 36'5956 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.379 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.377+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5723 (0'0,36'5723] local-lis/les=21/22 n=549 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5722 crt=36'5722 lcod 36'5720 mlcod 36'5720 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.380 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.377+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5762 (0'0,36'5762] local-lis/les=21/22 n=511 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5762 lcod 36'5760 mlcod 36'5760 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.383 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.379+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5917 (0'0,36'5917] local-lis/les=21/22 n=550 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5917 lcod 36'5915 mlcod 36'5915 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.386 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.382+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5817 (0'0,36'5817] local-lis/les=21/22 n=554 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5816 crt=36'5816 lcod 36'5814 mlcod 36'5814 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.386 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.382+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5919 (0'0,36'5919] local-lis/les=21/22 n=548 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5917 crt=36'5917 lcod 36'5915 mlcod 36'5915 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.387 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.385+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5644 (0'0,36'5644] local-lis/les=21/22 n=464 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5644 lcod 36'5642 mlcod 36'5642 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.388 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.385+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5666 (0'0,36'5666] local-lis/les=21/22 n=405 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5666 lcod 36'5664 mlcod 36'5664 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.390 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.387+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5764 (0'0,36'5764] local-lis/les=21/22 n=509 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5762 crt=36'5762 lcod 36'5760 mlcod 36'5760 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.391 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.389+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5646 (0'0,36'5646] local-lis/les=21/22 n=462 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5644 crt=36'5644 lcod 36'5642 mlcod 36'5642 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.392 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.389+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5725 (0'0,36'5725] local-lis/les=21/22 n=547 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5722 crt=36'5722 lcod 36'5720 mlcod 36'5720 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.394 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.386+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5819 (0'0,36'5819] local-lis/les=21/22 n=552 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5816 crt=36'5816 lcod 36'5814 mlcod 36'5814 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.395 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.392+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5629 (0'0,36'5629] local-lis/les=21/22 n=521 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5629 lcod 36'5627 mlcod 36'5627 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.395 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.393+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5962 (0'0,36'5962] local-lis/les=21/22 n=589 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5962 lcod 36'5960 mlcod 36'5960 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.398 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.396+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5631 (0'0,36'5631] local-lis/les=21/22 n=519 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5629 crt=36'5629 lcod 36'5627 mlcod 36'5627 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.402 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.400+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5668 (0'0,36'5668] local-lis/les=21/22 n=403 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5668 lcod 36'5666 mlcod 36'5666 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.403 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.401+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5766 (0'0,36'5766] local-lis/les=21/22 n=507 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5766 lcod 36'5764 mlcod 36'5764 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.405 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.403+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5670 (0'0,36'5670] local-lis/les=21/22 n=401 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5668 crt=36'5668 lcod 36'5666 mlcod 36'5666 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.405 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.403+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5964 (0'0,36'5964] local-lis/les=21/22 n=587 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5962 crt=36'5962 lcod 36'5960 mlcod 36'5960 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.406 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.403+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5727 (0'0,36'5727] local-lis/les=21/22 n=545 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5727 lcod 36'5725 mlcod 36'5725 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.407 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.405+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5768 (0'0,36'5768] local-lis/les=21/22 n=505 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5766 crt=36'5766 lcod 36'5764 mlcod 36'5764 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.409 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.407+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5729 (0'0,36'5729] local-lis/les=21/22 n=543 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5727 crt=36'5727 lcod 36'5725 mlcod 36'5725 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.416 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.413+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5922 (0'0,36'5922] local-lis/les=21/22 n=545 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5921 crt=36'5917 lcod 36'5919 mlcod 36'5919 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.416 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.414+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5821 (0'0,36'5821] local-lis/les=21/22 n=550 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5821 lcod 36'5819 mlcod 36'5819 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.421 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.417+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5924 (0'0,36'5924] local-lis/les=21/22 n=543 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5921 crt=36'5921 lcod 36'5919 mlcod 36'5919 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.421 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.418+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5823 (0'0,36'5823] local-lis/les=21/22 n=548 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5821 crt=36'5821 lcod 36'5819 mlcod 36'5819 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.421 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.417+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5672 (0'0,36'5672] local-lis/les=21/22 n=399 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5672 lcod 36'5670 mlcod 36'5670 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.423 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.420+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5674 (0'0,36'5674] local-lis/les=21/22 n=397 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5672 crt=36'5672 lcod 36'5670 mlcod 36'5670 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.425 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.421+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5648 (0'0,36'5648] local-lis/les=21/22 n=460 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5648 lcod 36'5646 mlcod 36'5646 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.427 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.425+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5633 (0'0,36'5633] local-lis/les=21/22 n=517 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5633 lcod 36'5631 mlcod 36'5631 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.429 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.427+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5770 (0'0,36'5770] local-lis/les=21/22 n=503 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5770 lcod 36'5768 mlcod 36'5768 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.430 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.428+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5635 (0'0,36'5635] local-lis/les=21/22 n=515 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5633 crt=36'5633 lcod 36'5631 mlcod 36'5631 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.430 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.429+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5650 (0'0,36'5650] local-lis/les=21/22 n=458 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5648 crt=36'5648 lcod 36'5646 mlcod 36'5646 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.434 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.432+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5825 (0'0,36'5825] local-lis/les=21/22 n=546 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5825 lcod 36'5823 mlcod 36'5823 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.438 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.435+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5966 (0'0,36'5966] local-lis/les=21/22 n=585 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5966 lcod 36'5964 mlcod 36'5964 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.439 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.436+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5732 (0'0,36'5732] local-lis/les=21/22 n=540 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5732 lcod 36'5731 mlcod 36'5731 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.442 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.439+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5968 (0'0,36'5968] local-lis/les=21/22 n=583 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5966 crt=36'5966 lcod 36'5964 mlcod 36'5964 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.444 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.440+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5926 (0'0,36'5926] local-lis/les=21/22 n=541 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5926 lcod 36'5924 mlcod 36'5924 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.445 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.441+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5652 (0'0,36'5652] local-lis/les=21/22 n=456 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5652 lcod 36'5650 mlcod 36'5650 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.446 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.443+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5827 (0'0,36'5827] local-lis/les=21/22 n=544 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5825 crt=36'5825 lcod 36'5823 mlcod 36'5823 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.448 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.445+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5654 (0'0,36'5654] local-lis/les=21/22 n=454 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5652 crt=36'5652 lcod 36'5650 mlcod 36'5650 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.449 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.443+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5677 (0'0,36'5677] local-lis/les=21/22 n=394 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5676 crt=36'5672 lcod 36'5674 mlcod 36'5674 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.449 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.443+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5772 (0'0,36'5772] local-lis/les=21/22 n=501 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5772 lcod 36'5770 mlcod 36'5770 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.450 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.448+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5734 (0'0,36'5734] local-lis/les=21/22 n=538 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5732 crt=36'5732 lcod 36'5731 mlcod 36'5731 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.450 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.447+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5774 (0'0,36'5774] local-lis/les=21/22 n=499 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5772 crt=36'5772 lcod 36'5770 mlcod 36'5770 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.451 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.448+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5928 (0'0,36'5928] local-lis/les=21/22 n=539 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5926 crt=36'5926 lcod 36'5924 mlcod 36'5924 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.451 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.449+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5637 (0'0,36'5637] local-lis/les=21/22 n=513 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5637 lcod 36'5635 mlcod 36'5635 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.454 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.450+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5679 (0'0,36'5679] local-lis/les=21/22 n=392 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5676 crt=36'5676 lcod 36'5674 mlcod 36'5674 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.461 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.459+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5970 (0'0,36'5970] local-lis/les=21/22 n=581 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5970 lcod 36'5968 mlcod 36'5968 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.462 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.459+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5830 (0'0,36'5830] local-lis/les=21/22 n=541 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5829 crt=36'5825 lcod 36'5827 mlcod 36'5827 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.462 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.460+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5736 (0'0,36'5736] local-lis/les=21/22 n=536 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5736 lcod 36'5734 mlcod 36'5734 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.464 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.462+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5656 (0'0,36'5656] local-lis/les=21/22 n=452 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5656 lcod 36'5654 mlcod 36'5654 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.465 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.462+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5972 (0'0,36'5972] local-lis/les=21/22 n=579 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5970 crt=36'5970 lcod 36'5968 mlcod 36'5968 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.467 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.466+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5658 (0'0,36'5658] local-lis/les=21/22 n=450 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5656 crt=36'5656 lcod 36'5654 mlcod 36'5654 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.468 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.466+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5832 (0'0,36'5832] local-lis/les=21/22 n=539 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5829 crt=36'5829 lcod 36'5827 mlcod 36'5827 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.471 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.464+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5738 (0'0,36'5738] local-lis/les=21/22 n=534 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5736 crt=36'5736 lcod 36'5734 mlcod 36'5734 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.478 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.471+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5776 (0'0,36'5776] local-lis/les=21/22 n=497 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5776 lcod 36'5774 mlcod 36'5774 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.478 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.472+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5639 (0'0,36'5639] local-lis/les=21/22 n=511 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5639 lcod 36'5637 mlcod 36'5637 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.479 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.473+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5681 (0'0,36'5681] local-lis/les=21/22 n=390 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5681 lcod 36'5679 mlcod 36'5679 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.479 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.475+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5778 (0'0,36'5778] local-lis/les=21/22 n=495 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5776 crt=36'5776 lcod 36'5774 mlcod 36'5774 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.480 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.478+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5683 (0'0,36'5683] local-lis/les=21/22 n=388 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5681 crt=36'5681 lcod 36'5679 mlcod 36'5679 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.483 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.480+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5974 (0'0,36'5974] local-lis/les=21/22 n=577 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5974 lcod 36'5972 mlcod 36'5972 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.484 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.479+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5930 (0'0,36'5930] local-lis/les=21/22 n=537 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5930 lcod 36'5928 mlcod 36'5928 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.485 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.483+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5976 (0'0,36'5976] local-lis/les=21/22 n=575 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5974 crt=36'5974 lcod 36'5972 mlcod 36'5972 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.488 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.482+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5834 (0'0,36'5834] local-lis/les=21/22 n=537 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5834 lcod 36'5832 mlcod 36'5832 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.488 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.483+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5932 (0'0,36'5932] local-lis/les=21/22 n=535 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5930 crt=36'5930 lcod 36'5928 mlcod 36'5928 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.489 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.483+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5641 (0'0,36'5641] local-lis/les=21/22 n=509 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5639 crt=36'5639 lcod 36'5637 mlcod 36'5637 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.492 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.490+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5662 (0'0,36'5662] local-lis/les=21/22 n=446 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5661 crt=36'5656 lcod 36'5660 mlcod 36'5660 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.493 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.491+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5836 (0'0,36'5836] local-lis/les=21/22 n=535 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5834 crt=36'5834 lcod 36'5832 mlcod 36'5832 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.494 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.492+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5740 (0'0,36'5740] local-lis/les=21/22 n=532 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5740 lcod 36'5738 mlcod 36'5738 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.496 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.494+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5643 (0'0,36'5643] local-lis/les=21/22 n=507 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5643 lcod 36'5641 mlcod 36'5641 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.500 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.496+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5742 (0'0,36'5742] local-lis/les=21/22 n=530 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5740 crt=36'5740 lcod 36'5738 mlcod 36'5738 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.503 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.498+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5645 (0'0,36'5645] local-lis/les=21/22 n=505 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5643 crt=36'5643 lcod 36'5641 mlcod 36'5641 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.503 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.500+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5685 (0'0,36'5685] local-lis/les=21/22 n=386 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5685 lcod 36'5683 mlcod 36'5683 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.508 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.500+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5934 (0'0,36'5934] local-lis/les=21/22 n=533 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5934 lcod 36'5932 mlcod 36'5932 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.509 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.503+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5936 (0'0,36'5936] local-lis/les=21/22 n=531 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5934 crt=36'5934 lcod 36'5932 mlcod 36'5932 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.510 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.505+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5978 (0'0,36'5978] local-lis/les=21/22 n=573 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5978 lcod 36'5976 mlcod 36'5976 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.510 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.507+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5687 (0'0,36'5687] local-lis/les=21/22 n=384 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5685 crt=36'5685 lcod 36'5683 mlcod 36'5683 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.510 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.507+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5781 (0'0,36'5781] local-lis/les=21/22 n=492 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5780 crt=36'5776 lcod 36'5778 mlcod 36'5778 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.511 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.509+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5980 (0'0,36'5980] local-lis/les=21/22 n=571 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5978 crt=36'5978 lcod 36'5976 mlcod 36'5976 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.512 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.511+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5744 (0'0,36'5744] local-lis/les=21/22 n=528 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5744 lcod 36'5742 mlcod 36'5742 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.514 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.510+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5783 (0'0,36'5783] local-lis/les=21/22 n=490 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5780 crt=36'5780 lcod 36'5778 mlcod 36'5778 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.516 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.513+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5838 (0'0,36'5838] local-lis/les=21/22 n=533 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5838 lcod 36'5836 mlcod 36'5836 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.518 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.516+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5664 (0'0,36'5664] local-lis/les=21/22 n=444 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5661 crt=36'5661 lcod 36'5660 mlcod 36'5660 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.519 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.518+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5840 (0'0,36'5840] local-lis/les=21/22 n=531 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5838 crt=36'5838 lcod 36'5836 mlcod 36'5836 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.523 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.521+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5746 (0'0,36'5746] local-lis/les=21/22 n=526 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5744 crt=36'5744 lcod 36'5742 mlcod 36'5742 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.528 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.527+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5647 (0'0,36'5647] local-lis/les=21/22 n=503 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5647 lcod 36'5645 mlcod 36'5645 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.529 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.527+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5938 (0'0,36'5938] local-lis/les=21/22 n=529 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5938 lcod 36'5936 mlcod 36'5936 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.531 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.527+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5666 (0'0,36'5666] local-lis/les=21/22 n=442 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5666 lcod 36'5664 mlcod 36'5664 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.531 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.530+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5984 (0'0,36'5984] local-lis/les=21/22 n=567 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5982 crt=36'5982 lcod 36'5980 mlcod 36'5980 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.532 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.531+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5940 (0'0,36'5940] local-lis/les=21/22 n=527 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5938 crt=36'5938 lcod 36'5936 mlcod 36'5936 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.533 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.531+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5668 (0'0,36'5668] local-lis/les=21/22 n=440 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5666 crt=36'5666 lcod 36'5664 mlcod 36'5664 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.535 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.534+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5649 (0'0,36'5649] local-lis/les=21/22 n=501 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5647 crt=36'5647 lcod 36'5645 mlcod 36'5645 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.536 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.535+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5785 (0'0,36'5785] local-lis/les=21/22 n=488 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5785 lcod 36'5783 mlcod 36'5783 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.539 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.536+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5986 (0'0,36'5986] local-lis/les=21/22 n=565 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5982 crt=36'5982 lcod 36'5980 mlcod 36'5980 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.540 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.538+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5689 (0'0,36'5689] local-lis/les=21/22 n=382 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5689 lcod 36'5687 mlcod 36'5687 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.541 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.539+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5787 (0'0,36'5787] local-lis/les=21/22 n=486 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5785 crt=36'5785 lcod 36'5783 mlcod 36'5783 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.546 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.544+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5691 (0'0,36'5691] local-lis/les=21/22 n=380 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5689 crt=36'5689 lcod 36'5687 mlcod 36'5687 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.546 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.544+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5842 (0'0,36'5842] local-lis/les=21/22 n=529 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5842 lcod 36'5840 mlcod 36'5840 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.551 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.549+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5748 (0'0,36'5748] local-lis/les=21/22 n=524 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5748 lcod 36'5746 mlcod 36'5746 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.551 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.549+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5844 (0'0,36'5844] local-lis/les=21/22 n=527 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5842 crt=36'5842 lcod 36'5840 mlcod 36'5840 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.555 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.553+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5750 (0'0,36'5750] local-lis/les=21/22 n=522 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5748 crt=36'5748 lcod 36'5746 mlcod 36'5746 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.555 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.554+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5651 (0'0,36'5651] local-lis/les=21/22 n=499 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5651 lcod 36'5649 mlcod 36'5649 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.558 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.554+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5943 (0'0,36'5943] local-lis/les=21/22 n=524 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5943 lcod 36'5942 mlcod 36'5942 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.560 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.559+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5945 (0'0,36'5945] local-lis/les=21/22 n=522 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5943 crt=36'5943 lcod 36'5942 mlcod 36'5942 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.563 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.561+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5988 (0'0,36'5988] local-lis/les=21/22 n=563 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5988 lcod 36'5986 mlcod 36'5986 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.563 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.562+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5693 (0'0,36'5693] local-lis/les=21/22 n=378 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5693 lcod 36'5691 mlcod 36'5691 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.569 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.565+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5695 (0'0,36'5695] local-lis/les=21/22 n=376 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5693 crt=36'5693 lcod 36'5691 mlcod 36'5691 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.569 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.561+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5653 (0'0,36'5653] local-lis/les=21/22 n=497 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5651 crt=36'5651 lcod 36'5649 mlcod 36'5649 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.571 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.566+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5752 (0'0,36'5752] local-lis/les=21/22 n=520 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5752 lcod 36'5750 mlcod 36'5750 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.571 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.569+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5990 (0'0,36'5990] local-lis/les=21/22 n=561 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5988 crt=36'5988 lcod 36'5986 mlcod 36'5986 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.573 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.571+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5670 (0'0,36'5670] local-lis/les=21/22 n=438 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5670 lcod 36'5668 mlcod 36'5668 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.574 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.573+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5790 (0'0,36'5790] local-lis/les=21/22 n=483 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5790 lcod 36'5789 mlcod 36'5789 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.579 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.577+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5754 (0'0,36'5754] local-lis/les=21/22 n=518 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5752 crt=36'5752 lcod 36'5750 mlcod 36'5750 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.580 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.575+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5672 (0'0,36'5672] local-lis/les=21/22 n=436 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5670 crt=36'5670 lcod 36'5668 mlcod 36'5668 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.582 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.574+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5847 (0'0,36'5847] local-lis/les=21/22 n=524 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5847 lcod 36'5846 mlcod 36'5846 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.582 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.576+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5947 (0'0,36'5947] local-lis/les=21/22 n=520 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5947 lcod 36'5945 mlcod 36'5945 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.583 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.579+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5849 (0'0,36'5849] local-lis/les=21/22 n=522 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5847 crt=36'5847 lcod 36'5846 mlcod 36'5846 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.584 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.581+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5792 (0'0,36'5792] local-lis/les=21/22 n=481 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5790 crt=36'5790 lcod 36'5789 mlcod 36'5789 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.584 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.583+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5949 (0'0,36'5949] local-lis/les=21/22 n=518 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5947 crt=36'5947 lcod 36'5945 mlcod 36'5945 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.592 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.590+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5655 (0'0,36'5655] local-lis/les=21/22 n=495 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5655 lcod 36'5653 mlcod 36'5653 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.594 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.593+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5657 (0'0,36'5657] local-lis/les=21/22 n=493 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5655 crt=36'5655 lcod 36'5653 mlcod 36'5653 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.595 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.590+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5756 (0'0,36'5756] local-lis/les=21/22 n=516 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5756 lcod 36'5754 mlcod 36'5754 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.595 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.593+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5794 (0'0,36'5794] local-lis/les=21/22 n=479 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5794 lcod 36'5792 mlcod 36'5792 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.597 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.595+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5697 (0'0,36'5697] local-lis/les=21/22 n=374 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5697 lcod 36'5695 mlcod 36'5695 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.598 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.596+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5758 (0'0,36'5758] local-lis/les=21/22 n=514 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5756 crt=36'5756 lcod 36'5754 mlcod 36'5754 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.598 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.597+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5796 (0'0,36'5796] local-lis/les=21/22 n=477 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5794 crt=36'5794 lcod 36'5792 mlcod 36'5792 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.599 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.590+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5674 (0'0,36'5674] local-lis/les=21/22 n=434 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5674 lcod 36'5672 mlcod 36'5672 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.603 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.599+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5994 (0'0,36'5994] local-lis/les=21/22 n=557 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5993 crt=36'5988 lcod 36'5992 mlcod 36'5992 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.603 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.599+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5699 (0'0,36'5699] local-lis/les=21/22 n=372 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5697 crt=36'5697 lcod 36'5695 mlcod 36'5695 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.603 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.601+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5851 (0'0,36'5851] local-lis/les=21/22 n=520 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5851 lcod 36'5849 mlcod 36'5849 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.604 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.603+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5951 (0'0,36'5951] local-lis/les=21/22 n=516 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5951 lcod 36'5949 mlcod 36'5949 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.607 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.605+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5853 (0'0,36'5853] local-lis/les=21/22 n=518 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5851 crt=36'5851 lcod 36'5849 mlcod 36'5849 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.607 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.605+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5996 (0'0,36'5996] local-lis/les=21/22 n=555 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5993 crt=36'5993 lcod 36'5992 mlcod 36'5992 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.607 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.606+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5676 (0'0,36'5676] local-lis/les=21/22 n=432 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5674 crt=36'5674 lcod 36'5672 mlcod 36'5672 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.616 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.615+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5659 (0'0,36'5659] local-lis/les=21/22 n=491 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5659 lcod 36'5657 mlcod 36'5657 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.620 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.619+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5661 (0'0,36'5661] local-lis/les=21/22 n=489 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5659 crt=36'5659 lcod 36'5657 mlcod 36'5657 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.622 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.621+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5798 (0'0,36'5798] local-lis/les=21/22 n=475 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5798 lcod 36'5796 mlcod 36'5796 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.630 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.622+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'5998 (0'0,36'5998] local-lis/les=21/22 n=553 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'5998 lcod 36'5996 mlcod 36'5996 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.630 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.623+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5855 (0'0,36'5855] local-lis/les=21/22 n=516 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5855 lcod 36'5853 mlcod 36'5853 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.631 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.627+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5857 (0'0,36'5857] local-lis/les=21/22 n=514 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5855 crt=36'5855 lcod 36'5853 mlcod 36'5853 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.631 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.625+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5800 (0'0,36'5800] local-lis/les=21/22 n=473 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5798 crt=36'5798 lcod 36'5796 mlcod 36'5796 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.632 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.630+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5953 (0'0,36'5953] local-lis/les=21/22 n=514 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5953 lcod 36'5951 mlcod 36'5951 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.633 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.625+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5760 (0'0,36'5760] local-lis/les=21/22 n=512 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5760 lcod 36'5758 mlcod 36'5758 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.635 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.629+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5762 (0'0,36'5762] local-lis/les=21/22 n=510 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5760 crt=36'5760 lcod 36'5758 mlcod 36'5758 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.635 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.625+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6000 (0'0,36'6000] local-lis/les=21/22 n=551 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'5998 crt=36'5998 lcod 36'5996 mlcod 36'5996 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.636 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.626+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5701 (0'0,36'5701] local-lis/les=21/22 n=370 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5701 lcod 36'5699 mlcod 36'5699 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.636 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.630+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5703 (0'0,36'5703] local-lis/les=21/22 n=368 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5701 crt=36'5701 lcod 36'5699 mlcod 36'5699 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.637 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.634+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5679 (0'0,36'5679] local-lis/les=21/22 n=429 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5679 lcod 36'5678 mlcod 36'5678 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.639 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.635+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5955 (0'0,36'5955] local-lis/les=21/22 n=512 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5953 crt=36'5953 lcod 36'5951 mlcod 36'5951 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.642 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.640+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5681 (0'0,36'5681] local-lis/les=21/22 n=427 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5679 crt=36'5679 lcod 36'5678 mlcod 36'5678 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.646 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.645+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5802 (0'0,36'5802] local-lis/les=21/22 n=471 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5802 lcod 36'5800 mlcod 36'5800 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.646 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.645+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5665 (0'0,36'5665] local-lis/les=21/22 n=485 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5664 crt=36'5659 lcod 36'5663 mlcod 36'5663 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.649 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.647+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5804 (0'0,36'5804] local-lis/les=21/22 n=469 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5802 crt=36'5802 lcod 36'5800 mlcod 36'5800 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.649 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.648+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5667 (0'0,36'5667] local-lis/les=21/22 n=483 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5664 crt=36'5664 lcod 36'5663 mlcod 36'5663 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.654 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.652+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6004 (0'0,36'6004] local-lis/les=21/22 n=548 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6002 crt=36'6002 lcod 36'6000 mlcod 36'6000 active+clean+snaptrim trimq=[205~23] ps=[1fe~7]] removing snap head 2020-02-11T16:31:31.661 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.658+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5957 (0'0,36'5957] local-lis/les=21/22 n=510 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5957 lcod 36'5955 mlcod 36'5955 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.663 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.661+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5765 (0'0,36'5765] local-lis/les=21/22 n=507 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5764 crt=36'5764 lcod 36'5762 mlcod 36'5762 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.664 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.660+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5705 (0'0,36'5705] local-lis/les=21/22 n=366 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5705 lcod 36'5703 mlcod 36'5703 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.665 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.663+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5707 (0'0,36'5707] local-lis/les=21/22 n=364 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5705 crt=36'5705 lcod 36'5703 mlcod 36'5703 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.665 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.663+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5669 (0'0,36'5669] local-lis/les=21/22 n=481 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5669 lcod 36'5667 mlcod 36'5667 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.669 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.668+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5671 (0'0,36'5671] local-lis/les=21/22 n=479 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5669 crt=36'5669 lcod 36'5667 mlcod 36'5667 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.670 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.668+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5767 (0'0,36'5767] local-lis/les=21/22 n=505 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5764 crt=36'5764 lcod 36'5762 mlcod 36'5762 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.672 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.665+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5959 (0'0,36'5959] local-lis/les=21/22 n=508 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5957 crt=36'5957 lcod 36'5955 mlcod 36'5955 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.676 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.675+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5709 (0'0,36'5709] local-lis/les=21/22 n=362 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5709 lcod 36'5707 mlcod 36'5707 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.678 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.677+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5806 (0'0,36'5806] local-lis/les=21/22 n=467 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5806 lcod 36'5804 mlcod 36'5804 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.679 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.678+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5711 (0'0,36'5711] local-lis/les=21/22 n=360 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5709 crt=36'5709 lcod 36'5707 mlcod 36'5707 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.681 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.678+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5683 (0'0,36'5683] local-lis/les=21/22 n=425 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5683 lcod 36'5681 mlcod 36'5681 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.686 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.679+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6006 (0'0,36'6006] local-lis/les=21/22 n=546 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6006 lcod 36'6004 mlcod 36'6004 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.686 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.683+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6008 (0'0,36'6008] local-lis/les=21/22 n=544 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6006 crt=36'6006 lcod 36'6004 mlcod 36'6004 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.687 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.681+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5673 (0'0,36'5673] local-lis/les=21/22 n=477 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5673 lcod 36'5671 mlcod 36'5671 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.688 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.685+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5675 (0'0,36'5675] local-lis/les=21/22 n=475 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5673 crt=36'5673 lcod 36'5671 mlcod 36'5671 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.688 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.685+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5961 (0'0,36'5961] local-lis/les=21/22 n=506 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5961 lcod 36'5959 mlcod 36'5959 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.689 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.685+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5685 (0'0,36'5685] local-lis/les=21/22 n=423 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5683 crt=36'5683 lcod 36'5681 mlcod 36'5681 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.691 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.690+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5963 (0'0,36'5963] local-lis/les=21/22 n=504 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5961 crt=36'5961 lcod 36'5959 mlcod 36'5959 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.692 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.691+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5808 (0'0,36'5808] local-lis/les=21/22 n=465 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5806 crt=36'5806 lcod 36'5804 mlcod 36'5804 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.693 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.691+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5769 (0'0,36'5769] local-lis/les=21/22 n=503 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5769 lcod 36'5767 mlcod 36'5767 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.694 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.693+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5862 (0'0,36'5862] local-lis/les=21/22 n=510 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5862 lcod 36'5860 mlcod 36'5860 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.699 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.697+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5864 (0'0,36'5864] local-lis/les=21/22 n=508 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5862 crt=36'5862 lcod 36'5860 mlcod 36'5860 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.700 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.695+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5771 (0'0,36'5771] local-lis/les=21/22 n=501 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5769 crt=36'5769 lcod 36'5767 mlcod 36'5767 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.706 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.705+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5713 (0'0,36'5713] local-lis/les=21/22 n=358 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5713 lcod 36'5711 mlcod 36'5711 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.710 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.706+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5677 (0'0,36'5677] local-lis/les=21/22 n=473 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5677 lcod 36'5675 mlcod 36'5675 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.710 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.706+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5810 (0'0,36'5810] local-lis/les=21/22 n=463 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5810 lcod 36'5808 mlcod 36'5808 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.711 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.709+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5687 (0'0,36'5687] local-lis/les=21/22 n=421 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5687 lcod 36'5685 mlcod 36'5685 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.711 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.710+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5679 (0'0,36'5679] local-lis/les=21/22 n=471 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5677 crt=36'5677 lcod 36'5675 mlcod 36'5675 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.712 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.709+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5866 (0'0,36'5866] local-lis/les=21/22 n=506 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5866 lcod 36'5864 mlcod 36'5864 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.713 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.712+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5715 (0'0,36'5715] local-lis/les=21/22 n=356 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5713 crt=36'5713 lcod 36'5711 mlcod 36'5711 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.714 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.713+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5689 (0'0,36'5689] local-lis/les=21/22 n=419 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5687 crt=36'5687 lcod 36'5685 mlcod 36'5685 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.717 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.710+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5812 (0'0,36'5812] local-lis/les=21/22 n=461 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5810 crt=36'5810 lcod 36'5808 mlcod 36'5808 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.718 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.713+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6010 (0'0,36'6010] local-lis/les=21/22 n=542 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6010 lcod 36'6008 mlcod 36'6008 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.721 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.719+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5967 (0'0,36'5967] local-lis/les=21/22 n=500 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5967 lcod 36'5966 mlcod 36'5966 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.721 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.720+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6012 (0'0,36'6012] local-lis/les=21/22 n=540 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6010 crt=36'6010 lcod 36'6008 mlcod 36'6008 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.724 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.722+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5969 (0'0,36'5969] local-lis/les=21/22 n=498 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5967 crt=36'5967 lcod 36'5966 mlcod 36'5966 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.725 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.723+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5868 (0'0,36'5868] local-lis/les=21/22 n=504 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5866 crt=36'5866 lcod 36'5864 mlcod 36'5864 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.738 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.732+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5691 (0'0,36'5691] local-lis/les=21/22 n=417 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5691 lcod 36'5689 mlcod 36'5689 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.740 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.733+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5718 (0'0,36'5718] local-lis/les=21/22 n=353 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5717 crt=36'5715 lcod 36'5715 mlcod 36'5715 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.740 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.737+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5720 (0'0,36'5720] local-lis/les=21/22 n=351 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5717 crt=36'5717 lcod 36'5715 mlcod 36'5715 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.740 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.735+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5870 (0'0,36'5870] local-lis/les=21/22 n=502 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5870 lcod 36'5868 mlcod 36'5868 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.741 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.731+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5681 (0'0,36'5681] local-lis/les=21/22 n=469 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5681 lcod 36'5679 mlcod 36'5679 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.741 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.735+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5683 (0'0,36'5683] local-lis/les=21/22 n=467 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5681 crt=36'5681 lcod 36'5679 mlcod 36'5679 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.742 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.740+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5872 (0'0,36'5872] local-lis/les=21/22 n=500 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5870 crt=36'5870 lcod 36'5868 mlcod 36'5868 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.744 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.738+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5774 (0'0,36'5774] local-lis/les=21/22 n=498 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5774 lcod 36'5773 mlcod 36'5773 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.745 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.739+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5693 (0'0,36'5693] local-lis/les=21/22 n=415 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5691 crt=36'5691 lcod 36'5689 mlcod 36'5689 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.745 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.743+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5816 (0'0,36'5816] local-lis/les=21/22 n=457 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5815 crt=36'5815 lcod 36'5814 mlcod 36'5814 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.746 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.744+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5971 (0'0,36'5971] local-lis/les=21/22 n=496 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5971 lcod 36'5969 mlcod 36'5969 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.747 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.745+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5776 (0'0,36'5776] local-lis/les=21/22 n=496 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5774 crt=36'5774 lcod 36'5773 mlcod 36'5773 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.747 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.743+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6014 (0'0,36'6014] local-lis/les=21/22 n=538 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6014 lcod 36'6012 mlcod 36'6012 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.748 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.747+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6016 (0'0,36'6016] local-lis/les=21/22 n=536 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6014 crt=36'6014 lcod 36'6012 mlcod 36'6012 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.749 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.748+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5973 (0'0,36'5973] local-lis/les=21/22 n=494 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5971 crt=36'5971 lcod 36'5969 mlcod 36'5969 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.752 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.751+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5818 (0'0,36'5818] local-lis/les=21/22 n=455 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5815 crt=36'5815 lcod 36'5814 mlcod 36'5814 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.758 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.757+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5686 (0'0,36'5686] local-lis/les=21/22 n=464 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5685 crt=36'5683 lcod 36'5683 mlcod 36'5683 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.761 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.759+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5695 (0'0,36'5695] local-lis/les=21/22 n=413 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5695 lcod 36'5693 mlcod 36'5693 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.762 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.761+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6018 (0'0,36'6018] local-lis/les=21/22 n=534 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6018 lcod 36'6016 mlcod 36'6016 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.769 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.767+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5778 (0'0,36'5778] local-lis/les=21/22 n=494 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5778 lcod 36'5776 mlcod 36'5776 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.770 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.762+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5722 (0'0,36'5722] local-lis/les=21/22 n=349 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5722 lcod 36'5720 mlcod 36'5720 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.770 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.766+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5724 (0'0,36'5724] local-lis/les=21/22 n=347 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5722 crt=36'5722 lcod 36'5720 mlcod 36'5720 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.770 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.766+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6020 (0'0,36'6020] local-lis/les=21/22 n=532 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6018 crt=36'6018 lcod 36'6016 mlcod 36'6016 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.770 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.766+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5874 (0'0,36'5874] local-lis/les=21/22 n=498 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5874 lcod 36'5872 mlcod 36'5872 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.771 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.769+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5697 (0'0,36'5697] local-lis/les=21/22 n=411 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5695 crt=36'5695 lcod 36'5693 mlcod 36'5693 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.772 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.770+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5876 (0'0,36'5876] local-lis/les=21/22 n=496 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5874 crt=36'5874 lcod 36'5872 mlcod 36'5872 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.773 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.770+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5820 (0'0,36'5820] local-lis/les=21/22 n=453 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5820 lcod 36'5818 mlcod 36'5818 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.774 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.771+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5975 (0'0,36'5975] local-lis/les=21/22 n=492 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5975 lcod 36'5973 mlcod 36'5973 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.774 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.771+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5689 (0'0,36'5689] local-lis/les=21/22 n=461 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5688 crt=36'5686 lcod 36'5686 mlcod 36'5686 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.779 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.774+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5822 (0'0,36'5822] local-lis/les=21/22 n=451 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5820 crt=36'5820 lcod 36'5818 mlcod 36'5818 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.780 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.777+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5691 (0'0,36'5691] local-lis/les=21/22 n=459 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5688 crt=36'5688 lcod 36'5686 mlcod 36'5686 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.780 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.778+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5780 (0'0,36'5780] local-lis/les=21/22 n=492 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5778 crt=36'5778 lcod 36'5776 mlcod 36'5776 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.783 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.782+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5977 (0'0,36'5977] local-lis/les=21/22 n=490 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5975 crt=36'5975 lcod 36'5973 mlcod 36'5973 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.790 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.788+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5726 (0'0,36'5726] local-lis/les=21/22 n=345 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5726 lcod 36'5724 mlcod 36'5724 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.793 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.792+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5728 (0'0,36'5728] local-lis/les=21/22 n=343 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5726 crt=36'5726 lcod 36'5724 mlcod 36'5724 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.795 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.789+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5699 (0'0,36'5699] local-lis/les=21/22 n=409 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5699 lcod 36'5697 mlcod 36'5697 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.796 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.793+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5701 (0'0,36'5701] local-lis/les=21/22 n=407 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5699 crt=36'5699 lcod 36'5697 mlcod 36'5697 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.808 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.797+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5824 (0'0,36'5824] local-lis/les=21/22 n=449 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5824 lcod 36'5822 mlcod 36'5822 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.808 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.793+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5980 (0'0,36'5980] local-lis/les=21/22 n=487 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5979 crt=36'5977 lcod 36'5977 mlcod 36'5977 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.808 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.800+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5982 (0'0,36'5982] local-lis/les=21/22 n=485 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5979 crt=36'5979 lcod 36'5977 mlcod 36'5977 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.808 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.805+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5879 (0'0,36'5879] local-lis/les=21/22 n=493 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5879 lcod 36'5878 mlcod 36'5878 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.808 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.799+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6022 (0'0,36'6022] local-lis/les=21/22 n=530 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6022 lcod 36'6020 mlcod 36'6020 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.809 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.803+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6024 (0'0,36'6024] local-lis/les=21/22 n=528 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6022 crt=36'6022 lcod 36'6020 mlcod 36'6020 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.814 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.810+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5782 (0'0,36'5782] local-lis/les=21/22 n=490 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5782 lcod 36'5780 mlcod 36'5780 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.814 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.809+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5881 (0'0,36'5881] local-lis/les=21/22 n=491 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5879 crt=36'5879 lcod 36'5878 mlcod 36'5878 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.816 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.813+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5693 (0'0,36'5693] local-lis/les=21/22 n=457 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5693 lcod 36'5691 mlcod 36'5691 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.818 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.817+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5826 (0'0,36'5826] local-lis/les=21/22 n=447 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5826 lcod 36'5824 mlcod 36'5824 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.819 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.817+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5695 (0'0,36'5695] local-lis/les=21/22 n=455 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5693 crt=36'5693 lcod 36'5691 mlcod 36'5691 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.820 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.817+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5784 (0'0,36'5784] local-lis/les=21/22 n=488 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5782 crt=36'5782 lcod 36'5780 mlcod 36'5780 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.822 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.821+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5828 (0'0,36'5828] local-lis/les=21/22 n=445 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5826 crt=36'5826 lcod 36'5824 mlcod 36'5824 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.826 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.825+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5883 (0'0,36'5883] local-lis/les=21/22 n=489 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5883 lcod 36'5881 mlcod 36'5881 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.827 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.825+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5703 (0'0,36'5703] local-lis/les=21/22 n=405 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5703 lcod 36'5701 mlcod 36'5701 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.827 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.822+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5732 (0'0,36'5732] local-lis/les=21/22 n=339 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5732 lcod 36'5731 mlcod 36'5731 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.828 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.825+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5734 (0'0,36'5734] local-lis/les=21/22 n=337 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5732 crt=36'5732 lcod 36'5731 mlcod 36'5731 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.831 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.829+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5705 (0'0,36'5705] local-lis/les=21/22 n=403 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5703 crt=36'5703 lcod 36'5701 mlcod 36'5701 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.832 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.830+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6026 (0'0,36'6026] local-lis/les=21/22 n=526 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6026 lcod 36'6024 mlcod 36'6024 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.832 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.828+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5986 (0'0,36'5986] local-lis/les=21/22 n=481 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5984 crt=36'5984 lcod 36'5982 mlcod 36'5982 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.832 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.829+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5885 (0'0,36'5885] local-lis/les=21/22 n=487 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5883 crt=36'5883 lcod 36'5881 mlcod 36'5881 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.836 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.835+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5830 (0'0,36'5830] local-lis/les=21/22 n=443 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5830 lcod 36'5828 mlcod 36'5828 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.837 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.835+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6028 (0'0,36'6028] local-lis/les=21/22 n=524 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6026 crt=36'6026 lcod 36'6024 mlcod 36'6024 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.837 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.833+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5988 (0'0,36'5988] local-lis/les=21/22 n=479 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5984 crt=36'5984 lcod 36'5982 mlcod 36'5982 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.840 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.839+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5832 (0'0,36'5832] local-lis/les=21/22 n=441 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5830 crt=36'5830 lcod 36'5828 mlcod 36'5828 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.845 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.843+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5786 (0'0,36'5786] local-lis/les=21/22 n=486 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5786 lcod 36'5784 mlcod 36'5784 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.845 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.844+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5887 (0'0,36'5887] local-lis/les=21/22 n=485 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5887 lcod 36'5885 mlcod 36'5885 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.850 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.848+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5736 (0'0,36'5736] local-lis/les=21/22 n=335 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5736 lcod 36'5734 mlcod 36'5734 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.851 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.850+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5697 (0'0,36'5697] local-lis/les=21/22 n=453 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5697 lcod 36'5695 mlcod 36'5695 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.855 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.846+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5788 (0'0,36'5788] local-lis/les=21/22 n=484 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5786 crt=36'5786 lcod 36'5784 mlcod 36'5784 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.858 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.851+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5738 (0'0,36'5738] local-lis/les=21/22 n=333 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5736 crt=36'5736 lcod 36'5734 mlcod 36'5734 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.858 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.848+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5889 (0'0,36'5889] local-lis/les=21/22 n=483 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5887 crt=36'5887 lcod 36'5885 mlcod 36'5885 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.859 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.853+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5699 (0'0,36'5699] local-lis/les=21/22 n=451 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5697 crt=36'5697 lcod 36'5695 mlcod 36'5695 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.861 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.848+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5707 (0'0,36'5707] local-lis/les=21/22 n=401 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5707 lcod 36'5705 mlcod 36'5705 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.862 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.860+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5990 (0'0,36'5990] local-lis/les=21/22 n=477 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5990 lcod 36'5988 mlcod 36'5988 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.865 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.863+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5992 (0'0,36'5992] local-lis/les=21/22 n=475 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5990 crt=36'5990 lcod 36'5988 mlcod 36'5988 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.867 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.861+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5791 (0'0,36'5791] local-lis/les=21/22 n=481 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5790 crt=36'5786 lcod 36'5788 mlcod 36'5788 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.868 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.866+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5834 (0'0,36'5834] local-lis/les=21/22 n=439 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5834 lcod 36'5832 mlcod 36'5832 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.869 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.865+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5793 (0'0,36'5793] local-lis/les=21/22 n=479 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5790 crt=36'5790 lcod 36'5788 mlcod 36'5788 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.869 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.867+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6030 (0'0,36'6030] local-lis/les=21/22 n=522 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6030 lcod 36'6028 mlcod 36'6028 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.871 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.869+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5836 (0'0,36'5836] local-lis/les=21/22 n=437 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5834 crt=36'5834 lcod 36'5832 mlcod 36'5832 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.871 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.869+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5709 (0'0,36'5709] local-lis/les=21/22 n=399 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5709 lcod 36'5707 mlcod 36'5707 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.873 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.871+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6032 (0'0,36'6032] local-lis/les=21/22 n=520 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6030 crt=36'6030 lcod 36'6028 mlcod 36'6028 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.875 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.874+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5701 (0'0,36'5701] local-lis/les=21/22 n=449 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5701 lcod 36'5699 mlcod 36'5699 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.877 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.875+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5711 (0'0,36'5711] local-lis/les=21/22 n=397 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5709 crt=36'5709 lcod 36'5707 mlcod 36'5707 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.880 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.879+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5891 (0'0,36'5891] local-lis/les=21/22 n=481 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5891 lcod 36'5889 mlcod 36'5889 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.883 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.877+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5703 (0'0,36'5703] local-lis/les=21/22 n=447 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5701 crt=36'5701 lcod 36'5699 mlcod 36'5699 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.884 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.883+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5893 (0'0,36'5893] local-lis/les=21/22 n=479 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5891 crt=36'5891 lcod 36'5889 mlcod 36'5889 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.890 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.888+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5741 (0'0,36'5741] local-lis/les=21/22 n=330 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5740 crt=36'5736 lcod 36'5738 mlcod 36'5738 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.891 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.888+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5713 (0'0,36'5713] local-lis/les=21/22 n=395 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5713 lcod 36'5711 mlcod 36'5711 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.892 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.888+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5795 (0'0,36'5795] local-lis/les=21/22 n=477 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5795 lcod 36'5793 mlcod 36'5793 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.895 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.893+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5797 (0'0,36'5797] local-lis/les=21/22 n=475 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5795 crt=36'5795 lcod 36'5793 mlcod 36'5793 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.895 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.894+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5895 (0'0,36'5895] local-lis/les=21/22 n=477 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5895 lcod 36'5893 mlcod 36'5893 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.896 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.892+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5743 (0'0,36'5743] local-lis/les=21/22 n=328 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5740 crt=36'5740 lcod 36'5738 mlcod 36'5738 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.897 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.895+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5705 (0'0,36'5705] local-lis/les=21/22 n=445 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5705 lcod 36'5703 mlcod 36'5703 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.900 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.896+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5715 (0'0,36'5715] local-lis/les=21/22 n=393 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5713 crt=36'5713 lcod 36'5711 mlcod 36'5711 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.902 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.900+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5707 (0'0,36'5707] local-lis/les=21/22 n=443 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5705 crt=36'5705 lcod 36'5703 mlcod 36'5703 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.902 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.897+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5897 (0'0,36'5897] local-lis/les=21/22 n=475 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5895 crt=36'5895 lcod 36'5893 mlcod 36'5893 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.902 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.898+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5995 (0'0,36'5995] local-lis/les=21/22 n=472 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5995 lcod 36'5994 mlcod 36'5994 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.903 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.902+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5997 (0'0,36'5997] local-lis/les=21/22 n=470 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5995 crt=36'5995 lcod 36'5994 mlcod 36'5994 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.908 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.907+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6034 (0'0,36'6034] local-lis/les=21/22 n=518 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6034 lcod 36'6032 mlcod 36'6032 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.909 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.906+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5838 (0'0,36'5838] local-lis/les=21/22 n=435 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5838 lcod 36'5836 mlcod 36'5836 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.912 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.911+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6036 (0'0,36'6036] local-lis/les=21/22 n=516 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6034 crt=36'6034 lcod 36'6032 mlcod 36'6032 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.913 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.911+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5799 (0'0,36'5799] local-lis/les=21/22 n=473 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5799 lcod 36'5797 mlcod 36'5797 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.914 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.912+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5840 (0'0,36'5840] local-lis/les=21/22 n=433 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5838 crt=36'5838 lcod 36'5836 mlcod 36'5836 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.921 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.919+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5899 (0'0,36'5899] local-lis/les=21/22 n=473 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5899 lcod 36'5897 mlcod 36'5897 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.922 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.920+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5746 (0'0,36'5746] local-lis/les=21/22 n=325 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5745 crt=36'5743 lcod 36'5743 mlcod 36'5743 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.923 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.922+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5709 (0'0,36'5709] local-lis/les=21/22 n=441 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5709 lcod 36'5707 mlcod 36'5707 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.925 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.924+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5901 (0'0,36'5901] local-lis/les=21/22 n=471 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5899 crt=36'5899 lcod 36'5897 mlcod 36'5897 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.926 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.919+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5801 (0'0,36'5801] local-lis/les=21/22 n=471 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5799 crt=36'5799 lcod 36'5797 mlcod 36'5797 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.928 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.925+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5711 (0'0,36'5711] local-lis/les=21/22 n=439 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5709 crt=36'5709 lcod 36'5707 mlcod 36'5707 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.929 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.925+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5748 (0'0,36'5748] local-lis/les=21/22 n=323 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5745 crt=36'5745 lcod 36'5743 mlcod 36'5743 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.929 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.924+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5718 (0'0,36'5718] local-lis/les=21/22 n=390 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5718 lcod 36'5717 mlcod 36'5717 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.930 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.929+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'5999 (0'0,36'5999] local-lis/les=21/22 n=468 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'5999 lcod 36'5997 mlcod 36'5997 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.931 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.929+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5720 (0'0,36'5720] local-lis/les=21/22 n=388 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5718 crt=36'5718 lcod 36'5717 mlcod 36'5717 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.935 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.933+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6001 (0'0,36'6001] local-lis/les=21/22 n=466 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'5999 crt=36'5999 lcod 36'5997 mlcod 36'5997 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.938 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.936+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6038 (0'0,36'6038] local-lis/les=21/22 n=514 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6038 lcod 36'6036 mlcod 36'6036 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.939 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.936+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5803 (0'0,36'5803] local-lis/les=21/22 n=469 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5803 lcod 36'5801 mlcod 36'5801 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.940 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.939+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5842 (0'0,36'5842] local-lis/les=21/22 n=431 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5842 lcod 36'5840 mlcod 36'5840 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.941 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.940+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6040 (0'0,36'6040] local-lis/les=21/22 n=512 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6038 crt=36'6038 lcod 36'6036 mlcod 36'6036 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.945 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.943+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5750 (0'0,36'5750] local-lis/les=21/22 n=321 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5750 lcod 36'5748 mlcod 36'5748 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.947 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.945+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5844 (0'0,36'5844] local-lis/les=21/22 n=429 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5842 crt=36'5842 lcod 36'5840 mlcod 36'5840 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.948 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.946+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5713 (0'0,36'5713] local-lis/les=21/22 n=437 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5713 lcod 36'5711 mlcod 36'5711 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.948 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.946+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5752 (0'0,36'5752] local-lis/les=21/22 n=319 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5750 crt=36'5750 lcod 36'5748 mlcod 36'5748 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.951 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.946+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5805 (0'0,36'5805] local-lis/les=21/22 n=467 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5803 crt=36'5803 lcod 36'5801 mlcod 36'5801 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.951 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.950+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6004 (0'0,36'6004] local-lis/les=21/22 n=463 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6003 crt=36'5999 lcod 36'6001 mlcod 36'6001 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.954 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.953+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5715 (0'0,36'5715] local-lis/les=21/22 n=435 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5713 crt=36'5713 lcod 36'5711 mlcod 36'5711 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.959 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.955+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5722 (0'0,36'5722] local-lis/les=21/22 n=386 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5722 lcod 36'5720 mlcod 36'5720 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.959 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.953+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6006 (0'0,36'6006] local-lis/les=21/22 n=461 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6003 crt=36'6003 lcod 36'6001 mlcod 36'6001 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.960 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.956+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5904 (0'0,36'5904] local-lis/les=21/22 n=468 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5904 lcod 36'5903 mlcod 36'5903 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.961 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.960+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5906 (0'0,36'5906] local-lis/les=21/22 n=466 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5904 crt=36'5904 lcod 36'5903 mlcod 36'5903 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.962 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.960+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5724 (0'0,36'5724] local-lis/les=21/22 n=384 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5722 crt=36'5722 lcod 36'5720 mlcod 36'5720 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:31.963 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.961+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5846 (0'0,36'5846] local-lis/les=21/22 n=427 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5846 lcod 36'5844 mlcod 36'5844 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.969 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.968+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5754 (0'0,36'5754] local-lis/les=21/22 n=317 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5754 lcod 36'5752 mlcod 36'5752 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.970 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.969+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5848 (0'0,36'5848] local-lis/les=21/22 n=425 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5846 crt=36'5846 lcod 36'5844 mlcod 36'5844 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.972 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.970+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5807 (0'0,36'5807] local-lis/les=21/22 n=465 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5807 lcod 36'5805 mlcod 36'5805 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.974 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.973+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5756 (0'0,36'5756] local-lis/les=21/22 n=315 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5754 crt=36'5754 lcod 36'5752 mlcod 36'5752 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.975 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.973+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5717 (0'0,36'5717] local-lis/les=21/22 n=433 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5717 lcod 36'5715 mlcod 36'5715 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.977 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:31.974+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5809 (0'0,36'5809] local-lis/les=21/22 n=463 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5807 crt=36'5807 lcod 36'5805 mlcod 36'5805 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.977 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.975+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6044 (0'0,36'6044] local-lis/les=21/22 n=509 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6042 crt=36'6042 lcod 36'6040 mlcod 36'6040 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.979 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.977+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5719 (0'0,36'5719] local-lis/les=21/22 n=431 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5717 crt=36'5717 lcod 36'5715 mlcod 36'5715 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.980 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.978+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6009 (0'0,36'6009] local-lis/les=21/22 n=458 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6008 crt=36'6003 lcod 36'6006 mlcod 36'6006 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:31.989 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.985+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5726 (0'0,36'5726] local-lis/les=21/22 n=382 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5726 lcod 36'5724 mlcod 36'5724 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.993 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.990+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5758 (0'0,36'5758] local-lis/les=21/22 n=313 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5758 lcod 36'5756 mlcod 36'5756 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.996 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.993+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6012 (0'0,36'6012] local-lis/les=21/22 n=455 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6011 crt=36'6011 lcod 36'6009 mlcod 36'6009 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:31.997 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:31.992+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5728 (0'0,36'5728] local-lis/les=21/22 n=380 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5726 crt=36'5726 lcod 36'5724 mlcod 36'5724 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.997 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:31.995+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5760 (0'0,36'5760] local-lis/les=21/22 n=311 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5758 crt=36'5758 lcod 36'5756 mlcod 36'5756 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:31.999 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.993+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5850 (0'0,36'5850] local-lis/les=21/22 n=423 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5850 lcod 36'5848 mlcod 36'5848 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.999 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:31.997+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5852 (0'0,36'5852] local-lis/les=21/22 n=421 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5850 crt=36'5850 lcod 36'5848 mlcod 36'5848 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:31.999 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:31.997+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5911 (0'0,36'5911] local-lis/les=21/22 n=462 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5909 crt=36'5909 lcod 36'5908 mlcod 36'5908 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.003 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.001+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6047 (0'0,36'6047] local-lis/les=21/22 n=506 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6046 crt=36'6044 lcod 36'6044 mlcod 36'6044 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:32.004 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.001+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6014 (0'0,36'6014] local-lis/les=21/22 n=453 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6011 crt=36'6011 lcod 36'6009 mlcod 36'6009 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.007 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.005+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5730 (0'0,36'5730] local-lis/les=21/22 n=378 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5730 lcod 36'5728 mlcod 36'5728 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.008 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.007+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5721 (0'0,36'5721] local-lis/les=21/22 n=429 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5721 lcod 36'5719 mlcod 36'5719 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.012 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.006+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5811 (0'0,36'5811] local-lis/les=21/22 n=461 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5811 lcod 36'5809 mlcod 36'5809 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:32.013 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.010+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5723 (0'0,36'5723] local-lis/les=21/22 n=427 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5721 crt=36'5721 lcod 36'5719 mlcod 36'5719 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.013 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.008+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6049 (0'0,36'6049] local-lis/les=21/22 n=504 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6046 crt=36'6046 lcod 36'6044 mlcod 36'6044 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:32.016 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.014+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5732 (0'0,36'5732] local-lis/les=21/22 n=376 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5730 crt=36'5730 lcod 36'5728 mlcod 36'5728 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.019 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.014+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5913 (0'0,36'5913] local-lis/les=21/22 n=460 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5913 lcod 36'5911 mlcod 36'5911 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.022 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.021+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5762 (0'0,36'5762] local-lis/les=21/22 n=309 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5762 lcod 36'5760 mlcod 36'5760 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.023 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.022+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5855 (0'0,36'5855] local-lis/les=21/22 n=418 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5854 crt=36'5850 lcod 36'5852 mlcod 36'5852 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.026 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.025+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6051 (0'0,36'6051] local-lis/les=21/22 n=502 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6051 lcod 36'6049 mlcod 36'6049 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:32.026 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.025+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5725 (0'0,36'5725] local-lis/les=21/22 n=425 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5725 lcod 36'5723 mlcod 36'5723 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.027 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.026+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5857 (0'0,36'5857] local-lis/les=21/22 n=416 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5854 crt=36'5854 lcod 36'5852 mlcod 36'5852 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.028 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.022+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6016 (0'0,36'6016] local-lis/les=21/22 n=451 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6016 lcod 36'6014 mlcod 36'6014 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.029 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.028+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5764 (0'0,36'5764] local-lis/les=21/22 n=307 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5762 crt=36'5762 lcod 36'5760 mlcod 36'5760 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.033 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.032+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6053 (0'0,36'6053] local-lis/les=21/22 n=500 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6051 crt=36'6051 lcod 36'6049 mlcod 36'6049 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:32.034 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.033+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5727 (0'0,36'5727] local-lis/les=21/22 n=423 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5725 crt=36'5725 lcod 36'5723 mlcod 36'5723 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.039 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.037+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5734 (0'0,36'5734] local-lis/les=21/22 n=374 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5734 lcod 36'5732 mlcod 36'5732 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.040 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.036+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6018 (0'0,36'6018] local-lis/les=21/22 n=449 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6016 crt=36'6016 lcod 36'6014 mlcod 36'6014 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.040 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.036+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5915 (0'0,36'5915] local-lis/les=21/22 n=458 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5915 lcod 36'5913 mlcod 36'5913 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.042 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.040+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5917 (0'0,36'5917] local-lis/les=21/22 n=456 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5915 crt=36'5915 lcod 36'5913 mlcod 36'5913 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.045 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.043+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5736 (0'0,36'5736] local-lis/les=21/22 n=372 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5734 crt=36'5734 lcod 36'5732 mlcod 36'5732 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.049 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.047+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5766 (0'0,36'5766] local-lis/les=21/22 n=305 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5766 lcod 36'5764 mlcod 36'5764 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.049 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.039+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5814 (0'0,36'5814] local-lis/les=21/22 n=458 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5814 lcod 36'5813 mlcod 36'5813 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.049 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.048+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6056 (0'0,36'6056] local-lis/les=21/22 n=497 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6055 crt=36'6051 lcod 36'6053 mlcod 36'6053 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:32.052 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.050+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5729 (0'0,36'5729] local-lis/les=21/22 n=421 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5729 lcod 36'5727 mlcod 36'5727 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.054 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.053+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5768 (0'0,36'5768] local-lis/les=21/22 n=303 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5766 crt=36'5766 lcod 36'5764 mlcod 36'5764 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.055 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.052+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6021 (0'0,36'6021] local-lis/les=21/22 n=446 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6020 crt=36'6016 lcod 36'6018 mlcod 36'6018 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.055 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.054+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5731 (0'0,36'5731] local-lis/les=21/22 n=419 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5729 crt=36'5729 lcod 36'5727 mlcod 36'5727 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.056 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.053+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5816 (0'0,36'5816] local-lis/les=21/22 n=456 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5814 crt=36'5814 lcod 36'5813 mlcod 36'5813 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.057 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.056+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6023 (0'0,36'6023] local-lis/les=21/22 n=444 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6020 crt=36'6020 lcod 36'6018 mlcod 36'6018 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.059 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.058+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6058 (0'0,36'6058] local-lis/les=21/22 n=495 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6055 crt=36'6055 lcod 36'6053 mlcod 36'6053 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:32.064 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.061+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5859 (0'0,36'5859] local-lis/les=21/22 n=414 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5859 lcod 36'5857 mlcod 36'5857 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.065 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.064+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5919 (0'0,36'5919] local-lis/les=21/22 n=454 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5919 lcod 36'5917 mlcod 36'5917 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.069 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.067+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5861 (0'0,36'5861] local-lis/les=21/22 n=412 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5859 crt=36'5859 lcod 36'5857 mlcod 36'5857 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.069 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.067+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5921 (0'0,36'5921] local-lis/les=21/22 n=452 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5919 crt=36'5919 lcod 36'5917 mlcod 36'5917 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.070 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.067+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5738 (0'0,36'5738] local-lis/les=21/22 n=370 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5738 lcod 36'5736 mlcod 36'5736 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.070 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.068+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5770 (0'0,36'5770] local-lis/les=21/22 n=301 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5770 lcod 36'5768 mlcod 36'5768 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.071 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.067+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5818 (0'0,36'5818] local-lis/les=21/22 n=454 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5818 lcod 36'5816 mlcod 36'5816 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.078 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.072+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6060 (0'0,36'6060] local-lis/les=21/22 n=493 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6060 lcod 36'6058 mlcod 36'6058 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:32.078 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.076+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5772 (0'0,36'5772] local-lis/les=21/22 n=299 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5770 crt=36'5770 lcod 36'5768 mlcod 36'5768 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.079 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.076+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6062 (0'0,36'6062] local-lis/les=21/22 n=491 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6060 crt=36'6060 lcod 36'6058 mlcod 36'6058 active+clean+snaptrim trimq=[206~22] ps=[1fe~8]] removing snap head 2020-02-11T16:31:32.079 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.076+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6026 (0'0,36'6026] local-lis/les=21/22 n=441 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6025 crt=36'6021 lcod 36'6023 mlcod 36'6023 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.080 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.079+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5733 (0'0,36'5733] local-lis/les=21/22 n=417 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5733 lcod 36'5731 mlcod 36'5731 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.081 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.078+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5820 (0'0,36'5820] local-lis/les=21/22 n=452 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5818 crt=36'5818 lcod 36'5816 mlcod 36'5816 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.084 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.083+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5735 (0'0,36'5735] local-lis/les=21/22 n=415 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5733 crt=36'5733 lcod 36'5731 mlcod 36'5731 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.085 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.081+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6028 (0'0,36'6028] local-lis/les=21/22 n=439 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6025 crt=36'6025 lcod 36'6023 mlcod 36'6023 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.087 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.085+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5740 (0'0,36'5740] local-lis/les=21/22 n=368 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5738 crt=36'5738 lcod 36'5736 mlcod 36'5736 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.092 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.091+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5924 (0'0,36'5924] local-lis/les=21/22 n=449 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5923 crt=36'5919 lcod 36'5921 mlcod 36'5921 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.093 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.091+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5863 (0'0,36'5863] local-lis/les=21/22 n=410 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5863 lcod 36'5861 mlcod 36'5861 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.095 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.094+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5926 (0'0,36'5926] local-lis/les=21/22 n=447 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5923 crt=36'5923 lcod 36'5921 mlcod 36'5921 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.096 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.094+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5742 (0'0,36'5742] local-lis/les=21/22 n=366 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5742 lcod 36'5740 mlcod 36'5740 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.097 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.095+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5865 (0'0,36'5865] local-lis/les=21/22 n=408 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5863 crt=36'5863 lcod 36'5861 mlcod 36'5861 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.104 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.101+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5822 (0'0,36'5822] local-lis/les=21/22 n=450 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5822 lcod 36'5820 mlcod 36'5820 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.106 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.102+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5737 (0'0,36'5737] local-lis/les=21/22 n=413 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5737 lcod 36'5735 mlcod 36'5735 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.106 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.105+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6030 (0'0,36'6030] local-lis/les=21/22 n=437 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6030 lcod 36'6028 mlcod 36'6028 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.110 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.102+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6065 (0'0,36'6065] local-lis/les=21/22 n=488 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6064 crt=36'6064 lcod 36'6062 mlcod 36'6062 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.111 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.107+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5739 (0'0,36'5739] local-lis/les=21/22 n=411 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5737 crt=36'5737 lcod 36'5735 mlcod 36'5735 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.111 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.100+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5744 (0'0,36'5744] local-lis/les=21/22 n=364 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5742 crt=36'5742 lcod 36'5740 mlcod 36'5740 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.112 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.109+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6032 (0'0,36'6032] local-lis/les=21/22 n=435 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6030 crt=36'6030 lcod 36'6028 mlcod 36'6028 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.115 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.110+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5774 (0'0,36'5774] local-lis/les=21/22 n=297 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5774 lcod 36'5772 mlcod 36'5772 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.115 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.111+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6067 (0'0,36'6067] local-lis/les=21/22 n=486 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6064 crt=36'6064 lcod 36'6062 mlcod 36'6062 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.116 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.104+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5824 (0'0,36'5824] local-lis/les=21/22 n=448 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5822 crt=36'5822 lcod 36'5820 mlcod 36'5820 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.116 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.113+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5776 (0'0,36'5776] local-lis/les=21/22 n=295 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5774 crt=36'5774 lcod 36'5772 mlcod 36'5772 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.122 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.120+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5928 (0'0,36'5928] local-lis/les=21/22 n=445 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5928 lcod 36'5926 mlcod 36'5926 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.126 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.124+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5930 (0'0,36'5930] local-lis/les=21/22 n=443 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5928 crt=36'5928 lcod 36'5926 mlcod 36'5926 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.132 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.127+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6069 (0'0,36'6069] local-lis/les=21/22 n=484 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6069 lcod 36'6067 mlcod 36'6067 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.132 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.131+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6071 (0'0,36'6071] local-lis/les=21/22 n=482 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6069 crt=36'6069 lcod 36'6067 mlcod 36'6067 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.133 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.131+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5741 (0'0,36'5741] local-lis/les=21/22 n=409 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5741 lcod 36'5739 mlcod 36'5739 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.134 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.132+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5746 (0'0,36'5746] local-lis/les=21/22 n=362 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5746 lcod 36'5744 mlcod 36'5744 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.137 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.132+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6034 (0'0,36'6034] local-lis/les=21/22 n=433 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6034 lcod 36'6032 mlcod 36'6032 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.137 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.135+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5778 (0'0,36'5778] local-lis/les=21/22 n=293 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5778 lcod 36'5776 mlcod 36'5776 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.140 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.138+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5780 (0'0,36'5780] local-lis/les=21/22 n=291 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5778 crt=36'5778 lcod 36'5776 mlcod 36'5776 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.140 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.139+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5869 (0'0,36'5869] local-lis/les=21/22 n=404 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5867 crt=36'5863 lcod 36'5865 mlcod 36'5865 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.144 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.142+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5871 (0'0,36'5871] local-lis/les=21/22 n=402 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5867 crt=36'5867 lcod 36'5865 mlcod 36'5865 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.147 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.139+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5748 (0'0,36'5748] local-lis/les=21/22 n=360 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5746 crt=36'5746 lcod 36'5744 mlcod 36'5744 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.147 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.145+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6073 (0'0,36'6073] local-lis/les=21/22 n=480 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6073 lcod 36'6071 mlcod 36'6071 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.151 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.149+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6036 (0'0,36'6036] local-lis/les=21/22 n=431 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6036 lcod 36'6034 mlcod 36'6034 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.151 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.149+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5932 (0'0,36'5932] local-lis/les=21/22 n=441 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5932 lcod 36'5930 mlcod 36'5930 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.152 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.150+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6075 (0'0,36'6075] local-lis/les=21/22 n=478 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6073 crt=36'6073 lcod 36'6071 mlcod 36'6071 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.152 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.146+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5826 (0'0,36'5826] local-lis/les=21/22 n=446 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5826 lcod 36'5824 mlcod 36'5824 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.152 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.150+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5828 (0'0,36'5828] local-lis/les=21/22 n=444 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5826 crt=36'5826 lcod 36'5824 mlcod 36'5824 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.158 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.153+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5934 (0'0,36'5934] local-lis/les=21/22 n=439 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5932 crt=36'5932 lcod 36'5930 mlcod 36'5930 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.158 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.154+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6038 (0'0,36'6038] local-lis/les=21/22 n=429 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6036 crt=36'6036 lcod 36'6034 mlcod 36'6034 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.159 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.155+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5743 (0'0,36'5743] local-lis/les=21/22 n=407 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5743 lcod 36'5741 mlcod 36'5741 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.164 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.159+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5782 (0'0,36'5782] local-lis/les=21/22 n=289 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5782 lcod 36'5780 mlcod 36'5780 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.165 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.162+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5745 (0'0,36'5745] local-lis/les=21/22 n=405 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5743 crt=36'5743 lcod 36'5741 mlcod 36'5741 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.166 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.163+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5784 (0'0,36'5784] local-lis/les=21/22 n=287 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5782 crt=36'5782 lcod 36'5780 mlcod 36'5780 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.166 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.163+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5750 (0'0,36'5750] local-lis/les=21/22 n=358 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5750 lcod 36'5748 mlcod 36'5748 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.171 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.168+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6041 (0'0,36'6041] local-lis/les=21/22 n=426 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6040 crt=36'6036 lcod 36'6038 mlcod 36'6038 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.172 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.170+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5874 (0'0,36'5874] local-lis/les=21/22 n=399 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5874 lcod 36'5873 mlcod 36'5873 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.173 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.172+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6043 (0'0,36'6043] local-lis/les=21/22 n=424 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6040 crt=36'6040 lcod 36'6038 mlcod 36'6038 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.174 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.173+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5876 (0'0,36'5876] local-lis/les=21/22 n=397 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5874 crt=36'5874 lcod 36'5873 mlcod 36'5873 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.175 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.173+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5830 (0'0,36'5830] local-lis/les=21/22 n=442 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5830 lcod 36'5828 mlcod 36'5828 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.177 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.175+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5786 (0'0,36'5786] local-lis/les=21/22 n=285 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5786 lcod 36'5784 mlcod 36'5784 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.179 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.176+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5832 (0'0,36'5832] local-lis/les=21/22 n=440 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5830 crt=36'5830 lcod 36'5828 mlcod 36'5828 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.181 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.178+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5788 (0'0,36'5788] local-lis/les=21/22 n=283 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5786 crt=36'5786 lcod 36'5784 mlcod 36'5784 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.182 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.179+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6077 (0'0,36'6077] local-lis/les=21/22 n=476 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6077 lcod 36'6075 mlcod 36'6075 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.186 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.183+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5936 (0'0,36'5936] local-lis/les=21/22 n=437 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5936 lcod 36'5934 mlcod 36'5934 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.189 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.187+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6045 (0'0,36'6045] local-lis/les=21/22 n=422 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6045 lcod 36'6043 mlcod 36'6043 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.189 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.187+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5938 (0'0,36'5938] local-lis/les=21/22 n=435 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5936 crt=36'5936 lcod 36'5934 mlcod 36'5934 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.190 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.189+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5747 (0'0,36'5747] local-lis/les=21/22 n=403 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5747 lcod 36'5745 mlcod 36'5745 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.191 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.185+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6079 (0'0,36'6079] local-lis/les=21/22 n=474 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6077 crt=36'6077 lcod 36'6075 mlcod 36'6075 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.193 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.191+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6047 (0'0,36'6047] local-lis/les=21/22 n=420 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6045 crt=36'6045 lcod 36'6043 mlcod 36'6043 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.194 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.192+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5749 (0'0,36'5749] local-lis/les=21/22 n=401 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5747 crt=36'5747 lcod 36'5745 mlcod 36'5745 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.196 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.194+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5834 (0'0,36'5834] local-lis/les=21/22 n=438 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5834 lcod 36'5832 mlcod 36'5832 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.197 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.190+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5753 (0'0,36'5753] local-lis/les=21/22 n=355 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5753 lcod 36'5752 mlcod 36'5752 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.199 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.196+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5878 (0'0,36'5878] local-lis/les=21/22 n=395 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5878 lcod 36'5876 mlcod 36'5876 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.199 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.196+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5755 (0'0,36'5755] local-lis/les=21/22 n=353 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5753 crt=36'5753 lcod 36'5752 mlcod 36'5752 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.201 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.198+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5836 (0'0,36'5836] local-lis/les=21/22 n=436 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5834 crt=36'5834 lcod 36'5832 mlcod 36'5832 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.207 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.206+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5790 (0'0,36'5790] local-lis/les=21/22 n=281 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5790 lcod 36'5788 mlcod 36'5788 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.210 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.208+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6081 (0'0,36'6081] local-lis/les=21/22 n=472 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6081 lcod 36'6079 mlcod 36'6079 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.210 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.209+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5752 (0'0,36'5752] local-lis/les=21/22 n=398 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5751 crt=36'5747 lcod 36'5749 mlcod 36'5749 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.212 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.211+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5792 (0'0,36'5792] local-lis/les=21/22 n=279 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5790 crt=36'5790 lcod 36'5788 mlcod 36'5788 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.213 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.212+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6083 (0'0,36'6083] local-lis/les=21/22 n=470 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6081 crt=36'6081 lcod 36'6079 mlcod 36'6079 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.214 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.213+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5757 (0'0,36'5757] local-lis/les=21/22 n=351 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5757 lcod 36'5755 mlcod 36'5755 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.217 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.212+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5754 (0'0,36'5754] local-lis/les=21/22 n=396 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5751 crt=36'5751 lcod 36'5749 mlcod 36'5749 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.221 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.220+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5838 (0'0,36'5838] local-lis/les=21/22 n=434 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5838 lcod 36'5836 mlcod 36'5836 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.222 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.219+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5794 (0'0,36'5794] local-lis/les=21/22 n=277 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5794 lcod 36'5792 mlcod 36'5792 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.223 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.220+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5880 (0'0,36'5880] local-lis/les=21/22 n=393 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5880 lcod 36'5878 mlcod 36'5878 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.223 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.219+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5759 (0'0,36'5759] local-lis/les=21/22 n=349 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5757 crt=36'5757 lcod 36'5755 mlcod 36'5755 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.225 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.223+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5796 (0'0,36'5796] local-lis/les=21/22 n=275 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5794 crt=36'5794 lcod 36'5792 mlcod 36'5792 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.226 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.224+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5840 (0'0,36'5840] local-lis/les=21/22 n=432 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5838 crt=36'5838 lcod 36'5836 mlcod 36'5836 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.226 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.224+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5882 (0'0,36'5882] local-lis/les=21/22 n=391 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5880 crt=36'5880 lcod 36'5878 mlcod 36'5878 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.230 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.229+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5756 (0'0,36'5756] local-lis/les=21/22 n=394 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5756 lcod 36'5754 mlcod 36'5754 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.231 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.230+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6085 (0'0,36'6085] local-lis/les=21/22 n=468 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6085 lcod 36'6083 mlcod 36'6083 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.236 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.234+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6087 (0'0,36'6087] local-lis/les=21/22 n=466 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6085 crt=36'6085 lcod 36'6083 mlcod 36'6083 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.254 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.241+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6050 (0'0,36'6050] local-lis/les=21/22 n=417 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6050 lcod 36'6049 mlcod 36'6049 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.254 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.245+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6052 (0'0,36'6052] local-lis/les=21/22 n=415 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6050 crt=36'6050 lcod 36'6049 mlcod 36'6049 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.254 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.246+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5943 (0'0,36'5943] local-lis/les=21/22 n=431 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5943 lcod 36'5941 mlcod 36'5941 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.254 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.245+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5799 (0'0,36'5799] local-lis/les=21/22 n=272 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5798 crt=36'5794 lcod 36'5796 mlcod 36'5796 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.254 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.249+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5801 (0'0,36'5801] local-lis/les=21/22 n=270 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5798 crt=36'5798 lcod 36'5796 mlcod 36'5796 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.254 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.245+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5884 (0'0,36'5884] local-lis/les=21/22 n=389 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5884 lcod 36'5882 mlcod 36'5882 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.255 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.250+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5886 (0'0,36'5886] local-lis/les=21/22 n=387 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5884 crt=36'5884 lcod 36'5882 mlcod 36'5882 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.255 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.239+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5761 (0'0,36'5761] local-lis/les=21/22 n=347 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5761 lcod 36'5759 mlcod 36'5759 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.256 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.245+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5842 (0'0,36'5842] local-lis/les=21/22 n=430 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5842 lcod 36'5840 mlcod 36'5840 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.256 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.253+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5945 (0'0,36'5945] local-lis/les=21/22 n=429 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5943 crt=36'5943 lcod 36'5941 mlcod 36'5941 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.256 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.253+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5844 (0'0,36'5844] local-lis/les=21/22 n=428 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5842 crt=36'5842 lcod 36'5840 mlcod 36'5840 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.257 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.254+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5763 (0'0,36'5763] local-lis/les=21/22 n=345 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5761 crt=36'5761 lcod 36'5759 mlcod 36'5759 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.257 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.256+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6089 (0'0,36'6089] local-lis/les=21/22 n=464 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6089 lcod 36'6087 mlcod 36'6087 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.262 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.261+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5758 (0'0,36'5758] local-lis/les=21/22 n=392 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5758 lcod 36'5756 mlcod 36'5756 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.265 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.259+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6091 (0'0,36'6091] local-lis/les=21/22 n=462 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6089 crt=36'6089 lcod 36'6087 mlcod 36'6087 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.266 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.265+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5760 (0'0,36'5760] local-lis/les=21/22 n=390 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5758 crt=36'5758 lcod 36'5756 mlcod 36'5756 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.266 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.265+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5803 (0'0,36'5803] local-lis/les=21/22 n=268 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5803 lcod 36'5801 mlcod 36'5801 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.267 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.266+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6054 (0'0,36'6054] local-lis/les=21/22 n=413 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6054 lcod 36'6052 mlcod 36'6052 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.270 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.269+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6056 (0'0,36'6056] local-lis/les=21/22 n=411 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6054 crt=36'6054 lcod 36'6052 mlcod 36'6052 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.272 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.271+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5947 (0'0,36'5947] local-lis/les=21/22 n=427 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5947 lcod 36'5945 mlcod 36'5945 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.275 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.272+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5805 (0'0,36'5805] local-lis/les=21/22 n=266 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5803 crt=36'5803 lcod 36'5801 mlcod 36'5801 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.276 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.274+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5949 (0'0,36'5949] local-lis/les=21/22 n=425 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5947 crt=36'5947 lcod 36'5945 mlcod 36'5945 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.278 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.276+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5888 (0'0,36'5888] local-lis/les=21/22 n=385 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5888 lcod 36'5886 mlcod 36'5886 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.282 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.280+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5890 (0'0,36'5890] local-lis/les=21/22 n=383 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5888 crt=36'5888 lcod 36'5886 mlcod 36'5886 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.282 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.277+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5846 (0'0,36'5846] local-lis/les=21/22 n=426 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5846 lcod 36'5844 mlcod 36'5844 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.283 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.281+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5848 (0'0,36'5848] local-lis/les=21/22 n=424 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5846 crt=36'5846 lcod 36'5844 mlcod 36'5844 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.283 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.282+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6093 (0'0,36'6093] local-lis/les=21/22 n=460 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6093 lcod 36'6091 mlcod 36'6091 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.287 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.285+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5767 (0'0,36'5767] local-lis/les=21/22 n=341 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5765 crt=36'5765 lcod 36'5763 mlcod 36'5763 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.290 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.286+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6095 (0'0,36'6095] local-lis/les=21/22 n=458 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6093 crt=36'6093 lcod 36'6091 mlcod 36'6091 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.291 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.289+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5762 (0'0,36'5762] local-lis/les=21/22 n=388 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5762 lcod 36'5760 mlcod 36'5760 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.292 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.290+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5807 (0'0,36'5807] local-lis/les=21/22 n=264 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5807 lcod 36'5805 mlcod 36'5805 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.294 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.289+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5769 (0'0,36'5769] local-lis/les=21/22 n=339 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5765 crt=36'5765 lcod 36'5763 mlcod 36'5763 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.297 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.294+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5809 (0'0,36'5809] local-lis/les=21/22 n=262 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5807 crt=36'5807 lcod 36'5805 mlcod 36'5805 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.298 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.293+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5764 (0'0,36'5764] local-lis/les=21/22 n=386 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5762 crt=36'5762 lcod 36'5760 mlcod 36'5760 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.298 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.293+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5951 (0'0,36'5951] local-lis/les=21/22 n=423 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5951 lcod 36'5949 mlcod 36'5949 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.299 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.297+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5850 (0'0,36'5850] local-lis/les=21/22 n=422 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5850 lcod 36'5848 mlcod 36'5848 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.301 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.299+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5953 (0'0,36'5953] local-lis/les=21/22 n=421 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5951 crt=36'5951 lcod 36'5949 mlcod 36'5949 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.303 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.302+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5893 (0'0,36'5893] local-lis/les=21/22 n=380 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5892 crt=36'5892 lcod 36'5890 mlcod 36'5890 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.306 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.303+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6097 (0'0,36'6097] local-lis/les=21/22 n=456 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6097 lcod 36'6095 mlcod 36'6095 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.308 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.307+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5895 (0'0,36'5895] local-lis/les=21/22 n=378 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5892 crt=36'5892 lcod 36'5890 mlcod 36'5890 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.312 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.307+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6058 (0'0,36'6058] local-lis/les=21/22 n=409 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6058 lcod 36'6056 mlcod 36'6056 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.312 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.310+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6099 (0'0,36'6099] local-lis/les=21/22 n=454 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6097 crt=36'6097 lcod 36'6095 mlcod 36'6095 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.312 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.309+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5852 (0'0,36'5852] local-lis/les=21/22 n=420 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5850 crt=36'5850 lcod 36'5848 mlcod 36'5848 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.318 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.316+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5771 (0'0,36'5771] local-lis/les=21/22 n=337 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5771 lcod 36'5769 mlcod 36'5769 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.319 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.315+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5766 (0'0,36'5766] local-lis/les=21/22 n=384 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5766 lcod 36'5764 mlcod 36'5764 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.321 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.314+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6060 (0'0,36'6060] local-lis/les=21/22 n=407 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6058 crt=36'6058 lcod 36'6056 mlcod 36'6056 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.321 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.314+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5956 (0'0,36'5956] local-lis/les=21/22 n=418 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5955 crt=36'5951 lcod 36'5953 mlcod 36'5953 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.321 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.317+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5958 (0'0,36'5958] local-lis/les=21/22 n=416 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5955 crt=36'5955 lcod 36'5953 mlcod 36'5953 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.321 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.319+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5768 (0'0,36'5768] local-lis/les=21/22 n=382 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5766 crt=36'5766 lcod 36'5764 mlcod 36'5764 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.322 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.319+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5773 (0'0,36'5773] local-lis/les=21/22 n=335 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5771 crt=36'5771 lcod 36'5769 mlcod 36'5769 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.335 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.330+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5897 (0'0,36'5897] local-lis/les=21/22 n=376 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5897 lcod 36'5895 mlcod 36'5895 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.336 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.331+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5770 (0'0,36'5770] local-lis/les=21/22 n=380 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5770 lcod 36'5768 mlcod 36'5768 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.336 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.334+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5899 (0'0,36'5899] local-lis/les=21/22 n=374 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5897 crt=36'5897 lcod 36'5895 mlcod 36'5895 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.336 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.334+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5772 (0'0,36'5772] local-lis/les=21/22 n=378 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5770 crt=36'5770 lcod 36'5768 mlcod 36'5768 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.336 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.328+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5811 (0'0,36'5811] local-lis/les=21/22 n=260 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5811 lcod 36'5809 mlcod 36'5809 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.337 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.332+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5813 (0'0,36'5813] local-lis/les=21/22 n=258 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5811 crt=36'5811 lcod 36'5809 mlcod 36'5809 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.337 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.332+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6063 (0'0,36'6063] local-lis/les=21/22 n=404 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6062 crt=36'6060 lcod 36'6060 mlcod 36'6060 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.338 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.336+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6065 (0'0,36'6065] local-lis/les=21/22 n=402 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6062 crt=36'6062 lcod 36'6060 mlcod 36'6060 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.344 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.342+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6102 (0'0,36'6102] local-lis/les=21/22 n=451 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6101 crt=36'6097 lcod 36'6099 mlcod 36'6099 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.348 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.347+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6104 (0'0,36'6104] local-lis/les=21/22 n=449 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6101 crt=36'6101 lcod 36'6099 mlcod 36'6099 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.352 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.350+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5815 (0'0,36'5815] local-lis/les=21/22 n=256 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5815 lcod 36'5813 mlcod 36'5813 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.354 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.353+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5817 (0'0,36'5817] local-lis/les=21/22 n=254 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5815 crt=36'5815 lcod 36'5813 mlcod 36'5813 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.415 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.330+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5854 (0'0,36'5854] local-lis/les=21/22 n=418 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5854 lcod 36'5852 mlcod 36'5852 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.416 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.341+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5856 (0'0,36'5856] local-lis/les=21/22 n=416 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5854 crt=36'5854 lcod 36'5852 mlcod 36'5852 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.418 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.334+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5775 (0'0,36'5775] local-lis/les=21/22 n=333 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5775 lcod 36'5773 mlcod 36'5773 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.418 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.337+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5777 (0'0,36'5777] local-lis/les=21/22 n=331 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5775 crt=36'5775 lcod 36'5773 mlcod 36'5773 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.423 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.422+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5960 (0'0,36'5960] local-lis/les=21/22 n=414 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5960 lcod 36'5958 mlcod 36'5958 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.425 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.423+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5779 (0'0,36'5779] local-lis/les=21/22 n=329 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5779 lcod 36'5777 mlcod 36'5777 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.430 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.427+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5962 (0'0,36'5962] local-lis/les=21/22 n=412 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5960 crt=36'5960 lcod 36'5958 mlcod 36'5958 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.432 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.425+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5774 (0'0,36'5774] local-lis/les=21/22 n=376 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5774 lcod 36'5772 mlcod 36'5772 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.433 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.432+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6106 (0'0,36'6106] local-lis/les=21/22 n=447 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6106 lcod 36'6104 mlcod 36'6104 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.434 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.430+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5781 (0'0,36'5781] local-lis/les=21/22 n=327 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5779 crt=36'5779 lcod 36'5777 mlcod 36'5777 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.434 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.433+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5819 (0'0,36'5819] local-lis/les=21/22 n=252 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5819 lcod 36'5817 mlcod 36'5817 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.435 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.433+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6069 (0'0,36'6069] local-lis/les=21/22 n=398 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6068 crt=36'6068 lcod 36'6067 mlcod 36'6067 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.438 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.436+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6108 (0'0,36'6108] local-lis/les=21/22 n=445 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6106 crt=36'6106 lcod 36'6104 mlcod 36'6104 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.438 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.436+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5858 (0'0,36'5858] local-lis/les=21/22 n=414 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5858 lcod 36'5856 mlcod 36'5856 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.439 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.437+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6071 (0'0,36'6071] local-lis/les=21/22 n=396 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6068 crt=36'6068 lcod 36'6067 mlcod 36'6067 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.441 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.438+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5902 (0'0,36'5902] local-lis/les=21/22 n=371 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5901 crt=36'5897 lcod 36'5899 mlcod 36'5899 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.444 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.441+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5860 (0'0,36'5860] local-lis/les=21/22 n=412 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5858 crt=36'5858 lcod 36'5856 mlcod 36'5856 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.445 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.442+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5776 (0'0,36'5776] local-lis/les=21/22 n=374 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5776 lcod 36'5774 mlcod 36'5774 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.446 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.443+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5821 (0'0,36'5821] local-lis/les=21/22 n=250 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5819 crt=36'5819 lcod 36'5817 mlcod 36'5817 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.447 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.443+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5964 (0'0,36'5964] local-lis/les=21/22 n=410 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5964 lcod 36'5962 mlcod 36'5962 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.457 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.451+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5783 (0'0,36'5783] local-lis/les=21/22 n=325 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5783 lcod 36'5781 mlcod 36'5781 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.458 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.456+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5785 (0'0,36'5785] local-lis/les=21/22 n=323 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5783 crt=36'5783 lcod 36'5781 mlcod 36'5781 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.468 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.446+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5778 (0'0,36'5778] local-lis/les=21/22 n=372 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5776 crt=36'5776 lcod 36'5774 mlcod 36'5774 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.470 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.454+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6074 (0'0,36'6074] local-lis/les=21/22 n=393 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6073 crt=36'6069 lcod 36'6071 mlcod 36'6071 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.470 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.457+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6076 (0'0,36'6076] local-lis/les=21/22 n=391 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6073 crt=36'6073 lcod 36'6071 mlcod 36'6071 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.470 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.447+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5904 (0'0,36'5904] local-lis/les=21/22 n=369 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5901 crt=36'5901 lcod 36'5899 mlcod 36'5899 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.474 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.472+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5906 (0'0,36'5906] local-lis/les=21/22 n=367 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5906 lcod 36'5904 mlcod 36'5904 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.477 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.451+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6110 (0'0,36'6110] local-lis/les=21/22 n=443 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6110 lcod 36'6108 mlcod 36'6108 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.477 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.474+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6078 (0'0,36'6078] local-lis/les=21/22 n=389 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6078 lcod 36'6076 mlcod 36'6076 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.478 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.476+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5863 (0'0,36'5863] local-lis/les=21/22 n=409 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5863 lcod 36'5862 mlcod 36'5862 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.479 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.476+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5968 (0'0,36'5968] local-lis/les=21/22 n=407 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5968 lcod 36'5966 mlcod 36'5966 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.479 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.477+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5908 (0'0,36'5908] local-lis/les=21/22 n=365 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5906 crt=36'5906 lcod 36'5904 mlcod 36'5904 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.479 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.476+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5823 (0'0,36'5823] local-lis/les=21/22 n=248 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5823 lcod 36'5821 mlcod 36'5821 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.481 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.479+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5825 (0'0,36'5825] local-lis/les=21/22 n=246 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5823 crt=36'5823 lcod 36'5821 mlcod 36'5821 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.484 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.481+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5865 (0'0,36'5865] local-lis/les=21/22 n=407 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5863 crt=36'5863 lcod 36'5862 mlcod 36'5862 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.485 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.482+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5970 (0'0,36'5970] local-lis/les=21/22 n=405 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5968 crt=36'5968 lcod 36'5966 mlcod 36'5966 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.485 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.484+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5780 (0'0,36'5780] local-lis/les=21/22 n=370 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5780 lcod 36'5778 mlcod 36'5778 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.487 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.485+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6080 (0'0,36'6080] local-lis/les=21/22 n=387 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6078 crt=36'6078 lcod 36'6076 mlcod 36'6076 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.492 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.490+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5782 (0'0,36'5782] local-lis/les=21/22 n=368 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5780 crt=36'5780 lcod 36'5778 mlcod 36'5778 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.494 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.493+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5827 (0'0,36'5827] local-lis/les=21/22 n=244 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5827 lcod 36'5825 mlcod 36'5825 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.498 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.496+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5829 (0'0,36'5829] local-lis/les=21/22 n=242 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5827 crt=36'5827 lcod 36'5825 mlcod 36'5825 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.502 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.501+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5912 (0'0,36'5912] local-lis/les=21/22 n=361 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5910 crt=36'5906 lcod 36'5908 mlcod 36'5908 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.503 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.492+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5788 (0'0,36'5788] local-lis/les=21/22 n=320 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5788 lcod 36'5787 mlcod 36'5787 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.504 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.501+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6114 (0'0,36'6114] local-lis/les=21/22 n=440 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6114 lcod 36'6112 mlcod 36'6112 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.504 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.500+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5972 (0'0,36'5972] local-lis/les=21/22 n=403 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5972 lcod 36'5970 mlcod 36'5970 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.505 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.497+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5790 (0'0,36'5790] local-lis/les=21/22 n=318 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5788 crt=36'5788 lcod 36'5787 mlcod 36'5787 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.506 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.503+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5867 (0'0,36'5867] local-lis/les=21/22 n=405 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5867 lcod 36'5865 mlcod 36'5865 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.507 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.506+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5784 (0'0,36'5784] local-lis/les=21/22 n=366 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5784 lcod 36'5782 mlcod 36'5782 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.508 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.506+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5974 (0'0,36'5974] local-lis/les=21/22 n=401 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5972 crt=36'5972 lcod 36'5970 mlcod 36'5970 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.511 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.505+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6116 (0'0,36'6116] local-lis/les=21/22 n=438 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6114 crt=36'6114 lcod 36'6112 mlcod 36'6112 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.512 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.509+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5786 (0'0,36'5786] local-lis/les=21/22 n=364 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5784 crt=36'5784 lcod 36'5782 mlcod 36'5782 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.512 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.510+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5914 (0'0,36'5914] local-lis/les=21/22 n=359 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5910 crt=36'5910 lcod 36'5908 mlcod 36'5908 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.514 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.510+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5869 (0'0,36'5869] local-lis/les=21/22 n=403 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5867 crt=36'5867 lcod 36'5865 mlcod 36'5865 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.517 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.515+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5976 (0'0,36'5976] local-lis/les=21/22 n=399 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5976 lcod 36'5974 mlcod 36'5974 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.518 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.516+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6082 (0'0,36'6082] local-lis/les=21/22 n=385 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6082 lcod 36'6080 mlcod 36'6080 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.518 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.515+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5831 (0'0,36'5831] local-lis/les=21/22 n=240 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5831 lcod 36'5829 mlcod 36'5829 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.521 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.518+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5792 (0'0,36'5792] local-lis/les=21/22 n=316 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5792 lcod 36'5790 mlcod 36'5790 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.522 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.521+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6084 (0'0,36'6084] local-lis/les=21/22 n=383 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6082 crt=36'6082 lcod 36'6080 mlcod 36'6080 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.523 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.522+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5978 (0'0,36'5978] local-lis/les=21/22 n=397 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5976 crt=36'5976 lcod 36'5974 mlcod 36'5974 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.524 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.523+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5833 (0'0,36'5833] local-lis/les=21/22 n=238 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5831 crt=36'5831 lcod 36'5829 mlcod 36'5829 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.527 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.522+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5794 (0'0,36'5794] local-lis/les=21/22 n=314 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5792 crt=36'5792 lcod 36'5790 mlcod 36'5790 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.531 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.529+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6118 (0'0,36'6118] local-lis/les=21/22 n=436 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6118 lcod 36'6116 mlcod 36'6116 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.532 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.531+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5788 (0'0,36'5788] local-lis/les=21/22 n=362 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5788 lcod 36'5786 mlcod 36'5786 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.536 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.534+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5871 (0'0,36'5871] local-lis/les=21/22 n=401 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5871 lcod 36'5869 mlcod 36'5869 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.537 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.535+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6086 (0'0,36'6086] local-lis/les=21/22 n=381 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6086 lcod 36'6084 mlcod 36'6084 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.540 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.538+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5916 (0'0,36'5916] local-lis/les=21/22 n=357 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5916 lcod 36'5914 mlcod 36'5914 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.541 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.539+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6120 (0'0,36'6120] local-lis/les=21/22 n=434 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6118 crt=36'6118 lcod 36'6116 mlcod 36'6116 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.541 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.539+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5981 (0'0,36'5981] local-lis/les=21/22 n=394 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5980 crt=36'5976 lcod 36'5978 mlcod 36'5978 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.542 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.540+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5873 (0'0,36'5873] local-lis/les=21/22 n=399 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5871 crt=36'5871 lcod 36'5869 mlcod 36'5869 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.543 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.541+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5790 (0'0,36'5790] local-lis/les=21/22 n=360 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5788 crt=36'5788 lcod 36'5786 mlcod 36'5786 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.544 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.543+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6088 (0'0,36'6088] local-lis/les=21/22 n=379 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6086 crt=36'6086 lcod 36'6084 mlcod 36'6084 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.545 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.543+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5983 (0'0,36'5983] local-lis/les=21/22 n=392 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5980 crt=36'5980 lcod 36'5978 mlcod 36'5978 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.551 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.550+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5918 (0'0,36'5918] local-lis/les=21/22 n=355 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5916 crt=36'5916 lcod 36'5914 mlcod 36'5914 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.552 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.550+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5836 (0'0,36'5836] local-lis/les=21/22 n=235 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5836 lcod 36'5835 mlcod 36'5835 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.555 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.553+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5875 (0'0,36'5875] local-lis/les=21/22 n=397 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5875 lcod 36'5873 mlcod 36'5873 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.555 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.554+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5838 (0'0,36'5838] local-lis/les=21/22 n=233 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5836 crt=36'5836 lcod 36'5835 mlcod 36'5835 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.556 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.555+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5796 (0'0,36'5796] local-lis/les=21/22 n=312 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5796 lcod 36'5794 mlcod 36'5794 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.560 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.558+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5793 (0'0,36'5793] local-lis/les=21/22 n=357 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5792 crt=36'5788 lcod 36'5790 mlcod 36'5790 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.562 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.561+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6122 (0'0,36'6122] local-lis/les=21/22 n=432 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6122 lcod 36'6120 mlcod 36'6120 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.563 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.562+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5795 (0'0,36'5795] local-lis/les=21/22 n=355 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5792 crt=36'5792 lcod 36'5790 mlcod 36'5790 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.564 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.562+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5798 (0'0,36'5798] local-lis/les=21/22 n=310 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5796 crt=36'5796 lcod 36'5794 mlcod 36'5794 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.564 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.562+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5877 (0'0,36'5877] local-lis/les=21/22 n=395 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5875 crt=36'5875 lcod 36'5873 mlcod 36'5873 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.568 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.565+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5986 (0'0,36'5986] local-lis/les=21/22 n=389 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5986 lcod 36'5985 mlcod 36'5985 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.570 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.568+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6124 (0'0,36'6124] local-lis/les=21/22 n=430 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6122 crt=36'6122 lcod 36'6120 mlcod 36'6120 active+clean+snaptrim trimq=[207~21] ps=[1fe~9]] removing snap head 2020-02-11T16:31:32.570 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.568+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6090 (0'0,36'6090] local-lis/les=21/22 n=377 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6090 lcod 36'6088 mlcod 36'6088 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.574 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.573+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5920 (0'0,36'5920] local-lis/les=21/22 n=353 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5920 lcod 36'5918 mlcod 36'5918 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.577 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.573+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6092 (0'0,36'6092] local-lis/les=21/22 n=375 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6090 crt=36'6090 lcod 36'6088 mlcod 36'6088 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.577 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.575+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5988 (0'0,36'5988] local-lis/les=21/22 n=387 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5986 crt=36'5986 lcod 36'5985 mlcod 36'5985 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.578 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.576+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5922 (0'0,36'5922] local-lis/les=21/22 n=351 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5920 crt=36'5920 lcod 36'5918 mlcod 36'5918 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.581 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.579+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5840 (0'0,36'5840] local-lis/les=21/22 n=231 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5840 lcod 36'5838 mlcod 36'5838 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.581 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.577+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5797 (0'0,36'5797] local-lis/les=21/22 n=353 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5797 lcod 36'5795 mlcod 36'5795 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.582 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.581+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5799 (0'0,36'5799] local-lis/les=21/22 n=351 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5797 crt=36'5797 lcod 36'5795 mlcod 36'5795 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.590 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.584+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5842 (0'0,36'5842] local-lis/les=21/22 n=229 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5840 crt=36'5840 lcod 36'5838 mlcod 36'5838 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.591 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.587+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5879 (0'0,36'5879] local-lis/les=21/22 n=393 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5879 lcod 36'5877 mlcod 36'5877 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.592 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.590+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6126 (0'0,36'6126] local-lis/les=21/22 n=428 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6126 lcod 36'6124 mlcod 36'6124 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.593 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.583+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5802 (0'0,36'5802] local-lis/les=21/22 n=306 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5801 crt=36'5796 lcod 36'5800 mlcod 36'5800 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.595 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.588+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6095 (0'0,36'6095] local-lis/les=21/22 n=372 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6094 crt=36'6090 lcod 36'6092 mlcod 36'6092 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.595 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.592+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6097 (0'0,36'6097] local-lis/les=21/22 n=370 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6094 crt=36'6094 lcod 36'6092 mlcod 36'6092 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.596 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.594+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6128 (0'0,36'6128] local-lis/les=21/22 n=426 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6126 crt=36'6126 lcod 36'6124 mlcod 36'6124 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.597 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.587+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5804 (0'0,36'5804] local-lis/les=21/22 n=304 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5801 crt=36'5801 lcod 36'5800 mlcod 36'5800 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.600 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.598+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5844 (0'0,36'5844] local-lis/les=21/22 n=227 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5844 lcod 36'5842 mlcod 36'5842 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.601 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.596+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5881 (0'0,36'5881] local-lis/les=21/22 n=391 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5879 crt=36'5879 lcod 36'5877 mlcod 36'5877 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.603 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.601+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5846 (0'0,36'5846] local-lis/les=21/22 n=225 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5844 crt=36'5844 lcod 36'5842 mlcod 36'5842 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.607 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.604+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5924 (0'0,36'5924] local-lis/les=21/22 n=349 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5924 lcod 36'5922 mlcod 36'5922 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.609 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.602+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5990 (0'0,36'5990] local-lis/les=21/22 n=385 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5990 lcod 36'5988 mlcod 36'5988 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.610 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.609+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6099 (0'0,36'6099] local-lis/les=21/22 n=368 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6099 lcod 36'6097 mlcod 36'6097 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.611 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.609+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5992 (0'0,36'5992] local-lis/les=21/22 n=383 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5990 crt=36'5990 lcod 36'5988 mlcod 36'5988 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.611 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.609+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5801 (0'0,36'5801] local-lis/les=21/22 n=349 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5801 lcod 36'5799 mlcod 36'5799 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.611 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.609+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5806 (0'0,36'5806] local-lis/les=21/22 n=302 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5806 lcod 36'5804 mlcod 36'5804 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.615 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.613+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5803 (0'0,36'5803] local-lis/les=21/22 n=347 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5801 crt=36'5801 lcod 36'5799 mlcod 36'5799 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.615 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.612+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5884 (0'0,36'5884] local-lis/les=21/22 n=388 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5883 crt=36'5879 lcod 36'5881 mlcod 36'5881 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.616 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.615+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5926 (0'0,36'5926] local-lis/les=21/22 n=347 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5924 crt=36'5924 lcod 36'5922 mlcod 36'5922 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.616 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.614+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6101 (0'0,36'6101] local-lis/les=21/22 n=366 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6099 crt=36'6099 lcod 36'6097 mlcod 36'6097 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.616 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.613+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5808 (0'0,36'5808] local-lis/les=21/22 n=300 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5806 crt=36'5806 lcod 36'5804 mlcod 36'5804 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.620 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.618+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5886 (0'0,36'5886] local-lis/les=21/22 n=386 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5883 crt=36'5883 lcod 36'5881 mlcod 36'5881 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.621 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.620+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5848 (0'0,36'5848] local-lis/les=21/22 n=223 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5848 lcod 36'5846 mlcod 36'5846 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.625 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.623+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5850 (0'0,36'5850] local-lis/les=21/22 n=221 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5848 crt=36'5848 lcod 36'5846 mlcod 36'5846 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.630 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.629+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6130 (0'0,36'6130] local-lis/les=21/22 n=424 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6130 lcod 36'6128 mlcod 36'6128 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.634 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.630+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6103 (0'0,36'6103] local-lis/les=21/22 n=364 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6103 lcod 36'6101 mlcod 36'6101 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.634 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.631+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5928 (0'0,36'5928] local-lis/les=21/22 n=345 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5928 lcod 36'5926 mlcod 36'5926 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.635 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.631+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5889 (0'0,36'5889] local-lis/les=21/22 n=383 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5888 crt=36'5884 lcod 36'5886 mlcod 36'5886 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.636 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.635+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5930 (0'0,36'5930] local-lis/les=21/22 n=343 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5928 crt=36'5928 lcod 36'5926 mlcod 36'5926 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.637 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.633+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6132 (0'0,36'6132] local-lis/les=21/22 n=422 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6130 crt=36'6130 lcod 36'6128 mlcod 36'6128 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.638 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.635+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6105 (0'0,36'6105] local-lis/les=21/22 n=362 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6103 crt=36'6103 lcod 36'6101 mlcod 36'6101 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.639 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.637+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5805 (0'0,36'5805] local-lis/les=21/22 n=345 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5805 lcod 36'5803 mlcod 36'5803 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.639 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.638+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5891 (0'0,36'5891] local-lis/les=21/22 n=381 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5888 crt=36'5888 lcod 36'5886 mlcod 36'5886 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.643 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.640+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5997 (0'0,36'5997] local-lis/les=21/22 n=379 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5995 crt=36'5995 lcod 36'5994 mlcod 36'5994 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.644 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.642+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5810 (0'0,36'5810] local-lis/les=21/22 n=298 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5810 lcod 36'5808 mlcod 36'5808 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.649 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.647+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5812 (0'0,36'5812] local-lis/les=21/22 n=296 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5810 crt=36'5810 lcod 36'5808 mlcod 36'5808 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.651 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.649+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5852 (0'0,36'5852] local-lis/les=21/22 n=219 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5852 lcod 36'5850 mlcod 36'5850 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.651 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.650+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6134 (0'0,36'6134] local-lis/les=21/22 n=420 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6134 lcod 36'6132 mlcod 36'6132 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.654 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.653+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5854 (0'0,36'5854] local-lis/les=21/22 n=217 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5852 crt=36'5852 lcod 36'5850 mlcod 36'5850 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.658 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.656+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5808 (0'0,36'5808] local-lis/les=21/22 n=342 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5807 crt=36'5805 lcod 36'5805 mlcod 36'5805 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.658 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.657+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'5999 (0'0,36'5999] local-lis/les=21/22 n=377 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'5999 lcod 36'5997 mlcod 36'5997 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.660 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.657+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6136 (0'0,36'6136] local-lis/les=21/22 n=418 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6134 crt=36'6134 lcod 36'6132 mlcod 36'6132 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.662 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.659+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5932 (0'0,36'5932] local-lis/les=21/22 n=341 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5932 lcod 36'5930 mlcod 36'5930 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.664 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.661+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6001 (0'0,36'6001] local-lis/les=21/22 n=375 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'5999 crt=36'5999 lcod 36'5997 mlcod 36'5997 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.665 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.662+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5893 (0'0,36'5893] local-lis/les=21/22 n=379 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5893 lcod 36'5891 mlcod 36'5891 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.666 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.661+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5810 (0'0,36'5810] local-lis/les=21/22 n=340 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5807 crt=36'5807 lcod 36'5805 mlcod 36'5805 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.666 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.663+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5934 (0'0,36'5934] local-lis/les=21/22 n=339 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5932 crt=36'5932 lcod 36'5930 mlcod 36'5930 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.677 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.676+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6003 (0'0,36'6003] local-lis/les=21/22 n=373 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6003 lcod 36'6001 mlcod 36'6001 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.677 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.676+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5856 (0'0,36'5856] local-lis/les=21/22 n=215 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5856 lcod 36'5854 mlcod 36'5854 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:32.679 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.677+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5814 (0'0,36'5814] local-lis/les=21/22 n=294 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5814 lcod 36'5812 mlcod 36'5812 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.685 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.682+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6005 (0'0,36'6005] local-lis/les=21/22 n=371 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6003 crt=36'6003 lcod 36'6001 mlcod 36'6001 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.686 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.683+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5812 (0'0,36'5812] local-lis/les=21/22 n=338 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5812 lcod 36'5810 mlcod 36'5810 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.686 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.683+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5936 (0'0,36'5936] local-lis/les=21/22 n=337 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5936 lcod 36'5934 mlcod 36'5934 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.686 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.685+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6108 (0'0,36'6108] local-lis/les=21/22 n=359 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6108 lcod 36'6107 mlcod 36'6107 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.687 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.684+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5858 (0'0,36'5858] local-lis/les=21/22 n=213 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5856 crt=36'5856 lcod 36'5854 mlcod 36'5854 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:32.689 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.681+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5816 (0'0,36'5816] local-lis/les=21/22 n=292 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5814 crt=36'5814 lcod 36'5812 mlcod 36'5812 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.690 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.687+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5814 (0'0,36'5814] local-lis/les=21/22 n=336 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5812 crt=36'5812 lcod 36'5810 mlcod 36'5810 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.691 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:31:32.692 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.689+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6110 (0'0,36'6110] local-lis/les=21/22 n=357 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6108 crt=36'6108 lcod 36'6107 mlcod 36'6107 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.692 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.689+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5938 (0'0,36'5938] local-lis/les=21/22 n=335 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5936 crt=36'5936 lcod 36'5934 mlcod 36'5934 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.698 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.695+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6140 (0'0,36'6140] local-lis/les=21/22 n=415 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6138 crt=36'6138 lcod 36'6136 mlcod 36'6136 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.703 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.700+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5897 (0'0,36'5897] local-lis/les=21/22 n=375 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5897 lcod 36'5896 mlcod 36'5896 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.707 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.702+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5818 (0'0,36'5818] local-lis/les=21/22 n=290 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5818 lcod 36'5816 mlcod 36'5816 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.708 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.703+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6008 (0'0,36'6008] local-lis/les=21/22 n=368 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6007 crt=36'6005 lcod 36'6005 mlcod 36'6005 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.708 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.703+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6112 (0'0,36'6112] local-lis/les=21/22 n=355 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6112 lcod 36'6110 mlcod 36'6110 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.709 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.706+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5899 (0'0,36'5899] local-lis/les=21/22 n=373 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5897 crt=36'5897 lcod 36'5896 mlcod 36'5896 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.709 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.707+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6010 (0'0,36'6010] local-lis/les=21/22 n=366 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6007 crt=36'6007 lcod 36'6005 mlcod 36'6005 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.709 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.707+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6114 (0'0,36'6114] local-lis/les=21/22 n=353 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6112 crt=36'6112 lcod 36'6110 mlcod 36'6110 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.712 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.711+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5940 (0'0,36'5940] local-lis/les=21/22 n=333 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5940 lcod 36'5938 mlcod 36'5938 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.714 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.712+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5816 (0'0,36'5816] local-lis/les=21/22 n=334 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5816 lcod 36'5814 mlcod 36'5814 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.714 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.707+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5820 (0'0,36'5820] local-lis/les=21/22 n=288 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5818 crt=36'5818 lcod 36'5816 mlcod 36'5816 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.717 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.715+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5942 (0'0,36'5942] local-lis/les=21/22 n=331 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5940 crt=36'5940 lcod 36'5938 mlcod 36'5938 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.718 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.712+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5861 (0'0,36'5861] local-lis/les=21/22 n=210 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5860 crt=36'5856 lcod 36'5858 mlcod 36'5858 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:32.719 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.715+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5863 (0'0,36'5863] local-lis/les=21/22 n=208 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5860 crt=36'5860 lcod 36'5858 mlcod 36'5858 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:32.720 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.715+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5818 (0'0,36'5818] local-lis/les=21/22 n=332 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5816 crt=36'5816 lcod 36'5814 mlcod 36'5814 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.729 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.726+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5901 (0'0,36'5901] local-lis/les=21/22 n=371 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5901 lcod 36'5899 mlcod 36'5899 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.730 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.728+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6012 (0'0,36'6012] local-lis/les=21/22 n=364 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6012 lcod 36'6010 mlcod 36'6010 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.730 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.726+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6142 (0'0,36'6142] local-lis/les=21/22 n=413 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6142 lcod 36'6140 mlcod 36'6140 active+clean+snaptrim trimq=[208~20] ps=[1fe~a]] removing snap head 2020-02-11T16:31:32.733 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.732+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6014 (0'0,36'6014] local-lis/les=21/22 n=362 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6012 crt=36'6012 lcod 36'6010 mlcod 36'6010 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.735 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.733+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5903 (0'0,36'5903] local-lis/les=21/22 n=369 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5901 crt=36'5901 lcod 36'5899 mlcod 36'5899 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.738 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.735+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5823 (0'0,36'5823] local-lis/les=21/22 n=285 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5822 crt=36'5818 lcod 36'5820 mlcod 36'5820 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.741 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.739+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5825 (0'0,36'5825] local-lis/les=21/22 n=283 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5822 crt=36'5822 lcod 36'5820 mlcod 36'5820 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.742 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.733+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6116 (0'0,36'6116] local-lis/les=21/22 n=351 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6116 lcod 36'6114 mlcod 36'6114 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.742 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.734+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5821 (0'0,36'5821] local-lis/les=21/22 n=329 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5820 crt=36'5816 lcod 36'5818 mlcod 36'5818 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.745 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.742+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5823 (0'0,36'5823] local-lis/les=21/22 n=327 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5820 crt=36'5820 lcod 36'5818 mlcod 36'5818 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.747 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.745+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6144 (0'0,36'6144] local-lis/les=21/22 n=411 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6144 lcod 36'6142 mlcod 36'6142 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.750 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.747+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5905 (0'0,36'5905] local-lis/les=21/22 n=367 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5905 lcod 36'5903 mlcod 36'5903 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.750 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.748+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5944 (0'0,36'5944] local-lis/les=21/22 n=329 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5944 lcod 36'5942 mlcod 36'5942 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.751 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.749+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6118 (0'0,36'6118] local-lis/les=21/22 n=349 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6118 lcod 36'6116 mlcod 36'6116 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.751 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.750+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6016 (0'0,36'6016] local-lis/les=21/22 n=360 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6016 lcod 36'6014 mlcod 36'6014 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.751 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.749+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5865 (0'0,36'5865] local-lis/les=21/22 n=206 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5865 lcod 36'5863 mlcod 36'5863 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:32.753 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.751+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6146 (0'0,36'6146] local-lis/les=21/22 n=409 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6144 crt=36'6144 lcod 36'6142 mlcod 36'6142 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.755 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.753+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5867 (0'0,36'5867] local-lis/les=21/22 n=204 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5865 crt=36'5865 lcod 36'5863 mlcod 36'5863 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:32.755 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.753+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6120 (0'0,36'6120] local-lis/les=21/22 n=347 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6118 crt=36'6118 lcod 36'6116 mlcod 36'6116 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.755 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.754+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6018 (0'0,36'6018] local-lis/les=21/22 n=358 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6016 crt=36'6016 lcod 36'6014 mlcod 36'6014 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.756 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.754+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5907 (0'0,36'5907] local-lis/les=21/22 n=365 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5905 crt=36'5905 lcod 36'5903 mlcod 36'5903 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.764 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.763+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5946 (0'0,36'5946] local-lis/les=21/22 n=327 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5944 crt=36'5944 lcod 36'5942 mlcod 36'5942 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.765 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.763+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5827 (0'0,36'5827] local-lis/les=21/22 n=281 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5827 lcod 36'5825 mlcod 36'5825 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.769 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.766+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6148 (0'0,36'6148] local-lis/les=21/22 n=407 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6148 lcod 36'6146 mlcod 36'6146 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.772 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.770+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5829 (0'0,36'5829] local-lis/les=21/22 n=279 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5827 crt=36'5827 lcod 36'5825 mlcod 36'5825 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.777 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.771+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6150 (0'0,36'6150] local-lis/les=21/22 n=405 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6148 crt=36'6148 lcod 36'6146 mlcod 36'6146 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.778 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.772+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6020 (0'0,36'6020] local-lis/les=21/22 n=356 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6020 lcod 36'6018 mlcod 36'6018 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.778 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.767+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5825 (0'0,36'5825] local-lis/les=21/22 n=325 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5825 lcod 36'5823 mlcod 36'5823 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.779 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.771+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5827 (0'0,36'5827] local-lis/les=21/22 n=323 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5825 crt=36'5825 lcod 36'5823 mlcod 36'5823 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.781 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.776+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6022 (0'0,36'6022] local-lis/les=21/22 n=354 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6020 crt=36'6020 lcod 36'6018 mlcod 36'6018 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.781 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.778+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6122 (0'0,36'6122] local-lis/les=21/22 n=345 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6122 lcod 36'6120 mlcod 36'6120 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.783 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.782+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6124 (0'0,36'6124] local-lis/les=21/22 n=343 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6122 crt=36'6122 lcod 36'6120 mlcod 36'6120 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.790 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.788+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5949 (0'0,36'5949] local-lis/les=21/22 n=324 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5949 lcod 36'5948 mlcod 36'5948 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.790 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.781+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5869 (0'0,36'5869] local-lis/les=21/22 n=202 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5869 lcod 36'5867 mlcod 36'5867 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:32.793 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.787+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5871 (0'0,36'5871] local-lis/les=21/22 n=200 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5869 crt=36'5869 lcod 36'5867 mlcod 36'5867 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:32.793 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.790+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6152 (0'0,36'6152] local-lis/les=21/22 n=403 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6152 lcod 36'6150 mlcod 36'6150 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.793 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.791+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5829 (0'0,36'5829] local-lis/les=21/22 n=321 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5829 lcod 36'5827 mlcod 36'5827 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.794 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.792+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5951 (0'0,36'5951] local-lis/les=21/22 n=322 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5949 crt=36'5949 lcod 36'5948 mlcod 36'5948 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.798 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.794+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6154 (0'0,36'6154] local-lis/les=21/22 n=401 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6152 crt=36'6152 lcod 36'6150 mlcod 36'6150 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.799 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.797+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6024 (0'0,36'6024] local-lis/les=21/22 n=352 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6024 lcod 36'6022 mlcod 36'6022 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.800 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.791+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5831 (0'0,36'5831] local-lis/les=21/22 n=277 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5831 lcod 36'5829 mlcod 36'5829 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.800 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.795+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5833 (0'0,36'5833] local-lis/les=21/22 n=275 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5831 crt=36'5831 lcod 36'5829 mlcod 36'5829 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.806 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.803+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5873 (0'0,36'5873] local-lis/les=21/22 n=198 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5873 lcod 36'5871 mlcod 36'5871 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.806 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.803+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6026 (0'0,36'6026] local-lis/les=21/22 n=350 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6024 crt=36'6024 lcod 36'6022 mlcod 36'6022 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.806 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.795+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5831 (0'0,36'5831] local-lis/les=21/22 n=319 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5829 crt=36'5829 lcod 36'5827 mlcod 36'5827 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.807 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.804+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5912 (0'0,36'5912] local-lis/les=21/22 n=360 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5910 crt=36'5910 lcod 36'5909 mlcod 36'5909 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.809 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.807+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5875 (0'0,36'5875] local-lis/les=21/22 n=196 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5873 crt=36'5873 lcod 36'5871 mlcod 36'5871 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.810 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.808+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5914 (0'0,36'5914] local-lis/les=21/22 n=358 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5910 crt=36'5910 lcod 36'5909 mlcod 36'5909 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.820 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.815+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6156 (0'0,36'6156] local-lis/les=21/22 n=399 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6156 lcod 36'6154 mlcod 36'6154 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.820 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.814+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6126 (0'0,36'6126] local-lis/les=21/22 n=341 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6126 lcod 36'6124 mlcod 36'6124 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.821 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.818+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6128 (0'0,36'6128] local-lis/les=21/22 n=339 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6126 crt=36'6126 lcod 36'6124 mlcod 36'6124 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.823 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.820+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6158 (0'0,36'6158] local-lis/les=21/22 n=397 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6156 crt=36'6156 lcod 36'6154 mlcod 36'6154 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.824 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.822+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5953 (0'0,36'5953] local-lis/les=21/22 n=320 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5953 lcod 36'5951 mlcod 36'5951 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.824 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.822+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5833 (0'0,36'5833] local-lis/les=21/22 n=317 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5833 lcod 36'5831 mlcod 36'5831 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.827 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.825+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5955 (0'0,36'5955] local-lis/les=21/22 n=318 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5953 crt=36'5953 lcod 36'5951 mlcod 36'5951 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.828 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.827+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5835 (0'0,36'5835] local-lis/les=21/22 n=315 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5833 crt=36'5833 lcod 36'5831 mlcod 36'5831 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.830 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.822+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5835 (0'0,36'5835] local-lis/les=21/22 n=273 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5835 lcod 36'5833 mlcod 36'5833 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.830 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.826+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5837 (0'0,36'5837] local-lis/les=21/22 n=271 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5835 crt=36'5835 lcod 36'5833 mlcod 36'5833 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.835 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.832+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6028 (0'0,36'6028] local-lis/les=21/22 n=348 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6028 lcod 36'6026 mlcod 36'6026 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.838 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.836+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6030 (0'0,36'6030] local-lis/les=21/22 n=346 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6028 crt=36'6028 lcod 36'6026 mlcod 36'6026 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.839 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.832+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5877 (0'0,36'5877] local-lis/les=21/22 n=194 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5877 lcod 36'5875 mlcod 36'5875 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.845 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.840+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5879 (0'0,36'5879] local-lis/les=21/22 n=192 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5877 crt=36'5877 lcod 36'5875 mlcod 36'5875 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.849 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.846+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5839 (0'0,36'5839] local-lis/les=21/22 n=269 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5839 lcod 36'5837 mlcod 36'5837 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.850 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.840+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6130 (0'0,36'6130] local-lis/les=21/22 n=337 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6130 lcod 36'6128 mlcod 36'6128 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.850 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.844+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6132 (0'0,36'6132] local-lis/les=21/22 n=335 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6130 crt=36'6130 lcod 36'6128 mlcod 36'6128 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.851 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.848+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5837 (0'0,36'5837] local-lis/les=21/22 n=313 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5837 lcod 36'5835 mlcod 36'5835 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.854 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.850+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5841 (0'0,36'5841] local-lis/les=21/22 n=267 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5839 crt=36'5839 lcod 36'5837 mlcod 36'5837 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.859 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.857+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6162 (0'0,36'6162] local-lis/les=21/22 n=394 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6160 crt=36'6160 lcod 36'6158 mlcod 36'6158 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.862 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.857+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5916 (0'0,36'5916] local-lis/les=21/22 n=356 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5916 lcod 36'5914 mlcod 36'5914 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.863 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.851+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5957 (0'0,36'5957] local-lis/les=21/22 n=316 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5957 lcod 36'5955 mlcod 36'5955 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.864 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.862+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6032 (0'0,36'6032] local-lis/les=21/22 n=344 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6032 lcod 36'6030 mlcod 36'6030 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.867 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.855+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5959 (0'0,36'5959] local-lis/les=21/22 n=314 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5957 crt=36'5957 lcod 36'5955 mlcod 36'5955 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.867 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.859+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5839 (0'0,36'5839] local-lis/les=21/22 n=311 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5837 crt=36'5837 lcod 36'5835 mlcod 36'5835 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.868 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.860+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5918 (0'0,36'5918] local-lis/les=21/22 n=354 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5916 crt=36'5916 lcod 36'5914 mlcod 36'5914 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.869 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.868+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6134 (0'0,36'6134] local-lis/les=21/22 n=333 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6134 lcod 36'6132 mlcod 36'6132 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.871 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.870+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6034 (0'0,36'6034] local-lis/les=21/22 n=342 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6032 crt=36'6032 lcod 36'6030 mlcod 36'6030 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.873 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.871+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6136 (0'0,36'6136] local-lis/les=21/22 n=331 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6134 crt=36'6134 lcod 36'6132 mlcod 36'6132 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.881 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.880+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5841 (0'0,36'5841] local-lis/les=21/22 n=309 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5841 lcod 36'5839 mlcod 36'5839 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.882 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.880+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5921 (0'0,36'5921] local-lis/les=21/22 n=351 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5920 crt=36'5920 lcod 36'5918 mlcod 36'5918 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.885 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.883+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5881 (0'0,36'5881] local-lis/les=21/22 n=190 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5881 lcod 36'5879 mlcod 36'5879 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.885 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.883+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6138 (0'0,36'6138] local-lis/les=21/22 n=329 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6138 lcod 36'6136 mlcod 36'6136 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.886 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.884+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5923 (0'0,36'5923] local-lis/les=21/22 n=349 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5920 crt=36'5920 lcod 36'5918 mlcod 36'5918 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.887 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.885+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5962 (0'0,36'5962] local-lis/les=21/22 n=311 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5961 crt=36'5961 lcod 36'5959 mlcod 36'5959 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.890 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.888+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6164 (0'0,36'6164] local-lis/les=21/22 n=392 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6164 lcod 36'6162 mlcod 36'6162 active+clean+snaptrim trimq=[209~1f] ps=[1fe~b]] removing snap head 2020-02-11T16:31:32.893 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.887+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5845 (0'0,36'5845] local-lis/les=21/22 n=263 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5845 lcod 36'5844 mlcod 36'5844 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.894 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.892+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5883 (0'0,36'5883] local-lis/les=21/22 n=188 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5881 crt=36'5881 lcod 36'5879 mlcod 36'5879 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.895 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.891+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5847 (0'0,36'5847] local-lis/les=21/22 n=261 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5845 crt=36'5845 lcod 36'5844 mlcod 36'5844 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.899 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.892+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6140 (0'0,36'6140] local-lis/les=21/22 n=327 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6138 crt=36'6138 lcod 36'6136 mlcod 36'6136 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.899 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.896+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6036 (0'0,36'6036] local-lis/les=21/22 n=340 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6036 lcod 36'6034 mlcod 36'6034 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.900 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.889+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5843 (0'0,36'5843] local-lis/les=21/22 n=307 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5841 crt=36'5841 lcod 36'5839 mlcod 36'5839 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.900 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.889+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5964 (0'0,36'5964] local-lis/les=21/22 n=309 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5961 crt=36'5961 lcod 36'5959 mlcod 36'5959 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.903 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.901+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6038 (0'0,36'6038] local-lis/les=21/22 n=338 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6036 crt=36'6036 lcod 36'6034 mlcod 36'6034 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.904 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.902+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6166 (0'0,36'6166] local-lis/les=21/22 n=390 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6166 lcod 36'6164 mlcod 36'6164 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.913 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.907+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6168 (0'0,36'6168] local-lis/les=21/22 n=388 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6166 crt=36'6166 lcod 36'6164 mlcod 36'6164 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.914 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.908+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6143 (0'0,36'6143] local-lis/les=21/22 n=324 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6142 crt=36'6140 lcod 36'6140 mlcod 36'6140 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.914 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.912+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5845 (0'0,36'5845] local-lis/les=21/22 n=305 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5845 lcod 36'5843 mlcod 36'5843 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.917 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.909+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5885 (0'0,36'5885] local-lis/les=21/22 n=186 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5885 lcod 36'5883 mlcod 36'5883 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.918 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.912+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5887 (0'0,36'5887] local-lis/les=21/22 n=184 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5885 crt=36'5885 lcod 36'5883 mlcod 36'5883 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.918 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.912+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6145 (0'0,36'6145] local-lis/les=21/22 n=322 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6142 crt=36'6142 lcod 36'6140 mlcod 36'6140 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.919 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.916+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5925 (0'0,36'5925] local-lis/les=21/22 n=347 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5925 lcod 36'5923 mlcod 36'5923 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.919 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.916+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5847 (0'0,36'5847] local-lis/les=21/22 n=303 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5845 crt=36'5845 lcod 36'5843 mlcod 36'5843 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.922 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.921+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5966 (0'0,36'5966] local-lis/les=21/22 n=307 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5966 lcod 36'5964 mlcod 36'5964 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.923 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.920+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5927 (0'0,36'5927] local-lis/les=21/22 n=345 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5925 crt=36'5925 lcod 36'5923 mlcod 36'5923 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.923 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.922+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6041 (0'0,36'6041] local-lis/les=21/22 n=335 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6040 crt=36'6036 lcod 36'6038 mlcod 36'6038 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.929 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.924+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5968 (0'0,36'5968] local-lis/les=21/22 n=305 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5966 crt=36'5966 lcod 36'5964 mlcod 36'5964 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.929 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.927+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5849 (0'0,36'5849] local-lis/les=21/22 n=259 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5849 lcod 36'5847 mlcod 36'5847 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.935 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.931+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6170 (0'0,36'6170] local-lis/les=21/22 n=386 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6170 lcod 36'6168 mlcod 36'6168 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.935 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.930+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6147 (0'0,36'6147] local-lis/les=21/22 n=320 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6147 lcod 36'6145 mlcod 36'6145 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.936 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.934+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6149 (0'0,36'6149] local-lis/les=21/22 n=318 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6147 crt=36'6147 lcod 36'6145 mlcod 36'6145 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.935+0000 7ff2c5176700 1 Processor -- start 2020-02-11T16:31:32.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.936+0000 7ff2c5176700 1 -- start start 2020-02-11T16:31:32.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2c5176700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2c00a3ab0 0x7ff2c00a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:32.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2c5176700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2c00a6f70 0x7ff2c0139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:32.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2c5176700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c00a4b00 con 0x7ff2c0139980 2020-02-11T16:31:32.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2c5176700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c00a75b0 con 0x7ff2c00a6f70 2020-02-11T16:31:32.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2c5176700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00a7850 con 0x7ff2c00a3ab0 2020-02-11T16:31:32.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2be59c700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7ff2c00a6f70 msgr2=0x7ff2c0139520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:32.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2be59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2c00a6f70 0x7ff2c0139520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:32.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2bf59e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff2c0139980 0x7ff2c012f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48928/0 (socket says 172.21.15.88:48928) 2020-02-11T16:31:32.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2bf59e700 1 -- 172.21.15.88:0/2001511698 learned_addr learned my addr 172.21.15.88:0/2001511698 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:32.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262442456 0 0) 0x7ff2c00a4b00 con 0x7ff2c0139980 2020-02-11T16:31:32.943 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a4003230 con 0x7ff2c0139980 2020-02-11T16:31:32.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 466282422 0 0) 0x7ff2a4003230 con 0x7ff2c0139980 2020-02-11T16:31:32.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2c00a3ab0 msgr2=0x7ff2c00a6b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:32.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2bdd9b700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2c00a3ab0 0x7ff2c00a6b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:32.944 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 >> v2:172.21.15.52:3300/0 conn(0x7ff2c00a6f70 msgr2=0x7ff2c0139520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:32.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.937+0000 7ff2bdd9b700 1 --2- 172.21.15.88:0/2001511698 >> v2:172.21.15.52:3300/0 conn(0x7ff2c00a6f70 0x7ff2c0139520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:32.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c01390f0 con 0x7ff2c0139980 2020-02-11T16:31:32.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7ff2b40016d0 con 0x7ff2c0139980 2020-02-11T16:31:32.945 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 >> v1:172.21.15.88:6789/0 conn(0x7ff2c0139980 legacy=0x7ff2c012f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:32.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bdd9b700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a4003720 0x7ff2a4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:32.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bdd9b700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2a4004060 0x7ff2a4004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:32.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bdd9b700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2a4004a50 0x7ff2a4004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:32.946 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00a75b0 con 0x7ff2a4003720 2020-02-11T16:31:32.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00a7850 con 0x7ff2a4004a50 2020-02-11T16:31:32.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a400b860 con 0x7ff2a4004060 2020-02-11T16:31:32.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bf59e700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2a4004a50 0x7ff2a4004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:32.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2be59c700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2a4004060 0x7ff2a4004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:32.947 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bf59e700 1 -- 172.21.15.88:0/2001511698 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2a4004060 msgr2=0x7ff2a4004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bf59e700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2a4004060 0x7ff2a4004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bf59e700 1 -- 172.21.15.88:0/2001511698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a4003720 msgr2=0x7ff2a4003b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bf59e700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a4003720 0x7ff2a4003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:32.948 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bf59e700 1 -- 172.21.15.88:0/2001511698 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4003230 con 0x7ff2a4004a50 2020-02-11T16:31:32.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bf59e700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2a4004a50 0x7ff2a4004ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff2b40013e0 tx=0x7ff2c00a3e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bf59e700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2a4004a50 0x7ff2a4004ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff2b40013e0 tx=0x7ff2c00a3e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.949 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bf59e700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2a4004a50 0x7ff2a4004ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7ff2b40013e0 tx=0x7ff2c00a3e90).ready entity=mon.1 client_cookie=6ba1640e32dbccb1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:32.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bf59e700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2a4004a50 0x7ff2a4004ed0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7ff2b40013e0 tx=0x7ff2c00a3e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.938+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2b400ec90 con 0x7ff2a4004a50 2020-02-11T16:31:32.950 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.939+0000 7ff2bf59e700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2a4004a50 0x7ff2a4004ed0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7ff2b40013e0 tx=0x7ff2c00a3e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.939+0000 7ff2bf59e700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2a4004a50 0x7ff2a4004ed0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7ff2b40013e0 tx=0x7ff2c00a3e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.939+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b400edf0 con 0x7ff2a4004a50 2020-02-11T16:31:32.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.939+0000 7ff2bdd9b700 1 -- 172.21.15.88:0/2001511698 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2b4010340 con 0x7ff2a4004a50 2020-02-11T16:31:32.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.939+0000 7ff2c5176700 1 -- 172.21.15.88:0/2001511698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2a4004a50 msgr2=0x7ff2a4004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:32.951 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.939+0000 7ff2c5176700 1 --2- 172.21.15.88:0/2001511698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2a4004a50 0x7ff2a4004ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7ff2b40013e0 tx=0x7ff2c00a3e90).stop 2020-02-11T16:31:32.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.939+0000 7ff2bf59e700 1 -- 172.21.15.88:0/2001511698 reap_dead start 2020-02-11T16:31:32.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.940+0000 7ff2c5176700 1 -- 172.21.15.88:0/2001511698 shutdown_connections 2020-02-11T16:31:32.952 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.940+0000 7ff2c5176700 1 -- 172.21.15.88:0/2001511698 >> 172.21.15.88:0/2001511698 conn(0x7ff2c009d110 msgr2=0x7ff2c009d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:32.953 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.939+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6172 (0'0,36'6172] local-lis/les=21/22 n=384 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6170 crt=36'6170 lcod 36'6168 mlcod 36'6168 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.953 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.939+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5889 (0'0,36'5889] local-lis/les=21/22 n=182 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5889 lcod 36'5887 mlcod 36'5887 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.954 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.939+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5851 (0'0,36'5851] local-lis/les=21/22 n=257 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5849 crt=36'5849 lcod 36'5847 mlcod 36'5847 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.955 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.947+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5930 (0'0,36'5930] local-lis/les=21/22 n=342 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5930 lcod 36'5929 mlcod 36'5929 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.955 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.942+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5891 (0'0,36'5891] local-lis/les=21/22 n=180 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5889 crt=36'5889 lcod 36'5887 mlcod 36'5887 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.955 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.947+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5849 (0'0,36'5849] local-lis/les=21/22 n=301 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5849 lcod 36'5847 mlcod 36'5847 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.956 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.951+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5970 (0'0,36'5970] local-lis/les=21/22 n=303 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5970 lcod 36'5968 mlcod 36'5968 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.956 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.951+0000 7ff2c5176700 1 -- 172.21.15.88:0/2001511698 shutdown_connections 2020-02-11T16:31:32.957 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.954+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6045 (0'0,36'6045] local-lis/les=21/22 n=332 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6045 lcod 36'6043 mlcod 36'6043 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.959 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.955+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5972 (0'0,36'5972] local-lis/les=21/22 n=301 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5970 crt=36'5970 lcod 36'5968 mlcod 36'5968 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.962 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.958+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6047 (0'0,36'6047] local-lis/les=21/22 n=330 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6045 crt=36'6045 lcod 36'6043 mlcod 36'6043 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.954+0000 7ff2c5176700 1 -- 172.21.15.88:0/2001511698 wait complete. 2020-02-11T16:31:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.956+0000 7ff2c5176700 1 Processor -- start 2020-02-11T16:31:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.956+0000 7ff2c5176700 1 -- start start 2020-02-11T16:31:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.957+0000 7ff2c5176700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2c0137c60 0x7ff2c007f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.957+0000 7ff2c5176700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2c0138040 0x7ff2c00a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.957+0000 7ff2c5176700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2c0135600 0x7ff2c00a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.957+0000 7ff2c5176700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c00a47f0 con 0x7ff2c0135600 2020-02-11T16:31:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.957+0000 7ff2c5176700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c00a4140 con 0x7ff2c0137c60 2020-02-11T16:31:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.957+0000 7ff2c5176700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0138780 con 0x7ff2c0138040 2020-02-11T16:31:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.957+0000 7ff2bf59e700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7ff2c0135600 msgr2=0x7ff2c00a1680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.957+0000 7ff2bf59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2c0135600 0x7ff2c00a1680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.958+0000 7ff2bed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2c0137c60 0x7ff2c007f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.958+0000 7ff2bed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2c0137c60 0x7ff2c007f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33080/0 (socket says 172.21.15.88:33080) 2020-02-11T16:31:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.958+0000 7ff2bed9d700 1 -- 172.21.15.88:0/4103381924 learned_addr learned my addr 172.21.15.88:0/4103381924 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.958+0000 7ff2bed9d700 1 -- 172.21.15.88:0/4103381924 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2c0138040 msgr2=0x7ff2c00a1220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.958+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2c0138040 0x7ff2c00a1220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:32.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.958+0000 7ff2bed9d700 1 -- 172.21.15.88:0/4103381924 >> v2:172.21.15.52:3300/0 conn(0x7ff2c0135600 msgr2=0x7ff2c00a1680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:32.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.958+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> v2:172.21.15.52:3300/0 conn(0x7ff2c0135600 0x7ff2c00a1680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:32.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.959+0000 7ff2bed9d700 1 -- 172.21.15.88:0/4103381924 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c00a3110 con 0x7ff2c0137c60 2020-02-11T16:31:32.966 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.959+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> v2:172.21.15.88:3300/0 conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.959+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> v2:172.21.15.88:3300/0 conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.959+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:32.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.959+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.959+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.959+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.968 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.954+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5853 (0'0,36'5853] local-lis/les=21/22 n=255 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5853 lcod 36'5851 mlcod 36'5851 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.968 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.959+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5855 (0'0,36'5855] local-lis/les=21/22 n=253 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5853 crt=36'5853 lcod 36'5851 mlcod 36'5851 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.968 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.955+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5932 (0'0,36'5932] local-lis/les=21/22 n=340 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5930 crt=36'5930 lcod 36'5929 mlcod 36'5929 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.962+0000 7ff2affff700 1 -- 172.21.15.88:0/4103381924 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2b0008690 con 0x7ff2c0137c60 2020-02-11T16:31:32.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.962+0000 7ff2affff700 1 -- 172.21.15.88:0/4103381924 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00087f0 con 0x7ff2c0137c60 2020-02-11T16:31:32.970 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.962+0000 7ff2affff700 1 -- 172.21.15.88:0/4103381924 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2b0008c10 con 0x7ff2c0137c60 2020-02-11T16:31:32.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.963+0000 7ff2c5176700 1 -- 172.21.15.88:0/4103381924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c0133d50 con 0x7ff2c0137c60 2020-02-11T16:31:32.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.963+0000 7ff2c5176700 1 -- 172.21.15.88:0/4103381924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c0134050 con 0x7ff2c0137c60 2020-02-11T16:31:32.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.964+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.964+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.964+0000 7ff2c5176700 1 -- 172.21.15.88:0/4103381924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c01341f0 con 0x7ff2c0137c60 2020-02-11T16:31:32.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.965+0000 7ff2affff700 1 -- 172.21.15.88:0/4103381924 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff2b0008d70 con 0x7ff2c0137c60 2020-02-11T16:31:32.972 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.959+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6152 (0'0,36'6152] local-lis/les=21/22 n=315 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6151 crt=36'6147 lcod 36'6149 mlcod 36'6149 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.972 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.965+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6154 (0'0,36'6154] local-lis/les=21/22 n=313 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6151 crt=36'6151 lcod 36'6149 mlcod 36'6149 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.973 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.967+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5851 (0'0,36'5851] local-lis/les=21/22 n=299 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5849 crt=36'5849 lcod 36'5847 mlcod 36'5847 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.973 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.966+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6174 (0'0,36'6174] local-lis/les=21/22 n=382 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6174 lcod 36'6172 mlcod 36'6172 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.974 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.966+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5895 (0'0,36'5895] local-lis/les=21/22 n=176 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5894 crt=36'5894 lcod 36'5893 mlcod 36'5893 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.972+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:32.975 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.973+0000 7ff2affff700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff29c039df0 0x7ff29c03c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:32.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.973+0000 7ff2affff700 1 -- 172.21.15.88:0/4103381924 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff2b0049260 con 0x7ff2c0137c60 2020-02-11T16:31:32.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.973+0000 7ff2affff700 1 -- 172.21.15.88:0/4103381924 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff2b004a690 con 0x7ff2c0137c60 2020-02-11T16:31:32.976 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.974+0000 7ff2be59c700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff29c039df0 0x7ff29c03c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:32.977 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.969+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5897 (0'0,36'5897] local-lis/les=21/22 n=174 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5894 crt=36'5894 lcod 36'5893 mlcod 36'5893 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:32.977 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.970+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6176 (0'0,36'6176] local-lis/les=21/22 n=380 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6174 crt=36'6174 lcod 36'6172 mlcod 36'6172 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.978 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:32.974+0000 7ff2be59c700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff29c039df0 0x7ff29c03c2b0 crc :-1 s=READY pgs=567 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:32.979 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.978+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5974 (0'0,36'5974] local-lis/les=21/22 n=299 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5974 lcod 36'5972 mlcod 36'5972 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.984 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.981+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5976 (0'0,36'5976] local-lis/les=21/22 n=297 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5974 crt=36'5974 lcod 36'5972 mlcod 36'5972 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.984 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.982+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5857 (0'0,36'5857] local-lis/les=21/22 n=251 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5857 lcod 36'5855 mlcod 36'5855 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.986 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.984+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5853 (0'0,36'5853] local-lis/les=21/22 n=297 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5853 lcod 36'5851 mlcod 36'5851 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.986 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.985+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5935 (0'0,36'5935] local-lis/les=21/22 n=337 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5934 crt=36'5930 lcod 36'5932 mlcod 36'5932 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.990 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:32.989+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5855 (0'0,36'5855] local-lis/les=21/22 n=295 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5853 crt=36'5853 lcod 36'5851 mlcod 36'5851 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.991 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.986+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6156 (0'0,36'6156] local-lis/les=21/22 n=311 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6156 lcod 36'6154 mlcod 36'6154 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.992 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:32.990+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5937 (0'0,36'5937] local-lis/les=21/22 n=335 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5934 crt=36'5934 lcod 36'5932 mlcod 36'5932 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.994 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.986+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6178 (0'0,36'6178] local-lis/les=21/22 n=378 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6178 lcod 36'6176 mlcod 36'6176 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.994 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:32.992+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6180 (0'0,36'6180] local-lis/les=21/22 n=376 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6178 crt=36'6178 lcod 36'6176 mlcod 36'6176 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:32.995 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.989+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6049 (0'0,36'6049] local-lis/les=21/22 n=328 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6049 lcod 36'6047 mlcod 36'6047 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:32.995 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.990+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6158 (0'0,36'6158] local-lis/les=21/22 n=309 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6156 crt=36'6156 lcod 36'6154 mlcod 36'6154 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:32.997 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:32.995+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5859 (0'0,36'5859] local-lis/les=21/22 n=249 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5857 crt=36'5857 lcod 36'5855 mlcod 36'5855 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:32.998 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:32.993+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6051 (0'0,36'6051] local-lis/les=21/22 n=326 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6049 crt=36'6049 lcod 36'6047 mlcod 36'6047 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.005 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.000+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5899 (0'0,36'5899] local-lis/les=21/22 n=172 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5899 lcod 36'5897 mlcod 36'5897 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.007 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.004+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5901 (0'0,36'5901] local-lis/les=21/22 n=170 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5899 crt=36'5899 lcod 36'5897 mlcod 36'5897 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.010 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.008+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5978 (0'0,36'5978] local-lis/les=21/22 n=295 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5978 lcod 36'5976 mlcod 36'5976 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.011 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.008+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5939 (0'0,36'5939] local-lis/les=21/22 n=333 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5939 lcod 36'5937 mlcod 36'5937 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.012 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.011+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6160 (0'0,36'6160] local-lis/les=21/22 n=307 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6160 lcod 36'6158 mlcod 36'6158 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.013 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.008+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5861 (0'0,36'5861] local-lis/les=21/22 n=247 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5861 lcod 36'5859 mlcod 36'5859 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.014 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.012+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5980 (0'0,36'5980] local-lis/les=21/22 n=293 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5978 crt=36'5978 lcod 36'5976 mlcod 36'5976 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.014 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.012+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5863 (0'0,36'5863] local-lis/les=21/22 n=245 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5861 crt=36'5861 lcod 36'5859 mlcod 36'5859 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.018 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.014+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6183 (0'0,36'6183] local-lis/les=21/22 n=373 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6182 crt=36'6178 lcod 36'6180 mlcod 36'6180 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.022 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.020+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6185 (0'0,36'6185] local-lis/les=21/22 n=371 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6182 crt=36'6182 lcod 36'6180 mlcod 36'6180 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.022 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.021+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5858 (0'0,36'5858] local-lis/les=21/22 n=292 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5858 lcod 36'5857 mlcod 36'5857 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.023 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.021+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6053 (0'0,36'6053] local-lis/les=21/22 n=324 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6053 lcod 36'6051 mlcod 36'6051 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.023 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.018+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5941 (0'0,36'5941] local-lis/les=21/22 n=331 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5939 crt=36'5939 lcod 36'5937 mlcod 36'5937 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.023 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.022+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6162 (0'0,36'6162] local-lis/les=21/22 n=305 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6160 crt=36'6160 lcod 36'6158 mlcod 36'6158 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.030 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.029+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6055 (0'0,36'6055] local-lis/les=21/22 n=322 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6053 crt=36'6053 lcod 36'6051 mlcod 36'6051 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.032 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.030+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5860 (0'0,36'5860] local-lis/les=21/22 n=290 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5858 crt=36'5858 lcod 36'5857 mlcod 36'5857 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.034 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.032+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5943 (0'0,36'5943] local-lis/les=21/22 n=329 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5943 lcod 36'5941 mlcod 36'5941 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.034 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.033+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6164 (0'0,36'6164] local-lis/les=21/22 n=303 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6164 lcod 36'6162 mlcod 36'6162 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.037 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.035+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5982 (0'0,36'5982] local-lis/les=21/22 n=291 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5982 lcod 36'5980 mlcod 36'5980 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.038 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.036+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5945 (0'0,36'5945] local-lis/les=21/22 n=327 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5943 crt=36'5943 lcod 36'5941 mlcod 36'5941 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.041 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.039+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6166 (0'0,36'6166] local-lis/les=21/22 n=301 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6164 crt=36'6164 lcod 36'6162 mlcod 36'6162 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.042 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.041+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5984 (0'0,36'5984] local-lis/les=21/22 n=289 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5982 crt=36'5982 lcod 36'5980 mlcod 36'5980 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.044 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.042+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6187 (0'0,36'6187] local-lis/les=21/22 n=369 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6187 lcod 36'6185 mlcod 36'6185 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.045 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.042+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5865 (0'0,36'5865] local-lis/les=21/22 n=243 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5865 lcod 36'5863 mlcod 36'5863 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.050 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.049+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5862 (0'0,36'5862] local-lis/les=21/22 n=288 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5862 lcod 36'5860 mlcod 36'5860 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.051 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.046+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5867 (0'0,36'5867] local-lis/les=21/22 n=241 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5865 crt=36'5865 lcod 36'5863 mlcod 36'5863 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.054 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.048+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5905 (0'0,36'5905] local-lis/les=21/22 n=166 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5903 crt=36'5903 lcod 36'5901 mlcod 36'5901 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.055 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.052+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5907 (0'0,36'5907] local-lis/les=21/22 n=164 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5903 crt=36'5903 lcod 36'5901 mlcod 36'5901 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.055 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.054+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6057 (0'0,36'6057] local-lis/les=21/22 n=320 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6057 lcod 36'6055 mlcod 36'6055 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.058 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.057+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6168 (0'0,36'6168] local-lis/les=21/22 n=299 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6168 lcod 36'6166 mlcod 36'6166 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.061 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.059+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6059 (0'0,36'6059] local-lis/les=21/22 n=318 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6057 crt=36'6057 lcod 36'6055 mlcod 36'6055 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.062 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.061+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6170 (0'0,36'6170] local-lis/les=21/22 n=297 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6168 crt=36'6168 lcod 36'6166 mlcod 36'6166 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.065 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.064+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5864 (0'0,36'5864] local-lis/les=21/22 n=286 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5862 crt=36'5862 lcod 36'5860 mlcod 36'5860 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.067 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.060+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5869 (0'0,36'5869] local-lis/les=21/22 n=239 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5869 lcod 36'5867 mlcod 36'5867 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.067 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.063+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5871 (0'0,36'5871] local-lis/les=21/22 n=237 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5869 crt=36'5869 lcod 36'5867 mlcod 36'5867 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.069 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.065+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5947 (0'0,36'5947] local-lis/les=21/22 n=325 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5947 lcod 36'5945 mlcod 36'5945 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.071 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.070+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5986 (0'0,36'5986] local-lis/les=21/22 n=287 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5986 lcod 36'5984 mlcod 36'5984 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.072 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.071+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6189 (0'0,36'6189] local-lis/les=21/22 n=367 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6187 crt=36'6187 lcod 36'6185 mlcod 36'6185 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.073 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.070+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5949 (0'0,36'5949] local-lis/les=21/22 n=323 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5947 crt=36'5947 lcod 36'5945 mlcod 36'5945 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.079 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.075+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5988 (0'0,36'5988] local-lis/les=21/22 n=285 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5986 crt=36'5986 lcod 36'5984 mlcod 36'5984 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.082 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.081+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6061 (0'0,36'6061] local-lis/les=21/22 n=316 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6061 lcod 36'6059 mlcod 36'6059 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.085 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.083+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5910 (0'0,36'5910] local-lis/les=21/22 n=161 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5910 lcod 36'5909 mlcod 36'5909 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.088 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.085+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6192 (0'0,36'6192] local-lis/les=21/22 n=364 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6191 crt=36'6189 lcod 36'6189 mlcod 36'6189 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.089 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.088+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6172 (0'0,36'6172] local-lis/les=21/22 n=295 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6172 lcod 36'6170 mlcod 36'6170 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.090 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.087+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5951 (0'0,36'5951] local-lis/les=21/22 n=321 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5951 lcod 36'5949 mlcod 36'5949 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.090 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.088+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5912 (0'0,36'5912] local-lis/les=21/22 n=159 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5910 crt=36'5910 lcod 36'5909 mlcod 36'5909 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.090 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.089+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5866 (0'0,36'5866] local-lis/les=21/22 n=284 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5866 lcod 36'5864 mlcod 36'5864 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.092 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.090+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6194 (0'0,36'6194] local-lis/les=21/22 n=362 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6191 crt=36'6191 lcod 36'6189 mlcod 36'6189 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.095 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.090+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5874 (0'0,36'5874] local-lis/les=21/22 n=234 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5873 crt=36'5873 lcod 36'5871 mlcod 36'5871 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.096 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.095+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6063 (0'0,36'6063] local-lis/les=21/22 n=314 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6061 crt=36'6061 lcod 36'6059 mlcod 36'6059 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.096 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.095+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5990 (0'0,36'5990] local-lis/les=21/22 n=283 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5990 lcod 36'5988 mlcod 36'5988 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.098 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.096+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5868 (0'0,36'5868] local-lis/les=21/22 n=282 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5866 crt=36'5866 lcod 36'5864 mlcod 36'5864 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.098 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.092+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5953 (0'0,36'5953] local-lis/les=21/22 n=319 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5951 crt=36'5951 lcod 36'5949 mlcod 36'5949 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.100 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.094+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5876 (0'0,36'5876] local-lis/les=21/22 n=232 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5873 crt=36'5873 lcod 36'5871 mlcod 36'5871 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.103 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.100+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6174 (0'0,36'6174] local-lis/les=21/22 n=293 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6172 crt=36'6172 lcod 36'6170 mlcod 36'6170 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.104 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.100+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5992 (0'0,36'5992] local-lis/les=21/22 n=281 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5990 crt=36'5990 lcod 36'5988 mlcod 36'5988 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.111 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.108+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5878 (0'0,36'5878] local-lis/les=21/22 n=230 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5878 lcod 36'5876 mlcod 36'5876 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.112 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.111+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5914 (0'0,36'5914] local-lis/les=21/22 n=157 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5914 lcod 36'5912 mlcod 36'5912 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.119 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.114+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5870 (0'0,36'5870] local-lis/les=21/22 n=280 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5870 lcod 36'5868 mlcod 36'5868 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.119 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.113+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5880 (0'0,36'5880] local-lis/les=21/22 n=228 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5878 crt=36'5878 lcod 36'5876 mlcod 36'5876 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.120 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.118+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5916 (0'0,36'5916] local-lis/les=21/22 n=155 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5914 crt=36'5914 lcod 36'5912 mlcod 36'5912 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.121 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.119+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5994 (0'0,36'5994] local-lis/les=21/22 n=279 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5994 lcod 36'5992 mlcod 36'5992 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.122 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.120+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6066 (0'0,36'6066] local-lis/les=21/22 n=311 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6065 crt=36'6065 lcod 36'6063 mlcod 36'6063 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.125 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.123+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5996 (0'0,36'5996] local-lis/les=21/22 n=277 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5994 crt=36'5994 lcod 36'5992 mlcod 36'5992 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.125 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.122+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6177 (0'0,36'6177] local-lis/les=21/22 n=290 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6176 crt=36'6176 lcod 36'6174 mlcod 36'6174 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.127 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.126+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6068 (0'0,36'6068] local-lis/les=21/22 n=309 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6065 crt=36'6065 lcod 36'6063 mlcod 36'6063 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.129 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.127+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6179 (0'0,36'6179] local-lis/les=21/22 n=288 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6176 crt=36'6176 lcod 36'6174 mlcod 36'6174 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.129 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.128+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5872 (0'0,36'5872] local-lis/les=21/22 n=278 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5870 crt=36'5870 lcod 36'5868 mlcod 36'5868 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.131 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.128+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5955 (0'0,36'5955] local-lis/les=21/22 n=317 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5955 lcod 36'5953 mlcod 36'5953 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.134 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.132+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5957 (0'0,36'5957] local-lis/les=21/22 n=315 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5955 crt=36'5955 lcod 36'5953 mlcod 36'5953 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.134 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.131+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6196 (0'0,36'6196] local-lis/les=21/22 n=360 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6196 lcod 36'6194 mlcod 36'6194 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.137 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.135+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6198 (0'0,36'6198] local-lis/les=21/22 n=358 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6196 crt=36'6196 lcod 36'6194 mlcod 36'6194 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.139 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.138+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5918 (0'0,36'5918] local-lis/les=21/22 n=153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5918 lcod 36'5916 mlcod 36'5916 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.146 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.145+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'5998 (0'0,36'5998] local-lis/les=21/22 n=275 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'5998 lcod 36'5996 mlcod 36'5996 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.147 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.146+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5920 (0'0,36'5920] local-lis/les=21/22 n=151 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5918 crt=36'5918 lcod 36'5916 mlcod 36'5916 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.149 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.146+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6070 (0'0,36'6070] local-lis/les=21/22 n=307 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6070 lcod 36'6068 mlcod 36'6068 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.150 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.148+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6000 (0'0,36'6000] local-lis/les=21/22 n=273 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'5998 crt=36'5998 lcod 36'5996 mlcod 36'5996 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.152 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.150+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6072 (0'0,36'6072] local-lis/les=21/22 n=305 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6070 crt=36'6070 lcod 36'6068 mlcod 36'6068 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.155 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.150+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5882 (0'0,36'5882] local-lis/les=21/22 n=226 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5882 lcod 36'5880 mlcod 36'5880 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.155 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.154+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5874 (0'0,36'5874] local-lis/les=21/22 n=276 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5874 lcod 36'5872 mlcod 36'5872 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.158 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.156+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6200 (0'0,36'6200] local-lis/les=21/22 n=356 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6200 lcod 36'6198 mlcod 36'6198 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.159 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.156+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6181 (0'0,36'6181] local-lis/les=21/22 n=286 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6181 lcod 36'6179 mlcod 36'6179 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.159 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.157+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5876 (0'0,36'5876] local-lis/les=21/22 n=274 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5874 crt=36'5874 lcod 36'5872 mlcod 36'5872 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.160 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.158+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5960 (0'0,36'5960] local-lis/les=21/22 n=312 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5959 crt=36'5955 lcod 36'5957 mlcod 36'5957 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.165 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.161+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6183 (0'0,36'6183] local-lis/les=21/22 n=284 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6181 crt=36'6181 lcod 36'6179 mlcod 36'6179 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.165 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.163+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5923 (0'0,36'5923] local-lis/les=21/22 n=148 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5922 crt=36'5920 lcod 36'5920 mlcod 36'5920 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.168 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.163+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5962 (0'0,36'5962] local-lis/les=21/22 n=310 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5959 crt=36'5959 lcod 36'5957 mlcod 36'5957 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.169 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.164+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5884 (0'0,36'5884] local-lis/les=21/22 n=224 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5882 crt=36'5882 lcod 36'5880 mlcod 36'5880 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.171 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.168+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5925 (0'0,36'5925] local-lis/les=21/22 n=146 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5922 crt=36'5922 lcod 36'5920 mlcod 36'5920 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.178 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.173+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6076 (0'0,36'6076] local-lis/les=21/22 n=302 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6074 crt=36'6074 lcod 36'6072 mlcod 36'6072 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.183 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.181+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6003 (0'0,36'6003] local-lis/les=21/22 n=270 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6002 crt=36'6002 lcod 36'6000 mlcod 36'6000 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.183 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.181+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5886 (0'0,36'5886] local-lis/les=21/22 n=222 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5886 lcod 36'5884 mlcod 36'5884 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.187 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.185+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5888 (0'0,36'5888] local-lis/les=21/22 n=220 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5886 crt=36'5886 lcod 36'5884 mlcod 36'5884 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.187 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.185+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5964 (0'0,36'5964] local-lis/les=21/22 n=308 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5964 lcod 36'5962 mlcod 36'5962 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.188 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.185+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6204 (0'0,36'6204] local-lis/les=21/22 n=353 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6204 lcod 36'6202 mlcod 36'6202 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.188 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.187+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5878 (0'0,36'5878] local-lis/les=21/22 n=272 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5878 lcod 36'5876 mlcod 36'5876 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.191 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.189+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6185 (0'0,36'6185] local-lis/les=21/22 n=282 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6185 lcod 36'6183 mlcod 36'6183 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.191 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.190+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6206 (0'0,36'6206] local-lis/les=21/22 n=351 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6204 crt=36'6204 lcod 36'6202 mlcod 36'6202 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.195 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.192+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5927 (0'0,36'5927] local-lis/les=21/22 n=144 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5927 lcod 36'5925 mlcod 36'5925 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.196 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.194+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6005 (0'0,36'6005] local-lis/les=21/22 n=268 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6002 crt=36'6002 lcod 36'6000 mlcod 36'6000 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.196 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.194+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5880 (0'0,36'5880] local-lis/les=21/22 n=270 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5878 crt=36'5878 lcod 36'5876 mlcod 36'5876 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.197 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.196+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6187 (0'0,36'6187] local-lis/les=21/22 n=280 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6185 crt=36'6185 lcod 36'6183 mlcod 36'6183 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.199 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.196+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5966 (0'0,36'5966] local-lis/les=21/22 n=306 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5964 crt=36'5964 lcod 36'5962 mlcod 36'5962 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.199 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.197+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5929 (0'0,36'5929] local-lis/les=21/22 n=142 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5927 crt=36'5927 lcod 36'5925 mlcod 36'5925 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.211 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.206+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5890 (0'0,36'5890] local-lis/les=21/22 n=218 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5890 lcod 36'5888 mlcod 36'5888 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.212 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.210+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6080 (0'0,36'6080] local-lis/les=21/22 n=298 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6079 crt=36'6079 lcod 36'6078 mlcod 36'6078 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.213 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.211+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6189 (0'0,36'6189] local-lis/les=21/22 n=278 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6189 lcod 36'6187 mlcod 36'6187 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.216 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.214+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5968 (0'0,36'5968] local-lis/les=21/22 n=304 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5968 lcod 36'5966 mlcod 36'5966 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.217 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.216+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5892 (0'0,36'5892] local-lis/les=21/22 n=216 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5890 crt=36'5890 lcod 36'5888 mlcod 36'5888 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.218 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.215+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6007 (0'0,36'6007] local-lis/les=21/22 n=266 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6007 lcod 36'6005 mlcod 36'6005 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.221 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.219+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6191 (0'0,36'6191] local-lis/les=21/22 n=276 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6189 crt=36'6189 lcod 36'6187 mlcod 36'6187 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.221 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.219+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6009 (0'0,36'6009] local-lis/les=21/22 n=264 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6007 crt=36'6007 lcod 36'6005 mlcod 36'6005 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.222 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.220+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5931 (0'0,36'5931] local-lis/les=21/22 n=140 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5931 lcod 36'5929 mlcod 36'5929 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.223 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.218+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5970 (0'0,36'5970] local-lis/les=21/22 n=302 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5968 crt=36'5968 lcod 36'5966 mlcod 36'5966 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.225 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.224+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6208 (0'0,36'6208] local-lis/les=21/22 n=349 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6208 lcod 36'6206 mlcod 36'6206 active+clean+snaptrim trimq=[20a~1e] ps=[1fe~c]] removing snap head 2020-02-11T16:31:33.229 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.227+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5933 (0'0,36'5933] local-lis/les=21/22 n=138 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5931 crt=36'5931 lcod 36'5929 mlcod 36'5929 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.232 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.231+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6083 (0'0,36'6083] local-lis/les=21/22 n=295 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6083 lcod 36'6082 mlcod 36'6082 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.237 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.235+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5883 (0'0,36'5883] local-lis/les=21/22 n=267 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5883 lcod 36'5882 mlcod 36'5882 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.238 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.236+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6085 (0'0,36'6085] local-lis/les=21/22 n=293 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6083 crt=36'6083 lcod 36'6082 mlcod 36'6082 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.239 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.237+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6193 (0'0,36'6193] local-lis/les=21/22 n=274 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6193 lcod 36'6191 mlcod 36'6191 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.239 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.236+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5895 (0'0,36'5895] local-lis/les=21/22 n=213 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5894 crt=36'5890 lcod 36'5892 mlcod 36'5892 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.239 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.237+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5972 (0'0,36'5972] local-lis/les=21/22 n=300 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5972 lcod 36'5970 mlcod 36'5970 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.242 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.239+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5885 (0'0,36'5885] local-lis/les=21/22 n=265 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5883 crt=36'5883 lcod 36'5882 mlcod 36'5882 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.243 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.241+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6195 (0'0,36'6195] local-lis/les=21/22 n=272 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6193 crt=36'6193 lcod 36'6191 mlcod 36'6191 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.246 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.243+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5897 (0'0,36'5897] local-lis/les=21/22 n=211 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5894 crt=36'5894 lcod 36'5892 mlcod 36'5892 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.248 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.247+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6012 (0'0,36'6012] local-lis/les=21/22 n=261 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6011 crt=36'6011 lcod 36'6009 mlcod 36'6009 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.250 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.247+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6210 (0'0,36'6210] local-lis/les=21/22 n=347 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6210 lcod 36'6208 mlcod 36'6208 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.252 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.248+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5935 (0'0,36'5935] local-lis/les=21/22 n=136 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5935 lcod 36'5933 mlcod 36'5933 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.253 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.247+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5974 (0'0,36'5974] local-lis/les=21/22 n=298 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5972 crt=36'5972 lcod 36'5970 mlcod 36'5970 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.253 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.251+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6014 (0'0,36'6014] local-lis/les=21/22 n=259 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6011 crt=36'6011 lcod 36'6009 mlcod 36'6009 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.253 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.251+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6212 (0'0,36'6212] local-lis/les=21/22 n=345 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6210 crt=36'6210 lcod 36'6208 mlcod 36'6208 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.253 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.251+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5937 (0'0,36'5937] local-lis/les=21/22 n=134 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5935 crt=36'5935 lcod 36'5933 mlcod 36'5933 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.265 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.261+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6197 (0'0,36'6197] local-lis/les=21/22 n=270 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6197 lcod 36'6195 mlcod 36'6195 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.267 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.263+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5887 (0'0,36'5887] local-lis/les=21/22 n=263 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5887 lcod 36'5885 mlcod 36'5885 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.268 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.267+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6087 (0'0,36'6087] local-lis/les=21/22 n=291 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6087 lcod 36'6085 mlcod 36'6085 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.271 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.267+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5889 (0'0,36'5889] local-lis/les=21/22 n=261 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5887 crt=36'5887 lcod 36'5885 mlcod 36'5885 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.271 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.269+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5976 (0'0,36'5976] local-lis/les=21/22 n=296 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5976 lcod 36'5974 mlcod 36'5974 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.272 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.270+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6089 (0'0,36'6089] local-lis/les=21/22 n=289 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6087 crt=36'6087 lcod 36'6085 mlcod 36'6085 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.275 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.273+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5899 (0'0,36'5899] local-lis/les=21/22 n=209 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5899 lcod 36'5897 mlcod 36'5897 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.275 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.273+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5978 (0'0,36'5978] local-lis/les=21/22 n=294 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5976 crt=36'5976 lcod 36'5974 mlcod 36'5974 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.281 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.280+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5901 (0'0,36'5901] local-lis/les=21/22 n=207 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5899 crt=36'5899 lcod 36'5897 mlcod 36'5897 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.284 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.283+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5891 (0'0,36'5891] local-lis/les=21/22 n=259 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5891 lcod 36'5889 mlcod 36'5889 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.284 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.283+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6016 (0'0,36'6016] local-lis/les=21/22 n=257 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6016 lcod 36'6014 mlcod 36'6014 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.286 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.283+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5941 (0'0,36'5941] local-lis/les=21/22 n=130 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5939 crt=36'5939 lcod 36'5937 mlcod 36'5937 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.289 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.287+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5943 (0'0,36'5943] local-lis/les=21/22 n=128 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5939 crt=36'5939 lcod 36'5937 mlcod 36'5937 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.290 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.286+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6018 (0'0,36'6018] local-lis/les=21/22 n=255 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6016 crt=36'6016 lcod 36'6014 mlcod 36'6014 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.291 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.290+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6214 (0'0,36'6214] local-lis/les=21/22 n=343 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6214 lcod 36'6212 mlcod 36'6212 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.294 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.292+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5893 (0'0,36'5893] local-lis/les=21/22 n=257 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5891 crt=36'5891 lcod 36'5889 mlcod 36'5889 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.296 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.294+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6216 (0'0,36'6216] local-lis/les=21/22 n=341 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6214 crt=36'6214 lcod 36'6212 mlcod 36'6212 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.296 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.294+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5903 (0'0,36'5903] local-lis/les=21/22 n=205 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5903 lcod 36'5901 mlcod 36'5901 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.299 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.288+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6199 (0'0,36'6199] local-lis/les=21/22 n=268 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6199 lcod 36'6197 mlcod 36'6197 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.301 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.298+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5905 (0'0,36'5905] local-lis/les=21/22 n=203 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5903 crt=36'5903 lcod 36'5901 mlcod 36'5901 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.301 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.292+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6201 (0'0,36'6201] local-lis/les=21/22 n=266 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6199 crt=36'6199 lcod 36'6197 mlcod 36'6197 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.301 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.294+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6091 (0'0,36'6091] local-lis/les=21/22 n=287 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6091 lcod 36'6089 mlcod 36'6089 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.301 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.298+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6093 (0'0,36'6093] local-lis/les=21/22 n=285 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6091 crt=36'6091 lcod 36'6089 mlcod 36'6089 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.305 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.303+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5980 (0'0,36'5980] local-lis/les=21/22 n=292 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5980 lcod 36'5978 mlcod 36'5978 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.310 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.309+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5895 (0'0,36'5895] local-lis/les=21/22 n=255 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5895 lcod 36'5893 mlcod 36'5893 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.312 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.309+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5982 (0'0,36'5982] local-lis/les=21/22 n=290 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5980 crt=36'5980 lcod 36'5978 mlcod 36'5978 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.313 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.312+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5897 (0'0,36'5897] local-lis/les=21/22 n=253 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5895 crt=36'5895 lcod 36'5893 mlcod 36'5893 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.315 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.313+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6203 (0'0,36'6203] local-lis/les=21/22 n=264 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6203 lcod 36'6201 mlcod 36'6201 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.319 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.314+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6218 (0'0,36'6218] local-lis/les=21/22 n=339 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6218 lcod 36'6216 mlcod 36'6216 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.322 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.316+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6095 (0'0,36'6095] local-lis/les=21/22 n=283 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6095 lcod 36'6093 mlcod 36'6093 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.323 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.317+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6205 (0'0,36'6205] local-lis/les=21/22 n=262 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6203 crt=36'6203 lcod 36'6201 mlcod 36'6201 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.323 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.321+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5907 (0'0,36'5907] local-lis/les=21/22 n=201 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5907 lcod 36'5905 mlcod 36'5905 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.326 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.325+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5909 (0'0,36'5909] local-lis/les=21/22 n=199 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5907 crt=36'5907 lcod 36'5905 mlcod 36'5905 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.328 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.326+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5945 (0'0,36'5945] local-lis/les=21/22 n=126 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5945 lcod 36'5943 mlcod 36'5943 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.329 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.327+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6097 (0'0,36'6097] local-lis/les=21/22 n=281 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6095 crt=36'6095 lcod 36'6093 mlcod 36'6093 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.342 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.336+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5947 (0'0,36'5947] local-lis/les=21/22 n=124 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5945 crt=36'5945 lcod 36'5943 mlcod 36'5943 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.342 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.338+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6207 (0'0,36'6207] local-lis/les=21/22 n=260 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6207 lcod 36'6205 mlcod 36'6205 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.343 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.339+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5911 (0'0,36'5911] local-lis/les=21/22 n=197 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5911 lcod 36'5909 mlcod 36'5909 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.343 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.342+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6220 (0'0,36'6220] local-lis/les=21/22 n=337 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6218 crt=36'6218 lcod 36'6216 mlcod 36'6216 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.344 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.340+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5984 (0'0,36'5984] local-lis/les=21/22 n=288 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5984 lcod 36'5982 mlcod 36'5982 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.345 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.343+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5913 (0'0,36'5913] local-lis/les=21/22 n=195 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5911 crt=36'5911 lcod 36'5909 mlcod 36'5909 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.347 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.346+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6209 (0'0,36'6209] local-lis/les=21/22 n=258 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6207 crt=36'6207 lcod 36'6205 mlcod 36'6205 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.348 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.344+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5986 (0'0,36'5986] local-lis/les=21/22 n=286 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5984 crt=36'5984 lcod 36'5982 mlcod 36'5982 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.354 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.351+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6099 (0'0,36'6099] local-lis/les=21/22 n=279 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6099 lcod 36'6097 mlcod 36'6097 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.355 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.347+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6021 (0'0,36'6021] local-lis/les=21/22 n=252 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6021 lcod 36'6020 mlcod 36'6020 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.358 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.354+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5950 (0'0,36'5950] local-lis/les=21/22 n=121 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5949 crt=36'5945 lcod 36'5947 mlcod 36'5947 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.360 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.358+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6101 (0'0,36'6101] local-lis/les=21/22 n=277 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6099 crt=36'6099 lcod 36'6097 mlcod 36'6097 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.365 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.362+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6212 (0'0,36'6212] local-lis/les=21/22 n=255 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6211 crt=36'6207 lcod 36'6209 mlcod 36'6209 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.365 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.355+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5900 (0'0,36'5900] local-lis/les=21/22 n=250 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5900 lcod 36'5899 mlcod 36'5899 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.365 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.355+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6023 (0'0,36'6023] local-lis/les=21/22 n=250 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6021 crt=36'6021 lcod 36'6020 mlcod 36'6020 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.366 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.362+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6222 (0'0,36'6222] local-lis/les=21/22 n=335 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6222 lcod 36'6220 mlcod 36'6220 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.366 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.362+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5952 (0'0,36'5952] local-lis/les=21/22 n=119 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5949 crt=36'5949 lcod 36'5947 mlcod 36'5947 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.367 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.362+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5988 (0'0,36'5988] local-lis/les=21/22 n=284 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5988 lcod 36'5986 mlcod 36'5986 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.368 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.366+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5990 (0'0,36'5990] local-lis/les=21/22 n=282 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5988 crt=36'5988 lcod 36'5986 mlcod 36'5986 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.372 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.365+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5902 (0'0,36'5902] local-lis/les=21/22 n=248 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5900 crt=36'5900 lcod 36'5899 mlcod 36'5899 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.375 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.370+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6025 (0'0,36'6025] local-lis/les=21/22 n=248 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6025 lcod 36'6023 mlcod 36'6023 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.375 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.370+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6224 (0'0,36'6224] local-lis/les=21/22 n=333 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6222 crt=36'6222 lcod 36'6220 mlcod 36'6220 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.376 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.374+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6027 (0'0,36'6027] local-lis/les=21/22 n=246 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6025 crt=36'6025 lcod 36'6023 mlcod 36'6023 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.377 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.374+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6214 (0'0,36'6214] local-lis/les=21/22 n=253 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6211 crt=36'6211 lcod 36'6209 mlcod 36'6209 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.380 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.378+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5954 (0'0,36'5954] local-lis/les=21/22 n=117 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5954 lcod 36'5952 mlcod 36'5952 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.382 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.379+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5915 (0'0,36'5915] local-lis/les=21/22 n=193 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5915 lcod 36'5913 mlcod 36'5913 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.386 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.384+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5904 (0'0,36'5904] local-lis/les=21/22 n=246 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5904 lcod 36'5902 mlcod 36'5902 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.387 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.382+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5956 (0'0,36'5956] local-lis/les=21/22 n=115 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5954 crt=36'5954 lcod 36'5952 mlcod 36'5952 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.389 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.386+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5917 (0'0,36'5917] local-lis/les=21/22 n=191 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5915 crt=36'5915 lcod 36'5913 mlcod 36'5913 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.391 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.389+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5992 (0'0,36'5992] local-lis/les=21/22 n=280 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5992 lcod 36'5990 mlcod 36'5990 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.394 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.389+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5906 (0'0,36'5906] local-lis/les=21/22 n=244 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5904 crt=36'5904 lcod 36'5902 mlcod 36'5902 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.395 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.393+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6226 (0'0,36'6226] local-lis/les=21/22 n=331 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6226 lcod 36'6224 mlcod 36'6224 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.398 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.395+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5994 (0'0,36'5994] local-lis/les=21/22 n=278 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5992 crt=36'5992 lcod 36'5990 mlcod 36'5990 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.399 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.396+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6228 (0'0,36'6228] local-lis/les=21/22 n=329 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6226 crt=36'6226 lcod 36'6224 mlcod 36'6224 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.407 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.403+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5919 (0'0,36'5919] local-lis/les=21/22 n=189 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5919 lcod 36'5917 mlcod 36'5917 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.408 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.397+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6216 (0'0,36'6216] local-lis/les=21/22 n=251 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6216 lcod 36'6214 mlcod 36'6214 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.408 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.399+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6107 (0'0,36'6107] local-lis/les=21/22 n=272 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6103 crt=36'6103 lcod 36'6101 mlcod 36'6101 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.406+0000 7ff2c5176700 1 -- 172.21.15.88:0/4103381924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff2c00565b0 con 0x7ff2c0137c60 2020-02-11T16:31:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.407+0000 7ff2bed9d700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.407+0000 7ff2affff700 1 -- 172.21.15.88:0/4103381924 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7ff2b002e8a0 con 0x7ff2c0137c60 2020-02-11T16:31:33.410 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":216,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:33.412 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.408+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6029 (0'0,36'6029] local-lis/les=21/22 n=244 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6029 lcod 36'6027 mlcod 36'6027 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.412 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.408+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5921 (0'0,36'5921] local-lis/les=21/22 n=187 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5919 crt=36'5919 lcod 36'5917 mlcod 36'5917 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.413 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.409+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5958 (0'0,36'5958] local-lis/les=21/22 n=113 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5958 lcod 36'5956 mlcod 36'5956 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.409+0000 7ff2c5176700 1 -- 172.21.15.88:0/4103381924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff29c039df0 msgr2=0x7ff29c03c2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.409+0000 7ff2c5176700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff29c039df0 0x7ff29c03c2b0 crc :-1 s=READY pgs=567 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.409+0000 7ff2c5176700 1 -- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 msgr2=0x7ff2c007f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:33.414 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.409+0000 7ff2c5176700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 0x7ff2c007f400 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7ff2b0002f10 tx=0x7ff2b0010900).stop 2020-02-11T16:31:33.414 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.408+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6218 (0'0,36'6218] local-lis/les=21/22 n=249 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6216 crt=36'6216 lcod 36'6214 mlcod 36'6214 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.422 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.414+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5960 (0'0,36'5960] local-lis/les=21/22 n=111 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5958 crt=36'5958 lcod 36'5956 mlcod 36'5956 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.423 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.414+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6230 (0'0,36'6230] local-lis/les=21/22 n=327 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6230 lcod 36'6228 mlcod 36'6228 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.423 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.419+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6232 (0'0,36'6232] local-lis/les=21/22 n=325 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6230 crt=36'6230 lcod 36'6228 mlcod 36'6228 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.423 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.417+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6031 (0'0,36'6031] local-lis/les=21/22 n=242 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6029 crt=36'6029 lcod 36'6027 mlcod 36'6027 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.423 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.413+0000 7ff2c5176700 1 -- 172.21.15.88:0/4103381924 shutdown_connections 2020-02-11T16:31:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.413+0000 7ff2c5176700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff29c039df0 0x7ff29c03c2b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.413+0000 7ff2c5176700 1 --2- 172.21.15.88:0/4103381924 >> v2:172.21.15.52:3300/0 conn(0x7ff2c0135600 0x7ff2c00a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.413+0000 7ff2c5176700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c0137c60 0x7ff2c007f400 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.413+0000 7ff2c5176700 1 --2- 172.21.15.88:0/4103381924 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2c0138040 0x7ff2c00a1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.413+0000 7ff2c5176700 1 -- 172.21.15.88:0/4103381924 >> 172.21.15.88:0/4103381924 conn(0x7ff2c009d110 msgr2=0x7ff2c0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.414+0000 7ff2c5176700 1 -- 172.21.15.88:0/4103381924 shutdown_connections 2020-02-11T16:31:33.424 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:33.414+0000 7ff2c5176700 1 -- 172.21.15.88:0/4103381924 wait complete. 2020-02-11T16:31:33.425 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.419+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6109 (0'0,36'6109] local-lis/les=21/22 n=270 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6109 lcod 36'6107 mlcod 36'6107 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.425 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.422+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5908 (0'0,36'5908] local-lis/les=21/22 n=242 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5908 lcod 36'5906 mlcod 36'5906 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.426 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.423+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6111 (0'0,36'6111] local-lis/les=21/22 n=268 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6109 crt=36'6109 lcod 36'6107 mlcod 36'6107 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.427 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.425+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5924 (0'0,36'5924] local-lis/les=21/22 n=184 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5923 crt=36'5921 lcod 36'5921 mlcod 36'5921 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.427 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.426+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5996 (0'0,36'5996] local-lis/les=21/22 n=276 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'5996 lcod 36'5994 mlcod 36'5994 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.431 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.429+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5963 (0'0,36'5963] local-lis/les=21/22 n=108 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5962 crt=36'5960 lcod 36'5960 mlcod 36'5960 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.433 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.432+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6033 (0'0,36'6033] local-lis/les=21/22 n=240 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6033 lcod 36'6031 mlcod 36'6031 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.437 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.433+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'5998 (0'0,36'5998] local-lis/les=21/22 n=274 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'5996 crt=36'5996 lcod 36'5994 mlcod 36'5994 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.438 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.436+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6220 (0'0,36'6220] local-lis/les=21/22 n=247 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6220 lcod 36'6218 mlcod 36'6218 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.441 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.435+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6035 (0'0,36'6035] local-lis/les=21/22 n=238 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6033 crt=36'6033 lcod 36'6031 mlcod 36'6031 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.441 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.429+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5926 (0'0,36'5926] local-lis/les=21/22 n=182 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5923 crt=36'5923 lcod 36'5921 mlcod 36'5921 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.442 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.440+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6234 (0'0,36'6234] local-lis/les=21/22 n=323 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6234 lcod 36'6232 mlcod 36'6232 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.443 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.440+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6222 (0'0,36'6222] local-lis/les=21/22 n=245 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6220 crt=36'6220 lcod 36'6218 mlcod 36'6218 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.444 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":216,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:33.444 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.441+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5910 (0'0,36'5910] local-lis/les=21/22 n=240 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5908 crt=36'5908 lcod 36'5906 mlcod 36'5906 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.448 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.443+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5965 (0'0,36'5965] local-lis/les=21/22 n=106 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5962 crt=36'5962 lcod 36'5960 mlcod 36'5960 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.450 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.447+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6113 (0'0,36'6113] local-lis/les=21/22 n=266 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6113 lcod 36'6111 mlcod 36'6111 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.450 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.448+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6236 (0'0,36'6236] local-lis/les=21/22 n=321 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6234 crt=36'6234 lcod 36'6232 mlcod 36'6232 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.454 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.451+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6115 (0'0,36'6115] local-lis/les=21/22 n=264 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6113 crt=36'6113 lcod 36'6111 mlcod 36'6111 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.459 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.458+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6038 (0'0,36'6038] local-lis/les=21/22 n=235 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6038 lcod 36'6037 mlcod 36'6037 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.460 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.458+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5967 (0'0,36'5967] local-lis/les=21/22 n=104 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5967 lcod 36'5965 mlcod 36'5965 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.460 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.456+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6000 (0'0,36'6000] local-lis/les=21/22 n=272 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6000 lcod 36'5998 mlcod 36'5998 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.461 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.459+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5912 (0'0,36'5912] local-lis/les=21/22 n=238 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5912 lcod 36'5910 mlcod 36'5910 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.465 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.461+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5969 (0'0,36'5969] local-lis/les=21/22 n=102 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5967 crt=36'5967 lcod 36'5965 mlcod 36'5965 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.465 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.463+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5914 (0'0,36'5914] local-lis/les=21/22 n=236 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5912 crt=36'5912 lcod 36'5910 mlcod 36'5910 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.466 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.462+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5928 (0'0,36'5928] local-lis/les=21/22 n=180 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5928 lcod 36'5926 mlcod 36'5926 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.466 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.460+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6002 (0'0,36'6002] local-lis/les=21/22 n=270 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6000 crt=36'6000 lcod 36'5998 mlcod 36'5998 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.468 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.466+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5930 (0'0,36'5930] local-lis/les=21/22 n=178 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5928 crt=36'5928 lcod 36'5926 mlcod 36'5926 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.470 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.468+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6224 (0'0,36'6224] local-lis/les=21/22 n=243 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6224 lcod 36'6222 mlcod 36'6222 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.473 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.471+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6240 (0'0,36'6240] local-lis/les=21/22 n=318 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6238 crt=36'6238 lcod 36'6236 mlcod 36'6236 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.474 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.470+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6040 (0'0,36'6040] local-lis/les=21/22 n=233 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6038 crt=36'6038 lcod 36'6037 mlcod 36'6037 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.489 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.482+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6226 (0'0,36'6226] local-lis/les=21/22 n=241 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6226 lcod 36'6224 mlcod 36'6224 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.492 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.484+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6004 (0'0,36'6004] local-lis/les=21/22 n=268 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6004 lcod 36'6002 mlcod 36'6002 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.498 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.485+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5916 (0'0,36'5916] local-lis/les=21/22 n=234 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5916 lcod 36'5914 mlcod 36'5914 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.499 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.484+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5932 (0'0,36'5932] local-lis/les=21/22 n=176 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5932 lcod 36'5930 mlcod 36'5930 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.500 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.489+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5972 (0'0,36'5972] local-lis/les=21/22 n=99 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5972 lcod 36'5971 mlcod 36'5971 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.500 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.488+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6118 (0'0,36'6118] local-lis/les=21/22 n=261 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6118 lcod 36'6117 mlcod 36'6117 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.501 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.488+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6006 (0'0,36'6006] local-lis/les=21/22 n=266 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6004 crt=36'6004 lcod 36'6002 mlcod 36'6002 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.502 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.489+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6228 (0'0,36'6228] local-lis/les=21/22 n=239 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6226 crt=36'6226 lcod 36'6224 mlcod 36'6224 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.502 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.492+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6120 (0'0,36'6120] local-lis/les=21/22 n=259 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6118 crt=36'6118 lcod 36'6117 mlcod 36'6117 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.505 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.495+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5974 (0'0,36'5974] local-lis/les=21/22 n=97 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5972 crt=36'5972 lcod 36'5971 mlcod 36'5971 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.507 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.498+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6242 (0'0,36'6242] local-lis/les=21/22 n=316 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6242 lcod 36'6240 mlcod 36'6240 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.509 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.498+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6042 (0'0,36'6042] local-lis/les=21/22 n=231 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6042 lcod 36'6040 mlcod 36'6040 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.510 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.500+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5934 (0'0,36'5934] local-lis/les=21/22 n=174 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5932 crt=36'5932 lcod 36'5930 mlcod 36'5930 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.514 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.504+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6244 (0'0,36'6244] local-lis/les=21/22 n=314 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6242 crt=36'6242 lcod 36'6240 mlcod 36'6240 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.516 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.508+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5918 (0'0,36'5918] local-lis/les=21/22 n=232 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5918 lcod 36'5916 mlcod 36'5916 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.520 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.506+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6230 (0'0,36'6230] local-lis/les=21/22 n=237 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6230 lcod 36'6228 mlcod 36'6228 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.520 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.509+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6122 (0'0,36'6122] local-lis/les=21/22 n=257 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6122 lcod 36'6120 mlcod 36'6120 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.520 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.510+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6232 (0'0,36'6232] local-lis/les=21/22 n=235 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6230 crt=36'6230 lcod 36'6228 mlcod 36'6228 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.521 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.512+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5920 (0'0,36'5920] local-lis/les=21/22 n=230 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5918 crt=36'5918 lcod 36'5916 mlcod 36'5916 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.523 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.514+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6124 (0'0,36'6124] local-lis/les=21/22 n=255 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6122 crt=36'6122 lcod 36'6120 mlcod 36'6120 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.525 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.517+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5976 (0'0,36'5976] local-lis/les=21/22 n=95 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5976 lcod 36'5974 mlcod 36'5974 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.526 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.519+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6246 (0'0,36'6246] local-lis/les=21/22 n=312 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6246 lcod 36'6244 mlcod 36'6244 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.527 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.520+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5978 (0'0,36'5978] local-lis/les=21/22 n=93 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5976 crt=36'5976 lcod 36'5974 mlcod 36'5974 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.530 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.523+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6248 (0'0,36'6248] local-lis/les=21/22 n=310 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6246 crt=36'6246 lcod 36'6244 mlcod 36'6244 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.532 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.524+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6010 (0'0,36'6010] local-lis/les=21/22 n=262 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6010 lcod 36'6009 mlcod 36'6009 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.532 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.527+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5936 (0'0,36'5936] local-lis/les=21/22 n=172 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5936 lcod 36'5934 mlcod 36'5934 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.534 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.530+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6234 (0'0,36'6234] local-lis/les=21/22 n=233 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6234 lcod 36'6232 mlcod 36'6232 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.535 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.529+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6045 (0'0,36'6045] local-lis/les=21/22 n=228 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6044 crt=36'6044 lcod 36'6042 mlcod 36'6042 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.535 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.533+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6236 (0'0,36'6236] local-lis/les=21/22 n=231 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6234 crt=36'6234 lcod 36'6232 mlcod 36'6232 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.539 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.534+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6047 (0'0,36'6047] local-lis/les=21/22 n=226 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6044 crt=36'6044 lcod 36'6042 mlcod 36'6042 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.539 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.536+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5922 (0'0,36'5922] local-lis/les=21/22 n=228 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5922 lcod 36'5920 mlcod 36'5920 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.540 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.539+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6250 (0'0,36'6250] local-lis/les=21/22 n=308 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6250 lcod 36'6248 mlcod 36'6248 active+clean+snaptrim trimq=[20b~1d] ps=[1fe~d]] removing snap head 2020-02-11T16:31:33.541 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.539+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5924 (0'0,36'5924] local-lis/les=21/22 n=226 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5922 crt=36'5922 lcod 36'5920 mlcod 36'5920 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.548 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.545+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6127 (0'0,36'6127] local-lis/les=21/22 n=252 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6127 lcod 36'6126 mlcod 36'6126 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.549 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.545+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5938 (0'0,36'5938] local-lis/les=21/22 n=170 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5938 lcod 36'5936 mlcod 36'5936 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.549 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.546+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6012 (0'0,36'6012] local-lis/les=21/22 n=260 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6010 crt=36'6010 lcod 36'6009 mlcod 36'6009 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.553 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.549+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5940 (0'0,36'5940] local-lis/les=21/22 n=168 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5938 crt=36'5938 lcod 36'5936 mlcod 36'5936 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.555 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.547+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5980 (0'0,36'5980] local-lis/les=21/22 n=91 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5980 lcod 36'5978 mlcod 36'5978 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.557 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.552+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5926 (0'0,36'5926] local-lis/les=21/22 n=224 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5926 lcod 36'5924 mlcod 36'5924 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.566 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.557+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5928 (0'0,36'5928] local-lis/les=21/22 n=222 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5926 crt=36'5926 lcod 36'5924 mlcod 36'5924 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.566 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.557+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6238 (0'0,36'6238] local-lis/les=21/22 n=229 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6238 lcod 36'6236 mlcod 36'6236 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.568 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.558+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6015 (0'0,36'6015] local-lis/les=21/22 n=257 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6014 crt=36'6012 lcod 36'6012 mlcod 36'6012 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.570 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.555+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6252 (0'0,36'6252] local-lis/les=21/22 n=306 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6252 lcod 36'6250 mlcod 36'6250 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.571 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.560+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6129 (0'0,36'6129] local-lis/les=21/22 n=250 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6127 crt=36'6127 lcod 36'6126 mlcod 36'6126 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.572 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.562+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6240 (0'0,36'6240] local-lis/les=21/22 n=227 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6238 crt=36'6238 lcod 36'6236 mlcod 36'6236 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.576 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.563+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5982 (0'0,36'5982] local-lis/les=21/22 n=89 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5982 lcod 36'5980 mlcod 36'5980 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.576 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.563+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6254 (0'0,36'6254] local-lis/les=21/22 n=304 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6252 crt=36'6252 lcod 36'6250 mlcod 36'6250 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.576 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.564+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6049 (0'0,36'6049] local-lis/les=21/22 n=224 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6049 lcod 36'6047 mlcod 36'6047 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.578 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.567+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5984 (0'0,36'5984] local-lis/les=21/22 n=87 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5982 crt=36'5982 lcod 36'5980 mlcod 36'5980 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.580 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.569+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6051 (0'0,36'6051] local-lis/les=21/22 n=222 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6049 crt=36'6049 lcod 36'6047 mlcod 36'6047 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.586 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.576+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6256 (0'0,36'6256] local-lis/les=21/22 n=302 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6256 lcod 36'6254 mlcod 36'6254 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.588 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.575+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5943 (0'0,36'5943] local-lis/les=21/22 n=165 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5943 lcod 36'5942 mlcod 36'5942 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.589 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.579+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6017 (0'0,36'6017] local-lis/les=21/22 n=255 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6017 lcod 36'6015 mlcod 36'6015 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.592 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.582+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5930 (0'0,36'5930] local-lis/les=21/22 n=220 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5930 lcod 36'5928 mlcod 36'5928 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.594 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.583+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6258 (0'0,36'6258] local-lis/les=21/22 n=300 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6256 crt=36'6256 lcod 36'6254 mlcod 36'6254 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.595 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.586+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6133 (0'0,36'6133] local-lis/les=21/22 n=246 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6132 crt=36'6129 lcod 36'6131 mlcod 36'6131 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.595 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.586+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6242 (0'0,36'6242] local-lis/les=21/22 n=225 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6242 lcod 36'6240 mlcod 36'6240 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.596 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.586+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5945 (0'0,36'5945] local-lis/les=21/22 n=163 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5943 crt=36'5943 lcod 36'5942 mlcod 36'5942 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.599 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.590+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6244 (0'0,36'6244] local-lis/les=21/22 n=223 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6242 crt=36'6242 lcod 36'6240 mlcod 36'6240 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.601 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.593+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6053 (0'0,36'6053] local-lis/les=21/22 n=220 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6053 lcod 36'6051 mlcod 36'6051 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.601 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.593+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5932 (0'0,36'5932] local-lis/les=21/22 n=218 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5930 crt=36'5930 lcod 36'5928 mlcod 36'5928 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.602 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.594+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6019 (0'0,36'6019] local-lis/les=21/22 n=253 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6017 crt=36'6017 lcod 36'6015 mlcod 36'6015 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.602 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.591+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5986 (0'0,36'5986] local-lis/les=21/22 n=85 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5986 lcod 36'5984 mlcod 36'5984 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.606 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.597+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5988 (0'0,36'5988] local-lis/les=21/22 n=83 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5986 crt=36'5986 lcod 36'5984 mlcod 36'5984 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.609 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.599+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6055 (0'0,36'6055] local-lis/les=21/22 n=218 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6053 crt=36'6053 lcod 36'6051 mlcod 36'6051 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.610 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.594+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6135 (0'0,36'6135] local-lis/les=21/22 n=244 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6132 crt=36'6132 lcod 36'6131 mlcod 36'6131 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.617 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.605+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5947 (0'0,36'5947] local-lis/les=21/22 n=161 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5947 lcod 36'5945 mlcod 36'5945 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.617 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.605+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5935 (0'0,36'5935] local-lis/les=21/22 n=215 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5934 crt=36'5932 lcod 36'5932 mlcod 36'5932 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.618 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.606+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6246 (0'0,36'6246] local-lis/les=21/22 n=221 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6246 lcod 36'6244 mlcod 36'6244 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.619 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.608+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5937 (0'0,36'5937] local-lis/les=21/22 n=213 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5934 crt=36'5934 lcod 36'5932 mlcod 36'5932 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.619 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.609+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6021 (0'0,36'6021] local-lis/les=21/22 n=251 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6021 lcod 36'6019 mlcod 36'6019 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.620 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.609+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5949 (0'0,36'5949] local-lis/les=21/22 n=159 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5947 crt=36'5947 lcod 36'5945 mlcod 36'5945 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.621 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.610+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6248 (0'0,36'6248] local-lis/les=21/22 n=219 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6246 crt=36'6246 lcod 36'6244 mlcod 36'6244 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.622 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.613+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6057 (0'0,36'6057] local-lis/les=21/22 n=216 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6057 lcod 36'6055 mlcod 36'6055 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.624 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.614+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6023 (0'0,36'6023] local-lis/les=21/22 n=249 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6021 crt=36'6021 lcod 36'6019 mlcod 36'6019 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.624 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.617+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5990 (0'0,36'5990] local-lis/les=21/22 n=81 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5990 lcod 36'5988 mlcod 36'5988 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.625 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.618+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6137 (0'0,36'6137] local-lis/les=21/22 n=242 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6137 lcod 36'6135 mlcod 36'6135 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.627 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.619+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6261 (0'0,36'6261] local-lis/les=21/22 n=297 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6261 lcod 36'6260 mlcod 36'6260 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.629 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.621+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5992 (0'0,36'5992] local-lis/les=21/22 n=79 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5990 crt=36'5990 lcod 36'5988 mlcod 36'5988 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.631 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.621+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6139 (0'0,36'6139] local-lis/les=21/22 n=240 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6137 crt=36'6137 lcod 36'6135 mlcod 36'6135 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.634 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.626+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5951 (0'0,36'5951] local-lis/les=21/22 n=157 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5951 lcod 36'5949 mlcod 36'5949 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.634 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.626+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6263 (0'0,36'6263] local-lis/les=21/22 n=295 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6261 crt=36'6261 lcod 36'6260 mlcod 36'6260 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.637 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.629+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6059 (0'0,36'6059] local-lis/les=21/22 n=214 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6057 crt=36'6057 lcod 36'6055 mlcod 36'6055 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.638 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.629+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5953 (0'0,36'5953] local-lis/les=21/22 n=155 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5951 crt=36'5951 lcod 36'5949 mlcod 36'5949 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.647 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.637+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6250 (0'0,36'6250] local-lis/les=21/22 n=217 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6250 lcod 36'6248 mlcod 36'6248 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.648 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.639+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6025 (0'0,36'6025] local-lis/les=21/22 n=247 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6025 lcod 36'6023 mlcod 36'6023 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.648 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.640+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6141 (0'0,36'6141] local-lis/les=21/22 n=238 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6141 lcod 36'6139 mlcod 36'6139 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.653 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.637+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5939 (0'0,36'5939] local-lis/les=21/22 n=211 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5939 lcod 36'5937 mlcod 36'5937 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.654 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.644+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6143 (0'0,36'6143] local-lis/les=21/22 n=236 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6141 crt=36'6141 lcod 36'6139 mlcod 36'6139 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.654 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.644+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6027 (0'0,36'6027] local-lis/les=21/22 n=245 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6025 crt=36'6025 lcod 36'6023 mlcod 36'6023 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.655 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.641+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5941 (0'0,36'5941] local-lis/les=21/22 n=209 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5939 crt=36'5939 lcod 36'5937 mlcod 36'5937 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.655 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.645+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6252 (0'0,36'6252] local-lis/les=21/22 n=215 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6250 crt=36'6250 lcod 36'6248 mlcod 36'6248 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.655 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.644+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5955 (0'0,36'5955] local-lis/les=21/22 n=153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5955 lcod 36'5953 mlcod 36'5953 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.656 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.648+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5957 (0'0,36'5957] local-lis/les=21/22 n=151 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5955 crt=36'5955 lcod 36'5953 mlcod 36'5953 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.660 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.654+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6062 (0'0,36'6062] local-lis/les=21/22 n=211 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6062 lcod 36'6061 mlcod 36'6061 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.670 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.654+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5995 (0'0,36'5995] local-lis/les=21/22 n=76 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'5995 lcod 36'5994 mlcod 36'5994 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.670 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.657+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6265 (0'0,36'6265] local-lis/les=21/22 n=293 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6265 lcod 36'6263 mlcod 36'6263 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.670 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.657+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'5997 (0'0,36'5997] local-lis/les=21/22 n=74 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5995 crt=36'5995 lcod 36'5994 mlcod 36'5994 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.679 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.661+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6254 (0'0,36'6254] local-lis/les=21/22 n=213 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6254 lcod 36'6252 mlcod 36'6252 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.679 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.661+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6145 (0'0,36'6145] local-lis/les=21/22 n=234 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6145 lcod 36'6143 mlcod 36'6143 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.681 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.658+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6064 (0'0,36'6064] local-lis/les=21/22 n=209 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6062 crt=36'6062 lcod 36'6061 mlcod 36'6061 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.681 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.665+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6147 (0'0,36'6147] local-lis/les=21/22 n=232 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6145 crt=36'6145 lcod 36'6143 mlcod 36'6143 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.681 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.666+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6256 (0'0,36'6256] local-lis/les=21/22 n=211 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6254 crt=36'6254 lcod 36'6252 mlcod 36'6252 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.684 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.670+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5943 (0'0,36'5943] local-lis/les=21/22 n=207 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5943 lcod 36'5941 mlcod 36'5941 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.686 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.672+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6029 (0'0,36'6029] local-lis/les=21/22 n=243 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6029 lcod 36'6027 mlcod 36'6027 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.687 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.674+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5945 (0'0,36'5945] local-lis/les=21/22 n=205 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5943 crt=36'5943 lcod 36'5941 mlcod 36'5941 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.689 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.677+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6066 (0'0,36'6066] local-lis/les=21/22 n=207 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6066 lcod 36'6064 mlcod 36'6064 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.689 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.678+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5960 (0'0,36'5960] local-lis/les=21/22 n=148 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5960 lcod 36'5959 mlcod 36'5959 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.689 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.676+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6031 (0'0,36'6031] local-lis/les=21/22 n=241 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6029 crt=36'6029 lcod 36'6027 mlcod 36'6027 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.690 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.680+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6068 (0'0,36'6068] local-lis/les=21/22 n=205 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6066 crt=36'6066 lcod 36'6064 mlcod 36'6064 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.694 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.682+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6000 (0'0,36'6000] local-lis/les=21/22 n=71 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5999 crt=36'5995 lcod 36'5997 mlcod 36'5997 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.695 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.684+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5962 (0'0,36'5962] local-lis/les=21/22 n=146 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5960 crt=36'5960 lcod 36'5959 mlcod 36'5959 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.696 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.686+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6002 (0'0,36'6002] local-lis/les=21/22 n=69 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'5999 crt=36'5999 lcod 36'5997 mlcod 36'5997 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.700 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.687+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6149 (0'0,36'6149] local-lis/les=21/22 n=230 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6149 lcod 36'6147 mlcod 36'6147 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.700 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.691+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6258 (0'0,36'6258] local-lis/les=21/22 n=209 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6258 lcod 36'6256 mlcod 36'6256 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.704 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.694+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6269 (0'0,36'6269] local-lis/les=21/22 n=290 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6269 lcod 36'6267 mlcod 36'6267 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.707 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.694+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6151 (0'0,36'6151] local-lis/les=21/22 n=228 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6149 crt=36'6149 lcod 36'6147 mlcod 36'6147 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.708 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.695+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6260 (0'0,36'6260] local-lis/les=21/22 n=207 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6258 crt=36'6258 lcod 36'6256 mlcod 36'6256 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.708 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.698+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6271 (0'0,36'6271] local-lis/les=21/22 n=288 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6269 crt=36'6269 lcod 36'6267 mlcod 36'6267 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.714 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.706+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5948 (0'0,36'5948] local-lis/les=21/22 n=202 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5947 crt=36'5947 lcod 36'5945 mlcod 36'5945 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.717 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.701+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6033 (0'0,36'6033] local-lis/les=21/22 n=239 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6033 lcod 36'6031 mlcod 36'6031 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.717 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.705+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6035 (0'0,36'6035] local-lis/les=21/22 n=237 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6033 crt=36'6033 lcod 36'6031 mlcod 36'6031 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.718 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.710+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5950 (0'0,36'5950] local-lis/les=21/22 n=200 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5947 crt=36'5947 lcod 36'5945 mlcod 36'5945 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.719 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.707+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6004 (0'0,36'6004] local-lis/les=21/22 n=67 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'6004 lcod 36'6002 mlcod 36'6002 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.719 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.711+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6006 (0'0,36'6006] local-lis/les=21/22 n=65 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'6004 crt=36'6004 lcod 36'6002 mlcod 36'6002 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.720 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.712+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6071 (0'0,36'6071] local-lis/les=21/22 n=202 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6071 lcod 36'6070 mlcod 36'6070 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.722 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.713+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5964 (0'0,36'5964] local-lis/les=21/22 n=144 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5964 lcod 36'5962 mlcod 36'5962 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.726 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.716+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6073 (0'0,36'6073] local-lis/les=21/22 n=200 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6071 crt=36'6071 lcod 36'6070 mlcod 36'6070 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.731 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.721+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6263 (0'0,36'6263] local-lis/les=21/22 n=204 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6263 lcod 36'6262 mlcod 36'6262 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.733 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.724+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6265 (0'0,36'6265] local-lis/les=21/22 n=202 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6263 crt=36'6263 lcod 36'6262 mlcod 36'6262 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.737 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.729+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6273 (0'0,36'6273] local-lis/les=21/22 n=286 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6273 lcod 36'6271 mlcod 36'6271 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.737 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.730+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6009 (0'0,36'6009] local-lis/les=21/22 n=62 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'6009 lcod 36'6008 mlcod 36'6008 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.738 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.730+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6037 (0'0,36'6037] local-lis/les=21/22 n=235 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6037 lcod 36'6035 mlcod 36'6035 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.738 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.731+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5966 (0'0,36'5966] local-lis/les=21/22 n=142 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5964 crt=36'5964 lcod 36'5962 mlcod 36'5962 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.739 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.732+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6275 (0'0,36'6275] local-lis/les=21/22 n=284 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6273 crt=36'6273 lcod 36'6271 mlcod 36'6271 active+clean+snaptrim trimq=[20c~1c] ps=[1fe~e]] removing snap head 2020-02-11T16:31:33.741 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.733+0000 7f27cf238700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6011 (0'0,36'6011] local-lis/les=21/22 n=60 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'6009 crt=36'6009 lcod 36'6008 mlcod 36'6008 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.742 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.735+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6039 (0'0,36'6039] local-lis/les=21/22 n=233 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6037 crt=36'6037 lcod 36'6035 mlcod 36'6035 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.742 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.737+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5952 (0'0,36'5952] local-lis/les=21/22 n=198 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5952 lcod 36'5950 mlcod 36'5950 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.743 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.738+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6154 (0'0,36'6154] local-lis/les=21/22 n=225 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6153 crt=36'6149 lcod 36'6151 mlcod 36'6151 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.747 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.741+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5954 (0'0,36'5954] local-lis/les=21/22 n=196 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5952 crt=36'5952 lcod 36'5950 mlcod 36'5950 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.753 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.745+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6267 (0'0,36'6267] local-lis/les=21/22 n=200 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6267 lcod 36'6265 mlcod 36'6265 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.756 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.747+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6075 (0'0,36'6075] local-lis/les=21/22 n=198 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6075 lcod 36'6073 mlcod 36'6073 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.758 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.749+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6269 (0'0,36'6269] local-lis/les=21/22 n=198 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6267 crt=36'6267 lcod 36'6265 mlcod 36'6265 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.759 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.749+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6041 (0'0,36'6041] local-lis/les=21/22 n=231 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6041 lcod 36'6039 mlcod 36'6039 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.759 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.750+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6077 (0'0,36'6077] local-lis/les=21/22 n=196 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6075 crt=36'6075 lcod 36'6073 mlcod 36'6073 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.762 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.749+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5968 (0'0,36'5968] local-lis/les=21/22 n=140 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5968 lcod 36'5966 mlcod 36'5966 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.763 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.753+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5970 (0'0,36'5970] local-lis/les=21/22 n=138 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5968 crt=36'5968 lcod 36'5966 mlcod 36'5966 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.764 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.752+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6156 (0'0,36'6156] local-lis/les=21/22 n=223 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6153 crt=36'6153 lcod 36'6151 mlcod 36'6151 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.770 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.757+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6043 (0'0,36'6043] local-lis/les=21/22 n=229 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6041 crt=36'6041 lcod 36'6039 mlcod 36'6039 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.773 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.760+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6278 (0'0,36'6278] local-lis/les=21/22 n=281 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6278 lcod 36'6277 mlcod 36'6277 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.774 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.765+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6013 (0'0,36'6013] local-lis/les=21/22 n=58 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'6013 lcod 36'6011 mlcod 36'6011 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.777 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.767+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5972 (0'0,36'5972] local-lis/les=21/22 n=136 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5972 lcod 36'5970 mlcod 36'5970 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.777 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.767+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6280 (0'0,36'6280] local-lis/les=21/22 n=279 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6278 crt=36'6278 lcod 36'6277 mlcod 36'6277 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.778 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.769+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6271 (0'0,36'6271] local-lis/les=21/22 n=196 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6271 lcod 36'6269 mlcod 36'6269 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.780 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.771+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5974 (0'0,36'5974] local-lis/les=21/22 n=134 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5972 crt=36'5972 lcod 36'5970 mlcod 36'5970 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.782 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.773+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5956 (0'0,36'5956] local-lis/les=21/22 n=194 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5956 lcod 36'5954 mlcod 36'5954 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.782 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.773+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6015 (0'0,36'6015] local-lis/les=21/22 n=56 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'6013 crt=36'6013 lcod 36'6011 mlcod 36'6011 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.786 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.776+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6045 (0'0,36'6045] local-lis/les=21/22 n=227 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6045 lcod 36'6043 mlcod 36'6043 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.788 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.773+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6273 (0'0,36'6273] local-lis/les=21/22 n=194 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6271 crt=36'6271 lcod 36'6269 mlcod 36'6269 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.789 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.775+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6162 (0'0,36'6162] local-lis/les=21/22 n=218 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6158 crt=36'6158 lcod 36'6156 mlcod 36'6156 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.790 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.781+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6079 (0'0,36'6079] local-lis/les=21/22 n=194 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6079 lcod 36'6077 mlcod 36'6077 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.791 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.782+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5958 (0'0,36'5958] local-lis/les=21/22 n=192 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5956 crt=36'5956 lcod 36'5954 mlcod 36'5954 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.793 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.784+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6081 (0'0,36'6081] local-lis/les=21/22 n=192 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6079 crt=36'6079 lcod 36'6077 mlcod 36'6077 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.796 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.784+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6047 (0'0,36'6047] local-lis/les=21/22 n=225 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6045 crt=36'6045 lcod 36'6043 mlcod 36'6043 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.802 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.788+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6017 (0'0,36'6017] local-lis/les=21/22 n=54 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'6017 lcod 36'6015 mlcod 36'6015 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.804 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.791+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6019 (0'0,36'6019] local-lis/les=21/22 n=52 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'6017 crt=36'6017 lcod 36'6015 mlcod 36'6015 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.804 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.792+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6284 (0'0,36'6284] local-lis/les=21/22 n=275 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6282 crt=36'6282 lcod 36'6280 mlcod 36'6280 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.806 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.796+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6286 (0'0,36'6286] local-lis/les=21/22 n=273 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6282 crt=36'6282 lcod 36'6280 mlcod 36'6280 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.810 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.797+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6164 (0'0,36'6164] local-lis/les=21/22 n=216 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6164 lcod 36'6162 mlcod 36'6162 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.811 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.798+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5960 (0'0,36'5960] local-lis/les=21/22 n=190 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5960 lcod 36'5958 mlcod 36'5958 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.812 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.801+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6166 (0'0,36'6166] local-lis/les=21/22 n=214 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6164 crt=36'6164 lcod 36'6162 mlcod 36'6162 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.814 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.804+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6049 (0'0,36'6049] local-lis/les=21/22 n=223 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6049 lcod 36'6047 mlcod 36'6047 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.816 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.802+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5976 (0'0,36'5976] local-lis/les=21/22 n=132 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5976 lcod 36'5974 mlcod 36'5974 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.816 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.806+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5978 (0'0,36'5978] local-lis/les=21/22 n=130 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5976 crt=36'5976 lcod 36'5974 mlcod 36'5974 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.818 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.802+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5962 (0'0,36'5962] local-lis/les=21/22 n=188 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5960 crt=36'5960 lcod 36'5958 mlcod 36'5958 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.818 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.803+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6083 (0'0,36'6083] local-lis/les=21/22 n=190 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6083 lcod 36'6081 mlcod 36'6081 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.819 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.806+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6275 (0'0,36'6275] local-lis/les=21/22 n=192 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6275 lcod 36'6273 mlcod 36'6273 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.819 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.808+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6051 (0'0,36'6051] local-lis/les=21/22 n=221 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6049 crt=36'6049 lcod 36'6047 mlcod 36'6047 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.820 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.807+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6085 (0'0,36'6085] local-lis/les=21/22 n=188 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6083 crt=36'6083 lcod 36'6081 mlcod 36'6081 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.821 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.810+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6277 (0'0,36'6277] local-lis/les=21/22 n=190 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6275 crt=36'6275 lcod 36'6273 mlcod 36'6273 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.827 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.817+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6021 (0'0,36'6021] local-lis/les=21/22 n=50 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=36'6021 lcod 36'6019 mlcod 36'6019 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.829 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.819+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6288 (0'0,36'6288] local-lis/les=21/22 n=271 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6288 lcod 36'6286 mlcod 36'6286 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.831 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.821+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5964 (0'0,36'5964] local-lis/les=21/22 n=186 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5964 lcod 36'5962 mlcod 36'5962 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.835 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.824+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5966 (0'0,36'5966] local-lis/les=21/22 n=184 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5964 crt=36'5964 lcod 36'5962 mlcod 36'5962 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.835 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.825+0000 7f27cb230700 -1 osd.0 pg_epoch: 36 pg[3.6s0( v 36'6023 (0'0,36'6023] local-lis/les=21/22 n=48 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=36'6021 crt=36'6021 lcod 36'6019 mlcod 36'6019 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.836 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.826+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6290 (0'0,36'6290] local-lis/les=21/22 n=269 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6288 crt=36'6288 lcod 36'6286 mlcod 36'6286 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.839 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.829+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6169 (0'0,36'6169] local-lis/les=21/22 n=211 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6169 lcod 36'6168 mlcod 36'6168 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.840 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.829+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5980 (0'0,36'5980] local-lis/les=21/22 n=128 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5980 lcod 36'5978 mlcod 36'5978 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.841 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.830+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6089 (0'0,36'6089] local-lis/les=21/22 n=184 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6088 crt=36'6083 lcod 36'6087 mlcod 36'6087 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.844 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.834+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6091 (0'0,36'6091] local-lis/les=21/22 n=182 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6088 crt=36'6088 lcod 36'6087 mlcod 36'6087 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.845 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.834+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5982 (0'0,36'5982] local-lis/les=21/22 n=126 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5980 crt=36'5980 lcod 36'5978 mlcod 36'5978 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.849 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.837+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6054 (0'0,36'6054] local-lis/les=21/22 n=218 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6053 crt=36'6051 lcod 36'6051 mlcod 36'6051 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.860 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.835+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6171 (0'0,36'6171] local-lis/les=21/22 n=209 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6169 crt=36'6169 lcod 36'6168 mlcod 36'6168 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.860 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.838+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6279 (0'0,36'6279] local-lis/les=21/22 n=188 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6279 lcod 36'6277 mlcod 36'6277 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.861 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.841+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6281 (0'0,36'6281] local-lis/les=21/22 n=186 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6279 crt=36'6279 lcod 36'6277 mlcod 36'6277 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.861 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.847+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6292 (0'0,36'6292] local-lis/les=21/22 n=267 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6292 lcod 36'6290 mlcod 36'6290 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.861 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.841+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6056 (0'0,36'6056] local-lis/les=21/22 n=216 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6053 crt=36'6053 lcod 36'6051 mlcod 36'6051 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.862 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.851+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6294 (0'0,36'6294] local-lis/les=21/22 n=265 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6292 crt=36'6292 lcod 36'6290 mlcod 36'6290 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.863 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.852+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5984 (0'0,36'5984] local-lis/les=21/22 n=124 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5984 lcod 36'5982 mlcod 36'5982 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.867 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.857+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5986 (0'0,36'5986] local-lis/les=21/22 n=122 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5984 crt=36'5984 lcod 36'5982 mlcod 36'5982 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.868 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.855+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5969 (0'0,36'5969] local-lis/les=21/22 n=181 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5969 lcod 36'5968 mlcod 36'5968 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.868 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.859+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5971 (0'0,36'5971] local-lis/les=21/22 n=179 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5969 crt=36'5969 lcod 36'5968 mlcod 36'5968 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.875 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.858+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6173 (0'0,36'6173] local-lis/les=21/22 n=207 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6173 lcod 36'6171 mlcod 36'6171 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.876 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.862+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6175 (0'0,36'6175] local-lis/les=21/22 n=205 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6173 crt=36'6173 lcod 36'6171 mlcod 36'6171 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.878 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.869+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6283 (0'0,36'6283] local-lis/les=21/22 n=184 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6283 lcod 36'6281 mlcod 36'6281 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.880 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.872+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6296 (0'0,36'6296] local-lis/les=21/22 n=263 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6296 lcod 36'6294 mlcod 36'6294 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.881 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.871+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6059 (0'0,36'6059] local-lis/les=21/22 n=213 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6059 lcod 36'6058 mlcod 36'6058 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.881 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.873+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6285 (0'0,36'6285] local-lis/les=21/22 n=182 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6283 crt=36'6283 lcod 36'6281 mlcod 36'6281 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.882 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.873+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6093 (0'0,36'6093] local-lis/les=21/22 n=180 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6093 lcod 36'6091 mlcod 36'6091 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.886 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.876+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5973 (0'0,36'5973] local-lis/les=21/22 n=177 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5973 lcod 36'5971 mlcod 36'5971 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.887 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.877+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6095 (0'0,36'6095] local-lis/les=21/22 n=178 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6093 crt=36'6093 lcod 36'6091 mlcod 36'6091 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.888 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.878+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6177 (0'0,36'6177] local-lis/les=21/22 n=203 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6177 lcod 36'6175 mlcod 36'6175 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.888 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.878+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6298 (0'0,36'6298] local-lis/les=21/22 n=261 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6296 crt=36'6296 lcod 36'6294 mlcod 36'6294 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.888 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.879+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6061 (0'0,36'6061] local-lis/les=21/22 n=211 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6059 crt=36'6059 lcod 36'6058 mlcod 36'6058 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.893 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.883+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6179 (0'0,36'6179] local-lis/les=21/22 n=201 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6177 crt=36'6177 lcod 36'6175 mlcod 36'6175 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.895 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.880+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5988 (0'0,36'5988] local-lis/les=21/22 n=120 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5988 lcod 36'5986 mlcod 36'5986 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.899 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.888+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5975 (0'0,36'5975] local-lis/les=21/22 n=175 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5973 crt=36'5973 lcod 36'5971 mlcod 36'5971 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.901 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.892+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6098 (0'0,36'6098] local-lis/les=21/22 n=175 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6097 crt=36'6095 lcod 36'6095 mlcod 36'6095 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.904 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.894+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6300 (0'0,36'6300] local-lis/les=21/22 n=259 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6300 lcod 36'6298 mlcod 36'6298 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.904 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.895+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6100 (0'0,36'6100] local-lis/les=21/22 n=173 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6097 crt=36'6097 lcod 36'6095 mlcod 36'6095 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.907 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.899+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6181 (0'0,36'6181] local-lis/les=21/22 n=199 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6181 lcod 36'6179 mlcod 36'6179 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.912 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.903+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5977 (0'0,36'5977] local-lis/les=21/22 n=173 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5977 lcod 36'5975 mlcod 36'5975 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.915 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.887+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5990 (0'0,36'5990] local-lis/les=21/22 n=118 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5988 crt=36'5988 lcod 36'5986 mlcod 36'5986 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.916 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.896+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6063 (0'0,36'6063] local-lis/les=21/22 n=209 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6063 lcod 36'6061 mlcod 36'6061 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.916 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.906+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5979 (0'0,36'5979] local-lis/les=21/22 n=171 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5977 crt=36'5977 lcod 36'5975 mlcod 36'5975 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.917 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.906+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6183 (0'0,36'6183] local-lis/les=21/22 n=197 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6181 crt=36'6181 lcod 36'6179 mlcod 36'6179 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.921 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.912+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6288 (0'0,36'6288] local-lis/les=21/22 n=179 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6288 lcod 36'6287 mlcod 36'6287 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.924 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.900+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6065 (0'0,36'6065] local-lis/les=21/22 n=207 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6063 crt=36'6063 lcod 36'6061 mlcod 36'6061 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.924 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.913+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5992 (0'0,36'5992] local-lis/les=21/22 n=116 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5992 lcod 36'5990 mlcod 36'5990 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.925 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.916+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6290 (0'0,36'6290] local-lis/les=21/22 n=177 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6288 crt=36'6288 lcod 36'6287 mlcod 36'6287 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.931 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.920+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6186 (0'0,36'6186] local-lis/les=21/22 n=194 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6185 crt=36'6183 lcod 36'6183 mlcod 36'6183 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.933 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.920+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6103 (0'0,36'6103] local-lis/les=21/22 n=170 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6103 lcod 36'6102 mlcod 36'6102 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.934 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.923+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6188 (0'0,36'6188] local-lis/les=21/22 n=192 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6185 crt=36'6185 lcod 36'6183 mlcod 36'6183 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.934 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.923+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6105 (0'0,36'6105] local-lis/les=21/22 n=168 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6103 crt=36'6103 lcod 36'6102 mlcod 36'6102 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.934 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.924+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6067 (0'0,36'6067] local-lis/les=21/22 n=205 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6067 lcod 36'6065 mlcod 36'6065 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.939 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.928+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6069 (0'0,36'6069] local-lis/les=21/22 n=203 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6067 crt=36'6067 lcod 36'6065 mlcod 36'6065 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.939 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.924+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5994 (0'0,36'5994] local-lis/les=21/22 n=114 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5992 crt=36'5992 lcod 36'5990 mlcod 36'5990 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.946 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.933+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6304 (0'0,36'6304] local-lis/les=21/22 n=256 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6304 lcod 36'6302 mlcod 36'6302 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.946 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.934+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6190 (0'0,36'6190] local-lis/les=21/22 n=190 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6190 lcod 36'6188 mlcod 36'6188 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.948 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.937+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6292 (0'0,36'6292] local-lis/les=21/22 n=175 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6292 lcod 36'6290 mlcod 36'6290 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.949 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.937+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6306 (0'0,36'6306] local-lis/les=21/22 n=254 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6304 crt=36'6304 lcod 36'6302 mlcod 36'6302 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.961 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.946+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5996 (0'0,36'5996] local-lis/les=21/22 n=112 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'5996 lcod 36'5994 mlcod 36'5994 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.962 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.938+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6192 (0'0,36'6192] local-lis/les=21/22 n=188 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6190 crt=36'6190 lcod 36'6188 mlcod 36'6188 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.962 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.946+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6294 (0'0,36'6294] local-lis/les=21/22 n=173 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6292 crt=36'6292 lcod 36'6290 mlcod 36'6290 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.962 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.938+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5982 (0'0,36'5982] local-lis/les=21/22 n=168 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5982 lcod 36'5981 mlcod 36'5981 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.962 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.942+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5984 (0'0,36'5984] local-lis/les=21/22 n=166 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5982 crt=36'5982 lcod 36'5981 mlcod 36'5981 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.962 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.950+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6108 (0'0,36'6108] local-lis/les=21/22 n=165 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6108 lcod 36'6107 mlcod 36'6107 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.963 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.953+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6308 (0'0,36'6308] local-lis/les=21/22 n=252 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6308 lcod 36'6306 mlcod 36'6306 active+clean+snaptrim trimq=[20d~1b] ps=[1fe~f]] removing snap head 2020-02-11T16:31:33.968 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.957+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6194 (0'0,36'6194] local-lis/les=21/22 n=186 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6194 lcod 36'6192 mlcod 36'6192 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.969 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.950+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'5998 (0'0,36'5998] local-lis/les=21/22 n=110 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'5996 crt=36'5996 lcod 36'5994 mlcod 36'5994 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.970 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.960+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6296 (0'0,36'6296] local-lis/les=21/22 n=171 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6296 lcod 36'6294 mlcod 36'6294 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.972 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.962+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6071 (0'0,36'6071] local-lis/les=21/22 n=201 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6071 lcod 36'6069 mlcod 36'6069 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.973 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.964+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6298 (0'0,36'6298] local-lis/les=21/22 n=169 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6296 crt=36'6296 lcod 36'6294 mlcod 36'6294 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.973 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.964+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6196 (0'0,36'6196] local-lis/les=21/22 n=184 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6194 crt=36'6194 lcod 36'6192 mlcod 36'6192 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.975 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.967+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6000 (0'0,36'6000] local-lis/les=21/22 n=108 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6000 lcod 36'5998 mlcod 36'5998 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.977 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.969+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6073 (0'0,36'6073] local-lis/les=21/22 n=199 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6071 crt=36'6071 lcod 36'6069 mlcod 36'6069 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.979 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.971+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5987 (0'0,36'5987] local-lis/les=21/22 n=163 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5987 lcod 36'5986 mlcod 36'5986 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.981 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.975+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5989 (0'0,36'5989] local-lis/les=21/22 n=161 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5987 crt=36'5987 lcod 36'5986 mlcod 36'5986 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.983 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.976+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6310 (0'0,36'6310] local-lis/les=21/22 n=250 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6310 lcod 36'6308 mlcod 36'6308 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.985 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.978+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6300 (0'0,36'6300] local-lis/les=21/22 n=167 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6300 lcod 36'6298 mlcod 36'6298 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.986 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.979+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6312 (0'0,36'6312] local-lis/les=21/22 n=248 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6310 crt=36'6310 lcod 36'6308 mlcod 36'6308 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:33.987 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.980+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6198 (0'0,36'6198] local-lis/les=21/22 n=182 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6198 lcod 36'6196 mlcod 36'6196 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.992 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.984+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6302 (0'0,36'6302] local-lis/les=21/22 n=165 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6300 crt=36'6300 lcod 36'6298 mlcod 36'6298 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.993 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.985+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6200 (0'0,36'6200] local-lis/les=21/22 n=180 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6198 crt=36'6198 lcod 36'6196 mlcod 36'6196 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:33.994 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.986+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6111 (0'0,36'6111] local-lis/les=21/22 n=162 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6110 crt=36'6108 lcod 36'6108 mlcod 36'6108 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.995 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.987+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6002 (0'0,36'6002] local-lis/les=21/22 n=106 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6002 lcod 36'6000 mlcod 36'6000 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:33.999 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.991+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5991 (0'0,36'5991] local-lis/les=21/22 n=159 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5991 lcod 36'5989 mlcod 36'5989 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:33.999 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:33.991+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6004 (0'0,36'6004] local-lis/les=21/22 n=104 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6002 crt=36'6002 lcod 36'6000 mlcod 36'6000 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.000 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.994+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6076 (0'0,36'6076] local-lis/les=21/22 n=196 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6075 crt=36'6075 lcod 36'6073 mlcod 36'6073 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.002 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:33.994+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5993 (0'0,36'5993] local-lis/les=21/22 n=157 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5991 crt=36'5991 lcod 36'5989 mlcod 36'5989 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.002 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:33.996+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6314 (0'0,36'6314] local-lis/les=21/22 n=246 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6314 lcod 36'6312 mlcod 36'6312 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:34.003 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:33.997+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6078 (0'0,36'6078] local-lis/les=21/22 n=194 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6075 crt=36'6075 lcod 36'6073 mlcod 36'6073 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.006 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.000+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6316 (0'0,36'6316] local-lis/les=21/22 n=244 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6314 crt=36'6314 lcod 36'6312 mlcod 36'6312 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:34.007 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:33.999+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6202 (0'0,36'6202] local-lis/les=21/22 n=178 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6202 lcod 36'6200 mlcod 36'6200 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.010 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.004+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6204 (0'0,36'6204] local-lis/les=21/22 n=176 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6202 crt=36'6202 lcod 36'6200 mlcod 36'6200 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.011 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.002+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6113 (0'0,36'6113] local-lis/les=21/22 n=160 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6110 crt=36'6110 lcod 36'6108 mlcod 36'6108 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.013 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.005+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6006 (0'0,36'6006] local-lis/les=21/22 n=102 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6006 lcod 36'6004 mlcod 36'6004 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.015 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.007+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6304 (0'0,36'6304] local-lis/les=21/22 n=163 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6304 lcod 36'6302 mlcod 36'6302 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.019 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.010+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6008 (0'0,36'6008] local-lis/les=21/22 n=100 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6006 crt=36'6006 lcod 36'6004 mlcod 36'6004 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.020 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.011+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6306 (0'0,36'6306] local-lis/les=21/22 n=161 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6304 crt=36'6304 lcod 36'6302 mlcod 36'6302 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.025 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.013+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5995 (0'0,36'5995] local-lis/les=21/22 n=155 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5995 lcod 36'5993 mlcod 36'5993 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.031 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.019+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5997 (0'0,36'5997] local-lis/les=21/22 n=153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5995 crt=36'5995 lcod 36'5993 mlcod 36'5993 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.032 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.021+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6206 (0'0,36'6206] local-lis/les=21/22 n=174 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6206 lcod 36'6204 mlcod 36'6204 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.032 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.020+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6115 (0'0,36'6115] local-lis/les=21/22 n=158 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6115 lcod 36'6113 mlcod 36'6113 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.033 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.020+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6080 (0'0,36'6080] local-lis/les=21/22 n=192 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6080 lcod 36'6078 mlcod 36'6078 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.034 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.025+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6208 (0'0,36'6208] local-lis/les=21/22 n=172 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6206 crt=36'6206 lcod 36'6204 mlcod 36'6204 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.036 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.027+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6308 (0'0,36'6308] local-lis/les=21/22 n=159 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6308 lcod 36'6306 mlcod 36'6306 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.037 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.024+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6117 (0'0,36'6117] local-lis/les=21/22 n=156 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6115 crt=36'6115 lcod 36'6113 mlcod 36'6113 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.039 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.030+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6310 (0'0,36'6310] local-lis/les=21/22 n=157 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6308 crt=36'6308 lcod 36'6306 mlcod 36'6306 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.040 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.031+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6082 (0'0,36'6082] local-lis/les=21/22 n=190 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6080 crt=36'6080 lcod 36'6078 mlcod 36'6078 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.041 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.032+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6010 (0'0,36'6010] local-lis/les=21/22 n=98 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6010 lcod 36'6008 mlcod 36'6008 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.045 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.036+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6012 (0'0,36'6012] local-lis/les=21/22 n=96 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6010 crt=36'6010 lcod 36'6008 mlcod 36'6008 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.051 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.035+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6320 (0'0,36'6320] local-lis/les=21/22 n=240 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6320 lcod 36'6319 mlcod 36'6319 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:34.051 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.038+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6322 (0'0,36'6322] local-lis/les=21/22 n=238 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6320 crt=36'6320 lcod 36'6319 mlcod 36'6319 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:34.054 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.043+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6212 (0'0,36'6212] local-lis/les=21/22 n=168 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6210 crt=36'6206 lcod 36'6208 mlcod 36'6208 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.057 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.037+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6119 (0'0,36'6119] local-lis/les=21/22 n=154 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6119 lcod 36'6117 mlcod 36'6117 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.057 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.039+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'5999 (0'0,36'5999] local-lis/les=21/22 n=151 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'5999 lcod 36'5997 mlcod 36'5997 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.057 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.042+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6121 (0'0,36'6121] local-lis/les=21/22 n=152 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6119 crt=36'6119 lcod 36'6117 mlcod 36'6117 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.057 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.043+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6001 (0'0,36'6001] local-lis/les=21/22 n=149 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'5999 crt=36'5999 lcod 36'5997 mlcod 36'5997 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.058 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.047+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6312 (0'0,36'6312] local-lis/les=21/22 n=155 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6312 lcod 36'6310 mlcod 36'6310 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.064 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.050+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6084 (0'0,36'6084] local-lis/les=21/22 n=188 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6084 lcod 36'6082 mlcod 36'6082 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.065 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.054+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6086 (0'0,36'6086] local-lis/les=21/22 n=186 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6084 crt=36'6084 lcod 36'6082 mlcod 36'6082 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.065 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.053+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6314 (0'0,36'6314] local-lis/les=21/22 n=153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6312 crt=36'6312 lcod 36'6310 mlcod 36'6310 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.069 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.060+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6123 (0'0,36'6123] local-lis/les=21/22 n=150 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6123 lcod 36'6121 mlcod 36'6121 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.069 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.062+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6324 (0'0,36'6324] local-lis/les=21/22 n=236 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6324 lcod 36'6322 mlcod 36'6322 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:34.071 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.063+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6125 (0'0,36'6125] local-lis/les=21/22 n=148 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6123 crt=36'6123 lcod 36'6121 mlcod 36'6121 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.072 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.061+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6014 (0'0,36'6014] local-lis/les=21/22 n=94 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6014 lcod 36'6012 mlcod 36'6012 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.075 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.068+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6326 (0'0,36'6326] local-lis/les=21/22 n=234 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6324 crt=36'6324 lcod 36'6322 mlcod 36'6322 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:34.077 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.073+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6003 (0'0,36'6003] local-lis/les=21/22 n=147 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6003 lcod 36'6001 mlcod 36'6001 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.081 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.076+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6089 (0'0,36'6089] local-lis/les=21/22 n=183 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6088 crt=36'6084 lcod 36'6086 mlcod 36'6086 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.082 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.073+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6316 (0'0,36'6316] local-lis/les=21/22 n=151 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6316 lcod 36'6314 mlcod 36'6314 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.082 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.075+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6216 (0'0,36'6216] local-lis/les=21/22 n=165 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6216 lcod 36'6214 mlcod 36'6214 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.082 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.076+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6016 (0'0,36'6016] local-lis/les=21/22 n=92 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6014 crt=36'6014 lcod 36'6012 mlcod 36'6012 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.082 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.079+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6218 (0'0,36'6218] local-lis/les=21/22 n=163 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6216 crt=36'6216 lcod 36'6214 mlcod 36'6214 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.087 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.083+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6005 (0'0,36'6005] local-lis/les=21/22 n=145 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6003 crt=36'6003 lcod 36'6001 mlcod 36'6001 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.090 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.084+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6127 (0'0,36'6127] local-lis/les=21/22 n=146 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6127 lcod 36'6125 mlcod 36'6125 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.091 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.081+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6091 (0'0,36'6091] local-lis/les=21/22 n=181 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6088 crt=36'6088 lcod 36'6086 mlcod 36'6086 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.091 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.087+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6329 (0'0,36'6329] local-lis/les=21/22 n=231 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6328 crt=36'6326 lcod 36'6326 mlcod 36'6326 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:34.091 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.087+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6129 (0'0,36'6129] local-lis/les=21/22 n=144 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6127 crt=36'6127 lcod 36'6125 mlcod 36'6125 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.096 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.095+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6318 (0'0,36'6318] local-lis/les=21/22 n=149 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6318 lcod 36'6316 mlcod 36'6316 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.098 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.096+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6007 (0'0,36'6007] local-lis/les=21/22 n=143 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6007 lcod 36'6005 mlcod 36'6005 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.103 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.099+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6320 (0'0,36'6320] local-lis/les=21/22 n=147 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6318 crt=36'6318 lcod 36'6316 mlcod 36'6316 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.103 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.100+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6009 (0'0,36'6009] local-lis/les=21/22 n=141 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6007 crt=36'6007 lcod 36'6005 mlcod 36'6005 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.104 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.102+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6220 (0'0,36'6220] local-lis/les=21/22 n=161 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6220 lcod 36'6218 mlcod 36'6218 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.106 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.100+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6018 (0'0,36'6018] local-lis/les=21/22 n=90 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6018 lcod 36'6016 mlcod 36'6016 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.107 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.105+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6131 (0'0,36'6131] local-lis/les=21/22 n=142 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6131 lcod 36'6129 mlcod 36'6129 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.111 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.108+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6020 (0'0,36'6020] local-lis/les=21/22 n=88 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6018 crt=36'6018 lcod 36'6016 mlcod 36'6016 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.112 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.109+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6222 (0'0,36'6222] local-lis/les=21/22 n=159 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6220 crt=36'6220 lcod 36'6218 mlcod 36'6218 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.112 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.109+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6133 (0'0,36'6133] local-lis/les=21/22 n=140 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6131 crt=36'6131 lcod 36'6129 mlcod 36'6129 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.113 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.110+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6333 (0'0,36'6333] local-lis/les=21/22 n=228 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6333 lcod 36'6331 mlcod 36'6331 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:34.118 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.116+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6322 (0'0,36'6322] local-lis/les=21/22 n=145 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6322 lcod 36'6320 mlcod 36'6320 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.119 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.117+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6011 (0'0,36'6011] local-lis/les=21/22 n=139 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6011 lcod 36'6009 mlcod 36'6009 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.119 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.117+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6094 (0'0,36'6094] local-lis/les=21/22 n=178 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6094 lcod 36'6093 mlcod 36'6093 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.121 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.119+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6335 (0'0,36'6335] local-lis/les=21/22 n=226 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6333 crt=36'6333 lcod 36'6331 mlcod 36'6331 active+clean+snaptrim trimq=[20e~1a] ps=[1fe~10]] removing snap head 2020-02-11T16:31:34.122 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.120+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6324 (0'0,36'6324] local-lis/les=21/22 n=143 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6322 crt=36'6322 lcod 36'6320 mlcod 36'6320 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.124 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.121+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6013 (0'0,36'6013] local-lis/les=21/22 n=137 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6011 crt=36'6011 lcod 36'6009 mlcod 36'6009 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.127 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.121+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6096 (0'0,36'6096] local-lis/les=21/22 n=176 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6094 crt=36'6094 lcod 36'6093 mlcod 36'6093 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.128 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.125+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6024 (0'0,36'6024] local-lis/les=21/22 n=84 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6022 crt=36'6018 lcod 36'6020 mlcod 36'6020 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.128 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.126+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6224 (0'0,36'6224] local-lis/les=21/22 n=157 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6224 lcod 36'6222 mlcod 36'6222 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.132 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.130+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6226 (0'0,36'6226] local-lis/les=21/22 n=155 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6224 crt=36'6224 lcod 36'6222 mlcod 36'6222 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.135 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.132+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6135 (0'0,36'6135] local-lis/les=21/22 n=138 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6135 lcod 36'6133 mlcod 36'6133 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.137 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.136+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6137 (0'0,36'6137] local-lis/les=21/22 n=136 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6135 crt=36'6135 lcod 36'6133 mlcod 36'6133 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.141 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.140+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6015 (0'0,36'6015] local-lis/les=21/22 n=135 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6015 lcod 36'6013 mlcod 36'6013 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.142 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.141+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6026 (0'0,36'6026] local-lis/les=21/22 n=82 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6022 crt=36'6022 lcod 36'6020 mlcod 36'6020 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.144 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.142+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6228 (0'0,36'6228] local-lis/les=21/22 n=153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6228 lcod 36'6226 mlcod 36'6226 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.148 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.146+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6230 (0'0,36'6230] local-lis/les=21/22 n=151 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6228 crt=36'6228 lcod 36'6226 mlcod 36'6226 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.148 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.145+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6017 (0'0,36'6017] local-lis/les=21/22 n=133 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6015 crt=36'6015 lcod 36'6013 mlcod 36'6013 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.149 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.146+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6337 (0'0,36'6337] local-lis/les=21/22 n=224 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6337 lcod 36'6335 mlcod 36'6335 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.151 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.149+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6098 (0'0,36'6098] local-lis/les=21/22 n=174 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6098 lcod 36'6096 mlcod 36'6096 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.152 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.151+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6339 (0'0,36'6339] local-lis/les=21/22 n=222 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6337 crt=36'6337 lcod 36'6335 mlcod 36'6335 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.155 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.154+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6139 (0'0,36'6139] local-lis/les=21/22 n=134 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6139 lcod 36'6137 mlcod 36'6137 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.157 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.155+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6100 (0'0,36'6100] local-lis/les=21/22 n=172 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6098 crt=36'6098 lcod 36'6096 mlcod 36'6096 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.158 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.156+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6326 (0'0,36'6326] local-lis/les=21/22 n=141 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6326 lcod 36'6324 mlcod 36'6324 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.160 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.159+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6019 (0'0,36'6019] local-lis/les=21/22 n=131 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6019 lcod 36'6017 mlcod 36'6017 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.160 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.159+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6141 (0'0,36'6141] local-lis/les=21/22 n=132 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6139 crt=36'6139 lcod 36'6137 mlcod 36'6137 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.162 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.161+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6328 (0'0,36'6328] local-lis/les=21/22 n=139 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6326 crt=36'6326 lcod 36'6324 mlcod 36'6324 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.164 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.163+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6021 (0'0,36'6021] local-lis/les=21/22 n=129 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6019 crt=36'6019 lcod 36'6017 mlcod 36'6017 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.165 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.163+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6232 (0'0,36'6232] local-lis/les=21/22 n=149 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6232 lcod 36'6230 mlcod 36'6230 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.165 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.160+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6028 (0'0,36'6028] local-lis/les=21/22 n=80 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6028 lcod 36'6026 mlcod 36'6026 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.169 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.168+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6341 (0'0,36'6341] local-lis/les=21/22 n=220 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6341 lcod 36'6339 mlcod 36'6339 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.170 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.168+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6030 (0'0,36'6030] local-lis/les=21/22 n=78 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6028 crt=36'6028 lcod 36'6026 mlcod 36'6026 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.171 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.168+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6234 (0'0,36'6234] local-lis/les=21/22 n=147 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6232 crt=36'6232 lcod 36'6230 mlcod 36'6230 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.174 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.172+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6343 (0'0,36'6343] local-lis/les=21/22 n=218 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6341 crt=36'6341 lcod 36'6339 mlcod 36'6339 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.180 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.178+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6102 (0'0,36'6102] local-lis/les=21/22 n=170 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6102 lcod 36'6100 mlcod 36'6100 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.181 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.179+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6143 (0'0,36'6143] local-lis/les=21/22 n=130 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6143 lcod 36'6141 mlcod 36'6141 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.185 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.183+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6145 (0'0,36'6145] local-lis/les=21/22 n=128 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6143 crt=36'6143 lcod 36'6141 mlcod 36'6141 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.185 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.183+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6032 (0'0,36'6032] local-lis/les=21/22 n=76 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6032 lcod 36'6030 mlcod 36'6030 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.186 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.183+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6332 (0'0,36'6332] local-lis/les=21/22 n=135 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6330 crt=36'6326 lcod 36'6328 mlcod 36'6328 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.186 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.185+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6236 (0'0,36'6236] local-lis/les=21/22 n=145 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6236 lcod 36'6234 mlcod 36'6234 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.188 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.186+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6104 (0'0,36'6104] local-lis/les=21/22 n=168 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6102 crt=36'6102 lcod 36'6100 mlcod 36'6100 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.189 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.188+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6345 (0'0,36'6345] local-lis/les=21/22 n=216 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6345 lcod 36'6343 mlcod 36'6343 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.190 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.188+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6023 (0'0,36'6023] local-lis/les=21/22 n=127 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6023 lcod 36'6021 mlcod 36'6021 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.191 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.189+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6238 (0'0,36'6238] local-lis/les=21/22 n=143 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6236 crt=36'6236 lcod 36'6234 mlcod 36'6234 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.192 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.191+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6334 (0'0,36'6334] local-lis/les=21/22 n=133 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6330 crt=36'6330 lcod 36'6328 mlcod 36'6328 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.193 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.191+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6034 (0'0,36'6034] local-lis/les=21/22 n=74 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6032 crt=36'6032 lcod 36'6030 mlcod 36'6030 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.195 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.193+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6347 (0'0,36'6347] local-lis/les=21/22 n=214 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6345 crt=36'6345 lcod 36'6343 mlcod 36'6343 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.198 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.196+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6025 (0'0,36'6025] local-lis/les=21/22 n=125 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6023 crt=36'6023 lcod 36'6021 mlcod 36'6021 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.202 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.200+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6147 (0'0,36'6147] local-lis/les=21/22 n=126 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6147 lcod 36'6145 mlcod 36'6145 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.205 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.203+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6149 (0'0,36'6149] local-lis/les=21/22 n=124 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6147 crt=36'6147 lcod 36'6145 mlcod 36'6145 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.208 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.206+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6336 (0'0,36'6336] local-lis/les=21/22 n=131 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6336 lcod 36'6334 mlcod 36'6334 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.209 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.206+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6106 (0'0,36'6106] local-lis/les=21/22 n=166 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6106 lcod 36'6104 mlcod 36'6104 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.211 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.209+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6338 (0'0,36'6338] local-lis/les=21/22 n=129 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6336 crt=36'6336 lcod 36'6334 mlcod 36'6334 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.212 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.210+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6108 (0'0,36'6108] local-lis/les=21/22 n=164 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6106 crt=36'6106 lcod 36'6104 mlcod 36'6104 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.221 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.219+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6240 (0'0,36'6240] local-lis/les=21/22 n=141 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6240 lcod 36'6238 mlcod 36'6238 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.222 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.215+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6036 (0'0,36'6036] local-lis/les=21/22 n=72 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6036 lcod 36'6034 mlcod 36'6034 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.222 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.219+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6038 (0'0,36'6038] local-lis/les=21/22 n=70 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6036 crt=36'6036 lcod 36'6034 mlcod 36'6034 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.223 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.220+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6152 (0'0,36'6152] local-lis/les=21/22 n=121 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6151 crt=36'6147 lcod 36'6149 mlcod 36'6149 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.223 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.220+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6028 (0'0,36'6028] local-lis/les=21/22 n=122 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6028 lcod 36'6027 mlcod 36'6027 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.226 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.223+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6349 (0'0,36'6349] local-lis/les=21/22 n=212 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6349 lcod 36'6347 mlcod 36'6347 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.226 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.225+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6154 (0'0,36'6154] local-lis/les=21/22 n=119 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6151 crt=36'6151 lcod 36'6149 mlcod 36'6149 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.227 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.223+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6242 (0'0,36'6242] local-lis/les=21/22 n=139 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6240 crt=36'6240 lcod 36'6238 mlcod 36'6238 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.229 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.228+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6030 (0'0,36'6030] local-lis/les=21/22 n=120 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6028 crt=36'6028 lcod 36'6027 mlcod 36'6027 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.230 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.229+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6340 (0'0,36'6340] local-lis/les=21/22 n=127 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6340 lcod 36'6338 mlcod 36'6338 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.232 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.230+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6351 (0'0,36'6351] local-lis/les=21/22 n=210 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6349 crt=36'6349 lcod 36'6347 mlcod 36'6347 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.235 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.233+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6110 (0'0,36'6110] local-lis/les=21/22 n=162 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6110 lcod 36'6108 mlcod 36'6108 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.237 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.232+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6342 (0'0,36'6342] local-lis/les=21/22 n=125 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6340 crt=36'6340 lcod 36'6338 mlcod 36'6338 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.240 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.238+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6112 (0'0,36'6112] local-lis/les=21/22 n=160 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6110 crt=36'6110 lcod 36'6108 mlcod 36'6108 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.244 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.242+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6040 (0'0,36'6040] local-lis/les=21/22 n=68 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6040 lcod 36'6038 mlcod 36'6038 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.249 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.246+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6042 (0'0,36'6042] local-lis/les=21/22 n=66 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6040 crt=36'6040 lcod 36'6038 mlcod 36'6038 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.250 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.242+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6244 (0'0,36'6244] local-lis/les=21/22 n=137 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6244 lcod 36'6242 mlcod 36'6242 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.251 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.245+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6246 (0'0,36'6246] local-lis/les=21/22 n=135 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6244 crt=36'6244 lcod 36'6242 mlcod 36'6242 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.252 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.250+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6156 (0'0,36'6156] local-lis/les=21/22 n=117 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6156 lcod 36'6154 mlcod 36'6154 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.256 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.253+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6033 (0'0,36'6033] local-lis/les=21/22 n=117 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6033 lcod 36'6032 mlcod 36'6032 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.256 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.254+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6344 (0'0,36'6344] local-lis/les=21/22 n=123 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6344 lcod 36'6342 mlcod 36'6342 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.256 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.254+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6355 (0'0,36'6355] local-lis/les=21/22 n=206 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6354 crt=36'6351 lcod 36'6353 mlcod 36'6353 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.260 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.257+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6035 (0'0,36'6035] local-lis/les=21/22 n=115 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6033 crt=36'6033 lcod 36'6032 mlcod 36'6032 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.260 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.258+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6158 (0'0,36'6158] local-lis/les=21/22 n=115 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6156 crt=36'6156 lcod 36'6154 mlcod 36'6154 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.261 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.258+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6357 (0'0,36'6357] local-lis/les=21/22 n=204 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6354 crt=36'6354 lcod 36'6353 mlcod 36'6353 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.262 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.260+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6248 (0'0,36'6248] local-lis/les=21/22 n=133 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6248 lcod 36'6246 mlcod 36'6246 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.262 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.261+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6114 (0'0,36'6114] local-lis/les=21/22 n=158 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6114 lcod 36'6112 mlcod 36'6112 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.265 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.264+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6250 (0'0,36'6250] local-lis/les=21/22 n=131 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6248 crt=36'6248 lcod 36'6246 mlcod 36'6246 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.268 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.264+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6346 (0'0,36'6346] local-lis/les=21/22 n=121 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6344 crt=36'6344 lcod 36'6342 mlcod 36'6342 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.269 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.265+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6116 (0'0,36'6116] local-lis/les=21/22 n=156 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6114 crt=36'6114 lcod 36'6112 mlcod 36'6112 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.273 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.271+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6044 (0'0,36'6044] local-lis/les=21/22 n=64 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6044 lcod 36'6042 mlcod 36'6042 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.277 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.276+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6359 (0'0,36'6359] local-lis/les=21/22 n=202 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6359 lcod 36'6357 mlcod 36'6357 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.280 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.279+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6160 (0'0,36'6160] local-lis/les=21/22 n=113 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6160 lcod 36'6158 mlcod 36'6158 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.281 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.279+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6038 (0'0,36'6038] local-lis/les=21/22 n=112 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6038 lcod 36'6037 mlcod 36'6037 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.281 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.276+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6046 (0'0,36'6046] local-lis/les=21/22 n=62 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6044 crt=36'6044 lcod 36'6042 mlcod 36'6042 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.283 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.282+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6162 (0'0,36'6162] local-lis/les=21/22 n=111 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6160 crt=36'6160 lcod 36'6158 mlcod 36'6158 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.284 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.282+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6361 (0'0,36'6361] local-lis/les=21/22 n=200 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6359 crt=36'6359 lcod 36'6357 mlcod 36'6357 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.284 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.283+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6040 (0'0,36'6040] local-lis/les=21/22 n=110 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6038 crt=36'6038 lcod 36'6037 mlcod 36'6037 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.288 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.287+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6119 (0'0,36'6119] local-lis/les=21/22 n=153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6118 crt=36'6114 lcod 36'6116 mlcod 36'6116 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.292 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.287+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6348 (0'0,36'6348] local-lis/les=21/22 n=119 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6348 lcod 36'6346 mlcod 36'6346 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.292 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.291+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6121 (0'0,36'6121] local-lis/les=21/22 n=151 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6118 crt=36'6118 lcod 36'6116 mlcod 36'6116 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.294 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.292+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6253 (0'0,36'6253] local-lis/les=21/22 n=128 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6253 lcod 36'6252 mlcod 36'6252 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.296 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.292+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6048 (0'0,36'6048] local-lis/les=21/22 n=60 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6048 lcod 36'6046 mlcod 36'6046 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.298 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.296+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6255 (0'0,36'6255] local-lis/les=21/22 n=126 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6253 crt=36'6253 lcod 36'6252 mlcod 36'6252 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.298 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.297+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6050 (0'0,36'6050] local-lis/les=21/22 n=58 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6048 crt=36'6048 lcod 36'6046 mlcod 36'6046 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.306 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.304+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6042 (0'0,36'6042] local-lis/les=21/22 n=108 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6042 lcod 36'6040 mlcod 36'6040 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.309 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.307+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6044 (0'0,36'6044] local-lis/les=21/22 n=106 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6042 crt=36'6042 lcod 36'6040 mlcod 36'6040 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.310 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.308+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6164 (0'0,36'6164] local-lis/les=21/22 n=109 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6164 lcod 36'6162 mlcod 36'6162 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.312 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.306+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6363 (0'0,36'6363] local-lis/les=21/22 n=198 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6363 lcod 36'6361 mlcod 36'6361 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.313 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.312+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6166 (0'0,36'6166] local-lis/les=21/22 n=107 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6164 crt=36'6164 lcod 36'6162 mlcod 36'6162 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.314 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.312+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6351 (0'0,36'6351] local-lis/les=21/22 n=116 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6351 lcod 36'6350 mlcod 36'6350 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.314 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.313+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6258 (0'0,36'6258] local-lis/les=21/22 n=123 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6257 crt=36'6253 lcod 36'6255 mlcod 36'6255 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.315 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.313+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6365 (0'0,36'6365] local-lis/les=21/22 n=196 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6363 crt=36'6363 lcod 36'6361 mlcod 36'6361 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.316 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.314+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6123 (0'0,36'6123] local-lis/les=21/22 n=149 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6123 lcod 36'6121 mlcod 36'6121 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.318 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.317+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6353 (0'0,36'6353] local-lis/les=21/22 n=114 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6351 crt=36'6351 lcod 36'6350 mlcod 36'6350 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.319 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.318+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6125 (0'0,36'6125] local-lis/les=21/22 n=147 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6123 crt=36'6123 lcod 36'6121 mlcod 36'6121 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.323 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.321+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6260 (0'0,36'6260] local-lis/les=21/22 n=121 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6257 crt=36'6257 lcod 36'6255 mlcod 36'6255 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.330 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.328+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6368 (0'0,36'6368] local-lis/les=21/22 n=193 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6367 crt=36'6363 lcod 36'6365 mlcod 36'6365 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.330 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.328+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6046 (0'0,36'6046] local-lis/les=21/22 n=104 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6046 lcod 36'6044 mlcod 36'6044 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.333 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.332+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6370 (0'0,36'6370] local-lis/les=21/22 n=191 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6367 crt=36'6367 lcod 36'6365 mlcod 36'6365 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.334 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.324+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6052 (0'0,36'6052] local-lis/les=21/22 n=56 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6052 lcod 36'6050 mlcod 36'6050 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.335 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.332+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6054 (0'0,36'6054] local-lis/les=21/22 n=54 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=36'6052 crt=36'6052 lcod 36'6050 mlcod 36'6050 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.336 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.334+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6127 (0'0,36'6127] local-lis/les=21/22 n=145 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6127 lcod 36'6125 mlcod 36'6125 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.337 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.334+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6048 (0'0,36'6048] local-lis/les=21/22 n=102 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6046 crt=36'6046 lcod 36'6044 mlcod 36'6044 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.338 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.335+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6263 (0'0,36'6263] local-lis/les=21/22 n=118 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6262 crt=36'6258 lcod 36'6260 mlcod 36'6260 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.338 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.335+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6355 (0'0,36'6355] local-lis/les=21/22 n=112 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6355 lcod 36'6353 mlcod 36'6353 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.341 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.339+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6357 (0'0,36'6357] local-lis/les=21/22 n=110 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6355 crt=36'6355 lcod 36'6353 mlcod 36'6353 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.342 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.339+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6265 (0'0,36'6265] local-lis/les=21/22 n=116 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6262 crt=36'6262 lcod 36'6260 mlcod 36'6260 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.343 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.342+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6168 (0'0,36'6168] local-lis/les=21/22 n=105 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6168 lcod 36'6166 mlcod 36'6166 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.347 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.342+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6129 (0'0,36'6129] local-lis/les=21/22 n=143 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6127 crt=36'6127 lcod 36'6125 mlcod 36'6125 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.349 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.345+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6170 (0'0,36'6170] local-lis/les=21/22 n=103 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6168 crt=36'6168 lcod 36'6166 mlcod 36'6166 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.351 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.349+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6050 (0'0,36'6050] local-lis/les=21/22 n=100 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6050 lcod 36'6048 mlcod 36'6048 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.357 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.353+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6052 (0'0,36'6052] local-lis/les=21/22 n=98 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6050 crt=36'6050 lcod 36'6048 mlcod 36'6048 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.358 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.357+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6372 (0'0,36'6372] local-lis/les=21/22 n=189 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6372 lcod 36'6370 mlcod 36'6370 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.360 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.358+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6131 (0'0,36'6131] local-lis/les=21/22 n=141 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6131 lcod 36'6129 mlcod 36'6129 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.362 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.360+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6267 (0'0,36'6267] local-lis/les=21/22 n=114 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6267 lcod 36'6265 mlcod 36'6265 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.363 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:31:34.360+0000 7f2f20b32700 -1 osd.5 pg_epoch: 36 pg[3.5s0( v 36'6056 (0'0,36'6056] local-lis/les=21/22 n=52 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=36'6056 lcod 36'6054 mlcod 36'6054 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.363 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.360+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6374 (0'0,36'6374] local-lis/les=21/22 n=187 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6372 crt=36'6372 lcod 36'6370 mlcod 36'6370 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.364 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.361+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6133 (0'0,36'6133] local-lis/les=21/22 n=139 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6131 crt=36'6131 lcod 36'6129 mlcod 36'6129 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.366 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.364+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6172 (0'0,36'6172] local-lis/les=21/22 n=101 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6172 lcod 36'6170 mlcod 36'6170 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.369 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.367+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6269 (0'0,36'6269] local-lis/les=21/22 n=112 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6267 crt=36'6267 lcod 36'6265 mlcod 36'6265 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.373 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.370+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6360 (0'0,36'6360] local-lis/les=21/22 n=107 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6359 crt=36'6355 lcod 36'6357 mlcod 36'6357 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.375 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.372+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6174 (0'0,36'6174] local-lis/les=21/22 n=99 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6172 crt=36'6172 lcod 36'6170 mlcod 36'6170 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.375 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.373+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6054 (0'0,36'6054] local-lis/les=21/22 n=96 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6054 lcod 36'6052 mlcod 36'6052 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.376 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.374+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6362 (0'0,36'6362] local-lis/les=21/22 n=105 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6359 crt=36'6359 lcod 36'6357 mlcod 36'6357 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.378 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.377+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6056 (0'0,36'6056] local-lis/les=21/22 n=94 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6054 crt=36'6054 lcod 36'6052 mlcod 36'6052 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.380 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.378+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6377 (0'0,36'6377] local-lis/les=21/22 n=184 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6376 crt=36'6372 lcod 36'6374 mlcod 36'6374 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.384 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.382+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6379 (0'0,36'6379] local-lis/les=21/22 n=182 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6376 crt=36'6376 lcod 36'6374 mlcod 36'6374 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.386 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.385+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6271 (0'0,36'6271] local-lis/les=21/22 n=110 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6271 lcod 36'6269 mlcod 36'6269 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.388 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.387+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6135 (0'0,36'6135] local-lis/les=21/22 n=137 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6135 lcod 36'6133 mlcod 36'6133 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.391 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.389+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6273 (0'0,36'6273] local-lis/les=21/22 n=108 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6271 crt=36'6271 lcod 36'6269 mlcod 36'6269 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.389+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6176 (0'0,36'6176] local-lis/les=21/22 n=97 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6176 lcod 36'6174 mlcod 36'6174 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.395 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.393+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6178 (0'0,36'6178] local-lis/les=21/22 n=95 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6176 crt=36'6176 lcod 36'6174 mlcod 36'6174 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.396 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.393+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6137 (0'0,36'6137] local-lis/les=21/22 n=135 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6135 crt=36'6135 lcod 36'6133 mlcod 36'6133 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.411 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.397+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6364 (0'0,36'6364] local-lis/les=21/22 n=103 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6364 lcod 36'6362 mlcod 36'6362 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.413 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.398+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6059 (0'0,36'6059] local-lis/les=21/22 n=91 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6059 lcod 36'6058 mlcod 36'6058 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.414 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.402+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6061 (0'0,36'6061] local-lis/les=21/22 n=89 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6059 crt=36'6059 lcod 36'6058 mlcod 36'6058 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.414 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.405+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6366 (0'0,36'6366] local-lis/les=21/22 n=101 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6364 crt=36'6364 lcod 36'6362 mlcod 36'6362 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.414 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.407+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6382 (0'0,36'6382] local-lis/les=21/22 n=179 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6381 crt=36'6381 lcod 36'6379 mlcod 36'6379 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.415 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.407+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6139 (0'0,36'6139] local-lis/les=21/22 n=133 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6139 lcod 36'6137 mlcod 36'6137 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.416 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.411+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6141 (0'0,36'6141] local-lis/les=21/22 n=131 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6139 crt=36'6139 lcod 36'6137 mlcod 36'6137 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.416 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.412+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6276 (0'0,36'6276] local-lis/les=21/22 n=105 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6276 lcod 36'6275 mlcod 36'6275 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.416 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.411+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6384 (0'0,36'6384] local-lis/les=21/22 n=177 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6381 crt=36'6381 lcod 36'6379 mlcod 36'6379 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.418 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.416+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6278 (0'0,36'6278] local-lis/les=21/22 n=103 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6276 crt=36'6276 lcod 36'6275 mlcod 36'6275 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.423 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.422+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6369 (0'0,36'6369] local-lis/les=21/22 n=98 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6369 lcod 36'6368 mlcod 36'6368 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.426 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.424+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6180 (0'0,36'6180] local-lis/les=21/22 n=93 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6180 lcod 36'6178 mlcod 36'6178 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.428 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.425+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6371 (0'0,36'6371] local-lis/les=21/22 n=96 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6369 crt=36'6369 lcod 36'6368 mlcod 36'6368 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.430 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.427+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6143 (0'0,36'6143] local-lis/les=21/22 n=129 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6143 lcod 36'6141 mlcod 36'6141 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.431 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.428+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6182 (0'0,36'6182] local-lis/les=21/22 n=91 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6180 crt=36'6180 lcod 36'6178 mlcod 36'6178 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.434 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.431+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6386 (0'0,36'6386] local-lis/les=21/22 n=175 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6386 lcod 36'6384 mlcod 36'6384 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.436 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.434+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6063 (0'0,36'6063] local-lis/les=21/22 n=87 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6063 lcod 36'6061 mlcod 36'6061 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.437 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.431+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6145 (0'0,36'6145] local-lis/les=21/22 n=127 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6143 crt=36'6143 lcod 36'6141 mlcod 36'6141 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.440 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.438+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6280 (0'0,36'6280] local-lis/les=21/22 n=101 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6280 lcod 36'6278 mlcod 36'6278 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.442 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.440+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6388 (0'0,36'6388] local-lis/les=21/22 n=173 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6386 crt=36'6386 lcod 36'6384 mlcod 36'6384 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.444 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.439+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6065 (0'0,36'6065] local-lis/les=21/22 n=85 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6063 crt=36'6063 lcod 36'6061 mlcod 36'6061 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.445 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.442+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6282 (0'0,36'6282] local-lis/les=21/22 n=99 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6280 crt=36'6280 lcod 36'6278 mlcod 36'6278 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.452 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.451+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6373 (0'0,36'6373] local-lis/les=21/22 n=94 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6373 lcod 36'6371 mlcod 36'6371 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.453 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.451+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6147 (0'0,36'6147] local-lis/les=21/22 n=125 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6147 lcod 36'6145 mlcod 36'6145 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.455 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.454+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6375 (0'0,36'6375] local-lis/les=21/22 n=92 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6373 crt=36'6373 lcod 36'6371 mlcod 36'6371 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.456 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.455+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6184 (0'0,36'6184] local-lis/les=21/22 n=89 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6184 lcod 36'6182 mlcod 36'6182 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.461 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.459+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6186 (0'0,36'6186] local-lis/les=21/22 n=87 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6184 crt=36'6184 lcod 36'6182 mlcod 36'6182 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.464 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.462+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6067 (0'0,36'6067] local-lis/les=21/22 n=83 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6067 lcod 36'6065 mlcod 36'6065 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.464 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.461+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6149 (0'0,36'6149] local-lis/les=21/22 n=123 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6147 crt=36'6147 lcod 36'6145 mlcod 36'6145 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.465 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.463+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6393 (0'0,36'6393] local-lis/les=21/22 n=169 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6391 crt=36'6391 lcod 36'6390 mlcod 36'6390 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.467 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.465+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6285 (0'0,36'6285] local-lis/les=21/22 n=96 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6285 lcod 36'6284 mlcod 36'6284 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.469 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.468+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6069 (0'0,36'6069] local-lis/les=21/22 n=81 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6067 crt=36'6067 lcod 36'6065 mlcod 36'6065 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.471 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.470+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6287 (0'0,36'6287] local-lis/les=21/22 n=94 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6285 crt=36'6285 lcod 36'6284 mlcod 36'6284 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.476 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.475+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6378 (0'0,36'6378] local-lis/les=21/22 n=89 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6378 lcod 36'6377 mlcod 36'6377 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.480 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.478+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6071 (0'0,36'6071] local-lis/les=21/22 n=79 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6071 lcod 36'6069 mlcod 36'6069 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.480 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.478+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6380 (0'0,36'6380] local-lis/les=21/22 n=87 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6378 crt=36'6378 lcod 36'6377 mlcod 36'6377 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.480 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.479+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6152 (0'0,36'6152] local-lis/les=21/22 n=120 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6151 crt=36'6147 lcod 36'6149 mlcod 36'6149 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.484 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.482+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6073 (0'0,36'6073] local-lis/les=21/22 n=77 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6071 crt=36'6071 lcod 36'6069 mlcod 36'6069 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.485 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.483+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6154 (0'0,36'6154] local-lis/les=21/22 n=118 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6151 crt=36'6151 lcod 36'6149 mlcod 36'6149 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.492 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.484+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6289 (0'0,36'6289] local-lis/les=21/22 n=92 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6289 lcod 36'6287 mlcod 36'6287 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.494 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.492+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6189 (0'0,36'6189] local-lis/les=21/22 n=84 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6189 lcod 36'6188 mlcod 36'6188 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.495 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.494+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6395 (0'0,36'6395] local-lis/les=21/22 n=167 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6395 lcod 36'6393 mlcod 36'6393 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.496 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.495+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6191 (0'0,36'6191] local-lis/les=21/22 n=82 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6189 crt=36'6189 lcod 36'6188 mlcod 36'6188 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.498 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.497+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6397 (0'0,36'6397] local-lis/les=21/22 n=165 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6395 crt=36'6395 lcod 36'6393 mlcod 36'6393 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.506 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.500+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6382 (0'0,36'6382] local-lis/les=21/22 n=85 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6382 lcod 36'6380 mlcod 36'6380 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.507 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.504+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6384 (0'0,36'6384] local-lis/les=21/22 n=83 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6382 crt=36'6382 lcod 36'6380 mlcod 36'6380 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.508 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.506+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6293 (0'0,36'6293] local-lis/les=21/22 n=89 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6293 lcod 36'6291 mlcod 36'6291 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.508 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.507+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6077 (0'0,36'6077] local-lis/les=21/22 n=73 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6076 crt=36'6076 lcod 36'6075 mlcod 36'6075 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.512 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.511+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6079 (0'0,36'6079] local-lis/les=21/22 n=71 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6076 crt=36'6076 lcod 36'6075 mlcod 36'6075 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.513 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.511+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6193 (0'0,36'6193] local-lis/les=21/22 n=80 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6193 lcod 36'6191 mlcod 36'6191 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.516 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.515+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6195 (0'0,36'6195] local-lis/les=21/22 n=78 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6193 crt=36'6193 lcod 36'6191 mlcod 36'6191 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.516 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.511+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6295 (0'0,36'6295] local-lis/les=21/22 n=87 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6293 crt=36'6293 lcod 36'6291 mlcod 36'6291 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.522 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.520+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6399 (0'0,36'6399] local-lis/les=21/22 n=163 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6399 lcod 36'6397 mlcod 36'6397 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.523 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.521+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6157 (0'0,36'6157] local-lis/les=21/22 n=115 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6157 lcod 36'6156 mlcod 36'6156 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.529 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.524+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6386 (0'0,36'6386] local-lis/les=21/22 n=81 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6386 lcod 36'6384 mlcod 36'6384 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.529 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.527+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6388 (0'0,36'6388] local-lis/les=21/22 n=79 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6386 crt=36'6386 lcod 36'6384 mlcod 36'6384 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.531 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.530+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6081 (0'0,36'6081] local-lis/les=21/22 n=69 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6081 lcod 36'6079 mlcod 36'6079 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.532 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.529+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6159 (0'0,36'6159] local-lis/les=21/22 n=113 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6157 crt=36'6157 lcod 36'6156 mlcod 36'6156 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.533 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.524+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6401 (0'0,36'6401] local-lis/les=21/22 n=161 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6399 crt=36'6399 lcod 36'6397 mlcod 36'6397 active+clean+snaptrim trimq=[20f~19] ps=[1fe~11]] removing snap head 2020-02-11T16:31:34.535 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.532+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6299 (0'0,36'6299] local-lis/les=21/22 n=83 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6297 crt=36'6297 lcod 36'6295 mlcod 36'6295 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.537 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.535+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6301 (0'0,36'6301] local-lis/les=21/22 n=81 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6297 crt=36'6297 lcod 36'6295 mlcod 36'6295 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.543 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.540+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6403 (0'0,36'6403] local-lis/les=21/22 n=159 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6403 lcod 36'6401 mlcod 36'6401 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.543 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.541+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6161 (0'0,36'6161] local-lis/les=21/22 n=111 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6161 lcod 36'6159 mlcod 36'6159 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.544 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.539+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6083 (0'0,36'6083] local-lis/les=21/22 n=67 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6081 crt=36'6081 lcod 36'6079 mlcod 36'6079 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.544 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.542+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6197 (0'0,36'6197] local-lis/les=21/22 n=76 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6197 lcod 36'6195 mlcod 36'6195 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.545 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.543+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6390 (0'0,36'6390] local-lis/les=21/22 n=77 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6390 lcod 36'6388 mlcod 36'6388 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.549 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.547+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6392 (0'0,36'6392] local-lis/les=21/22 n=75 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6390 crt=36'6390 lcod 36'6388 mlcod 36'6388 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.549 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.547+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6199 (0'0,36'6199] local-lis/les=21/22 n=74 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6197 crt=36'6197 lcod 36'6195 mlcod 36'6195 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.550 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.547+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6405 (0'0,36'6405] local-lis/les=21/22 n=157 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6403 crt=36'6403 lcod 36'6401 mlcod 36'6401 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.553 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.551+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6163 (0'0,36'6163] local-lis/les=21/22 n=109 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6161 crt=36'6161 lcod 36'6159 mlcod 36'6159 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.557 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.555+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6303 (0'0,36'6303] local-lis/les=21/22 n=79 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6303 lcod 36'6301 mlcod 36'6301 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.560 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.559+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6407 (0'0,36'6407] local-lis/les=21/22 n=155 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6407 lcod 36'6405 mlcod 36'6405 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.564 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.559+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6086 (0'0,36'6086] local-lis/les=21/22 n=64 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6085 crt=36'6083 lcod 36'6083 mlcod 36'6083 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.565 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.562+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6409 (0'0,36'6409] local-lis/les=21/22 n=153 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6407 crt=36'6407 lcod 36'6405 mlcod 36'6405 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.566 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.563+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6394 (0'0,36'6394] local-lis/les=21/22 n=73 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6394 lcod 36'6392 mlcod 36'6392 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.566 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.564+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6088 (0'0,36'6088] local-lis/les=21/22 n=62 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6085 crt=36'6085 lcod 36'6083 mlcod 36'6083 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.568 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.564+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6201 (0'0,36'6201] local-lis/les=21/22 n=72 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6201 lcod 36'6199 mlcod 36'6199 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.570 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.568+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6396 (0'0,36'6396] local-lis/les=21/22 n=71 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6394 crt=36'6394 lcod 36'6392 mlcod 36'6392 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.570 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.567+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6203 (0'0,36'6203] local-lis/les=21/22 n=70 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6201 crt=36'6201 lcod 36'6199 mlcod 36'6199 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.572 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.571+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6305 (0'0,36'6305] local-lis/les=21/22 n=77 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6305 lcod 36'6303 mlcod 36'6303 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.573 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.567+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6166 (0'0,36'6166] local-lis/les=21/22 n=106 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6165 crt=36'6161 lcod 36'6163 mlcod 36'6163 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.574 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.572+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6168 (0'0,36'6168] local-lis/les=21/22 n=104 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6165 crt=36'6165 lcod 36'6163 mlcod 36'6163 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.576 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.574+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6307 (0'0,36'6307] local-lis/les=21/22 n=75 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6305 crt=36'6305 lcod 36'6303 mlcod 36'6303 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.577 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-hardlink.sh... 2020-02-11T16:31:34.578 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-hardlink.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-hardlink.sh 2020-02-11T16:31:34.584 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.579+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6090 (0'0,36'6090] local-lis/les=21/22 n=60 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6090 lcod 36'6088 mlcod 36'6088 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.584 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.583+0000 7efe5ce57700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6092 (0'0,36'6092] local-lis/les=21/22 n=58 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6090 crt=36'6090 lcod 36'6088 mlcod 36'6088 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.586 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.585+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6170 (0'0,36'6170] local-lis/les=21/22 n=102 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6170 lcod 36'6168 mlcod 36'6168 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.587 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.584+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6398 (0'0,36'6398] local-lis/les=21/22 n=69 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6398 lcod 36'6396 mlcod 36'6396 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.588 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.584+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6412 (0'0,36'6412] local-lis/les=21/22 n=150 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6411 crt=36'6409 lcod 36'6409 mlcod 36'6409 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.590 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.588+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6400 (0'0,36'6400] local-lis/les=21/22 n=67 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6398 crt=36'6398 lcod 36'6396 mlcod 36'6396 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.590 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.584+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6206 (0'0,36'6206] local-lis/les=21/22 n=67 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6205 crt=36'6201 lcod 36'6203 mlcod 36'6203 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.591 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.590+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6208 (0'0,36'6208] local-lis/les=21/22 n=65 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6205 crt=36'6205 lcod 36'6203 mlcod 36'6203 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.592 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.588+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6172 (0'0,36'6172] local-lis/les=21/22 n=100 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6170 crt=36'6170 lcod 36'6168 mlcod 36'6168 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.594 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.591+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6414 (0'0,36'6414] local-lis/les=21/22 n=148 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6411 crt=36'6411 lcod 36'6409 mlcod 36'6409 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.595 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.594+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6309 (0'0,36'6309] local-lis/les=21/22 n=73 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6309 lcod 36'6307 mlcod 36'6307 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.600 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.599+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6311 (0'0,36'6311] local-lis/les=21/22 n=71 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6309 crt=36'6309 lcod 36'6307 mlcod 36'6307 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.606 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.602+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6402 (0'0,36'6402] local-lis/les=21/22 n=65 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6402 lcod 36'6400 mlcod 36'6400 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.607 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.606+0000 7efe60e5f700 -1 osd.3 pg_epoch: 36 pg[3.7s0( v 36'6095 (0'0,36'6095] local-lis/les=21/22 n=55 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=36'6094 crt=36'6094 lcod 36'6092 mlcod 36'6092 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.608 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.607+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6417 (0'0,36'6417] local-lis/les=21/22 n=145 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6416 crt=36'6414 lcod 36'6414 mlcod 36'6414 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.609 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.607+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6174 (0'0,36'6174] local-lis/les=21/22 n=98 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6174 lcod 36'6172 mlcod 36'6172 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.610 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.608+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6404 (0'0,36'6404] local-lis/les=21/22 n=63 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6402 crt=36'6402 lcod 36'6400 mlcod 36'6400 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.612 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.610+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6419 (0'0,36'6419] local-lis/les=21/22 n=143 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6416 crt=36'6416 lcod 36'6414 mlcod 36'6414 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.616 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.614+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6176 (0'0,36'6176] local-lis/les=21/22 n=96 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6174 crt=36'6174 lcod 36'6172 mlcod 36'6172 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.616 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.613+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6210 (0'0,36'6210] local-lis/les=21/22 n=63 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6210 lcod 36'6208 mlcod 36'6208 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.618 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.617+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6212 (0'0,36'6212] local-lis/les=21/22 n=61 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6210 crt=36'6210 lcod 36'6208 mlcod 36'6208 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.624 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.623+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6313 (0'0,36'6313] local-lis/les=21/22 n=69 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6313 lcod 36'6311 mlcod 36'6311 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.627 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.625+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6406 (0'0,36'6406] local-lis/les=21/22 n=61 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6406 lcod 36'6404 mlcod 36'6404 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.628 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.626+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6315 (0'0,36'6315] local-lis/les=21/22 n=67 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6313 crt=36'6313 lcod 36'6311 mlcod 36'6311 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.631 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.629+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6408 (0'0,36'6408] local-lis/les=21/22 n=59 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6406 crt=36'6406 lcod 36'6404 mlcod 36'6404 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.635 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.630+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6421 (0'0,36'6421] local-lis/les=21/22 n=141 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6421 lcod 36'6419 mlcod 36'6419 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.635 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.631+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6178 (0'0,36'6178] local-lis/les=21/22 n=94 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6178 lcod 36'6176 mlcod 36'6176 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.636 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.634+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6423 (0'0,36'6423] local-lis/les=21/22 n=139 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6421 crt=36'6421 lcod 36'6419 mlcod 36'6419 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.637 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.635+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6180 (0'0,36'6180] local-lis/les=21/22 n=92 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6178 crt=36'6178 lcod 36'6176 mlcod 36'6176 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.639 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.637+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6215 (0'0,36'6215] local-lis/les=21/22 n=58 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6214 crt=36'6210 lcod 36'6212 mlcod 36'6212 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.644 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.641+0000 7efe63664700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6217 (0'0,36'6217] local-lis/les=21/22 n=56 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=36'6214 crt=36'6214 lcod 36'6212 mlcod 36'6212 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.644 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.642+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6317 (0'0,36'6317] local-lis/les=21/22 n=65 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6317 lcod 36'6315 mlcod 36'6315 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.648 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.646+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6319 (0'0,36'6319] local-lis/les=21/22 n=63 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6317 crt=36'6317 lcod 36'6315 mlcod 36'6315 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.652 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.650+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6182 (0'0,36'6182] local-lis/les=21/22 n=90 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6182 lcod 36'6180 mlcod 36'6180 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.656 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:31:34.656 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:31:34.658 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.657+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6425 (0'0,36'6425] local-lis/les=21/22 n=137 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6425 lcod 36'6423 mlcod 36'6423 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.659 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:34.657+0000 7efe5f65c700 -1 osd.3 pg_epoch: 36 pg[3.2s0( v 36'6219 (0'0,36'6219] local-lis/les=21/22 n=54 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=36'6219 lcod 36'6217 mlcod 36'6217 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.659 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.658+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6184 (0'0,36'6184] local-lis/les=21/22 n=88 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6182 crt=36'6182 lcod 36'6180 mlcod 36'6180 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.667 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.666+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6427 (0'0,36'6427] local-lis/les=21/22 n=135 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6425 crt=36'6425 lcod 36'6423 mlcod 36'6423 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.670 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.668+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6187 (0'0,36'6187] local-lis/les=21/22 n=85 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6186 crt=36'6182 lcod 36'6184 mlcod 36'6184 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.674 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.662+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6411 (0'0,36'6411] local-lis/les=21/22 n=56 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6411 lcod 36'6410 mlcod 36'6410 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.674 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.662+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6321 (0'0,36'6321] local-lis/les=21/22 n=61 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6321 lcod 36'6319 mlcod 36'6319 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.675 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.668+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6323 (0'0,36'6323] local-lis/les=21/22 n=59 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6321 crt=36'6321 lcod 36'6319 mlcod 36'6319 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.675 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.672+0000 7f63d907d700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6413 (0'0,36'6413] local-lis/les=21/22 n=54 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6411 crt=36'6411 lcod 36'6410 mlcod 36'6410 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.678 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.673+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6189 (0'0,36'6189] local-lis/les=21/22 n=83 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6186 crt=36'6186 lcod 36'6184 mlcod 36'6184 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.684 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.679+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6429 (0'0,36'6429] local-lis/les=21/22 n=133 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6429 lcod 36'6427 mlcod 36'6427 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.684 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.683+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6431 (0'0,36'6431] local-lis/les=21/22 n=131 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6429 crt=36'6429 lcod 36'6427 mlcod 36'6427 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.689 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.686+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6325 (0'0,36'6325] local-lis/les=21/22 n=57 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6325 lcod 36'6323 mlcod 36'6323 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.689 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.687+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6192 (0'0,36'6192] local-lis/les=21/22 n=80 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6191 crt=36'6186 lcod 36'6189 mlcod 36'6189 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.690 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.688+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6415 (0'0,36'6415] local-lis/les=21/22 n=52 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=36'6415 lcod 36'6413 mlcod 36'6413 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.695 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.691+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6327 (0'0,36'6327] local-lis/les=21/22 n=55 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6325 crt=36'6325 lcod 36'6323 mlcod 36'6323 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.695 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.693+0000 7f63dd085700 -1 osd.1 pg_epoch: 36 pg[3.0s0( v 36'6417 (0'0,36'6417] local-lis/les=21/22 n=50 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=36'6415 crt=36'6415 lcod 36'6413 mlcod 36'6413 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.696 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.694+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6194 (0'0,36'6194] local-lis/les=21/22 n=78 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6191 crt=36'6191 lcod 36'6189 mlcod 36'6189 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.714 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.710+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6196 (0'0,36'6196] local-lis/les=21/22 n=76 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6196 lcod 36'6194 mlcod 36'6194 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.718 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.714+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6198 (0'0,36'6198] local-lis/les=21/22 n=74 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6196 crt=36'6196 lcod 36'6194 mlcod 36'6194 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.718 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.715+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6329 (0'0,36'6329] local-lis/les=21/22 n=53 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6329 lcod 36'6327 mlcod 36'6327 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.723 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.721+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6433 (0'0,36'6433] local-lis/les=21/22 n=129 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6433 lcod 36'6431 mlcod 36'6431 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.723 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.719+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6331 (0'0,36'6331] local-lis/les=21/22 n=51 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6329 crt=36'6329 lcod 36'6327 mlcod 36'6327 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.728 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.725+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6435 (0'0,36'6435] local-lis/les=21/22 n=127 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6433 crt=36'6433 lcod 36'6431 mlcod 36'6431 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.732 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.730+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6200 (0'0,36'6200] local-lis/les=21/22 n=72 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6200 lcod 36'6198 mlcod 36'6198 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.737 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.736+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6333 (0'0,36'6333] local-lis/les=21/22 n=49 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6333 lcod 36'6331 mlcod 36'6331 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.738 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.737+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6202 (0'0,36'6202] local-lis/les=21/22 n=70 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6200 crt=36'6200 lcod 36'6198 mlcod 36'6198 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.742 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.740+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6335 (0'0,36'6335] local-lis/les=21/22 n=47 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=36'6333 crt=36'6333 lcod 36'6331 mlcod 36'6331 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.742 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.740+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6438 (0'0,36'6438] local-lis/les=21/22 n=124 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6437 crt=36'6435 lcod 36'6435 mlcod 36'6435 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.750 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.747+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6440 (0'0,36'6440] local-lis/les=21/22 n=122 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6437 crt=36'6437 lcod 36'6435 mlcod 36'6435 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.756 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.754+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6204 (0'0,36'6204] local-lis/les=21/22 n=68 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6204 lcod 36'6202 mlcod 36'6202 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.760 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.758+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6206 (0'0,36'6206] local-lis/les=21/22 n=66 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6204 crt=36'6204 lcod 36'6202 mlcod 36'6202 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.760 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.759+0000 7f63db081700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6337 (0'0,36'6337] local-lis/les=21/22 n=45 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6337 lcod 36'6335 mlcod 36'6335 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.765 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.763+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6442 (0'0,36'6442] local-lis/les=21/22 n=120 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6442 lcod 36'6440 mlcod 36'6440 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.768 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.767+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6444 (0'0,36'6444] local-lis/les=21/22 n=118 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6442 crt=36'6442 lcod 36'6440 mlcod 36'6440 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.779 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.777+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6209 (0'0,36'6209] local-lis/les=21/22 n=63 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6208 crt=36'6208 lcod 36'6206 mlcod 36'6206 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.780 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:34.779+0000 7f63d7079700 -1 osd.1 pg_epoch: 36 pg[3.4s0( v 36'6341 (0'0,36'6341] local-lis/les=21/22 n=42 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=36'6341 lcod 36'6339 mlcod 36'6339 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.788 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.786+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6211 (0'0,36'6211] local-lis/les=21/22 n=61 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6208 crt=36'6208 lcod 36'6206 mlcod 36'6206 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.790 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.788+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6448 (0'0,36'6448] local-lis/les=21/22 n=115 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6446 crt=36'6446 lcod 36'6444 mlcod 36'6444 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.801 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.799+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6213 (0'0,36'6213] local-lis/les=21/22 n=59 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6213 lcod 36'6211 mlcod 36'6211 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.805 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.803+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6215 (0'0,36'6215] local-lis/les=21/22 n=57 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6213 crt=36'6213 lcod 36'6211 mlcod 36'6211 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.810 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.805+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6452 (0'0,36'6452] local-lis/les=21/22 n=111 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6451 crt=36'6451 lcod 36'6450 mlcod 36'6450 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.810 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.809+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6454 (0'0,36'6454] local-lis/les=21/22 n=109 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6451 crt=36'6451 lcod 36'6450 mlcod 36'6450 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.810 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.802+0000 7ff8fd992700 1 Processor -- start 2020-02-11T16:31:34.811 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.802+0000 7ff8fd992700 1 -- start start 2020-02-11T16:31:34.811 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.803+0000 7ff8fd992700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8f80a2da0 0x7ff8f80a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:34.811 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.803+0000 7ff8fd992700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff8f8099fa0 0x7ff8f814f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:34.811 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.803+0000 7ff8fd992700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f80a37e0 con 0x7ff8f805ac40 2020-02-11T16:31:34.811 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.803+0000 7ff8fd992700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f80a24e0 con 0x7ff8f80a2da0 2020-02-11T16:31:34.811 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.803+0000 7ff8fd992700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f80a4350 con 0x7ff8f8099fa0 2020-02-11T16:31:34.812 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff8f805ac40 0x7ff8f8099890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48944/0 (socket says 172.21.15.88:48944) 2020-02-11T16:31:34.812 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f77fe700 1 -- 172.21.15.88:0/2548782273 learned_addr learned my addr 172.21.15.88:0/2548782273 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:34.812 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 --2- 172.21.15.88:0/2548782273 >> v2:172.21.15.88:3300/0 conn(0x7ff8f8099fa0 0x7ff8f814f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:34.812 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 -- 172.21.15.88:0/2548782273 >> v2:172.21.15.52:3300/0 conn(0x7ff8f80a2da0 msgr2=0x7ff8f80a14c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2020-02-11T16:31:34.812 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 --2- 172.21.15.88:0/2548782273 >> v2:172.21.15.52:3300/0 conn(0x7ff8f80a2da0 0x7ff8f80a14c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:34.812 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 -- 172.21.15.88:0/2548782273 >> v1:172.21.15.88:6789/0 conn(0x7ff8f805ac40 legacy=0x7ff8f8099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:34.812 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 -- 172.21.15.88:0/2548782273 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f80a26d0 con 0x7ff8f8099fa0 2020-02-11T16:31:34.812 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 --2- 172.21.15.88:0/2548782273 >> v2:172.21.15.88:3300/0 conn(0x7ff8f8099fa0 0x7ff8f814f660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8f00032b0 tx=0x7ff8f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.813 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 --2- 172.21.15.88:0/2548782273 >> v2:172.21.15.88:3300/0 conn(0x7ff8f8099fa0 0x7ff8f814f660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8f00032b0 tx=0x7ff8f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.813 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 --2- 172.21.15.88:0/2548782273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f8099fa0 0x7ff8f814f660 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7ff8f00032b0 tx=0x7ff8f0007dc0).ready entity=mon.1 client_cookie=bed7e5ad24f2fd9a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:34.813 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 --2- 172.21.15.88:0/2548782273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f8099fa0 0x7ff8f814f660 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff8f00032b0 tx=0x7ff8f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.813 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 --2- 172.21.15.88:0/2548782273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f8099fa0 0x7ff8f814f660 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff8f00032b0 tx=0x7ff8f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.813 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.804+0000 7ff8f7fff700 1 --2- 172.21.15.88:0/2548782273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f8099fa0 0x7ff8f814f660 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff8f00032b0 tx=0x7ff8f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.813 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.805+0000 7ff8f67fc700 1 -- 172.21.15.88:0/2548782273 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8f000a160 con 0x7ff8f8099fa0 2020-02-11T16:31:34.813 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.805+0000 7ff8f67fc700 1 -- 172.21.15.88:0/2548782273 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f000a2c0 con 0x7ff8f8099fa0 2020-02-11T16:31:34.814 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.805+0000 7ff8f67fc700 1 -- 172.21.15.88:0/2548782273 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8f000a620 con 0x7ff8f8099fa0 2020-02-11T16:31:34.814 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.808+0000 7ff8fd992700 1 -- 172.21.15.88:0/2548782273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f8099fa0 msgr2=0x7ff8f814f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:34.814 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.808+0000 7ff8fd992700 1 --2- 172.21.15.88:0/2548782273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f8099fa0 0x7ff8f814f660 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7ff8f00032b0 tx=0x7ff8f0007dc0).stop 2020-02-11T16:31:34.814 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.808+0000 7ff8fd992700 1 -- 172.21.15.88:0/2548782273 shutdown_connections 2020-02-11T16:31:34.814 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.808+0000 7ff8fd992700 1 --2- 172.21.15.88:0/2548782273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f8099fa0 0x7ff8f814f660 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:34.814 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.808+0000 7ff8fd992700 1 --2- 172.21.15.88:0/2548782273 >> v2:172.21.15.52:3300/0 conn(0x7ff8f80a2da0 0x7ff8f80a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:34.814 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.808+0000 7ff8fd992700 1 -- 172.21.15.88:0/2548782273 >> 172.21.15.88:0/2548782273 conn(0x7ff8f805c170 msgr2=0x7ff8f805a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:34.815 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.808+0000 7ff8fd992700 1 -- 172.21.15.88:0/2548782273 shutdown_connections 2020-02-11T16:31:34.815 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.808+0000 7ff8fd992700 1 -- 172.21.15.88:0/2548782273 wait complete. 2020-02-11T16:31:34.817 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.811+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6217 (0'0,36'6217] local-lis/les=21/22 n=55 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6217 lcod 36'6215 mlcod 36'6215 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.817 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.809+0000 7ff8fd992700 1 Processor -- start 2020-02-11T16:31:34.818 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.810+0000 7ff8fd992700 1 -- start start 2020-02-11T16:31:34.818 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.810+0000 7ff8fd992700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8f805ac40 0x7ff8f809cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:34.818 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.810+0000 7ff8fd992700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:34.818 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.810+0000 7ff8fd992700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f809d0a0 con 0x7ff8f80a2da0 2020-02-11T16:31:34.818 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.810+0000 7ff8fd992700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f809c310 con 0x7ff8f805ac40 2020-02-11T16:31:34.818 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.810+0000 7ff8fd992700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f809c500 con 0x7ff8f8099fa0 2020-02-11T16:31:34.818 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.810+0000 7ff8f77fe700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7ff8f805ac40 msgr2=0x7ff8f809cc40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:34.819 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.810+0000 7ff8f77fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8f805ac40 0x7ff8f809cc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:34.819 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.810+0000 7ff8f7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff8f80a2da0 0x7ff8f807e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48954/0 (socket says 172.21.15.88:48954) 2020-02-11T16:31:34.819 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.810+0000 7ff8f7fff700 1 -- 172.21.15.88:0/560652806 learned_addr learned my addr 172.21.15.88:0/560652806 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:34.819 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.811+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:34.819 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.811+0000 7ff8f6ffd700 1 -- 172.21.15.88:0/560652806 >> v2:172.21.15.52:3300/0 conn(0x7ff8f805ac40 msgr2=0x7ff8f809cc40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:34.819 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.811+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> v2:172.21.15.52:3300/0 conn(0x7ff8f805ac40 0x7ff8f809cc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:34.819 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.811+0000 7ff8f6ffd700 1 -- 172.21.15.88:0/560652806 >> v1:172.21.15.88:6789/0 conn(0x7ff8f80a2da0 legacy=0x7ff8f807e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:34.820 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.811+0000 7ff8f6ffd700 1 -- 172.21.15.88:0/560652806 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f809c7a0 con 0x7ff8f8099fa0 2020-02-11T16:31:34.820 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.811+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.820 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.811+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.820 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.811+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:34.820 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.811+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.820 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.812+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.820 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.812+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.821 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.812+0000 7ff8dffff700 1 -- 172.21.15.88:0/560652806 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e8007540 con 0x7ff8f8099fa0 2020-02-11T16:31:34.821 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.812+0000 7ff8dffff700 1 -- 172.21.15.88:0/560652806 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e8005930 con 0x7ff8f8099fa0 2020-02-11T16:31:34.821 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.812+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f8124ab0 con 0x7ff8f8099fa0 2020-02-11T16:31:34.821 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.812+0000 7ff8dffff700 1 -- 172.21.15.88:0/560652806 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e8005d50 con 0x7ff8f8099fa0 2020-02-11T16:31:34.821 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.812+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f807ebd0 con 0x7ff8f8099fa0 2020-02-11T16:31:34.821 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.813+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f809d230 con 0x7ff8f8099fa0 2020-02-11T16:31:34.821 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.813+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.821 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.813+0000 7ff8dffff700 1 -- 172.21.15.88:0/560652806 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff8e80088a0 con 0x7ff8f8099fa0 2020-02-11T16:31:34.822 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.813+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.822 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.813+0000 7ff8dffff700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff8d8039c80 0x7ff8d803c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:34.822 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.814+0000 7ff8dffff700 1 -- 172.21.15.88:0/560652806 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff8e8049650 con 0x7ff8f8099fa0 2020-02-11T16:31:34.823 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.817+0000 7f25f7552700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6219 (0'0,36'6219] local-lis/les=21/22 n=53 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6217 crt=36'6217 lcod 36'6215 mlcod 36'6215 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.823 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.819+0000 7ff8f77fe700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff8d8039c80 0x7ff8d803c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:34.823 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.819+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:34.824 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.819+0000 7ff8dffff700 1 -- 172.21.15.88:0/560652806 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff8f809d230 con 0x7ff8f8099fa0 2020-02-11T16:31:34.824 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:34.819+0000 7ff8f77fe700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff8d8039c80 0x7ff8d803c140 crc :-1 s=READY pgs=568 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:34.824 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.821+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6456 (0'0,36'6456] local-lis/les=21/22 n=107 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6456 lcod 36'6454 mlcod 36'6454 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.826 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.825+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6458 (0'0,36'6458] local-lis/les=21/22 n=105 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6456 crt=36'6456 lcod 36'6454 mlcod 36'6454 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.831 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.829+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6223 (0'0,36'6223] local-lis/les=21/22 n=49 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6221 crt=36'6219 lcod 36'6219 mlcod 36'6219 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.833 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.832+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6460 (0'0,36'6460] local-lis/les=21/22 n=103 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6460 lcod 36'6458 mlcod 36'6458 active+clean+snaptrim trimq=[210~18] ps=[1fe~12]] removing snap head 2020-02-11T16:31:34.835 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.833+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6225 (0'0,36'6225] local-lis/les=21/22 n=47 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6221 crt=36'6221 lcod 36'6219 mlcod 36'6219 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.846 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.845+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6462 (0'0,36'6462] local-lis/les=21/22 n=101 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6462 lcod 36'6460 mlcod 36'6460 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.847 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.845+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6227 (0'0,36'6227] local-lis/les=21/22 n=45 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=36'6227 lcod 36'6225 mlcod 36'6225 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.850 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.849+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6464 (0'0,36'6464] local-lis/les=21/22 n=99 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6462 crt=36'6462 lcod 36'6460 mlcod 36'6460 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.851 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:31:34.849+0000 7f25f354a700 -1 osd.4 pg_epoch: 36 pg[3.3s0( v 36'6229 (0'0,36'6229] local-lis/les=21/22 n=43 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=36'6227 crt=36'6227 lcod 36'6225 mlcod 36'6225 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.858 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.856+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6466 (0'0,36'6466] local-lis/les=21/22 n=97 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6466 lcod 36'6464 mlcod 36'6464 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.862 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.861+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6468 (0'0,36'6468] local-lis/les=21/22 n=95 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6466 crt=36'6466 lcod 36'6464 mlcod 36'6464 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.872 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.871+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6470 (0'0,36'6470] local-lis/les=21/22 n=93 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6470 lcod 36'6468 mlcod 36'6468 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.885 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.878+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6472 (0'0,36'6472] local-lis/les=21/22 n=91 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6470 crt=36'6470 lcod 36'6468 mlcod 36'6468 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.897 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.896+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6474 (0'0,36'6474] local-lis/les=21/22 n=89 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6474 lcod 36'6472 mlcod 36'6472 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.900 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.899+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6476 (0'0,36'6476] local-lis/les=21/22 n=87 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6474 crt=36'6474 lcod 36'6472 mlcod 36'6472 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.916 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.912+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6478 (0'0,36'6478] local-lis/les=21/22 n=85 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6478 lcod 36'6476 mlcod 36'6476 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.917 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.916+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6480 (0'0,36'6480] local-lis/les=21/22 n=83 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6478 crt=36'6478 lcod 36'6476 mlcod 36'6476 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.930 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.928+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6482 (0'0,36'6482] local-lis/les=21/22 n=81 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6482 lcod 36'6480 mlcod 36'6480 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.933 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.931+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6484 (0'0,36'6484] local-lis/les=21/22 n=79 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6482 crt=36'6482 lcod 36'6480 mlcod 36'6480 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.947 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.946+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6487 (0'0,36'6487] local-lis/les=21/22 n=76 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6487 lcod 36'6486 mlcod 36'6486 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.952 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.950+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6489 (0'0,36'6489] local-lis/les=21/22 n=74 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6487 crt=36'6487 lcod 36'6486 mlcod 36'6486 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.963 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.962+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6491 (0'0,36'6491] local-lis/les=21/22 n=72 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6491 lcod 36'6489 mlcod 36'6489 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.966 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.965+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6493 (0'0,36'6493] local-lis/les=21/22 n=70 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6491 crt=36'6491 lcod 36'6489 mlcod 36'6489 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.979 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.977+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6495 (0'0,36'6495] local-lis/les=21/22 n=68 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6495 lcod 36'6493 mlcod 36'6493 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.982 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.981+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6497 (0'0,36'6497] local-lis/les=21/22 n=66 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6495 crt=36'6495 lcod 36'6493 mlcod 36'6493 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:34.996 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.994+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6499 (0'0,36'6499] local-lis/les=21/22 n=64 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6499 lcod 36'6497 mlcod 36'6497 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.002 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:34.999+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6501 (0'0,36'6501] local-lis/les=21/22 n=62 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6499 crt=36'6499 lcod 36'6497 mlcod 36'6497 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.011 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:35.010+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6503 (0'0,36'6503] local-lis/les=21/22 n=60 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6503 lcod 36'6501 mlcod 36'6501 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.016 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:35.014+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6505 (0'0,36'6505] local-lis/les=21/22 n=58 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6503 crt=36'6503 lcod 36'6501 mlcod 36'6501 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.026 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:35.025+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6509 (0'0,36'6509] local-lis/les=21/22 n=54 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6507 crt=36'6503 lcod 36'6505 mlcod 36'6505 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.039 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:35.037+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6513 (0'0,36'6513] local-lis/les=21/22 n=51 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6513 lcod 36'6511 mlcod 36'6511 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.043 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:35.041+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6515 (0'0,36'6515] local-lis/les=21/22 n=49 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6513 crt=36'6513 lcod 36'6511 mlcod 36'6511 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.056 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:35.054+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6517 (0'0,36'6517] local-lis/les=21/22 n=47 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6517 lcod 36'6515 mlcod 36'6515 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.061 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:35.057+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6519 (0'0,36'6519] local-lis/les=21/22 n=45 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6517 crt=36'6517 lcod 36'6515 mlcod 36'6515 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.073 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:35.071+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6522 (0'0,36'6522] local-lis/les=21/22 n=42 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=36'6522 lcod 36'6521 mlcod 36'6521 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.076 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:31:35.075+0000 7f27cda35700 -1 osd.0 pg_epoch: 36 pg[3.1s0( v 36'6524 (0'0,36'6524] local-lis/les=21/22 n=40 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=36'6522 crt=36'6522 lcod 36'6521 mlcod 36'6521 active+clean+snaptrim trimq=[211~17] ps=[1fe~13]] removing snap head 2020-02-11T16:31:35.116 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:35.114+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff8f809d230 con 0x7ff8f8099fa0 2020-02-11T16:31:36.445 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:31:36.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.559+0000 7f9f39317700 1 Processor -- start 2020-02-11T16:31:36.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.559+0000 7f9f39317700 1 -- start start 2020-02-11T16:31:36.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.560+0000 7f9f39317700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 0x7f9f340a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:36.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.560+0000 7f9f39317700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340a31b0 con 0x7f9f340a5de0 2020-02-11T16:31:36.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.560+0000 7f9f39317700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340a3570 con 0x7f9f340a6260 2020-02-11T16:31:36.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.560+0000 7f9f39317700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f340a3810 con 0x7f9f340a18a0 2020-02-11T16:31:36.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.560+0000 7f9f337fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9f340a6260 0x7f9f3412eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48960/0 (socket says 172.21.15.88:48960) 2020-02-11T16:31:36.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.560+0000 7f9f337fe700 1 -- 172.21.15.88:0/14599433 learned_addr learned my addr 172.21.15.88:0/14599433 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:36.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.560+0000 7f9f32ffd700 1 -- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 msgr2=0x7f9f340a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:36.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.560+0000 7f9f327fc700 1 -- 172.21.15.88:0/14599433 >> v1:172.21.15.52:6789/0 conn(0x7f9f340a5de0 legacy=0x7f9f3412e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:36.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.560+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 0x7f9f340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:36.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.761+0000 7f9f327fc700 1 -- 172.21.15.88:0/14599433 >> v1:172.21.15.52:6789/0 conn(0x7f9f340a5de0 legacy=0x7f9f3412e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:36.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.761+0000 7f9f32ffd700 1 -- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 msgr2=0x7f9f340a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:36.762 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:36.761+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 0x7f9f340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:31:37.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:37.162+0000 7f9f327fc700 1 -- 172.21.15.88:0/14599433 >> v1:172.21.15.52:6789/0 conn(0x7f9f340a5de0 legacy=0x7f9f3412e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:37.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:37.162+0000 7f9f32ffd700 1 -- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 msgr2=0x7f9f340a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:37.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:37.162+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 0x7f9f340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:31:37.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:37.963+0000 7f9f32ffd700 1 -- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 msgr2=0x7f9f340a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:37.964 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:37.963+0000 7f9f327fc700 1 -- 172.21.15.88:0/14599433 >> v1:172.21.15.52:6789/0 conn(0x7f9f340a5de0 legacy=0x7f9f3412e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:37.965 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:37.963+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 0x7f9f340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:31:39.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:39.565+0000 7f9f32ffd700 1 -- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 msgr2=0x7f9f340a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:39.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:39.565+0000 7f9f327fc700 1 -- 172.21.15.88:0/14599433 >> v1:172.21.15.52:6789/0 conn(0x7f9f340a5de0 legacy=0x7f9f3412e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:39.567 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:39.565+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 0x7f9f340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:31:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:42.768+0000 7f9f32ffd700 1 -- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 msgr2=0x7f9f340a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:42.768+0000 7f9f327fc700 1 -- 172.21.15.88:0/14599433 >> v1:172.21.15.52:6789/0 conn(0x7f9f340a5de0 legacy=0x7f9f3412e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:42.768+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 0x7f9f340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 6.400000 2020-02-11T16:31:43.861 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.860+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269589559 0 0) 0x7f9f340a3570 con 0x7f9f340a6260 2020-02-11T16:31:43.862 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.860+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f18003230 con 0x7f9f340a6260 2020-02-11T16:31:43.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2621820980 0 0) 0x7f9f18003230 con 0x7f9f340a6260 2020-02-11T16:31:43.866 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 msgr2=0x7f9f340a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 --2- 172.21.15.88:0/14599433 >> v2:172.21.15.52:3300/0 conn(0x7f9f340a18a0 0x7f9f340a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 >> v1:172.21.15.52:6789/0 conn(0x7f9f340a5de0 legacy=0x7f9f3412e3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340a3ab0 con 0x7f9f340a6260 2020-02-11T16:31:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f9f240015b0 con 0x7f9f340a6260 2020-02-11T16:31:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 >> v1:172.21.15.88:6789/0 conn(0x7f9f340a6260 legacy=0x7f9f3412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 0x7f9f18003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f18003fa0 0x7f9f180044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f18004a20 0x7f9f18004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340a3810 con 0x7f9f18004a20 2020-02-11T16:31:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1800b7b0 con 0x7f9f18003720 2020-02-11T16:31:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1800b970 con 0x7f9f18003fa0 2020-02-11T16:31:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f337fe700 1 -- 172.21.15.88:0/14599433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f18004a20 msgr2=0x7f9f18004ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f337fe700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f18004a20 0x7f9f18004ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.863+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 0x7f9f18003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.864+0000 7f9f327fc700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f18003fa0 0x7f9f180044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:43.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.864+0000 7f9f32ffd700 1 -- 172.21.15.88:0/14599433 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f18003fa0 msgr2=0x7f9f180044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:43.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.864+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f18003fa0 0x7f9f180044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:43.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.864+0000 7f9f32ffd700 1 -- 172.21.15.88:0/14599433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f18004a20 msgr2=0x7f9f18004ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:43.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.864+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f18004a20 0x7f9f18004ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:43.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.864+0000 7f9f32ffd700 1 -- 172.21.15.88:0/14599433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18003230 con 0x7f9f18003720 2020-02-11T16:31:43.869 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.864+0000 7f9f337fe700 1 -- 172.21.15.88:0/14599433 reap_dead start 2020-02-11T16:31:43.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.864+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 0x7f9f18003b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f18004440 tx=0x7f9f2c008bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.864+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 0x7f9f18003b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f18004440 tx=0x7f9f2c008bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.870 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.864+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 0x7f9f18003b20 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f9f18004440 tx=0x7f9f2c008bd0).ready entity=mon.1 client_cookie=b0c3522f0b8921a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.865+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 0x7f9f18003b20 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f9f18004440 tx=0x7f9f2c008bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.865+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f2c00d4a0 con 0x7f9f18003720 2020-02-11T16:31:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.865+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 0x7f9f18003b20 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f9f18004440 tx=0x7f9f2c008bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.866+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c00d600 con 0x7f9f18003720 2020-02-11T16:31:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.866+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 0x7f9f18003b20 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f9f18004440 tx=0x7f9f2c008bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.866+0000 7f9f31ffb700 1 -- 172.21.15.88:0/14599433 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f2c00d960 con 0x7f9f18003720 2020-02-11T16:31:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.866+0000 7f9f39317700 1 -- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 msgr2=0x7f9f18003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.866+0000 7f9f39317700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 0x7f9f18003b20 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f9f18004440 tx=0x7f9f2c008bd0).stop 2020-02-11T16:31:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.866+0000 7f9f39317700 1 -- 172.21.15.88:0/14599433 shutdown_connections 2020-02-11T16:31:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.866+0000 7f9f39317700 1 --2- 172.21.15.88:0/14599433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f18003720 0x7f9f18003b20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.866+0000 7f9f39317700 1 -- 172.21.15.88:0/14599433 >> 172.21.15.88:0/14599433 conn(0x7f9f3409d110 msgr2=0x7f9f3409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.866+0000 7f9f39317700 1 -- 172.21.15.88:0/14599433 shutdown_connections 2020-02-11T16:31:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.866+0000 7f9f39317700 1 -- 172.21.15.88:0/14599433 wait complete. 2020-02-11T16:31:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.868+0000 7f9f39317700 1 Processor -- start 2020-02-11T16:31:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.868+0000 7f9f39317700 1 -- start start 2020-02-11T16:31:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.868+0000 7f9f39317700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f18003720 0x7f9f3409f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.868+0000 7f9f39317700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f341319a0 0x7f9f34129360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.868+0000 7f9f39317700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f34135020 con 0x7f9f341297c0 2020-02-11T16:31:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.868+0000 7f9f39317700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f341352c0 con 0x7f9f341319a0 2020-02-11T16:31:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.868+0000 7f9f39317700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f34135560 con 0x7f9f18003720 2020-02-11T16:31:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.868+0000 7f9f337fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9f341297c0 0x7f9f34134090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48996/0 (socket says 172.21.15.88:48996) 2020-02-11T16:31:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.868+0000 7f9f327fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f341319a0 0x7f9f34129360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.868+0000 7f9f337fe700 1 -- 172.21.15.88:0/1545708433 learned_addr learned my addr 172.21.15.88:0/1545708433 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f18003720 0x7f9f3409f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f327fc700 1 -- 172.21.15.88:0/1545708433 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f18003720 msgr2=0x7f9f3409f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f18003720 0x7f9f3409f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f327fc700 1 -- 172.21.15.88:0/1545708433 >> v1:172.21.15.88:6789/0 conn(0x7f9f341297c0 legacy=0x7f9f34134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f23fff700 1 -- 172.21.15.88:0/1545708433 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300084603 0 0) 0x7f9f34135020 con 0x7f9f341297c0 2020-02-11T16:31:43.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f327fc700 1 -- 172.21.15.88:0/1545708433 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f34129c10 con 0x7f9f341319a0 2020-02-11T16:31:43.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> v2:172.21.15.88:3300/0 conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> v2:172.21.15.88:3300/0 conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:43.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f23fff700 1 -- 172.21.15.88:0/1545708433 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f28010160 con 0x7f9f341319a0 2020-02-11T16:31:43.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f23fff700 1 -- 172.21.15.88:0/1545708433 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f280102c0 con 0x7f9f341319a0 2020-02-11T16:31:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f39317700 1 -- 172.21.15.88:0/1545708433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f34131f80 con 0x7f9f341319a0 2020-02-11T16:31:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f23fff700 1 -- 172.21.15.88:0/1545708433 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f28010620 con 0x7f9f341319a0 2020-02-11T16:31:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.869+0000 7f9f39317700 1 -- 172.21.15.88:0/1545708433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f341347a0 con 0x7f9f341319a0 2020-02-11T16:31:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.870+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.870+0000 7f9f23fff700 1 -- 172.21.15.88:0/1545708433 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f9f280126e0 con 0x7f9f341319a0 2020-02-11T16:31:43.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.870+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.870+0000 7f9f23fff700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f10039bb0 0x7f9f1003c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:43.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.870+0000 7f9f39317700 1 -- 172.21.15.88:0/1545708433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f340565b0 con 0x7f9f341319a0 2020-02-11T16:31:43.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.871+0000 7f9f23fff700 1 -- 172.21.15.88:0/1545708433 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f9f28049ce0 con 0x7f9f341319a0 2020-02-11T16:31:43.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.871+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f10039bb0 0x7f9f1003c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:43.880 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.871+0000 7f9f32ffd700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f10039bb0 0x7f9f1003c070 crc :-1 s=READY pgs=569 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:43.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.874+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:43.881 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:43.874+0000 7f9f23fff700 1 -- 172.21.15.88:0/1545708433 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f9f2802f1b0 con 0x7f9f341319a0 2020-02-11T16:31:44.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.062+0000 7f9f39317700 1 -- 172.21.15.88:0/1545708433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9f341356d0 con 0x7f9f341319a0 2020-02-11T16:31:44.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.062+0000 7f9f327fc700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.062+0000 7f9f23fff700 1 -- 172.21.15.88:0/1545708433 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f9f28031e90 con 0x7f9f341319a0 2020-02-11T16:31:44.065 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":218,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:44.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 -- 172.21.15.88:0/1545708433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f10039bb0 msgr2=0x7f9f1003c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f10039bb0 0x7f9f1003c070 crc :-1 s=READY pgs=569 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 -- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 msgr2=0x7f9f34129360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 0x7f9f34129360 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f9f28003c00 tx=0x7f9f28011080).stop 2020-02-11T16:31:44.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 -- 172.21.15.88:0/1545708433 shutdown_connections 2020-02-11T16:31:44.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9f10039bb0 0x7f9f1003c070 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f18003720 0x7f9f3409f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 --2- 172.21.15.88:0/1545708433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f341319a0 0x7f9f34129360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 -- 172.21.15.88:0/1545708433 >> 172.21.15.88:0/1545708433 conn(0x7f9f3409d110 msgr2=0x7f9f340a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:44.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 -- 172.21.15.88:0/1545708433 shutdown_connections 2020-02-11T16:31:44.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.063+0000 7f9f39317700 1 -- 172.21.15.88:0/1545708433 wait complete. 2020-02-11T16:31:44.075 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":218,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:31:44.076 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:31:44.076 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:31:44.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.181+0000 7faed77cd700 1 Processor -- start 2020-02-11T16:31:44.182 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.181+0000 7faed77cd700 1 -- start start 2020-02-11T16:31:44.189 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.181+0000 7faed77cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 0x7faed00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.181+0000 7faed77cd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faed00a6260 0x7faed012eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.181+0000 7faed77cd700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed00a3570 con 0x7faed00a5de0 2020-02-11T16:31:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.181+0000 7faed77cd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed00a3810 con 0x7faed00a18a0 2020-02-11T16:31:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.181+0000 7faed77cd700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed00a3ab0 con 0x7faed00a6260 2020-02-11T16:31:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faed00a6260 0x7faed012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5569700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 msgr2=0x7faed00a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed4d68700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faed00a5de0 0x7faed012e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49006/0 (socket says 172.21.15.88:49006) 2020-02-11T16:31:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed4d68700 1 -- 172.21.15.88:0/843602689 learned_addr learned my addr 172.21.15.88:0/843602689 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5569700 1 --2- 172.21.15.88:0/843602689 >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 0x7faed00a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 -- 172.21.15.88:0/843602689 >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 msgr2=0x7faed00a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 --2- 172.21.15.88:0/843602689 >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 0x7faed00a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 -- 172.21.15.88:0/843602689 >> v1:172.21.15.88:6789/0 conn(0x7faed00a5de0 legacy=0x7faed012e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faebffff700 1 -- 172.21.15.88:0/843602689 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734884651 0 0) 0x7faed00a3570 con 0x7faed00a5de0 2020-02-11T16:31:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 -- 172.21.15.88:0/843602689 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed00a3d50 con 0x7faed00a6260 2020-02-11T16:31:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 --2- 172.21.15.88:0/843602689 >> v2:172.21.15.88:3300/0 conn(0x7faed00a6260 0x7faed012eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faec80032b0 tx=0x7faec8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 --2- 172.21.15.88:0/843602689 >> v2:172.21.15.88:3300/0 conn(0x7faed00a6260 0x7faed012eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faec80032b0 tx=0x7faec8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 --2- 172.21.15.88:0/843602689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed00a6260 0x7faed012eab0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7faec80032b0 tx=0x7faec8007dc0).ready entity=mon.1 client_cookie=3463ec3646c2e44b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 --2- 172.21.15.88:0/843602689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed00a6260 0x7faed012eab0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7faec80032b0 tx=0x7faec8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faebffff700 1 -- 172.21.15.88:0/843602689 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec800a160 con 0x7faed00a6260 2020-02-11T16:31:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 --2- 172.21.15.88:0/843602689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed00a6260 0x7faed012eab0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7faec80032b0 tx=0x7faec8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.192 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faebffff700 1 -- 172.21.15.88:0/843602689 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800a2c0 con 0x7faed00a6260 2020-02-11T16:31:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed5d6a700 1 --2- 172.21.15.88:0/843602689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed00a6260 0x7faed012eab0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7faec80032b0 tx=0x7faec8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faebffff700 1 -- 172.21.15.88:0/843602689 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec800a660 con 0x7faed00a6260 2020-02-11T16:31:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed77cd700 1 -- 172.21.15.88:0/843602689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed00a6260 msgr2=0x7faed012eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.182+0000 7faed77cd700 1 --2- 172.21.15.88:0/843602689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed00a6260 0x7faed012eab0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7faec80032b0 tx=0x7faec8007dc0).stop 2020-02-11T16:31:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.183+0000 7faed77cd700 1 -- 172.21.15.88:0/843602689 shutdown_connections 2020-02-11T16:31:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.183+0000 7faed77cd700 1 --2- 172.21.15.88:0/843602689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed00a6260 0x7faed012eab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.183+0000 7faed77cd700 1 --2- 172.21.15.88:0/843602689 >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 0x7faed00a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.183+0000 7faed77cd700 1 -- 172.21.15.88:0/843602689 >> 172.21.15.88:0/843602689 conn(0x7faed009d110 msgr2=0x7faed009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.183+0000 7faed77cd700 1 -- 172.21.15.88:0/843602689 shutdown_connections 2020-02-11T16:31:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.183+0000 7faed77cd700 1 -- 172.21.15.88:0/843602689 wait complete. 2020-02-11T16:31:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed77cd700 1 Processor -- start 2020-02-11T16:31:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed77cd700 1 -- start start 2020-02-11T16:31:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed77cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 0x7faed0134fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed77cd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed77cd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed0135b80 con 0x7faed00a6260 2020-02-11T16:31:44.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed77cd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed0135970 con 0x7faed00a18a0 2020-02-11T16:31:44.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed77cd700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed0142d60 con 0x7faed00a5de0 2020-02-11T16:31:44.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed5d6a700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7faed00a6260 legacy=0x7faed0143200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:44.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed5569700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 msgr2=0x7faed0134fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:44.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed5569700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 0x7faed0134fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:44.195 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed4d68700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed4d68700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.88:55708/0 (socket says 172.21.15.88:55708) 2020-02-11T16:31:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.184+0000 7faed4d68700 1 -- 172.21.15.88:0/1821956920 learned_addr learned my addr 172.21.15.88:0/1821956920 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed4d68700 1 -- 172.21.15.88:0/1821956920 >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 msgr2=0x7faed0134fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed4d68700 1 --2- 172.21.15.88:0/1821956920 >> v2:172.21.15.52:3300/0 conn(0x7faed00a18a0 0x7faed0134fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed4d68700 1 -- 172.21.15.88:0/1821956920 >> v1:172.21.15.52:6789/0 conn(0x7faed00a6260 legacy=0x7faed0143200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed4d68700 1 -- 172.21.15.88:0/1821956920 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed012cdc0 con 0x7faed00a5de0 2020-02-11T16:31:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed4d68700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faed0138530 tx=0x7faec0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed4d68700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faed0138530 tx=0x7faec0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed4d68700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7faed0138530 tx=0x7faec0001e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed4d68700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7faed0138530 tx=0x7faec0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec000ca40 con 0x7faed00a5de0 2020-02-11T16:31:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed4d68700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7faed0138530 tx=0x7faec0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed4d68700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7faed0138530 tx=0x7faec0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000cba0 con 0x7faed00a5de0 2020-02-11T16:31:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed77cd700 1 -- 172.21.15.88:0/1821956920 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed0135430 con 0x7faed00a5de0 2020-02-11T16:31:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec000d0c0 con 0x7faed00a5de0 2020-02-11T16:31:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.185+0000 7faed77cd700 1 -- 172.21.15.88:0/1821956920 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed0143ad0 con 0x7faed00a5de0 2020-02-11T16:31:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.186+0000 7faed4d68700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7faed0138530 tx=0x7faec0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.186+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7faec00055c0 con 0x7faed00a5de0 2020-02-11T16:31:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.186+0000 7faed4d68700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7faed0138530 tx=0x7faec0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.186+0000 7faed77cd700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 0x7faed012eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.186+0000 7faed77cd700 1 -- 172.21.15.88:0/1821956920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed005e2f0 con 0x7faed0128880 2020-02-11T16:31:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.186+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 0x7faed012eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.186+0000 7faebe7fc700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faeb0039bd0 0x7faeb003c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.186+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7faec0049570 con 0x7faed00a5de0 2020-02-11T16:31:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.186+0000 7faed5569700 1 -- 172.21.15.88:0/1821956920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faed0135740 con 0x7faed0128880 2020-02-11T16:31:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faed5d6a700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faeb0039bd0 0x7faeb003c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.199 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 0x7faed012eb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 0x7faed012eb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 0x7faed012eb00 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 0x7faed012eb00 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faecc007550 con 0x7faed0128880 2020-02-11T16:31:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faed5d6a700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faeb0039bd0 0x7faeb003c090 crc :-1 s=READY pgs=570 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 0x7faed012eb00 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7faecc00ed40 con 0x7faed0128880 2020-02-11T16:31:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 msgr2=0x7faed012eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faebe7fc700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 0x7faed012eb00 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).stop 2020-02-11T16:31:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 msgr2=0x7faed012eb00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.187+0000 7faebe7fc700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed0128880 0x7faed012eb00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.195+0000 7faed77cd700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 0x7faed012b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.195+0000 7faed77cd700 1 -- 172.21.15.88:0/1821956920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed01355c0 con 0x7faed012b4c0 2020-02-11T16:31:44.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.195+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 0x7faed012b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.195+0000 7faed5569700 1 -- 172.21.15.88:0/1821956920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7faed00565b0 con 0x7faed012b4c0 2020-02-11T16:31:44.204 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.195+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 0x7faed012b8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.195+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 0x7faed012b8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.195+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 0x7faed012b8d0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 0x7faed012b8d0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faecc00f2b0 con 0x7faed012b4c0 2020-02-11T16:31:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed5569700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 0x7faed012b8d0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4181 (secure 0 0 0) 0x7faecc00f410 con 0x7faed012b4c0 2020-02-11T16:31:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 msgr2=0x7faed012b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faebe7fc700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 0x7faed012b8d0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).stop 2020-02-11T16:31:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faebe7fc700 1 -- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 msgr2=0x7faed012b8d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faebe7fc700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed012b4c0 0x7faed012b8d0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0x7faecc003480 tx=0x7faecc0108c0).stop 2020-02-11T16:31:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed77cd700 1 -- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faeb0039bd0 msgr2=0x7faeb003c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed77cd700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7faeb0039bd0 0x7faeb003c090 crc :-1 s=READY pgs=570 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed77cd700 1 -- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 msgr2=0x7faed0128420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed77cd700 1 --2- 172.21.15.88:0/1821956920 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faed00a5de0 0x7faed0128420 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7faed0138530 tx=0x7faec0001e40).stop 2020-02-11T16:31:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed5d6a700 1 -- 172.21.15.88:0/1821956920 reap_dead start 2020-02-11T16:31:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed5d6a700 1 -- 172.21.15.88:0/1821956920 reap_dead start 2020-02-11T16:31:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed77cd700 1 -- 172.21.15.88:0/1821956920 shutdown_connections 2020-02-11T16:31:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed77cd700 1 -- 172.21.15.88:0/1821956920 >> 172.21.15.88:0/1821956920 conn(0x7faed009d110 msgr2=0x7faed00a4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed77cd700 1 -- 172.21.15.88:0/1821956920 shutdown_connections 2020-02-11T16:31:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.196+0000 7faed77cd700 1 -- 172.21.15.88:0/1821956920 wait complete. 2020-02-11T16:31:44.208 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:31:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:31:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 218, 2020-02-11T16:31:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:31:44.208 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:31:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:31:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:31:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:31:44.209 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:31:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:44.210 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:31:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:31:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:44.211 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:31:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:31:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:31:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:31:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:31:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:31:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:31:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:31:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:31:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.214 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:31:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:31:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:31:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:31:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:44.215 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:31:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:44.216 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:31:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:31:44.217 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:31:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:44.218 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:31:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:31:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:31:44.220 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:31:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:44.221 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:31:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:31:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.223 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:31:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:31:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:31:44.224 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:31:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.225 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:31:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2020-02-11T16:31:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:31:44.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:31:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:31:44.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.228 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.228 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:31:44.230 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:31:44.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.334+0000 7f80b98d1700 1 Processor -- start 2020-02-11T16:31:44.336 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.334+0000 7f80b98d1700 1 -- start start 2020-02-11T16:31:44.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.335+0000 7f80b98d1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b40a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:44.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.335+0000 7f80b98d1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b40a4350 con 0x7f80b40a2fa0 2020-02-11T16:31:44.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.335+0000 7f80b98d1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b40a3a40 con 0x7f80b4131280 2020-02-11T16:31:44.345 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.335+0000 7f80b98d1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40a1e60 con 0x7f80b40a5b20 2020-02-11T16:31:44.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.335+0000 7f80b2ffd700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f80b40a2fa0 legacy=0x7f80b40a5410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:44.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.335+0000 7f80b37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f80b4131280 0x7f80b4131710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49020/0 (socket says 172.21.15.88:49020) 2020-02-11T16:31:44.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.335+0000 7f80b37fe700 1 -- 172.21.15.88:0/698814809 learned_addr learned my addr 172.21.15.88:0/698814809 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:44.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.335+0000 7f80b27fc700 1 --2- 172.21.15.88:0/698814809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b40a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.335+0000 7f80b1ffb700 1 -- 172.21.15.88:0/698814809 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647129276 0 0) 0x7f80b40a3a40 con 0x7f80b4131280 2020-02-11T16:31:44.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.335+0000 7f80b1ffb700 1 -- 172.21.15.88:0/698814809 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8098003230 con 0x7f80b4131280 2020-02-11T16:31:44.346 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b27fc700 1 -- 172.21.15.88:0/698814809 >> v1:172.21.15.88:6789/0 conn(0x7f80b4131280 legacy=0x7f80b4131710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b27fc700 1 -- 172.21.15.88:0/698814809 >> v1:172.21.15.52:6789/0 conn(0x7f80b40a2fa0 legacy=0x7f80b40a5410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:44.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b27fc700 1 -- 172.21.15.88:0/698814809 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40a3ce0 con 0x7f80b40a5b20 2020-02-11T16:31:44.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b27fc700 1 --2- 172.21.15.88:0/698814809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b40a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f80b40a52f0 tx=0x7f80a40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b27fc700 1 --2- 172.21.15.88:0/698814809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b40a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f80b40a52f0 tx=0x7f80a40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b27fc700 1 --2- 172.21.15.88:0/698814809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b40a1520 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f80b40a52f0 tx=0x7f80a40088e0).ready entity=mon.2 client_cookie=ad122a1a52ce79e1 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:44.347 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b27fc700 1 --2- 172.21.15.88:0/698814809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b40a1520 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f80b40a52f0 tx=0x7f80a40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b1ffb700 1 -- 172.21.15.88:0/698814809 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80a4008e40 con 0x7f80b40a5b20 2020-02-11T16:31:44.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b27fc700 1 --2- 172.21.15.88:0/698814809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b40a1520 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f80b40a52f0 tx=0x7f80a40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b1ffb700 1 -- 172.21.15.88:0/698814809 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a40126c0 con 0x7f80b40a5b20 2020-02-11T16:31:44.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b27fc700 1 --2- 172.21.15.88:0/698814809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b40a1520 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f80b40a52f0 tx=0x7f80a40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b98d1700 1 -- 172.21.15.88:0/698814809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 msgr2=0x7f80b40a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b98d1700 1 --2- 172.21.15.88:0/698814809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b40a1520 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f80b40a52f0 tx=0x7f80a40088e0).stop 2020-02-11T16:31:44.348 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b1ffb700 1 -- 172.21.15.88:0/698814809 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80a4012a60 con 0x7f80b40a5b20 2020-02-11T16:31:44.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b98d1700 1 -- 172.21.15.88:0/698814809 shutdown_connections 2020-02-11T16:31:44.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b98d1700 1 --2- 172.21.15.88:0/698814809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b40a1520 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b98d1700 1 -- 172.21.15.88:0/698814809 >> 172.21.15.88:0/698814809 conn(0x7f80b409d110 msgr2=0x7f80b409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:44.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.336+0000 7f80b98d1700 1 -- 172.21.15.88:0/698814809 shutdown_connections 2020-02-11T16:31:44.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.337+0000 7f80b98d1700 1 -- 172.21.15.88:0/698814809 wait complete. 2020-02-11T16:31:44.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.337+0000 7f80b98d1700 1 Processor -- start 2020-02-11T16:31:44.349 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.337+0000 7f80b98d1700 1 -- start start 2020-02-11T16:31:44.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80b98d1700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b4140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80b98d1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b4131f50 con 0x7f80b4131280 2020-02-11T16:31:44.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80b98d1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b4141bc0 con 0x7f80b40a2fa0 2020-02-11T16:31:44.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80b98d1700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4132180 con 0x7f80b40a5b20 2020-02-11T16:31:44.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80b37fe700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f80b4131280 legacy=0x7f80b414b5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:44.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80b2ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f80b40a2fa0 0x7f80b4132f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49022/0 (socket says 172.21.15.88:49022) 2020-02-11T16:31:44.350 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80b2ffd700 1 -- 172.21.15.88:0/329639354 learned_addr learned my addr 172.21.15.88:0/329639354 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:44.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378784126 0 0) 0x7f80b4141bc0 con 0x7f80b40a2fa0 2020-02-11T16:31:44.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8090002fe0 con 0x7f80b40a2fa0 2020-02-11T16:31:44.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80b27fc700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b4140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2153222058 0 0) 0x7f8090002fe0 con 0x7f80b40a2fa0 2020-02-11T16:31:44.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f80b4141bc0 con 0x7f80b40a2fa0 2020-02-11T16:31:44.351 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f80a8003ef0 con 0x7f80b40a2fa0 2020-02-11T16:31:44.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 msgr2=0x7f80b4140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80a3fff700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f80b4140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.338+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 >> v1:172.21.15.88:6789/0 conn(0x7f80b40a2fa0 legacy=0x7f80b4132f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 >> v1:172.21.15.52:6789/0 conn(0x7f80b4131280 legacy=0x7f80b414b5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:44.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80a3fff700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80900049b0 0x7f8090004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80a3fff700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f8090003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.352 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80a3fff700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4132180 con 0x7f80900049b0 2020-02-11T16:31:44.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80900047b0 con 0x7f8090003d80 2020-02-11T16:31:44.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8090005370 con 0x7f80b40a5b20 2020-02-11T16:31:44.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b2ffd700 1 -- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80900049b0 msgr2=0x7f8090004d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:44.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80900049b0 0x7f8090004d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:44.353 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b27fc700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f8090003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 -- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 msgr2=0x7f8090003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80b40a5b20 0x7f8090003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 -- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80900049b0 msgr2=0x7f8090004d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:44.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80900049b0 0x7f8090004d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.354 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 -- 172.21.15.88:0/329639354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4061080 con 0x7f8090003d80 2020-02-11T16:31:44.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b98d1700 1 -- 172.21.15.88:0/329639354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b4132c40 con 0x7f8090003d80 2020-02-11T16:31:44.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80ac001210 tx=0x7f80ac010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b98d1700 1 -- 172.21.15.88:0/329639354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b405b190 con 0x7f8090003d80 2020-02-11T16:31:44.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80ac001210 tx=0x7f80ac010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f80ac001210 tx=0x7f80ac010d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:44.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f80ac001210 tx=0x7f80ac010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.355 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80ac005d40 con 0x7f8090003d80 2020-02-11T16:31:44.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f80ac001210 tx=0x7f80ac010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f80ac001210 tx=0x7f80ac010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac012740 con 0x7f8090003d80 2020-02-11T16:31:44.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.339+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80ac005ea0 con 0x7f8090003d80 2020-02-11T16:31:44.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f80ac001210 tx=0x7f80ac010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80b98d1700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 0x7f80940058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.356 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80b98d1700 1 -- 172.21.15.88:0/329639354 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8094005ea0 con 0x7f8094003420 2020-02-11T16:31:44.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f80ac012b60 con 0x7f8090003d80 2020-02-11T16:31:44.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80b37fe700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f80ac001210 tx=0x7f80ac010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 0x7f80940058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80a3fff700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8090041e60 0x7f8090044320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f80ac049d60 con 0x7f8090003d80 2020-02-11T16:31:44.357 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80b2ffd700 1 -- 172.21.15.88:0/329639354 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8094006060 con 0x7f8094003420 2020-02-11T16:31:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80b27fc700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8090041e60 0x7f8090044320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 0x7f80940058e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 0x7f80940058e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.340+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 0x7f80940058e0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.341+0000 7f80b27fc700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8090041e60 0x7f8090044320 crc :-1 s=READY pgs=571 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.341+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 0x7f80940058e0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.341+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80a800b070 con 0x7f8094003420 2020-02-11T16:31:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.341+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 0x7f80940058e0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.341+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f80a8008210 con 0x7f8094003420 2020-02-11T16:31:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.341+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 msgr2=0x7f80940058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.341+0000 7f80a3fff700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 0x7f80940058e0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).stop 2020-02-11T16:31:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.341+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 msgr2=0x7f80940058e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.341+0000 7f80b37fe700 1 -- 172.21.15.88:0/329639354 reap_dead start 2020-02-11T16:31:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.341+0000 7f80a3fff700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094003420 0x7f80940058e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.349+0000 7f80b98d1700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 0x7f80940068c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:44.362 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.349+0000 7f80b98d1700 1 -- 172.21.15.88:0/329639354 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8094006df0 con 0x7f8094006410 2020-02-11T16:31:44.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.349+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 0x7f80940068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:44.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.349+0000 7f80b2ffd700 1 -- 172.21.15.88:0/329639354 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8094006fb0 con 0x7f8094006410 2020-02-11T16:31:44.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.349+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 0x7f80940068c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 0x7f80940068c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 0x7f80940068c0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:44.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 0x7f80940068c0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.363 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80a800ed00 con 0x7f8094006410 2020-02-11T16:31:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b2ffd700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 0x7f80940068c0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7f80a800ee60 con 0x7f8094006410 2020-02-11T16:31:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 msgr2=0x7f80940068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80a3fff700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 0x7f80940068c0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f80a8004050 tx=0x7f80a80113e0).stop 2020-02-11T16:31:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80a3fff700 1 -- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 msgr2=0x7f80940068c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:31:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80a3fff700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 0x7f80940068c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b98d1700 1 -- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8090041e60 msgr2=0x7f8090044320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b98d1700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8090041e60 0x7f8090044320 crc :-1 s=READY pgs=571 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b98d1700 1 -- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 msgr2=0x7f8090004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:44.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b98d1700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f80ac001210 tx=0x7f80ac010d20).stop 2020-02-11T16:31:44.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b98d1700 1 -- 172.21.15.88:0/329639354 shutdown_connections 2020-02-11T16:31:44.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b98d1700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f8090041e60 0x7f8090044320 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.365 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b98d1700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090003d80 0x7f8090004200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b98d1700 1 --2- 172.21.15.88:0/329639354 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8094006410 0x7f80940068c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:44.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.350+0000 7f80b98d1700 1 -- 172.21.15.88:0/329639354 >> 172.21.15.88:0/329639354 conn(0x7f80b409d110 msgr2=0x7f80b4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:44.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.351+0000 7f80b98d1700 1 -- 172.21.15.88:0/329639354 shutdown_connections 2020-02-11T16:31:44.366 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:31:44.351+0000 7f80b98d1700 1 -- 172.21.15.88:0/329639354 wait complete. 2020-02-11T16:31:44.366 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:31:44.366 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:44.367 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:44.367 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:31:44.367 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 218, 2020-02-11T16:31:44.367 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:31:44.368 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:31:44.368 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:31:44.368 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.368 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:31:44.368 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:44.369 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:31:44.369 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:31:44.369 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:44.369 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:44.369 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:44.369 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:44.369 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:44.370 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:44.370 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.370 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:31:44.370 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:31:44.370 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:44.371 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:44.371 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:44.371 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:44.371 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:44.371 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:44.371 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.372 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:31:44.372 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:31:44.372 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:31:44.372 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:31:44.372 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:31:44.372 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:31:44.372 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:44.373 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:31:44.373 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:31:44.373 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:31:44.373 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:31:44.373 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:31:44.373 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:31:44.373 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:31:44.374 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:31:44.374 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:31:44.374 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:31:44.374 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:31:44.374 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.374 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:31:44.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.375 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:31:44.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.375 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:31:44.375 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:31:44.375 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:44.375 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:44.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.376 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:44.376 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:31:44.376 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.376 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:44.377 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:31:44.377 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.377 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.377 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.378 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:31:44.378 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:31:44.378 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:44.378 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:44.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.378 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:31:44.378 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:31:44.379 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:44.379 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:44.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.379 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:44.379 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:31:44.379 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.380 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:44.380 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:31:44.380 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.380 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.380 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.381 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:31:44.381 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:31:44.381 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:44.381 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:44.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.382 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:31:44.382 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:31:44.382 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:31:44.382 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:31:44.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.383 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:31:44.383 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:31:44.383 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.383 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:31:44.383 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:31:44.384 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:31:44.384 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.384 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.384 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:31:44.384 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:31:44.385 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:31:44.385 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:31:44.385 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.385 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:31:44.385 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:31:44.385 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:31:44.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.386 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:44.386 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:44.386 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:44.386 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.387 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.387 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:31:44.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.387 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:44.387 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:44.387 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:31:44.387 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.388 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.388 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:31:44.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.388 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:44.388 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:44.388 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2020-02-11T16:31:44.388 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.389 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.389 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:31:44.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.389 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:44.389 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:44.389 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:31:44.389 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:31:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:31:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:31:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:31:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:31:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:31:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:31:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:31:44.391 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:31:44.391 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:31:44.812 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:44.811+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.868 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:44.866+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:44.868 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:44.866+0000 7ff8dffff700 1 -- 172.21.15.88:0/560652806 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v32) v1 ==== 167+0+0 (secure 0 0 0) 0x7ff8f809d230 con 0x7ff8f8099fa0 2020-02-11T16:31:45.006 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.004+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff8f809d230 con 0x7ff8f8099fa0 2020-02-11T16:31:45.924 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.922+0000 7ff8f6ffd700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:45.924 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.922+0000 7ff8dffff700 1 -- 172.21.15.88:0/560652806 <== mon.2 v2:172.21.15.52:3301/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v33) v1 ==== 167+0+0 (secure 0 0 0) 0x7ff8f809d230 con 0x7ff8f8099fa0 2020-02-11T16:31:45.926 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff8d8039c80 msgr2=0x7ff8d803c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:45.926 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff8d8039c80 0x7ff8d803c140 crc :-1 s=READY pgs=568 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:45.926 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 msgr2=0x7ff8f8125600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:45.926 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7ff8e8002f60 tx=0x7ff8e8010930).stop 2020-02-11T16:31:45.927 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 shutdown_connections 2020-02-11T16:31:45.927 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff8d8039c80 0x7ff8d803c140 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:45.927 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 --2- 172.21.15.88:0/560652806 >> v2:172.21.15.52:3300/0 conn(0x7ff8f805ac40 0x7ff8f809cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:45.927 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 --2- 172.21.15.88:0/560652806 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8f8099fa0 0x7ff8f8125600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:45.927 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 >> 172.21.15.88:0/560652806 conn(0x7ff8f805c170 msgr2=0x7ff8f80a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:45.927 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 shutdown_connections 2020-02-11T16:31:45.927 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:45.924+0000 7ff8fd992700 1 -- 172.21.15.88:0/560652806 wait complete. 2020-02-11T16:31:45.928 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:31:45.938 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir 1 2 2020-02-11T16:31:45.943 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo asdf 2020-02-11T16:31:45.945 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo asdf 2020-02-11T16:31:45.946 INFO:tasks.workunit.client.0.smithi088.stderr:+ ln 1/file1 2/file1 2020-02-11T16:31:45.954 INFO:tasks.workunit.client.0.smithi088.stderr:+ ln 1/file2 2/file2 2020-02-11T16:31:45.958 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir 2/.snap/s1 2020-02-11T16:31:45.973 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo qwer 2020-02-11T16:31:45.979 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep asdf 2/.snap/s1/file1 2020-02-11T16:31:45.991 INFO:tasks.workunit.client.0.smithi088.stdout:asdf 2020-02-11T16:31:45.991 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -f 1/file2 2020-02-11T16:31:45.996 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep asdf 2/.snap/s1/file2 2020-02-11T16:31:46.004 INFO:tasks.workunit.client.0.smithi088.stdout:asdf 2020-02-11T16:31:46.004 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -f 2/file2 2020-02-11T16:31:46.015 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep asdf 2/.snap/s1/file2 2020-02-11T16:31:46.020 INFO:tasks.workunit.client.0.smithi088.stdout:asdf 2020-02-11T16:31:46.021 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir 2/.snap/s1 2020-02-11T16:31:46.028 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf 1 2 2020-02-11T16:31:46.058 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:31:46.058 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:31:46.059 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:31:46.059 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:31:46.131 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-intodir.sh... 2020-02-11T16:31:46.132 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-intodir.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-intodir.sh 2020-02-11T16:31:46.165 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:31:46.254 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.249+0000 7fd8a481c700 1 Processor -- start 2020-02-11T16:31:46.254 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.249+0000 7fd8a481c700 1 -- start start 2020-02-11T16:31:46.254 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.250+0000 7fd8a481c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8a00a2da0 0x7fd8a00a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:46.254 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.250+0000 7fd8a481c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd8a0099fa0 0x7fd8a014f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:46.254 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.250+0000 7fd8a481c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a00a37e0 con 0x7fd8a005ac40 2020-02-11T16:31:46.255 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.250+0000 7fd8a481c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a00a24e0 con 0x7fd8a0099fa0 2020-02-11T16:31:46.255 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.250+0000 7fd8a481c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00a4350 con 0x7fd8a00a2da0 2020-02-11T16:31:46.255 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.250+0000 7fd89f59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd8a0099fa0 0x7fd8a014f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:46.255 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.250+0000 7fd89ed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd8a005ac40 0x7fd8a0099890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49040/0 (socket says 172.21.15.88:49040) 2020-02-11T16:31:46.255 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.250+0000 7fd89ed9d700 1 -- 172.21.15.88:0/2375363204 learned_addr learned my addr 172.21.15.88:0/2375363204 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:46.255 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.250+0000 7fd89e59c700 1 --2- 172.21.15.88:0/2375363204 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8a00a2da0 0x7fd8a00a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:46.255 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.250+0000 7fd89f59e700 1 -- 172.21.15.88:0/2375363204 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8a00a2da0 msgr2=0x7fd8a00a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:46.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89f59e700 1 --2- 172.21.15.88:0/2375363204 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8a00a2da0 0x7fd8a00a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:46.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89f59e700 1 -- 172.21.15.88:0/2375363204 >> v1:172.21.15.88:6789/0 conn(0x7fd8a005ac40 legacy=0x7fd8a0099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:46.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89dd9b700 1 -- 172.21.15.88:0/2375363204 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350474101 0 0) 0x7fd8a00a37e0 con 0x7fd8a005ac40 2020-02-11T16:31:46.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89f59e700 1 -- 172.21.15.88:0/2375363204 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00a26d0 con 0x7fd8a0099fa0 2020-02-11T16:31:46.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89f59e700 1 --2- 172.21.15.88:0/2375363204 >> v2:172.21.15.88:3300/0 conn(0x7fd8a0099fa0 0x7fd8a014f660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8a007f130 tx=0x7fd898008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89f59e700 1 --2- 172.21.15.88:0/2375363204 >> v2:172.21.15.88:3300/0 conn(0x7fd8a0099fa0 0x7fd8a014f660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8a007f130 tx=0x7fd898008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89f59e700 1 --2- 172.21.15.88:0/2375363204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a0099fa0 0x7fd8a014f660 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd898008c60).ready entity=mon.1 client_cookie=3be440991d09f99b server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:46.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89f59e700 1 --2- 172.21.15.88:0/2375363204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a0099fa0 0x7fd8a014f660 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd898008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89dd9b700 1 -- 172.21.15.88:0/2375363204 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd89800a160 con 0x7fd8a0099fa0 2020-02-11T16:31:46.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89f59e700 1 --2- 172.21.15.88:0/2375363204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a0099fa0 0x7fd8a014f660 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd898008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89f59e700 1 --2- 172.21.15.88:0/2375363204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a0099fa0 0x7fd8a014f660 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd898008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89dd9b700 1 -- 172.21.15.88:0/2375363204 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89800a2c0 con 0x7fd8a0099fa0 2020-02-11T16:31:46.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd89dd9b700 1 -- 172.21.15.88:0/2375363204 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd89800a660 con 0x7fd8a0099fa0 2020-02-11T16:31:46.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd8a481c700 1 -- 172.21.15.88:0/2375363204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a0099fa0 msgr2=0x7fd8a014f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:46.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd8a481c700 1 --2- 172.21.15.88:0/2375363204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a0099fa0 0x7fd8a014f660 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd898008c60).stop 2020-02-11T16:31:46.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd8a481c700 1 -- 172.21.15.88:0/2375363204 shutdown_connections 2020-02-11T16:31:46.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd8a481c700 1 --2- 172.21.15.88:0/2375363204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a0099fa0 0x7fd8a014f660 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:46.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd8a481c700 1 --2- 172.21.15.88:0/2375363204 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd8a00a2da0 0x7fd8a00a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:46.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd8a481c700 1 -- 172.21.15.88:0/2375363204 >> 172.21.15.88:0/2375363204 conn(0x7fd8a005c170 msgr2=0x7fd8a005a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:46.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd8a481c700 1 -- 172.21.15.88:0/2375363204 shutdown_connections 2020-02-11T16:31:46.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.251+0000 7fd8a481c700 1 -- 172.21.15.88:0/2375363204 wait complete. 2020-02-11T16:31:46.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.252+0000 7fd8a481c700 1 Processor -- start 2020-02-11T16:31:46.259 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.252+0000 7fd8a481c700 1 -- start start 2020-02-11T16:31:46.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd8a481c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8a005ac40 0x7fd8a009c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:46.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd8a481c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd8a00a2da0 0x7fd8a009db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:46.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd8a481c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a007f2c0 con 0x7fd8a0099fa0 2020-02-11T16:31:46.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd8a481c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a00a00d0 con 0x7fd8a005ac40 2020-02-11T16:31:46.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd8a481c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a00a02c0 con 0x7fd8a00a2da0 2020-02-11T16:31:46.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd89ed9d700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7fd8a005ac40 msgr2=0x7fd8a009c590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:46.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd89e59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd8a0099fa0 0x7fd8a0099240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49046/0 (socket says 172.21.15.88:49046) 2020-02-11T16:31:46.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd89e59c700 1 -- 172.21.15.88:0/3912351152 learned_addr learned my addr 172.21.15.88:0/3912351152 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:46.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd89ed9d700 1 --2- 172.21.15.88:0/3912351152 >> v2:172.21.15.52:3300/0 conn(0x7fd8a005ac40 0x7fd8a009c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:46.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> v2:172.21.15.88:3300/0 conn(0x7fd8a00a2da0 0x7fd8a009db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:46.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd88f7fe700 1 -- 172.21.15.88:0/3912351152 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744316361 0 0) 0x7fd8a007f2c0 con 0x7fd8a0099fa0 2020-02-11T16:31:46.263 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd88f7fe700 1 -- 172.21.15.88:0/3912351152 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd884003230 con 0x7fd8a0099fa0 2020-02-11T16:31:46.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd89f59e700 1 -- 172.21.15.88:0/3912351152 >> v2:172.21.15.52:3300/0 conn(0x7fd8a005ac40 msgr2=0x7fd8a009c590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:46.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> v2:172.21.15.52:3300/0 conn(0x7fd8a005ac40 0x7fd8a009c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:46.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd89f59e700 1 -- 172.21.15.88:0/3912351152 >> v1:172.21.15.88:6789/0 conn(0x7fd8a0099fa0 legacy=0x7fd8a0099240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:46.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd89f59e700 1 -- 172.21.15.88:0/3912351152 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00a0560 con 0x7fd8a00a2da0 2020-02-11T16:31:46.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.253+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> v2:172.21.15.88:3300/0 conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> v2:172.21.15.88:3300/0 conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.264 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:46.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd88f7fe700 1 -- 172.21.15.88:0/3912351152 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd898008a70 con 0x7fd8a00a2da0 2020-02-11T16:31:46.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd88f7fe700 1 -- 172.21.15.88:0/3912351152 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89800ae80 con 0x7fd8a00a2da0 2020-02-11T16:31:46.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd88f7fe700 1 -- 172.21.15.88:0/3912351152 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd898005e20 con 0x7fd8a00a2da0 2020-02-11T16:31:46.265 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a007afb0 con 0x7fd8a00a2da0 2020-02-11T16:31:46.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a009c9f0 con 0x7fd8a00a2da0 2020-02-11T16:31:46.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd88f7fe700 1 -- 172.21.15.88:0/3912351152 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fd89800f570 con 0x7fd8a00a2da0 2020-02-11T16:31:46.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.254+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.255+0000 7fd88f7fe700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd884039f60 0x7fd88403c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:46.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.255+0000 7fd88f7fe700 1 -- 172.21.15.88:0/3912351152 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fd89804a750 con 0x7fd8a00a2da0 2020-02-11T16:31:46.266 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.255+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a00565b0 con 0x7fd8a00a2da0 2020-02-11T16:31:46.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.255+0000 7fd89ed9d700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd884039f60 0x7fd88403c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:46.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.255+0000 7fd89ed9d700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd884039f60 0x7fd88403c420 crc :-1 s=READY pgs=572 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:46.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.258+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.267 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.258+0000 7fd88f7fe700 1 -- 172.21.15.88:0/3912351152 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd89802fe10 con 0x7fd8a00a2da0 2020-02-11T16:31:46.439 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.437+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd8a00a0920 con 0x7fd8a00a2da0 2020-02-11T16:31:46.925 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:31:46.923+0000 7efe60e5f700 -1 osd.3 pg_epoch: 37 pg[3.7s0( v 36'6155 (0'0,36'6155] local-lis/les=21/22 n=2 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=36'6155 lcod 36'6154 mlcod 36'6154 active+clean+snaptrim trimq=[228~2] ps=[1fe~2a]] removing snap head 2020-02-11T16:31:46.930 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.928+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:46.930 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:46.928+0000 7fd88f7fe700 1 -- 172.21.15.88:0/3912351152 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v34) v1 ==== 167+0+0 (secure 0 0 0) 0x7fd898032900 con 0x7fd8a00a2da0 2020-02-11T16:31:47.071 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.070+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd8a00a0cc0 con 0x7fd8a00a2da0 2020-02-11T16:31:47.936 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.934+0000 7fd89f59e700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:47.936 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.934+0000 7fd88f7fe700 1 -- 172.21.15.88:0/3912351152 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v35) v1 ==== 167+0+0 (secure 0 0 0) 0x7fd898032d40 con 0x7fd8a00a2da0 2020-02-11T16:31:47.938 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd884039f60 msgr2=0x7fd88403c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:47.938 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd884039f60 0x7fd88403c420 crc :-1 s=READY pgs=572 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:47.938 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 msgr2=0x7fd8a009db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:47.939 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fd8a007f130 tx=0x7fd8a005fbb0).stop 2020-02-11T16:31:47.939 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 shutdown_connections 2020-02-11T16:31:47.939 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8a00a2da0 0x7fd8a009db90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:47.939 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 --2- 172.21.15.88:0/3912351152 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fd884039f60 0x7fd88403c420 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:47.939 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 --2- 172.21.15.88:0/3912351152 >> v2:172.21.15.52:3300/0 conn(0x7fd8a005ac40 0x7fd8a009c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:47.939 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 >> 172.21.15.88:0/3912351152 conn(0x7fd8a005c170 msgr2=0x7fd8a0069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:47.940 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 shutdown_connections 2020-02-11T16:31:47.940 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:47.936+0000 7fd8a481c700 1 -- 172.21.15.88:0/3912351152 wait complete. 2020-02-11T16:31:47.940 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:31:47.949 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir foo 2020-02-11T16:31:47.952 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir foo/.snap/one 2020-02-11T16:31:47.962 INFO:tasks.workunit.client.0.smithi088.stderr:+ touch bar 2020-02-11T16:31:47.964 INFO:tasks.workunit.client.0.smithi088.stderr:+ mv bar foo 2020-02-11T16:31:47.968 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:31:49.732 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir baz 2020-02-11T16:31:49.735 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir baz/.snap/two 2020-02-11T16:31:49.744 INFO:tasks.workunit.client.0.smithi088.stderr:+ mv baz foo 2020-02-11T16:31:49.750 INFO:tasks.workunit.client.0.smithi088.stderr:+ sync 2020-02-11T16:31:49.896 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir foo/baz/.snap/two 2020-02-11T16:31:49.907 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir foo/.snap/one 2020-02-11T16:31:49.917 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -r foo 2020-02-11T16:31:49.956 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:31:49.956 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:31:49.957 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:31:49.957 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:31:50.103 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-multiple-capsnaps.sh... 2020-02-11T16:31:50.104 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-multiple-capsnaps.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh 2020-02-11T16:31:50.160 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:31:50.160 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:31:50.246 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.241+0000 7f9c56369700 1 Processor -- start 2020-02-11T16:31:50.246 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.241+0000 7f9c56369700 1 -- start start 2020-02-11T16:31:50.246 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c56369700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9c500a2da0 0x7f9c500a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:50.247 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c56369700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9c50099fa0 0x7f9c5014f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:50.247 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c56369700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500a37e0 con 0x7f9c5005ac40 2020-02-11T16:31:50.247 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c56369700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c500a24e0 con 0x7f9c500a2da0 2020-02-11T16:31:50.247 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c56369700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500a4350 con 0x7f9c50099fa0 2020-02-11T16:31:50.247 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c4ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9c500a2da0 0x7f9c500a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:50.247 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c54906700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9c5005ac40 0x7f9c50099890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49052/0 (socket says 172.21.15.88:49052) 2020-02-11T16:31:50.247 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c54906700 1 -- 172.21.15.88:0/4266954846 learned_addr learned my addr 172.21.15.88:0/4266954846 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:50.248 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c55107700 1 --2- 172.21.15.88:0/4266954846 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9c50099fa0 0x7f9c5014f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:50.248 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c4ffff700 1 -- 172.21.15.88:0/4266954846 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9c50099fa0 msgr2=0x7f9c5014f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:50.248 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c4ffff700 1 --2- 172.21.15.88:0/4266954846 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9c50099fa0 0x7f9c5014f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:50.248 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c4ffff700 1 -- 172.21.15.88:0/4266954846 >> v1:172.21.15.88:6789/0 conn(0x7f9c5005ac40 legacy=0x7f9c50099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:50.248 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c4f7fe700 1 -- 172.21.15.88:0/4266954846 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400783792 0 0) 0x7f9c500a37e0 con 0x7f9c5005ac40 2020-02-11T16:31:50.248 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c4ffff700 1 -- 172.21.15.88:0/4266954846 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500a26d0 con 0x7f9c500a2da0 2020-02-11T16:31:50.248 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c55107700 1 --2- 172.21.15.88:0/4266954846 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9c50099fa0 0x7f9c5014f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:31:50.249 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c4ffff700 1 --2- 172.21.15.88:0/4266954846 >> v2:172.21.15.88:3300/0 conn(0x7f9c500a2da0 0x7f9c500a14c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c500a4490 tx=0x7f9c440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.249 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c4ffff700 1 --2- 172.21.15.88:0/4266954846 >> v2:172.21.15.88:3300/0 conn(0x7f9c500a2da0 0x7f9c500a14c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c500a4490 tx=0x7f9c440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.249 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.242+0000 7f9c4ffff700 1 --2- 172.21.15.88:0/4266954846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c500a2da0 0x7f9c500a14c0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f9c500a4490 tx=0x7f9c440088e0).ready entity=mon.1 client_cookie=ada1bbf973f3c1ea server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:50.249 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c4ffff700 1 --2- 172.21.15.88:0/4266954846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c500a2da0 0x7f9c500a14c0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f9c500a4490 tx=0x7f9c440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.249 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c4f7fe700 1 -- 172.21.15.88:0/4266954846 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c44008e40 con 0x7f9c500a2da0 2020-02-11T16:31:50.249 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c4ffff700 1 --2- 172.21.15.88:0/4266954846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c500a2da0 0x7f9c500a14c0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f9c500a4490 tx=0x7f9c440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.250 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c4f7fe700 1 -- 172.21.15.88:0/4266954846 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44011660 con 0x7f9c500a2da0 2020-02-11T16:31:50.250 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c4ffff700 1 --2- 172.21.15.88:0/4266954846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c500a2da0 0x7f9c500a14c0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f9c500a4490 tx=0x7f9c440088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.250 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c4f7fe700 1 -- 172.21.15.88:0/4266954846 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c44011a00 con 0x7f9c500a2da0 2020-02-11T16:31:50.250 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c56369700 1 -- 172.21.15.88:0/4266954846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c500a2da0 msgr2=0x7f9c500a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:50.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c56369700 1 --2- 172.21.15.88:0/4266954846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c500a2da0 0x7f9c500a14c0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f9c500a4490 tx=0x7f9c440088e0).stop 2020-02-11T16:31:50.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c56369700 1 -- 172.21.15.88:0/4266954846 shutdown_connections 2020-02-11T16:31:50.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c56369700 1 --2- 172.21.15.88:0/4266954846 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9c50099fa0 0x7f9c5014f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:50.256 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c56369700 1 --2- 172.21.15.88:0/4266954846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c500a2da0 0x7f9c500a14c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:50.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c56369700 1 -- 172.21.15.88:0/4266954846 >> 172.21.15.88:0/4266954846 conn(0x7f9c5005c170 msgr2=0x7f9c5005a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:50.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c56369700 1 -- 172.21.15.88:0/4266954846 shutdown_connections 2020-02-11T16:31:50.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.243+0000 7f9c56369700 1 -- 172.21.15.88:0/4266954846 wait complete. 2020-02-11T16:31:50.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.244+0000 7f9c56369700 1 Processor -- start 2020-02-11T16:31:50.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.244+0000 7f9c56369700 1 -- start start 2020-02-11T16:31:50.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c56369700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9c5005ac40 0x7f9c5009e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:50.257 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c56369700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500a8c10 con 0x7f9c500a2da0 2020-02-11T16:31:50.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c56369700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500a0420 con 0x7f9c50099fa0 2020-02-11T16:31:50.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c56369700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5009de50 con 0x7f9c5005ac40 2020-02-11T16:31:50.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9c50099fa0 0x7f9c500a7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49060/0 (socket says 172.21.15.88:49060) 2020-02-11T16:31:50.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4ffff700 1 -- 172.21.15.88:0/2488172936 learned_addr learned my addr 172.21.15.88:0/2488172936 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:50.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c54906700 1 -- 172.21.15.88:0/2488172936 >> v2:172.21.15.52:3300/0 conn(0x7f9c5005ac40 msgr2=0x7f9c5009e830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:50.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c55107700 1 -- 172.21.15.88:0/2488172936 >> v1:172.21.15.52:6789/0 conn(0x7f9c500a2da0 legacy=0x7f9c500a8500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:50.258 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> v2:172.21.15.52:3300/0 conn(0x7f9c5005ac40 0x7f9c5009e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:50.259 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255523713 0 0) 0x7f9c500a0420 con 0x7f9c50099fa0 2020-02-11T16:31:50.259 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c30003230 con 0x7f9c50099fa0 2020-02-11T16:31:50.259 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 824813835 0 0) 0x7f9c30003230 con 0x7f9c50099fa0 2020-02-11T16:31:50.259 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9c500a0420 con 0x7f9c50099fa0 2020-02-11T16:31:50.259 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f9c44002f10 con 0x7f9c50099fa0 2020-02-11T16:31:50.259 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 >> v2:172.21.15.52:3300/0 conn(0x7f9c5005ac40 msgr2=0x7f9c5009e830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:50.259 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4d7fa700 1 --2- 172.21.15.88:0/2488172936 >> v2:172.21.15.52:3300/0 conn(0x7f9c5005ac40 0x7f9c5009e830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:50.260 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 >> v1:172.21.15.88:6789/0 conn(0x7f9c50099fa0 legacy=0x7f9c500a7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:50.260 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.245+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 >> v1:172.21.15.52:6789/0 conn(0x7f9c500a2da0 legacy=0x7f9c500a8500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:50.260 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c4d7fa700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:50.260 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c4d7fa700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9c30004050 0x7f9c30004510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:50.260 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c4d7fa700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c30004a80 0x7f9c30004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:50.260 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5009de50 con 0x7f9c30004a80 2020-02-11T16:31:50.260 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3000b860 con 0x7f9c300037f0 2020-02-11T16:31:50.261 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3000ba20 con 0x7f9c30004050 2020-02-11T16:31:50.261 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:50.261 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c55107700 1 -- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c30004a80 msgr2=0x7f9c30004f30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:50.261 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c55107700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c30004a80 0x7f9c30004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:50.261 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 -- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9c30004050 msgr2=0x7f9c30004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:50.261 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9c30004050 0x7f9c30004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:50.261 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 -- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c30004a80 msgr2=0x7f9c30004f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:50.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c30004a80 0x7f9c30004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:50.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c55107700 1 -- 172.21.15.88:0/2488172936 reap_dead start 2020-02-11T16:31:50.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 -- 172.21.15.88:0/2488172936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5009e0f0 con 0x7f9c300037f0 2020-02-11T16:31:50.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5009e390 con 0x7f9c300037f0 2020-02-11T16:31:50.262 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.270 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c50060d40 con 0x7f9c300037f0 2020-02-11T16:31:50.270 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.270 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:50.270 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.270 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c40007560 con 0x7f9c300037f0 2020-02-11T16:31:50.270 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.270 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c40007700 con 0x7f9c300037f0 2020-02-11T16:31:50.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.246+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c40007b20 con 0x7f9c300037f0 2020-02-11T16:31:50.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.247+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.247+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f9c40007c80 con 0x7f9c300037f0 2020-02-11T16:31:50.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.247+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c28003340 con 0x7f9c300037f0 2020-02-11T16:31:50.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.247+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.271 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.247+0000 7f9c4d7fa700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9c3003db00 0x7f9c3003ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:50.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.247+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f9c40049550 con 0x7f9c300037f0 2020-02-11T16:31:50.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.247+0000 7f9c4ffff700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9c3003db00 0x7f9c3003ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:50.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.248+0000 7f9c4ffff700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9c3003db00 0x7f9c3003ffc0 crc :-1 s=READY pgs=573 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:50.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.251+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.272 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.251+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f9c4002ebb0 con 0x7f9c300037f0 2020-02-11T16:31:50.432 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.427+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9c28002260 con 0x7f9c300037f0 2020-02-11T16:31:50.942 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.940+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:50.942 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:50.940+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v36) v1 ==== 167+0+0 (secure 0 0 0) 0x7f9c40031680 con 0x7f9c300037f0 2020-02-11T16:31:51.078 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.074+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9c28002660 con 0x7f9c300037f0 2020-02-11T16:31:51.947 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.944+0000 7f9c54906700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:51.947 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.944+0000 7f9c4d7fa700 1 -- 172.21.15.88:0/2488172936 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v37) v1 ==== 167+0+0 (secure 0 0 0) 0x7f9c40031ac0 con 0x7f9c300037f0 2020-02-11T16:31:51.950 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.948+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9c3003db00 msgr2=0x7f9c3003ffc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:51.950 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.948+0000 7f9c56369700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9c3003db00 0x7f9c3003ffc0 crc :-1 s=READY pgs=573 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:51.951 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.948+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 msgr2=0x7f9c30003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:51.951 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.948+0000 7f9c56369700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f9c400010d0 tx=0x7f9c40010ab0).stop 2020-02-11T16:31:51.952 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.950+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 shutdown_connections 2020-02-11T16:31:51.952 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.950+0000 7f9c56369700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9c3003db00 0x7f9c3003ffc0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:51.952 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.950+0000 7f9c56369700 1 --2- 172.21.15.88:0/2488172936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c300037f0 0x7f9c30003bd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:51.952 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.950+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 >> 172.21.15.88:0/2488172936 conn(0x7f9c5005c170 msgr2=0x7f9c500a9250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:51.953 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.950+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 shutdown_connections 2020-02-11T16:31:51.953 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:51.950+0000 7f9c56369700 1 -- 172.21.15.88:0/2488172936 wait complete. 2020-02-11T16:31:51.953 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:31:51.963 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo asdf 2020-02-11T16:31:51.966 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/1 2020-02-11T16:31:51.983 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 777 a 2020-02-11T16:31:51.984 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/2 2020-02-11T16:31:51.993 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo qwer 2020-02-11T16:31:52.001 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/3 2020-02-11T16:31:52.013 INFO:tasks.workunit.client.0.smithi088.stderr:+ chmod 666 a 2020-02-11T16:31:52.013 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/4 2020-02-11T16:31:52.021 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo zxcv 2020-02-11T16:31:52.025 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/5 2020-02-11T16:31:52.057 INFO:tasks.workunit.client.0.smithi088.stderr:+ ls -al .snap/1/a .snap/2/a .snap/3/a .snap/4/a .snap/5/a 2020-02-11T16:31:52.068 INFO:tasks.workunit.client.0.smithi088.stdout:-rw-rw-r--. 1 ubuntu ubuntu 5 Feb 11 16:31 .snap/1/a 2020-02-11T16:31:52.068 INFO:tasks.workunit.client.0.smithi088.stdout:-rwxrwxrwx. 1 ubuntu ubuntu 5 Feb 11 16:31 .snap/2/a 2020-02-11T16:31:52.068 INFO:tasks.workunit.client.0.smithi088.stdout:-rwxrwxrwx. 1 ubuntu ubuntu 5 Feb 11 16:31 .snap/3/a 2020-02-11T16:31:52.068 INFO:tasks.workunit.client.0.smithi088.stdout:-rw-rw-rw-. 1 ubuntu ubuntu 5 Feb 11 16:31 .snap/4/a 2020-02-11T16:31:52.068 INFO:tasks.workunit.client.0.smithi088.stdout:-rw-rw-rw-. 1 ubuntu ubuntu 5 Feb 11 16:31 .snap/5/a 2020-02-11T16:31:52.069 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep asdf .snap/1/a 2020-02-11T16:31:52.071 INFO:tasks.workunit.client.0.smithi088.stdout:asdf 2020-02-11T16:31:52.071 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/1/a 2020-02-11T16:31:52.072 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'Size: 5' 2020-02-11T16:31:52.074 INFO:tasks.workunit.client.0.smithi088.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2020-02-11T16:31:52.074 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep asdf .snap/2/a 2020-02-11T16:31:52.077 INFO:tasks.workunit.client.0.smithi088.stdout:asdf 2020-02-11T16:31:52.077 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/2/a 2020-02-11T16:31:52.077 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'Size: 5' 2020-02-11T16:31:52.083 INFO:tasks.workunit.client.0.smithi088.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2020-02-11T16:31:52.083 INFO:tasks.workunit.client.0.smithi088.stdout:Access: (0777/-rwxrwxrwx) Uid: ( 1000/ ubuntu) Gid: ( 1209/ ubuntu) 2020-02-11T16:31:52.083 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/2/a 2020-02-11T16:31:52.083 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep -- -rwxrwxrwx 2020-02-11T16:31:52.084 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep qwer .snap/3/a 2020-02-11T16:31:52.086 INFO:tasks.workunit.client.0.smithi088.stdout:qwer 2020-02-11T16:31:52.087 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/3/a 2020-02-11T16:31:52.087 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'Size: 5' 2020-02-11T16:31:52.089 INFO:tasks.workunit.client.0.smithi088.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2020-02-11T16:31:52.089 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/3/a 2020-02-11T16:31:52.089 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep -- -rwxrwxrwx 2020-02-11T16:31:52.091 INFO:tasks.workunit.client.0.smithi088.stdout:Access: (0777/-rwxrwxrwx) Uid: ( 1000/ ubuntu) Gid: ( 1209/ ubuntu) 2020-02-11T16:31:52.092 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep qwer .snap/4/a 2020-02-11T16:31:52.094 INFO:tasks.workunit.client.0.smithi088.stdout:qwer 2020-02-11T16:31:52.094 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/4/a 2020-02-11T16:31:52.094 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'Size: 5' 2020-02-11T16:31:52.097 INFO:tasks.workunit.client.0.smithi088.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2020-02-11T16:31:52.098 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/4/a 2020-02-11T16:31:52.098 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep -- -rw-rw-rw- 2020-02-11T16:31:52.100 INFO:tasks.workunit.client.0.smithi088.stdout:Access: (0666/-rw-rw-rw-) Uid: ( 1000/ ubuntu) Gid: ( 1209/ ubuntu) 2020-02-11T16:31:52.100 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep zxcv .snap/5/a 2020-02-11T16:31:52.107 INFO:tasks.workunit.client.0.smithi088.stdout:zxcv 2020-02-11T16:31:52.107 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/5/a 2020-02-11T16:31:52.107 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep 'Size: 5' 2020-02-11T16:31:52.109 INFO:tasks.workunit.client.0.smithi088.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2020-02-11T16:31:52.110 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat .snap/5/a 2020-02-11T16:31:52.110 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep -- -rw-rw-rw- 2020-02-11T16:31:52.112 INFO:tasks.workunit.client.0.smithi088.stdout:Access: (0666/-rw-rw-rw-) Uid: ( 1000/ ubuntu) Gid: ( 1209/ ubuntu) 2020-02-11T16:31:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/1 .snap/2 .snap/3 .snap/4 .snap/5 2020-02-11T16:31:52.145 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:31:52.145 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:31:52.145 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:31:52.145 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:31:52.252 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-parents.sh... 2020-02-11T16:31:52.252 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-parents.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-parents.sh 2020-02-11T16:31:52.375 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.370+0000 7f71e1303700 1 Processor -- start 2020-02-11T16:31:52.376 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.370+0000 7f71e1303700 1 -- start start 2020-02-11T16:31:52.376 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71e1303700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71dc0a2da0 0x7f71dc0a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:52.376 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71e1303700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71dc099fa0 0x7f71dc14f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:52.376 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71e1303700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc0a37e0 con 0x7f71dc05ac40 2020-02-11T16:31:52.376 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71e1303700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0a24e0 con 0x7f71dc0a2da0 2020-02-11T16:31:52.376 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71e1303700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0a4350 con 0x7f71dc099fa0 2020-02-11T16:31:52.377 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71dc0a2da0 0x7f71dc0a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:52.377 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71db7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f71dc05ac40 0x7f71dc099890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49070/0 (socket says 172.21.15.88:49070) 2020-02-11T16:31:52.377 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71db7fe700 1 -- 172.21.15.88:0/1269398958 learned_addr learned my addr 172.21.15.88:0/1269398958 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:52.377 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 --2- 172.21.15.88:0/1269398958 >> v2:172.21.15.88:3300/0 conn(0x7f71dc0a2da0 0x7f71dc0a14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33212/0 (socket says 172.21.15.88:33212) 2020-02-11T16:31:52.377 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71dbfff700 1 --2- 172.21.15.88:0/1269398958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71dc099fa0 0x7f71dc14f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:52.377 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 -- 172.21.15.88:0/1269398958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71dc099fa0 msgr2=0x7f71dc14f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:52.378 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 --2- 172.21.15.88:0/1269398958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71dc099fa0 0x7f71dc14f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:52.378 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 -- 172.21.15.88:0/1269398958 >> v1:172.21.15.88:6789/0 conn(0x7f71dc05ac40 legacy=0x7f71dc099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:52.378 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71da7fc700 1 -- 172.21.15.88:0/1269398958 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836545640 0 0) 0x7f71dc0a37e0 con 0x7f71dc05ac40 2020-02-11T16:31:52.378 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 -- 172.21.15.88:0/1269398958 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0a26d0 con 0x7f71dc0a2da0 2020-02-11T16:31:52.378 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 --2- 172.21.15.88:0/1269398958 >> v2:172.21.15.88:3300/0 conn(0x7f71dc0a2da0 0x7f71dc0a14c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f71dc0a4490 tx=0x7f71d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.378 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 --2- 172.21.15.88:0/1269398958 >> v2:172.21.15.88:3300/0 conn(0x7f71dc0a2da0 0x7f71dc0a14c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f71dc0a4490 tx=0x7f71d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.379 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 --2- 172.21.15.88:0/1269398958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc0a2da0 0x7f71dc0a14c0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71d00088e0).ready entity=mon.1 client_cookie=c2b05f2d07b2e233 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:52.379 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 --2- 172.21.15.88:0/1269398958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc0a2da0 0x7f71dc0a14c0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.379 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71da7fc700 1 -- 172.21.15.88:0/1269398958 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d0008e40 con 0x7f71dc0a2da0 2020-02-11T16:31:52.379 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 --2- 172.21.15.88:0/1269398958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc0a2da0 0x7f71dc0a14c0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.379 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71daffd700 1 --2- 172.21.15.88:0/1269398958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc0a2da0 0x7f71dc0a14c0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71d00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.379 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71da7fc700 1 -- 172.21.15.88:0/1269398958 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d00115b0 con 0x7f71dc0a2da0 2020-02-11T16:31:52.379 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.371+0000 7f71da7fc700 1 -- 172.21.15.88:0/1269398958 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d0011950 con 0x7f71dc0a2da0 2020-02-11T16:31:52.380 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.372+0000 7f71e1303700 1 -- 172.21.15.88:0/1269398958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc0a2da0 msgr2=0x7f71dc0a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:52.380 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.372+0000 7f71e1303700 1 --2- 172.21.15.88:0/1269398958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc0a2da0 0x7f71dc0a14c0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71d00088e0).stop 2020-02-11T16:31:52.380 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.372+0000 7f71e1303700 1 -- 172.21.15.88:0/1269398958 shutdown_connections 2020-02-11T16:31:52.380 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.372+0000 7f71e1303700 1 --2- 172.21.15.88:0/1269398958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71dc099fa0 0x7f71dc14f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:52.380 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.372+0000 7f71e1303700 1 --2- 172.21.15.88:0/1269398958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc0a2da0 0x7f71dc0a14c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:52.381 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.372+0000 7f71e1303700 1 -- 172.21.15.88:0/1269398958 >> 172.21.15.88:0/1269398958 conn(0x7f71dc05c170 msgr2=0x7f71dc05a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:52.381 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.372+0000 7f71e1303700 1 -- 172.21.15.88:0/1269398958 shutdown_connections 2020-02-11T16:31:52.381 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.372+0000 7f71e1303700 1 -- 172.21.15.88:0/1269398958 wait complete. 2020-02-11T16:31:52.381 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.373+0000 7f71e1303700 1 Processor -- start 2020-02-11T16:31:52.384 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:31:52.384 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.373+0000 7f71e1303700 1 -- start start 2020-02-11T16:31:52.385 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71e1303700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71dc05ac40 0x7f71dc064350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:52.385 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71e1303700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71dc099fa0 0x7f71dc065de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:52.385 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71e1303700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f71dc0a2da0 0x7f71dc066240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:52.385 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71e1303700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0666a0 con 0x7f71dc0a2da0 2020-02-11T16:31:52.385 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71e1303700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0649e0 con 0x7f71dc099fa0 2020-02-11T16:31:52.386 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71e1303700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0647b0 con 0x7f71dc05ac40 2020-02-11T16:31:52.386 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71dbfff700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f71dc0a2da0 msgr2=0x7f71dc066240 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:52.386 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71dbfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f71dc0a2da0 0x7f71dc066240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:52.386 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71dc099fa0 0x7f71dc065de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:52.386 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71dc099fa0 0x7f71dc065de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33220/0 (socket says 172.21.15.88:33220) 2020-02-11T16:31:52.386 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 -- 172.21.15.88:0/2453325720 learned_addr learned my addr 172.21.15.88:0/2453325720 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:52.386 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71db7fe700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71dc05ac40 0x7f71dc064350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:52.387 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 -- 172.21.15.88:0/2453325720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71dc05ac40 msgr2=0x7f71dc064350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:52.387 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71dc05ac40 0x7f71dc064350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:52.387 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 -- 172.21.15.88:0/2453325720 >> v2:172.21.15.52:3300/0 conn(0x7f71dc0a2da0 msgr2=0x7f71dc066240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:52.387 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> v2:172.21.15.52:3300/0 conn(0x7f71dc0a2da0 0x7f71dc066240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:52.387 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 -- 172.21.15.88:0/2453325720 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0668e0 con 0x7f71dc099fa0 2020-02-11T16:31:52.387 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> v2:172.21.15.88:3300/0 conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.387 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> v2:172.21.15.88:3300/0 conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.388 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:52.388 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.388 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71c3fff700 1 -- 172.21.15.88:0/2453325720 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d000f780 con 0x7f71dc099fa0 2020-02-11T16:31:52.388 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.388 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.388 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.374+0000 7f71c3fff700 1 -- 172.21.15.88:0/2453325720 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d0007150 con 0x7f71dc099fa0 2020-02-11T16:31:52.393 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.375+0000 7f71c3fff700 1 -- 172.21.15.88:0/2453325720 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d0007570 con 0x7f71dc099fa0 2020-02-11T16:31:52.393 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.375+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc066b80 con 0x7f71dc099fa0 2020-02-11T16:31:52.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.375+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc0a7510 con 0x7f71dc099fa0 2020-02-11T16:31:52.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.375+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.375+0000 7f71c3fff700 1 -- 172.21.15.88:0/2453325720 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f71d00056c0 con 0x7f71dc099fa0 2020-02-11T16:31:52.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.375+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.375+0000 7f71c3fff700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71bc039b10 0x7f71bc03bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:52.395 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.375+0000 7f71c3fff700 1 -- 172.21.15.88:0/2453325720 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f71d004a340 con 0x7f71dc099fa0 2020-02-11T16:31:52.395 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.375+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc0565b0 con 0x7f71dc099fa0 2020-02-11T16:31:52.395 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.376+0000 7f71db7fe700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71bc039b10 0x7f71bc03bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:52.395 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.376+0000 7f71db7fe700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71bc039b10 0x7f71bc03bfd0 crc :-1 s=READY pgs=574 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:52.395 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.379+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.395 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.379+0000 7f71c3fff700 1 -- 172.21.15.88:0/2453325720 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f71d0032910 con 0x7f71dc099fa0 2020-02-11T16:31:52.398 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:31:52.566 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.563+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f71dc05e8e0 con 0x7f71dc099fa0 2020-02-11T16:31:52.947 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.945+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:52.948 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:52.945+0000 7f71c3fff700 1 -- 172.21.15.88:0/2453325720 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v38) v1 ==== 167+0+0 (secure 0 0 0) 0x7f71d00324d0 con 0x7f71dc099fa0 2020-02-11T16:31:53.085 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.082+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f71dc05eaf0 con 0x7f71dc099fa0 2020-02-11T16:31:53.952 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.950+0000 7f71daffd700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:53.952 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.950+0000 7f71c3fff700 1 -- 172.21.15.88:0/2453325720 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v39) v1 ==== 167+0+0 (secure 0 0 0) 0x7f71d0033f20 con 0x7f71dc099fa0 2020-02-11T16:31:53.954 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71bc039b10 msgr2=0x7f71bc03bfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:53.955 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71bc039b10 0x7f71bc03bfd0 crc :-1 s=READY pgs=574 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:53.955 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 msgr2=0x7f71dc065de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:53.955 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f71dc0a4490 tx=0x7f71dc05fbb0).stop 2020-02-11T16:31:53.955 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 shutdown_connections 2020-02-11T16:31:53.955 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f71bc039b10 0x7f71bc03bfd0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:53.956 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 --2- 172.21.15.88:0/2453325720 >> v2:172.21.15.52:3300/0 conn(0x7f71dc0a2da0 0x7f71dc066240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:53.956 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71dc05ac40 0x7f71dc064350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:53.956 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 --2- 172.21.15.88:0/2453325720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc099fa0 0x7f71dc065de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:53.956 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 >> 172.21.15.88:0/2453325720 conn(0x7f71dc05c170 msgr2=0x7f71dc069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:53.956 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 shutdown_connections 2020-02-11T16:31:53.957 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:53.952+0000 7f71e1303700 1 -- 172.21.15.88:0/2453325720 wait complete. 2020-02-11T16:31:53.957 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:31:53.967 INFO:tasks.workunit.client.0.smithi088.stdout:making directory tree and files 2020-02-11T16:31:53.986 INFO:tasks.workunit.client.0.smithi088.stdout:snapshotting 2020-02-11T16:31:54.007 INFO:tasks.workunit.client.0.smithi088.stdout:moving tree 2020-02-11T16:31:54.011 INFO:tasks.workunit.client.0.smithi088.stdout:checking snapshot contains tree... 2020-02-11T16:31:54.039 INFO:tasks.workunit.client.0.smithi088.stdout:Success! 2020-02-11T16:31:54.039 INFO:tasks.workunit.client.0.smithi088.stdout:adding folder and file to tree... 2020-02-11T16:31:54.043 INFO:tasks.workunit.client.0.smithi088.stdout:snapshotting tree 2 2020-02-11T16:31:54.053 INFO:tasks.workunit.client.0.smithi088.stdout:comparing snapshots 2020-02-11T16:31:54.071 INFO:tasks.workunit.client.0.smithi088.stdout:Success! 2020-02-11T16:31:54.072 INFO:tasks.workunit.client.0.smithi088.stdout:moving subtree to first folder 2020-02-11T16:31:54.076 INFO:tasks.workunit.client.0.smithi088.stdout:comparing snapshots and new tree 2020-02-11T16:31:54.096 INFO:tasks.workunit.client.0.smithi088.stdout:Success! 2020-02-11T16:31:54.112 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:31:54.113 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:31:54.113 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:31:54.231 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-realm-split.sh... 2020-02-11T16:31:54.231 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-realm-split.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-realm-split.sh 2020-02-11T16:31:54.254 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:31:54.254 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:31:54.346 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.335+0000 7f72e4820700 1 Processor -- start 2020-02-11T16:31:54.346 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.335+0000 7f72e4820700 1 -- start start 2020-02-11T16:31:54.346 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72e4820700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72e00a2da0 0x7f72e00a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:54.346 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72e4820700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 0x7f72e014f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:54.347 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72e4820700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e00a37e0 con 0x7f72e005ac40 2020-02-11T16:31:54.347 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72e4820700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e00a24e0 con 0x7f72e0099fa0 2020-02-11T16:31:54.348 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72e4820700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e00a4350 con 0x7f72e00a2da0 2020-02-11T16:31:54.348 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72de59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72e00a2da0 0x7f72e00a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:54.348 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72ded9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f72e005ac40 0x7f72e0099890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49084/0 (socket says 172.21.15.88:49084) 2020-02-11T16:31:54.348 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72ded9d700 1 -- 172.21.15.88:0/677495470 learned_addr learned my addr 172.21.15.88:0/677495470 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:54.349 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72df59e700 1 -- 172.21.15.88:0/677495470 >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 msgr2=0x7f72e014f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:54.349 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72df59e700 1 --2- 172.21.15.88:0/677495470 >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 0x7f72e014f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:54.349 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72de59c700 1 -- 172.21.15.88:0/677495470 >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 msgr2=0x7f72e014f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:54.349 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72de59c700 1 --2- 172.21.15.88:0/677495470 >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 0x7f72e014f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:54.349 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72de59c700 1 -- 172.21.15.88:0/677495470 >> v1:172.21.15.88:6789/0 conn(0x7f72e005ac40 legacy=0x7f72e0099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:54.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72ddd9b700 1 -- 172.21.15.88:0/677495470 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121725451 0 0) 0x7f72e00a37e0 con 0x7f72e005ac40 2020-02-11T16:31:54.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72de59c700 1 -- 172.21.15.88:0/677495470 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00a26d0 con 0x7f72e00a2da0 2020-02-11T16:31:54.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.336+0000 7f72de59c700 1 --2- 172.21.15.88:0/677495470 >> v2:172.21.15.88:3300/0 conn(0x7f72e00a2da0 0x7f72e00a14c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f72d4002f30 tx=0x7f72d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.350 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72de59c700 1 --2- 172.21.15.88:0/677495470 >> v2:172.21.15.88:3300/0 conn(0x7f72e00a2da0 0x7f72e00a14c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f72d4002f30 tx=0x7f72d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72de59c700 1 --2- 172.21.15.88:0/677495470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e00a14c0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f72d4002f30 tx=0x7f72d4007a40).ready entity=mon.1 client_cookie=21d4fff1c68b364f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:54.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72de59c700 1 --2- 172.21.15.88:0/677495470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e00a14c0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f72d4002f30 tx=0x7f72d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72ddd9b700 1 -- 172.21.15.88:0/677495470 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d4011660 con 0x7f72e00a2da0 2020-02-11T16:31:54.351 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72de59c700 1 --2- 172.21.15.88:0/677495470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e00a14c0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f72d4002f30 tx=0x7f72d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72ddd9b700 1 -- 172.21.15.88:0/677495470 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d40117c0 con 0x7f72e00a2da0 2020-02-11T16:31:54.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72de59c700 1 --2- 172.21.15.88:0/677495470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e00a14c0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f72d4002f30 tx=0x7f72d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72ddd9b700 1 -- 172.21.15.88:0/677495470 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d4011b20 con 0x7f72e00a2da0 2020-02-11T16:31:54.352 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72e4820700 1 -- 172.21.15.88:0/677495470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 msgr2=0x7f72e00a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:54.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72e4820700 1 --2- 172.21.15.88:0/677495470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e00a14c0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f72d4002f30 tx=0x7f72d4007a40).stop 2020-02-11T16:31:54.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72e4820700 1 -- 172.21.15.88:0/677495470 shutdown_connections 2020-02-11T16:31:54.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72e4820700 1 --2- 172.21.15.88:0/677495470 >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 0x7f72e014f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:54.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72e4820700 1 --2- 172.21.15.88:0/677495470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e00a14c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:54.353 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72e4820700 1 -- 172.21.15.88:0/677495470 >> 172.21.15.88:0/677495470 conn(0x7f72e005c170 msgr2=0x7f72e005a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:54.354 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72e4820700 1 -- 172.21.15.88:0/677495470 shutdown_connections 2020-02-11T16:31:54.354 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.337+0000 7f72e4820700 1 -- 172.21.15.88:0/677495470 wait complete. 2020-02-11T16:31:54.354 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.338+0000 7f72e4820700 1 Processor -- start 2020-02-11T16:31:54.354 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.338+0000 7f72e4820700 1 -- start start 2020-02-11T16:31:54.355 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72e4820700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 0x7f72e0062ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:54.355 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72e4820700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72e00a2da0 0x7f72e007e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:54.355 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72e4820700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e0066480 con 0x7f72e005ac40 2020-02-11T16:31:54.355 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72e4820700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e00a0d00 con 0x7f72e0099fa0 2020-02-11T16:31:54.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72e4820700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e0065d40 con 0x7f72e00a2da0 2020-02-11T16:31:54.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72ded9d700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f72e005ac40 legacy=0x7f72e0063f10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:54.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72de59c700 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 msgr2=0x7f72e0062ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:54.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72e00a2da0 0x7f72e007e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:54.356 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72e00a2da0 0x7f72e007e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33234/0 (socket says 172.21.15.88:33234) 2020-02-11T16:31:54.357 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72de59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 0x7f72e0062ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:54.357 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 -- 172.21.15.88:0/1252770936 learned_addr learned my addr 172.21.15.88:0/1252770936 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:31:54.357 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 -- 172.21.15.88:0/1252770936 >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 msgr2=0x7f72e0062ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:54.357 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 0x7f72e0062ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:54.358 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 -- 172.21.15.88:0/1252770936 >> v1:172.21.15.52:6789/0 conn(0x7f72e005ac40 legacy=0x7f72e0063f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:54.358 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 -- 172.21.15.88:0/1252770936 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0065fe0 con 0x7f72e00a2da0 2020-02-11T16:31:54.358 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> v2:172.21.15.88:3300/0 conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.358 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> v2:172.21.15.88:3300/0 conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:54.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72cf7fe700 1 -- 172.21.15.88:0/1252770936 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d8003e20 con 0x7f72e00a2da0 2020-02-11T16:31:54.359 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72cf7fe700 1 -- 172.21.15.88:0/1252770936 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d8012620 con 0x7f72e00a2da0 2020-02-11T16:31:54.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.339+0000 7f72cf7fe700 1 -- 172.21.15.88:0/1252770936 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d8012a00 con 0x7f72e00a2da0 2020-02-11T16:31:54.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.340+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e0063330 con 0x7f72e00a2da0 2020-02-11T16:31:54.360 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.340+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e0064620 con 0x7f72e00a2da0 2020-02-11T16:31:54.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.340+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.340+0000 7f72cf7fe700 1 -- 172.21.15.88:0/1252770936 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f72d8012c70 con 0x7f72e00a2da0 2020-02-11T16:31:54.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.340+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.361 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.341+0000 7f72cf7fe700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72c4039b90 0x7f72c403c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:54.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.341+0000 7f72cf7fe700 1 -- 172.21.15.88:0/1252770936 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f72d8049e10 con 0x7f72e00a2da0 2020-02-11T16:31:54.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.341+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e0066170 con 0x7f72e00a2da0 2020-02-11T16:31:54.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.341+0000 7f72ded9d700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72c4039b90 0x7f72c403c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:54.362 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.341+0000 7f72ded9d700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72c4039b90 0x7f72c403c050 crc :-1 s=READY pgs=575 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:54.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.344+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:54.363 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.344+0000 7f72cf7fe700 1 -- 172.21.15.88:0/1252770936 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f72d802f450 con 0x7f72e00a2da0 2020-02-11T16:31:54.526 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:54.523+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f72e00565b0 con 0x7f72e00a2da0 2020-02-11T16:31:55.145 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:55.142+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:55.145 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:55.142+0000 7f72cf7fe700 1 -- 172.21.15.88:0/1252770936 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v40) v1 ==== 167+0+0 (secure 0 0 0) 0x7f72d8031f60 con 0x7f72e00a2da0 2020-02-11T16:31:55.281 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:55.279+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f72e00663a0 con 0x7f72e00a2da0 2020-02-11T16:31:56.149 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.146+0000 7f72df59e700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.149 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.146+0000 7f72cf7fe700 1 -- 172.21.15.88:0/1252770936 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v41) v1 ==== 167+0+0 (secure 0 0 0) 0x7f72d80323a0 con 0x7f72e00a2da0 2020-02-11T16:31:56.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.148+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72c4039b90 msgr2=0x7f72c403c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:56.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.148+0000 7f72e4820700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72c4039b90 0x7f72c403c050 crc :-1 s=READY pgs=575 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:56.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.148+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 msgr2=0x7f72e007e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:56.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.148+0000 7f72e4820700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f72e0064cd0 tx=0x7f72d8010cc0).stop 2020-02-11T16:31:56.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.149+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 shutdown_connections 2020-02-11T16:31:56.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.149+0000 7f72e4820700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e00a2da0 0x7f72e007e310 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:56.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.149+0000 7f72e4820700 1 --2- 172.21.15.88:0/1252770936 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f72c4039b90 0x7f72c403c050 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:56.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.149+0000 7f72e4820700 1 --2- 172.21.15.88:0/1252770936 >> v2:172.21.15.52:3300/0 conn(0x7f72e0099fa0 0x7f72e0062ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:56.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.149+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 >> 172.21.15.88:0/1252770936 conn(0x7f72e005c170 msgr2=0x7f72e0069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:56.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.149+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 shutdown_connections 2020-02-11T16:31:56.153 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.149+0000 7f72e4820700 1 -- 172.21.15.88:0/1252770936 wait complete. 2020-02-11T16:31:56.153 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:31:56.162 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir -p 1/a 2020-02-11T16:31:56.167 INFO:tasks.workunit.client.0.smithi088.stderr:+ exec 2020-02-11T16:31:56.169 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo -n a 2020-02-11T16:31:56.169 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir 1/.snap/s1 2020-02-11T16:31:56.183 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo -n b 2020-02-11T16:31:56.186 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir 2 2020-02-11T16:31:56.191 INFO:tasks.workunit.client.0.smithi088.stderr:+ mv 1/a 2 2020-02-11T16:31:56.195 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir 2/.snap/s2 2020-02-11T16:31:56.205 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo -n c 2020-02-11T16:31:56.210 INFO:tasks.workunit.client.0.smithi088.stderr:+ exec 2020-02-11T16:31:56.210 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep '^a$' 1/.snap/s1/a/file1 2020-02-11T16:31:56.226 INFO:tasks.workunit.client.0.smithi088.stdout:a 2020-02-11T16:31:56.226 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep '^ab$' 2/.snap/s2/a/file1 2020-02-11T16:31:56.230 INFO:tasks.workunit.client.0.smithi088.stdout:ab 2020-02-11T16:31:56.230 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep '^abc$' 2/a/file1 2020-02-11T16:31:56.234 INFO:tasks.workunit.client.0.smithi088.stdout:abc 2020-02-11T16:31:56.234 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir 1/.snap/s1 2020-02-11T16:31:56.239 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir 2/.snap/s2 2020-02-11T16:31:56.246 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf 1 2 2020-02-11T16:31:56.268 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:31:56.268 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:31:56.268 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:31:56.269 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:31:56.343 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-snap-rename.sh... 2020-02-11T16:31:56.344 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-snap-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-snap-rename.sh 2020-02-11T16:31:56.405 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:31:56.405 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:31:56.493 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.487+0000 7f10b12c4700 1 Processor -- start 2020-02-11T16:31:56.493 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.487+0000 7f10b12c4700 1 -- start start 2020-02-11T16:31:56.493 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.487+0000 7f10b12c4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac0a14c0 0x7f10ac150670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:56.493 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.487+0000 7f10b12c4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac0a37e0 con 0x7f10ac0a2da0 2020-02-11T16:31:56.494 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.487+0000 7f10b12c4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac0a26d0 con 0x7f10ac05ac40 2020-02-11T16:31:56.494 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.487+0000 7f10b12c4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac0a24e0 con 0x7f10ac0a14c0 2020-02-11T16:31:56.494 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.487+0000 7f10ab7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f10ac05ac40 0x7f10ac099890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49100/0 (socket says 172.21.15.88:49100) 2020-02-11T16:31:56.494 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.487+0000 7f10ab7fe700 1 -- 172.21.15.88:0/958508684 learned_addr learned my addr 172.21.15.88:0/958508684 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:56.494 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.487+0000 7f10aaffd700 1 -- 172.21.15.88:0/958508684 >> v1:172.21.15.52:6789/0 conn(0x7f10ac0a2da0 legacy=0x7f10ac099fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:56.494 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544921454 0 0) 0x7f10ac0a26d0 con 0x7f10ac05ac40 2020-02-11T16:31:56.495 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1094003230 con 0x7f10ac05ac40 2020-02-11T16:31:56.495 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac0a14c0 0x7f10ac150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:56.495 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 516951452 0 0) 0x7f1094003230 con 0x7f10ac05ac40 2020-02-11T16:31:56.495 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac0a14c0 msgr2=0x7f10ac150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:56.495 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac0a14c0 0x7f10ac150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:56.495 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 >> v1:172.21.15.52:6789/0 conn(0x7f10ac0a2da0 legacy=0x7f10ac099fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:56.495 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac0a2970 con 0x7f10ac05ac40 2020-02-11T16:31:56.496 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f109c001a50 con 0x7f10ac05ac40 2020-02-11T16:31:56.496 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 >> v1:172.21.15.88:6789/0 conn(0x7f10ac05ac40 legacy=0x7f10ac099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:56.496 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac0a14c0 0x7f1094003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:56.496 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1094003bb0 0x7f1094004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:56.496 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1094004590 0x7f1094004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:56.496 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1094004f90 con 0x7f1094003bb0 2020-02-11T16:31:56.496 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1094005100 con 0x7f1094004590 2020-02-11T16:31:56.497 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10940052c0 con 0x7f10ac0a14c0 2020-02-11T16:31:56.497 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aaffd700 1 -- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1094003bb0 msgr2=0x7f1094004010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:56.497 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aaffd700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1094003bb0 0x7f1094004010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:56.497 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1094004590 0x7f1094004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:56.497 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac0a14c0 0x7f1094003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:56.498 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 -- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac0a14c0 msgr2=0x7f1094003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:56.498 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac0a14c0 0x7f1094003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:56.498 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 -- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1094003bb0 msgr2=0x7f1094004010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:31:56.498 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1094003bb0 0x7f1094004010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:56.498 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 -- 172.21.15.88:0/958508684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094003230 con 0x7f1094004590 2020-02-11T16:31:56.498 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1094004590 0x7f1094004a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f10a4002f30 tx=0x7f10a4010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.499 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1094004590 0x7f1094004a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f10a4002f30 tx=0x7f10a4010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.499 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1094004590 0x7f1094004a10 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f10a4002f30 tx=0x7f10a4010030).ready entity=mon.1 client_cookie=2af96d2f8ef98d9c server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:56.499 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1094004590 0x7f1094004a10 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f10a4002f30 tx=0x7f10a4010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.499 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10a4010de0 con 0x7f1094004590 2020-02-11T16:31:56.499 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1094004590 0x7f1094004a10 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f10a4002f30 tx=0x7f10a4010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.500 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10abfff700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1094004590 0x7f1094004a10 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f10a4002f30 tx=0x7f10a4010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.500 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a4008950 con 0x7f1094004590 2020-02-11T16:31:56.500 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.488+0000 7f10aa7fc700 1 -- 172.21.15.88:0/958508684 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10a4008d30 con 0x7f1094004590 2020-02-11T16:31:56.501 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.489+0000 7f10b12c4700 1 -- 172.21.15.88:0/958508684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1094004590 msgr2=0x7f1094004a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:56.501 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.489+0000 7f10b12c4700 1 --2- 172.21.15.88:0/958508684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1094004590 0x7f1094004a10 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f10a4002f30 tx=0x7f10a4010030).stop 2020-02-11T16:31:56.501 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.489+0000 7f10abfff700 1 -- 172.21.15.88:0/958508684 reap_dead start 2020-02-11T16:31:56.501 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.489+0000 7f10b12c4700 1 -- 172.21.15.88:0/958508684 shutdown_connections 2020-02-11T16:31:56.501 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.489+0000 7f10b12c4700 1 -- 172.21.15.88:0/958508684 >> 172.21.15.88:0/958508684 conn(0x7f10ac05c170 msgr2=0x7f10ac05a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:56.501 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.489+0000 7f10b12c4700 1 -- 172.21.15.88:0/958508684 shutdown_connections 2020-02-11T16:31:56.502 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.489+0000 7f10b12c4700 1 -- 172.21.15.88:0/958508684 wait complete. 2020-02-11T16:31:56.502 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.490+0000 7f10b12c4700 1 Processor -- start 2020-02-11T16:31:56.502 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.490+0000 7f10b12c4700 1 -- start start 2020-02-11T16:31:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10b12c4700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10b12c4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac0a4aa0 con 0x7f10ac09d6c0 2020-02-11T16:31:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10b12c4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac1228f0 con 0x7f10ac123310 2020-02-11T16:31:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10b12c4700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac1226f0 con 0x7f10ac07e190 2020-02-11T16:31:56.506 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10abfff700 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f10ac09d6c0 legacy=0x7f10ac13c870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:56.506 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10aaffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f10ac123310 0x7f10ac09cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49110/0 (socket says 172.21.15.88:49110) 2020-02-11T16:31:56.506 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10aaffd700 1 -- 172.21.15.88:0/954565218 learned_addr learned my addr 172.21.15.88:0/954565218 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:56.506 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:56.506 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f1093fff700 1 -- 172.21.15.88:0/954565218 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903166007 0 0) 0x7f10ac1228f0 con 0x7f10ac123310 2020-02-11T16:31:56.506 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f1093fff700 1 -- 172.21.15.88:0/954565218 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f108c003230 con 0x7f10ac123310 2020-02-11T16:31:56.507 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10ab7fe700 1 -- 172.21.15.88:0/954565218 >> v1:172.21.15.88:6789/0 conn(0x7f10ac123310 legacy=0x7f10ac09cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:56.507 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10ab7fe700 1 -- 172.21.15.88:0/954565218 >> v1:172.21.15.52:6789/0 conn(0x7f10ac09d6c0 legacy=0x7f10ac13c870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:56.507 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10ab7fe700 1 -- 172.21.15.88:0/954565218 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac122e70 con 0x7f10ac07e190 2020-02-11T16:31:56.507 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.507 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.491+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.507 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:56.508 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.508 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f1093fff700 1 -- 172.21.15.88:0/954565218 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f109c011a60 con 0x7f10ac07e190 2020-02-11T16:31:56.508 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.508 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f1093fff700 1 -- 172.21.15.88:0/954565218 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c011bc0 con 0x7f10ac07e190 2020-02-11T16:31:56.508 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ac05feb0 con 0x7f10ac07e190 2020-02-11T16:31:56.508 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.508 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f1093fff700 1 -- 172.21.15.88:0/954565218 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f109c00e150 con 0x7f10ac07e190 2020-02-11T16:31:56.509 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ac123950 con 0x7f10ac07e190 2020-02-11T16:31:56.509 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.509 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f1093fff700 1 -- 172.21.15.88:0/954565218 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f109c004930 con 0x7f10ac07e190 2020-02-11T16:31:56.509 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.492+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.509 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.493+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ac122cd0 con 0x7f10ac07e190 2020-02-11T16:31:56.509 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.493+0000 7f1093fff700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f108c039f30 0x7f108c03c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:56.510 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.493+0000 7f1093fff700 1 -- 172.21.15.88:0/954565218 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f109c049930 con 0x7f10ac07e190 2020-02-11T16:31:56.510 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.493+0000 7f10aaffd700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f108c039f30 0x7f108c03c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:56.510 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.493+0000 7f10aaffd700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f108c039f30 0x7f108c03c3f0 crc :-1 s=READY pgs=576 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:56.510 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.496+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:56.510 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.496+0000 7f1093fff700 1 -- 172.21.15.88:0/954565218 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f10ac122cd0 con 0x7f10ac07e190 2020-02-11T16:31:56.679 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:56.676+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f10ac060040 con 0x7f10ac07e190 2020-02-11T16:31:57.151 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:57.149+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:57.152 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:57.149+0000 7f1093fff700 1 -- 172.21.15.88:0/954565218 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v42) v1 ==== 167+0+0 (secure 0 0 0) 0x7f109c031ea0 con 0x7f10ac07e190 2020-02-11T16:31:57.301 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:57.298+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f10ac122cd0 con 0x7f10ac07e190 2020-02-11T16:31:57.896 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:57.894+0000 7f63d907d700 -1 osd.1 pg_epoch: 40 pg[3.0s0( v 40'6478 (0'0,40'6478] local-lis/les=21/22 n=2 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=40'6478 lcod 39'6476 mlcod 39'6476 active+clean+snaptrim trimq=[230~10] ps=[228~8]] removing snap head 2020-02-11T16:31:57.903 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:31:57.900+0000 7f63d7079700 -1 osd.1 pg_epoch: 40 pg[3.4s0( v 40'6391 (0'0,40'6391] local-lis/les=21/22 n=2 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=40'6391 lcod 39'6389 mlcod 39'6389 active+clean+snaptrim trimq=[23d~3] ps=[228~15]] removing snap head 2020-02-11T16:31:58.158 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.155+0000 7f10ab7fe700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.159 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.155+0000 7f1093fff700 1 -- 172.21.15.88:0/954565218 <== mon.2 v2:172.21.15.52:3301/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v43) v1 ==== 167+0+0 (secure 0 0 0) 0x7f10ac122cd0 con 0x7f10ac07e190 2020-02-11T16:31:58.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.157+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f108c039f30 msgr2=0x7f108c03c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:58.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.157+0000 7f10b12c4700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f108c039f30 0x7f108c03c3f0 crc :-1 s=READY pgs=576 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:58.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.157+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 msgr2=0x7f10ac122290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:58.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.157+0000 7f10b12c4700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f10ac0a0510 tx=0x7f10ac05fbb0).stop 2020-02-11T16:31:58.160 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.157+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 shutdown_connections 2020-02-11T16:31:58.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.157+0000 7f10b12c4700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f108c039f30 0x7f108c03c3f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:58.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.157+0000 7f10b12c4700 1 --2- 172.21.15.88:0/954565218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f10ac07e190 0x7f10ac122290 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:58.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.157+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 >> 172.21.15.88:0/954565218 conn(0x7f10ac05c170 msgr2=0x7f10ac07ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:58.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.157+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 shutdown_connections 2020-02-11T16:31:58.161 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.157+0000 7f10b12c4700 1 -- 172.21.15.88:0/954565218 wait complete. 2020-02-11T16:31:58.161 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:31:58.170 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir -p d1/d2 2020-02-11T16:31:58.175 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir -p d1/d3 2020-02-11T16:31:58.177 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir d1/.snap/foo 2020-02-11T16:31:58.191 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir d1/d2/.snap/foo 2020-02-11T16:31:58.198 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir d1/d3/.snap/foo 2020-02-11T16:31:58.204 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir d1/d3/.snap/bar 2020-02-11T16:31:58.211 INFO:tasks.workunit.client.0.smithi088.stderr:+ mv d1/d2/.snap/foo d1/d2/.snap/bar 2020-02-11T16:31:58.222 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_failure mv d1/d2/.snap/bar d1/d2/.snap/_bar 2020-02-11T16:31:58.222 INFO:tasks.workunit.client.0.smithi088.stderr:+ mv d1/d2/.snap/bar d1/d2/.snap/_bar 2020-02-11T16:31:58.234 INFO:tasks.workunit.client.0.smithi088.stderr:mv: cannot move 'd1/d2/.snap/bar' to a subdirectory of itself, 'd1/d2/.snap/_bar' 2020-02-11T16:31:58.234 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2020-02-11T16:31:58.235 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_failure mv d1/d2/.snap/_foo_1099511649621 d1/d2/.snap/foo 2020-02-11T16:31:58.235 INFO:tasks.workunit.client.0.smithi088.stderr:+ mv d1/d2/.snap/_foo_1099511649621 d1/d2/.snap/foo 2020-02-11T16:31:58.244 INFO:tasks.workunit.client.0.smithi088.stderr:mv: cannot move 'd1/d2/.snap/_foo_1099511649621' to a subdirectory of itself, 'd1/d2/.snap/foo' 2020-02-11T16:31:58.245 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2020-02-11T16:31:58.246 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_failure mv d1/d2/.snap/_foo_1099511649621 d1/d2/.snap/_foo_1 2020-02-11T16:31:58.246 INFO:tasks.workunit.client.0.smithi088.stderr:+ mv d1/d2/.snap/_foo_1099511649621 d1/d2/.snap/_foo_1 2020-02-11T16:31:58.255 INFO:tasks.workunit.client.0.smithi088.stderr:mv: cannot move 'd1/d2/.snap/_foo_1099511649621' to a subdirectory of itself, 'd1/d2/.snap/_foo_1' 2020-02-11T16:31:58.255 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2020-02-11T16:31:58.256 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_failure mv d1/d2/.snap/bar d1/.snap/ 2020-02-11T16:31:58.256 INFO:tasks.workunit.client.0.smithi088.stderr:+ mv d1/d2/.snap/bar d1/.snap/ 2020-02-11T16:31:58.264 INFO:tasks.workunit.client.0.smithi088.stderr:mv: cannot move 'd1/d2/.snap/bar' to 'd1/.snap/bar': Read-only file system 2020-02-11T16:31:58.264 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2020-02-11T16:31:58.264 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_failure python3 -c 'import os; os.rename('\''d1/d3/.snap/foo'\'', '\''d1/d3/.snap/bar'\'')' 2020-02-11T16:31:58.264 INFO:tasks.workunit.client.0.smithi088.stderr:+ python3 -c 'import os; os.rename('\''d1/d3/.snap/foo'\'', '\''d1/d3/.snap/bar'\'')' 2020-02-11T16:31:58.286 INFO:tasks.workunit.client.0.smithi088.stderr:Traceback (most recent call last): 2020-02-11T16:31:58.286 INFO:tasks.workunit.client.0.smithi088.stderr: File "", line 1, in 2020-02-11T16:31:58.286 INFO:tasks.workunit.client.0.smithi088.stderr:FileExistsError: [Errno 17] File exists: 'd1/d3/.snap/foo' -> 'd1/d3/.snap/bar' 2020-02-11T16:31:58.288 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2020-02-11T16:31:58.288 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_failure python3 -c 'import os; os.rename('\''d1/.snap/foo'\'', '\''d1/foo'\'')' 2020-02-11T16:31:58.288 INFO:tasks.workunit.client.0.smithi088.stderr:+ python3 -c 'import os; os.rename('\''d1/.snap/foo'\'', '\''d1/foo'\'')' 2020-02-11T16:31:58.308 INFO:tasks.workunit.client.0.smithi088.stderr:Traceback (most recent call last): 2020-02-11T16:31:58.308 INFO:tasks.workunit.client.0.smithi088.stderr: File "", line 1, in 2020-02-11T16:31:58.308 INFO:tasks.workunit.client.0.smithi088.stderr:OSError: [Errno 18] Invalid cross-device link: 'd1/.snap/foo' -> 'd1/foo' 2020-02-11T16:31:58.310 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2020-02-11T16:31:58.310 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir d1/.snap/foo 2020-02-11T16:31:58.317 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir d1/d2/.snap/bar 2020-02-11T16:31:58.323 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir d1/d3/.snap/foo 2020-02-11T16:31:58.329 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir d1/d3/.snap/bar 2020-02-11T16:31:58.336 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf d1 2020-02-11T16:31:58.352 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:31:58.352 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:31:58.352 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:31:58.353 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:31:58.427 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-snap-rm-cmp.sh... 2020-02-11T16:31:58.428 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-snap-rm-cmp.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-snap-rm-cmp.sh 2020-02-11T16:31:58.489 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:31:58.489 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:31:58.577 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.571+0000 7fecd07c6700 1 Processor -- start 2020-02-11T16:31:58.577 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.571+0000 7fecd07c6700 1 -- start start 2020-02-11T16:31:58.577 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecd07c6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fecc805ac40 0x7fecc80a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:58.577 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecd07c6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc80a14c0 0x7fecc8099890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:31:58.577 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecd07c6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc80a37e0 con 0x7fecc8099cf0 2020-02-11T16:31:58.578 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecd07c6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc80a24e0 con 0x7fecc805ac40 2020-02-11T16:31:58.578 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecd07c6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80a4350 con 0x7fecc80a14c0 2020-02-11T16:31:58.578 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecced63700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fecc805ac40 0x7fecc80a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:58.578 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7feccf564700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fecc8099cf0 0x7fecc80a6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49122/0 (socket says 172.21.15.88:49122) 2020-02-11T16:31:58.578 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7feccf564700 1 -- 172.21.15.88:0/1756825778 learned_addr learned my addr 172.21.15.88:0/1756825778 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:58.578 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecce562700 1 --2- 172.21.15.88:0/1756825778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc80a14c0 0x7fecc8099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:58.578 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecced63700 1 -- 172.21.15.88:0/1756825778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc80a14c0 msgr2=0x7fecc8099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:31:58.579 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecced63700 1 --2- 172.21.15.88:0/1756825778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc80a14c0 0x7fecc8099890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:58.579 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecced63700 1 -- 172.21.15.88:0/1756825778 >> v1:172.21.15.88:6789/0 conn(0x7fecc8099cf0 legacy=0x7fecc80a6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:58.579 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecced63700 1 -- 172.21.15.88:0/1756825778 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc80a26d0 con 0x7fecc805ac40 2020-02-11T16:31:58.579 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7feccdd61700 1 -- 172.21.15.88:0/1756825778 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677325443 0 0) 0x7fecc80a37e0 con 0x7fecc8099cf0 2020-02-11T16:31:58.579 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.572+0000 7fecce562700 1 --2- 172.21.15.88:0/1756825778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc80a14c0 0x7fecc8099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:31:58.579 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecced63700 1 --2- 172.21.15.88:0/1756825778 >> v2:172.21.15.88:3300/0 conn(0x7fecc805ac40 0x7fecc80a2da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fecc807f130 tx=0x7fecc4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.580 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecced63700 1 --2- 172.21.15.88:0/1756825778 >> v2:172.21.15.88:3300/0 conn(0x7fecc805ac40 0x7fecc80a2da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fecc807f130 tx=0x7fecc4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.580 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecced63700 1 --2- 172.21.15.88:0/1756825778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc805ac40 0x7fecc80a2da0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc4008c60).ready entity=mon.1 client_cookie=73a5f9835caa2962 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:58.580 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecced63700 1 --2- 172.21.15.88:0/1756825778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc805ac40 0x7fecc80a2da0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.580 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7feccdd61700 1 -- 172.21.15.88:0/1756825778 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecc400a160 con 0x7fecc805ac40 2020-02-11T16:31:58.580 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecced63700 1 --2- 172.21.15.88:0/1756825778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc805ac40 0x7fecc80a2da0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.580 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7feccdd61700 1 -- 172.21.15.88:0/1756825778 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc400a2c0 con 0x7fecc805ac40 2020-02-11T16:31:58.580 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecced63700 1 --2- 172.21.15.88:0/1756825778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc805ac40 0x7fecc80a2da0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.581 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7feccdd61700 1 -- 172.21.15.88:0/1756825778 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecc400a660 con 0x7fecc805ac40 2020-02-11T16:31:58.581 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecd07c6700 1 -- 172.21.15.88:0/1756825778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc805ac40 msgr2=0x7fecc80a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:58.581 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecd07c6700 1 --2- 172.21.15.88:0/1756825778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc805ac40 0x7fecc80a2da0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc4008c60).stop 2020-02-11T16:31:58.581 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecd07c6700 1 -- 172.21.15.88:0/1756825778 shutdown_connections 2020-02-11T16:31:58.581 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecd07c6700 1 --2- 172.21.15.88:0/1756825778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc805ac40 0x7fecc80a2da0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:58.581 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecd07c6700 1 --2- 172.21.15.88:0/1756825778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc80a14c0 0x7fecc8099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:31:58.581 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecd07c6700 1 -- 172.21.15.88:0/1756825778 >> 172.21.15.88:0/1756825778 conn(0x7fecc805c170 msgr2=0x7fecc805a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:31:58.582 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecd07c6700 1 -- 172.21.15.88:0/1756825778 shutdown_connections 2020-02-11T16:31:58.582 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.573+0000 7fecd07c6700 1 -- 172.21.15.88:0/1756825778 wait complete. 2020-02-11T16:31:58.582 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.574+0000 7fecd07c6700 1 Processor -- start 2020-02-11T16:31:58.582 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.574+0000 7fecd07c6700 1 -- start start 2020-02-11T16:31:58.586 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecd07c6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecc80634f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:58.587 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecd07c6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc8066090 con 0x7fecc80a14c0 2020-02-11T16:31:58.587 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecd07c6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc8063050 con 0x7fecc8099cf0 2020-02-11T16:31:58.587 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecd07c6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc809ce40 con 0x7fecc805ac40 2020-02-11T16:31:58.587 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecce562700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fecc8099cf0 0x7fecc807e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49126/0 (socket says 172.21.15.88:49126) 2020-02-11T16:31:58.587 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecce562700 1 -- 172.21.15.88:0/3253479120 learned_addr learned my addr 172.21.15.88:0/3253479120 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:31:58.587 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7feccf564700 1 -- 172.21.15.88:0/3253479120 >> v1:172.21.15.52:6789/0 conn(0x7fecc80a14c0 legacy=0x7fecc813c9f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.52:6789/0 2020-02-11T16:31:58.588 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecc80634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:58.588 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693022365 0 0) 0x7fecc8063050 con 0x7fecc8099cf0 2020-02-11T16:31:58.588 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb0003230 con 0x7fecc8099cf0 2020-02-11T16:31:58.588 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3804286495 0 0) 0x7fecb0003230 con 0x7fecc8099cf0 2020-02-11T16:31:58.588 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fecc8063050 con 0x7fecc8099cf0 2020-02-11T16:31:58.588 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fecb80083e0 con 0x7fecc8099cf0 2020-02-11T16:31:58.588 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 msgr2=0x7fecc80634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:58.589 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecc80634f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:58.589 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 >> v1:172.21.15.88:6789/0 conn(0x7fecc8099cf0 legacy=0x7fecc807e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:58.589 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 >> v1:172.21.15.52:6789/0 conn(0x7fecc80a14c0 legacy=0x7fecc813c9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:58.589 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:58.589 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecb0003c50 0x7fecb00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:58.589 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb0004930 0x7fecb0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:58.589 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc809ce40 con 0x7fecb0004930 2020-02-11T16:31:58.590 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb0005360 con 0x7fecb0003c50 2020-02-11T16:31:58.590 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.575+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb0004180 con 0x7fecc805ac40 2020-02-11T16:31:58.590 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7feccf564700 1 -- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb0004930 msgr2=0x7fecb0004db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3300/0 2020-02-11T16:31:58.590 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7feccf564700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb0004930 0x7fecb0004db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:31:58.590 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecce562700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecb0003c50 0x7fecb00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:58.590 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:58.590 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 -- 172.21.15.88:0/3253479120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecb0003c50 msgr2=0x7fecb00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:31:58.591 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecb0003c50 0x7fecb00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:58.591 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 -- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb0004930 msgr2=0x7fecb0004db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:31:58.591 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb0004930 0x7fecb0004db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:31:58.591 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 -- 172.21.15.88:0/3253479120 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc807ecc0 con 0x7fecc805ac40 2020-02-11T16:31:58.591 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc80a0730 con 0x7fecc805ac40 2020-02-11T16:31:58.591 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.591 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecce562700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecb0003c50 0x7fecb00044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:31:58.592 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc8066a50 con 0x7fecc805ac40 2020-02-11T16:31:58.592 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.592 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:58.592 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.592 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecc400ae80 con 0x7fecc805ac40 2020-02-11T16:31:58.592 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.592 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4005c30 con 0x7fecc805ac40 2020-02-11T16:31:58.593 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.593 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.576+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecc4005da0 con 0x7fecc805ac40 2020-02-11T16:31:58.593 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.577+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.593 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.577+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fecc400f760 con 0x7fecc805ac40 2020-02-11T16:31:58.593 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.577+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.593 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.577+0000 7fecbf7fe700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecb0041e00 0x7fecb00442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:31:58.593 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.577+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fecc404aa90 con 0x7fecc805ac40 2020-02-11T16:31:58.594 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.577+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc8063870 con 0x7fecc805ac40 2020-02-11T16:31:58.594 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.577+0000 7fecce562700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecb0041e00 0x7fecb00442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:31:58.594 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.578+0000 7fecce562700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecb0041e00 0x7fecb00442c0 crc :-1 s=READY pgs=577 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:31:58.594 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.581+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:58.594 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.581+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fecc4033060 con 0x7fecc805ac40 2020-02-11T16:31:58.762 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:58.760+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fecc80565b0 con 0x7fecc805ac40 2020-02-11T16:31:59.167 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:59.164+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:31:59.167 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:59.164+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v44) v1 ==== 167+0+0 (secure 0 0 0) 0x7fecc4032c20 con 0x7fecc805ac40 2020-02-11T16:31:59.303 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:31:59.301+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fecc805e8e0 con 0x7fecc805ac40 2020-02-11T16:32:00.171 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.168+0000 7fecced63700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:00.171 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.168+0000 7fecbf7fe700 1 -- 172.21.15.88:0/3253479120 <== mon.2 v2:172.21.15.52:3301/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v45) v1 ==== 167+0+0 (secure 0 0 0) 0x7fecc4032e00 con 0x7fecc805ac40 2020-02-11T16:32:00.173 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.170+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecb0041e00 msgr2=0x7fecb00442c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:00.173 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.170+0000 7fecd07c6700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fecb0041e00 0x7fecb00442c0 crc :-1 s=READY pgs=577 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:00.173 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.170+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 msgr2=0x7fecb00037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:00.173 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.170+0000 7fecd07c6700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fecc807f130 tx=0x7fecc805fbb0).stop 2020-02-11T16:32:00.174 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.170+0000 7feccf564700 1 -- 172.21.15.88:0/3253479120 reap_dead start 2020-02-11T16:32:00.174 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.170+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 shutdown_connections 2020-02-11T16:32:00.174 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.170+0000 7fecd07c6700 1 --2- 172.21.15.88:0/3253479120 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecc805ac40 0x7fecb00037f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:00.174 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.170+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 >> 172.21.15.88:0/3253479120 conn(0x7fecc805c170 msgr2=0x7fecc80a6290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:00.174 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.170+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 shutdown_connections 2020-02-11T16:32:00.174 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:00.170+0000 7fecd07c6700 1 -- 172.21.15.88:0/3253479120 wait complete. 2020-02-11T16:32:00.175 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:32:00.183 INFO:tasks.workunit.client.0.smithi088.stderr:+ file=linux-2.6.33.tar.bz2 2020-02-11T16:32:00.183 INFO:tasks.workunit.client.0.smithi088.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2020-02-11T16:32:02.573 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum linux-2.6.33.tar.bz2 2020-02-11T16:32:02.573 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:02.935 INFO:tasks.workunit.client.0.smithi088.stderr:+ real=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:02.935 INFO:tasks.workunit.client.0.smithi088.stderr:++ seq 1 20 2020-02-11T16:32:02.936 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:02.936 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 1 2020-02-11T16:32:02.936 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:02.937 INFO:tasks.workunit.client.0.smithi088.stdout:1 2020-02-11T16:32:03.806 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:03.821 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:03.828 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:04.110 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:04.110 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:04.208 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:04.208 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:04.208 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:04.219 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:04.219 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 2 2020-02-11T16:32:04.219 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:04.219 INFO:tasks.workunit.client.0.smithi088.stdout:2 2020-02-11T16:32:04.392 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2020-02-11T16:32:04.392 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2020-02-11T16:32:04.392 INFO:tasks.ceph.mon.b:Restarting daemon 2020-02-11T16:32:04.393 INFO:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-02-11T16:32:04.395 INFO:tasks.ceph.mon.b:Started 2020-02-11T16:32:04.395 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:32:04.395 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:04.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.520+0000 7fedecd9d700 1 Processor -- start 2020-02-11T16:32:04.523 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.520+0000 7fedecd9d700 1 -- start start 2020-02-11T16:32:04.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.521+0000 7fedecd9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fede80a3960 0x7fede8136770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:04.527 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.521+0000 7fedecd9d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede8136bd0 con 0x7fede809ed80 2020-02-11T16:32:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.521+0000 7fedecd9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede813a090 con 0x7fede809e8f0 2020-02-11T16:32:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.521+0000 7fedecd9d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede8136030 con 0x7fede80a3960 2020-02-11T16:32:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.521+0000 7feddffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fede809e8f0 0x7fede8139270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49140/0 (socket says 172.21.15.88:49140) 2020-02-11T16:32:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.521+0000 7feddffff700 1 -- 172.21.15.88:0/3136952506 learned_addr learned my addr 172.21.15.88:0/3136952506 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.521+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> v2:172.21.15.52:3300/0 conn(0x7fede80a3960 0x7fede8136770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781373820 0 0) 0x7fede813a090 con 0x7fede809e8f0 2020-02-11T16:32:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 -- 172.21.15.88:0/3136952506 >> v2:172.21.15.52:3300/0 conn(0x7fede80a3960 msgr2=0x7fede8136770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:32:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 -- 172.21.15.88:0/3136952506 >> v2:172.21.15.52:3300/0 conn(0x7fede80a3960 msgr2=0x7fede8136770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc8003230 con 0x7fede809e8f0 2020-02-11T16:32:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> v2:172.21.15.52:3300/0 conn(0x7fede80a3960 0x7fede8136770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> v2:172.21.15.52:3300/0 conn(0x7fede80a3960 0x7fede8136770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3967023610 0 0) 0x7fedc8003230 con 0x7fede809e8f0 2020-02-11T16:32:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 >> v2:172.21.15.52:3300/0 conn(0x7fede80a3960 msgr2=0x7fede8136770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:04.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 --2- 172.21.15.88:0/3136952506 >> v2:172.21.15.52:3300/0 conn(0x7fede80a3960 0x7fede8136770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:04.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 >> v1:172.21.15.52:6789/0 conn(0x7fede809ed80 legacy=0x7fede8139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:04.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede81362d0 con 0x7fede809e8f0 2020-02-11T16:32:04.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fedd00016d0 con 0x7fede809e8f0 2020-02-11T16:32:04.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 >> v1:172.21.15.88:6789/0 conn(0x7fede809e8f0 legacy=0x7fede8139270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:04.530 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 0x7fedc8003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedc80044d0 0x7fedc8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8004db0 0x7fedc800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede8136030 con 0x7fedc80044d0 2020-02-11T16:32:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8005260 con 0x7fedc8003770 2020-02-11T16:32:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc800bb80 con 0x7fedc8004db0 2020-02-11T16:32:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 0x7fedc8003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7feddffff700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedc80044d0 0x7fedc8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:04.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede7fff700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8004db0 0x7fedc800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:04.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 -- 172.21.15.88:0/3136952506 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8004db0 msgr2=0x7fedc800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:04.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8004db0 0x7fedc800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:04.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 -- 172.21.15.88:0/3136952506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedc80044d0 msgr2=0x7fedc8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:04.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedc80044d0 0x7fedc8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:04.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 -- 172.21.15.88:0/3136952506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8003230 con 0x7fedc8003770 2020-02-11T16:32:04.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede7fff700 1 -- 172.21.15.88:0/3136952506 reap_dead start 2020-02-11T16:32:04.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 0x7fedc8003b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fedd8002f30 tx=0x7fede80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 0x7fedc8003b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fedd8002f30 tx=0x7fede80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.522+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 0x7fedc8003b90 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fedd8002f30 tx=0x7fede80684d0).ready entity=mon.1 client_cookie=387246d74b497dfe server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:04.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 0x7fedc8003b90 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fedd8002f30 tx=0x7fede80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 0x7fedc8003b90 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fedd8002f30 tx=0x7fede80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedd8008d30 con 0x7fedc8003770 2020-02-11T16:32:04.533 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fede77fe700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 0x7fedc8003b90 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fedd8002f30 tx=0x7fede80684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd8008e90 con 0x7fedc8003770 2020-02-11T16:32:04.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fede6ffd700 1 -- 172.21.15.88:0/3136952506 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedd8010ac0 con 0x7fedc8003770 2020-02-11T16:32:04.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fedecd9d700 1 -- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 msgr2=0x7fedc8003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:04.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fedecd9d700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 0x7fedc8003b90 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fedd8002f30 tx=0x7fede80684d0).stop 2020-02-11T16:32:04.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fedecd9d700 1 -- 172.21.15.88:0/3136952506 shutdown_connections 2020-02-11T16:32:04.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fedecd9d700 1 --2- 172.21.15.88:0/3136952506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedc8003770 0x7fedc8003b90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:04.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fedecd9d700 1 -- 172.21.15.88:0/3136952506 >> 172.21.15.88:0/3136952506 conn(0x7fede80a9f90 msgr2=0x7fede80aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:04.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fedecd9d700 1 -- 172.21.15.88:0/3136952506 shutdown_connections 2020-02-11T16:32:04.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.523+0000 7fedecd9d700 1 -- 172.21.15.88:0/3136952506 wait complete. 2020-02-11T16:32:04.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.525+0000 7fedecd9d700 1 Processor -- start 2020-02-11T16:32:04.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.525+0000 7fedecd9d700 1 -- start start 2020-02-11T16:32:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.525+0000 7fedecd9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.525+0000 7fedecd9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fede8145860 0x7fede8139200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.525+0000 7fedecd9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede805ed90 con 0x7fede80a2c00 2020-02-11T16:32:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.525+0000 7fedecd9d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede80a4630 con 0x7fede8145860 2020-02-11T16:32:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.525+0000 7fedecd9d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede80a1f20 con 0x7fedc8003770 2020-02-11T16:32:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.525+0000 7feddffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fede80a2c00 0x7fede8145150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49152/0 (socket says 172.21.15.88:49152) 2020-02-11T16:32:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.525+0000 7feddffff700 1 -- 172.21.15.88:0/4116644013 learned_addr learned my addr 172.21.15.88:0/4116644013 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede7fff700 1 --2- 172.21.15.88:0/4116644013 >> v2:172.21.15.52:3300/0 conn(0x7fede8145860 0x7fede8139200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede57fa700 1 -- 172.21.15.88:0/4116644013 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093117196 0 0) 0x7fede805ed90 con 0x7fede80a2c00 2020-02-11T16:32:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede57fa700 1 -- 172.21.15.88:0/4116644013 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedcc002fe0 con 0x7fede80a2c00 2020-02-11T16:32:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede7fff700 1 -- 172.21.15.88:0/4116644013 >> v2:172.21.15.52:3300/0 conn(0x7fede8145860 msgr2=0x7fede8139200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:32:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede7fff700 1 -- 172.21.15.88:0/4116644013 >> v2:172.21.15.52:3300/0 conn(0x7fede8145860 msgr2=0x7fede8139200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:32:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede7fff700 1 --2- 172.21.15.88:0/4116644013 >> v2:172.21.15.52:3300/0 conn(0x7fede8145860 0x7fede8139200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede7fff700 1 --2- 172.21.15.88:0/4116644013 >> v2:172.21.15.52:3300/0 conn(0x7fede8145860 0x7fede8139200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede57fa700 1 -- 172.21.15.88:0/4116644013 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1364274126 0 0) 0x7fedcc002fe0 con 0x7fede80a2c00 2020-02-11T16:32:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 -- 172.21.15.88:0/4116644013 >> v2:172.21.15.52:3300/0 conn(0x7fede8145860 msgr2=0x7fede8139200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> v2:172.21.15.52:3300/0 conn(0x7fede8145860 0x7fede8139200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 -- 172.21.15.88:0/4116644013 >> v1:172.21.15.88:6789/0 conn(0x7fede80a2c00 legacy=0x7fede8145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:04.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 -- 172.21.15.88:0/4116644013 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede80a21c0 con 0x7fedc8003770 2020-02-11T16:32:04.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:04.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede57fa700 1 -- 172.21.15.88:0/4116644013 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedd00016d0 con 0x7fedc8003770 2020-02-11T16:32:04.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede57fa700 1 -- 172.21.15.88:0/4116644013 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd80056c0 con 0x7fedc8003770 2020-02-11T16:32:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fede57fa700 1 -- 172.21.15.88:0/4116644013 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedd8005a60 con 0x7fedc8003770 2020-02-11T16:32:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fedecd9d700 1 -- 172.21.15.88:0/4116644013 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede80a2460 con 0x7fedc8003770 2020-02-11T16:32:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.526+0000 7fedecd9d700 1 -- 172.21.15.88:0/4116644013 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede8139660 con 0x7fedc8003770 2020-02-11T16:32:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.527+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.527+0000 7fede57fa700 1 -- 172.21.15.88:0/4116644013 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fedd8005c60 con 0x7fedc8003770 2020-02-11T16:32:04.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.527+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.527+0000 7fede57fa700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedcc039ee0 0x7fedcc03c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:04.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.527+0000 7fedecd9d700 1 -- 172.21.15.88:0/4116644013 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede80a2660 con 0x7fedc8003770 2020-02-11T16:32:04.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.527+0000 7fede57fa700 1 -- 172.21.15.88:0/4116644013 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fedd8049800 con 0x7fedc8003770 2020-02-11T16:32:04.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.527+0000 7feddffff700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedcc039ee0 0x7fedcc03c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:04.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.528+0000 7feddffff700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedcc039ee0 0x7fedcc03c3a0 crc :-1 s=READY pgs=579 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:04.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.531+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.531+0000 7fede57fa700 1 -- 172.21.15.88:0/4116644013 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fedd8031990 con 0x7fedc8003770 2020-02-11T16:32:04.773 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.771+0000 7fedecd9d700 1 -- 172.21.15.88:0/4116644013 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fede80565b0 con 0x7fedc8003770 2020-02-11T16:32:04.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.771+0000 7fede77fe700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:04.774 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.771+0000 7fede57fa700 1 -- 172.21.15.88:0/4116644013 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7fedd8031990 con 0x7fedc8003770 2020-02-11T16:32:04.775 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":218,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:04.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 -- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedcc039ee0 msgr2=0x7fedcc03c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:04.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedcc039ee0 0x7fedcc03c3a0 crc :-1 s=READY pgs=579 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:04.776 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 -- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 msgr2=0x7fede80a19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:04.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fedd0001150 tx=0x7fedd8007ac0).stop 2020-02-11T16:32:04.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 -- 172.21.15.88:0/4116644013 shutdown_connections 2020-02-11T16:32:04.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fedcc039ee0 0x7fedcc03c3a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:04.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 --2- 172.21.15.88:0/4116644013 >> v2:172.21.15.52:3300/0 conn(0x7fede8145860 0x7fede8139200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:04.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 --2- 172.21.15.88:0/4116644013 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fedc8003770 0x7fede80a19a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:04.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 -- 172.21.15.88:0/4116644013 >> 172.21.15.88:0/4116644013 conn(0x7fede80a9f90 msgr2=0x7fede8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:04.777 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 -- 172.21.15.88:0/4116644013 shutdown_connections 2020-02-11T16:32:04.778 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:04.773+0000 7fedecd9d700 1 -- 172.21.15.88:0/4116644013 wait complete. 2020-02-11T16:32:04.787 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":218,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:05.116 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:05.126 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:05.135 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:05.777 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:05.777 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:05.875 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:05.875 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:05.876 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:05.887 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:05.887 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 3 2020-02-11T16:32:05.887 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:05.888 INFO:tasks.workunit.client.0.smithi088.stdout:3 2020-02-11T16:32:06.718 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:06.731 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:06.738 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:07.196 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:07.185+0000 7f27cb230700 -1 osd.0 pg_epoch: 43 pg[3.6s0( v 42'6089 (0'0,42'6089] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=42'6089 lcod 42'6088 mlcod 42'6088 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.196 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:07.186+0000 7f27cda35700 -1 osd.0 pg_epoch: 43 pg[3.1s0( v 42'6590 (0'0,42'6590] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=42'6590 lcod 42'6589 mlcod 42'6589 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.197 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:07.190+0000 7f27cda35700 -1 osd.0 pg_epoch: 43 pg[3.1s0( v 43'6592 (0'0,43'6592] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=42'6590 crt=42'6590 lcod 42'6589 mlcod 42'6589 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.197 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:07.190+0000 7efe63664700 -1 osd.3 pg_epoch: 43 pg[3.2s0( v 42'6291 (0'0,42'6291] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=42'6291 lcod 42'6290 mlcod 42'6290 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.197 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:07.192+0000 7efe60e5f700 -1 osd.3 pg_epoch: 43 pg[3.7s0( v 42'6168 (0'0,42'6168] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=42'6168 lcod 42'6167 mlcod 42'6167 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.197 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:07.182+0000 7f25f7552700 -1 osd.4 pg_epoch: 43 pg[3.3s0( v 42'6289 (0'0,42'6289] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=42'6289 lcod 42'6288 mlcod 42'6288 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.197 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:07.187+0000 7f25f7552700 -1 osd.4 pg_epoch: 43 pg[3.3s0( v 43'6291 (0'0,43'6291] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=42'6289 crt=42'6289 lcod 42'6288 mlcod 42'6288 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.198 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:07.194+0000 7efe63664700 -1 osd.3 pg_epoch: 43 pg[3.2s0( v 43'6293 (0'0,43'6293] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=42'6291 crt=42'6291 lcod 42'6290 mlcod 42'6290 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.198 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:07.195+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 43 pg[3.5s0( v 42'6126 (0'0,42'6126] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=42'6126 lcod 42'6125 mlcod 42'6125 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.199 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:07.196+0000 7f63db081700 -1 osd.1 pg_epoch: 43 pg[3.4s0( v 42'6401 (0'0,42'6401] local-lis/les=21/22 n=5 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=42'6401 lcod 42'6400 mlcod 42'6400 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.202 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:07.199+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 43 pg[3.5s0( v 43'6128 (0'0,43'6128] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=42'6126 crt=42'6126 lcod 42'6125 mlcod 42'6125 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.204 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:07.202+0000 7f25f354a700 -1 osd.4 pg_epoch: 43 pg[3.3s0( v 43'6293 (0'0,43'6293] local-lis/les=21/22 n=5 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=43'6293 lcod 43'6291 mlcod 43'6291 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.204 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:07.201+0000 7f63d907d700 -1 osd.1 pg_epoch: 43 pg[3.0s0( v 42'6488 (0'0,42'6488] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=42'6488 lcod 42'6487 mlcod 42'6487 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.229 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:07.212+0000 7efe5f65c700 -1 osd.3 pg_epoch: 43 pg[3.2s0( v 43'6295 (0'0,43'6295] local-lis/les=21/22 n=5 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=43'6295 lcod 43'6293 mlcod 43'6293 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.230 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:07.212+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 43 pg[3.1s0( v 43'6594 (0'0,43'6594] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=43'6594 lcod 43'6592 mlcod 43'6592 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.230 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:07.224+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 43 pg[3.5s0( v 43'6130 (0'0,43'6130] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=43'6130 lcod 43'6128 mlcod 43'6128 active+clean+snaptrim trimq=[24a~2] ps=[22e~1c]] removing snap head 2020-02-11T16:32:07.339 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:07.340 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:07.440 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:07.440 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:07.440 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:07.450 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:07.450 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 4 2020-02-11T16:32:07.450 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:07.450 INFO:tasks.workunit.client.0.smithi088.stdout:4 2020-02-11T16:32:07.789 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:07.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.919+0000 7fe0c6969700 1 Processor -- start 2020-02-11T16:32:07.924 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.919+0000 7fe0c6969700 1 -- start start 2020-02-11T16:32:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.920+0000 7fe0c6969700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0c00a5b20 0x7fe0c00a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.920+0000 7fe0c6969700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0c0131280 0x7fe0c01316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.920+0000 7fe0c6969700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c00a4350 con 0x7fe0c00a2fa0 2020-02-11T16:32:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.920+0000 7fe0c6969700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00a1e60 con 0x7fe0c0131280 2020-02-11T16:32:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.920+0000 7fe0c6969700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00a3450 con 0x7fe0c00a5b20 2020-02-11T16:32:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.920+0000 7fe0bf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0c00a5b20 0x7fe0c00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.920+0000 7fe0bffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe0c00a2fa0 0x7fe0c00a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49158/0 (socket says 172.21.15.88:49158) 2020-02-11T16:32:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.920+0000 7fe0bffff700 1 -- 172.21.15.88:0/2049462482 learned_addr learned my addr 172.21.15.88:0/2049462482 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:07.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.920+0000 7fe0beffd700 1 -- 172.21.15.88:0/2049462482 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595449893 0 0) 0x7fe0c00a4350 con 0x7fe0c00a2fa0 2020-02-11T16:32:07.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0c4f06700 1 --2- 172.21.15.88:0/2049462482 >> v2:172.21.15.52:3300/0 conn(0x7fe0c0131280 0x7fe0c01316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:07.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0beffd700 1 -- 172.21.15.88:0/2049462482 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0ac003230 con 0x7fe0c00a2fa0 2020-02-11T16:32:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0bf7fe700 1 -- 172.21.15.88:0/2049462482 >> v2:172.21.15.52:3300/0 conn(0x7fe0c0131280 msgr2=0x7fe0c01316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/2049462482 >> v2:172.21.15.52:3300/0 conn(0x7fe0c0131280 0x7fe0c01316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0bf7fe700 1 -- 172.21.15.88:0/2049462482 >> v1:172.21.15.88:6789/0 conn(0x7fe0c00a2fa0 legacy=0x7fe0c00a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0bf7fe700 1 -- 172.21.15.88:0/2049462482 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00a3a40 con 0x7fe0c00a5b20 2020-02-11T16:32:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/2049462482 >> v2:172.21.15.88:3300/0 conn(0x7fe0c00a5b20 0x7fe0c00a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/2049462482 >> v2:172.21.15.88:3300/0 conn(0x7fe0c00a5b20 0x7fe0c00a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/2049462482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c00a1520 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).ready entity=mon.1 client_cookie=a4db642cebb070a7 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/2049462482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c00a1520 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0beffd700 1 -- 172.21.15.88:0/2049462482 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b40113c0 con 0x7fe0c00a5b20 2020-02-11T16:32:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/2049462482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c00a1520 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/2049462482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c00a1520 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0beffd700 1 -- 172.21.15.88:0/2049462482 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4011520 con 0x7fe0c00a5b20 2020-02-11T16:32:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0beffd700 1 -- 172.21.15.88:0/2049462482 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b4011880 con 0x7fe0c00a5b20 2020-02-11T16:32:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0c6969700 1 -- 172.21.15.88:0/2049462482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 msgr2=0x7fe0c00a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0c6969700 1 --2- 172.21.15.88:0/2049462482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c00a1520 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).stop 2020-02-11T16:32:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0c6969700 1 -- 172.21.15.88:0/2049462482 shutdown_connections 2020-02-11T16:32:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0c6969700 1 --2- 172.21.15.88:0/2049462482 >> v2:172.21.15.52:3300/0 conn(0x7fe0c0131280 0x7fe0c01316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0c6969700 1 --2- 172.21.15.88:0/2049462482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c00a1520 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0c6969700 1 -- 172.21.15.88:0/2049462482 >> 172.21.15.88:0/2049462482 conn(0x7fe0c009d110 msgr2=0x7fe0c009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:07.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0c6969700 1 -- 172.21.15.88:0/2049462482 shutdown_connections 2020-02-11T16:32:07.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.921+0000 7fe0c6969700 1 -- 172.21.15.88:0/2049462482 wait complete. 2020-02-11T16:32:07.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.923+0000 7fe0c6969700 1 Processor -- start 2020-02-11T16:32:07.932 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.923+0000 7fe0c6969700 1 -- start start 2020-02-11T16:32:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0c6969700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0c00a2fa0 0x7fe0c009f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0c6969700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0c00a5b20 0x7fe0c009f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0c6969700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c009f8f0 con 0x7fe0c0131280 2020-02-11T16:32:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0c6969700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00a0070 con 0x7fe0c00a2fa0 2020-02-11T16:32:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0c6969700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00a0310 con 0x7fe0c00a5b20 2020-02-11T16:32:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0bf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0c00a5b20 0x7fe0c009f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0bf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0c00a5b20 0x7fe0c009f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33308/0 (socket says 172.21.15.88:33308) 2020-02-11T16:32:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0bf7fe700 1 -- 172.21.15.88:0/3804109490 learned_addr learned my addr 172.21.15.88:0/3804109490 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0bffff700 1 --2- 172.21.15.88:0/3804109490 >> v2:172.21.15.52:3300/0 conn(0x7fe0c00a2fa0 0x7fe0c009f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0bf7fe700 1 -- 172.21.15.88:0/3804109490 >> v2:172.21.15.52:3300/0 conn(0x7fe0c00a2fa0 msgr2=0x7fe0c009f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> v2:172.21.15.52:3300/0 conn(0x7fe0c00a2fa0 0x7fe0c009f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0bf7fe700 1 -- 172.21.15.88:0/3804109490 >> v1:172.21.15.88:6789/0 conn(0x7fe0c0131280 legacy=0x7fe0c012e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0bd7fa700 1 -- 172.21.15.88:0/3804109490 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169586659 0 0) 0x7fe0c009f8f0 con 0x7fe0c0131280 2020-02-11T16:32:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0bf7fe700 1 -- 172.21.15.88:0/3804109490 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0135330 con 0x7fe0c00a5b20 2020-02-11T16:32:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.924+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> v2:172.21.15.88:3300/0 conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> v2:172.21.15.88:3300/0 conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0bd7fa700 1 -- 172.21.15.88:0/3804109490 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b400f780 con 0x7fe0c00a5b20 2020-02-11T16:32:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0bd7fa700 1 -- 172.21.15.88:0/3804109490 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4007150 con 0x7fe0c00a5b20 2020-02-11T16:32:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0bd7fa700 1 -- 172.21.15.88:0/3804109490 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b40074f0 con 0x7fe0c00a5b20 2020-02-11T16:32:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0c6969700 1 -- 172.21.15.88:0/3804109490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c01383a0 con 0x7fe0c00a5b20 2020-02-11T16:32:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0c6969700 1 -- 172.21.15.88:0/3804109490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c0061e90 con 0x7fe0c00a5b20 2020-02-11T16:32:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.925+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.926+0000 7fe0bd7fa700 1 -- 172.21.15.88:0/3804109490 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe0b40056c0 con 0x7fe0c00a5b20 2020-02-11T16:32:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.926+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.926+0000 7fe0bd7fa700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe0a0039ac0 0x7fe0a003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.926+0000 7fe0c6969700 1 -- 172.21.15.88:0/3804109490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c00565b0 con 0x7fe0c00a5b20 2020-02-11T16:32:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.926+0000 7fe0bd7fa700 1 -- 172.21.15.88:0/3804109490 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fe0b404a2a0 con 0x7fe0c00a5b20 2020-02-11T16:32:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.926+0000 7fe0bffff700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe0a0039ac0 0x7fe0a003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:07.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.926+0000 7fe0bffff700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe0a0039ac0 0x7fe0a003bf80 crc :-1 s=READY pgs=580 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:07.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.930+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:07.941 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:07.930+0000 7fe0bd7fa700 1 -- 172.21.15.88:0/3804109490 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe0b402f8e0 con 0x7fe0c00a5b20 2020-02-11T16:32:08.171 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.169+0000 7fe0c6969700 1 -- 172.21.15.88:0/3804109490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe0c00a0480 con 0x7fe0c00a5b20 2020-02-11T16:32:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.169+0000 7fe0bf7fe700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.169+0000 7fe0bd7fa700 1 -- 172.21.15.88:0/3804109490 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1274 (secure 0 0 0) 0x7fe0b40323d0 con 0x7fe0c00a5b20 2020-02-11T16:32:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":218,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.171+0000 7fe0c6969700 1 -- 172.21.15.88:0/3804109490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe0a0039ac0 msgr2=0x7fe0a003bf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.171+0000 7fe0c6969700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe0a0039ac0 0x7fe0a003bf80 crc :-1 s=READY pgs=580 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.171+0000 7fe0c6969700 1 -- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 msgr2=0x7fe0c009f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.171+0000 7fe0c6969700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c009f490 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fe0b4002f30 tx=0x7fe0b4007a40).stop 2020-02-11T16:32:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.172+0000 7fe0c6969700 1 -- 172.21.15.88:0/3804109490 shutdown_connections 2020-02-11T16:32:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.172+0000 7fe0c6969700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe0a0039ac0 0x7fe0a003bf80 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.172+0000 7fe0c6969700 1 --2- 172.21.15.88:0/3804109490 >> v2:172.21.15.52:3300/0 conn(0x7fe0c00a2fa0 0x7fe0c009f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.172+0000 7fe0c6969700 1 --2- 172.21.15.88:0/3804109490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0c00a5b20 0x7fe0c009f490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.172+0000 7fe0c6969700 1 -- 172.21.15.88:0/3804109490 >> 172.21.15.88:0/3804109490 conn(0x7fe0c009d110 msgr2=0x7fe0c0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.172+0000 7fe0c6969700 1 -- 172.21.15.88:0/3804109490 shutdown_connections 2020-02-11T16:32:08.176 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:08.172+0000 7fe0c6969700 1 -- 172.21.15.88:0/3804109490 wait complete. 2020-02-11T16:32:08.188 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":218,"quorum":[1,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:08.368 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:08.382 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:08.390 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:08.991 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:08.991 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:09.091 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:09.091 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:09.091 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:09.104 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:09.105 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 5 2020-02-11T16:32:09.105 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:09.105 INFO:tasks.workunit.client.0.smithi088.stdout:5 2020-02-11T16:32:09.968 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:09.981 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:09.988 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:10.151 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:10.149+0000 7f2f20b32700 -1 osd.5 pg_epoch: 46 pg[3.5s0( v 45'6145 (0'0,45'6145] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=45'6145 lcod 44'6144 mlcod 44'6144 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.153 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:10.151+0000 7efe5ce57700 -1 osd.3 pg_epoch: 46 pg[3.7s0( v 45'6176 (0'0,45'6176] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=45'6176 lcod 44'6175 mlcod 44'6175 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.154 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:10.152+0000 7f2f20b32700 -1 osd.5 pg_epoch: 46 pg[3.5s0( v 46'6147 (0'0,46'6147] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=45'6145 crt=45'6145 lcod 44'6144 mlcod 44'6144 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.155 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:10.153+0000 7f27cb230700 -1 osd.0 pg_epoch: 46 pg[3.6s0( v 45'6106 (0'0,45'6106] local-lis/les=21/22 n=14 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=45'6106 lcod 45'6105 mlcod 45'6105 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.155 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:10.153+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 46 pg[3.1s0( v 45'6609 (0'0,45'6609] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=45'6609 lcod 45'6608 mlcod 45'6608 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.159 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:10.157+0000 7f25f354a700 -1 osd.4 pg_epoch: 46 pg[3.3s0( v 45'6304 (0'0,45'6304] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=45'6304 lcod 45'6303 mlcod 45'6303 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.160 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:10.158+0000 7efe5f65c700 -1 osd.3 pg_epoch: 46 pg[3.2s0( v 45'6304 (0'0,45'6304] local-lis/les=21/22 n=5 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=45'6304 lcod 45'6303 mlcod 45'6303 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.162 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:10.157+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 46 pg[3.1s0( v 46'6611 (0'0,46'6611] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=45'6609 crt=45'6609 lcod 45'6608 mlcod 45'6608 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.162 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:10.157+0000 7f27cb230700 -1 osd.0 pg_epoch: 46 pg[3.6s0( v 46'6108 (0'0,46'6108] local-lis/les=21/22 n=12 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=45'6106 crt=45'6106 lcod 45'6105 mlcod 45'6105 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.163 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:10.161+0000 7f25f354a700 -1 osd.4 pg_epoch: 46 pg[3.3s0( v 46'6306 (0'0,46'6306] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=45'6304 crt=45'6304 lcod 45'6303 mlcod 45'6303 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.165 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:10.163+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 46 pg[3.5s0( v 46'6149 (0'0,46'6149] local-lis/les=21/22 n=5 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=46'6149 lcod 46'6147 mlcod 46'6147 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.167 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:10.162+0000 7f63d907d700 -1 osd.1 pg_epoch: 46 pg[3.0s0( v 45'6504 (0'0,45'6504] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=45'6504 lcod 44'6503 mlcod 44'6503 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.169 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:10.166+0000 7f63d907d700 -1 osd.1 pg_epoch: 46 pg[3.0s0( v 46'6506 (0'0,46'6506] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=45'6504 crt=45'6504 lcod 44'6503 mlcod 44'6503 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.177 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:10.175+0000 7f27cb230700 -1 osd.0 pg_epoch: 46 pg[3.6s0( v 46'6110 (0'0,46'6110] local-lis/les=21/22 n=10 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=46'6110 lcod 46'6108 mlcod 46'6108 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.181 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:10.179+0000 7f27cda35700 -1 osd.0 pg_epoch: 46 pg[3.1s0( v 46'6613 (0'0,46'6613] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=46'6613 lcod 46'6611 mlcod 46'6611 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.187 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:10.182+0000 7f63dd085700 -1 osd.1 pg_epoch: 46 pg[3.0s0( v 46'6508 (0'0,46'6508] local-lis/les=21/22 n=4 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=46'6508 lcod 46'6506 mlcod 46'6506 active+clean+snaptrim trimq=[24e~2] ps=[248~6]] removing snap head 2020-02-11T16:32:10.658 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:10.659 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:10.773 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:10.774 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:10.774 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:10.785 INFO:tasks.workunit.client.0.smithi088.stdout:6 2020-02-11T16:32:10.785 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:10.785 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 6 2020-02-11T16:32:10.785 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:11.189 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:11.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.313+0000 7fe26b1f6700 1 Processor -- start 2020-02-11T16:32:11.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.313+0000 7fe26b1f6700 1 -- start start 2020-02-11T16:32:11.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.313+0000 7fe26b1f6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:11.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.313+0000 7fe26b1f6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2640a31b0 con 0x7fe2640a6260 2020-02-11T16:32:11.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.313+0000 7fe26b1f6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2640a3570 con 0x7fe2640a5de0 2020-02-11T16:32:11.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.313+0000 7fe26b1f6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640a3810 con 0x7fe2640a18a0 2020-02-11T16:32:11.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.314+0000 7fe263fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe2640a5de0 0x7fe26412e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49176/0 (socket says 172.21.15.88:49176) 2020-02-11T16:32:11.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.314+0000 7fe263fff700 1 -- 172.21.15.88:0/3516479773 learned_addr learned my addr 172.21.15.88:0/3516479773 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:11.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.314+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:11.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.314+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:32:11.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.314+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:11.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.314+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:11.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.314+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.515+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.515+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:32:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.515+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.515+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.515+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:32:11.672 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:11.682 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:11.693 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:11.918 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.916+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:11.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.916+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:32:11.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.916+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:11.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.916+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:11.919 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:11.916+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:32:12.326 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:12.327 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:12.427 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:12.427 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:12.427 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:12.438 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:12.438 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 7 2020-02-11T16:32:12.439 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:12.439 INFO:tasks.workunit.client.0.smithi088.stdout:7 2020-02-11T16:32:12.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:12.721+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:12.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:12.721+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:32:12.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:12.721+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:12.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:12.721+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:12.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:12.721+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:32:13.346 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:13.364 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:13.372 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:13.902 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:13.903 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:14.003 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:14.003 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:14.004 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:14.016 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:14.016 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 8 2020-02-11T16:32:14.016 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:14.016 INFO:tasks.workunit.client.0.smithi088.stdout:8 2020-02-11T16:32:14.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:14.323+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:14.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:14.323+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-11T16:32:14.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:14.323+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:14.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:14.323+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:14.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:14.323+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:32:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:14.489+0000 7fe269793700 1 -- 172.21.15.88:0/3516479773 >> v1:172.21.15.52:6789/0 conn(0x7fe2640a6260 legacy=0x7fe26412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2020-02-11T16:32:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:14.489+0000 7fe269793700 1 -- 172.21.15.88:0/3516479773 >> v1:172.21.15.52:6789/0 conn(0x7fe2640a6260 legacy=0x7fe26412eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:32:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:14.489+0000 7fe269793700 1 --1- 172.21.15.88:0/3516479773 >> v1:172.21.15.52:6789/0 conn(0x7fe2640a6260 0x7fe26412eab0 :-1 s=OPENED pgs=25 cs=1 l=1).handle_message read tag failed 2020-02-11T16:32:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:14.489+0000 7fe269793700 1 --1- 172.21.15.88:0/3516479773 >> v1:172.21.15.52:6789/0 conn(0x7fe2640a6260 0x7fe26412eab0 :-1 s=OPENED pgs=25 cs=1 l=1).fault on lossy channel, failing 2020-02-11T16:32:14.891 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:14.903 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:14.911 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:15.482 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:15.482 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:15.583 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:15.583 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:15.584 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:15.595 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:15.595 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 9 2020-02-11T16:32:15.595 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:15.595 INFO:tasks.workunit.client.0.smithi088.stdout:9 2020-02-11T16:32:15.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.731+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502038606 0 0) 0x7fe2640a3570 con 0x7fe2640a5de0 2020-02-11T16:32:15.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.731+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe250003230 con 0x7fe2640a5de0 2020-02-11T16:32:15.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1341472812 0 0) 0x7fe250003230 con 0x7fe2640a5de0 2020-02-11T16:32:15.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe2640a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:15.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe2640a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:15.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 >> v1:172.21.15.52:6789/0 conn(0x7fe2640a6260 legacy=0x7fe26412eab0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:15.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2640a3ab0 con 0x7fe2640a5de0 2020-02-11T16:32:15.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe25c001a50 con 0x7fe2640a5de0 2020-02-11T16:32:15.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 >> v1:172.21.15.88:6789/0 conn(0x7fe2640a5de0 legacy=0x7fe26412e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:15.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe250003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:15.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe250003b80 0x7fe250003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:15.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe250004570 0x7fe2500049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:15.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640a3810 con 0x7fe250003b80 2020-02-11T16:32:15.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe250004f80 con 0x7fe250004570 2020-02-11T16:32:15.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe250005140 con 0x7fe2640a18a0 2020-02-11T16:32:15.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe250003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:15.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe269793700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe250004570 0x7fe2500049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:15.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe263fff700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe250003b80 0x7fe250003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:15.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.732+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe250004570 msgr2=0x7fe2500049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:15.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe250004570 0x7fe2500049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:15.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe250003b80 msgr2=0x7fe250003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:15.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe250003b80 0x7fe250003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:15.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe268f92700 1 -- 172.21.15.88:0/3516479773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe250003230 con 0x7fe2640a18a0 2020-02-11T16:32:15.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe269793700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe250004570 0x7fe2500049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:32:15.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe250003720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe258002f30 tx=0x7fe25800bbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe250003720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe258002f30 tx=0x7fe25800bbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe250003720 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fe258002f30 tx=0x7fe25800bbc0).ready entity=mon.2 client_cookie=acc43361d704bebc server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:15.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe250003720 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe258002f30 tx=0x7fe25800bbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe250003720 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe258002f30 tx=0x7fe25800bbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe268f92700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe250003720 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe258002f30 tx=0x7fe25800bbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe25800eab0 con 0x7fe2640a18a0 2020-02-11T16:32:15.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25800ec10 con 0x7fe2640a18a0 2020-02-11T16:32:15.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe2637fe700 1 -- 172.21.15.88:0/3516479773 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe258010530 con 0x7fe2640a18a0 2020-02-11T16:32:15.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe26b1f6700 1 -- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 msgr2=0x7fe250003720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:15.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe26b1f6700 1 --2- 172.21.15.88:0/3516479773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2640a18a0 0x7fe250003720 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fe258002f30 tx=0x7fe25800bbc0).stop 2020-02-11T16:32:15.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.733+0000 7fe269793700 1 -- 172.21.15.88:0/3516479773 reap_dead start 2020-02-11T16:32:15.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.734+0000 7fe26b1f6700 1 -- 172.21.15.88:0/3516479773 shutdown_connections 2020-02-11T16:32:15.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.734+0000 7fe26b1f6700 1 -- 172.21.15.88:0/3516479773 >> 172.21.15.88:0/3516479773 conn(0x7fe26409d110 msgr2=0x7fe26409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:15.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.734+0000 7fe26b1f6700 1 -- 172.21.15.88:0/3516479773 shutdown_connections 2020-02-11T16:32:15.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.734+0000 7fe26b1f6700 1 -- 172.21.15.88:0/3516479773 wait complete. 2020-02-11T16:32:15.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.735+0000 7fe26b1f6700 1 Processor -- start 2020-02-11T16:32:15.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.736+0000 7fe26b1f6700 1 -- start start 2020-02-11T16:32:15.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.736+0000 7fe26b1f6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe26414b840 0x7fe26414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:15.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.736+0000 7fe26b1f6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe26414c130 0x7fe264153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:15.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.736+0000 7fe26b1f6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2640a7660 con 0x7fe2640a8cf0 2020-02-11T16:32:15.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.736+0000 7fe26b1f6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe264132440 con 0x7fe26414b840 2020-02-11T16:32:15.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.736+0000 7fe26b1f6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640a47f0 con 0x7fe26414c130 2020-02-11T16:32:15.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe263fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe26414b840 0x7fe26414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:15.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe263fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe26414b840 0x7fe26414bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33338/0 (socket says 172.21.15.88:33338) 2020-02-11T16:32:15.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe263fff700 1 -- 172.21.15.88:0/1771974076 learned_addr learned my addr 172.21.15.88:0/1771974076 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:15.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe269793700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe26414c130 0x7fe264153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:15.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe269793700 1 -- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe26414c130 msgr2=0x7fe264153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:32:15.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe269793700 1 -- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe26414c130 msgr2=0x7fe264153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:32:15.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe269793700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe26414c130 0x7fe264153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:15.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe269793700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe26414c130 0x7fe264153e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:15.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe263fff700 1 -- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe26414c130 msgr2=0x7fe264153e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:15.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe26414c130 0x7fe264153e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:15.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe263fff700 1 -- 172.21.15.88:0/1771974076 >> v1:172.21.15.88:6789/0 conn(0x7fe2640a8cf0 legacy=0x7fe264136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:15.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe263fff700 1 -- 172.21.15.88:0/1771974076 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264135870 con 0x7fe26414b840 2020-02-11T16:32:15.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.737+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> v2:172.21.15.88:3300/0 conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.738+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> v2:172.21.15.88:3300/0 conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.738+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:15.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.738+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.738+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.738+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.739+0000 7fe261ffb700 1 -- 172.21.15.88:0/1771974076 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe25c00ddb0 con 0x7fe26414b840 2020-02-11T16:32:15.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.739+0000 7fe261ffb700 1 -- 172.21.15.88:0/1771974076 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c009950 con 0x7fe26414b840 2020-02-11T16:32:15.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.739+0000 7fe261ffb700 1 -- 172.21.15.88:0/1771974076 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe25c009d70 con 0x7fe26414b840 2020-02-11T16:32:15.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.740+0000 7fe26b1f6700 1 -- 172.21.15.88:0/1771974076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe264137320 con 0x7fe26414b840 2020-02-11T16:32:15.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.740+0000 7fe26b1f6700 1 -- 172.21.15.88:0/1771974076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26412f700 con 0x7fe26414b840 2020-02-11T16:32:15.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.740+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.740+0000 7fe261ffb700 1 -- 172.21.15.88:0/1771974076 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe25c001570 con 0x7fe26414b840 2020-02-11T16:32:15.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.741+0000 7fe261ffb700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe244039e60 0x7fe24403c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:15.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.742+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.742+0000 7fe261ffb700 1 -- 172.21.15.88:0/1771974076 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fe25c031e00 con 0x7fe26414b840 2020-02-11T16:32:15.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.742+0000 7fe26b1f6700 1 -- 172.21.15.88:0/1771974076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe240003340 con 0x7fe26414b840 2020-02-11T16:32:15.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.743+0000 7fe268f92700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe244039e60 0x7fe24403c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:15.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.743+0000 7fe268f92700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe244039e60 0x7fe24403c320 crc :-1 s=READY pgs=581 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:15.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.748+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.748+0000 7fe261ffb700 1 -- 172.21.15.88:0/1771974076 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe25c032060 con 0x7fe26414b840 2020-02-11T16:32:15.967 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.966+0000 7fe26b1f6700 1 -- 172.21.15.88:0/1771974076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe2400036e0 con 0x7fe26414b840 2020-02-11T16:32:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.966+0000 7fe263fff700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.966+0000 7fe261ffb700 1 -- 172.21.15.88:0/1771974076 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fe25c031c20 con 0x7fe26414b840 2020-02-11T16:32:15.968 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":222,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 -- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe244039e60 msgr2=0x7fe24403c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe244039e60 0x7fe24403c320 crc :-1 s=READY pgs=581 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 -- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 msgr2=0x7fe26414bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 0x7fe26414bcd0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fe25c001450 tx=0x7fe2640a1c80).stop 2020-02-11T16:32:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 -- 172.21.15.88:0/1771974076 shutdown_connections 2020-02-11T16:32:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe244039e60 0x7fe24403c320 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe26414c130 0x7fe264153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 --2- 172.21.15.88:0/1771974076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe26414b840 0x7fe26414bcd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 -- 172.21.15.88:0/1771974076 >> 172.21.15.88:0/1771974076 conn(0x7fe26409d110 msgr2=0x7fe26412ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 -- 172.21.15.88:0/1771974076 shutdown_connections 2020-02-11T16:32:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:15.969+0000 7fe26b1f6700 1 -- 172.21.15.88:0/1771974076 wait complete. 2020-02-11T16:32:15.984 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":222,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:16.501 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:16.518 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:16.525 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:17.194 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:17.194 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:17.294 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:17.294 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:17.294 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:17.306 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:17.306 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 10 2020-02-11T16:32:17.307 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:17.307 INFO:tasks.workunit.client.0.smithi088.stdout:10 2020-02-11T16:32:18.163 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:18.177 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:18.184 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:18.767 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:18.768 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:18.866 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:18.867 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:18.867 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:18.879 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:18.879 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 11 2020-02-11T16:32:18.879 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:18.879 INFO:tasks.workunit.client.0.smithi088.stdout:11 2020-02-11T16:32:18.986 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:19.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.129+0000 7fc65c2e1700 1 Processor -- start 2020-02-11T16:32:19.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.129+0000 7fc65c2e1700 1 -- start start 2020-02-11T16:32:19.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65c2e1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:19.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65c2e1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6540a4350 con 0x7fc6540a5b20 2020-02-11T16:32:19.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65c2e1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6540a3a40 con 0x7fc6540a2fa0 2020-02-11T16:32:19.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65c2e1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6540a1e60 con 0x7fc6540a1520 2020-02-11T16:32:19.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65a87e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:19.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65a87e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33348/0 (socket says 172.21.15.88:33348) 2020-02-11T16:32:19.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65a07d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc6540a2fa0 0x7fc6540a5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49202/0 (socket says 172.21.15.88:49202) 2020-02-11T16:32:19.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65a87e700 1 -- 172.21.15.88:0/237391378 learned_addr learned my addr 172.21.15.88:0/237391378 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:19.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65a87e700 1 -- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 msgr2=0x7fc654131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65a87e700 1 -- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 msgr2=0x7fc654131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.130+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:19.332 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.331+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:19.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.331+0000 7fc65a87e700 1 -- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 msgr2=0x7fc654131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:19.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.331+0000 7fc65a87e700 1 -- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 msgr2=0x7fc654131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:19.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.331+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:19.333 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.331+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:32:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.732+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.732+0000 7fc65a87e700 1 -- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 msgr2=0x7fc654131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.732+0000 7fc65a87e700 1 -- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 msgr2=0x7fc654131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.732+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:19.732+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:32:19.755 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:19.771 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:19.779 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:20.370 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:20.370 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:20.470 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:20.470 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:20.470 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:20.482 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:20.482 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 12 2020-02-11T16:32:20.482 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:20.482 INFO:tasks.workunit.client.0.smithi088.stdout:12 2020-02-11T16:32:20.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:20.533+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:20.534 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:20.533+0000 7fc65a87e700 1 -- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 msgr2=0x7fc654131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:20.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:20.533+0000 7fc65a87e700 1 -- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 msgr2=0x7fc654131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:20.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:20.533+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:20.535 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:20.533+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:32:21.409 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:21.428 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:21.435 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:21.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326776765 0 0) 0x7fc6540a3a40 con 0x7fc6540a2fa0 2020-02-11T16:32:21.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc63c003230 con 0x7fc6540a2fa0 2020-02-11T16:32:21.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1335176201 0 0) 0x7fc63c003230 con 0x7fc6540a2fa0 2020-02-11T16:32:21.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 msgr2=0x7fc654131990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:21.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 --2- 172.21.15.88:0/237391378 >> v2:172.21.15.88:3300/0 conn(0x7fc6540a1520 0x7fc654131990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:21.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 >> v1:172.21.15.52:6789/0 conn(0x7fc6540a5b20 legacy=0x7fc654131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:21.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540a3ce0 con 0x7fc6540a2fa0 2020-02-11T16:32:21.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fc6500016d0 con 0x7fc6540a2fa0 2020-02-11T16:32:21.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 >> v1:172.21.15.88:6789/0 conn(0x7fc6540a2fa0 legacy=0x7fc6540a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:21.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 0x7fc63c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:21.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc63c0044d0 0x7fc63c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:21.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc63c004db0 0x7fc63c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:21.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6540a1e60 con 0x7fc63c004db0 2020-02-11T16:32:21.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0041c0 con 0x7fc63c003720 2020-02-11T16:32:21.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c00bb80 con 0x7fc63c0044d0 2020-02-11T16:32:21.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65a07d700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 0x7fc63c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:21.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65987c700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc63c0044d0 0x7fc63c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:21.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.727+0000 7fc65a87e700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc63c004db0 0x7fc63c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:21.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 -- 172.21.15.88:0/237391378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc63c0044d0 msgr2=0x7fc63c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:21.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc63c0044d0 0x7fc63c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:21.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 -- 172.21.15.88:0/237391378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc63c004db0 msgr2=0x7fc63c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:21.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc63c004db0 0x7fc63c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:21.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a87e700 1 -- 172.21.15.88:0/237391378 reap_dead start 2020-02-11T16:32:21.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 -- 172.21.15.88:0/237391378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c003230 con 0x7fc63c003720 2020-02-11T16:32:21.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 0x7fc63c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc63c0054a0 tx=0x7fc650001cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 0x7fc63c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc63c0054a0 tx=0x7fc650001cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 0x7fc63c003b40 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fc63c0054a0 tx=0x7fc650001cc0).ready entity=mon.1 client_cookie=ba21a74d06590c2 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:21.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 0x7fc63c003b40 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fc63c0054a0 tx=0x7fc650001cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 0x7fc63c003b40 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fc63c0054a0 tx=0x7fc650001cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc65000ee30 con 0x7fc63c003720 2020-02-11T16:32:21.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc650010d30 con 0x7fc63c003720 2020-02-11T16:32:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65a07d700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 0x7fc63c003b40 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fc63c0054a0 tx=0x7fc650001cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65907b700 1 -- 172.21.15.88:0/237391378 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc650010ea0 con 0x7fc63c003720 2020-02-11T16:32:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65c2e1700 1 -- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 msgr2=0x7fc63c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.728+0000 7fc65c2e1700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 0x7fc63c003b40 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fc63c0054a0 tx=0x7fc650001cc0).stop 2020-02-11T16:32:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.729+0000 7fc65c2e1700 1 -- 172.21.15.88:0/237391378 shutdown_connections 2020-02-11T16:32:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.729+0000 7fc65c2e1700 1 --2- 172.21.15.88:0/237391378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003720 0x7fc63c003b40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.729+0000 7fc65c2e1700 1 -- 172.21.15.88:0/237391378 >> 172.21.15.88:0/237391378 conn(0x7fc65409d110 msgr2=0x7fc65409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:21.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.729+0000 7fc65c2e1700 1 -- 172.21.15.88:0/237391378 shutdown_connections 2020-02-11T16:32:21.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.729+0000 7fc65c2e1700 1 -- 172.21.15.88:0/237391378 wait complete. 2020-02-11T16:32:21.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.730+0000 7fc65c2e1700 1 Processor -- start 2020-02-11T16:32:21.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.730+0000 7fc65c2e1700 1 -- start start 2020-02-11T16:32:21.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.730+0000 7fc65c2e1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc654137660 0x7fc654146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:21.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.730+0000 7fc65c2e1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc654137ad0 con 0x7fc63c003720 2020-02-11T16:32:21.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.730+0000 7fc65c2e1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6540a0fe0 con 0x7fc6541469e0 2020-02-11T16:32:21.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.730+0000 7fc65c2e1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc654131df0 con 0x7fc654137660 2020-02-11T16:32:21.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.730+0000 7fc65987c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc654137660 0x7fc654146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:21.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.730+0000 7fc65a87e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc6541469e0 0x7fc65414d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49224/0 (socket says 172.21.15.88:49224) 2020-02-11T16:32:21.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.730+0000 7fc65a87e700 1 -- 172.21.15.88:0/3945236141 learned_addr learned my addr 172.21.15.88:0/3945236141 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:21.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.731+0000 7fc65987c700 1 -- 172.21.15.88:0/3945236141 >> v1:172.21.15.88:6789/0 conn(0x7fc6541469e0 legacy=0x7fc65414d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:21.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.731+0000 7fc65987c700 1 -- 172.21.15.88:0/3945236141 >> v1:172.21.15.52:6789/0 conn(0x7fc63c003720 legacy=0x7fc6540669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:21.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.731+0000 7fc65987c700 1 -- 172.21.15.88:0/3945236141 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654061220 con 0x7fc654137660 2020-02-11T16:32:21.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.731+0000 7fc65987c700 1 --2- 172.21.15.88:0/3945236141 >> v2:172.21.15.88:3300/0 conn(0x7fc654137660 0x7fc654146580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.731+0000 7fc65987c700 1 --2- 172.21.15.88:0/3945236141 >> v2:172.21.15.88:3300/0 conn(0x7fc654137660 0x7fc654146580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.731+0000 7fc65987c700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 0x7fc654146580 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:21.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.732+0000 7fc65987c700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 0x7fc654146580 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.732+0000 7fc65987c700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 0x7fc654146580 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.732+0000 7fc65987c700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 0x7fc654146580 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.732+0000 7fc6437fe700 1 -- 172.21.15.88:0/3945236141 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc644012520 con 0x7fc654137660 2020-02-11T16:32:21.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.733+0000 7fc6437fe700 1 -- 172.21.15.88:0/3945236141 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc644012680 con 0x7fc654137660 2020-02-11T16:32:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.733+0000 7fc65c2e1700 1 -- 172.21.15.88:0/3945236141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6540614c0 con 0x7fc654137660 2020-02-11T16:32:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.733+0000 7fc6437fe700 1 -- 172.21.15.88:0/3945236141 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc644012aa0 con 0x7fc654137660 2020-02-11T16:32:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.733+0000 7fc65c2e1700 1 -- 172.21.15.88:0/3945236141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc654138310 con 0x7fc654137660 2020-02-11T16:32:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.733+0000 7fc65987c700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 0x7fc654146580 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.734+0000 7fc6437fe700 1 -- 172.21.15.88:0/3945236141 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc644012d10 con 0x7fc654137660 2020-02-11T16:32:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.734+0000 7fc65987c700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 0x7fc654146580 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.734+0000 7fc6437fe700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc634039b50 0x7fc63403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.734+0000 7fc6437fe700 1 -- 172.21.15.88:0/3945236141 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fc644049be0 con 0x7fc654137660 2020-02-11T16:32:21.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.734+0000 7fc65c2e1700 1 -- 172.21.15.88:0/3945236141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6540a78b0 con 0x7fc654137660 2020-02-11T16:32:21.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.734+0000 7fc65a07d700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc634039b50 0x7fc63403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:21.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.734+0000 7fc65a07d700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc634039b50 0x7fc63403c010 crc :-1 s=READY pgs=582 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:21.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.737+0000 7fc65987c700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 0x7fc654146580 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.737+0000 7fc6437fe700 1 -- 172.21.15.88:0/3945236141 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc6540a78b0 con 0x7fc654137660 2020-02-11T16:32:21.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.924+0000 7fc65c2e1700 1 -- 172.21.15.88:0/3945236141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc6540a78b0 con 0x7fc654137660 2020-02-11T16:32:21.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.924+0000 7fc65987c700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 0x7fc654146580 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:21.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.924+0000 7fc6437fe700 1 -- 172.21.15.88:0/3945236141 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fc6540a78b0 con 0x7fc654137660 2020-02-11T16:32:21.926 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":226,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:21.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.926+0000 7fc65c2e1700 1 -- 172.21.15.88:0/3945236141 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc634039b50 msgr2=0x7fc63403c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:21.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.926+0000 7fc65c2e1700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc634039b50 0x7fc63403c010 crc :-1 s=READY pgs=582 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:21.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.926+0000 7fc65c2e1700 1 -- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 msgr2=0x7fc654146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:21.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.926+0000 7fc65c2e1700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 0x7fc654146580 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fc65405ef00 tx=0x7fc644010ca0).stop 2020-02-11T16:32:21.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.926+0000 7fc65c2e1700 1 -- 172.21.15.88:0/3945236141 shutdown_connections 2020-02-11T16:32:21.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.926+0000 7fc65c2e1700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc634039b50 0x7fc63403c010 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:21.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.926+0000 7fc65c2e1700 1 --2- 172.21.15.88:0/3945236141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc654137660 0x7fc654146580 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:21.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.926+0000 7fc65c2e1700 1 -- 172.21.15.88:0/3945236141 >> 172.21.15.88:0/3945236141 conn(0x7fc65409d110 msgr2=0x7fc654069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:21.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.926+0000 7fc65c2e1700 1 -- 172.21.15.88:0/3945236141 shutdown_connections 2020-02-11T16:32:21.929 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:21.926+0000 7fc65c2e1700 1 -- 172.21.15.88:0/3945236141 wait complete. 2020-02-11T16:32:21.937 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":226,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:22.467 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:32:22.470 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:32:22.517 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:22.517 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:22.617 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:22.617 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:22.617 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:22.629 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:22.629 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 13 2020-02-11T16:32:22.629 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:22.630 INFO:tasks.workunit.client.0.smithi088.stdout:13 2020-02-11T16:32:23.480 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:23.495 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:23.502 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:24.634 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:24.634 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:24.735 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:24.735 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:24.735 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:24.748 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:24.748 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 14 2020-02-11T16:32:24.748 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:24.749 INFO:tasks.workunit.client.0.smithi088.stdout:14 2020-02-11T16:32:24.938 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.045+0000 7fa6a522b700 1 Processor -- start 2020-02-11T16:32:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.045+0000 7fa6a522b700 1 -- start start 2020-02-11T16:32:25.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.046+0000 7fa6a522b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:25.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.046+0000 7fa6a522b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a00adb40 con 0x7fa6a00a9130 2020-02-11T16:32:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.046+0000 7fa6a522b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a0137de0 con 0x7fa6a00ad380 2020-02-11T16:32:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.046+0000 7fa6a522b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a0137bf0 con 0x7fa6a0131bd0 2020-02-11T16:32:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.046+0000 7fa69ed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa6a00ad380 0x7fa6a0138280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49228/0 (socket says 172.21.15.88:49228) 2020-02-11T16:32:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.046+0000 7fa69ed9d700 1 -- 172.21.15.88:0/1539871717 learned_addr learned my addr 172.21.15.88:0/1539871717 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.047+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.047+0000 7fa69f59e700 1 -- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 msgr2=0x7fa6a0132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.047+0000 7fa69f59e700 1 -- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 msgr2=0x7fa6a0132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.047+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.047+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.248+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.248+0000 7fa69f59e700 1 -- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 msgr2=0x7fa6a0132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.248+0000 7fa69f59e700 1 -- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 msgr2=0x7fa6a0132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.248+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.248+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:32:25.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.649+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:25.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.649+0000 7fa69f59e700 1 -- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 msgr2=0x7fa6a0132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:25.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.649+0000 7fa69f59e700 1 -- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 msgr2=0x7fa6a0132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:25.651 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.649+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:25.652 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:25.649+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:32:26.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:26.450+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:26.452 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:26.451+0000 7fa69f59e700 1 -- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 msgr2=0x7fa6a0132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:26.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:26.451+0000 7fa69f59e700 1 -- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 msgr2=0x7fa6a0132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:26.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:26.451+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:26.453 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:26.451+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:32:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.729+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626754413 0 0) 0x7fa6a0137de0 con 0x7fa6a00ad380 2020-02-11T16:32:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.729+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa680003230 con 0x7fa6a00ad380 2020-02-11T16:32:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 119133093 0 0) 0x7fa680003230 con 0x7fa6a00ad380 2020-02-11T16:32:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 msgr2=0x7fa6a0132010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 --2- 172.21.15.88:0/1539871717 >> v2:172.21.15.52:3300/0 conn(0x7fa6a0131bd0 0x7fa6a0132010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 >> v1:172.21.15.52:6789/0 conn(0x7fa6a00a9130 legacy=0x7fa6a01314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a00a95c0 con 0x7fa6a00ad380 2020-02-11T16:32:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa690001a50 con 0x7fa6a00ad380 2020-02-11T16:32:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 >> v1:172.21.15.88:6789/0 conn(0x7fa6a00ad380 legacy=0x7fa6a0138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 0x7fa680003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:27.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6800044d0 0x7fa680004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:27.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa680004db0 0x7fa68000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:27.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800041e0 con 0x7fa6800044d0 2020-02-11T16:32:27.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68000bb80 con 0x7fa680003720 2020-02-11T16:32:27.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68000bcc0 con 0x7fa680004db0 2020-02-11T16:32:27.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 0x7fa680003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:27.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69e59c700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6800044d0 0x7fa680004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa680004db0 0x7fa68000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69ed9d700 1 -- 172.21.15.88:0/1539871717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa680004db0 msgr2=0x7fa68000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa680004db0 0x7fa68000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69ed9d700 1 -- 172.21.15.88:0/1539871717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6800044d0 msgr2=0x7fa680004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6800044d0 0x7fa680004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69ed9d700 1 -- 172.21.15.88:0/1539871717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680003230 con 0x7fa680003720 2020-02-11T16:32:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69f59e700 1 -- 172.21.15.88:0/1539871717 reap_dead start 2020-02-11T16:32:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 0x7fa680003b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa690001760 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 0x7fa680003b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa690001760 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.730+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 0x7fa680003b60 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fa690001760 tx=0x7fa6a00a9750).ready entity=mon.1 client_cookie=2bd3b648817a7ab6 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 0x7fa680003b60 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fa690001760 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 0x7fa680003b60 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fa690001760 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa69000e5e0 con 0x7fa680003720 2020-02-11T16:32:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 0x7fa680003b60 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fa690001760 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa690011e90 con 0x7fa680003720 2020-02-11T16:32:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa69dd9b700 1 -- 172.21.15.88:0/1539871717 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa69000e930 con 0x7fa680003720 2020-02-11T16:32:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa6a522b700 1 -- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 msgr2=0x7fa680003b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa6a522b700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 0x7fa680003b60 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fa690001760 tx=0x7fa6a00a9750).stop 2020-02-11T16:32:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa6a522b700 1 -- 172.21.15.88:0/1539871717 shutdown_connections 2020-02-11T16:32:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa6a522b700 1 --2- 172.21.15.88:0/1539871717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa680003720 0x7fa680003b60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa6a522b700 1 -- 172.21.15.88:0/1539871717 >> 172.21.15.88:0/1539871717 conn(0x7fa6a005ac70 msgr2=0x7fa6a00ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.731+0000 7fa6a522b700 1 -- 172.21.15.88:0/1539871717 shutdown_connections 2020-02-11T16:32:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.732+0000 7fa6a522b700 1 -- 172.21.15.88:0/1539871717 wait complete. 2020-02-11T16:32:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.733+0000 7fa6a522b700 1 Processor -- start 2020-02-11T16:32:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.733+0000 7fa6a522b700 1 -- start start 2020-02-11T16:32:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.733+0000 7fa6a522b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 0x7fa6a00a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.733+0000 7fa6a522b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a0148300 con 0x7fa6a0137060 2020-02-11T16:32:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.733+0000 7fa6a522b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a0148530 con 0x7fa680003720 2020-02-11T16:32:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.733+0000 7fa6a522b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a01487d0 con 0x7fa6a0148f10 2020-02-11T16:32:27.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.733+0000 7fa69ed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa680003720 0x7fa6a0144d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49264/0 (socket says 172.21.15.88:49264) 2020-02-11T16:32:27.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.733+0000 7fa69ed9d700 1 -- 172.21.15.88:0/1183575915 learned_addr learned my addr 172.21.15.88:0/1183575915 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:27.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.733+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 0x7fa6a00a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:27.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69f59e700 1 -- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 msgr2=0x7fa6a00a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-02-11T16:32:27.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69f59e700 1 -- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 msgr2=0x7fa6a00a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:32:27.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 0x7fa6a00a7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:27.746 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69f59e700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 0x7fa6a00a7030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171450762 0 0) 0x7fa6a0148530 con 0x7fa680003720 2020-02-11T16:32:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa684002fe0 con 0x7fa680003720 2020-02-11T16:32:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602513957 0 0) 0x7fa6a0148300 con 0x7fa6a0137060 2020-02-11T16:32:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6a0148530 con 0x7fa6a0137060 2020-02-11T16:32:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1625829596 0 0) 0x7fa684002fe0 con 0x7fa680003720 2020-02-11T16:32:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa6a0148300 con 0x7fa680003720 2020-02-11T16:32:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa69000bfe0 con 0x7fa680003720 2020-02-11T16:32:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 msgr2=0x7fa6a00a7030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 0x7fa6a00a7030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 >> v1:172.21.15.88:6789/0 conn(0x7fa680003720 legacy=0x7fa6a0144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 >> v1:172.21.15.52:6789/0 conn(0x7fa6a0137060 legacy=0x7fa6a0134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 0x7fa684003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa684003c60 0x7fa6840040e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a01487d0 con 0x7fa684003c60 2020-02-11T16:32:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa684004540 con 0x7fa684004b20 2020-02-11T16:32:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840046b0 con 0x7fa6a0148f10 2020-02-11T16:32:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69e59c700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 0x7fa684003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69e59c700 1 -- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 msgr2=0x7fa684003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-02-11T16:32:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69e59c700 1 -- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 msgr2=0x7fa684003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-02-11T16:32:27.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69e59c700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 0x7fa684003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:27.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69ed9d700 1 -- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 msgr2=0x7fa684003800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:27.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.734+0000 7fa69e59c700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 0x7fa684003800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:27.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6a0148f10 0x7fa684003800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:27.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 -- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa684003c60 msgr2=0x7fa6840040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:27.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa684003c60 0x7fa6840040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:27.751 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 -- 172.21.15.88:0/1183575915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a0148a70 con 0x7fa684004b20 2020-02-11T16:32:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa6a522b700 1 -- 172.21.15.88:0/1183575915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a00a5190 con 0x7fa684004b20 2020-02-11T16:32:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa69000b960 con 0x7fa684004b20 2020-02-11T16:32:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa690010c20 con 0x7fa684004b20 2020-02-11T16:32:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa690004e40 con 0x7fa684004b20 2020-02-11T16:32:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa6a522b700 1 -- 172.21.15.88:0/1183575915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a00a7030 con 0x7fa684004b20 2020-02-11T16:32:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.735+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.736+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa690006180 con 0x7fa684004b20 2020-02-11T16:32:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.736+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.736+0000 7fa697fff700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa684042050 0x7fa684044510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.736+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fa69004ab40 con 0x7fa684004b20 2020-02-11T16:32:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.736+0000 7fa6a522b700 1 -- 172.21.15.88:0/1183575915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a005e2f0 con 0x7fa684004b20 2020-02-11T16:32:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.736+0000 7fa69e59c700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa684042050 0x7fa684044510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.736+0000 7fa69e59c700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa684042050 0x7fa684044510 crc :-1 s=READY pgs=583 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.740+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.755 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.740+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fa690033130 con 0x7fa684004b20 2020-02-11T16:32:27.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.923+0000 7fa6a522b700 1 -- 172.21.15.88:0/1183575915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa6a0148c00 con 0x7fa684004b20 2020-02-11T16:32:27.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.923+0000 7fa69ed9d700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:27.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.923+0000 7fa697fff700 1 -- 172.21.15.88:0/1183575915 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7fa690032cf0 con 0x7fa684004b20 2020-02-11T16:32:27.926 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":230,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.925+0000 7fa6a522b700 1 -- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa684042050 msgr2=0x7fa684044510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.925+0000 7fa6a522b700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa684042050 0x7fa684044510 crc :-1 s=READY pgs=583 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.925+0000 7fa6a522b700 1 -- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 msgr2=0x7fa684004f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.925+0000 7fa6a522b700 1 --2- 172.21.15.88:0/1183575915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa684004b20 0x7fa684004f60 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fa6900017a0 tx=0x7fa6a00a9750).stop 2020-02-11T16:32:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.925+0000 7fa69f59e700 1 -- 172.21.15.88:0/1183575915 reap_dead start 2020-02-11T16:32:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.925+0000 7fa69f59e700 1 -- 172.21.15.88:0/1183575915 reap_dead start 2020-02-11T16:32:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.925+0000 7fa6a522b700 1 -- 172.21.15.88:0/1183575915 shutdown_connections 2020-02-11T16:32:27.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.925+0000 7fa6a522b700 1 -- 172.21.15.88:0/1183575915 >> 172.21.15.88:0/1183575915 conn(0x7fa6a005ac70 msgr2=0x7fa6a00ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:27.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.925+0000 7fa6a522b700 1 -- 172.21.15.88:0/1183575915 shutdown_connections 2020-02-11T16:32:27.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:27.925+0000 7fa6a522b700 1 -- 172.21.15.88:0/1183575915 wait complete. 2020-02-11T16:32:27.937 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":230,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:30.938 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:31.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.052+0000 7fe93515a700 1 Processor -- start 2020-02-11T16:32:31.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.052+0000 7fe93515a700 1 -- start start 2020-02-11T16:32:31.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe93515a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9300a18a0 0x7fe9300a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:31.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe93515a700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9300a5de0 0x7fe9300a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe93515a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300a31b0 con 0x7fe93012e3a0 2020-02-11T16:32:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe93515a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9300a3570 con 0x7fe9300a18a0 2020-02-11T16:32:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe93515a700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300a3810 con 0x7fe9300a5de0 2020-02-11T16:32:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9300a18a0 0x7fe9300a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9300a18a0 0x7fe9300a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33420/0 (socket says 172.21.15.88:33420) 2020-02-11T16:32:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92f59e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe93012e3a0 0x7fe93012e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49282/0 (socket says 172.21.15.88:49282) 2020-02-11T16:32:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 -- 172.21.15.88:0/2699110497 learned_addr learned my addr 172.21.15.88:0/2699110497 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 -- 172.21.15.88:0/2699110497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9300a5de0 msgr2=0x7fe9300a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 --2- 172.21.15.88:0/2699110497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9300a5de0 0x7fe9300a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 -- 172.21.15.88:0/2699110497 >> v1:172.21.15.88:6789/0 conn(0x7fe93012e3a0 legacy=0x7fe93012e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 -- 172.21.15.88:0/2699110497 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300a3ab0 con 0x7fe9300a18a0 2020-02-11T16:32:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92dd9b700 1 -- 172.21.15.88:0/2699110497 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195817008 0 0) 0x7fe9300a31b0 con 0x7fe93012e3a0 2020-02-11T16:32:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 --2- 172.21.15.88:0/2699110497 >> v2:172.21.15.88:3300/0 conn(0x7fe9300a18a0 0x7fe9300a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe918002f30 tx=0x7fe9180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 --2- 172.21.15.88:0/2699110497 >> v2:172.21.15.88:3300/0 conn(0x7fe9300a18a0 0x7fe9300a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe918002f30 tx=0x7fe9180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 --2- 172.21.15.88:0/2699110497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9300a18a0 0x7fe9300a6dd0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fe918002f30 tx=0x7fe9180088e0).ready entity=mon.1 client_cookie=c2a6c5fb1b8803b5 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 --2- 172.21.15.88:0/2699110497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9300a18a0 0x7fe9300a6dd0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fe918002f30 tx=0x7fe9180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 --2- 172.21.15.88:0/2699110497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9300a18a0 0x7fe9300a6dd0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fe918002f30 tx=0x7fe9180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92dd9b700 1 -- 172.21.15.88:0/2699110497 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe918011760 con 0x7fe9300a18a0 2020-02-11T16:32:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.053+0000 7fe92ed9d700 1 --2- 172.21.15.88:0/2699110497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9300a18a0 0x7fe9300a6dd0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fe918002f30 tx=0x7fe9180088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.054+0000 7fe92dd9b700 1 -- 172.21.15.88:0/2699110497 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9180118c0 con 0x7fe9300a18a0 2020-02-11T16:32:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.054+0000 7fe92dd9b700 1 -- 172.21.15.88:0/2699110497 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe918011c60 con 0x7fe9300a18a0 2020-02-11T16:32:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.054+0000 7fe93515a700 1 -- 172.21.15.88:0/2699110497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9300a18a0 msgr2=0x7fe9300a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.054+0000 7fe93515a700 1 --2- 172.21.15.88:0/2699110497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9300a18a0 0x7fe9300a6dd0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fe918002f30 tx=0x7fe9180088e0).stop 2020-02-11T16:32:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.054+0000 7fe93515a700 1 -- 172.21.15.88:0/2699110497 shutdown_connections 2020-02-11T16:32:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.054+0000 7fe93515a700 1 --2- 172.21.15.88:0/2699110497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9300a18a0 0x7fe9300a6dd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.054+0000 7fe93515a700 1 --2- 172.21.15.88:0/2699110497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe9300a5de0 0x7fe9300a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.054+0000 7fe93515a700 1 -- 172.21.15.88:0/2699110497 >> 172.21.15.88:0/2699110497 conn(0x7fe93009d110 msgr2=0x7fe93009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.054+0000 7fe93515a700 1 -- 172.21.15.88:0/2699110497 shutdown_connections 2020-02-11T16:32:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.054+0000 7fe93515a700 1 -- 172.21.15.88:0/2699110497 wait complete. 2020-02-11T16:32:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.055+0000 7fe93515a700 1 Processor -- start 2020-02-11T16:32:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.055+0000 7fe93515a700 1 -- start start 2020-02-11T16:32:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe93515a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe9300a5de0 0x7fe9300a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe93515a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300a0170 con 0x7fe93012e3a0 2020-02-11T16:32:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe93515a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300a0410 con 0x7fe9300a18a0 2020-02-11T16:32:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe93515a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93009ff80 con 0x7fe9300a5de0 2020-02-11T16:32:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe92ed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe9300a18a0 0x7fe9301484e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49284/0 (socket says 172.21.15.88:49284) 2020-02-11T16:32:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe92ed9d700 1 -- 172.21.15.88:0/3561424251 learned_addr learned my addr 172.21.15.88:0/3561424251 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe92e59c700 1 --2- 172.21.15.88:0/3561424251 >> v2:172.21.15.52:3300/0 conn(0x7fe9300a5de0 0x7fe9300a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509094235 0 0) 0x7fe9300a0410 con 0x7fe9300a18a0 2020-02-11T16:32:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe914002fe0 con 0x7fe9300a18a0 2020-02-11T16:32:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1535634881 0 0) 0x7fe914002fe0 con 0x7fe9300a18a0 2020-02-11T16:32:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9300a0410 con 0x7fe9300a18a0 2020-02-11T16:32:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fe9180085c0 con 0x7fe9300a18a0 2020-02-11T16:32:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 >> v2:172.21.15.52:3300/0 conn(0x7fe9300a5de0 msgr2=0x7fe9300a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 --2- 172.21.15.88:0/3561424251 >> v2:172.21.15.52:3300/0 conn(0x7fe9300a5de0 0x7fe9300a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 >> v1:172.21.15.88:6789/0 conn(0x7fe9300a18a0 legacy=0x7fe9301484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 >> v1:172.21.15.52:6789/0 conn(0x7fe93012e3a0 legacy=0x7fe9301283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9140049b0 0x7fe914004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe914003920 0x7fe914003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe914004700 con 0x7fe9140049b0 2020-02-11T16:32:31.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91400bbb0 con 0x7fe9140041c0 2020-02-11T16:32:31.070 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91400bcf0 con 0x7fe914003920 2020-02-11T16:32:31.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe92e59c700 1 --2- 172.21.15.88:0/3561424251 >> v2:172.21.15.52:3300/0 conn(0x7fe9300a5de0 0x7fe9300a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:32:31.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.056+0000 7fe92ed9d700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9140049b0 0x7fe914004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92e59c700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe914003920 0x7fe914003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 -- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe914003920 msgr2=0x7fe914003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.071 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe914003920 0x7fe914003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 -- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9140049b0 msgr2=0x7fe914004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9140049b0 0x7fe914004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 -- 172.21.15.88:0/3561424251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300a06b0 con 0x7fe9140041c0 2020-02-11T16:32:31.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe93515a700 1 -- 172.21.15.88:0/3561424251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe930066990 con 0x7fe9140041c0 2020-02-11T16:32:31.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 -- 172.21.15.88:0/3561424251 reap_dead start 2020-02-11T16:32:31.072 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe93515a700 1 -- 172.21.15.88:0/3561424251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe930129ac0 con 0x7fe9140041c0 2020-02-11T16:32:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe928005c80 con 0x7fe9140041c0 2020-02-11T16:32:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe928005de0 con 0x7fe9140041c0 2020-02-11T16:32:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe928012860 con 0x7fe9140041c0 2020-02-11T16:32:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.057+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.058+0000 7fe93515a700 1 -- 172.21.15.88:0/3561424251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe908003340 con 0x7fe9140041c0 2020-02-11T16:32:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.058+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fe9280120c0 con 0x7fe9140041c0 2020-02-11T16:32:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.058+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.058+0000 7fe927fff700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe91403dd50 0x7fe914040210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.058+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fe928049790 con 0x7fe9140041c0 2020-02-11T16:32:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.058+0000 7fe92ed9d700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe91403dd50 0x7fe914040210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.058+0000 7fe92ed9d700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe91403dd50 0x7fe914040210 crc :-1 s=READY pgs=584 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.061+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.062+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe92802ee50 con 0x7fe9140041c0 2020-02-11T16:32:31.248 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.247+0000 7fe93515a700 1 -- 172.21.15.88:0/3561424251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe9080036e0 con 0x7fe9140041c0 2020-02-11T16:32:31.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.247+0000 7fe92f59e700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.249 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.247+0000 7fe927fff700 1 -- 172.21.15.88:0/3561424251 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1279 (secure 0 0 0) 0x7fe928031940 con 0x7fe9140041c0 2020-02-11T16:32:31.249 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:31.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.248+0000 7fe93515a700 1 -- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe91403dd50 msgr2=0x7fe914040210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.250 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.248+0000 7fe93515a700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe91403dd50 0x7fe914040210 crc :-1 s=READY pgs=584 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.248+0000 7fe93515a700 1 -- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 msgr2=0x7fe91400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.248+0000 7fe93515a700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fe930129e30 tx=0x7fe928010c30).stop 2020-02-11T16:32:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.248+0000 7fe93515a700 1 -- 172.21.15.88:0/3561424251 shutdown_connections 2020-02-11T16:32:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.248+0000 7fe93515a700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fe91403dd50 0x7fe914040210 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.248+0000 7fe93515a700 1 --2- 172.21.15.88:0/3561424251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9140041c0 0x7fe91400b750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.248+0000 7fe93515a700 1 -- 172.21.15.88:0/3561424251 >> 172.21.15.88:0/3561424251 conn(0x7fe93009d110 msgr2=0x7fe9300a6240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.248+0000 7fe93515a700 1 -- 172.21.15.88:0/3561424251 shutdown_connections 2020-02-11T16:32:31.252 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.248+0000 7fe93515a700 1 -- 172.21.15.88:0/3561424251 wait complete. 2020-02-11T16:32:31.260 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":234,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:31.260 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:32:31.261 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:32:31.367 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.366+0000 7fcc4c48c700 1 Processor -- start 2020-02-11T16:32:31.368 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.366+0000 7fcc4c48c700 1 -- start start 2020-02-11T16:32:31.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc4c48c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc440a5de0 0x7fcc440a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:31.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc4c48c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc440a31b0 con 0x7fcc440a18a0 2020-02-11T16:32:31.376 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc4c48c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc440a3570 con 0x7fcc44134a50 2020-02-11T16:32:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc4c48c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440a3810 con 0x7fcc440a5de0 2020-02-11T16:32:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc4aa29700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcc44134a50 0x7fcc44134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49302/0 (socket says 172.21.15.88:49302) 2020-02-11T16:32:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc4aa29700 1 -- 172.21.15.88:0/2234262489 learned_addr learned my addr 172.21.15.88:0/2234262489 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881897608 0 0) 0x7fcc440a3570 con 0x7fcc44134a50 2020-02-11T16:32:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc2c003230 con 0x7fcc44134a50 2020-02-11T16:32:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49a27700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc440a5de0 0x7fcc440a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3655617626 0 0) 0x7fcc2c003230 con 0x7fcc44134a50 2020-02-11T16:32:31.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc440a5de0 msgr2=0x7fcc440a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:31.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc440a5de0 0x7fcc440a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:31.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 >> v1:172.21.15.52:6789/0 conn(0x7fcc440a18a0 legacy=0x7fcc440a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440a3ab0 con 0x7fcc44134a50 2020-02-11T16:32:31.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fcc400016d0 con 0x7fcc44134a50 2020-02-11T16:32:31.378 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 >> v1:172.21.15.88:6789/0 conn(0x7fcc44134a50 legacy=0x7fcc44134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c003750 0x7fcc2c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2c004090 0x7fcc2c004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc440a5de0 0x7fcc2c004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440a3810 con 0x7fcc2c004090 2020-02-11T16:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c004fb0 con 0x7fcc2c003750 2020-02-11T16:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c005170 con 0x7fcc440a5de0 2020-02-11T16:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.367+0000 7fcc4a228700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c003750 0x7fcc2c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc49a27700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2c004090 0x7fcc2c004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4aa29700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc440a5de0 0x7fcc2c004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 -- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc440a5de0 msgr2=0x7fcc2c004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:31.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc440a5de0 0x7fcc2c004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:31.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 -- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2c004090 msgr2=0x7fcc2c004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:31.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2c004090 0x7fcc2c004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:31.380 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 -- 172.21.15.88:0/2234262489 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c003230 con 0x7fcc2c003750 2020-02-11T16:32:31.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc49a27700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2c004090 0x7fcc2c004570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:32:31.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c003750 0x7fcc2c003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcc4405b910 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c003750 0x7fcc2c003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcc4405b910 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c003750 0x7fcc2c003b70 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fcc4405b910 tx=0x7fcc3c010150).ready entity=mon.1 client_cookie=1abc9486ba84611a server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c003750 0x7fcc2c003b70 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fcc4405b910 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc3c006c40 con 0x7fcc2c003750 2020-02-11T16:32:31.381 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c003750 0x7fcc2c003b70 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fcc4405b910 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4a228700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c003750 0x7fcc2c003b70 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fcc4405b910 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c006da0 con 0x7fcc2c003750 2020-02-11T16:32:31.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc49226700 1 -- 172.21.15.88:0/2234262489 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc3c002730 con 0x7fcc2c003750 2020-02-11T16:32:31.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4c48c700 1 -- 172.21.15.88:0/2234262489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c003750 msgr2=0x7fcc2c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4c48c700 1 --2- 172.21.15.88:0/2234262489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c003750 0x7fcc2c003b70 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fcc4405b910 tx=0x7fcc3c010150).stop 2020-02-11T16:32:31.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4aa29700 1 -- 172.21.15.88:0/2234262489 reap_dead start 2020-02-11T16:32:31.382 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4c48c700 1 -- 172.21.15.88:0/2234262489 shutdown_connections 2020-02-11T16:32:31.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4c48c700 1 -- 172.21.15.88:0/2234262489 >> 172.21.15.88:0/2234262489 conn(0x7fcc4409d110 msgr2=0x7fcc4409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:31.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4c48c700 1 -- 172.21.15.88:0/2234262489 shutdown_connections 2020-02-11T16:32:31.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.368+0000 7fcc4c48c700 1 -- 172.21.15.88:0/2234262489 wait complete. 2020-02-11T16:32:31.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.369+0000 7fcc4c48c700 1 Processor -- start 2020-02-11T16:32:31.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.369+0000 7fcc4c48c700 1 -- start start 2020-02-11T16:32:31.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4c48c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.383 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4c48c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc441278f0 0x7fcc4414b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4c48c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc44138d80 con 0x7fcc4412c020 2020-02-11T16:32:31.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4c48c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4412d7f0 con 0x7fcc441278f0 2020-02-11T16:32:31.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4c48c700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440a47f0 con 0x7fcc4412cfd0 2020-02-11T16:32:31.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc49a27700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcc4412c020 0x7fcc441271e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49312/0 (socket says 172.21.15.88:49312) 2020-02-11T16:32:31.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc49a27700 1 -- 172.21.15.88:0/624160490 learned_addr learned my addr 172.21.15.88:0/624160490 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:31.384 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4a228700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4aa29700 1 --2- 172.21.15.88:0/624160490 >> v2:172.21.15.52:3300/0 conn(0x7fcc441278f0 0x7fcc4414b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469467170 0 0) 0x7fcc44138d80 con 0x7fcc4412c020 2020-02-11T16:32:31.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc24002fe0 con 0x7fcc4412c020 2020-02-11T16:32:31.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4a228700 1 -- 172.21.15.88:0/624160490 >> v2:172.21.15.52:3300/0 conn(0x7fcc441278f0 msgr2=0x7fcc4414b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4a228700 1 --2- 172.21.15.88:0/624160490 >> v2:172.21.15.52:3300/0 conn(0x7fcc441278f0 0x7fcc4414b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4a228700 1 -- 172.21.15.88:0/624160490 >> v1:172.21.15.88:6789/0 conn(0x7fcc4412c020 legacy=0x7fcc441271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.385 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2642140143 0 0) 0x7fcc24002fe0 con 0x7fcc4412c020 2020-02-11T16:32:31.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4a228700 1 -- 172.21.15.88:0/624160490 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440a7660 con 0x7fcc4412cfd0 2020-02-11T16:32:31.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4aa29700 1 --2- 172.21.15.88:0/624160490 >> v2:172.21.15.52:3300/0 conn(0x7fcc441278f0 0x7fcc4414b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:32:31.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.370+0000 7fcc4a228700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc38001630 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc4a228700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc38001630 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc4a228700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fcc38001630 tx=0x7fcc3c010150).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.386 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc4a228700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fcc38001630 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc38001490 con 0x7fcc4412cfd0 2020-02-11T16:32:31.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc4a228700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fcc38001630 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc4a228700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fcc38001630 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0018a0 con 0x7fcc4412cfd0 2020-02-11T16:32:31.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc4c48c700 1 -- 172.21.15.88:0/624160490 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4412c4a0 con 0x7fcc4412cfd0 2020-02-11T16:32:31.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc3c011c10 con 0x7fcc4412cfd0 2020-02-11T16:32:31.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc4c48c700 1 -- 172.21.15.88:0/624160490 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc44130050 con 0x7fcc4412cfd0 2020-02-11T16:32:31.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc4a228700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fcc38001630 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fcc3c011d70 con 0x7fcc4412cfd0 2020-02-11T16:32:31.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.371+0000 7fcc4a228700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fcc38001630 tx=0x7fcc3c010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc4c48c700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 0x7fcc44128210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc4c48c700 1 -- 172.21.15.88:0/624160490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4405e2f0 con 0x7fcc4412a690 2020-02-11T16:32:31.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc377fe700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc24039f80 0x7fcc2403c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 0x7fcc44128210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fcc3c049860 con 0x7fcc4412cfd0 2020-02-11T16:32:31.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc4aa29700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc24039f80 0x7fcc2403c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc49a27700 1 -- 172.21.15.88:0/624160490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc440565b0 con 0x7fcc4412a690 2020-02-11T16:32:31.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 0x7fcc44128210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 0x7fcc44128210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 0x7fcc44128210 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc4aa29700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc24039f80 0x7fcc2403c440 crc :-1 s=READY pgs=585 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 0x7fcc44128210 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc380059c0 con 0x7fcc4412a690 2020-02-11T16:32:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 0x7fcc44128210 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fcc38005b20 con 0x7fcc4412a690 2020-02-11T16:32:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 msgr2=0x7fcc44128210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc377fe700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 0x7fcc44128210 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).stop 2020-02-11T16:32:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 msgr2=0x7fcc44128210 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.372+0000 7fcc377fe700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc4412a690 0x7fcc44128210 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).stop 2020-02-11T16:32:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.380+0000 7fcc4c48c700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 0x7fcc44128a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.380+0000 7fcc4c48c700 1 -- 172.21.15.88:0/624160490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4412c460 con 0x7fcc44128670 2020-02-11T16:32:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.380+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 0x7fcc44128a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc49a27700 1 -- 172.21.15.88:0/624160490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcc4412fb80 con 0x7fcc44128670 2020-02-11T16:32:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 0x7fcc44128a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 0x7fcc44128a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 0x7fcc44128a80 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 0x7fcc44128a80 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc38005e60 con 0x7fcc44128670 2020-02-11T16:32:31.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc49a27700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 0x7fcc44128a80 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4360 (secure 0 0 0) 0x7fcc3800e660 con 0x7fcc44128670 2020-02-11T16:32:31.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 msgr2=0x7fcc44128a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc377fe700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 0x7fcc44128a80 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fcc38008060 tx=0x7fcc380116a0).stop 2020-02-11T16:32:31.395 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc377fe700 1 -- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 msgr2=0x7fcc44128a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:31.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.381+0000 7fcc377fe700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc44128670 0x7fcc44128a80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.382+0000 7fcc4c48c700 1 -- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc24039f80 msgr2=0x7fcc2403c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.382+0000 7fcc4c48c700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fcc24039f80 0x7fcc2403c440 crc :-1 s=READY pgs=585 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.382+0000 7fcc4c48c700 1 -- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 msgr2=0x7fcc4412bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.382+0000 7fcc4c48c700 1 --2- 172.21.15.88:0/624160490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcc4412cfd0 0x7fcc4412bbc0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fcc38001630 tx=0x7fcc3c010150).stop 2020-02-11T16:32:31.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.382+0000 7fcc4aa29700 1 -- 172.21.15.88:0/624160490 reap_dead start 2020-02-11T16:32:31.396 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.382+0000 7fcc4aa29700 1 -- 172.21.15.88:0/624160490 reap_dead start 2020-02-11T16:32:31.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.382+0000 7fcc4c48c700 1 -- 172.21.15.88:0/624160490 shutdown_connections 2020-02-11T16:32:31.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.382+0000 7fcc4c48c700 1 -- 172.21.15.88:0/624160490 >> 172.21.15.88:0/624160490 conn(0x7fcc4409d110 msgr2=0x7fcc44069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:31.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.382+0000 7fcc4c48c700 1 -- 172.21.15.88:0/624160490 shutdown_connections 2020-02-11T16:32:31.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.382+0000 7fcc4c48c700 1 -- 172.21.15.88:0/624160490 wait complete. 2020-02-11T16:32:31.397 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:32:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:32:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 234, 2020-02-11T16:32:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:32:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:32:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:32:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:32:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:32:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:32:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:32:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:32:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:32:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:32:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:32:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:32:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:32:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:32:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:32:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:32:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:32:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:32:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:32:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:32:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:32:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:32:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:32:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:32:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:32:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:32:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:32:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:32:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:32:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:32:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:32:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:32:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:32:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:32:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:32:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:32:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:32:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:32:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:32:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:32:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:32:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:32:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.424 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:32:31.425 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:32:31.531 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.530+0000 7f19b8d1f700 1 Processor -- start 2020-02-11T16:32:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.530+0000 7f19b8d1f700 1 -- start start 2020-02-11T16:32:31.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b8d1f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19b40a18a0 0x7f19b40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:31.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b8d1f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19b40a5de0 0x7f19b40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:31.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b8d1f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b40a31b0 con 0x7f19b412e3a0 2020-02-11T16:32:31.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b8d1f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b40a3570 con 0x7f19b40a5de0 2020-02-11T16:32:31.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b8d1f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b40a3810 con 0x7f19b40a18a0 2020-02-11T16:32:31.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19b40a18a0 0x7f19b40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19b40a18a0 0x7f19b40a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33464/0 (socket says 172.21.15.88:33464) 2020-02-11T16:32:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 -- 172.21.15.88:0/2603797129 learned_addr learned my addr 172.21.15.88:0/2603797129 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 -- 172.21.15.88:0/2603797129 >> v2:172.21.15.52:3300/0 conn(0x7f19b40a5de0 msgr2=0x7f19b40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/2603797129 >> v2:172.21.15.52:3300/0 conn(0x7f19b40a5de0 0x7f19b40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 --2- 172.21.15.88:0/2603797129 >> v2:172.21.15.52:3300/0 conn(0x7f19b40a5de0 0x7f19b40a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 -- 172.21.15.88:0/2603797129 >> v1:172.21.15.52:6789/0 conn(0x7f19b412e3a0 legacy=0x7f19b412e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 -- 172.21.15.88:0/2603797129 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b40a3ab0 con 0x7f19b40a18a0 2020-02-11T16:32:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 --2- 172.21.15.88:0/2603797129 >> v2:172.21.15.88:3300/0 conn(0x7f19b40a18a0 0x7f19b40a6dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 --2- 172.21.15.88:0/2603797129 >> v2:172.21.15.88:3300/0 conn(0x7f19b40a18a0 0x7f19b40a6dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 --2- 172.21.15.88:0/2603797129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19b40a18a0 0x7f19b40a6dd0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).ready entity=mon.1 client_cookie=a927b81b38b3c381 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 --2- 172.21.15.88:0/2603797129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19b40a18a0 0x7f19b40a6dd0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b159a700 1 -- 172.21.15.88:0/2603797129 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19a40116e0 con 0x7f19b40a18a0 2020-02-11T16:32:31.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 --2- 172.21.15.88:0/2603797129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19b40a18a0 0x7f19b40a6dd0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.531+0000 7f19b259c700 1 --2- 172.21.15.88:0/2603797129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19b40a18a0 0x7f19b40a6dd0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.532+0000 7f19b159a700 1 -- 172.21.15.88:0/2603797129 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4011840 con 0x7f19b40a18a0 2020-02-11T16:32:31.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.532+0000 7f19b159a700 1 -- 172.21.15.88:0/2603797129 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19a4011c20 con 0x7f19b40a18a0 2020-02-11T16:32:31.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.532+0000 7f19b8d1f700 1 -- 172.21.15.88:0/2603797129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19b40a18a0 msgr2=0x7f19b40a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.532+0000 7f19b8d1f700 1 --2- 172.21.15.88:0/2603797129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19b40a18a0 0x7f19b40a6dd0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).stop 2020-02-11T16:32:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.532+0000 7f19b8d1f700 1 -- 172.21.15.88:0/2603797129 shutdown_connections 2020-02-11T16:32:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.532+0000 7f19b8d1f700 1 --2- 172.21.15.88:0/2603797129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19b40a18a0 0x7f19b40a6dd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.532+0000 7f19b8d1f700 1 --2- 172.21.15.88:0/2603797129 >> v2:172.21.15.52:3300/0 conn(0x7f19b40a5de0 0x7f19b40a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.532+0000 7f19b8d1f700 1 -- 172.21.15.88:0/2603797129 >> 172.21.15.88:0/2603797129 conn(0x7f19b409d110 msgr2=0x7f19b409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.532+0000 7f19b8d1f700 1 -- 172.21.15.88:0/2603797129 shutdown_connections 2020-02-11T16:32:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.532+0000 7f19b8d1f700 1 -- 172.21.15.88:0/2603797129 wait complete. 2020-02-11T16:32:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.533+0000 7f19b8d1f700 1 Processor -- start 2020-02-11T16:32:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.533+0000 7f19b8d1f700 1 -- start start 2020-02-11T16:32:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.533+0000 7f19b8d1f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19b40a18a0 0x7f19b4134d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.533+0000 7f19b8d1f700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19b412e3a0 0x7f19b4130dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.533+0000 7f19b8d1f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b4135850 con 0x7f19b40a5de0 2020-02-11T16:32:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.533+0000 7f19b8d1f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b4135310 con 0x7f19b40a18a0 2020-02-11T16:32:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.533+0000 7f19b8d1f700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b41355b0 con 0x7f19b412e3a0 2020-02-11T16:32:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19b40a18a0 0x7f19b4134d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b2d9d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19b412e3a0 0x7f19b4130dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19b40a18a0 0x7f19b4134d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:47686/0 (socket says 172.21.15.88:47686) 2020-02-11T16:32:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 -- 172.21.15.88:0/642763851 learned_addr learned my addr 172.21.15.88:0/642763851 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 -- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19b412e3a0 msgr2=0x7f19b4130dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19b412e3a0 0x7f19b4130dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 -- 172.21.15.88:0/642763851 >> v1:172.21.15.52:6789/0 conn(0x7f19b40a5de0 legacy=0x7f19b4134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 -- 172.21.15.88:0/642763851 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b412f4f0 con 0x7f19b40a18a0 2020-02-11T16:32:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 --2- 172.21.15.88:0/642763851 >> v2:172.21.15.52:3300/0 conn(0x7f19b40a18a0 0x7f19b4134d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 --2- 172.21.15.88:0/642763851 >> v2:172.21.15.52:3300/0 conn(0x7f19b40a18a0 0x7f19b4134d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a18a0 0x7f19b4134d90 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a18a0 0x7f19b4134d90 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19a4007340 con 0x7f19b40a18a0 2020-02-11T16:32:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a18a0 0x7f19b4134d90 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b259c700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a18a0 0x7f19b4134d90 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a40074a0 con 0x7f19b40a18a0 2020-02-11T16:32:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b8d1f700 1 -- 172.21.15.88:0/642763851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b40a0350 con 0x7f19b40a18a0 2020-02-11T16:32:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19a40058b0 con 0x7f19b40a18a0 2020-02-11T16:32:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.534+0000 7f19b8d1f700 1 -- 172.21.15.88:0/642763851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b41349f0 con 0x7f19b40a18a0 2020-02-11T16:32:31.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.535+0000 7f19b259c700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a18a0 0x7f19b4134d90 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.535+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f19a4005b30 con 0x7f19b40a18a0 2020-02-11T16:32:31.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.535+0000 7f19b259c700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a18a0 0x7f19b4134d90 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.535+0000 7f19b8d1f700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 0x7f19b412a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.535+0000 7f19b8d1f700 1 -- 172.21.15.88:0/642763851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b405e2f0 con 0x7f19b40a4a40 2020-02-11T16:32:31.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.535+0000 7f19a37fe700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1990039c50 0x7f199003c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.535+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 0x7f19b412a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.535+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f19a404a2b0 con 0x7f19b40a18a0 2020-02-11T16:32:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19b2d9d700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1990039c50 0x7f199003c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19b1d9b700 1 -- 172.21.15.88:0/642763851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19b40a0660 con 0x7f19b40a4a40 2020-02-11T16:32:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 0x7f19b412a7c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19b2d9d700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1990039c50 0x7f199003c110 crc :-1 s=READY pgs=586 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 0x7f19b412a7c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 0x7f19b412a7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 0x7f19b412a7c0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19a8007540 con 0x7f19b40a4a40 2020-02-11T16:32:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 0x7f19b412a7c0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f19a80059c0 con 0x7f19b40a4a40 2020-02-11T16:32:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 msgr2=0x7f19b412a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19a37fe700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 0x7f19b412a7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).stop 2020-02-11T16:32:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 msgr2=0x7f19b412a7c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.536+0000 7f19a37fe700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a4a40 0x7f19b412a7c0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).stop 2020-02-11T16:32:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.544+0000 7f19b8d1f700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 0x7f19b409dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.544+0000 7f19b8d1f700 1 -- 172.21.15.88:0/642763851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b4135450 con 0x7f19b412ac20 2020-02-11T16:32:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.545+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 0x7f19b409dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.545+0000 7f19b1d9b700 1 -- 172.21.15.88:0/642763851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f19b4133e80 con 0x7f19b412ac20 2020-02-11T16:32:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.545+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 0x7f19b409dec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.545+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 0x7f19b409dec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.545+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 0x7f19b409dec0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.545+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 0x7f19b409dec0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.545+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19a8008e30 con 0x7f19b412ac20 2020-02-11T16:32:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b1d9b700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 0x7f19b409dec0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4022 (secure 0 0 0) 0x7f19a800b240 con 0x7f19b412ac20 2020-02-11T16:32:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 msgr2=0x7f19b409dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19a37fe700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 0x7f19b409dec0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).stop 2020-02-11T16:32:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19a37fe700 1 -- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 msgr2=0x7f19b409dec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19a37fe700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b412ac20 0x7f19b409dec0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0x7f19b40a9850 tx=0x7f19a80109e0).stop 2020-02-11T16:32:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b8d1f700 1 -- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1990039c50 msgr2=0x7f199003c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b8d1f700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f1990039c50 0x7f199003c110 crc :-1 s=READY pgs=586 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b8d1f700 1 -- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a18a0 msgr2=0x7f19b4134d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b8d1f700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a18a0 0x7f19b4134d90 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f19b405bbc0 tx=0x7f19a4007a40).stop 2020-02-11T16:32:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b2d9d700 1 -- 172.21.15.88:0/642763851 reap_dead start 2020-02-11T16:32:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b2d9d700 1 -- 172.21.15.88:0/642763851 reap_dead start 2020-02-11T16:32:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b8d1f700 1 -- 172.21.15.88:0/642763851 shutdown_connections 2020-02-11T16:32:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b8d1f700 1 --2- 172.21.15.88:0/642763851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19b40a18a0 0x7f19b4134d90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b8d1f700 1 -- 172.21.15.88:0/642763851 >> 172.21.15.88:0/642763851 conn(0x7f19b409d110 msgr2=0x7f19b40a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b8d1f700 1 -- 172.21.15.88:0/642763851 shutdown_connections 2020-02-11T16:32:31.566 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.546+0000 7f19b8d1f700 1 -- 172.21.15.88:0/642763851 wait complete. 2020-02-11T16:32:31.566 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:32:31.566 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:31.566 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:31.567 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:32:31.567 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 234, 2020-02-11T16:32:31.567 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:32:31.567 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:32:31.568 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:32:31.568 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:32:31.568 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.568 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:32:31.569 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:31.569 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:32:31.569 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:32:31.569 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:31.570 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:32:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:32:31.571 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:31.572 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:32:31.573 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:32:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:32:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:32:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:32:31.574 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:32:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:32:31.575 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:32:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:32:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:31.576 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:31.577 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:32:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:32:31.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:31.579 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:32:31.580 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:32:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.582 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:32:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:32:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:31.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:32:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.585 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:32:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:32:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:32:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:31.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:32:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:32:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.588 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:32:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:32:31.589 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:32:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:32:31.590 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:32:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:32:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.591 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:32:31.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.593 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:32:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.594 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.595 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:32:31.595 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:32:31.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.700+0000 7f79e6c98700 1 Processor -- start 2020-02-11T16:32:31.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.700+0000 7f79e6c98700 1 -- start start 2020-02-11T16:32:31.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79e6c98700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79e00a5de0 0x7f79e00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:31.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79e6c98700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79e0134a50 0x7f79e0134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:31.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79e6c98700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00a31b0 con 0x7f79e00a18a0 2020-02-11T16:32:31.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79e6c98700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00a3570 con 0x7f79e0134a50 2020-02-11T16:32:31.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79e6c98700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00a3810 con 0x7f79e00a5de0 2020-02-11T16:32:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79dffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79e00a5de0 0x7f79e00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79dffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79e00a5de0 0x7f79e00a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33484/0 (socket says 172.21.15.88:33484) 2020-02-11T16:32:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79dffff700 1 -- 172.21.15.88:0/1888140263 learned_addr learned my addr 172.21.15.88:0/1888140263 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79e5235700 1 --2- 172.21.15.88:0/1888140263 >> v2:172.21.15.52:3300/0 conn(0x7f79e0134a50 0x7f79e0134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79dffff700 1 -- 172.21.15.88:0/1888140263 >> v2:172.21.15.52:3300/0 conn(0x7f79e0134a50 msgr2=0x7f79e0134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:31.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79dffff700 1 --2- 172.21.15.88:0/1888140263 >> v2:172.21.15.52:3300/0 conn(0x7f79e0134a50 0x7f79e0134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:31.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79dffff700 1 -- 172.21.15.88:0/1888140263 >> v1:172.21.15.52:6789/0 conn(0x7f79e00a18a0 legacy=0x7f79e00a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:31.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79dffff700 1 -- 172.21.15.88:0/1888140263 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00a3ab0 con 0x7f79e00a5de0 2020-02-11T16:32:31.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79dffff700 1 --2- 172.21.15.88:0/1888140263 >> v2:172.21.15.88:3300/0 conn(0x7f79e00a5de0 0x7f79e00a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79e005bbc0 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79dffff700 1 --2- 172.21.15.88:0/1888140263 >> v2:172.21.15.88:3300/0 conn(0x7f79e00a5de0 0x7f79e00a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79e005bbc0 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.701+0000 7f79dffff700 1 --2- 172.21.15.88:0/1888140263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e00a5de0 0x7f79e00a6260 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f79e005bbc0 tx=0x7f79d4007a40).ready entity=mon.1 client_cookie=b64b8fee5c816e9f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79dffff700 1 --2- 172.21.15.88:0/1888140263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e00a5de0 0x7f79e00a6260 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f79e005bbc0 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79df7fe700 1 -- 172.21.15.88:0/1888140263 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d40116e0 con 0x7f79e00a5de0 2020-02-11T16:32:31.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79dffff700 1 --2- 172.21.15.88:0/1888140263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e00a5de0 0x7f79e00a6260 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f79e005bbc0 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79dffff700 1 --2- 172.21.15.88:0/1888140263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e00a5de0 0x7f79e00a6260 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f79e005bbc0 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79df7fe700 1 -- 172.21.15.88:0/1888140263 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d4011840 con 0x7f79e00a5de0 2020-02-11T16:32:31.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79df7fe700 1 -- 172.21.15.88:0/1888140263 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d4011c20 con 0x7f79e00a5de0 2020-02-11T16:32:31.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79e6c98700 1 -- 172.21.15.88:0/1888140263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e00a5de0 msgr2=0x7f79e00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79e6c98700 1 --2- 172.21.15.88:0/1888140263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e00a5de0 0x7f79e00a6260 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f79e005bbc0 tx=0x7f79d4007a40).stop 2020-02-11T16:32:31.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79e6c98700 1 -- 172.21.15.88:0/1888140263 shutdown_connections 2020-02-11T16:32:31.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79e6c98700 1 --2- 172.21.15.88:0/1888140263 >> v2:172.21.15.52:3300/0 conn(0x7f79e0134a50 0x7f79e0134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:31.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79e6c98700 1 --2- 172.21.15.88:0/1888140263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e00a5de0 0x7f79e00a6260 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79e6c98700 1 -- 172.21.15.88:0/1888140263 >> 172.21.15.88:0/1888140263 conn(0x7f79e009d110 msgr2=0x7f79e009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:31.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79e6c98700 1 -- 172.21.15.88:0/1888140263 shutdown_connections 2020-02-11T16:32:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.702+0000 7f79e6c98700 1 -- 172.21.15.88:0/1888140263 wait complete. 2020-02-11T16:32:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.703+0000 7f79e6c98700 1 Processor -- start 2020-02-11T16:32:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.703+0000 7f79e6c98700 1 -- start start 2020-02-11T16:32:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e6c98700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79e00a18a0 0x7f79e01386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e6c98700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79e0134a50 0x7f79e011d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e6c98700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e009ebe0 con 0x7f79e00a5de0 2020-02-11T16:32:31.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e6c98700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e009ee80 con 0x7f79e00a18a0 2020-02-11T16:32:31.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e6c98700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e0134680 con 0x7f79e0134a50 2020-02-11T16:32:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79e0134a50 0x7f79e011d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79e0134a50 0x7f79e011d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33490/0 (socket says 172.21.15.88:33490) 2020-02-11T16:32:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 -- 172.21.15.88:0/2566361651 learned_addr learned my addr 172.21.15.88:0/2566361651 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> v2:172.21.15.52:3300/0 conn(0x7f79e00a18a0 0x7f79e01386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 -- 172.21.15.88:0/2566361651 >> v2:172.21.15.52:3300/0 conn(0x7f79e00a18a0 msgr2=0x7f79e01386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 --2- 172.21.15.88:0/2566361651 >> v2:172.21.15.52:3300/0 conn(0x7f79e00a18a0 0x7f79e01386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 -- 172.21.15.88:0/2566361651 >> v1:172.21.15.52:6789/0 conn(0x7f79e00a5de0 legacy=0x7f79e00a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 -- 172.21.15.88:0/2566361651 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e009f9b0 con 0x7f79e0134a50 2020-02-11T16:32:31.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 --2- 172.21.15.88:0/2566361651 >> v2:172.21.15.88:3300/0 conn(0x7f79e0134a50 0x7f79e011d370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79d80032b0 tx=0x7f79d8010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 --2- 172.21.15.88:0/2566361651 >> v2:172.21.15.88:3300/0 conn(0x7f79e0134a50 0x7f79e011d370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79d80032b0 tx=0x7f79d8010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0134a50 0x7f79e011d370 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f79d80032b0 tx=0x7f79d8010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0134a50 0x7f79e011d370 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f79d80032b0 tx=0x7f79d8010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0134a50 0x7f79e011d370 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f79d80032b0 tx=0x7f79d8010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d8012a80 con 0x7f79e0134a50 2020-02-11T16:32:31.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e5235700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0134a50 0x7f79e011d370 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f79d80032b0 tx=0x7f79d8010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d8012c20 con 0x7f79e0134a50 2020-02-11T16:32:31.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e6c98700 1 -- 172.21.15.88:0/2566361651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e009fc50 con 0x7f79e0134a50 2020-02-11T16:32:31.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d8012e50 con 0x7f79e0134a50 2020-02-11T16:32:31.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.704+0000 7f79e6c98700 1 -- 172.21.15.88:0/2566361651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e0138b00 con 0x7f79e0134a50 2020-02-11T16:32:31.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.705+0000 7f79e5235700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0134a50 0x7f79e011d370 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f79d80032b0 tx=0x7f79d8010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.705+0000 7f79e6c98700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 0x7f79e011d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.705+0000 7f79e6c98700 1 -- 172.21.15.88:0/2566361651 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e005e2f0 con 0x7f79e012d830 2020-02-11T16:32:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.705+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f79d8005a40 con 0x7f79e0134a50 2020-02-11T16:32:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.705+0000 7f79e5235700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0134a50 0x7f79e011d370 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f79d80032b0 tx=0x7f79d8010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 0x7f79e011d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79ddffb700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039de0 0x7f79c003c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f79d804a080 con 0x7f79e0134a50 2020-02-11T16:32:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79dffff700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039de0 0x7f79c003c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79e4a34700 1 -- 172.21.15.88:0/2566361651 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79e009f830 con 0x7f79e012d830 2020-02-11T16:32:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 0x7f79e011d7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 0x7f79e011d7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 0x7f79e011d7d0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79dffff700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039de0 0x7f79c003c2a0 crc :-1 s=READY pgs=587 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 0x7f79e011d7d0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d00058c0 con 0x7f79e012d830 2020-02-11T16:32:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 0x7f79e011d7d0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f79d0002d80 con 0x7f79e012d830 2020-02-11T16:32:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 msgr2=0x7f79e011d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79ddffb700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 0x7f79e011d7d0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).stop 2020-02-11T16:32:31.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 msgr2=0x7f79e011d7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:31.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.706+0000 7f79ddffb700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e012d830 0x7f79e011d7d0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).stop 2020-02-11T16:32:31.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.714+0000 7f79e6c98700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 0x7f79e005a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:31.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.714+0000 7f79e6c98700 1 -- 172.21.15.88:0/2566361651 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0134850 con 0x7f79e011dc30 2020-02-11T16:32:31.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.715+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 0x7f79e005a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:31.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.715+0000 7f79e4a34700 1 -- 172.21.15.88:0/2566361651 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f79e00565b0 con 0x7f79e011dc30 2020-02-11T16:32:31.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.715+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 0x7f79e005a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.715+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 0x7f79e005a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.715+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 0x7f79e005a5d0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:31.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.715+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 0x7f79e005a5d0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.735 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.715+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d000f580 con 0x7f79e011dc30 2020-02-11T16:32:31.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e4a34700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 0x7f79e005a5d0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:31.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3850 (secure 0 0 0) 0x7f79d000f6e0 con 0x7f79e011dc30 2020-02-11T16:32:31.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 msgr2=0x7f79e005a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79ddffb700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 0x7f79e005a5d0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).stop 2020-02-11T16:32:31.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79ddffb700 1 -- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 msgr2=0x7f79e005a5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:31.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79ddffb700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e011dc30 0x7f79e005a5d0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0x7f79d0002f40 tx=0x7f79d0010b70).stop 2020-02-11T16:32:31.736 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e6c98700 1 -- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039de0 msgr2=0x7f79c003c2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e6c98700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f79c0039de0 0x7f79c003c2a0 crc :-1 s=READY pgs=587 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e6c98700 1 -- 172.21.15.88:0/2566361651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0134a50 msgr2=0x7f79e011d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:31.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e6c98700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0134a50 0x7f79e011d370 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f79d80032b0 tx=0x7f79d8010d00).stop 2020-02-11T16:32:31.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e5235700 1 -- 172.21.15.88:0/2566361651 reap_dead start 2020-02-11T16:32:31.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e5235700 1 -- 172.21.15.88:0/2566361651 reap_dead start 2020-02-11T16:32:31.737 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e6c98700 1 -- 172.21.15.88:0/2566361651 shutdown_connections 2020-02-11T16:32:31.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e6c98700 1 --2- 172.21.15.88:0/2566361651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0134a50 0x7f79e011d370 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:31.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e6c98700 1 -- 172.21.15.88:0/2566361651 >> 172.21.15.88:0/2566361651 conn(0x7f79e009d110 msgr2=0x7f79e0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:31.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e6c98700 1 -- 172.21.15.88:0/2566361651 shutdown_connections 2020-02-11T16:32:31.738 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:31.716+0000 7f79e6c98700 1 -- 172.21.15.88:0/2566361651 wait complete. 2020-02-11T16:32:31.738 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:32:31.738 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:32:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:32:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:32:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 234, 2020-02-11T16:32:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:32:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:32:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:32:31.740 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:32:31.740 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.740 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2020-02-11T16:32:31.740 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:31.740 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:32:31.741 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:32:31.741 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:31.741 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:31.741 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:31.741 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:31.741 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:31.741 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:32:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:32:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:32:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:32:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:32:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:32:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:32:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:32:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:32:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:32:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:32:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:32:31.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.747 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:32:31.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.747 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:31.747 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:31.747 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:31.747 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:31.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.748 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:31.748 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:32:31.748 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.748 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:31.749 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:32:31.749 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.749 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.749 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.750 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:32:31.750 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:32:31.750 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:31.750 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:31.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.751 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:31.751 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:31.751 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:31.751 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:31.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.751 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:31.751 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:32:31.752 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.752 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:31.752 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:32:31.752 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.752 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.753 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.753 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:32:31.753 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:32:31.753 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:31.753 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:31.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.754 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:32:31.895 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:32:31.895 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:31.895 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:32:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:32:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:31.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:32:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:32:31.898 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:32:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:32:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:31.900 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:31.901 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:32:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:31.902 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.903 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:31.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:31.903 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:32:31.904 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2020-02-11T16:32:31.904 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mon scrub 2020-02-11T16:32:32.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.045+0000 7ff0657fb700 1 Processor -- start 2020-02-11T16:32:32.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.045+0000 7ff0657fb700 1 -- start start 2020-02-11T16:32:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff0657fb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff06005fc80 0x7ff06013bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff0657fb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0600a9750 0x7ff06009d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff0657fb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff0600669e0 0x7ff060066e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff0657fb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0601325d0 con 0x7ff0600669e0 2020-02-11T16:32:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff0657fb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06013b2f0 con 0x7ff06005fc80 2020-02-11T16:32:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff0657fb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600a9bb0 con 0x7ff0600a9750 2020-02-11T16:32:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff05ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff06005fc80 0x7ff06013bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff05ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff06005fc80 0x7ff06013bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33498/0 (socket says 172.21.15.88:33498) 2020-02-11T16:32:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff05ffff700 1 -- 172.21.15.88:0/2082468779 learned_addr learned my addr 172.21.15.88:0/2082468779 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff05f7fe700 1 --2- 172.21.15.88:0/2082468779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0600a9750 0x7ff06009d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.046+0000 7ff064ffa700 1 --2- 172.21.15.88:0/2082468779 >> v2:172.21.15.52:3300/0 conn(0x7ff0600669e0 0x7ff060066e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 -- 172.21.15.88:0/2082468779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0600a9750 msgr2=0x7ff06009d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 --2- 172.21.15.88:0/2082468779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0600a9750 0x7ff06009d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 -- 172.21.15.88:0/2082468779 >> v2:172.21.15.52:3300/0 conn(0x7ff0600669e0 msgr2=0x7ff060066e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 --2- 172.21.15.88:0/2082468779 >> v2:172.21.15.52:3300/0 conn(0x7ff0600669e0 0x7ff060066e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 -- 172.21.15.88:0/2082468779 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06005c1a0 con 0x7ff06005fc80 2020-02-11T16:32:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05f7fe700 1 --2- 172.21.15.88:0/2082468779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0600a9750 0x7ff06009d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:32:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff064ffa700 1 --2- 172.21.15.88:0/2082468779 >> v2:172.21.15.52:3300/0 conn(0x7ff0600669e0 0x7ff060066e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:32:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 --2- 172.21.15.88:0/2082468779 >> v2:172.21.15.88:3300/0 conn(0x7ff06005fc80 0x7ff06013bf00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff050002f30 tx=0x7ff050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 --2- 172.21.15.88:0/2082468779 >> v2:172.21.15.88:3300/0 conn(0x7ff06005fc80 0x7ff06013bf00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff050002f30 tx=0x7ff050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 --2- 172.21.15.88:0/2082468779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff06005fc80 0x7ff06013bf00 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007a40).ready entity=mon.1 client_cookie=eba522ae1e7ed425 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 --2- 172.21.15.88:0/2082468779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff06005fc80 0x7ff06013bf00 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 --2- 172.21.15.88:0/2082468779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff06005fc80 0x7ff06013bf00 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05ffff700 1 --2- 172.21.15.88:0/2082468779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff06005fc80 0x7ff06013bf00 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05effd700 1 -- 172.21.15.88:0/2082468779 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff050011720 con 0x7ff06005fc80 2020-02-11T16:32:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05effd700 1 -- 172.21.15.88:0/2082468779 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050011880 con 0x7ff06005fc80 2020-02-11T16:32:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff05effd700 1 -- 172.21.15.88:0/2082468779 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff050011c20 con 0x7ff06005fc80 2020-02-11T16:32:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff0657fb700 1 -- 172.21.15.88:0/2082468779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff06005fc80 msgr2=0x7ff06013bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.047+0000 7ff0657fb700 1 --2- 172.21.15.88:0/2082468779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff06005fc80 0x7ff06013bf00 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007a40).stop 2020-02-11T16:32:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.048+0000 7ff0657fb700 1 -- 172.21.15.88:0/2082468779 shutdown_connections 2020-02-11T16:32:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.048+0000 7ff0657fb700 1 --2- 172.21.15.88:0/2082468779 >> v2:172.21.15.52:3300/0 conn(0x7ff0600669e0 0x7ff060066e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:32.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.048+0000 7ff0657fb700 1 --2- 172.21.15.88:0/2082468779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff06005fc80 0x7ff06013bf00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:32.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.048+0000 7ff0657fb700 1 --2- 172.21.15.88:0/2082468779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0600a9750 0x7ff06009d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:32.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.048+0000 7ff0657fb700 1 -- 172.21.15.88:0/2082468779 >> 172.21.15.88:0/2082468779 conn(0x7ff0600aeea0 msgr2=0x7ff0600aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:32.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.048+0000 7ff0657fb700 1 -- 172.21.15.88:0/2082468779 shutdown_connections 2020-02-11T16:32:32.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.048+0000 7ff0657fb700 1 -- 172.21.15.88:0/2082468779 wait complete. 2020-02-11T16:32:32.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.048+0000 7ff0657fb700 1 Processor -- start 2020-02-11T16:32:32.055 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.048+0000 7ff0657fb700 1 -- start start 2020-02-11T16:32:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.049+0000 7ff0657fb700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff06005fc80 0x7ff06013a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.049+0000 7ff0657fb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0600adf90 con 0x7ff0600a9750 2020-02-11T16:32:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.049+0000 7ff0657fb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff060136030 con 0x7ff0600669e0 2020-02-11T16:32:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.049+0000 7ff0657fb700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0601451a0 con 0x7ff06005fc80 2020-02-11T16:32:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.049+0000 7ff05f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff0600669e0 0x7ff060138210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49364/0 (socket says 172.21.15.88:49364) 2020-02-11T16:32:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.049+0000 7ff05f7fe700 1 -- 172.21.15.88:0/3066939916 learned_addr learned my addr 172.21.15.88:0/3066939916 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05ffff700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff06005fc80 0x7ff06013a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256806448 0 0) 0x7ff060136030 con 0x7ff0600669e0 2020-02-11T16:32:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff040002fe0 con 0x7ff0600669e0 2020-02-11T16:32:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348357870 0 0) 0x7ff0600adf90 con 0x7ff0600a9750 2020-02-11T16:32:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff060136030 con 0x7ff0600a9750 2020-02-11T16:32:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3741133848 0 0) 0x7ff040002fe0 con 0x7ff0600669e0 2020-02-11T16:32:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0600adf90 con 0x7ff0600669e0 2020-02-11T16:32:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7ff054001490 con 0x7ff0600669e0 2020-02-11T16:32:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff06005fc80 msgr2=0x7ff06013a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff06005fc80 0x7ff06013a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 >> v1:172.21.15.88:6789/0 conn(0x7ff0600669e0 legacy=0x7ff060138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 >> v1:172.21.15.52:6789/0 conn(0x7ff0600a9750 legacy=0x7ff060145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff040004b20 0x7ff040004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff040003ab0 0x7ff040003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff040004890 con 0x7ff040004b20 2020-02-11T16:32:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04000bbb0 con 0x7ff040004370 2020-02-11T16:32:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04000bcf0 con 0x7ff040003ab0 2020-02-11T16:32:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05ffff700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff06005fc80 0x7ff06013a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:32:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05f7fe700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff040003ab0 0x7ff040003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff05ffff700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff040004b20 0x7ff040004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff064ffa700 1 -- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff040003ab0 msgr2=0x7ff040003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff040003ab0 0x7ff040003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff064ffa700 1 -- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff040004b20 msgr2=0x7ff040004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.050+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff040004b20 0x7ff040004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff064ffa700 1 -- 172.21.15.88:0/3066939916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060136290 con 0x7ff040004370 2020-02-11T16:32:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff0657fb700 1 -- 172.21.15.88:0/3066939916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff060136530 con 0x7ff040004370 2020-02-11T16:32:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff0657fb700 1 -- 172.21.15.88:0/3066939916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff060145f30 con 0x7ff040004370 2020-02-11T16:32:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.051+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.052+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff058005e20 con 0x7ff040004370 2020-02-11T16:32:32.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.052+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800ea00 con 0x7ff040004370 2020-02-11T16:32:32.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.052+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff05800ee20 con 0x7ff040004370 2020-02-11T16:32:32.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.052+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7ff058010160 con 0x7ff040004370 2020-02-11T16:32:32.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.052+0000 7ff0657fb700 1 -- 172.21.15.88:0/3066939916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0600565b0 con 0x7ff040004370 2020-02-11T16:32:32.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.052+0000 7ff05d7fa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff040042870 0x7ff040044d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:32.067 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.052+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff058049900 con 0x7ff040004370 2020-02-11T16:32:32.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.052+0000 7ff05ffff700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff040042870 0x7ff040044d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:32.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.053+0000 7ff05ffff700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff040042870 0x7ff040044d30 crc :-1 s=READY pgs=588 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:32.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.056+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.068 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.056+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff05802eef0 con 0x7ff040004370 2020-02-11T16:32:32.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.304+0000 7ff0657fb700 1 -- 172.21.15.88:0/3066939916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7ff060132030 con 0x7ff040004370 2020-02-11T16:32:32.306 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:32.303+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 47 pg[3.5s0( v 46'6186 (0'0,46'6186] local-lis/les=21/22 n=19 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=46'6186 lcod 46'6185 mlcod 46'6185 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.308 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.307+0000 7efe63664700 -1 osd.3 pg_epoch: 47 pg[3.2s0( v 46'6354 (0'0,46'6354] local-lis/les=21/22 n=22 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=46'6354 lcod 46'6353 mlcod 46'6353 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.309 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.307+0000 7efe5ce57700 -1 osd.3 pg_epoch: 47 pg[3.7s0( v 46'6217 (0'0,46'6217] local-lis/les=21/22 n=22 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=46'6217 lcod 46'6216 mlcod 46'6216 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.311 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.310+0000 7efe63664700 -1 osd.3 pg_epoch: 47 pg[3.2s0( v 47'6356 (0'0,47'6356] local-lis/les=21/22 n=20 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=46'6354 crt=46'6354 lcod 46'6353 mlcod 46'6353 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.311+0000 7ff064ffa700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:32.312 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.311+0000 7efe5ce57700 -1 osd.3 pg_epoch: 47 pg[3.7s0( v 47'6219 (0'0,47'6219] local-lis/les=21/22 n=20 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=46'6217 crt=46'6217 lcod 46'6216 mlcod 46'6216 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.317 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:32.314+0000 7f25f354a700 -1 osd.4 pg_epoch: 47 pg[3.3s0( v 46'6350 (0'0,46'6350] local-lis/les=21/22 n=21 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=46'6350 lcod 46'6349 mlcod 46'6349 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.319 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.315+0000 7f27cf238700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 46'6169 (0'0,46'6169] local-lis/les=21/22 n=33 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=46'6169 lcod 46'6168 mlcod 46'6168 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.319 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.315+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 47 pg[3.1s0( v 46'6652 (0'0,46'6652] local-lis/les=21/22 n=24 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=46'6652 lcod 46'6651 mlcod 46'6651 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.317+0000 7ff05d7fa700 1 -- 172.21.15.88:0/3066939916 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7ff058031a00 con 0x7ff040004370 2020-02-11T16:32:32.322 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.321+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 47 pg[3.1s0( v 47'6654 (0'0,47'6654] local-lis/les=21/22 n=22 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=46'6652 crt=46'6652 lcod 46'6651 mlcod 46'6651 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.324 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.322+0000 7f27cf238700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 47'6171 (0'0,47'6171] local-lis/les=21/22 n=31 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=46'6169 crt=46'6169 lcod 46'6168 mlcod 46'6168 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.325 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:32.319+0000 7f25f354a700 -1 osd.4 pg_epoch: 47 pg[3.3s0( v 47'6352 (0'0,47'6352] local-lis/les=21/22 n=19 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=46'6350 crt=46'6350 lcod 46'6349 mlcod 46'6349 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.323+0000 7ff0657fb700 1 -- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff040042870 msgr2=0x7ff040044d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:32.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.323+0000 7ff0657fb700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7ff040042870 0x7ff040044d30 crc :-1 s=READY pgs=588 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:32.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.323+0000 7ff0657fb700 1 -- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 msgr2=0x7ff04000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:32.325 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.323+0000 7ff0657fb700 1 --2- 172.21.15.88:0/3066939916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff040004370 0x7ff04000b750 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7ff058003270 tx=0x7ff058010f00).stop 2020-02-11T16:32:32.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.325+0000 7ff064ffa700 1 -- 172.21.15.88:0/3066939916 reap_dead start 2020-02-11T16:32:32.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.325+0000 7ff064ffa700 1 -- 172.21.15.88:0/3066939916 reap_dead start 2020-02-11T16:32:32.326 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.325+0000 7ff0657fb700 1 -- 172.21.15.88:0/3066939916 shutdown_connections 2020-02-11T16:32:32.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.325+0000 7ff0657fb700 1 -- 172.21.15.88:0/3066939916 >> 172.21.15.88:0/3066939916 conn(0x7ff0600aeea0 msgr2=0x7ff060069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:32.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.326+0000 7ff0657fb700 1 -- 172.21.15.88:0/3066939916 shutdown_connections 2020-02-11T16:32:32.327 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:32.326+0000 7ff0657fb700 1 -- 172.21.15.88:0/3066939916 wait complete. 2020-02-11T16:32:32.331 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:32.327+0000 7f63d7079700 -1 osd.1 pg_epoch: 47 pg[3.4s0( v 46'6438 (0'0,46'6438] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=46'6438 lcod 46'6437 mlcod 46'6437 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.334 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:32.330+0000 7f2f20b32700 -1 osd.5 pg_epoch: 47 pg[3.5s0( v 47'6188 (0'0,47'6188] local-lis/les=21/22 n=17 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=47'6188 lcod 46'6186 mlcod 46'6186 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.335 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:32.332+0000 7f63d907d700 -1 osd.1 pg_epoch: 47 pg[3.0s0( v 46'6549 (0'0,46'6549] local-lis/les=21/22 n=17 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=46'6549 lcod 46'6548 mlcod 46'6548 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.335 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.332+0000 7efe63664700 -1 osd.3 pg_epoch: 47 pg[3.2s0( v 47'6358 (0'0,47'6358] local-lis/les=21/22 n=18 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=47'6358 lcod 47'6356 mlcod 47'6356 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.338 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:32.335+0000 7f2f20b32700 -1 osd.5 pg_epoch: 47 pg[3.5s0( v 47'6190 (0'0,47'6190] local-lis/les=21/22 n=15 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=47'6188 crt=47'6188 lcod 46'6186 mlcod 46'6186 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.340 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.337+0000 7efe63664700 -1 osd.3 pg_epoch: 47 pg[3.2s0( v 47'6360 (0'0,47'6360] local-lis/les=21/22 n=16 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=47'6358 crt=47'6358 lcod 47'6356 mlcod 47'6356 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.343 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2020-02-11T16:32:32.348 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.345+0000 7efe60e5f700 -1 osd.3 pg_epoch: 47 pg[3.7s0( v 47'6221 (0'0,47'6221] local-lis/les=21/22 n=18 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=47'6221 lcod 47'6219 mlcod 47'6219 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.352 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.349+0000 7f27cf238700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 47'6173 (0'0,47'6173] local-lis/les=21/22 n=29 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=47'6173 lcod 47'6171 mlcod 47'6171 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.354 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.353+0000 7f27cf238700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 47'6175 (0'0,47'6175] local-lis/les=21/22 n=27 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=47'6173 crt=47'6173 lcod 47'6171 mlcod 47'6171 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.362 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:32.357+0000 7f63db081700 -1 osd.1 pg_epoch: 47 pg[3.4s0( v 47'6440 (0'0,47'6440] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=47'6440 lcod 46'6438 mlcod 46'6438 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.363 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.361+0000 7efe5f65c700 -1 osd.3 pg_epoch: 47 pg[3.2s0( v 47'6362 (0'0,47'6362] local-lis/les=21/22 n=14 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=47'6362 lcod 47'6360 mlcod 47'6360 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.364 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:32.360+0000 7f63d907d700 -1 osd.1 pg_epoch: 47 pg[3.0s0( v 47'6551 (0'0,47'6551] local-lis/les=21/22 n=15 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=47'6551 lcod 46'6549 mlcod 46'6549 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.367 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:32.364+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 47 pg[3.5s0( v 47'6192 (0'0,47'6192] local-lis/les=21/22 n=13 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=47'6192 lcod 47'6190 mlcod 47'6190 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.368 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.366+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 47 pg[3.1s0( v 47'6656 (0'0,47'6656] local-lis/les=21/22 n=20 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=47'6656 lcod 47'6654 mlcod 47'6654 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.370 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.369+0000 7efe60e5f700 -1 osd.3 pg_epoch: 47 pg[3.7s0( v 47'6223 (0'0,47'6223] local-lis/les=21/22 n=16 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=47'6223 lcod 47'6221 mlcod 47'6221 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.372 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.370+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 47 pg[3.1s0( v 47'6658 (0'0,47'6658] local-lis/les=21/22 n=18 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=47'6656 crt=47'6656 lcod 47'6654 mlcod 47'6654 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.372 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:32.369+0000 7f25f7552700 -1 osd.4 pg_epoch: 47 pg[3.3s0( v 47'6354 (0'0,47'6354] local-lis/les=21/22 n=17 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=47'6354 lcod 47'6352 mlcod 47'6352 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.373 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:32.365+0000 7f63db081700 -1 osd.1 pg_epoch: 47 pg[3.4s0( v 47'6442 (0'0,47'6442] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=47'6440 crt=47'6440 lcod 46'6438 mlcod 46'6438 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.373 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:32.366+0000 7f63d907d700 -1 osd.1 pg_epoch: 47 pg[3.0s0( v 47'6553 (0'0,47'6553] local-lis/les=21/22 n=13 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=47'6551 crt=47'6551 lcod 46'6549 mlcod 46'6549 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.374 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.373+0000 7efe60e5f700 -1 osd.3 pg_epoch: 47 pg[3.7s0( v 47'6225 (0'0,47'6225] local-lis/les=21/22 n=14 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=47'6223 crt=47'6223 lcod 47'6221 mlcod 47'6221 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.376 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:32.373+0000 7f25f7552700 -1 osd.4 pg_epoch: 47 pg[3.3s0( v 47'6356 (0'0,47'6356] local-lis/les=21/22 n=15 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=47'6354 crt=47'6354 lcod 47'6352 mlcod 47'6352 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.382 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.380+0000 7f27cb230700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 47'6177 (0'0,47'6177] local-lis/les=21/22 n=25 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=47'6177 lcod 47'6175 mlcod 47'6175 active+clean+snaptrim trimq=[250~10] ps=[248~8]] removing snap head 2020-02-11T16:32:32.393 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:32.391+0000 7efe5f65c700 -1 osd.3 pg_epoch: 47 pg[3.2s0( v 47'6364 (0'0,47'6364] local-lis/les=21/22 n=12 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=47'6364 lcod 47'6362 mlcod 47'6362 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.397 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:32.394+0000 7f63dd085700 -1 osd.1 pg_epoch: 47 pg[3.0s0( v 47'6555 (0'0,47'6555] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=47'6555 lcod 47'6553 mlcod 47'6553 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.398 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.394+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 47 pg[3.1s0( v 47'6660 (0'0,47'6660] local-lis/les=21/22 n=16 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=47'6660 lcod 47'6658 mlcod 47'6658 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.400 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.398+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 47 pg[3.1s0( v 47'6662 (0'0,47'6662] local-lis/les=21/22 n=14 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=47'6660 crt=47'6660 lcod 47'6658 mlcod 47'6658 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.402 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:32.398+0000 7f63dd085700 -1 osd.1 pg_epoch: 47 pg[3.0s0( v 47'6557 (0'0,47'6557] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=47'6555 crt=47'6555 lcod 47'6553 mlcod 47'6553 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.408 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:32.402+0000 7f25f354a700 -1 osd.4 pg_epoch: 47 pg[3.3s0( v 47'6358 (0'0,47'6358] local-lis/les=21/22 n=13 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=47'6358 lcod 47'6356 mlcod 47'6356 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.410 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.409+0000 7f27cf238700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 47'6179 (0'0,47'6179] local-lis/les=21/22 n=23 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=47'6179 lcod 47'6177 mlcod 47'6177 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.414 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:32.410+0000 7f25f354a700 -1 osd.4 pg_epoch: 47 pg[3.3s0( v 47'6360 (0'0,47'6360] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=47'6358 crt=47'6358 lcod 47'6356 mlcod 47'6356 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.414 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.413+0000 7f27cf238700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 47'6181 (0'0,47'6181] local-lis/les=21/22 n=21 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=47'6179 crt=47'6179 lcod 47'6177 mlcod 47'6177 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.418 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.416+0000 7f27cda35700 -1 osd.0 pg_epoch: 47 pg[3.1s0( v 47'6664 (0'0,47'6664] local-lis/les=21/22 n=12 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=47'6664 lcod 47'6662 mlcod 47'6662 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.427 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.425+0000 7f27cb230700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 47'6183 (0'0,47'6183] local-lis/les=21/22 n=19 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=47'6183 lcod 47'6181 mlcod 47'6181 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.428 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:32.425+0000 7f25f7552700 -1 osd.4 pg_epoch: 47 pg[3.3s0( v 47'6362 (0'0,47'6362] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=47'6362 lcod 47'6360 mlcod 47'6360 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.430 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.428+0000 7f27cb230700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 47'6185 (0'0,47'6185] local-lis/les=21/22 n=17 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=47'6183 crt=47'6183 lcod 47'6181 mlcod 47'6181 active+clean+snaptrim trimq=[258~8] ps=[248~10]] removing snap head 2020-02-11T16:32:32.444 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.442+0000 7f27cf238700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 47'6187 (0'0,47'6187] local-lis/les=21/22 n=15 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=47'6187 lcod 47'6185 mlcod 47'6185 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.446 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:32.445+0000 7f27cf238700 -1 osd.0 pg_epoch: 47 pg[3.6s0( v 47'6189 (0'0,47'6189] local-lis/les=21/22 n=13 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=47'6187 crt=47'6187 lcod 47'6185 mlcod 47'6185 active+clean+snaptrim trimq=[25a~6] ps=[248~12]] removing snap head 2020-02-11T16:32:32.728 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:32.759 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:32.766 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:33.311 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:33.310+0000 7efe60e5f700 -1 osd.3 pg_epoch: 48 pg[3.7s0( v 47'6231 (0'0,47'6231] local-lis/les=21/22 n=12 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=47'6231 lcod 47'6230 mlcod 47'6230 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.312 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:33.310+0000 7efe5f65c700 -1 osd.3 pg_epoch: 48 pg[3.2s0( v 47'6367 (0'0,47'6367] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=47'6367 lcod 47'6366 mlcod 47'6366 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.312 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:33.309+0000 7f2f20b32700 -1 osd.5 pg_epoch: 48 pg[3.5s0( v 47'6197 (0'0,47'6197] local-lis/les=21/22 n=10 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=47'6197 lcod 47'6196 mlcod 47'6196 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.314 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:33.313+0000 7f27cb230700 -1 osd.0 pg_epoch: 48 pg[3.6s0( v 47'6192 (0'0,47'6192] local-lis/les=21/22 n=10 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=47'6192 lcod 47'6191 mlcod 47'6191 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.316 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:33.313+0000 7f2f20b32700 -1 osd.5 pg_epoch: 48 pg[3.5s0( v 48'6199 (0'0,48'6199] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=47'6197 crt=47'6197 lcod 47'6196 mlcod 47'6196 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.316 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:33.315+0000 7efe5f65c700 -1 osd.3 pg_epoch: 48 pg[3.2s0( v 48'6369 (0'0,48'6369] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=47'6367 crt=47'6367 lcod 47'6366 mlcod 47'6366 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.318 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:33.315+0000 7f25f354a700 -1 osd.4 pg_epoch: 48 pg[3.3s0( v 47'6365 (0'0,47'6365] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=47'6365 lcod 47'6364 mlcod 47'6364 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.318 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:33.317+0000 7f63d907d700 -1 osd.1 pg_epoch: 48 pg[3.0s0( v 47'6562 (0'0,47'6562] local-lis/les=21/22 n=4 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=47'6562 lcod 47'6561 mlcod 47'6561 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.321 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:33.319+0000 7efe60e5f700 -1 osd.3 pg_epoch: 48 pg[3.7s0( v 48'6233 (0'0,48'6233] local-lis/les=21/22 n=10 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=47'6231 crt=47'6231 lcod 47'6230 mlcod 47'6230 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.322 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:33.319+0000 7f25f354a700 -1 osd.4 pg_epoch: 48 pg[3.3s0( v 48'6367 (0'0,48'6367] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=47'6365 crt=47'6365 lcod 47'6364 mlcod 47'6364 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.323 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:33.321+0000 7f27cb230700 -1 osd.0 pg_epoch: 48 pg[3.6s0( v 48'6194 (0'0,48'6194] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=47'6192 crt=47'6192 lcod 47'6191 mlcod 47'6191 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.323 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:33.321+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 48 pg[3.1s0( v 47'6671 (0'0,47'6671] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=47'6671 lcod 47'6670 mlcod 47'6670 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.332 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:33.332 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:33.338 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:33.335+0000 7f2f20b32700 -1 osd.5 pg_epoch: 48 pg[3.5s0( v 48'6201 (0'0,48'6201] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=48'6201 lcod 48'6199 mlcod 48'6199 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.340 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:33.337+0000 7f27cf238700 -1 osd.0 pg_epoch: 48 pg[3.6s0( v 48'6196 (0'0,48'6196] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=48'6196 lcod 48'6194 mlcod 48'6194 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.346 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:33.342+0000 7efe5ce57700 -1 osd.3 pg_epoch: 48 pg[3.7s0( v 48'6235 (0'0,48'6235] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=48'6235 lcod 48'6233 mlcod 48'6233 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.349 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:33.348+0000 7efe63664700 -1 osd.3 pg_epoch: 48 pg[3.2s0( v 48'6371 (0'0,48'6371] local-lis/les=21/22 n=5 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=48'6371 lcod 48'6369 mlcod 48'6369 active+clean+snaptrim trimq=[260~2] ps=[248~18]] removing snap head 2020-02-11T16:32:33.440 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:33.440 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:33.440 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:33.452 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:33.452 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 15 2020-02-11T16:32:33.453 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:33.453 INFO:tasks.workunit.client.0.smithi088.stdout:15 2020-02-11T16:32:34.299 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:34.315 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:34.323 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:34.993 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:34.993 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:35.096 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:35.096 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:35.096 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:35.109 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:35.109 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 16 2020-02-11T16:32:35.109 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:35.110 INFO:tasks.workunit.client.0.smithi088.stdout:16 2020-02-11T16:32:35.988 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:36.003 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:36.011 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:36.506 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:36.504+0000 7f2f20b32700 -1 osd.5 pg_epoch: 51 pg[3.5s0( v 50'6213 (0'0,50'6213] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=50'6213 lcod 49'6212 mlcod 49'6212 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.506 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:36.503+0000 7efe5f65c700 -1 osd.3 pg_epoch: 51 pg[3.2s0( v 50'6380 (0'0,50'6380] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=50'6380 lcod 49'6379 mlcod 49'6379 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.510 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:36.507+0000 7efe5f65c700 -1 osd.3 pg_epoch: 51 pg[3.2s0( v 51'6382 (0'0,51'6382] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 luod=50'6380 crt=50'6380 lcod 49'6379 mlcod 49'6379 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.510 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:36.508+0000 7f2f20b32700 -1 osd.5 pg_epoch: 51 pg[3.5s0( v 51'6215 (0'0,51'6215] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=50'6213 crt=50'6213 lcod 49'6212 mlcod 49'6212 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.514 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:36.508+0000 7f25f354a700 -1 osd.4 pg_epoch: 51 pg[3.3s0( v 50'6378 (0'0,50'6378] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=50'6378 lcod 50'6377 mlcod 50'6377 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.515 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:36.512+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 51 pg[3.1s0( v 49'6681 (0'0,49'6681] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=49'6681 lcod 49'6680 mlcod 49'6680 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.515 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:36.512+0000 7f27cb230700 -1 osd.0 pg_epoch: 51 pg[3.6s0( v 50'6210 (0'0,50'6210] local-lis/les=21/22 n=13 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=50'6210 lcod 50'6209 mlcod 50'6209 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.515 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:36.513+0000 7f25f354a700 -1 osd.4 pg_epoch: 51 pg[3.3s0( v 51'6380 (0'0,51'6380] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=50'6378 crt=50'6378 lcod 50'6377 mlcod 50'6377 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.517 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:36.515+0000 7f63db081700 -1 osd.1 pg_epoch: 51 pg[3.4s0( v 50'6458 (0'0,50'6458] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=50'6458 lcod 49'6457 mlcod 49'6457 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.520 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:36.517+0000 7f63d907d700 -1 osd.1 pg_epoch: 51 pg[3.0s0( v 50'6572 (0'0,50'6572] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=50'6572 lcod 50'6571 mlcod 50'6571 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.520 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:36.516+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 51 pg[3.1s0( v 51'6683 (0'0,51'6683] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=49'6681 crt=49'6681 lcod 49'6680 mlcod 49'6680 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.520 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:36.516+0000 7f27cb230700 -1 osd.0 pg_epoch: 51 pg[3.6s0( v 51'6212 (0'0,51'6212] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=50'6210 crt=50'6210 lcod 50'6209 mlcod 50'6209 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.524 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:36.519+0000 7f63db081700 -1 osd.1 pg_epoch: 51 pg[3.4s0( v 51'6460 (0'0,51'6460] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=50'6458 crt=50'6458 lcod 49'6457 mlcod 49'6457 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.524 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:36.521+0000 7f63d907d700 -1 osd.1 pg_epoch: 51 pg[3.0s0( v 51'6574 (0'0,51'6574] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=50'6572 crt=50'6572 lcod 50'6571 mlcod 50'6571 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.536 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:36.532+0000 7f2f20b32700 -1 osd.5 pg_epoch: 51 pg[3.5s0( v 51'6217 (0'0,51'6217] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=51'6217 lcod 51'6215 mlcod 51'6215 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.540 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:36.537+0000 7f27cf238700 -1 osd.0 pg_epoch: 51 pg[3.6s0( v 51'6214 (0'0,51'6214] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=51'6214 lcod 51'6212 mlcod 51'6212 active+clean+snaptrim trimq=[264~2] ps=[260~4]] removing snap head 2020-02-11T16:32:36.658 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:36.658 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:36.762 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:36.762 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:36.762 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:36.774 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:36.774 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 17 2020-02-11T16:32:36.774 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:36.774 INFO:tasks.workunit.client.0.smithi088.stdout:17 2020-02-11T16:32:37.662 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:37.677 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:37.684 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:38.319 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:38.320 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:38.419 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:38.419 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:38.420 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:38.435 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:38.436 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 18 2020-02-11T16:32:38.436 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:38.436 INFO:tasks.workunit.client.0.smithi088.stdout:18 2020-02-11T16:32:39.344 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:39.357 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:39.364 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:39.922 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:39.922 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:40.021 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:40.021 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:40.021 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:40.033 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:40.033 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 19 2020-02-11T16:32:40.033 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:40.033 INFO:tasks.workunit.client.0.smithi088.stdout:19 2020-02-11T16:32:40.889 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:40.902 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:40.910 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:41.586 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:41.586 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:41.687 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:41.687 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:41.687 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:41.700 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in `seq 1 20` 2020-02-11T16:32:41.700 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 20 2020-02-11T16:32:41.700 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp linux-2.6.33.tar.bz2 a 2020-02-11T16:32:41.701 INFO:tasks.workunit.client.0.smithi088.stdout:20 2020-02-11T16:32:42.347 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2020-02-11T16:32:42.347 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:42.367 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:42.364+0000 7f2f20b32700 -1 osd.5 pg_epoch: 52 pg[3.5s0( v 51'6240 (0'0,51'6240] local-lis/les=21/22 n=12 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=51'6240 lcod 51'6239 mlcod 51'6239 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.370 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:42.367+0000 7efe5f65c700 -1 osd.3 pg_epoch: 52 pg[3.2s0( v 51'6388 (0'0,51'6388] local-lis/les=21/22 n=3 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,6,4]p3(0) r=0 lpr=21 crt=51'6388 lcod 51'6387 mlcod 51'6387 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.370 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:42.368+0000 7efe5ce57700 -1 osd.3 pg_epoch: 52 pg[3.7s0( v 51'6259 (0'0,51'6259] local-lis/les=21/22 n=12 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=51'6259 lcod 51'6258 mlcod 51'6258 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.372 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:42.370+0000 7f27cf238700 -1 osd.0 pg_epoch: 52 pg[3.6s0( v 51'6239 (0'0,51'6239] local-lis/les=21/22 n=13 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=51'6239 lcod 51'6238 mlcod 51'6238 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.373 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:42.370+0000 7f27cda35700 -1 osd.0 pg_epoch: 52 pg[3.1s0( v 51'6706 (0'0,51'6706] local-lis/les=21/22 n=12 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=51'6706 lcod 51'6705 mlcod 51'6705 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.376 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:42.374+0000 7f25f354a700 -1 osd.4 pg_epoch: 52 pg[3.3s0( v 51'6407 (0'0,51'6407] local-lis/les=21/22 n=14 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=51'6407 lcod 51'6406 mlcod 51'6406 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.378 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:42.376+0000 7f63d907d700 -1 osd.1 pg_epoch: 52 pg[3.0s0( v 51'6608 (0'0,51'6608] local-lis/les=21/22 n=14 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=51'6608 lcod 51'6607 mlcod 51'6607 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.378 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:42.376+0000 7f63db081700 -1 osd.1 pg_epoch: 52 pg[3.4s0( v 51'6485 (0'0,51'6485] local-lis/les=21/22 n=10 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=51'6485 lcod 51'6484 mlcod 51'6484 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.379 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:42.378+0000 7f25f354a700 -1 osd.4 pg_epoch: 52 pg[3.3s0( v 52'6409 (0'0,52'6409] local-lis/les=21/22 n=12 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=51'6407 crt=51'6407 lcod 51'6406 mlcod 51'6406 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.384 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:42.374+0000 7f27cf238700 -1 osd.0 pg_epoch: 52 pg[3.6s0( v 52'6241 (0'0,52'6241] local-lis/les=21/22 n=11 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=51'6239 crt=51'6239 lcod 51'6238 mlcod 51'6238 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.385 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:42.379+0000 7f63d907d700 -1 osd.1 pg_epoch: 52 pg[3.0s0( v 52'6610 (0'0,52'6610] local-lis/les=21/22 n=12 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=51'6608 crt=51'6608 lcod 51'6607 mlcod 51'6607 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.385 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:42.380+0000 7f63db081700 -1 osd.1 pg_epoch: 52 pg[3.4s0( v 52'6487 (0'0,52'6487] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 luod=51'6485 crt=51'6485 lcod 51'6484 mlcod 51'6484 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.387 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:42.385+0000 7f27cda35700 -1 osd.0 pg_epoch: 52 pg[3.1s0( v 52'6708 (0'0,52'6708] local-lis/les=21/22 n=10 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=51'6706 crt=51'6706 lcod 51'6705 mlcod 51'6705 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.396 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:42.393+0000 7efe60e5f700 -1 osd.3 pg_epoch: 52 pg[3.7s0( v 52'6261 (0'0,52'6261] local-lis/les=21/22 n=10 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=52'6261 lcod 51'6259 mlcod 51'6259 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.398 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:42.395+0000 7f27cb230700 -1 osd.0 pg_epoch: 52 pg[3.6s0( v 52'6243 (0'0,52'6243] local-lis/les=21/22 n=9 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=52'6243 lcod 52'6241 mlcod 52'6241 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.399 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:42.390+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 52 pg[3.5s0( v 52'6242 (0'0,52'6242] local-lis/les=21/22 n=10 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=52'6242 lcod 51'6240 mlcod 51'6240 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.400 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:42.396+0000 7f25f354a700 -1 osd.4 pg_epoch: 52 pg[3.3s0( v 52'6411 (0'0,52'6411] local-lis/les=21/22 n=10 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=52'6411 lcod 52'6409 mlcod 52'6409 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.400 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:42.397+0000 7f63d7079700 -1 osd.1 pg_epoch: 52 pg[3.4s0( v 52'6489 (0'0,52'6489] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=52'6489 lcod 52'6487 mlcod 52'6487 active+clean+snaptrim trimq=[266~8] ps=[260~6]] removing snap head 2020-02-11T16:32:42.401 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:42.393+0000 7f2f24b3a700 -1 osd.5 pg_epoch: 52 pg[3.5s0( v 52'6244 (0'0,52'6244] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 luod=52'6242 crt=52'6242 lcod 51'6240 mlcod 51'6240 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.412 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:42.407+0000 7efe60e5f700 -1 osd.3 pg_epoch: 52 pg[3.7s0( v 52'6263 (0'0,52'6263] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 luod=52'6261 crt=52'6261 lcod 51'6259 mlcod 51'6259 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.414 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:42.409+0000 7f63d907d700 -1 osd.1 pg_epoch: 52 pg[3.0s0( v 52'6612 (0'0,52'6612] local-lis/les=21/22 n=10 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 crt=52'6612 lcod 52'6610 mlcod 52'6610 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.420 INFO:tasks.ceph.osd.5.smithi052.stderr:2020-02-11T16:32:42.418+0000 7f2f20b32700 -1 osd.5 pg_epoch: 52 pg[3.5s0( v 52'6246 (0'0,52'6246] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [5,3,2,6]p5(0) r=0 lpr=21 crt=52'6246 lcod 52'6244 mlcod 52'6244 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.422 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:42.420+0000 7f27cf238700 -1 osd.0 pg_epoch: 52 pg[3.6s0( v 52'6245 (0'0,52'6245] local-lis/les=21/22 n=7 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 crt=52'6245 lcod 52'6243 mlcod 52'6243 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.424 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:42.419+0000 7f63d907d700 -1 osd.1 pg_epoch: 52 pg[3.0s0( v 52'6614 (0'0,52'6614] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,6,5]p1(0) r=0 lpr=21 luod=52'6612 crt=52'6612 lcod 52'6610 mlcod 52'6610 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.428 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:42.424+0000 7f27cf238700 -1 osd.0 pg_epoch: 52 pg[3.6s0( v 52'6247 (0'0,52'6247] local-lis/les=21/22 n=5 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,1,4,7]p0(0) r=0 lpr=21 luod=52'6245 crt=52'6245 lcod 52'6243 mlcod 52'6243 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.429 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:42.425+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 52 pg[3.1s0( v 52'6710 (0'0,52'6710] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 crt=52'6710 lcod 52'6708 mlcod 52'6708 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.430 INFO:tasks.ceph.osd.3.smithi088.stderr:2020-02-11T16:32:42.427+0000 7efe5ce57700 -1 osd.3 pg_epoch: 52 pg[3.7s0( v 52'6265 (0'0,52'6265] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [3,5,7,0]p3(0) r=0 lpr=21 crt=52'6265 lcod 52'6263 mlcod 52'6263 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.430 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:42.429+0000 7f25f354a700 -1 osd.4 pg_epoch: 52 pg[3.3s0( v 52'6413 (0'0,52'6413] local-lis/les=21/22 n=8 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=52'6413 lcod 52'6411 mlcod 52'6411 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.431 INFO:tasks.ceph.osd.0.smithi088.stderr:2020-02-11T16:32:42.428+0000 7f27d1a3d700 -1 osd.0 pg_epoch: 52 pg[3.1s0( v 52'6712 (0'0,52'6712] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [0,4,3,5]p0(0) r=0 lpr=21 luod=52'6710 crt=52'6710 lcod 52'6708 mlcod 52'6708 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.435 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:42.433+0000 7f25f354a700 -1 osd.4 pg_epoch: 52 pg[3.3s0( v 52'6415 (0'0,52'6415] local-lis/les=21/22 n=6 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 luod=52'6413 crt=52'6413 lcod 52'6411 mlcod 52'6411 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.447 INFO:tasks.ceph.osd.1.smithi088.stderr:2020-02-11T16:32:42.443+0000 7f63d7079700 -1 osd.1 pg_epoch: 52 pg[3.4s0( v 52'6491 (0'0,52'6491] local-lis/les=21/22 n=4 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [1,2,0,5]p1(0) r=0 lpr=21 crt=52'6491 lcod 52'6489 mlcod 52'6489 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.448 INFO:tasks.ceph.osd.4.smithi052.stderr:2020-02-11T16:32:42.446+0000 7f25f7552700 -1 osd.4 pg_epoch: 52 pg[3.3s0( v 52'6417 (0'0,52'6417] local-lis/les=21/22 n=4 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) [4,5,0,6]p4(0) r=0 lpr=21 crt=52'6417 lcod 52'6415 mlcod 52'6415 active+clean+snaptrim trimq=[26a~4] ps=[260~a]] removing snap head 2020-02-11T16:32:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.534+0000 7fbc033b2700 1 Processor -- start 2020-02-11T16:32:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.534+0000 7fbc033b2700 1 -- start start 2020-02-11T16:32:42.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.535+0000 7fbc033b2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:42.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.535+0000 7fbc033b2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbfc0a5410 0x7fbbfc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:42.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.535+0000 7fbc033b2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbfc131280 0x7fbbfc1316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:42.538 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.535+0000 7fbc033b2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0a1e60 con 0x7fbbfc131280 2020-02-11T16:32:42.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.535+0000 7fbc033b2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0a3450 con 0x7fbbfc0a2fa0 2020-02-11T16:32:42.539 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.535+0000 7fbc033b2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0a4350 con 0x7fbbfc0a5410 2020-02-11T16:32:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.535+0000 7fbc0114e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.535+0000 7fbc0114e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33518/0 (socket says 172.21.15.88:33518) 2020-02-11T16:32:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.535+0000 7fbc0114e700 1 -- 172.21.15.88:0/2533475582 learned_addr learned my addr 172.21.15.88:0/2533475582 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 -- 172.21.15.88:0/2533475582 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbfc0a5410 msgr2=0x7fbbfc0a5870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2020-02-11T16:32:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 --2- 172.21.15.88:0/2533475582 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbfc0a5410 0x7fbbfc0a5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 -- 172.21.15.88:0/2533475582 >> v2:172.21.15.52:3300/0 conn(0x7fbbfc131280 msgr2=0x7fbbfc1316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 --2- 172.21.15.88:0/2533475582 >> v2:172.21.15.52:3300/0 conn(0x7fbbfc131280 0x7fbbfc1316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 -- 172.21.15.88:0/2533475582 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc0a3a40 con 0x7fbbfc0a2fa0 2020-02-11T16:32:42.543 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 --2- 172.21.15.88:0/2533475582 >> v2:172.21.15.88:3300/0 conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbbec002f30 tx=0x7fbbec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 --2- 172.21.15.88:0/2533475582 >> v2:172.21.15.88:3300/0 conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbbec002f30 tx=0x7fbbec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 --2- 172.21.15.88:0/2533475582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fbbec002f30 tx=0x7fbbec007a40).ready entity=mon.1 client_cookie=9065d650da1dc613 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 --2- 172.21.15.88:0/2533475582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fbbec002f30 tx=0x7fbbec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 --2- 172.21.15.88:0/2533475582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fbbec002f30 tx=0x7fbbec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc0114e700 1 --2- 172.21.15.88:0/2533475582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fbbec002f30 tx=0x7fbbec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbbebfff700 1 -- 172.21.15.88:0/2533475582 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec008e20 con 0x7fbbfc0a2fa0 2020-02-11T16:32:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbbebfff700 1 -- 172.21.15.88:0/2533475582 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec012a20 con 0x7fbbfc0a2fa0 2020-02-11T16:32:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbbebfff700 1 -- 172.21.15.88:0/2533475582 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec012e00 con 0x7fbbfc0a2fa0 2020-02-11T16:32:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc033b2700 1 -- 172.21.15.88:0/2533475582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a2fa0 msgr2=0x7fbbfc0a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.536+0000 7fbc033b2700 1 --2- 172.21.15.88:0/2533475582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fbbec002f30 tx=0x7fbbec007a40).stop 2020-02-11T16:32:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.537+0000 7fbc033b2700 1 -- 172.21.15.88:0/2533475582 shutdown_connections 2020-02-11T16:32:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.537+0000 7fbc033b2700 1 --2- 172.21.15.88:0/2533475582 >> v2:172.21.15.52:3300/0 conn(0x7fbbfc131280 0x7fbbfc1316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.537+0000 7fbc033b2700 1 --2- 172.21.15.88:0/2533475582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a2fa0 0x7fbbfc0a1520 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.537+0000 7fbc033b2700 1 --2- 172.21.15.88:0/2533475582 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbbfc0a5410 0x7fbbfc0a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.537+0000 7fbc033b2700 1 -- 172.21.15.88:0/2533475582 >> 172.21.15.88:0/2533475582 conn(0x7fbbfc09d110 msgr2=0x7fbbfc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.537+0000 7fbc033b2700 1 -- 172.21.15.88:0/2533475582 shutdown_connections 2020-02-11T16:32:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.537+0000 7fbc033b2700 1 -- 172.21.15.88:0/2533475582 wait complete. 2020-02-11T16:32:42.546 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.538+0000 7fbc033b2700 1 Processor -- start 2020-02-11T16:32:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.538+0000 7fbc033b2700 1 -- start start 2020-02-11T16:32:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.539+0000 7fbc033b2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbbfc0a5410 0x7fbbfc063110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.539+0000 7fbc033b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc0a0fe0 con 0x7fbbfc131280 2020-02-11T16:32:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.539+0000 7fbc033b2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc0a00f0 con 0x7fbbfc0a2fa0 2020-02-11T16:32:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.539+0000 7fbc033b2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc062190 con 0x7fbbfc0a5410 2020-02-11T16:32:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.539+0000 7fbc0114e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbbfc0a2fa0 0x7fbbfc0669c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49380/0 (socket says 172.21.15.88:49380) 2020-02-11T16:32:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.539+0000 7fbc0114e700 1 -- 172.21.15.88:0/2455740661 learned_addr learned my addr 172.21.15.88:0/2455740661 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.539+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> v2:172.21.15.88:3300/0 conn(0x7fbbfc0a5410 0x7fbbfc063110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc0094d700 1 -- 172.21.15.88:0/2455740661 >> v1:172.21.15.88:6789/0 conn(0x7fbbfc0a2fa0 legacy=0x7fbbfc0669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc0094d700 1 -- 172.21.15.88:0/2455740661 >> v1:172.21.15.52:6789/0 conn(0x7fbbfc131280 legacy=0x7fbbfc1430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc0094d700 1 -- 172.21.15.88:0/2455740661 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc0a0390 con 0x7fbbfc0a5410 2020-02-11T16:32:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> v2:172.21.15.88:3300/0 conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> v2:172.21.15.88:3300/0 conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbbea7fc700 1 -- 172.21.15.88:0/2455740661 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf8005930 con 0x7fbbfc0a5410 2020-02-11T16:32:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbbea7fc700 1 -- 172.21.15.88:0/2455740661 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf8005a90 con 0x7fbbfc0a5410 2020-02-11T16:32:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc033b2700 1 -- 172.21.15.88:0/2455740661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc0a0690 con 0x7fbbfc0a5410 2020-02-11T16:32:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbbea7fc700 1 -- 172.21.15.88:0/2455740661 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf8008880 con 0x7fbbfc0a5410 2020-02-11T16:32:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.540+0000 7fbc033b2700 1 -- 172.21.15.88:0/2455740661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc0670d0 con 0x7fbbfc0a5410 2020-02-11T16:32:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.541+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.541+0000 7fbbea7fc700 1 -- 172.21.15.88:0/2455740661 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fbbf8008b40 con 0x7fbbfc0a5410 2020-02-11T16:32:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.541+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.541+0000 7fbbea7fc700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbdc039b10 0x7fbbdc03bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.541+0000 7fbbea7fc700 1 -- 172.21.15.88:0/2455740661 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fbbf8049590 con 0x7fbbfc0a5410 2020-02-11T16:32:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.542+0000 7fbc0114e700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbdc039b10 0x7fbbdc03bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.542+0000 7fbc033b2700 1 -- 172.21.15.88:0/2455740661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc09ff30 con 0x7fbbfc0a5410 2020-02-11T16:32:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.542+0000 7fbc0114e700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbdc039b10 0x7fbbdc03bfd0 crc :-1 s=READY pgs=589 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.545+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.555 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.545+0000 7fbbea7fc700 1 -- 172.21.15.88:0/2455740661 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbbf802ec30 con 0x7fbbfc0a5410 2020-02-11T16:32:42.681 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s 2020-02-11T16:32:42.693 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm a 2020-02-11T16:32:42.700 INFO:tasks.workunit.client.0.smithi088.stderr:+ cp .snap/s/a /tmp/a 2020-02-11T16:32:42.796 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.794+0000 7fbc033b2700 1 -- 172.21.15.88:0/2455740661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbbfc0565b0 con 0x7fbbfc0a5410 2020-02-11T16:32:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.794+0000 7fbc0094d700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.794+0000 7fbbea7fc700 1 -- 172.21.15.88:0/2455740661 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fbbf8031720 con 0x7fbbfc0a5410 2020-02-11T16:32:42.797 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:42.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.796+0000 7fbc033b2700 1 -- 172.21.15.88:0/2455740661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbdc039b10 msgr2=0x7fbbdc03bfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:42.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.796+0000 7fbc033b2700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbdc039b10 0x7fbbdc03bfd0 crc :-1 s=READY pgs=589 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:42.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.796+0000 7fbc033b2700 1 -- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 msgr2=0x7fbbfc063110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:42.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.796+0000 7fbc033b2700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 0x7fbbfc063110 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fbbf8002f60 tx=0x7fbbf8010910).stop 2020-02-11T16:32:42.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.796+0000 7fbc033b2700 1 -- 172.21.15.88:0/2455740661 shutdown_connections 2020-02-11T16:32:42.799 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.796+0000 7fbc033b2700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fbbdc039b10 0x7fbbdc03bfd0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:42.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.796+0000 7fbc033b2700 1 --2- 172.21.15.88:0/2455740661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbfc0a5410 0x7fbbfc063110 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:42.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.796+0000 7fbc033b2700 1 -- 172.21.15.88:0/2455740661 >> 172.21.15.88:0/2455740661 conn(0x7fbbfc09d110 msgr2=0x7fbbfc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:42.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.796+0000 7fbc033b2700 1 -- 172.21.15.88:0/2455740661 shutdown_connections 2020-02-11T16:32:42.800 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.796+0000 7fbc033b2700 1 -- 172.21.15.88:0/2455740661 wait complete. 2020-02-11T16:32:42.810 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":234,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:42.811 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2020-02-11T16:32:42.811 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2020-02-11T16:32:42.811 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:32:42.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.979+0000 7f3363b2d700 1 Processor -- start 2020-02-11T16:32:42.982 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.980+0000 7f3363b2d700 1 -- start start 2020-02-11T16:32:42.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.980+0000 7f3363b2d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f335c0a2fa0 0x7f335c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:42.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.980+0000 7f3363b2d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c0a4350 con 0x7f335c0a5410 2020-02-11T16:32:42.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.980+0000 7f3363b2d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c0a3a40 con 0x7f335c131990 2020-02-11T16:32:42.985 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.980+0000 7f3363b2d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c0a1e60 con 0x7f335c0a2fa0 2020-02-11T16:32:42.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.980+0000 7f33618c9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f335c0a2fa0 0x7f335c0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:42.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f335c0a2fa0 0x7f335c0a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33530/0 (socket says 172.21.15.88:33530) 2020-02-11T16:32:42.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 -- 172.21.15.88:0/3884977757 learned_addr learned my addr 172.21.15.88:0/3884977757 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:42.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33620ca700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f335c131990 0x7f335c13ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49388/0 (socket says 172.21.15.88:49388) 2020-02-11T16:32:42.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 -- 172.21.15.88:0/3884977757 >> v1:172.21.15.88:6789/0 conn(0x7f335c131990 legacy=0x7f335c13ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:42.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33608c7700 1 -- 172.21.15.88:0/3884977757 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196633152 0 0) 0x7f335c0a4350 con 0x7f335c0a5410 2020-02-11T16:32:42.986 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 -- 172.21.15.88:0/3884977757 >> v1:172.21.15.52:6789/0 conn(0x7f335c0a5410 legacy=0x7f335c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:42.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 -- 172.21.15.88:0/3884977757 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0a3ce0 con 0x7f335c0a2fa0 2020-02-11T16:32:42.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 --2- 172.21.15.88:0/3884977757 >> v2:172.21.15.88:3300/0 conn(0x7f335c0a2fa0 0x7f335c0a1520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3358002f30 tx=0x7f33580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 --2- 172.21.15.88:0/3884977757 >> v2:172.21.15.88:3300/0 conn(0x7f335c0a2fa0 0x7f335c0a1520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3358002f30 tx=0x7f33580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 --2- 172.21.15.88:0/3884977757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c0a2fa0 0x7f335c0a1520 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f33580088e0).ready entity=mon.1 client_cookie=552f10a7b5253a6 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:42.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 --2- 172.21.15.88:0/3884977757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c0a2fa0 0x7f335c0a1520 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f33580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.987 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33608c7700 1 -- 172.21.15.88:0/3884977757 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3358011760 con 0x7f335c0a2fa0 2020-02-11T16:32:42.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 --2- 172.21.15.88:0/3884977757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c0a2fa0 0x7f335c0a1520 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f33580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33618c9700 1 --2- 172.21.15.88:0/3884977757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c0a2fa0 0x7f335c0a1520 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f33580088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33608c7700 1 -- 172.21.15.88:0/3884977757 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33580118c0 con 0x7f335c0a2fa0 2020-02-11T16:32:42.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f33608c7700 1 -- 172.21.15.88:0/3884977757 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3358011ca0 con 0x7f335c0a2fa0 2020-02-11T16:32:42.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f3363b2d700 1 -- 172.21.15.88:0/3884977757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c0a2fa0 msgr2=0x7f335c0a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:42.988 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.981+0000 7f3363b2d700 1 --2- 172.21.15.88:0/3884977757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c0a2fa0 0x7f335c0a1520 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f33580088e0).stop 2020-02-11T16:32:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.982+0000 7f3363b2d700 1 -- 172.21.15.88:0/3884977757 shutdown_connections 2020-02-11T16:32:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.982+0000 7f3363b2d700 1 --2- 172.21.15.88:0/3884977757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c0a2fa0 0x7f335c0a1520 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.982+0000 7f3363b2d700 1 -- 172.21.15.88:0/3884977757 >> 172.21.15.88:0/3884977757 conn(0x7f335c09d110 msgr2=0x7f335c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.982+0000 7f3363b2d700 1 -- 172.21.15.88:0/3884977757 shutdown_connections 2020-02-11T16:32:42.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.982+0000 7f3363b2d700 1 -- 172.21.15.88:0/3884977757 wait complete. 2020-02-11T16:32:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f3363b2d700 1 Processor -- start 2020-02-11T16:32:42.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f3363b2d700 1 -- start start 2020-02-11T16:32:42.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f3363b2d700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:42.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f3363b2d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f335c131990 0x7f335c136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:42.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f3363b2d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c148560 con 0x7f335c0a5410 2020-02-11T16:32:42.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f3363b2d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c0662c0 con 0x7f335c131990 2020-02-11T16:32:42.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f3363b2d700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c126480 con 0x7f335c0a2fa0 2020-02-11T16:32:42.994 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f33620ca700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f335c131990 0x7f335c136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:42.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f33620ca700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f335c131990 0x7f335c136ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33540/0 (socket says 172.21.15.88:33540) 2020-02-11T16:32:42.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f33620ca700 1 -- 172.21.15.88:0/3669700273 learned_addr learned my addr 172.21.15.88:0/3669700273 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:42.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.984+0000 7f33618c9700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:42.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33618c9700 1 -- 172.21.15.88:0/3669700273 >> v2:172.21.15.88:3300/0 conn(0x7f335c131990 msgr2=0x7f335c136ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:42.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33618c9700 1 --2- 172.21.15.88:0/3669700273 >> v2:172.21.15.88:3300/0 conn(0x7f335c131990 0x7f335c136ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:42.995 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33618c9700 1 -- 172.21.15.88:0/3669700273 >> v1:172.21.15.88:6789/0 conn(0x7f335c0a5410 legacy=0x7f335c148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:42.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33618c9700 1 -- 172.21.15.88:0/3669700273 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c066690 con 0x7f335c0a2fa0 2020-02-11T16:32:42.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33620ca700 1 --2- 172.21.15.88:0/3669700273 >> v2:172.21.15.88:3300/0 conn(0x7f335c131990 0x7f335c136ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-11T16:32:42.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33618c9700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f3358011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33618c9700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f3358011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33618c9700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f3358011510).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:42.996 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33618c9700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f3358011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33618c9700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f3358011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3358011d40 con 0x7f335c0a2fa0 2020-02-11T16:32:42.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f33618c9700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f3358011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358007340 con 0x7f335c0a2fa0 2020-02-11T16:32:42.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f3363b2d700 1 -- 172.21.15.88:0/3669700273 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335c135330 con 0x7f335c0a2fa0 2020-02-11T16:32:42.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33580056c0 con 0x7f335c0a2fa0 2020-02-11T16:32:42.997 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.985+0000 7f3363b2d700 1 -- 172.21.15.88:0/3669700273 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c1492d0 con 0x7f335c0a2fa0 2020-02-11T16:32:42.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.986+0000 7f33618c9700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f3358011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.986+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f33580058f0 con 0x7f335c0a2fa0 2020-02-11T16:32:42.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.986+0000 7f33618c9700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f3358011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.986+0000 7f3363b2d700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 0x7f335c05a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:42.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.986+0000 7f3363b2d700 1 -- 172.21.15.88:0/3669700273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c05e2f0 con 0x7f335c1265c0 2020-02-11T16:32:42.998 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f334affd700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f333c039c40 0x7f333c03c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:42.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f335804a370 con 0x7f335c0a2fa0 2020-02-11T16:32:42.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 0x7f335c05a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:42.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f33620ca700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f333c039c40 0x7f333c03c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:42.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f33610c8700 1 -- 172.21.15.88:0/3669700273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f335c136220 con 0x7f335c1265c0 2020-02-11T16:32:42.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f33620ca700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f333c039c40 0x7f333c03c100 crc :-1 s=READY pgs=590 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:42.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 0x7f335c05a5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:42.999 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 0x7f335c05a5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 0x7f335c05a5d0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 0x7f335c05a5d0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f334c00cc00 con 0x7f335c1265c0 2020-02-11T16:32:43.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 0x7f335c05a5d0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f334c00cd60 con 0x7f335c1265c0 2020-02-11T16:32:43.000 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 msgr2=0x7f335c05a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f334affd700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 0x7f335c05a5d0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).stop 2020-02-11T16:32:43.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 msgr2=0x7f335c05a5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:43.001 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.987+0000 7f334affd700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c1265c0 0x7f335c05a5d0 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).stop 2020-02-11T16:32:43.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.997+0000 7f3363b2d700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 0x7f335c125520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.003 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.997+0000 7f3363b2d700 1 -- 172.21.15.88:0/3669700273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0565b0 con 0x7f335c125140 2020-02-11T16:32:43.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 0x7f335c125520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f33610c8700 1 -- 172.21.15.88:0/3669700273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f335c066400 con 0x7f335c125140 2020-02-11T16:32:43.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 0x7f335c125520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 0x7f335c125520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 0x7f335c125520 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 0x7f335c125520 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.004 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f334c0066d0 con 0x7f335c125140 2020-02-11T16:32:43.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f33610c8700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 0x7f335c125520 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4361 (secure 0 0 0) 0x7f334c006830 con 0x7f335c125140 2020-02-11T16:32:43.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 msgr2=0x7f335c125520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f334affd700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 0x7f335c125520 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).stop 2020-02-11T16:32:43.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f334affd700 1 -- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 msgr2=0x7f335c125520 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:43.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.998+0000 7f334affd700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c125140 0x7f335c125520 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0x7f335c05b3a0 tx=0x7f334c00c410).stop 2020-02-11T16:32:43.005 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.999+0000 7f3363b2d700 1 -- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f333c039c40 msgr2=0x7f333c03c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.999+0000 7f3363b2d700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f333c039c40 0x7f333c03c100 crc :-1 s=READY pgs=590 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.999+0000 7f3363b2d700 1 -- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 msgr2=0x7f335c136650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.999+0000 7f3363b2d700 1 --2- 172.21.15.88:0/3669700273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f335c0a2fa0 0x7f335c136650 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f3358002f30 tx=0x7f3358011510).stop 2020-02-11T16:32:43.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.999+0000 7f33620ca700 1 -- 172.21.15.88:0/3669700273 reap_dead start 2020-02-11T16:32:43.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.999+0000 7f33620ca700 1 -- 172.21.15.88:0/3669700273 reap_dead start 2020-02-11T16:32:43.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.999+0000 7f3363b2d700 1 -- 172.21.15.88:0/3669700273 shutdown_connections 2020-02-11T16:32:43.006 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.999+0000 7f3363b2d700 1 -- 172.21.15.88:0/3669700273 >> 172.21.15.88:0/3669700273 conn(0x7f335c09d110 msgr2=0x7f335c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:43.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.999+0000 7f3363b2d700 1 -- 172.21.15.88:0/3669700273 shutdown_connections 2020-02-11T16:32:43.007 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:42.999+0000 7f3363b2d700 1 -- 172.21.15.88:0/3669700273 wait complete. 2020-02-11T16:32:43.007 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:32:43.007 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:43.007 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:43.007 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:32:43.008 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 234, 2020-02-11T16:32:43.008 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:32:43.008 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:32:43.008 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:32:43.008 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:32:43.008 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.008 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 13, 2020-02-11T16:32:43.008 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:43.009 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:32:43.009 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:32:43.009 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:43.009 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:43.009 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:43.009 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:43.009 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:43.010 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:43.010 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.010 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:32:43.010 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:32:43.010 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:43.010 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:43.011 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:43.011 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:43.011 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:43.011 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:43.011 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.011 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:32:43.012 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:32:43.012 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:32:43.012 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:32:43.012 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:32:43.012 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:32:43.012 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:43.013 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:43.013 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:32:43.013 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:32:43.013 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:43.013 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:32:43.013 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:43.013 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:43.014 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:43.014 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:43.014 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:43.014 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:43.014 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.014 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:32:43.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.015 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:32:43.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.015 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:43.015 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:43.015 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:43.015 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:43.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.016 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:43.016 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:32:43.016 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.016 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:43.016 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:32:43.017 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.017 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.017 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.017 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:32:43.017 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:32:43.017 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:43.018 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:43.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.018 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:43.018 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:43.018 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:43.019 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:43.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.019 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:43.019 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:32:43.019 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.020 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:43.020 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:32:43.020 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.020 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.020 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.020 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:32:43.020 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:32:43.021 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:43.021 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:43.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.021 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:32:43.021 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:32:43.022 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:43.022 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:43.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.022 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:43.022 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:32:43.022 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.023 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:43.023 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:32:43.023 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.023 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.023 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.024 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:32:43.024 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:32:43.024 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:43.024 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:43.024 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.024 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.025 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:32:43.025 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:32:43.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.025 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:43.025 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:43.025 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:43.025 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.026 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.026 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:32:43.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.026 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:43.026 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:43.026 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:43.026 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.027 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.027 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:32:43.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.028 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:43.028 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:43.028 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:32:43.028 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.028 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.028 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:32:43.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.029 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:43.029 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:43.029 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2020-02-11T16:32:43.029 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.029 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.029 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:32:43.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.030 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:43.030 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:43.030 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:43.030 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.031 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.031 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.031 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:32:43.032 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:32:43.139 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.137+0000 7f9b44ad5700 1 Processor -- start 2020-02-11T16:32:43.140 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.137+0000 7f9b44ad5700 1 -- start start 2020-02-11T16:32:43.146 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b44ad5700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b400a5de0 0x7f9b400a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b44ad5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b400a11a0 0x7f9b40131ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b44ad5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b400a3e30 con 0x7f9b40131f40 2020-02-11T16:32:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b44ad5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b400a2830 con 0x7f9b400a11a0 2020-02-11T16:32:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b44ad5700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b400a2ad0 con 0x7f9b400a5de0 2020-02-11T16:32:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b400a11a0 0x7f9b40131ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b400a11a0 0x7f9b40131ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33548/0 (socket says 172.21.15.88:33548) 2020-02-11T16:32:43.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 -- 172.21.15.88:0/1376687637 learned_addr learned my addr 172.21.15.88:0/1376687637 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:43.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3f7fe700 1 --2- 172.21.15.88:0/1376687637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b400a5de0 0x7f9b400a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.148 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 -- 172.21.15.88:0/1376687637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b400a5de0 msgr2=0x7f9b400a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 --2- 172.21.15.88:0/1376687637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b400a5de0 0x7f9b400a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 -- 172.21.15.88:0/1376687637 >> v1:172.21.15.88:6789/0 conn(0x7f9b40131f40 legacy=0x7f9b4005a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 -- 172.21.15.88:0/1376687637 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b400a2d70 con 0x7f9b400a11a0 2020-02-11T16:32:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 --2- 172.21.15.88:0/1376687637 >> v2:172.21.15.88:3300/0 conn(0x7f9b400a11a0 0x7f9b40131ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b34002f30 tx=0x7f9b340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 --2- 172.21.15.88:0/1376687637 >> v2:172.21.15.88:3300/0 conn(0x7f9b400a11a0 0x7f9b40131ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b34002f30 tx=0x7f9b340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 --2- 172.21.15.88:0/1376687637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40131ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f9b34002f30 tx=0x7f9b340088e0).ready entity=mon.1 client_cookie=6b93fdddd3b1b2c4 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 --2- 172.21.15.88:0/1376687637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40131ae0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9b34002f30 tx=0x7f9b340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3e7fc700 1 -- 172.21.15.88:0/1376687637 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b34011760 con 0x7f9b400a11a0 2020-02-11T16:32:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 --2- 172.21.15.88:0/1376687637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40131ae0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9b34002f30 tx=0x7f9b340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3effd700 1 --2- 172.21.15.88:0/1376687637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40131ae0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9b34002f30 tx=0x7f9b340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3e7fc700 1 -- 172.21.15.88:0/1376687637 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b340118c0 con 0x7f9b400a11a0 2020-02-11T16:32:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b3e7fc700 1 -- 172.21.15.88:0/1376687637 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b34011ca0 con 0x7f9b400a11a0 2020-02-11T16:32:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b44ad5700 1 -- 172.21.15.88:0/1376687637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 msgr2=0x7f9b40131ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.138+0000 7f9b44ad5700 1 --2- 172.21.15.88:0/1376687637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40131ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f9b34002f30 tx=0x7f9b340088e0).stop 2020-02-11T16:32:43.151 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.139+0000 7f9b44ad5700 1 -- 172.21.15.88:0/1376687637 shutdown_connections 2020-02-11T16:32:43.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.139+0000 7f9b44ad5700 1 --2- 172.21.15.88:0/1376687637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b400a5de0 0x7f9b400a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:43.152 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.139+0000 7f9b44ad5700 1 --2- 172.21.15.88:0/1376687637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40131ae0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.139+0000 7f9b44ad5700 1 -- 172.21.15.88:0/1376687637 >> 172.21.15.88:0/1376687637 conn(0x7f9b400a9fb0 msgr2=0x7f9b400aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.139+0000 7f9b44ad5700 1 -- 172.21.15.88:0/1376687637 shutdown_connections 2020-02-11T16:32:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.139+0000 7f9b44ad5700 1 -- 172.21.15.88:0/1376687637 wait complete. 2020-02-11T16:32:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.140+0000 7f9b44ad5700 1 Processor -- start 2020-02-11T16:32:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.140+0000 7f9b44ad5700 1 -- start start 2020-02-11T16:32:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.140+0000 7f9b44ad5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b400a11a0 0x7f9b40061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.140+0000 7f9b44ad5700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b40131f40 0x7f9b40134ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b44ad5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b40135700 con 0x7f9b400a5de0 2020-02-11T16:32:43.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b44ad5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b401359a0 con 0x7f9b400a11a0 2020-02-11T16:32:43.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b44ad5700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4009bb90 con 0x7f9b40131f40 2020-02-11T16:32:43.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b400a11a0 0x7f9b40061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b400a11a0 0x7f9b40061520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33554/0 (socket says 172.21.15.88:33554) 2020-02-11T16:32:43.154 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 -- 172.21.15.88:0/2756376076 learned_addr learned my addr 172.21.15.88:0/2756376076 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:43.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3ffff700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b40131f40 0x7f9b40134ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 -- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b40131f40 msgr2=0x7f9b40134ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b40131f40 0x7f9b40134ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 -- 172.21.15.88:0/2756376076 >> v1:172.21.15.52:6789/0 conn(0x7f9b400a5de0 legacy=0x7f9b4009c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 -- 172.21.15.88:0/2756376076 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b40135450 con 0x7f9b400a11a0 2020-02-11T16:32:43.155 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 --2- 172.21.15.88:0/2756376076 >> v2:172.21.15.88:3300/0 conn(0x7f9b400a11a0 0x7f9b40061520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b300032b0 tx=0x7f9b400684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 --2- 172.21.15.88:0/2756376076 >> v2:172.21.15.88:3300/0 conn(0x7f9b400a11a0 0x7f9b40061520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b300032b0 tx=0x7f9b400684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40061520 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f9b300032b0 tx=0x7f9b400684d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40061520 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f9b300032b0 tx=0x7f9b400684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40061520 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f9b300032b0 tx=0x7f9b400684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b30012e40 con 0x7f9b400a11a0 2020-02-11T16:32:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3f7fe700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40061520 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f9b300032b0 tx=0x7f9b400684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b30005a40 con 0x7f9b400a11a0 2020-02-11T16:32:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b30005de0 con 0x7f9b400a11a0 2020-02-11T16:32:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b44ad5700 1 -- 172.21.15.88:0/2756376076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4009c740 con 0x7f9b400a11a0 2020-02-11T16:32:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.141+0000 7f9b44ad5700 1 -- 172.21.15.88:0/2756376076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b40134a60 con 0x7f9b400a11a0 2020-02-11T16:32:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b3f7fe700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40061520 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f9b300032b0 tx=0x7f9b400684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b44ad5700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 0x7f9b40130f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b44ad5700 1 -- 172.21.15.88:0/2756376076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4009d970 con 0x7f9b40099a60 2020-02-11T16:32:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f9b30007180 con 0x7f9b400a11a0 2020-02-11T16:32:43.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b3f7fe700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40061520 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f9b300032b0 tx=0x7f9b400684d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 0x7f9b40130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b3cff9700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9b20039e00 0x7f9b2003c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f9b30049ca0 con 0x7f9b400a11a0 2020-02-11T16:32:43.158 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b3ffff700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9b20039e00 0x7f9b2003c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b3effd700 1 -- 172.21.15.88:0/2756376076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b400565b0 con 0x7f9b40099a60 2020-02-11T16:32:43.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.142+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 0x7f9b40130f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 0x7f9b40130f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 0x7f9b40130f90 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3ffff700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9b20039e00 0x7f9b2003c2c0 crc :-1 s=READY pgs=591 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 0x7f9b40130f90 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.159 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b34011be0 con 0x7f9b40099a60 2020-02-11T16:32:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 0x7f9b40130f90 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f9b34011d40 con 0x7f9b40099a60 2020-02-11T16:32:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 msgr2=0x7f9b40130f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3cff9700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 0x7f9b40130f90 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).stop 2020-02-11T16:32:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 msgr2=0x7f9b40130f90 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.143+0000 7f9b3cff9700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b40099a60 0x7f9b40130f90 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).stop 2020-02-11T16:32:43.162 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.151+0000 7f9b44ad5700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 0x7f9b4009f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.151+0000 7f9b44ad5700 1 -- 172.21.15.88:0/2756376076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4005e2f0 con 0x7f9b4009ef40 2020-02-11T16:32:43.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.151+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 0x7f9b4009f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.163 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3effd700 1 -- 172.21.15.88:0/2756376076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9b4009bcd0 con 0x7f9b4009ef40 2020-02-11T16:32:43.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 0x7f9b4009f350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 0x7f9b4009f350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 0x7f9b4009f350 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 0x7f9b4009f350 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b3400c730 con 0x7f9b4009ef40 2020-02-11T16:32:43.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3effd700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 0x7f9b4009f350 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.164 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4023 (secure 0 0 0) 0x7f9b3400c890 con 0x7f9b4009ef40 2020-02-11T16:32:43.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 msgr2=0x7f9b4009f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3cff9700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 0x7f9b4009f350 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).stop 2020-02-11T16:32:43.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3cff9700 1 -- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 msgr2=0x7f9b4009f350 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:43.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3cff9700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b4009ef40 0x7f9b4009f350 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0x7f9b400a0de0 tx=0x7f9b400a61c0).stop 2020-02-11T16:32:43.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b44ad5700 1 -- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9b20039e00 msgr2=0x7f9b2003c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b44ad5700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9b20039e00 0x7f9b2003c2c0 crc :-1 s=READY pgs=591 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.165 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b44ad5700 1 -- 172.21.15.88:0/2756376076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 msgr2=0x7f9b40061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b44ad5700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40061520 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f9b300032b0 tx=0x7f9b400684d0).stop 2020-02-11T16:32:43.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b3ffff700 1 -- 172.21.15.88:0/2756376076 reap_dead start 2020-02-11T16:32:43.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b44ad5700 1 -- 172.21.15.88:0/2756376076 shutdown_connections 2020-02-11T16:32:43.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b44ad5700 1 --2- 172.21.15.88:0/2756376076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b400a11a0 0x7f9b40061520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b44ad5700 1 -- 172.21.15.88:0/2756376076 >> 172.21.15.88:0/2756376076 conn(0x7f9b400a9fb0 msgr2=0x7f9b40069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:43.166 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b44ad5700 1 -- 172.21.15.88:0/2756376076 shutdown_connections 2020-02-11T16:32:43.167 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.152+0000 7f9b44ad5700 1 -- 172.21.15.88:0/2756376076 wait complete. 2020-02-11T16:32:43.167 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:32:43.167 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:43.167 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:43.167 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:32:43.167 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 234, 2020-02-11T16:32:43.167 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:32:43.168 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:32:43.168 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:32:43.168 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:32:43.168 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.168 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 13, 2020-02-11T16:32:43.168 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:43.168 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:32:43.169 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:32:43.169 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:43.169 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:43.169 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:43.170 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:43.170 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:43.170 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:43.171 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.172 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:32:43.172 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:32:43.172 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:43.172 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:43.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:43.172 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:43.172 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:43.173 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:43.173 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.173 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:32:43.173 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:32:43.173 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:32:43.173 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:32:43.174 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:32:43.174 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:32:43.174 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:43.174 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:43.174 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:32:43.174 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:32:43.174 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:43.175 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:32:43.175 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:43.175 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:43.175 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:43.175 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:43.175 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:43.175 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:43.176 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.176 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:32:43.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.176 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:32:43.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.176 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:43.176 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:43.177 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:43.177 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:43.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.177 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:43.177 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:32:43.177 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.178 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:43.178 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:32:43.178 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.178 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.178 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.179 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:32:43.179 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:32:43.179 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:43.179 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:43.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.180 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:43.180 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:43.180 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:43.180 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:43.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.180 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:43.181 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:32:43.181 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.181 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:43.181 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:32:43.182 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.182 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.182 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.182 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:32:43.182 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:32:43.183 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:43.183 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:43.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.183 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:32:43.183 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:32:43.183 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:43.183 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:43.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.184 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:43.184 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:32:43.184 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.184 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:43.185 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:32:43.185 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.185 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.185 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.185 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:32:43.185 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:32:43.186 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:43.186 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:43.186 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.186 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.186 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:32:43.186 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:32:43.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.187 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:43.187 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:43.187 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:43.187 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.187 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.187 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:32:43.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.188 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:43.188 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:43.188 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:43.188 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.188 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.189 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:32:43.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.189 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:43.189 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:43.190 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:43.190 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.190 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.190 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.190 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:32:43.191 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.c mon_status 2020-02-11T16:32:43.300 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.296+0000 7f9ce24a2700 1 Processor -- start 2020-02-11T16:32:43.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.296+0000 7f9ce24a2700 1 -- start start 2020-02-11T16:32:43.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.296+0000 7f9ce24a2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9cdc0a7120 0x7f9cdc0a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:43.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.296+0000 7f9ce24a2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9cdc0a50f0 0x7f9cdc0a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:43.301 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.296+0000 7f9ce24a2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc136930 con 0x7f9cdc13c120 2020-02-11T16:32:43.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9ce24a2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc0a6470 con 0x7f9cdc0a50f0 2020-02-11T16:32:43.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9ce24a2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc0a49b0 con 0x7f9cdc0a7120 2020-02-11T16:32:43.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9cdc0a7120 0x7f9cdc0a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9cdc0a7120 0x7f9cdc0a2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33566/0 (socket says 172.21.15.88:33566) 2020-02-11T16:32:43.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 -- 172.21.15.88:0/2392169969 learned_addr learned my addr 172.21.15.88:0/2392169969 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:43.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/2392169969 >> v2:172.21.15.52:3300/0 conn(0x7f9cdc0a50f0 0x7f9cdc0a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.302 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 -- 172.21.15.88:0/2392169969 >> v2:172.21.15.52:3300/0 conn(0x7f9cdc0a50f0 msgr2=0x7f9cdc0a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:43.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/2392169969 >> v2:172.21.15.52:3300/0 conn(0x7f9cdc0a50f0 0x7f9cdc0a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:43.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 -- 172.21.15.88:0/2392169969 >> v1:172.21.15.52:6789/0 conn(0x7f9cdc13c120 legacy=0x7f9cdc13c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 -- 172.21.15.88:0/2392169969 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc0a4c50 con 0x7f9cdc0a7120 2020-02-11T16:32:43.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/2392169969 >> v2:172.21.15.88:3300/0 conn(0x7f9cdc0a7120 0x7f9cdc0a2900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/2392169969 >> v2:172.21.15.88:3300/0 conn(0x7f9cdc0a7120 0x7f9cdc0a2900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/2392169969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc0a7120 0x7f9cdc0a2900 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).ready entity=mon.1 client_cookie=1a49498a19d17e27 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.303 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/2392169969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc0a7120 0x7f9cdc0a2900 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdb7fe700 1 -- 172.21.15.88:0/2392169969 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ccc011670 con 0x7f9cdc0a7120 2020-02-11T16:32:43.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/2392169969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc0a7120 0x7f9cdc0a2900 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdb7fe700 1 -- 172.21.15.88:0/2392169969 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc0117d0 con 0x7f9cdc0a7120 2020-02-11T16:32:43.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/2392169969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc0a7120 0x7f9cdc0a2900 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9cdb7fe700 1 -- 172.21.15.88:0/2392169969 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ccc011bb0 con 0x7f9cdc0a7120 2020-02-11T16:32:43.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9ce24a2700 1 -- 172.21.15.88:0/2392169969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc0a7120 msgr2=0x7f9cdc0a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.304 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.297+0000 7f9ce24a2700 1 --2- 172.21.15.88:0/2392169969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc0a7120 0x7f9cdc0a2900 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).stop 2020-02-11T16:32:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.298+0000 7f9ce24a2700 1 -- 172.21.15.88:0/2392169969 shutdown_connections 2020-02-11T16:32:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.298+0000 7f9ce24a2700 1 --2- 172.21.15.88:0/2392169969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc0a7120 0x7f9cdc0a2900 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.298+0000 7f9ce24a2700 1 --2- 172.21.15.88:0/2392169969 >> v2:172.21.15.52:3300/0 conn(0x7f9cdc0a50f0 0x7f9cdc0a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.298+0000 7f9ce24a2700 1 -- 172.21.15.88:0/2392169969 >> 172.21.15.88:0/2392169969 conn(0x7f9cdc09d110 msgr2=0x7f9cdc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.298+0000 7f9ce24a2700 1 -- 172.21.15.88:0/2392169969 shutdown_connections 2020-02-11T16:32:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.298+0000 7f9ce24a2700 1 -- 172.21.15.88:0/2392169969 wait complete. 2020-02-11T16:32:43.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.299+0000 7f9ce24a2700 1 Processor -- start 2020-02-11T16:32:43.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.299+0000 7f9ce24a2700 1 -- start start 2020-02-11T16:32:43.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.299+0000 7f9ce24a2700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.299+0000 7f9ce24a2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc139280 con 0x7f9cdc0a7120 2020-02-11T16:32:43.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.299+0000 7f9ce24a2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc135430 con 0x7f9cdc13c120 2020-02-11T16:32:43.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.299+0000 7f9ce24a2700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc0a9930 con 0x7f9cdc0a50f0 2020-02-11T16:32:43.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.299+0000 7f9ce0a3f700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9cdc13c120 0x7f9cdc153e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49430/0 (socket says 172.21.15.88:49430) 2020-02-11T16:32:43.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.299+0000 7f9ce0a3f700 1 -- 172.21.15.88:0/3517354268 learned_addr learned my addr 172.21.15.88:0/3517354268 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:43.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.299+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441111495 0 0) 0x7f9cdc135430 con 0x7f9cdc13c120 2020-02-11T16:32:43.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc0002fe0 con 0x7f9cdc13c120 2020-02-11T16:32:43.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738474121 0 0) 0x7f9cdc139280 con 0x7f9cdc0a7120 2020-02-11T16:32:43.311 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cdc135430 con 0x7f9cdc0a7120 2020-02-11T16:32:43.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cdbfff700 1 -- 172.21.15.88:0/3517354268 >> v1:172.21.15.88:6789/0 conn(0x7f9cdc13c120 legacy=0x7f9cdc153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cdbfff700 1 -- 172.21.15.88:0/3517354268 >> v1:172.21.15.52:6789/0 conn(0x7f9cdc0a7120 legacy=0x7f9cdc12dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cdbfff700 1 -- 172.21.15.88:0/3517354268 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc09e100 con 0x7f9cdc0a50f0 2020-02-11T16:32:43.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.312 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ccc011e30 con 0x7f9cdc0a50f0 2020-02-11T16:32:43.313 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc011c00 con 0x7f9cdc0a50f0 2020-02-11T16:32:43.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9ce24a2700 1 -- 172.21.15.88:0/3517354268 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc0a76c0 con 0x7f9cdc0a50f0 2020-02-11T16:32:43.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ccc007530 con 0x7f9cdc0a50f0 2020-02-11T16:32:43.314 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.300+0000 7f9ce24a2700 1 -- 172.21.15.88:0/3517354268 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cdc134f90 con 0x7f9cdc0a50f0 2020-02-11T16:32:43.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f9ccc0056c0 con 0x7f9cdc0a50f0 2020-02-11T16:32:43.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9cdbfff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9ce24a2700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 0x7f9cdc12e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9ce24a2700 1 -- 172.21.15.88:0/3517354268 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc1352f0 con 0x7f9cdc09ee10 2020-02-11T16:32:43.315 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9cd9ffb700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9cc003a0e0 0x7f9cc003c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f9ccc049ce0 con 0x7f9cdc0a50f0 2020-02-11T16:32:43.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 0x7f9cdc12e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9ce0a3f700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9cc003a0e0 0x7f9cc003c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9ce0a3f700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9cc003a0e0 0x7f9cc003c5a0 crc :-1 s=READY pgs=592 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9cd3fff700 1 -- 172.21.15.88:0/3517354268 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9cdc0565b0 con 0x7f9cdc09ee10 2020-02-11T16:32:43.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.301+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 0x7f9cdc12e410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.316 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.302+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 0x7f9cdc12e410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.302+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 0x7f9cdc12e410 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.302+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 0x7f9cdc12e410 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.302+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cc4007530 con 0x7f9cdc09ee10 2020-02-11T16:32:43.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.302+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 0x7f9cdc12e410 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.317 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.302+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7f9cc400aeb0 con 0x7f9cdc09ee10 2020-02-11T16:32:43.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.302+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 msgr2=0x7f9cdc12e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.302+0000 7f9cd9ffb700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 0x7f9cdc12e410 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).stop 2020-02-11T16:32:43.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.302+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 msgr2=0x7f9cdc12e410 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:43.318 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.302+0000 7f9cd9ffb700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc09ee10 0x7f9cdc12e410 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).stop 2020-02-11T16:32:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.310+0000 7f9ce24a2700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 0x7f9cdc133900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.310+0000 7f9ce24a2700 1 -- 172.21.15.88:0/3517354268 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc05e2f0 con 0x7f9cdc0a3260 2020-02-11T16:32:43.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.310+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 0x7f9cdc133900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.310+0000 7f9cd3fff700 1 -- 172.21.15.88:0/3517354268 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9cdc1355c0 con 0x7f9cdc0a3260 2020-02-11T16:32:43.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.310+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 0x7f9cdc133900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 0x7f9cdc133900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 0x7f9cdc133900 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.321 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 0x7f9cdc133900 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cc4010350 con 0x7f9cdc0a3260 2020-02-11T16:32:43.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9cd3fff700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 0x7f9cdc133900 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 <== mon.2 v2:172.21.15.52:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3851 (secure 0 0 0) 0x7f9cc400e560 con 0x7f9cdc0a3260 2020-02-11T16:32:43.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 msgr2=0x7f9cdc133900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.322 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9cd9ffb700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 0x7f9cdc133900 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).stop 2020-02-11T16:32:43.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9cd9ffb700 1 -- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 msgr2=0x7f9cdc133900 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:43.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9cd9ffb700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a3260 0x7f9cdc133900 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0x7f9cc4007920 tx=0x7f9cc400c270).stop 2020-02-11T16:32:43.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9ce24a2700 1 -- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9cc003a0e0 msgr2=0x7f9cc003c5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9ce24a2700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f9cc003a0e0 0x7f9cc003c5a0 crc :-1 s=READY pgs=592 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9ce24a2700 1 -- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 msgr2=0x7f9cdc09e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.323 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9ce24a2700 1 --2- 172.21.15.88:0/3517354268 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cdc0a50f0 0x7f9cdc09e9b0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f9ccc002f30 tx=0x7f9ccc007a40).stop 2020-02-11T16:32:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9ce0a3f700 1 -- 172.21.15.88:0/3517354268 reap_dead start 2020-02-11T16:32:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9ce0a3f700 1 -- 172.21.15.88:0/3517354268 reap_dead start 2020-02-11T16:32:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9ce24a2700 1 -- 172.21.15.88:0/3517354268 shutdown_connections 2020-02-11T16:32:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9ce24a2700 1 -- 172.21.15.88:0/3517354268 >> 172.21.15.88:0/3517354268 conn(0x7f9cdc09d110 msgr2=0x7f9cdc05ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9ce24a2700 1 -- 172.21.15.88:0/3517354268 shutdown_connections 2020-02-11T16:32:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.311+0000 7f9ce24a2700 1 -- 172.21.15.88:0/3517354268 wait complete. 2020-02-11T16:32:43.324 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:32:43.325 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:32:43.325 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:32:43.325 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:32:43.325 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 234, 2020-02-11T16:32:43.325 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:32:43.325 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:32:43.326 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2020-02-11T16:32:43.326 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2020-02-11T16:32:43.326 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.326 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 13, 2020-02-11T16:32:43.326 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:43.326 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:32:43.326 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:32:43.327 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:43.327 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:43.328 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:43.328 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:43.328 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:43.328 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:43.328 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.329 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:32:43.329 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:32:43.329 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:43.329 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:43.329 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:43.330 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:43.330 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:43.330 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:43.330 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.331 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:32:43.331 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:32:43.331 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:32:43.331 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:32:43.331 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:32:43.331 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:32:43.332 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:43.332 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:43.332 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:32:43.332 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:32:43.332 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:43.332 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:32:43.332 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:43.333 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:43.333 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:43.333 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:43.333 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:43.333 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:43.333 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.333 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:32:43.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.334 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:32:43.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.334 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:43.334 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:43.334 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:43.334 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:43.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.335 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:43.335 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:32:43.335 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.335 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:43.335 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:32:43.336 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.336 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.336 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.336 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:32:43.336 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:32:43.336 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:43.337 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:43.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.337 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:43.337 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:43.337 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:43.337 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:43.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.338 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:43.338 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:32:43.338 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.339 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:43.339 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:32:43.339 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.339 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.339 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.340 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:32:43.340 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:32:43.340 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:43.340 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:43.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.341 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:32:43.341 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:32:43.341 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:43.341 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:43.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.342 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:43.342 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:32:43.342 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.342 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:43.342 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:32:43.343 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:43.343 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.343 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.343 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:32:43.343 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:32:43.343 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:43.344 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:43.344 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.344 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:43.344 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:32:43.344 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:32:43.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.345 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:43.345 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:43.345 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:43.345 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.345 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:43.345 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:32:43.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:43.346 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:43.346 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:43.346 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:43.346 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.346 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:43.346 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:43.346 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:32:43.348 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2020-02-11T16:32:43.348 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2020-02-11T16:32:43.348 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2020-02-11T16:32:43.348 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2020-02-11T16:32:43.348 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-02-11T16:32:43.348 INFO:teuthology.orchestra.run:waiting for 300 2020-02-11T16:32:43.359 INFO:tasks.ceph.mon.c:Stopped 2020-02-11T16:32:43.359 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2020-02-11T16:32:43.359 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:43.415 INFO:tasks.workunit.client.0.smithi088.stderr:++ md5sum /tmp/a 2020-02-11T16:32:43.415 INFO:tasks.workunit.client.0.smithi088.stderr:++ awk '{print $1}' 2020-02-11T16:32:43.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.464+0000 7fb9905cd700 1 Processor -- start 2020-02-11T16:32:43.466 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.464+0000 7fb9905cd700 1 -- start start 2020-02-11T16:32:43.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb9905cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9880a5de0 0x7fb9880a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:43.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb9905cd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9880a31b0 con 0x7fb9880a18a0 2020-02-11T16:32:43.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb9905cd700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9880a3570 con 0x7fb988134a50 2020-02-11T16:32:43.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb9905cd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9880a3810 con 0x7fb9880a5de0 2020-02-11T16:32:43.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb98eb6a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb988134a50 0x7fb988134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49442/0 (socket says 172.21.15.88:49442) 2020-02-11T16:32:43.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb98eb6a700 1 -- 172.21.15.88:0/2829814104 learned_addr learned my addr 172.21.15.88:0/2829814104 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:43.470 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb98db68700 1 --2- 172.21.15.88:0/2829814104 >> v2:172.21.15.52:3300/0 conn(0x7fb9880a5de0 0x7fb9880a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb98db68700 1 -- 172.21.15.88:0/2829814104 >> v1:172.21.15.88:6789/0 conn(0x7fb988134a50 legacy=0x7fb988134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb98db68700 1 -- 172.21.15.88:0/2829814104 >> v1:172.21.15.52:6789/0 conn(0x7fb9880a18a0 legacy=0x7fb9880a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb98db68700 1 -- 172.21.15.88:0/2829814104 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880a3ab0 con 0x7fb9880a5de0 2020-02-11T16:32:43.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb98db68700 1 --2- 172.21.15.88:0/2829814104 >> v2:172.21.15.52:3300/0 conn(0x7fb9880a5de0 0x7fb9880a6260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb984002f30 tx=0x7fb9840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb98db68700 1 --2- 172.21.15.88:0/2829814104 >> v2:172.21.15.52:3300/0 conn(0x7fb9880a5de0 0x7fb9880a6260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb984002f30 tx=0x7fb9840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.471 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.465+0000 7fb98db68700 1 --2- 172.21.15.88:0/2829814104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb9880a6260 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb9840088e0).ready entity=mon.0 client_cookie=41cc85ed2da84799 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb98db68700 1 --2- 172.21.15.88:0/2829814104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb9880a6260 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb9840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb98d367700 1 -- 172.21.15.88:0/2829814104 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb984008e40 con 0x7fb9880a5de0 2020-02-11T16:32:43.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb98db68700 1 --2- 172.21.15.88:0/2829814104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb9880a6260 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb9840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb98db68700 1 --2- 172.21.15.88:0/2829814104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb9880a6260 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb9840088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb98d367700 1 -- 172.21.15.88:0/2829814104 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9840116a0 con 0x7fb9880a5de0 2020-02-11T16:32:43.472 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb98d367700 1 -- 172.21.15.88:0/2829814104 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb984011a80 con 0x7fb9880a5de0 2020-02-11T16:32:43.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb9905cd700 1 -- 172.21.15.88:0/2829814104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 msgr2=0x7fb9880a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb9905cd700 1 --2- 172.21.15.88:0/2829814104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb9880a6260 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb9840088e0).stop 2020-02-11T16:32:43.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb9905cd700 1 -- 172.21.15.88:0/2829814104 shutdown_connections 2020-02-11T16:32:43.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb9905cd700 1 --2- 172.21.15.88:0/2829814104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb9880a6260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb9905cd700 1 -- 172.21.15.88:0/2829814104 >> 172.21.15.88:0/2829814104 conn(0x7fb98809d110 msgr2=0x7fb98809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:43.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb9905cd700 1 -- 172.21.15.88:0/2829814104 shutdown_connections 2020-02-11T16:32:43.473 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.466+0000 7fb9905cd700 1 -- 172.21.15.88:0/2829814104 wait complete. 2020-02-11T16:32:43.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.467+0000 7fb9905cd700 1 Processor -- start 2020-02-11T16:32:43.474 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.467+0000 7fb9905cd700 1 -- start start 2020-02-11T16:32:43.479 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb9905cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9880a5de0 0x7fb988066f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb9905cd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb988066b70 con 0x7fb9880a18a0 2020-02-11T16:32:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb9905cd700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb988148ea0 con 0x7fb988134a50 2020-02-11T16:32:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb9905cd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb988149140 con 0x7fb9880a5de0 2020-02-11T16:32:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98eb6a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb988134a50 0x7fb9881452a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49448/0 (socket says 172.21.15.88:49448) 2020-02-11T16:32:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98eb6a700 1 -- 172.21.15.88:0/582692484 learned_addr learned my addr 172.21.15.88:0/582692484 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> v2:172.21.15.52:3300/0 conn(0x7fb9880a5de0 0x7fb988066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98db68700 1 -- 172.21.15.88:0/582692484 >> v1:172.21.15.88:6789/0 conn(0x7fb988134a50 legacy=0x7fb9881452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98db68700 1 -- 172.21.15.88:0/582692484 >> v1:172.21.15.52:6789/0 conn(0x7fb9880a18a0 legacy=0x7fb988066460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98db68700 1 -- 172.21.15.88:0/582692484 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9881459b0 con 0x7fb9880a5de0 2020-02-11T16:32:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> v2:172.21.15.52:3300/0 conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> v2:172.21.15.52:3300/0 conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.481 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb97b7fe700 1 -- 172.21.15.88:0/582692484 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb984011ae0 con 0x7fb9880a5de0 2020-02-11T16:32:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb97b7fe700 1 -- 172.21.15.88:0/582692484 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb984007340 con 0x7fb9880a5de0 2020-02-11T16:32:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb97b7fe700 1 -- 172.21.15.88:0/582692484 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9840056c0 con 0x7fb9880a5de0 2020-02-11T16:32:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb9905cd700 1 -- 172.21.15.88:0/582692484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb988145c60 con 0x7fb9880a5de0 2020-02-11T16:32:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.468+0000 7fb9905cd700 1 -- 172.21.15.88:0/582692484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9880a0b30 con 0x7fb9880a5de0 2020-02-11T16:32:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.469+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.470+0000 7fb97b7fe700 1 -- 172.21.15.88:0/582692484 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fb9840058f0 con 0x7fb9880a5de0 2020-02-11T16:32:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.470+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.470+0000 7fb97b7fe700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb968039c40 0x7fb96803c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.470+0000 7fb97b7fe700 1 -- 172.21.15.88:0/582692484 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fb98404a100 con 0x7fb9880a5de0 2020-02-11T16:32:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.470+0000 7fb9905cd700 1 -- 172.21.15.88:0/582692484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9880a0de0 con 0x7fb9880a5de0 2020-02-11T16:32:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.470+0000 7fb98e369700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb968039c40 0x7fb96803c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.470+0000 7fb98e369700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb968039c40 0x7fb96803c100 crc :-1 s=READY pgs=593 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.474+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.474+0000 7fb97b7fe700 1 -- 172.21.15.88:0/582692484 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb98402f7a0 con 0x7fb9880a5de0 2020-02-11T16:32:43.516 INFO:tasks.workunit.client.0.smithi088.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2020-02-11T16:32:43.516 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' c3883760b18d50e8d78819c54d579b00 '!=' c3883760b18d50e8d78819c54d579b00 ']' 2020-02-11T16:32:43.516 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s 2020-02-11T16:32:43.528 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm linux-2.6.33.tar.bz2 2020-02-11T16:32:43.536 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:32:43.536 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:32:43.603 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-upchildrealms.sh... 2020-02-11T16:32:43.604 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-upchildrealms.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-upchildrealms.sh 2020-02-11T16:32:43.637 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:32:43.637 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:32:43.669 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.667+0000 7fb9905cd700 1 -- 172.21.15.88:0/582692484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb9880a1070 con 0x7fb9880a5de0 2020-02-11T16:32:43.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.667+0000 7fb98db68700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.670 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.667+0000 7fb97b7fe700 1 -- 172.21.15.88:0/582692484 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fb9840322b0 con 0x7fb9880a5de0 2020-02-11T16:32:43.670 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.669+0000 7fb9905cd700 1 -- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb968039c40 msgr2=0x7fb96803c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.669+0000 7fb9905cd700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb968039c40 0x7fb96803c100 crc :-1 s=READY pgs=593 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.669+0000 7fb9905cd700 1 -- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 msgr2=0x7fb988066f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.669+0000 7fb9905cd700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb988066f30 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fb984002f30 tx=0x7fb984011450).stop 2020-02-11T16:32:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.669+0000 7fb9905cd700 1 -- 172.21.15.88:0/582692484 shutdown_connections 2020-02-11T16:32:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.669+0000 7fb9905cd700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fb968039c40 0x7fb96803c100 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.669+0000 7fb9905cd700 1 --2- 172.21.15.88:0/582692484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9880a5de0 0x7fb988066f30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.669+0000 7fb9905cd700 1 -- 172.21.15.88:0/582692484 >> 172.21.15.88:0/582692484 conn(0x7fb98809d110 msgr2=0x7fb988069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.669+0000 7fb9905cd700 1 -- 172.21.15.88:0/582692484 shutdown_connections 2020-02-11T16:32:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:43.669+0000 7fb9905cd700 1 -- 172.21.15.88:0/582692484 wait complete. 2020-02-11T16:32:43.682 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":234,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:43.743 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.721+0000 7fc1f9e47700 1 Processor -- start 2020-02-11T16:32:43.744 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.721+0000 7fc1f9e47700 1 -- start start 2020-02-11T16:32:43.744 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.722+0000 7fc1f9e47700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1f405ac40 0x7fc1f40a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:43.744 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.722+0000 7fc1f9e47700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1f4099fa0 0x7fc1f414f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:43.744 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.722+0000 7fc1f9e47700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40a37e0 con 0x7fc1f40a14c0 2020-02-11T16:32:43.744 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.722+0000 7fc1f9e47700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40a24e0 con 0x7fc1f405ac40 2020-02-11T16:32:43.744 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.722+0000 7fc1f9e47700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40a4350 con 0x7fc1f4099fa0 2020-02-11T16:32:43.745 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1f405ac40 0x7fc1f40a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.745 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1f405ac40 0x7fc1f40a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33594/0 (socket says 172.21.15.88:33594) 2020-02-11T16:32:43.745 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 -- 172.21.15.88:0/3238759838 learned_addr learned my addr 172.21.15.88:0/3238759838 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:43.745 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1ebfff700 1 --1- 172.21.15.88:0/3238759838 >> v1:172.21.15.88:6789/0 conn(0x7fc1f40a14c0 0x7fc1f4099890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49452/0 (socket says 172.21.15.88:49452) 2020-02-11T16:32:43.745 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 -- 172.21.15.88:0/3238759838 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1f4099fa0 msgr2=0x7fc1f414f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:43.745 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/3238759838 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1f4099fa0 0x7fc1f414f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:43.745 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 -- 172.21.15.88:0/3238759838 >> v1:172.21.15.88:6789/0 conn(0x7fc1f40a14c0 legacy=0x7fc1f4099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.746 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 -- 172.21.15.88:0/3238759838 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40a26d0 con 0x7fc1f405ac40 2020-02-11T16:32:43.746 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/3238759838 >> v2:172.21.15.88:3300/0 conn(0x7fc1f405ac40 0x7fc1f40a2da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc1f40a23f0 tx=0x7fc1e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.746 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/3238759838 >> v2:172.21.15.88:3300/0 conn(0x7fc1f405ac40 0x7fc1f40a2da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc1f40a23f0 tx=0x7fc1e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.746 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/3238759838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f40a2da0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fc1f40a23f0 tx=0x7fc1e40088e0).ready entity=mon.1 client_cookie=3911f5812fd2f9c6 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.746 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/3238759838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f40a2da0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fc1f40a23f0 tx=0x7fc1e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.746 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/3238759838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f40a2da0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fc1f40a23f0 tx=0x7fc1e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.746 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/3238759838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f40a2da0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fc1f40a23f0 tx=0x7fc1e40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.747 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f37fe700 1 -- 172.21.15.88:0/3238759838 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e4008e20 con 0x7fc1f405ac40 2020-02-11T16:32:43.747 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f37fe700 1 -- 172.21.15.88:0/3238759838 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4011910 con 0x7fc1f405ac40 2020-02-11T16:32:43.747 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.723+0000 7fc1f37fe700 1 -- 172.21.15.88:0/3238759838 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e4011cf0 con 0x7fc1f405ac40 2020-02-11T16:32:43.747 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.724+0000 7fc1f9e47700 1 -- 172.21.15.88:0/3238759838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 msgr2=0x7fc1f40a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.747 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.724+0000 7fc1f9e47700 1 --2- 172.21.15.88:0/3238759838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f40a2da0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fc1f40a23f0 tx=0x7fc1e40088e0).stop 2020-02-11T16:32:43.747 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.726+0000 7fc1f9e47700 1 -- 172.21.15.88:0/3238759838 shutdown_connections 2020-02-11T16:32:43.748 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.726+0000 7fc1f9e47700 1 --2- 172.21.15.88:0/3238759838 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1f4099fa0 0x7fc1f414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:43.748 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.726+0000 7fc1f9e47700 1 --2- 172.21.15.88:0/3238759838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f40a2da0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:43.748 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.726+0000 7fc1f9e47700 1 -- 172.21.15.88:0/3238759838 >> 172.21.15.88:0/3238759838 conn(0x7fc1f405c170 msgr2=0x7fc1f405a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:43.748 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.733+0000 7fc1f9e47700 1 -- 172.21.15.88:0/3238759838 shutdown_connections 2020-02-11T16:32:43.748 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.733+0000 7fc1f9e47700 1 -- 172.21.15.88:0/3238759838 wait complete. 2020-02-11T16:32:43.748 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.734+0000 7fc1f9e47700 1 Processor -- start 2020-02-11T16:32:43.749 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.734+0000 7fc1f9e47700 1 -- start start 2020-02-11T16:32:43.749 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.735+0000 7fc1f9e47700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1f405ac40 0x7fc1f41334d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.749 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.735+0000 7fc1f9e47700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f409ecb0 con 0x7fc1f4099fa0 2020-02-11T16:32:43.749 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.735+0000 7fc1f9e47700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f4127de0 con 0x7fc1f40a14c0 2020-02-11T16:32:43.749 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.735+0000 7fc1f9e47700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f4127f70 con 0x7fc1f405ac40 2020-02-11T16:32:43.749 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.735+0000 7fc1f3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1f405ac40 0x7fc1f41334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.750 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.735+0000 7fc1f3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1f405ac40 0x7fc1f41334d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33598/0 (socket says 172.21.15.88:33598) 2020-02-11T16:32:43.750 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.735+0000 7fc1f3fff700 1 -- 172.21.15.88:0/1272738571 learned_addr learned my addr 172.21.15.88:0/1272738571 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:43.750 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f3fff700 1 -- 172.21.15.88:0/1272738571 >> v1:172.21.15.88:6789/0 conn(0x7fc1f40a14c0 legacy=0x7fc1f409fa90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:43.750 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f3fff700 1 -- 172.21.15.88:0/1272738571 >> v1:172.21.15.52:6789/0 conn(0x7fc1f4099fa0 legacy=0x7fc1f4133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:43.750 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f3fff700 1 -- 172.21.15.88:0/1272738571 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40a7220 con 0x7fc1f405ac40 2020-02-11T16:32:43.750 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> v2:172.21.15.88:3300/0 conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.750 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> v2:172.21.15.88:3300/0 conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.751 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.751 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.751 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.751 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.751 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f17fa700 1 -- 172.21.15.88:0/1272738571 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e4008ea0 con 0x7fc1f405ac40 2020-02-11T16:32:43.751 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f17fa700 1 -- 172.21.15.88:0/1272738571 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4007340 con 0x7fc1f405ac40 2020-02-11T16:32:43.751 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.736+0000 7fc1f17fa700 1 -- 172.21.15.88:0/1272738571 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e40056c0 con 0x7fc1f405ac40 2020-02-11T16:32:43.752 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.737+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f40a73b0 con 0x7fc1f405ac40 2020-02-11T16:32:43.752 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.737+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f4121260 con 0x7fc1f405ac40 2020-02-11T16:32:43.752 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.738+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.752 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.738+0000 7fc1f17fa700 1 -- 172.21.15.88:0/1272738571 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc1e4005930 con 0x7fc1f405ac40 2020-02-11T16:32:43.752 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.738+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.752 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.739+0000 7fc1f17fa700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1d8039c70 0x7fc1d803c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:43.752 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.739+0000 7fc1f17fa700 1 -- 172.21.15.88:0/1272738571 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fc1e404a240 con 0x7fc1f405ac40 2020-02-11T16:32:43.753 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.739+0000 7fc1ebfff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1d8039c70 0x7fc1d803c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:43.753 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.739+0000 7fc1ebfff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1d8039c70 0x7fc1d803c130 crc :-1 s=READY pgs=594 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:43.753 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.740+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f40565b0 con 0x7fc1f405ac40 2020-02-11T16:32:43.754 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.746+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:43.754 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.748+0000 7fc1f17fa700 1 -- 172.21.15.88:0/1272738571 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc1e4032830 con 0x7fc1f405ac40 2020-02-11T16:32:43.964 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:43.961+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc1f409ee40 con 0x7fc1f405ac40 2020-02-11T16:32:46.683 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:46.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.795+0000 7fa1415f6700 1 Processor -- start 2020-02-11T16:32:46.798 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.795+0000 7fa1415f6700 1 -- start start 2020-02-11T16:32:46.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.796+0000 7fa1415f6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a5de0 0x7fa13c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:46.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.796+0000 7fa1415f6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa13c134a50 0x7fa13c134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:46.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.796+0000 7fa1415f6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13c0a31b0 con 0x7fa13c0a18a0 2020-02-11T16:32:46.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.796+0000 7fa1415f6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13c0a3570 con 0x7fa13c134a50 2020-02-11T16:32:46.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.796+0000 7fa1415f6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0a3810 con 0x7fa13c0a5de0 2020-02-11T16:32:46.801 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.796+0000 7fa13b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa13c134a50 0x7fa13c134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:46.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.796+0000 7fa13affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa13c0a18a0 0x7fa13c0a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49462/0 (socket says 172.21.15.88:49462) 2020-02-11T16:32:46.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.796+0000 7fa13a7fc700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a5de0 msgr2=0x7fa13c0a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:46.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.796+0000 7fa13affd700 1 -- 172.21.15.88:0/1207894007 learned_addr learned my addr 172.21.15.88:0/1207894007 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:46.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.796+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1207894007 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a5de0 0x7fa13c0a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:46.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa13b7fe700 1 -- 172.21.15.88:0/1207894007 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a5de0 msgr2=0x7fa13c0a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:46.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa13b7fe700 1 --2- 172.21.15.88:0/1207894007 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a5de0 0x7fa13c0a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:46.802 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa13b7fe700 1 -- 172.21.15.88:0/1207894007 >> v1:172.21.15.88:6789/0 conn(0x7fa13c0a18a0 legacy=0x7fa13c0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:46.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa13b7fe700 1 -- 172.21.15.88:0/1207894007 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c0a3ab0 con 0x7fa13c134a50 2020-02-11T16:32:46.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa13b7fe700 1 --2- 172.21.15.88:0/1207894007 >> v2:172.21.15.88:3300/0 conn(0x7fa13c134a50 0x7fa13c134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa13c0a5cc0 tx=0x7fa134008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa13b7fe700 1 --2- 172.21.15.88:0/1207894007 >> v2:172.21.15.88:3300/0 conn(0x7fa13c134a50 0x7fa13c134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa13c0a5cc0 tx=0x7fa134008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa13b7fe700 1 --2- 172.21.15.88:0/1207894007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c134a50 0x7fa13c134ee0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7fa13c0a5cc0 tx=0x7fa134008c60).ready entity=mon.1 client_cookie=ffbf6d82e2638956 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:46.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa13b7fe700 1 --2- 172.21.15.88:0/1207894007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c134a50 0x7fa13c134ee0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fa13c0a5cc0 tx=0x7fa134008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa139ffb700 1 -- 172.21.15.88:0/1207894007 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa13400a160 con 0x7fa13c134a50 2020-02-11T16:32:46.803 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa13b7fe700 1 --2- 172.21.15.88:0/1207894007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c134a50 0x7fa13c134ee0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fa13c0a5cc0 tx=0x7fa134008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa139ffb700 1 -- 172.21.15.88:0/1207894007 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13400a2c0 con 0x7fa13c134a50 2020-02-11T16:32:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa13b7fe700 1 --2- 172.21.15.88:0/1207894007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c134a50 0x7fa13c134ee0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fa13c0a5cc0 tx=0x7fa134008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa139ffb700 1 -- 172.21.15.88:0/1207894007 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa13400a660 con 0x7fa13c134a50 2020-02-11T16:32:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa1415f6700 1 -- 172.21.15.88:0/1207894007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c134a50 msgr2=0x7fa13c134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa1415f6700 1 --2- 172.21.15.88:0/1207894007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c134a50 0x7fa13c134ee0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7fa13c0a5cc0 tx=0x7fa134008c60).stop 2020-02-11T16:32:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.797+0000 7fa1415f6700 1 -- 172.21.15.88:0/1207894007 shutdown_connections 2020-02-11T16:32:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.798+0000 7fa1415f6700 1 --2- 172.21.15.88:0/1207894007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c134a50 0x7fa13c134ee0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.798+0000 7fa1415f6700 1 --2- 172.21.15.88:0/1207894007 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a5de0 0x7fa13c0a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.798+0000 7fa1415f6700 1 -- 172.21.15.88:0/1207894007 >> 172.21.15.88:0/1207894007 conn(0x7fa13c09d110 msgr2=0x7fa13c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.798+0000 7fa1415f6700 1 -- 172.21.15.88:0/1207894007 shutdown_connections 2020-02-11T16:32:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.798+0000 7fa1415f6700 1 -- 172.21.15.88:0/1207894007 wait complete. 2020-02-11T16:32:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.798+0000 7fa1415f6700 1 Processor -- start 2020-02-11T16:32:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.798+0000 7fa1415f6700 1 -- start start 2020-02-11T16:32:46.809 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa1415f6700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a18a0 0x7fa13c12fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa1415f6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa13c0a5de0 0x7fa13c1254a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa1415f6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13c0a0480 con 0x7fa13c134a50 2020-02-11T16:32:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa1415f6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13c0a06b0 con 0x7fa13c0a5de0 2020-02-11T16:32:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa1415f6700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0a0950 con 0x7fa13c0a18a0 2020-02-11T16:32:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa13c0a5de0 0x7fa13c1254a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13affd700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a18a0 msgr2=0x7fa13c12fd60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa13c0a5de0 0x7fa13c1254a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33608/0 (socket says 172.21.15.88:33608) 2020-02-11T16:32:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13a7fc700 1 -- 172.21.15.88:0/1676393383 learned_addr learned my addr 172.21.15.88:0/1676393383 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13affd700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a18a0 0x7fa13c12fd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13a7fc700 1 -- 172.21.15.88:0/1676393383 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a18a0 msgr2=0x7fa13c12fd60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a18a0 0x7fa13c12fd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13a7fc700 1 -- 172.21.15.88:0/1676393383 >> v1:172.21.15.52:6789/0 conn(0x7fa13c134a50 legacy=0x7fa13c09eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13a7fc700 1 -- 172.21.15.88:0/1676393383 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c125900 con 0x7fa13c0a5de0 2020-02-11T16:32:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> v2:172.21.15.88:3300/0 conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> v2:172.21.15.88:3300/0 conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.799+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:46.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.812 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa133fff700 1 -- 172.21.15.88:0/1676393383 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c008db0 con 0x7fa13c0a5de0 2020-02-11T16:32:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa133fff700 1 -- 172.21.15.88:0/1676393383 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c0037c0 con 0x7fa13c0a5de0 2020-02-11T16:32:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa1415f6700 1 -- 172.21.15.88:0/1676393383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13c0a1dc0 con 0x7fa13c0a5de0 2020-02-11T16:32:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa133fff700 1 -- 172.21.15.88:0/1676393383 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c003be0 con 0x7fa13c0a5de0 2020-02-11T16:32:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa1415f6700 1 -- 172.21.15.88:0/1676393383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13c125000 con 0x7fa13c0a5de0 2020-02-11T16:32:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa133fff700 1 -- 172.21.15.88:0/1676393383 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa12c0123a0 con 0x7fa13c0a5de0 2020-02-11T16:32:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.800+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.801+0000 7fa1415f6700 1 -- 172.21.15.88:0/1676393383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13c125190 con 0x7fa13c0a5de0 2020-02-11T16:32:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.801+0000 7fa133fff700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa120039cd0 0x7fa12003c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.801+0000 7fa133fff700 1 -- 172.21.15.88:0/1676393383 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fa12c049610 con 0x7fa13c0a5de0 2020-02-11T16:32:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.801+0000 7fa13affd700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa120039cd0 0x7fa12003c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.801+0000 7fa13affd700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa120039cd0 0x7fa12003c190 crc :-1 s=READY pgs=595 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.804+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.804+0000 7fa133fff700 1 -- 172.21.15.88:0/1676393383 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fa12c02ec70 con 0x7fa13c0a5de0 2020-02-11T16:32:46.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.986+0000 7fa1415f6700 1 -- 172.21.15.88:0/1676393383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa13c0565b0 con 0x7fa13c0a5de0 2020-02-11T16:32:46.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.987+0000 7fa13a7fc700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:46.989 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.987+0000 7fa133fff700 1 -- 172.21.15.88:0/1676393383 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fa12c031760 con 0x7fa13c0a5de0 2020-02-11T16:32:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:46.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 -- 172.21.15.88:0/1676393383 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa120039cd0 msgr2=0x7fa12003c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:46.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa120039cd0 0x7fa12003c190 crc :-1 s=READY pgs=595 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:46.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 -- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 msgr2=0x7fa13c1254a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:46.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 0x7fa13c1254a0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7fa13c0a0c90 tx=0x7fa12c010a40).stop 2020-02-11T16:32:46.991 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 -- 172.21.15.88:0/1676393383 shutdown_connections 2020-02-11T16:32:46.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa120039cd0 0x7fa12003c190 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:46.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa13c0a18a0 0x7fa13c12fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:46.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 --2- 172.21.15.88:0/1676393383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa13c0a5de0 0x7fa13c1254a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:46.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 -- 172.21.15.88:0/1676393383 >> 172.21.15.88:0/1676393383 conn(0x7fa13c09d110 msgr2=0x7fa13c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:46.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 -- 172.21.15.88:0/1676393383 shutdown_connections 2020-02-11T16:32:46.992 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:46.988+0000 7fa1415f6700 1 -- 172.21.15.88:0/1676393383 wait complete. 2020-02-11T16:32:47.000 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":234,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:50.001 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:50.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.113+0000 7fc689256700 1 Processor -- start 2020-02-11T16:32:50.116 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.113+0000 7fc689256700 1 -- start start 2020-02-11T16:32:50.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.114+0000 7fc689256700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6840a5de0 0x7fc6840a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:50.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.114+0000 7fc689256700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc684134a50 0x7fc684134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:50.122 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.114+0000 7fc689256700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6840a31b0 con 0x7fc6840a18a0 2020-02-11T16:32:50.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.114+0000 7fc689256700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6840a3570 con 0x7fc684134a50 2020-02-11T16:32:50.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.114+0000 7fc689256700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840a3810 con 0x7fc6840a5de0 2020-02-11T16:32:50.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.114+0000 7fc68259c700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6840a5de0 msgr2=0x7fc6840a6260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:50.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.114+0000 7fc68259c700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6840a5de0 0x7fc6840a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:50.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc684134a50 0x7fc684134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:50.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc684134a50 0x7fc684134ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.88:47836/0 (socket says 172.21.15.88:47836) 2020-02-11T16:32:50.123 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 -- 172.21.15.88:0/3990675263 learned_addr learned my addr 172.21.15.88:0/3990675263 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:50.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 -- 172.21.15.88:0/3990675263 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6840a5de0 msgr2=0x7fc6840a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:50.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 --2- 172.21.15.88:0/3990675263 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6840a5de0 0x7fc6840a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:50.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 -- 172.21.15.88:0/3990675263 >> v1:172.21.15.52:6789/0 conn(0x7fc6840a18a0 legacy=0x7fc6840a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:50.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 -- 172.21.15.88:0/3990675263 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6840a3ab0 con 0x7fc684134a50 2020-02-11T16:32:50.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 --2- 172.21.15.88:0/3990675263 >> v2:172.21.15.52:3300/0 conn(0x7fc684134a50 0x7fc684134ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6840a5cc0 tx=0x7fc6740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.124 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 --2- 172.21.15.88:0/3990675263 >> v2:172.21.15.52:3300/0 conn(0x7fc684134a50 0x7fc684134ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6840a5cc0 tx=0x7fc6740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 --2- 172.21.15.88:0/3990675263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc684134a50 0x7fc684134ee0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7fc6840a5cc0 tx=0x7fc6740088e0).ready entity=mon.0 client_cookie=9d63e7361e34263e server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:50.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 --2- 172.21.15.88:0/3990675263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc684134a50 0x7fc684134ee0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fc6840a5cc0 tx=0x7fc6740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc681d9b700 1 -- 172.21.15.88:0/3990675263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc674008e20 con 0x7fc684134a50 2020-02-11T16:32:50.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 --2- 172.21.15.88:0/3990675263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc684134a50 0x7fc684134ee0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fc6840a5cc0 tx=0x7fc6740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc68359e700 1 --2- 172.21.15.88:0/3990675263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc684134a50 0x7fc684134ee0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fc6840a5cc0 tx=0x7fc6740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc681d9b700 1 -- 172.21.15.88:0/3990675263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc674011910 con 0x7fc684134a50 2020-02-11T16:32:50.125 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc681d9b700 1 -- 172.21.15.88:0/3990675263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc674011cf0 con 0x7fc684134a50 2020-02-11T16:32:50.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc689256700 1 -- 172.21.15.88:0/3990675263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc684134a50 msgr2=0x7fc684134ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:50.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.115+0000 7fc689256700 1 --2- 172.21.15.88:0/3990675263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc684134a50 0x7fc684134ee0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7fc6840a5cc0 tx=0x7fc6740088e0).stop 2020-02-11T16:32:50.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.116+0000 7fc689256700 1 -- 172.21.15.88:0/3990675263 shutdown_connections 2020-02-11T16:32:50.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.116+0000 7fc689256700 1 --2- 172.21.15.88:0/3990675263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc684134a50 0x7fc684134ee0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:50.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.116+0000 7fc689256700 1 --2- 172.21.15.88:0/3990675263 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6840a5de0 0x7fc6840a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:50.126 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.116+0000 7fc689256700 1 -- 172.21.15.88:0/3990675263 >> 172.21.15.88:0/3990675263 conn(0x7fc68409d110 msgr2=0x7fc68409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:50.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.116+0000 7fc689256700 1 -- 172.21.15.88:0/3990675263 shutdown_connections 2020-02-11T16:32:50.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.116+0000 7fc689256700 1 -- 172.21.15.88:0/3990675263 wait complete. 2020-02-11T16:32:50.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc689256700 1 Processor -- start 2020-02-11T16:32:50.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc689256700 1 -- start start 2020-02-11T16:32:50.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc689256700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc6840a18a0 0x7fc68409f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:50.127 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc689256700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc684134a50 0x7fc6840668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:50.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc689256700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6840a8ef0 con 0x7fc6840a5de0 2020-02-11T16:32:50.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc689256700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68409ea40 con 0x7fc6840a18a0 2020-02-11T16:32:50.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc689256700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68409f8b0 con 0x7fc684134a50 2020-02-11T16:32:50.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc68359e700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc684134a50 msgr2=0x7fc6840668c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:50.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc68259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc6840a5de0 0x7fc68409faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49482/0 (socket says 172.21.15.88:49482) 2020-02-11T16:32:50.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc68259c700 1 -- 172.21.15.88:0/3881791651 learned_addr learned my addr 172.21.15.88:0/3881791651 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:50.128 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc68359e700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc684134a50 0x7fc6840668c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:50.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.117+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> v2:172.21.15.52:3300/0 conn(0x7fc6840a18a0 0x7fc68409f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:50.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc682d9d700 1 -- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc684134a50 msgr2=0x7fc6840668c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:50.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc684134a50 0x7fc6840668c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:50.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc682d9d700 1 -- 172.21.15.88:0/3881791651 >> v1:172.21.15.88:6789/0 conn(0x7fc6840a5de0 legacy=0x7fc68409faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:50.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc682d9d700 1 -- 172.21.15.88:0/3881791651 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68409ec30 con 0x7fc6840a18a0 2020-02-11T16:32:50.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> v2:172.21.15.52:3300/0 conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.129 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> v2:172.21.15.52:3300/0 conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:50.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc67bfff700 1 -- 172.21.15.88:0/3881791651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc67c012380 con 0x7fc6840a18a0 2020-02-11T16:32:50.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc67bfff700 1 -- 172.21.15.88:0/3881791651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c0124e0 con 0x7fc6840a18a0 2020-02-11T16:32:50.130 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc689256700 1 -- 172.21.15.88:0/3881791651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68412d770 con 0x7fc6840a18a0 2020-02-11T16:32:50.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc67bfff700 1 -- 172.21.15.88:0/3881791651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc67c012900 con 0x7fc6840a18a0 2020-02-11T16:32:50.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.118+0000 7fc689256700 1 -- 172.21.15.88:0/3881791651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc684125700 con 0x7fc6840a18a0 2020-02-11T16:32:50.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.119+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.119+0000 7fc689256700 1 -- 172.21.15.88:0/3881791651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6840565b0 con 0x7fc6840a18a0 2020-02-11T16:32:50.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.119+0000 7fc67bfff700 1 -- 172.21.15.88:0/3881791651 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fc67c012b70 con 0x7fc6840a18a0 2020-02-11T16:32:50.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.119+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.131 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.119+0000 7fc67bfff700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc668039cd0 0x7fc66803c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:50.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.119+0000 7fc67bfff700 1 -- 172.21.15.88:0/3881791651 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fc67c04a270 con 0x7fc6840a18a0 2020-02-11T16:32:50.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.119+0000 7fc68259c700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc668039cd0 0x7fc66803c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:50.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.120+0000 7fc68259c700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc668039cd0 0x7fc66803c190 crc :-1 s=READY pgs=596 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:50.132 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.123+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.133 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.123+0000 7fc67bfff700 1 -- 172.21.15.88:0/3881791651 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc67c02f7b0 con 0x7fc6840a18a0 2020-02-11T16:32:50.306 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.304+0000 7fc689256700 1 -- 172.21.15.88:0/3881791651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc6840a72c0 con 0x7fc6840a18a0 2020-02-11T16:32:50.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.304+0000 7fc682d9d700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:50.307 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.305+0000 7fc67bfff700 1 -- 172.21.15.88:0/3881791651 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1280 (secure 0 0 0) 0x7fc67c0322a0 con 0x7fc6840a18a0 2020-02-11T16:32:50.307 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:50.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 -- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc668039cd0 msgr2=0x7fc66803c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:50.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc668039cd0 0x7fc66803c190 crc :-1 s=READY pgs=596 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:50.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 -- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 msgr2=0x7fc68409f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:50.309 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 0x7fc68409f450 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fc68405b910 tx=0x7fc67c010ce0).stop 2020-02-11T16:32:50.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 -- 172.21.15.88:0/3881791651 shutdown_connections 2020-02-11T16:32:50.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc684134a50 0x7fc6840668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:50.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc668039cd0 0x7fc66803c190 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:50.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 --2- 172.21.15.88:0/3881791651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6840a18a0 0x7fc68409f450 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:50.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 -- 172.21.15.88:0/3881791651 >> 172.21.15.88:0/3881791651 conn(0x7fc68409d110 msgr2=0x7fc684069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:50.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 -- 172.21.15.88:0/3881791651 shutdown_connections 2020-02-11T16:32:50.310 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:50.306+0000 7fc689256700 1 -- 172.21.15.88:0/3881791651 wait complete. 2020-02-11T16:32:50.320 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":234,"quorum":[0,1,2],"quorum_names":["b","a","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:52.997 INFO:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:32:53.000 INFO:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-11T16:32:53.321 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status 2020-02-11T16:32:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.442+0000 7f4eca4aa700 1 Processor -- start 2020-02-11T16:32:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.442+0000 7f4eca4aa700 1 -- start start 2020-02-11T16:32:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4eca4aa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4eca4aa700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 0x7f4ec4134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4eca4aa700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec40a31b0 con 0x7f4ec40a18a0 2020-02-11T16:32:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4eca4aa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec40a3570 con 0x7f4ec40a5de0 2020-02-11T16:32:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4eca4aa700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40a3810 con 0x7f4ec4134a50 2020-02-11T16:32:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4ec37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4ec3fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4ec40a18a0 0x7f4ec40a6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49494/0 (socket says 172.21.15.88:49494) 2020-02-11T16:32:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4ec8a47700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 msgr2=0x7f4ec4134ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4ec3fff700 1 -- 172.21.15.88:0/875453688 learned_addr learned my addr 172.21.15.88:0/875453688 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 0x7f4ec4134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:53.447 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:32:53.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:53.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:53.448 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.443+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:53.646 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.644+0000 7f4ec8a47700 1 -- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 msgr2=0x7f4ec4134ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.644+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 0x7f4ec4134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:32:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.644+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.644+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.644+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.644+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:53.644+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-11T16:32:53.738 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:53.736+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:54.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.045+0000 7f4ec8a47700 1 -- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 msgr2=0x7f4ec4134ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:54.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.045+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 0x7f4ec4134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:32:54.047 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.045+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:54.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.045+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-11T16:32:54.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.045+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:54.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.045+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:54.048 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.045+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-11T16:32:54.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.846+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:54.849 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.846+0000 7f4ec8a47700 1 -- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 msgr2=0x7f4ec4134ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:54.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.846+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 0x7f4ec4134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:32:54.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.846+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:54.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.846+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:54.850 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.846+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:54.851 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:54.846+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-11T16:32:56.450 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:56.448+0000 7f4ec8a47700 1 -- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 msgr2=0x7f4ec4134ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:56.448+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 0x7f4ec4134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:32:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:56.448+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:56.448+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-02-11T16:32:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:56.448+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-11T16:32:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:56.448+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-11T16:32:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:56.448+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-11T16:32:57.387 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.381+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915328952 0 0) 0x7f4ec40a31b0 con 0x7f4ec40a18a0 2020-02-11T16:32:57.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.381+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eb0003230 con 0x7f4ec40a18a0 2020-02-11T16:32:57.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3651448069 0 0) 0x7f4eb0003230 con 0x7f4ec40a18a0 2020-02-11T16:32:57.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 msgr2=0x7f4ec4134ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:57.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 0x7f4ec4134ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:57.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 msgr2=0x7f4ec40a6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:57.388 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 --2- 172.21.15.88:0/875453688 >> v2:172.21.15.88:3300/0 conn(0x7f4ec40a5de0 0x7f4ec40a6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:57.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec40a3ab0 con 0x7f4ec40a18a0 2020-02-11T16:32:57.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f4eb40016b0 con 0x7f4ec40a18a0 2020-02-11T16:32:57.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 >> v1:172.21.15.88:6789/0 conn(0x7f4ec40a18a0 legacy=0x7f4ec40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eb0003720 0x7f4eb0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:57.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 0x7f4eb00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:57.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb0004930 0x7f4eb0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:57.389 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40a3570 con 0x7f4eb0003720 2020-02-11T16:32:57.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40a3810 con 0x7f4eb0004930 2020-02-11T16:32:57.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb00040b0 con 0x7f4ec4134a50 2020-02-11T16:32:57.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb0004930 0x7f4eb0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec37fe700 1 -- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 msgr2=0x7f4eb00044d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:57.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 0x7f4eb00044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:57.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec8a47700 1 -- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 msgr2=0x7f4eb00044d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:57.390 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec4134a50 0x7f4eb00044d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec8a47700 1 -- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eb0003720 msgr2=0x7f4eb0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eb0003720 0x7f4eb0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec8a47700 1 -- 172.21.15.88:0/875453688 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb0003230 con 0x7f4eb0004930 2020-02-11T16:32:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb0004930 0x7f4eb0004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4ebc005f10 tx=0x7f4ebc0090a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb0004930 0x7f4eb0004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4ebc005f10 tx=0x7f4ebc0090a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.382+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb0004930 0x7f4eb0004db0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f4ebc005f10 tx=0x7f4ebc0090a0).ready entity=mon.1 client_cookie=ac72ae228844bb8d server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb0004930 0x7f4eb0004db0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f4ebc005f10 tx=0x7f4ebc0090a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb0004930 0x7f4eb0004db0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f4ebc005f10 tx=0x7f4ebc0090a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ebc0112e0 con 0x7f4eb0004930 2020-02-11T16:32:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4ec8a47700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb0004930 0x7f4eb0004db0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f4ebc005f10 tx=0x7f4ebc0090a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc011440 con 0x7f4eb0004930 2020-02-11T16:32:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4ec2ffd700 1 -- 172.21.15.88:0/875453688 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ebc011820 con 0x7f4eb0004930 2020-02-11T16:32:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4eca4aa700 1 -- 172.21.15.88:0/875453688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb0004930 msgr2=0x7f4eb0004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4eca4aa700 1 --2- 172.21.15.88:0/875453688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb0004930 0x7f4eb0004db0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f4ebc005f10 tx=0x7f4ebc0090a0).stop 2020-02-11T16:32:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4ec8a47700 1 -- 172.21.15.88:0/875453688 reap_dead start 2020-02-11T16:32:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4eca4aa700 1 -- 172.21.15.88:0/875453688 shutdown_connections 2020-02-11T16:32:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4eca4aa700 1 -- 172.21.15.88:0/875453688 >> 172.21.15.88:0/875453688 conn(0x7f4ec409d110 msgr2=0x7f4ec409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4eca4aa700 1 -- 172.21.15.88:0/875453688 shutdown_connections 2020-02-11T16:32:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.383+0000 7f4eca4aa700 1 -- 172.21.15.88:0/875453688 wait complete. 2020-02-11T16:32:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.385+0000 7f4eca4aa700 1 Processor -- start 2020-02-11T16:32:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.385+0000 7f4eca4aa700 1 -- start start 2020-02-11T16:32:57.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.385+0000 7f4eca4aa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ec41319a0 0x7f4ec412d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.385+0000 7f4eca4aa700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec412b9c0 0x7f4ec4138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4eca4aa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec4135b10 con 0x7f4ec4138720 2020-02-11T16:32:57.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4eca4aa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec4138b80 con 0x7f4ec41319a0 2020-02-11T16:32:57.397 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4eca4aa700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec4135d40 con 0x7f4ec412b9c0 2020-02-11T16:32:57.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec8a47700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec412b9c0 msgr2=0x7f4ec4138040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:57.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ec41319a0 0x7f4ec412d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec8a47700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec412b9c0 0x7f4ec4138040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:57.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ec41319a0 0x7f4ec412d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33668/0 (socket says 172.21.15.88:33668) 2020-02-11T16:32:57.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec3fff700 1 -- 172.21.15.88:0/3171531523 learned_addr learned my addr 172.21.15.88:0/3171531523 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:57.398 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec3fff700 1 -- 172.21.15.88:0/3171531523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec412b9c0 msgr2=0x7f4ec4138040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:57.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec412b9c0 0x7f4ec4138040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec3fff700 1 -- 172.21.15.88:0/3171531523 >> v1:172.21.15.52:6789/0 conn(0x7f4ec4138720 legacy=0x7f4ec412b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec3fff700 1 -- 172.21.15.88:0/3171531523 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4135fe0 con 0x7f4ec41319a0 2020-02-11T16:32:57.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> v2:172.21.15.88:3300/0 conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> v2:172.21.15.88:3300/0 conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.386+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.399 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.387+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.387+0000 7f4ec17fa700 1 -- 172.21.15.88:0/3171531523 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb400ccf0 con 0x7f4ec41319a0 2020-02-11T16:32:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.387+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.387+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.387+0000 7f4ec17fa700 1 -- 172.21.15.88:0/3171531523 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb400ce50 con 0x7f4ec41319a0 2020-02-11T16:32:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.387+0000 7f4eca4aa700 1 -- 172.21.15.88:0/3171531523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec41384a0 con 0x7f4ec41319a0 2020-02-11T16:32:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.387+0000 7f4ec17fa700 1 -- 172.21.15.88:0/3171531523 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb40047a0 con 0x7f4ec41319a0 2020-02-11T16:32:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.387+0000 7f4eca4aa700 1 -- 172.21.15.88:0/3171531523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec414d7c0 con 0x7f4ec41319a0 2020-02-11T16:32:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.388+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.388+0000 7f4ec17fa700 1 -- 172.21.15.88:0/3171531523 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f4eb4004a10 con 0x7f4ec41319a0 2020-02-11T16:32:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.388+0000 7f4eca4aa700 1 -- 172.21.15.88:0/3171531523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec40565b0 con 0x7f4ec41319a0 2020-02-11T16:32:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.388+0000 7f4ec17fa700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea4039c70 0x7f4ea403c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.389+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea4039c70 0x7f4ea403c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.389+0000 7f4ec37fe700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea4039c70 0x7f4ea403c130 crc :-1 s=READY pgs=597 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.391+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.391+0000 7f4ec17fa700 1 -- 172.21.15.88:0/3171531523 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f4eb4031d40 con 0x7f4ec41319a0 2020-02-11T16:32:57.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.394+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.402 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.394+0000 7f4ec17fa700 1 -- 172.21.15.88:0/3171531523 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4eb402f090 con 0x7f4ec41319a0 2020-02-11T16:32:57.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.580+0000 7f4eca4aa700 1 -- 172.21.15.88:0/3171531523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4ec405ccb0 con 0x7f4ec41319a0 2020-02-11T16:32:57.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.581+0000 7f4ec3fff700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.583 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.581+0000 7f4ec17fa700 1 -- 172.21.15.88:0/3171531523 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1273 (secure 0 0 0) 0x7f4eb4031b60 con 0x7f4ec41319a0 2020-02-11T16:32:57.584 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":238,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:57.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 -- 172.21.15.88:0/3171531523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea4039c70 msgr2=0x7f4ea403c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea4039c70 0x7f4ea403c130 crc :-1 s=READY pgs=597 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 -- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 msgr2=0x7f4ec412d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 0x7f4ec412d4d0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f4ec40aa050 tx=0x7f4ec412f3b0).stop 2020-02-11T16:32:57.585 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 -- 172.21.15.88:0/3171531523 shutdown_connections 2020-02-11T16:32:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f4ea4039c70 0x7f4ea403c130 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ec412b9c0 0x7f4ec4138040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 --2- 172.21.15.88:0/3171531523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ec41319a0 0x7f4ec412d4d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 -- 172.21.15.88:0/3171531523 >> 172.21.15.88:0/3171531523 conn(0x7f4ec409d110 msgr2=0x7f4ec4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 -- 172.21.15.88:0/3171531523 shutdown_connections 2020-02-11T16:32:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.582+0000 7f4eca4aa700 1 -- 172.21.15.88:0/3171531523 wait complete. 2020-02-11T16:32:57.595 INFO:tasks.mon_thrash.ceph_manager:quorum_status is {"election_epoch":238,"quorum":[0,1],"quorum_names":["b","a"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292836696063","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"386cdcef-05ad-40b9-b029-1e37a6356c21","modified":"2020-02-11T16:04:42.404721Z","created":"2020-02-11T16:04:42.404721Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0},{"rank":1,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3301","nonce":0},{"type":"v1","addr":"172.21.15.52:6790","nonce":0}]},"addr":"172.21.15.52:6790/0","public_addr":"172.21.15.52:6790/0","priority":0,"weight":0}]}} 2020-02-11T16:32:57.595 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2020-02-11T16:32:57.595 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.a mon_status 2020-02-11T16:32:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.699+0000 7fdf3fb7b700 1 Processor -- start 2020-02-11T16:32:57.702 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.699+0000 7fdf3fb7b700 1 -- start start 2020-02-11T16:32:57.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.699+0000 7fdf3fb7b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a18a0 0x7fdf380a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:57.713 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.699+0000 7fdf3fb7b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf380a6260 0x7fdf3812eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3fb7b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf380a3570 con 0x7fdf380a5de0 2020-02-11T16:32:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3fb7b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf380a3810 con 0x7fdf380a6260 2020-02-11T16:32:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3fb7b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf380a3ab0 con 0x7fdf380a18a0 2020-02-11T16:32:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf380a6260 0x7fdf3812eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3d917700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a18a0 msgr2=0x7fdf380a6dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3d917700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a18a0 0x7fdf380a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf380a6260 0x7fdf3812eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33676/0 (socket says 172.21.15.88:33676) 2020-02-11T16:32:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 -- 172.21.15.88:0/3140487278 learned_addr learned my addr 172.21.15.88:0/3140487278 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 -- 172.21.15.88:0/3140487278 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a18a0 msgr2=0x7fdf380a6dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 --2- 172.21.15.88:0/3140487278 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a18a0 0x7fdf380a6dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 -- 172.21.15.88:0/3140487278 >> v1:172.21.15.52:6789/0 conn(0x7fdf380a5de0 legacy=0x7fdf3812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 -- 172.21.15.88:0/3140487278 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf380a3d50 con 0x7fdf380a6260 2020-02-11T16:32:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 --2- 172.21.15.88:0/3140487278 >> v2:172.21.15.88:3300/0 conn(0x7fdf380a6260 0x7fdf3812eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdf3805bbc0 tx=0x7fdf340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 --2- 172.21.15.88:0/3140487278 >> v2:172.21.15.88:3300/0 conn(0x7fdf380a6260 0x7fdf3812eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdf3805bbc0 tx=0x7fdf340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 --2- 172.21.15.88:0/3140487278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a6260 0x7fdf3812eab0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fdf3805bbc0 tx=0x7fdf340088e0).ready entity=mon.1 client_cookie=a64b62f92572bebe server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 --2- 172.21.15.88:0/3140487278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a6260 0x7fdf3812eab0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fdf3805bbc0 tx=0x7fdf340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3c915700 1 -- 172.21.15.88:0/3140487278 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf34008e20 con 0x7fdf380a6260 2020-02-11T16:32:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 --2- 172.21.15.88:0/3140487278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a6260 0x7fdf3812eab0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fdf3805bbc0 tx=0x7fdf340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3c915700 1 -- 172.21.15.88:0/3140487278 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf34011910 con 0x7fdf380a6260 2020-02-11T16:32:57.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3e118700 1 --2- 172.21.15.88:0/3140487278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a6260 0x7fdf3812eab0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fdf3805bbc0 tx=0x7fdf340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3c915700 1 -- 172.21.15.88:0/3140487278 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf34011cf0 con 0x7fdf380a6260 2020-02-11T16:32:57.719 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/3140487278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a6260 msgr2=0x7fdf3812eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.700+0000 7fdf3fb7b700 1 --2- 172.21.15.88:0/3140487278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a6260 0x7fdf3812eab0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fdf3805bbc0 tx=0x7fdf340088e0).stop 2020-02-11T16:32:57.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.701+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/3140487278 shutdown_connections 2020-02-11T16:32:57.720 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.701+0000 7fdf3fb7b700 1 --2- 172.21.15.88:0/3140487278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a6260 0x7fdf3812eab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.701+0000 7fdf3fb7b700 1 --2- 172.21.15.88:0/3140487278 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a18a0 0x7fdf380a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:57.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.701+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/3140487278 >> 172.21.15.88:0/3140487278 conn(0x7fdf3809d110 msgr2=0x7fdf3809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:57.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.701+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/3140487278 shutdown_connections 2020-02-11T16:32:57.721 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.701+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/3140487278 wait complete. 2020-02-11T16:32:57.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3fb7b700 1 Processor -- start 2020-02-11T16:32:57.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3fb7b700 1 -- start start 2020-02-11T16:32:57.722 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3fb7b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf380a18a0 0x7fdf381367b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3fb7b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a6260 0x7fdf3812fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3fb7b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf38130240 con 0x7fdf380a5de0 2020-02-11T16:32:57.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3fb7b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf38143030 con 0x7fdf380a18a0 2020-02-11T16:32:57.723 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3fb7b700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38142d20 con 0x7fdf380a6260 2020-02-11T16:32:57.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3e118700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a6260 msgr2=0x7fdf3812fac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:57.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3e118700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a6260 0x7fdf3812fac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:57.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3d917700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf380a18a0 0x7fdf381367b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.724 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3d917700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf380a18a0 0x7fdf381367b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33680/0 (socket says 172.21.15.88:33680) 2020-02-11T16:32:57.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.702+0000 7fdf3d917700 1 -- 172.21.15.88:0/2691560729 learned_addr learned my addr 172.21.15.88:0/2691560729 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:32:57.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 -- 172.21.15.88:0/2691560729 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a6260 msgr2=0x7fdf3812fac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:57.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf380a6260 0x7fdf3812fac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.725 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 -- 172.21.15.88:0/2691560729 >> v1:172.21.15.52:6789/0 conn(0x7fdf380a5de0 legacy=0x7fdf381434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 -- 172.21.15.88:0/2691560729 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3812ff20 con 0x7fdf380a18a0 2020-02-11T16:32:57.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 --2- 172.21.15.88:0/2691560729 >> v2:172.21.15.88:3300/0 conn(0x7fdf380a18a0 0x7fdf381367b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf30000b20 tx=0x7fdf30010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 --2- 172.21.15.88:0/2691560729 >> v2:172.21.15.88:3300/0 conn(0x7fdf380a18a0 0x7fdf381367b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf30000b20 tx=0x7fdf30010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.726 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a18a0 0x7fdf381367b0 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7fdf30000b20 tx=0x7fdf30010dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a18a0 0x7fdf381367b0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fdf30000b20 tx=0x7fdf30010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf30003e90 con 0x7fdf380a18a0 2020-02-11T16:32:57.727 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a18a0 0x7fdf381367b0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fdf30000b20 tx=0x7fdf30010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a18a0 0x7fdf381367b0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fdf30000b20 tx=0x7fdf30010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf30012760 con 0x7fdf380a18a0 2020-02-11T16:32:57.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/2691560729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf381462b0 con 0x7fdf380a18a0 2020-02-11T16:32:57.728 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf30012b40 con 0x7fdf380a18a0 2020-02-11T16:32:57.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/2691560729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf38135110 con 0x7fdf380a18a0 2020-02-11T16:32:57.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.703+0000 7fdf3d917700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a18a0 0x7fdf381367b0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fdf30000b20 tx=0x7fdf30010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.704+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fdf3000a180 con 0x7fdf380a18a0 2020-02-11T16:32:57.729 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.704+0000 7fdf3d917700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a18a0 0x7fdf381367b0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fdf30000b20 tx=0x7fdf30010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.704+0000 7fdf3fb7b700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 0x7fdf38146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.704+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/2691560729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3805e2f0 con 0x7fdf380a93e0 2020-02-11T16:32:57.730 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.704+0000 7fdf26ffd700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdf18039c20 0x7fdf1803c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.704+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fdf30049cb0 con 0x7fdf380a18a0 2020-02-11T16:32:57.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.704+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 0x7fdf38146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.704+0000 7fdf3e118700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdf18039c20 0x7fdf1803c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.731 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.704+0000 7fdf3d116700 1 -- 172.21.15.88:0/2691560729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf38142e90 con 0x7fdf380a93e0 2020-02-11T16:32:57.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.704+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 0x7fdf38146ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf3e118700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdf18039c20 0x7fdf1803c0e0 crc :-1 s=READY pgs=598 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 0x7fdf38146ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.732 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 0x7fdf38146ba0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28002e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 0x7fdf38146ba0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf2800cc20 con 0x7fdf380a93e0 2020-02-11T16:32:57.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 0x7fdf38146ba0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.733 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fdf2800cd80 con 0x7fdf380a93e0 2020-02-11T16:32:57.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 msgr2=0x7fdf38146ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf26ffd700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 0x7fdf38146ba0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28002e60).stop 2020-02-11T16:32:57.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 msgr2=0x7fdf38146ba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:57.734 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.705+0000 7fdf26ffd700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a93e0 0x7fdf38146ba0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28002e60).stop 2020-02-11T16:32:57.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.713+0000 7fdf3fb7b700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 0x7fdf3812bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.713+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/2691560729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38143200 con 0x7fdf3812b750 2020-02-11T16:32:57.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.713+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 0x7fdf3812bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.739 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.713+0000 7fdf3d116700 1 -- 172.21.15.88:0/2691560729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdf380565b0 con 0x7fdf3812b750 2020-02-11T16:32:57.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.713+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 0x7fdf3812bb30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.713+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 0x7fdf3812bb30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.713+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 0x7fdf3812bb30 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28011f20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 0x7fdf3812bb30 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf2800ee20 con 0x7fdf3812b750 2020-02-11T16:32:57.740 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3d116700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 0x7fdf3812bb30 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28011f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 <== mon.1 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4349 (secure 0 0 0) 0x7fdf2800b370 con 0x7fdf3812b750 2020-02-11T16:32:57.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 msgr2=0x7fdf3812bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf26ffd700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 0x7fdf3812bb30 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28011f20).stop 2020-02-11T16:32:57.741 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf26ffd700 1 -- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 msgr2=0x7fdf3812bb30 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:57.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf26ffd700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf3812b750 0x7fdf3812bb30 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0x7fdf38135480 tx=0x7fdf28011f20).stop 2020-02-11T16:32:57.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/2691560729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdf18039c20 msgr2=0x7fdf1803c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3fb7b700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fdf18039c20 0x7fdf1803c0e0 crc :-1 s=READY pgs=598 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a18a0 msgr2=0x7fdf381367b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.742 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3fb7b700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a18a0 0x7fdf381367b0 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7fdf30000b20 tx=0x7fdf30010dc0).stop 2020-02-11T16:32:57.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3e118700 1 -- 172.21.15.88:0/2691560729 reap_dead start 2020-02-11T16:32:57.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3e118700 1 -- 172.21.15.88:0/2691560729 reap_dead start 2020-02-11T16:32:57.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/2691560729 shutdown_connections 2020-02-11T16:32:57.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3fb7b700 1 --2- 172.21.15.88:0/2691560729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf380a18a0 0x7fdf381367b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.743 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/2691560729 >> 172.21.15.88:0/2691560729 conn(0x7fdf3809d110 msgr2=0x7fdf380a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:57.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.714+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/2691560729 shutdown_connections 2020-02-11T16:32:57.744 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.715+0000 7fdf3fb7b700 1 -- 172.21.15.88:0/2691560729 wait complete. 2020-02-11T16:32:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:32:57.744 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:57.744 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:57.744 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2020-02-11T16:32:57.745 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 238, 2020-02-11T16:32:57.745 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:32:57.745 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:32:57.745 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:32:57.745 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.745 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:32:57.745 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:57.746 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:32:57.746 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:32:57.746 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:57.746 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:57.746 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:57.747 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:57.747 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:57.747 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:57.747 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.747 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:32:57.747 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:32:57.748 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:57.748 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:57.748 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:57.748 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:57.748 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:57.748 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:57.748 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.749 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:32:57.749 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:32:57.749 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:32:57.749 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:32:57.749 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:32:57.749 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:32:57.750 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:57.750 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:57.750 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:32:57.750 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:32:57.750 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:57.750 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:32:57.751 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:57.751 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:57.751 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:57.751 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:57.751 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:57.751 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:57.751 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.752 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:32:57.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.752 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:32:57.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.752 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:57.752 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:57.752 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:57.753 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:57.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.753 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:57.753 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:32:57.753 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.754 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:57.754 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:32:57.754 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.754 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.754 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.755 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:32:57.755 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:32:57.755 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:57.755 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:57.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.756 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:57.756 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:57.756 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:57.756 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:57.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.757 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:57.757 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:32:57.757 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.757 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:57.757 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:32:57.758 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.758 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.758 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.758 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:32:57.758 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:32:57.758 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:57.759 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:57.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.759 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:32:57.759 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:32:57.759 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:57.760 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:57.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.760 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:57.760 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:32:57.760 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.761 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:57.761 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:32:57.761 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.761 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.762 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.762 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:32:57.762 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:32:57.762 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:57.762 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:57.762 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.763 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.763 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:32:57.763 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:32:57.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.763 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:57.763 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2020-02-11T16:32:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:57.764 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:57.765 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:57.765 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.765 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.765 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:32:57.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.765 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:57.765 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:57.766 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:32:57.766 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.766 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.766 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:32:57.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.766 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:57.769 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:57.769 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2020-02-11T16:32:57.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.769 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.770 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2020-02-11T16:32:57.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.770 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:57.770 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:57.770 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:57.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.771 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:32:57.772 INFO:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mon.b mon_status 2020-02-11T16:32:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.875+0000 7fa2d8f56700 1 Processor -- start 2020-02-11T16:32:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.875+0000 7fa2d8f56700 1 -- start start 2020-02-11T16:32:57.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.876+0000 7fa2d8f56700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2d40a4ec0 0x7fa2d412f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:57.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.876+0000 7fa2d8f56700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40a5560 con 0x7fa2d412fcf0 2020-02-11T16:32:57.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.876+0000 7fa2d8f56700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d409e060 con 0x7fa2d40a7120 2020-02-11T16:32:57.888 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.876+0000 7fa2d8f56700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d40a5350 con 0x7fa2d40a4ec0 2020-02-11T16:32:57.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.876+0000 7fa2d259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa2d40a7120 0x7fa2d40a39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49550/0 (socket says 172.21.15.88:49550) 2020-02-11T16:32:57.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.876+0000 7fa2d259c700 1 -- 172.21.15.88:0/3507701445 learned_addr learned my addr 172.21.15.88:0/3507701445 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:57.889 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.876+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/3507701445 >> v2:172.21.15.52:3300/0 conn(0x7fa2d40a4ec0 0x7fa2d412f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.876+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326291528 0 0) 0x7fa2d409e060 con 0x7fa2d40a7120 2020-02-11T16:32:57.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.876+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2b8003230 con 0x7fa2d40a7120 2020-02-11T16:32:57.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 891214497 0 0) 0x7fa2b8003230 con 0x7fa2d40a7120 2020-02-11T16:32:57.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 >> v2:172.21.15.52:3300/0 conn(0x7fa2d40a4ec0 msgr2=0x7fa2d412f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:57.890 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 --2- 172.21.15.88:0/3507701445 >> v2:172.21.15.52:3300/0 conn(0x7fa2d40a4ec0 0x7fa2d412f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:57.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 >> v1:172.21.15.52:6789/0 conn(0x7fa2d412fcf0 legacy=0x7fa2d4140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d409e300 con 0x7fa2d40a7120 2020-02-11T16:32:57.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa2c80016d0 con 0x7fa2d40a7120 2020-02-11T16:32:57.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 >> v1:172.21.15.88:6789/0 conn(0x7fa2d40a7120 legacy=0x7fa2d40a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b8003720 0x7fa2b8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:57.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 0x7fa2b8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:57.891 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2b8004db0 0x7fa2b800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:57.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40a5350 con 0x7fa2b8003720 2020-02-11T16:32:57.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b80041c0 con 0x7fa2b80044d0 2020-02-11T16:32:57.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b800bb80 con 0x7fa2b8004db0 2020-02-11T16:32:57.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 0x7fa2b8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d2d9d700 1 -- 172.21.15.88:0/3507701445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2b8004db0 msgr2=0x7fa2b800b720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:57.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d2d9d700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2b8004db0 0x7fa2b800b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:57.892 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d259c700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b8003720 0x7fa2b8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 -- 172.21.15.88:0/3507701445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2b8004db0 msgr2=0x7fa2b800b720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:57.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2b8004db0 0x7fa2b800b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:57.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 -- 172.21.15.88:0/3507701445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b8003720 msgr2=0x7fa2b8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:57.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b8003720 0x7fa2b8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:57.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d2d9d700 1 -- 172.21.15.88:0/3507701445 reap_dead start 2020-02-11T16:32:57.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 -- 172.21.15.88:0/3507701445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b8003230 con 0x7fa2b80044d0 2020-02-11T16:32:57.893 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 0x7fa2b8004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa2b80054a0 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 0x7fa2b8004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa2b80054a0 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 0x7fa2b8004950 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fa2b80054a0 tx=0x7fa2c4010080).ready entity=mon.1 client_cookie=c5d4196f3856827f server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 0x7fa2b8004950 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fa2b80054a0 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2c4008d30 con 0x7fa2b80044d0 2020-02-11T16:32:57.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 0x7fa2b8004950 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fa2b80054a0 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.894 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 0x7fa2b8004950 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fa2b80054a0 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c4008e90 con 0x7fa2b80044d0 2020-02-11T16:32:57.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d159a700 1 -- 172.21.15.88:0/3507701445 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2c4010b20 con 0x7fa2b80044d0 2020-02-11T16:32:57.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d8f56700 1 -- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 msgr2=0x7fa2b8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.895 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.877+0000 7fa2d8f56700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 0x7fa2b8004950 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fa2b80054a0 tx=0x7fa2c4010080).stop 2020-02-11T16:32:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.878+0000 7fa2d8f56700 1 -- 172.21.15.88:0/3507701445 shutdown_connections 2020-02-11T16:32:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.878+0000 7fa2d8f56700 1 --2- 172.21.15.88:0/3507701445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b80044d0 0x7fa2b8004950 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.878+0000 7fa2d8f56700 1 -- 172.21.15.88:0/3507701445 >> 172.21.15.88:0/3507701445 conn(0x7fa2d409d110 msgr2=0x7fa2d409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.878+0000 7fa2d8f56700 1 -- 172.21.15.88:0/3507701445 shutdown_connections 2020-02-11T16:32:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.878+0000 7fa2d8f56700 1 -- 172.21.15.88:0/3507701445 wait complete. 2020-02-11T16:32:57.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.879+0000 7fa2d8f56700 1 Processor -- start 2020-02-11T16:32:57.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.879+0000 7fa2d8f56700 1 -- start start 2020-02-11T16:32:57.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.879+0000 7fa2d8f56700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2d4145bc0 0x7fa2d40a31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.879+0000 7fa2d8f56700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40a4780 con 0x7fa2d4136670 2020-02-11T16:32:57.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.879+0000 7fa2d8f56700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40a17d0 con 0x7fa2b80044d0 2020-02-11T16:32:57.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.879+0000 7fa2d8f56700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40a1a70 con 0x7fa2d4145bc0 2020-02-11T16:32:57.898 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.879+0000 7fa2d2d9d700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2d4145bc0 msgr2=0x7fa2d40a31d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:57.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.879+0000 7fa2d259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa2b80044d0 0x7fa2d41454b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49560/0 (socket says 172.21.15.88:49560) 2020-02-11T16:32:57.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.879+0000 7fa2d259c700 1 -- 172.21.15.88:0/4125364035 learned_addr learned my addr 172.21.15.88:0/4125364035 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:57.899 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.879+0000 7fa2d2d9d700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2d4145bc0 0x7fa2d40a31d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:57.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083268978 0 0) 0x7fa2d40a17d0 con 0x7fa2b80044d0 2020-02-11T16:32:57.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2b0002fe0 con 0x7fa2b80044d0 2020-02-11T16:32:57.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275521793 0 0) 0x7fa2d40a4780 con 0x7fa2d4136670 2020-02-11T16:32:57.900 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d40a17d0 con 0x7fa2d4136670 2020-02-11T16:32:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1100075239 0 0) 0x7fa2b0002fe0 con 0x7fa2b80044d0 2020-02-11T16:32:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 --> v1:172.21.15.88:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2d40a4780 con 0x7fa2b80044d0 2020-02-11T16:32:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7fa2c80016d0 con 0x7fa2b80044d0 2020-02-11T16:32:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2d4145bc0 msgr2=0x7fa2d40a31d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2d4145bc0 0x7fa2d40a31d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 >> v1:172.21.15.88:6789/0 conn(0x7fa2b80044d0 legacy=0x7fa2d41454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 >> v1:172.21.15.52:6789/0 conn(0x7fa2d4136670 legacy=0x7fa2d412bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b0004b20 0x7fa2b0004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2d4145bc0 0x7fa2b0004370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40a1a70 con 0x7fa2b0004b20 2020-02-11T16:32:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00047d0 con 0x7fa2b0003ab0 2020-02-11T16:32:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0004960 con 0x7fa2d4145bc0 2020-02-11T16:32:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d2d9d700 1 -- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2d4145bc0 msgr2=0x7fa2b0004370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d2d9d700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2d4145bc0 0x7fa2b0004370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b0004b20 0x7fa2b0004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 -- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2d4145bc0 msgr2=0x7fa2b0004370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa2d4145bc0 0x7fa2b0004370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 -- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b0004b20 msgr2=0x7fa2b0004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b0004b20 0x7fa2b0004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 -- 172.21.15.88:0/4125364035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40a1d10 con 0x7fa2b0003ab0 2020-02-11T16:32:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d8f56700 1 -- 172.21.15.88:0/4125364035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d40aa130 con 0x7fa2b0003ab0 2020-02-11T16:32:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2d40aa060 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d8f56700 1 -- 172.21.15.88:0/4125364035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d40a3390 con 0x7fa2b0003ab0 2020-02-11T16:32:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2d40aa060 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fa2d40aa060 tx=0x7fa2c4010080).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa2d40aa060 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2c4005ac0 con 0x7fa2b0003ab0 2020-02-11T16:32:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa2d40aa060 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa2d40aa060 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.880+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c4005c20 con 0x7fa2b0003ab0 2020-02-11T16:32:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.881+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2c400a180 con 0x7fa2b0003ab0 2020-02-11T16:32:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.881+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa2d40aa060 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.881+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7fa2c400a2e0 con 0x7fa2b0003ab0 2020-02-11T16:32:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.881+0000 7fa2d8f56700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 0x7fa2d4135b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.881+0000 7fa2d8f56700 1 -- 172.21.15.88:0/4125364035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d405e2f0 con 0x7fa2d412c960 2020-02-11T16:32:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.881+0000 7fa2d1d9b700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa2d40aa060 tx=0x7fa2c4010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.881+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 0x7fa2d4135b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2c37fe700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2b0042150 0x7fa2b0044610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fa2c4049930 con 0x7fa2b0003ab0 2020-02-11T16:32:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2d259c700 1 -- 172.21.15.88:0/4125364035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2d412cd70 con 0x7fa2d412c960 2020-02-11T16:32:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 0x7fa2d4135b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2d2d9d700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2b0042150 0x7fa2b0044610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 0x7fa2d4135b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 0x7fa2d4135b20 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 0x7fa2d4135b20 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2c800cdc0 con 0x7fa2d412c960 2020-02-11T16:32:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2d2d9d700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2b0042150 0x7fa2b0044610 crc :-1 s=READY pgs=599 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 0x7fa2d4135b20 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7662 (secure 0 0 0) 0x7fa2c800e160 con 0x7fa2d412c960 2020-02-11T16:32:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 msgr2=0x7fa2d4135b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2c37fe700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 0x7fa2d4135b20 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).stop 2020-02-11T16:32:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 msgr2=0x7fa2d4135b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2d2d9d700 1 -- 172.21.15.88:0/4125364035 reap_dead start 2020-02-11T16:32:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.882+0000 7fa2c37fe700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412c960 0x7fa2d4135b20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.890+0000 7fa2d8f56700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 0x7fa2d41452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.890+0000 7fa2d8f56700 1 -- 172.21.15.88:0/4125364035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40a1bb0 con 0x7fa2d412bed0 2020-02-11T16:32:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.891+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 0x7fa2d41452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.891+0000 7fa2d259c700 1 -- 172.21.15.88:0/4125364035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa2d40565b0 con 0x7fa2d412bed0 2020-02-11T16:32:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.891+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 0x7fa2d41452b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.891+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 0x7fa2d41452b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.891+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 0x7fa2d41452b0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.891+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 0x7fa2d41452b0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.891+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2c8004970 con 0x7fa2d412bed0 2020-02-11T16:32:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d259c700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 0x7fa2d41452b0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 <== mon.0 v2:172.21.15.52:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4011 (secure 0 0 0) 0x7fa2c8004ad0 con 0x7fa2d412bed0 2020-02-11T16:32:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 msgr2=0x7fa2d41452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2c37fe700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 0x7fa2d41452b0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7fa2c800fa60 tx=0x7fa2d40a11a0).stop 2020-02-11T16:32:57.925 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2c37fe700 1 -- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 msgr2=0x7fa2d41452b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2020-02-11T16:32:57.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2c37fe700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 0x7fa2d41452b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 -- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2b0042150 msgr2=0x7fa2b0044610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2b0042150 0x7fa2b0044610 crc :-1 s=READY pgs=599 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.926 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 -- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 msgr2=0x7fa2b0003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:57.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fa2d40aa060 tx=0x7fa2c4010080).stop 2020-02-11T16:32:57.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 -- 172.21.15.88:0/4125364035 shutdown_connections 2020-02-11T16:32:57.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fa2b0042150 0x7fa2b0044610 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b0003ab0 0x7fa2b0003f10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.927 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 --2- 172.21.15.88:0/4125364035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d412bed0 0x7fa2d41452b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:57.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 -- 172.21.15.88:0/4125364035 >> 172.21.15.88:0/4125364035 conn(0x7fa2d409d110 msgr2=0x7fa2d409e830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:57.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 -- 172.21.15.88:0/4125364035 shutdown_connections 2020-02-11T16:32:57.928 INFO:teuthology.orchestra.run.smithi088.stderr:2020-02-11T16:32:57.892+0000 7fa2d8f56700 1 -- 172.21.15.88:0/4125364035 wait complete. 2020-02-11T16:32:57.928 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2020-02-11T16:32:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2020-02-11T16:32:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 238, 2020-02-11T16:32:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2020-02-11T16:32:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2020-02-11T16:32:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2020-02-11T16:32:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2020-02-11T16:32:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958747315978244", 2020-02-11T16:32:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2020-02-11T16:32:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138292836696063", 2020-02-11T16:32:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2020-02-11T16:32:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2020-02-11T16:32:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2020-02-11T16:32:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2020-02-11T16:32:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2020-02-11T16:32:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2020-02-11T16:32:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "386cdcef-05ad-40b9-b029-1e37a6356c21", 2020-02-11T16:32:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2020-02-11T16:04:42.404721Z", 2020-02-11T16:32:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 15, 2020-02-11T16:32:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "octopus", 2020-02-11T16:32:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2020-02-11T16:32:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2020-02-11T16:32:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2020-02-11T16:32:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2020-02-11T16:32:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2020-02-11T16:32:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2020-02-11T16:32:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2020-02-11T16:32:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus" 2020-02-11T16:32:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2020-02-11T16:32:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2020-02-11T16:32:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2020-02-11T16:32:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2020-02-11T16:32:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3300", 2020-02-11T16:32:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789", 2020-02-11T16:32:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6789/0", 2020-02-11T16:32:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6789/0", 2020-02-11T16:32:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2020-02-11T16:32:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2020-02-11T16:32:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2020-02-11T16:32:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2020-02-11T16:32:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2020-02-11T16:32:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2020-02-11T16:32:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2020-02-11T16:32:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2020-02-11T16:32:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2020-02-11T16:32:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2020-02-11T16:32:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2020-02-11T16:32:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:3301", 2020-02-11T16:32:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2020-02-11T16:32:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790", 2020-02-11T16:32:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2020-02-11T16:32:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.52:6790/0", 2020-02-11T16:32:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.52:6790/0", 2020-02-11T16:32:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2020-02-11T16:32:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0 2020-02-11T16:32:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2020-02-11T16:32:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2020-02-11T16:32:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2020-02-11T16:32:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2020-02-11T16:32:57.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2020-02-11T16:32:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2020-02-11T16:32:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2020-02-11T16:32:57.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2020-02-11T16:32:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfb8ffadffff", 2020-02-11T16:32:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2020-02-11T16:32:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2020-02-11T16:32:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2020-02-11T16:32:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: } 2020-02-11T16:32:57.953 INFO:teuthology.orchestra.run.smithi088.stdout:} 2020-02-11T16:32:57.954 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2020-02-11T16:32:58.390 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:58.388+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:58.390 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:58.388+0000 7fc1f17fa700 1 -- 172.21.15.88:0/1272738571 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v46) v1 ==== 167+0+0 (secure 0 0 0) 0x7fc1e40323f0 con 0x7fc1f405ac40 2020-02-11T16:32:58.531 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:58.529+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc1f409ee40 con 0x7fc1f405ac40 2020-02-11T16:32:59.391 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.388+0000 7fc1f3fff700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.391 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.388+0000 7fc1f17fa700 1 -- 172.21.15.88:0/1272738571 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v47) v1 ==== 167+0+0 (secure 0 0 0) 0x7fc1e40325d0 con 0x7fc1f405ac40 2020-02-11T16:32:59.393 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.390+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1d8039c70 msgr2=0x7fc1d803c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:59.393 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.390+0000 7fc1f9e47700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1d8039c70 0x7fc1d803c130 crc :-1 s=READY pgs=594 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:59.393 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.390+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 msgr2=0x7fc1f41334d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:59.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.390+0000 7fc1f9e47700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7fc1f4121170 tx=0x7fc1f405fbb0).stop 2020-02-11T16:32:59.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.390+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 shutdown_connections 2020-02-11T16:32:59.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.390+0000 7fc1f9e47700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7fc1d8039c70 0x7fc1d803c130 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:59.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.390+0000 7fc1f9e47700 1 --2- 172.21.15.88:0/1272738571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f405ac40 0x7fc1f41334d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:59.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.390+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 >> 172.21.15.88:0/1272738571 conn(0x7fc1f405c170 msgr2=0x7fc1f4069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:59.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.391+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 shutdown_connections 2020-02-11T16:32:59.394 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.391+0000 7fc1f9e47700 1 -- 172.21.15.88:0/1272738571 wait complete. 2020-02-11T16:32:59.395 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:32:59.405 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:32:59.408 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/b 2020-02-11T16:32:59.411 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/a1 2020-02-11T16:32:59.422 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/b/.snap/b1 2020-02-11T16:32:59.429 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo asdf 2020-02-11T16:32:59.431 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/a2 2020-02-11T16:32:59.441 INFO:tasks.workunit.client.0.smithi088.stderr:+ ln a/b/foo a/b/bar 2020-02-11T16:32:59.445 INFO:tasks.workunit.client.0.smithi088.stdout:this should not hang... 2020-02-11T16:32:59.446 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 'this should not hang...' 2020-02-11T16:32:59.454 INFO:tasks.workunit.client.0.smithi088.stderr:+ cat a/b/.snap/_a2_1099511649647/foo 2020-02-11T16:32:59.457 INFO:tasks.workunit.client.0.smithi088.stdout:asdf 2020-02-11T16:32:59.458 INFO:tasks.workunit.client.0.smithi088.stdout:good, it did not hang. 2020-02-11T16:32:59.458 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 'good, it did not hang.' 2020-02-11T16:32:59.458 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/b/.snap/b1 2020-02-11T16:32:59.464 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/a1 2020-02-11T16:32:59.471 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/a2 2020-02-11T16:32:59.478 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -r a 2020-02-11T16:32:59.498 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:32:59.499 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:32:59.499 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:32:59.499 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:32:59.566 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-xattrwb.sh... 2020-02-11T16:32:59.567 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/snaptest-xattrwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-xattrwb.sh 2020-02-11T16:32:59.598 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -e 2020-02-11T16:32:59.598 INFO:tasks.workunit.client.0.smithi088.stderr:+ ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-02-11T16:32:59.691 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.682+0000 7f94b3abd700 1 Processor -- start 2020-02-11T16:32:59.691 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.682+0000 7f94b3abd700 1 -- start start 2020-02-11T16:32:59.691 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.683+0000 7f94b3abd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac05ac40 0x7f94ac0a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:59.691 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.683+0000 7f94b3abd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f94ac0a14c0 0x7f94ac099890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:59.692 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.683+0000 7f94b3abd700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac0a37e0 con 0x7f94ac099cf0 2020-02-11T16:32:59.692 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.683+0000 7f94b3abd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac0a24e0 con 0x7f94ac0a14c0 2020-02-11T16:32:59.692 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.683+0000 7f94b3abd700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0a4350 con 0x7f94ac05ac40 2020-02-11T16:32:59.692 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.683+0000 7f94b285b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f94ac099cf0 0x7f94ac0a6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49582/0 (socket says 172.21.15.88:49582) 2020-02-11T16:32:59.692 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.683+0000 7f94b285b700 1 -- 172.21.15.88:0/3556595902 learned_addr learned my addr 172.21.15.88:0/3556595902 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:59.692 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.683+0000 7f94b205a700 1 -- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac05ac40 msgr2=0x7f94ac0a2da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:59.692 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.683+0000 7f94b205a700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac05ac40 0x7f94ac0a2da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:59.693 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310391701 0 0) 0x7f94ac0a37e0 con 0x7f94ac099cf0 2020-02-11T16:32:59.693 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9498003230 con 0x7f94ac099cf0 2020-02-11T16:32:59.693 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1859700 1 --2- 172.21.15.88:0/3556595902 >> v2:172.21.15.52:3300/0 conn(0x7f94ac0a14c0 0x7f94ac099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:59.693 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3093697937 0 0) 0x7f9498003230 con 0x7f94ac099cf0 2020-02-11T16:32:59.693 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac05ac40 msgr2=0x7f94ac0a2da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:59.693 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac05ac40 0x7f94ac0a2da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:59.693 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 >> v2:172.21.15.52:3300/0 conn(0x7f94ac0a14c0 msgr2=0x7f94ac099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:59.694 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 --2- 172.21.15.88:0/3556595902 >> v2:172.21.15.52:3300/0 conn(0x7f94ac0a14c0 0x7f94ac099890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:59.694 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac0a26d0 con 0x7f94ac099cf0 2020-02-11T16:32:59.694 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3084400708 0 0) 0x7f94a40016d0 con 0x7f94ac099cf0 2020-02-11T16:32:59.694 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 >> v1:172.21.15.88:6789/0 conn(0x7f94ac099cf0 legacy=0x7f94ac0a6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:59.694 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac05ac40 0x7f9498003770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:59.694 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9498003bf0 0x7f94980044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:59.694 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b205a700 1 -- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac05ac40 msgr2=0x7f9498003770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:59.695 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b205a700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac05ac40 0x7f9498003770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:59.695 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9498004930 0x7f9498004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:32:59.695 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0a4350 con 0x7f9498003bf0 2020-02-11T16:32:59.695 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9498004130 con 0x7f9498004930 2020-02-11T16:32:59.695 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94980042f0 con 0x7f94ac05ac40 2020-02-11T16:32:59.695 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9498004930 0x7f9498004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:59.695 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1859700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9498003bf0 0x7f94980044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:59.696 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 -- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac05ac40 msgr2=0x7f9498003770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:32:59.696 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac05ac40 0x7f9498003770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:59.696 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 -- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9498003bf0 msgr2=0x7f94980044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:32:59.696 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9498003bf0 0x7f94980044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:32:59.696 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 -- 172.21.15.88:0/3556595902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498003230 con 0x7f9498004930 2020-02-11T16:32:59.696 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9498004930 0x7f9498004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f94a40013e0 tx=0x7f94ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.696 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9498004930 0x7f9498004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f94a40013e0 tx=0x7f94ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.697 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9498004930 0x7f9498004db0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f94a40013e0 tx=0x7f94ac05fbb0).ready entity=mon.1 client_cookie=a102ae1ae9e15a8 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:59.697 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9498004930 0x7f9498004db0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f94a40013e0 tx=0x7f94ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.697 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9498004930 0x7f9498004db0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f94a40013e0 tx=0x7f94ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.697 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94a400e160 con 0x7f9498004930 2020-02-11T16:32:59.697 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9498004930 0x7f9498004db0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f94a40013e0 tx=0x7f94ac05fbb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.698 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a400e2c0 con 0x7f9498004930 2020-02-11T16:32:59.698 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b1058700 1 -- 172.21.15.88:0/3556595902 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94a400e660 con 0x7f9498004930 2020-02-11T16:32:59.698 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b3abd700 1 -- 172.21.15.88:0/3556595902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9498004930 msgr2=0x7f9498004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:59.698 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b3abd700 1 --2- 172.21.15.88:0/3556595902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9498004930 0x7f9498004db0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f94a40013e0 tx=0x7f94ac05fbb0).stop 2020-02-11T16:32:59.698 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.684+0000 7f94b285b700 1 -- 172.21.15.88:0/3556595902 reap_dead start 2020-02-11T16:32:59.698 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.685+0000 7f94b3abd700 1 -- 172.21.15.88:0/3556595902 shutdown_connections 2020-02-11T16:32:59.698 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.685+0000 7f94b3abd700 1 -- 172.21.15.88:0/3556595902 >> 172.21.15.88:0/3556595902 conn(0x7f94ac05c170 msgr2=0x7f94ac05a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:32:59.699 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.685+0000 7f94b3abd700 1 -- 172.21.15.88:0/3556595902 shutdown_connections 2020-02-11T16:32:59.699 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.685+0000 7f94b3abd700 1 -- 172.21.15.88:0/3556595902 wait complete. 2020-02-11T16:32:59.699 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.686+0000 7f94b3abd700 1 Processor -- start 2020-02-11T16:32:59.699 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.686+0000 7f94b3abd700 1 -- start start 2020-02-11T16:32:59.699 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b3abd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94ac135070 0x7f94ac09fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:59.699 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b3abd700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac0a0230 0x7f94ac0a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:59.699 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b3abd700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac134690 con 0x7f94ac120d00 2020-02-11T16:32:59.700 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b3abd700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac134930 con 0x7f94ac135070 2020-02-11T16:32:59.700 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b3abd700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac1210e0 con 0x7f94ac0a0230 2020-02-11T16:32:59.700 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b285b700 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac0a0230 msgr2=0x7f94ac0a06c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:32:59.700 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b285b700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac0a0230 0x7f94ac0a06c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:32:59.700 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b205a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f94ac120d00 0x7f94ac122540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49590/0 (socket says 172.21.15.88:49590) 2020-02-11T16:32:59.702 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b205a700 1 -- 172.21.15.88:0/81269890 learned_addr learned my addr 172.21.15.88:0/81269890 (peer_addr_for_me v1:172.21.15.88:0/0) 2020-02-11T16:32:59.702 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> v2:172.21.15.88:3300/0 conn(0x7f94ac135070 0x7f94ac09fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:59.702 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 -- 172.21.15.88:0/81269890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac0a0230 msgr2=0x7f94ac0a06c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-02-11T16:32:59.702 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac0a0230 0x7f94ac0a06c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:32:59.702 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 -- 172.21.15.88:0/81269890 >> v1:172.21.15.88:6789/0 conn(0x7f94ac120d00 legacy=0x7f94ac122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:32:59.702 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 -- 172.21.15.88:0/81269890 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac0a2f70 con 0x7f94ac135070 2020-02-11T16:32:59.703 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94a2ffd700 1 -- 172.21.15.88:0/81269890 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372198273 0 0) 0x7f94ac134690 con 0x7f94ac120d00 2020-02-11T16:32:59.703 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> v2:172.21.15.88:3300/0 conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.703 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> v2:172.21.15.88:3300/0 conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.703 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:59.703 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.703 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94a2ffd700 1 -- 172.21.15.88:0/81269890 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f949c005e90 con 0x7f94ac135070 2020-02-11T16:32:59.704 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.704 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.704 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94a2ffd700 1 -- 172.21.15.88:0/81269890 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c007160 con 0x7f94ac135070 2020-02-11T16:32:59.704 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac122c50 con 0x7f94ac135070 2020-02-11T16:32:59.704 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94a2ffd700 1 -- 172.21.15.88:0/81269890 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f949c007540 con 0x7f94ac135070 2020-02-11T16:32:59.704 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.687+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac0a0b20 con 0x7f94ac135070 2020-02-11T16:32:59.704 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.688+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.705 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.688+0000 7f94a2ffd700 1 -- 172.21.15.88:0/81269890 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f949c008970 con 0x7f94ac135070 2020-02-11T16:32:59.705 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.688+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.705 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.688+0000 7f94a2ffd700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f949403bc80 0x7f949403e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:32:59.705 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.688+0000 7f94a2ffd700 1 -- 172.21.15.88:0/81269890 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f949c049ae0 con 0x7f94ac135070 2020-02-11T16:32:59.705 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.688+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac0565b0 con 0x7f94ac135070 2020-02-11T16:32:59.705 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.689+0000 7f94b205a700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f949403bc80 0x7f949403e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:32:59.705 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.689+0000 7f94b205a700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f949403bc80 0x7f949403e140 crc :-1 s=READY pgs=600 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:32:59.706 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.692+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:32:59.706 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.692+0000 7f94a2ffd700 1 -- 172.21.15.88:0/81269890 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f949c02f140 con 0x7f94ac135070 2020-02-11T16:32:59.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:32:59.878+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f94ac05e8e0 con 0x7f94ac135070 2020-02-11T16:33:00.506 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:00.504+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:00.506 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:00.504+0000 7f94a2ffd700 1 -- 172.21.15.88:0/81269890 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v48) v1 ==== 167+0+0 (secure 0 0 0) 0x7f949c031c30 con 0x7f94ac135070 2020-02-11T16:33:00.654 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:00.653+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f94ac05eaf0 con 0x7f94ac135070 2020-02-11T16:33:01.508 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.507+0000 7f94b1859700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.509 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.507+0000 7f94a2ffd700 1 -- 172.21.15.88:0/81269890 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v49) v1 ==== 167+0+0 (secure 0 0 0) 0x7f949c032070 con 0x7f94ac135070 2020-02-11T16:33:01.511 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f949403bc80 msgr2=0x7f949403e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:33:01.511 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f949403bc80 0x7f949403e140 crc :-1 s=READY pgs=600 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:33:01.511 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 msgr2=0x7f94ac09fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:33:01.511 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f949c002f30 tx=0x7f949c010c20).stop 2020-02-11T16:33:01.511 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 shutdown_connections 2020-02-11T16:33:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f949403bc80 0x7f949403e140 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:33:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f94ac0a0230 0x7f94ac0a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:33:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 --2- 172.21.15.88:0/81269890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94ac135070 0x7f94ac09fdd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:33:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 >> 172.21.15.88:0/81269890 conn(0x7f94ac05c170 msgr2=0x7f94ac0a6290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:33:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 shutdown_connections 2020-02-11T16:33:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.509+0000 7f94b3abd700 1 -- 172.21.15.88:0/81269890 wait complete. 2020-02-11T16:33:01.513 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:33:01.521 INFO:tasks.workunit.client.0.smithi088.stdout:testing simple xattr wb 2020-02-11T16:33:01.522 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 'testing simple xattr wb' 2020-02-11T16:33:01.522 INFO:tasks.workunit.client.0.smithi088.stderr:+ touch x 2020-02-11T16:33:01.526 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr -n user.foo x 2020-02-11T16:33:01.543 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir .snap/s1 2020-02-11T16:33:01.560 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep user.foo 2020-02-11T16:33:01.560 INFO:tasks.workunit.client.0.smithi088.stderr:+ getfattr -n user.foo .snap/s1/x 2020-02-11T16:33:01.566 INFO:tasks.workunit.client.0.smithi088.stdout:user.foo="" 2020-02-11T16:33:01.567 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm x 2020-02-11T16:33:01.569 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir .snap/s1 2020-02-11T16:33:01.582 INFO:tasks.workunit.client.0.smithi088.stdout:testing wb with pre-wb server cow 2020-02-11T16:33:01.582 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo 'testing wb with pre-wb server cow' 2020-02-11T16:33:01.582 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a 2020-02-11T16:33:01.583 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/b 2020-02-11T16:33:01.586 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/b/c 2020-02-11T16:33:01.588 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr -n user.foo a/b 2020-02-11T16:33:01.590 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/.snap/s 2020-02-11T16:33:01.601 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir a/b/cc 2020-02-11T16:33:01.603 INFO:tasks.workunit.client.0.smithi088.stderr:+ getfattr -n user.foo a/b 2020-02-11T16:33:01.604 INFO:tasks.workunit.client.0.smithi088.stdout:# file: a/b 2020-02-11T16:33:01.604 INFO:tasks.workunit.client.0.smithi088.stdout:user.foo="" 2020-02-11T16:33:01.605 INFO:tasks.workunit.client.0.smithi088.stdout: 2020-02-11T16:33:01.605 INFO:tasks.workunit.client.0.smithi088.stderr:+ getfattr -n user.foo a/.snap/s/b 2020-02-11T16:33:01.605 INFO:tasks.workunit.client.0.smithi088.stderr:+ grep user.foo 2020-02-11T16:33:01.613 INFO:tasks.workunit.client.0.smithi088.stdout:user.foo="" 2020-02-11T16:33:01.613 INFO:tasks.workunit.client.0.smithi088.stderr:+ rmdir a/.snap/s 2020-02-11T16:33:01.620 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -r a 2020-02-11T16:33:01.642 INFO:tasks.workunit.client.0.smithi088.stdout:OK 2020-02-11T16:33:01.642 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK 2020-02-11T16:33:01.643 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-11T16:33:01.643 INFO:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-11T16:33:01.718 INFO:tasks.workunit:Running workunit fs/snaps/untar_snap_rm.sh... 2020-02-11T16:33:01.718 INFO:teuthology.orchestra.run.smithi088:workunit test fs/snaps/untar_snap_rm.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71281e48a442b0f38f812cad32658ed72c6d8ff5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh 2020-02-11T16:33:01.871 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.863+0000 7f781a199700 1 Processor -- start 2020-02-11T16:33:01.872 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f781a199700 1 -- start start 2020-02-11T16:33:01.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f781a199700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 0x7f78140a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:33:01.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f781a199700 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78140a14c0 0x7f7814099890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:33:01.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f781a199700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7814099cf0 0x7f781409a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-11T16:33:01.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f781a199700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78140a24e0 con 0x7f781405ac40 2020-02-11T16:33:01.873 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f781a199700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78140a4350 con 0x7f7814099cf0 2020-02-11T16:33:01.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f781a199700 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78140a37e0 con 0x7f78140a14c0 2020-02-11T16:33:01.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f7818f37700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7814099cf0 0x7f781409a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:33:01.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f7818f37700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7814099cf0 0x7f781409a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33740/0 (socket says 172.21.15.88:33740) 2020-02-11T16:33:01.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f7818f37700 1 -- 172.21.15.88:0/3771214278 learned_addr learned my addr 172.21.15.88:0/3771214278 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:33:01.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f780bfff700 1 -- 172.21.15.88:0/3771214278 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78140a14c0 msgr2=0x7f7814099890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2020-02-11T16:33:01.874 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f780bfff700 1 --2- 172.21.15.88:0/3771214278 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78140a14c0 0x7f7814099890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-11T16:33:01.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f7818f37700 1 -- 172.21.15.88:0/3771214278 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78140a14c0 msgr2=0x7f7814099890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-11T16:33:01.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f7818f37700 1 --2- 172.21.15.88:0/3771214278 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78140a14c0 0x7f7814099890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:33:01.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f7813fff700 1 --2- 172.21.15.88:0/3771214278 >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 0x7f78140a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:33:01.875 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.864+0000 7f7818f37700 1 -- 172.21.15.88:0/3771214278 >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 msgr2=0x7f78140a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-11T16:33:01.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f7818f37700 1 --2- 172.21.15.88:0/3771214278 >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 0x7f78140a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:33:01.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f7818f37700 1 -- 172.21.15.88:0/3771214278 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78140a26d0 con 0x7f7814099cf0 2020-02-11T16:33:01.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f7818f37700 1 --2- 172.21.15.88:0/3771214278 >> v2:172.21.15.88:3300/0 conn(0x7f7814099cf0 0x7f781409a130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f7818f37700 1 --2- 172.21.15.88:0/3771214278 >> v2:172.21.15.88:3300/0 conn(0x7f7814099cf0 0x7f781409a130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f7818f37700 1 --2- 172.21.15.88:0/3771214278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7814099cf0 0x7f781409a130 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).ready entity=mon.1 client_cookie=f95e0f0a36e68a76 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:33:01.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f7818f37700 1 --2- 172.21.15.88:0/3771214278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7814099cf0 0x7f781409a130 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.876 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f78137fe700 1 -- 172.21.15.88:0/3771214278 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f780c011e90 con 0x7f7814099cf0 2020-02-11T16:33:01.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f7818f37700 1 --2- 172.21.15.88:0/3771214278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7814099cf0 0x7f781409a130 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f7818f37700 1 --2- 172.21.15.88:0/3771214278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7814099cf0 0x7f781409a130 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f78137fe700 1 -- 172.21.15.88:0/3771214278 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c00a350 con 0x7f7814099cf0 2020-02-11T16:33:01.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f78137fe700 1 -- 172.21.15.88:0/3771214278 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f780c00a6f0 con 0x7f7814099cf0 2020-02-11T16:33:01.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f781a199700 1 -- 172.21.15.88:0/3771214278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7814099cf0 msgr2=0x7f781409a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:33:01.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f781a199700 1 --2- 172.21.15.88:0/3771214278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7814099cf0 0x7f781409a130 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).stop 2020-02-11T16:33:01.877 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f781a199700 1 -- 172.21.15.88:0/3771214278 shutdown_connections 2020-02-11T16:33:01.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f781a199700 1 --2- 172.21.15.88:0/3771214278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7814099cf0 0x7f781409a130 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:33:01.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f781a199700 1 --2- 172.21.15.88:0/3771214278 >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 0x7f78140a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:33:01.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f781a199700 1 --2- 172.21.15.88:0/3771214278 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78140a14c0 0x7f7814099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-11T16:33:01.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f781a199700 1 -- 172.21.15.88:0/3771214278 >> 172.21.15.88:0/3771214278 conn(0x7f781405c170 msgr2=0x7f781405a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:33:01.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f781a199700 1 -- 172.21.15.88:0/3771214278 shutdown_connections 2020-02-11T16:33:01.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.865+0000 7f781a199700 1 -- 172.21.15.88:0/3771214278 wait complete. 2020-02-11T16:33:01.878 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.866+0000 7f781a199700 1 Processor -- start 2020-02-11T16:33:01.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.866+0000 7f781a199700 1 -- start start 2020-02-11T16:33:01.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f781a199700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 0x7f7814063190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:33:01.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f781a199700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f78140a14c0 0x7f7814132c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:33:01.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f781a199700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78140a1c50 con 0x7f7814099cf0 2020-02-11T16:33:01.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f781a199700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7814064dd0 con 0x7f781405ac40 2020-02-11T16:33:01.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f781a199700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7814064fc0 con 0x7f78140a14c0 2020-02-11T16:33:01.879 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7818f37700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f78140a14c0 0x7f7814132c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:33:01.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7818f37700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f78140a14c0 0x7f7814132c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33750/0 (socket says 172.21.15.88:33750) 2020-02-11T16:33:01.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7818f37700 1 -- 172.21.15.88:0/2755309716 learned_addr learned my addr 172.21.15.88:0/2755309716 (peer_addr_for_me v2:172.21.15.88:0/0) 2020-02-11T16:33:01.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f780bfff700 1 --1- 172.21.15.88:0/2755309716 >> v1:172.21.15.88:6789/0 conn(0x7f7814099cf0 0x7f7814132510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49606/0 (socket says 172.21.15.88:49606) 2020-02-11T16:33:01.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7813fff700 1 --2- 172.21.15.88:0/2755309716 >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 0x7f7814063190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:33:01.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7818f37700 1 -- 172.21.15.88:0/2755309716 >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 msgr2=0x7f7814063190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:33:01.880 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 0x7f7814063190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:33:01.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7818f37700 1 -- 172.21.15.88:0/2755309716 >> v1:172.21.15.88:6789/0 conn(0x7f7814099cf0 legacy=0x7f7814132510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:33:01.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7818f37700 1 -- 172.21.15.88:0/2755309716 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814065260 con 0x7f78140a14c0 2020-02-11T16:33:01.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7813fff700 1 --2- 172.21.15.88:0/2755309716 >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 0x7f7814063190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-11T16:33:01.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> v2:172.21.15.88:3300/0 conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.881 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.867+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> v2:172.21.15.88:3300/0 conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:33:01.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f78117fa700 1 -- 172.21.15.88:0/2755309716 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f780c010640 con 0x7f78140a14c0 2020-02-11T16:33:01.882 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f78117fa700 1 -- 172.21.15.88:0/2755309716 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c005c30 con 0x7f78140a14c0 2020-02-11T16:33:01.883 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7814065500 con 0x7f78140a14c0 2020-02-11T16:33:01.883 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f78117fa700 1 -- 172.21.15.88:0/2755309716 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f780c007150 con 0x7f78140a14c0 2020-02-11T16:33:01.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7814099aa0 con 0x7f78140a14c0 2020-02-11T16:33:01.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f78117fa700 1 -- 172.21.15.88:0/2755309716 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45157+0+0 (secure 0 0 0) 0x7f780c0072b0 con 0x7f78140a14c0 2020-02-11T16:33:01.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.868+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.869+0000 7f78117fa700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77f8039b50 0x7f77f803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-11T16:33:01.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.869+0000 7f78117fa700 1 -- 172.21.15.88:0/2755309716 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f780c04a8e0 con 0x7f78140a14c0 2020-02-11T16:33:01.884 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.869+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7814062fe0 con 0x7f78140a14c0 2020-02-11T16:33:01.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.869+0000 7f7813fff700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77f8039b50 0x7f77f803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-11T16:33:01.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.869+0000 7f7813fff700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77f8039b50 0x7f77f803c010 crc :-1 s=READY pgs=601 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-11T16:33:01.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.872+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:01.885 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:01.872+0000 7f78117fa700 1 -- 172.21.15.88:0/2755309716 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f780c032ed0 con 0x7f78140a14c0 2020-02-11T16:33:02.054 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:02.053+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f78140565b0 con 0x7f78140a14c0 2020-02-11T16:33:02.514 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:02.512+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:02.514 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:02.512+0000 7f78117fa700 1 -- 172.21.15.88:0/2755309716 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v50) v1 ==== 167+0+0 (secure 0 0 0) 0x7f780c032a90 con 0x7f78140a14c0 2020-02-11T16:33:02.657 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:02.656+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f78140a8330 con 0x7f78140a14c0 2020-02-11T16:33:03.518 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.516+0000 7f7818f37700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-11T16:33:03.518 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.516+0000 7f78117fa700 1 -- 172.21.15.88:0/2755309716 <== mon.1 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v51) v1 ==== 167+0+0 (secure 0 0 0) 0x7f780c0344e0 con 0x7f78140a14c0 2020-02-11T16:33:03.520 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.518+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77f8039b50 msgr2=0x7f77f803c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:33:03.520 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.518+0000 7f781a199700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77f8039b50 0x7f77f803c010 crc :-1 s=READY pgs=601 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:33:03.520 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.518+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 msgr2=0x7f7814132c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-11T16:33:03.521 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.518+0000 7f781a199700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f780c0032b0 tx=0x7f780c007dc0).stop 2020-02-11T16:33:03.521 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.518+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 shutdown_connections 2020-02-11T16:33:03.521 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.518+0000 7f781a199700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78140a14c0 0x7f7814132c20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:33:03.521 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.518+0000 7f781a199700 1 --2- 172.21.15.88:0/2755309716 >> [v2:172.21.15.52:6800/30001,v1:172.21.15.52:6801/30001] conn(0x7f77f8039b50 0x7f77f803c010 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:33:03.521 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.518+0000 7f781a199700 1 --2- 172.21.15.88:0/2755309716 >> v2:172.21.15.52:3300/0 conn(0x7f781405ac40 0x7f7814063190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-11T16:33:03.521 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.518+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 >> 172.21.15.88:0/2755309716 conn(0x7f781405c170 msgr2=0x7f78140a96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-11T16:33:03.522 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.519+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 shutdown_connections 2020-02-11T16:33:03.522 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11T16:33:03.519+0000 7f781a199700 1 -- 172.21.15.88:0/2755309716 wait complete. 2020-02-11T16:33:03.522 INFO:tasks.workunit.client.0.smithi088.stderr:enabled new snapshots 2020-02-11T16:33:03.537 INFO:tasks.workunit.client.0.smithi088.stderr:--2020-02-11 16:33:03-- http://download.ceph.com/qa/coreutils_8.5.orig.tar.gz 2020-02-11T16:33:03.537 INFO:tasks.workunit.client.0.smithi088.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2020-02-11T16:33:03.556 INFO:tasks.workunit.client.0.smithi088.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2020-02-11T16:33:03.576 INFO:tasks.workunit.client.0.smithi088.stderr:HTTP request sent, awaiting response... 200 OK 2020-02-11T16:33:03.576 INFO:tasks.workunit.client.0.smithi088.stderr:Length: 10740866 (10M) [application/octet-stream] 2020-02-11T16:33:03.578 INFO:tasks.workunit.client.0.smithi088.stderr:Saving to: ‘coreutils_8.5.orig.tar.gz’ 2020-02-11T16:33:03.579 INFO:tasks.workunit.client.0.smithi088.stderr: 2020-02-11T16:33:03.618 INFO:tasks.workunit.client.0.smithi088.stderr: 0K .......... .......... .......... .......... .......... 0% 1.30M 8s 2020-02-11T16:33:03.646 INFO:tasks.workunit.client.0.smithi088.stderr: 50K .......... .......... .......... .......... .......... 0% 2.49M 6s 2020-02-11T16:33:03.646 INFO:tasks.workunit.client.0.smithi088.stderr: 100K .......... .......... .......... .......... .......... 1% 28.6M 4s 2020-02-11T16:33:03.646 INFO:tasks.workunit.client.0.smithi088.stderr: 150K .......... .......... .......... .......... .......... 1% 29.4M 3s 2020-02-11T16:33:03.658 INFO:tasks.workunit.client.0.smithi088.stderr: 200K .......... .......... .......... .......... .......... 2% 2.71M 3s 2020-02-11T16:33:03.659 INFO:tasks.workunit.client.0.smithi088.stderr: 250K .......... .......... .......... .......... .......... 2% 30.0M 3s 2020-02-11T16:33:03.661 INFO:tasks.workunit.client.0.smithi088.stderr: 300K .......... .......... .......... .......... .......... 3% 34.8M 2s 2020-02-11T16:33:03.677 INFO:tasks.workunit.client.0.smithi088.stderr: 350K .......... .......... .......... .......... .......... 3% 3.01M 2s 2020-02-11T16:33:03.679 INFO:tasks.workunit.client.0.smithi088.stderr: 400K .......... .......... .......... .......... .......... 4% 29.7M 2s 2020-02-11T16:33:03.680 INFO:tasks.workunit.client.0.smithi088.stderr: 450K .......... .......... .......... .......... .......... 4% 34.5M 2s 2020-02-11T16:33:03.681 INFO:tasks.workunit.client.0.smithi088.stderr: 500K .......... .......... .......... .......... .......... 5% 35.2M 2s 2020-02-11T16:33:03.683 INFO:tasks.workunit.client.0.smithi088.stderr: 550K .......... .......... .......... .......... .......... 5% 29.3M 2s 2020-02-11T16:33:03.684 INFO:tasks.workunit.client.0.smithi088.stderr: 600K .......... .......... .......... .......... .......... 6% 34.1M 2s 2020-02-11T16:33:03.686 INFO:tasks.workunit.client.0.smithi088.stderr: 650K .......... .......... .......... .......... .......... 6% 33.5M 1s 2020-02-11T16:33:03.687 INFO:tasks.workunit.client.0.smithi088.stderr: 700K .......... .......... .......... .......... .......... 7% 33.0M 1s 2020-02-11T16:33:03.697 INFO:tasks.workunit.client.0.smithi088.stderr: 750K .......... .......... .......... .......... .......... 7% 5.24M 1s 2020-02-11T16:33:03.699 INFO:tasks.workunit.client.0.smithi088.stderr: 800K .......... .......... .......... .......... .......... 8% 27.1M 1s 2020-02-11T16:33:03.700 INFO:tasks.workunit.client.0.smithi088.stderr: 850K .......... .......... .......... .......... .......... 8% 37.1M 1s 2020-02-11T16:33:03.702 INFO:tasks.workunit.client.0.smithi088.stderr: 900K .......... .......... .......... .......... .......... 9% 37.2M 1s 2020-02-11T16:33:03.703 INFO:tasks.workunit.client.0.smithi088.stderr: 950K .......... .......... .......... .......... .......... 9% 32.3M 1s 2020-02-11T16:33:03.704 INFO:tasks.workunit.client.0.smithi088.stderr: 1000K .......... .......... .......... .......... .......... 10% 37.5M 1s 2020-02-11T16:33:03.705 INFO:tasks.workunit.client.0.smithi088.stderr: 1050K .......... .......... .......... .......... .......... 10% 35.9M 1s 2020-02-11T16:33:03.707 INFO:tasks.workunit.client.0.smithi088.stderr: 1100K .......... .......... .......... .......... .......... 10% 36.0M 1s 2020-02-11T16:33:03.709 INFO:tasks.workunit.client.0.smithi088.stderr: 1150K .......... .......... .......... .......... .......... 11% 30.5M 1s 2020-02-11T16:33:03.710 INFO:tasks.workunit.client.0.smithi088.stderr: 1200K .......... .......... .......... .......... .......... 11% 34.4M 1s 2020-02-11T16:33:03.712 INFO:tasks.workunit.client.0.smithi088.stderr: 1250K .......... .......... .......... .......... .......... 12% 35.3M 1s 2020-02-11T16:33:03.713 INFO:tasks.workunit.client.0.smithi088.stderr: 1300K .......... .......... .......... .......... .......... 12% 33.8M 1s 2020-02-11T16:33:03.714 INFO:tasks.workunit.client.0.smithi088.stderr: 1350K .......... .......... .......... .......... .......... 13% 29.8M 1s 2020-02-11T16:33:03.716 INFO:tasks.workunit.client.0.smithi088.stderr: 1400K .......... .......... .......... .......... .......... 13% 33.0M 1s 2020-02-11T16:33:03.717 INFO:tasks.workunit.client.0.smithi088.stderr: 1450K .......... .......... .......... .......... .......... 14% 33.2M 1s 2020-02-11T16:33:03.719 INFO:tasks.workunit.client.0.smithi088.stderr: 1500K .......... .......... .......... .......... .......... 14% 32.4M 1s 2020-02-11T16:33:03.721 INFO:tasks.workunit.client.0.smithi088.stderr: 1550K .......... .......... .......... .......... .......... 15% 28.2M 1s 2020-02-11T16:33:03.722 INFO:tasks.workunit.client.0.smithi088.stderr: 1600K .......... .......... .......... .......... .......... 15% 32.6M 1s 2020-02-11T16:33:03.723 INFO:tasks.workunit.client.0.smithi088.stderr: 1650K .......... .......... .......... .......... .......... 16% 32.3M 1s 2020-02-11T16:33:03.725 INFO:tasks.workunit.client.0.smithi088.stderr: 1700K .......... .......... .......... .......... .......... 16% 28.0M 1s 2020-02-11T16:33:03.727 INFO:tasks.workunit.client.0.smithi088.stderr: 1750K .......... .......... .......... .......... .......... 17% 33.0M 1s 2020-02-11T16:33:03.728 INFO:tasks.workunit.client.0.smithi088.stderr: 1800K .......... .......... .......... .......... .......... 17% 37.4M 1s 2020-02-11T16:33:03.729 INFO:tasks.workunit.client.0.smithi088.stderr: 1850K .......... .......... .......... .......... .......... 18% 34.5M 1s 2020-02-11T16:33:03.731 INFO:tasks.workunit.client.0.smithi088.stderr: 1900K .......... .......... .......... .......... .......... 18% 37.0M 1s 2020-02-11T16:33:03.733 INFO:tasks.workunit.client.0.smithi088.stderr: 1950K .......... .......... .......... .......... .......... 19% 30.2M 1s 2020-02-11T16:33:03.734 INFO:tasks.workunit.client.0.smithi088.stderr: 2000K .......... .......... .......... .......... .......... 19% 35.9M 1s 2020-02-11T16:33:03.735 INFO:tasks.workunit.client.0.smithi088.stderr: 2050K .......... .......... .......... .......... .......... 20% 33.6M 1s 2020-02-11T16:33:03.737 INFO:tasks.workunit.client.0.smithi088.stderr: 2100K .......... .......... .......... .......... .......... 20% 28.2M 1s 2020-02-11T16:33:03.738 INFO:tasks.workunit.client.0.smithi088.stderr: 2150K .......... .......... .......... .......... .......... 20% 27.6M 1s 2020-02-11T16:33:03.740 INFO:tasks.workunit.client.0.smithi088.stderr: 2200K .......... .......... .......... .......... .......... 21% 35.2M 1s 2020-02-11T16:33:03.741 INFO:tasks.workunit.client.0.smithi088.stderr: 2250K .......... .......... .......... .......... .......... 21% 33.5M 1s 2020-02-11T16:33:03.743 INFO:tasks.workunit.client.0.smithi088.stderr: 2300K .......... .......... .......... .......... .......... 22% 35.7M 1s 2020-02-11T16:33:03.744 INFO:tasks.workunit.client.0.smithi088.stderr: 2350K .......... .......... .......... .......... .......... 22% 29.5M 1s 2020-02-11T16:33:03.746 INFO:tasks.workunit.client.0.smithi088.stderr: 2400K .......... .......... .......... .......... .......... 23% 33.6M 1s 2020-02-11T16:33:03.747 INFO:tasks.workunit.client.0.smithi088.stderr: 2450K .......... .......... .......... .......... .......... 23% 33.6M 1s 2020-02-11T16:33:03.749 INFO:tasks.workunit.client.0.smithi088.stderr: 2500K .......... .......... .......... .......... .......... 24% 32.6M 1s 2020-02-11T16:33:03.750 INFO:tasks.workunit.client.0.smithi088.stderr: 2550K .......... .......... .......... .......... .......... 24% 28.6M 1s 2020-02-11T16:33:03.752 INFO:tasks.workunit.client.0.smithi088.stderr: 2600K .......... .......... .......... .......... .......... 25% 32.5M 1s 2020-02-11T16:33:03.753 INFO:tasks.workunit.client.0.smithi088.stderr: 2650K .......... .......... .......... .......... .......... 25% 32.9M 1s 2020-02-11T16:33:03.757 INFO:tasks.workunit.client.0.smithi088.stderr: 2700K .......... .......... .......... .......... .......... 26% 16.1M 0s 2020-02-11T16:33:03.759 INFO:tasks.workunit.client.0.smithi088.stderr: 2750K .......... .......... .......... .......... .......... 26% 22.9M 0s 2020-02-11T16:33:03.760 INFO:tasks.workunit.client.0.smithi088.stderr: 2800K .......... .......... .......... .......... .......... 27% 26.7M 0s 2020-02-11T16:33:03.762 INFO:tasks.workunit.client.0.smithi088.stderr: 2850K .......... .......... .......... .......... .......... 27% 22.2M 0s 2020-02-11T16:33:03.764 INFO:tasks.workunit.client.0.smithi088.stderr: 2900K .......... .......... .......... .......... .......... 28% 30.9M 0s 2020-02-11T16:33:03.766 INFO:tasks.workunit.client.0.smithi088.stderr: 2950K .......... .......... .......... .......... .......... 28% 26.9M 0s 2020-02-11T16:33:03.768 INFO:tasks.workunit.client.0.smithi088.stderr: 3000K .......... .......... .......... .......... .......... 29% 25.8M 0s 2020-02-11T16:33:03.770 INFO:tasks.workunit.client.0.smithi088.stderr: 3050K .......... .......... .......... .......... .......... 29% 29.3M 0s 2020-02-11T16:33:03.771 INFO:tasks.workunit.client.0.smithi088.stderr: 3100K .......... .......... .......... .......... .......... 30% 30.1M 0s 2020-02-11T16:33:03.773 INFO:tasks.workunit.client.0.smithi088.stderr: 3150K .......... .......... .......... .......... .......... 30% 29.8M 0s 2020-02-11T16:33:03.775 INFO:tasks.workunit.client.0.smithi088.stderr: 3200K .......... .......... .......... .......... .......... 30% 25.3M 0s 2020-02-11T16:33:03.776 INFO:tasks.workunit.client.0.smithi088.stderr: 3250K .......... .......... .......... .......... .......... 31% 28.8M 0s 2020-02-11T16:33:03.778 INFO:tasks.workunit.client.0.smithi088.stderr: 3300K .......... .......... .......... .......... .......... 31% 28.2M 0s 2020-02-11T16:33:03.780 INFO:tasks.workunit.client.0.smithi088.stderr: 3350K .......... .......... .......... .......... .......... 32% 28.4M 0s 2020-02-11T16:33:03.782 INFO:tasks.workunit.client.0.smithi088.stderr: 3400K .......... .......... .......... .......... .......... 32% 24.5M 0s 2020-02-11T16:33:03.784 INFO:tasks.workunit.client.0.smithi088.stderr: 3450K .......... .......... .......... .......... .......... 33% 21.3M 0s 2020-02-11T16:33:03.785 INFO:tasks.workunit.client.0.smithi088.stderr: 3500K .......... .......... .......... .......... .......... 33% 43.0M 0s 2020-02-11T16:33:03.786 INFO:tasks.workunit.client.0.smithi088.stderr: 3550K .......... .......... .......... .......... .......... 34% 41.5M 0s 2020-02-11T16:33:03.788 INFO:tasks.workunit.client.0.smithi088.stderr: 3600K .......... .......... .......... .......... .......... 34% 35.2M 0s 2020-02-11T16:33:03.789 INFO:tasks.workunit.client.0.smithi088.stderr: 3650K .......... .......... .......... .......... .......... 35% 40.6M 0s 2020-02-11T16:33:03.790 INFO:tasks.workunit.client.0.smithi088.stderr: 3700K .......... .......... .......... .......... .......... 35% 39.4M 0s 2020-02-11T16:33:03.792 INFO:tasks.workunit.client.0.smithi088.stderr: 3750K .......... .......... .......... .......... .......... 36% 31.3M 0s 2020-02-11T16:33:03.793 INFO:tasks.workunit.client.0.smithi088.stderr: 3800K .......... .......... .......... .......... .......... 36% 39.5M 0s 2020-02-11T16:33:03.795 INFO:tasks.workunit.client.0.smithi088.stderr: 3850K .......... .......... .......... .......... .......... 37% 25.9M 0s 2020-02-11T16:33:03.797 INFO:tasks.workunit.client.0.smithi088.stderr: 3900K .......... .......... .......... .......... .......... 37% 28.0M 0s 2020-02-11T16:33:03.799 INFO:tasks.workunit.client.0.smithi088.stderr: 3950K .......... .......... .......... .......... .......... 38% 26.2M 0s 2020-02-11T16:33:03.800 INFO:tasks.workunit.client.0.smithi088.stderr: 4000K .......... .......... .......... .......... .......... 38% 27.2M 0s 2020-02-11T16:33:03.802 INFO:tasks.workunit.client.0.smithi088.stderr: 4050K .......... .......... .......... .......... .......... 39% 36.2M 0s 2020-02-11T16:33:03.803 INFO:tasks.workunit.client.0.smithi088.stderr: 4100K .......... .......... .......... .......... .......... 39% 30.1M 0s 2020-02-11T16:33:03.805 INFO:tasks.workunit.client.0.smithi088.stderr: 4150K .......... .......... .......... .......... .......... 40% 27.2M 0s 2020-02-11T16:33:03.807 INFO:tasks.workunit.client.0.smithi088.stderr: 4200K .......... .......... .......... .......... .......... 40% 27.0M 0s 2020-02-11T16:33:03.810 INFO:tasks.workunit.client.0.smithi088.stderr: 4250K .......... .......... .......... .......... .......... 40% 30.6M 0s 2020-02-11T16:33:03.810 INFO:tasks.workunit.client.0.smithi088.stderr: 4300K .......... .......... .......... .......... .......... 41% 31.4M 0s 2020-02-11T16:33:03.812 INFO:tasks.workunit.client.0.smithi088.stderr: 4350K .......... .......... .......... .......... .......... 41% 29.6M 0s 2020-02-11T16:33:03.813 INFO:tasks.workunit.client.0.smithi088.stderr: 4400K .......... .......... .......... .......... .......... 42% 27.6M 0s 2020-02-11T16:33:03.815 INFO:tasks.workunit.client.0.smithi088.stderr: 4450K .......... .......... .......... .......... .......... 42% 28.0M 0s 2020-02-11T16:33:03.817 INFO:tasks.workunit.client.0.smithi088.stderr: 4500K .......... .......... .......... .......... .......... 43% 30.2M 0s 2020-02-11T16:33:03.818 INFO:tasks.workunit.client.0.smithi088.stderr: 4550K .......... .......... .......... .......... .......... 43% 30.6M 0s 2020-02-11T16:33:03.821 INFO:tasks.workunit.client.0.smithi088.stderr: 4600K .......... .......... .......... .......... .......... 44% 27.0M 0s 2020-02-11T16:33:03.822 INFO:tasks.workunit.client.0.smithi088.stderr: 4650K .......... .......... .......... .......... .......... 44% 24.2M 0s 2020-02-11T16:33:03.824 INFO:tasks.workunit.client.0.smithi088.stderr: 4700K .......... .......... .......... .......... .......... 45% 26.3M 0s 2020-02-11T16:33:03.826 INFO:tasks.workunit.client.0.smithi088.stderr: 4750K .......... .......... .......... .......... .......... 45% 22.3M 0s 2020-02-11T16:33:03.828 INFO:tasks.workunit.client.0.smithi088.stderr: 4800K .......... .......... .......... .......... .......... 46% 28.2M 0s 2020-02-11T16:33:03.830 INFO:tasks.workunit.client.0.smithi088.stderr: 4850K .......... .......... .......... .......... .......... 46% 38.6M 0s 2020-02-11T16:33:03.831 INFO:tasks.workunit.client.0.smithi088.stderr: 4900K .......... .......... .......... .......... .......... 47% 26.3M 0s 2020-02-11T16:33:03.833 INFO:tasks.workunit.client.0.smithi088.stderr: 4950K .......... .......... .......... .......... .......... 47% 28.3M 0s 2020-02-11T16:33:03.837 INFO:tasks.workunit.client.0.smithi088.stderr: 5000K .......... .......... .......... .......... .......... 48% 27.2M 0s 2020-02-11T16:33:03.844 INFO:tasks.workunit.client.0.smithi088.stderr: 5050K .......... .......... .......... .......... .......... 48% 28.4M 0s 2020-02-11T16:33:03.845 INFO:tasks.workunit.client.0.smithi088.stderr: 5100K .......... .......... .......... .......... .......... 49% 30.1M 0s 2020-02-11T16:33:03.845 INFO:tasks.workunit.client.0.smithi088.stderr: 5150K .......... .......... .......... .......... .......... 49% 27.1M 0s 2020-02-11T16:33:03.845 INFO:tasks.workunit.client.0.smithi088.stderr: 5200K .......... .......... .......... .......... .......... 50% 36.1M 0s 2020-02-11T16:33:03.845 INFO:tasks.workunit.client.0.smithi088.stderr: 5250K .......... .......... .......... .......... .......... 50% 26.4M 0s 2020-02-11T16:33:03.847 INFO:tasks.workunit.client.0.smithi088.stderr: 5300K .......... .......... .......... .......... .......... 51% 29.1M 0s 2020-02-11T16:33:03.847 INFO:tasks.workunit.client.0.smithi088.stderr: 5350K .......... .......... .......... .......... .......... 51% 38.7M 0s 2020-02-11T16:33:03.848 INFO:tasks.workunit.client.0.smithi088.stderr: 5400K .......... .......... .......... .......... .......... 51% 25.7M 0s 2020-02-11T16:33:03.849 INFO:tasks.workunit.client.0.smithi088.stderr: 5450K .......... .......... .......... .......... .......... 52% 31.2M 0s 2020-02-11T16:33:03.852 INFO:tasks.workunit.client.0.smithi088.stderr: 5500K .......... .......... .......... .......... .......... 52% 24.5M 0s 2020-02-11T16:33:03.853 INFO:tasks.workunit.client.0.smithi088.stderr: 5550K .......... .......... .......... .......... .......... 53% 29.0M 0s 2020-02-11T16:33:03.854 INFO:tasks.workunit.client.0.smithi088.stderr: 5600K .......... .......... .......... .......... .......... 53% 36.0M 0s 2020-02-11T16:33:03.856 INFO:tasks.workunit.client.0.smithi088.stderr: 5650K .......... .......... .......... .......... .......... 54% 26.7M 0s 2020-02-11T16:33:03.858 INFO:tasks.workunit.client.0.smithi088.stderr: 5700K .......... .......... .......... .......... .......... 54% 29.0M 0s 2020-02-11T16:33:03.860 INFO:tasks.workunit.client.0.smithi088.stderr: 5750K .......... .......... .......... .......... .......... 55% 26.7M 0s 2020-02-11T16:33:03.861 INFO:tasks.workunit.client.0.smithi088.stderr: 5800K .......... .......... .......... .......... .......... 55% 36.9M 0s 2020-02-11T16:33:03.863 INFO:tasks.workunit.client.0.smithi088.stderr: 5850K .......... .......... .......... .......... .......... 56% 24.8M 0s 2020-02-11T16:33:03.865 INFO:tasks.workunit.client.0.smithi088.stderr: 5900K .......... .......... .......... .......... .......... 56% 29.7M 0s 2020-02-11T16:33:03.869 INFO:tasks.workunit.client.0.smithi088.stderr: 5950K .......... .......... .......... .......... .......... 57% 11.7M 0s 2020-02-11T16:33:03.871 INFO:tasks.workunit.client.0.smithi088.stderr: 6000K .......... .......... .......... .......... .......... 57% 23.4M 0s 2020-02-11T16:33:03.873 INFO:tasks.workunit.client.0.smithi088.stderr: 6050K .......... .......... .......... .......... .......... 58% 21.8M 0s 2020-02-11T16:33:03.875 INFO:tasks.workunit.client.0.smithi088.stderr: 6100K .......... .......... .......... .......... .......... 58% 35.1M 0s 2020-02-11T16:33:03.876 INFO:tasks.workunit.client.0.smithi088.stderr: 6150K .......... .......... .......... .......... .......... 59% 28.3M 0s 2020-02-11T16:33:03.878 INFO:tasks.workunit.client.0.smithi088.stderr: 6200K .......... .......... .......... .......... .......... 59% 26.4M 0s 2020-02-11T16:33:03.880 INFO:tasks.workunit.client.0.smithi088.stderr: 6250K .......... .......... .......... .......... .......... 60% 29.6M 0s 2020-02-11T16:33:03.881 INFO:tasks.workunit.client.0.smithi088.stderr: 6300K .......... .......... .......... .......... .......... 60% 33.4M 0s 2020-02-11T16:33:03.884 INFO:tasks.workunit.client.0.smithi088.stderr: 6350K .......... .......... .......... .......... .......... 61% 21.2M 0s 2020-02-11T16:33:03.885 INFO:tasks.workunit.client.0.smithi088.stderr: 6400K .......... .......... .......... .......... .......... 61% 43.2M 0s 2020-02-11T16:33:03.886 INFO:tasks.workunit.client.0.smithi088.stderr: 6450K .......... .......... .......... .......... .......... 61% 29.2M 0s 2020-02-11T16:33:03.888 INFO:tasks.workunit.client.0.smithi088.stderr: 6500K .......... .......... .......... .......... .......... 62% 28.7M 0s 2020-02-11T16:33:03.890 INFO:tasks.workunit.client.0.smithi088.stderr: 6550K .......... .......... .......... .......... .......... 62% 27.9M 0s 2020-02-11T16:33:03.891 INFO:tasks.workunit.client.0.smithi088.stderr: 6600K .......... .......... .......... .......... .......... 63% 35.7M 0s 2020-02-11T16:33:03.893 INFO:tasks.workunit.client.0.smithi088.stderr: 6650K .......... .......... .......... .......... .......... 63% 25.7M 0s 2020-02-11T16:33:03.895 INFO:tasks.workunit.client.0.smithi088.stderr: 6700K .......... .......... .......... .......... .......... 64% 29.9M 0s 2020-02-11T16:33:03.896 INFO:tasks.workunit.client.0.smithi088.stderr: 6750K .......... .......... .......... .......... .......... 64% 28.6M 0s 2020-02-11T16:33:03.898 INFO:tasks.workunit.client.0.smithi088.stderr: 6800K .......... .......... .......... .......... .......... 65% 26.6M 0s 2020-02-11T16:33:03.900 INFO:tasks.workunit.client.0.smithi088.stderr: 6850K .......... .......... .......... .......... .......... 65% 38.6M 0s 2020-02-11T16:33:03.902 INFO:tasks.workunit.client.0.smithi088.stderr: 6900K .......... .......... .......... .......... .......... 66% 26.6M 0s 2020-02-11T16:33:03.903 INFO:tasks.workunit.client.0.smithi088.stderr: 6950K .......... .......... .......... .......... .......... 66% 27.7M 0s 2020-02-11T16:33:03.905 INFO:tasks.workunit.client.0.smithi088.stderr: 7000K .......... .......... .......... .......... .......... 67% 28.4M 0s 2020-02-11T16:33:03.907 INFO:tasks.workunit.client.0.smithi088.stderr: 7050K .......... .......... .......... .......... .......... 67% 32.4M 0s 2020-02-11T16:33:03.909 INFO:tasks.workunit.client.0.smithi088.stderr: 7100K .......... .......... .......... .......... .......... 68% 27.6M 0s 2020-02-11T16:33:03.910 INFO:tasks.workunit.client.0.smithi088.stderr: 7150K .......... .......... .......... .......... .......... 68% 29.8M 0s 2020-02-11T16:33:03.913 INFO:tasks.workunit.client.0.smithi088.stderr: 7200K .......... .......... .......... .......... .......... 69% 29.0M 0s 2020-02-11T16:33:03.914 INFO:tasks.workunit.client.0.smithi088.stderr: 7250K .......... .......... .......... .......... .......... 69% 26.9M 0s 2020-02-11T16:33:03.915 INFO:tasks.workunit.client.0.smithi088.stderr: 7300K .......... .......... .......... .......... .......... 70% 26.4M 0s 2020-02-11T16:33:03.917 INFO:tasks.workunit.client.0.smithi088.stderr: 7350K .......... .......... .......... .......... .......... 70% 34.3M 0s 2020-02-11T16:33:03.918 INFO:tasks.workunit.client.0.smithi088.stderr: 7400K .......... .......... .......... .......... .......... 71% 28.4M 0s 2020-02-11T16:33:03.920 INFO:tasks.workunit.client.0.smithi088.stderr: 7450K .......... .......... .......... .......... .......... 71% 25.7M 0s 2020-02-11T16:33:03.922 INFO:tasks.workunit.client.0.smithi088.stderr: 7500K .......... .......... .......... .......... .......... 71% 32.1M 0s 2020-02-11T16:33:03.923 INFO:tasks.workunit.client.0.smithi088.stderr: 7550K .......... .......... .......... .......... .......... 72% 28.8M 0s 2020-02-11T16:33:03.925 INFO:tasks.workunit.client.0.smithi088.stderr: 7600K .......... .......... .......... .......... .......... 72% 29.5M 0s 2020-02-11T16:33:03.927 INFO:tasks.workunit.client.0.smithi088.stderr: 7650K .......... .......... .......... .......... .......... 73% 25.7M 0s 2020-02-11T16:33:03.929 INFO:tasks.workunit.client.0.smithi088.stderr: 7700K .......... .......... .......... .......... .......... 73% 29.0M 0s 2020-02-11T16:33:03.933 INFO:tasks.workunit.client.0.smithi088.stderr: 7750K .......... .......... .......... .......... .......... 74% 29.4M 0s 2020-02-11T16:33:03.933 INFO:tasks.workunit.client.0.smithi088.stderr: 7800K .......... .......... .......... .......... .......... 74% 29.1M 0s 2020-02-11T16:33:03.935 INFO:tasks.workunit.client.0.smithi088.stderr: 7850K .......... .......... .......... .......... .......... 75% 24.9M 0s 2020-02-11T16:33:03.936 INFO:tasks.workunit.client.0.smithi088.stderr: 7900K .......... .......... .......... .......... .......... 75% 28.9M 0s 2020-02-11T16:33:03.938 INFO:tasks.workunit.client.0.smithi088.stderr: 7950K .......... .......... .......... .......... .......... 76% 27.9M 0s 2020-02-11T16:33:03.940 INFO:tasks.workunit.client.0.smithi088.stderr: 8000K .......... .......... .......... .......... .......... 76% 25.5M 0s 2020-02-11T16:33:03.942 INFO:tasks.workunit.client.0.smithi088.stderr: 8050K .......... .......... .......... .......... .......... 77% 27.1M 0s 2020-02-11T16:33:03.944 INFO:tasks.workunit.client.0.smithi088.stderr: 8100K .......... .......... .......... .......... .......... 77% 23.7M 0s 2020-02-11T16:33:03.946 INFO:tasks.workunit.client.0.smithi088.stderr: 8150K .......... .......... .......... .......... .......... 78% 27.1M 0s 2020-02-11T16:33:03.952 INFO:tasks.workunit.client.0.smithi088.stderr: 8200K .......... .......... .......... .......... .......... 78% 31.7M 0s 2020-02-11T16:33:03.953 INFO:tasks.workunit.client.0.smithi088.stderr: 8250K .......... .......... .......... .......... .......... 79% 34.5M 0s 2020-02-11T16:33:03.953 INFO:tasks.workunit.client.0.smithi088.stderr: 8300K .......... .......... .......... .......... .......... 79% 30.9M 0s 2020-02-11T16:33:03.953 INFO:tasks.workunit.client.0.smithi088.stderr: 8350K .......... .......... .......... .......... .......... 80% 41.9M 0s 2020-02-11T16:33:03.963 INFO:tasks.workunit.client.0.smithi088.stderr: 8400K .......... .......... .......... .......... .......... 80% 19.5M 0s 2020-02-11T16:33:03.963 INFO:tasks.workunit.client.0.smithi088.stderr: 8450K .......... .......... .......... .......... .......... 81% 30.8M 0s 2020-02-11T16:33:03.963 INFO:tasks.workunit.client.0.smithi088.stderr: 8500K .......... .......... .......... .......... .......... 81% 32.5M 0s 2020-02-11T16:33:03.963 INFO:tasks.workunit.client.0.smithi088.stderr: 8550K .......... .......... .......... .......... .......... 81% 30.9M 0s 2020-02-11T16:33:03.964 INFO:tasks.workunit.client.0.smithi088.stderr: 8600K .......... .......... .......... .......... .......... 82% 37.2M 0s 2020-02-11T16:33:03.964 INFO:tasks.workunit.client.0.smithi088.stderr: 8650K .......... .......... .......... .......... .......... 82% 25.3M 0s 2020-02-11T16:33:03.968 INFO:tasks.workunit.client.0.smithi088.stderr: 8700K .......... .......... .......... .......... .......... 83% 27.2M 0s 2020-02-11T16:33:03.968 INFO:tasks.workunit.client.0.smithi088.stderr: 8750K .......... .......... .......... .......... .......... 83% 19.7M 0s 2020-02-11T16:33:03.968 INFO:tasks.workunit.client.0.smithi088.stderr: 8800K .......... .......... .......... .......... .......... 84% 35.8M 0s 2020-02-11T16:33:03.973 INFO:tasks.workunit.client.0.smithi088.stderr: 8850K .......... .......... .......... .......... .......... 84% 35.2M 0s 2020-02-11T16:33:03.973 INFO:tasks.workunit.client.0.smithi088.stderr: 8900K .......... .......... .......... .......... .......... 85% 34.8M 0s 2020-02-11T16:33:03.973 INFO:tasks.workunit.client.0.smithi088.stderr: 8950K .......... .......... .......... .......... .......... 85% 27.5M 0s 2020-02-11T16:33:03.978 INFO:tasks.workunit.client.0.smithi088.stderr: 9000K .......... .......... .......... .......... .......... 86% 28.6M 0s 2020-02-11T16:33:03.978 INFO:tasks.workunit.client.0.smithi088.stderr: 9050K .......... .......... .......... .......... .......... 86% 30.8M 0s 2020-02-11T16:33:03.978 INFO:tasks.workunit.client.0.smithi088.stderr: 9100K .......... .......... .......... .......... .......... 87% 35.2M 0s 2020-02-11T16:33:03.982 INFO:tasks.workunit.client.0.smithi088.stderr: 9150K .......... .......... .......... .......... .......... 87% 24.4M 0s 2020-02-11T16:33:03.983 INFO:tasks.workunit.client.0.smithi088.stderr: 9200K .......... .......... .......... .......... .......... 88% 30.7M 0s 2020-02-11T16:33:03.983 INFO:tasks.workunit.client.0.smithi088.stderr: 9250K .......... .......... .......... .......... .......... 88% 28.6M 0s 2020-02-11T16:33:03.986 INFO:tasks.workunit.client.0.smithi088.stderr: 9300K .......... .......... .......... .......... .......... 89% 27.5M 0s 2020-02-11T16:33:03.986 INFO:tasks.workunit.client.0.smithi088.stderr: 9350K .......... .......... .......... .......... .......... 89% 23.3M 0s 2020-02-11T16:33:03.989 INFO:tasks.workunit.client.0.smithi088.stderr: 9400K .......... .......... .......... .......... .......... 90% 14.3M 0s 2020-02-11T16:33:03.991 INFO:tasks.workunit.client.0.smithi088.stderr: 9450K .......... .......... .......... .......... .......... 90% 25.2M 0s 2020-02-11T16:33:03.996 INFO:tasks.workunit.client.0.smithi088.stderr: 9500K .......... .......... .......... .......... .......... 91% 21.1M 0s 2020-02-11T16:33:03.996 INFO:tasks.workunit.client.0.smithi088.stderr: 9550K .......... .......... .......... .......... .......... 91% 26.1M 0s 2020-02-11T16:33:03.999 INFO:tasks.workunit.client.0.smithi088.stderr: 9600K .......... .......... .......... .......... .......... 92% 36.3M 0s 2020-02-11T16:33:03.999 INFO:tasks.workunit.client.0.smithi088.stderr: 9650K .......... .......... .......... .......... .......... 92% 23.7M 0s 2020-02-11T16:33:04.000 INFO:tasks.workunit.client.0.smithi088.stderr: 9700K .......... .......... .......... .......... .......... 92% 28.2M 0s 2020-02-11T16:33:04.002 INFO:tasks.workunit.client.0.smithi088.stderr: 9750K .......... .......... .......... .......... .......... 93% 27.8M 0s 2020-02-11T16:33:04.003 INFO:tasks.workunit.client.0.smithi088.stderr: 9800K .......... .......... .......... .......... .......... 93% 25.5M 0s 2020-02-11T16:33:04.005 INFO:tasks.workunit.client.0.smithi088.stderr: 9850K .......... .......... .......... .......... .......... 94% 34.5M 0s 2020-02-11T16:33:04.007 INFO:tasks.workunit.client.0.smithi088.stderr: 9900K .......... .......... .......... .......... .......... 94% 28.5M 0s 2020-02-11T16:33:04.008 INFO:tasks.workunit.client.0.smithi088.stderr: 9950K .......... .......... .......... .......... .......... 95% 29.3M 0s 2020-02-11T16:33:04.010 INFO:tasks.workunit.client.0.smithi088.stderr: 10000K .......... .......... .......... .......... .......... 95% 29.6M 0s 2020-02-11T16:33:04.012 INFO:tasks.workunit.client.0.smithi088.stderr: 10050K .......... .......... .......... .......... .......... 96% 26.3M 0s 2020-02-11T16:33:04.013 INFO:tasks.workunit.client.0.smithi088.stderr: 10100K .......... .......... .......... .......... .......... 96% 29.5M 0s 2020-02-11T16:33:04.015 INFO:tasks.workunit.client.0.smithi088.stderr: 10150K .......... .......... .......... .......... .......... 97% 30.8M 0s 2020-02-11T16:33:04.017 INFO:tasks.workunit.client.0.smithi088.stderr: 10200K .......... .......... .......... .......... .......... 97% 25.9M 0s 2020-02-11T16:33:04.019 INFO:tasks.workunit.client.0.smithi088.stderr: 10250K .......... .......... .......... .......... .......... 98% 28.4M 0s 2020-02-11T16:33:04.021 INFO:tasks.workunit.client.0.smithi088.stderr: 10300K .......... .......... .......... .......... .......... 98% 34.9M 0s 2020-02-11T16:33:04.022 INFO:tasks.workunit.client.0.smithi088.stderr: 10350K .......... .......... .......... .......... .......... 99% 27.2M 0s 2020-02-11T16:33:04.023 INFO:tasks.workunit.client.0.smithi088.stderr: 10400K .......... .......... .......... .......... .......... 99% 41.5M 0s 2020-02-11T16:33:04.024 INFO:tasks.workunit.client.0.smithi088.stderr: 10450K .......... .......... .......... ......... 100% 33.0M=0.4s 2020-02-11T16:33:04.024 INFO:tasks.workunit.client.0.smithi088.stderr: 2020-02-11T16:33:04.025 INFO:tasks.workunit.client.0.smithi088.stderr:2020-02-11 16:33:04 (23.0 MB/s) - ‘coreutils_8.5.orig.tar.gz’ saved [10740866/10740866] 2020-02-11T16:33:04.025 INFO:tasks.workunit.client.0.smithi088.stderr: 2020-02-11T16:33:04.049 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/ 2020-02-11T16:33:04.050 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/maint.mk 2020-02-11T16:33:04.053 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/THANKS 2020-02-11T16:33:04.055 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/ABOUT-NLS 2020-02-11T16:33:04.059 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/ 2020-02-11T16:33:04.061 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/textutils/ 2020-02-11T16:33:04.063 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/textutils/ChangeLog 2020-02-11T16:33:04.072 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/textutils/NEWS 2020-02-11T16:33:04.075 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/fileutils/ 2020-02-11T16:33:04.080 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/fileutils/ChangeLog 2020-02-11T16:33:04.089 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/fileutils/ChangeLog-1997 2020-02-11T16:33:04.096 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/fileutils/NEWS 2020-02-11T16:33:04.099 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/sh-utils/ 2020-02-11T16:33:04.101 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/sh-utils/ChangeLog 2020-02-11T16:33:04.107 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/sh-utils/NEWS 2020-02-11T16:33:04.110 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/old/sh-utils/ChangeLog.0 2020-02-11T16:33:04.113 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_prohibit_strcmp 2020-02-11T16:33:04.116 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/ 2020-02-11T16:33:04.118 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/config.rpath 2020-02-11T16:33:04.121 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/cvsu 2020-02-11T16:33:04.126 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/mdate-sh 2020-02-11T16:33:04.129 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/gitlog-to-changelog 2020-02-11T16:33:04.133 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/gnu-web-doc-update 2020-02-11T16:33:04.137 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/useless-if-before-free 2020-02-11T16:33:04.139 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/config.sub 2020-02-11T16:33:04.143 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/missing 2020-02-11T16:33:04.145 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/compile 2020-02-11T16:33:04.148 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/install-sh 2020-02-11T16:33:04.156 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/gendocs.sh 2020-02-11T16:33:04.160 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/update-copyright 2020-02-11T16:33:04.162 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/texinfo.tex 2020-02-11T16:33:04.176 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/unused-parameter.h 2020-02-11T16:33:04.178 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/c++defs.h 2020-02-11T16:33:04.179 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/config.guess 2020-02-11T16:33:04.183 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/do-release-commit-and-tag 2020-02-11T16:33:04.188 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/git-version-gen 2020-02-11T16:33:04.191 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/arg-nonnull.h 2020-02-11T16:33:04.194 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/gnupload 2020-02-11T16:33:04.195 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/warn-on-use.h 2020-02-11T16:33:04.198 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/vc-list-files 2020-02-11T16:33:04.200 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/ylwrap 2020-02-11T16:33:04.202 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/ChangeLog-2007 2020-02-11T16:33:04.210 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/announce-gen 2020-02-11T16:33:04.214 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/build-aux/depcomp 2020-02-11T16:33:04.217 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_error_message_uppercase 2020-02-11T16:33:04.219 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_obsolete_symbols 2020-02-11T16:33:04.226 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/INSTALL 2020-02-11T16:33:04.232 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/gl/ 2020-02-11T16:33:04.233 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/gl/modules/ 2020-02-11T16:33:04.235 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/gl/modules/getloadavg.diff 2020-02-11T16:33:04.237 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/configure.ac 2020-02-11T16:33:04.240 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_prohibit_tab_based_indentation 2020-02-11T16:33:04.241 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/GNUmakefile 2020-02-11T16:33:04.246 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/ChangeLog 2020-02-11T16:33:04.262 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/COPYING 2020-02-11T16:33:04.262 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/ 2020-02-11T16:33:04.264 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/closeout.m4 2020-02-11T16:33:04.266 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/dirent-safer.m4 2020-02-11T16:33:04.268 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/settime.m4 2020-02-11T16:33:04.270 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/readtokens.m4 2020-02-11T16:33:04.274 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/clock_time.m4 2020-02-11T16:33:04.276 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/config-h.m4 2020-02-11T16:33:04.282 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/euidaccess.m4 2020-02-11T16:33:04.284 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/printf-frexpl.m4 2020-02-11T16:33:04.286 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/posix-shell.m4 2020-02-11T16:33:04.288 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/servent.m4 2020-02-11T16:33:04.293 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/xstrtol.m4 2020-02-11T16:33:04.298 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mkdir-p.m4 2020-02-11T16:33:04.300 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/00gnulib.m4 2020-02-11T16:33:04.302 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mbsinit.m4 2020-02-11T16:33:04.304 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/dup2.m4 2020-02-11T16:33:04.306 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/eealloc.m4 2020-02-11T16:33:04.309 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/savewd.m4 2020-02-11T16:33:04.311 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/memrchr.m4 2020-02-11T16:33:04.315 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/d-ino.m4 2020-02-11T16:33:04.317 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/bison.m4 2020-02-11T16:33:04.322 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/isnanl.m4 2020-02-11T16:33:04.324 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/lib-ld.m4 2020-02-11T16:33:04.326 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stpcpy.m4 2020-02-11T16:33:04.331 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/progtest.m4 2020-02-11T16:33:04.334 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/unistd_h.m4 2020-02-11T16:33:04.336 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/time_h.m4 2020-02-11T16:33:04.342 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mkancesdirs.m4 2020-02-11T16:33:04.344 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/signalblocking.m4 2020-02-11T16:33:04.346 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/unlink.m4 2020-02-11T16:33:04.348 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/backupfile.m4 2020-02-11T16:33:04.350 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/remove.m4 2020-02-11T16:33:04.351 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fts.m4 2020-02-11T16:33:04.356 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/xalloc.m4 2020-02-11T16:33:04.359 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/inet_ntop.m4 2020-02-11T16:33:04.361 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/iconv_open.m4 2020-02-11T16:33:04.363 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/extensions.m4 2020-02-11T16:33:04.368 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mbrtowc.m4 2020-02-11T16:33:04.370 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/check-decl.m4 2020-02-11T16:33:04.373 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/cycle-check.m4 2020-02-11T16:33:04.375 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/signal_h.m4 2020-02-11T16:33:04.381 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sys_socket_h.m4 2020-02-11T16:33:04.383 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fprintftime.m4 2020-02-11T16:33:04.386 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/lib-check.m4 2020-02-11T16:33:04.391 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/isblank.m4 2020-02-11T16:33:04.395 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/xstrtod.m4 2020-02-11T16:33:04.397 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stdarg.m4 2020-02-11T16:33:04.399 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/selinux-selinux-h.m4 2020-02-11T16:33:04.401 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fstypename.m4 2020-02-11T16:33:04.403 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/link.m4 2020-02-11T16:33:04.408 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/md5.m4 2020-02-11T16:33:04.411 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/multiarch.m4 2020-02-11T16:33:04.418 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/ioctl.m4 2020-02-11T16:33:04.420 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/flexmember.m4 2020-02-11T16:33:04.424 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/locale-fr.m4 2020-02-11T16:33:04.427 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fdopendir.m4 2020-02-11T16:33:04.431 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/exponentf.m4 2020-02-11T16:33:04.433 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/utimecmp.m4 2020-02-11T16:33:04.435 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/human.m4 2020-02-11T16:33:04.437 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strerror.m4 2020-02-11T16:33:04.439 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/socklen.m4 2020-02-11T16:33:04.444 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/dirent_h.m4 2020-02-11T16:33:04.449 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/locale-zh.m4 2020-02-11T16:33:04.451 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getdate.m4 2020-02-11T16:33:04.456 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/cloexec.m4 2020-02-11T16:33:04.458 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/i-ring.m4 2020-02-11T16:33:04.465 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/group-member.m4 2020-02-11T16:33:04.468 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strtod.m4 2020-02-11T16:33:04.470 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/chdir-long.m4 2020-02-11T16:33:04.472 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strnlen.m4 2020-02-11T16:33:04.477 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strtoimax.m4 2020-02-11T16:33:04.482 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getgroups.m4 2020-02-11T16:33:04.486 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/yield.m4 2020-02-11T16:33:04.491 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/write.m4 2020-02-11T16:33:04.493 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/localcharset.m4 2020-02-11T16:33:04.495 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/usleep.m4 2020-02-11T16:33:04.498 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/memmove.m4 2020-02-11T16:33:04.505 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/close.m4 2020-02-11T16:33:04.509 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/memcmp.m4 2020-02-11T16:33:04.512 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/autobuild.m4 2020-02-11T16:33:04.514 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fchdir.m4 2020-02-11T16:33:04.518 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fd-reopen.m4 2020-02-11T16:33:04.520 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/jm-winsz2.m4 2020-02-11T16:33:04.522 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/posixver.m4 2020-02-11T16:33:04.529 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/locale-ja.m4 2020-02-11T16:33:04.534 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stat-prog.m4 2020-02-11T16:33:04.536 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/wint_t.m4 2020-02-11T16:33:04.538 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/st_dm_mode.m4 2020-02-11T16:33:04.540 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/tempname.m4 2020-02-11T16:33:04.545 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/frexp.m4 2020-02-11T16:33:04.547 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/dirfd.m4 2020-02-11T16:33:04.549 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sys_select_h.m4 2020-02-11T16:33:04.553 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/btowc.m4 2020-02-11T16:33:04.556 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/filenamecat.m4 2020-02-11T16:33:04.558 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/gmp.m4 2020-02-11T16:33:04.560 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/isapipe.m4 2020-02-11T16:33:04.564 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/wctype_h.m4 2020-02-11T16:33:04.569 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/ldexpl.m4 2020-02-11T16:33:04.571 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getloadavg.m4 2020-02-11T16:33:04.572 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mbchar.m4 2020-02-11T16:33:04.574 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/version-etc.m4 2020-02-11T16:33:04.577 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fcntl_h.m4 2020-02-11T16:33:04.579 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/gettime.m4 2020-02-11T16:33:04.585 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/wchar_h.m4 2020-02-11T16:33:04.588 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/vasprintf-posix.m4 2020-02-11T16:33:04.589 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/selinux-context-h.m4 2020-02-11T16:33:04.591 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getpass.m4 2020-02-11T16:33:04.593 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mempcpy.m4 2020-02-11T16:33:04.595 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/save-cwd.m4 2020-02-11T16:33:04.597 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fclose.m4 2020-02-11T16:33:04.599 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/modechange.m4 2020-02-11T16:33:04.607 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strstr.m4 2020-02-11T16:33:04.611 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getdtablesize.m4 2020-02-11T16:33:04.613 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/wchar_t.m4 2020-02-11T16:33:04.614 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mkdir.m4 2020-02-11T16:33:04.616 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/idcache.m4 2020-02-11T16:33:04.622 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/tm_gmtoff.m4 2020-02-11T16:33:04.624 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/dirname.m4 2020-02-11T16:33:04.628 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mbiter.m4 2020-02-11T16:33:04.632 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fcntl-safer.m4 2020-02-11T16:33:04.634 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/manywarnings.m4 2020-02-11T16:33:04.636 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/same.m4 2020-02-11T16:33:04.638 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getdelim.m4 2020-02-11T16:33:04.640 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mountlist.m4 2020-02-11T16:33:04.645 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/lchmod.m4 2020-02-11T16:33:04.647 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/readlink.m4 2020-02-11T16:33:04.653 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/gnu-make.m4 2020-02-11T16:33:04.656 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/thread.m4 2020-02-11T16:33:04.659 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/hostent.m4 2020-02-11T16:33:04.660 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/math_h.m4 2020-02-11T16:33:04.661 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fpending.m4 2020-02-11T16:33:04.666 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/xgetcwd.m4 2020-02-11T16:33:04.671 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/utimens.m4 2020-02-11T16:33:04.673 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/exponentd.m4 2020-02-11T16:33:04.675 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getaddrinfo.m4 2020-02-11T16:33:04.677 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sys_ioctl_h.m4 2020-02-11T16:33:04.679 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stdlib_h.m4 2020-02-11T16:33:04.683 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mgetgroups.m4 2020-02-11T16:33:04.683 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/open.m4 2020-02-11T16:33:04.688 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strpbrk.m4 2020-02-11T16:33:04.692 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/ssize_t.m4 2020-02-11T16:33:04.694 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/priv-set.m4 2020-02-11T16:33:04.698 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fcntl-o.m4 2020-02-11T16:33:04.701 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/inttostr.m4 2020-02-11T16:33:04.703 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/malloca.m4 2020-02-11T16:33:04.705 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/unlocked-io.m4 2020-02-11T16:33:04.707 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getugroups.m4 2020-02-11T16:33:04.709 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sha1.m4 2020-02-11T16:33:04.711 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fpurge.m4 2020-02-11T16:33:04.717 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/gnulib-comp.m4 2020-02-11T16:33:04.718 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/wcrtomb.m4 2020-02-11T16:33:04.720 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/putenv.m4 2020-02-11T16:33:04.722 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/lstat.m4 2020-02-11T16:33:06.875 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strsignal.m4 2020-02-11T16:33:06.879 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mbslen.m4 2020-02-11T16:33:06.886 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/inttypes.m4 2020-02-11T16:33:06.890 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stdlib-safer.m4 2020-02-11T16:33:06.893 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strtol.m4 2020-02-11T16:33:06.897 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/lib-ignore.m4 2020-02-11T16:33:06.901 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/readutmp.m4 2020-02-11T16:33:06.906 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strtoll.m4 2020-02-11T16:33:06.909 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stdbool.m4 2020-02-11T16:33:06.913 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/setenv.m4 2020-02-11T16:33:06.920 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/alloca.m4 2020-02-11T16:33:06.923 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/size_max.m4 2020-02-11T16:33:06.927 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/include_next.m4 2020-02-11T16:33:06.934 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sys_stat_h.m4 2020-02-11T16:33:06.939 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strndup.m4 2020-02-11T16:33:06.942 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/link-follow.m4 2020-02-11T16:33:06.945 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/ctype.m4 2020-02-11T16:33:06.951 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/timespec.m4 2020-02-11T16:33:06.955 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getline.m4 2020-02-11T16:33:06.957 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/calloc.m4 2020-02-11T16:33:06.960 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strftime.m4 2020-02-11T16:33:06.964 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/arpa_inet_h.m4 2020-02-11T16:33:06.967 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sig2str.m4 2020-02-11T16:33:06.973 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/printf.m4 2020-02-11T16:33:06.978 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/environ.m4 2020-02-11T16:33:06.982 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/vprintf-posix.m4 2020-02-11T16:33:06.989 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/intlmacosx.m4 2020-02-11T16:33:06.990 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/locale-tr.m4 2020-02-11T16:33:06.991 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mktime.m4 2020-02-11T16:33:06.994 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/iconv.m4 2020-02-11T16:33:07.003 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/pathmax.m4 2020-02-11T16:33:07.006 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/printf-frexp.m4 2020-02-11T16:33:07.009 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/userspec.m4 2020-02-11T16:33:07.014 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/host-os.m4 2020-02-11T16:33:07.018 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/file-type.m4 2020-02-11T16:33:07.021 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/ls-mntd-fs.m4 2020-02-11T16:33:07.024 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sha512.m4 2020-02-11T16:33:07.029 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stdio-safer.m4 2020-02-11T16:33:07.033 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/lock.m4 2020-02-11T16:33:07.037 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/c-strtod.m4 2020-02-11T16:33:07.042 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/closein.m4 2020-02-11T16:33:07.045 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/frexpl.m4 2020-02-11T16:33:07.048 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/posixtm.m4 2020-02-11T16:33:07.051 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/rmdir.m4 2020-02-11T16:33:07.063 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/chown.m4 2020-02-11T16:33:07.069 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stdint.m4 2020-02-11T16:33:07.073 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stddef_h.m4 2020-02-11T16:33:07.076 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sigaction.m4 2020-02-11T16:33:07.079 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/error.m4 2020-02-11T16:33:07.083 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/vasnprintf.m4 2020-02-11T16:33:07.087 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/utimbuf.m4 2020-02-11T16:33:07.092 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sockets.m4 2020-02-11T16:33:07.098 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/canonicalize.m4 2020-02-11T16:33:07.101 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sys_time_h.m4 2020-02-11T16:33:07.103 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/unlink-busy.m4 2020-02-11T16:33:07.109 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/gettimeofday.m4 2020-02-11T16:33:07.115 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/write-any-file.m4 2020-02-11T16:33:07.121 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strdup.m4 2020-02-11T16:33:07.126 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/regex.m4 2020-02-11T16:33:07.129 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sleep.m4 2020-02-11T16:33:07.131 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/float_h.m4 2020-02-11T16:33:07.137 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/warn-on-use.m4 2020-02-11T16:33:07.142 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/atexit.m4 2020-02-11T16:33:07.145 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getcwd-path-max.m4 2020-02-11T16:33:07.148 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fnmatch.m4 2020-02-11T16:33:07.154 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strnumcmp.m4 2020-02-11T16:33:07.157 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/gnulib-common.m4 2020-02-11T16:33:07.160 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/codeset.m4 2020-02-11T16:33:07.163 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/time_r.m4 2020-02-11T16:33:07.167 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/memcoll.m4 2020-02-11T16:33:07.171 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/string_h.m4 2020-02-11T16:33:07.174 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sys_utsname_h.m4 2020-02-11T16:33:07.180 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stdint_h.m4 2020-02-11T16:33:07.186 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/nproc.m4 2020-02-11T16:33:07.191 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/symlink.m4 2020-02-11T16:33:07.194 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/rename.m4 2020-02-11T16:33:07.198 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/read-file.m4 2020-02-11T16:33:07.201 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strtoumax.m4 2020-02-11T16:33:07.206 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getopt.m4 2020-02-11T16:33:07.209 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fopen.m4 2020-02-11T16:33:07.212 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/ungetc.m4 2020-02-11T16:33:07.216 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/xsize.m4 2020-02-11T16:33:07.222 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fflush.m4 2020-02-11T16:33:07.227 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/acl.m4 2020-02-11T16:33:07.230 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fsusage.m4 2020-02-11T16:33:07.235 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/gethrxtime.m4 2020-02-11T16:33:07.238 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/nls.m4 2020-02-11T16:33:07.241 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/lib-link.m4 2020-02-11T16:33:07.246 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mpsort.m4 2020-02-11T16:33:07.248 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/netinet_in_h.m4 2020-02-11T16:33:07.251 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fseeko.m4 2020-02-11T16:33:07.257 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/inet_pton.m4 2020-02-11T16:33:07.260 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/yesno.m4 2020-02-11T16:33:07.264 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/physmem.m4 2020-02-11T16:33:07.266 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/intmax_t.m4 2020-02-11T16:33:07.270 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/inttypes-pri.m4 2020-02-11T16:33:07.275 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/malloc.m4 2020-02-11T16:33:07.278 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/jm-winsz1.m4 2020-02-11T16:33:07.286 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/close-stream.m4 2020-02-11T16:33:07.288 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/nocrash.m4 2020-02-11T16:33:07.293 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/realloc.m4 2020-02-11T16:33:07.297 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/canon-host.m4 2020-02-11T16:33:07.300 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/memcpy.m4 2020-02-11T16:33:07.303 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/tls.m4 2020-02-11T16:33:07.310 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/perl.m4 2020-02-11T16:33:07.312 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/signbit.m4 2020-02-11T16:33:07.318 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/memchr.m4 2020-02-11T16:33:07.321 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/d-type.m4 2020-02-11T16:33:07.324 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/lchown.m4 2020-02-11T16:33:07.329 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/lib-prefix.m4 2020-02-11T16:33:07.331 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getcwd.m4 2020-02-11T16:33:07.338 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/locale_h.m4 2020-02-11T16:33:07.341 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/memxfrm.m4 2020-02-11T16:33:07.348 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mbstate_t.m4 2020-02-11T16:33:07.350 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/filemode.m4 2020-02-11T16:33:07.353 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/memset.m4 2020-02-11T16:33:07.356 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/gethostname.m4 2020-02-11T16:33:07.365 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/vasprintf.m4 2020-02-11T16:33:07.367 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/unistd-safer.m4 2020-02-11T16:33:07.370 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/xfts.m4 2020-02-11T16:33:07.373 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/uptime.m4 2020-02-11T16:33:07.376 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/prereq.m4 2020-02-11T16:33:07.381 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/symlinkat.m4 2020-02-11T16:33:07.388 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getusershell.m4 2020-02-11T16:33:07.391 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/isnand.m4 2020-02-11T16:33:07.394 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/select.m4 2020-02-11T16:33:07.398 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/wctob.m4 2020-02-11T16:33:07.402 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/double-slash-root.m4 2020-02-11T16:33:07.405 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/long-options.m4 2020-02-11T16:33:07.409 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/glibc21.m4 2020-02-11T16:33:07.412 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stat-time.m4 2020-02-11T16:33:07.416 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/rpmatch.m4 2020-02-11T16:33:07.419 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/xattr.m4 2020-02-11T16:33:07.425 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/gettext.m4 2020-02-11T16:33:07.428 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fsync.m4 2020-02-11T16:33:07.434 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/exclude.m4 2020-02-11T16:33:07.439 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/freopen.m4 2020-02-11T16:33:07.442 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strtoul.m4 2020-02-11T16:33:07.445 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/netdb_h.m4 2020-02-11T16:33:07.448 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/snprintf.m4 2020-02-11T16:33:07.451 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stpncpy.m4 2020-02-11T16:33:07.454 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/xnanosleep.m4 2020-02-11T16:33:07.457 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/warnings.m4 2020-02-11T16:33:07.463 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/lseek.m4 2020-02-11T16:33:07.466 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/hard-locale.m4 2020-02-11T16:33:07.469 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/include-exclude-prog.m4 2020-02-11T16:33:07.473 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mmap-anon.m4 2020-02-11T16:33:07.476 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mkstemp.m4 2020-02-11T16:33:07.480 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/openat.m4 2020-02-11T16:33:07.482 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mbrlen.m4 2020-02-11T16:33:07.486 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/jm-macros.m4 2020-02-11T16:33:07.489 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/ftello.m4 2020-02-11T16:33:07.494 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stdio_h.m4 2020-02-11T16:33:07.497 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/exponentl.m4 2020-02-11T16:33:07.500 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getpagesize.m4 2020-02-11T16:33:07.503 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/argmatch.m4 2020-02-11T16:33:07.508 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/perror.m4 2020-02-11T16:33:07.513 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/inline.m4 2020-02-11T16:33:07.514 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/inttypes_h.m4 2020-02-11T16:33:07.521 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/iconv_h.m4 2020-02-11T16:33:07.524 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/base64.m4 2020-02-11T16:33:07.527 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/stat.m4 2020-02-11T16:33:07.533 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/tzset.m4 2020-02-11T16:33:07.539 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/unicodeio.m4 2020-02-11T16:33:07.543 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sha256.m4 2020-02-11T16:33:07.546 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/errno_h.m4 2020-02-11T16:33:07.549 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/unlinkdir.m4 2020-02-11T16:33:07.555 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/boottime.m4 2020-02-11T16:33:07.558 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/freading.m4 2020-02-11T16:33:07.560 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mode_t.m4 2020-02-11T16:33:07.563 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getndelim2.m4 2020-02-11T16:33:07.566 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/xvasprintf.m4 2020-02-11T16:33:07.569 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mbsrtowcs.m4 2020-02-11T16:33:07.575 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/hash.m4 2020-02-11T16:33:07.580 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/safe-write.m4 2020-02-11T16:33:07.584 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/po.m4 2020-02-11T16:33:07.587 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/isnanf.m4 2020-02-11T16:33:07.590 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/longlong.m4 2020-02-11T16:33:07.594 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/xstrndup.m4 2020-02-11T16:33:07.597 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/euidaccess-stat.m4 2020-02-11T16:33:07.603 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/getcwd-abort-bug.m4 2020-02-11T16:33:07.606 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/faccessat.m4 2020-02-11T16:33:07.611 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/nanosleep.m4 2020-02-11T16:33:07.615 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/ChangeLog-2007 2020-02-11T16:33:07.623 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/utimes.m4 2020-02-11T16:33:07.626 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fileblocks.m4 2020-02-11T16:33:07.630 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/sockpfaf.m4 2020-02-11T16:33:07.632 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strtoull.m4 2020-02-11T16:33:07.638 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/assert.m4 2020-02-11T16:33:07.641 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/quotearg.m4 2020-02-11T16:33:07.644 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/uname.m4 2020-02-11T16:33:07.647 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/savedir.m4 2020-02-11T16:33:07.657 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/threadlib.m4 2020-02-11T16:33:07.660 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/langinfo_h.m4 2020-02-11T16:33:07.664 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/linkat.m4 2020-02-11T16:33:07.666 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fpieee.m4 2020-02-11T16:33:07.669 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/memcasecmp.m4 2020-02-11T16:33:07.672 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/vfprintf-posix.m4 2020-02-11T16:33:07.676 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/dos.m4 2020-02-11T16:33:07.682 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/root-dev-ino.m4 2020-02-11T16:33:07.687 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/quote.m4 2020-02-11T16:33:07.690 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/mbswidth.m4 2020-02-11T16:33:07.693 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/nl_langinfo.m4 2020-02-11T16:33:07.697 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/fcntl.m4 2020-02-11T16:33:07.701 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/strcspn.m4 2020-02-11T16:33:07.703 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/safe-read.m4 2020-02-11T16:33:07.709 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/m4/wcwidth.m4 2020-02-11T16:33:07.713 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/Makefile.am 2020-02-11T16:33:07.717 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_po_check 2020-02-11T16:33:07.718 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/dist-check.mk 2020-02-11T16:33:07.722 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_GPL_version 2020-02-11T16:33:07.727 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_unmarked_diagnostics 2020-02-11T16:33:07.733 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.prev-version 2020-02-11T16:33:07.734 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/bootstrap.conf 2020-02-11T16:33:07.738 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/ChangeLog-2005 2020-02-11T16:33:07.753 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/aclocal.m4 2020-02-11T16:33:07.756 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/AUTHORS 2020-02-11T16:33:07.758 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/cfg.mk 2020-02-11T16:33:07.760 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_file_system 2020-02-11T16:33:07.763 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.version 2020-02-11T16:33:07.765 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/TODO 2020-02-11T16:33:07.767 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_space_tab 2020-02-11T16:33:07.769 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_prohibit_empty_lines_at_EOF 2020-02-11T16:33:07.773 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/Makefile.in 2020-02-11T16:33:07.781 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/ 2020-02-11T16:33:07.787 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/cat.x 2020-02-11T16:33:07.787 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/date.x 2020-02-11T16:33:07.788 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/basename.1 2020-02-11T16:33:07.789 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/pathchk.x 2020-02-11T16:33:07.791 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tail.x 2020-02-11T16:33:07.793 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/yes.x 2020-02-11T16:33:07.795 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/pinky.1 2020-02-11T16:33:07.800 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/kill.x 2020-02-11T16:33:07.805 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/pathchk.1 2020-02-11T16:33:07.808 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sync.1 2020-02-11T16:33:07.810 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/dir.1 2020-02-11T16:33:07.814 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/mv.1 2020-02-11T16:33:07.815 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/rm.1 2020-02-11T16:33:07.818 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/dircolors.x 2020-02-11T16:33:07.820 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/rmdir.1 2020-02-11T16:33:07.823 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tty.1 2020-02-11T16:33:07.824 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/fold.x 2020-02-11T16:33:07.827 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/fold.1 2020-02-11T16:33:07.830 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/dir.x 2020-02-11T16:33:07.835 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/fmt.x 2020-02-11T16:33:07.840 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/paste.1 2020-02-11T16:33:07.843 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/chmod.x 2020-02-11T16:33:07.846 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/od.1 2020-02-11T16:33:07.848 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/ptx.x 2020-02-11T16:33:07.849 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/nice.1 2020-02-11T16:33:07.851 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/install.1 2020-02-11T16:33:07.855 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/dd.x 2020-02-11T16:33:07.856 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/cksum.1 2020-02-11T16:33:07.858 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/test.1 2020-02-11T16:33:07.863 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/chgrp.1 2020-02-11T16:33:07.863 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/unlink.1 2020-02-11T16:33:07.874 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/chmod.1 2020-02-11T16:33:07.877 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/dd.1 2020-02-11T16:33:07.880 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/du.1 2020-02-11T16:33:07.881 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tsort.1 2020-02-11T16:33:07.884 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/ls.1 2020-02-11T16:33:07.886 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/split.x 2020-02-11T16:33:07.888 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/nohup.x 2020-02-11T16:33:07.890 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sha1sum.1 2020-02-11T16:33:07.891 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tr.1 2020-02-11T16:33:07.894 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/head.x 2020-02-11T16:33:07.896 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/false.1 2020-02-11T16:33:07.899 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/pwd.x 2020-02-11T16:33:07.909 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/logname.x 2020-02-11T16:33:07.909 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/paste.x 2020-02-11T16:33:07.913 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/nl.x 2020-02-11T16:33:07.918 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sha224sum.1 2020-02-11T16:33:07.920 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/mkdir.1 2020-02-11T16:33:07.926 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/nl.1 2020-02-11T16:33:07.931 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sha256sum.1 2020-02-11T16:33:07.936 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/printf.x 2020-02-11T16:33:07.939 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/md5sum.1 2020-02-11T16:33:07.944 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/Makefile.am 2020-02-11T16:33:07.946 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/dirname.1 2020-02-11T16:33:07.948 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/shuf.x 2020-02-11T16:33:07.950 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/echo.1 2020-02-11T16:33:07.952 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/chcon.x 2020-02-11T16:33:07.957 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/chroot.1 2020-02-11T16:33:07.958 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sha384sum.x 2020-02-11T16:33:07.962 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/stdbuf.1 2020-02-11T16:33:07.967 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/users.1 2020-02-11T16:33:07.969 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/readlink.x 2020-02-11T16:33:07.973 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/cut.x 2020-02-11T16:33:07.978 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/groups.1 2020-02-11T16:33:07.981 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/seq.1 2020-02-11T16:33:07.983 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/help2man 2020-02-11T16:33:07.986 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/dirname.x 2020-02-11T16:33:07.987 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/uname.x 2020-02-11T16:33:07.989 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/uptime.x 2020-02-11T16:33:07.990 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/cut.1 2020-02-11T16:33:07.993 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/cksum.x 2020-02-11T16:33:07.998 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/nohup.1 2020-02-11T16:33:08.002 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/mv.x 2020-02-11T16:33:08.004 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sort.1 2020-02-11T16:33:08.007 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/chown.1 2020-02-11T16:33:08.011 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/pr.x 2020-02-11T16:33:08.015 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/true.x 2020-02-11T16:33:08.020 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/base64.1 2020-02-11T16:33:08.021 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/factor.1 2020-02-11T16:33:08.022 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/ln.x 2020-02-11T16:33:08.026 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/head.1 2020-02-11T16:33:08.031 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/unexpand.1 2020-02-11T16:33:08.033 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/df.x 2020-02-11T16:33:08.034 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/join.x 2020-02-11T16:33:08.038 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/du.x 2020-02-11T16:33:08.046 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/dircolors.1 2020-02-11T16:33:08.051 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/uniq.x 2020-02-11T16:33:08.055 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/split.1 2020-02-11T16:33:08.056 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tty.x 2020-02-11T16:33:08.062 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/uname.1 2020-02-11T16:33:08.063 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/uptime.1 2020-02-11T16:33:08.068 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sort.x 2020-02-11T16:33:08.070 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sha256sum.x 2020-02-11T16:33:08.073 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sha512sum.x 2020-02-11T16:33:08.081 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/nice.x 2020-02-11T16:33:08.082 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/pinky.x 2020-02-11T16:33:08.082 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/fmt.1 2020-02-11T16:33:08.085 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/expr.1 2020-02-11T16:33:08.086 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/wc.1 2020-02-11T16:33:08.090 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/true.1 2020-02-11T16:33:08.092 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/comm.x 2020-02-11T16:33:08.095 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/truncate.x 2020-02-11T16:33:08.098 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/install.x 2020-02-11T16:33:08.100 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/wc.x 2020-02-11T16:33:08.102 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/uniq.1 2020-02-11T16:33:08.104 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/arch.x 2020-02-11T16:33:08.105 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sum.x 2020-02-11T16:33:08.109 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/timeout.x 2020-02-11T16:33:08.114 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/link.x 2020-02-11T16:33:08.115 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tac.1 2020-02-11T16:33:08.122 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sync.x 2020-02-11T16:33:08.126 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/Makefile.in 2020-02-11T16:33:08.129 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/mkfifo.1 2020-02-11T16:33:08.133 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/od.x 2020-02-11T16:33:08.136 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/vdir.1 2020-02-11T16:33:08.139 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/timeout.1 2020-02-11T16:33:08.141 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/mkfifo.x 2020-02-11T16:33:08.143 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/basename.x 2020-02-11T16:33:08.147 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/expr.x 2020-02-11T16:33:08.152 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/mktemp.x 2020-02-11T16:33:08.157 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/vdir.x 2020-02-11T16:33:08.158 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/su.x 2020-02-11T16:33:08.160 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/env.1 2020-02-11T16:33:08.161 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/who.x 2020-02-11T16:33:08.162 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/hostid.1 2020-02-11T16:33:08.165 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tee.x 2020-02-11T16:33:08.168 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/rmdir.x 2020-02-11T16:33:08.170 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/hostid.x 2020-02-11T16:33:08.177 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/id.x 2020-02-11T16:33:08.181 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/unexpand.x 2020-02-11T16:33:08.183 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/pr.1 2020-02-11T16:33:08.185 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/csplit.1 2020-02-11T16:33:08.187 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/truncate.1 2020-02-11T16:33:08.192 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tee.1 2020-02-11T16:33:08.193 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/env.x 2020-02-11T16:33:08.197 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/chroot.x 2020-02-11T16:33:08.198 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/cp.x 2020-02-11T16:33:08.203 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/whoami.x 2020-02-11T16:33:08.204 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/logname.1 2020-02-11T16:33:08.205 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/mknod.1 2020-02-11T16:33:08.208 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/groups.x 2020-02-11T16:33:08.213 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/cp.1 2020-02-11T16:33:08.221 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/runcon.x 2020-02-11T16:33:08.223 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/yes.1 2020-02-11T16:33:08.226 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/stat.1 2020-02-11T16:33:08.228 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/nproc.x 2020-02-11T16:33:08.231 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/unlink.x 2020-02-11T16:33:08.236 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sha384sum.1 2020-02-11T16:33:08.241 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/nproc.1 2020-02-11T16:33:08.246 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/seq.x 2020-02-11T16:33:08.249 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sha512sum.1 2020-02-11T16:33:08.250 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/stat.x 2020-02-11T16:33:11.947 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sleep.x 2020-02-11T16:33:11.950 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/printenv.1 2020-02-11T16:33:11.953 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tr.x 2020-02-11T16:33:11.960 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tail.1 2020-02-11T16:33:11.966 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/md5sum.x 2020-02-11T16:33:11.969 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/link.1 2020-02-11T16:33:11.972 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/echo.x 2020-02-11T16:33:11.980 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/ptx.1 2020-02-11T16:33:11.982 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/factor.x 2020-02-11T16:33:11.985 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/who.1 2020-02-11T16:33:11.988 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/mktemp.1 2020-02-11T16:33:11.993 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/shred.1 2020-02-11T16:33:11.997 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/runcon.1 2020-02-11T16:33:12.003 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/stty.x 2020-02-11T16:33:12.005 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/comm.1 2020-02-11T16:33:12.011 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/shuf.1 2020-02-11T16:33:12.014 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/stty.1 2020-02-11T16:33:12.020 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/printenv.x 2020-02-11T16:33:12.023 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/join.1 2020-02-11T16:33:12.026 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/hostname.x 2020-02-11T16:33:12.030 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/ln.1 2020-02-11T16:33:12.033 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/false.x 2020-02-11T16:33:12.036 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/cat.1 2020-02-11T16:33:12.039 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/users.x 2020-02-11T16:33:12.042 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/printf.1 2020-02-11T16:33:12.049 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/ls.x 2020-02-11T16:33:12.051 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sha224sum.x 2020-02-11T16:33:12.054 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/whoami.1 2020-02-11T16:33:12.061 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/expand.1 2020-02-11T16:33:12.063 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/chgrp.x 2020-02-11T16:33:12.067 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sleep.1 2020-02-11T16:33:12.070 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/csplit.x 2020-02-11T16:33:12.073 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/pwd.1 2020-02-11T16:33:12.076 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/kill.1 2020-02-11T16:33:12.079 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/touch.x 2020-02-11T16:33:12.085 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/df.1 2020-02-11T16:33:12.090 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/stdbuf.x 2020-02-11T16:33:12.096 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/mkdir.x 2020-02-11T16:33:12.098 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/id.1 2020-02-11T16:33:12.103 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/mknod.x 2020-02-11T16:33:12.107 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sum.1 2020-02-11T16:33:12.109 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/rm.x 2020-02-11T16:33:12.112 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/date.1 2020-02-11T16:33:12.117 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/chown.x 2020-02-11T16:33:12.120 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/touch.1 2020-02-11T16:33:12.124 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tac.x 2020-02-11T16:33:12.127 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/base64.x 2020-02-11T16:33:12.133 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/tsort.x 2020-02-11T16:33:12.138 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/shred.x 2020-02-11T16:33:12.145 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/readlink.1 2020-02-11T16:33:12.148 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/sha1sum.x 2020-02-11T16:33:12.153 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/expand.x 2020-02-11T16:33:12.156 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/test.x 2020-02-11T16:33:12.159 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/man/chcon.1 2020-02-11T16:33:12.166 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.tarball-version 2020-02-11T16:33:12.169 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/NEWS 2020-02-11T16:33:12.175 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/.x-sc_sun_os_names 2020-02-11T16:33:12.176 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/bootstrap 2020-02-11T16:33:12.179 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/ 2020-02-11T16:33:12.181 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mbsalign.h 2020-02-11T16:33:12.186 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/streq.h 2020-02-11T16:33:12.188 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/asprintf.c 2020-02-11T16:33:12.190 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/strnlen1.c 2020-02-11T16:33:12.191 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/dirfd.c 2020-02-11T16:33:12.199 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/safe-write.h 2020-02-11T16:33:12.201 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/snprintf.c 2020-02-11T16:33:12.203 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mbiter.h 2020-02-11T16:33:12.205 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mountlist.c 2020-02-11T16:33:12.207 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/propername.h 2020-02-11T16:33:12.214 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/memset.c 2020-02-11T16:33:12.216 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/nproc.c 2020-02-11T16:33:12.222 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/getdelim.c 2020-02-11T16:33:12.224 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/signbitl.c 2020-02-11T16:33:12.226 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/group-member.h 2020-02-11T16:33:12.232 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/long-options.c 2020-02-11T16:33:12.234 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/fts_.h 2020-02-11T16:33:12.236 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/fts.c 2020-02-11T16:33:12.242 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/verify.h 2020-02-11T16:33:12.247 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/str-two-way.h 2020-02-11T16:33:12.249 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/areadlink.c 2020-02-11T16:33:12.254 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/c-strtod.h 2020-02-11T16:33:12.257 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/sha256.h 2020-02-11T16:33:12.260 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/stddef.in.h 2020-02-11T16:33:12.264 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/randint.c 2020-02-11T16:33:12.266 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/dup-safer.c 2020-02-11T16:33:12.268 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/getpass.h 2020-02-11T16:33:12.273 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/gettext.h 2020-02-11T16:33:12.275 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/randint.h 2020-02-11T16:33:12.277 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/stdio-write.c 2020-02-11T16:33:12.282 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xgethostname.h 2020-02-11T16:33:12.284 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/asnprintf.c 2020-02-11T16:33:12.286 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/iconv_open-solaris.gperf 2020-02-11T16:33:12.288 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/stdio-impl.h 2020-02-11T16:33:12.291 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mpsort.h 2020-02-11T16:33:12.299 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/closein.c 2020-02-11T16:33:12.301 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/hard-locale.c 2020-02-11T16:33:12.304 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/utimecmp.c 2020-02-11T16:33:12.306 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/vasnprintf.c 2020-02-11T16:33:12.316 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/chown.c 2020-02-11T16:33:12.318 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/printf-args.c 2020-02-11T16:33:12.322 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/netdb.in.h 2020-02-11T16:33:12.324 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/strnlen.c 2020-02-11T16:33:12.329 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/errno.in.h 2020-02-11T16:33:12.333 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mbslen.c 2020-02-11T16:33:12.335 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/obstack.h 2020-02-11T16:33:12.341 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/file-type.h 2020-02-11T16:33:12.343 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mbsrtowcs.c 2020-02-11T16:33:12.346 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/fnmatch_loop.c 2020-02-11T16:33:12.348 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/safe-write.c 2020-02-11T16:33:12.350 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mpsort.c 2020-02-11T16:33:12.352 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/netinet_in.in.h 2020-02-11T16:33:12.356 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xfreopen.h 2020-02-11T16:33:12.358 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/wctype.in.h 2020-02-11T16:33:12.363 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/stripslash.c 2020-02-11T16:33:12.369 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/closein.h 2020-02-11T16:33:12.371 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/memchr2.c 2020-02-11T16:33:12.374 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/memcoll.c 2020-02-11T16:33:12.376 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/malloca.h 2020-02-11T16:33:12.380 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/stpcpy.c 2020-02-11T16:33:12.382 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/striconv.c 2020-02-11T16:33:12.385 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/basename.c 2020-02-11T16:33:12.388 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/sha256.c 2020-02-11T16:33:12.391 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/stdint.in.h 2020-02-11T16:33:12.393 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/acl-internal.h 2020-02-11T16:33:12.396 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/atexit.c 2020-02-11T16:33:12.398 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/size_max.h 2020-02-11T16:33:12.403 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/buffer-lcm.h 2020-02-11T16:33:12.409 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/idcache.h 2020-02-11T16:33:12.411 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/root-dev-ino.c 2020-02-11T16:33:12.413 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/physmem.c 2020-02-11T16:33:12.417 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/glthread/ 2020-02-11T16:33:12.421 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/glthread/lock.h 2020-02-11T16:33:12.425 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/glthread/threadlib.c 2020-02-11T16:33:12.427 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/glthread/lock.c 2020-02-11T16:33:12.430 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/glthread/tls.h 2020-02-11T16:33:12.432 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/glthread/tls.c 2020-02-11T16:33:12.434 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/unistr/ 2020-02-11T16:33:12.437 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/unistr/u8-uctomb.c 2020-02-11T16:33:12.441 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/unistr/u8-uctomb-aux.c 2020-02-11T16:33:12.443 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mkancesdirs.c 2020-02-11T16:33:12.445 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/readtokens0.c 2020-02-11T16:33:12.447 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/fnmatch.in.h 2020-02-11T16:33:12.449 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/dirname.h 2020-02-11T16:33:12.452 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/regex_internal.c 2020-02-11T16:33:12.461 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/strcspn.c 2020-02-11T16:33:12.461 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/getugroups.h 2020-02-11T16:33:12.462 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/file-set.c 2020-02-11T16:33:12.464 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/sys_socket.in.h 2020-02-11T16:33:12.469 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/inttostr.h 2020-02-11T16:33:12.471 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mkdirat.c 2020-02-11T16:33:12.475 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/readtokens.h 2020-02-11T16:33:12.491 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/fd-reopen.h 2020-02-11T16:33:12.492 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/w32sock.h 2020-02-11T16:33:12.492 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/memcasecmp.c 2020-02-11T16:33:12.492 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/at-func.c 2020-02-11T16:33:12.492 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/unistd-safer.h 2020-02-11T16:33:12.494 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/filevercmp.h 2020-02-11T16:33:12.496 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/c-strcasecmp.c 2020-02-11T16:33:12.498 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/fopen-safer.c 2020-02-11T16:33:12.501 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/modechange.h 2020-02-11T16:33:12.507 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/sys_stat.in.h 2020-02-11T16:33:12.513 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/freading.c 2020-02-11T16:33:12.515 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/utimens.h 2020-02-11T16:33:12.517 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/md5.h 2020-02-11T16:33:12.521 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/isnanf.c 2020-02-11T16:33:12.523 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/sha1.c 2020-02-11T16:33:12.530 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/filenamecat-lgpl.c 2020-02-11T16:33:12.532 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/config.hin 2020-02-11T16:33:12.537 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/ignore-value.h 2020-02-11T16:33:12.542 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/strstr.c 2020-02-11T16:33:12.546 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/verror.c 2020-02-11T16:33:12.549 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/randperm.h 2020-02-11T16:33:12.551 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/vasprintf.c 2020-02-11T16:33:12.554 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/c-strncasecmp.c 2020-02-11T16:33:12.560 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/basename-lgpl.c 2020-02-11T16:33:12.561 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/human.h 2020-02-11T16:33:12.566 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/regex.h 2020-02-11T16:33:12.571 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/regcomp.c 2020-02-11T16:33:12.576 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/freadahead.c 2020-02-11T16:33:12.578 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/trim.h 2020-02-11T16:33:12.582 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/getgroups.c 2020-02-11T16:33:12.584 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xprintf.c 2020-02-11T16:33:12.587 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/euidaccess-stat.h 2020-02-11T16:33:12.588 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/rand-isaac.h 2020-02-11T16:33:12.590 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mgetgroups.h 2020-02-11T16:33:12.593 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/selinux-at.h 2020-02-11T16:33:12.596 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/iconv_open-solaris.h 2020-02-11T16:33:12.598 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/setenv.c 2020-02-11T16:33:12.604 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/locale.in.h 2020-02-11T16:33:12.610 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/base64.h 2020-02-11T16:33:12.611 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/open-safer.c 2020-02-11T16:33:12.613 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/exitfail.c 2020-02-11T16:33:12.615 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/closeout.h 2020-02-11T16:33:12.618 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/idcache.c 2020-02-11T16:33:12.620 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/unlink.c 2020-02-11T16:33:12.624 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xfts.c 2020-02-11T16:33:12.634 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/memrchr.c 2020-02-11T16:33:12.716 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/Makefile.am 2020-02-11T16:33:12.717 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xstrtol.h 2020-02-11T16:33:12.719 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/gettimeofday.c 2020-02-11T16:33:12.721 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/isnanf-nolibm.h 2020-02-11T16:33:12.723 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/chdir-long.c 2020-02-11T16:33:12.726 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mbchar.c 2020-02-11T16:33:12.727 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/canon-host.h 2020-02-11T16:33:12.730 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/unsetenv.c 2020-02-11T16:33:12.732 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/freadseek.c 2020-02-11T16:33:12.735 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xnanosleep.c 2020-02-11T16:33:12.738 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/nanosleep.c 2020-02-11T16:33:12.741 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/ctype.in.h 2020-02-11T16:33:12.745 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xmalloc.c 2020-02-11T16:33:12.748 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/strtoul.c 2020-02-11T16:33:12.750 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/sha512.h 2020-02-11T16:33:12.752 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/dirchownmod.h 2020-02-11T16:33:12.756 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/freadptr.h 2020-02-11T16:33:12.758 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/getfilecon.c 2020-02-11T16:33:12.764 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/alignof.h 2020-02-11T16:33:12.766 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mempcpy.c 2020-02-11T16:33:12.771 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/savedir.h 2020-02-11T16:33:16.947 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/areadlink-with-size.c 2020-02-11T16:33:16.949 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/inttypes.in.h 2020-02-11T16:33:16.954 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/config.charset 2020-02-11T16:33:16.960 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xstrtold.c 2020-02-11T16:33:16.963 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/fcntl-safer.h 2020-02-11T16:33:16.966 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xstrndup.c 2020-02-11T16:33:16.972 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/write.c 2020-02-11T16:33:16.974 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/math.in.h 2020-02-11T16:33:16.978 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/openat-priv.h 2020-02-11T16:33:16.981 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/vasnprintf.h 2020-02-11T16:33:16.988 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/getcwd.c 2020-02-11T16:33:16.992 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/stdbool.in.h 2020-02-11T16:33:16.995 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/strtol.c 2020-02-11T16:33:17.001 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/argmatch.c 2020-02-11T16:33:17.004 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/acl_entries.c 2020-02-11T16:33:17.009 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/progname.c 2020-02-11T16:33:17.015 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/mktime-internal.h 2020-02-11T16:33:17.018 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/printf-frexpl.c 2020-02-11T16:33:17.021 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/offtostr.c 2020-02-11T16:33:17.025 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/memchr2.h 2020-02-11T16:33:17.035 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xstrtoumax.c 2020-02-11T16:33:17.037 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/getdate.y 2020-02-11T16:33:17.041 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/close-hook.h 2020-02-11T16:33:17.047 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/printf-parse.c 2020-02-11T16:33:17.051 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/isnand.c 2020-02-11T16:33:17.058 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/timespec.h 2020-02-11T16:33:17.060 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/getusershell.c 2020-02-11T16:33:17.064 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xstrtod.c 2020-02-11T16:33:17.070 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/verror.h 2020-02-11T16:33:17.074 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/same.c 2020-02-11T16:33:17.078 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/quote.c 2020-02-11T16:33:17.082 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/raise.c 2020-02-11T16:33:17.083 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/link.c 2020-02-11T16:33:17.087 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/cloexec.h 2020-02-11T16:33:17.090 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/sys_utsname.in.h 2020-02-11T16:33:17.096 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/cloexec.c 2020-02-11T16:33:17.100 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/vfprintf.c 2020-02-11T16:33:17.102 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/uniwidth/ 2020-02-11T16:33:17.105 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/uniwidth/cjk.h 2020-02-11T16:33:17.107 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/uniwidth/width.c 2020-02-11T16:33:17.112 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/strtoull.c 2020-02-11T16:33:17.113 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/opendir-safer.c 2020-02-11T16:33:17.120 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/hash-pjw.h 2020-02-11T16:33:17.124 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/uname.c 2020-02-11T16:33:17.128 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/full-read.c 2020-02-11T16:33:17.132 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/priv-set.h 2020-02-11T16:33:17.136 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/close.c 2020-02-11T16:33:17.138 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/fpending.h 2020-02-11T16:33:17.144 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/i-ring.h 2020-02-11T16:33:17.148 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/nl_langinfo.c 2020-02-11T16:33:17.154 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xmemxfrm.h 2020-02-11T16:33:17.156 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/c-strcase.h 2020-02-11T16:33:17.159 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/fchdir.c 2020-02-11T16:33:17.163 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/canon-host.c 2020-02-11T16:33:17.182 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/signbitf.c 2020-02-11T16:33:17.182 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xnanosleep.h 2020-02-11T16:33:17.182 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/tempname.c 2020-02-11T16:33:17.182 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xreadlink.c 2020-02-11T16:33:17.183 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/xgetcwd.h 2020-02-11T16:33:17.186 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/regex.c 2020-02-11T16:33:17.194 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/diacrit.h 2020-02-11T16:33:17.199 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/posixver.c 2020-02-11T16:33:17.206 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/getugroups.c 2020-02-11T16:33:17.208 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/readutmp.h 2020-02-11T16:33:17.213 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/quote.h 2020-02-11T16:33:17.216 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/quotearg.c 2020-02-11T16:33:17.220 INFO:tasks.workunit.client.0.smithi088.stdout:coreutils-8.5/lib/filevercmp.c 2020-02-11T16:33:17.221 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-02-11T16:33:17.221 DEBUG:teuthology.task.console_log:Killing console logger for smithi052 2020-02-11T16:33:17.222 DEBUG:teuthology.task.console_log:Killing console logger for smithi088 2020-02-11T16:33:17.222 DEBUG:teuthology.task.console_log:Killing console logger for smithi052 2020-02-11T16:33:17.222 DEBUG:teuthology.task.console_log:Killing console logger for smithi088 2020-02-11T16:33:17.222 DEBUG:teuthology.exit:Finished running handlers